-- Logs begin at Thu 2022-10-27 18:03:20 UTC, end at Thu 2022-10-27 20:29:02 UTC. -- Oct 27 18:34:21.826270 n-d-860687-3 systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 18:34:21.835086 n-d-860687-3 devstack@n-api.service[111205]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 18:34:21.837119 n-d-860687-3 devstack@n-api.service[111205]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 18:34:21 2022] *** Oct 27 18:34:21.837119 n-d-860687-3 devstack@n-api.service[111205]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 18:34:21.837119 n-d-860687-3 devstack@n-api.service[111205]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 18:34:21.837119 n-d-860687-3 devstack@n-api.service[111205]: nodename: n-d-860687-3 Oct 27 18:34:21.837119 n-d-860687-3 devstack@n-api.service[111205]: machine: x86_64 Oct 27 18:34:21.837119 n-d-860687-3 devstack@n-api.service[111205]: clock source: unix Oct 27 18:34:21.837119 n-d-860687-3 devstack@n-api.service[111205]: pcre jit disabled Oct 27 18:34:21.837119 n-d-860687-3 devstack@n-api.service[111205]: detected number of CPU cores: 4 Oct 27 18:34:21.837119 n-d-860687-3 devstack@n-api.service[111205]: current working directory: / Oct 27 18:34:21.837119 n-d-860687-3 devstack@n-api.service[111205]: detected binary path: /usr/bin/uwsgi-core Oct 27 18:34:21.837119 n-d-860687-3 devstack@n-api.service[111205]: your processes number limit is 47680 Oct 27 18:34:21.837119 n-d-860687-3 devstack@n-api.service[111205]: your memory page size is 4096 bytes Oct 27 18:34:21.837119 n-d-860687-3 devstack@n-api.service[111205]: detected max file descriptor number: 2048 Oct 27 18:34:21.837119 n-d-860687-3 devstack@n-api.service[111205]: lock engine: pthread robust mutexes Oct 27 18:34:21.838076 n-d-860687-3 devstack@n-api.service[111205]: thunder lock: enabled Oct 27 18:34:21.838076 n-d-860687-3 devstack@n-api.service[111205]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 18:34:21.838076 n-d-860687-3 devstack@n-api.service[111205]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 18:34:21.876620 n-d-860687-3 devstack@n-api.service[111205]: Python main interpreter initialized at 0x55866798b9c0 Oct 27 18:34:21.876620 n-d-860687-3 devstack@n-api.service[111205]: python threads support enabled Oct 27 18:34:21.876620 n-d-860687-3 devstack@n-api.service[111205]: your server socket listen backlog is limited to 100 connections Oct 27 18:34:21.876620 n-d-860687-3 devstack@n-api.service[111205]: your mercy for graceful operations on workers is 90 seconds Oct 27 18:34:21.876969 n-d-860687-3 devstack@n-api.service[111205]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 18:34:21.877050 n-d-860687-3 devstack@n-api.service[111205]: *** Operational MODE: preforking *** Oct 27 18:34:21.877280 n-d-860687-3 devstack@n-api.service[111205]: *** uWSGI is running in multiple interpreter mode *** Oct 27 18:34:21.877280 n-d-860687-3 devstack@n-api.service[111205]: spawned uWSGI master process (pid: 111205) Oct 27 18:34:21.877467 n-d-860687-3 systemd[1]: Started Devstack devstack@n-api.service. Oct 27 18:34:21.878058 n-d-860687-3 devstack@n-api.service[111205]: spawned uWSGI worker 1 (pid: 111206, cores: 1) Oct 27 18:34:21.879384 n-d-860687-3 devstack@n-api.service[111205]: spawned uWSGI worker 2 (pid: 111207, cores: 1) Oct 27 18:34:21.879384 n-d-860687-3 devstack@n-api.service[111205]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 18:34:22.535280 n-d-860687-3 devstack@n-api.service[111206]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 18:34:22.535886 n-d-860687-3 devstack@n-api.service[111207]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 18:34:23.609542 n-d-860687-3 devstack@n-api.service[111206]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 18:34:23.609542 n-d-860687-3 devstack@n-api.service[111206]: from cryptography.utils import int_from_bytes Oct 27 18:34:23.610101 n-d-860687-3 devstack@n-api.service[111206]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 18:34:23.610101 n-d-860687-3 devstack@n-api.service[111206]: from cryptography.utils import int_from_bytes Oct 27 18:34:23.612490 n-d-860687-3 devstack@n-api.service[111207]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 18:34:23.612490 n-d-860687-3 devstack@n-api.service[111207]: from cryptography.utils import int_from_bytes Oct 27 18:34:23.612910 n-d-860687-3 devstack@n-api.service[111207]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 18:34:23.612910 n-d-860687-3 devstack@n-api.service[111207]: from cryptography.utils import int_from_bytes Oct 27 18:34:26.107169 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 18:34:26.107737 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 18:34:26.108089 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 18:34:26.108196 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 18:34:26.108280 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 18:34:26.108360 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 18:34:26.108436 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 18:34:26.108529 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 18:34:26.108609 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 18:34:26.108687 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 18:34:26.108885 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.108996 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.109207 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.109318 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.109588 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.109677 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.109907 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.109996 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.110236 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.110330 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.110569 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.110696 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.110885 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.110974 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.111198 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.111292 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.111518 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.111605 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.111771 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.111859 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.112080 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.112178 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.112403 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860687-3 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.112489 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860687-3 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.112722 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.112807 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.113023 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.113110 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.113328 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.113414 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.113640 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.113726 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.113942 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.114041 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.114256 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.114364 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.114577 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.114677 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.115058 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.115161 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.115611 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.115721 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.115825 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.115929 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.116087 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.116203 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.116414 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.116536 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.116733 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.116874 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.117029 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.117145 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.117343 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.117444 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.117646 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.117753 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.117961 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.118053 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.118261 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.118346 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.118674 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860687-3 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.118773 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860687-3 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.118985 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.119078 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.119292 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.119384 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.119596 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.119678 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.119998 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.120099 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.120305 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.120405 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.121098 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.121606 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.121606 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.121781 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.121781 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.121939 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.122016 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.122091 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.122342 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.122467 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.122684 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.122785 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.122994 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.123078 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.123307 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.123393 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.123603 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.123688 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.123903 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.124002 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.124208 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.124301 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.124518 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.124606 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.124818 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.124918 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.125117 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.125215 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.125360 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.125442 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.125659 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.125741 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.125977 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.126069 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.126289 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.126372 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.126626 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.126802 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.126885 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.126963 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.127105 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.127192 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.127416 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.127505 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.127734 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.127826 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.128035 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.128118 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.128338 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.128430 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.128639 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.128730 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.128939 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.129022 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.129238 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.129331 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.129535 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.129618 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.129834 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.129928 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.130134 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.130219 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.130467 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.130557 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.130778 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.130878 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.131092 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.131176 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.131395 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.131479 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.131707 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.131800 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.132099 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.132182 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.132342 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.132426 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.132644 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.132737 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.132976 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.133060 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.133289 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.133372 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.133590 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.133676 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.133904 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.133987 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.134217 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.134309 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.134540 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.134637 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.134842 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.134926 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.135199 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.135297 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.135453 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.135540 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.135785 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.135876 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.136087 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.136173 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.136892 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.137428 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.137518 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.137596 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.137672 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.137763 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.137842 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.137919 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.138076 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.138197 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.138377 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.138533 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.138700 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.138843 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.138998 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.139147 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.139300 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.139457 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.139601 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.139764 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.139902 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.140070 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.140201 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.140378 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.140500 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.140683 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.140802 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.140990 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.141101 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.141295 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.141387 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.141601 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.141685 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.141907 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.142000 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.142213 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.142304 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.142555 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.142641 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.142878 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.142974 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.143175 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.143268 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.143474 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.143560 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.143774 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.143859 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.144077 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.144168 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.144375 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.144469 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.144673 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.144764 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.144978 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.145063 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.145283 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.145401 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.145581 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.145687 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.145887 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.145979 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.146186 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.146277 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.146521 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.146691 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.146827 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.146984 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.147144 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.147282 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.147445 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.147584 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.147749 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.147894 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.148066 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.148195 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.148373 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.148496 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.148678 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.148794 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.148980 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.149091 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.149283 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.149389 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.149583 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.149688 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.149885 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.149970 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.150187 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.150273 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.150512 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.150598 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.150813 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.150897 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.151127 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.151221 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.151445 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.151529 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.151743 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.151833 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.152175 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.152562 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.152562 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.152712 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.152792 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:34:26.152880 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.152994 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.153079 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.153324 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.153408 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.153629 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.153791 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.153956 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.154041 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.154280 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.154459 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.154618 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.154713 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.154927 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.155015 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.155233 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.155317 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.155547 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.155634 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.155853 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.155944 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.156210 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.156305 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.156461 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.156547 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.156768 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.156853 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.157078 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.157208 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.157390 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.157482 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.157700 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.157786 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.158009 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.158093 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.158319 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.158424 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.158646 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.158730 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.158956 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.159038 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.159271 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.159357 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.159581 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.159664 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.160157 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.160251 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.160467 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.160552 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.160804 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.160889 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.161110 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.161195 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.161426 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.161513 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.161740 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.161824 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.162046 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.162139 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.162350 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.162482 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.162677 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.162762 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.162985 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.163081 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.163302 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.163385 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.163608 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.163699 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.163918 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.164014 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.164219 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.164309 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.164532 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.164622 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.164836 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.164928 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.165140 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.165224 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.165448 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.165578 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.165754 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.165838 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.166060 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.166142 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.166370 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.166485 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.166710 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.166802 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.167029 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.167113 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.167339 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.167434 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.167726 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.168195 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.168289 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.168369 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.168447 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.168575 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.168672 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.168891 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.168977 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.169190 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.169274 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.169491 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.169584 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.169791 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.169876 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.170095 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.170178 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.170427 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.170516 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.170727 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.170814 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.171032 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.171119 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.171338 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.171430 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.171662 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.171745 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.171963 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.172045 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.172271 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.172365 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.172576 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.172660 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.172881 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.172965 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.173184 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.173270 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.173489 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.173580 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.173792 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.173884 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.174091 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.174173 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.174419 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.174506 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.174728 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.174824 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.175029 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.175114 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.175347 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.175431 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.175652 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.175744 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.175954 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.176047 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.176263 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.176355 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.176568 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.176738 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.176872 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.176956 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.177179 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.177270 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.177486 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.177572 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.177795 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.177881 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.178101 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.178184 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.178429 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.178518 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.178758 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.178844 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.179070 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.179154 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.179370 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.179455 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.179689 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.179773 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.180009 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.180094 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.180321 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.180406 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.180623 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.180718 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.180931 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.181032 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.181231 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.181316 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.181531 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.181615 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.181831 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.181924 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.182132 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.182216 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.182454 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.182543 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.182757 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.182853 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.183056 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.183657 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.183944 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.184340 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.184340 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.184495 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.184606 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.184727 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.184912 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.185035 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.185237 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.185332 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.185546 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.185630 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.185851 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.185935 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.186154 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.186240 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.186486 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.186576 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.186830 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.186918 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.187133 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.187219 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.187473 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.187558 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.187803 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.187887 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.188110 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.188194 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.188422 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.188506 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.188728 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.188821 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.189034 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.189161 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.189340 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.189432 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.189647 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.189738 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.189955 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.190047 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.190259 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.190342 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.190600 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.190703 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.190942 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.191080 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.191217 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.191302 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.191521 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.191615 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.191839 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.191923 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.192144 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.192235 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.192456 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.192541 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.192756 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.192846 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.193070 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.193154 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.193405 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.193491 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.193721 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.193804 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.194028 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.194113 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.194341 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.194447 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.194669 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.194755 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.194978 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.195068 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.195282 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.195369 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.195587 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.195670 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.195893 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.195976 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.196203 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.196287 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.196516 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.196600 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.196821 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.196913 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.197136 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.197221 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.197440 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.197523 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.197756 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.197850 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.198057 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.198141 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.198368 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.198511 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.198695 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.198838 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.199401 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.199498 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.199498 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.199642 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.199800 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.199896 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.200120 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.200205 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.200428 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.200522 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.200736 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.200822 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.201042 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.201127 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.201344 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.201429 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.201647 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.201734 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.201948 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.202031 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.202251 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.202342 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.202581 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.202669 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.202888 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.202976 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.203189 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.203273 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.203493 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.203578 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.203798 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.203882 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.204096 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.204190 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.204395 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.204481 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.204696 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.204781 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.204999 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.205093 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.205300 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.205390 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.205615 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.205700 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.205920 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.206079 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.206223 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.206306 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.206543 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.206630 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.206861 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.206959 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.207163 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.207246 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.207457 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.207541 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.207756 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.207850 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.208054 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.208146 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.208353 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.208437 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.208653 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.208746 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.208968 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.209081 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.209284 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.209375 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.209580 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.209674 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.209888 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.209980 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.210196 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.210289 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.210524 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.210629 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.210836 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.210928 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.211144 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.211247 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.211452 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.211548 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.211771 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.211858 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.212077 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.212170 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.212382 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.212474 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.212683 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.212775 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.212987 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.213079 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.213294 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.213379 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.213597 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.213679 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.213900 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.213995 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.214207 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.214330 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.215049 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.215510 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.215510 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.215677 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.215798 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.215892 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.216109 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.216423 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.216517 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.216841 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.216985 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.217153 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.217315 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.217469 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.217627 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.217809 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.217944 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.218125 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.218286 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.218482 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.218628 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.218783 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.218956 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.219092 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.219283 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.219368 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.219594 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.219686 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.219897 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.219984 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.220204 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.220290 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.220509 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.220594 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.220814 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.220903 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.221108 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.221192 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.221408 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.221493 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.221706 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.221791 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.222004 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.222087 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.222302 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.222405 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.222623 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.222712 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.222922 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.223008 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.223223 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.223316 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.223519 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.223612 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.223825 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.223910 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.224124 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.224219 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.224431 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.224515 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.224731 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.224815 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.225029 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.225128 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.225327 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.225422 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.225624 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.225709 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.225922 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.226019 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.226225 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.226323 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.226585 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.226672 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.226891 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.226976 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.227223 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.227315 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.227523 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.227606 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.227825 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.227952 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.228142 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.228235 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.228442 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.228527 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.228741 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.228827 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.229037 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.229122 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.229340 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.229434 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.229643 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.229738 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.229939 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.230083 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.230356 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.230942 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.231032 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.231110 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.231187 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.231265 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.231342 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.231431 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.231537 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.231648 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.231842 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.231956 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.232141 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.232256 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.232524 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.232656 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.232762 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.232885 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.233032 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.233143 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.233337 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.233442 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.233640 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.233747 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.233941 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.234051 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.234247 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.234351 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.234583 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.234669 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.234886 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.234973 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.235195 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.235316 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.235496 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.235581 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.235808 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.235897 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.236110 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.236195 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.236412 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.236509 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.236713 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.236797 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.237011 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.237097 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.237314 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.237406 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.237614 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.237699 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.237909 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.238002 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.238207 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.238303 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.238532 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.238637 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.238833 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.238917 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.239127 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.239220 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.239428 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.239512 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.239729 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.239815 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.240036 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.240122 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.240335 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.240419 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.240640 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.240726 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.240938 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.241031 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.241236 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.241321 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.241534 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.241624 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.241832 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.241926 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.242129 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.242214 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.242444 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.242534 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.242743 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.242830 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.243042 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.243133 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.243340 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.243433 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.243639 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.243723 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.243942 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.244026 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.244236 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.244330 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.244535 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.244620 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.244831 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.244915 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.245130 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.245222 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.245429 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.245516 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.246150 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.246257 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.246336 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.246460 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.246537 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.246614 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.246791 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.246885 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.247105 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.247191 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.247410 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.247493 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.247717 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.247809 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.248015 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.248100 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.248324 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.248407 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.248626 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.248709 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.248934 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.249019 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.249235 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.249318 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.249534 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.249618 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.249837 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.249930 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.250141 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.250225 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.250468 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.250555 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.250782 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.250868 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.251092 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.251178 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.251407 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.251500 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.251707 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.251792 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.252026 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.252116 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.252330 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.252425 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.252629 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.252713 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.252934 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.253018 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.253235 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.253327 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.253540 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.253623 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.253842 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.253932 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.254146 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.254242 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.254472 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.254558 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.254778 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.254874 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.255081 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.255169 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.255384 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.255527 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.255686 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.255771 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.255986 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.256077 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.256292 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.256389 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.256594 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.256684 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.256890 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.256975 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.257196 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.257290 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.257495 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.257580 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.257801 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.257885 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.258096 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.258179 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.258424 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.258590 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.258733 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.258817 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.259118 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.259201 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.259416 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.259530 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.259722 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.259815 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.260024 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.260117 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.260329 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.260428 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.260634 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.260716 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.260933 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.261019 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.261742 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.262275 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.262466 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.262565 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.262646 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.262723 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.262809 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.262888 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.263060 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.263176 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.263368 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.263461 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.263669 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.263756 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.263969 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.264055 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.264275 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.264367 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.264595 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.264681 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.264896 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.264981 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.265199 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.265291 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.265501 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.265628 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.265812 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.265907 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.266109 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.266207 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.266449 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.266539 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.266837 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.266920 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.267161 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.267258 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.267465 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.267553 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.267831 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.267917 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.268149 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.268298 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.268465 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.268562 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.268782 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.268867 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.269082 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.269174 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.269389 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.269552 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.269694 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.269781 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.270003 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.270096 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.270310 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.270418 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.270636 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.270720 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.270945 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.271030 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.271245 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.271332 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.271553 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.271637 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.271857 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.271950 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.272160 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.272253 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.272475 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.272568 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.272782 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.272867 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.273101 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.273187 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.273474 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.273558 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.273790 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.273876 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.274109 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.274196 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.274444 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.274534 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.274734 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.274835 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.275040 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.275127 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.275339 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.275424 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.275637 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.275786 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.275938 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.276023 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.276237 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.276320 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.276547 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.276641 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.276864 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.277436 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.277546 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.277627 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.277705 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.277796 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.277887 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.277967 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.278077 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.278218 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.278376 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.278523 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.278794 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.278892 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.279097 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.279185 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.279415 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.279501 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.279731 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.279857 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.280030 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.280119 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.280346 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.280441 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.280646 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.280738 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.280941 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.281033 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.281240 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.281333 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.281536 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.281630 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.281834 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.281937 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.282134 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.282228 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.282475 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.282583 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.282790 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.282900 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.283108 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.283193 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.283415 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.283501 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.283741 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.283836 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.284049 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.284134 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.284359 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.284450 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.284663 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.285026 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.285236 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.285321 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.285551 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.285636 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.285850 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.285937 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.286148 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.286233 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.286475 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.286566 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.286775 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.286862 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.287071 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.287155 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.287368 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.287452 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.287668 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.287754 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.287964 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.288049 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.288260 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.288345 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.288559 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.288646 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.288857 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.288940 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.289169 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.289265 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.289469 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.289555 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.289770 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.289861 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.290065 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.290170 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.290362 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.290493 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.290680 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.290766 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.290985 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.291122 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.291288 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.291373 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.291606 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.291697 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.291912 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.292007 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.292232 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.292317 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.293061 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.293608 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.293723 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.293805 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.293883 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.293961 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.294045 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.294125 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.294257 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.294352 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.294586 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.294674 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.294896 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.294981 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.295200 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.295294 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.295509 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.295601 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.295814 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.295939 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.296124 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.296211 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.296435 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.296637 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.296751 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.296971 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.297272 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.297359 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.297579 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.297671 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.297888 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.297984 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.298196 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.298281 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.298524 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.298631 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.298835 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.298995 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.299140 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.299226 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.299445 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.299529 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.299748 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.299834 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.300054 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.300146 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.300363 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.300463 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.300682 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.300768 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.300999 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.301091 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.301311 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.301396 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.301621 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.301715 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.301931 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.302017 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.302241 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.302335 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.302597 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.302684 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.302909 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.302997 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.303262 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.303359 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.303570 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.303654 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.303872 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.303956 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.304179 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.304265 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.304484 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.304569 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.304789 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.304881 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.305094 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.305179 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.305397 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.305483 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.305702 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.305786 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.306001 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.306139 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.306307 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.306638 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.306948 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.307036 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.307400 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.307573 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.307736 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.307898 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.308075 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.308320 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.308821 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.308954 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.309021 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.310464 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.310567 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.310659 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.310733 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.310800 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.310876 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.310945 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.311022 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.311099 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.311099 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.311220 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.311295 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.311363 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.311438 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.311515 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.311624 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.311729 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.311937 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.312016 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.312260 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.312348 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.312565 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.312651 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.312869 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.312954 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.313179 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.313266 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.313485 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.313570 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.313789 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.313884 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.314105 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.314189 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.314433 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.314662 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.314746 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.314882 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.315041 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.315201 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.315350 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.315507 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.315880 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.316034 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.316225 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.316378 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.316539 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.316696 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.316863 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.317021 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.317191 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.317342 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.317509 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.317656 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.317816 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.317960 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.318135 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.318278 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.318472 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.318607 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.318778 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.318911 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.319092 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.319229 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.319401 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.319515 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.319705 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.319815 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.320008 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.320104 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.320317 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.320413 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.320621 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.320716 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.320924 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.321009 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.321230 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.321325 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.321530 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.321616 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.321853 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.321946 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.322157 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.322251 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.322478 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.322568 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.322781 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.322878 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.323087 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.323181 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.323385 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.323476 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.323683 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.324271 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.324767 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.324876 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.324959 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.325038 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.325115 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.325192 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.325356 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.325444 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.325659 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.325744 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.325956 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.326040 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.326262 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.326348 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.326635 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.326722 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.326939 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.327025 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.327242 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.327328 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.327560 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.327644 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.327860 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.327944 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.328158 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.328251 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.328470 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.328564 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.328775 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.328919 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.329089 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.329174 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.329395 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.329484 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.329699 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.329794 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.330035 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.330120 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.330345 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.330487 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.330891 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.330989 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.331220 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.331314 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.331534 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.331686 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.331863 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.331959 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.332185 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.332273 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.332486 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.332571 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.332788 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.332874 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.333086 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.333170 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.333405 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.333490 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.333712 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.333807 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.334019 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.334105 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.334321 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.334432 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.334654 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.334744 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.334957 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.335041 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.335260 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.335356 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.335563 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.335649 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.335868 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.335953 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.336171 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.336269 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.336477 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.336566 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.336778 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.336863 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.337082 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.337175 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.337382 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.337465 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.337684 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.337768 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.337989 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.338081 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.338322 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.338424 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.338663 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.338749 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.338976 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.339062 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.339286 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.339431 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.339907 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.339999 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.340091 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.340172 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.340250 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.340340 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.340519 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.340614 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.340821 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.340909 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.341129 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.341214 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.341451 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.341549 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.341759 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.341846 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.342057 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.342144 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.342749 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.342854 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.343065 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.343153 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.343386 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.343472 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.343707 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.343794 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.344015 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.344107 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.344335 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.344420 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.344654 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.344749 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.344961 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.345053 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.345278 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.345372 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.345584 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.345677 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.345908 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.345993 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.346238 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.346330 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.346591 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.346679 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.346913 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.346999 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.347216 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.347314 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.347516 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.347642 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.347818 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.347903 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.348122 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.348216 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.348437 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.348530 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.348739 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.348834 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.349039 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.349133 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.349336 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.349421 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.349638 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.349723 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.349935 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.350027 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.350231 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.350317 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.350556 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.350643 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.350856 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.350946 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.351159 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.351244 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.351456 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.351541 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.351754 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.351847 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.352051 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.352137 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.352350 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.352441 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.352645 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.352740 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.352943 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.353028 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.353245 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.353338 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.353541 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.353629 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.353840 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.353931 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.354135 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.354229 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.354455 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.354543 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.354752 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.354836 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.355616 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.356781 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.356878 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.356959 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.357038 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.357116 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.357238 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.357339 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.357421 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.357506 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.357587 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.357665 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.357741 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.357808 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.357892 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.357971 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.358129 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.358215 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.358469 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.358560 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.358781 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.358868 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.359112 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.359197 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.359415 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.359502 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.359723 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.359808 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.360029 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.360114 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.360334 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.360420 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.360634 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.360719 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.360940 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.361036 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.361257 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.361343 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.361575 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.361660 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.361875 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.361974 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.362192 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.362277 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.362527 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.362619 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.362840 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.362944 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.363152 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.363238 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.363456 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.363549 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.363778 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.363915 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.364084 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.364172 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.364389 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.364473 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.364690 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.364776 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.364995 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.365081 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.365300 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.365384 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.365607 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.365693 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.365911 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.365996 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.366214 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.366308 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.366545 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.366632 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.366857 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.366951 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.367179 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.367273 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.367502 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.367587 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.367806 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.367891 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.368126 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.368221 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.368447 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.368531 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.368783 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.368867 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.369090 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.369176 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.369426 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.369511 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.369748 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.369834 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.370060 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.370145 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.370365 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.370483 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.370811 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.371256 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:34:26.371256 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 18:34:26.371423 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 18:34:26.524622 n-d-860687-3 devstack@n-api.service[111206]: INFO dbcounter [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Registered counter for database nova_api Oct 27 18:34:26.526097 n-d-860687-3 devstack@n-api.service[111207]: INFO dbcounter [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] Registered counter for database nova_api Oct 27 18:34:26.545672 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_db.sqlalchemy.engines [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:34:26.547606 n-d-860687-3 devstack@n-api.service[111207]: DEBUG oslo_db.sqlalchemy.engines [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:34:26.552367 n-d-860687-3 devstack@n-api.service[111206]: DEBUG dbcounter [-] [111206] Writer thread running {{(pid=111206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:34:26.553982 n-d-860687-3 devstack@n-api.service[111207]: DEBUG dbcounter [-] [111207] Writer thread running {{(pid=111207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:34:26.609148 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.context [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af35862a-071a-430c-affa-82567dc9805c(cell1) {{(pid=111206) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 18:34:26.612404 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.context [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af35862a-071a-430c-affa-82567dc9805c(cell1) {{(pid=111207) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 18:34:26.612949 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:34:26.613416 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:34:26.615033 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:34:26.615738 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:34:26.616174 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:34:26.616290 n-d-860687-3 devstack@n-api.service[111207]: DEBUG oslo_concurrency.lockutils [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:34:26.616745 n-d-860687-3 devstack@n-api.service[111207]: DEBUG oslo_concurrency.lockutils [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:34:26.618264 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:34:26.618378 n-d-860687-3 devstack@n-api.service[111207]: DEBUG oslo_concurrency.lockutils [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:34:26.619029 n-d-860687-3 devstack@n-api.service[111207]: DEBUG oslo_concurrency.lockutils [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:34:26.619462 n-d-860687-3 devstack@n-api.service[111207]: DEBUG oslo_concurrency.lockutils [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:34:26.620246 n-d-860687-3 devstack@n-api.service[111206]: INFO dbcounter [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Registered counter for database nova_cell0 Oct 27 18:34:26.621977 n-d-860687-3 devstack@n-api.service[111207]: DEBUG oslo_concurrency.lockutils [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:34:26.623988 n-d-860687-3 devstack@n-api.service[111207]: INFO dbcounter [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] Registered counter for database nova_cell0 Oct 27 18:34:26.624368 n-d-860687-3 devstack@n-api.service[111206]: INFO dbcounter [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Registered counter for database nova_cell1 Oct 27 18:34:26.628228 n-d-860687-3 devstack@n-api.service[111207]: INFO dbcounter [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] Registered counter for database nova_cell1 Oct 27 18:34:26.633997 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_db.sqlalchemy.engines [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:34:26.634889 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_db.sqlalchemy.engines [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:34:26.635600 n-d-860687-3 devstack@n-api.service[111207]: DEBUG oslo_db.sqlalchemy.engines [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:34:26.638493 n-d-860687-3 devstack@n-api.service[111207]: DEBUG oslo_db.sqlalchemy.engines [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:34:26.642248 n-d-860687-3 devstack@n-api.service[111206]: DEBUG dbcounter [-] [111206] Writer thread running {{(pid=111206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:34:26.642987 n-d-860687-3 devstack@n-api.service[111207]: DEBUG dbcounter [-] [111207] Writer thread running {{(pid=111207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:34:26.643751 n-d-860687-3 devstack@n-api.service[111206]: DEBUG dbcounter [-] [111206] Writer thread running {{(pid=111206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:34:26.783918 n-d-860687-3 devstack@n-api.service[111207]: DEBUG dbcounter [-] [111207] Writer thread running {{(pid=111207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:34:26.789373 n-d-860687-3 devstack@n-api.service[111206]: INFO dbcounter [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Registered counter for database nova_cell0 Oct 27 18:34:26.793823 n-d-860687-3 devstack@n-api.service[111207]: INFO dbcounter [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] Registered counter for database nova_cell0 Oct 27 18:34:26.798586 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_db.sqlalchemy.engines [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:34:26.800574 n-d-860687-3 devstack@n-api.service[111207]: DEBUG oslo_db.sqlalchemy.engines [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:34:26.803353 n-d-860687-3 devstack@n-api.service[111206]: DEBUG dbcounter [-] [111206] Writer thread running {{(pid=111206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:34:26.804794 n-d-860687-3 devstack@n-api.service[111207]: DEBUG dbcounter [-] [111207] Writer thread running {{(pid=111207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:34:27.138143 n-d-860687-3 devstack@n-api.service[111206]: WARNING keystonemiddleware.auth_token [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 18:34:27.145366 n-d-860687-3 devstack@n-api.service[111206]: WARNING keystonemiddleware.auth_token [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 18:34:27.145566 n-d-860687-3 devstack@n-api.service[111207]: WARNING keystonemiddleware.auth_token [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 18:34:27.153841 n-d-860687-3 devstack@n-api.service[111207]: WARNING keystonemiddleware.auth_token [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 18:34:27.487266 n-d-860687-3 devstack@n-api.service[111206]: WARNING keystonemiddleware.auth_token [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 18:34:27.493135 n-d-860687-3 devstack@n-api.service[111206]: WARNING keystonemiddleware.auth_token [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 18:34:27.498938 n-d-860687-3 devstack@n-api.service[111206]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55866798b9c0 pid: 111206 (default app) Oct 27 18:34:27.501001 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:34:27.502176 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Oct 27 18:34:27.502611 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Thu Oct 27 18:34:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:34:27.504067 n-d-860687-3 devstack@n-api.service[111207]: WARNING keystonemiddleware.auth_token [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 18:34:27.509954 n-d-860687-3 devstack@n-api.service[111207]: WARNING keystonemiddleware.auth_token [None req-30bc6d4e-4811-4d9e-9f14-eb928d802bbc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 18:34:27.515904 n-d-860687-3 devstack@n-api.service[111207]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55866798b9c0 pid: 111207 (default app) Oct 27 18:35:49.563621 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:35:49.564641 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 27 18:35:49.565046 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 18:35:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:35:49.582689 n-d-860687-3 devstack@n-api.service[111207]: DEBUG dbcounter [-] [111207] Writing DB stats nova_api:SELECT=3 {{(pid=111207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:35:49.584127 n-d-860687-3 devstack@n-api.service[111207]: DEBUG dbcounter [-] [111207] Writing DB stats nova_cell0:SELECT=3 {{(pid=111207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:35:49.585153 n-d-860687-3 devstack@n-api.service[111207]: DEBUG dbcounter [-] [111207] Writing DB stats nova_cell1:SELECT=3 {{(pid=111207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:35:49.585981 n-d-860687-3 devstack@n-api.service[111207]: DEBUG dbcounter [-] [111207] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:35:50.452181 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-7829585f-0f9e-4003-9d80-5ea9a6055792 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:35:50.484445 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-7829585f-0f9e-4003-9d80-5ea9a6055792 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.912522 Oct 27 18:35:50.485183 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Oct 27 18:35:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:35:53.145592 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:35:53.146652 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-22b6bc4e-0593-4fa4-ba4d-6b08c61a9f16 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 27 18:35:53.147342 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 18:35:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:35:53.604550 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-ca6c031e-6793-4955-ae15-b49840deb8c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "c1", "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1}} {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:35:53.651700 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-ca6c031e-6793-4955-ae15-b49840deb8c3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.497270 Oct 27 18:35:53.652079 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 18:35:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:35:53.665941 n-d-860687-3 devstack@n-api.service[111206]: DEBUG dbcounter [-] [111206] Writing DB stats nova_api:SELECT=3 {{(pid=111206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:35:53.666830 n-d-860687-3 devstack@n-api.service[111206]: DEBUG dbcounter [-] [111206] Writing DB stats nova_cell0:SELECT=3 {{(pid=111206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:35:53.669489 n-d-860687-3 devstack@n-api.service[111206]: DEBUG dbcounter [-] [111206] Writing DB stats nova_cell1:SELECT=3 {{(pid=111206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:35:53.670234 n-d-860687-3 devstack@n-api.service[111206]: DEBUG dbcounter [-] [111206] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:35:53.881085 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-597dca42-c009-4de3-a1fd-fcdf26c1022c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:35:53.953758 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-597dca42-c009-4de3-a1fd-fcdf26c1022c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293479 Oct 27 18:35:53.954350 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Oct 27 18:35:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:35:56.653981 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-ca6c031e-6793-4955-ae15-b49840deb8c3 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:35:56.655672 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-ca6c031e-6793-4955-ae15-b49840deb8c3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002144 Oct 27 18:35:56.656675 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 18:35:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:35:57.529275 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-fa951735-0f70-4a73-abbf-7f35c4d400b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M", "swap": 0}} {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:35:57.590339 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-fa951735-0f70-4a73-abbf-7f35c4d400b0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.927590 Oct 27 18:35:57.592643 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 18:35:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:35:57.607496 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-d08bd78e-34a7-4c2c-a4cd-4d3c6f4cc67b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:35:57.673612 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-d08bd78e-34a7-4c2c-a4cd-4d3c6f4cc67b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070142 Oct 27 18:35:57.675814 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Oct 27 18:35:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:36:00.636605 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-fa951735-0f70-4a73-abbf-7f35c4d400b0 admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:00.642421 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-fa951735-0f70-4a73-abbf-7f35c4d400b0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006891 Oct 27 18:36:00.647220 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 18:36:00 2022] GET /compute/v2.1 => generated 388 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:01.133019 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-96713306-6fe2-4531-95af-d1a7cce545a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "id": "d2", "name": "ds1G", "vcpus": 1}} {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:01.154678 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-96713306-6fe2-4531-95af-d1a7cce545a2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.502631 Oct 27 18:36:01.155668 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 18:36:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:36:01.167649 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-47bf1375-78df-44e5-a8c1-b6f3494e755e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:01.198958 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-47bf1375-78df-44e5-a8c1-b6f3494e755e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034825 Oct 27 18:36:01.203364 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Oct 27 18:36:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:36:03.854188 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-96713306-6fe2-4531-95af-d1a7cce545a2 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:03.855266 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-96713306-6fe2-4531-95af-d1a7cce545a2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Oct 27 18:36:03.855983 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 18:36:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:04.317330 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-6e180e7b-9b80-4788-8e33-52505a773eef admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3"}} {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:04.344294 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-6e180e7b-9b80-4788-8e33-52505a773eef admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482098 Oct 27 18:36:04.344858 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 18:36:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 18:36:04.357201 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-82511b3a-aa78-41ef-94f6-1b3f51bd0b8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:04.388991 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-82511b3a-aa78-41ef-94f6-1b3f51bd0b8b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035652 Oct 27 18:36:04.389604 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Oct 27 18:36:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:36:07.155903 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-6e180e7b-9b80-4788-8e33-52505a773eef admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:07.157470 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-6e180e7b-9b80-4788-8e33-52505a773eef admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002100 Oct 27 18:36:07.168558 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 18:36:07 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:07.674457 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-a5ce3283-cc36-4faa-be3e-407bca471636 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "name": "ds4G", "rxtx_factor": 1.0}} {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:07.700335 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-a5ce3283-cc36-4faa-be3e-407bca471636 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.535595 Oct 27 18:36:07.701649 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 18:36:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:36:07.713741 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-dd314c8f-7530-481b-abb2-bfa63b804b75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:07.743606 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-dd314c8f-7530-481b-abb2-bfa63b804b75 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033519 Oct 27 18:36:07.759476 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Oct 27 18:36:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:36:10.429180 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-a5ce3283-cc36-4faa-be3e-407bca471636 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:10.430541 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-a5ce3283-cc36-4faa-be3e-407bca471636 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Oct 27 18:36:10.431136 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 18:36:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:10.863898 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-61327fc3-ea6a-4fd4-854c-768a1d4ee8dd admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:10.889093 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-61327fc3-ea6a-4fd4-854c-768a1d4ee8dd admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.449706 Oct 27 18:36:10.889638 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Oct 27 18:36:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:36:13.664055 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-a5ce3283-cc36-4faa-be3e-407bca471636 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:13.665057 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-a5ce3283-cc36-4faa-be3e-407bca471636 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 27 18:36:13.665462 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 18:36:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:14.117462 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-ab879f76-2499-4a54-8038-5ae7d86fdf22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.tiny", "id": "1", "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0}} {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:14.141813 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-ab879f76-2499-4a54-8038-5ae7d86fdf22 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.469889 Oct 27 18:36:14.142472 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 18:36:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 18:36:14.157188 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-ae5dce2e-296a-4b18-944c-083664fdc9fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:14.187546 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-ae5dce2e-296a-4b18-944c-083664fdc9fe admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033971 Oct 27 18:36:14.188892 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Oct 27 18:36:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:36:16.836315 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-ab879f76-2499-4a54-8038-5ae7d86fdf22 admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:16.837251 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-ab879f76-2499-4a54-8038-5ae7d86fdf22 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 27 18:36:16.837662 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 18:36:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:17.234294 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-02455832-5c4f-47a2-99ae-f4b70b952b51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "2", "disk": 20, "name": "m1.small", "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:17.252970 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-02455832-5c4f-47a2-99ae-f4b70b952b51 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.408903 Oct 27 18:36:17.253527 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 18:36:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:36:17.266254 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-8dc20f75-2295-42d3-b6b3-08684b84c637 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:17.291010 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-8dc20f75-2295-42d3-b6b3-08684b84c637 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028744 Oct 27 18:36:17.291593 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Oct 27 18:36:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:36:19.929085 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-02455832-5c4f-47a2-99ae-f4b70b952b51 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:19.930591 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-02455832-5c4f-47a2-99ae-f4b70b952b51 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001888 Oct 27 18:36:19.930993 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 18:36:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:20.375716 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-12322f5a-d250-41c4-9e41-9992b61eb530 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "swap": 0}} {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:20.401846 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-12322f5a-d250-41c4-9e41-9992b61eb530 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.464199 Oct 27 18:36:20.403352 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 18:36:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:36:20.419586 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-a67f911f-4459-4d92-916a-fb1b6a592d4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:20.424623 n-d-860687-3 devstack@n-api.service[111207]: DEBUG dbcounter [-] [111207] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:36:20.448603 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-a67f911f-4459-4d92-916a-fb1b6a592d4e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036576 Oct 27 18:36:20.449494 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Oct 27 18:36:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:36:23.166499 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-12322f5a-d250-41c4-9e41-9992b61eb530 admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:23.167888 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-12322f5a-d250-41c4-9e41-9992b61eb530 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001958 Oct 27 18:36:23.178482 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 18:36:23 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:23.610955 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-9e4013fd-c598-4bc5-a6b1-79f1618e1373 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0, "ram": 8192, "disk": 80, "id": "4", "os-flavor-access:is_public": true}} {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:23.630333 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-9e4013fd-c598-4bc5-a6b1-79f1618e1373 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.455477 Oct 27 18:36:23.634435 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 18:36:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:36:23.643919 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-ee3266e4-1f02-47e6-81dd-c697110a53ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:23.670077 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-ee3266e4-1f02-47e6-81dd-c697110a53ba admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030382 Oct 27 18:36:23.678850 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Oct 27 18:36:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:36:26.320464 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-9e4013fd-c598-4bc5-a6b1-79f1618e1373 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:26.321374 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-9e4013fd-c598-4bc5-a6b1-79f1618e1373 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 27 18:36:26.321772 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 18:36:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:26.762985 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-26dbeae0-d51c-48c0-8d23-cbff0f49d7f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:26.769426 n-d-860687-3 devstack@n-api.service[111206]: DEBUG dbcounter [-] [111206] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:36:26.785084 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-26dbeae0-d51c-48c0-8d23-cbff0f49d7f0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.456782 Oct 27 18:36:26.785875 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 18:36:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:36:26.798325 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-a9e3ec71-c5c4-47e6-b1e6-a3e41df24170 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:26.827302 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-a9e3ec71-c5c4-47e6-b1e6-a3e41df24170 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032710 Oct 27 18:36:26.828182 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Oct 27 18:36:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:36:47.686635 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-26dbeae0-d51c-48c0-8d23-cbff0f49d7f0 admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:47.687595 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-26dbeae0-d51c-48c0-8d23-cbff0f49d7f0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Oct 27 18:36:47.688005 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 18:36:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:47.698589 n-d-860687-3 devstack@n-api.service[111207]: DEBUG dbcounter [-] [111207] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:36:48.079777 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-57a11ffb-0e94-4470-a94a-def006f825cd admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:48.098198 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-57a11ffb-0e94-4470-a94a-def006f825cd admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404016 Oct 27 18:36:48.098768 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Oct 27 18:36:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:36:49.397568 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-26dbeae0-d51c-48c0-8d23-cbff0f49d7f0 admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:49.398611 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-26dbeae0-d51c-48c0-8d23-cbff0f49d7f0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 27 18:36:49.399017 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 18:36:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:49.930934 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-26bf7d0e-070a-4421-b7c6-804187d960da admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:49.936427 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.wsgi [None req-26bf7d0e-070a-4421-b7c6-804187d960da admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-26bf7d0e-070a-4421-b7c6-804187d960da admin admin] Request method failure captured: Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: Accept: application/json Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: Accept-Encoding: gzip, deflate Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: Connection: keep-alive Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: Content-Length: 0 Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: Host: 10.222.0.42 Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: Openstack-Api-Version: compute 2.92 Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: Openstack-System-Scope: None Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: User-Agent: python-novaclient Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: X-Auth-Token: gAAAAABjWs_Bj91cMkNEBCIGgzs8m-avf-s3MsMQPHSBEhyuXLpdBO7CjOsEFmTABumS5E8rzp8mMTCAOZKntkurngRu8KKleT_p-TTsZ0WU_wSF2Daxe83Y1z9SpADvamAHNiAkp67u_xjOVtW59mQcWA9fRUcsSHsPz383VbqMW7NvDu9hOPA Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: X-Domain-Id: None Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: X-Domain-Name: None Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: X-Identity-Status: Confirmed Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: X-Is-Admin-Project: True Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: X-Project-Domain-Id: default Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: X-Project-Domain-Name: Default Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: X-Project-Id: b2726af56bb94c71accb06f766d0b94d Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: X-Project-Name: admin Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: X-Role: admin,member,reader Oct 27 18:36:49.939643 n-d-860687-3 devstack@n-api.service[111207]: X-Roles: admin,member,reader Oct 27 18:36:49.941064 n-d-860687-3 devstack@n-api.service[111207]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b2726af56bb94c71accb06f766d0b94d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:36:49.941064 n-d-860687-3 devstack@n-api.service[111207]: X-Tenant: admin Oct 27 18:36:49.941064 n-d-860687-3 devstack@n-api.service[111207]: X-Tenant-Id: b2726af56bb94c71accb06f766d0b94d Oct 27 18:36:49.941064 n-d-860687-3 devstack@n-api.service[111207]: X-Tenant-Name: admin Oct 27 18:36:49.941064 n-d-860687-3 devstack@n-api.service[111207]: X-User: admin Oct 27 18:36:49.941064 n-d-860687-3 devstack@n-api.service[111207]: X-User-Domain-Id: default Oct 27 18:36:49.941064 n-d-860687-3 devstack@n-api.service[111207]: X-User-Domain-Name: Default Oct 27 18:36:49.941064 n-d-860687-3 devstack@n-api.service[111207]: X-User-Id: a93f6c013ca04d8da88dda44fe7bfcfe Oct 27 18:36:49.941064 n-d-860687-3 devstack@n-api.service[111207]: X-User-Name: admin Oct 27 18:36:49.941064 n-d-860687-3 devstack@n-api.service[111207]: method: > Oct 27 18:36:49.941064 n-d-860687-3 devstack@n-api.service[111207]: exception: Flavor 42 could not be found. Oct 27 18:36:49.941064 n-d-860687-3 devstack@n-api.service[111207]: action_args: {'id': '42'} Oct 27 18:36:49.941064 n-d-860687-3 devstack@n-api.service[111207]: {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:36:49.941064 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:36:49.941985 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:49.943312 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-26bf7d0e-070a-4421-b7c6-804187d960da admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:36:49.944594 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-26bf7d0e-070a-4421-b7c6-804187d960da admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397065 Oct 27 18:36:49.944594 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Oct 27 18:36:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:36:49.950955 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-333ad58b-6c38-495e-9edf-844194833bda admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:49.973393 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-333ad58b-6c38-495e-9edf-844194833bda admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026329 Oct 27 18:36:49.973927 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Oct 27 18:36:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:36:49.991944 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-9c7ec967-3a69-43a1-96d5-703b4c321337 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:50.013909 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-9c7ec967-3a69-43a1-96d5-703b4c321337 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026413 Oct 27 18:36:50.014445 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Oct 27 18:36:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:36:50.023672 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-1349be5a-a27b-49fe-b727-fe05bf8becf7 admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:50.029431 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.wsgi [None req-1349be5a-a27b-49fe-b727-fe05bf8becf7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-1349be5a-a27b-49fe-b727-fe05bf8becf7 admin admin] Request method failure captured: Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: Accept: application/json Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: Accept-Encoding: gzip, deflate Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: Connection: keep-alive Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: Content-Length: 0 Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: Host: 10.222.0.42 Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: Openstack-Api-Version: compute 2.92 Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: Openstack-System-Scope: None Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: User-Agent: python-novaclient Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: X-Auth-Token: gAAAAABjWs_Bj91cMkNEBCIGgzs8m-avf-s3MsMQPHSBEhyuXLpdBO7CjOsEFmTABumS5E8rzp8mMTCAOZKntkurngRu8KKleT_p-TTsZ0WU_wSF2Daxe83Y1z9SpADvamAHNiAkp67u_xjOVtW59mQcWA9fRUcsSHsPz383VbqMW7NvDu9hOPA Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: X-Domain-Id: None Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: X-Domain-Name: None Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: X-Identity-Status: Confirmed Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: X-Is-Admin-Project: True Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: X-Project-Domain-Id: default Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: X-Project-Domain-Name: Default Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: X-Project-Id: b2726af56bb94c71accb06f766d0b94d Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: X-Project-Name: admin Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: X-Role: admin,member,reader Oct 27 18:36:50.032701 n-d-860687-3 devstack@n-api.service[111206]: X-Roles: admin,member,reader Oct 27 18:36:50.034214 n-d-860687-3 devstack@n-api.service[111206]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b2726af56bb94c71accb06f766d0b94d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:36:50.034214 n-d-860687-3 devstack@n-api.service[111206]: X-Tenant: admin Oct 27 18:36:50.034214 n-d-860687-3 devstack@n-api.service[111206]: X-Tenant-Id: b2726af56bb94c71accb06f766d0b94d Oct 27 18:36:50.034214 n-d-860687-3 devstack@n-api.service[111206]: X-Tenant-Name: admin Oct 27 18:36:50.034214 n-d-860687-3 devstack@n-api.service[111206]: X-User: admin Oct 27 18:36:50.034214 n-d-860687-3 devstack@n-api.service[111206]: X-User-Domain-Id: default Oct 27 18:36:50.034214 n-d-860687-3 devstack@n-api.service[111206]: X-User-Domain-Name: Default Oct 27 18:36:50.034214 n-d-860687-3 devstack@n-api.service[111206]: X-User-Id: a93f6c013ca04d8da88dda44fe7bfcfe Oct 27 18:36:50.034214 n-d-860687-3 devstack@n-api.service[111206]: X-User-Name: admin Oct 27 18:36:50.034214 n-d-860687-3 devstack@n-api.service[111206]: method: > Oct 27 18:36:50.034214 n-d-860687-3 devstack@n-api.service[111206]: exception: Flavor 42 could not be found. Oct 27 18:36:50.034214 n-d-860687-3 devstack@n-api.service[111206]: action_args: {'id': '42'} Oct 27 18:36:50.034214 n-d-860687-3 devstack@n-api.service[111206]: {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:36:50.034214 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:36:50.035248 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:50.036650 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-1349be5a-a27b-49fe-b727-fe05bf8becf7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:36:50.038120 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-1349be5a-a27b-49fe-b727-fe05bf8becf7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013926 Oct 27 18:36:50.038120 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Oct 27 18:36:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:36:51.242052 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-9c7ec967-3a69-43a1-96d5-703b4c321337 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:51.243086 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-9c7ec967-3a69-43a1-96d5-703b4c321337 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 27 18:36:51.243504 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 18:36:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:51.764123 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-827a3a7f-4813-4b34-ad07-ea2f8829d912 admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:51.769045 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.wsgi [None req-827a3a7f-4813-4b34-ad07-ea2f8829d912 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-827a3a7f-4813-4b34-ad07-ea2f8829d912 admin admin] Request method failure captured: Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: Accept: application/json Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: Accept-Encoding: gzip, deflate Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: Connection: keep-alive Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: Content-Length: 0 Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: Host: 10.222.0.42 Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: Openstack-Api-Version: compute 2.92 Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: Openstack-System-Scope: None Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: User-Agent: python-novaclient Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: X-Auth-Token: gAAAAABjWs_DHL8nXxvASzJObcSEEalLDZmRuJPuFSe501gtd0__tprTmES-AHbtZsiz7T95dMhqPcXwheCV-zi8VmMccHVm2X5UCg5ryOlHz9BzAgBJGhtEvB-X8lYGXDZyXuvk5SK4wjCDzrx4xJ8yyTrZ7cr_QIEMhsYdtdjcJxmWA1b2SIg Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: X-Domain-Id: None Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: X-Domain-Name: None Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: X-Identity-Status: Confirmed Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: X-Is-Admin-Project: True Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: X-Project-Domain-Id: default Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: X-Project-Domain-Name: Default Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: X-Project-Id: b2726af56bb94c71accb06f766d0b94d Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: X-Project-Name: admin Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: X-Role: admin,member,reader Oct 27 18:36:51.770569 n-d-860687-3 devstack@n-api.service[111206]: X-Roles: admin,member,reader Oct 27 18:36:51.772130 n-d-860687-3 devstack@n-api.service[111206]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b2726af56bb94c71accb06f766d0b94d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:36:51.772130 n-d-860687-3 devstack@n-api.service[111206]: X-Tenant: admin Oct 27 18:36:51.772130 n-d-860687-3 devstack@n-api.service[111206]: X-Tenant-Id: b2726af56bb94c71accb06f766d0b94d Oct 27 18:36:51.772130 n-d-860687-3 devstack@n-api.service[111206]: X-Tenant-Name: admin Oct 27 18:36:51.772130 n-d-860687-3 devstack@n-api.service[111206]: X-User: admin Oct 27 18:36:51.772130 n-d-860687-3 devstack@n-api.service[111206]: X-User-Domain-Id: default Oct 27 18:36:51.772130 n-d-860687-3 devstack@n-api.service[111206]: X-User-Domain-Name: Default Oct 27 18:36:51.772130 n-d-860687-3 devstack@n-api.service[111206]: X-User-Id: a93f6c013ca04d8da88dda44fe7bfcfe Oct 27 18:36:51.772130 n-d-860687-3 devstack@n-api.service[111206]: X-User-Name: admin Oct 27 18:36:51.772130 n-d-860687-3 devstack@n-api.service[111206]: method: > Oct 27 18:36:51.772130 n-d-860687-3 devstack@n-api.service[111206]: exception: Flavor 84 could not be found. Oct 27 18:36:51.772130 n-d-860687-3 devstack@n-api.service[111206]: action_args: {'id': '84'} Oct 27 18:36:51.772130 n-d-860687-3 devstack@n-api.service[111206]: {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:36:51.772130 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:36:51.772938 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:51.773963 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-827a3a7f-4813-4b34-ad07-ea2f8829d912 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:36:51.775005 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-827a3a7f-4813-4b34-ad07-ea2f8829d912 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391031 Oct 27 18:36:51.775005 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Oct 27 18:36:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:36:51.782054 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-fbfb9d5c-67de-4b8d-be13-d725c424210e admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:51.797146 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-fbfb9d5c-67de-4b8d-be13-d725c424210e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018589 Oct 27 18:36:51.797615 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Oct 27 18:36:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:36:51.807563 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-5df2d953-3da3-45a4-ac58-33aeacc8d3c4 admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:51.822817 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-5df2d953-3da3-45a4-ac58-33aeacc8d3c4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018618 Oct 27 18:36:51.823340 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Oct 27 18:36:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:36:51.832336 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-a1984357-aadc-4718-a4b4-0ebc07028e99 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:51.837264 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.wsgi [None req-a1984357-aadc-4718-a4b4-0ebc07028e99 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-a1984357-aadc-4718-a4b4-0ebc07028e99 admin admin] Request method failure captured: Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: Accept: application/json Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: Accept-Encoding: gzip, deflate Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: Connection: keep-alive Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: Content-Length: 0 Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: Host: 10.222.0.42 Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: Openstack-Api-Version: compute 2.92 Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: Openstack-System-Scope: None Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: User-Agent: python-novaclient Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: X-Auth-Token: gAAAAABjWs_DHL8nXxvASzJObcSEEalLDZmRuJPuFSe501gtd0__tprTmES-AHbtZsiz7T95dMhqPcXwheCV-zi8VmMccHVm2X5UCg5ryOlHz9BzAgBJGhtEvB-X8lYGXDZyXuvk5SK4wjCDzrx4xJ8yyTrZ7cr_QIEMhsYdtdjcJxmWA1b2SIg Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: X-Domain-Id: None Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: X-Domain-Name: None Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: X-Identity-Status: Confirmed Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: X-Is-Admin-Project: True Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: X-Project-Domain-Id: default Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: X-Project-Domain-Name: Default Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: X-Project-Id: b2726af56bb94c71accb06f766d0b94d Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: X-Project-Name: admin Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: X-Role: admin,member,reader Oct 27 18:36:51.839873 n-d-860687-3 devstack@n-api.service[111207]: X-Roles: admin,member,reader Oct 27 18:36:51.841354 n-d-860687-3 devstack@n-api.service[111207]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b2726af56bb94c71accb06f766d0b94d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:36:51.841354 n-d-860687-3 devstack@n-api.service[111207]: X-Tenant: admin Oct 27 18:36:51.841354 n-d-860687-3 devstack@n-api.service[111207]: X-Tenant-Id: b2726af56bb94c71accb06f766d0b94d Oct 27 18:36:51.841354 n-d-860687-3 devstack@n-api.service[111207]: X-Tenant-Name: admin Oct 27 18:36:51.841354 n-d-860687-3 devstack@n-api.service[111207]: X-User: admin Oct 27 18:36:51.841354 n-d-860687-3 devstack@n-api.service[111207]: X-User-Domain-Id: default Oct 27 18:36:51.841354 n-d-860687-3 devstack@n-api.service[111207]: X-User-Domain-Name: Default Oct 27 18:36:51.841354 n-d-860687-3 devstack@n-api.service[111207]: X-User-Id: a93f6c013ca04d8da88dda44fe7bfcfe Oct 27 18:36:51.841354 n-d-860687-3 devstack@n-api.service[111207]: X-User-Name: admin Oct 27 18:36:51.841354 n-d-860687-3 devstack@n-api.service[111207]: method: > Oct 27 18:36:51.841354 n-d-860687-3 devstack@n-api.service[111207]: exception: Flavor 84 could not be found. Oct 27 18:36:51.841354 n-d-860687-3 devstack@n-api.service[111207]: action_args: {'id': '84'} Oct 27 18:36:51.841354 n-d-860687-3 devstack@n-api.service[111207]: {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:36:51.841354 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:36:51.842295 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:51.843601 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-a1984357-aadc-4718-a4b4-0ebc07028e99 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:36:51.844795 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-a1984357-aadc-4718-a4b4-0ebc07028e99 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012346 Oct 27 18:36:51.844795 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Oct 27 18:36:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 27 18:36:53.046433 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-5df2d953-3da3-45a4-ac58-33aeacc8d3c4 admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:53.047443 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-5df2d953-3da3-45a4-ac58-33aeacc8d3c4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 27 18:36:53.047981 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 18:36:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:53.568422 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-c36e8d0a-339b-4cd1-96e5-1aa5b1d9dd8a admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:53.574464 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.wsgi [None req-c36e8d0a-339b-4cd1-96e5-1aa5b1d9dd8a admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-c36e8d0a-339b-4cd1-96e5-1aa5b1d9dd8a admin admin] Request method failure captured: Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: Accept: application/json Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: Accept-Encoding: gzip, deflate Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: Connection: keep-alive Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: Content-Length: 0 Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: Host: 10.222.0.42 Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: Openstack-Api-Version: compute 2.92 Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: Openstack-System-Scope: None Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: User-Agent: python-novaclient Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: X-Auth-Token: gAAAAABjWs_EvEaBCpvMJZOuyU-XuqJ24MiC795mQDQHgxwdqAKd-GLi7EsOV502LkbV20LYxqmIHSRJWvaYA8DaRfL9mb5e2wn41oxwDNp0prFx6J_azhR2CUJdIR422OL1PrOVnID3X15K8KFUsgO2eBdXU06oFjmqXmC4boNruBnu5NzPQ88 Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: X-Domain-Id: None Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: X-Domain-Name: None Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: X-Identity-Status: Confirmed Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: X-Is-Admin-Project: True Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: X-Project-Domain-Id: default Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: X-Project-Domain-Name: Default Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: X-Project-Id: b2726af56bb94c71accb06f766d0b94d Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: X-Project-Name: admin Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: X-Role: admin,member,reader Oct 27 18:36:53.575959 n-d-860687-3 devstack@n-api.service[111207]: X-Roles: admin,member,reader Oct 27 18:36:53.577546 n-d-860687-3 devstack@n-api.service[111207]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b2726af56bb94c71accb06f766d0b94d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:36:53.577546 n-d-860687-3 devstack@n-api.service[111207]: X-Tenant: admin Oct 27 18:36:53.577546 n-d-860687-3 devstack@n-api.service[111207]: X-Tenant-Id: b2726af56bb94c71accb06f766d0b94d Oct 27 18:36:53.577546 n-d-860687-3 devstack@n-api.service[111207]: X-Tenant-Name: admin Oct 27 18:36:53.577546 n-d-860687-3 devstack@n-api.service[111207]: X-User: admin Oct 27 18:36:53.577546 n-d-860687-3 devstack@n-api.service[111207]: X-User-Domain-Id: default Oct 27 18:36:53.577546 n-d-860687-3 devstack@n-api.service[111207]: X-User-Domain-Name: Default Oct 27 18:36:53.577546 n-d-860687-3 devstack@n-api.service[111207]: X-User-Id: a93f6c013ca04d8da88dda44fe7bfcfe Oct 27 18:36:53.577546 n-d-860687-3 devstack@n-api.service[111207]: X-User-Name: admin Oct 27 18:36:53.577546 n-d-860687-3 devstack@n-api.service[111207]: method: > Oct 27 18:36:53.577546 n-d-860687-3 devstack@n-api.service[111207]: exception: Flavor 451 could not be found. Oct 27 18:36:53.577546 n-d-860687-3 devstack@n-api.service[111207]: action_args: {'id': '451'} Oct 27 18:36:53.577546 n-d-860687-3 devstack@n-api.service[111207]: {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:36:53.577546 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:36:53.578499 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: ERROR nova.api.openstack.wsgi Oct 27 18:36:53.579812 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-c36e8d0a-339b-4cd1-96e5-1aa5b1d9dd8a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:36:53.580796 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-c36e8d0a-339b-4cd1-96e5-1aa5b1d9dd8a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.393451 Oct 27 18:36:53.580796 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Oct 27 18:36:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:36:53.587096 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-52708480-d0b9-4a33-82e6-1f03c74e8481 admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:53.602279 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-52708480-d0b9-4a33-82e6-1f03c74e8481 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018928 Oct 27 18:36:53.602879 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Oct 27 18:36:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:36:53.613061 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-e0284335-95b7-40b1-94a0-1a649e29a052 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:53.627955 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-e0284335-95b7-40b1-94a0-1a649e29a052 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018441 Oct 27 18:36:53.628607 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Oct 27 18:36:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:36:53.637718 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-f0e6228f-3dbd-4dd8-a089-ca4cdf8de594 admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:53.642621 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.wsgi [None req-f0e6228f-3dbd-4dd8-a089-ca4cdf8de594 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-f0e6228f-3dbd-4dd8-a089-ca4cdf8de594 admin admin] Request method failure captured: Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: Accept: application/json Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: Accept-Encoding: gzip, deflate Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: Connection: keep-alive Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: Content-Length: 0 Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: Host: 10.222.0.42 Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: Openstack-Api-Version: compute 2.92 Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: Openstack-System-Scope: None Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: User-Agent: python-novaclient Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: X-Auth-Token: gAAAAABjWs_EvEaBCpvMJZOuyU-XuqJ24MiC795mQDQHgxwdqAKd-GLi7EsOV502LkbV20LYxqmIHSRJWvaYA8DaRfL9mb5e2wn41oxwDNp0prFx6J_azhR2CUJdIR422OL1PrOVnID3X15K8KFUsgO2eBdXU06oFjmqXmC4boNruBnu5NzPQ88 Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: X-Domain-Id: None Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: X-Domain-Name: None Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: X-Identity-Status: Confirmed Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: X-Is-Admin-Project: True Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: X-Project-Domain-Id: default Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: X-Project-Domain-Name: Default Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: X-Project-Id: b2726af56bb94c71accb06f766d0b94d Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: X-Project-Name: admin Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: X-Role: admin,member,reader Oct 27 18:36:53.644390 n-d-860687-3 devstack@n-api.service[111206]: X-Roles: admin,member,reader Oct 27 18:36:53.645982 n-d-860687-3 devstack@n-api.service[111206]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b2726af56bb94c71accb06f766d0b94d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2726af56bb94c71accb06f766d0b94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:36:53.645982 n-d-860687-3 devstack@n-api.service[111206]: X-Tenant: admin Oct 27 18:36:53.645982 n-d-860687-3 devstack@n-api.service[111206]: X-Tenant-Id: b2726af56bb94c71accb06f766d0b94d Oct 27 18:36:53.645982 n-d-860687-3 devstack@n-api.service[111206]: X-Tenant-Name: admin Oct 27 18:36:53.645982 n-d-860687-3 devstack@n-api.service[111206]: X-User: admin Oct 27 18:36:53.645982 n-d-860687-3 devstack@n-api.service[111206]: X-User-Domain-Id: default Oct 27 18:36:53.645982 n-d-860687-3 devstack@n-api.service[111206]: X-User-Domain-Name: Default Oct 27 18:36:53.645982 n-d-860687-3 devstack@n-api.service[111206]: X-User-Id: a93f6c013ca04d8da88dda44fe7bfcfe Oct 27 18:36:53.645982 n-d-860687-3 devstack@n-api.service[111206]: X-User-Name: admin Oct 27 18:36:53.645982 n-d-860687-3 devstack@n-api.service[111206]: method: > Oct 27 18:36:53.645982 n-d-860687-3 devstack@n-api.service[111206]: exception: Flavor 451 could not be found. Oct 27 18:36:53.645982 n-d-860687-3 devstack@n-api.service[111206]: action_args: {'id': '451'} Oct 27 18:36:53.645982 n-d-860687-3 devstack@n-api.service[111206]: {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:36:53.645982 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:36:53.646983 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: ERROR nova.api.openstack.wsgi Oct 27 18:36:53.648296 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-f0e6228f-3dbd-4dd8-a089-ca4cdf8de594 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:36:53.649706 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-f0e6228f-3dbd-4dd8-a089-ca4cdf8de594 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011333 Oct 27 18:36:53.649706 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Oct 27 18:36:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:36:54.847777 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-e0284335-95b7-40b1-94a0-1a649e29a052 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:54.848787 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-e0284335-95b7-40b1-94a0-1a649e29a052 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 27 18:36:54.849179 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 18:36:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:55.371226 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-787dc2ab-6748-45d4-9a15-a591df0add95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:55.391229 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-787dc2ab-6748-45d4-9a15-a591df0add95 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.405354 Oct 27 18:36:55.391779 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Oct 27 18:36:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:36:56.593707 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-e0284335-95b7-40b1-94a0-1a649e29a052 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:56.594764 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-e0284335-95b7-40b1-94a0-1a649e29a052 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 27 18:36:56.595158 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 18:36:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:36:57.116969 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-0ca80233-a419-4d55-84db-20fd405b752e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:57.136087 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-0ca80233-a419-4d55-84db-20fd405b752e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.400863 Oct 27 18:36:57.136632 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Oct 27 18:36:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:36:58.342487 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-e0284335-95b7-40b1-94a0-1a649e29a052 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:36:58.343489 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-e0284335-95b7-40b1-94a0-1a649e29a052 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 27 18:36:58.343887 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 18:36:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:36:58.862554 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-ad5799df-668c-423b-be87-8d8fa2a656c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:36:58.881210 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-ad5799df-668c-423b-be87-8d8fa2a656c0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.401345 Oct 27 18:36:58.881755 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Oct 27 18:36:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:37:00.099960 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-e0284335-95b7-40b1-94a0-1a649e29a052 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:37:00.100970 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-e0284335-95b7-40b1-94a0-1a649e29a052 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 27 18:37:00.101363 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 18:37:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:37:00.627059 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-4cf4cc44-5740-41ac-aaec-9e71331a2f3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:37:00.646193 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-4cf4cc44-5740-41ac-aaec-9e71331a2f3c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402596 Oct 27 18:37:00.646769 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Oct 27 18:37:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:37:01.855395 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-e0284335-95b7-40b1-94a0-1a649e29a052 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:37:01.856402 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-e0284335-95b7-40b1-94a0-1a649e29a052 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 27 18:37:01.856799 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 18:37:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:37:02.380649 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-7f4d2adc-5132-4172-a7d4-ce5581c73b23 admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:37:02.401351 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-7f4d2adc-5132-4172-a7d4-ce5581c73b23 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402819 Oct 27 18:37:02.401893 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Thu Oct 27 18:37:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:37:59.236733 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-e0284335-95b7-40b1-94a0-1a649e29a052 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:37:59.237739 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-e0284335-95b7-40b1-94a0-1a649e29a052 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 27 18:37:59.238140 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 18:37:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:37:59.249453 n-d-860687-3 devstack@n-api.service[111206]: DEBUG dbcounter [-] [111206] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:37:59.630475 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-e9215462-7a35-4eb9-b917-fed526d58acd admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:37:59.651128 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-e9215462-7a35-4eb9-b917-fed526d58acd admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406161 Oct 27 18:37:59.651608 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Oct 27 18:37:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:37:59.673292 n-d-860687-3 devstack@n-api.service[111207]: DEBUG dbcounter [-] [111207] Writing DB stats nova_api:SELECT=14 {{(pid=111207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:37:59.677120 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-c3442266-a2b4-4cce-b4a0-d88894e81755 admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:37:59.685099 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-c3442266-a2b4-4cce-b4a0-d88894e81755 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013234 Oct 27 18:37:59.685619 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Thu Oct 27 18:37:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:37:59.697743 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-de146202-a45c-4124-9d6e-0761d07e4faa admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:37:59.704993 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-de146202-a45c-4124-9d6e-0761d07e4faa admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011516 Oct 27 18:37:59.705511 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Thu Oct 27 18:37:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:37:59.716881 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-a73b0bd1-4073-4f16-8c13-7765bddcf2aa admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:37:59.724156 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-a73b0bd1-4073-4f16-8c13-7765bddcf2aa admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010827 Oct 27 18:37:59.724673 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Thu Oct 27 18:37:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:37:59.735834 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-3bf44bc9-f228-415d-80a6-ff724343117e admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:37:59.743300 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-3bf44bc9-f228-415d-80a6-ff724343117e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010913 Oct 27 18:37:59.743808 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Thu Oct 27 18:37:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:43:26.251279 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-a73b0bd1-4073-4f16-8c13-7765bddcf2aa admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:43:26.252295 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-a73b0bd1-4073-4f16-8c13-7765bddcf2aa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 27 18:43:26.252686 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 18:43:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:43:26.395082 n-d-860687-3 devstack@n-api.service[111206]: DEBUG dbcounter [-] [111206] Writing DB stats nova_api:SELECT=6 {{(pid=111206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:43:26.537050 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-f89290ac-19f6-4ac1-aca5-38af46722d41 admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:43:26.541989 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-f89290ac-19f6-4ac1-aca5-38af46722d41 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:43:26.542491 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-f89290ac-19f6-4ac1-aca5-38af46722d41 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:43:26.542920 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-f89290ac-19f6-4ac1-aca5-38af46722d41 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:43:26.543636 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-f89290ac-19f6-4ac1-aca5-38af46722d41 admin admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:43:26.544084 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-f89290ac-19f6-4ac1-aca5-38af46722d41 admin admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:43:26.544501 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-f89290ac-19f6-4ac1-aca5-38af46722d41 admin admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:43:26.583014 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-f89290ac-19f6-4ac1-aca5-38af46722d41 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.189118 Oct 27 18:43:26.583955 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Oct 27 18:43:26 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:43:27.654023 n-d-860687-3 devstack@n-api.service[111207]: DEBUG nova.api.openstack.wsgi [None req-a73b0bd1-4073-4f16-8c13-7765bddcf2aa admin admin] Calling method '>' {{(pid=111207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:43:27.655271 n-d-860687-3 devstack@n-api.service[111207]: INFO nova.api.openstack.requestlog [None req-a73b0bd1-4073-4f16-8c13-7765bddcf2aa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 27 18:43:27.655518 n-d-860687-3 devstack@n-api.service[111207]: [pid: 111207|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 18:43:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:43:27.844884 n-d-860687-3 devstack@n-api.service[111206]: DEBUG nova.api.openstack.wsgi [None req-690cf65a-82e4-4331-bd4b-a047483cce1f admin admin] Calling method '>' {{(pid=111206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:43:27.848362 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-690cf65a-82e4-4331-bd4b-a047483cce1f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:43:27.848832 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-690cf65a-82e4-4331-bd4b-a047483cce1f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:43:27.849260 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-690cf65a-82e4-4331-bd4b-a047483cce1f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:43:27.849965 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-690cf65a-82e4-4331-bd4b-a047483cce1f admin admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:43:27.850492 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-690cf65a-82e4-4331-bd4b-a047483cce1f admin admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:43:27.850909 n-d-860687-3 devstack@n-api.service[111206]: DEBUG oslo_concurrency.lockutils [None req-690cf65a-82e4-4331-bd4b-a047483cce1f admin admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:43:27.874475 n-d-860687-3 devstack@n-api.service[111206]: INFO nova.api.openstack.requestlog [None req-690cf65a-82e4-4331-bd4b-a047483cce1f admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.080954 Oct 27 18:43:27.875027 n-d-860687-3 devstack@n-api.service[111206]: [pid: 111206|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Oct 27 18:43:27 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:44:12.239054 n-d-860687-3 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 27 18:44:12.239748 n-d-860687-3 devstack@n-api.service[111205]: Thu Oct 27 18:44:12 2022 - graceful shutdown triggered... Oct 27 18:44:12.240261 n-d-860687-3 devstack@n-api.service[111207]: Gracefully killing worker 2 (pid: 111207)... Oct 27 18:44:12.240635 n-d-860687-3 devstack@n-api.service[111206]: Gracefully killing worker 1 (pid: 111206)... Oct 27 18:44:12.365643 n-d-860687-3 devstack@n-api.service[111207]: DEBUG dbcounter [-] [111207] Writing DB stats nova_api:SELECT=4 {{(pid=111207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:44:13.240889 n-d-860687-3 devstack@n-api.service[111205]: worker 1 buried after 1 seconds Oct 27 18:44:13.240889 n-d-860687-3 devstack@n-api.service[111205]: worker 2 buried after 1 seconds Oct 27 18:44:13.240889 n-d-860687-3 devstack@n-api.service[111205]: goodbye to uWSGI. Oct 27 18:44:13.242470 n-d-860687-3 systemd[1]: devstack@n-api.service: Succeeded. Oct 27 18:44:13.243026 n-d-860687-3 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 27 18:44:13.245765 n-d-860687-3 systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 18:44:13.263288 n-d-860687-3 devstack@n-api.service[127019]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 18:44:13.283953 n-d-860687-3 devstack@n-api.service[127019]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 18:44:13 2022] *** Oct 27 18:44:13.284199 n-d-860687-3 devstack@n-api.service[127019]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 18:44:13.284464 n-d-860687-3 devstack@n-api.service[127019]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 18:44:13.284464 n-d-860687-3 devstack@n-api.service[127019]: nodename: n-d-860687-3 Oct 27 18:44:13.284464 n-d-860687-3 devstack@n-api.service[127019]: machine: x86_64 Oct 27 18:44:13.284464 n-d-860687-3 devstack@n-api.service[127019]: clock source: unix Oct 27 18:44:13.284464 n-d-860687-3 devstack@n-api.service[127019]: pcre jit disabled Oct 27 18:44:13.284464 n-d-860687-3 devstack@n-api.service[127019]: detected number of CPU cores: 4 Oct 27 18:44:13.284464 n-d-860687-3 devstack@n-api.service[127019]: current working directory: / Oct 27 18:44:13.284464 n-d-860687-3 devstack@n-api.service[127019]: detected binary path: /usr/bin/uwsgi-core Oct 27 18:44:13.284464 n-d-860687-3 devstack@n-api.service[127019]: your processes number limit is 47680 Oct 27 18:44:13.284464 n-d-860687-3 devstack@n-api.service[127019]: your memory page size is 4096 bytes Oct 27 18:44:13.284464 n-d-860687-3 devstack@n-api.service[127019]: detected max file descriptor number: 2048 Oct 27 18:44:13.284464 n-d-860687-3 devstack@n-api.service[127019]: lock engine: pthread robust mutexes Oct 27 18:44:13.285260 n-d-860687-3 devstack@n-api.service[127019]: thunder lock: enabled Oct 27 18:44:13.285260 n-d-860687-3 devstack@n-api.service[127019]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 18:44:13.285260 n-d-860687-3 devstack@n-api.service[127019]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 18:44:13.328020 n-d-860687-3 devstack@n-api.service[127019]: Python main interpreter initialized at 0x55898b49a9c0 Oct 27 18:44:13.328020 n-d-860687-3 devstack@n-api.service[127019]: python threads support enabled Oct 27 18:44:13.328020 n-d-860687-3 devstack@n-api.service[127019]: your server socket listen backlog is limited to 100 connections Oct 27 18:44:13.328020 n-d-860687-3 devstack@n-api.service[127019]: your mercy for graceful operations on workers is 90 seconds Oct 27 18:44:13.328470 n-d-860687-3 devstack@n-api.service[127019]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 18:44:13.328470 n-d-860687-3 devstack@n-api.service[127019]: *** Operational MODE: preforking *** Oct 27 18:44:13.328722 n-d-860687-3 devstack@n-api.service[127019]: *** uWSGI is running in multiple interpreter mode *** Oct 27 18:44:13.328722 n-d-860687-3 devstack@n-api.service[127019]: spawned uWSGI master process (pid: 127019) Oct 27 18:44:13.328923 n-d-860687-3 systemd[1]: Started Devstack devstack@n-api.service. Oct 27 18:44:13.334410 n-d-860687-3 devstack@n-api.service[127019]: spawned uWSGI worker 1 (pid: 127028, cores: 1) Oct 27 18:44:13.334410 n-d-860687-3 devstack@n-api.service[127019]: spawned uWSGI worker 2 (pid: 127029, cores: 1) Oct 27 18:44:13.334410 n-d-860687-3 devstack@n-api.service[127019]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 18:44:14.004842 n-d-860687-3 devstack@n-api.service[127029]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 18:44:14.009334 n-d-860687-3 devstack@n-api.service[127028]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 18:44:15.262851 n-d-860687-3 devstack@n-api.service[127029]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 18:44:15.262851 n-d-860687-3 devstack@n-api.service[127029]: from cryptography.utils import int_from_bytes Oct 27 18:44:15.263475 n-d-860687-3 devstack@n-api.service[127029]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 18:44:15.263475 n-d-860687-3 devstack@n-api.service[127029]: from cryptography.utils import int_from_bytes Oct 27 18:44:15.288946 n-d-860687-3 devstack@n-api.service[127028]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 18:44:15.288946 n-d-860687-3 devstack@n-api.service[127028]: from cryptography.utils import int_from_bytes Oct 27 18:44:15.289776 n-d-860687-3 devstack@n-api.service[127028]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 18:44:15.289776 n-d-860687-3 devstack@n-api.service[127028]: from cryptography.utils import int_from_bytes Oct 27 18:44:17.759581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 18:44:17.760113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 18:44:17.760379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 18:44:17.760757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 18:44:17.761024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 18:44:17.761428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.761752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.762083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.762428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.762772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.763096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.763439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.763759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.764663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.764942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.765304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.765613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860687-3 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.765928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.766249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.766600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.766931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.767248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.767580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.767898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.768406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.768859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.769178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.769594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.769846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.770242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.770581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.772417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.772549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 18:44:17.775993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.776080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 18:44:17.776173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.776173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.776328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 18:44:17.776406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860687-3 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.776488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 18:44:17.776488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 18:44:17.776637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.776637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.776777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.776857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.776937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.776937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.777082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.777162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.777241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.777318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.777396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.777479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.777550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.777627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.777704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.777787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.777867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.777943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.778023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.778102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.778183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.778253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.778338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.778867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860687-3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.779033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.779197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.779341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.779544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.779706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.780012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.780178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.780322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.780464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.780619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.780771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.780914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.781067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.781220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.781378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.781378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.781663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.781831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.781984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.781984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.782263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.782465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.782628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.782777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.782929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.782929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.783218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.783368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.783518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.783669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.783812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.783961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.784118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.784261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.784410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.784564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.784722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.784865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.785023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860687-3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.785167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.785309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.785449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.785596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.785748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.785901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.786268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.786465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.786617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.786781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.786942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.787093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.787248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.787399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.787541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.787698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.787849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.788000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.788149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.788293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.788433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.788592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.788761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.788917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.789073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.789224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.789636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.789788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.789929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.790080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.790221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.790371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.790562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.790707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.790857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.791009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.791166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.791309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.791309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.791605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.791756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.791948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.792093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.792234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.792385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.792529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.792529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.792796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.792796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.793091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.793233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.793385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.793530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.793680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.793830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.793983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.794134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.794289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.794557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.794730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.794948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.795597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.795746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.795888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.796042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.796288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.796530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.796680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.796837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.796979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.797121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.797263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.797434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.797588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.797743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.797892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.798035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.798177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.798333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.798523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.798668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.798821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.798821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.799091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.799242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.799403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.799554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.799704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.799856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.800007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.800150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.800291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.800443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.800585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.800732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.800882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.801031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.801184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.801339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.801488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.801638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.801788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.801931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.802071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.802224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.802367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.802549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.802704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.802855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.803006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.803006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.803303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.803463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.803604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.803752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.803900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.804056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.804207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.804357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.804507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.804663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.804814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.804964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.805117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.805266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.805408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.805548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.805703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.805846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.805994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.806143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.806301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.806556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.806800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.806949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.807090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.807243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.807385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.807533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.807689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.807832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.807980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.808122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.808263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.808413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.808555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.808704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.808865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.809014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.809173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.809332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.809481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.809624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.809774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.809931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.810073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.810222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.810371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.810561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.810561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.811487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.811649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.811793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.811942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.812093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.812250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.812394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.812543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.812696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.812839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.812991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.813135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.813284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.813436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.813588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.813741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.813893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.814037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.814189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.814332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.814518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.814673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.814829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.814829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.815109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.815250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.815402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.815555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.815707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.815857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.816000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.816140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.816289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.816289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.816674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.816848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.817091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.817247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.817403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.817572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.817728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.817872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.818022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.818172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.818314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.818500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.818645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.818787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.818941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.819093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.819244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.819387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 18:44:17.819557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.819711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.819861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.820004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.820153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.820302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.820462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.820614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.820757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.820906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.821050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.821198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.821457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.821619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.821762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.821914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.822056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.822208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.822351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.822568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.822721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.822873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.823015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.823171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.823315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.823474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.823617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.823758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.823901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.824051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.824193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.824341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.824491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.824641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.824784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.824939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.825094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.825297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.825479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.825632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.825785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.825928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.826071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.826220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.826451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.826674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.826909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.827148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.827390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.827541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.827686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.827848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.828007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.828151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.828292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.828434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.828583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.828734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.828896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.829040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.829183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.829333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.829475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.829631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.829805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.829957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.830109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.830260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.830422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.830590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.830735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.830885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.831027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.831176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.831326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.831486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.831647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.831798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.831948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.832090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.832239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.832395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.832545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.832695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.832845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.832989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.833143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.833286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.833436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.833587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.833729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.833879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.834030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.834218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.834369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.834549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.834703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.834847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.835002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.835144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.835286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.835429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.835590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.835743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.835894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.836037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.836179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.836321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.836473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.836643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.836796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.837033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.837184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.837328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.837570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.837748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.837893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.838035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.838183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.838378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.838576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.838826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.838986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.839131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.839274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.839424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.839566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.839731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.839883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.840056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.840200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.840349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.840349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.840632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.840783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.840940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.841097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.841249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.841406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.841557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.841718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.841877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.842050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.842204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.842527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.842683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.842837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.842981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.843135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.843278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.843430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.843580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.843732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.843888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.844039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.844192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.844343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.844486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.844638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.844789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.844932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.844932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.845220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.845371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.845514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.845656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.845808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.845961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.846105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.846255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.846423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.846585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.846730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.846886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.847068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.847288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.847444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.847588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.847754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.848008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.848161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.848303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.848453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.848604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.848771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.848924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.849080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.849224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.849367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.849518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.849675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.849838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.849991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.850144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.850144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.850489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.850727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.850874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.851024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.851168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.851317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.851460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.851616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.851772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.851936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.852088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.852245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.852407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.852551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.852701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.852852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.852994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.853145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.853303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.853446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.853595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.853738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.853896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.854040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.854191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.854334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.854500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.854655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.854798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.854940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.855091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.855242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.855392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.855535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.855685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.855858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.856010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.856167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.856316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.856476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.856633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.856797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.856955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.858426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.858603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.858774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.858927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.859100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.859258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.859419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.859578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.859728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.859876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.860034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.860192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.860349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.860499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.860815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.860992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.861155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.861332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.861492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.861651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.861809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.861967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.862118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.862266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.862461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.862627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.862778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.862942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.863092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.863239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.863410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.863561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.863709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.863868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.864026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.864186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.864335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.864482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.864639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.864798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.864948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.865104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.865261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.865429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.865588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.865745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.865903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.866053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.866201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.866357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.866571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.866723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.866872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.867021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.867170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.867327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.867495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.867645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.867794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.867943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.868092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.868240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.868582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.868750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.868901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.869059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.869209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.869367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.869538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.869688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.869845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.870340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.870524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.870694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.870854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.870854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.871165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.871334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.871672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.871840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.871992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.872163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.872314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.872474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.872624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.872783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.872933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.873091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.873356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.873519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.873678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.873829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.874025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.874187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.874351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.874527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.874699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.874857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.875015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.875166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.875316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.875465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.875627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.875786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.875786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.876078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.876229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.876397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.876558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.876708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.876865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.877024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.877174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.877341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.877500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.877663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.877813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.877982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.878134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.878302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.878708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.878881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.879040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.879201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.879360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.879519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.879678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.879828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.879991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.880141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.880290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.880445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.880608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.880776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.880990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.881150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.881300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.881457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.881617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.881768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.881926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.882084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.882242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.882418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.882577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.882752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.882911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.883061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.883210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.883358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.883515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.883675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.883825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.883974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.884130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.884286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.884286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.884583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.884749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.884899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.885056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.885206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.885354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.885555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.885878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.886046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.886208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.886494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.886655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.886807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.886968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.887119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.887282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.887433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.887583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.887740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.887899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.888051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.888051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.888356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.888517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.888693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.889559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.889746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.889900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.890052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.890209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.890360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.890536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.890707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.890859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.891010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.891158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.891316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.891485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.891645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.891806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.892007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.892165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.892323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.892474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.892638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.892790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.892939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.893089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.893247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.893407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.893571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.893723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.893882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.894033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.894183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.894425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.894585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.894747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.894899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.895049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.895199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.895362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.895520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.895670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.895830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.895990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.896141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.896309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.896468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.896627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.896786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.896945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.897104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.897263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.897414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.897563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.897713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.897881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.898046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.898196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.898346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.898548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.898709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.898861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.899031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.899191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.899349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.899601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.899843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.899999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.900173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.900325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.900475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.900623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.900779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.900944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.901095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.901244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.901393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.901542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.901691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.901849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.901999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.902159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.902309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.902482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.902647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.902807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.902958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.903108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.903265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.903422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.903572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.903738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.903897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.904067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.904218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.904375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.904632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.904787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.904936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.905094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.905244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.905402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.905566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.905726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.905726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.906022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.906190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.906349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.906583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.906744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.906895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.907043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.907201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.907350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.907508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.907660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.907812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.907960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.908118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.908297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.908450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.908607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.908758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.908934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.909094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.909260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.909420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.909591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.909832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.910075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.910231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.910495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.910680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.910832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.910991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.911149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.911299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.911459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.911609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.911766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.911917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.912076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.912226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.912385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.912543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.912711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.912862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.913021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.913182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.913340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.913498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.913650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.913799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.913948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.914107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.914107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.914670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.914834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.914985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.915144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.915305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.915456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.915664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.915906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.916129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.916292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.916443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.916443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.916743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.916900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.917071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.917237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.917388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.917550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.917701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.917851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.918014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.918014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.918309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.918482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.918635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.918635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.918959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.919129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.919281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.919431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.919580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.919580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.919980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.920783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.920941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.921100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.921259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.921418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.921578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.921768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.921945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.922106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.922264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.922473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.922633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.922784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.922784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.923080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.923240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.923467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.923621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.923770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.923931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.924087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.924237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.924432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.924600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.924752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.924900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.925056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.925207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.925369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.925527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.925679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.925828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.925828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.926146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.926298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.926467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.926624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.926786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.926946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.927114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.927265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.927424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.927584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.927744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.927895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.928070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.928222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.928387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.928588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.928753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.928913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.929077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.929251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.929405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.929556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.929705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.929870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.930119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.930119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.930456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.930622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.930798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.931127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.931285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.931442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.931602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.931760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.931922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.932086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.932245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.932411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.932562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.932711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.932860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.933020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.933170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.933327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.933485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.933636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.933794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.933954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.934113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.934271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.934449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.934607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.934774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.934925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.935082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.935233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.935382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.935538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.935785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.935950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.936113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.936278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.936440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.936611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.936762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.936912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.937070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.937221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.937385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.937385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.937672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.937672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.937964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.938114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.938273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.938464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.938622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.938772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.938928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.939105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.939362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.939527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.939679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.939835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.939986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.940163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.940385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.940548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.940710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.940860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.941025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.941191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.941361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.941606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.941770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.941921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.942071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.942235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.942405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.942573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.942732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.942894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.943053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.943217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.943377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.943537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.943689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.943853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.944014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.944172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.944330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.944481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.944630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.944794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.944968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.945128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.945278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.945427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.945585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.945585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.945894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.945894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.946189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.946189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.946575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.946740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.946901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.947060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.947225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.947378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.947527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.947691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.947849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.948001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.948150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.948307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.948466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.948630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.948782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.948942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.949091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.949262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.949426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.949631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.949797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.949948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.950095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.950187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.950285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.950406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.950507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.950594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.950687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.950774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.950872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.950958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.950958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.951108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.951188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.951277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.952052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.952129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.952201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.952271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.952349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.952421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.952568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.952652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.952725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.952795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.952865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.952949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.953022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.953091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.953161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.953230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.953300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.953382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.953455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.953535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.953607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.953676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.953745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.953825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.953905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.953977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.954047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.954116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.954194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.954274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.954355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.954505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.954584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.954654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.954752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.954833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.954906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.954975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.955053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.955132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.955218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.955298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.955370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.955446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.955518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.955587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.955666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.955745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.955745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.955890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.955969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.956047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.956131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.956203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.956203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.956328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.956398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.956475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.956554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.956554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.956688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.956760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.956760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.956897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.956970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.957039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.957128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.957128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.957128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.957128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.957128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.957451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.957529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.957599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.957669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.957750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.957823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.957892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.957961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.958037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.958123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.958195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.958265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.958333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.958426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.958502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.958586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.958586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.958723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.958803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.958881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.959086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.959179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.959485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.959652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.959825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.959993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.960162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.960318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.960497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.960637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.960829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.960998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.961208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.961303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.961540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.961622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.961864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.961961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.962219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.962305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.963777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.963908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.964021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.964147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.964269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.964381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.964493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.964604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.964714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.964838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.964951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.965069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.965188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.965308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.965421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.965561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.965682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.965794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.965912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.966030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.966168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.966282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.966422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.966541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.966664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.966787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.966969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.967156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.967287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.967417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.967537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.967664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.967785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.967905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.968090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.968222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.968420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.968552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.968771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.968893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.969105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.969224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.969422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.969552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.969738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.969860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.970063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.970184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.970574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.970748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.970904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.971057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.971202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.971353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.971507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.971673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.971819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.971970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.971970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.972454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.972612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.972756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.972900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.973559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.973716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.973862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.974021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.974165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.974321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.974501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.974501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.974802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.974949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.975092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.975241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.975393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.975537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.975779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.975935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.976080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.976223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.976378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.976523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.976681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.976825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.976976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.977121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.977263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.977415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.977569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.977722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.977866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.978016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.978304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.978548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.978699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.978699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.978981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.979125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.979267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.979423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.979574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.979718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.979860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.980002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.980153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.980317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.980462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.980605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.980747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.980890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.981032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.981184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.981329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.981472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.981627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.981627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.981913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.982065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.982281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.983590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.983762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.983925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.984088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.984239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.984398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.984550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.984707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.984860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.985019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.985171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.985329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.985496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.985657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.985809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.985968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.986120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.986270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.986458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.986630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.986804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.986955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.987117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.987269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.987419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.987583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.987747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.987906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.988057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.988206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.988447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.988615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.988777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.988777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.989073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.989232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.989381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.989543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.989714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.989866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.990016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.990165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.990313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.990502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.990664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.990816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.990816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.991100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.991249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.991413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.991594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.991748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.991897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.992096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.992260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.992421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.992598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.992839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.992995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.993153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.993786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.993959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.994121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.994294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.994294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.994622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.994787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.994939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.995097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.995255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.995405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.995563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.995728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.995881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.996039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.996201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.996358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.996509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.996672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.996822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.996974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.997123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.997273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.997432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.997583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.997741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.997899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.998051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.998283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.999054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.999213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.999372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.999523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.999672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.999822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:17.999985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.000138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.000295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.000454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.000605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.000781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.000941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.001106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.001273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.001424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.001589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.001754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.001906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.002056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.002213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.002371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.002549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.002717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.002991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.003151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.003311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.003950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.004122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.004122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.004422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.004573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.004723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.004882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.005046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.005198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.005359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.005509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.005658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.005809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.005977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.006143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.006296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.006480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.006686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.006854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.007023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.007182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.007352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.007505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.007654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.007883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.008037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.008186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.008335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.008486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.008635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.008795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.008945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.009186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.009346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.010142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.010301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.010525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.010682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.010840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.011000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.011152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.011301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.011457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.011620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.011771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.011930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.012096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.012254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.012405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.012555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.012706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.012871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.013136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.013303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.013463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.014702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.014882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.015037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.015199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.015350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.015508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.015660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.015826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.015826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.016121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.016121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.016416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.016416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.016725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.016886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.017045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.017215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.017366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.017523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.017681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.017833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.017990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.018141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.018289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.018474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.018632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.018782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.018940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.019099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.019366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.019537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.019689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.019839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.019992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.020142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.020291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.020455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.020606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.020757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.020907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.021067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.021219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.021397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.021557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.021711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.021861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.022018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.022185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.022336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.022614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.022949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.023039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.023156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.023261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.023349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.023440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.023533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.023625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.023944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.024052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.024191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.024305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.024435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.024911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.025077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.025212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.025307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.025392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.025477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.025569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.025669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.025764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.025849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.025943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.026030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.026123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.026226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.026321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.026442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.026533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.026625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.026625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.026625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.026625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.026625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.027017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.027102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.027244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.027347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.027347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.027504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.027589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.027679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.027774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.027859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.027953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.028039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.028123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.028206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.028303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.028388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.028480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.028572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.028657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.028750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.028836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.028919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.029003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.029092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.029177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.029269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.029376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.029565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.029718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.029825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.029901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.029998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.030085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.030202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.030339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.030474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.030641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.030769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.030981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.031090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.031336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.031431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.031654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.031764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.032005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.032107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.032268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 18:44:18.032373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.032649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.032968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.033283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 18:44:18.033529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 18:44:18.096929 n-d-860687-3 devstack@n-api.service[127028]: INFO dbcounter [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] Registered counter for database nova_api Oct 27 18:44:18.097536 n-d-860687-3 devstack@n-api.service[127029]: INFO dbcounter [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] Registered counter for database nova_api Oct 27 18:44:18.118277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_db.sqlalchemy.engines [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:44:18.119903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_db.sqlalchemy.engines [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:44:18.126412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writer thread running {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:44:18.129061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writer thread running {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:44:18.187694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.context [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af35862a-071a-430c-affa-82567dc9805c(cell1) {{(pid=127028) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 18:44:18.187947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.context [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af35862a-071a-430c-affa-82567dc9805c(cell1) {{(pid=127029) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 18:44:18.191816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:44:18.191932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:44:18.192300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:44:18.192422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:44:18.193929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:44:18.194045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:44:18.194695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:44:18.194798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:44:18.195149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:44:18.195248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:44:18.197158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:44:18.197288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:44:18.199219 n-d-860687-3 devstack@n-api.service[127028]: INFO dbcounter [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] Registered counter for database nova_cell0 Oct 27 18:44:18.199350 n-d-860687-3 devstack@n-api.service[127029]: INFO dbcounter [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] Registered counter for database nova_cell0 Oct 27 18:44:18.203651 n-d-860687-3 devstack@n-api.service[127029]: INFO dbcounter [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] Registered counter for database nova_cell1 Oct 27 18:44:18.204176 n-d-860687-3 devstack@n-api.service[127028]: INFO dbcounter [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] Registered counter for database nova_cell1 Oct 27 18:44:18.216463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_db.sqlalchemy.engines [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:44:18.218953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_db.sqlalchemy.engines [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:44:18.221413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_db.sqlalchemy.engines [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:44:18.223211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writer thread running {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:44:18.224027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_db.sqlalchemy.engines [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:44:18.227499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writer thread running {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:44:18.371076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writer thread running {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:44:18.371952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writer thread running {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:44:18.381453 n-d-860687-3 devstack@n-api.service[127029]: INFO dbcounter [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] Registered counter for database nova_cell0 Oct 27 18:44:18.382584 n-d-860687-3 devstack@n-api.service[127028]: INFO dbcounter [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] Registered counter for database nova_cell0 Oct 27 18:44:18.389054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_db.sqlalchemy.engines [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:44:18.391342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_db.sqlalchemy.engines [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 18:44:18.393912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writer thread running {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:44:18.395772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writer thread running {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 18:44:18.719503 n-d-860687-3 devstack@n-api.service[127029]: WARNING keystonemiddleware.auth_token [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 18:44:18.726818 n-d-860687-3 devstack@n-api.service[127029]: WARNING keystonemiddleware.auth_token [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 18:44:18.730955 n-d-860687-3 devstack@n-api.service[127028]: WARNING keystonemiddleware.auth_token [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 18:44:18.738813 n-d-860687-3 devstack@n-api.service[127028]: WARNING keystonemiddleware.auth_token [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 18:44:19.077406 n-d-860687-3 devstack@n-api.service[127029]: WARNING keystonemiddleware.auth_token [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 18:44:19.083395 n-d-860687-3 devstack@n-api.service[127029]: WARNING keystonemiddleware.auth_token [None req-d5e91b60-5cfc-41b1-8a3b-891d5ed1bd2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 18:44:19.088721 n-d-860687-3 devstack@n-api.service[127029]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55898b49a9c0 pid: 127029 (default app) Oct 27 18:44:19.093734 n-d-860687-3 devstack@n-api.service[127028]: WARNING keystonemiddleware.auth_token [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 18:44:19.099743 n-d-860687-3 devstack@n-api.service[127028]: WARNING keystonemiddleware.auth_token [None req-803a6d55-e32d-4b0c-818a-a493d04b423f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 18:44:19.105031 n-d-860687-3 devstack@n-api.service[127028]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55898b49a9c0 pid: 127028 (default app) Oct 27 18:44:59.027063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:44:59.028306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:44:59.029630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:44:59.030374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:44:59.227732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:44:59.228857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:44:59.230067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:44:59.231046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:00.103676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-50d11111-357e-401d-9dee-aff5c2b8f479 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-488849566", "id": 1343395640, "os-flavor-access:is_public": "True"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:00.159716 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-50d11111-357e-401d-9dee-aff5c2b8f479 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 1.143999 Oct 27 18:45:00.160470 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:44:59 2022] POST /compute/v2.1/flavors => generated 429 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:00.176937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8053b034-8a60-4279-b07a-b65c5d5a1f50 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:00.204778 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8053b034-8a60-4279-b07a-b65c5d5a1f50 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1343395640" status: 202 len: 0 microversion: 2.1 time: 0.031942 Oct 27 18:45:00.205357 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2/2] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:45:00 2022] DELETE /compute/v2.1/flavors/1343395640 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:00.213024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a8385e8d-343b-41fd-acfe-63749dd68e55 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:00.244314 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a8385e8d-343b-41fd-acfe-63749dd68e55 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034685 Oct 27 18:45:00.244897 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3/3] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:00.265937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-294fa519-3f66-4a3b-bc89-975866bddc02 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-509317219", "id": 2073525646, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:00.285559 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-294fa519-3f66-4a3b-bc89-975866bddc02 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.023813 Oct 27 18:45:00.286371 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4/4] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:00 2022] POST /compute/v2.1/flavors => generated 416 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:45:00.298790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cb1abe3f-56bc-42c8-9853-f7a6a661f52f tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:00.320680 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cb1abe3f-56bc-42c8-9853-f7a6a661f52f tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.025432 Oct 27 18:45:00.322542 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 5/5] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:00 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:00.347257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-25d8353e-28b9-41bb-918e-47adf05a7836 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:00.373525 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-25d8353e-28b9-41bb-918e-47adf05a7836 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/2073525646" status: 202 len: 0 microversion: 2.1 time: 0.036088 Oct 27 18:45:00.374260 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 6/6] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:45:00 2022] DELETE /compute/v2.1/flavors/2073525646 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:00.505697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-27622935-09c7-4a4d-8eb9-e1ef804fd14c tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-928054826", "ram": 512, "vcpus": 1, "disk": 10, "id": 1609434799, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:00.566176 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-27622935-09c7-4a4d-8eb9-e1ef804fd14c tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 1.345608 Oct 27 18:45:00.567048 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1/7] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:44:59 2022] POST /compute/v2.1/flavors => generated 415 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:00.694585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e9fe0b12-6efd-44b3-93a7-33c922372c67 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Calling method '.version_select at 0x7fc87099c670>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:00.703841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e9fe0b12-6efd-44b3-93a7-33c922372c67 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af35862a-071a-430c-affa-82567dc9805c(cell1) {{(pid=127029) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 27 18:45:00.704705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9fe0b12-6efd-44b3-93a7-33c922372c67 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:00.705373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9fe0b12-6efd-44b3-93a7-33c922372c67 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:00.705911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9fe0b12-6efd-44b3-93a7-33c922372c67 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:00.733709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9fe0b12-6efd-44b3-93a7-33c922372c67 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:00.734293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9fe0b12-6efd-44b3-93a7-33c922372c67 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:00.734836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9fe0b12-6efd-44b3-93a7-33c922372c67 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:00.757884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9fe0b12-6efd-44b3-93a7-33c922372c67 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:00.758582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9fe0b12-6efd-44b3-93a7-33c922372c67 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:00.758850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9fe0b12-6efd-44b3-93a7-33c922372c67 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:00.766568 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e9fe0b12-6efd-44b3-93a7-33c922372c67 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.391101 Oct 27 18:45:00.767159 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 7/8] 10.222.0.42 () {60 vars in 1208 bytes} [Thu Oct 27 18:45:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:45:00.771560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bbf4de7b-b260-43a0-8a7d-e54725286f1e tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:00.791775 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bbf4de7b-b260-43a0-8a7d-e54725286f1e tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.023588 Oct 27 18:45:00.792335 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 8/9] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:00 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:00.910512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-af9817b6-f67f-4637-802d-4db297b6e194 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '.version_select at 0x7fc870af1e50>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:00.917857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-af9817b6-f67f-4637-802d-4db297b6e194 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af35862a-071a-430c-affa-82567dc9805c(cell1) {{(pid=127028) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 27 18:45:00.918662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af9817b6-f67f-4637-802d-4db297b6e194 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:00.919091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af9817b6-f67f-4637-802d-4db297b6e194 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:00.920151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af9817b6-f67f-4637-802d-4db297b6e194 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:00.949429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af9817b6-f67f-4637-802d-4db297b6e194 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:00.949916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af9817b6-f67f-4637-802d-4db297b6e194 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:00.950352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af9817b6-f67f-4637-802d-4db297b6e194 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:00.963868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af9817b6-f67f-4637-802d-4db297b6e194 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:00.964344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af9817b6-f67f-4637-802d-4db297b6e194 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:00.964843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af9817b6-f67f-4637-802d-4db297b6e194 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:00.972318 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-af9817b6-f67f-4637-802d-4db297b6e194 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.404076 Oct 27 18:45:00.972886 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2/10] 10.222.0.42 () {58 vars in 1167 bytes} [Thu Oct 27 18:45:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:01.001955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5ff65f06-810b-4723-8976-9b9d0751774f tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:01.021735 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-5ff65f06-810b-4723-8976-9b9d0751774f tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] HTTP exception thrown: Flavor 1609434799 has no extra specs with key hw:cpu_thread_policy. Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5ff65f06-810b-4723-8976-9b9d0751774f tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Request method failure captured: Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/flavors/1609434799/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGotH_a5CipJ2xme4PV5YKTajugiuzbxJ5QcUFQsJywEYw-MMHO-cM_0dp-h8P2yKM-OWfkpnO04gdalXi20HyxotA9lNCk8WvdDTBWgViaDel9lsWHdDjT7u7st3raOrfW12vvkUmFSytYXDLUCOcLPwie-UAXogyOHTzuKObapos Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f8a4b87214e9455ca7e9b812d180dbbe Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:45:01.024433 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:45:01.025799 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f8a4b87214e9455ca7e9b812d180dbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f8a4b87214e9455ca7e9b812d180dbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f8a4b87214e9455ca7e9b812d180dbbe", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f8a4b87214e9455ca7e9b812d180dbbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:01.025799 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 Oct 27 18:45:01.025799 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f8a4b87214e9455ca7e9b812d180dbbe Oct 27 18:45:01.025799 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 Oct 27 18:45:01.025799 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project Oct 27 18:45:01.025799 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:01.025799 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:01.025799 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: bbb9e9c440d4437bade7844176a3c64d Oct 27 18:45:01.025799 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project Oct 27 18:45:01.025799 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:01.025799 n-d-860687-3 devstack@n-api.service[127029]: exception: Flavor 1609434799 has no extra specs with key hw:cpu_thread_policy. Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'flavor_id': '1609434799', 'id': 'hw:cpu_thread_policy'} Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1609434799 has no extra specs with key hw:cpu_thread_policy. Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:01.026620 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:01.028028 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:01.028028 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:01.028028 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:01.028028 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:01.028028 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:01.028028 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1609434799 has no extra specs with key hw:cpu_thread_policy. Oct 27 18:45:01.028028 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:01.028028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5ff65f06-810b-4723-8976-9b9d0751774f tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Returning 404 to user: Flavor 1609434799 has no extra specs with key hw:cpu_thread_policy. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:01.028028 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5ff65f06-810b-4723-8976-9b9d0751774f tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] 10.222.0.42 "GET /compute/v2.1/flavors/1609434799/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.232220 Oct 27 18:45:01.028028 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 9/11] 10.222.0.42 () {58 vars in 1266 bytes} [Thu Oct 27 18:45:00 2022] GET /compute/v2.1/flavors/1609434799/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:01.100194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-253604572", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:01.213816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-204f47f6-2f0d-494b-9802-a7234fe96741 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:01.217837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-204f47f6-2f0d-494b-9802-a7234fe96741 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:01.218329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-204f47f6-2f0d-494b-9802-a7234fe96741 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:01.218803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-204f47f6-2f0d-494b-9802-a7234fe96741 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:01.219538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-204f47f6-2f0d-494b-9802-a7234fe96741 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:01.219993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-204f47f6-2f0d-494b-9802-a7234fe96741 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:01.220422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-204f47f6-2f0d-494b-9802-a7234fe96741 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:01.261049 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-204f47f6-2f0d-494b-9802-a7234fe96741 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.232985 Oct 27 18:45:01.261631 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 10/12] 10.222.0.42 () {58 vars in 1176 bytes} [Thu Oct 27 18:45:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:01.266279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6cfa3cf2-26e5-4aca-b89c-adf12cad5a6c tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1348898308"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:01.269768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.aggregate [None req-6cfa3cf2-26e5-4aca-b89c-adf12cad5a6c tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Generated uuid 1eb8d2b4-b3e0-4ecc-aa55-9eb61a511f9f for aggregate {{(pid=127029) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:01.327694 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6cfa3cf2-26e5-4aca-b89c-adf12cad5a6c tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.064869 Oct 27 18:45:01.328902 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 11/13] 10.222.0.42 () {62 vars in 1205 bytes} [Thu Oct 27 18:45:01 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:45:01.423637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:45:01.444055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-117649543", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:01.609014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:45:01.740385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:45:01.740963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:45:01.741544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:45:01.742027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:45:01.742665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:45:01.760699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:01.761184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:01.761619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:01.762342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:01.762819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:01.763345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:01.795897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Getting quotas for project 20f8835dd20640b7a48c16bfef72e4ad. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:45:01.802643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Getting quotas for user 77144d8cdd134333ae77e2df1c022ea8 and project 20f8835dd20640b7a48c16bfef72e4ad. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:45:01.814594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:45:01.817430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:45:01.886074 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-31f35b82-71da-4ed4-877c-988d5733b6a6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906531 Oct 27 18:45:01.887569 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3/14] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:45:01.894714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7c21ca2e-36fc-4234-a1f6-274c6df27f5e tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1881115876", "id": 1003511982, "os-flavor-access:is_public": "True"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:01.914000 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7c21ca2e-36fc-4234-a1f6-274c6df27f5e tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.025890 Oct 27 18:45:01.914791 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 4/15] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:01 2022] POST /compute/v2.1/flavors => generated 429 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:01.921921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-91dfb75d-d2e0-498a-a9c2-f1c148f68a61 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:01.922699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:45:01.923161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:45:01.923644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:45:01.924056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:45:01.924466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:45:01.927342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-91dfb75d-d2e0-498a-a9c2-f1c148f68a61 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'bbb9e9c440d4437bade7844176a3c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a4b87214e9455ca7e9b812d180dbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-91dfb75d-d2e0-498a-a9c2-f1c148f68a61 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Request method failure captured: Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/flavors/1609434799/os-extra_specs HTTP/1.1 Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 66 Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGotH_a5CipJ2xme4PV5YKTajugiuzbxJ5QcUFQsJywEYw-MMHO-cM_0dp-h8P2yKM-OWfkpnO04gdalXi20HyxotA9lNCk8WvdDTBWgViaDel9lsWHdDjT7u7st3raOrfW12vvkUmFSytYXDLUCOcLPwie-UAXogyOHTzuKObapos Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f8a4b87214e9455ca7e9b812d180dbbe Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:45:01.931617 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:45:01.932782 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f8a4b87214e9455ca7e9b812d180dbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f8a4b87214e9455ca7e9b812d180dbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f8a4b87214e9455ca7e9b812d180dbbe", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f8a4b87214e9455ca7e9b812d180dbbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:01.932782 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 Oct 27 18:45:01.932782 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f8a4b87214e9455ca7e9b812d180dbbe Oct 27 18:45:01.932782 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 Oct 27 18:45:01.932782 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project Oct 27 18:45:01.932782 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:01.932782 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:01.932782 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: bbb9e9c440d4437bade7844176a3c64d Oct 27 18:45:01.932782 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project Oct 27 18:45:01.932782 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:45:01.932782 n-d-860687-3 devstack@n-api.service[127028]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 27 18:45:01.932782 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'flavor_id': '1609434799', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:45:01.933431 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 27 18:45:01.934528 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:01.936526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-91dfb75d-d2e0-498a-a9c2-f1c148f68a61 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:01.936964 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-91dfb75d-d2e0-498a-a9c2-f1c148f68a61 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] 10.222.0.42 "POST /compute/v2.1/flavors/1609434799/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.020236 Oct 27 18:45:01.938046 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 5/16] 10.222.0.42 () {60 vars in 1224 bytes} [Thu Oct 27 18:45:01 2022] POST /compute/v2.1/flavors/1609434799/os-extra_specs => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:01.945000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:01.945882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:01.946414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:01.947219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:01.947751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:01.948295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:01.984962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Getting quotas for project ee37570c43c8438faad6c2bcdbacce99. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:45:01.991629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Getting quotas for user 6a0b4798f17b408dab3af2ae0d2a45b7 and project ee37570c43c8438faad6c2bcdbacce99. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:45:02.004461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:45:02.007318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:45:02.057445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9835a87b-23c1-447e-b987-2eaa4455ec92 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-757584770", "id": 577737158, "os-flavor-access:is_public": "False"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:02.065827 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-765700d8-9410-4d32-bf80-53ae4d9992d1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735622 Oct 27 18:45:02.067050 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 12/17] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:45:02.086818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9e3bab15-e56c-4cb9-b77f-e1349298adbf tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-668689539"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:02.087537 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9835a87b-23c1-447e-b987-2eaa4455ec92 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.148249 Oct 27 18:45:02.088695 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 6/18] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:01 2022] POST /compute/v2.1/flavors => generated 435 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:02.104446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eadbbfaa-5187-43c3-9084-4c388ec12ae9 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:02.105316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eadbbfaa-5187-43c3-9084-4c388ec12ae9 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:02.215307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-eadbbfaa-5187-43c3-9084-4c388ec12ae9 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:02.238102 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eadbbfaa-5187-43c3-9084-4c388ec12ae9 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1219 microversion: 2.1 time: 0.148139 Oct 27 18:45:02.244142 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 7/19] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:02 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:02.249808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-90f35bc5-575c-4471-92c4-18c441f18d1b tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:02.253796 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9e3bab15-e56c-4cb9-b77f-e1349298adbf tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.185196 Oct 27 18:45:02.254503 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 13/20] 10.222.0.42 () {62 vars in 1210 bytes} [Thu Oct 27 18:45:02 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:45:02.261472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-03ec3f7c-f23c-4893-9310-397c2c7b8e56 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:02.288465 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-90f35bc5-575c-4471-92c4-18c441f18d1b tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1003511982" status: 202 len: 0 microversion: 2.1 time: 0.042956 Oct 27 18:45:02.289504 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 8/21] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:45:02 2022] DELETE /compute/v2.1/flavors/1003511982 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:02.299477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0b22af32-1301-47d9-8046-2a2c1e459c90 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "feca7944715c4504ad119fcb288e0a89"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:02.313684 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-03ec3f7c-f23c-4893-9310-397c2c7b8e56 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1609434799/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.057396 Oct 27 18:45:02.314918 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 14/22] 10.222.0.42 () {60 vars in 1224 bytes} [Thu Oct 27 18:45:02 2022] POST /compute/v2.1/flavors/1609434799/os-extra_specs => generated 66 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:02.320938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-427316113", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:02.382479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:45:02.415476 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0b22af32-1301-47d9-8046-2a2c1e459c90 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/577737158/action" status: 200 len: 96 microversion: 2.1 time: 0.120536 Oct 27 18:45:02.416375 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 9/23] 10.222.0.42 () {60 vars in 1197 bytes} [Thu Oct 27 18:45:02 2022] POST /compute/v2.1/flavors/577737158/action => generated 96 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:02.422589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a9295395-e346-42dd-aeb5-4aa4dfc8406a tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:02.453427 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a9295395-e346-42dd-aeb5-4aa4dfc8406a tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.035972 Oct 27 18:45:02.454020 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 10/24] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Oct 27 18:45:02 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:45:02.465946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3946f544-f96d-43a8-ad2e-db7855967ac4 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:02.495456 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3946f544-f96d-43a8-ad2e-db7855967ac4 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.033020 Oct 27 18:45:02.496049 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 11/25] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:02 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:02.502413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b77b3b87-0350-4ee9-881f-6f9f15468ef8 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:02.504171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b77b3b87-0350-4ee9-881f-6f9f15468ef8 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'bbb9e9c440d4437bade7844176a3c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a4b87214e9455ca7e9b812d180dbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b77b3b87-0350-4ee9-881f-6f9f15468ef8 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Request method failure captured: Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/flavors/1609434799/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGotH_a5CipJ2xme4PV5YKTajugiuzbxJ5QcUFQsJywEYw-MMHO-cM_0dp-h8P2yKM-OWfkpnO04gdalXi20HyxotA9lNCk8WvdDTBWgViaDel9lsWHdDjT7u7st3raOrfW12vvkUmFSytYXDLUCOcLPwie-UAXogyOHTzuKObapos Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f8a4b87214e9455ca7e9b812d180dbbe Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:45:02.505857 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:45:02.507125 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f8a4b87214e9455ca7e9b812d180dbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f8a4b87214e9455ca7e9b812d180dbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f8a4b87214e9455ca7e9b812d180dbbe", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f8a4b87214e9455ca7e9b812d180dbbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:02.507125 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 Oct 27 18:45:02.507125 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f8a4b87214e9455ca7e9b812d180dbbe Oct 27 18:45:02.507125 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 Oct 27 18:45:02.507125 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project Oct 27 18:45:02.507125 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:02.507125 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:02.507125 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: bbb9e9c440d4437bade7844176a3c64d Oct 27 18:45:02.507125 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project Oct 27 18:45:02.507125 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:02.507125 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'flavor_id': '1609434799', 'id': 'hw:numa_nodes'} Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:02.507754 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 27 18:45:02.508846 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:02.510442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b77b3b87-0350-4ee9-881f-6f9f15468ef8 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:02.511568 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b77b3b87-0350-4ee9-881f-6f9f15468ef8 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] 10.222.0.42 "DELETE /compute/v2.1/flavors/1609434799/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.014262 Oct 27 18:45:02.512331 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 12/26] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 18:45:02 2022] DELETE /compute/v2.1/flavors/1609434799/os-extra_specs/hw:numa_nodes => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:02.518369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fed67a3b-2fa0-499b-8495-11740cd8cbd3 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "feca7944715c4504ad119fcb288e0a89"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:02.616671 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-fed67a3b-2fa0-499b-8495-11740cd8cbd3 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] HTTP exception thrown: Flavor access already exists for flavor 19 and project feca7944715c4504ad119fcb288e0a89 combination. Oct 27 18:45:02.619281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:45:02.619991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:45:02.620651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:45:02.621270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:45:02.621986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fed67a3b-2fa0-499b-8495-11740cd8cbd3 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Request method failure captured: Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/flavors/577737158/action HTTP/1.1 Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 67 Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGsLbp8MpBuhTA_UYIaKXWDgVdYBAfbrd5oqVZT3RAQj8PoOzymqpfvPbXG9fxgw4Bac3ZcEK9fS1MEtKwgT6_wdMGwXTm9wkDWA0FEH_kQgTP1kfRzdyIonfTjIIEx_VN-kopR3Ob6T9qCecN_Ovc5_mRqKJvsLFjYsyBb_89zTMs Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: c650c9e3f46b4eebbe354dd05694262c Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-808884614 Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 18:45:02.629534 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 18:45:02.631100 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c650c9e3f46b4eebbe354dd05694262c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c650c9e3f46b4eebbe354dd05694262c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c650c9e3f46b4eebbe354dd05694262c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c650c9e3f46b4eebbe354dd05694262c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:02.631100 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-808884614 Oct 27 18:45:02.631100 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: c650c9e3f46b4eebbe354dd05694262c Oct 27 18:45:02.631100 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-808884614 Oct 27 18:45:02.631100 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin Oct 27 18:45:02.631100 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:02.631100 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:02.631100 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 96cacc4822a647d4b219becbb2bd5a71 Oct 27 18:45:02.631100 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin Oct 27 18:45:02.631100 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:45:02.631100 n-d-860687-3 devstack@n-api.service[127028]: {"addTenantAccess": {"tenant": "feca7944715c4504ad119fcb288e0a89"}} Oct 27 18:45:02.631100 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: exception: Flavor access already exists for flavor 19 and project feca7944715c4504ad119fcb288e0a89 combination. Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '577737158', 'body': {'addTenantAccess': {'tenant': 'feca7944715c4504ad119fcb288e0a89'}}} Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result.read() Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 18:45:02.631935 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '19-feca7944715c4504ad119fcb288e0a89' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi session.flush() Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 18:45:02.632963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 18:45:02.634315 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 18:45:02.635320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result.read() Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '19-feca7944715c4504ad119fcb288e0a89' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 27, 18, 45, 2, 608738), 'updated_at': None, 'flavor_id': 19, 'project_id': 'feca7944715c4504ad119fcb288e0a89'}] Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:02.636654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 19 and project feca7944715c4504ad119fcb288e0a89 combination. Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:02.637602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 19 and project feca7944715c4504ad119fcb288e0a89 combination. Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:02.639184 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:02.640432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 19 and project feca7944715c4504ad119fcb288e0a89 combination. Oct 27 18:45:02.640432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:02.640432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fed67a3b-2fa0-499b-8495-11740cd8cbd3 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Returning 409 to user: Flavor access already exists for flavor 19 and project feca7944715c4504ad119fcb288e0a89 combination. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:02.640432 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fed67a3b-2fa0-499b-8495-11740cd8cbd3 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/577737158/action" status: 409 len: 152 microversion: 2.1 time: 0.118926 Oct 27 18:45:02.640432 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 13/27] 10.222.0.42 () {60 vars in 1197 bytes} [Thu Oct 27 18:45:02 2022] POST /compute/v2.1/flavors/577737158/action => generated 152 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:45:02.644025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d53152ec-90bc-47ec-abb9-c04edc789334 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-3"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:02.646458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:02.647103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:02.647706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:02.648795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:02.649549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:02.650213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:02.673814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Getting quotas for project ee37570c43c8438faad6c2bcdbacce99. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:45:02.678773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Getting quotas for user 6a0b4798f17b408dab3af2ae0d2a45b7 and project ee37570c43c8438faad6c2bcdbacce99. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:45:02.688379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d53152ec-90bc-47ec-abb9-c04edc789334 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:02.688878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d53152ec-90bc-47ec-abb9-c04edc789334 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:02.689325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d53152ec-90bc-47ec-abb9-c04edc789334 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:02.699423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:45:02.702988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:45:02.783501 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-290d0de5-48b3-442a-bf60-c399de78063d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.467229 Oct 27 18:45:02.789748 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 15/28] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:45:02.789748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-124bbf37-3213-4d7b-8974-bcb604f2a138 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1458696313", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:02.833201 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-124bbf37-3213-4d7b-8974-bcb604f2a138 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.047764 Oct 27 18:45:02.838912 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 16/29] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:02 2022] POST /compute/v2.1/flavors => generated 507 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:02.851958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d7229ce4-34d4-4ce2-a09f-a143088828d1 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:02.870285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=12,nova_api:DELETE=6,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:02.920299 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d7229ce4-34d4-4ce2-a09f-a143088828d1 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1609434799/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.078270 Oct 27 18:45:02.921469 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 17/30] 10.222.0.42 () {60 vars in 1224 bytes} [Thu Oct 27 18:45:02 2022] POST /compute/v2.1/flavors/1609434799/os-extra_specs => generated 66 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:02.927596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d7e952bc-9c9c-4f1a-95e8-ed3e10981908 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "feca7944715c4504ad119fcb288e0a89"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:03.053325 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d53152ec-90bc-47ec-abb9-c04edc789334 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.416235 Oct 27 18:45:03.053965 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 14/31] 10.222.0.42 () {62 vars in 1232 bytes} [Thu Oct 27 18:45:02 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:45:03.068206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a4561364-476c-47c5-bff7-1e359684d69d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.068920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a4561364-476c-47c5-bff7-1e359684d69d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:03.076802 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d7e952bc-9c9c-4f1a-95e8-ed3e10981908 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/577737158/action" status: 200 len: 21 microversion: 2.1 time: 0.154285 Oct 27 18:45:03.084101 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 18/32] 10.222.0.42 () {60 vars in 1197 bytes} [Thu Oct 27 18:45:02 2022] POST /compute/v2.1/flavors/577737158/action => generated 21 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:03.094438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-455ca3e6-4b64-4473-b5c3-db291233fe7c tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.136809 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-455ca3e6-4b64-4473-b5c3-db291233fe7c tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/5a829e93-21d5-4880-8b58-b1c56f168476" status: 202 len: 0 microversion: 2.1 time: 0.050323 Oct 27 18:45:03.137919 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 19/33] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:45:03 2022] DELETE /compute/v2.1/flavors/5a829e93-21d5-4880-8b58-b1c56f168476 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:03.144953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a4561364-476c-47c5-bff7-1e359684d69d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:03.147650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e42e2093-cf22-4bcc-b5ae-e547b3714d76 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:03.154597 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a4561364-476c-47c5-bff7-1e359684d69d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1213 microversion: 2.1 time: 0.089906 Oct 27 18:45:03.156943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e42e2093-cf22-4bcc-b5ae-e547b3714d76 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'bbb9e9c440d4437bade7844176a3c64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a4b87214e9455ca7e9b812d180dbbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:03.158682 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 15/34] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:03 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e42e2093-cf22-4bcc-b5ae-e547b3714d76 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Request method failure captured: Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/flavors/1609434799/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 22 Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGotH_a5CipJ2xme4PV5YKTajugiuzbxJ5QcUFQsJywEYw-MMHO-cM_0dp-h8P2yKM-OWfkpnO04gdalXi20HyxotA9lNCk8WvdDTBWgViaDel9lsWHdDjT7u7st3raOrfW12vvkUmFSytYXDLUCOcLPwie-UAXogyOHTzuKObapos Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f8a4b87214e9455ca7e9b812d180dbbe Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:45:03.163840 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:45:03.165809 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f8a4b87214e9455ca7e9b812d180dbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f8a4b87214e9455ca7e9b812d180dbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f8a4b87214e9455ca7e9b812d180dbbe", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f8a4b87214e9455ca7e9b812d180dbbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:03.165809 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 Oct 27 18:45:03.165809 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f8a4b87214e9455ca7e9b812d180dbbe Oct 27 18:45:03.165809 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 Oct 27 18:45:03.165809 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project Oct 27 18:45:03.165809 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:03.165809 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:03.165809 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: bbb9e9c440d4437bade7844176a3c64d Oct 27 18:45:03.165809 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project Oct 27 18:45:03.165809 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:45:03.165809 n-d-860687-3 devstack@n-api.service[127029]: {"hw:numa_nodes": "1"} Oct 27 18:45:03.165809 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:03.165809 n-d-860687-3 devstack@n-api.service[127029]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'flavor_id': '1609434799', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:03.166776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 27 18:45:03.168107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.169242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e42e2093-cf22-4bcc-b5ae-e547b3714d76 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:03.175782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3446ee0f-66e9-431a-9da7-6e014c65ff7a tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-3"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:03.176591 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e42e2093-cf22-4bcc-b5ae-e547b3714d76 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621 tempest-FlavorsExtraSpecsNegativeTestJSON-362676621-project] 10.222.0.42 "PUT /compute/v2.1/flavors/1609434799/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.035710 Oct 27 18:45:03.179098 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 20/35] 10.222.0.42 () {60 vars in 1265 bytes} [Thu Oct 27 18:45:03 2022] PUT /compute/v2.1/flavors/1609434799/os-extra_specs/hw:numa_nodes => generated 124 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:03.190649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dc019a16-a6a1-497e-adc3-216d8a676e34 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.194156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3446ee0f-66e9-431a-9da7-6e014c65ff7a tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:03.194907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3446ee0f-66e9-431a-9da7-6e014c65ff7a tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:03.195446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3446ee0f-66e9-431a-9da7-6e014c65ff7a tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:03.241339 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dc019a16-a6a1-497e-adc3-216d8a676e34 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/577737158" status: 202 len: 0 microversion: 2.1 time: 0.060388 Oct 27 18:45:03.245770 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 21/36] 10.222.0.42 () {58 vars in 1158 bytes} [Thu Oct 27 18:45:03 2022] DELETE /compute/v2.1/flavors/577737158 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:03.252035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c4ad7913-3d2f-48e9-a8fe-662843bbed78 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.284489 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c4ad7913-3d2f-48e9-a8fe-662843bbed78 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.037446 Oct 27 18:45:03.285308 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 22/37] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:03 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:03.291889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e4dec250-e9ec-4d27-a670-e5c93715352c tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.299143 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-e4dec250-e9ec-4d27-a670-e5c93715352c tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] HTTP exception thrown: Flavor 1609434799 has no extra specs with key hw:cpu_thread_policy. Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e4dec250-e9ec-4d27-a670-e5c93715352c tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] Request method failure captured: Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/flavors/1609434799/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGrnnz5G65GzXPm3PQfiVIRLQqzC4AOI6_IbSpyMpKVySl6E47Hc5zWgjtuU10EewkCMae2Emna-D5weJ8F5OvgoqSYftVnS9cmDK-U2y1DQ2xNeCqcUTEI-9NIezJUOAtvgZLQxYOO5tGBB8XakzT7nE4vuV7Gr7CPRb-5mFBiyTo Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 42a5fc243e3d445f966c11fb0b20c84e Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:45:03.300582 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:45:03.301885 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/42a5fc243e3d445f966c11fb0b20c84e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42a5fc243e3d445f966c11fb0b20c84e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_42a5fc243e3d445f966c11fb0b20c84e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42a5fc243e3d445f966c11fb0b20c84e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:03.301885 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 Oct 27 18:45:03.301885 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 42a5fc243e3d445f966c11fb0b20c84e Oct 27 18:45:03.301885 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 Oct 27 18:45:03.301885 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin Oct 27 18:45:03.301885 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:03.301885 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:03.301885 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 0ef18aca9b01448eba71b8ea1c7c8b60 Oct 27 18:45:03.301885 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin Oct 27 18:45:03.301885 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:03.301885 n-d-860687-3 devstack@n-api.service[127029]: exception: Flavor 1609434799 has no extra specs with key hw:cpu_thread_policy. Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'flavor_id': '1609434799', 'id': 'hw:cpu_thread_policy'} Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1609434799 has no extra specs with key hw:cpu_thread_policy. Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:03.302665 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.303914 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:03.303914 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:03.303914 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:03.303914 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:03.303914 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:03.303914 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1609434799 has no extra specs with key hw:cpu_thread_policy. Oct 27 18:45:03.303914 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.303914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e4dec250-e9ec-4d27-a670-e5c93715352c tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] Returning 404 to user: Flavor 1609434799 has no extra specs with key hw:cpu_thread_policy. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:03.303914 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e4dec250-e9ec-4d27-a670-e5c93715352c tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1609434799/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.015429 Oct 27 18:45:03.303914 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 23/38] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 18:45:03 2022] DELETE /compute/v2.1/flavors/1609434799/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:03.309105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-49c04cd5-5916-4eeb-9f7c-46f923edc464 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.340910 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-49c04cd5-5916-4eeb-9f7c-46f923edc464 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.035719 Oct 27 18:45:03.346434 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 24/39] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:03 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:03.353267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fea9790f-eeaf-4709-869f-b63fd199ca48 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.354339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fea9790f-eeaf-4709-869f-b63fd199ca48 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:03.379394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fea9790f-eeaf-4709-869f-b63fd199ca48 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:03.381009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fea9790f-eeaf-4709-869f-b63fd199ca48 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:03.381590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fea9790f-eeaf-4709-869f-b63fd199ca48 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:03.383700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fea9790f-eeaf-4709-869f-b63fd199ca48 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:03.384521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fea9790f-eeaf-4709-869f-b63fd199ca48 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:03.385523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fea9790f-eeaf-4709-869f-b63fd199ca48 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:03.400114 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3446ee0f-66e9-431a-9da7-6e014c65ff7a tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.239677 Oct 27 18:45:03.400736 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 16/40] 10.222.0.42 () {62 vars in 1232 bytes} [Thu Oct 27 18:45:03 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:45:03.413592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bade96e5-6489-4f2d-8af6-41892f6a2967 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1812685271", "id": "586f1b89-7786-4bd2-8b0e-0c8c6e723b06", "os-flavor-access:is_public": "True"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:03.440376 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bade96e5-6489-4f2d-8af6-41892f6a2967 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.030527 Oct 27 18:45:03.441224 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 17/41] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:03 2022] POST /compute/v2.1/flavors => generated 507 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:03.445910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13600073-c753-4cd9-8788-e09b2d3cc250 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:03.449793 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-13600073-c753-4cd9-8788-e09b2d3cc250 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13600073-c753-4cd9-8788-e09b2d3cc250 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] Request method failure captured: Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: request: PUT /compute/v2.1/flavors/1609434799/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 27 Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGrnnz5G65GzXPm3PQfiVIRLQqzC4AOI6_IbSpyMpKVySl6E47Hc5zWgjtuU10EewkCMae2Emna-D5weJ8F5OvgoqSYftVnS9cmDK-U2y1DQ2xNeCqcUTEI-9NIezJUOAtvgZLQxYOO5tGBB8XakzT7nE4vuV7Gr7CPRb-5mFBiyTo Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 42a5fc243e3d445f966c11fb0b20c84e Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 18:45:03.451984 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 18:45:03.453298 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/42a5fc243e3d445f966c11fb0b20c84e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42a5fc243e3d445f966c11fb0b20c84e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_42a5fc243e3d445f966c11fb0b20c84e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42a5fc243e3d445f966c11fb0b20c84e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:03.453298 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 Oct 27 18:45:03.453298 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 42a5fc243e3d445f966c11fb0b20c84e Oct 27 18:45:03.453298 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 Oct 27 18:45:03.453298 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin Oct 27 18:45:03.453298 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:03.453298 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:03.453298 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 0ef18aca9b01448eba71b8ea1c7c8b60 Oct 27 18:45:03.453298 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin Oct 27 18:45:03.453298 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:45:03.453298 n-d-860687-3 devstack@n-api.service[127028]: {"hw:cpu_policy": "shared"} Oct 27 18:45:03.453298 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:03.453298 n-d-860687-3 devstack@n-api.service[127028]: exception: Request body and URI mismatch Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'flavor_id': '1609434799', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:03.454219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:03.455573 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:03.455573 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:03.455573 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 27 18:45:03.455573 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.456663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13600073-c753-4cd9-8788-e09b2d3cc250 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:03.457617 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-13600073-c753-4cd9-8788-e09b2d3cc250 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/1609434799/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.015157 Oct 27 18:45:03.458246 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 18/42] 10.222.0.42 () {60 vars in 1265 bytes} [Thu Oct 27 18:45:03 2022] PUT /compute/v2.1/flavors/1609434799/os-extra_specs/hw:numa_nodes => generated 73 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:45:03.464462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9965a37-57f2-484c-9aef-a026b03e3588 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1615747645", "id": 436648215, "os-flavor-access:is_public": "True"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:03.512457 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d9965a37-57f2-484c-9aef-a026b03e3588 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.052470 Oct 27 18:45:03.515484 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 19/43] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:03 2022] POST /compute/v2.1/flavors => generated 435 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:03.521485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6ca61d1-9f61-4eb3-92d3-482940835911 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.552667 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d6ca61d1-9f61-4eb3-92d3-482940835911 tempest-AggregatesAdminTestV241-1493684818 tempest-AggregatesAdminTestV241-1493684818-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.035457 Oct 27 18:45:03.559579 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 20/44] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Oct 27 18:45:03 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:03.569003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3611829c-ad3a-41e8-a83d-06fd62caa1d0 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.599689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fea9790f-eeaf-4709-869f-b63fd199ca48 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:03.602433 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3611829c-ad3a-41e8-a83d-06fd62caa1d0 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/586f1b89-7786-4bd2-8b0e-0c8c6e723b06" status: 202 len: 0 microversion: 2.1 time: 0.041111 Oct 27 18:45:03.605192 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 21/45] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:45:03 2022] DELETE /compute/v2.1/flavors/586f1b89-7786-4bd2-8b0e-0c8c6e723b06 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:03.613340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e810f655-ff7b-4e17-9694-24339ac870db tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:03.617646 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fea9790f-eeaf-4709-869f-b63fd199ca48 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1223 microversion: 2.1 time: 0.269880 Oct 27 18:45:03.619109 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 25/46] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:03 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1223 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e810f655-ff7b-4e17-9694-24339ac870db tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] Request method failure captured: Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: request: PUT /compute/v2.1/flavors/1609434799/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 49 Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGrnnz5G65GzXPm3PQfiVIRLQqzC4AOI6_IbSpyMpKVySl6E47Hc5zWgjtuU10EewkCMae2Emna-D5weJ8F5OvgoqSYftVnS9cmDK-U2y1DQ2xNeCqcUTEI-9NIezJUOAtvgZLQxYOO5tGBB8XakzT7nE4vuV7Gr7CPRb-5mFBiyTo Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 42a5fc243e3d445f966c11fb0b20c84e Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 18:45:03.624467 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 18:45:03.625496 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/42a5fc243e3d445f966c11fb0b20c84e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42a5fc243e3d445f966c11fb0b20c84e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_42a5fc243e3d445f966c11fb0b20c84e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42a5fc243e3d445f966c11fb0b20c84e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:03.625496 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 Oct 27 18:45:03.625496 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 42a5fc243e3d445f966c11fb0b20c84e Oct 27 18:45:03.625496 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 Oct 27 18:45:03.625496 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin Oct 27 18:45:03.625496 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:03.625496 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:03.625496 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 0ef18aca9b01448eba71b8ea1c7c8b60 Oct 27 18:45:03.625496 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin Oct 27 18:45:03.625496 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:45:03.625496 n-d-860687-3 devstack@n-api.service[127028]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 27 18:45:03.625496 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'flavor_id': '1609434799', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance: Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 27 18:45:03.626060 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.627099 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:03.628040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:03.628040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:03.628040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:45:03.628040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:45:03.628040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 18:45:03.628040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.628040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e810f655-ff7b-4e17-9694-24339ac870db tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:03.628040 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e810f655-ff7b-4e17-9694-24339ac870db tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/1609434799/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.017177 Oct 27 18:45:03.628040 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 22/47] 10.222.0.42 () {60 vars in 1265 bytes} [Thu Oct 27 18:45:03 2022] PUT /compute/v2.1/flavors/1609434799/os-extra_specs/hw:numa_nodes => generated 117 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:45:03.631247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ff5cda31-9691-4c0a-a87f-ed33a6624c90 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.632763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-83266bb8-7167-41ac-85ec-38ffc5ea16ad tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.645596 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-83266bb8-7167-41ac-85ec-38ffc5ea16ad tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-83266bb8-7167-41ac-85ec-38ffc5ea16ad tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Request method failure captured: Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/flavors/436648215/os-flavor-access HTTP/1.1 Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGsLbp8MpBuhTA_UYIaKXWDgVdYBAfbrd5oqVZT3RAQj8PoOzymqpfvPbXG9fxgw4Bac3ZcEK9fS1MEtKwgT6_wdMGwXTm9wkDWA0FEH_kQgTP1kfRzdyIonfTjIIEx_VN-kopR3Ob6T9qCecN_Ovc5_mRqKJvsLFjYsyBb_89zTMs Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c650c9e3f46b4eebbe354dd05694262c Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-808884614 Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:45:03.647606 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:45:03.648910 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c650c9e3f46b4eebbe354dd05694262c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c650c9e3f46b4eebbe354dd05694262c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c650c9e3f46b4eebbe354dd05694262c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c650c9e3f46b4eebbe354dd05694262c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:03.648910 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-808884614 Oct 27 18:45:03.648910 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c650c9e3f46b4eebbe354dd05694262c Oct 27 18:45:03.648910 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-808884614 Oct 27 18:45:03.648910 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin Oct 27 18:45:03.648910 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:03.648910 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:03.648910 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 96cacc4822a647d4b219becbb2bd5a71 Oct 27 18:45:03.648910 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin Oct 27 18:45:03.648910 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:03.648910 n-d-860687-3 devstack@n-api.service[127029]: exception: Access list not available for public flavors. Oct 27 18:45:03.648910 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'flavor_id': '436648215'} Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 27 18:45:03.649744 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:03.652504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-83266bb8-7167-41ac-85ec-38ffc5ea16ad tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:03.653436 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-83266bb8-7167-41ac-85ec-38ffc5ea16ad tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/436648215/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.033258 Oct 27 18:45:03.655409 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 26/48] 10.222.0.42 () {58 vars in 1206 bytes} [Thu Oct 27 18:45:03 2022] GET /compute/v2.1/flavors/436648215/os-flavor-access => generated 91 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:45:03.662050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f21e64ba-393d-4ff8-b2c0-4b3bb51f6d1d tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-806075510"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:03.667404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.aggregate [None req-f21e64ba-393d-4ff8-b2c0-4b3bb51f6d1d tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Generated uuid 2de2af6a-3932-4032-946b-4e754bf54187 for aggregate {{(pid=127029) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:03.672675 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ff5cda31-9691-4c0a-a87f-ed33a6624c90 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.045675 Oct 27 18:45:03.673786 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 23/49] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:03 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:03.678756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e587d78a-dc4b-4e5f-a0ab-aa5aab960f52 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.682225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=11,nova_api:DELETE=9 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:03.714203 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e587d78a-dc4b-4e5f-a0ab-aa5aab960f52 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1609434799" status: 202 len: 0 microversion: 2.1 time: 0.038439 Oct 27 18:45:03.715419 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 24/50] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:45:03 2022] DELETE /compute/v2.1/flavors/1609434799 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:03.721787 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f21e64ba-393d-4ff8-b2c0-4b3bb51f6d1d tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.062847 Oct 27 18:45:03.722496 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 27/51] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:03 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:03.730420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-06efa538-024e-4c0c-972f-95764fdec778 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1527912574", "id": 1708968052, "os-flavor-access:is_public": "True"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:03.737504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-795fc5f7-8b17-4914-a73c-d99283b7d18a tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.764390 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-06efa538-024e-4c0c-972f-95764fdec778 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.040016 Oct 27 18:45:03.772688 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 28/52] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:03 2022] POST /compute/v2.1/flavors => generated 414 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:03.772857 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-795fc5f7-8b17-4914-a73c-d99283b7d18a tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/436648215" status: 202 len: 0 microversion: 2.1 time: 0.048105 Oct 27 18:45:03.772857 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 25/53] 10.222.0.42 () {58 vars in 1158 bytes} [Thu Oct 27 18:45:03 2022] DELETE /compute/v2.1/flavors/436648215 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:03.773036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-89ea905b-aeca-469d-84f7-5cf012728510 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.778006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bbf26eda-cbf2-40ea-9260-9797de6b4ff7 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-3"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:03.793348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbf26eda-cbf2-40ea-9260-9797de6b4ff7 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:03.794207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbf26eda-cbf2-40ea-9260-9797de6b4ff7 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:03.795447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbf26eda-cbf2-40ea-9260-9797de6b4ff7 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:03.797767 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-89ea905b-aeca-469d-84f7-5cf012728510 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019 tempest-FlavorsExtraSpecsNegativeTestJSON-277705019-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.031037 Oct 27 18:45:03.798605 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 29/54] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:03 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:03.802774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fb5ffc60-946b-410f-8916-443148ef25e2 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.836077 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fb5ffc60-946b-410f-8916-443148ef25e2 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.036143 Oct 27 18:45:03.850464 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 30/55] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:03 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:03.850464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a1df10cc-54a4-4aab-bd20-d1b099c4dcc4 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:03.851228 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a1df10cc-54a4-4aab-bd20-d1b099c4dcc4 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1708968052" status: 200 len: 414 microversion: 2.1 time: 0.012379 Oct 27 18:45:03.851935 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 31/56] 10.222.0.42 () {58 vars in 1158 bytes} [Thu Oct 27 18:45:03 2022] GET /compute/v2.1/flavors/1708968052 => generated 414 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:03.867413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d40fc62d-aa25-4f90-bae3-b73aa53daea3 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-348849179", "id": 1416281095, "os-flavor-access:is_public": "False"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:03.894880 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d40fc62d-aa25-4f90-bae3-b73aa53daea3 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.031659 Oct 27 18:45:03.905233 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 32/57] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:03 2022] POST /compute/v2.1/flavors => generated 438 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:03.977163 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bbf26eda-cbf2-40ea-9260-9797de6b4ff7 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.207105 Oct 27 18:45:03.978398 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 26/58] 10.222.0.42 () {60 vars in 1191 bytes} [Thu Oct 27 18:45:03 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:04.206222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5030bb24-babd-409a-8ab8-19af671d0066 tempest-FlavorsAdminTestJSON-1580156533 tempest-FlavorsAdminTestJSON-1580156533-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:04.251642 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5030bb24-babd-409a-8ab8-19af671d0066 tempest-FlavorsAdminTestJSON-1580156533 tempest-FlavorsAdminTestJSON-1580156533-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.343412 Oct 27 18:45:04.252525 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 33/59] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:03 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:04.259003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-57a6b1f0-9b34-4d65-89d2-a3e2fbd8de57 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-3"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:04.264529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc0d98fa-78e4-418a-997c-742e862b3389 tempest-FlavorsAccessNegativeTestJSON-387565799 tempest-FlavorsAccessNegativeTestJSON-387565799-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "feca7944715c4504ad119fcb288e0a89"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:04.274649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57a6b1f0-9b34-4d65-89d2-a3e2fbd8de57 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:04.275413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57a6b1f0-9b34-4d65-89d2-a3e2fbd8de57 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:04.275551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc0d98fa-78e4-418a-997c-742e862b3389 tempest-FlavorsAccessNegativeTestJSON-387565799 tempest-FlavorsAccessNegativeTestJSON-387565799-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '443545a0b14a4db485ec9c975b71f55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feca7944715c4504ad119fcb288e0a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:04.276247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57a6b1f0-9b34-4d65-89d2-a3e2fbd8de57 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc0d98fa-78e4-418a-997c-742e862b3389 tempest-FlavorsAccessNegativeTestJSON-387565799 tempest-FlavorsAccessNegativeTestJSON-387565799-project] Request method failure captured: Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/flavors/1416281095/action HTTP/1.1 Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 67 Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGqt8A8apCU_sYGof0-qKIoYQTJ_TICPjKKIVUSu0A1-b_eFi3B8R5C47JBUnWtPMzZCqmv6Cskr9buXFJi-JJYK7X1O0g5rUM9-Eo2PirBDT0otTlZkp9w1dmuz6PYdVd0GaAwRLHVgfKv4pJBCPJyDk3uD7zVdj_ZthlMXuJVHtY Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: feca7944715c4504ad119fcb288e0a89 Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-387565799 Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:45:04.283712 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:45:04.285022 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/feca7944715c4504ad119fcb288e0a89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/feca7944715c4504ad119fcb288e0a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_feca7944715c4504ad119fcb288e0a89", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/feca7944715c4504ad119fcb288e0a89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:04.285022 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-387565799 Oct 27 18:45:04.285022 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: feca7944715c4504ad119fcb288e0a89 Oct 27 18:45:04.285022 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-387565799 Oct 27 18:45:04.285022 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FlavorsAccessNegativeTestJSON-387565799-project Oct 27 18:45:04.285022 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:04.285022 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:04.285022 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 443545a0b14a4db485ec9c975b71f55d Oct 27 18:45:04.285022 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-387565799-project Oct 27 18:45:04.285022 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:45:04.285022 n-d-860687-3 devstack@n-api.service[127028]: {"addTenantAccess": {"tenant": "feca7944715c4504ad119fcb288e0a89"}} Oct 27 18:45:04.285022 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '1416281095', 'body': {'addTenantAccess': {'tenant': 'feca7944715c4504ad119fcb288e0a89'}}} Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:45:04.285738 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 27 18:45:04.286840 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.289556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc0d98fa-78e4-418a-997c-742e862b3389 tempest-FlavorsAccessNegativeTestJSON-387565799 tempest-FlavorsAccessNegativeTestJSON-387565799-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:04.291315 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc0d98fa-78e4-418a-997c-742e862b3389 tempest-FlavorsAccessNegativeTestJSON-387565799 tempest-FlavorsAccessNegativeTestJSON-387565799-project] 10.222.0.42 "POST /compute/v2.1/flavors/1416281095/action" status: 403 len: 130 microversion: 2.1 time: 0.311775 Oct 27 18:45:04.293144 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 27/60] 10.222.0.42 () {60 vars in 1200 bytes} [Thu Oct 27 18:45:03 2022] POST /compute/v2.1/flavors/1416281095/action => generated 130 bytes in 314 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:04.308180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-154a0cd7-894a-4118-8876-b9ad768d6466 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:04.311649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-154a0cd7-894a-4118-8876-b9ad768d6466 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:04.326836 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-57a6b1f0-9b34-4d65-89d2-a3e2fbd8de57 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-860687-3. Oct 27 18:45:04.333314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154a0cd7-894a-4118-8876-b9ad768d6466 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:04.336708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154a0cd7-894a-4118-8876-b9ad768d6466 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:04.339837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154a0cd7-894a-4118-8876-b9ad768d6466 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:04.340685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154a0cd7-894a-4118-8876-b9ad768d6466 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:04.341283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154a0cd7-894a-4118-8876-b9ad768d6466 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:04.343217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154a0cd7-894a-4118-8876-b9ad768d6466 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-57a6b1f0-9b34-4d65-89d2-a3e2fbd8de57 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Request method failure captured: Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 39 Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGs_ysdUBr5Z2suyC2IjQ_aj6kWWTMJm7cbSel7EwjBj_qX1eIlE_9aG8ZrtpBH3xFS5ayL2HTiRvfinXNyzFmDGL4sNDbqVsUBI61DCqFO-jXmM1b_8Xveqz3e8RYdgjKcIT4UGyHhSSGw7ADShxpAE9ZqmThZRCN9Tl4eEJHt6Pk Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:45:04.359735 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:45:04.361267 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c3796e5c38b84e89b9a80523736cbbb2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:04.361267 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:04.361267 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:04.361267 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:04.361267 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:04.361267 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:04.361267 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:04.361267 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 76b10cd0cd584e1d9c36e5350ed6f1d8 Oct 27 18:45:04.361267 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:04.361267 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:45:04.361267 n-d-860687-3 devstack@n-api.service[127029]: {"add_host": {"host": "n-h1-860687-3"}} Oct 27 18:45:04.361267 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:04.361267 n-d-860687-3 devstack@n-api.service[127029]: exception: Aggregate 2 already has host n-h1-860687-3. Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-860687-3'}}} Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result.read() Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 18:45:04.362176 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-860687-3-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi session.flush() Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 18:45:04.363325 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 18:45:04.366174 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 18:45:04.368215 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result.read() Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-860687-3-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 27, 18, 45, 4, 309192), 'updated_at': None, 'host': 'n-h1-860687-3', 'aggregate_id': 2}] Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:04.370806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-860687-3. Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.372624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-860687-3. Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:04.377581 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:04.380169 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-860687-3. Oct 27 18:45:04.380169 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.380169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-57a6b1f0-9b34-4d65-89d2-a3e2fbd8de57 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-860687-3. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:04.380169 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-57a6b1f0-9b34-4d65-89d2-a3e2fbd8de57 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.108030 Oct 27 18:45:04.380169 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 34/61] 10.222.0.42 () {60 vars in 1191 bytes} [Thu Oct 27 18:45:04 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 27 18:45:04.380169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7d7e2b69-bf12-48d0-839e-267e0f430249 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:04.409107 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7d7e2b69-bf12-48d0-839e-267e0f430249 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1708968052" status: 202 len: 0 microversion: 2.1 time: 0.042611 Oct 27 18:45:04.410242 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 35/62] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:45:04 2022] DELETE /compute/v2.1/flavors/1708968052 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:04.418951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b7d370c-32b1-4e76-8d01-2b0598bc8633 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:04.462362 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b7d370c-32b1-4e76-8d01-2b0598bc8633 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1416281095" status: 202 len: 0 microversion: 2.1 time: 0.050904 Oct 27 18:45:04.463243 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 36/63] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:45:04 2022] DELETE /compute/v2.1/flavors/1416281095 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:04.492580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9762889c-e1aa-4dc9-99b1-7c1883b76c92 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-3"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:04.506184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9762889c-e1aa-4dc9-99b1-7c1883b76c92 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:04.507198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9762889c-e1aa-4dc9-99b1-7c1883b76c92 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:04.508090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9762889c-e1aa-4dc9-99b1-7c1883b76c92 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:04.601321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-154a0cd7-894a-4118-8876-b9ad768d6466 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:04.623883 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-154a0cd7-894a-4118-8876-b9ad768d6466 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1209 microversion: 2.1 time: 0.328248 Oct 27 18:45:04.646488 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 28/64] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:04 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1209 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:04.649036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-74e168dc-8963-467b-8c6e-dd1e6323c884 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:04.685519 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-74e168dc-8963-467b-8c6e-dd1e6323c884 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050244 Oct 27 18:45:04.702783 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 29/65] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:04.708791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-98bd3ee7-86f0-45fe-be0c-80f4feccb311 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:04.734099 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-98bd3ee7-86f0-45fe-be0c-80f4feccb311 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028029 Oct 27 18:45:04.749748 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 30/66] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:04.749748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dac96352-f54f-4bd6-ae40-9ec204c037e2 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:04.749748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dac96352-f54f-4bd6-ae40-9ec204c037e2 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:04.755864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dac96352-f54f-4bd6-ae40-9ec204c037e2 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:04.756469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dac96352-f54f-4bd6-ae40-9ec204c037e2 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:04.756974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dac96352-f54f-4bd6-ae40-9ec204c037e2 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:04.759134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dac96352-f54f-4bd6-ae40-9ec204c037e2 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:04.759502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dac96352-f54f-4bd6-ae40-9ec204c037e2 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:04.760070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dac96352-f54f-4bd6-ae40-9ec204c037e2 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:04.852234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dac96352-f54f-4bd6-ae40-9ec204c037e2 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:04.874361 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dac96352-f54f-4bd6-ae40-9ec204c037e2 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1277 microversion: 2.1 time: 0.134181 Oct 27 18:45:04.886414 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 31/67] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:04 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1277 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:04.886414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fe88dafe-4a89-4d13-8706-7c85c6824fd9 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-702024184", "id": 1415695086, "os-flavor-access:is_public": "False"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:04.903079 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fe88dafe-4a89-4d13-8706-7c85c6824fd9 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.026800 Oct 27 18:45:04.911810 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 32/68] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:04 2022] POST /compute/v2.1/flavors => generated 429 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:04.911810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cab0ac69-eb8a-46ea-956e-bfc79745ee88 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-486830070", "id": 1058239209, "os-flavor-access:is_public": "False"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:04.929171 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cab0ac69-eb8a-46ea-956e-bfc79745ee88 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.024071 Oct 27 18:45:04.937645 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 33/69] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:04 2022] POST /compute/v2.1/flavors => generated 438 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:04.937645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-40902ed4-f043-428d-884c-10194161d224 tempest-FlavorsAdminTestJSON-1580156533 tempest-FlavorsAdminTestJSON-1580156533-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "1415695086"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:04.949006 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-40902ed4-f043-428d-884c-10194161d224 tempest-FlavorsAdminTestJSON-1580156533 tempest-FlavorsAdminTestJSON-1580156533-project] HTTP exception thrown: Flavor 1415695086 could not be found. Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-40902ed4-f043-428d-884c-10194161d224 tempest-FlavorsAdminTestJSON-1580156533 tempest-FlavorsAdminTestJSON-1580156533-project] Request method failure captured: Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 107 Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGoS6ZYwxuU_LkY56j5PtF0HMH_dSej8zX-5s0UjKo898bquzk2v--Ge-jHwQzDvG9VXlyBNoJkDf_9ff5dZRwbQtSk6mbmZ_K1QeGocV5mBzrfLkuIEfuuycV_Ov0OBkcjEztDo7Yjasb3AobCO6E1s0eb0jh0VRDYIymo5PkpHss Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: d781266ac6724ffb9627881d4de52f93 Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FlavorsAdminTestJSON-1580156533 Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:45:04.952434 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:45:04.954976 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d781266ac6724ffb9627881d4de52f93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d781266ac6724ffb9627881d4de52f93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d781266ac6724ffb9627881d4de52f93", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d781266ac6724ffb9627881d4de52f93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:04.954976 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FlavorsAdminTestJSON-1580156533 Oct 27 18:45:04.954976 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: d781266ac6724ffb9627881d4de52f93 Oct 27 18:45:04.954976 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1580156533 Oct 27 18:45:04.954976 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FlavorsAdminTestJSON-1580156533-project Oct 27 18:45:04.954976 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:04.954976 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:04.954976 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: a8415559cac048f096cacd05b55dcfce Oct 27 18:45:04.954976 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FlavorsAdminTestJSON-1580156533-project Oct 27 18:45:04.954976 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:45:04.954976 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "test", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "1415695086"}} Oct 27 18:45:04.954976 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:04.954976 n-d-860687-3 devstack@n-api.service[127028]: exception: Flavor 1415695086 could not be found. Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '1415695086'}}} Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1415695086 could not be found. Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.955857 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1415695086 could not be found. Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:04.956832 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:04.958882 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:04.958882 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:04.958882 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:04.958882 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1415695086 could not be found. Oct 27 18:45:04.958882 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:04.958882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-40902ed4-f043-428d-884c-10194161d224 tempest-FlavorsAdminTestJSON-1580156533 tempest-FlavorsAdminTestJSON-1580156533-project] Returning 400 to user: Flavor 1415695086 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:04.958882 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-40902ed4-f043-428d-884c-10194161d224 tempest-FlavorsAdminTestJSON-1580156533 tempest-FlavorsAdminTestJSON-1580156533-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.022740 Oct 27 18:45:04.958882 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 34/70] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:04 2022] POST /compute/v2.1/servers => generated 81 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:45:04.959711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a6e2e39d-02af-4679-b233-f3f37ab72fbe tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "feca7944715c4504ad119fcb288e0a89"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:04.973825 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9762889c-e1aa-4dc9-99b1-7c1883b76c92 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.509140 Oct 27 18:45:04.981902 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 37/71] 10.222.0.42 () {60 vars in 1191 bytes} [Thu Oct 27 18:45:04 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:04.988859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aac48df2-9eaa-49a1-9a50-e400df32baab tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:05.013323 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aac48df2-9eaa-49a1-9a50-e400df32baab tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1415695086" status: 202 len: 0 microversion: 2.1 time: 0.029160 Oct 27 18:45:05.014331 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 38/72] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:45:04 2022] DELETE /compute/v2.1/flavors/1415695086 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:05.019540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-65ec9272-e4ae-478b-b560-d208cf7b4e93 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:05.059202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=73,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=19,nova_api:INSERT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:05.077205 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-65ec9272-e4ae-478b-b560-d208cf7b4e93 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.061013 Oct 27 18:45:05.078767 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 39/73] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:05 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:05.098129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14a067be-7746-4a72-8376-7a0b5ecf2790 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:05.152811 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-14a067be-7746-4a72-8376-7a0b5ecf2790 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072687 Oct 27 18:45:05.154991 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 40/74] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:05.163267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a6cd4fb9-0ed7-4707-842f-75e3abcf121f tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-214712118"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:05.183278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.aggregate [None req-a6cd4fb9-0ed7-4707-842f-75e3abcf121f tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Generated uuid 56e7ee0a-916b-40d2-92f9-04d801a4e53a for aggregate {{(pid=127029) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:05.215094 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a6cd4fb9-0ed7-4707-842f-75e3abcf121f tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.057391 Oct 27 18:45:05.217482 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 41/75] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:05 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:05.230097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0ef97e45-3ad0-4ade-ba66-d82975485091 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-505906271", "name": "tempest-test_aggregate-748760780"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:05.261001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.aggregate [None req-0ef97e45-3ad0-4ade-ba66-d82975485091 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Generated uuid 4da04d2d-9cb9-48f7-ba05-c2fc1c3ef05c for aggregate {{(pid=127029) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:05.308976 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0ef97e45-3ad0-4ade-ba66-d82975485091 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.090037 Oct 27 18:45:05.310557 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 42/76] 10.222.0.42 () {60 vars in 1165 bytes} [Thu Oct 27 18:45:05 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:05.326503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f22c702c-8529-4d49-bc72-c100b14f01f5 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-485766605", "id": 1300916342, "os-flavor-access:is_public": "False"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:05.377743 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f22c702c-8529-4d49-bc72-c100b14f01f5 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.064822 Oct 27 18:45:05.380243 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 43/77] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:05 2022] POST /compute/v2.1/flavors => generated 414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:05.449257 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a6e2e39d-02af-4679-b233-f3f37ab72fbe tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1058239209/action" status: 200 len: 97 microversion: 2.1 time: 0.492610 Oct 27 18:45:05.451707 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 35/78] 10.222.0.42 () {60 vars in 1200 bytes} [Thu Oct 27 18:45:04 2022] POST /compute/v2.1/flavors/1058239209/action => generated 97 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:05.458994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cbc7bd88-42b7-4b29-9c15-2662c693d425 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:05.484989 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cbc7bd88-42b7-4b29-9c15-2662c693d425 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 513 microversion: 2.1 time: 0.031712 Oct 27 18:45:05.485882 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 36/79] 10.222.0.42 () {58 vars in 1143 bytes} [Thu Oct 27 18:45:05 2022] GET /compute/v2.1/os-aggregates => generated 513 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:05.501135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-05c4320a-6f7a-4e17-a657-eadf5afb2541 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1853977841", "id": 1034420877, "os-flavor-access:is_public": "True"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:05.528003 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-05c4320a-6f7a-4e17-a657-eadf5afb2541 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.040385 Oct 27 18:45:05.531522 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 37/80] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:05 2022] POST /compute/v2.1/flavors => generated 414 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:05.536282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b68feb13-98f2-466b-a9f8-725feefc2703 tempest-FlavorsAccessNegativeTestJSON-387565799 tempest-FlavorsAccessNegativeTestJSON-387565799-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "feca7944715c4504ad119fcb288e0a89"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:05.542862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b68feb13-98f2-466b-a9f8-725feefc2703 tempest-FlavorsAccessNegativeTestJSON-387565799 tempest-FlavorsAccessNegativeTestJSON-387565799-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '443545a0b14a4db485ec9c975b71f55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feca7944715c4504ad119fcb288e0a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b68feb13-98f2-466b-a9f8-725feefc2703 tempest-FlavorsAccessNegativeTestJSON-387565799 tempest-FlavorsAccessNegativeTestJSON-387565799-project] Request method failure captured: Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/flavors/1058239209/action HTTP/1.1 Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 70 Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGqt8A8apCU_sYGof0-qKIoYQTJ_TICPjKKIVUSu0A1-b_eFi3B8R5C47JBUnWtPMzZCqmv6Cskr9buXFJi-JJYK7X1O0g5rUM9-Eo2PirBDT0otTlZkp9w1dmuz6PYdVd0GaAwRLHVgfKv4pJBCPJyDk3uD7zVdj_ZthlMXuJVHtY Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: feca7944715c4504ad119fcb288e0a89 Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-387565799 Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:45:05.545799 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:45:05.546879 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/feca7944715c4504ad119fcb288e0a89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/feca7944715c4504ad119fcb288e0a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_feca7944715c4504ad119fcb288e0a89", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/feca7944715c4504ad119fcb288e0a89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:05.546879 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-387565799 Oct 27 18:45:05.546879 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: feca7944715c4504ad119fcb288e0a89 Oct 27 18:45:05.546879 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-387565799 Oct 27 18:45:05.546879 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FlavorsAccessNegativeTestJSON-387565799-project Oct 27 18:45:05.546879 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:05.546879 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:05.546879 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 443545a0b14a4db485ec9c975b71f55d Oct 27 18:45:05.546879 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-387565799-project Oct 27 18:45:05.546879 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:45:05.546879 n-d-860687-3 devstack@n-api.service[127028]: {"removeTenantAccess": {"tenant": "feca7944715c4504ad119fcb288e0a89"}} Oct 27 18:45:05.546879 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '1058239209', 'body': {'removeTenantAccess': {'tenant': 'feca7944715c4504ad119fcb288e0a89'}}} Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can( Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:05.547461 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 27 18:45:05.548465 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:05.550234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b68feb13-98f2-466b-a9f8-725feefc2703 tempest-FlavorsAccessNegativeTestJSON-387565799 tempest-FlavorsAccessNegativeTestJSON-387565799-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:05.551804 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b68feb13-98f2-466b-a9f8-725feefc2703 tempest-FlavorsAccessNegativeTestJSON-387565799 tempest-FlavorsAccessNegativeTestJSON-387565799-project] 10.222.0.42 "POST /compute/v2.1/flavors/1058239209/action" status: 403 len: 133 microversion: 2.1 time: 0.018897 Oct 27 18:45:05.553028 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 38/81] 10.222.0.42 () {60 vars in 1200 bytes} [Thu Oct 27 18:45:05 2022] POST /compute/v2.1/flavors/1058239209/action => generated 133 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:05.559322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e78f95b1-1c64-4c3c-aac5-9b6c46fd5d50 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-3"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:05.575528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e78f95b1-1c64-4c3c-aac5-9b6c46fd5d50 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:05.576361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e78f95b1-1c64-4c3c-aac5-9b6c46fd5d50 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:05.581479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e78f95b1-1c64-4c3c-aac5-9b6c46fd5d50 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:05.835244 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e78f95b1-1c64-4c3c-aac5-9b6c46fd5d50 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 312 microversion: 2.1 time: 0.280735 Oct 27 18:45:05.836166 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 39/82] 10.222.0.42 () {60 vars in 1191 bytes} [Thu Oct 27 18:45:05 2022] POST /compute/v2.1/os-aggregates/4/action => generated 312 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:05.841008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-522c485f-8548-4f1c-b502-1ef82bf0c4ed tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:05.871056 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-522c485f-8548-4f1c-b502-1ef82bf0c4ed tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 845 microversion: 2.1 time: 0.033529 Oct 27 18:45:05.872132 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 40/83] 10.222.0.42 () {58 vars in 1169 bytes} [Thu Oct 27 18:45:05 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 845 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:05.879140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9473dbb0-5253-406f-82a0-83810141568a tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "feca7944715c4504ad119fcb288e0a89"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:06.073891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0121b0a5-c526-4544-8751-4b09ee622d85 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-3"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:06.079213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0121b0a5-c526-4544-8751-4b09ee622d85 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '85f7aabce23a4f0e96602625464c997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0df4e5654a04747ae69752316b6127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0121b0a5-c526-4544-8751-4b09ee622d85 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Request method failure captured: Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 39 Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGqV0DjaYXQe-IzomTLCwMkDKwOIx6alwBBND54DJ7DsxKmYkh91Hs5uNszTBDiKfnge54x6u8XqdCxMb7Xq_TVuFktgrAfPWg1YIPw7PaoZSCIA_Vfppo_q6MbhX0Vz9ya8S3DMheia8QnviXk2xyH2feodcem25HOkuEcQxDvBtE Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f0df4e5654a04747ae69752316b6127a Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:45:06.083939 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:45:06.085035 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f0df4e5654a04747ae69752316b6127a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:06.085035 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:06.085035 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f0df4e5654a04747ae69752316b6127a Oct 27 18:45:06.085035 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:06.085035 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminNegativeTestJSON-1275643815-project Oct 27 18:45:06.085035 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:06.085035 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:06.085035 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 85f7aabce23a4f0e96602625464c997a Oct 27 18:45:06.085035 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815-project Oct 27 18:45:06.085035 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:45:06.085035 n-d-860687-3 devstack@n-api.service[127029]: {"add_host": {"host": "n-h1-860687-3"}} Oct 27 18:45:06.085035 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:06.085035 n-d-860687-3 devstack@n-api.service[127029]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-860687-3'}}} Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:06.085709 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 27 18:45:06.087884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:06.089085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0121b0a5-c526-4544-8751-4b09ee622d85 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:06.089085 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0121b0a5-c526-4544-8751-4b09ee622d85 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] 10.222.0.42 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.704149 Oct 27 18:45:06.089085 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 44/84] 10.222.0.42 () {60 vars in 1191 bytes} [Thu Oct 27 18:45:05 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 705 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:06.098063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a32da94a-077f-43d6-a21c-6b14c125ef9b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:06.100835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a32da94a-077f-43d6-a21c-6b14c125ef9b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:06.118170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a32da94a-077f-43d6-a21c-6b14c125ef9b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:06.121192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a32da94a-077f-43d6-a21c-6b14c125ef9b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:06.121668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a32da94a-077f-43d6-a21c-6b14c125ef9b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:06.123576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a32da94a-077f-43d6-a21c-6b14c125ef9b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:06.124055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a32da94a-077f-43d6-a21c-6b14c125ef9b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:06.126767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a32da94a-077f-43d6-a21c-6b14c125ef9b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:06.405572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a32da94a-077f-43d6-a21c-6b14c125ef9b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:06.429234 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a32da94a-077f-43d6-a21c-6b14c125ef9b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1271 microversion: 2.1 time: 0.341928 Oct 27 18:45:06.430375 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 45/85] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:06 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1271 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:06.447205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-51ff20e9-63c1-455f-b45a-fa7a54e44aca tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:06.515031 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-51ff20e9-63c1-455f-b45a-fa7a54e44aca tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 845 microversion: 2.1 time: 0.078619 Oct 27 18:45:06.516434 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 46/86] 10.222.0.42 () {58 vars in 1177 bytes} [Thu Oct 27 18:45:06 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 845 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:06.533798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fba4e9cb-abef-4813-b99d-6285c7d2227b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:06.534870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fba4e9cb-abef-4813-b99d-6285c7d2227b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:06.554268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fba4e9cb-abef-4813-b99d-6285c7d2227b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:06.555436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fba4e9cb-abef-4813-b99d-6285c7d2227b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:06.557886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fba4e9cb-abef-4813-b99d-6285c7d2227b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:06.559229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fba4e9cb-abef-4813-b99d-6285c7d2227b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:06.561295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fba4e9cb-abef-4813-b99d-6285c7d2227b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:06.561995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fba4e9cb-abef-4813-b99d-6285c7d2227b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:06.969520 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9473dbb0-5253-406f-82a0-83810141568a tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1058239209/action" status: 200 len: 21 microversion: 2.1 time: 1.095214 Oct 27 18:45:06.973189 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 41/87] 10.222.0.42 () {60 vars in 1200 bytes} [Thu Oct 27 18:45:05 2022] POST /compute/v2.1/flavors/1058239209/action => generated 21 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:06.985672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a1c07344-c448-415e-b7e5-5df981c0ca4c tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:07.040461 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a1c07344-c448-415e-b7e5-5df981c0ca4c tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.063458 Oct 27 18:45:07.043817 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 42/88] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:06 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:07.179038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fba4e9cb-abef-4813-b99d-6285c7d2227b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:07.190035 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fba4e9cb-abef-4813-b99d-6285c7d2227b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1277 microversion: 2.1 time: 0.670714 Oct 27 18:45:07.191212 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 47/89] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:06 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1277 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:07.197616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a3995523-5e45-4684-acbc-2144873d496c tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:07.214422 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a3995523-5e45-4684-acbc-2144873d496c tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 845 microversion: 2.1 time: 0.021395 Oct 27 18:45:07.215392 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 48/90] 10.222.0.42 () {58 vars in 1171 bytes} [Thu Oct 27 18:45:07 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 845 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:07.224513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7e5f6110-efa3-4aa0-a747-209692763c8b tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:07.262817 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7e5f6110-efa3-4aa0-a747-209692763c8b tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1058239209" status: 202 len: 0 microversion: 2.1 time: 0.045167 Oct 27 18:45:07.264463 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 49/91] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:45:07 2022] DELETE /compute/v2.1/flavors/1058239209 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:07.272850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-deecc4a3-49e8-42e3-b2d8-c6726ebbb509 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1233848545"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:07.280037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.aggregate [None req-deecc4a3-49e8-42e3-b2d8-c6726ebbb509 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Generated uuid ee585da0-8c85-42cb-b03b-e482c2076976 for aggregate {{(pid=127029) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:07.332686 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-deecc4a3-49e8-42e3-b2d8-c6726ebbb509 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065276 Oct 27 18:45:07.335661 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 50/92] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:07.350036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dd650f98-b33e-478a-a9bb-2cc9e03f9233 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:07.391088 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dd650f98-b33e-478a-a9bb-2cc9e03f9233 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.053264 Oct 27 18:45:07.394252 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 51/93] 10.222.0.42 () {58 vars in 1169 bytes} [Thu Oct 27 18:45:07 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:07.407769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f82c16a1-0649-428e-a61d-e91462435185 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:07.468915 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f82c16a1-0649-428e-a61d-e91462435185 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.070864 Oct 27 18:45:07.469438 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 52/94] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:07 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:07.485012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b85c895b-0f09-4bfe-bdc8-9fb6cb1540ac tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-845481629"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:07.511392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b85c895b-0f09-4bfe-bdc8-9fb6cb1540ac tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:07.511887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b85c895b-0f09-4bfe-bdc8-9fb6cb1540ac tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:07.515675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b85c895b-0f09-4bfe-bdc8-9fb6cb1540ac tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:07.535293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b85c895b-0f09-4bfe-bdc8-9fb6cb1540ac tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:07.536568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b85c895b-0f09-4bfe-bdc8-9fb6cb1540ac tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:07.536993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-616135499", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "availability_zone": "tempest-test_az-505906271"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:07.537634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b85c895b-0f09-4bfe-bdc8-9fb6cb1540ac tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:07.549362 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-b85c895b-0f09-4bfe-bdc8-9fb6cb1540ac tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-845481629 could not be found. Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b85c895b-0f09-4bfe-bdc8-9fb6cb1540ac tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Request method failure captured: Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 57 Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGs_ysdUBr5Z2suyC2IjQ_aj6kWWTMJm7cbSel7EwjBj_qX1eIlE_9aG8ZrtpBH3xFS5ayL2HTiRvfinXNyzFmDGL4sNDbqVsUBI61DCqFO-jXmM1b_8Xveqz3e8RYdgjKcIT4UGyHhSSGw7ADShxpAE9ZqmThZRCN9Tl4eEJHt6Pk Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:45:07.562582 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:45:07.563772 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c3796e5c38b84e89b9a80523736cbbb2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:07.563772 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:07.563772 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:07.563772 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:07.563772 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:07.563772 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:07.563772 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:07.563772 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 76b10cd0cd584e1d9c36e5350ed6f1d8 Oct 27 18:45:07.563772 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:07.563772 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:45:07.563772 n-d-860687-3 devstack@n-api.service[127029]: {"add_host": {"host": "tempest-nonexist_host-845481629"}} Oct 27 18:45:07.563772 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: exception: Compute host tempest-nonexist_host-845481629 could not be found. Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-845481629'}}} Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-845481629' is not mapped to any cell Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:07.564428 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 27 18:45:07.565572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-845481629 could not be found. Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-845481629 could not be found. Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:07.566588 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:07.567642 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:07.567642 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:07.567642 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:07.567642 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:07.567642 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:07.567642 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-845481629 could not be found. Oct 27 18:45:07.567642 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:07.568809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:07.570523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b85c895b-0f09-4bfe-bdc8-9fb6cb1540ac tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-845481629 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:07.572241 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b85c895b-0f09-4bfe-bdc8-9fb6cb1540ac tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 110 microversion: 2.1 time: 0.101820 Oct 27 18:45:07.574017 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 53/95] 10.222.0.42 () {60 vars in 1191 bytes} [Thu Oct 27 18:45:07 2022] POST /compute/v2.1/os-aggregates/5/action => generated 110 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:07.579792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-890abe4e-e333-4196-b99b-276e66eff21d tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:07.590022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:07.592433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:07.597992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:07.598673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:07.599418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:07.626350 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-890abe4e-e333-4196-b99b-276e66eff21d tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.050943 Oct 27 18:45:07.630585 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 54/96] 10.222.0.42 () {58 vars in 1169 bytes} [Thu Oct 27 18:45:07 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:07.636495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f7931210-a76c-41cb-aff5-632708fd2e11 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:07.643954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f7931210-a76c-41cb-aff5-632708fd2e11 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:07.680703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7931210-a76c-41cb-aff5-632708fd2e11 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:07.681484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7931210-a76c-41cb-aff5-632708fd2e11 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:07.682925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7931210-a76c-41cb-aff5-632708fd2e11 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:07.683682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7931210-a76c-41cb-aff5-632708fd2e11 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:07.684385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7931210-a76c-41cb-aff5-632708fd2e11 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:07.684606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7931210-a76c-41cb-aff5-632708fd2e11 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:07.772626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:45:07.975966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f7931210-a76c-41cb-aff5-632708fd2e11 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:07.985176 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f7931210-a76c-41cb-aff5-632708fd2e11 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1271 microversion: 2.1 time: 0.352830 Oct 27 18:45:07.994753 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 55/97] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:07 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1271 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:08.004240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7316d3bf-7f8d-4a24-ba54-0559195e5056 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1114526515", "id": 1087780225, "os-flavor-access:is_public": "False"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:08.081408 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7316d3bf-7f8d-4a24-ba54-0559195e5056 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.084964 Oct 27 18:45:08.090178 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 56/98] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:07 2022] POST /compute/v2.1/flavors => generated 439 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:08.105034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6270585c-cc0f-44d0-9dbc-8b83b155a4cd tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:08.194440 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6270585c-cc0f-44d0-9dbc-8b83b155a4cd tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.109588 Oct 27 18:45:08.197086 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 57/99] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:08 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:08.210937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-570b6905-2a52-4b78-9074-7f7bf6baccf2 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:08.278616 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-570b6905-2a52-4b78-9074-7f7bf6baccf2 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.078779 Oct 27 18:45:08.280746 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 58/100] 10.222.0.42 () {58 vars in 1175 bytes} [Thu Oct 27 18:45:08 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:08.293722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-952783dc-6844-4f1a-9d86-28b2326196ca tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d7dc49d380554ee591d7bd065839d60b"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:08.680516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:45:08.680516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:45:08.681247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:45:08.681247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:45:08.681596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:45:08.697595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:08.698130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:08.698599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:08.699364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:08.699818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:08.700241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:08.753175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Getting quotas for project cdb1ba9cb5644deeb4c2009add788a01. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:45:08.766313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Getting quotas for user efa7fd186f2747628701e834fac1b8b0 and project cdb1ba9cb5644deeb4c2009add788a01. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:45:08.783614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:45:08.789224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:45:08.923015 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-190eb026-a37d-4a25-881c-070a1faa1d07 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.876495 Oct 27 18:45:08.928792 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 43/101] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:45:08.944600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fdf2d02d-1af1-4d4c-b929-6aa60e216214 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fdf2d02d-1af1-4d4c-b929-6aa60e216214 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Request method failure captured: Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 283 Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGs_ysdUBr5Z2suyC2IjQ_aj6kWWTMJm7cbSel7EwjBj_qX1eIlE_9aG8ZrtpBH3xFS5ayL2HTiRvfinXNyzFmDGL4sNDbqVsUBI61DCqFO-jXmM1b_8Xveqz3e8RYdgjKcIT4UGyHhSSGw7ADShxpAE9ZqmThZRCN9Tl4eEJHt6Pk Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 18:45:08.957529 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 18:45:08.958873 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c3796e5c38b84e89b9a80523736cbbb2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:08.958873 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:08.958873 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:08.958873 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:08.958873 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:08.958873 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:08.958873 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:08.958873 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 76b10cd0cd584e1d9c36e5350ed6f1d8 Oct 27 18:45:08.958873 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:08.958873 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:45:08.959564 n-d-860687-3 devstack@n-api.service[127028]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 27 18:45:08.959564 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:08.959564 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 18:45:08.959564 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 27 18:45:08.959564 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:08.959564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:08.959564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:45:08.959564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:45:08.959564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:45:08.959564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:08.960203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:08.961438 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:08.962564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:45:08.962564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:45:08.962564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 18:45:08.962564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:08.962564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fdf2d02d-1af1-4d4c-b929-6aa60e216214 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:08.964241 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fdf2d02d-1af1-4d4c-b929-6aa60e216214 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.032740 Oct 27 18:45:08.967055 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 44/102] 10.222.0.42 () {60 vars in 1165 bytes} [Thu Oct 27 18:45:08 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:45:08.983705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6089732d-6d33-46d2-81f0-7df439db1e20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:08.984452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6089732d-6d33-46d2-81f0-7df439db1e20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:09.002141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6089732d-6d33-46d2-81f0-7df439db1e20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:09.004038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6089732d-6d33-46d2-81f0-7df439db1e20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:09.004642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6089732d-6d33-46d2-81f0-7df439db1e20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:09.006282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6089732d-6d33-46d2-81f0-7df439db1e20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:09.014756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6089732d-6d33-46d2-81f0-7df439db1e20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:09.014756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6089732d-6d33-46d2-81f0-7df439db1e20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:09.240625 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-952783dc-6844-4f1a-9d86-28b2326196ca tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] HTTP exception thrown: Flavor access not found for 29 / d7dc49d380554ee591d7bd065839d60b combination. Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-952783dc-6844-4f1a-9d86-28b2326196ca tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Request method failure captured: Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/flavors/1087780225/action HTTP/1.1 Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 70 Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGsLbp8MpBuhTA_UYIaKXWDgVdYBAfbrd5oqVZT3RAQj8PoOzymqpfvPbXG9fxgw4Bac3ZcEK9fS1MEtKwgT6_wdMGwXTm9wkDWA0FEH_kQgTP1kfRzdyIonfTjIIEx_VN-kopR3Ob6T9qCecN_Ovc5_mRqKJvsLFjYsyBb_89zTMs Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c650c9e3f46b4eebbe354dd05694262c Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-808884614 Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:45:09.242739 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:45:09.244241 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c650c9e3f46b4eebbe354dd05694262c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c650c9e3f46b4eebbe354dd05694262c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c650c9e3f46b4eebbe354dd05694262c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c650c9e3f46b4eebbe354dd05694262c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:09.244241 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-808884614 Oct 27 18:45:09.244241 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c650c9e3f46b4eebbe354dd05694262c Oct 27 18:45:09.244241 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-808884614 Oct 27 18:45:09.244241 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin Oct 27 18:45:09.244241 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:09.244241 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:09.244241 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 96cacc4822a647d4b219becbb2bd5a71 Oct 27 18:45:09.244241 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin Oct 27 18:45:09.244241 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:45:09.244241 n-d-860687-3 devstack@n-api.service[127029]: {"removeTenantAccess": {"tenant": "d7dc49d380554ee591d7bd065839d60b"}} Oct 27 18:45:09.244241 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: exception: Flavor access not found for 29 / d7dc49d380554ee591d7bd065839d60b combination. Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '1087780225', 'body': {'removeTenantAccess': {'tenant': 'd7dc49d380554ee591d7bd065839d60b'}}} Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 27 18:45:09.249476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 29 / d7dc49d380554ee591d7bd065839d60b combination. Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 29 / d7dc49d380554ee591d7bd065839d60b combination. Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:09.251094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:09.252434 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:09.252434 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:09.252434 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:09.252434 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:09.252434 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 29 / d7dc49d380554ee591d7bd065839d60b combination. Oct 27 18:45:09.252434 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:09.252434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-952783dc-6844-4f1a-9d86-28b2326196ca tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Returning 404 to user: Flavor access not found for 29 / d7dc49d380554ee591d7bd065839d60b combination. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:09.252434 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-952783dc-6844-4f1a-9d86-28b2326196ca tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1087780225/action" status: 404 len: 124 microversion: 2.1 time: 0.960825 Oct 27 18:45:09.252434 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 59/103] 10.222.0.42 () {60 vars in 1200 bytes} [Thu Oct 27 18:45:08 2022] POST /compute/v2.1/flavors/1087780225/action => generated 124 bytes in 962 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:09.270948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bcbed9d5-329b-48ba-8ba5-b98926e91340 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:09.339310 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bcbed9d5-329b-48ba-8ba5-b98926e91340 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.093402 Oct 27 18:45:09.339911 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 60/104] 10.222.0.42 () {58 vars in 1173 bytes} [Thu Oct 27 18:45:09 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:09.380109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a5044a21-e7b6-4e67-b3a6-c02944399b2a tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:09.391531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a5044a21-e7b6-4e67-b3a6-c02944399b2a tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:09.726918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a5044a21-e7b6-4e67-b3a6-c02944399b2a tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:09.758675 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a5044a21-e7b6-4e67-b3a6-c02944399b2a tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1241 microversion: 2.1 time: 0.382007 Oct 27 18:45:09.778640 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 61/105] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:09 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1241 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:09.788382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b82bab01-c75f-42d1-8a7f-58a4b12bd91b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b82bab01-c75f-42d1-8a7f-58a4b12bd91b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Request method failure captured: Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 27 Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGs_ysdUBr5Z2suyC2IjQ_aj6kWWTMJm7cbSel7EwjBj_qX1eIlE_9aG8ZrtpBH3xFS5ayL2HTiRvfinXNyzFmDGL4sNDbqVsUBI61DCqFO-jXmM1b_8Xveqz3e8RYdgjKcIT4UGyHhSSGw7ADShxpAE9ZqmThZRCN9Tl4eEJHt6Pk Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:45:09.801629 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:45:09.803201 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c3796e5c38b84e89b9a80523736cbbb2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:09.803201 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:09.803201 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:09.803201 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:09.803201 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:09.803201 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:09.803201 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:09.803201 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 76b10cd0cd584e1d9c36e5350ed6f1d8 Oct 27 18:45:09.803201 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:09.803201 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:45:09.803201 n-d-860687-3 devstack@n-api.service[127029]: {"aggregate": {"name": ""}} Oct 27 18:45:09.803201 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:09.803201 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi '' Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:09.803855 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 18:45:09.804999 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:09.808180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b82bab01-c75f-42d1-8a7f-58a4b12bd91b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:09.809314 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b82bab01-c75f-42d1-8a7f-58a4b12bd91b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.028604 Oct 27 18:45:09.816532 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 62/106] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:09 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:45:09.823919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e16d31dd-09b7-4458-aaa2-819adfcbac66 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:09.825077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e16d31dd-09b7-4458-aaa2-819adfcbac66 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:09.839901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e16d31dd-09b7-4458-aaa2-819adfcbac66 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:09.841986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e16d31dd-09b7-4458-aaa2-819adfcbac66 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:09.842787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e16d31dd-09b7-4458-aaa2-819adfcbac66 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:09.843794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e16d31dd-09b7-4458-aaa2-819adfcbac66 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:09.844522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e16d31dd-09b7-4458-aaa2-819adfcbac66 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:09.845217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e16d31dd-09b7-4458-aaa2-819adfcbac66 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:10.248497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6089732d-6d33-46d2-81f0-7df439db1e20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:10.259972 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6089732d-6d33-46d2-81f0-7df439db1e20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 1.291766 Oct 27 18:45:10.262853 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 45/107] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:08 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:10.282323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f211b23b-144b-480a-80db-6b7d4b05c898 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:10.300551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=11,nova_api:INSERT=9 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:10.341139 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f211b23b-144b-480a-80db-6b7d4b05c898 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1087780225" status: 202 len: 0 microversion: 2.1 time: 0.076929 Oct 27 18:45:10.347881 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 46/108] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:45:10 2022] DELETE /compute/v2.1/flavors/1087780225 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:10.359720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7f4ced98-2e4d-4688-94e1-351b28847c10 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:10.422826 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7f4ced98-2e4d-4688-94e1-351b28847c10 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.073320 Oct 27 18:45:10.424412 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 47/109] 10.222.0.42 () {58 vars in 1169 bytes} [Thu Oct 27 18:45:10 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:10.442925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-abf140ad-bbe5-4a54-a32f-1293c7efbee2 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-131127317"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:10.450992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-abf140ad-bbe5-4a54-a32f-1293c7efbee2 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '85f7aabce23a4f0e96602625464c997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0df4e5654a04747ae69752316b6127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-abf140ad-bbe5-4a54-a32f-1293c7efbee2 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Request method failure captured: Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 59 Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGqV0DjaYXQe-IzomTLCwMkDKwOIx6alwBBND54DJ7DsxKmYkh91Hs5uNszTBDiKfnge54x6u8XqdCxMb7Xq_TVuFktgrAfPWg1YIPw7PaoZSCIA_Vfppo_q6MbhX0Vz9ya8S3DMheia8QnviXk2xyH2feodcem25HOkuEcQxDvBtE Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f0df4e5654a04747ae69752316b6127a Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:45:10.463169 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:45:10.464592 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f0df4e5654a04747ae69752316b6127a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:10.464592 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:10.464592 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f0df4e5654a04747ae69752316b6127a Oct 27 18:45:10.464592 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:10.464592 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AggregatesAdminNegativeTestJSON-1275643815-project Oct 27 18:45:10.464592 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:10.464592 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:10.464592 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 85f7aabce23a4f0e96602625464c997a Oct 27 18:45:10.464592 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815-project Oct 27 18:45:10.464592 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:45:10.464592 n-d-860687-3 devstack@n-api.service[127028]: {"aggregate": {"name": "tempest-test_aggregate-131127317"}} Oct 27 18:45:10.464592 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:10.464592 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-131127317'}}} Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:45:10.465375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:45:10.466803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 27 18:45:10.468735 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:10.475066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-abf140ad-bbe5-4a54-a32f-1293c7efbee2 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:10.482741 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-abf140ad-bbe5-4a54-a32f-1293c7efbee2 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.052710 Oct 27 18:45:10.487288 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 48/110] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:10 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:10.502715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cfb4e1f9-e244-46c5-9e58-46e154894bb5 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:10.521568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e16d31dd-09b7-4458-aaa2-819adfcbac66 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:10.534102 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e16d31dd-09b7-4458-aaa2-819adfcbac66 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.714830 Oct 27 18:45:10.536539 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 63/111] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:09 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:10.551133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-06dd489d-adb0-4f9d-8c15-b6917ae2a254 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:10.576735 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cfb4e1f9-e244-46c5-9e58-46e154894bb5 tempest-FlavorsAccessNegativeTestJSON-808884614 tempest-FlavorsAccessNegativeTestJSON-808884614-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.087059 Oct 27 18:45:10.594008 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-06dd489d-adb0-4f9d-8c15-b6917ae2a254 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1034420877" status: 202 len: 0 microversion: 2.1 time: 0.053004 Oct 27 18:45:10.594979 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 64/113] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:45:10 2022] DELETE /compute/v2.1/flavors/1034420877 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:10.600625 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 49/113] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:10 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:10.606544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2e93a81d-1d11-49ae-b994-10c8e4711bd0 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-112041757"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:10.609951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6405abb5-6b27-4cba-88d6-11021066ebf9 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:10.614646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.aggregate [None req-2e93a81d-1d11-49ae-b994-10c8e4711bd0 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Generated uuid 0e7034d9-d4df-4dfc-b5b9-efc1b5895a61 for aggregate {{(pid=127029) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:10.643398 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6405abb5-6b27-4cba-88d6-11021066ebf9 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038556 Oct 27 18:45:10.644789 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 50/114] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:10.672355 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2e93a81d-1d11-49ae-b994-10c8e4711bd0 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.075701 Oct 27 18:45:10.673341 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 65/115] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:10 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:10.686886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4f66dcf9-83df-496a-ae4a-1a1b9986d17f tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:10.689958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dda1a65c-2be9-4639-8e0f-34c578979dff tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-112041757"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:10.705415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.aggregate [None req-dda1a65c-2be9-4639-8e0f-34c578979dff tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Generated uuid 16914de2-8b70-48f8-93fe-cbf1ad08d425 for aggregate {{(pid=127029) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:10.718840 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4f66dcf9-83df-496a-ae4a-1a1b9986d17f tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1300916342" status: 202 len: 0 microversion: 2.1 time: 0.055611 Oct 27 18:45:10.720364 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 51/116] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:45:10 2022] DELETE /compute/v2.1/flavors/1300916342 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 18:45:10.736502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7cf0c11b-47f5-48bd-b0f5-da7bfc3f8fe5 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:10.742224 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-dda1a65c-2be9-4639-8e0f-34c578979dff tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-112041757 already exists. Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dda1a65c-2be9-4639-8e0f-34c578979dff tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Request method failure captured: Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 59 Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGs_ysdUBr5Z2suyC2IjQ_aj6kWWTMJm7cbSel7EwjBj_qX1eIlE_9aG8ZrtpBH3xFS5ayL2HTiRvfinXNyzFmDGL4sNDbqVsUBI61DCqFO-jXmM1b_8Xveqz3e8RYdgjKcIT4UGyHhSSGw7ADShxpAE9ZqmThZRCN9Tl4eEJHt6Pk Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:45:10.745325 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:45:10.746681 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c3796e5c38b84e89b9a80523736cbbb2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:10.746681 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:10.746681 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:10.746681 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:10.746681 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:10.746681 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:10.746681 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:10.746681 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 76b10cd0cd584e1d9c36e5350ed6f1d8 Oct 27 18:45:10.746681 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:10.746681 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:45:10.746681 n-d-860687-3 devstack@n-api.service[127029]: {"aggregate": {"name": "tempest-test_aggregate-112041757"}} Oct 27 18:45:10.746681 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:10.746681 n-d-860687-3 devstack@n-api.service[127029]: exception: Aggregate tempest-test_aggregate-112041757 already exists. Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-112041757'}}} Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 27 18:45:10.747993 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-112041757 already exists. Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:10.749249 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 27 18:45:10.750341 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 27 18:45:10.750341 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-112041757 already exists. Oct 27 18:45:10.750341 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:10.750341 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:10.750341 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:10.750341 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:10.750341 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:10.750341 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:10.750341 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:10.750341 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:10.750341 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-112041757 already exists. Oct 27 18:45:10.750341 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:10.753511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dda1a65c-2be9-4639-8e0f-34c578979dff tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-112041757 already exists. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:10.754592 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dda1a65c-2be9-4639-8e0f-34c578979dff tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.073436 Oct 27 18:45:10.758430 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 66/117] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:10 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 18:45:10.769434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6cecceb1-c750-4d00-81c0-214970cda672 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:10.790829 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7cf0c11b-47f5-48bd-b0f5-da7bfc3f8fe5 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065563 Oct 27 18:45:10.791735 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 52/118] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:10.797191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5f86cbe5-0525-4aee-88ea-d2662009efcd tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:10.797810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5f86cbe5-0525-4aee-88ea-d2662009efcd tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:10.811246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f86cbe5-0525-4aee-88ea-d2662009efcd tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:10.811246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f86cbe5-0525-4aee-88ea-d2662009efcd tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:10.811246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f86cbe5-0525-4aee-88ea-d2662009efcd tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:10.811246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f86cbe5-0525-4aee-88ea-d2662009efcd tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:10.812695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f86cbe5-0525-4aee-88ea-d2662009efcd tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:10.812695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f86cbe5-0525-4aee-88ea-d2662009efcd tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:10.834611 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6cecceb1-c750-4d00-81c0-214970cda672 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.071245 Oct 27 18:45:10.838876 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 67/119] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:10 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:10.847742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-26e01b8e-7f5e-4d48-bc9d-2705efedd1d3 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2074571255", "id": 2029773311, "os-flavor-access:is_public": "False"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:10.933513 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-26e01b8e-7f5e-4d48-bc9d-2705efedd1d3 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.093853 Oct 27 18:45:10.934308 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 68/120] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:10 2022] POST /compute/v2.1/flavors => generated 415 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:10.954084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3dafc89d-9c43-47f4-b112-cec0f56cdac1 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1025198443"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:10.957615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.aggregate [None req-3dafc89d-9c43-47f4-b112-cec0f56cdac1 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Generated uuid dbea8e0d-17b8-4c9a-9e51-2de0bc9de976 for aggregate {{(pid=127029) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:10.998506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9,nova_api:DELETE=11 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:11.018190 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3dafc89d-9c43-47f4-b112-cec0f56cdac1 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.078449 Oct 27 18:45:11.020721 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 69/121] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:11.041484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-785b6bce-85f7-4f83-aa96-e9e0e5b0eea5 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:11.109962 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-785b6bce-85f7-4f83-aa96-e9e0e5b0eea5 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.087933 Oct 27 18:45:11.120797 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 70/122] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:11.138544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c42fa713-ab3d-4c6e-ba7f-89779558aff9 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:11.143918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c42fa713-ab3d-4c6e-ba7f-89779558aff9 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '85f7aabce23a4f0e96602625464c997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0df4e5654a04747ae69752316b6127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c42fa713-ab3d-4c6e-ba7f-89779558aff9 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Request method failure captured: Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGqV0DjaYXQe-IzomTLCwMkDKwOIx6alwBBND54DJ7DsxKmYkh91Hs5uNszTBDiKfnge54x6u8XqdCxMb7Xq_TVuFktgrAfPWg1YIPw7PaoZSCIA_Vfppo_q6MbhX0Vz9ya8S3DMheia8QnviXk2xyH2feodcem25HOkuEcQxDvBtE Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f0df4e5654a04747ae69752316b6127a Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:45:11.149489 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:45:11.150932 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f0df4e5654a04747ae69752316b6127a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:11.150932 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:11.150932 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f0df4e5654a04747ae69752316b6127a Oct 27 18:45:11.150932 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:11.150932 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminNegativeTestJSON-1275643815-project Oct 27 18:45:11.150932 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:11.150932 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:11.150932 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 85f7aabce23a4f0e96602625464c997a Oct 27 18:45:11.150932 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815-project Oct 27 18:45:11.150932 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:11.150932 n-d-860687-3 devstack@n-api.service[127029]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 27 18:45:11.150932 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '7'} Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:11.151692 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 27 18:45:11.152835 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:11.156984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c42fa713-ab3d-4c6e-ba7f-89779558aff9 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:11.158165 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c42fa713-ab3d-4c6e-ba7f-89779558aff9 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.035407 Oct 27 18:45:11.162753 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 71/123] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:11 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:11.177805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d4be031-1063-42af-9e05-8e6445e21a0c tempest-FlavorsAdminTestJSON-1580156533 tempest-FlavorsAdminTestJSON-1580156533-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:11.244773 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0d4be031-1063-42af-9e05-8e6445e21a0c tempest-FlavorsAdminTestJSON-1580156533 tempest-FlavorsAdminTestJSON-1580156533-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.078515 Oct 27 18:45:11.253338 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 72/124] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:11.267325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-10efbb01-3d7d-4817-bb7e-4d181442883e tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:11.343167 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-10efbb01-3d7d-4817-bb7e-4d181442883e tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.086328 Oct 27 18:45:11.346019 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 73/125] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:11 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:11.364114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e52f5c1e-c78d-46a8-874b-b4c40dd73632 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:11.423867 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e52f5c1e-c78d-46a8-874b-b4c40dd73632 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/2029773311" status: 202 len: 0 microversion: 2.1 time: 0.074290 Oct 27 18:45:11.426740 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 74/126] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:45:11 2022] DELETE /compute/v2.1/flavors/2029773311 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:11.447699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-81220405-c769-44cd-a465-7e8e4ebe62c8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:11.448339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-81220405-c769-44cd-a465-7e8e4ebe62c8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:11.458597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5f86cbe5-0525-4aee-88ea-d2662009efcd tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:11.474656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81220405-c769-44cd-a465-7e8e4ebe62c8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:11.475152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81220405-c769-44cd-a465-7e8e4ebe62c8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:11.476580 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5f86cbe5-0525-4aee-88ea-d2662009efcd tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1289 microversion: 2.1 time: 0.683531 Oct 27 18:45:11.477473 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 53/127] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:10 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1289 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:11.487660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1e11b61b-31df-41bd-a77b-45b05e6f1631 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:11.501591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81220405-c769-44cd-a465-7e8e4ebe62c8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:11.502449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81220405-c769-44cd-a465-7e8e4ebe62c8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:11.506128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81220405-c769-44cd-a465-7e8e4ebe62c8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:11.506128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81220405-c769-44cd-a465-7e8e4ebe62c8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:11.528306 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-1e11b61b-31df-41bd-a77b-45b05e6f1631 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1e11b61b-31df-41bd-a77b-45b05e6f1631 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Request method failure captured: Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGs_ysdUBr5Z2suyC2IjQ_aj6kWWTMJm7cbSel7EwjBj_qX1eIlE_9aG8ZrtpBH3xFS5ayL2HTiRvfinXNyzFmDGL4sNDbqVsUBI61DCqFO-jXmM1b_8Xveqz3e8RYdgjKcIT4UGyHhSSGw7ADShxpAE9ZqmThZRCN9Tl4eEJHt6Pk Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 18:45:11.564907 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 18:45:11.566258 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c3796e5c38b84e89b9a80523736cbbb2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:11.566258 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:11.566258 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:11.566258 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:11.566258 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:11.566258 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:11.566258 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:11.566258 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 76b10cd0cd584e1d9c36e5350ed6f1d8 Oct 27 18:45:11.566258 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:11.566258 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:11.566258 n-d-860687-3 devstack@n-api.service[127028]: exception: Aggregate -1 could not be found. Oct 27 18:45:11.566258 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '-1'} Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 18:45:11.566957 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:11.567885 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:11.569190 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:11.569190 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:11.569190 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:11.569190 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:11.569190 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 27 18:45:11.569190 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:11.583058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1e11b61b-31df-41bd-a77b-45b05e6f1631 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:11.590997 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1e11b61b-31df-41bd-a77b-45b05e6f1631 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.108751 Oct 27 18:45:11.592353 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 54/128] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 18:45:11 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:45:11.612908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-680cd7fc-c30e-4db4-bbb2-fe5560a5e6ff tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:11.667981 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-680cd7fc-c30e-4db4-bbb2-fe5560a5e6ff tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074484 Oct 27 18:45:11.672490 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 55/129] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:11.679320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-db458a82-6f78-4faf-a0a7-15aa1043d8c3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:11.680171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-db458a82-6f78-4faf-a0a7-15aa1043d8c3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:11.697109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db458a82-6f78-4faf-a0a7-15aa1043d8c3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:11.697621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db458a82-6f78-4faf-a0a7-15aa1043d8c3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:11.698156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db458a82-6f78-4faf-a0a7-15aa1043d8c3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:11.698995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db458a82-6f78-4faf-a0a7-15aa1043d8c3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:11.703816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db458a82-6f78-4faf-a0a7-15aa1043d8c3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:11.704275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db458a82-6f78-4faf-a0a7-15aa1043d8c3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:12.104687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-81220405-c769-44cd-a465-7e8e4ebe62c8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:12.117638 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-81220405-c769-44cd-a465-7e8e4ebe62c8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 0.688536 Oct 27 18:45:12.120174 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 75/130] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:11 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:12.133893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9fd1c473-11bc-47b7-b72f-51868ab0eaef tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-19065643"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:12.142630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.aggregate [None req-9fd1c473-11bc-47b7-b72f-51868ab0eaef tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Generated uuid 39b3497b-3ea3-49b6-83e5-e56b660c8213 for aggregate {{(pid=127029) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:12.190000 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9fd1c473-11bc-47b7-b72f-51868ab0eaef tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.068073 Oct 27 18:45:12.193686 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 76/131] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:12 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:12.207944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85bae4d5-8064-45ce-8593-5b60b1c01543 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1880011752", "id": 2028133990, "os-flavor-access:is_public": "True"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:12.246718 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-85bae4d5-8064-45ce-8593-5b60b1c01543 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.050263 Oct 27 18:45:12.248339 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 77/132] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:12 2022] POST /compute/v2.1/flavors => generated 414 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:12.409910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5de92eee-c437-41ee-a123-50cebb89abee req-d5837a46-00cf-4633-8b75-457dccea85fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a43e1759-0ffb-423c-8d31-569d5ce79268", "tag": "a4a765b2-af26-4b76-a70c-74d7dc9d17af"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:12.457658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5de92eee-c437-41ee-a123-50cebb89abee req-d5837a46-00cf-4633-8b75-457dccea85fa service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:12.460383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5de92eee-c437-41ee-a123-50cebb89abee req-d5837a46-00cf-4633-8b75-457dccea85fa service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:12.463354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5de92eee-c437-41ee-a123-50cebb89abee req-d5837a46-00cf-4633-8b75-457dccea85fa service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:12.529923 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5de92eee-c437-41ee-a123-50cebb89abee req-d5837a46-00cf-4633-8b75-457dccea85fa service nova] Creating event network-changed:a4a765b2-af26-4b76-a70c-74d7dc9d17af for instance a43e1759-0ffb-423c-8d31-569d5ce79268 on n-h2-860687-3 Oct 27 18:45:12.533839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5de92eee-c437-41ee-a123-50cebb89abee req-d5837a46-00cf-4633-8b75-457dccea85fa service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 18:45:12.535204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5de92eee-c437-41ee-a123-50cebb89abee req-d5837a46-00cf-4633-8b75-457dccea85fa service nova] Acquired lock "compute-rpcapi-router" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 18:45:12.543908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdc78a48-c2cf-43b1-8438-51d92eedc8dc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:12.546660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdc78a48-c2cf-43b1-8438-51d92eedc8dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:12.547271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdc78a48-c2cf-43b1-8438-51d92eedc8dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:12.549636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdc78a48-c2cf-43b1-8438-51d92eedc8dc None None] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:12.551686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdc78a48-c2cf-43b1-8438-51d92eedc8dc None None] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:12.554227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdc78a48-c2cf-43b1-8438-51d92eedc8dc None None] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:12.615648 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.compute.rpcapi [None req-cdc78a48-c2cf-43b1-8438-51d92eedc8dc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 27 18:45:12.621065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdc78a48-c2cf-43b1-8438-51d92eedc8dc None None] Releasing lock "compute-rpcapi-router" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 18:45:12.664473 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cdc78a48-c2cf-43b1-8438-51d92eedc8dc None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.406342 Oct 27 18:45:12.666179 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 78/133] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:12.680936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce9b9a07-e7e0-4db5-83d3-e166434786b5 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:12.685908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ce9b9a07-e7e0-4db5-83d3-e166434786b5 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '85f7aabce23a4f0e96602625464c997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0df4e5654a04747ae69752316b6127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce9b9a07-e7e0-4db5-83d3-e166434786b5 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Request method failure captured: Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGqV0DjaYXQe-IzomTLCwMkDKwOIx6alwBBND54DJ7DsxKmYkh91Hs5uNszTBDiKfnge54x6u8XqdCxMb7Xq_TVuFktgrAfPWg1YIPw7PaoZSCIA_Vfppo_q6MbhX0Vz9ya8S3DMheia8QnviXk2xyH2feodcem25HOkuEcQxDvBtE Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f0df4e5654a04747ae69752316b6127a Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:45:12.688008 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:45:12.689229 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f0df4e5654a04747ae69752316b6127a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:12.689229 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:12.689229 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f0df4e5654a04747ae69752316b6127a Oct 27 18:45:12.689229 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:12.689229 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminNegativeTestJSON-1275643815-project Oct 27 18:45:12.689229 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:12.689229 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:12.689229 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 85f7aabce23a4f0e96602625464c997a Oct 27 18:45:12.689229 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815-project Oct 27 18:45:12.689229 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:12.689229 n-d-860687-3 devstack@n-api.service[127029]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 27 18:45:12.689229 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '8'} Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:12.689956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 27 18:45:12.690980 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:12.695474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce9b9a07-e7e0-4db5-83d3-e166434786b5 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:12.698491 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce9b9a07-e7e0-4db5-83d3-e166434786b5 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] 10.222.0.42 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.030845 Oct 27 18:45:12.701155 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 79/134] 10.222.0.42 () {58 vars in 1149 bytes} [Thu Oct 27 18:45:12 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:12.712212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ad97f3b2-6313-439b-a2ca-e18307ce56e3 tempest-FlavorsAdminTestJSON-1580156533 tempest-FlavorsAdminTestJSON-1580156533-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:12.770779 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ad97f3b2-6313-439b-a2ca-e18307ce56e3 tempest-FlavorsAdminTestJSON-1580156533 tempest-FlavorsAdminTestJSON-1580156533-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.068214 Oct 27 18:45:12.771897 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 80/135] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:12 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:12.780823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-22021997-c765-4a6e-a7b9-85e0b2355adc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:12.787175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-22021997-c765-4a6e-a7b9-85e0b2355adc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:12.801114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22021997-c765-4a6e-a7b9-85e0b2355adc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:12.804940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22021997-c765-4a6e-a7b9-85e0b2355adc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:12.806183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22021997-c765-4a6e-a7b9-85e0b2355adc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:12.809947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22021997-c765-4a6e-a7b9-85e0b2355adc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:12.810814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22021997-c765-4a6e-a7b9-85e0b2355adc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:12.811485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22021997-c765-4a6e-a7b9-85e0b2355adc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:13.064179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-22021997-c765-4a6e-a7b9-85e0b2355adc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:13.080946 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-22021997-c765-4a6e-a7b9-85e0b2355adc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1295 microversion: 2.1 time: 0.299912 Oct 27 18:45:13.096937 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 81/136] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:12 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1295 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:13.110910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13c41173-e276-48e6-9d67-0da19c3fbf40 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:13.137320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-db458a82-6f78-4faf-a0a7-15aa1043d8c3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:13.152775 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-db458a82-6f78-4faf-a0a7-15aa1043d8c3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 1.479075 Oct 27 18:45:13.166414 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 56/137] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:11 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:13.174798 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13c41173-e276-48e6-9d67-0da19c3fbf40 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.072866 Oct 27 18:45:13.174798 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 82/138] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:13 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:13.183417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1d1b3af3-0c63-40b9-bf70-305ed33953b1 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:13.238738 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1d1b3af3-0c63-40b9-bf70-305ed33953b1 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/2028133990" status: 202 len: 0 microversion: 2.1 time: 0.082439 Oct 27 18:45:13.239364 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 57/139] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:45:13 2022] DELETE /compute/v2.1/flavors/2028133990 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:13.264989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03a11914-29e6-4fbe-ba56-ba4f09df2775 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:13.265653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-03a11914-29e6-4fbe-ba56-ba4f09df2775 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:13.293716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03a11914-29e6-4fbe-ba56-ba4f09df2775 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:13.296583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03a11914-29e6-4fbe-ba56-ba4f09df2775 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:13.297268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03a11914-29e6-4fbe-ba56-ba4f09df2775 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:13.298955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03a11914-29e6-4fbe-ba56-ba4f09df2775 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:13.301451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03a11914-29e6-4fbe-ba56-ba4f09df2775 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:13.302818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03a11914-29e6-4fbe-ba56-ba4f09df2775 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:13.476637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-636d1fb1-fe4c-4ae8-91ce-6e1c044f7274 tempest-FlavorsV255TestJSON-1907817755 tempest-FlavorsV255TestJSON-1907817755-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1124807306", "id": 1630844087, "os-flavor-access:is_public": "True"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:13.548267 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-636d1fb1-fe4c-4ae8-91ce-6e1c044f7274 tempest-FlavorsV255TestJSON-1907817755 tempest-FlavorsV255TestJSON-1907817755-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.373457 Oct 27 18:45:13.565375 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 83/140] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 18:45:13 2022] POST /compute/v2.1/flavors => generated 449 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:45:13.589109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-28857a33-09f0-4b8e-904c-8019dc509014 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:13.607310 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-28857a33-09f0-4b8e-904c-8019dc509014 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-28857a33-09f0-4b8e-904c-8019dc509014 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Request method failure captured: Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGs_ysdUBr5Z2suyC2IjQ_aj6kWWTMJm7cbSel7EwjBj_qX1eIlE_9aG8ZrtpBH3xFS5ayL2HTiRvfinXNyzFmDGL4sNDbqVsUBI61DCqFO-jXmM1b_8Xveqz3e8RYdgjKcIT4UGyHhSSGw7ADShxpAE9ZqmThZRCN9Tl4eEJHt6Pk Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:45:13.609193 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:45:13.610514 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c3796e5c38b84e89b9a80523736cbbb2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:13.610514 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:13.610514 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:13.610514 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:13.610514 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:13.610514 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:13.610514 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:13.610514 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 76b10cd0cd584e1d9c36e5350ed6f1d8 Oct 27 18:45:13.610514 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:13.610514 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:13.610514 n-d-860687-3 devstack@n-api.service[127029]: exception: Aggregate -1 could not be found. Oct 27 18:45:13.610514 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '-1'} Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:13.611259 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 27 18:45:13.612508 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:13.614281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-28857a33-09f0-4b8e-904c-8019dc509014 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:13.615329 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-28857a33-09f0-4b8e-904c-8019dc509014 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.036012 Oct 27 18:45:13.616029 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 84/141] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:13 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:45:13.621440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6669da47-c9e0-4a03-80bc-1c6ee7df9010 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:13.655569 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6669da47-c9e0-4a03-80bc-1c6ee7df9010 tempest-FlavorsAdminTestJSON-223428695 tempest-FlavorsAdminTestJSON-223428695-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.038160 Oct 27 18:45:13.670352 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 85/142] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:13 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:13.959589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6a08d707-f3fd-4808-be00-5245dfc92f39 tempest-FlavorsV255TestJSON-495652606 tempest-FlavorsV255TestJSON-495652606-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:13.986255 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6a08d707-f3fd-4808-be00-5245dfc92f39 tempest-FlavorsV255TestJSON-495652606 tempest-FlavorsV255TestJSON-495652606-project] 10.222.0.42 "GET /compute/v2.1/flavors/1630844087" status: 200 len: 449 microversion: 2.55 time: 0.314381 Oct 27 18:45:13.993147 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 86/143] 10.222.0.42 () {60 vars in 1199 bytes} [Thu Oct 27 18:45:13 2022] GET /compute/v2.1/flavors/1630844087 => generated 449 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:45:14.018066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7d08a0b8-3b69-4cf0-be22-4cd9a08d1e90 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:14.021073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7d08a0b8-3b69-4cf0-be22-4cd9a08d1e90 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '85f7aabce23a4f0e96602625464c997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0df4e5654a04747ae69752316b6127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7d08a0b8-3b69-4cf0-be22-4cd9a08d1e90 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Request method failure captured: Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGqV0DjaYXQe-IzomTLCwMkDKwOIx6alwBBND54DJ7DsxKmYkh91Hs5uNszTBDiKfnge54x6u8XqdCxMb7Xq_TVuFktgrAfPWg1YIPw7PaoZSCIA_Vfppo_q6MbhX0Vz9ya8S3DMheia8QnviXk2xyH2feodcem25HOkuEcQxDvBtE Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f0df4e5654a04747ae69752316b6127a Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:45:14.030296 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:45:14.031506 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f0df4e5654a04747ae69752316b6127a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:14.031506 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:14.031506 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f0df4e5654a04747ae69752316b6127a Oct 27 18:45:14.031506 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:14.031506 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminNegativeTestJSON-1275643815-project Oct 27 18:45:14.031506 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:14.031506 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:14.031506 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 85f7aabce23a4f0e96602625464c997a Oct 27 18:45:14.031506 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815-project Oct 27 18:45:14.031506 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:14.031506 n-d-860687-3 devstack@n-api.service[127029]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 27 18:45:14.031506 n-d-860687-3 devstack@n-api.service[127029]: action_args: {} Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:14.032102 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:14.032998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7d08a0b8-3b69-4cf0-be22-4cd9a08d1e90 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:14.036987 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7d08a0b8-3b69-4cf0-be22-4cd9a08d1e90 tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.038687 Oct 27 18:45:14.039434 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 87/144] 10.222.0.42 () {58 vars in 1143 bytes} [Thu Oct 27 18:45:13 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:14.061691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a6dc298-6a14-442d-92fe-95dc250ac696 tempest-FlavorsV255TestJSON-1907817755 tempest-FlavorsV255TestJSON-1907817755-project-admin] Action: 'update', calling method: .version_select at 0x7fc870ec3b80>, body: {"flavor": {"description": "new"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:14.176297 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5a6dc298-6a14-442d-92fe-95dc250ac696 tempest-FlavorsV255TestJSON-1907817755 tempest-FlavorsV255TestJSON-1907817755-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/1630844087" status: 200 len: 450 microversion: 2.55 time: 0.135538 Oct 27 18:45:14.183041 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 88/145] 10.222.0.42 () {62 vars in 1219 bytes} [Thu Oct 27 18:45:14 2022] PUT /compute/v2.1/flavors/1630844087 => generated 450 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:45:14.193667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3dc8db6b-5836-4f2e-bce7-d0b1c78e13fa tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:14.194887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3dc8db6b-5836-4f2e-bce7-d0b1c78e13fa tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:14.206214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dc8db6b-5836-4f2e-bce7-d0b1c78e13fa tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:14.207747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dc8db6b-5836-4f2e-bce7-d0b1c78e13fa tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:14.208735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dc8db6b-5836-4f2e-bce7-d0b1c78e13fa tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:14.211498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dc8db6b-5836-4f2e-bce7-d0b1c78e13fa tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:14.213648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dc8db6b-5836-4f2e-bce7-d0b1c78e13fa tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:14.215433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dc8db6b-5836-4f2e-bce7-d0b1c78e13fa tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:14.395293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3dc8db6b-5836-4f2e-bce7-d0b1c78e13fa tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:14.416840 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3dc8db6b-5836-4f2e-bce7-d0b1c78e13fa tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1295 microversion: 2.1 time: 0.232881 Oct 27 18:45:14.418865 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 89/146] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:14 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1295 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:14.434280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e26fd109-99b6-4eb6-b046-ccf92d84658b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:14.436791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e26fd109-99b6-4eb6-b046-ccf92d84658b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:14.455012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e26fd109-99b6-4eb6-b046-ccf92d84658b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:14.458760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e26fd109-99b6-4eb6-b046-ccf92d84658b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:14.459537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e26fd109-99b6-4eb6-b046-ccf92d84658b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:14.463837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e26fd109-99b6-4eb6-b046-ccf92d84658b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:14.468078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e26fd109-99b6-4eb6-b046-ccf92d84658b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:14.470170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e26fd109-99b6-4eb6-b046-ccf92d84658b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:14.996994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-03a11914-29e6-4fbe-ba56-ba4f09df2775 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:15.032759 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-03a11914-29e6-4fbe-ba56-ba4f09df2775 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 1.790641 Oct 27 18:45:15.034304 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 58/147] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:13 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:15.043976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d8a823fb-ca49-4fd9-b65b-d5e5f0a7ea11 tempest-FlavorsV255TestJSON-495652606 tempest-FlavorsV255TestJSON-495652606-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:15.106175 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d8a823fb-ca49-4fd9-b65b-d5e5f0a7ea11 tempest-FlavorsV255TestJSON-495652606 tempest-FlavorsV255TestJSON-495652606-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.068692 Oct 27 18:45:15.107739 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 59/148] 10.222.0.42 () {60 vars in 1187 bytes} [Thu Oct 27 18:45:15 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:45:15.143334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e26fd109-99b6-4eb6-b046-ccf92d84658b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:15.159926 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e26fd109-99b6-4eb6-b046-ccf92d84658b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.737356 Oct 27 18:45:15.161158 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 90/149] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:14 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:15.175030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-93bc884a-4a5c-4e9b-9e10-ebfde0d30074 tempest-FlavorsV255TestJSON-495652606 tempest-FlavorsV255TestJSON-495652606-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:15.212943 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-93bc884a-4a5c-4e9b-9e10-ebfde0d30074 tempest-FlavorsV255TestJSON-495652606 tempest-FlavorsV255TestJSON-495652606-project] 10.222.0.42 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.047671 Oct 27 18:45:15.229461 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 91/150] 10.222.0.42 () {60 vars in 1166 bytes} [Thu Oct 27 18:45:15 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:45:15.240935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8848354b-eb6e-4bf0-880c-c64f04eafa68 tempest-FlavorsV255TestJSON-1907817755 tempest-FlavorsV255TestJSON-1907817755-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:15.276013 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8848354b-eb6e-4bf0-880c-c64f04eafa68 tempest-FlavorsV255TestJSON-1907817755 tempest-FlavorsV255TestJSON-1907817755-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1630844087" status: 202 len: 0 microversion: 2.55 time: 0.043868 Oct 27 18:45:15.283824 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 92/151] 10.222.0.42 () {60 vars in 1202 bytes} [Thu Oct 27 18:45:15 2022] DELETE /compute/v2.1/flavors/1630844087 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 18:45:15.293518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1bbf12b5-8625-456b-9c4b-e42ddf8fa55a tempest-FlavorsV255TestJSON-1907817755 tempest-FlavorsV255TestJSON-1907817755-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:15.333006 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1bbf12b5-8625-456b-9c4b-e42ddf8fa55a tempest-FlavorsV255TestJSON-1907817755 tempest-FlavorsV255TestJSON-1907817755-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.047480 Oct 27 18:45:15.357525 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 93/152] 10.222.0.42 () {60 vars in 1187 bytes} [Thu Oct 27 18:45:15 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:45:15.447293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a8507dcc-e429-4310-80ab-37f53fb5d97a tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:15.448678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a8507dcc-e429-4310-80ab-37f53fb5d97a tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:15.463646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-fd7047de-099f-46d4-b83b-8e87d9a5d08c req-16eba57a-193d-49ff-8779-8a7558c1e567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cdb9a88-0030-489e-ad1a-4a8e02b48412", "tag": "cd2c07f5-0093-4c0e-aaa2-fd60e1aa715e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:15.475171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8507dcc-e429-4310-80ab-37f53fb5d97a tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:15.478237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8507dcc-e429-4310-80ab-37f53fb5d97a tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:15.478961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8507dcc-e429-4310-80ab-37f53fb5d97a tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:15.480039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8507dcc-e429-4310-80ab-37f53fb5d97a tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:15.483211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8507dcc-e429-4310-80ab-37f53fb5d97a tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:15.483952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8507dcc-e429-4310-80ab-37f53fb5d97a tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:15.495355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fd7047de-099f-46d4-b83b-8e87d9a5d08c req-16eba57a-193d-49ff-8779-8a7558c1e567 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:15.498620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fd7047de-099f-46d4-b83b-8e87d9a5d08c req-16eba57a-193d-49ff-8779-8a7558c1e567 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:15.499923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fd7047de-099f-46d4-b83b-8e87d9a5d08c req-16eba57a-193d-49ff-8779-8a7558c1e567 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:15.542802 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-fd7047de-099f-46d4-b83b-8e87d9a5d08c req-16eba57a-193d-49ff-8779-8a7558c1e567 service nova] Creating event network-changed:cd2c07f5-0093-4c0e-aaa2-fd60e1aa715e for instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 on n-h2-860687-3 Oct 27 18:45:15.543896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fd7047de-099f-46d4-b83b-8e87d9a5d08c req-16eba57a-193d-49ff-8779-8a7558c1e567 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 18:45:15.549505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fd7047de-099f-46d4-b83b-8e87d9a5d08c req-16eba57a-193d-49ff-8779-8a7558c1e567 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 18:45:15.552563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-220658d1-ada8-403e-a066-38e20fe9d60b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:15.556277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-220658d1-ada8-403e-a066-38e20fe9d60b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:15.558094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-220658d1-ada8-403e-a066-38e20fe9d60b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:15.559486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-220658d1-ada8-403e-a066-38e20fe9d60b None None] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:15.561898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-220658d1-ada8-403e-a066-38e20fe9d60b None None] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:15.562584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-220658d1-ada8-403e-a066-38e20fe9d60b None None] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:15.587695 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.compute.rpcapi [None req-220658d1-ada8-403e-a066-38e20fe9d60b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 27 18:45:15.596088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-220658d1-ada8-403e-a066-38e20fe9d60b None None] Releasing lock "compute-rpcapi-router" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 18:45:15.634249 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-220658d1-ada8-403e-a066-38e20fe9d60b None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.522938 Oct 27 18:45:15.637159 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 60/153] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:15.640926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a8507dcc-e429-4310-80ab-37f53fb5d97a tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:15.655887 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a8507dcc-e429-4310-80ab-37f53fb5d97a tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1295 microversion: 2.1 time: 0.213092 Oct 27 18:45:15.656782 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 94/154] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:15 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1295 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:16.069842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a1222f8f-cb83-4976-9b9b-8cad3a813973 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:16.074576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a1222f8f-cb83-4976-9b9b-8cad3a813973 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:16.096469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1222f8f-cb83-4976-9b9b-8cad3a813973 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:16.098980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1222f8f-cb83-4976-9b9b-8cad3a813973 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:16.101029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1222f8f-cb83-4976-9b9b-8cad3a813973 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:16.102229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1222f8f-cb83-4976-9b9b-8cad3a813973 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:16.102937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1222f8f-cb83-4976-9b9b-8cad3a813973 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:16.103592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1222f8f-cb83-4976-9b9b-8cad3a813973 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:16.188701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5176b44c-c3d0-4844-89c6-0ba19afdd483 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:16.189245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5176b44c-c3d0-4844-89c6-0ba19afdd483 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:16.204318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5176b44c-c3d0-4844-89c6-0ba19afdd483 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:16.204849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5176b44c-c3d0-4844-89c6-0ba19afdd483 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:16.205442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5176b44c-c3d0-4844-89c6-0ba19afdd483 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:16.206025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5176b44c-c3d0-4844-89c6-0ba19afdd483 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:16.206480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5176b44c-c3d0-4844-89c6-0ba19afdd483 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:16.206929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5176b44c-c3d0-4844-89c6-0ba19afdd483 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:16.823993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a1222f8f-cb83-4976-9b9b-8cad3a813973 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:16.835992 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a1222f8f-cb83-4976-9b9b-8cad3a813973 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 0.774312 Oct 27 18:45:16.855531 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 61/155] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:16 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:16.870953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-02e02284-c103-46f8-b158-deaa1eaee7c3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:16.871661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-02e02284-c103-46f8-b158-deaa1eaee7c3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:16.886126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02e02284-c103-46f8-b158-deaa1eaee7c3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:16.887784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02e02284-c103-46f8-b158-deaa1eaee7c3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:16.890152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02e02284-c103-46f8-b158-deaa1eaee7c3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:16.891445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02e02284-c103-46f8-b158-deaa1eaee7c3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:16.894372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02e02284-c103-46f8-b158-deaa1eaee7c3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:16.895088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02e02284-c103-46f8-b158-deaa1eaee7c3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:16.937413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5176b44c-c3d0-4844-89c6-0ba19afdd483 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:16.950549 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5176b44c-c3d0-4844-89c6-0ba19afdd483 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.765982 Oct 27 18:45:16.955335 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 95/156] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:16 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:17.867753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e6015350-fc64-4b46-bf47-ad47a653a460 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:17.868373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e6015350-fc64-4b46-bf47-ad47a653a460 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:17.881253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6015350-fc64-4b46-bf47-ad47a653a460 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:17.888645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6015350-fc64-4b46-bf47-ad47a653a460 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:17.889196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6015350-fc64-4b46-bf47-ad47a653a460 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:17.889966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6015350-fc64-4b46-bf47-ad47a653a460 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:17.890479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6015350-fc64-4b46-bf47-ad47a653a460 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:17.894183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6015350-fc64-4b46-bf47-ad47a653a460 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:18.145848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-02e02284-c103-46f8-b158-deaa1eaee7c3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:18.158479 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-02e02284-c103-46f8-b158-deaa1eaee7c3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1337 microversion: 2.1 time: 1.301608 Oct 27 18:45:18.175011 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 62/157] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:16 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1337 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:18.201001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-997d1d49-f92e-47ea-82a1-125b23123da9 req-70a04a5d-a5e5-48dd-bad1-ff2c4f2e2aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e16b25-683e-43bf-b5f8-1781478bb25a", "tag": "5cfd40ff-4e39-4110-b64b-079f4abd01a6"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:18.255006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-997d1d49-f92e-47ea-82a1-125b23123da9 req-70a04a5d-a5e5-48dd-bad1-ff2c4f2e2aec service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:18.255499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-997d1d49-f92e-47ea-82a1-125b23123da9 req-70a04a5d-a5e5-48dd-bad1-ff2c4f2e2aec service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:18.266507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-997d1d49-f92e-47ea-82a1-125b23123da9 req-70a04a5d-a5e5-48dd-bad1-ff2c4f2e2aec service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:18.332803 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-997d1d49-f92e-47ea-82a1-125b23123da9 req-70a04a5d-a5e5-48dd-bad1-ff2c4f2e2aec service nova] Creating event network-changed:5cfd40ff-4e39-4110-b64b-079f4abd01a6 for instance 45e16b25-683e-43bf-b5f8-1781478bb25a on n-h2-860687-3 Oct 27 18:45:18.351230 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-997d1d49-f92e-47ea-82a1-125b23123da9 req-70a04a5d-a5e5-48dd-bad1-ff2c4f2e2aec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170979 Oct 27 18:45:18.358035 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 63/158] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:18.364355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b9fbf2ba-eb50-44d4-8c3e-7006b2c406ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:18.367923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b9fbf2ba-eb50-44d4-8c3e-7006b2c406ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:18.382918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9fbf2ba-eb50-44d4-8c3e-7006b2c406ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:18.384682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9fbf2ba-eb50-44d4-8c3e-7006b2c406ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:18.386022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9fbf2ba-eb50-44d4-8c3e-7006b2c406ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:18.390188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9fbf2ba-eb50-44d4-8c3e-7006b2c406ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:18.392930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9fbf2ba-eb50-44d4-8c3e-7006b2c406ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:18.393677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9fbf2ba-eb50-44d4-8c3e-7006b2c406ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:18.776425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=16 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:18.866373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e6015350-fc64-4b46-bf47-ad47a653a460 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:18.884951 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e6015350-fc64-4b46-bf47-ad47a653a460 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 1.018716 Oct 27 18:45:18.887721 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 96/159] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:17 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:19.196509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5871a5f7-b987-4ea4-8c38-fd3a9ac6a39e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:19.198052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5871a5f7-b987-4ea4-8c38-fd3a9ac6a39e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:19.216045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5871a5f7-b987-4ea4-8c38-fd3a9ac6a39e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:19.224117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5871a5f7-b987-4ea4-8c38-fd3a9ac6a39e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:19.225678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5871a5f7-b987-4ea4-8c38-fd3a9ac6a39e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:19.226803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5871a5f7-b987-4ea4-8c38-fd3a9ac6a39e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:19.228469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5871a5f7-b987-4ea4-8c38-fd3a9ac6a39e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:19.236267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5871a5f7-b987-4ea4-8c38-fd3a9ac6a39e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:19.300565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:19.742704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=14 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:19.965781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b9fbf2ba-eb50-44d4-8c3e-7006b2c406ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:19.969879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5871a5f7-b987-4ea4-8c38-fd3a9ac6a39e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:19.979502 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b9fbf2ba-eb50-44d4-8c3e-7006b2c406ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 1.617608 Oct 27 18:45:19.994757 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5871a5f7-b987-4ea4-8c38-fd3a9ac6a39e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1337 microversion: 2.1 time: 0.795438 Oct 27 18:45:19.994757 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 97/160] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:19 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1337 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:19.995453 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 64/161] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:18 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:20.015619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-629d8ade-e34b-455b-b7fd-c3bbe532999f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:20.016228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-629d8ade-e34b-455b-b7fd-c3bbe532999f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:20.049628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-629d8ade-e34b-455b-b7fd-c3bbe532999f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:20.050160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-629d8ade-e34b-455b-b7fd-c3bbe532999f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:20.056437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-629d8ade-e34b-455b-b7fd-c3bbe532999f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:20.058249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-629d8ade-e34b-455b-b7fd-c3bbe532999f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:20.060982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-629d8ade-e34b-455b-b7fd-c3bbe532999f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:20.066368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-629d8ade-e34b-455b-b7fd-c3bbe532999f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:20.442866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-316e711c-b2d5-4339-a606-b249e6758eb8 req-e2fe25b4-a6bd-4f44-a241-b35c4e3aaf59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a3f842-fb4c-4973-a787-b1e84ba6ae88", "tag": "11eb54ef-42aa-41b7-bece-cfe4088dc947"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:20.495652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-316e711c-b2d5-4339-a606-b249e6758eb8 req-e2fe25b4-a6bd-4f44-a241-b35c4e3aaf59 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:20.503048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-316e711c-b2d5-4339-a606-b249e6758eb8 req-e2fe25b4-a6bd-4f44-a241-b35c4e3aaf59 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:20.508540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-316e711c-b2d5-4339-a606-b249e6758eb8 req-e2fe25b4-a6bd-4f44-a241-b35c4e3aaf59 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:20.571836 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-316e711c-b2d5-4339-a606-b249e6758eb8 req-e2fe25b4-a6bd-4f44-a241-b35c4e3aaf59 service nova] Creating event network-changed:11eb54ef-42aa-41b7-bece-cfe4088dc947 for instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 on n-h1-860687-3 Oct 27 18:45:20.612733 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-316e711c-b2d5-4339-a606-b249e6758eb8 req-e2fe25b4-a6bd-4f44-a241-b35c4e3aaf59 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173224 Oct 27 18:45:20.618511 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 65/162] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:20.627769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-629d8ade-e34b-455b-b7fd-c3bbe532999f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:20.641922 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-629d8ade-e34b-455b-b7fd-c3bbe532999f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 0.647875 Oct 27 18:45:20.645938 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 98/163] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:19 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:21.011506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3cf4be91-31a7-44fa-a9f0-3c51d31ebb19 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:21.013499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3cf4be91-31a7-44fa-a9f0-3c51d31ebb19 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:21.021008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ca244512-3e7c-4fb5-b83d-bbe34b3d3345 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:21.022880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ca244512-3e7c-4fb5-b83d-bbe34b3d3345 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:21.036651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca244512-3e7c-4fb5-b83d-bbe34b3d3345 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:21.037450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca244512-3e7c-4fb5-b83d-bbe34b3d3345 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:21.039045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca244512-3e7c-4fb5-b83d-bbe34b3d3345 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:21.041204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca244512-3e7c-4fb5-b83d-bbe34b3d3345 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:21.043261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca244512-3e7c-4fb5-b83d-bbe34b3d3345 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:21.044724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca244512-3e7c-4fb5-b83d-bbe34b3d3345 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:21.045766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cf4be91-31a7-44fa-a9f0-3c51d31ebb19 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:21.046667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cf4be91-31a7-44fa-a9f0-3c51d31ebb19 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:21.051036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cf4be91-31a7-44fa-a9f0-3c51d31ebb19 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:21.052326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cf4be91-31a7-44fa-a9f0-3c51d31ebb19 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:21.053115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cf4be91-31a7-44fa-a9f0-3c51d31ebb19 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:21.053849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cf4be91-31a7-44fa-a9f0-3c51d31ebb19 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:21.465441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ca244512-3e7c-4fb5-b83d-bbe34b3d3345 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:21.479327 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ca244512-3e7c-4fb5-b83d-bbe34b3d3345 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1337 microversion: 2.1 time: 0.469132 Oct 27 18:45:21.491519 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 99/164] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:21 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1337 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:21.670860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e9e0adcd-3660-4157-86a4-f81f456b89ec tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:21.671791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e9e0adcd-3660-4157-86a4-f81f456b89ec tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:21.684715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9e0adcd-3660-4157-86a4-f81f456b89ec tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:21.700799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9e0adcd-3660-4157-86a4-f81f456b89ec tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:21.701688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9e0adcd-3660-4157-86a4-f81f456b89ec tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:21.702816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9e0adcd-3660-4157-86a4-f81f456b89ec tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:21.703480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9e0adcd-3660-4157-86a4-f81f456b89ec tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:21.704206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9e0adcd-3660-4157-86a4-f81f456b89ec tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:22.440896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3cf4be91-31a7-44fa-a9f0-3c51d31ebb19 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:22.460862 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3cf4be91-31a7-44fa-a9f0-3c51d31ebb19 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 1.452438 Oct 27 18:45:22.465185 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 66/165] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:21 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:22.505930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2451ba22-1cd5-4175-8639-0cf965d134be tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:22.507345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2451ba22-1cd5-4175-8639-0cf965d134be tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:22.529340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2451ba22-1cd5-4175-8639-0cf965d134be tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:22.530930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2451ba22-1cd5-4175-8639-0cf965d134be tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:22.533588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2451ba22-1cd5-4175-8639-0cf965d134be tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:22.572282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e9e0adcd-3660-4157-86a4-f81f456b89ec tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:22.582572 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e9e0adcd-3660-4157-86a4-f81f456b89ec tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 0.918152 Oct 27 18:45:22.589054 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 100/166] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:21 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:22.595742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2451ba22-1cd5-4175-8639-0cf965d134be tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:22.597129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2451ba22-1cd5-4175-8639-0cf965d134be tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.059s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:22.613732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2451ba22-1cd5-4175-8639-0cf965d134be tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:22.754285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:23.481618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2451ba22-1cd5-4175-8639-0cf965d134be tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:23.502969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a5e2d006-0096-4886-93bc-763a74f69faa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:23.503639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a5e2d006-0096-4886-93bc-763a74f69faa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:23.512477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=10 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:23.513639 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2451ba22-1cd5-4175-8639-0cf965d134be tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1337 microversion: 2.1 time: 1.012513 Oct 27 18:45:23.520698 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 67/167] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:22 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1337 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:23.524299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5e2d006-0096-4886-93bc-763a74f69faa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:23.533723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5e2d006-0096-4886-93bc-763a74f69faa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:23.534284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5e2d006-0096-4886-93bc-763a74f69faa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:23.535167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5e2d006-0096-4886-93bc-763a74f69faa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:23.535718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5e2d006-0096-4886-93bc-763a74f69faa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:23.536201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5e2d006-0096-4886-93bc-763a74f69faa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:23.614860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-871fce79-17e8-43be-85ba-2b8b2873820e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:23.615896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-871fce79-17e8-43be-85ba-2b8b2873820e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:23.636719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-871fce79-17e8-43be-85ba-2b8b2873820e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:23.637285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-871fce79-17e8-43be-85ba-2b8b2873820e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:23.637816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-871fce79-17e8-43be-85ba-2b8b2873820e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:23.642745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-871fce79-17e8-43be-85ba-2b8b2873820e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:23.644757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-871fce79-17e8-43be-85ba-2b8b2873820e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:23.645207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-871fce79-17e8-43be-85ba-2b8b2873820e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:24.087848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a5e2d006-0096-4886-93bc-763a74f69faa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:24.107253 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a5e2d006-0096-4886-93bc-763a74f69faa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.610345 Oct 27 18:45:24.122487 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 101/168] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:23 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:24.591800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-964061ea-ed16-4b90-a65d-bcbafa7eae38 tempest-FlavorMetadataValidation-254036633 tempest-FlavorMetadataValidation-254036633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1615825922", "id": 1661286184, "os-flavor-access:is_public": "True"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:24.636980 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-964061ea-ed16-4b90-a65d-bcbafa7eae38 tempest-FlavorMetadataValidation-254036633 tempest-FlavorMetadataValidation-254036633-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.511368 Oct 27 18:45:24.641138 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 102/169] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 18:45:24 2022] POST /compute/v2.1/flavors => generated 471 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:45:24.655314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a298bb0e-4e74-4688-8a79-030880c90e80 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:24.656157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a298bb0e-4e74-4688-8a79-030880c90e80 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:24.671650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a298bb0e-4e74-4688-8a79-030880c90e80 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:24.673834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a298bb0e-4e74-4688-8a79-030880c90e80 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:24.674874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a298bb0e-4e74-4688-8a79-030880c90e80 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:24.675625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a298bb0e-4e74-4688-8a79-030880c90e80 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:24.679085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a298bb0e-4e74-4688-8a79-030880c90e80 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:24.680056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a298bb0e-4e74-4688-8a79-030880c90e80 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:24.681495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-871fce79-17e8-43be-85ba-2b8b2873820e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:24.695560 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-871fce79-17e8-43be-85ba-2b8b2873820e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 1.085808 Oct 27 18:45:24.715878 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 68/170] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:23 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:24.721623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0b77d45a-a3ee-4d18-a8c7-c2336684e0c6 tempest-FlavorMetadataValidation-254036633 tempest-FlavorMetadataValidation-254036633-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:25.044080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a298bb0e-4e74-4688-8a79-030880c90e80 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:25.060440 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a298bb0e-4e74-4688-8a79-030880c90e80 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1337 microversion: 2.1 time: 0.415829 Oct 27 18:45:25.061160 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 103/171] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:24 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1337 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:25.138937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-62b4b3f2-5ada-4d56-a8ae-49c48aea2a42 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:25.141347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-62b4b3f2-5ada-4d56-a8ae-49c48aea2a42 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:25.157315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62b4b3f2-5ada-4d56-a8ae-49c48aea2a42 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:25.159024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62b4b3f2-5ada-4d56-a8ae-49c48aea2a42 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:25.161371 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0b77d45a-a3ee-4d18-a8c7-c2336684e0c6 tempest-FlavorMetadataValidation-254036633 tempest-FlavorMetadataValidation-254036633-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1661286184/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.443399 Oct 27 18:45:25.162779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62b4b3f2-5ada-4d56-a8ae-49c48aea2a42 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:25.168399 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 69/172] 10.222.0.42 () {62 vars in 1265 bytes} [Thu Oct 27 18:45:24 2022] POST /compute/v2.1/flavors/1661286184/os-extra_specs => generated 62 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:25.171116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62b4b3f2-5ada-4d56-a8ae-49c48aea2a42 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:25.172101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62b4b3f2-5ada-4d56-a8ae-49c48aea2a42 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:25.174576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62b4b3f2-5ada-4d56-a8ae-49c48aea2a42 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:25.191586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2ba10147-a163-4971-99bf-d0f1f48d1272 tempest-FlavorMetadataValidation-254036633 tempest-FlavorMetadataValidation-254036633-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:25.240459 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2ba10147-a163-4971-99bf-d0f1f48d1272 tempest-FlavorMetadataValidation-254036633 tempest-FlavorMetadataValidation-254036633-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1661286184" status: 202 len: 0 microversion: 2.86 time: 0.066953 Oct 27 18:45:25.247931 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 70/173] 10.222.0.42 () {60 vars in 1202 bytes} [Thu Oct 27 18:45:25 2022] DELETE /compute/v2.1/flavors/1661286184 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:45:25.262451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-95c901a2-ed38-4bfe-add3-cd072eb53160 tempest-FlavorMetadataValidation-254036633 tempest-FlavorMetadataValidation-254036633-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:25.356733 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-95c901a2-ed38-4bfe-add3-cd072eb53160 tempest-FlavorMetadataValidation-254036633 tempest-FlavorMetadataValidation-254036633-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.095641 Oct 27 18:45:25.359160 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 71/174] 10.222.0.42 () {60 vars in 1187 bytes} [Thu Oct 27 18:45:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:45:25.573092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-62b4b3f2-5ada-4d56-a8ae-49c48aea2a42 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:25.586641 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-62b4b3f2-5ada-4d56-a8ae-49c48aea2a42 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.455757 Oct 27 18:45:25.587629 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 104/175] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:25 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:25.723390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-56d8d40a-28e4-4d8f-b20d-9e63ea1998d5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:25.724827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-56d8d40a-28e4-4d8f-b20d-9e63ea1998d5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:25.737951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:25.750618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d8d40a-28e4-4d8f-b20d-9e63ea1998d5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:25.751788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d8d40a-28e4-4d8f-b20d-9e63ea1998d5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:25.753710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d8d40a-28e4-4d8f-b20d-9e63ea1998d5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:25.754874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d8d40a-28e4-4d8f-b20d-9e63ea1998d5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:25.758408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d8d40a-28e4-4d8f-b20d-9e63ea1998d5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:25.763972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d8d40a-28e4-4d8f-b20d-9e63ea1998d5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:26.045827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-56d8d40a-28e4-4d8f-b20d-9e63ea1998d5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:26.061425 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-56d8d40a-28e4-4d8f-b20d-9e63ea1998d5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 0.343394 Oct 27 18:45:26.083304 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 72/176] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:25 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:26.087760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cacfefcc-2add-4a3c-a0b6-08a4e509ac99 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:26.088406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cacfefcc-2add-4a3c-a0b6-08a4e509ac99 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:26.099131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cacfefcc-2add-4a3c-a0b6-08a4e509ac99 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:26.099664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cacfefcc-2add-4a3c-a0b6-08a4e509ac99 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:26.100114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cacfefcc-2add-4a3c-a0b6-08a4e509ac99 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:26.100832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cacfefcc-2add-4a3c-a0b6-08a4e509ac99 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:26.101299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cacfefcc-2add-4a3c-a0b6-08a4e509ac99 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:26.101729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cacfefcc-2add-4a3c-a0b6-08a4e509ac99 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:26.552521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cacfefcc-2add-4a3c-a0b6-08a4e509ac99 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:26.570634 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cacfefcc-2add-4a3c-a0b6-08a4e509ac99 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1337 microversion: 2.1 time: 0.486978 Oct 27 18:45:26.589564 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 105/177] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:26 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1337 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:26.604977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-31648d63-7001-4102-aa83-3894cba78440 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1608629872", "ram": 512, "vcpus": 1, "disk": 10, "id": 1285001446, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:26.628450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bb4f42da-b9f0-4b37-8ca3-3c832a771dcf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:26.632889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bb4f42da-b9f0-4b37-8ca3-3c832a771dcf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:26.646785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb4f42da-b9f0-4b37-8ca3-3c832a771dcf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:26.649473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb4f42da-b9f0-4b37-8ca3-3c832a771dcf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:26.650131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb4f42da-b9f0-4b37-8ca3-3c832a771dcf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:26.656704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb4f42da-b9f0-4b37-8ca3-3c832a771dcf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:26.657272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb4f42da-b9f0-4b37-8ca3-3c832a771dcf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:26.658500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb4f42da-b9f0-4b37-8ca3-3c832a771dcf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:26.667902 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-31648d63-7001-4102-aa83-3894cba78440 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.507043 Oct 27 18:45:26.668675 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 73/178] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:26 2022] POST /compute/v2.1/flavors => generated 416 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:26.692429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ce156c6-397a-4ef2-88a5-810944464a15 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:26.740710 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ce156c6-397a-4ef2-88a5-810944464a15 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1285001446/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.061054 Oct 27 18:45:26.742483 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 74/179] 10.222.0.42 () {60 vars in 1224 bytes} [Thu Oct 27 18:45:26 2022] POST /compute/v2.1/flavors/1285001446/os-extra_specs => generated 66 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:26.936185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bb4f42da-b9f0-4b37-8ca3-3c832a771dcf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:26.958497 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bb4f42da-b9f0-4b37-8ca3-3c832a771dcf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.344111 Oct 27 18:45:26.959572 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 106/180] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:26 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:27.091811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2540cc09-cb53-4297-977f-edd2bd4ef019 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:27.092535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2540cc09-cb53-4297-977f-edd2bd4ef019 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:27.101024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=10,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:27.102600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2540cc09-cb53-4297-977f-edd2bd4ef019 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:27.102954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2540cc09-cb53-4297-977f-edd2bd4ef019 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:27.103395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2540cc09-cb53-4297-977f-edd2bd4ef019 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:27.104180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2540cc09-cb53-4297-977f-edd2bd4ef019 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:27.104666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2540cc09-cb53-4297-977f-edd2bd4ef019 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:27.105094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2540cc09-cb53-4297-977f-edd2bd4ef019 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:27.111229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03c3eff3-e6d2-4d47-a445-463deeeaf837 tempest-FlavorsExtraSpecsTestJSON-1540592103 tempest-FlavorsExtraSpecsTestJSON-1540592103-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:27.131014 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-03c3eff3-e6d2-4d47-a445-463deeeaf837 tempest-FlavorsExtraSpecsTestJSON-1540592103 tempest-FlavorsExtraSpecsTestJSON-1540592103-project] 10.222.0.42 "GET /compute/v2.1/flavors/1285001446/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.378205 Oct 27 18:45:27.131642 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 75/181] 10.222.0.42 () {58 vars in 1203 bytes} [Thu Oct 27 18:45:26 2022] GET /compute/v2.1/flavors/1285001446/os-extra_specs => generated 66 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 18:45:27.142123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b11bf570-51ba-40eb-9434-b38d28ab68b9 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:27.181212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=10,nova_api:SAVEPOINT=4,nova_api:INSERT=5,nova_api:RELEASE=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:27.203432 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b11bf570-51ba-40eb-9434-b38d28ab68b9 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1285001446/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.064767 Oct 27 18:45:27.204643 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 76/182] 10.222.0.42 () {60 vars in 1224 bytes} [Thu Oct 27 18:45:27 2022] POST /compute/v2.1/flavors/1285001446/os-extra_specs => generated 66 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 18:45:27.217666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-710c5ae4-33b5-450d-a4d7-7497ce0999dd tempest-FlavorsExtraSpecsTestJSON-1540592103 tempest-FlavorsExtraSpecsTestJSON-1540592103-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:27.237801 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-710c5ae4-33b5-450d-a4d7-7497ce0999dd tempest-FlavorsExtraSpecsTestJSON-1540592103 tempest-FlavorsExtraSpecsTestJSON-1540592103-project] 10.222.0.42 "GET /compute/v2.1/flavors/1285001446/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.027496 Oct 27 18:45:27.244231 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 77/183] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 18:45:27 2022] GET /compute/v2.1/flavors/1285001446/os-extra_specs/hw:numa_nodes => generated 22 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:27.250023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f5eb4d8e-3cc5-40e1-b653-44539fdea429 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:27.277208 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f5eb4d8e-3cc5-40e1-b653-44539fdea429 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1285001446/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031826 Oct 27 18:45:27.280390 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 78/184] 10.222.0.42 () {60 vars in 1224 bytes} [Thu Oct 27 18:45:27 2022] POST /compute/v2.1/flavors/1285001446/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:27.288873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e09b62e9-dbed-4c7b-89a1-9f693732068f tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:27.300452 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e09b62e9-dbed-4c7b-89a1-9f693732068f tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1285001446/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015023 Oct 27 18:45:27.306410 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 79/185] 10.222.0.42 () {58 vars in 1203 bytes} [Thu Oct 27 18:45:27 2022] GET /compute/v2.1/flavors/1285001446/os-extra_specs => generated 66 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:27.312619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ec83ed24-34cc-4ab1-a95a-bcfa07e84b21 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:27.352099 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ec83ed24-34cc-4ab1-a95a-bcfa07e84b21 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/1285001446/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.044396 Oct 27 18:45:27.358925 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 80/186] 10.222.0.42 () {60 vars in 1265 bytes} [Thu Oct 27 18:45:27 2022] PUT /compute/v2.1/flavors/1285001446/os-extra_specs/hw:numa_nodes => generated 22 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:27.364634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-92f88bae-f44f-41b0-a93d-41492042b63b tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:27.375507 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-92f88bae-f44f-41b0-a93d-41492042b63b tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1285001446/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015301 Oct 27 18:45:27.376507 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 81/187] 10.222.0.42 () {58 vars in 1203 bytes} [Thu Oct 27 18:45:27 2022] GET /compute/v2.1/flavors/1285001446/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:27.385884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e7d7913b-cc39-463e-b633-49e2347e4d4c tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:27.427822 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e7d7913b-cc39-463e-b633-49e2347e4d4c tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1285001446/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.045372 Oct 27 18:45:27.433445 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 82/188] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 18:45:27 2022] DELETE /compute/v2.1/flavors/1285001446/os-extra_specs/hw:numa_nodes => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:27.439702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0fd5b972-6434-4319-ab48-c3e282aaeb5f tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:27.470483 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0fd5b972-6434-4319-ab48-c3e282aaeb5f tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1285001446/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.035446 Oct 27 18:45:27.474510 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 83/189] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 18:45:27 2022] DELETE /compute/v2.1/flavors/1285001446/os-extra_specs/hw:cpu_policy => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:27.489076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d55b96d-60e6-41ef-a878-9906b7333069 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:27.501582 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d55b96d-60e6-41ef-a878-9906b7333069 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1285001446/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021807 Oct 27 18:45:27.507609 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 84/190] 10.222.0.42 () {58 vars in 1203 bytes} [Thu Oct 27 18:45:27 2022] GET /compute/v2.1/flavors/1285001446/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:27.507609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d55b96d-60e6-41ef-a878-9906b7333069 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:27.507609 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d55b96d-60e6-41ef-a878-9906b7333069 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001501 Oct 27 18:45:27.511318 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 85/191] 10.222.0.42 () {56 vars in 886 bytes} [Thu Oct 27 18:45:27 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 18:45:27.524326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2540cc09-cb53-4297-977f-edd2bd4ef019 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:27.525577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c55c771d-2b46-4896-bf1d-fd8d8dc5ed75 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:27.539705 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2540cc09-cb53-4297-977f-edd2bd4ef019 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 0.452426 Oct 27 18:45:27.554822 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 107/192] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:27 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:27.555462 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c55c771d-2b46-4896-bf1d-fd8d8dc5ed75 tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1285001446" status: 202 len: 0 microversion: 2.1 time: 0.041374 Oct 27 18:45:27.557792 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 86/193] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:45:27 2022] DELETE /compute/v2.1/flavors/1285001446 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:45:27.566710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14fd707b-6784-4dd9-938a-a6197e27872a tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:27.598282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c0fad2d7-0461-493b-a52c-4a607ea2e158 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:27.600497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c0fad2d7-0461-493b-a52c-4a607ea2e158 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:27.621168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0fad2d7-0461-493b-a52c-4a607ea2e158 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:27.624521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0fad2d7-0461-493b-a52c-4a607ea2e158 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:27.626563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0fad2d7-0461-493b-a52c-4a607ea2e158 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:27.629437 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-14fd707b-6784-4dd9-938a-a6197e27872a tempest-FlavorsExtraSpecsTestJSON-166152481 tempest-FlavorsExtraSpecsTestJSON-166152481-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069512 Oct 27 18:45:27.631631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0fad2d7-0461-493b-a52c-4a607ea2e158 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:27.632257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0fad2d7-0461-493b-a52c-4a607ea2e158 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:27.632863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0fad2d7-0461-493b-a52c-4a607ea2e158 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:27.635688 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 108/194] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:27.983840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3c15aa5b-e6e1-4dbc-b6a3-4114cd6d6d5a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:27.984298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3c15aa5b-e6e1-4dbc-b6a3-4114cd6d6d5a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:27.993422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c15aa5b-e6e1-4dbc-b6a3-4114cd6d6d5a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:27.993915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c15aa5b-e6e1-4dbc-b6a3-4114cd6d6d5a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:27.994349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c15aa5b-e6e1-4dbc-b6a3-4114cd6d6d5a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:27.995071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c15aa5b-e6e1-4dbc-b6a3-4114cd6d6d5a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:27.995533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c15aa5b-e6e1-4dbc-b6a3-4114cd6d6d5a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:27.995948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c15aa5b-e6e1-4dbc-b6a3-4114cd6d6d5a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:28.181253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c0fad2d7-0461-493b-a52c-4a607ea2e158 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:28.193883 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c0fad2d7-0461-493b-a52c-4a607ea2e158 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1337 microversion: 2.1 time: 0.599911 Oct 27 18:45:28.194544 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 87/195] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:27 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1337 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:28.259862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3c15aa5b-e6e1-4dbc-b6a3-4114cd6d6d5a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:28.268825 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3c15aa5b-e6e1-4dbc-b6a3-4114cd6d6d5a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.289285 Oct 27 18:45:28.269921 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 109/196] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:27 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:28.571369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c8db03a5-69f7-467b-92e9-f780524dfe6d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:28.572208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c8db03a5-69f7-467b-92e9-f780524dfe6d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:28.588044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8db03a5-69f7-467b-92e9-f780524dfe6d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:28.589025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8db03a5-69f7-467b-92e9-f780524dfe6d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:28.592636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8db03a5-69f7-467b-92e9-f780524dfe6d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:28.593607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8db03a5-69f7-467b-92e9-f780524dfe6d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:28.594187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8db03a5-69f7-467b-92e9-f780524dfe6d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:28.595715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8db03a5-69f7-467b-92e9-f780524dfe6d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:29.033915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c8db03a5-69f7-467b-92e9-f780524dfe6d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:29.061002 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c8db03a5-69f7-467b-92e9-f780524dfe6d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 0.498637 Oct 27 18:45:29.063459 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 88/197] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:28 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:29.219854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b60c81f3-2201-4cb0-bcb1-d89294317812 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:29.220775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b60c81f3-2201-4cb0-bcb1-d89294317812 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:29.229175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b60c81f3-2201-4cb0-bcb1-d89294317812 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:29.229748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b60c81f3-2201-4cb0-bcb1-d89294317812 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:29.230249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b60c81f3-2201-4cb0-bcb1-d89294317812 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:29.232469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b60c81f3-2201-4cb0-bcb1-d89294317812 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:29.233873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b60c81f3-2201-4cb0-bcb1-d89294317812 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:29.236934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b60c81f3-2201-4cb0-bcb1-d89294317812 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:29.299060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8191daec-7fea-4c44-b166-478ac419c5b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:29.299832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8191daec-7fea-4c44-b166-478ac419c5b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:29.312504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8191daec-7fea-4c44-b166-478ac419c5b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:29.313008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8191daec-7fea-4c44-b166-478ac419c5b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:29.313576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8191daec-7fea-4c44-b166-478ac419c5b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:29.314294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8191daec-7fea-4c44-b166-478ac419c5b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:29.314798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8191daec-7fea-4c44-b166-478ac419c5b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:29.315481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8191daec-7fea-4c44-b166-478ac419c5b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:29.489670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b60c81f3-2201-4cb0-bcb1-d89294317812 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:29.499321 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b60c81f3-2201-4cb0-bcb1-d89294317812 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1337 microversion: 2.1 time: 0.285891 Oct 27 18:45:29.500620 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 110/198] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:29 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1337 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:29.604998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8191daec-7fea-4c44-b166-478ac419c5b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:29.615323 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8191daec-7fea-4c44-b166-478ac419c5b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.323391 Oct 27 18:45:29.616680 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 89/199] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:29 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:30.084746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e42548e6-80c5-4077-a24e-9577802bc33e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:30.087112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e42548e6-80c5-4077-a24e-9577802bc33e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:30.098200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e42548e6-80c5-4077-a24e-9577802bc33e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:30.098797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e42548e6-80c5-4077-a24e-9577802bc33e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:30.099814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e42548e6-80c5-4077-a24e-9577802bc33e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:30.100833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e42548e6-80c5-4077-a24e-9577802bc33e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:30.101753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e42548e6-80c5-4077-a24e-9577802bc33e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:30.102499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e42548e6-80c5-4077-a24e-9577802bc33e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:30.402105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e42548e6-80c5-4077-a24e-9577802bc33e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:30.413311 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e42548e6-80c5-4077-a24e-9577802bc33e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 0.332269 Oct 27 18:45:30.413899 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 111/200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:30 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:30.523345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71f90a6a-b657-4214-abc8-4a713bf8a6bc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:30.524010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-71f90a6a-b657-4214-abc8-4a713bf8a6bc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:30.530963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71f90a6a-b657-4214-abc8-4a713bf8a6bc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:30.531482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71f90a6a-b657-4214-abc8-4a713bf8a6bc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:30.537164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71f90a6a-b657-4214-abc8-4a713bf8a6bc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:30.537842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71f90a6a-b657-4214-abc8-4a713bf8a6bc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:30.538362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71f90a6a-b657-4214-abc8-4a713bf8a6bc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:30.538830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71f90a6a-b657-4214-abc8-4a713bf8a6bc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:30.642926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f35180b0-fb57-406f-bf40-3c5c5bb01df8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:30.643630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f35180b0-fb57-406f-bf40-3c5c5bb01df8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:30.657553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f35180b0-fb57-406f-bf40-3c5c5bb01df8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:30.658253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f35180b0-fb57-406f-bf40-3c5c5bb01df8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:30.659157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f35180b0-fb57-406f-bf40-3c5c5bb01df8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:30.663822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f35180b0-fb57-406f-bf40-3c5c5bb01df8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:30.666611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f35180b0-fb57-406f-bf40-3c5c5bb01df8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:30.668931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f35180b0-fb57-406f-bf40-3c5c5bb01df8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:30.864768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-71f90a6a-b657-4214-abc8-4a713bf8a6bc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:30.875760 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-71f90a6a-b657-4214-abc8-4a713bf8a6bc tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1337 microversion: 2.1 time: 0.353580 Oct 27 18:45:30.876642 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 90/201] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:30 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1337 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:31.113614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f35180b0-fb57-406f-bf40-3c5c5bb01df8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:31.123972 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f35180b0-fb57-406f-bf40-3c5c5bb01df8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.486881 Oct 27 18:45:31.128103 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 112/202] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:30 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:31.437671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-846f1392-992b-4cdd-8168-79bb65d64c13 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:31.438664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-846f1392-992b-4cdd-8168-79bb65d64c13 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:31.445436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-846f1392-992b-4cdd-8168-79bb65d64c13 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:31.445926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-846f1392-992b-4cdd-8168-79bb65d64c13 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:31.446363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-846f1392-992b-4cdd-8168-79bb65d64c13 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:31.447214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-846f1392-992b-4cdd-8168-79bb65d64c13 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:31.447529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-846f1392-992b-4cdd-8168-79bb65d64c13 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:31.459124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-846f1392-992b-4cdd-8168-79bb65d64c13 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:31.734516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-846f1392-992b-4cdd-8168-79bb65d64c13 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:31.743007 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-846f1392-992b-4cdd-8168-79bb65d64c13 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 0.309769 Oct 27 18:45:31.748585 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 91/203] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:31 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:31.901611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3e283cc3-56d9-4053-a2d1-2ed2de68c053 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:31.902330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3e283cc3-56d9-4053-a2d1-2ed2de68c053 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:31.912954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e283cc3-56d9-4053-a2d1-2ed2de68c053 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:31.914920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e283cc3-56d9-4053-a2d1-2ed2de68c053 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:31.916341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e283cc3-56d9-4053-a2d1-2ed2de68c053 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:31.917134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e283cc3-56d9-4053-a2d1-2ed2de68c053 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:31.920748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e283cc3-56d9-4053-a2d1-2ed2de68c053 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:31.921288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e283cc3-56d9-4053-a2d1-2ed2de68c053 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:32.155025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5147ab0f-1d26-4c72-aa25-ce7ae103628d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:32.155672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5147ab0f-1d26-4c72-aa25-ce7ae103628d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:32.170475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5147ab0f-1d26-4c72-aa25-ce7ae103628d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:32.170475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5147ab0f-1d26-4c72-aa25-ce7ae103628d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:32.170475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5147ab0f-1d26-4c72-aa25-ce7ae103628d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:32.170475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5147ab0f-1d26-4c72-aa25-ce7ae103628d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:32.171131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5147ab0f-1d26-4c72-aa25-ce7ae103628d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:32.175383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5147ab0f-1d26-4c72-aa25-ce7ae103628d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:32.268317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3e283cc3-56d9-4053-a2d1-2ed2de68c053 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:32.280394 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3e283cc3-56d9-4053-a2d1-2ed2de68c053 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1337 microversion: 2.1 time: 0.381990 Oct 27 18:45:32.283246 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 113/204] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:31 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1337 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:32.499952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5147ab0f-1d26-4c72-aa25-ce7ae103628d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:32.514872 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5147ab0f-1d26-4c72-aa25-ce7ae103628d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.364001 Oct 27 18:45:32.517181 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 92/205] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:32 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:32.656342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-005a5c96-a7e9-4ab0-9fab-e1b26244c332 req-cb23e1df-9322-4de9-b321-8b8a30712c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cdb9a88-0030-489e-ad1a-4a8e02b48412", "name": "network-vif-plugged", "status": "completed", "tag": "cd2c07f5-0093-4c0e-aaa2-fd60e1aa715e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:32.669256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-005a5c96-a7e9-4ab0-9fab-e1b26244c332 req-cb23e1df-9322-4de9-b321-8b8a30712c98 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:32.669898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-005a5c96-a7e9-4ab0-9fab-e1b26244c332 req-cb23e1df-9322-4de9-b321-8b8a30712c98 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:32.670587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-005a5c96-a7e9-4ab0-9fab-e1b26244c332 req-cb23e1df-9322-4de9-b321-8b8a30712c98 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:32.685157 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-005a5c96-a7e9-4ab0-9fab-e1b26244c332 req-cb23e1df-9322-4de9-b321-8b8a30712c98 service nova] Creating event network-vif-plugged:cd2c07f5-0093-4c0e-aaa2-fd60e1aa715e for instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 on n-h2-860687-3 Oct 27 18:45:32.692278 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-005a5c96-a7e9-4ab0-9fab-e1b26244c332 req-cb23e1df-9322-4de9-b321-8b8a30712c98 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.407108 Oct 27 18:45:32.693785 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 114/206] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:32.781782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a924d616-b8c0-4fe5-8a2a-ce992ef4f505 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:32.782585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a924d616-b8c0-4fe5-8a2a-ce992ef4f505 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:32.800049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a924d616-b8c0-4fe5-8a2a-ce992ef4f505 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:32.802160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a924d616-b8c0-4fe5-8a2a-ce992ef4f505 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:32.805658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a924d616-b8c0-4fe5-8a2a-ce992ef4f505 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:32.806845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a924d616-b8c0-4fe5-8a2a-ce992ef4f505 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:32.808904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a924d616-b8c0-4fe5-8a2a-ce992ef4f505 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:32.813474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a924d616-b8c0-4fe5-8a2a-ce992ef4f505 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:33.057934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a924d616-b8c0-4fe5-8a2a-ce992ef4f505 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:33.072895 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a924d616-b8c0-4fe5-8a2a-ce992ef4f505 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 0.300661 Oct 27 18:45:33.074252 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 93/207] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:32 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:33.305344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-819bd886-81ef-419e-8e96-d14ccb4b9ec1 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:33.305965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-819bd886-81ef-419e-8e96-d14ccb4b9ec1 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:33.314975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-819bd886-81ef-419e-8e96-d14ccb4b9ec1 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:33.316578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-819bd886-81ef-419e-8e96-d14ccb4b9ec1 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:33.317093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-819bd886-81ef-419e-8e96-d14ccb4b9ec1 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:33.324130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-819bd886-81ef-419e-8e96-d14ccb4b9ec1 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:33.324644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-819bd886-81ef-419e-8e96-d14ccb4b9ec1 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:33.325188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-819bd886-81ef-419e-8e96-d14ccb4b9ec1 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:33.351427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7d2c414f-2185-4c69-911d-9a78b19cd6d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Calling method '.version_select at 0x7fc86bb63280>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:33.361705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d2c414f-2185-4c69-911d-9a78b19cd6d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:33.365420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d2c414f-2185-4c69-911d-9a78b19cd6d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:33.368172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d2c414f-2185-4c69-911d-9a78b19cd6d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:33.370184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d2c414f-2185-4c69-911d-9a78b19cd6d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:33.373967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d2c414f-2185-4c69-911d-9a78b19cd6d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:33.376089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d2c414f-2185-4c69-911d-9a78b19cd6d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:33.497675 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7d2c414f-2185-4c69-911d-9a78b19cd6d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.591277 Oct 27 18:45:33.498720 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 115/208] 10.222.0.42 () {58 vars in 1128 bytes} [Thu Oct 27 18:45:32 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:45:33.520016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-263f6fdb-b022-4286-951a-736df4d1cf61 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Calling method '.version_select at 0x7fc870fd1dc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:33.527948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-263f6fdb-b022-4286-951a-736df4d1cf61 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:33.530252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-263f6fdb-b022-4286-951a-736df4d1cf61 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:33.532221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-263f6fdb-b022-4286-951a-736df4d1cf61 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:33.533349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-263f6fdb-b022-4286-951a-736df4d1cf61 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:33.534423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-263f6fdb-b022-4286-951a-736df4d1cf61 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:33.536473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-263f6fdb-b022-4286-951a-736df4d1cf61 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:33.614042 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-263f6fdb-b022-4286-951a-736df4d1cf61 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.102937 Oct 27 18:45:33.615910 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 116/209] 10.222.0.42 () {58 vars in 1139 bytes} [Thu Oct 27 18:45:33 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:33.629121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5921b72c-0b91-41ce-a7ce-47cfe1fa9a76 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:33.630030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5921b72c-0b91-41ce-a7ce-47cfe1fa9a76 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:33.642139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-819bd886-81ef-419e-8e96-d14ccb4b9ec1 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:33.646696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5921b72c-0b91-41ce-a7ce-47cfe1fa9a76 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:33.647210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5921b72c-0b91-41ce-a7ce-47cfe1fa9a76 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:33.649973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5921b72c-0b91-41ce-a7ce-47cfe1fa9a76 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:33.650948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5921b72c-0b91-41ce-a7ce-47cfe1fa9a76 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:33.653640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5921b72c-0b91-41ce-a7ce-47cfe1fa9a76 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:33.655411 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-819bd886-81ef-419e-8e96-d14ccb4b9ec1 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1337 microversion: 2.1 time: 0.350521 Oct 27 18:45:33.656048 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 94/210] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:33 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1337 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:33.656202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5921b72c-0b91-41ce-a7ce-47cfe1fa9a76 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:33.662957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0cce3615-3826-4f97-a504-95840524df0b tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Calling method '.version_select at 0x7fc86b9cdc10>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:33.687294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cce3615-3826-4f97-a504-95840524df0b tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:33.687787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cce3615-3826-4f97-a504-95840524df0b tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:33.691955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cce3615-3826-4f97-a504-95840524df0b tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:33.693500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cce3615-3826-4f97-a504-95840524df0b tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:33.695428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cce3615-3826-4f97-a504-95840524df0b tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:33.695872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cce3615-3826-4f97-a504-95840524df0b tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:33.755547 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0cce3615-3826-4f97-a504-95840524df0b tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.098352 Oct 27 18:45:33.762452 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 95/211] 10.222.0.42 () {58 vars in 1145 bytes} [Thu Oct 27 18:45:33 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:34.100430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c870f6a8-5ef9-4298-a18b-1f5c2f7761dd tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:34.101983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c870f6a8-5ef9-4298-a18b-1f5c2f7761dd tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:34.108738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c870f6a8-5ef9-4298-a18b-1f5c2f7761dd tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:34.109224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c870f6a8-5ef9-4298-a18b-1f5c2f7761dd tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:34.109930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c870f6a8-5ef9-4298-a18b-1f5c2f7761dd tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:34.111314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c870f6a8-5ef9-4298-a18b-1f5c2f7761dd tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:34.112010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c870f6a8-5ef9-4298-a18b-1f5c2f7761dd tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:34.112765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c870f6a8-5ef9-4298-a18b-1f5c2f7761dd tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:34.201077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5921b72c-0b91-41ce-a7ce-47cfe1fa9a76 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:34.212439 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5921b72c-0b91-41ce-a7ce-47cfe1fa9a76 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.593884 Oct 27 18:45:34.213672 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 117/212] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:33 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:34.336720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c870f6a8-5ef9-4298-a18b-1f5c2f7761dd tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:34.362514 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c870f6a8-5ef9-4298-a18b-1f5c2f7761dd tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1319 microversion: 2.1 time: 0.267642 Oct 27 18:45:34.364095 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 96/213] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:34 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:34.626075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9a936bf3-580c-4b90-8494-928ff471353b tempest-FlavorsV261TestJSON-124593649 tempest-FlavorsV261TestJSON-124593649-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1596548659", "id": 858306434, "os-flavor-access:is_public": "True"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:34.664992 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9a936bf3-580c-4b90-8494-928ff471353b tempest-FlavorsV261TestJSON-124593649 tempest-FlavorsV261TestJSON-124593649-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.449870 Oct 27 18:45:34.671266 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 118/214] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 18:45:34 2022] POST /compute/v2.1/flavors => generated 465 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:45:34.687529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c3bccad3-3642-489c-acd3-1319cd729a68 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:34.697211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c3bccad3-3642-489c-acd3-1319cd729a68 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:34.726070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3bccad3-3642-489c-acd3-1319cd729a68 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:34.728661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3bccad3-3642-489c-acd3-1319cd729a68 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:34.731431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3bccad3-3642-489c-acd3-1319cd729a68 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:34.732740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3bccad3-3642-489c-acd3-1319cd729a68 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:34.737528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3bccad3-3642-489c-acd3-1319cd729a68 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:34.741590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3bccad3-3642-489c-acd3-1319cd729a68 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:34.765220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:34.885929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-231ef4a7-e4e7-4a56-99af-fab4608ad55d tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Calling method '.version_select at 0x7fc86ba94dc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:34.888714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231ef4a7-e4e7-4a56-99af-fab4608ad55d tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:34.889620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231ef4a7-e4e7-4a56-99af-fab4608ad55d tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:34.890539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231ef4a7-e4e7-4a56-99af-fab4608ad55d tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:34.921786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231ef4a7-e4e7-4a56-99af-fab4608ad55d tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:34.925109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231ef4a7-e4e7-4a56-99af-fab4608ad55d tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:34.925906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231ef4a7-e4e7-4a56-99af-fab4608ad55d tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:34.950541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231ef4a7-e4e7-4a56-99af-fab4608ad55d tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:34.951422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231ef4a7-e4e7-4a56-99af-fab4608ad55d tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:34.953869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231ef4a7-e4e7-4a56-99af-fab4608ad55d tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:34.970722 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-231ef4a7-e4e7-4a56-99af-fab4608ad55d tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.382253 Oct 27 18:45:34.971985 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 97/215] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:45:35.159400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-df4f56c1-bc9f-4e24-b2b1-4648f0f966dd tempest-FlavorsV261TestJSON-291412700 tempest-FlavorsV261TestJSON-291412700-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:35.181813 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-df4f56c1-bc9f-4e24-b2b1-4648f0f966dd tempest-FlavorsV261TestJSON-291412700 tempest-FlavorsV261TestJSON-291412700-project] 10.222.0.42 "GET /compute/v2.1/flavors/858306434" status: 200 len: 465 microversion: 2.61 time: 0.208180 Oct 27 18:45:35.182312 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 98/216] 10.222.0.42 () {60 vars in 1196 bytes} [Thu Oct 27 18:45:34 2022] GET /compute/v2.1/flavors/858306434 => generated 465 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:45:35.187107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-89a7424f-f2e9-4a5b-a5e1-eab512fe8911 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Calling method '.version_select at 0x7fc86b9cdd30>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:35.188925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a7424f-f2e9-4a5b-a5e1-eab512fe8911 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:35.189495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a7424f-f2e9-4a5b-a5e1-eab512fe8911 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:35.189939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a7424f-f2e9-4a5b-a5e1-eab512fe8911 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:35.219004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a7424f-f2e9-4a5b-a5e1-eab512fe8911 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:35.219505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a7424f-f2e9-4a5b-a5e1-eab512fe8911 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:35.220072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a7424f-f2e9-4a5b-a5e1-eab512fe8911 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:35.222025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c3bccad3-3642-489c-acd3-1319cd729a68 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:35.232221 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c3bccad3-3642-489c-acd3-1319cd729a68 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1337 microversion: 2.1 time: 0.551043 Oct 27 18:45:35.232849 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 119/217] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:34 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1337 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:35.241338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-19bb31c3-890f-49b1-87a7-9490ccb7fc7d req-25441fdd-8ba0-4f58-a52e-da5878188c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a3f842-fb4c-4973-a787-b1e84ba6ae88", "name": "network-vif-plugged", "status": "completed", "tag": "11eb54ef-42aa-41b7-bece-cfe4088dc947"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:35.256196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a7424f-f2e9-4a5b-a5e1-eab512fe8911 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:35.256688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a7424f-f2e9-4a5b-a5e1-eab512fe8911 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:35.257131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a7424f-f2e9-4a5b-a5e1-eab512fe8911 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:35.266081 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-89a7424f-f2e9-4a5b-a5e1-eab512fe8911 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.082661 Oct 27 18:45:35.272428 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 99/218] 10.222.0.42 () {58 vars in 1167 bytes} [Thu Oct 27 18:45:35 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:35.282205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-479989f3-442d-4339-a181-4e9342ab2c86 tempest-FlavorsV261TestJSON-124593649 tempest-FlavorsV261TestJSON-124593649-project-admin] Action: 'update', calling method: .version_select at 0x7fc870ec4b80>, body: {"flavor": {"description": "new"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:35.283493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-19bb31c3-890f-49b1-87a7-9490ccb7fc7d req-25441fdd-8ba0-4f58-a52e-da5878188c31 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:35.283986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-19bb31c3-890f-49b1-87a7-9490ccb7fc7d req-25441fdd-8ba0-4f58-a52e-da5878188c31 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:35.284612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-19bb31c3-890f-49b1-87a7-9490ccb7fc7d req-25441fdd-8ba0-4f58-a52e-da5878188c31 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:35.306779 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-19bb31c3-890f-49b1-87a7-9490ccb7fc7d req-25441fdd-8ba0-4f58-a52e-da5878188c31 service nova] Creating event network-vif-plugged:11eb54ef-42aa-41b7-bece-cfe4088dc947 for instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 on n-h1-860687-3 Oct 27 18:45:35.316505 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-19bb31c3-890f-49b1-87a7-9490ccb7fc7d req-25441fdd-8ba0-4f58-a52e-da5878188c31 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078357 Oct 27 18:45:35.320094 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 120/219] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:35.337618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7930cda2-c057-4f3a-a081-921c292d25d8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:35.339097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7930cda2-c057-4f3a-a081-921c292d25d8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:35.352686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7930cda2-c057-4f3a-a081-921c292d25d8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:35.361836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7930cda2-c057-4f3a-a081-921c292d25d8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:35.362687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7930cda2-c057-4f3a-a081-921c292d25d8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:35.363860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7930cda2-c057-4f3a-a081-921c292d25d8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:35.364563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7930cda2-c057-4f3a-a081-921c292d25d8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:35.374028 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-479989f3-442d-4339-a181-4e9342ab2c86 tempest-FlavorsV261TestJSON-124593649 tempest-FlavorsV261TestJSON-124593649-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/858306434" status: 200 len: 466 microversion: 2.61 time: 0.099797 Oct 27 18:45:35.374687 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 100/220] 10.222.0.42 () {62 vars in 1216 bytes} [Thu Oct 27 18:45:35 2022] PUT /compute/v2.1/flavors/858306434 => generated 466 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:45:35.384513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7930cda2-c057-4f3a-a081-921c292d25d8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:35.387432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-61cc4f7b-7444-4a9d-8124-a0e82ec7f543 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Calling method '.version_select at 0x7fc86ba948b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:35.389917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61cc4f7b-7444-4a9d-8124-a0e82ec7f543 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:35.390419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61cc4f7b-7444-4a9d-8124-a0e82ec7f543 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:35.396696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61cc4f7b-7444-4a9d-8124-a0e82ec7f543 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:35.445576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61cc4f7b-7444-4a9d-8124-a0e82ec7f543 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:35.457898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61cc4f7b-7444-4a9d-8124-a0e82ec7f543 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:35.458558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61cc4f7b-7444-4a9d-8124-a0e82ec7f543 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:35.488758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=5 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:35.496642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61cc4f7b-7444-4a9d-8124-a0e82ec7f543 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:35.498133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61cc4f7b-7444-4a9d-8124-a0e82ec7f543 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:35.499676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61cc4f7b-7444-4a9d-8124-a0e82ec7f543 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:35.515870 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-61cc4f7b-7444-4a9d-8124-a0e82ec7f543 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.140104 Oct 27 18:45:35.517514 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 101/221] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:35.527424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1d8c9e87-9451-4d28-b9a0-f65e018accd7 tempest-FlavorsV261TestJSON-291412700 tempest-FlavorsV261TestJSON-291412700-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:35.643649 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1d8c9e87-9451-4d28-b9a0-f65e018accd7 tempest-FlavorsV261TestJSON-291412700 tempest-FlavorsV261TestJSON-291412700-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.120487 Oct 27 18:45:35.654739 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 102/222] 10.222.0.42 () {60 vars in 1187 bytes} [Thu Oct 27 18:45:35 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:45:35.661158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b3c89bb2-66b5-4a8f-bf24-d80a9e38ede3 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:35.662040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b3c89bb2-66b5-4a8f-bf24-d80a9e38ede3 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:35.680615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3c89bb2-66b5-4a8f-bf24-d80a9e38ede3 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:35.681871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3c89bb2-66b5-4a8f-bf24-d80a9e38ede3 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:35.687085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3c89bb2-66b5-4a8f-bf24-d80a9e38ede3 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:35.688329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3c89bb2-66b5-4a8f-bf24-d80a9e38ede3 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:35.689017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3c89bb2-66b5-4a8f-bf24-d80a9e38ede3 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:35.689919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3c89bb2-66b5-4a8f-bf24-d80a9e38ede3 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:35.955490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b3c89bb2-66b5-4a8f-bf24-d80a9e38ede3 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:35.969061 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b3c89bb2-66b5-4a8f-bf24-d80a9e38ede3 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1468 microversion: 2.1 time: 0.312874 Oct 27 18:45:35.969959 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 103/223] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:35 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1468 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:35.985714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fbf81bb0-5dac-4c80-a0dc-7ac7e25ff21f tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Calling method '.version_select at 0x7fc86bca2550>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:35.987967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf81bb0-5dac-4c80-a0dc-7ac7e25ff21f tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:35.991999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf81bb0-5dac-4c80-a0dc-7ac7e25ff21f tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:35.992526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf81bb0-5dac-4c80-a0dc-7ac7e25ff21f tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:36.033770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf81bb0-5dac-4c80-a0dc-7ac7e25ff21f tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:36.034272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf81bb0-5dac-4c80-a0dc-7ac7e25ff21f tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:36.034751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf81bb0-5dac-4c80-a0dc-7ac7e25ff21f tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:36.052903 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fbf81bb0-5dac-4c80-a0dc-7ac7e25ff21f tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.081816 Oct 27 18:45:36.053858 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 104/224] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:36.063953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-92550619-f3e8-44d4-a229-3b23ea6323dc tempest-FlavorsV261TestJSON-291412700 tempest-FlavorsV261TestJSON-291412700-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:36.101115 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-92550619-f3e8-44d4-a229-3b23ea6323dc tempest-FlavorsV261TestJSON-291412700 tempest-FlavorsV261TestJSON-291412700-project] 10.222.0.42 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.045891 Oct 27 18:45:36.111868 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 105/225] 10.222.0.42 () {60 vars in 1166 bytes} [Thu Oct 27 18:45:36 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:45:36.280283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7930cda2-c057-4f3a-a081-921c292d25d8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:36.295099 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7930cda2-c057-4f3a-a081-921c292d25d8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.972701 Oct 27 18:45:36.297419 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 121/226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:35 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:36.302770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9245b8da-3525-475c-87fd-649ae06fc639 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Calling method '.version_select at 0x7fc86ba765e0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:36.304763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9245b8da-3525-475c-87fd-649ae06fc639 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:36.305425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9245b8da-3525-475c-87fd-649ae06fc639 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:36.306064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9245b8da-3525-475c-87fd-649ae06fc639 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:36.322985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55dcf436-de9f-4309-aa1d-36e2a6f77c1f tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:36.323511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-55dcf436-de9f-4309-aa1d-36e2a6f77c1f tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:36.334632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55dcf436-de9f-4309-aa1d-36e2a6f77c1f tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:36.335127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55dcf436-de9f-4309-aa1d-36e2a6f77c1f tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:36.335576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55dcf436-de9f-4309-aa1d-36e2a6f77c1f tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:36.336281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55dcf436-de9f-4309-aa1d-36e2a6f77c1f tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:36.336650 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9245b8da-3525-475c-87fd-649ae06fc639 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.037461 Oct 27 18:45:36.343364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55dcf436-de9f-4309-aa1d-36e2a6f77c1f tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:36.346303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55dcf436-de9f-4309-aa1d-36e2a6f77c1f tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:36.347595 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 122/227] 10.222.0.42 () {58 vars in 1179 bytes} [Thu Oct 27 18:45:36 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:36.353965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5670ddce-7b32-4f4d-87ac-e9a7f6f11d56 tempest-FlavorsV261TestJSON-124593649 tempest-FlavorsV261TestJSON-124593649-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:36.380918 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5670ddce-7b32-4f4d-87ac-e9a7f6f11d56 tempest-FlavorsV261TestJSON-124593649 tempest-FlavorsV261TestJSON-124593649-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/858306434" status: 202 len: 0 microversion: 2.61 time: 0.031876 Oct 27 18:45:36.386188 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 123/228] 10.222.0.42 () {60 vars in 1199 bytes} [Thu Oct 27 18:45:36 2022] DELETE /compute/v2.1/flavors/858306434 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:45:36.400214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-36e27032-46a4-40f3-95ad-be5d70c7021b tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:36.400836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-36e27032-46a4-40f3-95ad-be5d70c7021b tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:36.408707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-36e27032-46a4-40f3-95ad-be5d70c7021b tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:36.409435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-36e27032-46a4-40f3-95ad-be5d70c7021b tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:36.410960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-36e27032-46a4-40f3-95ad-be5d70c7021b tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:36.411868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-36e27032-46a4-40f3-95ad-be5d70c7021b tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:36.412472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-36e27032-46a4-40f3-95ad-be5d70c7021b tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:36.413779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-36e27032-46a4-40f3-95ad-be5d70c7021b tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:36.422855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:36.529040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-55dcf436-de9f-4309-aa1d-36e2a6f77c1f tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:45:36.908454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-36e27032-46a4-40f3-95ad-be5d70c7021b tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:36.926760 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-55dcf436-de9f-4309-aa1d-36e2a6f77c1f tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] 10.222.0.42 "DELETE /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 204 len: 0 microversion: 2.1 time: 0.817260 Oct 27 18:45:36.930662 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 106/229] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:45:36 2022] DELETE /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:45:36.940293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fbf698bf-ac3e-4d65-bf3f-3c0a12542be7 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Calling method '.version_select at 0x7fc86bc014c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:36.942208 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-36e27032-46a4-40f3-95ad-be5d70c7021b tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1337 microversion: 2.1 time: 0.551544 Oct 27 18:45:36.943553 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 124/230] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:36 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1337 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:36.956196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf698bf-ac3e-4d65-bf3f-3c0a12542be7 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:36.959391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b4d1dab8-e113-4dd5-9ffc-c1da59126c30 tempest-FlavorsV261TestJSON-124593649 tempest-FlavorsV261TestJSON-124593649-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:36.960165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf698bf-ac3e-4d65-bf3f-3c0a12542be7 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:36.962763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf698bf-ac3e-4d65-bf3f-3c0a12542be7 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:36.999949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf698bf-ac3e-4d65-bf3f-3c0a12542be7 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.000445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf698bf-ac3e-4d65-bf3f-3c0a12542be7 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.007589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf698bf-ac3e-4d65-bf3f-3c0a12542be7 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.039752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf698bf-ac3e-4d65-bf3f-3c0a12542be7 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.040734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf698bf-ac3e-4d65-bf3f-3c0a12542be7 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.041328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbf698bf-ac3e-4d65-bf3f-3c0a12542be7 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.042426 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b4d1dab8-e113-4dd5-9ffc-c1da59126c30 tempest-FlavorsV261TestJSON-124593649 tempest-FlavorsV261TestJSON-124593649-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.097547 Oct 27 18:45:37.043116 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 125/231] 10.222.0.42 () {60 vars in 1187 bytes} [Thu Oct 27 18:45:36 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:45:37.049118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-692795b6-4201-4f95-bc8d-cd22b6fca03d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:37.053563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-692795b6-4201-4f95-bc8d-cd22b6fca03d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:37.070420 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fbf698bf-ac3e-4d65-bf3f-3c0a12542be7 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.141016 Oct 27 18:45:37.076151 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 107/232] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:37.088129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-692795b6-4201-4f95-bc8d-cd22b6fca03d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.088854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-692795b6-4201-4f95-bc8d-cd22b6fca03d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.092978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-692795b6-4201-4f95-bc8d-cd22b6fca03d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.093919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-692795b6-4201-4f95-bc8d-cd22b6fca03d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.094568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-692795b6-4201-4f95-bc8d-cd22b6fca03d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.100607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4e947979-242f-4164-b6af-6389278579c8 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Calling method '.version_select at 0x7fc86bcb5160>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:37.102090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-692795b6-4201-4f95-bc8d-cd22b6fca03d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.106313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e947979-242f-4164-b6af-6389278579c8 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.107012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e947979-242f-4164-b6af-6389278579c8 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.107477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e947979-242f-4164-b6af-6389278579c8 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.141534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e947979-242f-4164-b6af-6389278579c8 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.142045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e947979-242f-4164-b6af-6389278579c8 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.145592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e947979-242f-4164-b6af-6389278579c8 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.158551 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4e947979-242f-4164-b6af-6389278579c8 tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.075106 Oct 27 18:45:37.173921 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 108/233] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:37 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:37.183384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a2a73308-8948-4444-b058-d9a1a7b422ff tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Calling method '.version_select at 0x7fc870fd0dc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:37.186804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2a73308-8948-4444-b058-d9a1a7b422ff tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.187206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2a73308-8948-4444-b058-d9a1a7b422ff tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.187795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2a73308-8948-4444-b058-d9a1a7b422ff tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.213692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2a73308-8948-4444-b058-d9a1a7b422ff tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.214190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2a73308-8948-4444-b058-d9a1a7b422ff tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.214707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2a73308-8948-4444-b058-d9a1a7b422ff tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.222970 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a2a73308-8948-4444-b058-d9a1a7b422ff tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.043194 Oct 27 18:45:37.224451 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 109/234] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:37 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:37.253442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b05d6023-9fb3-4d4b-a169-de9d9255822a tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Calling method '.version_select at 0x7fc86baebe50>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:37.258101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05d6023-9fb3-4d4b-a169-de9d9255822a tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.258719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05d6023-9fb3-4d4b-a169-de9d9255822a tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.259176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05d6023-9fb3-4d4b-a169-de9d9255822a tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.277571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05d6023-9fb3-4d4b-a169-de9d9255822a tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.278086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05d6023-9fb3-4d4b-a169-de9d9255822a tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.279157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05d6023-9fb3-4d4b-a169-de9d9255822a tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.295232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05d6023-9fb3-4d4b-a169-de9d9255822a tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.296109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05d6023-9fb3-4d4b-a169-de9d9255822a tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.296645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05d6023-9fb3-4d4b-a169-de9d9255822a tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.343605 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b05d6023-9fb3-4d4b-a169-de9d9255822a tempest-HypervisorAdminTestJSON-1845692243 tempest-HypervisorAdminTestJSON-1845692243-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.107808 Oct 27 18:45:37.364607 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 110/235] 10.222.0.42 () {58 vars in 1173 bytes} [Thu Oct 27 18:45:37 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:45:37.376589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7bdfbf4b-1e04-4dab-9a95-148b019049b7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:37.377677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7bdfbf4b-1e04-4dab-9a95-148b019049b7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:37.408999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bdfbf4b-1e04-4dab-9a95-148b019049b7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.409735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bdfbf4b-1e04-4dab-9a95-148b019049b7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.417785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bdfbf4b-1e04-4dab-9a95-148b019049b7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.419856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bdfbf4b-1e04-4dab-9a95-148b019049b7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.423275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bdfbf4b-1e04-4dab-9a95-148b019049b7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.425527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bdfbf4b-1e04-4dab-9a95-148b019049b7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.658718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-692795b6-4201-4f95-bc8d-cd22b6fca03d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:37.690820 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-692795b6-4201-4f95-bc8d-cd22b6fca03d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1474 microversion: 2.1 time: 0.645250 Oct 27 18:45:37.691968 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 126/236] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:37 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1474 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:37.697785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-4d236665-5088-4e08-b735-fff3734173cd req-20ae5e9f-a6b9-4b44-876e-4174bdfca494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43e1759-0ffb-423c-8d31-569d5ce79268", "name": "network-vif-plugged", "status": "completed", "tag": "a4a765b2-af26-4b76-a70c-74d7dc9d17af"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:37.708358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4d236665-5088-4e08-b735-fff3734173cd req-20ae5e9f-a6b9-4b44-876e-4174bdfca494 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.709413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4d236665-5088-4e08-b735-fff3734173cd req-20ae5e9f-a6b9-4b44-876e-4174bdfca494 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.710017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4d236665-5088-4e08-b735-fff3734173cd req-20ae5e9f-a6b9-4b44-876e-4174bdfca494 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.731908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7bdfbf4b-1e04-4dab-9a95-148b019049b7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:37.740708 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7bdfbf4b-1e04-4dab-9a95-148b019049b7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.372930 Oct 27 18:45:37.741295 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 111/237] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:37 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:37.743207 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-4d236665-5088-4e08-b735-fff3734173cd req-20ae5e9f-a6b9-4b44-876e-4174bdfca494 service nova] Creating event network-vif-plugged:a4a765b2-af26-4b76-a70c-74d7dc9d17af for instance a43e1759-0ffb-423c-8d31-569d5ce79268 on n-h2-860687-3 Oct 27 18:45:37.765145 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-4d236665-5088-4e08-b735-fff3734173cd req-20ae5e9f-a6b9-4b44-876e-4174bdfca494 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070597 Oct 27 18:45:37.766304 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 127/238] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:37.975232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c47f47d7-3cd9-455b-8444-691726ad1817 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:37.975927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c47f47d7-3cd9-455b-8444-691726ad1817 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:37.991196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c47f47d7-3cd9-455b-8444-691726ad1817 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.992158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c47f47d7-3cd9-455b-8444-691726ad1817 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.993370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c47f47d7-3cd9-455b-8444-691726ad1817 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:37.995593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c47f47d7-3cd9-455b-8444-691726ad1817 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:37.996807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c47f47d7-3cd9-455b-8444-691726ad1817 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:37.998122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c47f47d7-3cd9-455b-8444-691726ad1817 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:38.780018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b0c76a73-bd0d-4c6b-acd7-4ac3bdb1d20f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:38.787814 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b0c76a73-bd0d-4c6b-acd7-4ac3bdb1d20f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.194788 Oct 27 18:45:38.788384 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 128/239] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:45:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:38.793297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2685111f-89f3-43b5-bd7f-dcda68d709fe tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:38.795093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2685111f-89f3-43b5-bd7f-dcda68d709fe tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:38.801895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2685111f-89f3-43b5-bd7f-dcda68d709fe tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:38.802407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2685111f-89f3-43b5-bd7f-dcda68d709fe tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:38.803007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2685111f-89f3-43b5-bd7f-dcda68d709fe tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:38.803704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2685111f-89f3-43b5-bd7f-dcda68d709fe tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:38.804333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2685111f-89f3-43b5-bd7f-dcda68d709fe tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:38.804919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2685111f-89f3-43b5-bd7f-dcda68d709fe tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:38.842069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c47f47d7-3cd9-455b-8444-691726ad1817 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:38.851004 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c47f47d7-3cd9-455b-8444-691726ad1817 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1337 microversion: 2.1 time: 0.883132 Oct 27 18:45:38.867451 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 112/240] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:37 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1337 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:38.872693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-68c4d543-14cd-4d39-a84d-af56d673b138 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:38.873324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-68c4d543-14cd-4d39-a84d-af56d673b138 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:38.884641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68c4d543-14cd-4d39-a84d-af56d673b138 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:38.885421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68c4d543-14cd-4d39-a84d-af56d673b138 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:38.886018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68c4d543-14cd-4d39-a84d-af56d673b138 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:38.888179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68c4d543-14cd-4d39-a84d-af56d673b138 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:38.888508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68c4d543-14cd-4d39-a84d-af56d673b138 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:38.889124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68c4d543-14cd-4d39-a84d-af56d673b138 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:38.987453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2685111f-89f3-43b5-bd7f-dcda68d709fe tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:38.997991 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2685111f-89f3-43b5-bd7f-dcda68d709fe tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1474 microversion: 2.1 time: 0.208338 Oct 27 18:45:38.998959 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 129/241] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:38 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1474 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:39.085096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9fd3ae7d-8d4e-4081-8d3a-20b6afb2e4e3 tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1158960037", "id": 547218031, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:39.116473 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9fd3ae7d-8d4e-4081-8d3a-20b6afb2e4e3 tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.116123 Oct 27 18:45:39.117762 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 130/242] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:38 2022] POST /compute/v2.1/flavors => generated 422 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:39.134342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-55e9d8b7-6195-463f-8c7a-e69f39bc5cdd tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:39.147435 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-55e9d8b7-6195-463f-8c7a-e69f39bc5cdd tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018839 Oct 27 18:45:39.148062 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 131/243] 10.222.0.42 () {58 vars in 1182 bytes} [Thu Oct 27 18:45:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:45:39.158736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-12653320-67d9-478e-908a-dd077e5d7e07 tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1512463003", "id": 619435472, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:39.208868 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-12653320-67d9-478e-908a-dd077e5d7e07 tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.052828 Oct 27 18:45:39.212857 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 132/244] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:39 2022] POST /compute/v2.1/flavors => generated 422 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:39.214684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-68c4d543-14cd-4d39-a84d-af56d673b138 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:39.225824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-40d4912c-e917-47f3-8b00-a50e5ecb162c tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:39.231161 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-68c4d543-14cd-4d39-a84d-af56d673b138 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.363111 Oct 27 18:45:39.241155 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 113/245] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:38 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:39.254198 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-40d4912c-e917-47f3-8b00-a50e5ecb162c tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034833 Oct 27 18:45:39.255247 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 133/246] 10.222.0.42 () {58 vars in 1182 bytes} [Thu Oct 27 18:45:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 18:45:39.268247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28301711-ea7e-4185-a96d-46696778e6ed tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Action: 'create', calling method: .version_select at 0x7fc86b931af0>, body: {"keypair": {"name": "tempest-keypair-1180244837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDNA1Cat+3H2D2Lmuk2CUloVBWXzA9TadFLvYIA3SZ17aWX9qNuW/z6ZWtzYJoD+PzKvtRosIe7fAg1Wfb7Q4xXuKVzJBK9titm4fF/F2zKQrxi3cK8+G9WDdYUZnpEew=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:39.305853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-28301711-ea7e-4185-a96d-46696778e6ed tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Getting quotas for project f976057610c846c3b9caaf190a4abc89. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:45:39.310596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-28301711-ea7e-4185-a96d-46696778e6ed tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Getting quotas for user 97a85e281f544f4aa49b27cd776c849a and project f976057610c846c3b9caaf190a4abc89. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:45:39.346420 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-28301711-ea7e-4185-a96d-46696778e6ed tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.082033 Oct 27 18:45:39.347287 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 114/247] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:45:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:39.652290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e4039458-80ef-4885-8510-5a11fe9f4c53 req-423a56bc-e5a2-48e8-a161-a7e9b6648c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cdb9a88-0030-489e-ad1a-4a8e02b48412", "name": "network-vif-deleted", "tag": "cd2c07f5-0093-4c0e-aaa2-fd60e1aa715e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:39.680674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e4039458-80ef-4885-8510-5a11fe9f4c53 req-423a56bc-e5a2-48e8-a161-a7e9b6648c43 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:39.681765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e4039458-80ef-4885-8510-5a11fe9f4c53 req-423a56bc-e5a2-48e8-a161-a7e9b6648c43 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:39.681887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e4039458-80ef-4885-8510-5a11fe9f4c53 req-423a56bc-e5a2-48e8-a161-a7e9b6648c43 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:39.699376 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e4039458-80ef-4885-8510-5a11fe9f4c53 req-423a56bc-e5a2-48e8-a161-a7e9b6648c43 service nova] Creating event network-vif-deleted:cd2c07f5-0093-4c0e-aaa2-fd60e1aa715e for instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 on n-h2-860687-3 Oct 27 18:45:39.713510 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e4039458-80ef-4885-8510-5a11fe9f4c53 req-423a56bc-e5a2-48e8-a161-a7e9b6648c43 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064985 Oct 27 18:45:39.714267 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 134/248] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:39.878940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d74dd37-6a74-4bbc-a3ef-29e70e0fe2b3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:39.879702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d74dd37-6a74-4bbc-a3ef-29e70e0fe2b3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:39.898282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d74dd37-6a74-4bbc-a3ef-29e70e0fe2b3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:39.898833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d74dd37-6a74-4bbc-a3ef-29e70e0fe2b3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:39.900314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d74dd37-6a74-4bbc-a3ef-29e70e0fe2b3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:39.903117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d74dd37-6a74-4bbc-a3ef-29e70e0fe2b3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:39.903313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-8c91c6ae-0a57-4801-8502-edef378d8f28 req-93114464-5902-4c63-a934-b1d095e9b573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e16b25-683e-43bf-b5f8-1781478bb25a", "name": "network-vif-plugged", "status": "completed", "tag": "5cfd40ff-4e39-4110-b64b-079f4abd01a6"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:39.907693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d74dd37-6a74-4bbc-a3ef-29e70e0fe2b3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:39.909164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d74dd37-6a74-4bbc-a3ef-29e70e0fe2b3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:39.929170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8c91c6ae-0a57-4801-8502-edef378d8f28 req-93114464-5902-4c63-a934-b1d095e9b573 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:39.934667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8c91c6ae-0a57-4801-8502-edef378d8f28 req-93114464-5902-4c63-a934-b1d095e9b573 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:39.935501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8c91c6ae-0a57-4801-8502-edef378d8f28 req-93114464-5902-4c63-a934-b1d095e9b573 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:39.954682 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8c91c6ae-0a57-4801-8502-edef378d8f28 req-93114464-5902-4c63-a934-b1d095e9b573 service nova] Creating event network-vif-plugged:5cfd40ff-4e39-4110-b64b-079f4abd01a6 for instance 45e16b25-683e-43bf-b5f8-1781478bb25a on n-h2-860687-3 Oct 27 18:45:39.972061 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-8c91c6ae-0a57-4801-8502-edef378d8f28 req-93114464-5902-4c63-a934-b1d095e9b573 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078733 Oct 27 18:45:39.973134 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 135/249] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:45:40.023253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-59378c97-641d-4813-a893-ab792e74ad6b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:40.024229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-59378c97-641d-4813-a893-ab792e74ad6b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:40.042531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59378c97-641d-4813-a893-ab792e74ad6b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:40.043366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59378c97-641d-4813-a893-ab792e74ad6b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:40.044780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59378c97-641d-4813-a893-ab792e74ad6b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:40.045997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59378c97-641d-4813-a893-ab792e74ad6b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:40.046611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59378c97-641d-4813-a893-ab792e74ad6b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:40.047154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59378c97-641d-4813-a893-ab792e74ad6b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:40.147151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59378c97-641d-4813-a893-ab792e74ad6b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:40.148540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59378c97-641d-4813-a893-ab792e74ad6b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:40.151128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59378c97-641d-4813-a893-ab792e74ad6b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:40.151889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-59378c97-641d-4813-a893-ab792e74ad6b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lazy-loading 'fault' on Instance uuid 7cdb9a88-0030-489e-ad1a-4a8e02b48412 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:45:40.236142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d74dd37-6a74-4bbc-a3ef-29e70e0fe2b3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:40.244819 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d74dd37-6a74-4bbc-a3ef-29e70e0fe2b3 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1487 microversion: 2.1 time: 0.370079 Oct 27 18:45:40.258736 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 115/250] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:39 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1487 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:40.265286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b8188490-4e67-4f54-8254-00f254c00a30 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:40.268856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b8188490-4e67-4f54-8254-00f254c00a30 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:40.304240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8188490-4e67-4f54-8254-00f254c00a30 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:40.304652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8188490-4e67-4f54-8254-00f254c00a30 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:40.305098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8188490-4e67-4f54-8254-00f254c00a30 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:40.305814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8188490-4e67-4f54-8254-00f254c00a30 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:40.306269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8188490-4e67-4f54-8254-00f254c00a30 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:40.306726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8188490-4e67-4f54-8254-00f254c00a30 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:40.331145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-59378c97-641d-4813-a893-ab792e74ad6b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:40.368788 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-59378c97-641d-4813-a893-ab792e74ad6b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 200 len: 1309 microversion: 2.1 time: 0.349830 Oct 27 18:45:40.371882 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 136/251] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:40 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 1309 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:40.396097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f6468061-f43b-4ded-91d1-3b277cbc9877 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:40.396724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f6468061-f43b-4ded-91d1-3b277cbc9877 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:40.403922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6468061-f43b-4ded-91d1-3b277cbc9877 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:40.405395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6468061-f43b-4ded-91d1-3b277cbc9877 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:40.406084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6468061-f43b-4ded-91d1-3b277cbc9877 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:40.407032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6468061-f43b-4ded-91d1-3b277cbc9877 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:40.407900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6468061-f43b-4ded-91d1-3b277cbc9877 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:40.408339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6468061-f43b-4ded-91d1-3b277cbc9877 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:40.684204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b8188490-4e67-4f54-8254-00f254c00a30 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:40.695629 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b8188490-4e67-4f54-8254-00f254c00a30 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.435446 Oct 27 18:45:40.717919 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 116/252] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:40 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:40.926587 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f6468061-f43b-4ded-91d1-3b277cbc9877 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1638 microversion: 2.1 time: 0.536435 Oct 27 18:45:40.929789 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 137/253] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:40 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1638 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:40.954578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e7b40b16-8476-4615-8d04-80988b9d6e1e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:40.955085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e7b40b16-8476-4615-8d04-80988b9d6e1e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:40.965701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7b40b16-8476-4615-8d04-80988b9d6e1e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:40.967074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7b40b16-8476-4615-8d04-80988b9d6e1e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:40.969433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7b40b16-8476-4615-8d04-80988b9d6e1e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:40.970351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7b40b16-8476-4615-8d04-80988b9d6e1e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:40.971181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7b40b16-8476-4615-8d04-80988b9d6e1e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:40.974859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7b40b16-8476-4615-8d04-80988b9d6e1e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:41.029890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e7b40b16-8476-4615-8d04-80988b9d6e1e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:45:41.281790 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e7b40b16-8476-4615-8d04-80988b9d6e1e tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 204 len: 0 microversion: 2.1 time: 0.331593 Oct 27 18:45:41.288105 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 117/254] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:45:40 2022] DELETE /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:45:41.295694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b1502d0d-1f01-4e26-b5f8-f01635c8ebc7 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:41.296310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b1502d0d-1f01-4e26-b5f8-f01635c8ebc7 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:41.315436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1502d0d-1f01-4e26-b5f8-f01635c8ebc7 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:41.316890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1502d0d-1f01-4e26-b5f8-f01635c8ebc7 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:41.317515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1502d0d-1f01-4e26-b5f8-f01635c8ebc7 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:41.319947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1502d0d-1f01-4e26-b5f8-f01635c8ebc7 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:41.320574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1502d0d-1f01-4e26-b5f8-f01635c8ebc7 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:41.322559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1502d0d-1f01-4e26-b5f8-f01635c8ebc7 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:41.398143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-268cfc2a-e0e9-4880-ace0-9c1973319e27 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:41.398925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-268cfc2a-e0e9-4880-ace0-9c1973319e27 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:41.408031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-268cfc2a-e0e9-4880-ace0-9c1973319e27 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:41.408529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-268cfc2a-e0e9-4880-ace0-9c1973319e27 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:41.409047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-268cfc2a-e0e9-4880-ace0-9c1973319e27 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:41.409675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-268cfc2a-e0e9-4880-ace0-9c1973319e27 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:41.410146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-268cfc2a-e0e9-4880-ace0-9c1973319e27 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:41.414411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-268cfc2a-e0e9-4880-ace0-9c1973319e27 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:41.471905 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-268cfc2a-e0e9-4880-ace0-9c1973319e27 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] HTTP exception thrown: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-268cfc2a-e0e9-4880-ace0-9c1973319e27 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Request method failure captured: Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 HTTP/1.1 Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGpZNkL-xSL-kMQjkWU1-gnc5d_8D7aOSjp-FIIKMyv1HD17dpxM5I-gxSVYLDsLpKhilaar6Yun8tRMCXFQFYE1xGmxDTceUZXwcylenMwHg7S4gjxyIN3gxIqBEJj48ELrDt_ieHkD5G1nTqEuvAXRrfE4P0g29S-XtX4vyqSM0g Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 20f8835dd20640b7a48c16bfef72e4ad Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:45:41.477763 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:45:41.479266 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20f8835dd20640b7a48c16bfef72e4ad", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:41.479266 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:45:41.479266 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 20f8835dd20640b7a48c16bfef72e4ad Oct 27 18:45:41.479266 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:45:41.479266 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersAdminTestJSON-1333743885-project Oct 27 18:45:41.479266 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:41.479266 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:41.479266 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 77144d8cdd134333ae77e2df1c022ea8 Oct 27 18:45:41.479266 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersAdminTestJSON-1333743885-project Oct 27 18:45:41.479266 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:41.479266 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:45:41.479266 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '7cdb9a88-0030-489e-ad1a-4a8e02b48412'} Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:41.480123 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:45:41.481521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:41.485189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-268cfc2a-e0e9-4880-ace0-9c1973319e27 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Returning 404 to user: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:41.487176 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-268cfc2a-e0e9-4880-ace0-9c1973319e27 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 404 len: 111 microversion: 2.1 time: 0.093247 Oct 27 18:45:41.493182 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 118/255] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:41 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:45:41.592382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b1502d0d-1f01-4e26-b5f8-f01635c8ebc7 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:41.601110 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b1502d0d-1f01-4e26-b5f8-f01635c8ebc7 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1493 microversion: 2.1 time: 0.310911 Oct 27 18:45:41.602662 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 138/256] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:41 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1493 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:41.666830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-211271525", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:41.723238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae0f85dc-12da-493c-b0f4-55aa57982b7c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:41.723860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ae0f85dc-12da-493c-b0f4-55aa57982b7c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:41.739105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae0f85dc-12da-493c-b0f4-55aa57982b7c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:41.739366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:45:41.739615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae0f85dc-12da-493c-b0f4-55aa57982b7c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:41.740524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae0f85dc-12da-493c-b0f4-55aa57982b7c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:41.743459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae0f85dc-12da-493c-b0f4-55aa57982b7c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:41.746073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae0f85dc-12da-493c-b0f4-55aa57982b7c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:41.746559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae0f85dc-12da-493c-b0f4-55aa57982b7c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:41.937458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ae0f85dc-12da-493c-b0f4-55aa57982b7c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:41.948077 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ae0f85dc-12da-493c-b0f4-55aa57982b7c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1313 microversion: 2.1 time: 0.228831 Oct 27 18:45:41.949312 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 139/257] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:41 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:42.125916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:45:42.127118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:45:42.128071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:45:42.128764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:45:42.130305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:45:42.145507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:42.146493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:42.147144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:42.148247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:42.148924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:42.151809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:42.176426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Getting quotas for project 20f8835dd20640b7a48c16bfef72e4ad. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:45:42.181515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Getting quotas for user 77144d8cdd134333ae77e2df1c022ea8 and project 20f8835dd20640b7a48c16bfef72e4ad. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:45:42.197944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:45:42.201595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:45:42.244633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-901350579", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "619435472", "adminPass": "***", "networks": [{"uuid": "638fca29-2801-4b26-833b-1d1d0c6d3d12"}], "security_groups": [{"name": "tempest-securitygroup--1631803479"}], "key_name": "tempest-keypair-1180244837", "user_data": "}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:42.289569 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-79385877-e39d-47bd-b58a-478563e5fc1c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627486 Oct 27 18:45:42.291284 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 119/258] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:45:42.315128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6af44eff-959b-4ca4-8e48-dc197a3fb0d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:42.316099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6af44eff-959b-4ca4-8e48-dc197a3fb0d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:42.428293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6af44eff-959b-4ca4-8e48-dc197a3fb0d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:42.436732 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6af44eff-959b-4ca4-8e48-dc197a3fb0d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1219 microversion: 2.1 time: 0.138366 Oct 27 18:45:42.452144 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 120/259] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:42 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:42.470198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] validate_networks() for [('638fca29-2801-4b26-833b-1d1d0c6d3d12', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:45:42.625379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-12db68b9-ab43-4715-bc3a-1504ed7743ca tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:42.626002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-12db68b9-ab43-4715-bc3a-1504ed7743ca tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:42.645049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12db68b9-ab43-4715-bc3a-1504ed7743ca tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:42.645543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12db68b9-ab43-4715-bc3a-1504ed7743ca tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:42.645983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12db68b9-ab43-4715-bc3a-1504ed7743ca tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:42.646726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12db68b9-ab43-4715-bc3a-1504ed7743ca tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:42.652032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12db68b9-ab43-4715-bc3a-1504ed7743ca tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:42.652521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12db68b9-ab43-4715-bc3a-1504ed7743ca tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:42.936599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-12db68b9-ab43-4715-bc3a-1504ed7743ca tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:42.949014 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-12db68b9-ab43-4715-bc3a-1504ed7743ca tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1493 microversion: 2.1 time: 0.326378 Oct 27 18:45:42.967810 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 121/260] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:42 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1493 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:42.974304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2b898dc9-cd11-4cf9-ab50-213c01e741eb tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:42.975313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2b898dc9-cd11-4cf9-ab50-213c01e741eb tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:42.988825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b898dc9-cd11-4cf9-ab50-213c01e741eb tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:42.989679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b898dc9-cd11-4cf9-ab50-213c01e741eb tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:42.990289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b898dc9-cd11-4cf9-ab50-213c01e741eb tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:42.991421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b898dc9-cd11-4cf9-ab50-213c01e741eb tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:42.992074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b898dc9-cd11-4cf9-ab50-213c01e741eb tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:42.992649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b898dc9-cd11-4cf9-ab50-213c01e741eb tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:43.233433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2b898dc9-cd11-4cf9-ab50-213c01e741eb tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:43.242593 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2b898dc9-cd11-4cf9-ab50-213c01e741eb tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1463 microversion: 2.1 time: 0.273257 Oct 27 18:45:43.243260 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 122/261] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:42 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1463 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:43.431998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1513917372", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:43.524382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:45:43.561076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:44.046156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:45:44.046863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:45:44.047691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:45:44.048496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:45:44.051519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:45:44.068669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:44.069763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:44.070950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:44.074977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:44.077734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:44.078624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:44.130835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Getting quotas for project f2469694f60446648bdd4fe005a7f17b. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:45:44.142767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Getting quotas for user a76e6b9746814167abf1f3088468a87c and project f2469694f60446648bdd4fe005a7f17b. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:45:44.179478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:45:44.179908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:45:44.180397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:45:44.181008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:45:44.181571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:45:44.192501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:45:44.201092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:44.201431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:44.201876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:44.202663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:44.203120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:44.203326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:45:44.211837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:44.226925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:44.255286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Getting quotas for project f976057610c846c3b9caaf190a4abc89. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:45:44.259897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Getting quotas for user 97a85e281f544f4aa49b27cd776c849a and project f976057610c846c3b9caaf190a4abc89. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:45:44.272476 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-641b5fc6-ef1f-4f6f-8528-d457a4aa7aeb tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.026460 Oct 27 18:45:44.273454 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 123/262] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:45:44.285766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bed1a351-26e0-4ae1-9fb0-26b0911f8cd5 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:44.286884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bed1a351-26e0-4ae1-9fb0-26b0911f8cd5 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:44.288665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:45:44.301838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:45:44.314326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bed1a351-26e0-4ae1-9fb0-26b0911f8cd5 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:44.315352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bed1a351-26e0-4ae1-9fb0-26b0911f8cd5 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:44.315805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bed1a351-26e0-4ae1-9fb0-26b0911f8cd5 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:44.316527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bed1a351-26e0-4ae1-9fb0-26b0911f8cd5 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:44.317068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bed1a351-26e0-4ae1-9fb0-26b0911f8cd5 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:44.317504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bed1a351-26e0-4ae1-9fb0-26b0911f8cd5 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:44.322878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:44.402129 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c855b828-8bbf-4d50-8d22-058b48a3c0b9 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.179820 Oct 27 18:45:44.412101 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 140/263] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 2190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:45:44.422322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5f39fad8-eda1-4d2b-967d-3391b6475cd6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:44.423184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5f39fad8-eda1-4d2b-967d-3391b6475cd6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:44.436694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f39fad8-eda1-4d2b-967d-3391b6475cd6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:44.437410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f39fad8-eda1-4d2b-967d-3391b6475cd6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:44.438007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f39fad8-eda1-4d2b-967d-3391b6475cd6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:44.438933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f39fad8-eda1-4d2b-967d-3391b6475cd6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:44.439548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f39fad8-eda1-4d2b-967d-3391b6475cd6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:44.440285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f39fad8-eda1-4d2b-967d-3391b6475cd6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:44.611171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5f39fad8-eda1-4d2b-967d-3391b6475cd6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:44.630445 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5f39fad8-eda1-4d2b-967d-3391b6475cd6 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1298 microversion: 2.1 time: 0.215930 Oct 27 18:45:44.631779 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 141/264] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:44 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1298 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:44.642561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d50b197c-3e76-4831-8f9e-d962b8e0129d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:44.643566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d50b197c-3e76-4831-8f9e-d962b8e0129d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:44.662425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:44.664594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d50b197c-3e76-4831-8f9e-d962b8e0129d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:44.665249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d50b197c-3e76-4831-8f9e-d962b8e0129d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:44.665797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d50b197c-3e76-4831-8f9e-d962b8e0129d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:44.667574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d50b197c-3e76-4831-8f9e-d962b8e0129d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:44.668221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d50b197c-3e76-4831-8f9e-d962b8e0129d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:44.669024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d50b197c-3e76-4831-8f9e-d962b8e0129d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:44.729809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bed1a351-26e0-4ae1-9fb0-26b0911f8cd5 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:44.745232 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bed1a351-26e0-4ae1-9fb0-26b0911f8cd5 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1463 microversion: 2.1 time: 0.469562 Oct 27 18:45:44.746773 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 124/265] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:44 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1463 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:44.768886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b492f4fd-0c93-48e6-abd8-482ae828b802 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:44.770111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b492f4fd-0c93-48e6-abd8-482ae828b802 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:44.833453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d50b197c-3e76-4831-8f9e-d962b8e0129d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:44.836041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d50b197c-3e76-4831-8f9e-d962b8e0129d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:44.837632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d50b197c-3e76-4831-8f9e-d962b8e0129d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:44.839842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-d50b197c-3e76-4831-8f9e-d962b8e0129d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lazy-loading 'fault' on Instance uuid e6a3f842-fb4c-4973-a787-b1e84ba6ae88 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:45:44.911136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d50b197c-3e76-4831-8f9e-d962b8e0129d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa7fd186f2747628701e834fac1b8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb1ba9cb5644deeb4c2009add788a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:44.923121 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d50b197c-3e76-4831-8f9e-d962b8e0129d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 200 len: 1327 microversion: 2.1 time: 0.289074 Oct 27 18:45:44.936653 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 142/266] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:44 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 1327 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:44.946871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-feb2deb5-2a9b-46b6-894d-b4ee776bf501 req-9fdb500f-6f62-4f8e-8e16-00f1b81ce68f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a3f842-fb4c-4973-a787-b1e84ba6ae88", "name": "network-vif-deleted", "tag": "11eb54ef-42aa-41b7-bece-cfe4088dc947"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:44.949523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b492f4fd-0c93-48e6-abd8-482ae828b802 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:44.958668 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b492f4fd-0c93-48e6-abd8-482ae828b802 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1223 microversion: 2.1 time: 0.209465 Oct 27 18:45:44.959664 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 125/267] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:44 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1223 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:44.960116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-feb2deb5-2a9b-46b6-894d-b4ee776bf501 req-9fdb500f-6f62-4f8e-8e16-00f1b81ce68f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:44.960841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-feb2deb5-2a9b-46b6-894d-b4ee776bf501 req-9fdb500f-6f62-4f8e-8e16-00f1b81ce68f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:44.961447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-feb2deb5-2a9b-46b6-894d-b4ee776bf501 req-9fdb500f-6f62-4f8e-8e16-00f1b81ce68f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:44.965334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c7b0d2ca-9d09-4bf8-9618-5ad48d439407 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:44.966053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c7b0d2ca-9d09-4bf8-9618-5ad48d439407 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:44.983619 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-feb2deb5-2a9b-46b6-894d-b4ee776bf501 req-9fdb500f-6f62-4f8e-8e16-00f1b81ce68f service nova] Creating event network-vif-deleted:11eb54ef-42aa-41b7-bece-cfe4088dc947 for instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 on n-h1-860687-3 Oct 27 18:45:44.998735 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-feb2deb5-2a9b-46b6-894d-b4ee776bf501 req-9fdb500f-6f62-4f8e-8e16-00f1b81ce68f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054306 Oct 27 18:45:45.005163 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 143/268] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:45.028783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1558078854", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a43e1759-0ffb-423c-8d31-569d5ce79268"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:45.107653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:45:45.227388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c7b0d2ca-9d09-4bf8-9618-5ad48d439407 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:45.252700 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c7b0d2ca-9d09-4bf8-9618-5ad48d439407 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 200 len: 1262 microversion: 2.1 time: 0.288657 Oct 27 18:45:45.254861 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 126/269] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:44 2022] GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 1262 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:45.458052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:45:45.458597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:45:45.459113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:45:45.459561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:45:45.460013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:45:45.470551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:45.471250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:45.471969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:45.472993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:45.473627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:45.474352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:45.496336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Getting quotas for project ee37570c43c8438faad6c2bcdbacce99. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:45:45.502212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Getting quotas for user 6a0b4798f17b408dab3af2ae0d2a45b7 and project ee37570c43c8438faad6c2bcdbacce99. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:45:45.516964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:45:45.523108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:45:45.659078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2b69564f-7d75-484c-8b47-6634a51cd0c0 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:45.659861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2b69564f-7d75-484c-8b47-6634a51cd0c0 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:45.667622 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-60d5b94b-ac5f-48fe-8d99-401e2b4882ea tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643603 Oct 27 18:45:45.671626 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 144/270] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:45:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 18:45:45.676236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b69564f-7d75-484c-8b47-6634a51cd0c0 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:45.676786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b69564f-7d75-484c-8b47-6634a51cd0c0 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:45.677320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b69564f-7d75-484c-8b47-6634a51cd0c0 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:45.678183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b69564f-7d75-484c-8b47-6634a51cd0c0 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:45.678836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b69564f-7d75-484c-8b47-6634a51cd0c0 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:45.679417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b69564f-7d75-484c-8b47-6634a51cd0c0 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:45.686625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c06e83a1-ab70-4e5d-94e7-cfb68b6832da tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:45.688372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c06e83a1-ab70-4e5d-94e7-cfb68b6832da tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:45.777498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c06e83a1-ab70-4e5d-94e7-cfb68b6832da tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:45.788309 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c06e83a1-ab70-4e5d-94e7-cfb68b6832da tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1214 microversion: 2.1 time: 0.109418 Oct 27 18:45:45.789284 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 145/271] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:45 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:45.949309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d331c91f-2cae-41ff-9223-319e37a3d72f tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:45.950084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d331c91f-2cae-41ff-9223-319e37a3d72f tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:45.967457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d331c91f-2cae-41ff-9223-319e37a3d72f tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:45.969972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2b69564f-7d75-484c-8b47-6634a51cd0c0 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:45.973221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d331c91f-2cae-41ff-9223-319e37a3d72f tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:45.973850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d331c91f-2cae-41ff-9223-319e37a3d72f tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:45.978182 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2b69564f-7d75-484c-8b47-6634a51cd0c0 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1298 microversion: 2.1 time: 0.324623 Oct 27 18:45:45.979885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d331c91f-2cae-41ff-9223-319e37a3d72f tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:45.980478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d331c91f-2cae-41ff-9223-319e37a3d72f tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:45.980939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d331c91f-2cae-41ff-9223-319e37a3d72f tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:45.990554 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 127/272] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:45 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1298 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:46.000415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b889e5fd-1de1-4751-bded-3ba05d5768ed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:46.002648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b889e5fd-1de1-4751-bded-3ba05d5768ed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:46.013615 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-d331c91f-2cae-41ff-9223-319e37a3d72f tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] HTTP exception thrown: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d331c91f-2cae-41ff-9223-319e37a3d72f tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Request method failure captured: Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 HTTP/1.1 Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGpN1ir0UxaLDomtg8TLKp5aav2lRh0r39PGGpqI2ykZpGcUOf0Iahk1bI8fB_PPTC_8mqXY196u9WhwCb5bAZvyJJcgEfS-TifDDG8MghZrV1EueD-aCjjFMcYD6x_BPPZXwrxtz1_yHtbyI044TLCIo0JhUuWdLB_4RUlk1byTOY Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: cdb1ba9cb5644deeb4c2009add788a01 Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminTestJSON-223616936 Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:45:46.016885 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:45:46.018407 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cdb1ba9cb5644deeb4c2009add788a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdb1ba9cb5644deeb4c2009add788a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cdb1ba9cb5644deeb4c2009add788a01", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdb1ba9cb5644deeb4c2009add788a01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:46.018407 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminTestJSON-223616936 Oct 27 18:45:46.018407 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: cdb1ba9cb5644deeb4c2009add788a01 Oct 27 18:45:46.018407 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-223616936 Oct 27 18:45:46.018407 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminTestJSON-223616936-project Oct 27 18:45:46.018407 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:46.018407 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:46.018407 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: efa7fd186f2747628701e834fac1b8b0 Oct 27 18:45:46.018407 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminTestJSON-223616936-project Oct 27 18:45:46.018407 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:46.018407 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:46.018407 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'e6a3f842-fb4c-4973-a787-b1e84ba6ae88'} Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:46.019386 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:46.020645 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:46.021853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b889e5fd-1de1-4751-bded-3ba05d5768ed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:46.022217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b889e5fd-1de1-4751-bded-3ba05d5768ed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:46.022687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b889e5fd-1de1-4751-bded-3ba05d5768ed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:46.023406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b889e5fd-1de1-4751-bded-3ba05d5768ed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:46.023736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d331c91f-2cae-41ff-9223-319e37a3d72f tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Returning 404 to user: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:46.023848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b889e5fd-1de1-4751-bded-3ba05d5768ed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:46.024364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b889e5fd-1de1-4751-bded-3ba05d5768ed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:46.025198 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d331c91f-2cae-41ff-9223-319e37a3d72f tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 404 len: 111 microversion: 2.1 time: 0.079845 Oct 27 18:45:46.026811 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 146/273] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:45 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:45:46.041646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0a13b2f5-812a-4b16-8bbe-32621b5bde2b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-3"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:46.081370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a13b2f5-812a-4b16-8bbe-32621b5bde2b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:46.082332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a13b2f5-812a-4b16-8bbe-32621b5bde2b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:46.083060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a13b2f5-812a-4b16-8bbe-32621b5bde2b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:46.146686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b889e5fd-1de1-4751-bded-3ba05d5768ed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:46.170337 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b889e5fd-1de1-4751-bded-3ba05d5768ed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1275 microversion: 2.1 time: 0.175433 Oct 27 18:45:46.174628 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 128/274] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:45 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:46.277104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2820915c-2f2f-4f35-869b-2c92011f9c98 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:46.283170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2820915c-2f2f-4f35-869b-2c92011f9c98 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:46.302838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2820915c-2f2f-4f35-869b-2c92011f9c98 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:46.308584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2820915c-2f2f-4f35-869b-2c92011f9c98 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:46.311553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2820915c-2f2f-4f35-869b-2c92011f9c98 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:46.312647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2820915c-2f2f-4f35-869b-2c92011f9c98 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:46.314464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2820915c-2f2f-4f35-869b-2c92011f9c98 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:46.315032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2820915c-2f2f-4f35-869b-2c92011f9c98 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:46.408561 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0a13b2f5-812a-4b16-8bbe-32621b5bde2b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 297 microversion: 2.1 time: 0.371252 Oct 27 18:45:46.410813 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 147/275] 10.222.0.42 () {60 vars in 1191 bytes} [Thu Oct 27 18:45:46 2022] POST /compute/v2.1/os-aggregates/4/action => generated 297 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:46.435827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-86e1afaf-177e-4f35-8b08-a1fc90eb619a tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:46.458759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2820915c-2f2f-4f35-869b-2c92011f9c98 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:46.483987 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2820915c-2f2f-4f35-869b-2c92011f9c98 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 200 len: 1335 microversion: 2.1 time: 0.210336 Oct 27 18:45:46.485040 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 129/276] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:46 2022] GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 1335 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:46.520963 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-86e1afaf-177e-4f35-8b08-a1fc90eb619a tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.099331 Oct 27 18:45:46.522511 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 148/277] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:46 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 27 18:45:46.554828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-98e5ba1c-c74f-484a-8995-06ee90f582f3 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-430493129"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:46.563047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.aggregate [None req-98e5ba1c-c74f-484a-8995-06ee90f582f3 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Generated uuid e8f08865-6a6c-44b5-a424-3b39553a23a5 for aggregate {{(pid=127028) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:46.607027 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-98e5ba1c-c74f-484a-8995-06ee90f582f3 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.069606 Oct 27 18:45:46.611181 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 130/278] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:46 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:46.625071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-32909f02-2717-4799-acdc-19a3cc12cf28 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-3"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:46.650224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32909f02-2717-4799-acdc-19a3cc12cf28 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:46.652292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32909f02-2717-4799-acdc-19a3cc12cf28 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:46.653920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32909f02-2717-4799-acdc-19a3cc12cf28 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:46.812908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8d909eec-7cca-4512-9efe-7bc3150ae159 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:46.815217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8d909eec-7cca-4512-9efe-7bc3150ae159 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:46.824892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d909eec-7cca-4512-9efe-7bc3150ae159 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:46.827047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d909eec-7cca-4512-9efe-7bc3150ae159 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:46.827961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d909eec-7cca-4512-9efe-7bc3150ae159 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:46.829557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d909eec-7cca-4512-9efe-7bc3150ae159 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:46.830250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d909eec-7cca-4512-9efe-7bc3150ae159 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:46.830463 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-32909f02-2717-4799-acdc-19a3cc12cf28 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.215197 Oct 27 18:45:46.831419 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 149/279] 10.222.0.42 () {60 vars in 1191 bytes} [Thu Oct 27 18:45:46 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:46.832085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d909eec-7cca-4512-9efe-7bc3150ae159 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:46.843546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-21ae77e1-a023-4438-b08f-5dfe13af32a8 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:46.870665 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-21ae77e1-a023-4438-b08f-5dfe13af32a8 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.031939 Oct 27 18:45:46.874759 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 150/280] 10.222.0.42 () {58 vars in 1149 bytes} [Thu Oct 27 18:45:46 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:45:46.899137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-159db475-bf00-4de0-84e2-22dd33414bec tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-3"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:46.928937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-159db475-bf00-4de0-84e2-22dd33414bec tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:46.929439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-159db475-bf00-4de0-84e2-22dd33414bec tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:46.929957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-159db475-bf00-4de0-84e2-22dd33414bec tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:47.023033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8d909eec-7cca-4512-9efe-7bc3150ae159 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:47.036918 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8d909eec-7cca-4512-9efe-7bc3150ae159 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1210 microversion: 2.1 time: 0.229252 Oct 27 18:45:47.037774 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 131/281] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:46 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1210 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:47.062344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c7e5d95e-0b37-428e-8cf5-c1f9de00c1dc tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:47.063286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c7e5d95e-0b37-428e-8cf5-c1f9de00c1dc tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:47.076460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7e5d95e-0b37-428e-8cf5-c1f9de00c1dc tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:47.077399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7e5d95e-0b37-428e-8cf5-c1f9de00c1dc tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:47.078146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7e5d95e-0b37-428e-8cf5-c1f9de00c1dc tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:47.079117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7e5d95e-0b37-428e-8cf5-c1f9de00c1dc tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:47.079746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7e5d95e-0b37-428e-8cf5-c1f9de00c1dc tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:47.080335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7e5d95e-0b37-428e-8cf5-c1f9de00c1dc tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:47.114894 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-159db475-bf00-4de0-84e2-22dd33414bec tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.230268 Oct 27 18:45:47.115766 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 151/282] 10.222.0.42 () {60 vars in 1191 bytes} [Thu Oct 27 18:45:46 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:45:47.127709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fc566447-5f6b-43c3-bb4b-5a24d8c63cb4 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:47.164006 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fc566447-5f6b-43c3-bb4b-5a24d8c63cb4 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.039966 Oct 27 18:45:47.167281 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 152/283] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:47 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 27 18:45:47.179545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d889acbd-5fbd-4b0a-b6f6-3331586e9ae0 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-649864723"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:47.183413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.aggregate [None req-d889acbd-5fbd-4b0a-b6f6-3331586e9ae0 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Generated uuid 1bba263a-b690-48f7-ad0e-ff7d7c564b7e for aggregate {{(pid=127029) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:47.222369 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d889acbd-5fbd-4b0a-b6f6-3331586e9ae0 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046132 Oct 27 18:45:47.223202 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 153/284] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:47.229831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9ac5d69b-9e8f-49ed-b38d-455e69114392 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:47.230682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9ac5d69b-9e8f-49ed-b38d-455e69114392 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:47.239363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ac5d69b-9e8f-49ed-b38d-455e69114392 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:47.240196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ac5d69b-9e8f-49ed-b38d-455e69114392 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:47.240851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ac5d69b-9e8f-49ed-b38d-455e69114392 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:47.241775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ac5d69b-9e8f-49ed-b38d-455e69114392 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:47.242502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ac5d69b-9e8f-49ed-b38d-455e69114392 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:47.243701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ac5d69b-9e8f-49ed-b38d-455e69114392 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:47.249484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:47.351925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9ac5d69b-9e8f-49ed-b38d-455e69114392 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:47.366493 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9ac5d69b-9e8f-49ed-b38d-455e69114392 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1281 microversion: 2.1 time: 0.141789 Oct 27 18:45:47.367666 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 154/285] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:47 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1281 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:47.377419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b0711b5f-1bf4-4744-91fe-690cac7ffdcb tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-3"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:47.406879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0711b5f-1bf4-4744-91fe-690cac7ffdcb tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:47.407457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0711b5f-1bf4-4744-91fe-690cac7ffdcb tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:47.408281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0711b5f-1bf4-4744-91fe-690cac7ffdcb tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:47.610439 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b0711b5f-1bf4-4744-91fe-690cac7ffdcb tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.240333 Oct 27 18:45:47.611275 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 155/286] 10.222.0.42 () {60 vars in 1194 bytes} [Thu Oct 27 18:45:47 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:47.618916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-30ef610a-3c2a-4720-b561-bacc132f587f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:47.619709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-30ef610a-3c2a-4720-b561-bacc132f587f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:47.629031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef610a-3c2a-4720-b561-bacc132f587f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:47.629260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef610a-3c2a-4720-b561-bacc132f587f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:47.629898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef610a-3c2a-4720-b561-bacc132f587f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:47.630858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef610a-3c2a-4720-b561-bacc132f587f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:47.631480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef610a-3c2a-4720-b561-bacc132f587f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:47.632051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef610a-3c2a-4720-b561-bacc132f587f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:47.673338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c7e5d95e-0b37-428e-8cf5-c1f9de00c1dc tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:47.699754 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c7e5d95e-0b37-428e-8cf5-c1f9de00c1dc tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1319 microversion: 2.1 time: 0.644487 Oct 27 18:45:47.700502 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 132/287] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:47 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1319 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:47.705260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ef8eee0-beb5-4bc1-9eef-ced30f6882ac tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-3"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:47.722246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5ef8eee0-beb5-4bc1-9eef-ced30f6882ac tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '85f7aabce23a4f0e96602625464c997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0df4e5654a04747ae69752316b6127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ef8eee0-beb5-4bc1-9eef-ced30f6882ac tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Request method failure captured: Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 42 Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGqV0DjaYXQe-IzomTLCwMkDKwOIx6alwBBND54DJ7DsxKmYkh91Hs5uNszTBDiKfnge54x6u8XqdCxMb7Xq_TVuFktgrAfPWg1YIPw7PaoZSCIA_Vfppo_q6MbhX0Vz9ya8S3DMheia8QnviXk2xyH2feodcem25HOkuEcQxDvBtE Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f0df4e5654a04747ae69752316b6127a Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:45:47.724054 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:45:47.725324 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f0df4e5654a04747ae69752316b6127a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0df4e5654a04747ae69752316b6127a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:47.725324 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:47.725324 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f0df4e5654a04747ae69752316b6127a Oct 27 18:45:47.725324 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815 Oct 27 18:45:47.725324 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AggregatesAdminNegativeTestJSON-1275643815-project Oct 27 18:45:47.725324 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:47.725324 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:47.725324 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 85f7aabce23a4f0e96602625464c997a Oct 27 18:45:47.725324 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1275643815-project Oct 27 18:45:47.725324 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:45:47.725324 n-d-860687-3 devstack@n-api.service[127028]: {"remove_host": {"host": "n-h1-860687-3"}} Oct 27 18:45:47.725324 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:47.725324 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '10', 'body': {'remove_host': {'host': 'n-h1-860687-3'}}} Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:47.726128 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 27 18:45:47.727373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:47.729797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ef8eee0-beb5-4bc1-9eef-ced30f6882ac tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:47.731214 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5ef8eee0-beb5-4bc1-9eef-ced30f6882ac tempest-AggregatesAdminNegativeTestJSON-1275643815 tempest-AggregatesAdminNegativeTestJSON-1275643815-project] 10.222.0.42 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 121 microversion: 2.1 time: 0.029457 Oct 27 18:45:47.732389 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 133/288] 10.222.0.42 () {60 vars in 1194 bytes} [Thu Oct 27 18:45:47 2022] POST /compute/v2.1/os-aggregates/10/action => generated 121 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:47.741594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e3e7b0a2-86ac-45b2-b858-ba6c931df675 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-3"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:47.771132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e7b0a2-86ac-45b2-b858-ba6c931df675 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:47.773213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e7b0a2-86ac-45b2-b858-ba6c931df675 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:47.773850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e7b0a2-86ac-45b2-b858-ba6c931df675 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:47.848359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-30ef610a-3c2a-4720-b561-bacc132f587f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:47.868052 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-30ef610a-3c2a-4720-b561-bacc132f587f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 200 len: 1320 microversion: 2.1 time: 0.255611 Oct 27 18:45:47.868709 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 156/289] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:47 2022] GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 1320 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:47.993384 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e3e7b0a2-86ac-45b2-b858-ba6c931df675 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.252555 Oct 27 18:45:47.995097 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 134/290] 10.222.0.42 () {60 vars in 1194 bytes} [Thu Oct 27 18:45:47 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:45:48.006460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-30c1c038-a388-481b-a7ef-f4df4dccfbfd tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:48.068926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb78cbef-84a9-45e3-a532-cf72d86a4af9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:48.069468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cb78cbef-84a9-45e3-a532-cf72d86a4af9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:48.103319 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-30c1c038-a388-481b-a7ef-f4df4dccfbfd tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.101142 Oct 27 18:45:48.114533 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 157/291] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 18:45:48 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:48.116143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb78cbef-84a9-45e3-a532-cf72d86a4af9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:48.117059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb78cbef-84a9-45e3-a532-cf72d86a4af9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:48.117525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb78cbef-84a9-45e3-a532-cf72d86a4af9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:48.132351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb78cbef-84a9-45e3-a532-cf72d86a4af9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:48.136687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb78cbef-84a9-45e3-a532-cf72d86a4af9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:48.139024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb78cbef-84a9-45e3-a532-cf72d86a4af9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:48.146847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d87eec6f-bae6-4f8a-a306-f089262e03dc tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1977533222"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:48.173611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.aggregate [None req-d87eec6f-bae6-4f8a-a306-f089262e03dc tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Generated uuid 5d549af4-f94f-409e-9b45-3ce4f9732352 for aggregate {{(pid=127029) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:48.249844 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d87eec6f-bae6-4f8a-a306-f089262e03dc tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.131316 Oct 27 18:45:48.250453 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 158/292] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:48 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:48.289115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9b16f0bd-fef9-4ca9-95b0-3736c90d996b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-453735785"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:48.301358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.aggregate [None req-9b16f0bd-fef9-4ca9-95b0-3736c90d996b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Generated uuid 0e28da03-3cce-454b-9315-42ce462c45f4 for aggregate {{(pid=127029) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:48.353903 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9b16f0bd-fef9-4ca9-95b0-3736c90d996b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.085121 Oct 27 18:45:48.358079 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 159/293] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:48.385919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d775ab90-ab42-4298-942b-1a8a57700e9b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:48.403979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d775ab90-ab42-4298-942b-1a8a57700e9b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:48.405617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d775ab90-ab42-4298-942b-1a8a57700e9b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:48.407548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d775ab90-ab42-4298-942b-1a8a57700e9b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:48.416439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d775ab90-ab42-4298-942b-1a8a57700e9b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:48.417158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d775ab90-ab42-4298-942b-1a8a57700e9b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:48.418338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d775ab90-ab42-4298-942b-1a8a57700e9b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:48.427894 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.compute.aggregates [None req-d775ab90-ab42-4298-942b-1a8a57700e9b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Failed to remove host nonexist_host from aggregate 11. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 27 18:45:48.428773 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-d775ab90-ab42-4298-942b-1a8a57700e9b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 11 Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d775ab90-ab42-4298-942b-1a8a57700e9b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Request method failure captured: Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 42 Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGs_ysdUBr5Z2suyC2IjQ_aj6kWWTMJm7cbSel7EwjBj_qX1eIlE_9aG8ZrtpBH3xFS5ayL2HTiRvfinXNyzFmDGL4sNDbqVsUBI61DCqFO-jXmM1b_8Xveqz3e8RYdgjKcIT4UGyHhSSGw7ADShxpAE9ZqmThZRCN9Tl4eEJHt6Pk Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:45:48.432432 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:45:48.433788 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c3796e5c38b84e89b9a80523736cbbb2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3796e5c38b84e89b9a80523736cbbb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:48.433788 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:48.433788 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c3796e5c38b84e89b9a80523736cbbb2 Oct 27 18:45:48.433788 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739 Oct 27 18:45:48.433788 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:48.433788 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:48.433788 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:48.433788 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 76b10cd0cd584e1d9c36e5350ed6f1d8 Oct 27 18:45:48.433788 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin Oct 27 18:45:48.433788 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:45:48.433788 n-d-860687-3 devstack@n-api.service[127029]: {"remove_host": {"host": "nonexist_host"}} Oct 27 18:45:48.433788 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:48.433788 n-d-860687-3 devstack@n-api.service[127029]: exception: Cannot remove host nonexist_host in aggregate 11 Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '11', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 27 18:45:48.436125 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 27 18:45:48.437438 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 11 Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:48.438694 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:48.439965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:48.439965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:48.439965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:48.439965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:48.439965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 11 Oct 27 18:45:48.439965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:48.439965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d775ab90-ab42-4298-942b-1a8a57700e9b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 11 {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:48.441386 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d775ab90-ab42-4298-942b-1a8a57700e9b tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 94 microversion: 2.1 time: 0.081527 Oct 27 18:45:48.445853 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 160/294] 10.222.0.42 () {60 vars in 1194 bytes} [Thu Oct 27 18:45:48 2022] POST /compute/v2.1/os-aggregates/11/action => generated 94 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:45:48.454014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a3c2387c-a088-42ac-8bb2-3473ac3e046b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-3"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:48.469663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3c2387c-a088-42ac-8bb2-3473ac3e046b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:48.470245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3c2387c-a088-42ac-8bb2-3473ac3e046b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:48.470724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3c2387c-a088-42ac-8bb2-3473ac3e046b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:48.482318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:DELETE=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:48.599520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cb78cbef-84a9-45e3-a532-cf72d86a4af9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:48.613353 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cb78cbef-84a9-45e3-a532-cf72d86a4af9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1272 microversion: 2.1 time: 0.554970 Oct 27 18:45:48.614188 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 135/295] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:48 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1272 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:48.623968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f9f79b2d-c76f-4914-9d30-a8d6f61a3698 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:48.625017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f9f79b2d-c76f-4914-9d30-a8d6f61a3698 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:48.632325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9f79b2d-c76f-4914-9d30-a8d6f61a3698 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:48.632825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9f79b2d-c76f-4914-9d30-a8d6f61a3698 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:48.633929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9f79b2d-c76f-4914-9d30-a8d6f61a3698 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:48.634685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9f79b2d-c76f-4914-9d30-a8d6f61a3698 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:48.635147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9f79b2d-c76f-4914-9d30-a8d6f61a3698 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:48.635743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9f79b2d-c76f-4914-9d30-a8d6f61a3698 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:48.693363 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a3c2387c-a088-42ac-8bb2-3473ac3e046b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 242 microversion: 2.1 time: 0.246117 Oct 27 18:45:48.693986 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 161/296] 10.222.0.42 () {60 vars in 1194 bytes} [Thu Oct 27 18:45:48 2022] POST /compute/v2.1/os-aggregates/12/action => generated 242 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:48.699715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cf9f1614-934d-480c-935a-9589cacdf5f6 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:48.739274 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cf9f1614-934d-480c-935a-9589cacdf5f6 tempest-AggregatesAdminNegativeTestJSON-1634131739 tempest-AggregatesAdminNegativeTestJSON-1634131739-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.043806 Oct 27 18:45:48.740269 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 162/297] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 18:45:48 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:48.756790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-02f1c83a-22e6-45ad-bce8-5f42b465bf11 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:48.786047 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-02f1c83a-22e6-45ad-bce8-5f42b465bf11 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.042579 Oct 27 18:45:48.794614 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 163/298] 10.222.0.42 () {58 vars in 1143 bytes} [Thu Oct 27 18:45:48 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:48.794614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0dc1f0ce-8763-4008-b0ae-0476affdd1df tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:48.794614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0dc1f0ce-8763-4008-b0ae-0476affdd1df tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:48.815947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dc1f0ce-8763-4008-b0ae-0476affdd1df tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:48.817214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dc1f0ce-8763-4008-b0ae-0476affdd1df tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:48.817869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dc1f0ce-8763-4008-b0ae-0476affdd1df tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:48.820124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dc1f0ce-8763-4008-b0ae-0476affdd1df tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:48.821442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dc1f0ce-8763-4008-b0ae-0476affdd1df tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:48.821993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dc1f0ce-8763-4008-b0ae-0476affdd1df tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:49.079987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f9f79b2d-c76f-4914-9d30-a8d6f61a3698 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:49.087735 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f9f79b2d-c76f-4914-9d30-a8d6f61a3698 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1281 microversion: 2.1 time: 0.472355 Oct 27 18:45:49.088551 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 136/299] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:48 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1281 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:49.090130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0dc1f0ce-8763-4008-b0ae-0476affdd1df tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:49.099867 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0dc1f0ce-8763-4008-b0ae-0476affdd1df tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1319 microversion: 2.1 time: 0.311475 Oct 27 18:45:49.100947 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 164/300] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:48 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:49.109110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7909fddd-156f-484d-ba54-2c87145d6646 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:49.110524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7909fddd-156f-484d-ba54-2c87145d6646 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:49.118285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-133ec347-7bee-4115-af3a-03ac3d22aa33 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-3"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:49.120716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7909fddd-156f-484d-ba54-2c87145d6646 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:49.121418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7909fddd-156f-484d-ba54-2c87145d6646 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:49.122604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7909fddd-156f-484d-ba54-2c87145d6646 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:49.123605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7909fddd-156f-484d-ba54-2c87145d6646 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:49.124311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7909fddd-156f-484d-ba54-2c87145d6646 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:49.125019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7909fddd-156f-484d-ba54-2c87145d6646 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:49.136216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-133ec347-7bee-4115-af3a-03ac3d22aa33 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:49.136724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-133ec347-7bee-4115-af3a-03ac3d22aa33 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:49.137165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-133ec347-7bee-4115-af3a-03ac3d22aa33 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:49.362764 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-133ec347-7bee-4115-af3a-03ac3d22aa33 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.272652 Oct 27 18:45:49.363484 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 137/301] 10.222.0.42 () {60 vars in 1194 bytes} [Thu Oct 27 18:45:49 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:49.378905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-76ccf10a-e0b3-4441-a926-8ccb2ac6ae0c tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:49.413774 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-76ccf10a-e0b3-4441-a926-8ccb2ac6ae0c tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.041777 Oct 27 18:45:49.415544 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 138/302] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 18:45:49 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:49.429066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-893c1478-7e32-46e6-bfba-5a9d47135f69 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-73671862"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:49.433388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.aggregate [None req-893c1478-7e32-46e6-bfba-5a9d47135f69 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Generated uuid 218412f3-8322-4deb-a25c-5b94b787b0d5 for aggregate {{(pid=127028) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:49.479870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7909fddd-156f-484d-ba54-2c87145d6646 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:49.480124 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-893c1478-7e32-46e6-bfba-5a9d47135f69 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.056092 Oct 27 18:45:49.480655 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 139/303] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:49 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:49.493491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-94ab82e3-cb1f-48d7-8e66-9eff7f7b6b10 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-3"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:49.497142 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7909fddd-156f-484d-ba54-2c87145d6646 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 200 len: 1388 microversion: 2.1 time: 0.394618 Oct 27 18:45:49.498005 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 165/304] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:49 2022] GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 1388 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:49.521374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94ab82e3-cb1f-48d7-8e66-9eff7f7b6b10 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:49.521887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94ab82e3-cb1f-48d7-8e66-9eff7f7b6b10 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:49.522331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94ab82e3-cb1f-48d7-8e66-9eff7f7b6b10 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:49.560545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d4a2e3cd-b738-4c52-961b-16ebb23a7931 req-a2610ba7-51ff-439e-8581-988db7630192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ec313b-f165-450a-92ba-215e7989df1f", "tag": "887f62ff-9ca9-40b8-9c3d-8a4707bae8ce"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:49.577957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d4a2e3cd-b738-4c52-961b-16ebb23a7931 req-a2610ba7-51ff-439e-8581-988db7630192 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:49.580886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d4a2e3cd-b738-4c52-961b-16ebb23a7931 req-a2610ba7-51ff-439e-8581-988db7630192 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:49.581615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d4a2e3cd-b738-4c52-961b-16ebb23a7931 req-a2610ba7-51ff-439e-8581-988db7630192 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:49.601232 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d4a2e3cd-b738-4c52-961b-16ebb23a7931 req-a2610ba7-51ff-439e-8581-988db7630192 service nova] Creating event network-changed:887f62ff-9ca9-40b8-9c3d-8a4707bae8ce for instance c0ec313b-f165-450a-92ba-215e7989df1f on n-h1-860687-3 Oct 27 18:45:49.619294 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d4a2e3cd-b738-4c52-961b-16ebb23a7931 req-a2610ba7-51ff-439e-8581-988db7630192 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063067 Oct 27 18:45:49.625103 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 166/305] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:45:49.642549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0f4c4877-8a4b-450f-9d66-e384c99a21c8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:49.642775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0f4c4877-8a4b-450f-9d66-e384c99a21c8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:49.651924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4c4877-8a4b-450f-9d66-e384c99a21c8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:49.655047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4c4877-8a4b-450f-9d66-e384c99a21c8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:49.655423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4c4877-8a4b-450f-9d66-e384c99a21c8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:49.656146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4c4877-8a4b-450f-9d66-e384c99a21c8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:49.656725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4c4877-8a4b-450f-9d66-e384c99a21c8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:49.657127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4c4877-8a4b-450f-9d66-e384c99a21c8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:49.744897 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-94ab82e3-cb1f-48d7-8e66-9eff7f7b6b10 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 241 microversion: 2.1 time: 0.256066 Oct 27 18:45:49.745642 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 140/306] 10.222.0.42 () {60 vars in 1194 bytes} [Thu Oct 27 18:45:49 2022] POST /compute/v2.1/os-aggregates/13/action => generated 241 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:45:49.758495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-502cce94-a9f0-4842-a287-c58d840858ef tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-3"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:49.770961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-502cce94-a9f0-4842-a287-c58d840858ef tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:49.771788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-502cce94-a9f0-4842-a287-c58d840858ef tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:49.772451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-502cce94-a9f0-4842-a287-c58d840858ef tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:49.824002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0f4c4877-8a4b-450f-9d66-e384c99a21c8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:49.833558 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0f4c4877-8a4b-450f-9d66-e384c99a21c8 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1272 microversion: 2.1 time: 0.195912 Oct 27 18:45:49.849596 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 167/307] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:49 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1272 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:49.930766 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-502cce94-a9f0-4842-a287-c58d840858ef tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 226 microversion: 2.1 time: 0.176531 Oct 27 18:45:49.933206 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 141/308] 10.222.0.42 () {60 vars in 1194 bytes} [Thu Oct 27 18:45:49 2022] POST /compute/v2.1/os-aggregates/13/action => generated 226 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:45:49.945120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ec0b89da-32ed-4ffa-9d43-c4edcc932626 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:49.972598 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ec0b89da-32ed-4ffa-9d43-c4edcc932626 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.031127 Oct 27 18:45:49.973439 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 168/309] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 18:45:49 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:49.986505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-075a49fe-0efb-4025-bd06-6171009a7b3e tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-820745115"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:49.990287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.aggregate [None req-075a49fe-0efb-4025-bd06-6171009a7b3e tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Generated uuid b6325028-dcf0-4950-a16e-9790566e7eee for aggregate {{(pid=127028) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:50.018190 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-075a49fe-0efb-4025-bd06-6171009a7b3e tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038049 Oct 27 18:45:50.019476 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 142/310] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:50.032277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-39bc8663-6e51-47b0-b2b8-767a1b77bbe5 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.057103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-681e6745-410a-4522-83d7-b18caa02ffe5 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Calling method '.version_select at 0x7fc86bc12280>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.062265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-681e6745-410a-4522-83d7-b18caa02ffe5 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.063073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-681e6745-410a-4522-83d7-b18caa02ffe5 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.063779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-681e6745-410a-4522-83d7-b18caa02ffe5 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.064751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-681e6745-410a-4522-83d7-b18caa02ffe5 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.065447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-681e6745-410a-4522-83d7-b18caa02ffe5 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.066108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-681e6745-410a-4522-83d7-b18caa02ffe5 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.076937 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-39bc8663-6e51-47b0-b2b8-767a1b77bbe5 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.050015 Oct 27 18:45:50.078016 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 169/311] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 18:45:50 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 27 18:45:50.085657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-474b166a-8fec-40c9-98fa-ed842ef4d22b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.097335 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-474b166a-8fec-40c9-98fa-ed842ef4d22b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-474b166a-8fec-40c9-98fa-ed842ef4d22b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Request method failure captured: Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGsSW4iLKOGdu4iTF-AE9k6HIESOisYAQNJFBn5FyNrWSgdpXVItFpKl48TXC8ATQiotpLiMNlS8_UPUYR-BRqd1o0z5c8C1kw_RkJOkSKGkZA7rLivaA3krIgEKWhyLFOFH-Z22N0v9QOGR7z8XbvCMqC_rQ5IBthG9qTbn2I9tos Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: be5430fc49034e249835006a6f5a31d9 Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminTestJSON-910064282 Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:45:50.099481 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:45:50.101576 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/be5430fc49034e249835006a6f5a31d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be5430fc49034e249835006a6f5a31d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_be5430fc49034e249835006a6f5a31d9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be5430fc49034e249835006a6f5a31d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:50.101576 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminTestJSON-910064282 Oct 27 18:45:50.101576 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: be5430fc49034e249835006a6f5a31d9 Oct 27 18:45:50.101576 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-910064282 Oct 27 18:45:50.101576 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminTestJSON-910064282-project-admin Oct 27 18:45:50.101576 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:50.101576 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:50.101576 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ecf6731dd7e3491db8a5bc5e6f5917bd Oct 27 18:45:50.101576 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminTestJSON-910064282-project-admin Oct 27 18:45:50.101576 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:50.101576 n-d-860687-3 devstack@n-api.service[127029]: exception: Aggregate 14 could not be found. Oct 27 18:45:50.101576 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '14'} Oct 27 18:45:50.101576 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:50.102759 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 27 18:45:50.104063 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.106969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-474b166a-8fec-40c9-98fa-ed842ef4d22b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:50.108871 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-474b166a-8fec-40c9-98fa-ed842ef4d22b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.027136 Oct 27 18:45:50.112008 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-681e6745-410a-4522-83d7-b18caa02ffe5 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.056234 Oct 27 18:45:50.112008 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 143/312] 10.222.0.42 () {58 vars in 1128 bytes} [Thu Oct 27 18:45:50 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:50.116818 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 170/313] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:50 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:45:50.118576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-423f850b-cc52-4ba8-a43d-69d8d77da67f tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.119415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-423f850b-cc52-4ba8-a43d-69d8d77da67f tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:50.124945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af109432-6c53-45fc-9c11-51968ae4cb14 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Calling method '.version_select at 0x7fc86b9f1160>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.127367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-423f850b-cc52-4ba8-a43d-69d8d77da67f tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.127943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-423f850b-cc52-4ba8-a43d-69d8d77da67f tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.128605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-423f850b-cc52-4ba8-a43d-69d8d77da67f tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.130640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af109432-6c53-45fc-9c11-51968ae4cb14 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.131176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-423f850b-cc52-4ba8-a43d-69d8d77da67f tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.131457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af109432-6c53-45fc-9c11-51968ae4cb14 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.132040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-423f850b-cc52-4ba8-a43d-69d8d77da67f tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.132823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-423f850b-cc52-4ba8-a43d-69d8d77da67f tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.133614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af109432-6c53-45fc-9c11-51968ae4cb14 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.135322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af109432-6c53-45fc-9c11-51968ae4cb14 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.135857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af109432-6c53-45fc-9c11-51968ae4cb14 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.136293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af109432-6c53-45fc-9c11-51968ae4cb14 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.167481 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-af109432-6c53-45fc-9c11-51968ae4cb14 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.049139 Oct 27 18:45:50.168413 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 171/314] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 18:45:50 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:50.176073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-80a62137-3e14-42e2-851f-cbd7e4c45eff tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.191370 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-80a62137-3e14-42e2-851f-cbd7e4c45eff tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-80a62137-3e14-42e2-851f-cbd7e4c45eff tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Request method failure captured: Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGsSW4iLKOGdu4iTF-AE9k6HIESOisYAQNJFBn5FyNrWSgdpXVItFpKl48TXC8ATQiotpLiMNlS8_UPUYR-BRqd1o0z5c8C1kw_RkJOkSKGkZA7rLivaA3krIgEKWhyLFOFH-Z22N0v9QOGR7z8XbvCMqC_rQ5IBthG9qTbn2I9tos Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: be5430fc49034e249835006a6f5a31d9 Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminTestJSON-910064282 Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:45:50.193044 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:45:50.194231 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/be5430fc49034e249835006a6f5a31d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be5430fc49034e249835006a6f5a31d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_be5430fc49034e249835006a6f5a31d9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be5430fc49034e249835006a6f5a31d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:50.194231 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminTestJSON-910064282 Oct 27 18:45:50.194231 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: be5430fc49034e249835006a6f5a31d9 Oct 27 18:45:50.194231 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-910064282 Oct 27 18:45:50.194231 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminTestJSON-910064282-project-admin Oct 27 18:45:50.194231 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:50.194231 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:50.194231 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ecf6731dd7e3491db8a5bc5e6f5917bd Oct 27 18:45:50.194231 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminTestJSON-910064282-project-admin Oct 27 18:45:50.194231 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:50.194231 n-d-860687-3 devstack@n-api.service[127029]: exception: Aggregate 14 could not be found. Oct 27 18:45:50.194231 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '14'} Oct 27 18:45:50.194231 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:45:50.194950 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:50.196933 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:50.198016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:50.198016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:50.198016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:50.198016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 27 18:45:50.198016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.198016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-80a62137-3e14-42e2-851f-cbd7e4c45eff tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:50.198016 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-80a62137-3e14-42e2-851f-cbd7e4c45eff tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.022624 Oct 27 18:45:50.198016 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 172/315] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 18:45:50 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:45:50.201696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-17757cfe-074e-4f8d-9cbc-a3c1cd9f8e6f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.202328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-17757cfe-074e-4f8d-9cbc-a3c1cd9f8e6f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:50.208982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17757cfe-074e-4f8d-9cbc-a3c1cd9f8e6f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.209707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17757cfe-074e-4f8d-9cbc-a3c1cd9f8e6f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.210151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17757cfe-074e-4f8d-9cbc-a3c1cd9f8e6f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.210880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17757cfe-074e-4f8d-9cbc-a3c1cd9f8e6f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.211340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17757cfe-074e-4f8d-9cbc-a3c1cd9f8e6f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.211774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17757cfe-074e-4f8d-9cbc-a3c1cd9f8e6f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.276778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-423f850b-cc52-4ba8-a43d-69d8d77da67f tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:50.287034 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-423f850b-cc52-4ba8-a43d-69d8d77da67f tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1281 microversion: 2.1 time: 0.175011 Oct 27 18:45:50.289034 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 144/316] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:50 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1281 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:50.296081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5961d17b-354b-4b3b-bc39-66bc2df07e95 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Calling method '.version_select at 0x7fc86b840b80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.309086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5961d17b-354b-4b3b-bc39-66bc2df07e95 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.310577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5961d17b-354b-4b3b-bc39-66bc2df07e95 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.311188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5961d17b-354b-4b3b-bc39-66bc2df07e95 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.312119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5961d17b-354b-4b3b-bc39-66bc2df07e95 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.312578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5961d17b-354b-4b3b-bc39-66bc2df07e95 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.313170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5961d17b-354b-4b3b-bc39-66bc2df07e95 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.338875 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5961d17b-354b-4b3b-bc39-66bc2df07e95 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.048560 Oct 27 18:45:50.339731 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 145/317] 10.222.0.42 () {58 vars in 1128 bytes} [Thu Oct 27 18:45:50 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:50.344731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c6fcbc6b-3ab6-4d78-a47d-606c0f63f604 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-730163983", "name": "tempest-test_aggregate-1916643227"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:50.365928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.aggregate [None req-c6fcbc6b-3ab6-4d78-a47d-606c0f63f604 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Generated uuid 61f43ee1-3e67-457d-bc49-a74f485c3548 for aggregate {{(pid=127028) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:50.390615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-17757cfe-074e-4f8d-9cbc-a3c1cd9f8e6f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:50.397144 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c6fcbc6b-3ab6-4d78-a47d-606c0f63f604 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.055638 Oct 27 18:45:50.398475 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 146/318] 10.222.0.42 () {60 vars in 1165 bytes} [Thu Oct 27 18:45:50 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:50.399983 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-17757cfe-074e-4f8d-9cbc-a3c1cd9f8e6f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1319 microversion: 2.1 time: 0.204011 Oct 27 18:45:50.401010 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 173/319] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:50 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:50.406368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5009d4a4-fbf3-488b-9501-aaaa0337da23 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Calling method '.version_select at 0x7fc86b8404c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.408004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14a41907-d390-48cd-b2cf-4486cf3aba96 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.414695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5009d4a4-fbf3-488b-9501-aaaa0337da23 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.415219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5009d4a4-fbf3-488b-9501-aaaa0337da23 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.415921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5009d4a4-fbf3-488b-9501-aaaa0337da23 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.438680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5009d4a4-fbf3-488b-9501-aaaa0337da23 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.439773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5009d4a4-fbf3-488b-9501-aaaa0337da23 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.440905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5009d4a4-fbf3-488b-9501-aaaa0337da23 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.472681 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-14a41907-d390-48cd-b2cf-4486cf3aba96 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.068218 Oct 27 18:45:50.474833 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 174/320] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 18:45:50 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:50.485351 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5009d4a4-fbf3-488b-9501-aaaa0337da23 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-h1-860687-3" status: 200 len: 598 microversion: 2.1 time: 0.084226 Oct 27 18:45:50.486016 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 147/321] 10.222.0.42 () {58 vars in 1170 bytes} [Thu Oct 27 18:45:50 2022] GET /compute/v2.1/os-hosts/n-h1-860687-3 => generated 598 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:50.487919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-15090f3c-e29b-41a3-b1b7-467f5910a8c5 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.498690 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-15090f3c-e29b-41a3-b1b7-467f5910a8c5 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-15090f3c-e29b-41a3-b1b7-467f5910a8c5 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Request method failure captured: Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGsSW4iLKOGdu4iTF-AE9k6HIESOisYAQNJFBn5FyNrWSgdpXVItFpKl48TXC8ATQiotpLiMNlS8_UPUYR-BRqd1o0z5c8C1kw_RkJOkSKGkZA7rLivaA3krIgEKWhyLFOFH-Z22N0v9QOGR7z8XbvCMqC_rQ5IBthG9qTbn2I9tos Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: be5430fc49034e249835006a6f5a31d9 Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminTestJSON-910064282 Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:45:50.500463 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:45:50.501657 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/be5430fc49034e249835006a6f5a31d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be5430fc49034e249835006a6f5a31d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_be5430fc49034e249835006a6f5a31d9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be5430fc49034e249835006a6f5a31d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:50.501657 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminTestJSON-910064282 Oct 27 18:45:50.501657 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: be5430fc49034e249835006a6f5a31d9 Oct 27 18:45:50.501657 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-910064282 Oct 27 18:45:50.501657 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminTestJSON-910064282-project-admin Oct 27 18:45:50.501657 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:50.501657 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:50.501657 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ecf6731dd7e3491db8a5bc5e6f5917bd Oct 27 18:45:50.501657 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminTestJSON-910064282-project-admin Oct 27 18:45:50.501657 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:50.501657 n-d-860687-3 devstack@n-api.service[127029]: exception: Aggregate 15 could not be found. Oct 27 18:45:50.501657 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '15'} Oct 27 18:45:50.501657 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:50.502343 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Oct 27 18:45:50.503469 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.505946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-15090f3c-e29b-41a3-b1b7-467f5910a8c5 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:50.505946 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-15090f3c-e29b-41a3-b1b7-467f5910a8c5 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.022322 Oct 27 18:45:50.506940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-76a97b2f-21e7-4c72-8a57-1f520fc965d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Calling method '.version_select at 0x7fc86ba948b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.507606 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 175/322] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:50 2022] GET /compute/v2.1/os-aggregates/15 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:45:50.515732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2ee58511-4a73-44a0-b05a-018a70b8966a tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.529192 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-2ee58511-4a73-44a0-b05a-018a70b8966a tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2ee58511-4a73-44a0-b05a-018a70b8966a tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Request method failure captured: Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGsSW4iLKOGdu4iTF-AE9k6HIESOisYAQNJFBn5FyNrWSgdpXVItFpKl48TXC8ATQiotpLiMNlS8_UPUYR-BRqd1o0z5c8C1kw_RkJOkSKGkZA7rLivaA3krIgEKWhyLFOFH-Z22N0v9QOGR7z8XbvCMqC_rQ5IBthG9qTbn2I9tos Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: be5430fc49034e249835006a6f5a31d9 Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AggregatesAdminTestJSON-910064282 Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:45:50.531309 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:45:50.532701 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/be5430fc49034e249835006a6f5a31d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be5430fc49034e249835006a6f5a31d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_be5430fc49034e249835006a6f5a31d9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be5430fc49034e249835006a6f5a31d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:50.532701 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AggregatesAdminTestJSON-910064282 Oct 27 18:45:50.532701 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: be5430fc49034e249835006a6f5a31d9 Oct 27 18:45:50.532701 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-910064282 Oct 27 18:45:50.532701 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AggregatesAdminTestJSON-910064282-project-admin Oct 27 18:45:50.532701 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:45:50.532701 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:45:50.532701 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ecf6731dd7e3491db8a5bc5e6f5917bd Oct 27 18:45:50.532701 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AggregatesAdminTestJSON-910064282-project-admin Oct 27 18:45:50.532701 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:45:50.532701 n-d-860687-3 devstack@n-api.service[127029]: exception: Aggregate 15 could not be found. Oct 27 18:45:50.532701 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '15'} Oct 27 18:45:50.532701 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:45:50.533512 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:50.534811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:50.536147 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:50.536147 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:50.536147 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:50.536147 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Oct 27 18:45:50.536147 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:45:50.538176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2ee58511-4a73-44a0-b05a-018a70b8966a tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:50.539302 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2ee58511-4a73-44a0-b05a-018a70b8966a tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.030278 Oct 27 18:45:50.540933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76a97b2f-21e7-4c72-8a57-1f520fc965d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.542094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76a97b2f-21e7-4c72-8a57-1f520fc965d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.543425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76a97b2f-21e7-4c72-8a57-1f520fc965d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.545432 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 176/323] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 18:45:50 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:45:50.551856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dcd42d9d-edfb-48f5-b5d3-f2a2456ac809 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.551856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dcd42d9d-edfb-48f5-b5d3-f2a2456ac809 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:50.570821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcd42d9d-edfb-48f5-b5d3-f2a2456ac809 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.571323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcd42d9d-edfb-48f5-b5d3-f2a2456ac809 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.571949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcd42d9d-edfb-48f5-b5d3-f2a2456ac809 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.572846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcd42d9d-edfb-48f5-b5d3-f2a2456ac809 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.573456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcd42d9d-edfb-48f5-b5d3-f2a2456ac809 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.574041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcd42d9d-edfb-48f5-b5d3-f2a2456ac809 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.592324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=88,nova_api:DELETE=5 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:50.596158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76a97b2f-21e7-4c72-8a57-1f520fc965d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.599476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76a97b2f-21e7-4c72-8a57-1f520fc965d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.600292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76a97b2f-21e7-4c72-8a57-1f520fc965d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.725880 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-76a97b2f-21e7-4c72-8a57-1f520fc965d2 tempest-HostsAdminTestJSON-652603063 tempest-HostsAdminTestJSON-652603063-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-h2-860687-3" status: 200 len: 598 microversion: 2.1 time: 0.230435 Oct 27 18:45:50.738615 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 148/324] 10.222.0.42 () {58 vars in 1170 bytes} [Thu Oct 27 18:45:50 2022] GET /compute/v2.1/os-hosts/n-h2-860687-3 => generated 598 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:50.751874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b1d820d1-5c3e-44d5-bd91-2542c186c257 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1392403450"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:50.761450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.aggregate [None req-b1d820d1-5c3e-44d5-bd91-2542c186c257 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Generated uuid 6dabdd7d-655a-469b-8a64-d458b9646bf0 for aggregate {{(pid=127028) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:50.776803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dcd42d9d-edfb-48f5-b5d3-f2a2456ac809 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:50.787617 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dcd42d9d-edfb-48f5-b5d3-f2a2456ac809 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 200 len: 1388 microversion: 2.1 time: 0.240866 Oct 27 18:45:50.788923 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 177/325] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:50 2022] GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 1388 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:50.805802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-46fa0fe9-ccc0-47b0-afb8-2ff77bc12bb0 req-51cf8117-55cd-43c4-9eef-003cc1a85c35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20197946-daa3-44ae-9c98-e9ba238df184", "tag": "d9b04de2-1137-4c7c-82dd-5120635edab6"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:50.817682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-46fa0fe9-ccc0-47b0-afb8-2ff77bc12bb0 req-51cf8117-55cd-43c4-9eef-003cc1a85c35 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.819345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-46fa0fe9-ccc0-47b0-afb8-2ff77bc12bb0 req-51cf8117-55cd-43c4-9eef-003cc1a85c35 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.819771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-46fa0fe9-ccc0-47b0-afb8-2ff77bc12bb0 req-51cf8117-55cd-43c4-9eef-003cc1a85c35 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.856750 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b1d820d1-5c3e-44d5-bd91-2542c186c257 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.113716 Oct 27 18:45:50.858213 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 149/326] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:50.867343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-308a9cae-1e09-430f-b0da-8ff6f4016fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.868295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-308a9cae-1e09-430f-b0da-8ff6f4016fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:50.873376 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-46fa0fe9-ccc0-47b0-afb8-2ff77bc12bb0 req-51cf8117-55cd-43c4-9eef-003cc1a85c35 service nova] Creating event network-changed:d9b04de2-1137-4c7c-82dd-5120635edab6 for instance 20197946-daa3-44ae-9c98-e9ba238df184 on n-h1-860687-3 Oct 27 18:45:50.876275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-308a9cae-1e09-430f-b0da-8ff6f4016fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.877248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-308a9cae-1e09-430f-b0da-8ff6f4016fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.877984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-308a9cae-1e09-430f-b0da-8ff6f4016fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.879674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-308a9cae-1e09-430f-b0da-8ff6f4016fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:50.880794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-308a9cae-1e09-430f-b0da-8ff6f4016fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:50.881569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-308a9cae-1e09-430f-b0da-8ff6f4016fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:50.891554 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-46fa0fe9-ccc0-47b0-afb8-2ff77bc12bb0 req-51cf8117-55cd-43c4-9eef-003cc1a85c35 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101144 Oct 27 18:45:50.894692 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 178/327] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:50.900982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ef0cad42-888d-4fe2-a8ff-27714a646079 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:50.915204 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ef0cad42-888d-4fe2-a8ff-27714a646079 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.019250 Oct 27 18:45:50.916241 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 179/328] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:50 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:50.935853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-16cbb4e8-21b1-47dd-b70f-1bb7c26ecff8 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:50.986496 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-16cbb4e8-21b1-47dd-b70f-1bb7c26ecff8 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.054571 Oct 27 18:45:50.988462 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 180/329] 10.222.0.42 () {60 vars in 1194 bytes} [Thu Oct 27 18:45:50 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:51.001298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1dd0b7b5-3176-4c91-8138-044a65a2dbda tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:51.013193 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1dd0b7b5-3176-4c91-8138-044a65a2dbda tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.015406 Oct 27 18:45:51.020662 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 181/330] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:45:50 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:51.028473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f7455761-9634-494d-a6d8-324522d4c8e2 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:51.090586 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f7455761-9634-494d-a6d8-324522d4c8e2 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.066927 Oct 27 18:45:51.091364 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 182/331] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 18:45:51 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:51.103637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f9d91ca2-b1ec-497b-b15d-bf7e79a20141 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-621484171", "availability_zone": "tempest-test_az-1621636068"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:51.109645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.aggregate [None req-f9d91ca2-b1ec-497b-b15d-bf7e79a20141 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Generated uuid b51d9011-50f0-4db9-8636-54ebdb8fe928 for aggregate {{(pid=127029) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:51.149060 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f9d91ca2-b1ec-497b-b15d-bf7e79a20141 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.049922 Oct 27 18:45:51.150611 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 183/332] 10.222.0.42 () {60 vars in 1165 bytes} [Thu Oct 27 18:45:51 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:51.164292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-084a51b6-65f5-4892-8896-02b9886cd59b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-621484171_new", "availability_zone": "tempest-test_az-1621636068_new"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:51.221467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-084a51b6-65f5-4892-8896-02b9886cd59b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:51.222514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-084a51b6-65f5-4892-8896-02b9886cd59b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:51.223262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-084a51b6-65f5-4892-8896-02b9886cd59b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:51.315860 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-084a51b6-65f5-4892-8896-02b9886cd59b tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.156139 Oct 27 18:45:51.323082 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 184/333] 10.222.0.42 () {60 vars in 1173 bytes} [Thu Oct 27 18:45:51 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:51.326048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9b6e9149-e97b-450c-bae5-99dcd676ceed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:51.327045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9b6e9149-e97b-450c-bae5-99dcd676ceed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:51.337195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b6e9149-e97b-450c-bae5-99dcd676ceed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:51.337837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b6e9149-e97b-450c-bae5-99dcd676ceed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:51.338896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b6e9149-e97b-450c-bae5-99dcd676ceed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:51.339654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b6e9149-e97b-450c-bae5-99dcd676ceed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:51.340131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b6e9149-e97b-450c-bae5-99dcd676ceed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:51.341644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b6e9149-e97b-450c-bae5-99dcd676ceed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:51.357091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-308a9cae-1e09-430f-b0da-8ff6f4016fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:51.370865 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-308a9cae-1e09-430f-b0da-8ff6f4016fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1272 microversion: 2.1 time: 0.509235 Oct 27 18:45:51.375008 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 150/334] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:50 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1272 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:51.386217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-54fb3349-aaf7-4f68-83b3-c352efd569e8 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:51.427434 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-54fb3349-aaf7-4f68-83b3-c352efd569e8 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.049872 Oct 27 18:45:51.428772 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 151/335] 10.222.0.42 () {58 vars in 1143 bytes} [Thu Oct 27 18:45:51 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:51.434249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fd621478-f4ab-4135-af28-b04623b46b0b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:51.436829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fd621478-f4ab-4135-af28-b04623b46b0b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:51.448899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd621478-f4ab-4135-af28-b04623b46b0b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:51.449841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd621478-f4ab-4135-af28-b04623b46b0b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:51.452762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd621478-f4ab-4135-af28-b04623b46b0b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:51.454419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd621478-f4ab-4135-af28-b04623b46b0b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:51.455826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd621478-f4ab-4135-af28-b04623b46b0b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:51.457145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd621478-f4ab-4135-af28-b04623b46b0b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:52.024490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd621478-f4ab-4135-af28-b04623b46b0b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:52.076733 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fd621478-f4ab-4135-af28-b04623b46b0b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1319 microversion: 2.1 time: 0.644169 Oct 27 18:45:52.093301 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 152/336] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:51 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1319 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:52.132003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-32481044-7ed2-48d9-9c85-e8f03c15ed23 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:52.195735 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-32481044-7ed2-48d9-9c85-e8f03c15ed23 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.093066 Oct 27 18:45:52.196416 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 153/337] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 18:45:52 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:52.209637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8b5e5594-d8be-45c5-9a19-f99d9b7536df tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:52.210274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8b5e5594-d8be-45c5-9a19-f99d9b7536df tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:52.226520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b5e5594-d8be-45c5-9a19-f99d9b7536df tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:52.227175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b5e5594-d8be-45c5-9a19-f99d9b7536df tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:52.228991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b5e5594-d8be-45c5-9a19-f99d9b7536df tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:52.229786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b5e5594-d8be-45c5-9a19-f99d9b7536df tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:52.231294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b5e5594-d8be-45c5-9a19-f99d9b7536df tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:52.233439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b5e5594-d8be-45c5-9a19-f99d9b7536df tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:52.271613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:52.301399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9b6e9149-e97b-450c-bae5-99dcd676ceed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:52.317176 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9b6e9149-e97b-450c-bae5-99dcd676ceed tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1323 microversion: 2.1 time: 0.998891 Oct 27 18:45:52.321064 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 185/338] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:51 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1323 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:52.330205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aaa0749f-6e65-43e5-9180-be7516ae5da9 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-325278289"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:52.337116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.aggregate [None req-aaa0749f-6e65-43e5-9180-be7516ae5da9 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Generated uuid 6348cf6e-0d13-4c74-bb89-6c22987b5b6f for aggregate {{(pid=127029) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 18:45:52.358282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:DELETE=10,nova_api:UPDATE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:52.382034 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aaa0749f-6e65-43e5-9180-be7516ae5da9 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058287 Oct 27 18:45:52.393769 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 186/339] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 18:45:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:52.399286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4ce3a695-0b56-496b-862a-5a6bdaeac6b1 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:52.412802 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4ce3a695-0b56-496b-862a-5a6bdaeac6b1 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.017082 Oct 27 18:45:52.413385 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 187/340] 10.222.0.42 () {58 vars in 1143 bytes} [Thu Oct 27 18:45:52 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:52.433328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a3efe144-0207-427d-b5a8-d98033db30bd tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:52.434517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a3efe144-0207-427d-b5a8-d98033db30bd tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:52.447679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3efe144-0207-427d-b5a8-d98033db30bd tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:52.448168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3efe144-0207-427d-b5a8-d98033db30bd tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:52.448841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3efe144-0207-427d-b5a8-d98033db30bd tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:52.449759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3efe144-0207-427d-b5a8-d98033db30bd tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:52.451662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3efe144-0207-427d-b5a8-d98033db30bd tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:52.453256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3efe144-0207-427d-b5a8-d98033db30bd tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:52.835339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8b5e5594-d8be-45c5-9a19-f99d9b7536df tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:52.844164 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8b5e5594-d8be-45c5-9a19-f99d9b7536df tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 200 len: 1388 microversion: 2.1 time: 0.646541 Oct 27 18:45:52.859115 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 154/341] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:52 2022] GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 1388 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:52.866075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-59fafb86-e18a-4954-a54b-fe7fcdc38271 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:52.901140 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-59fafb86-e18a-4954-a54b-fe7fcdc38271 tempest-AggregatesAdminTestJSON-910064282 tempest-AggregatesAdminTestJSON-910064282-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.040622 Oct 27 18:45:52.901817 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 155/342] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 18:45:52 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 18:45:52.913270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-92777d1b-5c0c-4027-9071-4d8a9099616d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:52.914075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-92777d1b-5c0c-4027-9071-4d8a9099616d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:52.923555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92777d1b-5c0c-4027-9071-4d8a9099616d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:52.924435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92777d1b-5c0c-4027-9071-4d8a9099616d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:52.925247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92777d1b-5c0c-4027-9071-4d8a9099616d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:52.926062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92777d1b-5c0c-4027-9071-4d8a9099616d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:52.926656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92777d1b-5c0c-4027-9071-4d8a9099616d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:52.927189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92777d1b-5c0c-4027-9071-4d8a9099616d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:52.944057 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-92777d1b-5c0c-4027-9071-4d8a9099616d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] HTTP exception thrown: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-92777d1b-5c0c-4027-9071-4d8a9099616d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Request method failure captured: Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 HTTP/1.1 Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGpN1ir0UxaLDomtg8TLKp5aav2lRh0r39PGGpqI2ykZpGcUOf0Iahk1bI8fB_PPTC_8mqXY196u9WhwCb5bAZvyJJcgEfS-TifDDG8MghZrV1EueD-aCjjFMcYD6x_BPPZXwrxtz1_yHtbyI044TLCIo0JhUuWdLB_4RUlk1byTOY Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: cdb1ba9cb5644deeb4c2009add788a01 Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AggregatesAdminTestJSON-223616936 Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:45:52.953637 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:45:52.955115 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cdb1ba9cb5644deeb4c2009add788a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdb1ba9cb5644deeb4c2009add788a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cdb1ba9cb5644deeb4c2009add788a01", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdb1ba9cb5644deeb4c2009add788a01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:52.955115 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AggregatesAdminTestJSON-223616936 Oct 27 18:45:52.955115 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: cdb1ba9cb5644deeb4c2009add788a01 Oct 27 18:45:52.955115 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-223616936 Oct 27 18:45:52.955115 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AggregatesAdminTestJSON-223616936-project Oct 27 18:45:52.955115 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:52.955115 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:52.955115 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: efa7fd186f2747628701e834fac1b8b0 Oct 27 18:45:52.955115 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AggregatesAdminTestJSON-223616936-project Oct 27 18:45:52.955115 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:52.955115 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:52.955115 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'e6a3f842-fb4c-4973-a787-b1e84ba6ae88'} Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:52.955968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:52.957286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:52.959320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-92777d1b-5c0c-4027-9071-4d8a9099616d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Returning 404 to user: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:52.960331 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-92777d1b-5c0c-4027-9071-4d8a9099616d tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 404 len: 111 microversion: 2.1 time: 0.051494 Oct 27 18:45:52.961914 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 156/343] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:45:52 2022] DELETE /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:52.971391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7eeb5940-b2f2-45f7-9c69-c03d4e5ce2a8 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:52.972178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7eeb5940-b2f2-45f7-9c69-c03d4e5ce2a8 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] [instance: e6a3f842-fb4c-4973-a787-b1e84ba6ae88] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:52.978339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7eeb5940-b2f2-45f7-9c69-c03d4e5ce2a8 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:52.979003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7eeb5940-b2f2-45f7-9c69-c03d4e5ce2a8 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:52.979544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7eeb5940-b2f2-45f7-9c69-c03d4e5ce2a8 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:52.980350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7eeb5940-b2f2-45f7-9c69-c03d4e5ce2a8 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:52.980911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7eeb5940-b2f2-45f7-9c69-c03d4e5ce2a8 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:52.981566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7eeb5940-b2f2-45f7-9c69-c03d4e5ce2a8 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:53.003381 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-7eeb5940-b2f2-45f7-9c69-c03d4e5ce2a8 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] HTTP exception thrown: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7eeb5940-b2f2-45f7-9c69-c03d4e5ce2a8 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Request method failure captured: Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 HTTP/1.1 Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGpN1ir0UxaLDomtg8TLKp5aav2lRh0r39PGGpqI2ykZpGcUOf0Iahk1bI8fB_PPTC_8mqXY196u9WhwCb5bAZvyJJcgEfS-TifDDG8MghZrV1EueD-aCjjFMcYD6x_BPPZXwrxtz1_yHtbyI044TLCIo0JhUuWdLB_4RUlk1byTOY Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: cdb1ba9cb5644deeb4c2009add788a01 Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AggregatesAdminTestJSON-223616936 Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:45:53.008245 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:45:53.009607 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cdb1ba9cb5644deeb4c2009add788a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdb1ba9cb5644deeb4c2009add788a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cdb1ba9cb5644deeb4c2009add788a01", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdb1ba9cb5644deeb4c2009add788a01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:45:53.009607 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AggregatesAdminTestJSON-223616936 Oct 27 18:45:53.009607 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: cdb1ba9cb5644deeb4c2009add788a01 Oct 27 18:45:53.009607 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-223616936 Oct 27 18:45:53.009607 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AggregatesAdminTestJSON-223616936-project Oct 27 18:45:53.009607 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:45:53.009607 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:45:53.009607 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: efa7fd186f2747628701e834fac1b8b0 Oct 27 18:45:53.009607 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AggregatesAdminTestJSON-223616936-project Oct 27 18:45:53.009607 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:45:53.009607 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:53.009607 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'e6a3f842-fb4c-4973-a787-b1e84ba6ae88'} Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:45:53.010325 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. Oct 27 18:45:53.011464 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:45:53.012408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7eeb5940-b2f2-45f7-9c69-c03d4e5ce2a8 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] Returning 404 to user: Instance e6a3f842-fb4c-4973-a787-b1e84ba6ae88 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:45:53.012408 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7eeb5940-b2f2-45f7-9c69-c03d4e5ce2a8 tempest-AggregatesAdminTestJSON-223616936 tempest-AggregatesAdminTestJSON-223616936-project] 10.222.0.42 "GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88" status: 404 len: 111 microversion: 2.1 time: 0.045033 Oct 27 18:45:53.014719 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 157/344] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:52 2022] GET /compute/v2.1/servers/e6a3f842-fb4c-4973-a787-b1e84ba6ae88 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:45:53.119305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-25dac2ec-b503-46f9-b808-c1ad92e1ea20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:53.120861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-25dac2ec-b503-46f9-b808-c1ad92e1ea20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:53.124277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a3efe144-0207-427d-b5a8-d98033db30bd tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:53.132927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25dac2ec-b503-46f9-b808-c1ad92e1ea20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:53.133522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25dac2ec-b503-46f9-b808-c1ad92e1ea20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:53.133987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25dac2ec-b503-46f9-b808-c1ad92e1ea20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:53.136736 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a3efe144-0207-427d-b5a8-d98033db30bd tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1314 microversion: 2.1 time: 0.706591 Oct 27 18:45:53.137060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25dac2ec-b503-46f9-b808-c1ad92e1ea20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:53.138984 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 188/345] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:52 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:53.143174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25dac2ec-b503-46f9-b808-c1ad92e1ea20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:53.144065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25dac2ec-b503-46f9-b808-c1ad92e1ea20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:53.350622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0dc862d1-d095-40d4-8dd0-18b269943a03 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:53.352039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0dc862d1-d095-40d4-8dd0-18b269943a03 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:53.370727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dc862d1-d095-40d4-8dd0-18b269943a03 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:53.371774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dc862d1-d095-40d4-8dd0-18b269943a03 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:53.372750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dc862d1-d095-40d4-8dd0-18b269943a03 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:53.373718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dc862d1-d095-40d4-8dd0-18b269943a03 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:53.374769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dc862d1-d095-40d4-8dd0-18b269943a03 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:53.376067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dc862d1-d095-40d4-8dd0-18b269943a03 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:53.576790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-25dac2ec-b503-46f9-b808-c1ad92e1ea20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:53.592045 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-25dac2ec-b503-46f9-b808-c1ad92e1ea20 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1319 microversion: 2.1 time: 0.473287 Oct 27 18:45:53.592690 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 158/346] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:53 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1319 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:53.699652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-2f00cd15-d46f-48e4-a339-e17ef7a5205d req-8c64decc-4d87-4fc3-82cb-3bd624419d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d432d309-21c5-4225-9d63-b988bc43c2dc", "tag": "a10d0d4c-7a3f-4a82-86b4-28517b22b876"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:53.766778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2f00cd15-d46f-48e4-a339-e17ef7a5205d req-8c64decc-4d87-4fc3-82cb-3bd624419d5b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:53.773135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2f00cd15-d46f-48e4-a339-e17ef7a5205d req-8c64decc-4d87-4fc3-82cb-3bd624419d5b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:53.774343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2f00cd15-d46f-48e4-a339-e17ef7a5205d req-8c64decc-4d87-4fc3-82cb-3bd624419d5b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:53.802747 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-2f00cd15-d46f-48e4-a339-e17ef7a5205d req-8c64decc-4d87-4fc3-82cb-3bd624419d5b service nova] Creating event network-changed:a10d0d4c-7a3f-4a82-86b4-28517b22b876 for instance d432d309-21c5-4225-9d63-b988bc43c2dc on n-h2-860687-3 Oct 27 18:45:53.813345 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-2f00cd15-d46f-48e4-a339-e17ef7a5205d req-8c64decc-4d87-4fc3-82cb-3bd624419d5b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118427 Oct 27 18:45:53.814933 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 159/347] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:53.881356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1590409b-536c-4d5a-9a92-7a8f44450ad4 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:53.883165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1590409b-536c-4d5a-9a92-7a8f44450ad4 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:53.901814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1590409b-536c-4d5a-9a92-7a8f44450ad4 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:53.902831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1590409b-536c-4d5a-9a92-7a8f44450ad4 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:53.903709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1590409b-536c-4d5a-9a92-7a8f44450ad4 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:53.904807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1590409b-536c-4d5a-9a92-7a8f44450ad4 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:53.905491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1590409b-536c-4d5a-9a92-7a8f44450ad4 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:53.906404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1590409b-536c-4d5a-9a92-7a8f44450ad4 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:54.349166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0dc862d1-d095-40d4-8dd0-18b269943a03 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:54.362665 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0dc862d1-d095-40d4-8dd0-18b269943a03 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1323 microversion: 2.1 time: 1.017391 Oct 27 18:45:54.375136 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 189/348] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:53 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1323 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:54.402471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4e7e720f-1d90-4012-9c74-da1f4b6e593f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:54.403839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4e7e720f-1d90-4012-9c74-da1f4b6e593f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:54.422719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e7e720f-1d90-4012-9c74-da1f4b6e593f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:54.428100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e7e720f-1d90-4012-9c74-da1f4b6e593f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:54.436101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e7e720f-1d90-4012-9c74-da1f4b6e593f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:54.437108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e7e720f-1d90-4012-9c74-da1f4b6e593f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:54.437742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e7e720f-1d90-4012-9c74-da1f4b6e593f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:54.438880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e7e720f-1d90-4012-9c74-da1f4b6e593f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:54.917718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1590409b-536c-4d5a-9a92-7a8f44450ad4 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:54.934067 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1590409b-536c-4d5a-9a92-7a8f44450ad4 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 200 len: 1388 microversion: 2.1 time: 1.065195 Oct 27 18:45:54.935257 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 160/349] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:53 2022] GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 1388 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:54.947099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4e7e720f-1d90-4012-9c74-da1f4b6e593f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:54.958076 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4e7e720f-1d90-4012-9c74-da1f4b6e593f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1314 microversion: 2.1 time: 0.581481 Oct 27 18:45:54.961472 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 190/350] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:54 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:54.969549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b5a3efd-9c63-4588-b1dc-707cb187c89d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:54.971029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6b5a3efd-9c63-4588-b1dc-707cb187c89d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:54.985211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b5a3efd-9c63-4588-b1dc-707cb187c89d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:54.986065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b5a3efd-9c63-4588-b1dc-707cb187c89d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:54.988358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b5a3efd-9c63-4588-b1dc-707cb187c89d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:54.992146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b5a3efd-9c63-4588-b1dc-707cb187c89d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:54.992848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b5a3efd-9c63-4588-b1dc-707cb187c89d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:54.993469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b5a3efd-9c63-4588-b1dc-707cb187c89d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:55.248309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=22 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:55.391813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8201c978-032e-433a-a7fd-a75a6eaacfc4 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:55.392620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8201c978-032e-433a-a7fd-a75a6eaacfc4 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:55.411730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8201c978-032e-433a-a7fd-a75a6eaacfc4 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:55.412410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8201c978-032e-433a-a7fd-a75a6eaacfc4 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:55.413036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8201c978-032e-433a-a7fd-a75a6eaacfc4 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:55.414108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8201c978-032e-433a-a7fd-a75a6eaacfc4 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:55.414976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8201c978-032e-433a-a7fd-a75a6eaacfc4 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:55.415985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8201c978-032e-433a-a7fd-a75a6eaacfc4 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:55.759615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6b5a3efd-9c63-4588-b1dc-707cb187c89d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:55.768966 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b5a3efd-9c63-4588-b1dc-707cb187c89d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1319 microversion: 2.1 time: 0.819858 Oct 27 18:45:55.783988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=14 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:55.786591 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 161/351] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:54 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1319 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:55.864714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-08d5dbf1-901c-4e06-8d39-bc4f280081f6 req-77319a1c-6095-4b5b-8979-8c0c821a8391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d71f0172-5c69-42a1-bb37-d0511f852211", "tag": "3545f586-170a-4011-93a6-4288e4a5de64"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:55.884474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-08d5dbf1-901c-4e06-8d39-bc4f280081f6 req-77319a1c-6095-4b5b-8979-8c0c821a8391 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:55.885455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-08d5dbf1-901c-4e06-8d39-bc4f280081f6 req-77319a1c-6095-4b5b-8979-8c0c821a8391 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:55.888763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-08d5dbf1-901c-4e06-8d39-bc4f280081f6 req-77319a1c-6095-4b5b-8979-8c0c821a8391 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:55.901739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8201c978-032e-433a-a7fd-a75a6eaacfc4 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:55.919992 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8201c978-032e-433a-a7fd-a75a6eaacfc4 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1323 microversion: 2.1 time: 0.533458 Oct 27 18:45:55.939783 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 191/352] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:55 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1323 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:55.941319 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-08d5dbf1-901c-4e06-8d39-bc4f280081f6 req-77319a1c-6095-4b5b-8979-8c0c821a8391 service nova] Creating event network-changed:3545f586-170a-4011-93a6-4288e4a5de64 for instance d71f0172-5c69-42a1-bb37-d0511f852211 on n-h2-860687-3 Oct 27 18:45:55.947457 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-08d5dbf1-901c-4e06-8d39-bc4f280081f6 req-77319a1c-6095-4b5b-8979-8c0c821a8391 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086218 Oct 27 18:45:55.948399 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 162/353] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:45:55.962896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-114b6ac8-ae9f-42a5-9591-927ac4ca4c28 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:55.963895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-114b6ac8-ae9f-42a5-9591-927ac4ca4c28 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:55.978439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-114b6ac8-ae9f-42a5-9591-927ac4ca4c28 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:55.981831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-114b6ac8-ae9f-42a5-9591-927ac4ca4c28 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:55.984208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-114b6ac8-ae9f-42a5-9591-927ac4ca4c28 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:55.986780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-114b6ac8-ae9f-42a5-9591-927ac4ca4c28 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:55.986939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cce5b8e7-2872-4de5-89be-25e924ad3cd3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:55.988578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cce5b8e7-2872-4de5-89be-25e924ad3cd3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:55.989055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-114b6ac8-ae9f-42a5-9591-927ac4ca4c28 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:55.991000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-114b6ac8-ae9f-42a5-9591-927ac4ca4c28 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:56.005844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cce5b8e7-2872-4de5-89be-25e924ad3cd3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:56.006374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cce5b8e7-2872-4de5-89be-25e924ad3cd3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:56.010215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cce5b8e7-2872-4de5-89be-25e924ad3cd3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:56.011076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cce5b8e7-2872-4de5-89be-25e924ad3cd3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:56.015757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cce5b8e7-2872-4de5-89be-25e924ad3cd3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:56.016213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cce5b8e7-2872-4de5-89be-25e924ad3cd3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:56.307328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-114b6ac8-ae9f-42a5-9591-927ac4ca4c28 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:56.315843 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-114b6ac8-ae9f-42a5-9591-927ac4ca4c28 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 200 len: 1388 microversion: 2.1 time: 0.357652 Oct 27 18:45:56.316422 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 192/354] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:55 2022] GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 1388 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:56.436094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cce5b8e7-2872-4de5-89be-25e924ad3cd3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:56.460415 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cce5b8e7-2872-4de5-89be-25e924ad3cd3 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1314 microversion: 2.1 time: 0.476685 Oct 27 18:45:56.462564 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 163/355] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:55 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:56.506735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-f2ae147f-4261-4a6d-993d-a998d06d39e3 req-ee8474c7-1548-48c6-80c9-0c7daa734c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ec313b-f165-450a-92ba-215e7989df1f", "name": "network-vif-plugged", "status": "completed", "tag": "887f62ff-9ca9-40b8-9c3d-8a4707bae8ce"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:45:56.547933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f2ae147f-4261-4a6d-993d-a998d06d39e3 req-ee8474c7-1548-48c6-80c9-0c7daa734c62 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:56.548788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f2ae147f-4261-4a6d-993d-a998d06d39e3 req-ee8474c7-1548-48c6-80c9-0c7daa734c62 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:56.550586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f2ae147f-4261-4a6d-993d-a998d06d39e3 req-ee8474c7-1548-48c6-80c9-0c7daa734c62 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:56.577401 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-f2ae147f-4261-4a6d-993d-a998d06d39e3 req-ee8474c7-1548-48c6-80c9-0c7daa734c62 service nova] Creating event network-vif-plugged:887f62ff-9ca9-40b8-9c3d-8a4707bae8ce for instance c0ec313b-f165-450a-92ba-215e7989df1f on n-h1-860687-3 Oct 27 18:45:56.594594 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-f2ae147f-4261-4a6d-993d-a998d06d39e3 req-ee8474c7-1548-48c6-80c9-0c7daa734c62 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087065 Oct 27 18:45:56.597698 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 193/356] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:56.793409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-07076708-ed71-4775-8d70-e583eb09495f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:56.795049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-07076708-ed71-4775-8d70-e583eb09495f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:56.803535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07076708-ed71-4775-8d70-e583eb09495f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:56.805213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07076708-ed71-4775-8d70-e583eb09495f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:56.805852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07076708-ed71-4775-8d70-e583eb09495f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:56.806858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07076708-ed71-4775-8d70-e583eb09495f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:56.807399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07076708-ed71-4775-8d70-e583eb09495f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:56.808016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07076708-ed71-4775-8d70-e583eb09495f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:56.844760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:45:56.929792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-afe278d1-e90d-4564-bc6f-076815c2fbf1 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Calling method '.version_select at 0x7fc86b80aca0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:56.932414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afe278d1-e90d-4564-bc6f-076815c2fbf1 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:56.933246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afe278d1-e90d-4564-bc6f-076815c2fbf1 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:56.933681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afe278d1-e90d-4564-bc6f-076815c2fbf1 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:56.966610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afe278d1-e90d-4564-bc6f-076815c2fbf1 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:56.970748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afe278d1-e90d-4564-bc6f-076815c2fbf1 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:56.972058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afe278d1-e90d-4564-bc6f-076815c2fbf1 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:56.999482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afe278d1-e90d-4564-bc6f-076815c2fbf1 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.001381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afe278d1-e90d-4564-bc6f-076815c2fbf1 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.001931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afe278d1-e90d-4564-bc6f-076815c2fbf1 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.013065 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-afe278d1-e90d-4564-bc6f-076815c2fbf1 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.472466 Oct 27 18:45:57.021986 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 164/357] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:57.032326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-05bacd19-4571-4174-99a0-6e8a801860bd tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:57.036059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-05bacd19-4571-4174-99a0-6e8a801860bd tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:57.044080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05bacd19-4571-4174-99a0-6e8a801860bd tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.044577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05bacd19-4571-4174-99a0-6e8a801860bd tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.045016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05bacd19-4571-4174-99a0-6e8a801860bd tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.046659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05bacd19-4571-4174-99a0-6e8a801860bd tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.047140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05bacd19-4571-4174-99a0-6e8a801860bd tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.047681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05bacd19-4571-4174-99a0-6e8a801860bd tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.105069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-07076708-ed71-4775-8d70-e583eb09495f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:57.118018 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-07076708-ed71-4775-8d70-e583eb09495f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1319 microversion: 2.1 time: 0.326052 Oct 27 18:45:57.119739 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 194/358] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:56 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:57.127796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-231b979e-8d81-4149-a2bc-75c1ab040d40 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Calling method '.version_select at 0x7fc86bac2dc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:57.129540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231b979e-8d81-4149-a2bc-75c1ab040d40 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.130020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231b979e-8d81-4149-a2bc-75c1ab040d40 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.130475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231b979e-8d81-4149-a2bc-75c1ab040d40 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.188698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231b979e-8d81-4149-a2bc-75c1ab040d40 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.189199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231b979e-8d81-4149-a2bc-75c1ab040d40 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.189642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231b979e-8d81-4149-a2bc-75c1ab040d40 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.262132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-05bacd19-4571-4174-99a0-6e8a801860bd tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:57.271832 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-05bacd19-4571-4174-99a0-6e8a801860bd tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1323 microversion: 2.1 time: 0.248756 Oct 27 18:45:57.286572 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 165/359] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:57 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1323 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:57.289322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231b979e-8d81-4149-a2bc-75c1ab040d40 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.289867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231b979e-8d81-4149-a2bc-75c1ab040d40 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.291304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231b979e-8d81-4149-a2bc-75c1ab040d40 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.307832 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-231b979e-8d81-4149-a2bc-75c1ab040d40 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/n-h1-860687-3/servers" status: 200 len: 275 microversion: 2.1 time: 0.182371 Oct 27 18:45:57.308935 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 195/360] 10.222.0.42 () {58 vars in 1212 bytes} [Thu Oct 27 18:45:57 2022] GET /compute/v2.1/os-hypervisors/n-h1-860687-3/servers => generated 275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:57.322054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9adb210c-313c-42c8-a720-0fb080a19952 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Calling method '.version_select at 0x7fc86ba944c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:57.323944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9adb210c-313c-42c8-a720-0fb080a19952 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.324450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9adb210c-313c-42c8-a720-0fb080a19952 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.324927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9adb210c-313c-42c8-a720-0fb080a19952 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.339312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-32eae583-8a57-40d1-a2d7-29c79314c810 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:57.340180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-32eae583-8a57-40d1-a2d7-29c79314c810 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:57.341947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9adb210c-313c-42c8-a720-0fb080a19952 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.342719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9adb210c-313c-42c8-a720-0fb080a19952 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.343374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9adb210c-313c-42c8-a720-0fb080a19952 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.348743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32eae583-8a57-40d1-a2d7-29c79314c810 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.349408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32eae583-8a57-40d1-a2d7-29c79314c810 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.350478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32eae583-8a57-40d1-a2d7-29c79314c810 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.351515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32eae583-8a57-40d1-a2d7-29c79314c810 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.352702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32eae583-8a57-40d1-a2d7-29c79314c810 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.353414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32eae583-8a57-40d1-a2d7-29c79314c810 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.354957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9adb210c-313c-42c8-a720-0fb080a19952 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.355567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9adb210c-313c-42c8-a720-0fb080a19952 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.356731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9adb210c-313c-42c8-a720-0fb080a19952 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.364127 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9adb210c-313c-42c8-a720-0fb080a19952 tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.046872 Oct 27 18:45:57.365572 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 166/361] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:45:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:57.382030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f26bd0e6-bfce-4797-9dab-118c8245400f tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Calling method '.version_select at 0x7fc86b8dab80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:57.386935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f26bd0e6-bfce-4797-9dab-118c8245400f tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.390535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f26bd0e6-bfce-4797-9dab-118c8245400f tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.391221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f26bd0e6-bfce-4797-9dab-118c8245400f tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.413319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f26bd0e6-bfce-4797-9dab-118c8245400f tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.414256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f26bd0e6-bfce-4797-9dab-118c8245400f tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.414934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f26bd0e6-bfce-4797-9dab-118c8245400f tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.426496 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f26bd0e6-bfce-4797-9dab-118c8245400f tempest-HypervisorAdminUnderV252Test-442512068 tempest-HypervisorAdminUnderV252Test-442512068-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/n-h1-860687-3/search" status: 200 len: 104 microversion: 2.1 time: 0.048167 Oct 27 18:45:57.427290 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 167/362] 10.222.0.42 () {58 vars in 1209 bytes} [Thu Oct 27 18:45:57 2022] GET /compute/v2.1/os-hypervisors/n-h1-860687-3/search => generated 104 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:45:57.487875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b38a56f9-4689-4893-b2f5-6ad990ea8568 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:57.489029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b38a56f9-4689-4893-b2f5-6ad990ea8568 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:57.499813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38a56f9-4689-4893-b2f5-6ad990ea8568 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.502374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38a56f9-4689-4893-b2f5-6ad990ea8568 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.504400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38a56f9-4689-4893-b2f5-6ad990ea8568 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.505159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38a56f9-4689-4893-b2f5-6ad990ea8568 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:57.507036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38a56f9-4689-4893-b2f5-6ad990ea8568 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:57.510604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38a56f9-4689-4893-b2f5-6ad990ea8568 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:57.573898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-32eae583-8a57-40d1-a2d7-29c79314c810 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:57.588536 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-32eae583-8a57-40d1-a2d7-29c79314c810 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 200 len: 1388 microversion: 2.1 time: 0.253944 Oct 27 18:45:57.589786 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 196/363] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:57 2022] GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 1388 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:57.674212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b38a56f9-4689-4893-b2f5-6ad990ea8568 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:57.683441 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b38a56f9-4689-4893-b2f5-6ad990ea8568 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1314 microversion: 2.1 time: 0.199461 Oct 27 18:45:57.685839 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 168/364] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:57 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:58.141293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5d01d913-b132-44a3-b652-8b1051d5c0e5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:58.142106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5d01d913-b132-44a3-b652-8b1051d5c0e5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:58.158031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d01d913-b132-44a3-b652-8b1051d5c0e5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:58.158577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d01d913-b132-44a3-b652-8b1051d5c0e5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:58.159240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d01d913-b132-44a3-b652-8b1051d5c0e5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:58.160504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d01d913-b132-44a3-b652-8b1051d5c0e5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:58.161655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d01d913-b132-44a3-b652-8b1051d5c0e5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:58.162290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d01d913-b132-44a3-b652-8b1051d5c0e5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:58.300167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cbf0e238-0254-49c2-b207-97dbb5b062c3 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:58.300957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cbf0e238-0254-49c2-b207-97dbb5b062c3 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:58.339045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbf0e238-0254-49c2-b207-97dbb5b062c3 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:58.344458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbf0e238-0254-49c2-b207-97dbb5b062c3 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:58.345021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbf0e238-0254-49c2-b207-97dbb5b062c3 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:58.345863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbf0e238-0254-49c2-b207-97dbb5b062c3 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:58.348640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbf0e238-0254-49c2-b207-97dbb5b062c3 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:58.349174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbf0e238-0254-49c2-b207-97dbb5b062c3 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:58.598878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5d01d913-b132-44a3-b652-8b1051d5c0e5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:58.610000 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5d01d913-b132-44a3-b652-8b1051d5c0e5 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1319 microversion: 2.1 time: 0.472727 Oct 27 18:45:58.611688 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 197/365] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:58 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:58.626577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-180b1d88-d35d-4f54-b716-24123b27d73c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:58.626577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-180b1d88-d35d-4f54-b716-24123b27d73c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:58.627012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cbf0e238-0254-49c2-b207-97dbb5b062c3 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:58.627102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-180b1d88-d35d-4f54-b716-24123b27d73c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:58.627102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-180b1d88-d35d-4f54-b716-24123b27d73c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:58.627102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-180b1d88-d35d-4f54-b716-24123b27d73c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:58.627102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-180b1d88-d35d-4f54-b716-24123b27d73c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:58.627369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-180b1d88-d35d-4f54-b716-24123b27d73c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:58.627369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-180b1d88-d35d-4f54-b716-24123b27d73c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:58.634138 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cbf0e238-0254-49c2-b207-97dbb5b062c3 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1323 microversion: 2.1 time: 0.340356 Oct 27 18:45:58.635863 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 169/366] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:58 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1323 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:45:58.711108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1354cfda-d5a9-457b-8ba2-a668dced1619 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:58.712173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1354cfda-d5a9-457b-8ba2-a668dced1619 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:58.722163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1354cfda-d5a9-457b-8ba2-a668dced1619 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:58.723068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1354cfda-d5a9-457b-8ba2-a668dced1619 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:58.724226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1354cfda-d5a9-457b-8ba2-a668dced1619 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:58.725974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1354cfda-d5a9-457b-8ba2-a668dced1619 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:58.726711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1354cfda-d5a9-457b-8ba2-a668dced1619 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:58.728371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1354cfda-d5a9-457b-8ba2-a668dced1619 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:58.830961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-180b1d88-d35d-4f54-b716-24123b27d73c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:58.845318 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-180b1d88-d35d-4f54-b716-24123b27d73c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 200 len: 1587 microversion: 2.1 time: 0.231427 Oct 27 18:45:58.846724 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 198/367] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:58 2022] GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 1587 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:58.876965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-95263ddc-2eb2-4981-ad67-2a50e70f5812 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:58.877486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-95263ddc-2eb2-4981-ad67-2a50e70f5812 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:58.892625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95263ddc-2eb2-4981-ad67-2a50e70f5812 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:58.894923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95263ddc-2eb2-4981-ad67-2a50e70f5812 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:58.895557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95263ddc-2eb2-4981-ad67-2a50e70f5812 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:58.897519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95263ddc-2eb2-4981-ad67-2a50e70f5812 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:58.899469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95263ddc-2eb2-4981-ad67-2a50e70f5812 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:58.900080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95263ddc-2eb2-4981-ad67-2a50e70f5812 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:59.015938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1354cfda-d5a9-457b-8ba2-a668dced1619 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:45:59.025580 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1354cfda-d5a9-457b-8ba2-a668dced1619 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1314 microversion: 2.1 time: 0.319972 Oct 27 18:45:59.036576 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 170/368] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:58 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:45:59.145667 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-95263ddc-2eb2-4981-ad67-2a50e70f5812 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.279087 Oct 27 18:45:59.146271 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 199/369] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 18:45:58 2022] GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f/os-interface => generated 285 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:45:59.633975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2bb61029-296a-48b7-ac42-8b57bf75e998 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:59.635153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2bb61029-296a-48b7-ac42-8b57bf75e998 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:59.642640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bb61029-296a-48b7-ac42-8b57bf75e998 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:59.651350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bb61029-296a-48b7-ac42-8b57bf75e998 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:59.651980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bb61029-296a-48b7-ac42-8b57bf75e998 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:59.657332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bb61029-296a-48b7-ac42-8b57bf75e998 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:59.658030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bb61029-296a-48b7-ac42-8b57bf75e998 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:59.658689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bb61029-296a-48b7-ac42-8b57bf75e998 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:59.661637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a6f64c78-2c74-46e7-b0af-b52608a2badc tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:45:59.662267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a6f64c78-2c74-46e7-b0af-b52608a2badc tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:45:59.673391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6f64c78-2c74-46e7-b0af-b52608a2badc tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:59.673937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6f64c78-2c74-46e7-b0af-b52608a2badc tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:59.674421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6f64c78-2c74-46e7-b0af-b52608a2badc tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:59.677758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6f64c78-2c74-46e7-b0af-b52608a2badc tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:45:59.678247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6f64c78-2c74-46e7-b0af-b52608a2badc tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:45:59.678726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6f64c78-2c74-46e7-b0af-b52608a2badc tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:45:59.989430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a6f64c78-2c74-46e7-b0af-b52608a2badc tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:00.011269 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a6f64c78-2c74-46e7-b0af-b52608a2badc tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1323 microversion: 2.1 time: 0.352761 Oct 27 18:46:00.011910 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 200/370] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:59 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1323 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:00.052361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e9c6278f-5269-4caf-8b20-e3f2ff2d2ae2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:00.053053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e9c6278f-5269-4caf-8b20-e3f2ff2d2ae2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:00.093188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9c6278f-5269-4caf-8b20-e3f2ff2d2ae2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:00.093758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9c6278f-5269-4caf-8b20-e3f2ff2d2ae2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:00.094248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9c6278f-5269-4caf-8b20-e3f2ff2d2ae2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:00.099155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9c6278f-5269-4caf-8b20-e3f2ff2d2ae2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:00.099655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9c6278f-5269-4caf-8b20-e3f2ff2d2ae2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:00.102933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9c6278f-5269-4caf-8b20-e3f2ff2d2ae2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:00.150773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:00.320029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=10 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:00.526984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e9c6278f-5269-4caf-8b20-e3f2ff2d2ae2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:00.539860 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e9c6278f-5269-4caf-8b20-e3f2ff2d2ae2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1314 microversion: 2.1 time: 0.491928 Oct 27 18:46:00.552373 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 201/371] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:00 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:00.615105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2bb61029-296a-48b7-ac42-8b57bf75e998 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:00.624371 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2bb61029-296a-48b7-ac42-8b57bf75e998 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1319 microversion: 2.1 time: 0.995174 Oct 27 18:46:00.629330 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 171/372] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:45:59 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1319 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:00.645115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-83b0a566-fb93-4042-a8cc-8cf905e8939c req-8d8ea089-127b-4e94-8546-ce9082eda751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20197946-daa3-44ae-9c98-e9ba238df184", "name": "network-vif-plugged", "status": "completed", "tag": "d9b04de2-1137-4c7c-82dd-5120635edab6"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:00.661470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-83b0a566-fb93-4042-a8cc-8cf905e8939c req-8d8ea089-127b-4e94-8546-ce9082eda751 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:00.662592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-83b0a566-fb93-4042-a8cc-8cf905e8939c req-8d8ea089-127b-4e94-8546-ce9082eda751 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:00.664001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-83b0a566-fb93-4042-a8cc-8cf905e8939c req-8d8ea089-127b-4e94-8546-ce9082eda751 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:00.688163 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-83b0a566-fb93-4042-a8cc-8cf905e8939c req-8d8ea089-127b-4e94-8546-ce9082eda751 service nova] Creating event network-vif-plugged:d9b04de2-1137-4c7c-82dd-5120635edab6 for instance 20197946-daa3-44ae-9c98-e9ba238df184 on n-h1-860687-3 Oct 27 18:46:00.696818 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-83b0a566-fb93-4042-a8cc-8cf905e8939c req-8d8ea089-127b-4e94-8546-ce9082eda751 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064997 Oct 27 18:46:00.698836 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 172/373] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:00.834171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-823f2bd7-858a-4b83-af94-53d75cb12bd3 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Calling method '.version_select at 0x7fc86b8b0160>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:00.836251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-823f2bd7-858a-4b83-af94-53d75cb12bd3 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:00.836927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-823f2bd7-858a-4b83-af94-53d75cb12bd3 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:00.837361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-823f2bd7-858a-4b83-af94-53d75cb12bd3 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:00.891116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-823f2bd7-858a-4b83-af94-53d75cb12bd3 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:00.891621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-823f2bd7-858a-4b83-af94-53d75cb12bd3 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:00.894082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-823f2bd7-858a-4b83-af94-53d75cb12bd3 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:00.920941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-823f2bd7-858a-4b83-af94-53d75cb12bd3 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:00.921441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-823f2bd7-858a-4b83-af94-53d75cb12bd3 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:00.921894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-823f2bd7-858a-4b83-af94-53d75cb12bd3 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:00.936611 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-823f2bd7-858a-4b83-af94-53d75cb12bd3 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.387647 Oct 27 18:46:00.937420 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 202/374] 10.222.0.42 () {60 vars in 1187 bytes} [Thu Oct 27 18:46:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:46:00.950049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6c527cf2-9d8a-4851-9aa5-30112e2f7ce1 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Calling method '.version_select at 0x7fc86b819820>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:00.952653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c527cf2-9d8a-4851-9aa5-30112e2f7ce1 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:00.953550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c527cf2-9d8a-4851-9aa5-30112e2f7ce1 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:00.954213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c527cf2-9d8a-4851-9aa5-30112e2f7ce1 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:00.993576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c527cf2-9d8a-4851-9aa5-30112e2f7ce1 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:00.994093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c527cf2-9d8a-4851-9aa5-30112e2f7ce1 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:00.994746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c527cf2-9d8a-4851-9aa5-30112e2f7ce1 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:01.005221 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6c527cf2-9d8a-4851-9aa5-30112e2f7ce1 tempest-HypervisorAdminV228Test-1388304596 tempest-HypervisorAdminV228Test-1388304596-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.060438 Oct 27 18:46:01.009937 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 173/375] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Oct 27 18:46:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:46:01.041094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-71e12faf-ee4a-469d-9c78-a2221c114f2e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:01.041891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-71e12faf-ee4a-469d-9c78-a2221c114f2e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:01.063993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e12faf-ee4a-469d-9c78-a2221c114f2e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:01.067650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e12faf-ee4a-469d-9c78-a2221c114f2e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:01.068949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e12faf-ee4a-469d-9c78-a2221c114f2e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:01.070183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e12faf-ee4a-469d-9c78-a2221c114f2e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:01.083206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e12faf-ee4a-469d-9c78-a2221c114f2e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:01.083957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e12faf-ee4a-469d-9c78-a2221c114f2e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:01.553836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-71e12faf-ee4a-469d-9c78-a2221c114f2e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:01.573990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f1283db1-4d42-4e58-8f15-8c9b0e87abc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:01.575594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f1283db1-4d42-4e58-8f15-8c9b0e87abc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:01.586560 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-71e12faf-ee4a-469d-9c78-a2221c114f2e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1323 microversion: 2.1 time: 0.551123 Oct 27 18:46:01.587744 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 203/376] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:01 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1323 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:01.589772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1283db1-4d42-4e58-8f15-8c9b0e87abc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:01.591700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1283db1-4d42-4e58-8f15-8c9b0e87abc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:01.593508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1283db1-4d42-4e58-8f15-8c9b0e87abc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:01.597530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1283db1-4d42-4e58-8f15-8c9b0e87abc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:01.598555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1283db1-4d42-4e58-8f15-8c9b0e87abc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:01.599300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1283db1-4d42-4e58-8f15-8c9b0e87abc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:01.654125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ff4e9839-35f4-402a-b711-245e7696a06d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:01.654934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ff4e9839-35f4-402a-b711-245e7696a06d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:01.667373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff4e9839-35f4-402a-b711-245e7696a06d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:01.669038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff4e9839-35f4-402a-b711-245e7696a06d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:01.672997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff4e9839-35f4-402a-b711-245e7696a06d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:01.677467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff4e9839-35f4-402a-b711-245e7696a06d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:01.680055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff4e9839-35f4-402a-b711-245e7696a06d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:01.681747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff4e9839-35f4-402a-b711-245e7696a06d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:02.152985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ff4e9839-35f4-402a-b711-245e7696a06d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:02.165550 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ff4e9839-35f4-402a-b711-245e7696a06d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1319 microversion: 2.1 time: 0.515902 Oct 27 18:46:02.167168 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 204/377] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:01 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1319 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:46:02.514957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f1283db1-4d42-4e58-8f15-8c9b0e87abc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:02.571961 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f1283db1-4d42-4e58-8f15-8c9b0e87abc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1314 microversion: 2.1 time: 1.006848 Oct 27 18:46:02.605901 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 174/378] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:01 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1314 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:46:02.609510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ab5d3f0a-1190-4b6c-ac97-1b9064884d49 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:02.610185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ab5d3f0a-1190-4b6c-ac97-1b9064884d49 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:02.625029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab5d3f0a-1190-4b6c-ac97-1b9064884d49 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:02.625512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab5d3f0a-1190-4b6c-ac97-1b9064884d49 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:02.625963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab5d3f0a-1190-4b6c-ac97-1b9064884d49 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:02.626725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab5d3f0a-1190-4b6c-ac97-1b9064884d49 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:02.627186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab5d3f0a-1190-4b6c-ac97-1b9064884d49 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:02.627611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab5d3f0a-1190-4b6c-ac97-1b9064884d49 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:02.984456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ab5d3f0a-1190-4b6c-ac97-1b9064884d49 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:02.994792 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ab5d3f0a-1190-4b6c-ac97-1b9064884d49 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1323 microversion: 2.1 time: 0.389508 Oct 27 18:46:02.995375 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 205/379] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:02 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1323 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:46:03.193436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-228261b4-7a86-491a-9bdd-6e933d8a657d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:03.194051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-228261b4-7a86-491a-9bdd-6e933d8a657d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:03.209570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-be14c849-3d79-4289-b5ec-1ecda1bcdcfa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:03.210191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-be14c849-3d79-4289-b5ec-1ecda1bcdcfa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:03.221066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be14c849-3d79-4289-b5ec-1ecda1bcdcfa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:03.237268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-228261b4-7a86-491a-9bdd-6e933d8a657d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:03.237828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-228261b4-7a86-491a-9bdd-6e933d8a657d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:03.238279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-228261b4-7a86-491a-9bdd-6e933d8a657d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:03.239048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-228261b4-7a86-491a-9bdd-6e933d8a657d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:03.239566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-228261b4-7a86-491a-9bdd-6e933d8a657d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:03.239937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-228261b4-7a86-491a-9bdd-6e933d8a657d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:03.242778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be14c849-3d79-4289-b5ec-1ecda1bcdcfa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:03.243323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be14c849-3d79-4289-b5ec-1ecda1bcdcfa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:03.244063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be14c849-3d79-4289-b5ec-1ecda1bcdcfa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:03.244533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be14c849-3d79-4289-b5ec-1ecda1bcdcfa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:03.244962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be14c849-3d79-4289-b5ec-1ecda1bcdcfa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:03.803585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-228261b4-7a86-491a-9bdd-6e933d8a657d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:03.831455 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-228261b4-7a86-491a-9bdd-6e933d8a657d tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1469 microversion: 2.1 time: 0.638421 Oct 27 18:46:03.833348 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 175/380] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:03 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1469 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:03.847899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-bd86ce55-267d-46d3-b401-d734c4c380ba req-7411359c-c95c-403c-8688-cdb0bf908472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ec313b-f165-450a-92ba-215e7989df1f", "tag": "887f62ff-9ca9-40b8-9c3d-8a4707bae8ce"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:03.875074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bd86ce55-267d-46d3-b401-d734c4c380ba req-7411359c-c95c-403c-8688-cdb0bf908472 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:03.876293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bd86ce55-267d-46d3-b401-d734c4c380ba req-7411359c-c95c-403c-8688-cdb0bf908472 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:03.878076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bd86ce55-267d-46d3-b401-d734c4c380ba req-7411359c-c95c-403c-8688-cdb0bf908472 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:03.889761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:03.901294 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-bd86ce55-267d-46d3-b401-d734c4c380ba req-7411359c-c95c-403c-8688-cdb0bf908472 service nova] Creating event network-changed:887f62ff-9ca9-40b8-9c3d-8a4707bae8ce for instance c0ec313b-f165-450a-92ba-215e7989df1f on n-h1-860687-3 Oct 27 18:46:03.908554 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-bd86ce55-267d-46d3-b401-d734c4c380ba req-7411359c-c95c-403c-8688-cdb0bf908472 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073560 Oct 27 18:46:03.910930 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 176/381] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:03.933225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5aeac124-4f62-4c8d-a117-be52ac69337f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:03.935491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5aeac124-4f62-4c8d-a117-be52ac69337f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:03.948449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeac124-4f62-4c8d-a117-be52ac69337f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:03.949850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeac124-4f62-4c8d-a117-be52ac69337f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:03.953253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeac124-4f62-4c8d-a117-be52ac69337f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:03.954794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeac124-4f62-4c8d-a117-be52ac69337f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:03.955754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeac124-4f62-4c8d-a117-be52ac69337f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:03.958552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeac124-4f62-4c8d-a117-be52ac69337f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:04.060153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-be14c849-3d79-4289-b5ec-1ecda1bcdcfa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:04.071876 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-be14c849-3d79-4289-b5ec-1ecda1bcdcfa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 200 len: 1587 microversion: 2.1 time: 0.866073 Oct 27 18:46:04.072461 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 206/382] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:03 2022] GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 1587 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:04.093364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e2b0c3f7-bcc9-4455-abf8-cbb1da939f23 tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:04.107688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e2b0c3f7-bcc9-4455-abf8-cbb1da939f23 tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:04.125956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2b0c3f7-bcc9-4455-abf8-cbb1da939f23 tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:04.126499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2b0c3f7-bcc9-4455-abf8-cbb1da939f23 tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:04.130607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2b0c3f7-bcc9-4455-abf8-cbb1da939f23 tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:04.131483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2b0c3f7-bcc9-4455-abf8-cbb1da939f23 tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:04.131946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2b0c3f7-bcc9-4455-abf8-cbb1da939f23 tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:04.132393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2b0c3f7-bcc9-4455-abf8-cbb1da939f23 tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:04.480664 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e2b0c3f7-bcc9-4455-abf8-cbb1da939f23 tempest-DeleteServersAdminTestJSON-164043344 tempest-DeleteServersAdminTestJSON-164043344-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184/action" status: 202 len: 0 microversion: 2.1 time: 0.402406 Oct 27 18:46:04.484844 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 207/383] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:46:04 2022] POST /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:46:04.506982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-49476da1-bc7e-40b8-ad78-d27185d4b681 req-0a9fe984-a4ac-4a3a-b910-9b56e76951d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d432d309-21c5-4225-9d63-b988bc43c2dc", "name": "network-vif-plugged", "status": "completed", "tag": "a10d0d4c-7a3f-4a82-86b4-28517b22b876"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:04.530698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-49476da1-bc7e-40b8-ad78-d27185d4b681 req-0a9fe984-a4ac-4a3a-b910-9b56e76951d4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:04.531431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-49476da1-bc7e-40b8-ad78-d27185d4b681 req-0a9fe984-a4ac-4a3a-b910-9b56e76951d4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:04.532050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-49476da1-bc7e-40b8-ad78-d27185d4b681 req-0a9fe984-a4ac-4a3a-b910-9b56e76951d4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:04.548317 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-49476da1-bc7e-40b8-ad78-d27185d4b681 req-0a9fe984-a4ac-4a3a-b910-9b56e76951d4 service nova] Creating event network-vif-plugged:a10d0d4c-7a3f-4a82-86b4-28517b22b876 for instance d432d309-21c5-4225-9d63-b988bc43c2dc on n-h2-860687-3 Oct 27 18:46:04.631620 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-49476da1-bc7e-40b8-ad78-d27185d4b681 req-0a9fe984-a4ac-4a3a-b910-9b56e76951d4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090597 Oct 27 18:46:04.633088 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 208/384] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:04.639925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eaef7caf-bbb1-4c32-ac58-ee056e68f8c6 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:04.641111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-eaef7caf-bbb1-4c32-ac58-ee056e68f8c6 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:04.650700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaef7caf-bbb1-4c32-ac58-ee056e68f8c6 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:04.651492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaef7caf-bbb1-4c32-ac58-ee056e68f8c6 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:04.652382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaef7caf-bbb1-4c32-ac58-ee056e68f8c6 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:04.655243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaef7caf-bbb1-4c32-ac58-ee056e68f8c6 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:04.655987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaef7caf-bbb1-4c32-ac58-ee056e68f8c6 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:04.656658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaef7caf-bbb1-4c32-ac58-ee056e68f8c6 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:04.786416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5aeac124-4f62-4c8d-a117-be52ac69337f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:04.805640 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5aeac124-4f62-4c8d-a117-be52ac69337f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1314 microversion: 2.1 time: 0.893236 Oct 27 18:46:04.808866 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 177/385] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:03 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1314 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:04.817102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8be2c616-9f3b-4d91-a373-e073253c493b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:04.819098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8be2c616-9f3b-4d91-a373-e073253c493b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:04.827377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be2c616-9f3b-4d91-a373-e073253c493b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:04.828357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be2c616-9f3b-4d91-a373-e073253c493b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:04.829144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be2c616-9f3b-4d91-a373-e073253c493b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:04.830094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be2c616-9f3b-4d91-a373-e073253c493b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:04.830837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be2c616-9f3b-4d91-a373-e073253c493b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:04.831484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be2c616-9f3b-4d91-a373-e073253c493b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:04.926664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be2c616-9f3b-4d91-a373-e073253c493b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:04.927993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be2c616-9f3b-4d91-a373-e073253c493b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:04.929537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be2c616-9f3b-4d91-a373-e073253c493b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:04.932431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-8be2c616-9f3b-4d91-a373-e073253c493b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lazy-loading 'fault' on Instance uuid 20197946-daa3-44ae-9c98-e9ba238df184 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:46:05.192063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8be2c616-9f3b-4d91-a373-e073253c493b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:05.210369 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8be2c616-9f3b-4d91-a373-e073253c493b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1452 microversion: 2.1 time: 0.396908 Oct 27 18:46:05.211822 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 178/386] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:04 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1452 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:05.239910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1df984c7-2fc8-4878-9ee3-7a7c35a80de9 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:05.240355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1df984c7-2fc8-4878-9ee3-7a7c35a80de9 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:05.252874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df984c7-2fc8-4878-9ee3-7a7c35a80de9 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:05.253376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df984c7-2fc8-4878-9ee3-7a7c35a80de9 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:05.253824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df984c7-2fc8-4878-9ee3-7a7c35a80de9 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:05.268613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df984c7-2fc8-4878-9ee3-7a7c35a80de9 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:05.269179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df984c7-2fc8-4878-9ee3-7a7c35a80de9 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:05.269643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df984c7-2fc8-4878-9ee3-7a7c35a80de9 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:05.341521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1df984c7-2fc8-4878-9ee3-7a7c35a80de9 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:46:05.555647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:05.568176 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1df984c7-2fc8-4878-9ee3-7a7c35a80de9 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "DELETE /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 204 len: 0 microversion: 2.1 time: 0.330154 Oct 27 18:46:05.575527 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 179/387] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:46:05 2022] DELETE /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:46:05.588393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d34235d6-d565-4fcd-9a3c-d6213de4f229 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:05.589153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d34235d6-d565-4fcd-9a3c-d6213de4f229 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:05.616727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34235d6-d565-4fcd-9a3c-d6213de4f229 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:05.617556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34235d6-d565-4fcd-9a3c-d6213de4f229 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:05.618610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34235d6-d565-4fcd-9a3c-d6213de4f229 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:05.621017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34235d6-d565-4fcd-9a3c-d6213de4f229 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:05.624272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34235d6-d565-4fcd-9a3c-d6213de4f229 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:05.625605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34235d6-d565-4fcd-9a3c-d6213de4f229 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:05.718843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34235d6-d565-4fcd-9a3c-d6213de4f229 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:05.719366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34235d6-d565-4fcd-9a3c-d6213de4f229 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:05.720219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34235d6-d565-4fcd-9a3c-d6213de4f229 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:05.721072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-d34235d6-d565-4fcd-9a3c-d6213de4f229 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lazy-loading 'fault' on Instance uuid 20197946-daa3-44ae-9c98-e9ba238df184 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:46:05.744987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-eaef7caf-bbb1-4c32-ac58-ee056e68f8c6 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:05.756794 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eaef7caf-bbb1-4c32-ac58-ee056e68f8c6 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1323 microversion: 2.1 time: 1.121693 Oct 27 18:46:05.774092 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 209/388] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:04 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1323 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:05.835416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9b5315c9-1605-4157-8191-34e9f0f17775 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:05.836570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9b5315c9-1605-4157-8191-34e9f0f17775 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:05.851701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b5315c9-1605-4157-8191-34e9f0f17775 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:05.852898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b5315c9-1605-4157-8191-34e9f0f17775 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:05.853531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b5315c9-1605-4157-8191-34e9f0f17775 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:05.855943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b5315c9-1605-4157-8191-34e9f0f17775 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:05.858971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b5315c9-1605-4157-8191-34e9f0f17775 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:05.860805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b5315c9-1605-4157-8191-34e9f0f17775 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:05.947092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:06.034683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d34235d6-d565-4fcd-9a3c-d6213de4f229 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:06.045142 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d34235d6-d565-4fcd-9a3c-d6213de4f229 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1458 microversion: 2.1 time: 0.466289 Oct 27 18:46:06.046512 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 180/389] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:05 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1458 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:06.346488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9b5315c9-1605-4157-8191-34e9f0f17775 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:06.362474 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9b5315c9-1605-4157-8191-34e9f0f17775 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1314 microversion: 2.1 time: 0.527644 Oct 27 18:46:06.365483 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 210/390] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:05 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:46:06.553623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-36eed8e3-b8ac-4253-90e2-4581c4328f26 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:06.555214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36eed8e3-b8ac-4253-90e2-4581c4328f26 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:06.555928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36eed8e3-b8ac-4253-90e2-4581c4328f26 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:06.556537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36eed8e3-b8ac-4253-90e2-4581c4328f26 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:06.557446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36eed8e3-b8ac-4253-90e2-4581c4328f26 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:06.558112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36eed8e3-b8ac-4253-90e2-4581c4328f26 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:06.569055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36eed8e3-b8ac-4253-90e2-4581c4328f26 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:06.632534 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-36eed8e3-b8ac-4253-90e2-4581c4328f26 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] 10.222.0.42 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.329923 Oct 27 18:46:06.633782 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 181/391] 10.222.0.42 () {58 vars in 1164 bytes} [Thu Oct 27 18:46:06 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 18:46:06.648883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6d51d12c-487b-48e2-afb2-cfd62eb34e58 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:06.651062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d51d12c-487b-48e2-afb2-cfd62eb34e58 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:06.651557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d51d12c-487b-48e2-afb2-cfd62eb34e58 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:06.651995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d51d12c-487b-48e2-afb2-cfd62eb34e58 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:06.652972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d51d12c-487b-48e2-afb2-cfd62eb34e58 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:06.654366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d51d12c-487b-48e2-afb2-cfd62eb34e58 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:06.654831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d51d12c-487b-48e2-afb2-cfd62eb34e58 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:06.703496 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6d51d12c-487b-48e2-afb2-cfd62eb34e58 tempest-AZAdminV2TestJSON-2132473442 tempest-AZAdminV2TestJSON-2132473442-project-admin] 10.222.0.42 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.057457 Oct 27 18:46:06.704755 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 211/392] 10.222.0.42 () {58 vars in 1185 bytes} [Thu Oct 27 18:46:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:06.783035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-230197b3-0865-4f3a-bbb1-aa94dc09cb84 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:06.784120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-230197b3-0865-4f3a-bbb1-aa94dc09cb84 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:06.792317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230197b3-0865-4f3a-bbb1-aa94dc09cb84 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:06.793030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230197b3-0865-4f3a-bbb1-aa94dc09cb84 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:06.794508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230197b3-0865-4f3a-bbb1-aa94dc09cb84 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:06.795134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230197b3-0865-4f3a-bbb1-aa94dc09cb84 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:06.795815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230197b3-0865-4f3a-bbb1-aa94dc09cb84 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:06.796447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230197b3-0865-4f3a-bbb1-aa94dc09cb84 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:07.068437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7b47c91f-7125-4e88-b334-3510a5b0f26b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:07.069059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7b47c91f-7125-4e88-b334-3510a5b0f26b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:07.080918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b47c91f-7125-4e88-b334-3510a5b0f26b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:07.081416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b47c91f-7125-4e88-b334-3510a5b0f26b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:07.081860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b47c91f-7125-4e88-b334-3510a5b0f26b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:07.084287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b47c91f-7125-4e88-b334-3510a5b0f26b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:07.084769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b47c91f-7125-4e88-b334-3510a5b0f26b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:07.085415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b47c91f-7125-4e88-b334-3510a5b0f26b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:07.170612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b47c91f-7125-4e88-b334-3510a5b0f26b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:07.171112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b47c91f-7125-4e88-b334-3510a5b0f26b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:07.171555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b47c91f-7125-4e88-b334-3510a5b0f26b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:07.172013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-7b47c91f-7125-4e88-b334-3510a5b0f26b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lazy-loading 'fault' on Instance uuid 20197946-daa3-44ae-9c98-e9ba238df184 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:46:07.280373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-230197b3-0865-4f3a-bbb1-aa94dc09cb84 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:07.295024 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-230197b3-0865-4f3a-bbb1-aa94dc09cb84 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1473 microversion: 2.1 time: 0.515578 Oct 27 18:46:07.328897 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 182/393] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:06 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1473 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:07.344930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4d1e40b7-b1d4-4742-93b1-f4caafdd911d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:07.345605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4d1e40b7-b1d4-4742-93b1-f4caafdd911d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:07.375288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d1e40b7-b1d4-4742-93b1-f4caafdd911d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:07.376776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d1e40b7-b1d4-4742-93b1-f4caafdd911d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:07.381025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d1e40b7-b1d4-4742-93b1-f4caafdd911d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:07.381876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d1e40b7-b1d4-4742-93b1-f4caafdd911d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:07.384548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d1e40b7-b1d4-4742-93b1-f4caafdd911d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:07.385005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d1e40b7-b1d4-4742-93b1-f4caafdd911d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:07.513419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4d1e40b7-b1d4-4742-93b1-f4caafdd911d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:07.514168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7b47c91f-7125-4e88-b334-3510a5b0f26b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:07.529299 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7b47c91f-7125-4e88-b334-3510a5b0f26b tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1458 microversion: 2.1 time: 0.463872 Oct 27 18:46:07.532779 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 212/394] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:07 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1458 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4d1e40b7-b1d4-4742-93b1-f4caafdd911d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Request method failure captured: Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc/diagnostics HTTP/1.1 Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtHV4XmdQ8R1zb4FiFXvW3ML3SIMrL4sRwPXKVekG0jnsoVhVE_a6t9_RW068ZAjhLMVTLlXmeYBz2HAp4Ck0S2H2iy9VkGYFHOVLfJZeIFRTl9ib9EVjDD1mZV2HTaDVAmD7ysKFi0rh8uQQ1Wcwg3TM4mfu3Agpve9jmIaqaJPeRw Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f2469694f60446648bdd4fe005a7f17b Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-634192142 Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:07.533935 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:07.535222 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f2469694f60446648bdd4fe005a7f17b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2469694f60446648bdd4fe005a7f17b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f2469694f60446648bdd4fe005a7f17b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2469694f60446648bdd4fe005a7f17b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:07.535222 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-634192142 Oct 27 18:46:07.535222 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f2469694f60446648bdd4fe005a7f17b Oct 27 18:46:07.535222 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-634192142 Oct 27 18:46:07.535222 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerDiagnosticsNegativeTest-634192142-project Oct 27 18:46:07.535222 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:07.535222 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:07.535222 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: a76e6b9746814167abf1f3088468a87c Oct 27 18:46:07.535222 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-634192142-project Oct 27 18:46:07.535222 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:46:07.535222 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'server_id': 'd432d309-21c5-4225-9d63-b988bc43c2dc'} Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:07.535891 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:07.537047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4d1e40b7-b1d4-4742-93b1-f4caafdd911d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:07.538987 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4d1e40b7-b1d4-4742-93b1-f4caafdd911d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.205578 Oct 27 18:46:07.538987 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 183/395] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:46:07 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc/diagnostics => generated 117 bytes in 207 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:07.552105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-240c5001-3cdf-495e-a87f-3fe66deb1e52 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:07.552971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-240c5001-3cdf-495e-a87f-3fe66deb1e52 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:07.579605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0758e1d4-5763-4ae0-bc09-5bffbd79b4ca tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:07.586979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0758e1d4-5763-4ae0-bc09-5bffbd79b4ca tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:07.591848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-240c5001-3cdf-495e-a87f-3fe66deb1e52 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:07.593187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-240c5001-3cdf-495e-a87f-3fe66deb1e52 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:07.594230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-240c5001-3cdf-495e-a87f-3fe66deb1e52 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:07.596340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-240c5001-3cdf-495e-a87f-3fe66deb1e52 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:07.596819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-240c5001-3cdf-495e-a87f-3fe66deb1e52 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:07.598180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-240c5001-3cdf-495e-a87f-3fe66deb1e52 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:07.601195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0758e1d4-5763-4ae0-bc09-5bffbd79b4ca tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:07.607824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0758e1d4-5763-4ae0-bc09-5bffbd79b4ca tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:07.610701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0758e1d4-5763-4ae0-bc09-5bffbd79b4ca tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:07.612146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0758e1d4-5763-4ae0-bc09-5bffbd79b4ca tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:07.614148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0758e1d4-5763-4ae0-bc09-5bffbd79b4ca tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:07.616037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0758e1d4-5763-4ae0-bc09-5bffbd79b4ca tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:07.698446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0758e1d4-5763-4ae0-bc09-5bffbd79b4ca tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:46:07.844721 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0758e1d4-5763-4ae0-bc09-5bffbd79b4ca tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 204 len: 0 microversion: 2.1 time: 0.283668 Oct 27 18:46:07.848412 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 184/396] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:46:07 2022] DELETE /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:46:08.048647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-240c5001-3cdf-495e-a87f-3fe66deb1e52 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:08.076790 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-240c5001-3cdf-495e-a87f-3fe66deb1e52 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1314 microversion: 2.1 time: 0.534312 Oct 27 18:46:08.079911 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 213/397] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:07 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:08.086287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e5e541a-1622-4064-ba49-6d4eda09b870 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:08.087396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6e5e541a-1622-4064-ba49-6d4eda09b870 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:08.096001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Calling method '.version_select at 0x7fc86bd7ec10>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:08.110695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.113241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.114226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.124378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e5e541a-1622-4064-ba49-6d4eda09b870 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.127733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e5e541a-1622-4064-ba49-6d4eda09b870 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.129061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e5e541a-1622-4064-ba49-6d4eda09b870 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.130137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e5e541a-1622-4064-ba49-6d4eda09b870 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.131631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e5e541a-1622-4064-ba49-6d4eda09b870 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.133523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e5e541a-1622-4064-ba49-6d4eda09b870 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.186068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.186635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.190056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.237679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.238331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.238809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.266590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.267461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.269111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.326899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.328462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.328878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.345941 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d1b29a91-bdcb-4554-b803-ef4ef4ab3c5b tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2073 microversion: 2.53 time: 0.498509 Oct 27 18:46:08.347681 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 185/398] 10.222.0.42 () {60 vars in 1243 bytes} [Thu Oct 27 18:46:07 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2073 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:08.359372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-209fe182-7b1d-49d2-a249-06626e526a4a req-e823656e-a976-4b1f-ae8a-88d4bd40cb7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d71f0172-5c69-42a1-bb37-d0511f852211", "name": "network-vif-plugged", "status": "completed", "tag": "3545f586-170a-4011-93a6-4288e4a5de64"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:08.389451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-209fe182-7b1d-49d2-a249-06626e526a4a req-e823656e-a976-4b1f-ae8a-88d4bd40cb7b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.389940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-209fe182-7b1d-49d2-a249-06626e526a4a req-e823656e-a976-4b1f-ae8a-88d4bd40cb7b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.390415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-209fe182-7b1d-49d2-a249-06626e526a4a req-e823656e-a976-4b1f-ae8a-88d4bd40cb7b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.402144 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-209fe182-7b1d-49d2-a249-06626e526a4a req-e823656e-a976-4b1f-ae8a-88d4bd40cb7b service nova] Creating event network-vif-plugged:3545f586-170a-4011-93a6-4288e4a5de64 for instance d71f0172-5c69-42a1-bb37-d0511f852211 on n-h2-860687-3 Oct 27 18:46:08.407954 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-209fe182-7b1d-49d2-a249-06626e526a4a req-e823656e-a976-4b1f-ae8a-88d4bd40cb7b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056832 Oct 27 18:46:08.409136 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 186/399] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:08.414673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Calling method '.version_select at 0x7fc86b7a9dc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:08.420551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.421413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.422050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.439310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.440337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.440997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.467476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.468340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.468998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.483240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.485011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.485727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.524602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.525750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.526707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.535042 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3b735cb4-f6b0-47e9-87f6-ca57d7a90318 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 765 microversion: 2.53 time: 0.124393 Oct 27 18:46:08.536521 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 187/400] 10.222.0.42 () {60 vars in 1222 bytes} [Thu Oct 27 18:46:08 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 765 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:46:08.549640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a954db04-fb51-4ab5-8814-0fee84f27148 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Calling method '.version_select at 0x7fc86bd9c430>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:08.569459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a954db04-fb51-4ab5-8814-0fee84f27148 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.569987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a954db04-fb51-4ab5-8814-0fee84f27148 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.570472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a954db04-fb51-4ab5-8814-0fee84f27148 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.612308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a954db04-fb51-4ab5-8814-0fee84f27148 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.612308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a954db04-fb51-4ab5-8814-0fee84f27148 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.612597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a954db04-fb51-4ab5-8814-0fee84f27148 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.630879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:08.633719 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a954db04-fb51-4ab5-8814-0fee84f27148 tempest-HypervisorAdminV253TestBase-614311793 tempest-HypervisorAdminV253TestBase-614311793-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/7b109766-0c2a-4bbc-8020-1937af8feb61" status: 200 len: 792 microversion: 2.53 time: 0.088351 Oct 27 18:46:08.639160 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 188/401] 10.222.0.42 () {60 vars in 1298 bytes} [Thu Oct 27 18:46:08 2022] GET /compute/v2.1/os-hypervisors/7b109766-0c2a-4bbc-8020-1937af8feb61 => generated 792 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 18:46:08.647460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1081c5dc-2f04-4a39-aadd-482dac892793 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:08.648222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1081c5dc-2f04-4a39-aadd-482dac892793 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:08.665119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1081c5dc-2f04-4a39-aadd-482dac892793 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.665626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1081c5dc-2f04-4a39-aadd-482dac892793 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.666325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1081c5dc-2f04-4a39-aadd-482dac892793 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.667089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1081c5dc-2f04-4a39-aadd-482dac892793 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.667551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1081c5dc-2f04-4a39-aadd-482dac892793 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.667989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1081c5dc-2f04-4a39-aadd-482dac892793 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.754020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1081c5dc-2f04-4a39-aadd-482dac892793 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:08.754556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1081c5dc-2f04-4a39-aadd-482dac892793 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:08.755010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1081c5dc-2f04-4a39-aadd-482dac892793 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:08.755965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-1081c5dc-2f04-4a39-aadd-482dac892793 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lazy-loading 'fault' on Instance uuid 20197946-daa3-44ae-9c98-e9ba238df184 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:46:08.923597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6e5e541a-1622-4064-ba49-6d4eda09b870 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:08.934615 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6e5e541a-1622-4064-ba49-6d4eda09b870 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1479 microversion: 2.1 time: 0.852655 Oct 27 18:46:08.935892 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 214/402] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:08 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1479 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:09.109327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aaadd1f1-bbe5-4cf3-ad63-c1a58719d11f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:09.109989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-aaadd1f1-bbe5-4cf3-ad63-c1a58719d11f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:09.131877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aaadd1f1-bbe5-4cf3-ad63-c1a58719d11f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:09.132374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aaadd1f1-bbe5-4cf3-ad63-c1a58719d11f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:09.139272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aaadd1f1-bbe5-4cf3-ad63-c1a58719d11f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:09.142527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aaadd1f1-bbe5-4cf3-ad63-c1a58719d11f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:09.143367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aaadd1f1-bbe5-4cf3-ad63-c1a58719d11f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:09.146185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aaadd1f1-bbe5-4cf3-ad63-c1a58719d11f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:09.611535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-aaadd1f1-bbe5-4cf3-ad63-c1a58719d11f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:09.630151 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aaadd1f1-bbe5-4cf3-ad63-c1a58719d11f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1314 microversion: 2.1 time: 0.527041 Oct 27 18:46:09.650000 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 215/403] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:09 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:46:09.674646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1081c5dc-2f04-4a39-aadd-482dac892793 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77144d8cdd134333ae77e2df1c022ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f8835dd20640b7a48c16bfef72e4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:09.713096 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1081c5dc-2f04-4a39-aadd-482dac892793 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 200 len: 1416 microversion: 2.1 time: 1.067563 Oct 27 18:46:09.714811 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 189/404] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:08 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 1416 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:09.766047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-35a6c4e4-1c0e-451e-8283-92a846a5b8e7 req-fe89f988-ea37-4839-88fb-e9ee8650f41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20197946-daa3-44ae-9c98-e9ba238df184", "name": "network-vif-deleted", "tag": "d9b04de2-1137-4c7c-82dd-5120635edab6"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:09.795104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-35a6c4e4-1c0e-451e-8283-92a846a5b8e7 req-fe89f988-ea37-4839-88fb-e9ee8650f41f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:09.795605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-35a6c4e4-1c0e-451e-8283-92a846a5b8e7 req-fe89f988-ea37-4839-88fb-e9ee8650f41f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:09.796039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-35a6c4e4-1c0e-451e-8283-92a846a5b8e7 req-fe89f988-ea37-4839-88fb-e9ee8650f41f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:09.845471 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-35a6c4e4-1c0e-451e-8283-92a846a5b8e7 req-fe89f988-ea37-4839-88fb-e9ee8650f41f service nova] Creating event network-vif-deleted:d9b04de2-1137-4c7c-82dd-5120635edab6 for instance 20197946-daa3-44ae-9c98-e9ba238df184 on n-h1-860687-3 Oct 27 18:46:09.868451 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-35a6c4e4-1c0e-451e-8283-92a846a5b8e7 req-fe89f988-ea37-4839-88fb-e9ee8650f41f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102658 Oct 27 18:46:09.869124 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 216/405] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:09.960047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-265104b6-b1a8-4b8b-b45d-7132cbc1a9a8 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:09.960660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-265104b6-b1a8-4b8b-b45d-7132cbc1a9a8 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:09.970581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-265104b6-b1a8-4b8b-b45d-7132cbc1a9a8 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:09.971081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-265104b6-b1a8-4b8b-b45d-7132cbc1a9a8 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:09.971523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-265104b6-b1a8-4b8b-b45d-7132cbc1a9a8 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:09.972238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-265104b6-b1a8-4b8b-b45d-7132cbc1a9a8 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:09.972693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-265104b6-b1a8-4b8b-b45d-7132cbc1a9a8 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:09.973123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-265104b6-b1a8-4b8b-b45d-7132cbc1a9a8 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:10.488163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-265104b6-b1a8-4b8b-b45d-7132cbc1a9a8 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:10.498802 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-265104b6-b1a8-4b8b-b45d-7132cbc1a9a8 tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1479 microversion: 2.1 time: 0.543222 Oct 27 18:46:10.519030 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 190/406] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:09 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1479 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:10.657073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a152bf86-dd87-4f18-826e-15ac9d11f64a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:10.657792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a152bf86-dd87-4f18-826e-15ac9d11f64a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:10.672121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a152bf86-dd87-4f18-826e-15ac9d11f64a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:10.673042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a152bf86-dd87-4f18-826e-15ac9d11f64a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:10.673699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a152bf86-dd87-4f18-826e-15ac9d11f64a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:10.674477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a152bf86-dd87-4f18-826e-15ac9d11f64a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:10.674912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a152bf86-dd87-4f18-826e-15ac9d11f64a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:10.675341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a152bf86-dd87-4f18-826e-15ac9d11f64a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:10.737214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ee29174-ea7e-460c-bf66-43a032d83e4f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:10.737838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ee29174-ea7e-460c-bf66-43a032d83e4f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:10.744729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ee29174-ea7e-460c-bf66-43a032d83e4f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:10.745454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ee29174-ea7e-460c-bf66-43a032d83e4f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:10.746242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ee29174-ea7e-460c-bf66-43a032d83e4f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:10.747836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ee29174-ea7e-460c-bf66-43a032d83e4f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:10.748446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ee29174-ea7e-460c-bf66-43a032d83e4f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:10.749244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ee29174-ea7e-460c-bf66-43a032d83e4f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:10.770644 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-9ee29174-ea7e-460c-bf66-43a032d83e4f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] HTTP exception thrown: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ee29174-ea7e-460c-bf66-43a032d83e4f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Request method failure captured: Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 HTTP/1.1 Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGpZNkL-xSL-kMQjkWU1-gnc5d_8D7aOSjp-FIIKMyv1HD17dpxM5I-gxSVYLDsLpKhilaar6Yun8tRMCXFQFYE1xGmxDTceUZXwcylenMwHg7S4gjxyIN3gxIqBEJj48ELrDt_ieHkD5G1nTqEuvAXRrfE4P0g29S-XtX4vyqSM0g Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 20f8835dd20640b7a48c16bfef72e4ad Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:10.772860 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:10.774360 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20f8835dd20640b7a48c16bfef72e4ad", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:10.774360 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.774360 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 20f8835dd20640b7a48c16bfef72e4ad Oct 27 18:46:10.774360 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.774360 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersAdminTestJSON-1333743885-project Oct 27 18:46:10.774360 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:10.774360 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:10.774360 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 77144d8cdd134333ae77e2df1c022ea8 Oct 27 18:46:10.774360 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersAdminTestJSON-1333743885-project Oct 27 18:46:10.774360 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:46:10.774360 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.774360 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '20197946-daa3-44ae-9c98-e9ba238df184'} Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:10.775168 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.776236 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.778962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ee29174-ea7e-460c-bf66-43a032d83e4f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Returning 404 to user: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:10.780279 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ee29174-ea7e-460c-bf66-43a032d83e4f tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 404 len: 111 microversion: 2.1 time: 0.046819 Oct 27 18:46:10.788924 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 191/407] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:10 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:46:10.800556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a3f64919-1771-4f9b-aa8b-27577f64111e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:10.801283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a3f64919-1771-4f9b-aa8b-27577f64111e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:10.816240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3f64919-1771-4f9b-aa8b-27577f64111e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:10.819588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3f64919-1771-4f9b-aa8b-27577f64111e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:10.819588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3f64919-1771-4f9b-aa8b-27577f64111e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:10.819588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3f64919-1771-4f9b-aa8b-27577f64111e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:10.819588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3f64919-1771-4f9b-aa8b-27577f64111e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:10.820671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3f64919-1771-4f9b-aa8b-27577f64111e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:10.838173 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-a3f64919-1771-4f9b-aa8b-27577f64111e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] HTTP exception thrown: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a3f64919-1771-4f9b-aa8b-27577f64111e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Request method failure captured: Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 HTTP/1.1 Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGpZNkL-xSL-kMQjkWU1-gnc5d_8D7aOSjp-FIIKMyv1HD17dpxM5I-gxSVYLDsLpKhilaar6Yun8tRMCXFQFYE1xGmxDTceUZXwcylenMwHg7S4gjxyIN3gxIqBEJj48ELrDt_ieHkD5G1nTqEuvAXRrfE4P0g29S-XtX4vyqSM0g Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 20f8835dd20640b7a48c16bfef72e4ad Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:10.841713 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:10.842869 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20f8835dd20640b7a48c16bfef72e4ad", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:10.842869 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.842869 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 20f8835dd20640b7a48c16bfef72e4ad Oct 27 18:46:10.842869 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.842869 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersAdminTestJSON-1333743885-project Oct 27 18:46:10.842869 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:10.842869 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:10.842869 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 77144d8cdd134333ae77e2df1c022ea8 Oct 27 18:46:10.842869 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersAdminTestJSON-1333743885-project Oct 27 18:46:10.842869 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:46:10.842869 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.842869 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '20197946-daa3-44ae-9c98-e9ba238df184'} Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:10.843502 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.844880 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.851087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a3f64919-1771-4f9b-aa8b-27577f64111e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Returning 404 to user: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:10.851990 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a3f64919-1771-4f9b-aa8b-27577f64111e tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "DELETE /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 404 len: 111 microversion: 2.1 time: 0.056740 Oct 27 18:46:10.858741 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 192/408] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:46:10 2022] DELETE /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:10.866443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d382a27b-abea-4321-9111-687c98bfca4c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:10.867182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d382a27b-abea-4321-9111-687c98bfca4c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 20197946-daa3-44ae-9c98-e9ba238df184] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:10.874595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d382a27b-abea-4321-9111-687c98bfca4c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:10.876178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d382a27b-abea-4321-9111-687c98bfca4c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:10.876178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d382a27b-abea-4321-9111-687c98bfca4c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:10.876758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d382a27b-abea-4321-9111-687c98bfca4c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:10.877289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d382a27b-abea-4321-9111-687c98bfca4c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:10.877980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d382a27b-abea-4321-9111-687c98bfca4c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:10.899900 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d382a27b-abea-4321-9111-687c98bfca4c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] HTTP exception thrown: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d382a27b-abea-4321-9111-687c98bfca4c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Request method failure captured: Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 HTTP/1.1 Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGpZNkL-xSL-kMQjkWU1-gnc5d_8D7aOSjp-FIIKMyv1HD17dpxM5I-gxSVYLDsLpKhilaar6Yun8tRMCXFQFYE1xGmxDTceUZXwcylenMwHg7S4gjxyIN3gxIqBEJj48ELrDt_ieHkD5G1nTqEuvAXRrfE4P0g29S-XtX4vyqSM0g Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 20f8835dd20640b7a48c16bfef72e4ad Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:10.901504 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:10.902662 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20f8835dd20640b7a48c16bfef72e4ad", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:10.902662 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.902662 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 20f8835dd20640b7a48c16bfef72e4ad Oct 27 18:46:10.902662 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.902662 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersAdminTestJSON-1333743885-project Oct 27 18:46:10.902662 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:10.902662 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:10.902662 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 77144d8cdd134333ae77e2df1c022ea8 Oct 27 18:46:10.902662 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersAdminTestJSON-1333743885-project Oct 27 18:46:10.902662 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:46:10.902662 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.902662 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '20197946-daa3-44ae-9c98-e9ba238df184'} Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:10.904535 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. Oct 27 18:46:10.905549 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.908292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d382a27b-abea-4321-9111-687c98bfca4c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Returning 404 to user: Instance 20197946-daa3-44ae-9c98-e9ba238df184 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:10.908292 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d382a27b-abea-4321-9111-687c98bfca4c tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184" status: 404 len: 111 microversion: 2.1 time: 0.043072 Oct 27 18:46:10.908292 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 193/409] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:10 2022] GET /compute/v2.1/servers/20197946-daa3-44ae-9c98-e9ba238df184 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:10.912623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9c12665-0657-4d9c-9e23-bc880fdfb4d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:10.913135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d9c12665-0657-4d9c-9e23-bc880fdfb4d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:10.921276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9c12665-0657-4d9c-9e23-bc880fdfb4d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:10.921768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9c12665-0657-4d9c-9e23-bc880fdfb4d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:10.922502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9c12665-0657-4d9c-9e23-bc880fdfb4d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:10.923496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9c12665-0657-4d9c-9e23-bc880fdfb4d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:10.924519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9c12665-0657-4d9c-9e23-bc880fdfb4d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:10.924976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9c12665-0657-4d9c-9e23-bc880fdfb4d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:10.943158 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d9c12665-0657-4d9c-9e23-bc880fdfb4d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] HTTP exception thrown: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9c12665-0657-4d9c-9e23-bc880fdfb4d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Request method failure captured: Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 HTTP/1.1 Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGpZNkL-xSL-kMQjkWU1-gnc5d_8D7aOSjp-FIIKMyv1HD17dpxM5I-gxSVYLDsLpKhilaar6Yun8tRMCXFQFYE1xGmxDTceUZXwcylenMwHg7S4gjxyIN3gxIqBEJj48ELrDt_ieHkD5G1nTqEuvAXRrfE4P0g29S-XtX4vyqSM0g Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 20f8835dd20640b7a48c16bfef72e4ad Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:10.944775 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:10.945932 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20f8835dd20640b7a48c16bfef72e4ad", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:10.945932 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.945932 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 20f8835dd20640b7a48c16bfef72e4ad Oct 27 18:46:10.945932 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.945932 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersAdminTestJSON-1333743885-project Oct 27 18:46:10.945932 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:10.945932 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:10.945932 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 77144d8cdd134333ae77e2df1c022ea8 Oct 27 18:46:10.945932 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersAdminTestJSON-1333743885-project Oct 27 18:46:10.945932 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:46:10.945932 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:46:10.945932 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '7cdb9a88-0030-489e-ad1a-4a8e02b48412'} Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:10.946595 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:46:10.947726 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.948771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9c12665-0657-4d9c-9e23-bc880fdfb4d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Returning 404 to user: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:10.948771 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d9c12665-0657-4d9c-9e23-bc880fdfb4d8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 404 len: 111 microversion: 2.1 time: 0.038015 Oct 27 18:46:10.950190 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 194/410] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:46:10 2022] DELETE /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:46:10.955806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ce3313fa-219c-4f95-a299-5aa8215ce4e8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:10.956558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ce3313fa-219c-4f95-a299-5aa8215ce4e8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] [instance: 7cdb9a88-0030-489e-ad1a-4a8e02b48412] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:10.963677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce3313fa-219c-4f95-a299-5aa8215ce4e8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:10.964414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce3313fa-219c-4f95-a299-5aa8215ce4e8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:10.965159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce3313fa-219c-4f95-a299-5aa8215ce4e8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:10.966653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce3313fa-219c-4f95-a299-5aa8215ce4e8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:10.967257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce3313fa-219c-4f95-a299-5aa8215ce4e8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:10.967862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce3313fa-219c-4f95-a299-5aa8215ce4e8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:10.983802 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-ce3313fa-219c-4f95-a299-5aa8215ce4e8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] HTTP exception thrown: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ce3313fa-219c-4f95-a299-5aa8215ce4e8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Request method failure captured: Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 HTTP/1.1 Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGpZNkL-xSL-kMQjkWU1-gnc5d_8D7aOSjp-FIIKMyv1HD17dpxM5I-gxSVYLDsLpKhilaar6Yun8tRMCXFQFYE1xGmxDTceUZXwcylenMwHg7S4gjxyIN3gxIqBEJj48ELrDt_ieHkD5G1nTqEuvAXRrfE4P0g29S-XtX4vyqSM0g Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 20f8835dd20640b7a48c16bfef72e4ad Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:10.985685 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:10.986912 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20f8835dd20640b7a48c16bfef72e4ad", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20f8835dd20640b7a48c16bfef72e4ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:10.986912 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.986912 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 20f8835dd20640b7a48c16bfef72e4ad Oct 27 18:46:10.986912 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1333743885 Oct 27 18:46:10.986912 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersAdminTestJSON-1333743885-project Oct 27 18:46:10.986912 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:10.986912 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:10.986912 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 77144d8cdd134333ae77e2df1c022ea8 Oct 27 18:46:10.986912 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersAdminTestJSON-1333743885-project Oct 27 18:46:10.986912 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:46:10.986912 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:46:10.986912 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '7cdb9a88-0030-489e-ad1a-4a8e02b48412'} Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:10.987543 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. Oct 27 18:46:10.988550 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:10.991297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ce3313fa-219c-4f95-a299-5aa8215ce4e8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] Returning 404 to user: Instance 7cdb9a88-0030-489e-ad1a-4a8e02b48412 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:10.992463 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ce3313fa-219c-4f95-a299-5aa8215ce4e8 tempest-DeleteServersAdminTestJSON-1333743885 tempest-DeleteServersAdminTestJSON-1333743885-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412" status: 404 len: 111 microversion: 2.1 time: 0.041283 Oct 27 18:46:10.996237 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 195/411] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:10 2022] GET /compute/v2.1/servers/7cdb9a88-0030-489e-ad1a-4a8e02b48412 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:11.245307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a152bf86-dd87-4f18-826e-15ac9d11f64a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:11.259422 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a152bf86-dd87-4f18-826e-15ac9d11f64a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1314 microversion: 2.1 time: 0.606704 Oct 27 18:46:11.275142 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 217/412] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:10 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:11.526860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0586300a-3ca3-4cec-8139-85715857a17d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:11.528842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0586300a-3ca3-4cec-8139-85715857a17d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:11.546519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0586300a-3ca3-4cec-8139-85715857a17d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:11.551245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0586300a-3ca3-4cec-8139-85715857a17d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:11.551929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0586300a-3ca3-4cec-8139-85715857a17d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:11.554702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0586300a-3ca3-4cec-8139-85715857a17d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:11.556426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0586300a-3ca3-4cec-8139-85715857a17d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:11.557100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0586300a-3ca3-4cec-8139-85715857a17d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:11.788292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0586300a-3ca3-4cec-8139-85715857a17d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e6b9746814167abf1f3088468a87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2469694f60446648bdd4fe005a7f17b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:11.807723 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0586300a-3ca3-4cec-8139-85715857a17d tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 200 len: 1437 microversion: 2.1 time: 0.282886 Oct 27 18:46:11.809546 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 196/413] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:11 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 1437 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:12.149674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-0e95ce91-0cfe-4157-810b-3db1defccfa0 req-ba76d265-d800-47d4-9d61-8d8d2bf14ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d432d309-21c5-4225-9d63-b988bc43c2dc", "name": "network-vif-deleted", "tag": "a10d0d4c-7a3f-4a82-86b4-28517b22b876"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:12.179802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0e95ce91-0cfe-4157-810b-3db1defccfa0 req-ba76d265-d800-47d4-9d61-8d8d2bf14ac4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:12.180469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0e95ce91-0cfe-4157-810b-3db1defccfa0 req-ba76d265-d800-47d4-9d61-8d8d2bf14ac4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:12.181207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0e95ce91-0cfe-4157-810b-3db1defccfa0 req-ba76d265-d800-47d4-9d61-8d8d2bf14ac4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:12.204911 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-0e95ce91-0cfe-4157-810b-3db1defccfa0 req-ba76d265-d800-47d4-9d61-8d8d2bf14ac4 service nova] Creating event network-vif-deleted:a10d0d4c-7a3f-4a82-86b4-28517b22b876 for instance d432d309-21c5-4225-9d63-b988bc43c2dc on n-h2-860687-3 Oct 27 18:46:12.217411 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-0e95ce91-0cfe-4157-810b-3db1defccfa0 req-ba76d265-d800-47d4-9d61-8d8d2bf14ac4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092519 Oct 27 18:46:12.227409 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 218/414] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:46:12.288487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f9e1ba33-86b5-4b76-896f-0f82de9852ce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:12.289116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f9e1ba33-86b5-4b76-896f-0f82de9852ce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:12.309080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9e1ba33-86b5-4b76-896f-0f82de9852ce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:12.309871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9e1ba33-86b5-4b76-896f-0f82de9852ce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:12.314113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9e1ba33-86b5-4b76-896f-0f82de9852ce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:12.317209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9e1ba33-86b5-4b76-896f-0f82de9852ce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:12.319254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9e1ba33-86b5-4b76-896f-0f82de9852ce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:12.319733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9e1ba33-86b5-4b76-896f-0f82de9852ce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:12.812454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f9e1ba33-86b5-4b76-896f-0f82de9852ce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:12.825915 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f9e1ba33-86b5-4b76-896f-0f82de9852ce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1463 microversion: 2.1 time: 0.542035 Oct 27 18:46:12.827174 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 197/415] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:12 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1463 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:12.844863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-22e4a650-0989-403d-aaba-2969a9f6829e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:12.846150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-22e4a650-0989-403d-aaba-2969a9f6829e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] [instance: d432d309-21c5-4225-9d63-b988bc43c2dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:12.876985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e4a650-0989-403d-aaba-2969a9f6829e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:12.877861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e4a650-0989-403d-aaba-2969a9f6829e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:12.885102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e4a650-0989-403d-aaba-2969a9f6829e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:12.886656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e4a650-0989-403d-aaba-2969a9f6829e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:12.888239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e4a650-0989-403d-aaba-2969a9f6829e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:12.889474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e4a650-0989-403d-aaba-2969a9f6829e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:12.931693 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-22e4a650-0989-403d-aaba-2969a9f6829e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] HTTP exception thrown: Instance d432d309-21c5-4225-9d63-b988bc43c2dc could not be found. Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-22e4a650-0989-403d-aaba-2969a9f6829e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Request method failure captured: Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc HTTP/1.1 Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtHV4XmdQ8R1zb4FiFXvW3ML3SIMrL4sRwPXKVekG0jnsoVhVE_a6t9_RW068ZAjhLMVTLlXmeYBz2HAp4Ck0S2H2iy9VkGYFHOVLfJZeIFRTl9ib9EVjDD1mZV2HTaDVAmD7ysKFi0rh8uQQ1Wcwg3TM4mfu3Agpve9jmIaqaJPeRw Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f2469694f60446648bdd4fe005a7f17b Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-634192142 Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:46:12.942462 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:46:12.944769 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f2469694f60446648bdd4fe005a7f17b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2469694f60446648bdd4fe005a7f17b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f2469694f60446648bdd4fe005a7f17b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2469694f60446648bdd4fe005a7f17b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:12.944769 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-634192142 Oct 27 18:46:12.944769 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f2469694f60446648bdd4fe005a7f17b Oct 27 18:46:12.944769 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-634192142 Oct 27 18:46:12.944769 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerDiagnosticsNegativeTest-634192142-project Oct 27 18:46:12.944769 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:46:12.944769 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:46:12.944769 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a76e6b9746814167abf1f3088468a87c Oct 27 18:46:12.944769 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-634192142-project Oct 27 18:46:12.944769 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:46:12.944769 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance d432d309-21c5-4225-9d63-b988bc43c2dc could not be found. Oct 27 18:46:12.944769 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'd432d309-21c5-4225-9d63-b988bc43c2dc'} Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d432d309-21c5-4225-9d63-b988bc43c2dc could not be found. Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:12.946505 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d432d309-21c5-4225-9d63-b988bc43c2dc could not be found. Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d432d309-21c5-4225-9d63-b988bc43c2dc could not be found. Oct 27 18:46:12.947817 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:12.949238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-22e4a650-0989-403d-aaba-2969a9f6829e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] Returning 404 to user: Instance d432d309-21c5-4225-9d63-b988bc43c2dc could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:12.949742 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-22e4a650-0989-403d-aaba-2969a9f6829e tempest-ServerDiagnosticsNegativeTest-634192142 tempest-ServerDiagnosticsNegativeTest-634192142-project] 10.222.0.42 "GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc" status: 404 len: 111 microversion: 2.1 time: 0.115659 Oct 27 18:46:12.951191 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 219/416] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:12 2022] GET /compute/v2.1/servers/d432d309-21c5-4225-9d63-b988bc43c2dc => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:13.446779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1f0898dd-7d5d-4c9f-a4e2-6e41b9c6dd32 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:13.460358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1f0898dd-7d5d-4c9f-a4e2-6e41b9c6dd32 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Searching by: {'deleted': False, 'project_id': 'a11017c36a3c4562930899e7619e0661'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:46:13.485234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f0898dd-7d5d-4c9f-a4e2-6e41b9c6dd32 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:13.488952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f0898dd-7d5d-4c9f-a4e2-6e41b9c6dd32 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:13.495981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f0898dd-7d5d-4c9f-a4e2-6e41b9c6dd32 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:13.499458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f0898dd-7d5d-4c9f-a4e2-6e41b9c6dd32 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:13.499958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f0898dd-7d5d-4c9f-a4e2-6e41b9c6dd32 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:13.500400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f0898dd-7d5d-4c9f-a4e2-6e41b9c6dd32 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:13.775090 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1f0898dd-7d5d-4c9f-a4e2-6e41b9c6dd32 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.921929 Oct 27 18:46:13.776800 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 198/417] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:46:12 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:46:13.799814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e072dd39-1897-461d-9d0d-8608951487dc tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:13.809931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e072dd39-1897-461d-9d0d-8608951487dc tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Searching by: {'deleted': False} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:46:13.817731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e072dd39-1897-461d-9d0d-8608951487dc tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:13.818464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e072dd39-1897-461d-9d0d-8608951487dc tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:13.819080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e072dd39-1897-461d-9d0d-8608951487dc tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:13.819978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e072dd39-1897-461d-9d0d-8608951487dc tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:13.820582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e072dd39-1897-461d-9d0d-8608951487dc tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:13.821320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e072dd39-1897-461d-9d0d-8608951487dc tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:13.963941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-e072dd39-1897-461d-9d0d-8608951487dc tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:46:14.140072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e072dd39-1897-461d-9d0d-8608951487dc tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:14.140529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e072dd39-1897-461d-9d0d-8608951487dc tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:14.142308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e072dd39-1897-461d-9d0d-8608951487dc tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:15.163086 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e072dd39-1897-461d-9d0d-8608951487dc tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 6672 microversion: 2.1 time: 1.366977 Oct 27 18:46:15.180222 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 220/418] 10.222.0.42 () {58 vars in 1171 bytes} [Thu Oct 27 18:46:13 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 6672 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:15.207989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8865214b-aed3-4934-a06b-c3f5f15bc3d3 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:15.225982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8865214b-aed3-4934-a06b-c3f5f15bc3d3 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Searching by: {'deleted': False, 'project_id': 'a11017c36a3c4562930899e7619e0661'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:46:15.247029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8865214b-aed3-4934-a06b-c3f5f15bc3d3 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:15.247997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8865214b-aed3-4934-a06b-c3f5f15bc3d3 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:15.249429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8865214b-aed3-4934-a06b-c3f5f15bc3d3 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:15.251302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8865214b-aed3-4934-a06b-c3f5f15bc3d3 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:15.254946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8865214b-aed3-4934-a06b-c3f5f15bc3d3 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:15.256604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8865214b-aed3-4934-a06b-c3f5f15bc3d3 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:15.345515 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8865214b-aed3-4934-a06b-c3f5f15bc3d3 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?tenant_id=ee37570c43c8438faad6c2bcdbacce99" status: 200 len: 15 microversion: 2.1 time: 0.142147 Oct 27 18:46:15.349020 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 199/419] 10.222.0.42 () {58 vars in 1231 bytes} [Thu Oct 27 18:46:15 2022] GET /compute/v2.1/servers/detail?tenant_id=ee37570c43c8438faad6c2bcdbacce99 => generated 15 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 18:46:15.376464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c521c833-9c87-41fa-b03c-4659d163ac00 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:15.393701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c521c833-9c87-41fa-b03c-4659d163ac00 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Searching by: {'tenant_id': 'ee37570c43c8438faad6c2bcdbacce99', 'deleted': False} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:46:15.406436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c521c833-9c87-41fa-b03c-4659d163ac00 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:15.406942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c521c833-9c87-41fa-b03c-4659d163ac00 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:15.407380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c521c833-9c87-41fa-b03c-4659d163ac00 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:15.410844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c521c833-9c87-41fa-b03c-4659d163ac00 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:15.413224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c521c833-9c87-41fa-b03c-4659d163ac00 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:15.413985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c521c833-9c87-41fa-b03c-4659d163ac00 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:15.758271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-c521c833-9c87-41fa-b03c-4659d163ac00 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:46:16.018447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:16.032343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c521c833-9c87-41fa-b03c-4659d163ac00 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:16.032835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c521c833-9c87-41fa-b03c-4659d163ac00 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:16.040279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c521c833-9c87-41fa-b03c-4659d163ac00 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:16.791745 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c521c833-9c87-41fa-b03c-4659d163ac00 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ee37570c43c8438faad6c2bcdbacce99" status: 200 len: 4825 microversion: 2.1 time: 1.420225 Oct 27 18:46:16.792747 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 221/420] 10.222.0.42 () {58 vars in 1257 bytes} [Thu Oct 27 18:46:15 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ee37570c43c8438faad6c2bcdbacce99 => generated 4825 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:46:16.822524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6e521299-98cb-4b18-b9aa-32e158a6a37d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:16.831551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6e521299-98cb-4b18-b9aa-32e158a6a37d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Searching by: {'tenant_id': 'a11017c36a3c4562930899e7619e0661', 'deleted': False} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:46:16.839607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e521299-98cb-4b18-b9aa-32e158a6a37d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:16.842233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e521299-98cb-4b18-b9aa-32e158a6a37d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:16.843041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e521299-98cb-4b18-b9aa-32e158a6a37d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:16.844178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e521299-98cb-4b18-b9aa-32e158a6a37d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:16.844836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e521299-98cb-4b18-b9aa-32e158a6a37d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:16.845471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e521299-98cb-4b18-b9aa-32e158a6a37d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:16.888924 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6e521299-98cb-4b18-b9aa-32e158a6a37d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a11017c36a3c4562930899e7619e0661" status: 200 len: 15 microversion: 2.1 time: 0.070732 Oct 27 18:46:16.889756 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 200/421] 10.222.0.42 () {58 vars in 1257 bytes} [Thu Oct 27 18:46:16 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a11017c36a3c4562930899e7619e0661 => generated 15 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:46:16.916254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-068c552d-9e5e-495e-9de3-cc2d4795fca0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:16.922724 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-068c552d-9e5e-495e-9de3-cc2d4795fca0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.011184 Oct 27 18:46:16.935833 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 222/422] 10.222.0.42 () {58 vars in 1189 bytes} [Thu Oct 27 18:46:16 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:46:16.953940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-beaa7519-3630-40bd-a15f-7468d0107222 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:16.956876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-beaa7519-3630-40bd-a15f-7468d0107222 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:16.963617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beaa7519-3630-40bd-a15f-7468d0107222 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:16.964440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beaa7519-3630-40bd-a15f-7468d0107222 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:16.966552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beaa7519-3630-40bd-a15f-7468d0107222 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:16.967760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beaa7519-3630-40bd-a15f-7468d0107222 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:16.968461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beaa7519-3630-40bd-a15f-7468d0107222 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:16.969108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beaa7519-3630-40bd-a15f-7468d0107222 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:17.165326 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-beaa7519-3630-40bd-a15f-7468d0107222 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268/action" status: 202 len: 0 microversion: 2.1 time: 0.216820 Oct 27 18:46:17.167286 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 201/423] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:46:16 2022] POST /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:46:17.175774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e2b5d417-c07d-4ff9-8acf-628007ae8e50 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:17.186049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e2b5d417-c07d-4ff9-8acf-628007ae8e50 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:17.191402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e2b5d417-c07d-4ff9-8acf-628007ae8e50 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:46:17.212546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2b5d417-c07d-4ff9-8acf-628007ae8e50 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:17.223457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2b5d417-c07d-4ff9-8acf-628007ae8e50 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:17.224092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2b5d417-c07d-4ff9-8acf-628007ae8e50 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:17.228865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2b5d417-c07d-4ff9-8acf-628007ae8e50 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:17.230459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2b5d417-c07d-4ff9-8acf-628007ae8e50 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:17.231920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2b5d417-c07d-4ff9-8acf-628007ae8e50 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:17.429527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-e2b5d417-c07d-4ff9-8acf-628007ae8e50 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:46:17.691030 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e2b5d417-c07d-4ff9-8acf-628007ae8e50 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.508294 Oct 27 18:46:17.691030 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 202/424] 10.222.0.42 () {58 vars in 1150 bytes} [Thu Oct 27 18:46:17 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:17.700185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2584f72e-3763-416f-bd00-8c73cf12bfb0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:17.706817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2584f72e-3763-416f-bd00-8c73cf12bfb0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:17.718365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2584f72e-3763-416f-bd00-8c73cf12bfb0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:17.720287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2584f72e-3763-416f-bd00-8c73cf12bfb0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:17.726053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2584f72e-3763-416f-bd00-8c73cf12bfb0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:17.727276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2584f72e-3763-416f-bd00-8c73cf12bfb0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:17.729185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2584f72e-3763-416f-bd00-8c73cf12bfb0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:17.729714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2584f72e-3763-416f-bd00-8c73cf12bfb0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:17.885468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ba3b4b14-39fa-4873-8ef4-5967e1c5c8f7 tempest-AZAdminNegativeTestJSON-1887529881 tempest-AZAdminNegativeTestJSON-1887529881-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:17.889649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ba3b4b14-39fa-4873-8ef4-5967e1c5c8f7 tempest-AZAdminNegativeTestJSON-1887529881 tempest-AZAdminNegativeTestJSON-1887529881-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '55fcdf59808d48878f73adc83fab7474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5db0aee3cd3418db3a30c6354cad53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ba3b4b14-39fa-4873-8ef4-5967e1c5c8f7 tempest-AZAdminNegativeTestJSON-1887529881 tempest-AZAdminNegativeTestJSON-1887529881-project] Request method failure captured: Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtH23F6RR2ecNO2cW5dsblFCCp-tYI4HkDs0q8w3scFnMX6R_96MtwIuCrrlPIF5061K11Id65SJrZLtVF3KxOFrC-9f9olz3RTaXyjWO2XO4pdoxExaAccG5QgYCijAhCBXafUNPy7XlYdqoBm04MxfjHAebIKa1MIgfy8CABiMA9Y Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: a5db0aee3cd3418db3a30c6354cad53a Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1887529881 Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:46:17.906725 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:46:17.908336 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a5db0aee3cd3418db3a30c6354cad53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a5db0aee3cd3418db3a30c6354cad53a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a5db0aee3cd3418db3a30c6354cad53a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a5db0aee3cd3418db3a30c6354cad53a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:17.908336 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AZAdminNegativeTestJSON-1887529881 Oct 27 18:46:17.908336 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: a5db0aee3cd3418db3a30c6354cad53a Oct 27 18:46:17.908336 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1887529881 Oct 27 18:46:17.908336 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AZAdminNegativeTestJSON-1887529881-project Oct 27 18:46:17.908336 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:46:17.908336 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:46:17.908336 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 55fcdf59808d48878f73adc83fab7474 Oct 27 18:46:17.908336 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AZAdminNegativeTestJSON-1887529881-project Oct 27 18:46:17.908336 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:46:17.908336 n-d-860687-3 devstack@n-api.service[127029]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 27 18:46:17.908336 n-d-860687-3 devstack@n-api.service[127029]: action_args: {} Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:17.909175 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 27 18:46:17.910677 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:17.915063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ba3b4b14-39fa-4873-8ef4-5967e1c5c8f7 tempest-AZAdminNegativeTestJSON-1887529881 tempest-AZAdminNegativeTestJSON-1887529881-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:17.921387 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ba3b4b14-39fa-4873-8ef4-5967e1c5c8f7 tempest-AZAdminNegativeTestJSON-1887529881 tempest-AZAdminNegativeTestJSON-1887529881-project] 10.222.0.42 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.903556 Oct 27 18:46:17.924359 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 223/425] 10.222.0.42 () {58 vars in 1185 bytes} [Thu Oct 27 18:46:17 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 910 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:17.932821 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2584f72e-3763-416f-bd00-8c73cf12bfb0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268/action" status: 202 len: 0 microversion: 2.1 time: 0.240701 Oct 27 18:46:17.939937 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 203/426] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:46:17 2022] POST /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 18:46:17.945167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e475dc37-d9e6-48f5-9440-ee1ecd67569b tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:17.945798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e475dc37-d9e6-48f5-9440-ee1ecd67569b tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:17.960138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e475dc37-d9e6-48f5-9440-ee1ecd67569b tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:17.960650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e475dc37-d9e6-48f5-9440-ee1ecd67569b tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:17.966253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e475dc37-d9e6-48f5-9440-ee1ecd67569b tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:17.967384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e475dc37-d9e6-48f5-9440-ee1ecd67569b tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:17.968039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e475dc37-d9e6-48f5-9440-ee1ecd67569b tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:17.970104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e475dc37-d9e6-48f5-9440-ee1ecd67569b tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:18.275575 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e475dc37-d9e6-48f5-9440-ee1ecd67569b tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1614 microversion: 2.1 time: 0.334896 Oct 27 18:46:18.279208 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 224/427] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:17 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1614 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:18.302916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0858ebd3-bad0-4f2f-ae2c-3044cfc21feb tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:18.303977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0858ebd3-bad0-4f2f-ae2c-3044cfc21feb tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:18.312516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0858ebd3-bad0-4f2f-ae2c-3044cfc21feb tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:18.313481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0858ebd3-bad0-4f2f-ae2c-3044cfc21feb tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:18.314212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0858ebd3-bad0-4f2f-ae2c-3044cfc21feb tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:18.318590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0858ebd3-bad0-4f2f-ae2c-3044cfc21feb tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:18.320571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0858ebd3-bad0-4f2f-ae2c-3044cfc21feb tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:18.321327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0858ebd3-bad0-4f2f-ae2c-3044cfc21feb tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:18.622541 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0858ebd3-bad0-4f2f-ae2c-3044cfc21feb tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1614 microversion: 2.1 time: 0.318121 Oct 27 18:46:18.625323 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 204/428] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:18 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1614 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:18.646066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8688f6b9-aa60-4e6c-a306-644ed188437a tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:18.655323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8688f6b9-aa60-4e6c-a306-644ed188437a tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Searching by: {'host': 'n-h2-860687-3', 'deleted': False} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:46:18.669973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8688f6b9-aa60-4e6c-a306-644ed188437a tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:18.670577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8688f6b9-aa60-4e6c-a306-644ed188437a tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:18.672579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8688f6b9-aa60-4e6c-a306-644ed188437a tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:18.674062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8688f6b9-aa60-4e6c-a306-644ed188437a tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:18.674940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8688f6b9-aa60-4e6c-a306-644ed188437a tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:18.675687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8688f6b9-aa60-4e6c-a306-644ed188437a tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:18.834646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-8688f6b9-aa60-4e6c-a306-644ed188437a tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:46:18.977058 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8688f6b9-aa60-4e6c-a306-644ed188437a tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "GET /compute/v2.1/servers?host=n-h2-860687-3&all_tenants=1" status: 200 len: 989 microversion: 2.1 time: 0.330788 Oct 27 18:46:18.978869 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 225/429] 10.222.0.42 () {58 vars in 1190 bytes} [Thu Oct 27 18:46:18 2022] GET /compute/v2.1/servers?host=n-h2-860687-3&all_tenants=1 => generated 989 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:18.992131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c781ccff-094b-4e11-8fa4-afde4c6ffdf9 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:18.999095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c781ccff-094b-4e11-8fa4-afde4c6ffdf9 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:46:19.016863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c781ccff-094b-4e11-8fa4-afde4c6ffdf9 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:19.017746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c781ccff-094b-4e11-8fa4-afde4c6ffdf9 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:19.020623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c781ccff-094b-4e11-8fa4-afde4c6ffdf9 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:19.021609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c781ccff-094b-4e11-8fa4-afde4c6ffdf9 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:19.023853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c781ccff-094b-4e11-8fa4-afde4c6ffdf9 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:19.024312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c781ccff-094b-4e11-8fa4-afde4c6ffdf9 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:19.214705 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c781ccff-094b-4e11-8fa4-afde4c6ffdf9 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.226035 Oct 27 18:46:19.216150 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 205/430] 10.222.0.42 () {58 vars in 1196 bytes} [Thu Oct 27 18:46:18 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:46:19.233651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2bb969a3-fe31-4281-b8f0-91b3843aaa3d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:19.239864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2bb969a3-fe31-4281-b8f0-91b3843aaa3d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:19.267813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bb969a3-fe31-4281-b8f0-91b3843aaa3d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:19.270098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bb969a3-fe31-4281-b8f0-91b3843aaa3d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:19.270610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bb969a3-fe31-4281-b8f0-91b3843aaa3d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:19.272018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bb969a3-fe31-4281-b8f0-91b3843aaa3d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:19.275736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bb969a3-fe31-4281-b8f0-91b3843aaa3d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:19.276688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bb969a3-fe31-4281-b8f0-91b3843aaa3d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:19.441927 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2bb969a3-fe31-4281-b8f0-91b3843aaa3d tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268/action" status: 202 len: 0 microversion: 2.1 time: 0.215345 Oct 27 18:46:19.443697 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 226/431] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:46:19 2022] POST /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 18:46:19.453243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:19.458560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:19.469470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:19.471076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:19.471720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:19.472783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:19.473677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:19.474264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:19.678193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:46:19.680213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:46:19.680708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:46:19.681518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:46:19.683055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:46:19.755902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:19.820819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:19.835994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:19.836504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:19.837650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:19.841777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:19.842267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:19.842746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:19.960532 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-57c8765a-0988-41f9-b2b5-1c4513e5a03c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "POST /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268/action" status: 202 len: 1067 microversion: 2.1 time: 0.511510 Oct 27 18:46:19.962807 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 206/432] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:46:19 2022] POST /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268/action => generated 1067 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 27 18:46:19.986892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d5664781-ba5c-4112-8bd7-6b2f3ffad1fe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:19.987528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d5664781-ba5c-4112-8bd7-6b2f3ffad1fe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:20.006790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5664781-ba5c-4112-8bd7-6b2f3ffad1fe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:20.007239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5664781-ba5c-4112-8bd7-6b2f3ffad1fe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:20.007682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5664781-ba5c-4112-8bd7-6b2f3ffad1fe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:20.008405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5664781-ba5c-4112-8bd7-6b2f3ffad1fe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:20.008974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5664781-ba5c-4112-8bd7-6b2f3ffad1fe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:20.009281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5664781-ba5c-4112-8bd7-6b2f3ffad1fe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:20.787579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d5664781-ba5c-4112-8bd7-6b2f3ffad1fe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:20.799913 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d5664781-ba5c-4112-8bd7-6b2f3ffad1fe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1471 microversion: 2.1 time: 0.817862 Oct 27 18:46:20.806802 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 227/433] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:19 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1471 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:20.982553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dabe0272-a0f4-4d3d-a579-58ffae1aee97 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Calling method '.version_select at 0x7fc86b614700>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:20.987475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dabe0272-a0f4-4d3d-a579-58ffae1aee97 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'f67cd95a7de644438ccde5ba093520fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eafa1a1a4f436b87f07a56783d271e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dabe0272-a0f4-4d3d-a579-58ffae1aee97 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Request method failure captured: Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtH47wVNb7ltVQBZ6FCoYY3I0vJtEj6c0EhWN8-ELPBLefMoUwsJGRVAlabRRi0IHf3im8qG4vzUoGdTROGj9t6MVVIM6TJgnTSVqqVB_fYOJZ-JbOdLEsuYXvZj-qvxCO3s6Ce3YNy68pXpbCw42SRyBtI6OJ4aX1CWxguanpcyC0Y Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: a9eafa1a1a4f436b87f07a56783d271e Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:20.993333 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:20.994804 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a9eafa1a1a4f436b87f07a56783d271e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:20.994804 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:20.994804 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: a9eafa1a1a4f436b87f07a56783d271e Oct 27 18:46:20.994804 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:20.994804 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-HypervisorAdminNegativeTestJSON-405274240-project Oct 27 18:46:20.994804 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:20.994804 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:20.994804 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: f67cd95a7de644438ccde5ba093520fb Oct 27 18:46:20.994804 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-405274240-project Oct 27 18:46:20.994804 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:46:20.994804 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 27 18:46:20.994804 n-d-860687-3 devstack@n-api.service[127028]: action_args: {} Oct 27 18:46:20.994804 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:20.996080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 27 18:46:20.998115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.006508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dabe0272-a0f4-4d3d-a579-58ffae1aee97 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:21.007382 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dabe0272-a0f4-4d3d-a579-58ffae1aee97 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.671500 Oct 27 18:46:21.011866 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 207/434] 10.222.0.42 () {58 vars in 1167 bytes} [Thu Oct 27 18:46:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 676 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:21.017775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a76f34da-ca83-4182-85b3-7620ceac0d18 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Calling method '.version_select at 0x7fc86b6248b0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:21.020375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a76f34da-ca83-4182-85b3-7620ceac0d18 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'f67cd95a7de644438ccde5ba093520fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eafa1a1a4f436b87f07a56783d271e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a76f34da-ca83-4182-85b3-7620ceac0d18 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Request method failure captured: Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtH47wVNb7ltVQBZ6FCoYY3I0vJtEj6c0EhWN8-ELPBLefMoUwsJGRVAlabRRi0IHf3im8qG4vzUoGdTROGj9t6MVVIM6TJgnTSVqqVB_fYOJZ-JbOdLEsuYXvZj-qvxCO3s6Ce3YNy68pXpbCw42SRyBtI6OJ4aX1CWxguanpcyC0Y Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: a9eafa1a1a4f436b87f07a56783d271e Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:46:21.024220 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:46:21.025701 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a9eafa1a1a4f436b87f07a56783d271e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:21.025701 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:21.025701 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: a9eafa1a1a4f436b87f07a56783d271e Oct 27 18:46:21.025701 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:21.025701 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-HypervisorAdminNegativeTestJSON-405274240-project Oct 27 18:46:21.025701 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:46:21.025701 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:46:21.025701 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: f67cd95a7de644438ccde5ba093520fb Oct 27 18:46:21.025701 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-405274240-project Oct 27 18:46:21.025701 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:46:21.025701 n-d-860687-3 devstack@n-api.service[127029]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 27 18:46:21.025701 n-d-860687-3 devstack@n-api.service[127029]: action_args: {} Oct 27 18:46:21.025701 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:21.026600 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 27 18:46:21.027945 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.031236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a76f34da-ca83-4182-85b3-7620ceac0d18 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:21.035381 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a76f34da-ca83-4182-85b3-7620ceac0d18 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.021519 Oct 27 18:46:21.036931 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 228/435] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:46:21 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:46:21.047721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-207c0b16-9d9b-463d-a6d8-8143f351cf3c tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Calling method '.version_select at 0x7fc86b57c5e0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:21.049486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-207c0b16-9d9b-463d-a6d8-8143f351cf3c tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'f67cd95a7de644438ccde5ba093520fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eafa1a1a4f436b87f07a56783d271e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-207c0b16-9d9b-463d-a6d8-8143f351cf3c tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Request method failure captured: Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtH47wVNb7ltVQBZ6FCoYY3I0vJtEj6c0EhWN8-ELPBLefMoUwsJGRVAlabRRi0IHf3im8qG4vzUoGdTROGj9t6MVVIM6TJgnTSVqqVB_fYOJZ-JbOdLEsuYXvZj-qvxCO3s6Ce3YNy68pXpbCw42SRyBtI6OJ4aX1CWxguanpcyC0Y Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: a9eafa1a1a4f436b87f07a56783d271e Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:21.051995 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:21.053457 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a9eafa1a1a4f436b87f07a56783d271e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:21.053457 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:21.053457 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: a9eafa1a1a4f436b87f07a56783d271e Oct 27 18:46:21.053457 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:21.053457 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-HypervisorAdminNegativeTestJSON-405274240-project Oct 27 18:46:21.053457 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:21.053457 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:21.053457 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: f67cd95a7de644438ccde5ba093520fb Oct 27 18:46:21.053457 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-405274240-project Oct 27 18:46:21.053457 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:46:21.053457 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 27 18:46:21.053457 n-d-860687-3 devstack@n-api.service[127028]: action_args: {} Oct 27 18:46:21.053457 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:21.058631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 27 18:46:21.060353 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.061971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-207c0b16-9d9b-463d-a6d8-8143f351cf3c tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:21.061971 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-207c0b16-9d9b-463d-a6d8-8143f351cf3c tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.010646 Oct 27 18:46:21.061971 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 208/436] 10.222.0.42 () {58 vars in 1179 bytes} [Thu Oct 27 18:46:21 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:21.619322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-04fc9603-5c52-4ab3-997e-3bb38620abdb tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Calling method '.version_select at 0x7fc86b59edc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:21.623377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fc9603-5c52-4ab3-997e-3bb38620abdb tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:21.624089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fc9603-5c52-4ab3-997e-3bb38620abdb tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:21.625984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fc9603-5c52-4ab3-997e-3bb38620abdb tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:21.645645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:21.692567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fc9603-5c52-4ab3-997e-3bb38620abdb tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:21.694620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fc9603-5c52-4ab3-997e-3bb38620abdb tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:21.695349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fc9603-5c52-4ab3-997e-3bb38620abdb tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:21.728173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fc9603-5c52-4ab3-997e-3bb38620abdb tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:21.729432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fc9603-5c52-4ab3-997e-3bb38620abdb tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:21.729913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fc9603-5c52-4ab3-997e-3bb38620abdb tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:21.752232 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-04fc9603-5c52-4ab3-997e-3bb38620abdb tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.684871 Oct 27 18:46:21.753214 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 229/437] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:46:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:21.766677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-27b8e108-23e0-4750-b766-569eb0992f60 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Calling method '.version_select at 0x7fc86b6144c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:21.769078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-27b8e108-23e0-4750-b766-569eb0992f60 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'f67cd95a7de644438ccde5ba093520fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eafa1a1a4f436b87f07a56783d271e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-27b8e108-23e0-4750-b766-569eb0992f60 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Request method failure captured: Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtH47wVNb7ltVQBZ6FCoYY3I0vJtEj6c0EhWN8-ELPBLefMoUwsJGRVAlabRRi0IHf3im8qG4vzUoGdTROGj9t6MVVIM6TJgnTSVqqVB_fYOJZ-JbOdLEsuYXvZj-qvxCO3s6Ce3YNy68pXpbCw42SRyBtI6OJ4aX1CWxguanpcyC0Y Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: a9eafa1a1a4f436b87f07a56783d271e Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:21.773512 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:21.774700 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a9eafa1a1a4f436b87f07a56783d271e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:21.774700 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:21.774700 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: a9eafa1a1a4f436b87f07a56783d271e Oct 27 18:46:21.774700 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:21.774700 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-HypervisorAdminNegativeTestJSON-405274240-project Oct 27 18:46:21.774700 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:21.774700 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:21.774700 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: f67cd95a7de644438ccde5ba093520fb Oct 27 18:46:21.774700 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-405274240-project Oct 27 18:46:21.774700 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:46:21.774700 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 27 18:46:21.774700 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '1'} Oct 27 18:46:21.774700 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:21.775602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 27 18:46:21.776743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.781432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-27b8e108-23e0-4750-b766-569eb0992f60 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:21.785838 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-27b8e108-23e0-4750-b766-569eb0992f60 tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.025034 Oct 27 18:46:21.786990 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 209/438] 10.222.0.42 () {58 vars in 1173 bytes} [Thu Oct 27 18:46:21 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:21.799246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-01e4a080-3a72-4a8b-b350-540899ad8614 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Calling method '.version_select at 0x7fc86b5ca3a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:21.801075 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-01e4a080-3a72-4a8b-b350-540899ad8614 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] HTTP exception thrown: Hypervisor with ID '961bd2e0-4f2d-4cd4-9198-9ab4971339bf' could not be found. Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-01e4a080-3a72-4a8b-b350-540899ad8614 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Request method failure captured: Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-hypervisors/961bd2e0-4f2d-4cd4-9198-9ab4971339bf/uptime HTTP/1.1 Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtH7vElDF1U3guK9l2ETnn6Qc6zsDstFO2Yhl-r2CS_iPnMrJsSFJ1981BaHq4HeOlafyANCS_pFywOpfxEcGgLv1gjTgjdhGgNKsUoFYmMCG5KYU6YOBC2Etk-dtBfZrGvpefWJDDMQO5NNEG9KXcE4Tdcr5VgoLPcJjx71H1KjvwQ Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 70be5ca93546422c93159f64e5c0d89f Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2053132234 Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:46:21.811571 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:46:21.812839 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/70be5ca93546422c93159f64e5c0d89f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/70be5ca93546422c93159f64e5c0d89f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_70be5ca93546422c93159f64e5c0d89f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/70be5ca93546422c93159f64e5c0d89f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:21.812839 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2053132234 Oct 27 18:46:21.812839 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 70be5ca93546422c93159f64e5c0d89f Oct 27 18:46:21.812839 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2053132234 Oct 27 18:46:21.812839 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin Oct 27 18:46:21.812839 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:46:21.812839 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:46:21.812839 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 5374b0c4915a42d3a9ddf019fec8ee7a Oct 27 18:46:21.812839 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin Oct 27 18:46:21.812839 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:46:21.812839 n-d-860687-3 devstack@n-api.service[127029]: exception: Hypervisor with ID '961bd2e0-4f2d-4cd4-9198-9ab4971339bf' could not be found. Oct 27 18:46:21.812839 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '961bd2e0-4f2d-4cd4-9198-9ab4971339bf'} Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '961bd2e0-4f2d-4cd4-9198-9ab4971339bf' Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 27 18:46:21.813510 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '961bd2e0-4f2d-4cd4-9198-9ab4971339bf' could not be found. Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:21.814701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.815806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.815806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:21.815806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:21.815806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:21.815806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:21.815806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '961bd2e0-4f2d-4cd4-9198-9ab4971339bf' could not be found. Oct 27 18:46:21.815806 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.815806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-01e4a080-3a72-4a8b-b350-540899ad8614 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Returning 404 to user: Hypervisor with ID '961bd2e0-4f2d-4cd4-9198-9ab4971339bf' could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:21.819223 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-01e4a080-3a72-4a8b-b350-540899ad8614 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/961bd2e0-4f2d-4cd4-9198-9ab4971339bf/uptime" status: 404 len: 123 microversion: 2.1 time: 0.022079 Oct 27 18:46:21.819223 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 230/439] 10.222.0.42 () {58 vars in 1278 bytes} [Thu Oct 27 18:46:21 2022] GET /compute/v2.1/os-hypervisors/961bd2e0-4f2d-4cd4-9198-9ab4971339bf/uptime => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:21.829814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-685094be-1906-4f5c-8950-760a7dad3b44 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Calling method '.version_select at 0x7fc86b57c5e0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:21.834698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685094be-1906-4f5c-8950-760a7dad3b44 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:21.835465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685094be-1906-4f5c-8950-760a7dad3b44 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:21.836158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685094be-1906-4f5c-8950-760a7dad3b44 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:21.851058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-07813d35-e6ff-4a70-951b-785540b62337 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:21.852465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-07813d35-e6ff-4a70-951b-785540b62337 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:21.879684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685094be-1906-4f5c-8950-760a7dad3b44 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:21.880144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07813d35-e6ff-4a70-951b-785540b62337 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:21.881451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07813d35-e6ff-4a70-951b-785540b62337 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:21.882122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07813d35-e6ff-4a70-951b-785540b62337 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:21.883093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07813d35-e6ff-4a70-951b-785540b62337 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:21.885387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07813d35-e6ff-4a70-951b-785540b62337 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:21.886288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685094be-1906-4f5c-8950-760a7dad3b44 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:21.887549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07813d35-e6ff-4a70-951b-785540b62337 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:21.889434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685094be-1906-4f5c-8950-760a7dad3b44 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:21.930281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685094be-1906-4f5c-8950-760a7dad3b44 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:21.931073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685094be-1906-4f5c-8950-760a7dad3b44 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:21.931795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685094be-1906-4f5c-8950-760a7dad3b44 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:21.944897 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-685094be-1906-4f5c-8950-760a7dad3b44 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.121179 Oct 27 18:46:21.948436 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 210/440] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:46:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:46:21.960769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9b628f8-6ab9-40f2-90ee-31e3bf56c3ee tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Calling method '.version_select at 0x7fc86b614f70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:21.963049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d9b628f8-6ab9-40f2-90ee-31e3bf56c3ee tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'f67cd95a7de644438ccde5ba093520fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eafa1a1a4f436b87f07a56783d271e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9b628f8-6ab9-40f2-90ee-31e3bf56c3ee tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Request method failure captured: Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtH47wVNb7ltVQBZ6FCoYY3I0vJtEj6c0EhWN8-ELPBLefMoUwsJGRVAlabRRi0IHf3im8qG4vzUoGdTROGj9t6MVVIM6TJgnTSVqqVB_fYOJZ-JbOdLEsuYXvZj-qvxCO3s6Ce3YNy68pXpbCw42SRyBtI6OJ4aX1CWxguanpcyC0Y Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: a9eafa1a1a4f436b87f07a56783d271e Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:21.964756 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:21.966665 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a9eafa1a1a4f436b87f07a56783d271e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9eafa1a1a4f436b87f07a56783d271e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:21.966665 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:21.966665 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: a9eafa1a1a4f436b87f07a56783d271e Oct 27 18:46:21.966665 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-405274240 Oct 27 18:46:21.966665 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-HypervisorAdminNegativeTestJSON-405274240-project Oct 27 18:46:21.966665 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:21.966665 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:21.966665 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: f67cd95a7de644438ccde5ba093520fb Oct 27 18:46:21.966665 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-405274240-project Oct 27 18:46:21.966665 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:46:21.966665 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 27 18:46:21.966665 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '1'} Oct 27 18:46:21.966665 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:21.967385 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 27 18:46:21.970307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.971777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9b628f8-6ab9-40f2-90ee-31e3bf56c3ee tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:21.981574 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d9b628f8-6ab9-40f2-90ee-31e3bf56c3ee tempest-HypervisorAdminNegativeTestJSON-405274240 tempest-HypervisorAdminNegativeTestJSON-405274240-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.016452 Oct 27 18:46:21.982896 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 211/441] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:46:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:46:21.991767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1c36e696-414b-4081-9d02-a09661ee5f69 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Calling method '.version_select at 0x7fc86b57c310>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:21.993652 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-1c36e696-414b-4081-9d02-a09661ee5f69 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] HTTP exception thrown: Hypervisor with ID 'a5346588-3533-43e7-b4ea-4fa662483b34' could not be found. Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1c36e696-414b-4081-9d02-a09661ee5f69 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Request method failure captured: Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-hypervisors/a5346588-3533-43e7-b4ea-4fa662483b34 HTTP/1.1 Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtH7vElDF1U3guK9l2ETnn6Qc6zsDstFO2Yhl-r2CS_iPnMrJsSFJ1981BaHq4HeOlafyANCS_pFywOpfxEcGgLv1gjTgjdhGgNKsUoFYmMCG5KYU6YOBC2Etk-dtBfZrGvpefWJDDMQO5NNEG9KXcE4Tdcr5VgoLPcJjx71H1KjvwQ Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 70be5ca93546422c93159f64e5c0d89f Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2053132234 Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 18:46:21.996484 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 18:46:21.997671 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/70be5ca93546422c93159f64e5c0d89f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/70be5ca93546422c93159f64e5c0d89f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_70be5ca93546422c93159f64e5c0d89f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/70be5ca93546422c93159f64e5c0d89f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:21.997671 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2053132234 Oct 27 18:46:21.997671 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 70be5ca93546422c93159f64e5c0d89f Oct 27 18:46:21.997671 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2053132234 Oct 27 18:46:21.997671 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin Oct 27 18:46:21.997671 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:21.997671 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:21.997671 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 5374b0c4915a42d3a9ddf019fec8ee7a Oct 27 18:46:21.997671 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin Oct 27 18:46:21.997671 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:46:21.997671 n-d-860687-3 devstack@n-api.service[127028]: exception: Hypervisor with ID 'a5346588-3533-43e7-b4ea-4fa662483b34' could not be found. Oct 27 18:46:21.997671 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a5346588-3533-43e7-b4ea-4fa662483b34'} Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'a5346588-3533-43e7-b4ea-4fa662483b34' Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 27 18:46:21.998321 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 18:46:21.999707 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'a5346588-3533-43e7-b4ea-4fa662483b34' could not be found. Oct 27 18:46:22.001216 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:22.001216 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:22.001216 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:22.001216 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:22.001216 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:22.001216 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:22.001216 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:22.001216 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:22.001216 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'a5346588-3533-43e7-b4ea-4fa662483b34' could not be found. Oct 27 18:46:22.001216 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:22.003139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1c36e696-414b-4081-9d02-a09661ee5f69 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] Returning 404 to user: Hypervisor with ID 'a5346588-3533-43e7-b4ea-4fa662483b34' could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:22.004178 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1c36e696-414b-4081-9d02-a09661ee5f69 tempest-HypervisorAdminNegativeTestJSON-2053132234 tempest-HypervisorAdminNegativeTestJSON-2053132234-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/a5346588-3533-43e7-b4ea-4fa662483b34" status: 404 len: 123 microversion: 2.1 time: 0.016204 Oct 27 18:46:22.005205 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 212/442] 10.222.0.42 () {58 vars in 1257 bytes} [Thu Oct 27 18:46:21 2022] GET /compute/v2.1/os-hypervisors/a5346588-3533-43e7-b4ea-4fa662483b34 => generated 123 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:22.357327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-07813d35-e6ff-4a70-951b-785540b62337 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:22.369300 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-07813d35-e6ff-4a70-951b-785540b62337 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1471 microversion: 2.1 time: 0.535869 Oct 27 18:46:22.369884 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 231/443] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:21 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1471 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:23.404754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4bf3e49f-9c9b-4477-bfe6-f71ecf27acef tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:23.406078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4bf3e49f-9c9b-4477-bfe6-f71ecf27acef tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:23.415166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bf3e49f-9c9b-4477-bfe6-f71ecf27acef tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:23.415996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bf3e49f-9c9b-4477-bfe6-f71ecf27acef tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:23.416869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bf3e49f-9c9b-4477-bfe6-f71ecf27acef tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:23.417764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bf3e49f-9c9b-4477-bfe6-f71ecf27acef tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:23.419286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bf3e49f-9c9b-4477-bfe6-f71ecf27acef tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:23.420120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bf3e49f-9c9b-4477-bfe6-f71ecf27acef tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:23.938249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e96b3f4-7aa4-43dc-9535-25cf92255b2e tempest-InstanceUsageAuditLogTestJSON-1615572523 tempest-InstanceUsageAuditLogTestJSON-1615572523-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:23.999838 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e96b3f4-7aa4-43dc-9535-25cf92255b2e tempest-InstanceUsageAuditLogTestJSON-1615572523 tempest-InstanceUsageAuditLogTestJSON-1615572523-project-admin] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27 18:46:23" status: 200 len: 318 microversion: 2.1 time: 0.696713 Oct 27 18:46:24.007707 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 213/444] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 18:46:23 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27%2018%3A46%3A23 => generated 318 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:24.032319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bcf4d579-f57a-4806-9274-7edfe2d1a05e tempest-InstanceUsageAuditLogTestJSON-1615572523 tempest-InstanceUsageAuditLogTestJSON-1615572523-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:24.080901 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bcf4d579-f57a-4806-9274-7edfe2d1a05e tempest-InstanceUsageAuditLogTestJSON-1615572523 tempest-InstanceUsageAuditLogTestJSON-1615572523-project-admin] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.054467 Oct 27 18:46:24.085367 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 214/445] 10.222.0.42 () {58 vars in 1185 bytes} [Thu Oct 27 18:46:24 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:24.547154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4bf3e49f-9c9b-4477-bfe6-f71ecf27acef tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:24.569737 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4bf3e49f-9c9b-4477-bfe6-f71ecf27acef tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1471 microversion: 2.1 time: 1.169476 Oct 27 18:46:24.570341 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 232/446] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:23 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1471 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:46:25.595104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9572f567-689e-4649-bd52-07400f9bde36 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:25.596795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9572f567-689e-4649-bd52-07400f9bde36 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:25.609712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9572f567-689e-4649-bd52-07400f9bde36 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:25.614824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9572f567-689e-4649-bd52-07400f9bde36 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:25.615504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9572f567-689e-4649-bd52-07400f9bde36 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:25.616510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9572f567-689e-4649-bd52-07400f9bde36 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:25.618184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9572f567-689e-4649-bd52-07400f9bde36 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:25.619461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9572f567-689e-4649-bd52-07400f9bde36 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:25.829566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dc57f411-b03d-44c3-8a17-322f9b32e828 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:25.834261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc57f411-b03d-44c3-8a17-322f9b32e828 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:25.834778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc57f411-b03d-44c3-8a17-322f9b32e828 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:25.835222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc57f411-b03d-44c3-8a17-322f9b32e828 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:25.835969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc57f411-b03d-44c3-8a17-322f9b32e828 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:25.836410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc57f411-b03d-44c3-8a17-322f9b32e828 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:25.844692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc57f411-b03d-44c3-8a17-322f9b32e828 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:25.931121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:25.964510 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dc57f411-b03d-44c3-8a17-322f9b32e828 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.675907 Oct 27 18:46:25.970293 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 215/447] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:46:25 2022] GET /compute/v2.1/os-services => generated 944 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:25.983867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-134849b4-56dd-43c7-a4f2-5f3b56b87f89 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:25.989095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:25.990217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-134849b4-56dd-43c7-a4f2-5f3b56b87f89 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:25.991034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-134849b4-56dd-43c7-a4f2-5f3b56b87f89 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:25.991867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-134849b4-56dd-43c7-a4f2-5f3b56b87f89 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:25.992992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-134849b4-56dd-43c7-a4f2-5f3b56b87f89 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:25.993892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-134849b4-56dd-43c7-a4f2-5f3b56b87f89 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:25.994789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-134849b4-56dd-43c7-a4f2-5f3b56b87f89 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:26.054175 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-134849b4-56dd-43c7-a4f2-5f3b56b87f89 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.075765 Oct 27 18:46:26.056316 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 216/448] 10.222.0.42 () {58 vars in 1170 bytes} [Thu Oct 27 18:46:25 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:26.080422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d62cd523-0323-4f87-8f7a-e1dfad3527a7 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:26.104460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d62cd523-0323-4f87-8f7a-e1dfad3527a7 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:26.105327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d62cd523-0323-4f87-8f7a-e1dfad3527a7 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:26.106607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d62cd523-0323-4f87-8f7a-e1dfad3527a7 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:26.107684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d62cd523-0323-4f87-8f7a-e1dfad3527a7 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:26.108341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d62cd523-0323-4f87-8f7a-e1dfad3527a7 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:26.108977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d62cd523-0323-4f87-8f7a-e1dfad3527a7 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:26.143868 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d62cd523-0323-4f87-8f7a-e1dfad3527a7 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.075303 Oct 27 18:46:26.144988 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 217/449] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:46:26 2022] GET /compute/v2.1/os-services => generated 944 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:46:26.171775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4199a235-6f38-4b77-a519-efd2383d676d tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:26.182216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4199a235-6f38-4b77-a519-efd2383d676d tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:26.183333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4199a235-6f38-4b77-a519-efd2383d676d tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:26.184057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4199a235-6f38-4b77-a519-efd2383d676d tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:26.185954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4199a235-6f38-4b77-a519-efd2383d676d tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:26.186657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4199a235-6f38-4b77-a519-efd2383d676d tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:26.187318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4199a235-6f38-4b77-a519-efd2383d676d tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:26.228200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9572f567-689e-4649-bd52-07400f9bde36 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:26.255872 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4199a235-6f38-4b77-a519-efd2383d676d tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=n-d-860687-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.096693 Oct 27 18:46:26.259480 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 218/450] 10.222.0.42 () {58 vars in 1194 bytes} [Thu Oct 27 18:46:26 2022] GET /compute/v2.1/os-services?host=n-d-860687-3&binary=xxx => generated 16 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:46:26.264929 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9572f567-689e-4649-bd52-07400f9bde36 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1471 microversion: 2.1 time: 0.664737 Oct 27 18:46:26.273568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0b13a8ee-14ab-4d1a-aece-1c29bdaa08d6 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:26.280411 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 233/451] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:25 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1471 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:26.286711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b13a8ee-14ab-4d1a-aece-1c29bdaa08d6 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:26.287599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b13a8ee-14ab-4d1a-aece-1c29bdaa08d6 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:26.288477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b13a8ee-14ab-4d1a-aece-1c29bdaa08d6 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:26.292042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b13a8ee-14ab-4d1a-aece-1c29bdaa08d6 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:26.292884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b13a8ee-14ab-4d1a-aece-1c29bdaa08d6 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:26.294475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b13a8ee-14ab-4d1a-aece-1c29bdaa08d6 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:26.376581 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0b13a8ee-14ab-4d1a-aece-1c29bdaa08d6 tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.106816 Oct 27 18:46:26.392562 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 219/452] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:46:26 2022] GET /compute/v2.1/os-services => generated 944 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:26.395876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b472a5ab-b691-440a-955c-b0c9de54d17c tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:26.400371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b472a5ab-b691-440a-955c-b0c9de54d17c tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:26.400871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b472a5ab-b691-440a-955c-b0c9de54d17c tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:26.401406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b472a5ab-b691-440a-955c-b0c9de54d17c tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:26.402041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b472a5ab-b691-440a-955c-b0c9de54d17c tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:26.407071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b472a5ab-b691-440a-955c-b0c9de54d17c tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:26.408077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b472a5ab-b691-440a-955c-b0c9de54d17c tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:26.470174 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b472a5ab-b691-440a-955c-b0c9de54d17c tempest-ServicesAdminNegativeTestJSON-1900600417 tempest-ServicesAdminNegativeTestJSON-1900600417-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.082028 Oct 27 18:46:26.472358 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 234/453] 10.222.0.42 () {58 vars in 1198 bytes} [Thu Oct 27 18:46:26 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:46:26.877838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f960d46-c19a-4f67-ba84-aeea2b79c09e tempest-ServicesAdminNegativeTestJSON-2109725239 tempest-ServicesAdminNegativeTestJSON-2109725239-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:26.881661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0f960d46-c19a-4f67-ba84-aeea2b79c09e tempest-ServicesAdminNegativeTestJSON-2109725239 tempest-ServicesAdminNegativeTestJSON-2109725239-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '7b3479174c154ab2827dd2949274f382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59a06f722d44bfa98cd25d6050e4d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f960d46-c19a-4f67-ba84-aeea2b79c09e tempest-ServicesAdminNegativeTestJSON-2109725239 tempest-ServicesAdminNegativeTestJSON-2109725239-project] Request method failure captured: Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtH-sXnmV0rpNUWhZwxWDJMQ50rVDxRWUKC6gBMJ_C_O6Gu44oF3dcFA_jpulu2F2jaJH8bCKRbb2X7x3udi7g0luoXaeH0TR1gvYW2u38gDYmF9-1pfcuYAzZ67XY54Vj6GNHOOl4v7ns5UUrZM9cR5oFGKkKNaXS6NhL7fmdiR-ck Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f59a06f722d44bfa98cd25d6050e4d77 Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-2109725239 Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:26.895337 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:26.896495 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f59a06f722d44bfa98cd25d6050e4d77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f59a06f722d44bfa98cd25d6050e4d77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f59a06f722d44bfa98cd25d6050e4d77", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f59a06f722d44bfa98cd25d6050e4d77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:26.896495 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-2109725239 Oct 27 18:46:26.896495 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f59a06f722d44bfa98cd25d6050e4d77 Oct 27 18:46:26.896495 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-2109725239 Oct 27 18:46:26.896495 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServicesAdminNegativeTestJSON-2109725239-project Oct 27 18:46:26.896495 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:26.896495 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:26.896495 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 7b3479174c154ab2827dd2949274f382 Oct 27 18:46:26.896495 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-2109725239-project Oct 27 18:46:26.896495 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:46:26.896495 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 18:46:26.896495 n-d-860687-3 devstack@n-api.service[127028]: action_args: {} Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:26.897381 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 18:46:26.898365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:26.900315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f960d46-c19a-4f67-ba84-aeea2b79c09e tempest-ServicesAdminNegativeTestJSON-2109725239 tempest-ServicesAdminNegativeTestJSON-2109725239-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:26.900315 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0f960d46-c19a-4f67-ba84-aeea2b79c09e tempest-ServicesAdminNegativeTestJSON-2109725239 tempest-ServicesAdminNegativeTestJSON-2109725239-project] 10.222.0.42 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.413383 Oct 27 18:46:26.900315 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 220/454] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:46:26 2022] GET /compute/v2.1/os-services => generated 112 bytes in 414 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:27.295203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d6d1fb0-01c9-4b48-97a9-a9bfa8ceca85 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:27.296885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3d6d1fb0-01c9-4b48-97a9-a9bfa8ceca85 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:27.308337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d6d1fb0-01c9-4b48-97a9-a9bfa8ceca85 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:27.309475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d6d1fb0-01c9-4b48-97a9-a9bfa8ceca85 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:27.310156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d6d1fb0-01c9-4b48-97a9-a9bfa8ceca85 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:27.315238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d6d1fb0-01c9-4b48-97a9-a9bfa8ceca85 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:27.316143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d6d1fb0-01c9-4b48-97a9-a9bfa8ceca85 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:27.316954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d6d1fb0-01c9-4b48-97a9-a9bfa8ceca85 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:28.350139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3d6d1fb0-01c9-4b48-97a9-a9bfa8ceca85 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:28.388443 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3d6d1fb0-01c9-4b48-97a9-a9bfa8ceca85 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1471 microversion: 2.1 time: 1.096346 Oct 27 18:46:28.391126 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 235/455] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:27 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1471 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:28.457612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ed3908ad-33d0-4083-939d-45fb6aaf18ae tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Calling method '.version_select at 0x7fc86b4ecc10>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:28.472892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed3908ad-33d0-4083-939d-45fb6aaf18ae tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:28.478052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed3908ad-33d0-4083-939d-45fb6aaf18ae tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:28.479978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed3908ad-33d0-4083-939d-45fb6aaf18ae tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:28.484406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed3908ad-33d0-4083-939d-45fb6aaf18ae tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:28.489761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed3908ad-33d0-4083-939d-45fb6aaf18ae tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:28.492697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed3908ad-33d0-4083-939d-45fb6aaf18ae tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:28.579067 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ed3908ad-33d0-4083-939d-45fb6aaf18ae tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.549068 Oct 27 18:46:28.580545 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 221/456] 10.222.0.42 () {58 vars in 1128 bytes} [Thu Oct 27 18:46:28 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:28.933129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cbdc3bec-bbf8-4405-af87-8319edf6c6d2 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Calling method '.version_select at 0x7fc86b784e50>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:28.945898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cbdc3bec-bbf8-4405-af87-8319edf6c6d2 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '2edfb9dca7cd435f87b6e334136303ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438be762397848219f39517fe33e2af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cbdc3bec-bbf8-4405-af87-8319edf6c6d2 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Request method failure captured: Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIBYxbVRsGxIncBaP-qfksMGri8jxl356N64w2Oi9GTfdMdbfLsBZBvCAXt8antKhOMJnNown6Unre2FjCCfDxM5KHPA4LWJ34hQJL7QyCiL2wLT3gRyafmYmIuTclMRz8WFgQyFCxo4Vj8w7nPY-iIQsIJt7ghGDOhkVcYbo8nOqM Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 438be762397848219f39517fe33e2af4 Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:46:28.958064 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:46:28.959566 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/438be762397848219f39517fe33e2af4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/438be762397848219f39517fe33e2af4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_438be762397848219f39517fe33e2af4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/438be762397848219f39517fe33e2af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:28.959566 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:28.959566 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 438be762397848219f39517fe33e2af4 Oct 27 18:46:28.959566 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:28.959566 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-HostsAdminNegativeTestJSON-475076632-project Oct 27 18:46:28.959566 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:46:28.959566 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:46:28.959566 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2edfb9dca7cd435f87b6e334136303ab Oct 27 18:46:28.959566 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-HostsAdminNegativeTestJSON-475076632-project Oct 27 18:46:28.959566 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:46:28.959566 n-d-860687-3 devstack@n-api.service[127029]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 27 18:46:28.959566 n-d-860687-3 devstack@n-api.service[127029]: action_args: {} Oct 27 18:46:28.959566 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:28.960380 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 27 18:46:28.961501 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:28.962665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cbdc3bec-bbf8-4405-af87-8319edf6c6d2 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:28.964906 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cbdc3bec-bbf8-4405-af87-8319edf6c6d2 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.375150 Oct 27 18:46:28.971821 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 236/457] 10.222.0.42 () {58 vars in 1128 bytes} [Thu Oct 27 18:46:28 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 384 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:28.981464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b23343f6-308e-4983-8d89-c5b12ff4f73d tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Calling method '.version_select at 0x7fc86b74ff70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:28.983931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b23343f6-308e-4983-8d89-c5b12ff4f73d tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '2edfb9dca7cd435f87b6e334136303ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438be762397848219f39517fe33e2af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b23343f6-308e-4983-8d89-c5b12ff4f73d tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Request method failure captured: Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-hosts/n-d-860687-3/reboot HTTP/1.1 Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtIBYxbVRsGxIncBaP-qfksMGri8jxl356N64w2Oi9GTfdMdbfLsBZBvCAXt8antKhOMJnNown6Unre2FjCCfDxM5KHPA4LWJ34hQJL7QyCiL2wLT3gRyafmYmIuTclMRz8WFgQyFCxo4Vj8w7nPY-iIQsIJt7ghGDOhkVcYbo8nOqM Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 438be762397848219f39517fe33e2af4 Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:28.986221 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:28.987622 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/438be762397848219f39517fe33e2af4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/438be762397848219f39517fe33e2af4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_438be762397848219f39517fe33e2af4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/438be762397848219f39517fe33e2af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:28.987622 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:28.987622 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 438be762397848219f39517fe33e2af4 Oct 27 18:46:28.987622 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:28.987622 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-HostsAdminNegativeTestJSON-475076632-project Oct 27 18:46:28.987622 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:28.987622 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:28.987622 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2edfb9dca7cd435f87b6e334136303ab Oct 27 18:46:28.987622 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-HostsAdminNegativeTestJSON-475076632-project Oct 27 18:46:28.987622 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:46:28.987622 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 27 18:46:28.987622 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'n-d-860687-3'} Oct 27 18:46:28.987622 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:28.988323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 27 18:46:28.989340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:28.991735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b23343f6-308e-4983-8d89-c5b12ff4f73d tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:28.993909 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b23343f6-308e-4983-8d89-c5b12ff4f73d tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-d-860687-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.016357 Oct 27 18:46:28.996760 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 222/458] 10.222.0.42 () {58 vars in 1188 bytes} [Thu Oct 27 18:46:28 2022] GET /compute/v2.1/os-hosts/n-d-860687-3/reboot => generated 111 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:29.007431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-82fcc36f-48b2-4632-9e66-5865c8882bde tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Calling method '.version_select at 0x7fc86b5caaf0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:29.031799 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-82fcc36f-48b2-4632-9e66-5865c8882bde tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-82fcc36f-48b2-4632-9e66-5865c8882bde tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Request method failure captured: Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIDclMyLHlJA2Td01jddNL1p2l1WiND6GjY8PyfN8h-7tILScoYJVqLInSajDnhflja9PJpU5zoqLYVFuxgRBCp9BX2LVhU-cnAIGrPEx3xgUFVC9FZ8Hzwyn7PZDZgynJDIEhr7pkGiqBtyiy8-r_xFHWxeDh_wdK48qqjL5phCMQ Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:46:29.035034 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:46:29.036444 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ed30da9baca414580ac3ecce27a904f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:29.036444 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.036444 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.036444 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.036444 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.036444 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:46:29.036444 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:46:29.036444 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 9429c7057666467db4aa86d8dbc55edb Oct 27 18:46:29.036444 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.036444 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:46:29.036444 n-d-860687-3 devstack@n-api.service[127029]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.036444 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'nonexistent_hostname'} Oct 27 18:46:29.036444 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:46:29.037328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 27 18:46:29.038737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:46:29.039904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.039904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.039904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.039904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.039904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.039904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.039904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.039904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:29.039904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:29.039904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.039904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.042453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-82fcc36f-48b2-4632-9e66-5865c8882bde tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:29.047597 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-82fcc36f-48b2-4632-9e66-5865c8882bde tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.045218 Oct 27 18:46:29.049820 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 237/459] 10.222.0.42 () {58 vars in 1212 bytes} [Thu Oct 27 18:46:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:46:29.059476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-81929b44-6577-47c2-a11d-9b5fdc3d9b14 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Calling method '.version_select at 0x7fc86b6d4310>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:29.061696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-81929b44-6577-47c2-a11d-9b5fdc3d9b14 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '2edfb9dca7cd435f87b6e334136303ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438be762397848219f39517fe33e2af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-81929b44-6577-47c2-a11d-9b5fdc3d9b14 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Request method failure captured: Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-hosts/n-d-860687-3 HTTP/1.1 Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtIBYxbVRsGxIncBaP-qfksMGri8jxl356N64w2Oi9GTfdMdbfLsBZBvCAXt8antKhOMJnNown6Unre2FjCCfDxM5KHPA4LWJ34hQJL7QyCiL2wLT3gRyafmYmIuTclMRz8WFgQyFCxo4Vj8w7nPY-iIQsIJt7ghGDOhkVcYbo8nOqM Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 438be762397848219f39517fe33e2af4 Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:29.063755 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:29.064916 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/438be762397848219f39517fe33e2af4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/438be762397848219f39517fe33e2af4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_438be762397848219f39517fe33e2af4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/438be762397848219f39517fe33e2af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:29.064916 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:29.064916 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 438be762397848219f39517fe33e2af4 Oct 27 18:46:29.064916 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:29.064916 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-HostsAdminNegativeTestJSON-475076632-project Oct 27 18:46:29.064916 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:29.064916 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:29.064916 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2edfb9dca7cd435f87b6e334136303ab Oct 27 18:46:29.064916 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-HostsAdminNegativeTestJSON-475076632-project Oct 27 18:46:29.064916 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:46:29.064916 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 27 18:46:29.064916 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'n-d-860687-3'} Oct 27 18:46:29.064916 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:29.065640 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 27 18:46:29.066670 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.072097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-81929b44-6577-47c2-a11d-9b5fdc3d9b14 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:29.073842 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-81929b44-6577-47c2-a11d-9b5fdc3d9b14 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-d-860687-3" status: 403 len: 109 microversion: 2.1 time: 0.019819 Oct 27 18:46:29.075121 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 223/460] 10.222.0.42 () {58 vars in 1167 bytes} [Thu Oct 27 18:46:29 2022] GET /compute/v2.1/os-hosts/n-d-860687-3 => generated 109 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:29.086676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fe38d560-53bd-4a4e-af08-974e783bd011 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Calling method '.version_select at 0x7fc86b59e160>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:29.115528 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-fe38d560-53bd-4a4e-af08-974e783bd011 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fe38d560-53bd-4a4e-af08-974e783bd011 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Request method failure captured: Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIDclMyLHlJA2Td01jddNL1p2l1WiND6GjY8PyfN8h-7tILScoYJVqLInSajDnhflja9PJpU5zoqLYVFuxgRBCp9BX2LVhU-cnAIGrPEx3xgUFVC9FZ8Hzwyn7PZDZgynJDIEhr7pkGiqBtyiy8-r_xFHWxeDh_wdK48qqjL5phCMQ Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:46:29.117140 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:46:29.118485 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ed30da9baca414580ac3ecce27a904f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:29.118485 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.118485 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.118485 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.118485 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.118485 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:46:29.118485 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:46:29.118485 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 9429c7057666467db4aa86d8dbc55edb Oct 27 18:46:29.118485 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.118485 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:46:29.118485 n-d-860687-3 devstack@n-api.service[127029]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.118485 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'nonexistent_hostname'} Oct 27 18:46:29.118485 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.120057 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.121055 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.123925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fe38d560-53bd-4a4e-af08-974e783bd011 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:29.125675 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fe38d560-53bd-4a4e-af08-974e783bd011 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.045338 Oct 27 18:46:29.135945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-db374ac5-cf87-415c-bc21-c01371cf9186 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Calling method '.version_select at 0x7fc86b586040>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:29.138284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-db374ac5-cf87-415c-bc21-c01371cf9186 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '2edfb9dca7cd435f87b6e334136303ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438be762397848219f39517fe33e2af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-db374ac5-cf87-415c-bc21-c01371cf9186 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Request method failure captured: Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-hosts/n-d-860687-3/shutdown HTTP/1.1 Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtIBYxbVRsGxIncBaP-qfksMGri8jxl356N64w2Oi9GTfdMdbfLsBZBvCAXt8antKhOMJnNown6Unre2FjCCfDxM5KHPA4LWJ34hQJL7QyCiL2wLT3gRyafmYmIuTclMRz8WFgQyFCxo4Vj8w7nPY-iIQsIJt7ghGDOhkVcYbo8nOqM Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 438be762397848219f39517fe33e2af4 Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:29.141328 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:29.142528 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/438be762397848219f39517fe33e2af4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/438be762397848219f39517fe33e2af4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_438be762397848219f39517fe33e2af4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/438be762397848219f39517fe33e2af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:29.142528 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:29.142528 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 438be762397848219f39517fe33e2af4 Oct 27 18:46:29.142528 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:29.142528 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-HostsAdminNegativeTestJSON-475076632-project Oct 27 18:46:29.142528 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:29.142528 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:29.142528 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2edfb9dca7cd435f87b6e334136303ab Oct 27 18:46:29.142528 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-HostsAdminNegativeTestJSON-475076632-project Oct 27 18:46:29.142528 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:46:29.142528 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 27 18:46:29.142528 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'n-d-860687-3'} Oct 27 18:46:29.142528 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:29.143224 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 27 18:46:29.145739 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.146699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-db374ac5-cf87-415c-bc21-c01371cf9186 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:29.146699 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-db374ac5-cf87-415c-bc21-c01371cf9186 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-d-860687-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.011323 Oct 27 18:46:29.146699 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 224/461] 10.222.0.42 () {58 vars in 1194 bytes} [Thu Oct 27 18:46:29 2022] GET /compute/v2.1/os-hosts/n-d-860687-3/shutdown => generated 113 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:46:29.159739 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 238/462] 10.222.0.42 () {58 vars in 1191 bytes} [Thu Oct 27 18:46:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:46:29.178002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb973b6e-89f1-4666-bd23-a0bfcb69f589 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Calling method '.version_select at 0x7fc86b57c430>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:29.209337 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-eb973b6e-89f1-4666-bd23-a0bfcb69f589 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb973b6e-89f1-4666-bd23-a0bfcb69f589 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Request method failure captured: Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtIDclMyLHlJA2Td01jddNL1p2l1WiND6GjY8PyfN8h-7tILScoYJVqLInSajDnhflja9PJpU5zoqLYVFuxgRBCp9BX2LVhU-cnAIGrPEx3xgUFVC9FZ8Hzwyn7PZDZgynJDIEhr7pkGiqBtyiy8-r_xFHWxeDh_wdK48qqjL5phCMQ Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 18:46:29.213306 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 18:46:29.216203 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ed30da9baca414580ac3ecce27a904f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:29.216203 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.216203 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.216203 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.216203 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.216203 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:29.216203 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:29.216203 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 9429c7057666467db4aa86d8dbc55edb Oct 27 18:46:29.216203 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.216203 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:46:29.216203 n-d-860687-3 devstack@n-api.service[127028]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.216203 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'nonexistent_hostname'} Oct 27 18:46:29.216203 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:46:29.216969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 27 18:46:29.217975 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:46:29.219018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.219018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.219018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.219018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.219018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.219018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.219018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.219018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:29.219018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:29.219018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.219018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.226090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb973b6e-89f1-4666-bd23-a0bfcb69f589 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:29.227303 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb973b6e-89f1-4666-bd23-a0bfcb69f589 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.063613 Oct 27 18:46:29.230679 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 225/463] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Oct 27 18:46:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:46:29.249971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7811865f-3caf-44d5-beda-59ca74701e53 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Calling method '.version_select at 0x7fc86b4a8160>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:29.251956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7811865f-3caf-44d5-beda-59ca74701e53 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '2edfb9dca7cd435f87b6e334136303ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438be762397848219f39517fe33e2af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7811865f-3caf-44d5-beda-59ca74701e53 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Request method failure captured: Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-hosts/n-d-860687-3/startup HTTP/1.1 Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIBYxbVRsGxIncBaP-qfksMGri8jxl356N64w2Oi9GTfdMdbfLsBZBvCAXt8antKhOMJnNown6Unre2FjCCfDxM5KHPA4LWJ34hQJL7QyCiL2wLT3gRyafmYmIuTclMRz8WFgQyFCxo4Vj8w7nPY-iIQsIJt7ghGDOhkVcYbo8nOqM Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 438be762397848219f39517fe33e2af4 Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:46:29.256178 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:46:29.258783 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/438be762397848219f39517fe33e2af4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/438be762397848219f39517fe33e2af4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_438be762397848219f39517fe33e2af4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/438be762397848219f39517fe33e2af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:29.258783 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:29.258783 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 438be762397848219f39517fe33e2af4 Oct 27 18:46:29.258783 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:29.258783 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-HostsAdminNegativeTestJSON-475076632-project Oct 27 18:46:29.258783 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:46:29.258783 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:46:29.258783 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2edfb9dca7cd435f87b6e334136303ab Oct 27 18:46:29.258783 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-HostsAdminNegativeTestJSON-475076632-project Oct 27 18:46:29.258783 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:46:29.258783 n-d-860687-3 devstack@n-api.service[127029]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 27 18:46:29.258783 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'n-d-860687-3'} Oct 27 18:46:29.258783 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:29.260084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 27 18:46:29.261126 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.263977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7811865f-3caf-44d5-beda-59ca74701e53 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:29.263977 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7811865f-3caf-44d5-beda-59ca74701e53 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-d-860687-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.019113 Oct 27 18:46:29.269656 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 239/464] 10.222.0.42 () {58 vars in 1191 bytes} [Thu Oct 27 18:46:29 2022] GET /compute/v2.1/os-hosts/n-d-860687-3/startup => generated 110 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:29.276632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b894ef1f-12ec-4ae6-a74e-0359be2ed8a3 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Calling method '.version_select at 0x7fc86b4d8e50>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:29.314428 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-b894ef1f-12ec-4ae6-a74e-0359be2ed8a3 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b894ef1f-12ec-4ae6-a74e-0359be2ed8a3 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Request method failure captured: Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtIDclMyLHlJA2Td01jddNL1p2l1WiND6GjY8PyfN8h-7tILScoYJVqLInSajDnhflja9PJpU5zoqLYVFuxgRBCp9BX2LVhU-cnAIGrPEx3xgUFVC9FZ8Hzwyn7PZDZgynJDIEhr7pkGiqBtyiy8-r_xFHWxeDh_wdK48qqjL5phCMQ Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 18:46:29.325588 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 18:46:29.327342 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ed30da9baca414580ac3ecce27a904f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:29.327342 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.327342 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.327342 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.327342 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.327342 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:29.327342 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:29.327342 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 9429c7057666467db4aa86d8dbc55edb Oct 27 18:46:29.327342 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.327342 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:46:29.327342 n-d-860687-3 devstack@n-api.service[127028]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.327342 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'nonexistent_hostname'} Oct 27 18:46:29.327342 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:46:29.328406 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 27 18:46:29.329768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:46:29.331018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.331018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.331018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.331018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.331018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.331018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.331018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.331018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:29.331018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:29.331018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.331018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.335759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b894ef1f-12ec-4ae6-a74e-0359be2ed8a3 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:29.339519 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b894ef1f-12ec-4ae6-a74e-0359be2ed8a3 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.071000 Oct 27 18:46:29.344276 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 226/465] 10.222.0.42 () {58 vars in 1215 bytes} [Thu Oct 27 18:46:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:46:29.353276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af7320cf-cb08-4d32-b22a-930de12e5fa0 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b4a8040>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af7320cf-cb08-4d32-b22a-930de12e5fa0 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Request method failure captured: Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/os-hosts/n-d-860687-3 HTTP/1.1 Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 51 Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIDclMyLHlJA2Td01jddNL1p2l1WiND6GjY8PyfN8h-7tILScoYJVqLInSajDnhflja9PJpU5zoqLYVFuxgRBCp9BX2LVhU-cnAIGrPEx3xgUFVC9FZ8Hzwyn7PZDZgynJDIEhr7pkGiqBtyiy8-r_xFHWxeDh_wdK48qqjL5phCMQ Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:46:29.359793 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:46:29.361048 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ed30da9baca414580ac3ecce27a904f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:29.361048 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.361048 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.361048 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.361048 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.361048 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:46:29.361048 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:46:29.361048 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 9429c7057666467db4aa86d8dbc55edb Oct 27 18:46:29.361048 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.361048 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:46:29.361048 n-d-860687-3 devstack@n-api.service[127029]: {"status": "enable", "maintenance_mode": "invalid"} Oct 27 18:46:29.361048 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:46:29.361048 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'n-d-860687-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'disable', Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'Enable', Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'Disable', Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance: Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.361774 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.363232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.364627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.364627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:46:29.364627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:46:29.364627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 18:46:29.364627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.368452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af7320cf-cb08-4d32-b22a-930de12e5fa0 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:29.369354 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-af7320cf-cb08-4d32-b22a-930de12e5fa0 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-hosts/n-d-860687-3" status: 400 len: 199 microversion: 2.1 time: 0.020116 Oct 27 18:46:29.378595 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 240/466] 10.222.0.42 () {60 vars in 1187 bytes} [Thu Oct 27 18:46:29 2022] PUT /compute/v2.1/os-hosts/n-d-860687-3 => generated 199 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:46:29.381924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5a2ec713-3458-49ab-8aea-0a8ee52c2907 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b57c5e0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5a2ec713-3458-49ab-8aea-0a8ee52c2907 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Request method failure captured: Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: request: PUT /compute/v2.1/os-hosts/n-d-860687-3 HTTP/1.1 Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 51 Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtIDclMyLHlJA2Td01jddNL1p2l1WiND6GjY8PyfN8h-7tILScoYJVqLInSajDnhflja9PJpU5zoqLYVFuxgRBCp9BX2LVhU-cnAIGrPEx3xgUFVC9FZ8Hzwyn7PZDZgynJDIEhr7pkGiqBtyiy8-r_xFHWxeDh_wdK48qqjL5phCMQ Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 18:46:29.386729 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 18:46:29.388979 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ed30da9baca414580ac3ecce27a904f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:29.388979 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.388979 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.388979 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.388979 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.388979 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:29.388979 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:29.388979 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 9429c7057666467db4aa86d8dbc55edb Oct 27 18:46:29.388979 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.388979 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:46:29.388979 n-d-860687-3 devstack@n-api.service[127028]: {"status": "invalid", "maintenance_mode": "enable"} Oct 27 18:46:29.388979 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:46:29.388979 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'n-d-860687-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'disable', Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'Enable', Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'Disable', Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance: Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.389828 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.391457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.392674 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.392674 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:46:29.392674 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:46:29.392674 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 18:46:29.392674 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.392674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5a2ec713-3458-49ab-8aea-0a8ee52c2907 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:29.393083 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5a2ec713-3458-49ab-8aea-0a8ee52c2907 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-hosts/n-d-860687-3" status: 400 len: 189 microversion: 2.1 time: 0.015596 Oct 27 18:46:29.394488 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 227/467] 10.222.0.42 () {60 vars in 1187 bytes} [Thu Oct 27 18:46:29 2022] PUT /compute/v2.1/os-hosts/n-d-860687-3 => generated 189 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 18:46:29.408814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42d551f6-8b36-4b31-abf2-d42627559173 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Action: 'update', calling method: .version_select at 0x7fc86b59e670>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:29.420181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-da43f5bf-4540-46ae-89cb-8d3894c91334 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:29.420801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-da43f5bf-4540-46ae-89cb-8d3894c91334 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:29.424732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-42d551f6-8b36-4b31-abf2-d42627559173 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '2edfb9dca7cd435f87b6e334136303ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438be762397848219f39517fe33e2af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42d551f6-8b36-4b31-abf2-d42627559173 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Request method failure captured: Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/os-hosts/n-d-860687-3 HTTP/1.1 Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 50 Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIBYxbVRsGxIncBaP-qfksMGri8jxl356N64w2Oi9GTfdMdbfLsBZBvCAXt8antKhOMJnNown6Unre2FjCCfDxM5KHPA4LWJ34hQJL7QyCiL2wLT3gRyafmYmIuTclMRz8WFgQyFCxo4Vj8w7nPY-iIQsIJt7ghGDOhkVcYbo8nOqM Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 438be762397848219f39517fe33e2af4 Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:46:29.432815 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:46:29.434364 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/438be762397848219f39517fe33e2af4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/438be762397848219f39517fe33e2af4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_438be762397848219f39517fe33e2af4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/438be762397848219f39517fe33e2af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:29.434364 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:29.434364 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 438be762397848219f39517fe33e2af4 Oct 27 18:46:29.434364 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-475076632 Oct 27 18:46:29.434364 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-HostsAdminNegativeTestJSON-475076632-project Oct 27 18:46:29.434364 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:46:29.434364 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:46:29.434364 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2edfb9dca7cd435f87b6e334136303ab Oct 27 18:46:29.434364 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-HostsAdminNegativeTestJSON-475076632-project Oct 27 18:46:29.434364 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:46:29.434364 n-d-860687-3 devstack@n-api.service[127029]: {"status": "enable", "maintenance_mode": "enable"} Oct 27 18:46:29.434364 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:46:29.434364 n-d-860687-3 devstack@n-api.service[127029]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 27 18:46:29.434364 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'n-d-860687-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:29.435303 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 27 18:46:29.436560 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.440114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42d551f6-8b36-4b31-abf2-d42627559173 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:29.440114 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-42d551f6-8b36-4b31-abf2-d42627559173 tempest-HostsAdminNegativeTestJSON-475076632 tempest-HostsAdminNegativeTestJSON-475076632-project] 10.222.0.42 "PUT /compute/v2.1/os-hosts/n-d-860687-3" status: 403 len: 111 microversion: 2.1 time: 0.037609 Oct 27 18:46:29.440114 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 241/468] 10.222.0.42 () {60 vars in 1187 bytes} [Thu Oct 27 18:46:29 2022] PUT /compute/v2.1/os-hosts/n-d-860687-3 => generated 111 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:29.474858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3598823f-e9a4-47b6-b051-0d5073b3978d tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b4dc0d0>, body: {"status": null, "maintenance_mode": null} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:29.476498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da43f5bf-4540-46ae-89cb-8d3894c91334 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:29.477621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da43f5bf-4540-46ae-89cb-8d3894c91334 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:29.479750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da43f5bf-4540-46ae-89cb-8d3894c91334 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:29.483550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da43f5bf-4540-46ae-89cb-8d3894c91334 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:29.484270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da43f5bf-4540-46ae-89cb-8d3894c91334 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:29.484864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da43f5bf-4540-46ae-89cb-8d3894c91334 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3598823f-e9a4-47b6-b051-0d5073b3978d tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Request method failure captured: Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/os-hosts/n-d-860687-3 HTTP/1.1 Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 42 Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIDclMyLHlJA2Td01jddNL1p2l1WiND6GjY8PyfN8h-7tILScoYJVqLInSajDnhflja9PJpU5zoqLYVFuxgRBCp9BX2LVhU-cnAIGrPEx3xgUFVC9FZ8Hzwyn7PZDZgynJDIEhr7pkGiqBtyiy8-r_xFHWxeDh_wdK48qqjL5phCMQ Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:46:29.485282 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:46:29.486797 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ed30da9baca414580ac3ecce27a904f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:29.486797 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.486797 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.486797 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.486797 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.486797 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:46:29.486797 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:46:29.486797 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 9429c7057666467db4aa86d8dbc55edb Oct 27 18:46:29.486797 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.486797 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:46:29.486797 n-d-860687-3 devstack@n-api.service[127029]: {"status": null, "maintenance_mode": null} Oct 27 18:46:29.486797 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:46:29.486797 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 27 18:46:29.486797 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'n-d-860687-3', 'body': {'status': None, 'maintenance_mode': None}} Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'disable', Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'Enable', Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'Disable', Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance: Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi None Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.493874 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.502332 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.503684 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:46:29.503684 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:46:29.503684 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 27 18:46:29.503684 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.503684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3598823f-e9a4-47b6-b051-0d5073b3978d tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:29.503684 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3598823f-e9a4-47b6-b051-0d5073b3978d tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-hosts/n-d-860687-3" status: 400 len: 127 microversion: 2.1 time: 0.039316 Oct 27 18:46:29.503684 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 242/469] 10.222.0.42 () {60 vars in 1187 bytes} [Thu Oct 27 18:46:29 2022] PUT /compute/v2.1/os-hosts/n-d-860687-3 => generated 127 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:46:29.503684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e268961d-5218-4f8d-bdae-767ab341b834 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b624820>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:29.513301 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.hosts [None req-e268961d-5218-4f8d-bdae-767ab341b834 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Enabling host nonexistent_hostname. Oct 27 18:46:29.535336 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-e268961d-5218-4f8d-bdae-767ab341b834 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e268961d-5218-4f8d-bdae-767ab341b834 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Request method failure captured: Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 50 Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIDclMyLHlJA2Td01jddNL1p2l1WiND6GjY8PyfN8h-7tILScoYJVqLInSajDnhflja9PJpU5zoqLYVFuxgRBCp9BX2LVhU-cnAIGrPEx3xgUFVC9FZ8Hzwyn7PZDZgynJDIEhr7pkGiqBtyiy8-r_xFHWxeDh_wdK48qqjL5phCMQ Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:46:29.537113 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:46:29.538297 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ed30da9baca414580ac3ecce27a904f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ed30da9baca414580ac3ecce27a904f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:29.538297 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.538297 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 9ed30da9baca414580ac3ecce27a904f Oct 27 18:46:29.538297 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-41039211 Oct 27 18:46:29.538297 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.538297 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:46:29.538297 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:46:29.538297 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 9429c7057666467db4aa86d8dbc55edb Oct 27 18:46:29.538297 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-HostsAdminNegativeTestJSON-41039211-project-admin Oct 27 18:46:29.538297 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:46:29.538297 n-d-860687-3 devstack@n-api.service[127029]: {"status": "enable", "maintenance_mode": "enable"} Oct 27 18:46:29.538297 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:46:29.538297 n-d-860687-3 devstack@n-api.service[127029]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.538297 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 18:46:29.539083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:46:29.540022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:29.541060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e268961d-5218-4f8d-bdae-767ab341b834 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:29.549568 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e268961d-5218-4f8d-bdae-767ab341b834 tempest-HostsAdminNegativeTestJSON-41039211 tempest-HostsAdminNegativeTestJSON-41039211-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.042881 Oct 27 18:46:29.549568 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 243/470] 10.222.0.42 () {60 vars in 1211 bytes} [Thu Oct 27 18:46:29 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:46:29.848580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-da43f5bf-4540-46ae-89cb-8d3894c91334 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:29.862648 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-da43f5bf-4540-46ae-89cb-8d3894c91334 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1471 microversion: 2.1 time: 0.447688 Oct 27 18:46:29.876203 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 228/471] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:29 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1471 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:30.888830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a48af4b8-630e-44c6-bb6e-292cb896d0a1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:30.889443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a48af4b8-630e-44c6-bb6e-292cb896d0a1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:30.898807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a48af4b8-630e-44c6-bb6e-292cb896d0a1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:30.899498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a48af4b8-630e-44c6-bb6e-292cb896d0a1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:30.900282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a48af4b8-630e-44c6-bb6e-292cb896d0a1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:30.901136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a48af4b8-630e-44c6-bb6e-292cb896d0a1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:30.901954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a48af4b8-630e-44c6-bb6e-292cb896d0a1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:30.902799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a48af4b8-630e-44c6-bb6e-292cb896d0a1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:31.712433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a48af4b8-630e-44c6-bb6e-292cb896d0a1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:31.722065 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a48af4b8-630e-44c6-bb6e-292cb896d0a1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1471 microversion: 2.1 time: 0.837715 Oct 27 18:46:31.726930 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 244/472] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:30 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1471 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:32.753864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-34dfa060-fc92-4455-8bd7-d5ff8d86cc6d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:32.754508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-34dfa060-fc92-4455-8bd7-d5ff8d86cc6d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:32.762187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34dfa060-fc92-4455-8bd7-d5ff8d86cc6d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:32.763160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34dfa060-fc92-4455-8bd7-d5ff8d86cc6d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:32.764064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34dfa060-fc92-4455-8bd7-d5ff8d86cc6d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:32.765268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34dfa060-fc92-4455-8bd7-d5ff8d86cc6d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:32.766032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34dfa060-fc92-4455-8bd7-d5ff8d86cc6d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:32.766809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34dfa060-fc92-4455-8bd7-d5ff8d86cc6d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:32.957009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-34dfa060-fc92-4455-8bd7-d5ff8d86cc6d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:32.972921 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-34dfa060-fc92-4455-8bd7-d5ff8d86cc6d tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1477 microversion: 2.1 time: 0.222511 Oct 27 18:46:32.988010 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 229/473] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:32 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1477 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:33.801173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1836318615", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "339d213d-d58f-44f1-aeaf-54d635220475"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:33.875108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] validate_networks() for [('339d213d-d58f-44f1-aeaf-54d635220475', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:46:34.003437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-72404536-6531-42f6-be3e-e7355bb27c04 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:34.005608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-72404536-6531-42f6-be3e-e7355bb27c04 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:34.020835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72404536-6531-42f6-be3e-e7355bb27c04 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:34.021340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72404536-6531-42f6-be3e-e7355bb27c04 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:34.023396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72404536-6531-42f6-be3e-e7355bb27c04 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:34.025600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72404536-6531-42f6-be3e-e7355bb27c04 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:34.026075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72404536-6531-42f6-be3e-e7355bb27c04 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:34.028979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72404536-6531-42f6-be3e-e7355bb27c04 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:34.089788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:34.284202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-72404536-6531-42f6-be3e-e7355bb27c04 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:34.295707 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-72404536-6531-42f6-be3e-e7355bb27c04 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1477 microversion: 2.1 time: 0.296934 Oct 27 18:46:34.310610 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 230/474] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:33 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1477 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:34.445531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:46:34.445962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:46:34.446824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:46:34.447756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:46:34.448353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:46:34.462991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:34.464020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:34.464638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:34.466303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:34.466966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:34.467922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:34.478228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=11 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:34.492239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Getting quotas for project a1c89e4b67024f91ae460e3ae3278277. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:46:34.499573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Getting quotas for user c73a9daf485b421c8244f287fee5a942 and project a1c89e4b67024f91ae460e3ae3278277. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:46:34.517049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:46:34.519957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:46:34.618889 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8ec063eb-4168-4930-9c31-21fe83aa2a07 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.492670 Oct 27 18:46:34.620658 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 245/475] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 18:46:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 18:46:34.631851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e6b7f9d2-13d0-41b1-af0c-33a351c3e2c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:34.633043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e6b7f9d2-13d0-41b1-af0c-33a351c3e2c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:34.708740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e6b7f9d2-13d0-41b1-af0c-33a351c3e2c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:34.721497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e6b7f9d2-13d0-41b1-af0c-33a351c3e2c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:34.723033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e6b7f9d2-13d0-41b1-af0c-33a351c3e2c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:34.724186 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e6b7f9d2-13d0-41b1-af0c-33a351c3e2c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1262 microversion: 2.25 time: 0.096720 Oct 27 18:46:34.726993 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 246/476] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:34 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:46:34.854282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-23468ef9-44e7-421a-a20e-c609c3dbfd21 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Action: 'create', calling method: .version_select at 0x7fc86b57c3a0>, body: {"keypair": {"name": "tempest-keypair-2105908824", "type": "ssh", "user_id": "c9414efebfe64d879f3f521135386e99", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKEn7H0WpzJ5bmNTgH+bs3kJsMrB4t4EN6V6KH7o2ECbjknZziPHrgi9P2lU3XEGE76+gDtcF8LkShGqo2hr0Zi/ld1ZlffvA6CHnpM/y7BmBS28SUocf5ZQGIvkKjzbQ=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:34.875019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-23468ef9-44e7-421a-a20e-c609c3dbfd21 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Getting quotas for project 09af2379739c44e48d6ac7e9207d4791. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:46:34.884958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-23468ef9-44e7-421a-a20e-c609c3dbfd21 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Getting quotas for user f4e48ac1347943afb205a584bcfe401f and project 09af2379739c44e48d6ac7e9207d4791. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:46:34.930409 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-23468ef9-44e7-421a-a20e-c609c3dbfd21 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.312090 Oct 27 18:46:34.931433 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 231/477] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Oct 27 18:46:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 315 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 18:46:34.948074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c621ec81-cb9a-440a-b5ab-4dc46cd2c02e tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Action: 'create', calling method: .version_select at 0x7fc86b6d4310>, body: {"keypair": {"name": "tempest-keypair-1377200551", "type": "ssh", "user_id": "c9414efebfe64d879f3f521135386e99", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXG+EwKyc1puVSIuqb5EdqIqVm26REfhKvLP+VpgDlyAE2hwnIxkVEZRtOz8couIiCfFPPY0KkXUUKTjjOkK1jRQV8Hhjie7f6yziEQbZvJ8aTS5hDfYnpnTjvauhl/4Q=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:34.967443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c621ec81-cb9a-440a-b5ab-4dc46cd2c02e tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Getting quotas for project 09af2379739c44e48d6ac7e9207d4791. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:46:34.972368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c621ec81-cb9a-440a-b5ab-4dc46cd2c02e tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Getting quotas for user f4e48ac1347943afb205a584bcfe401f and project 09af2379739c44e48d6ac7e9207d4791. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:46:34.999353 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c621ec81-cb9a-440a-b5ab-4dc46cd2c02e tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.055789 Oct 27 18:46:35.000282 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 232/478] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Oct 27 18:46:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 27 18:46:35.012778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ef78f9f-2c14-40e6-9e68-06dbe384f355 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Calling method '.version_select at 0x7fc86b4ec820>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:35.028028 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ef78f9f-2c14-40e6-9e68-06dbe384f355 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-2105908824?user_id=c9414efebfe64d879f3f521135386e99" status: 200 len: 512 microversion: 2.10 time: 0.020112 Oct 27 18:46:35.031123 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 233/479] 10.222.0.42 () {60 vars in 1340 bytes} [Thu Oct 27 18:46:35 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2105908824?user_id=c9414efebfe64d879f3f521135386e99 => generated 512 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 18:46:35.047033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c972e820-cdc8-44b5-a692-965a8dd1c5d1 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Action: 'create', calling method: .version_select at 0x7fc86b4d8700>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-697913164", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTQFaaPAh6l/wDlKorIqgiyK+NLXRm7u2Cwx52p4pde3FEW7+IXan0RV5a2ksMgEIYbaJLmUjss3+R0duOXf98lPI9E2mIXoZNCkC+MC5kV8vWaXLhIIlCT2nmtwi8FTQ=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:35.048029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-545002913", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:35.071378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c972e820-cdc8-44b5-a692-965a8dd1c5d1 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Getting quotas for project 09af2379739c44e48d6ac7e9207d4791. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:46:35.076325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c972e820-cdc8-44b5-a692-965a8dd1c5d1 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Getting quotas for user f4e48ac1347943afb205a584bcfe401f and project 09af2379739c44e48d6ac7e9207d4791. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:46:35.141942 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c972e820-cdc8-44b5-a692-965a8dd1c5d1 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.102176 Oct 27 18:46:35.143487 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 234/480] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Oct 27 18:46:35 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 18:46:35.159512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:46:35.164662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0be13a44-2570-4a78-a6f6-394c8972eaa0 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Calling method '.version_select at 0x7fc86b4ecca0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:35.178546 n-d-860687-3 devstack@n-api.service[127028]: WARNING oslo_db.sqlalchemy.utils [None req-0be13a44-2570-4a78-a6f6-394c8972eaa0 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 18:46:35.202285 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0be13a44-2570-4a78-a6f6-394c8972eaa0 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] 10.222.0.42 "GET /compute/v2.1/os-keypairs?user_id=c9414efebfe64d879f3f521135386e99" status: 200 len: 726 microversion: 2.10 time: 0.052309 Oct 27 18:46:35.205313 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 235/481] 10.222.0.42 () {60 vars in 1259 bytes} [Thu Oct 27 18:46:35 2022] GET /compute/v2.1/os-keypairs?user_id=c9414efebfe64d879f3f521135386e99 => generated 726 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:46:35.217244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ff2b7a61-3ecc-43db-8271-1dd0ec07746b tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Calling method '.version_select at 0x7fc86b4f33a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:35.263961 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ff2b7a61-3ecc-43db-8271-1dd0ec07746b tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-697913164" status: 204 len: 0 microversion: 2.10 time: 0.051137 Oct 27 18:46:35.266351 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 236/482] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Oct 27 18:46:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-697913164 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 18:46:35.276579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2ae4d00d-b733-4264-a482-1afa5e3c6561 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Calling method '.version_select at 0x7fc86ba94f70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:35.357510 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2ae4d00d-b733-4264-a482-1afa5e3c6561 tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1377200551?user_id=c9414efebfe64d879f3f521135386e99" status: 204 len: 0 microversion: 2.10 time: 0.086560 Oct 27 18:46:35.358528 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 237/483] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 18:46:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1377200551?user_id=c9414efebfe64d879f3f521135386e99 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 18:46:35.369626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-30a29905-d5b0-499b-9699-c1689a63b6e6 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:35.370257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-30a29905-d5b0-499b-9699-c1689a63b6e6 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:35.393123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30a29905-d5b0-499b-9699-c1689a63b6e6 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:35.393628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30a29905-d5b0-499b-9699-c1689a63b6e6 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:35.394072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30a29905-d5b0-499b-9699-c1689a63b6e6 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:35.394827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30a29905-d5b0-499b-9699-c1689a63b6e6 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:35.395288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30a29905-d5b0-499b-9699-c1689a63b6e6 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:35.395719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30a29905-d5b0-499b-9699-c1689a63b6e6 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:35.524606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:46:35.525038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:46:35.525529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:46:35.525940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:46:35.526360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:46:35.543635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:35.547818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:35.548519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:35.549373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:35.551233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:35.552199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:35.597123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Getting quotas for project 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:46:35.602694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Getting quotas for user 1917ae65262c40b792c28c2aa4d44b44 and project 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:46:35.624973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:46:35.628348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:46:35.767603 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9473a560-b175-4db4-a7f4-5eed970c3a62 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.879891 Oct 27 18:46:35.775171 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 247/484] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:46:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:46:35.784173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4135fc94-f38e-44fe-8c03-a4b51887cc4d tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] Calling method '.version_select at 0x7fc86b59e280>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:35.814327 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4135fc94-f38e-44fe-8c03-a4b51887cc4d tempest-KeyPairsV210TestJSON-1450246777 tempest-KeyPairsV210TestJSON-1450246777-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105908824?user_id=c9414efebfe64d879f3f521135386e99" status: 204 len: 0 microversion: 2.10 time: 0.037239 Oct 27 18:46:35.815368 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 248/485] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 18:46:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105908824?user_id=c9414efebfe64d879f3f521135386e99 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 18:46:35.824771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce032c5c-fd14-4173-b7dd-06b6be5a4450 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:35.825421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ce032c5c-fd14-4173-b7dd-06b6be5a4450 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:35.843306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce032c5c-fd14-4173-b7dd-06b6be5a4450 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:35.844234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce032c5c-fd14-4173-b7dd-06b6be5a4450 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:35.846471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce032c5c-fd14-4173-b7dd-06b6be5a4450 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:35.851657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce032c5c-fd14-4173-b7dd-06b6be5a4450 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:35.852545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce032c5c-fd14-4173-b7dd-06b6be5a4450 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:35.853521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce032c5c-fd14-4173-b7dd-06b6be5a4450 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:35.963587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-30a29905-d5b0-499b-9699-c1689a63b6e6 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:35.991494 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-30a29905-d5b0-499b-9699-c1689a63b6e6 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1477 microversion: 2.1 time: 0.629333 Oct 27 18:46:35.993465 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 238/486] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:35 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1477 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:36.008978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ce032c5c-fd14-4173-b7dd-06b6be5a4450 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:36.010757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-547d0bf8-f5ff-4c59-86ff-884ec77b1262 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:36.011388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-547d0bf8-f5ff-4c59-86ff-884ec77b1262 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:36.020117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ce032c5c-fd14-4173-b7dd-06b6be5a4450 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:36.025775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ce032c5c-fd14-4173-b7dd-06b6be5a4450 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:36.029511 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce032c5c-fd14-4173-b7dd-06b6be5a4450 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1258 microversion: 2.25 time: 0.211796 Oct 27 18:46:36.031727 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 249/487] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:35 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1258 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:36.083850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-547d0bf8-f5ff-4c59-86ff-884ec77b1262 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:36.093799 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-547d0bf8-f5ff-4c59-86ff-884ec77b1262 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1212 microversion: 2.1 time: 0.098708 Oct 27 18:46:36.094759 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 239/488] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:35 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1212 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:37.016255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-92386544-0b1d-4957-8585-fa68ea2d6cd2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:37.016861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-92386544-0b1d-4957-8585-fa68ea2d6cd2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:37.033858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92386544-0b1d-4957-8585-fa68ea2d6cd2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:37.034613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92386544-0b1d-4957-8585-fa68ea2d6cd2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:37.034817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92386544-0b1d-4957-8585-fa68ea2d6cd2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:37.035529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92386544-0b1d-4957-8585-fa68ea2d6cd2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:37.035986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92386544-0b1d-4957-8585-fa68ea2d6cd2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:37.036417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92386544-0b1d-4957-8585-fa68ea2d6cd2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:37.061880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-572d3832-5297-4beb-a016-b5010572f5f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:37.062543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-572d3832-5297-4beb-a016-b5010572f5f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:37.075405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-572d3832-5297-4beb-a016-b5010572f5f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:37.075858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-572d3832-5297-4beb-a016-b5010572f5f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:37.076285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-572d3832-5297-4beb-a016-b5010572f5f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:37.077007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-572d3832-5297-4beb-a016-b5010572f5f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:37.087264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-572d3832-5297-4beb-a016-b5010572f5f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:37.088332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-572d3832-5297-4beb-a016-b5010572f5f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:37.294826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-92386544-0b1d-4957-8585-fa68ea2d6cd2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:37.326306 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-92386544-0b1d-4957-8585-fa68ea2d6cd2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1477 microversion: 2.1 time: 0.312179 Oct 27 18:46:37.327667 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 250/489] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:37 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1477 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:37.331649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-572d3832-5297-4beb-a016-b5010572f5f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:37.345123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-261c7f49-92a4-40c5-a196-3cabce91d856 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:37.345749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-261c7f49-92a4-40c5-a196-3cabce91d856 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:37.351713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-572d3832-5297-4beb-a016-b5010572f5f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:37.354094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-572d3832-5297-4beb-a016-b5010572f5f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:37.357373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-261c7f49-92a4-40c5-a196-3cabce91d856 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:37.357948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-261c7f49-92a4-40c5-a196-3cabce91d856 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:37.360492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-261c7f49-92a4-40c5-a196-3cabce91d856 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:37.361267 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-572d3832-5297-4beb-a016-b5010572f5f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1320 microversion: 2.25 time: 0.300977 Oct 27 18:46:37.361389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-261c7f49-92a4-40c5-a196-3cabce91d856 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:37.362467 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 240/490] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:37 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:46:37.362944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-261c7f49-92a4-40c5-a196-3cabce91d856 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:37.363558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-261c7f49-92a4-40c5-a196-3cabce91d856 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:37.508788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-261c7f49-92a4-40c5-a196-3cabce91d856 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:37.521840 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-261c7f49-92a4-40c5-a196-3cabce91d856 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1264 microversion: 2.1 time: 0.191761 Oct 27 18:46:37.527587 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 251/491] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:37 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:37.903906 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ad47d58b-f5ba-4bbe-b37d-c0af683dde2d tempest-TenantUsagesNegativeTestJSON-1907397054 tempest-TenantUsagesNegativeTestJSON-1907397054-project-admin] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-26T18%3A46%3A37.242768&end=2022-10-28T18%3A46%3A37.242768" status: 404 len: 112 microversion: - time: 0.538697 Oct 27 18:46:37.904435 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 241/492] 10.222.0.42 () {58 vars in 1316 bytes} [Thu Oct 27 18:46:37 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-26T18%3A46%3A37.242768&end=2022-10-28T18%3A46%3A37.242768 => generated 112 bytes in 541 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 18:46:37.920518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-08c3acea-8d4f-4b20-ae27-e2310103ccf2 req-60ee9003-b94f-41d9-a962-a9054c6e2f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43e1759-0ffb-423c-8d31-569d5ce79268", "name": "network-vif-unplugged", "status": "completed", "tag": "a4a765b2-af26-4b76-a70c-74d7dc9d17af"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:37.948969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-08c3acea-8d4f-4b20-ae27-e2310103ccf2 req-60ee9003-b94f-41d9-a962-a9054c6e2f05 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:37.949543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-08c3acea-8d4f-4b20-ae27-e2310103ccf2 req-60ee9003-b94f-41d9-a962-a9054c6e2f05 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:37.950002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-08c3acea-8d4f-4b20-ae27-e2310103ccf2 req-60ee9003-b94f-41d9-a962-a9054c6e2f05 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:37.983642 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-08c3acea-8d4f-4b20-ae27-e2310103ccf2 req-60ee9003-b94f-41d9-a962-a9054c6e2f05 service nova] Creating event network-vif-unplugged:a4a765b2-af26-4b76-a70c-74d7dc9d17af for instance a43e1759-0ffb-423c-8d31-569d5ce79268 on n-h2-860687-3 Oct 27 18:46:37.996466 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-08c3acea-8d4f-4b20-ae27-e2310103ccf2 req-60ee9003-b94f-41d9-a962-a9054c6e2f05 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090649 Oct 27 18:46:38.003380 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 242/493] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:38.019254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3467b0f1-f7ae-471a-9525-a16b24dd4cd3 tempest-TenantUsagesNegativeTestJSON-1907397054 tempest-TenantUsagesNegativeTestJSON-1907397054-project-admin] Calling method '.version_select at 0x7fc86b4d8940>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:38.031544 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-3467b0f1-f7ae-471a-9525-a16b24dd4cd3 tempest-TenantUsagesNegativeTestJSON-1907397054 tempest-TenantUsagesNegativeTestJSON-1907397054-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3467b0f1-f7ae-471a-9525-a16b24dd4cd3 tempest-TenantUsagesNegativeTestJSON-1907397054 tempest-TenantUsagesNegativeTestJSON-1907397054-project-admin] Request method failure captured: Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-simple-tenant-usage/2677029fdefa4ffca838803d92608753?start=2022-10-28T18%3A46%3A37.242768&end=2022-10-26T18%3A46%3A37.242768 HTTP/1.1 Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtINAfURTzw-batXVA7EBEJihvLck2zwCZtDCC3BJoJx3h4Yka8Hi8WFJ8oqBz5v9A8kr6_h1_3wVQcNr22oPzPUX2o_GqWHjDau6LiFft9OAtDiHVLHvwuSarr8-du8l8wCiYwTptqfXolhKKOl1k3lHO0o1xEwq0n1Q3evca79vV0 Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 73c1493d6f4742fb9ef246b3e5e3e70f Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1907397054 Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 18:46:38.033715 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 18:46:38.035381 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/73c1493d6f4742fb9ef246b3e5e3e70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73c1493d6f4742fb9ef246b3e5e3e70f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_73c1493d6f4742fb9ef246b3e5e3e70f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73c1493d6f4742fb9ef246b3e5e3e70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:38.035381 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1907397054 Oct 27 18:46:38.035381 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 73c1493d6f4742fb9ef246b3e5e3e70f Oct 27 18:46:38.035381 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1907397054 Oct 27 18:46:38.035381 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TenantUsagesNegativeTestJSON-1907397054-project-admin Oct 27 18:46:38.035381 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:38.035381 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:38.035381 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ec39aaa7d16547c885af7fb38434fe56 Oct 27 18:46:38.035381 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1907397054-project-admin Oct 27 18:46:38.035381 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:46:38.035381 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid start time. The start time cannot occur after the end time. Oct 27 18:46:38.035381 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '2677029fdefa4ffca838803d92608753'} Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 18:46:38.036290 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 27 18:46:38.037741 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:38.037741 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:38.037741 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:38.037741 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:38.037741 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:38.037741 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:38.037741 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:38.037741 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:38.037741 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 27 18:46:38.037741 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:38.039383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3467b0f1-f7ae-471a-9525-a16b24dd4cd3 tempest-TenantUsagesNegativeTestJSON-1907397054 tempest-TenantUsagesNegativeTestJSON-1907397054-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:38.040444 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3467b0f1-f7ae-471a-9525-a16b24dd4cd3 tempest-TenantUsagesNegativeTestJSON-1907397054 tempest-TenantUsagesNegativeTestJSON-1907397054-project-admin] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage/2677029fdefa4ffca838803d92608753?start=2022-10-28T18%3A46%3A37.242768&end=2022-10-26T18%3A46%3A37.242768" status: 400 len: 111 microversion: 2.1 time: 0.035668 Oct 27 18:46:38.044699 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 243/494] 10.222.0.42 () {58 vars in 1412 bytes} [Thu Oct 27 18:46:38 2022] GET /compute/v2.1/os-simple-tenant-usage/2677029fdefa4ffca838803d92608753?start=2022-10-28T18%3A46%3A37.242768&end=2022-10-26T18%3A46%3A37.242768 => generated 111 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:46:38.113443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-accde912-b150-4faf-a65b-e0f0838bf151 tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472 tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:38.119006 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-accde912-b150-4faf-a65b-e0f0838bf151 tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472 tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-accde912-b150-4faf-a65b-e0f0838bf151 tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472 tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472-project-admin] Request method failure captured: Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIN1K4m7LPo7rlcCRZUNniqpWw2xuOy7KktLT6yHMxvXvEIZh41amx8itZhkZ2BoMi2kdxzwfvo1msA6XApTrpXJ1tLlvJmZVFfG16xWhoJFp965ScyNhLDSmqwA_mIQuBjnalWw-kGASHCHYc6bHI-NsU6_QiKR54M7Yx-11Wvpzo Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 312e7bc4dcd34cee89ab123b88158388 Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472 Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:46:38.131159 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:46:38.132595 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/312e7bc4dcd34cee89ab123b88158388"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/312e7bc4dcd34cee89ab123b88158388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_312e7bc4dcd34cee89ab123b88158388", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/312e7bc4dcd34cee89ab123b88158388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:38.132595 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472 Oct 27 18:46:38.132595 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 312e7bc4dcd34cee89ab123b88158388 Oct 27 18:46:38.132595 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472 Oct 27 18:46:38.132595 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472-project-admin Oct 27 18:46:38.132595 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:46:38.132595 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:46:38.132595 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 9fb34bd6b1b041c388148510eceb0ad8 Oct 27 18:46:38.132595 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472-project-admin Oct 27 18:46:38.132595 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:46:38.132595 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid timestamp for date invalid_time Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'invalid_time'} Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:38.133360 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-accde912-b150-4faf-a65b-e0f0838bf151 tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472 tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:38.139589 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-accde912-b150-4faf-a65b-e0f0838bf151 tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472 tempest-InstanceUsageAuditLogNegativeTestJSON-1117194472-project-admin] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.549593 Oct 27 18:46:38.140682 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 252/495] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Oct 27 18:46:37 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 551 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:46:38.145352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7a985d64-8332-4b69-8b45-ac7e66f91295 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:38.145958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7a985d64-8332-4b69-8b45-ac7e66f91295 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:38.155295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a985d64-8332-4b69-8b45-ac7e66f91295 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:38.155955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a985d64-8332-4b69-8b45-ac7e66f91295 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:38.156858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a985d64-8332-4b69-8b45-ac7e66f91295 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:38.158172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a985d64-8332-4b69-8b45-ac7e66f91295 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:38.158863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a985d64-8332-4b69-8b45-ac7e66f91295 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:38.159507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a985d64-8332-4b69-8b45-ac7e66f91295 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:38.199777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7a985d64-8332-4b69-8b45-ac7e66f91295 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:46:38.364525 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7a985d64-8332-4b69-8b45-ac7e66f91295 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 204 len: 0 microversion: 2.1 time: 0.228584 Oct 27 18:46:38.365516 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 253/496] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:46:38 2022] DELETE /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:46:38.529270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=24 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:38.574755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7df8626-9d75-4df5-ad87-39fb101d1e58 tempest-TenantUsagesNegativeTestJSON-577560718 tempest-TenantUsagesNegativeTestJSON-577560718-project] Calling method '.version_select at 0x7fc86b485550>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:38.591845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7df8626-9d75-4df5-ad87-39fb101d1e58 tempest-TenantUsagesNegativeTestJSON-577560718 tempest-TenantUsagesNegativeTestJSON-577560718-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '224fdbba078b427792dcb7686a1de149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677029fdefa4ffca838803d92608753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7df8626-9d75-4df5-ad87-39fb101d1e58 tempest-TenantUsagesNegativeTestJSON-577560718 tempest-TenantUsagesNegativeTestJSON-577560718-project] Request method failure captured: Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T18%3A46%3A37.242768&end=2022-10-28T18%3A46%3A37.242768&detailed=1 HTTP/1.1 Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtILFc4oZbN1UtY3m96MP-gEYJgs83ZWUegS_r_RSmenl1gv7dwA6EVfV80iSFruxoWUCfgSKex_rbEoba_wdHnwsA_0dFs0MouBWTDBntZ4XpEfOE4OcFOvCZd6K0bLDTe7wmKoXdepPdDxEfVJFRgSpuqUMuAUjopAHIIPfKgOolA Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 2677029fdefa4ffca838803d92608753 Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-577560718 Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:38.599836 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:38.604790 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2677029fdefa4ffca838803d92608753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2677029fdefa4ffca838803d92608753"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2677029fdefa4ffca838803d92608753", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2677029fdefa4ffca838803d92608753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:38.604790 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-577560718 Oct 27 18:46:38.604790 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 2677029fdefa4ffca838803d92608753 Oct 27 18:46:38.604790 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-577560718 Oct 27 18:46:38.604790 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TenantUsagesNegativeTestJSON-577560718-project Oct 27 18:46:38.604790 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:38.604790 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:38.604790 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 224fdbba078b427792dcb7686a1de149 Oct 27 18:46:38.604790 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-577560718-project Oct 27 18:46:38.604790 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:46:38.604790 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 27 18:46:38.604790 n-d-860687-3 devstack@n-api.service[127028]: action_args: {} Oct 27 18:46:38.604790 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:38.606132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:38.607351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:38.608594 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 27 18:46:38.608594 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:38.609788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7df8626-9d75-4df5-ad87-39fb101d1e58 tempest-TenantUsagesNegativeTestJSON-577560718 tempest-TenantUsagesNegativeTestJSON-577560718-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:38.612112 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7df8626-9d75-4df5-ad87-39fb101d1e58 tempest-TenantUsagesNegativeTestJSON-577560718 tempest-TenantUsagesNegativeTestJSON-577560718-project] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T18%3A46%3A37.242768&end=2022-10-28T18%3A46%3A37.242768&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.560174 Oct 27 18:46:38.618035 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 244/497] 10.222.0.42 () {58 vars in 1335 bytes} [Thu Oct 27 18:46:38 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T18%3A46%3A37.242768&end=2022-10-28T18%3A46%3A37.242768&detailed=1 => generated 123 bytes in 562 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:38.630343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c2fd3693-dcf4-4623-8ea3-4dba931d215e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:38.631998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c2fd3693-dcf4-4623-8ea3-4dba931d215e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:38.645500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2fd3693-dcf4-4623-8ea3-4dba931d215e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:38.647479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2fd3693-dcf4-4623-8ea3-4dba931d215e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:38.647927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2fd3693-dcf4-4623-8ea3-4dba931d215e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:38.654568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2fd3693-dcf4-4623-8ea3-4dba931d215e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:38.655300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2fd3693-dcf4-4623-8ea3-4dba931d215e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:38.655921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2fd3693-dcf4-4623-8ea3-4dba931d215e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:38.886134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7fcc9637-f545-49ef-9b7c-be69415a781d tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:38.895093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7fcc9637-f545-49ef-9b7c-be69415a781d tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '2b886cd0dc394ffc887f49dbeb8b3ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee13570e8d9492c8f7994e7e1c187a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7fcc9637-f545-49ef-9b7c-be69415a781d tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184-project] Request method failure captured: Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIMlLTCX0hzZi3Fqq449DXmBicT__zhf330wNUDScjtvkRLOFlyxdL5HO2AWxyUhj3seCF7xLQ3VjlLwh2VeZgOLjYNqH1bRNw_psWcYz0vjhfOBYgjBkWcLlLQtzk4V5qsF7FZIIQ9i-fstDns5BdvjLCuxz8FB38_pVp9qYuNypo Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: aee13570e8d9492c8f7994e7e1c187a3 Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:46:38.900123 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:46:38.901629 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aee13570e8d9492c8f7994e7e1c187a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aee13570e8d9492c8f7994e7e1c187a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aee13570e8d9492c8f7994e7e1c187a3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aee13570e8d9492c8f7994e7e1c187a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:38.901629 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 Oct 27 18:46:38.901629 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: aee13570e8d9492c8f7994e7e1c187a3 Oct 27 18:46:38.901629 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 Oct 27 18:46:38.901629 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184-project Oct 27 18:46:38.901629 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:46:38.901629 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:46:38.901629 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2b886cd0dc394ffc887f49dbeb8b3ec5 Oct 27 18:46:38.901629 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184-project Oct 27 18:46:38.901629 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: action_args: {} Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:38.902331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 27 18:46:38.903710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:46:38.908875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7fcc9637-f545-49ef-9b7c-be69415a781d tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:38.908875 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7fcc9637-f545-49ef-9b7c-be69415a781d tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184-project] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.535383 Oct 27 18:46:38.908875 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 254/498] 10.222.0.42 () {58 vars in 1185 bytes} [Thu Oct 27 18:46:38 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 539 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:38.910630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b03c04c-8899-4033-b192-d676f2fb8a33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:38.910928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b03c04c-8899-4033-b192-d676f2fb8a33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:38.919012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b03c04c-8899-4033-b192-d676f2fb8a33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:38.919469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b03c04c-8899-4033-b192-d676f2fb8a33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:38.920475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b03c04c-8899-4033-b192-d676f2fb8a33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:38.921367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b03c04c-8899-4033-b192-d676f2fb8a33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:38.922081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b03c04c-8899-4033-b192-d676f2fb8a33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:38.922699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b03c04c-8899-4033-b192-d676f2fb8a33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:38.931294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c2fd3693-dcf4-4623-8ea3-4dba931d215e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:38.950999 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c2fd3693-dcf4-4623-8ea3-4dba931d215e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1463 microversion: 2.1 time: 0.330034 Oct 27 18:46:38.951494 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 245/499] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:38 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1463 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:38.956101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03b108cd-55a2-4e3a-a6d3-593b0e39d41f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:38.956897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-03b108cd-55a2-4e3a-a6d3-593b0e39d41f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:38.972748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03b108cd-55a2-4e3a-a6d3-593b0e39d41f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:38.973241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03b108cd-55a2-4e3a-a6d3-593b0e39d41f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:38.973873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03b108cd-55a2-4e3a-a6d3-593b0e39d41f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:38.974643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03b108cd-55a2-4e3a-a6d3-593b0e39d41f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:38.975094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03b108cd-55a2-4e3a-a6d3-593b0e39d41f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:38.975523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03b108cd-55a2-4e3a-a6d3-593b0e39d41f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:39.062806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-03b108cd-55a2-4e3a-a6d3-593b0e39d41f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:39.074132 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-03b108cd-55a2-4e3a-a6d3-593b0e39d41f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1270 microversion: 2.1 time: 0.121517 Oct 27 18:46:39.093078 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 246/500] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:38 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1270 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:39.269152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3b03c04c-8899-4033-b192-d676f2fb8a33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:39.282915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3b03c04c-8899-4033-b192-d676f2fb8a33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:39.284688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3b03c04c-8899-4033-b192-d676f2fb8a33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:39.289558 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b03c04c-8899-4033-b192-d676f2fb8a33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1362 microversion: 2.25 time: 0.383615 Oct 27 18:46:39.290453 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 255/501] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:38 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:39.309392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1416005795", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "547218031", "adminPass": "***", "networks": [{"uuid": "638fca29-2801-4b26-833b-1d1d0c6d3d12"}], "security_groups": [{"name": "tempest-securitygroup--1631803479"}], "key_name": "tempest-keypair-1180244837", "user_data": "}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:39.472369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] validate_networks() for [('638fca29-2801-4b26-833b-1d1d0c6d3d12', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:46:39.521871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-88122b3f-58bb-4e2f-9a6d-c9dce8a2fd8f tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b48e790>, body: {"quota_set": {"ram": "5120"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:39.650958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88122b3f-58bb-4e2f-9a6d-c9dce8a2fd8f tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:39.654800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88122b3f-58bb-4e2f-9a6d-c9dce8a2fd8f tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:39.655854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88122b3f-58bb-4e2f-9a6d-c9dce8a2fd8f tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:39.656995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88122b3f-58bb-4e2f-9a6d-c9dce8a2fd8f tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:39.658616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88122b3f-58bb-4e2f-9a6d-c9dce8a2fd8f tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:39.664389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88122b3f-58bb-4e2f-9a6d-c9dce8a2fd8f tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:39.713846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:39.796566 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-88122b3f-58bb-4e2f-9a6d-c9dce8a2fd8f tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/b5201f1ea111496c8305266c56bda44e" status: 200 len: 148 microversion: 2.57 time: 0.719049 Oct 27 18:46:39.797939 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 247/502] 10.222.0.42 () {62 vars in 1303 bytes} [Thu Oct 27 18:46:39 2022] PUT /compute/v2.1/os-quota-sets/b5201f1ea111496c8305266c56bda44e => generated 148 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:46:39.818068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8f8c28e8-96e8-467b-a541-0fd3e8de0e84 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:39.820487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8f8c28e8-96e8-467b-a541-0fd3e8de0e84 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '2b886cd0dc394ffc887f49dbeb8b3ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee13570e8d9492c8f7994e7e1c187a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8f8c28e8-96e8-467b-a541-0fd3e8de0e84 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184-project] Request method failure captured: Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27%2018:46:38 HTTP/1.1 Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtIMlLTCX0hzZi3Fqq449DXmBicT__zhf330wNUDScjtvkRLOFlyxdL5HO2AWxyUhj3seCF7xLQ3VjlLwh2VeZgOLjYNqH1bRNw_psWcYz0vjhfOBYgjBkWcLlLQtzk4V5qsF7FZIIQ9i-fstDns5BdvjLCuxz8FB38_pVp9qYuNypo Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: aee13570e8d9492c8f7994e7e1c187a3 Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:46:39.823559 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:46:39.825721 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aee13570e8d9492c8f7994e7e1c187a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aee13570e8d9492c8f7994e7e1c187a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aee13570e8d9492c8f7994e7e1c187a3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aee13570e8d9492c8f7994e7e1c187a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:46:39.825721 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 Oct 27 18:46:39.825721 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: aee13570e8d9492c8f7994e7e1c187a3 Oct 27 18:46:39.825721 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 Oct 27 18:46:39.825721 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184-project Oct 27 18:46:39.825721 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:46:39.825721 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:46:39.825721 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2b886cd0dc394ffc887f49dbeb8b3ec5 Oct 27 18:46:39.825721 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184-project Oct 27 18:46:39.825721 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '2022-10-27 18:46:38'} Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:46:39.826507 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 27 18:46:39.827930 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:46:39.832206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8f8c28e8-96e8-467b-a541-0fd3e8de0e84 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:46:39.833608 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8f8c28e8-96e8-467b-a541-0fd3e8de0e84 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184 tempest-InstanceUsageAuditLogNegativeTestJSON-1577584184-project] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27 18:46:38" status: 403 len: 128 microversion: 2.1 time: 0.034400 Oct 27 18:46:39.834759 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 248/503] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 18:46:39 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27%2018%3A46%3A38 => generated 128 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:46:39.843982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-43b0fa67-50b2-49b1-b084-44e984b6efce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:39.845042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-43b0fa67-50b2-49b1-b084-44e984b6efce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:39.869697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43b0fa67-50b2-49b1-b084-44e984b6efce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:39.872033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43b0fa67-50b2-49b1-b084-44e984b6efce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:39.872946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43b0fa67-50b2-49b1-b084-44e984b6efce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:39.874312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43b0fa67-50b2-49b1-b084-44e984b6efce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:39.875119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43b0fa67-50b2-49b1-b084-44e984b6efce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:39.875894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43b0fa67-50b2-49b1-b084-44e984b6efce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:40.167219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-43b0fa67-50b2-49b1-b084-44e984b6efce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:40.175784 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-43b0fa67-50b2-49b1-b084-44e984b6efce tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1463 microversion: 2.1 time: 0.339816 Oct 27 18:46:40.183337 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 249/504] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:39 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1463 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:40.212707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9dc95992-bdc9-43fe-a561-27a1513916e3 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Calling method '.version_select at 0x7fc86b48e9d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:40.655169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dc95992-bdc9-43fe-a561-27a1513916e3 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:40.656468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dc95992-bdc9-43fe-a561-27a1513916e3 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:40.657073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dc95992-bdc9-43fe-a561-27a1513916e3 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:40.657955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dc95992-bdc9-43fe-a561-27a1513916e3 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:40.658596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dc95992-bdc9-43fe-a561-27a1513916e3 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:40.659399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dc95992-bdc9-43fe-a561-27a1513916e3 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:40.690249 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9dc95992-bdc9-43fe-a561-27a1513916e3 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/b5201f1ea111496c8305266c56bda44e/detail" status: 200 len: 463 microversion: 2.57 time: 0.490206 Oct 27 18:46:40.695692 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 250/505] 10.222.0.42 () {60 vars in 1304 bytes} [Thu Oct 27 18:46:40 2022] GET /compute/v2.1/os-quota-sets/b5201f1ea111496c8305266c56bda44e/detail => generated 463 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:46:40.717349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d989165a-6910-409a-a0ae-ce7d4cc6072e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:40.722139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d989165a-6910-409a-a0ae-ce7d4cc6072e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:40.734737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d989165a-6910-409a-a0ae-ce7d4cc6072e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:40.739400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d989165a-6910-409a-a0ae-ce7d4cc6072e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:40.741621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d989165a-6910-409a-a0ae-ce7d4cc6072e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:40.745405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d989165a-6910-409a-a0ae-ce7d4cc6072e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:40.746314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d989165a-6910-409a-a0ae-ce7d4cc6072e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:40.747122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d989165a-6910-409a-a0ae-ce7d4cc6072e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:40.767874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:46:40.768338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:46:40.768712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:46:40.769134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:46:40.769553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:46:40.789752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:40.790259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:40.790734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:40.791959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:40.792644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:40.793387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:40.839795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Getting quotas for project f976057610c846c3b9caaf190a4abc89. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:46:40.846754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Getting quotas for user 97a85e281f544f4aa49b27cd776c849a and project f976057610c846c3b9caaf190a4abc89. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:46:40.852419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:40.878301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:46:40.885894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:46:40.987672 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-34b7c9c9-4ba2-4eb2-b7b8-0850e1789180 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.695856 Oct 27 18:46:40.989092 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 256/506] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:46:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:46:40.994063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:40.997750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:41.004914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:41.005775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:41.006587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:41.007525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:41.008199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:41.008842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:41.150685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:46:41.151123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:46:41.151599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:46:41.152247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:46:41.152957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:46:41.267719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d989165a-6910-409a-a0ae-ce7d4cc6072e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:41.272804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:41.277006 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d989165a-6910-409a-a0ae-ce7d4cc6072e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1312 microversion: 2.1 time: 0.579555 Oct 27 18:46:41.281443 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 251/507] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:40 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1312 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:41.284342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:41.284850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:41.285294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:41.286009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:41.286496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:41.286930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:41.298955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-4b96e503-f7da-41b1-bb16-7ce008d231a8 req-a13b13b5-2b08-4ed5-96f1-3e8af656ccaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43e1759-0ffb-423c-8d31-569d5ce79268", "name": "network-vif-plugged", "status": "completed", "tag": "a4a765b2-af26-4b76-a70c-74d7dc9d17af"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:41.320486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4b96e503-f7da-41b1-bb16-7ce008d231a8 req-a13b13b5-2b08-4ed5-96f1-3e8af656ccaf service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:41.321022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4b96e503-f7da-41b1-bb16-7ce008d231a8 req-a13b13b5-2b08-4ed5-96f1-3e8af656ccaf service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:41.321557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4b96e503-f7da-41b1-bb16-7ce008d231a8 req-a13b13b5-2b08-4ed5-96f1-3e8af656ccaf service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:41.345042 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-4b96e503-f7da-41b1-bb16-7ce008d231a8 req-a13b13b5-2b08-4ed5-96f1-3e8af656ccaf service nova] Creating event network-vif-plugged:a4a765b2-af26-4b76-a70c-74d7dc9d17af for instance a43e1759-0ffb-423c-8d31-569d5ce79268 on n-h2-860687-3 Oct 27 18:46:41.349271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:41.363154 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-4b96e503-f7da-41b1-bb16-7ce008d231a8 req-a13b13b5-2b08-4ed5-96f1-3e8af656ccaf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080046 Oct 27 18:46:41.364731 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 252/508] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:41.370533 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ed639362-8122-4cf6-8a88-d76adfad1a56 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "POST /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268/action" status: 202 len: 1067 microversion: 2.1 time: 0.378084 Oct 27 18:46:41.372640 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 257/509] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:46:40 2022] POST /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268/action => generated 1067 bytes in 383 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 18:46:41.375669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9815391-d1fb-4f59-a4f5-807fb625fb3e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:41.376739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c9815391-d1fb-4f59-a4f5-807fb625fb3e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:41.378859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-39cd30a9-e316-4954-bd9d-6a8aa0b0b3d9 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b4a8550>, body: {"quota_set": {"ram": "2048"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:41.393001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9815391-d1fb-4f59-a4f5-807fb625fb3e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:41.393885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9815391-d1fb-4f59-a4f5-807fb625fb3e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:41.403003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9815391-d1fb-4f59-a4f5-807fb625fb3e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:41.404054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9815391-d1fb-4f59-a4f5-807fb625fb3e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:41.404712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9815391-d1fb-4f59-a4f5-807fb625fb3e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:41.405578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9815391-d1fb-4f59-a4f5-807fb625fb3e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:41.770162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39cd30a9-e316-4954-bd9d-6a8aa0b0b3d9 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:41.770792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39cd30a9-e316-4954-bd9d-6a8aa0b0b3d9 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:41.771153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39cd30a9-e316-4954-bd9d-6a8aa0b0b3d9 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:41.775036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39cd30a9-e316-4954-bd9d-6a8aa0b0b3d9 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:41.775922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39cd30a9-e316-4954-bd9d-6a8aa0b0b3d9 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:41.778721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39cd30a9-e316-4954-bd9d-6a8aa0b0b3d9 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:41.857772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c9815391-d1fb-4f59-a4f5-807fb625fb3e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:41.867327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c9815391-d1fb-4f59-a4f5-807fb625fb3e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:41.868790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c9815391-d1fb-4f59-a4f5-807fb625fb3e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:41.877234 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c9815391-d1fb-4f59-a4f5-807fb625fb3e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1362 microversion: 2.25 time: 0.511231 Oct 27 18:46:41.885585 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 253/510] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:41 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1362 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:41.903765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-18b6894a-5aa2-4eac-a7ad-464dfc213a8f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:41.908379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-18b6894a-5aa2-4eac-a7ad-464dfc213a8f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:41.915195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39cd30a9-e316-4954-bd9d-6a8aa0b0b3d9 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:41.916101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39cd30a9-e316-4954-bd9d-6a8aa0b0b3d9 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:41.917644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18b6894a-5aa2-4eac-a7ad-464dfc213a8f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:41.918494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39cd30a9-e316-4954-bd9d-6a8aa0b0b3d9 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:41.919541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39cd30a9-e316-4954-bd9d-6a8aa0b0b3d9 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:41.920786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39cd30a9-e316-4954-bd9d-6a8aa0b0b3d9 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:41.921728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18b6894a-5aa2-4eac-a7ad-464dfc213a8f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:41.922100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39cd30a9-e316-4954-bd9d-6a8aa0b0b3d9 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:41.922211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18b6894a-5aa2-4eac-a7ad-464dfc213a8f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:41.926916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18b6894a-5aa2-4eac-a7ad-464dfc213a8f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:41.927399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18b6894a-5aa2-4eac-a7ad-464dfc213a8f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:41.928985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18b6894a-5aa2-4eac-a7ad-464dfc213a8f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:42.026054 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-39cd30a9-e316-4954-bd9d-6a8aa0b0b3d9 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/b5201f1ea111496c8305266c56bda44e?user_id=745507c7877b4d1da46b9a0ea954b58f" status: 200 len: 148 microversion: 2.57 time: 0.652106 Oct 27 18:46:42.027531 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 258/511] 10.222.0.42 () {62 vars in 1384 bytes} [Thu Oct 27 18:46:41 2022] PUT /compute/v2.1/os-quota-sets/b5201f1ea111496c8305266c56bda44e?user_id=745507c7877b4d1da46b9a0ea954b58f => generated 148 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:46:42.032694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b73e8069-336f-428d-94b1-42cf5b3d8834 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:42.033991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b73e8069-336f-428d-94b1-42cf5b3d8834 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:42.058172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73e8069-336f-428d-94b1-42cf5b3d8834 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:42.059877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73e8069-336f-428d-94b1-42cf5b3d8834 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:42.060355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73e8069-336f-428d-94b1-42cf5b3d8834 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:42.062343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73e8069-336f-428d-94b1-42cf5b3d8834 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:42.062947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73e8069-336f-428d-94b1-42cf5b3d8834 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:42.063437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73e8069-336f-428d-94b1-42cf5b3d8834 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:42.140108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-18b6894a-5aa2-4eac-a7ad-464dfc213a8f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:42.150771 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-18b6894a-5aa2-4eac-a7ad-464dfc213a8f tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1267 microversion: 2.1 time: 0.263625 Oct 27 18:46:42.153736 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 254/512] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:41 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1267 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:42.165192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0275ada1-dbaf-41ec-a725-aaf8c49ece46 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] Calling method '.version_select at 0x7fc86b44f9d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:42.435451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b73e8069-336f-428d-94b1-42cf5b3d8834 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:42.445442 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b73e8069-336f-428d-94b1-42cf5b3d8834 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1472 microversion: 2.1 time: 0.416730 Oct 27 18:46:42.447872 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 259/513] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:42 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1472 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:42.468589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-c1ed970f-567b-43ee-9c75-982fac4c0206 req-7f298bab-a5c9-4e52-824c-b7957e916213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60", "tag": "a55bb603-e764-4da2-9e39-dba7565b80df"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:42.503228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c1ed970f-567b-43ee-9c75-982fac4c0206 req-7f298bab-a5c9-4e52-824c-b7957e916213 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:42.503737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c1ed970f-567b-43ee-9c75-982fac4c0206 req-7f298bab-a5c9-4e52-824c-b7957e916213 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:42.504172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c1ed970f-567b-43ee-9c75-982fac4c0206 req-7f298bab-a5c9-4e52-824c-b7957e916213 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:42.547985 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-c1ed970f-567b-43ee-9c75-982fac4c0206 req-7f298bab-a5c9-4e52-824c-b7957e916213 service nova] Creating event network-changed:a55bb603-e764-4da2-9e39-dba7565b80df for instance 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 on n-h1-860687-3 Oct 27 18:46:42.562638 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-c1ed970f-567b-43ee-9c75-982fac4c0206 req-7f298bab-a5c9-4e52-824c-b7957e916213 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112023 Oct 27 18:46:42.569659 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 260/514] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:42.585931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e6de9d7b-1d34-4bcd-b256-8145c859d293 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:42.589164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e6de9d7b-1d34-4bcd-b256-8145c859d293 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:42.607914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6de9d7b-1d34-4bcd-b256-8145c859d293 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:42.609697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6de9d7b-1d34-4bcd-b256-8145c859d293 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:42.610206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6de9d7b-1d34-4bcd-b256-8145c859d293 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:42.612773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6de9d7b-1d34-4bcd-b256-8145c859d293 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:42.615670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6de9d7b-1d34-4bcd-b256-8145c859d293 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:42.616699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6de9d7b-1d34-4bcd-b256-8145c859d293 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:42.948478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e6de9d7b-1d34-4bcd-b256-8145c859d293 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:42.961514 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e6de9d7b-1d34-4bcd-b256-8145c859d293 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1312 microversion: 2.1 time: 0.389511 Oct 27 18:46:42.988286 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 261/515] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:42 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1312 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:43.289793 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0275ada1-dbaf-41ec-a725-aaf8c49ece46 tempest-QuotasAdminTestV257-284098364 tempest-QuotasAdminTestV257-284098364-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/b5201f1ea111496c8305266c56bda44e?user_id=745507c7877b4d1da46b9a0ea954b58f" status: 200 len: 190 microversion: 2.57 time: 1.134770 Oct 27 18:46:43.290724 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 255/516] 10.222.0.42 () {60 vars in 1364 bytes} [Thu Oct 27 18:46:42 2022] GET /compute/v2.1/os-quota-sets/b5201f1ea111496c8305266c56bda44e?user_id=745507c7877b4d1da46b9a0ea954b58f => generated 190 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:46:43.301741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e33565af-bd51-41e3-b55f-ac7972e58d93 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:43.304292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e33565af-bd51-41e3-b55f-ac7972e58d93 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:43.317744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e33565af-bd51-41e3-b55f-ac7972e58d93 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:43.321813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e33565af-bd51-41e3-b55f-ac7972e58d93 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:43.322508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e33565af-bd51-41e3-b55f-ac7972e58d93 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:43.323617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e33565af-bd51-41e3-b55f-ac7972e58d93 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:43.325111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e33565af-bd51-41e3-b55f-ac7972e58d93 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:43.326462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e33565af-bd51-41e3-b55f-ac7972e58d93 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:43.339640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:43.392980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1398998104", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": "none"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:43.515736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:46:43.516478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:46:43.518586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:46:43.519250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:46:43.519688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:46:43.537494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:43.539354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:43.540713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:43.542145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:43.542900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:43.546102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:43.593756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Getting quotas for project b268c59fc44c4f3993f0861c71a2519a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:46:43.603667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Getting quotas for user c713bf0a611a404a8779158825869b50 and project b268c59fc44c4f3993f0861c71a2519a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:46:43.635885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:46:43.639863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:46:43.742229 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-230b10b0-66be-444c-877e-578a0326a3eb tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.751069 Oct 27 18:46:43.743235 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 262/517] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 18:46:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 18:46:43.748186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5fa7af69-055c-40d2-8c4c-702a4e24e31e req-bc9146b9-5d3a-4547-8c60-3ab490801195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ec313b-f165-450a-92ba-215e7989df1f", "name": "network-vif-deleted", "tag": "887f62ff-9ca9-40b8-9c3d-8a4707bae8ce"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:43.773363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5fa7af69-055c-40d2-8c4c-702a4e24e31e req-bc9146b9-5d3a-4547-8c60-3ab490801195 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:43.774121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5fa7af69-055c-40d2-8c4c-702a4e24e31e req-bc9146b9-5d3a-4547-8c60-3ab490801195 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:43.774915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5fa7af69-055c-40d2-8c4c-702a4e24e31e req-bc9146b9-5d3a-4547-8c60-3ab490801195 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:43.812213 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5fa7af69-055c-40d2-8c4c-702a4e24e31e req-bc9146b9-5d3a-4547-8c60-3ab490801195 service nova] Creating event network-vif-deleted:887f62ff-9ca9-40b8-9c3d-8a4707bae8ce for instance c0ec313b-f165-450a-92ba-215e7989df1f on n-h1-860687-3 Oct 27 18:46:43.818994 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5fa7af69-055c-40d2-8c4c-702a4e24e31e req-bc9146b9-5d3a-4547-8c60-3ab490801195 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074354 Oct 27 18:46:43.819782 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 263/518] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:43.827995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-38be725e-e866-4c70-a3e2-ae711b523a9c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:43.828798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-38be725e-e866-4c70-a3e2-ae711b523a9c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:43.837201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38be725e-e866-4c70-a3e2-ae711b523a9c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:43.838085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38be725e-e866-4c70-a3e2-ae711b523a9c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:43.838726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38be725e-e866-4c70-a3e2-ae711b523a9c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:43.841402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38be725e-e866-4c70-a3e2-ae711b523a9c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:43.842037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38be725e-e866-4c70-a3e2-ae711b523a9c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:43.842997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38be725e-e866-4c70-a3e2-ae711b523a9c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:44.196973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-38be725e-e866-4c70-a3e2-ae711b523a9c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:44.222204 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-38be725e-e866-4c70-a3e2-ae711b523a9c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1321 microversion: 2.1 time: 0.400966 Oct 27 18:46:44.223341 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 264/519] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:43 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:44.256879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d8c36930-79dc-4bea-92b6-692e6df070f0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:44.257862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d8c36930-79dc-4bea-92b6-692e6df070f0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:44.269626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8c36930-79dc-4bea-92b6-692e6df070f0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:44.271803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8c36930-79dc-4bea-92b6-692e6df070f0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:44.273290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8c36930-79dc-4bea-92b6-692e6df070f0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:44.275225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8c36930-79dc-4bea-92b6-692e6df070f0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:44.276782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8c36930-79dc-4bea-92b6-692e6df070f0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:44.279727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8c36930-79dc-4bea-92b6-692e6df070f0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:44.799608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e33565af-bd51-41e3-b55f-ac7972e58d93 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:44.828681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e33565af-bd51-41e3-b55f-ac7972e58d93 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:44.841844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e33565af-bd51-41e3-b55f-ac7972e58d93 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:44.848960 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e33565af-bd51-41e3-b55f-ac7972e58d93 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1362 microversion: 2.25 time: 1.554430 Oct 27 18:46:44.853959 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 256/520] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:43 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1362 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:44.900792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-af446d12-05b0-4cce-9656-0d9a3286fa89 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:44.909139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-af446d12-05b0-4cce-9656-0d9a3286fa89 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:44.924335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d8c36930-79dc-4bea-92b6-692e6df070f0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:44.937127 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d8c36930-79dc-4bea-92b6-692e6df070f0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1472 microversion: 2.1 time: 0.691312 Oct 27 18:46:44.938050 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 265/521] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:44 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1472 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:44.949677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-abf27f6a-2022-4f2e-b410-8184a68368d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:44.952754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-abf27f6a-2022-4f2e-b410-8184a68368d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:44.957020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af446d12-05b0-4cce-9656-0d9a3286fa89 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:44.957537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af446d12-05b0-4cce-9656-0d9a3286fa89 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:44.960714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af446d12-05b0-4cce-9656-0d9a3286fa89 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:44.962607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af446d12-05b0-4cce-9656-0d9a3286fa89 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:44.964469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abf27f6a-2022-4f2e-b410-8184a68368d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:44.965375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af446d12-05b0-4cce-9656-0d9a3286fa89 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:44.965833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af446d12-05b0-4cce-9656-0d9a3286fa89 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:44.967412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abf27f6a-2022-4f2e-b410-8184a68368d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:44.968973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abf27f6a-2022-4f2e-b410-8184a68368d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:44.970975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abf27f6a-2022-4f2e-b410-8184a68368d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:44.974028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abf27f6a-2022-4f2e-b410-8184a68368d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:44.974734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abf27f6a-2022-4f2e-b410-8184a68368d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:45.234560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-af446d12-05b0-4cce-9656-0d9a3286fa89 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:45.249405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-af446d12-05b0-4cce-9656-0d9a3286fa89 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:45.252289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-af446d12-05b0-4cce-9656-0d9a3286fa89 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:45.261937 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-af446d12-05b0-4cce-9656-0d9a3286fa89 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "PUT /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1363 microversion: 2.75 time: 0.405612 Oct 27 18:46:45.263295 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 257/522] 10.222.0.42 () {62 vars in 1297 bytes} [Thu Oct 27 18:46:44 2022] PUT /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1363 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:45.268404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-2dc75277-55bd-4ecc-904d-5006ac9cac01 req-6c76120f-c4bc-44c1-8fc6-65125fc04133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901fd413-2d42-4014-86c1-5fe80598f789", "tag": "11fc4a40-18f3-4dcf-b5eb-6e544bd414ef"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:45.287137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2dc75277-55bd-4ecc-904d-5006ac9cac01 req-6c76120f-c4bc-44c1-8fc6-65125fc04133 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:45.287639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2dc75277-55bd-4ecc-904d-5006ac9cac01 req-6c76120f-c4bc-44c1-8fc6-65125fc04133 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:45.288081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2dc75277-55bd-4ecc-904d-5006ac9cac01 req-6c76120f-c4bc-44c1-8fc6-65125fc04133 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:45.310620 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-2dc75277-55bd-4ecc-904d-5006ac9cac01 req-6c76120f-c4bc-44c1-8fc6-65125fc04133 service nova] Creating event network-changed:11fc4a40-18f3-4dcf-b5eb-6e544bd414ef for instance 901fd413-2d42-4014-86c1-5fe80598f789 on n-h2-860687-3 Oct 27 18:46:45.318491 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-2dc75277-55bd-4ecc-904d-5006ac9cac01 req-6c76120f-c4bc-44c1-8fc6-65125fc04133 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053555 Oct 27 18:46:45.319964 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 258/523] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:45.326901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b4575fe6-2751-48d9-99ce-dd80a476c080 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:45.327892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b4575fe6-2751-48d9-99ce-dd80a476c080 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:45.335896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4575fe6-2751-48d9-99ce-dd80a476c080 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:45.336714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4575fe6-2751-48d9-99ce-dd80a476c080 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:45.337413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4575fe6-2751-48d9-99ce-dd80a476c080 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:45.338632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4575fe6-2751-48d9-99ce-dd80a476c080 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:45.340825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4575fe6-2751-48d9-99ce-dd80a476c080 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:45.341751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4575fe6-2751-48d9-99ce-dd80a476c080 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:45.529150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-abf27f6a-2022-4f2e-b410-8184a68368d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:45.539406 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-abf27f6a-2022-4f2e-b410-8184a68368d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1312 microversion: 2.1 time: 0.600081 Oct 27 18:46:45.545312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b4575fe6-2751-48d9-99ce-dd80a476c080 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:45.546961 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 266/524] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:44 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1312 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:45.554874 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b4575fe6-2751-48d9-99ce-dd80a476c080 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1321 microversion: 2.1 time: 0.233392 Oct 27 18:46:45.555954 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 259/525] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:45 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:45.562210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0ebed3c9-b606-4f06-ba95-c4065756822f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:45.565148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0ebed3c9-b606-4f06-ba95-c4065756822f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:45.589012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebed3c9-b606-4f06-ba95-c4065756822f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:45.593012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebed3c9-b606-4f06-ba95-c4065756822f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:45.593616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebed3c9-b606-4f06-ba95-c4065756822f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:45.596918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebed3c9-b606-4f06-ba95-c4065756822f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:45.597538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebed3c9-b606-4f06-ba95-c4065756822f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:45.598270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebed3c9-b606-4f06-ba95-c4065756822f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:45.790768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0ebed3c9-b606-4f06-ba95-c4065756822f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:45.811520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0ebed3c9-b606-4f06-ba95-c4065756822f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:45.812975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0ebed3c9-b606-4f06-ba95-c4065756822f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:45.829944 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0ebed3c9-b606-4f06-ba95-c4065756822f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1355 microversion: 2.75 time: 0.281819 Oct 27 18:46:45.832407 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 267/526] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:45 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1355 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:45.891399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-403003d2-bca8-4689-9832-5343d0094258 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:45.892355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-403003d2-bca8-4689-9832-5343d0094258 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:45.900713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-403003d2-bca8-4689-9832-5343d0094258 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:45.901472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-403003d2-bca8-4689-9832-5343d0094258 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:45.902648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-403003d2-bca8-4689-9832-5343d0094258 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:45.904096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-403003d2-bca8-4689-9832-5343d0094258 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:45.905350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-403003d2-bca8-4689-9832-5343d0094258 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:45.910634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-403003d2-bca8-4689-9832-5343d0094258 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:45.961412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4ee70225-b1ed-4137-88d1-9953eac2362c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:45.962168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4ee70225-b1ed-4137-88d1-9953eac2362c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:45.974924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee70225-b1ed-4137-88d1-9953eac2362c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:45.991091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee70225-b1ed-4137-88d1-9953eac2362c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:45.992018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee70225-b1ed-4137-88d1-9953eac2362c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:45.993580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee70225-b1ed-4137-88d1-9953eac2362c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:45.995035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee70225-b1ed-4137-88d1-9953eac2362c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:46.001237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee70225-b1ed-4137-88d1-9953eac2362c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:46.206764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-403003d2-bca8-4689-9832-5343d0094258 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:46.218289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-403003d2-bca8-4689-9832-5343d0094258 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:46.221731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-403003d2-bca8-4689-9832-5343d0094258 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:46.223642 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-403003d2-bca8-4689-9832-5343d0094258 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1362 microversion: 2.25 time: 0.345814 Oct 27 18:46:46.235395 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 260/527] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:45 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:46:46.549202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4ee70225-b1ed-4137-88d1-9953eac2362c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:46.564546 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4ee70225-b1ed-4137-88d1-9953eac2362c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1472 microversion: 2.1 time: 0.605813 Oct 27 18:46:46.564781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ebdd1f0-847d-458a-8068-021b2cd19a2a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:46.565467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ebdd1f0-847d-458a-8068-021b2cd19a2a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:46.588481 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 268/528] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:45 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1472 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:46.593945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ebdd1f0-847d-458a-8068-021b2cd19a2a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:46.595961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ebdd1f0-847d-458a-8068-021b2cd19a2a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:46.596762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ebdd1f0-847d-458a-8068-021b2cd19a2a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:46.597917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2bedc937-957b-4ee6-bd0e-110e49d526ef tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:46.600323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ebdd1f0-847d-458a-8068-021b2cd19a2a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:46.600797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ebdd1f0-847d-458a-8068-021b2cd19a2a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:46.601148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2bedc937-957b-4ee6-bd0e-110e49d526ef tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:46.606699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ebdd1f0-847d-458a-8068-021b2cd19a2a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:46.618721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bedc937-957b-4ee6-bd0e-110e49d526ef tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:46.619219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bedc937-957b-4ee6-bd0e-110e49d526ef tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:46.619659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bedc937-957b-4ee6-bd0e-110e49d526ef tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:46.624660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bedc937-957b-4ee6-bd0e-110e49d526ef tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:46.625352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bedc937-957b-4ee6-bd0e-110e49d526ef tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:46.625746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bedc937-957b-4ee6-bd0e-110e49d526ef tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:47.106848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2bedc937-957b-4ee6-bd0e-110e49d526ef tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:47.119458 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2bedc937-957b-4ee6-bd0e-110e49d526ef tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1389 microversion: 2.1 time: 0.529308 Oct 27 18:46:47.122473 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 269/529] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:46 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1389 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:47.129250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-33442a14-3a43-4cc1-8aa0-ef0b47facd2f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:47.130599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-33442a14-3a43-4cc1-8aa0-ef0b47facd2f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:47.139855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33442a14-3a43-4cc1-8aa0-ef0b47facd2f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:47.140549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33442a14-3a43-4cc1-8aa0-ef0b47facd2f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:47.141839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33442a14-3a43-4cc1-8aa0-ef0b47facd2f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:47.142935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33442a14-3a43-4cc1-8aa0-ef0b47facd2f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:47.143649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33442a14-3a43-4cc1-8aa0-ef0b47facd2f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:47.144361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33442a14-3a43-4cc1-8aa0-ef0b47facd2f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:47.242094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ebdd1f0-847d-458a-8068-021b2cd19a2a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:47.258000 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ebdd1f0-847d-458a-8068-021b2cd19a2a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1312 microversion: 2.1 time: 0.697654 Oct 27 18:46:47.258646 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 261/530] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:46 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1312 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:47.267352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5012f62f-67a1-47e9-8ea7-c2ab60a879d1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:47.271126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5012f62f-67a1-47e9-8ea7-c2ab60a879d1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:47.286691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5012f62f-67a1-47e9-8ea7-c2ab60a879d1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:47.289921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5012f62f-67a1-47e9-8ea7-c2ab60a879d1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:47.290689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5012f62f-67a1-47e9-8ea7-c2ab60a879d1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:47.295455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5012f62f-67a1-47e9-8ea7-c2ab60a879d1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:47.296603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5012f62f-67a1-47e9-8ea7-c2ab60a879d1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:47.299740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5012f62f-67a1-47e9-8ea7-c2ab60a879d1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:47.313137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-33442a14-3a43-4cc1-8aa0-ef0b47facd2f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:47.327005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-33442a14-3a43-4cc1-8aa0-ef0b47facd2f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:47.329662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-33442a14-3a43-4cc1-8aa0-ef0b47facd2f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:47.338307 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-33442a14-3a43-4cc1-8aa0-ef0b47facd2f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1417 microversion: 2.75 time: 0.214032 Oct 27 18:46:47.341586 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 270/531] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:47 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1417 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:47.595829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3910750d-f98b-4fe7-82e3-0b599e3aab80 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:47.596612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3910750d-f98b-4fe7-82e3-0b599e3aab80 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:47.609153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3910750d-f98b-4fe7-82e3-0b599e3aab80 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:47.609967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3910750d-f98b-4fe7-82e3-0b599e3aab80 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:47.611315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3910750d-f98b-4fe7-82e3-0b599e3aab80 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:47.612053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3910750d-f98b-4fe7-82e3-0b599e3aab80 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:47.612517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3910750d-f98b-4fe7-82e3-0b599e3aab80 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:47.615216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3910750d-f98b-4fe7-82e3-0b599e3aab80 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:47.685560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5012f62f-67a1-47e9-8ea7-c2ab60a879d1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:47.699915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5012f62f-67a1-47e9-8ea7-c2ab60a879d1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:47.705293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5012f62f-67a1-47e9-8ea7-c2ab60a879d1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:47.713031 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5012f62f-67a1-47e9-8ea7-c2ab60a879d1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1362 microversion: 2.25 time: 0.452865 Oct 27 18:46:47.716287 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 262/532] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:47 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:47.724961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-7a817993-05bd-446a-b1da-539e6221ec23 req-04964163-f8ae-4665-89a3-c38f9a323e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c245477e-5ecc-4296-9557-8dfef9214334", "tag": "5d609ce6-6650-4772-b209-a042e0c43787"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:47.756089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7a817993-05bd-446a-b1da-539e6221ec23 req-04964163-f8ae-4665-89a3-c38f9a323e4d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:47.759066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7a817993-05bd-446a-b1da-539e6221ec23 req-04964163-f8ae-4665-89a3-c38f9a323e4d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:47.760828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7a817993-05bd-446a-b1da-539e6221ec23 req-04964163-f8ae-4665-89a3-c38f9a323e4d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:47.784307 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-7a817993-05bd-446a-b1da-539e6221ec23 req-04964163-f8ae-4665-89a3-c38f9a323e4d service nova] Creating event network-changed:5d609ce6-6650-4772-b209-a042e0c43787 for instance c245477e-5ecc-4296-9557-8dfef9214334 on n-h1-860687-3 Oct 27 18:46:47.792400 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-7a817993-05bd-446a-b1da-539e6221ec23 req-04964163-f8ae-4665-89a3-c38f9a323e4d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074003 Oct 27 18:46:47.794370 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 263/533] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:47.833845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3910750d-f98b-4fe7-82e3-0b599e3aab80 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:47.848981 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3910750d-f98b-4fe7-82e3-0b599e3aab80 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1472 microversion: 2.1 time: 0.259387 Oct 27 18:46:47.850509 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 271/534] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:47 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:46:48.148915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fe00eb09-0817-4e83-91a8-04dc3825caab tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:48.149918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fe00eb09-0817-4e83-91a8-04dc3825caab tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:48.160435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe00eb09-0817-4e83-91a8-04dc3825caab tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:48.160938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe00eb09-0817-4e83-91a8-04dc3825caab tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:48.161380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe00eb09-0817-4e83-91a8-04dc3825caab tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:48.162190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe00eb09-0817-4e83-91a8-04dc3825caab tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:48.162602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe00eb09-0817-4e83-91a8-04dc3825caab tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:48.163577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe00eb09-0817-4e83-91a8-04dc3825caab tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:48.210200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9565f8bc-3852-45a1-83bd-d28d1124cf2e tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b4b6b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:48.304991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9565f8bc-3852-45a1-83bd-d28d1124cf2e tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:48.306404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9565f8bc-3852-45a1-83bd-d28d1124cf2e tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:48.307044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9565f8bc-3852-45a1-83bd-d28d1124cf2e tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:48.309610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9565f8bc-3852-45a1-83bd-d28d1124cf2e tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:48.310377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9565f8bc-3852-45a1-83bd-d28d1124cf2e tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:48.311034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9565f8bc-3852-45a1-83bd-d28d1124cf2e tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:48.403264 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9565f8bc-3852-45a1-83bd-d28d1124cf2e tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/09b299235b7f4b95804ff390853cb375" status: 200 len: 240 microversion: 2.36 time: 0.371084 Oct 27 18:46:48.404655 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 264/535] 10.222.0.42 () {62 vars in 1303 bytes} [Thu Oct 27 18:46:48 2022] PUT /compute/v2.1/os-quota-sets/09b299235b7f4b95804ff390853cb375 => generated 240 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 18:46:48.410711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-155e028a-e953-453f-abf7-cfebe197ba06 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:48.411410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-155e028a-e953-453f-abf7-cfebe197ba06 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:48.429258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-155e028a-e953-453f-abf7-cfebe197ba06 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:48.430160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-155e028a-e953-453f-abf7-cfebe197ba06 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:48.430813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-155e028a-e953-453f-abf7-cfebe197ba06 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:48.432211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-155e028a-e953-453f-abf7-cfebe197ba06 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:48.432827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-155e028a-e953-453f-abf7-cfebe197ba06 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:48.434255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-155e028a-e953-453f-abf7-cfebe197ba06 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:48.452285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fe00eb09-0817-4e83-91a8-04dc3825caab tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:48.468895 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fe00eb09-0817-4e83-91a8-04dc3825caab tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1389 microversion: 2.1 time: 0.318209 Oct 27 18:46:48.469595 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 272/536] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:48 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1389 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:46:48.483729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9367f634-8083-46eb-bcf7-8607161ccb72 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:48.484008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9367f634-8083-46eb-bcf7-8607161ccb72 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:48.492056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9367f634-8083-46eb-bcf7-8607161ccb72 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:48.492545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9367f634-8083-46eb-bcf7-8607161ccb72 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:48.498170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9367f634-8083-46eb-bcf7-8607161ccb72 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:48.498968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9367f634-8083-46eb-bcf7-8607161ccb72 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:48.499446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9367f634-8083-46eb-bcf7-8607161ccb72 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:48.499880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9367f634-8083-46eb-bcf7-8607161ccb72 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:48.655205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-155e028a-e953-453f-abf7-cfebe197ba06 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:48.670602 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-155e028a-e953-453f-abf7-cfebe197ba06 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1312 microversion: 2.1 time: 0.264605 Oct 27 18:46:48.671218 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 265/537] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:48 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1312 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:48.683611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9367f634-8083-46eb-bcf7-8607161ccb72 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:48.685520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9563a2c6-4bec-474e-a62b-09e0aeb5c084 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Calling method '.version_select at 0x7fc86b3e84c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:48.719952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9367f634-8083-46eb-bcf7-8607161ccb72 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:48.726651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9367f634-8083-46eb-bcf7-8607161ccb72 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:48.769756 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9367f634-8083-46eb-bcf7-8607161ccb72 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1417 microversion: 2.75 time: 0.297133 Oct 27 18:46:48.771786 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 273/538] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:48 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1417 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:48.788888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-774bf776-9b99-4072-869c-6c4529c7e539 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:48.789793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-774bf776-9b99-4072-869c-6c4529c7e539 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:48.798772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-774bf776-9b99-4072-869c-6c4529c7e539 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:48.799303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-774bf776-9b99-4072-869c-6c4529c7e539 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:48.799814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-774bf776-9b99-4072-869c-6c4529c7e539 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:48.800656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-774bf776-9b99-4072-869c-6c4529c7e539 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:48.801371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-774bf776-9b99-4072-869c-6c4529c7e539 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:48.801817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-774bf776-9b99-4072-869c-6c4529c7e539 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:49.060442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-774bf776-9b99-4072-869c-6c4529c7e539 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:49.074308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-774bf776-9b99-4072-869c-6c4529c7e539 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:49.076119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-774bf776-9b99-4072-869c-6c4529c7e539 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:49.078051 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-774bf776-9b99-4072-869c-6c4529c7e539 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1362 microversion: 2.25 time: 0.294540 Oct 27 18:46:49.079089 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 274/539] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:48 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:49.090882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6d100b7e-22bd-4f17-b9fd-4c9c6539bf26 req-8a0288f7-5076-4efa-8ac5-79a2a07c9d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60", "name": "network-vif-plugged", "status": "completed", "tag": "a55bb603-e764-4da2-9e39-dba7565b80df"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:49.107230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6d100b7e-22bd-4f17-b9fd-4c9c6539bf26 req-8a0288f7-5076-4efa-8ac5-79a2a07c9d48 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:49.107730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6d100b7e-22bd-4f17-b9fd-4c9c6539bf26 req-8a0288f7-5076-4efa-8ac5-79a2a07c9d48 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:49.108170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6d100b7e-22bd-4f17-b9fd-4c9c6539bf26 req-8a0288f7-5076-4efa-8ac5-79a2a07c9d48 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:49.123010 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6d100b7e-22bd-4f17-b9fd-4c9c6539bf26 req-8a0288f7-5076-4efa-8ac5-79a2a07c9d48 service nova] Creating event network-vif-plugged:a55bb603-e764-4da2-9e39-dba7565b80df for instance 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 on n-h1-860687-3 Oct 27 18:46:49.131647 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6d100b7e-22bd-4f17-b9fd-4c9c6539bf26 req-8a0288f7-5076-4efa-8ac5-79a2a07c9d48 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050591 Oct 27 18:46:49.133331 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 275/540] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:49.141240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cc8d8253-0b6f-480c-bcfc-001fe41abd33 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:49.141947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cc8d8253-0b6f-480c-bcfc-001fe41abd33 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:49.148552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc8d8253-0b6f-480c-bcfc-001fe41abd33 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:49.149261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc8d8253-0b6f-480c-bcfc-001fe41abd33 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:49.149856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc8d8253-0b6f-480c-bcfc-001fe41abd33 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:49.150947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc8d8253-0b6f-480c-bcfc-001fe41abd33 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:49.151579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc8d8253-0b6f-480c-bcfc-001fe41abd33 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:49.153184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc8d8253-0b6f-480c-bcfc-001fe41abd33 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:49.197230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9563a2c6-4bec-474e-a62b-09e0aeb5c084 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:49.199704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9563a2c6-4bec-474e-a62b-09e0aeb5c084 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:49.200375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9563a2c6-4bec-474e-a62b-09e0aeb5c084 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:49.202684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9563a2c6-4bec-474e-a62b-09e0aeb5c084 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:49.203519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9563a2c6-4bec-474e-a62b-09e0aeb5c084 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:49.204787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9563a2c6-4bec-474e-a62b-09e0aeb5c084 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:49.235766 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9563a2c6-4bec-474e-a62b-09e0aeb5c084 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/09b299235b7f4b95804ff390853cb375/detail" status: 200 len: 672 microversion: 2.36 time: 0.563291 Oct 27 18:46:49.255480 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 266/541] 10.222.0.42 () {60 vars in 1304 bytes} [Thu Oct 27 18:46:48 2022] GET /compute/v2.1/os-quota-sets/09b299235b7f4b95804ff390853cb375/detail => generated 672 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:46:49.427514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cc8d8253-0b6f-480c-bcfc-001fe41abd33 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:49.436654 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cc8d8253-0b6f-480c-bcfc-001fe41abd33 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1472 microversion: 2.1 time: 0.301614 Oct 27 18:46:49.447157 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 276/542] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:49 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:49.496228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e4bdb3f5-bd9d-40da-be64-1af778d88ba7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:49.496905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e4bdb3f5-bd9d-40da-be64-1af778d88ba7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:49.504113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c5996d22-e6f9-47bf-816f-3b19771ef2c6 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b7848b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:49.504655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4bdb3f5-bd9d-40da-be64-1af778d88ba7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:49.505394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4bdb3f5-bd9d-40da-be64-1af778d88ba7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:49.505830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4bdb3f5-bd9d-40da-be64-1af778d88ba7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:49.506558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4bdb3f5-bd9d-40da-be64-1af778d88ba7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:49.510215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4bdb3f5-bd9d-40da-be64-1af778d88ba7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:49.512586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4bdb3f5-bd9d-40da-be64-1af778d88ba7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:49.782236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5996d22-e6f9-47bf-816f-3b19771ef2c6 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:49.782919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5996d22-e6f9-47bf-816f-3b19771ef2c6 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:49.783497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5996d22-e6f9-47bf-816f-3b19771ef2c6 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:49.784765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5996d22-e6f9-47bf-816f-3b19771ef2c6 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:49.785384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5996d22-e6f9-47bf-816f-3b19771ef2c6 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:49.785913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5996d22-e6f9-47bf-816f-3b19771ef2c6 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:49.832023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:49.838371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5996d22-e6f9-47bf-816f-3b19771ef2c6 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:49.839034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5996d22-e6f9-47bf-816f-3b19771ef2c6 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:49.839571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5996d22-e6f9-47bf-816f-3b19771ef2c6 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:49.843118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5996d22-e6f9-47bf-816f-3b19771ef2c6 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:49.843730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5996d22-e6f9-47bf-816f-3b19771ef2c6 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:49.844435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5996d22-e6f9-47bf-816f-3b19771ef2c6 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:49.854087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:49.931056 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c5996d22-e6f9-47bf-816f-3b19771ef2c6 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/09b299235b7f4b95804ff390853cb375?user_id=666c4a4b9c794b3d85d76cd3aa1ec93c" status: 200 len: 240 microversion: 2.36 time: 0.431561 Oct 27 18:46:49.939436 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 277/543] 10.222.0.42 () {62 vars in 1384 bytes} [Thu Oct 27 18:46:49 2022] PUT /compute/v2.1/os-quota-sets/09b299235b7f4b95804ff390853cb375?user_id=666c4a4b9c794b3d85d76cd3aa1ec93c => generated 240 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:46:49.945463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d832c043-7e06-477c-92e2-3d09f0758001 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:49.947224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d832c043-7e06-477c-92e2-3d09f0758001 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:49.956969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d832c043-7e06-477c-92e2-3d09f0758001 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:49.957501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d832c043-7e06-477c-92e2-3d09f0758001 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:49.957950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d832c043-7e06-477c-92e2-3d09f0758001 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:49.958948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d832c043-7e06-477c-92e2-3d09f0758001 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:49.959682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d832c043-7e06-477c-92e2-3d09f0758001 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:49.960131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d832c043-7e06-477c-92e2-3d09f0758001 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:50.121683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e4bdb3f5-bd9d-40da-be64-1af778d88ba7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:50.145621 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e4bdb3f5-bd9d-40da-be64-1af778d88ba7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1389 microversion: 2.1 time: 0.654116 Oct 27 18:46:50.147247 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 267/544] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:49 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1389 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:50.156723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae7c9659-89d9-4906-a826-ed4691231921 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:50.157518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ae7c9659-89d9-4906-a826-ed4691231921 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:50.167278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae7c9659-89d9-4906-a826-ed4691231921 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:50.169987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae7c9659-89d9-4906-a826-ed4691231921 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:50.172043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae7c9659-89d9-4906-a826-ed4691231921 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:50.173185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae7c9659-89d9-4906-a826-ed4691231921 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:50.174043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae7c9659-89d9-4906-a826-ed4691231921 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:50.176044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae7c9659-89d9-4906-a826-ed4691231921 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:50.264480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d832c043-7e06-477c-92e2-3d09f0758001 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:50.277014 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d832c043-7e06-477c-92e2-3d09f0758001 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1312 microversion: 2.1 time: 0.335217 Oct 27 18:46:50.278209 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 278/545] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:49 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1312 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:50.291097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5812e7d6-c845-4c02-8332-d6e30fb716b0 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] Calling method '.version_select at 0x7fc86b3c75e0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:50.312004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae7c9659-89d9-4906-a826-ed4691231921 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:50.322435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae7c9659-89d9-4906-a826-ed4691231921 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:50.325216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae7c9659-89d9-4906-a826-ed4691231921 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:50.330856 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ae7c9659-89d9-4906-a826-ed4691231921 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1438 microversion: 2.75 time: 0.180016 Oct 27 18:46:50.331438 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 268/546] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:50 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1438 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:50.336413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-96708426-2e56-46ed-9ece-45c63d3fed33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:50.337297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-96708426-2e56-46ed-9ece-45c63d3fed33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:50.351997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96708426-2e56-46ed-9ece-45c63d3fed33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:50.352903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96708426-2e56-46ed-9ece-45c63d3fed33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:50.354076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96708426-2e56-46ed-9ece-45c63d3fed33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:50.355191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96708426-2e56-46ed-9ece-45c63d3fed33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:50.356758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96708426-2e56-46ed-9ece-45c63d3fed33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:50.356758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96708426-2e56-46ed-9ece-45c63d3fed33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:50.414540 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5812e7d6-c845-4c02-8332-d6e30fb716b0 tempest-QuotasAdminTestV236-324501663 tempest-QuotasAdminTestV236-324501663-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/09b299235b7f4b95804ff390853cb375?user_id=666c4a4b9c794b3d85d76cd3aa1ec93c" status: 200 len: 282 microversion: 2.36 time: 0.134700 Oct 27 18:46:50.421987 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 279/547] 10.222.0.42 () {60 vars in 1364 bytes} [Thu Oct 27 18:46:50 2022] GET /compute/v2.1/os-quota-sets/09b299235b7f4b95804ff390853cb375?user_id=666c4a4b9c794b3d85d76cd3aa1ec93c => generated 282 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:46:50.434348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:50.457596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:50.500845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:50.501588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:50.502179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:50.503739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:50.504625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:50.506564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:50.699299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:46:50.700201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:46:50.700841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:46:50.701405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:46:50.702098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:46:50.785943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:50.794506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:50.795359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:50.796249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:50.797249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:50.797864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:50.798466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:50.893604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:50.904249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:50.905984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:50.911409 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f583645e-ab0a-4946-bf7b-2d85568c8d4f tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "POST /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8/action" status: 202 len: 1495 microversion: 2.75 time: 0.494716 Oct 27 18:46:50.912235 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 280/548] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 18:46:50 2022] POST /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8/action => generated 1495 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 18:46:50.916469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1bfa6d77-45ed-4525-a5c6-a1b65473c19a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:50.917335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1bfa6d77-45ed-4525-a5c6-a1b65473c19a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:50.922754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-96708426-2e56-46ed-9ece-45c63d3fed33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:50.924640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bfa6d77-45ed-4525-a5c6-a1b65473c19a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:50.925204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bfa6d77-45ed-4525-a5c6-a1b65473c19a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:50.926006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bfa6d77-45ed-4525-a5c6-a1b65473c19a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:50.926929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bfa6d77-45ed-4525-a5c6-a1b65473c19a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:50.928119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bfa6d77-45ed-4525-a5c6-a1b65473c19a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:50.928665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bfa6d77-45ed-4525-a5c6-a1b65473c19a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:50.937332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-96708426-2e56-46ed-9ece-45c63d3fed33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:50.938820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-96708426-2e56-46ed-9ece-45c63d3fed33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:50.940155 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-96708426-2e56-46ed-9ece-45c63d3fed33 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1362 microversion: 2.25 time: 0.607713 Oct 27 18:46:50.941195 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 269/549] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:50 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:50.945902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e59ff552-6f38-43a7-be5d-c55aa94ed586 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:50.946621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e59ff552-6f38-43a7-be5d-c55aa94ed586 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:50.954474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e59ff552-6f38-43a7-be5d-c55aa94ed586 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:50.955287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e59ff552-6f38-43a7-be5d-c55aa94ed586 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:50.955913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e59ff552-6f38-43a7-be5d-c55aa94ed586 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:50.956827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e59ff552-6f38-43a7-be5d-c55aa94ed586 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:50.957479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e59ff552-6f38-43a7-be5d-c55aa94ed586 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:50.958086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e59ff552-6f38-43a7-be5d-c55aa94ed586 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:51.123740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1bfa6d77-45ed-4525-a5c6-a1b65473c19a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:51.134666 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1bfa6d77-45ed-4525-a5c6-a1b65473c19a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1472 microversion: 2.1 time: 0.221185 Oct 27 18:46:51.135469 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 281/550] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:50 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:51.167792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e59ff552-6f38-43a7-be5d-c55aa94ed586 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:51.176707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-29e34379-ace3-45ee-bc1f-bf6b4eaf425d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:51.177323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-29e34379-ace3-45ee-bc1f-bf6b4eaf425d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:51.182164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e59ff552-6f38-43a7-be5d-c55aa94ed586 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:51.185749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e59ff552-6f38-43a7-be5d-c55aa94ed586 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:51.194589 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e59ff552-6f38-43a7-be5d-c55aa94ed586 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.252101 Oct 27 18:46:51.195773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29e34379-ace3-45ee-bc1f-bf6b4eaf425d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:51.196293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29e34379-ace3-45ee-bc1f-bf6b4eaf425d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:51.198630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29e34379-ace3-45ee-bc1f-bf6b4eaf425d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:51.200398 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 270/551] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:50 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:51.208159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29e34379-ace3-45ee-bc1f-bf6b4eaf425d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:51.208969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29e34379-ace3-45ee-bc1f-bf6b4eaf425d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:51.209613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29e34379-ace3-45ee-bc1f-bf6b4eaf425d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:51.304458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ce80558a-3339-46df-b14f-afac3b0f4016 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:51.305079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ce80558a-3339-46df-b14f-afac3b0f4016 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:51.318594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce80558a-3339-46df-b14f-afac3b0f4016 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:51.322444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce80558a-3339-46df-b14f-afac3b0f4016 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:51.323222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce80558a-3339-46df-b14f-afac3b0f4016 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:51.324792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce80558a-3339-46df-b14f-afac3b0f4016 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:51.325303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce80558a-3339-46df-b14f-afac3b0f4016 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:51.325891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce80558a-3339-46df-b14f-afac3b0f4016 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:51.517226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-29e34379-ace3-45ee-bc1f-bf6b4eaf425d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:51.529733 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-29e34379-ace3-45ee-bc1f-bf6b4eaf425d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1389 microversion: 2.1 time: 0.358571 Oct 27 18:46:51.531566 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 282/552] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:51 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1389 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:51.970098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-545a5bcc-e9d3-45d6-a5da-f942abbb55a7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:51.970779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-545a5bcc-e9d3-45d6-a5da-f942abbb55a7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:51.985005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-545a5bcc-e9d3-45d6-a5da-f942abbb55a7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:51.985721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-545a5bcc-e9d3-45d6-a5da-f942abbb55a7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:51.986428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-545a5bcc-e9d3-45d6-a5da-f942abbb55a7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:51.987109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-545a5bcc-e9d3-45d6-a5da-f942abbb55a7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:51.987634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-545a5bcc-e9d3-45d6-a5da-f942abbb55a7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:51.987987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-545a5bcc-e9d3-45d6-a5da-f942abbb55a7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:52.169913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ce80558a-3339-46df-b14f-afac3b0f4016 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:52.187584 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ce80558a-3339-46df-b14f-afac3b0f4016 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1312 microversion: 2.1 time: 0.880646 Oct 27 18:46:52.198857 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 271/553] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:51 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1312 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:52.209596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d9f1ee5e-4c3e-42ea-b814-474f96aabcfe req-edd28ff4-a740-435d-aff2-a14e12761741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901fd413-2d42-4014-86c1-5fe80598f789", "name": "network-vif-plugged", "status": "completed", "tag": "11fc4a40-18f3-4dcf-b5eb-6e544bd414ef"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:52.239499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d9f1ee5e-4c3e-42ea-b814-474f96aabcfe req-edd28ff4-a740-435d-aff2-a14e12761741 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:52.240288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d9f1ee5e-4c3e-42ea-b814-474f96aabcfe req-edd28ff4-a740-435d-aff2-a14e12761741 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:52.240936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d9f1ee5e-4c3e-42ea-b814-474f96aabcfe req-edd28ff4-a740-435d-aff2-a14e12761741 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:52.254922 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d9f1ee5e-4c3e-42ea-b814-474f96aabcfe req-edd28ff4-a740-435d-aff2-a14e12761741 service nova] Creating event network-vif-plugged:11fc4a40-18f3-4dcf-b5eb-6e544bd414ef for instance 901fd413-2d42-4014-86c1-5fe80598f789 on n-h2-860687-3 Oct 27 18:46:52.261431 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d9f1ee5e-4c3e-42ea-b814-474f96aabcfe req-edd28ff4-a740-435d-aff2-a14e12761741 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060964 Oct 27 18:46:52.267008 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 272/554] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:52.274090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f9c448a2-977e-48af-bba1-f5731a2d077f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:52.275203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f9c448a2-977e-48af-bba1-f5731a2d077f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:52.282685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9c448a2-977e-48af-bba1-f5731a2d077f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:52.283522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9c448a2-977e-48af-bba1-f5731a2d077f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:52.288897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-545a5bcc-e9d3-45d6-a5da-f942abbb55a7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:52.294549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9c448a2-977e-48af-bba1-f5731a2d077f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:52.303188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9c448a2-977e-48af-bba1-f5731a2d077f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:52.305806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9c448a2-977e-48af-bba1-f5731a2d077f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:52.306601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9c448a2-977e-48af-bba1-f5731a2d077f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:52.311008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-545a5bcc-e9d3-45d6-a5da-f942abbb55a7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:52.313388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-545a5bcc-e9d3-45d6-a5da-f942abbb55a7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:52.318076 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-545a5bcc-e9d3-45d6-a5da-f942abbb55a7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1362 microversion: 2.25 time: 0.352017 Oct 27 18:46:52.322509 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 283/555] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:51 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:46:52.339114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3c04361a-e1e1-409c-b27e-94fe025a1235 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:52.340611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3c04361a-e1e1-409c-b27e-94fe025a1235 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:52.354239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c04361a-e1e1-409c-b27e-94fe025a1235 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:52.356344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c04361a-e1e1-409c-b27e-94fe025a1235 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:52.358940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c04361a-e1e1-409c-b27e-94fe025a1235 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:52.359878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c04361a-e1e1-409c-b27e-94fe025a1235 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:52.360459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c04361a-e1e1-409c-b27e-94fe025a1235 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:52.360990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c04361a-e1e1-409c-b27e-94fe025a1235 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:52.510911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3c04361a-e1e1-409c-b27e-94fe025a1235 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:52.525796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3c04361a-e1e1-409c-b27e-94fe025a1235 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:52.528473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3c04361a-e1e1-409c-b27e-94fe025a1235 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:52.536829 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3c04361a-e1e1-409c-b27e-94fe025a1235 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.211668 Oct 27 18:46:52.538128 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 284/556] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:52 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:52.560559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f25fb3f9-62b6-40ec-9565-f5de18c3c130 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:52.561183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f25fb3f9-62b6-40ec-9565-f5de18c3c130 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:52.570418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f25fb3f9-62b6-40ec-9565-f5de18c3c130 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:52.570927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f25fb3f9-62b6-40ec-9565-f5de18c3c130 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:52.571361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f25fb3f9-62b6-40ec-9565-f5de18c3c130 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:52.575768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f25fb3f9-62b6-40ec-9565-f5de18c3c130 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:52.576752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f25fb3f9-62b6-40ec-9565-f5de18c3c130 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:52.577210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f25fb3f9-62b6-40ec-9565-f5de18c3c130 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:52.991737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f25fb3f9-62b6-40ec-9565-f5de18c3c130 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:53.006741 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f25fb3f9-62b6-40ec-9565-f5de18c3c130 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1389 microversion: 2.1 time: 0.453271 Oct 27 18:46:53.008907 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 285/557] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:52 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1389 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:46:53.213294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1ac38e0e-7965-4dd6-9cbd-3f61f18d27d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:53.214131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1ac38e0e-7965-4dd6-9cbd-3f61f18d27d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:53.221617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ac38e0e-7965-4dd6-9cbd-3f61f18d27d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:53.225552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ac38e0e-7965-4dd6-9cbd-3f61f18d27d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:53.226271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ac38e0e-7965-4dd6-9cbd-3f61f18d27d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:53.227305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ac38e0e-7965-4dd6-9cbd-3f61f18d27d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:53.227987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ac38e0e-7965-4dd6-9cbd-3f61f18d27d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:53.228634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ac38e0e-7965-4dd6-9cbd-3f61f18d27d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:53.280298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f9c448a2-977e-48af-bba1-f5731a2d077f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:53.295041 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f9c448a2-977e-48af-bba1-f5731a2d077f tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1472 microversion: 2.1 time: 1.024681 Oct 27 18:46:53.296323 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 273/558] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:52 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1472 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:53.352720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bfa0ede2-d0fe-440c-ade4-74591e30abbd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:53.353646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bfa0ede2-d0fe-440c-ade4-74591e30abbd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:53.360790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfa0ede2-d0fe-440c-ade4-74591e30abbd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:53.361602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfa0ede2-d0fe-440c-ade4-74591e30abbd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:53.362269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfa0ede2-d0fe-440c-ade4-74591e30abbd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:53.363272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfa0ede2-d0fe-440c-ade4-74591e30abbd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:53.363947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfa0ede2-d0fe-440c-ade4-74591e30abbd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:53.364593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfa0ede2-d0fe-440c-ade4-74591e30abbd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:53.480869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1ac38e0e-7965-4dd6-9cbd-3f61f18d27d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:53.498453 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1ac38e0e-7965-4dd6-9cbd-3f61f18d27d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1312 microversion: 2.1 time: 0.288980 Oct 27 18:46:53.499836 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 286/559] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:53 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1312 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:46:53.570560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a19faeee-9113-4a9f-8451-7d21b5b9bbd4 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:53.572127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a19faeee-9113-4a9f-8451-7d21b5b9bbd4 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:53.588560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a19faeee-9113-4a9f-8451-7d21b5b9bbd4 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:53.589139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a19faeee-9113-4a9f-8451-7d21b5b9bbd4 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:53.591200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a19faeee-9113-4a9f-8451-7d21b5b9bbd4 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:53.592440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a19faeee-9113-4a9f-8451-7d21b5b9bbd4 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:53.593032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a19faeee-9113-4a9f-8451-7d21b5b9bbd4 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:53.593640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a19faeee-9113-4a9f-8451-7d21b5b9bbd4 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:53.719248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a19faeee-9113-4a9f-8451-7d21b5b9bbd4 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:53.729208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a19faeee-9113-4a9f-8451-7d21b5b9bbd4 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:53.731615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a19faeee-9113-4a9f-8451-7d21b5b9bbd4 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:53.744854 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a19faeee-9113-4a9f-8451-7d21b5b9bbd4 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.179146 Oct 27 18:46:53.748017 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 287/560] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:53 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:53.884208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bfa0ede2-d0fe-440c-ade4-74591e30abbd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:53.895644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bfa0ede2-d0fe-440c-ade4-74591e30abbd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:53.899378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bfa0ede2-d0fe-440c-ade4-74591e30abbd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:53.900633 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bfa0ede2-d0fe-440c-ade4-74591e30abbd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1558 microversion: 2.25 time: 0.552154 Oct 27 18:46:53.901524 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 274/561] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:53 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1558 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:46:54.038941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c2dde21a-8fd0-4b3c-be8d-f5fd3e4a937c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:54.039331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c2dde21a-8fd0-4b3c-be8d-f5fd3e4a937c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:54.055993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2dde21a-8fd0-4b3c-be8d-f5fd3e4a937c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:54.056499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2dde21a-8fd0-4b3c-be8d-f5fd3e4a937c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:54.056950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2dde21a-8fd0-4b3c-be8d-f5fd3e4a937c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:54.057672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2dde21a-8fd0-4b3c-be8d-f5fd3e4a937c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:54.063800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2dde21a-8fd0-4b3c-be8d-f5fd3e4a937c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:54.064382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2dde21a-8fd0-4b3c-be8d-f5fd3e4a937c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:54.284078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c473c8c9-5e95-4421-8f23-c17ff3959959 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:54.284856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c473c8c9-5e95-4421-8f23-c17ff3959959 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:54.298227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c473c8c9-5e95-4421-8f23-c17ff3959959 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:54.301470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c473c8c9-5e95-4421-8f23-c17ff3959959 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:54.302956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c473c8c9-5e95-4421-8f23-c17ff3959959 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:54.305171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c473c8c9-5e95-4421-8f23-c17ff3959959 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:54.306997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c473c8c9-5e95-4421-8f23-c17ff3959959 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:54.309241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c473c8c9-5e95-4421-8f23-c17ff3959959 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:54.595132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c2dde21a-8fd0-4b3c-be8d-f5fd3e4a937c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:54.612369 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c2dde21a-8fd0-4b3c-be8d-f5fd3e4a937c tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1389 microversion: 2.1 time: 0.583531 Oct 27 18:46:54.614831 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 275/562] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:54 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1389 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:46:54.632716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-555e3dbe-1d36-4330-bd5a-90e846b2cb99 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:54.633635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-555e3dbe-1d36-4330-bd5a-90e846b2cb99 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:54.656804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-555e3dbe-1d36-4330-bd5a-90e846b2cb99 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:54.657593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-555e3dbe-1d36-4330-bd5a-90e846b2cb99 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:54.659108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-555e3dbe-1d36-4330-bd5a-90e846b2cb99 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:54.660971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-555e3dbe-1d36-4330-bd5a-90e846b2cb99 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:54.663722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-555e3dbe-1d36-4330-bd5a-90e846b2cb99 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:54.664335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-555e3dbe-1d36-4330-bd5a-90e846b2cb99 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:54.679361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:54.796246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-c473c8c9-5e95-4421-8f23-c17ff3959959 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:46:54.911819 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c473c8c9-5e95-4421-8f23-c17ff3959959 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 2051 microversion: 2.25 time: 0.987063 Oct 27 18:46:54.912648 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 288/563] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:53 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 2051 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:54.944493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-72448feb-97ab-4642-9300-84e79bc3144a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:54.945286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-72448feb-97ab-4642-9300-84e79bc3144a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:54.966249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72448feb-97ab-4642-9300-84e79bc3144a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:54.967867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72448feb-97ab-4642-9300-84e79bc3144a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:54.968534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72448feb-97ab-4642-9300-84e79bc3144a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:54.970670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72448feb-97ab-4642-9300-84e79bc3144a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:54.971443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72448feb-97ab-4642-9300-84e79bc3144a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:54.972023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72448feb-97ab-4642-9300-84e79bc3144a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:55.359039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-72448feb-97ab-4642-9300-84e79bc3144a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:55.370255 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-72448feb-97ab-4642-9300-84e79bc3144a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1461 microversion: 2.1 time: 0.430667 Oct 27 18:46:55.370911 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 289/564] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:54 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1461 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:55.378147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3222aac4-ec21-4490-ba4d-a2e4a8c7d521 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:55.378828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3222aac4-ec21-4490-ba4d-a2e4a8c7d521 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:55.395732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3222aac4-ec21-4490-ba4d-a2e4a8c7d521 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:55.396472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3222aac4-ec21-4490-ba4d-a2e4a8c7d521 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:55.397144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3222aac4-ec21-4490-ba4d-a2e4a8c7d521 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:55.398059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3222aac4-ec21-4490-ba4d-a2e4a8c7d521 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:55.398749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3222aac4-ec21-4490-ba4d-a2e4a8c7d521 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:55.399382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3222aac4-ec21-4490-ba4d-a2e4a8c7d521 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:55.401031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-555e3dbe-1d36-4330-bd5a-90e846b2cb99 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:55.412217 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-555e3dbe-1d36-4330-bd5a-90e846b2cb99 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1472 microversion: 2.1 time: 0.794146 Oct 27 18:46:55.417242 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 276/565] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:54 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1472 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:55.430579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f3905eae-51ed-4e40-a514-36c9d20830a9 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:55.432009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f3905eae-51ed-4e40-a514-36c9d20830a9 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:55.454845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3905eae-51ed-4e40-a514-36c9d20830a9 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:55.455371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3905eae-51ed-4e40-a514-36c9d20830a9 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:55.459590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3905eae-51ed-4e40-a514-36c9d20830a9 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:55.478648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3905eae-51ed-4e40-a514-36c9d20830a9 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:55.479946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3905eae-51ed-4e40-a514-36c9d20830a9 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:55.481825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3905eae-51ed-4e40-a514-36c9d20830a9 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:55.552460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3222aac4-ec21-4490-ba4d-a2e4a8c7d521 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:55.602699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3222aac4-ec21-4490-ba4d-a2e4a8c7d521 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:55.609713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3222aac4-ec21-4490-ba4d-a2e4a8c7d521 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:55.646504 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3222aac4-ec21-4490-ba4d-a2e4a8c7d521 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.274276 Oct 27 18:46:55.651540 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 290/566] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:55 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:55.670719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-42fe0297-dee1-4c21-ad2e-6a9be7a30b8a req-86ba2299-2156-45df-bcfe-55a7f7142ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c245477e-5ecc-4296-9557-8dfef9214334", "name": "network-vif-plugged", "status": "completed", "tag": "5d609ce6-6650-4772-b209-a042e0c43787"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:55.724888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-42fe0297-dee1-4c21-ad2e-6a9be7a30b8a req-86ba2299-2156-45df-bcfe-55a7f7142ada service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:55.725558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-42fe0297-dee1-4c21-ad2e-6a9be7a30b8a req-86ba2299-2156-45df-bcfe-55a7f7142ada service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:55.726112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-42fe0297-dee1-4c21-ad2e-6a9be7a30b8a req-86ba2299-2156-45df-bcfe-55a7f7142ada service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:55.746104 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-42fe0297-dee1-4c21-ad2e-6a9be7a30b8a req-86ba2299-2156-45df-bcfe-55a7f7142ada service nova] Creating event network-vif-plugged:5d609ce6-6650-4772-b209-a042e0c43787 for instance c245477e-5ecc-4296-9557-8dfef9214334 on n-h1-860687-3 Oct 27 18:46:55.766504 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-42fe0297-dee1-4c21-ad2e-6a9be7a30b8a req-86ba2299-2156-45df-bcfe-55a7f7142ada service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108839 Oct 27 18:46:55.767538 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 291/567] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:46:56.261343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-620b04d9-a0d4-4c0b-abbb-5953f22c1e5b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:56.262830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-620b04d9-a0d4-4c0b-abbb-5953f22c1e5b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:56.280492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-620b04d9-a0d4-4c0b-abbb-5953f22c1e5b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:56.281590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-620b04d9-a0d4-4c0b-abbb-5953f22c1e5b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:56.282340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-620b04d9-a0d4-4c0b-abbb-5953f22c1e5b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:56.284053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-620b04d9-a0d4-4c0b-abbb-5953f22c1e5b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:56.284612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-620b04d9-a0d4-4c0b-abbb-5953f22c1e5b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:56.286039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-620b04d9-a0d4-4c0b-abbb-5953f22c1e5b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:56.733246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-f3905eae-51ed-4e40-a514-36c9d20830a9 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:46:56.848430 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f3905eae-51ed-4e40-a514-36c9d20830a9 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 2051 microversion: 2.25 time: 1.427982 Oct 27 18:46:56.867178 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 277/568] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:55 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 2051 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:56.873286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a4870a12-b8d2-49ac-be1d-7795d9a25cc5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:56.873442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a4870a12-b8d2-49ac-be1d-7795d9a25cc5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:56.879677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4870a12-b8d2-49ac-be1d-7795d9a25cc5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:56.880175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4870a12-b8d2-49ac-be1d-7795d9a25cc5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:56.880619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4870a12-b8d2-49ac-be1d-7795d9a25cc5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:56.881338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4870a12-b8d2-49ac-be1d-7795d9a25cc5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:56.881791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4870a12-b8d2-49ac-be1d-7795d9a25cc5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:56.888200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4870a12-b8d2-49ac-be1d-7795d9a25cc5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:56.991840 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-620b04d9-a0d4-4c0b-abbb-5953f22c1e5b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1612 microversion: 2.1 time: 1.218764 Oct 27 18:46:57.006413 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 292/569] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:55 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1612 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:57.006413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-324a92ec-2928-41b8-bb2f-e9b5356c55bc tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:57.006413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-324a92ec-2928-41b8-bb2f-e9b5356c55bc tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:57.012963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-324a92ec-2928-41b8-bb2f-e9b5356c55bc tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:57.013738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-324a92ec-2928-41b8-bb2f-e9b5356c55bc tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:57.014431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-324a92ec-2928-41b8-bb2f-e9b5356c55bc tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:57.016164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-324a92ec-2928-41b8-bb2f-e9b5356c55bc tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:57.017094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-324a92ec-2928-41b8-bb2f-e9b5356c55bc tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:57.018814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-324a92ec-2928-41b8-bb2f-e9b5356c55bc tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:57.024619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:57.158088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a4870a12-b8d2-49ac-be1d-7795d9a25cc5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:57.171113 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a4870a12-b8d2-49ac-be1d-7795d9a25cc5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1389 microversion: 2.1 time: 0.302670 Oct 27 18:46:57.171705 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 278/570] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:56 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1389 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:57.183274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7f032c49-c5fa-45b8-80b4-76b16b5c4aa5 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:57.189717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7f032c49-c5fa-45b8-80b4-76b16b5c4aa5 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:57.203463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f032c49-c5fa-45b8-80b4-76b16b5c4aa5 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:57.204226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f032c49-c5fa-45b8-80b4-76b16b5c4aa5 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:57.204893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f032c49-c5fa-45b8-80b4-76b16b5c4aa5 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:57.206293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f032c49-c5fa-45b8-80b4-76b16b5c4aa5 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:57.207300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f032c49-c5fa-45b8-80b4-76b16b5c4aa5 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:57.208089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f032c49-c5fa-45b8-80b4-76b16b5c4aa5 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:57.345359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7f032c49-c5fa-45b8-80b4-76b16b5c4aa5 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:57.356972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7f032c49-c5fa-45b8-80b4-76b16b5c4aa5 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:57.360608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7f032c49-c5fa-45b8-80b4-76b16b5c4aa5 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:57.367082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:57.370165 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7f032c49-c5fa-45b8-80b4-76b16b5c4aa5 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.196888 Oct 27 18:46:57.371734 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 279/571] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:57 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:57.379811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5dc27d59-acac-4fc8-a88a-8038433ea7de tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:57.383969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5dc27d59-acac-4fc8-a88a-8038433ea7de tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:57.384742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5dc27d59-acac-4fc8-a88a-8038433ea7de tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:57.385400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5dc27d59-acac-4fc8-a88a-8038433ea7de tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:57.386333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5dc27d59-acac-4fc8-a88a-8038433ea7de tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:57.387564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5dc27d59-acac-4fc8-a88a-8038433ea7de tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:57.388192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5dc27d59-acac-4fc8-a88a-8038433ea7de tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:57.429316 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5dc27d59-acac-4fc8-a88a-8038433ea7de tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.054924 Oct 27 18:46:57.435941 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 280/572] 10.222.0.42 () {60 vars in 1217 bytes} [Thu Oct 27 18:46:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:46:57.440912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-94459985-516f-40bf-b676-89b5abba69f3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:57.441493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-94459985-516f-40bf-b676-89b5abba69f3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:57.459944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94459985-516f-40bf-b676-89b5abba69f3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:57.460920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94459985-516f-40bf-b676-89b5abba69f3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:57.461370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94459985-516f-40bf-b676-89b5abba69f3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:57.462076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94459985-516f-40bf-b676-89b5abba69f3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:57.462793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94459985-516f-40bf-b676-89b5abba69f3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:57.463291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94459985-516f-40bf-b676-89b5abba69f3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:57.563644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-324a92ec-2928-41b8-bb2f-e9b5356c55bc tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:57.573804 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-324a92ec-2928-41b8-bb2f-e9b5356c55bc tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1472 microversion: 2.1 time: 0.578162 Oct 27 18:46:57.578676 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 293/573] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:56 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1472 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:57.614680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-65a346d9-2f62-4d6f-96e8-4637052d3dd8 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860687-3", "block_migration": "auto"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:46:57.618294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-65a346d9-2f62-4d6f-96e8-4637052d3dd8 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:57.635132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65a346d9-2f62-4d6f-96e8-4637052d3dd8 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:57.636092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65a346d9-2f62-4d6f-96e8-4637052d3dd8 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:57.638283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65a346d9-2f62-4d6f-96e8-4637052d3dd8 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:57.639286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65a346d9-2f62-4d6f-96e8-4637052d3dd8 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:57.639921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65a346d9-2f62-4d6f-96e8-4637052d3dd8 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:57.640521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65a346d9-2f62-4d6f-96e8-4637052d3dd8 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:57.829662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-94459985-516f-40bf-b676-89b5abba69f3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '01e4ec7a5e11493b936c3b5b1532aafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73930bf034df486bacb5c7ed0e5c2dc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:57.830248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-94459985-516f-40bf-b676-89b5abba69f3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] flavor_id is None. Assuming migration. {{(pid=127028) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 27 18:46:57.830723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-94459985-516f-40bf-b676-89b5abba69f3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127028) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 18:46:57.842418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-65a346d9-2f62-4d6f-96e8-4637052d3dd8 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'flavor' on Instance uuid 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:46:57.961900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-65a346d9-2f62-4d6f-96e8-4637052d3dd8 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Going to try to live migrate instance to n-h2-860687-3 {{(pid=127029) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 18:46:58.158933 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-94459985-516f-40bf-b676-89b5abba69f3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789/action" status: 202 len: 0 microversion: 2.1 time: 0.719779 Oct 27 18:46:58.160709 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 281/574] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:46:57 2022] POST /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789/action => generated 0 bytes in 724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:46:58.170307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-257a4189-2ae8-4612-8fc3-6c98e8aaf688 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:58.175119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-257a4189-2ae8-4612-8fc3-6c98e8aaf688 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:58.189005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-257a4189-2ae8-4612-8fc3-6c98e8aaf688 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:58.190286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-257a4189-2ae8-4612-8fc3-6c98e8aaf688 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:58.191096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-257a4189-2ae8-4612-8fc3-6c98e8aaf688 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:58.192256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-257a4189-2ae8-4612-8fc3-6c98e8aaf688 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:58.193149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-257a4189-2ae8-4612-8fc3-6c98e8aaf688 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:58.194166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-257a4189-2ae8-4612-8fc3-6c98e8aaf688 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:58.508918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-257a4189-2ae8-4612-8fc3-6c98e8aaf688 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:58.533735 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-257a4189-2ae8-4612-8fc3-6c98e8aaf688 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1470 microversion: 2.1 time: 0.368745 Oct 27 18:46:58.535546 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 282/575] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:58 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1470 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:58.546513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2dafa28d-c43f-4701-9c3a-745c9f323574 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:58.548347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2dafa28d-c43f-4701-9c3a-745c9f323574 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:58.572227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2dafa28d-c43f-4701-9c3a-745c9f323574 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:58.573231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2dafa28d-c43f-4701-9c3a-745c9f323574 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:58.573927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2dafa28d-c43f-4701-9c3a-745c9f323574 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:58.575047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2dafa28d-c43f-4701-9c3a-745c9f323574 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:58.575875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2dafa28d-c43f-4701-9c3a-745c9f323574 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:58.581545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2dafa28d-c43f-4701-9c3a-745c9f323574 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:59.019030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2dafa28d-c43f-4701-9c3a-745c9f323574 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:59.041435 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2dafa28d-c43f-4701-9c3a-745c9f323574 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1587 microversion: 2.1 time: 0.503986 Oct 27 18:46:59.044879 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 283/576] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:58 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1587 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:46:59.056835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7358e10-5405-4c99-8592-8ff39364765d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:59.057715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a7358e10-5405-4c99-8592-8ff39364765d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:59.075991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7358e10-5405-4c99-8592-8ff39364765d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:59.076866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7358e10-5405-4c99-8592-8ff39364765d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:59.078830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7358e10-5405-4c99-8592-8ff39364765d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:59.081346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7358e10-5405-4c99-8592-8ff39364765d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:59.083525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7358e10-5405-4c99-8592-8ff39364765d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:59.084317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7358e10-5405-4c99-8592-8ff39364765d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:59.205963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=38 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:46:59.611703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a7358e10-5405-4c99-8592-8ff39364765d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:59.626203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a7358e10-5405-4c99-8592-8ff39364765d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:59.632357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a7358e10-5405-4c99-8592-8ff39364765d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:46:59.658155 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7358e10-5405-4c99-8592-8ff39364765d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.611398 Oct 27 18:46:59.660422 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 284/577] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:46:59 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:46:59.672707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-972771b4-06fb-41ec-8863-a19dcc4c8b48 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:46:59.674875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-972771b4-06fb-41ec-8863-a19dcc4c8b48 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:46:59.714178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-972771b4-06fb-41ec-8863-a19dcc4c8b48 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:59.715401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-972771b4-06fb-41ec-8863-a19dcc4c8b48 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:59.716473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-972771b4-06fb-41ec-8863-a19dcc4c8b48 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:59.719640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-972771b4-06fb-41ec-8863-a19dcc4c8b48 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:46:59.720931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-972771b4-06fb-41ec-8863-a19dcc4c8b48 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:46:59.722823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-972771b4-06fb-41ec-8863-a19dcc4c8b48 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:46:59.862126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=17 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:00.306419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-972771b4-06fb-41ec-8863-a19dcc4c8b48 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:00.319812 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-972771b4-06fb-41ec-8863-a19dcc4c8b48 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1472 microversion: 2.1 time: 0.654870 Oct 27 18:47:00.319812 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 285/578] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:46:59 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1472 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:00.332330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-39f60e6a-873c-45bf-935d-2bb62f892b42 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:00.333763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-39f60e6a-873c-45bf-935d-2bb62f892b42 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:00.348678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39f60e6a-873c-45bf-935d-2bb62f892b42 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:00.350850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39f60e6a-873c-45bf-935d-2bb62f892b42 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:00.354782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39f60e6a-873c-45bf-935d-2bb62f892b42 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:00.358981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39f60e6a-873c-45bf-935d-2bb62f892b42 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:00.359590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39f60e6a-873c-45bf-935d-2bb62f892b42 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:00.360148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39f60e6a-873c-45bf-935d-2bb62f892b42 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:00.408322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=54 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:00.613562 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-39f60e6a-873c-45bf-935d-2bb62f892b42 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.295350 Oct 27 18:47:00.614818 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 286/579] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 18:47:00 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334/os-interface => generated 284 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:01.158227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb3a121d-6b07-4ff0-b763-5bb7cd512e00 tempest-FloatingIPDetailsNegativeTestJSON-282007507 tempest-FloatingIPDetailsNegativeTestJSON-282007507-project] Calling method '.version_select at 0x7fc86b381430>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:01.303667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG neutronclient.v2_0.client [None req-eb3a121d-6b07-4ff0-b763-5bb7cd512e00 tempest-FloatingIPDetailsNegativeTestJSON-282007507 tempest-FloatingIPDetailsNegativeTestJSON-282007507-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b0ae855c-c8f5-4aea-8611-e0a704a2d889 could not be found", "detail": ""}} {{(pid=127028) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:47:01.304712 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-eb3a121d-6b07-4ff0-b763-5bb7cd512e00 tempest-FloatingIPDetailsNegativeTestJSON-282007507 tempest-FloatingIPDetailsNegativeTestJSON-282007507-project] HTTP exception thrown: Floating IP not found for ID b0ae855c-c8f5-4aea-8611-e0a704a2d889 Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb3a121d-6b07-4ff0-b763-5bb7cd512e00 tempest-FloatingIPDetailsNegativeTestJSON-282007507 tempest-FloatingIPDetailsNegativeTestJSON-282007507-project] Request method failure captured: Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-floating-ips/b0ae855c-c8f5-4aea-8611-e0a704a2d889 HTTP/1.1 Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtIjo5UodLyyOy_sw-RdbjpYZAHSs0hK6emzzKwYzNF_0wDMuHX8aoRT2I-yLym13LAtmJgfQ3_KadjN4cOoXZxqVIvPCJqUG7piHDz2PjaX0s8W7D4Uv-0JEvzezzgJjoqVIiK5u2tzSc9ssjvKcRhch0bnVazIfD-jDbDZ2uBSL7I Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 8557d502d9834e28a957ccba844d7418 Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-282007507 Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:47:01.316852 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:47:01.319100 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8557d502d9834e28a957ccba844d7418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8557d502d9834e28a957ccba844d7418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8557d502d9834e28a957ccba844d7418", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8557d502d9834e28a957ccba844d7418"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:01.319100 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-282007507 Oct 27 18:47:01.319100 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 8557d502d9834e28a957ccba844d7418 Oct 27 18:47:01.319100 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-282007507 Oct 27 18:47:01.319100 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-282007507-project Oct 27 18:47:01.319100 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:47:01.319100 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:47:01.319100 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 085dc2cc8ea54140a6bd808dc80db170 Oct 27 18:47:01.319100 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-282007507-project Oct 27 18:47:01.319100 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:47:01.319100 n-d-860687-3 devstack@n-api.service[127028]: exception: Floating IP not found for ID b0ae855c-c8f5-4aea-8611-e0a704a2d889 Oct 27 18:47:01.319100 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'b0ae855c-c8f5-4aea-8611-e0a704a2d889'} Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:47:01.320038 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b0ae855c-c8f5-4aea-8611-e0a704a2d889 could not be found Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9b26f17-a5fd-4e07-8711-c4240720ae97'] Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b0ae855c-c8f5-4aea-8611-e0a704a2d889. Oct 27 18:47:01.321457 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b0ae855c-c8f5-4aea-8611-e0a704a2d889 Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:01.322953 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:47:01.324680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:47:01.324680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b0ae855c-c8f5-4aea-8611-e0a704a2d889 Oct 27 18:47:01.324680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:01.326049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb3a121d-6b07-4ff0-b763-5bb7cd512e00 tempest-FloatingIPDetailsNegativeTestJSON-282007507 tempest-FloatingIPDetailsNegativeTestJSON-282007507-project] Returning 404 to user: Floating IP not found for ID b0ae855c-c8f5-4aea-8611-e0a704a2d889 {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:01.327150 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb3a121d-6b07-4ff0-b763-5bb7cd512e00 tempest-FloatingIPDetailsNegativeTestJSON-282007507 tempest-FloatingIPDetailsNegativeTestJSON-282007507-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/b0ae855c-c8f5-4aea-8611-e0a704a2d889" status: 404 len: 111 microversion: 2.1 time: 0.710876 Oct 27 18:47:01.333728 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 287/580] 10.222.0.42 () {58 vars in 1260 bytes} [Thu Oct 27 18:47:00 2022] GET /compute/v2.1/os-floating-ips/b0ae855c-c8f5-4aea-8611-e0a704a2d889 => generated 111 bytes in 718 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:47:01.341223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c0ba7fc8-d03a-4179-973f-32c31bb74198 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:01.351374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c0ba7fc8-d03a-4179-973f-32c31bb74198 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:01.372299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0ba7fc8-d03a-4179-973f-32c31bb74198 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:01.375731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0ba7fc8-d03a-4179-973f-32c31bb74198 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:01.376345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0ba7fc8-d03a-4179-973f-32c31bb74198 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:01.379134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0ba7fc8-d03a-4179-973f-32c31bb74198 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:01.379780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0ba7fc8-d03a-4179-973f-32c31bb74198 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:01.381414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0ba7fc8-d03a-4179-973f-32c31bb74198 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:02.158025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c0ba7fc8-d03a-4179-973f-32c31bb74198 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:02.189849 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c0ba7fc8-d03a-4179-973f-32c31bb74198 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1470 microversion: 2.1 time: 0.853079 Oct 27 18:47:02.193784 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 288/581] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:01 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1470 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:02.222768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6edb0241-b3a8-4e75-8af3-0617dcde670b tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:02.229290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6edb0241-b3a8-4e75-8af3-0617dcde670b tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:02.259295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6edb0241-b3a8-4e75-8af3-0617dcde670b tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:02.259788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6edb0241-b3a8-4e75-8af3-0617dcde670b tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:02.269651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6edb0241-b3a8-4e75-8af3-0617dcde670b tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:02.274791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6edb0241-b3a8-4e75-8af3-0617dcde670b tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:02.279855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6edb0241-b3a8-4e75-8af3-0617dcde670b tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:02.280642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6edb0241-b3a8-4e75-8af3-0617dcde670b tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:02.331171 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-65a346d9-2f62-4d6f-96e8-4637052d3dd8 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60/action" status: 202 len: 0 microversion: 2.25 time: 4.745483 Oct 27 18:47:02.336478 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 294/582] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 18:46:57 2022] POST /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60/action => generated 0 bytes in 4753 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:47:02.343643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0b5b2be-218e-4ea9-a70a-3cefc48f67e9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:02.344270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f0b5b2be-218e-4ea9-a70a-3cefc48f67e9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:02.369838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0b5b2be-218e-4ea9-a70a-3cefc48f67e9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:02.373754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0b5b2be-218e-4ea9-a70a-3cefc48f67e9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:02.375015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0b5b2be-218e-4ea9-a70a-3cefc48f67e9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:02.377622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0b5b2be-218e-4ea9-a70a-3cefc48f67e9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:02.378458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0b5b2be-218e-4ea9-a70a-3cefc48f67e9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:02.395788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0b5b2be-218e-4ea9-a70a-3cefc48f67e9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:02.985054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6edb0241-b3a8-4e75-8af3-0617dcde670b tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:02.990325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f0b5b2be-218e-4ea9-a70a-3cefc48f67e9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:03.000170 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f0b5b2be-218e-4ea9-a70a-3cefc48f67e9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1472 microversion: 2.1 time: 0.662523 Oct 27 18:47:03.000755 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 295/583] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:02 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1472 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:03.015921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6edb0241-b3a8-4e75-8af3-0617dcde670b tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:03.019001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-28196421-70e3-4794-81c9-08c299a5bab8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:03.019829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-28196421-70e3-4794-81c9-08c299a5bab8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:03.022631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6edb0241-b3a8-4e75-8af3-0617dcde670b tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:03.033287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28196421-70e3-4794-81c9-08c299a5bab8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:03.034593 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6edb0241-b3a8-4e75-8af3-0617dcde670b tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.839562 Oct 27 18:47:03.035262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28196421-70e3-4794-81c9-08c299a5bab8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:03.036329 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 289/584] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:02 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:03.036843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28196421-70e3-4794-81c9-08c299a5bab8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:03.037663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28196421-70e3-4794-81c9-08c299a5bab8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:03.044717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28196421-70e3-4794-81c9-08c299a5bab8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:03.045233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28196421-70e3-4794-81c9-08c299a5bab8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:03.427392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d947cd4-319f-4831-8c21-1b84fd436630 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b1faa60>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:03.436506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d947cd4-319f-4831-8c21-1b84fd436630 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:03.444066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d947cd4-319f-4831-8c21-1b84fd436630 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:03.456038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d947cd4-319f-4831-8c21-1b84fd436630 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:03.488762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d947cd4-319f-4831-8c21-1b84fd436630 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:03.492149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d947cd4-319f-4831-8c21-1b84fd436630 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:03.492615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d947cd4-319f-4831-8c21-1b84fd436630 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:03.518698 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-2d947cd4-319f-4831-8c21-1b84fd436630 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] HTTP exception thrown: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d947cd4-319f-4831-8c21-1b84fd436630 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Request method failure captured: Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: request: PUT /compute/v2.1/os-services/26e7bd75-cc05-466a-8c59-9517f3cc084b HTTP/1.1 Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 56 Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtImbivvhWu7z2aHSJKLLlzdUY1o3BkGxowKMDVl1r8FkU-rmZmSzx54nZFt4IY1XooFHP3IMSWZtOwOWC3CApR8ME5F-3DIgJ-AMYy3Bg7xyDCQX4Dx3pUJwXamy3WWj2waYDuRy-1Z2wSmtSSa4wNAGPDeObnrIab2lkFbl7ysOmI Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 55f03dacb0f84a9cbe13bdf36ad90f4a Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-917331171 Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 18:47:03.524155 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 18:47:03.525822 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55f03dacb0f84a9cbe13bdf36ad90f4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f03dacb0f84a9cbe13bdf36ad90f4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55f03dacb0f84a9cbe13bdf36ad90f4a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f03dacb0f84a9cbe13bdf36ad90f4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:03.525822 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-917331171 Oct 27 18:47:03.525822 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 55f03dacb0f84a9cbe13bdf36ad90f4a Oct 27 18:47:03.525822 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-917331171 Oct 27 18:47:03.525822 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin Oct 27 18:47:03.525822 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:47:03.525822 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:47:03.525822 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 4828cedab9dd4d58b585f3dfe28e0522 Oct 27 18:47:03.525822 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin Oct 27 18:47:03.525822 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:47:03.525822 n-d-860687-3 devstack@n-api.service[127028]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 27 18:47:03.525822 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:47:03.525822 n-d-860687-3 devstack@n-api.service[127028]: exception: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '26e7bd75-cc05-466a-8c59-9517f3cc084b', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.526817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:03.529426 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:47:03.530817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:47:03.530817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.530817 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.530817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d947cd4-319f-4831-8c21-1b84fd436630 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Returning 404 to user: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:03.530817 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d947cd4-319f-4831-8c21-1b84fd436630 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-services/26e7bd75-cc05-466a-8c59-9517f3cc084b" status: 404 len: 110 microversion: 2.53 time: 0.489151 Oct 27 18:47:03.539885 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 290/585] 10.222.0.42 () {62 vars in 1309 bytes} [Thu Oct 27 18:47:03 2022] PUT /compute/v2.1/os-services/26e7bd75-cc05-466a-8c59-9517f3cc084b => generated 110 bytes in 503 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:47:03.548130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dc9a5a2e-c117-4b23-8ff9-1cf17d0716e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:03.549056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dc9a5a2e-c117-4b23-8ff9-1cf17d0716e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:03.556992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc9a5a2e-c117-4b23-8ff9-1cf17d0716e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:03.557725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc9a5a2e-c117-4b23-8ff9-1cf17d0716e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:03.558899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc9a5a2e-c117-4b23-8ff9-1cf17d0716e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:03.567161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc9a5a2e-c117-4b23-8ff9-1cf17d0716e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:03.567958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc9a5a2e-c117-4b23-8ff9-1cf17d0716e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:03.568564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc9a5a2e-c117-4b23-8ff9-1cf17d0716e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:03.753199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-28196421-70e3-4794-81c9-08c299a5bab8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:03.782378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-28196421-70e3-4794-81c9-08c299a5bab8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:03.784464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-28196421-70e3-4794-81c9-08c299a5bab8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:03.785995 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-28196421-70e3-4794-81c9-08c299a5bab8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1568 microversion: 2.25 time: 0.771366 Oct 27 18:47:03.786738 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 296/586] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:03 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1568 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:03.804176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-057ffdf1-cb21-47e1-bd4c-b8f864dc02a0 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b8b0700>, body: {"status": "disabled"} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:03.823900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-057ffdf1-cb21-47e1-bd4c-b8f864dc02a0 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:03.826961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-057ffdf1-cb21-47e1-bd4c-b8f864dc02a0 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:03.833378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-057ffdf1-cb21-47e1-bd4c-b8f864dc02a0 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:03.855901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-057ffdf1-cb21-47e1-bd4c-b8f864dc02a0 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:03.857833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-057ffdf1-cb21-47e1-bd4c-b8f864dc02a0 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:03.858480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-057ffdf1-cb21-47e1-bd4c-b8f864dc02a0 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:03.881307 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-057ffdf1-cb21-47e1-bd4c-b8f864dc02a0 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] HTTP exception thrown: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-057ffdf1-cb21-47e1-bd4c-b8f864dc02a0 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Request method failure captured: Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/os-services/26e7bd75-cc05-466a-8c59-9517f3cc084b HTTP/1.1 Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 22 Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtImbivvhWu7z2aHSJKLLlzdUY1o3BkGxowKMDVl1r8FkU-rmZmSzx54nZFt4IY1XooFHP3IMSWZtOwOWC3CApR8ME5F-3DIgJ-AMYy3Bg7xyDCQX4Dx3pUJwXamy3WWj2waYDuRy-1Z2wSmtSSa4wNAGPDeObnrIab2lkFbl7ysOmI Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 55f03dacb0f84a9cbe13bdf36ad90f4a Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-917331171 Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:47:03.883477 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:47:03.885083 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55f03dacb0f84a9cbe13bdf36ad90f4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f03dacb0f84a9cbe13bdf36ad90f4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55f03dacb0f84a9cbe13bdf36ad90f4a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f03dacb0f84a9cbe13bdf36ad90f4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:03.885083 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-917331171 Oct 27 18:47:03.885083 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 55f03dacb0f84a9cbe13bdf36ad90f4a Oct 27 18:47:03.885083 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-917331171 Oct 27 18:47:03.885083 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin Oct 27 18:47:03.885083 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:47:03.885083 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:47:03.885083 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 4828cedab9dd4d58b585f3dfe28e0522 Oct 27 18:47:03.885083 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin Oct 27 18:47:03.885083 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:47:03.885083 n-d-860687-3 devstack@n-api.service[127029]: {"status": "disabled"} Oct 27 18:47:03.885083 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:47:03.885083 n-d-860687-3 devstack@n-api.service[127029]: exception: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.885083 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '26e7bd75-cc05-466a-8c59-9517f3cc084b', 'body': {'status': 'disabled'}} Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:03.886024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:47:03.887531 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:47:03.888890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.888890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.888890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-057ffdf1-cb21-47e1-bd4c-b8f864dc02a0 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Returning 404 to user: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:03.888890 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-057ffdf1-cb21-47e1-bd4c-b8f864dc02a0 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-services/26e7bd75-cc05-466a-8c59-9517f3cc084b" status: 404 len: 110 microversion: 2.53 time: 0.097255 Oct 27 18:47:03.888890 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 297/587] 10.222.0.42 () {62 vars in 1309 bytes} [Thu Oct 27 18:47:03 2022] PUT /compute/v2.1/os-services/26e7bd75-cc05-466a-8c59-9517f3cc084b => generated 110 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:47:03.899390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fb1f98f9-7f74-4e4e-b3df-d2d0d1b4cf94 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Action: 'update', calling method: .version_select at 0x7fc86be4e040>, body: {"status": "enabled"} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:03.905215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb1f98f9-7f74-4e4e-b3df-d2d0d1b4cf94 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:03.906043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb1f98f9-7f74-4e4e-b3df-d2d0d1b4cf94 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:03.907305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb1f98f9-7f74-4e4e-b3df-d2d0d1b4cf94 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:03.913781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dc9a5a2e-c117-4b23-8ff9-1cf17d0716e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:03.940676 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dc9a5a2e-c117-4b23-8ff9-1cf17d0716e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1470 microversion: 2.1 time: 0.399549 Oct 27 18:47:03.944346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb1f98f9-7f74-4e4e-b3df-d2d0d1b4cf94 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:03.947077 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 291/588] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:03 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1470 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:03.948474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb1f98f9-7f74-4e4e-b3df-d2d0d1b4cf94 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:03.950230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb1f98f9-7f74-4e4e-b3df-d2d0d1b4cf94 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:03.958680 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-fb1f98f9-7f74-4e4e-b3df-d2d0d1b4cf94 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] HTTP exception thrown: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fb1f98f9-7f74-4e4e-b3df-d2d0d1b4cf94 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Request method failure captured: Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/os-services/26e7bd75-cc05-466a-8c59-9517f3cc084b HTTP/1.1 Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 21 Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtImbivvhWu7z2aHSJKLLlzdUY1o3BkGxowKMDVl1r8FkU-rmZmSzx54nZFt4IY1XooFHP3IMSWZtOwOWC3CApR8ME5F-3DIgJ-AMYy3Bg7xyDCQX4Dx3pUJwXamy3WWj2waYDuRy-1Z2wSmtSSa4wNAGPDeObnrIab2lkFbl7ysOmI Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 55f03dacb0f84a9cbe13bdf36ad90f4a Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-917331171 Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:47:03.963941 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:47:03.965777 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55f03dacb0f84a9cbe13bdf36ad90f4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f03dacb0f84a9cbe13bdf36ad90f4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55f03dacb0f84a9cbe13bdf36ad90f4a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55f03dacb0f84a9cbe13bdf36ad90f4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:03.965777 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-917331171 Oct 27 18:47:03.965777 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 55f03dacb0f84a9cbe13bdf36ad90f4a Oct 27 18:47:03.965777 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-917331171 Oct 27 18:47:03.965777 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin Oct 27 18:47:03.965777 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:47:03.965777 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:47:03.965777 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 4828cedab9dd4d58b585f3dfe28e0522 Oct 27 18:47:03.965777 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin Oct 27 18:47:03.965777 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:47:03.965777 n-d-860687-3 devstack@n-api.service[127029]: {"status": "enabled"} Oct 27 18:47:03.965777 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:47:03.965777 n-d-860687-3 devstack@n-api.service[127029]: exception: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.965777 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '26e7bd75-cc05-466a-8c59-9517f3cc084b', 'body': {'status': 'enabled'}} Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:03.966631 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:47:03.967795 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:47:03.968899 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. Oct 27 18:47:03.968899 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:03.976632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fb1f98f9-7f74-4e4e-b3df-d2d0d1b4cf94 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Returning 404 to user: Service 26e7bd75-cc05-466a-8c59-9517f3cc084b could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:03.977820 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fb1f98f9-7f74-4e4e-b3df-d2d0d1b4cf94 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-services/26e7bd75-cc05-466a-8c59-9517f3cc084b" status: 404 len: 110 microversion: 2.53 time: 0.083296 Oct 27 18:47:03.986476 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 298/589] 10.222.0.42 () {62 vars in 1309 bytes} [Thu Oct 27 18:47:03 2022] PUT /compute/v2.1/os-services/26e7bd75-cc05-466a-8c59-9517f3cc084b => generated 110 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:47:03.989979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f7a54f92-f9a0-4878-8652-9d1e9aae742c tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:03.993486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7a54f92-f9a0-4878-8652-9d1e9aae742c tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:03.994216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7a54f92-f9a0-4878-8652-9d1e9aae742c tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:03.995326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7a54f92-f9a0-4878-8652-9d1e9aae742c tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:03.996484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7a54f92-f9a0-4878-8652-9d1e9aae742c tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:03.997282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7a54f92-f9a0-4878-8652-9d1e9aae742c tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:03.997896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7a54f92-f9a0-4878-8652-9d1e9aae742c tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.031842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3833d11d-88e9-4004-92d7-6e3bf36b805b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:04.032544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3833d11d-88e9-4004-92d7-6e3bf36b805b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:04.034834 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f7a54f92-f9a0-4878-8652-9d1e9aae742c tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.048472 Oct 27 18:47:04.038084 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 292/590] 10.222.0.42 () {60 vars in 1178 bytes} [Thu Oct 27 18:47:03 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:04.052463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3833d11d-88e9-4004-92d7-6e3bf36b805b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.053234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3833d11d-88e9-4004-92d7-6e3bf36b805b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.053844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3833d11d-88e9-4004-92d7-6e3bf36b805b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.054851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3833d11d-88e9-4004-92d7-6e3bf36b805b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.055485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3833d11d-88e9-4004-92d7-6e3bf36b805b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.056419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1e3e4e22-2f06-41d3-acab-76283d154b50 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:04.056561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3833d11d-88e9-4004-92d7-6e3bf36b805b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.061321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e3e4e22-2f06-41d3-acab-76283d154b50 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.065409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e3e4e22-2f06-41d3-acab-76283d154b50 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.066367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e3e4e22-2f06-41d3-acab-76283d154b50 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.068776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e3e4e22-2f06-41d3-acab-76283d154b50 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.070828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e3e4e22-2f06-41d3-acab-76283d154b50 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.071286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e3e4e22-2f06-41d3-acab-76283d154b50 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.138345 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1e3e4e22-2f06-41d3-acab-76283d154b50 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.088088 Oct 27 18:47:04.139888 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 293/591] 10.222.0.42 () {60 vars in 1211 bytes} [Thu Oct 27 18:47:04 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:04.158978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-40a51089-390d-4dbb-b45c-3b918004bb78 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:04.159956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-40a51089-390d-4dbb-b45c-3b918004bb78 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:04.168334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40a51089-390d-4dbb-b45c-3b918004bb78 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.169203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40a51089-390d-4dbb-b45c-3b918004bb78 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.169805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40a51089-390d-4dbb-b45c-3b918004bb78 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.171068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40a51089-390d-4dbb-b45c-3b918004bb78 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.172216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40a51089-390d-4dbb-b45c-3b918004bb78 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.172915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40a51089-390d-4dbb-b45c-3b918004bb78 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.607476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3833d11d-88e9-4004-92d7-6e3bf36b805b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:04.612556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-40a51089-390d-4dbb-b45c-3b918004bb78 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:04.616057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:04.620443 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3833d11d-88e9-4004-92d7-6e3bf36b805b tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1472 microversion: 2.1 time: 0.595117 Oct 27 18:47:04.621747 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 299/592] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:04 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1472 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:04.622234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-40a51089-390d-4dbb-b45c-3b918004bb78 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:04.623928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-40a51089-390d-4dbb-b45c-3b918004bb78 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:04.630145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af64ae83-671e-46c4-bdbe-829f8b6edd20 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:04.633473 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-40a51089-390d-4dbb-b45c-3b918004bb78 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.479897 Oct 27 18:47:04.633756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af64ae83-671e-46c4-bdbe-829f8b6edd20 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.638245 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 294/593] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:04 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:04.643164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af64ae83-671e-46c4-bdbe-829f8b6edd20 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.643808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af64ae83-671e-46c4-bdbe-829f8b6edd20 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.644792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af64ae83-671e-46c4-bdbe-829f8b6edd20 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.645570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af64ae83-671e-46c4-bdbe-829f8b6edd20 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.646141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af64ae83-671e-46c4-bdbe-829f8b6edd20 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.681410 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-af64ae83-671e-46c4-bdbe-829f8b6edd20 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.058318 Oct 27 18:47:04.683404 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 300/594] 10.222.0.42 () {60 vars in 1178 bytes} [Thu Oct 27 18:47:04 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:04.695649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5cfddb47-e6f8-4f83-8c97-3022fe2e9c45 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:04.706434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cfddb47-e6f8-4f83-8c97-3022fe2e9c45 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.706945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cfddb47-e6f8-4f83-8c97-3022fe2e9c45 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.707394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cfddb47-e6f8-4f83-8c97-3022fe2e9c45 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.708145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cfddb47-e6f8-4f83-8c97-3022fe2e9c45 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.708607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cfddb47-e6f8-4f83-8c97-3022fe2e9c45 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.709047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cfddb47-e6f8-4f83-8c97-3022fe2e9c45 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.753390 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5cfddb47-e6f8-4f83-8c97-3022fe2e9c45 tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=n-d-860687-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.061639 Oct 27 18:47:04.754219 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 295/595] 10.222.0.42 () {60 vars in 1235 bytes} [Thu Oct 27 18:47:04 2022] GET /compute/v2.1/os-services?host=n-d-860687-3&binary=xxx => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:04.768122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0cce6ae0-533d-4312-8fa3-8f20938084ad tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:04.771670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cce6ae0-533d-4312-8fa3-8f20938084ad tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.772399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cce6ae0-533d-4312-8fa3-8f20938084ad tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.773026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cce6ae0-533d-4312-8fa3-8f20938084ad tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.774337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cce6ae0-533d-4312-8fa3-8f20938084ad tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.779019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cce6ae0-533d-4312-8fa3-8f20938084ad tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.779768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cce6ae0-533d-4312-8fa3-8f20938084ad tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.810925 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0cce6ae0-533d-4312-8fa3-8f20938084ad tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.047667 Oct 27 18:47:04.811994 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 301/596] 10.222.0.42 () {60 vars in 1178 bytes} [Thu Oct 27 18:47:04 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:04.815465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-496f2583-a59e-4a9c-9e5f-ed950217509e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:04.816397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-496f2583-a59e-4a9c-9e5f-ed950217509e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:04.827519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5d5bea95-f229-4eb8-be2f-b0a2257872be tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:04.828859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-496f2583-a59e-4a9c-9e5f-ed950217509e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.829468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-496f2583-a59e-4a9c-9e5f-ed950217509e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.830013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-496f2583-a59e-4a9c-9e5f-ed950217509e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.830861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-496f2583-a59e-4a9c-9e5f-ed950217509e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.831236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5bea95-f229-4eb8-be2f-b0a2257872be tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.831558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-496f2583-a59e-4a9c-9e5f-ed950217509e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.831724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5bea95-f229-4eb8-be2f-b0a2257872be tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.832162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5bea95-f229-4eb8-be2f-b0a2257872be tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.832269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-496f2583-a59e-4a9c-9e5f-ed950217509e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.832894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5bea95-f229-4eb8-be2f-b0a2257872be tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:04.834465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5bea95-f229-4eb8-be2f-b0a2257872be tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:04.835175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5bea95-f229-4eb8-be2f-b0a2257872be tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:04.874586 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5d5bea95-f229-4eb8-be2f-b0a2257872be tempest-ServicesAdminNegativeV253TestJSON-917331171 tempest-ServicesAdminNegativeV253TestJSON-917331171-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.053765 Oct 27 18:47:04.884276 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 302/597] 10.222.0.42 () {60 vars in 1239 bytes} [Thu Oct 27 18:47:04 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:47:05.126783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-496f2583-a59e-4a9c-9e5f-ed950217509e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:05.138167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-496f2583-a59e-4a9c-9e5f-ed950217509e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:05.142473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-496f2583-a59e-4a9c-9e5f-ed950217509e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:05.146042 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-496f2583-a59e-4a9c-9e5f-ed950217509e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1568 microversion: 2.25 time: 0.332681 Oct 27 18:47:05.159851 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 296/598] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:04 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1568 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:47:05.163994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3621660f-8c27-4df2-a7a8-67865fa37467 tempest-ServicesAdminNegativeV253TestJSON-1118442924 tempest-ServicesAdminNegativeV253TestJSON-1118442924-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:05.171598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e5054ab2-0b62-47da-995e-867e576cdc75 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:05.172224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e5054ab2-0b62-47da-995e-867e576cdc75 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:05.173520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3621660f-8c27-4df2-a7a8-67865fa37467 tempest-ServicesAdminNegativeV253TestJSON-1118442924 tempest-ServicesAdminNegativeV253TestJSON-1118442924-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4de00809ea024f228f343449d5a50185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d783e4c45c14ab19f065aeff83c0ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3621660f-8c27-4df2-a7a8-67865fa37467 tempest-ServicesAdminNegativeV253TestJSON-1118442924 tempest-ServicesAdminNegativeV253TestJSON-1118442924-project] Request method failure captured: Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIl51UNc1H6ylqTgvHEx28ga7dxBi4qYtqmA52jVObaZwHXYt9LUOU6FikXpzq9AfSLovVOt6TirSfV50uj0RKZXDRNzqxLKX5MIZQ9kyw5kuEecGJudEJaA5ivPCe6aUeBB1nfRXtzS0OI12x2EhjpYmpG_4fWA8rs2z3T86sMcns Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 9d783e4c45c14ab19f065aeff83c0ff5 Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1118442924 Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:47:05.176331 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:47:05.178018 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d783e4c45c14ab19f065aeff83c0ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d783e4c45c14ab19f065aeff83c0ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d783e4c45c14ab19f065aeff83c0ff5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d783e4c45c14ab19f065aeff83c0ff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:05.178018 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1118442924 Oct 27 18:47:05.178018 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 9d783e4c45c14ab19f065aeff83c0ff5 Oct 27 18:47:05.178018 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1118442924 Oct 27 18:47:05.178018 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1118442924-project Oct 27 18:47:05.178018 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:47:05.178018 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:47:05.178018 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 4de00809ea024f228f343449d5a50185 Oct 27 18:47:05.178018 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1118442924-project Oct 27 18:47:05.178018 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:47:05.178018 n-d-860687-3 devstack@n-api.service[127029]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 18:47:05.178018 n-d-860687-3 devstack@n-api.service[127029]: action_args: {} Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:47:05.179399 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 18:47:05.182976 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:05.187366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5054ab2-0b62-47da-995e-867e576cdc75 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:05.187366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5054ab2-0b62-47da-995e-867e576cdc75 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:05.187366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5054ab2-0b62-47da-995e-867e576cdc75 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:05.187366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5054ab2-0b62-47da-995e-867e576cdc75 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:05.187707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5054ab2-0b62-47da-995e-867e576cdc75 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:05.187707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5054ab2-0b62-47da-995e-867e576cdc75 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:05.190184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3621660f-8c27-4df2-a7a8-67865fa37467 tempest-ServicesAdminNegativeV253TestJSON-1118442924 tempest-ServicesAdminNegativeV253TestJSON-1118442924-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:05.196685 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3621660f-8c27-4df2-a7a8-67865fa37467 tempest-ServicesAdminNegativeV253TestJSON-1118442924 tempest-ServicesAdminNegativeV253TestJSON-1118442924-project] 10.222.0.42 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.309019 Oct 27 18:47:05.198371 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 303/599] 10.222.0.42 () {60 vars in 1178 bytes} [Thu Oct 27 18:47:04 2022] GET /compute/v2.1/os-services => generated 112 bytes in 311 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:47:05.220452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-9337f448-2cfd-4bc6-a4e3-6cb7a434f9ca req-b552521b-969b-4d4a-ba1f-b468ba731ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60", "name": "network-vif-unplugged", "status": "completed", "tag": "a55bb603-e764-4da2-9e39-dba7565b80df"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:05.238206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9337f448-2cfd-4bc6-a4e3-6cb7a434f9ca req-b552521b-969b-4d4a-ba1f-b468ba731ae4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:05.239166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9337f448-2cfd-4bc6-a4e3-6cb7a434f9ca req-b552521b-969b-4d4a-ba1f-b468ba731ae4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:05.240267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9337f448-2cfd-4bc6-a4e3-6cb7a434f9ca req-b552521b-969b-4d4a-ba1f-b468ba731ae4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:05.258368 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-9337f448-2cfd-4bc6-a4e3-6cb7a434f9ca req-b552521b-969b-4d4a-ba1f-b468ba731ae4 service nova] Creating event network-vif-unplugged:a55bb603-e764-4da2-9e39-dba7565b80df for instance 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 on n-h1-860687-3 Oct 27 18:47:05.267720 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-9337f448-2cfd-4bc6-a4e3-6cb7a434f9ca req-b552521b-969b-4d4a-ba1f-b468ba731ae4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053807 Oct 27 18:47:05.267720 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 304/600] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 27 18:47:05.506037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e5054ab2-0b62-47da-995e-867e576cdc75 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:05.518700 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e5054ab2-0b62-47da-995e-867e576cdc75 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1475 microversion: 2.1 time: 0.357652 Oct 27 18:47:05.519286 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 297/601] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:05 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1475 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:05.646687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6a3e6f8b-fae3-48f5-8dd5-dd24331a0e89 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:05.647509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6a3e6f8b-fae3-48f5-8dd5-dd24331a0e89 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:05.658438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a3e6f8b-fae3-48f5-8dd5-dd24331a0e89 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:05.659027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a3e6f8b-fae3-48f5-8dd5-dd24331a0e89 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:05.659546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a3e6f8b-fae3-48f5-8dd5-dd24331a0e89 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:05.660341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a3e6f8b-fae3-48f5-8dd5-dd24331a0e89 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:05.660880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a3e6f8b-fae3-48f5-8dd5-dd24331a0e89 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:05.661384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a3e6f8b-fae3-48f5-8dd5-dd24331a0e89 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:05.682461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8e8a8210-d2fd-429b-af22-62f87b7e1c18 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:05.683991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8e8a8210-d2fd-429b-af22-62f87b7e1c18 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:05.694466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e8a8210-d2fd-429b-af22-62f87b7e1c18 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:05.696812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e8a8210-d2fd-429b-af22-62f87b7e1c18 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:05.697572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e8a8210-d2fd-429b-af22-62f87b7e1c18 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:05.698558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e8a8210-d2fd-429b-af22-62f87b7e1c18 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:05.699533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e8a8210-d2fd-429b-af22-62f87b7e1c18 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:05.700996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e8a8210-d2fd-429b-af22-62f87b7e1c18 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:05.842076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8e8a8210-d2fd-429b-af22-62f87b7e1c18 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:05.857177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8e8a8210-d2fd-429b-af22-62f87b7e1c18 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:05.864316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8e8a8210-d2fd-429b-af22-62f87b7e1c18 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:05.875417 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8e8a8210-d2fd-429b-af22-62f87b7e1c18 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.200383 Oct 27 18:47:05.877044 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 298/602] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:05 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:06.153214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f38442fd-ed49-4b5b-8889-89bdf1fe44ba tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:06.155306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f38442fd-ed49-4b5b-8889-89bdf1fe44ba tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:06.166676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f38442fd-ed49-4b5b-8889-89bdf1fe44ba tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:06.167521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f38442fd-ed49-4b5b-8889-89bdf1fe44ba tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:06.168668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f38442fd-ed49-4b5b-8889-89bdf1fe44ba tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:06.169512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f38442fd-ed49-4b5b-8889-89bdf1fe44ba tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:06.171626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f38442fd-ed49-4b5b-8889-89bdf1fe44ba tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:06.172205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f38442fd-ed49-4b5b-8889-89bdf1fe44ba tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:06.385494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f38442fd-ed49-4b5b-8889-89bdf1fe44ba tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:06.395212 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f38442fd-ed49-4b5b-8889-89bdf1fe44ba tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1587 microversion: 2.1 time: 0.250101 Oct 27 18:47:06.399809 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 299/603] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:06 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1587 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:06.414408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-515e5be3-5add-4d5d-a129-5bf67bf95067 req-0df9f82b-295e-424c-9499-f98924226bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c245477e-5ecc-4296-9557-8dfef9214334", "tag": "5d609ce6-6650-4772-b209-a042e0c43787"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:06.435441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-515e5be3-5add-4d5d-a129-5bf67bf95067 req-0df9f82b-295e-424c-9499-f98924226bd3 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:06.436071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-515e5be3-5add-4d5d-a129-5bf67bf95067 req-0df9f82b-295e-424c-9499-f98924226bd3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:06.436572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-515e5be3-5add-4d5d-a129-5bf67bf95067 req-0df9f82b-295e-424c-9499-f98924226bd3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:06.466683 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-515e5be3-5add-4d5d-a129-5bf67bf95067 req-0df9f82b-295e-424c-9499-f98924226bd3 service nova] Creating event network-changed:5d609ce6-6650-4772-b209-a042e0c43787 for instance c245477e-5ecc-4296-9557-8dfef9214334 on n-h1-860687-3 Oct 27 18:47:06.478453 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-515e5be3-5add-4d5d-a129-5bf67bf95067 req-0df9f82b-295e-424c-9499-f98924226bd3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068423 Oct 27 18:47:06.479463 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 300/604] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:06.495662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5af34b0e-7ae7-417c-92c7-17357aeb9876 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:06.496982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5af34b0e-7ae7-417c-92c7-17357aeb9876 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:06.505719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5af34b0e-7ae7-417c-92c7-17357aeb9876 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:06.506231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5af34b0e-7ae7-417c-92c7-17357aeb9876 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:06.506722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5af34b0e-7ae7-417c-92c7-17357aeb9876 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:06.507452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5af34b0e-7ae7-417c-92c7-17357aeb9876 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:06.508000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5af34b0e-7ae7-417c-92c7-17357aeb9876 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:06.508442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5af34b0e-7ae7-417c-92c7-17357aeb9876 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:06.570835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6a3e6f8b-fae3-48f5-8dd5-dd24331a0e89 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:06.595483 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6a3e6f8b-fae3-48f5-8dd5-dd24331a0e89 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1472 microversion: 2.1 time: 0.953515 Oct 27 18:47:06.610448 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 305/605] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:05 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1472 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:06.610448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cb1d308c-a257-4793-9d4b-8c9ff9ce0cf1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:06.610448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cb1d308c-a257-4793-9d4b-8c9ff9ce0cf1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:06.616286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb1d308c-a257-4793-9d4b-8c9ff9ce0cf1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:06.616932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb1d308c-a257-4793-9d4b-8c9ff9ce0cf1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:06.617624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb1d308c-a257-4793-9d4b-8c9ff9ce0cf1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:06.618447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb1d308c-a257-4793-9d4b-8c9ff9ce0cf1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:06.619047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb1d308c-a257-4793-9d4b-8c9ff9ce0cf1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:06.619553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb1d308c-a257-4793-9d4b-8c9ff9ce0cf1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:06.861934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5af34b0e-7ae7-417c-92c7-17357aeb9876 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:06.871900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5af34b0e-7ae7-417c-92c7-17357aeb9876 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:06.876339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5af34b0e-7ae7-417c-92c7-17357aeb9876 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:06.881913 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5af34b0e-7ae7-417c-92c7-17357aeb9876 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1568 microversion: 2.25 time: 0.396921 Oct 27 18:47:06.887371 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 301/606] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:06 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1568 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:06.905743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f9ca5ebc-40a3-4ce4-8b7c-721e85dd6c36 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:06.906372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f9ca5ebc-40a3-4ce4-8b7c-721e85dd6c36 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:06.920657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9ca5ebc-40a3-4ce4-8b7c-721e85dd6c36 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:06.921169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9ca5ebc-40a3-4ce4-8b7c-721e85dd6c36 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:06.921618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9ca5ebc-40a3-4ce4-8b7c-721e85dd6c36 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:06.922351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9ca5ebc-40a3-4ce4-8b7c-721e85dd6c36 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:06.922845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9ca5ebc-40a3-4ce4-8b7c-721e85dd6c36 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:06.923289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9ca5ebc-40a3-4ce4-8b7c-721e85dd6c36 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:07.049491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f9ca5ebc-40a3-4ce4-8b7c-721e85dd6c36 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:07.066775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f9ca5ebc-40a3-4ce4-8b7c-721e85dd6c36 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:07.068244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f9ca5ebc-40a3-4ce4-8b7c-721e85dd6c36 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:07.077273 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f9ca5ebc-40a3-4ce4-8b7c-721e85dd6c36 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.175752 Oct 27 18:47:07.093067 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 302/607] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:06 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:07.383296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-98cdc46d-755b-4b74-8cd8-919afc390fb4 req-eb3ddbd0-0f49-49f8-b5ff-27f0cb13cf90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60", "tag": "a55bb603-e764-4da2-9e39-dba7565b80df"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:07.404582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-98cdc46d-755b-4b74-8cd8-919afc390fb4 req-eb3ddbd0-0f49-49f8-b5ff-27f0cb13cf90 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:07.405222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-98cdc46d-755b-4b74-8cd8-919afc390fb4 req-eb3ddbd0-0f49-49f8-b5ff-27f0cb13cf90 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:07.408062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-98cdc46d-755b-4b74-8cd8-919afc390fb4 req-eb3ddbd0-0f49-49f8-b5ff-27f0cb13cf90 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:07.425953 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-98cdc46d-755b-4b74-8cd8-919afc390fb4 req-eb3ddbd0-0f49-49f8-b5ff-27f0cb13cf90 service nova] Creating event network-changed:a55bb603-e764-4da2-9e39-dba7565b80df for instance 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 on n-h1-860687-3 Oct 27 18:47:07.436068 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-98cdc46d-755b-4b74-8cd8-919afc390fb4 req-eb3ddbd0-0f49-49f8-b5ff-27f0cb13cf90 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060705 Oct 27 18:47:07.437294 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 303/608] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:47:07.484804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cb1d308c-a257-4793-9d4b-8c9ff9ce0cf1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:07.501852 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cb1d308c-a257-4793-9d4b-8c9ff9ce0cf1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1475 microversion: 2.1 time: 0.900799 Oct 27 18:47:07.506144 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 306/609] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:06 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1475 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:07.621118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ab226e28-17e0-4557-bde9-58e2657005cf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:07.622083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ab226e28-17e0-4557-bde9-58e2657005cf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:07.629625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab226e28-17e0-4557-bde9-58e2657005cf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:07.630335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab226e28-17e0-4557-bde9-58e2657005cf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:07.631096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab226e28-17e0-4557-bde9-58e2657005cf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:07.632009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab226e28-17e0-4557-bde9-58e2657005cf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:07.632630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab226e28-17e0-4557-bde9-58e2657005cf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:07.633217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab226e28-17e0-4557-bde9-58e2657005cf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:07.812268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ab226e28-17e0-4557-bde9-58e2657005cf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:07.824874 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ab226e28-17e0-4557-bde9-58e2657005cf tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1472 microversion: 2.1 time: 0.207841 Oct 27 18:47:07.826117 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 304/610] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:07 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1472 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:47:07.910689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bffed407-9e11-4610-930a-5522529c6436 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:07.912013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bffed407-9e11-4610-930a-5522529c6436 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:07.920148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bffed407-9e11-4610-930a-5522529c6436 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:07.920910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bffed407-9e11-4610-930a-5522529c6436 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:07.921605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bffed407-9e11-4610-930a-5522529c6436 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:07.922566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bffed407-9e11-4610-930a-5522529c6436 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:07.923445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bffed407-9e11-4610-930a-5522529c6436 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:07.924096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bffed407-9e11-4610-930a-5522529c6436 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:08.118109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-41ecc261-55c3-47c0-ae21-0c86ece54961 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:08.119052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-41ecc261-55c3-47c0-ae21-0c86ece54961 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:08.135890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41ecc261-55c3-47c0-ae21-0c86ece54961 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:08.136283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41ecc261-55c3-47c0-ae21-0c86ece54961 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:08.138730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41ecc261-55c3-47c0-ae21-0c86ece54961 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:08.139639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41ecc261-55c3-47c0-ae21-0c86ece54961 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:08.140598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41ecc261-55c3-47c0-ae21-0c86ece54961 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:08.141344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41ecc261-55c3-47c0-ae21-0c86ece54961 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:08.242715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-41ecc261-55c3-47c0-ae21-0c86ece54961 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:08.253318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-41ecc261-55c3-47c0-ae21-0c86ece54961 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:08.255032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-41ecc261-55c3-47c0-ae21-0c86ece54961 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:08.260593 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-41ecc261-55c3-47c0-ae21-0c86ece54961 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.151267 Oct 27 18:47:08.282697 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 305/611] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:08 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:47:08.390501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bffed407-9e11-4610-930a-5522529c6436 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:08.426168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bffed407-9e11-4610-930a-5522529c6436 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:08.431079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bffed407-9e11-4610-930a-5522529c6436 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:08.433839 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bffed407-9e11-4610-930a-5522529c6436 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1568 microversion: 2.25 time: 0.527112 Oct 27 18:47:08.435817 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 307/612] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:07 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1568 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:08.536232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-06e2a2f9-80ab-40eb-83f8-ebb5f2cbc3ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:08.536910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-06e2a2f9-80ab-40eb-83f8-ebb5f2cbc3ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:08.555227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06e2a2f9-80ab-40eb-83f8-ebb5f2cbc3ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:08.555559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06e2a2f9-80ab-40eb-83f8-ebb5f2cbc3ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:08.561703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06e2a2f9-80ab-40eb-83f8-ebb5f2cbc3ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:08.573896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06e2a2f9-80ab-40eb-83f8-ebb5f2cbc3ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:08.575807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06e2a2f9-80ab-40eb-83f8-ebb5f2cbc3ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:08.577570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06e2a2f9-80ab-40eb-83f8-ebb5f2cbc3ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:08.849735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3ac8ea85-8865-4b04-9fa0-78a978ec91ba tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:08.850451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3ac8ea85-8865-4b04-9fa0-78a978ec91ba tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:08.861213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ac8ea85-8865-4b04-9fa0-78a978ec91ba tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:08.865071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ac8ea85-8865-4b04-9fa0-78a978ec91ba tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:08.865740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ac8ea85-8865-4b04-9fa0-78a978ec91ba tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:08.866734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ac8ea85-8865-4b04-9fa0-78a978ec91ba tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:08.867418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ac8ea85-8865-4b04-9fa0-78a978ec91ba tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:08.868066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ac8ea85-8865-4b04-9fa0-78a978ec91ba tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:09.367266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-06e2a2f9-80ab-40eb-83f8-ebb5f2cbc3ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:09.376378 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-06e2a2f9-80ab-40eb-83f8-ebb5f2cbc3ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1475 microversion: 2.1 time: 0.846810 Oct 27 18:47:09.383435 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 306/613] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:08 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1475 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:09.388541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4b8fc95a-3b0b-4adc-9e5f-a0a5503e5006 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:09.393277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4b8fc95a-3b0b-4adc-9e5f-a0a5503e5006 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:09.406268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b8fc95a-3b0b-4adc-9e5f-a0a5503e5006 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:09.415902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b8fc95a-3b0b-4adc-9e5f-a0a5503e5006 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:09.416577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b8fc95a-3b0b-4adc-9e5f-a0a5503e5006 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:09.418451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b8fc95a-3b0b-4adc-9e5f-a0a5503e5006 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:09.419133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b8fc95a-3b0b-4adc-9e5f-a0a5503e5006 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:09.419737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3ac8ea85-8865-4b04-9fa0-78a978ec91ba tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:09.420348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b8fc95a-3b0b-4adc-9e5f-a0a5503e5006 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:09.436196 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3ac8ea85-8865-4b04-9fa0-78a978ec91ba tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1478 microversion: 2.1 time: 0.586754 Oct 27 18:47:09.438595 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 308/614] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:08 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1478 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:09.473934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1efd7631-3c21-495b-8105-b7c6aa8f93f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:09.474971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1efd7631-3c21-495b-8105-b7c6aa8f93f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:09.491009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1efd7631-3c21-495b-8105-b7c6aa8f93f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:09.494517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1efd7631-3c21-495b-8105-b7c6aa8f93f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:09.495290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1efd7631-3c21-495b-8105-b7c6aa8f93f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:09.499918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1efd7631-3c21-495b-8105-b7c6aa8f93f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:09.501670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1efd7631-3c21-495b-8105-b7c6aa8f93f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:09.504193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1efd7631-3c21-495b-8105-b7c6aa8f93f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:09.661022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4b8fc95a-3b0b-4adc-9e5f-a0a5503e5006 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:09.679254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4b8fc95a-3b0b-4adc-9e5f-a0a5503e5006 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:09.684233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4b8fc95a-3b0b-4adc-9e5f-a0a5503e5006 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:09.705440 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4b8fc95a-3b0b-4adc-9e5f-a0a5503e5006 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.318031 Oct 27 18:47:09.722446 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 307/615] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:09 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:10.144756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1efd7631-3c21-495b-8105-b7c6aa8f93f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:10.164288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1efd7631-3c21-495b-8105-b7c6aa8f93f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:10.166346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1efd7631-3c21-495b-8105-b7c6aa8f93f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:10.174749 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1efd7631-3c21-495b-8105-b7c6aa8f93f5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1568 microversion: 2.25 time: 0.700540 Oct 27 18:47:10.175362 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 309/616] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:09 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1568 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:47:10.410548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aada2b22-dfad-42ba-a00c-5304e2ca0b45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:10.411175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aada2b22-dfad-42ba-a00c-5304e2ca0b45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:10.426153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aada2b22-dfad-42ba-a00c-5304e2ca0b45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:10.427087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aada2b22-dfad-42ba-a00c-5304e2ca0b45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:10.427877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aada2b22-dfad-42ba-a00c-5304e2ca0b45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:10.429158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aada2b22-dfad-42ba-a00c-5304e2ca0b45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:10.429852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aada2b22-dfad-42ba-a00c-5304e2ca0b45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:10.430702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aada2b22-dfad-42ba-a00c-5304e2ca0b45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:10.467049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8efe4dc3-e97f-45a4-b0b8-436c9154059a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:10.471527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8efe4dc3-e97f-45a4-b0b8-436c9154059a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:10.490334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8efe4dc3-e97f-45a4-b0b8-436c9154059a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:10.493617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8efe4dc3-e97f-45a4-b0b8-436c9154059a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:10.495197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8efe4dc3-e97f-45a4-b0b8-436c9154059a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:10.497369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8efe4dc3-e97f-45a4-b0b8-436c9154059a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:10.498557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8efe4dc3-e97f-45a4-b0b8-436c9154059a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:10.501457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8efe4dc3-e97f-45a4-b0b8-436c9154059a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:10.764958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8efe4dc3-e97f-45a4-b0b8-436c9154059a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:10.779198 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8efe4dc3-e97f-45a4-b0b8-436c9154059a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1478 microversion: 2.1 time: 0.316393 Oct 27 18:47:10.781271 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 310/617] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:10 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1478 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:10.792660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-03790ac1-1834-4c88-a677-0cf3bd36aea1 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:10.795098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-03790ac1-1834-4c88-a677-0cf3bd36aea1 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:10.807401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:10.810411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03790ac1-1834-4c88-a677-0cf3bd36aea1 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:10.814598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03790ac1-1834-4c88-a677-0cf3bd36aea1 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:10.815750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03790ac1-1834-4c88-a677-0cf3bd36aea1 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:10.816660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03790ac1-1834-4c88-a677-0cf3bd36aea1 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:10.817726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03790ac1-1834-4c88-a677-0cf3bd36aea1 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:10.820485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03790ac1-1834-4c88-a677-0cf3bd36aea1 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:10.953945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-03790ac1-1834-4c88-a677-0cf3bd36aea1 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:10.970447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-03790ac1-1834-4c88-a677-0cf3bd36aea1 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:10.972096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-03790ac1-1834-4c88-a677-0cf3bd36aea1 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:10.983112 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-03790ac1-1834-4c88-a677-0cf3bd36aea1 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.199786 Oct 27 18:47:10.983781 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 311/618] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:10 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:11.201265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3700420b-155d-4e2a-93bf-bd94d0964c0e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:11.202241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3700420b-155d-4e2a-93bf-bd94d0964c0e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:11.212496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3700420b-155d-4e2a-93bf-bd94d0964c0e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:11.213907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3700420b-155d-4e2a-93bf-bd94d0964c0e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:11.216589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3700420b-155d-4e2a-93bf-bd94d0964c0e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:11.219067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3700420b-155d-4e2a-93bf-bd94d0964c0e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:11.219828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3700420b-155d-4e2a-93bf-bd94d0964c0e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:11.220685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3700420b-155d-4e2a-93bf-bd94d0964c0e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:11.329799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aada2b22-dfad-42ba-a00c-5304e2ca0b45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:11.339228 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aada2b22-dfad-42ba-a00c-5304e2ca0b45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1475 microversion: 2.1 time: 0.933981 Oct 27 18:47:11.356520 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 308/619] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:10 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1475 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:11.660078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3700420b-155d-4e2a-93bf-bd94d0964c0e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:11.678481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:11.682613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3700420b-155d-4e2a-93bf-bd94d0964c0e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:11.688234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3700420b-155d-4e2a-93bf-bd94d0964c0e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:11.690779 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3700420b-155d-4e2a-93bf-bd94d0964c0e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1568 microversion: 2.25 time: 0.493985 Oct 27 18:47:11.695792 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 312/620] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:11 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1568 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:47:11.806086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-703be68c-d029-40d0-9311-744cac6e16f1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:11.806802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-703be68c-d029-40d0-9311-744cac6e16f1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:11.827842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-703be68c-d029-40d0-9311-744cac6e16f1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:11.834412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-703be68c-d029-40d0-9311-744cac6e16f1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:11.837753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-703be68c-d029-40d0-9311-744cac6e16f1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:11.838885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-703be68c-d029-40d0-9311-744cac6e16f1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:11.840097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-703be68c-d029-40d0-9311-744cac6e16f1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:11.840881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-703be68c-d029-40d0-9311-744cac6e16f1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:12.017523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ff58cb00-633a-45f0-ac93-1c0f6c991d25 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:12.018478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ff58cb00-633a-45f0-ac93-1c0f6c991d25 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:12.034198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff58cb00-633a-45f0-ac93-1c0f6c991d25 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:12.035416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff58cb00-633a-45f0-ac93-1c0f6c991d25 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:12.036021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff58cb00-633a-45f0-ac93-1c0f6c991d25 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:12.037456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff58cb00-633a-45f0-ac93-1c0f6c991d25 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:12.039785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff58cb00-633a-45f0-ac93-1c0f6c991d25 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:12.040578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff58cb00-633a-45f0-ac93-1c0f6c991d25 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:12.166434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ff58cb00-633a-45f0-ac93-1c0f6c991d25 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:12.185595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ff58cb00-633a-45f0-ac93-1c0f6c991d25 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:12.187089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ff58cb00-633a-45f0-ac93-1c0f6c991d25 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:12.192733 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ff58cb00-633a-45f0-ac93-1c0f6c991d25 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.184866 Oct 27 18:47:12.193517 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 313/621] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:12 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:12.290527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-703be68c-d029-40d0-9311-744cac6e16f1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:12.301253 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-703be68c-d029-40d0-9311-744cac6e16f1 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1478 microversion: 2.1 time: 0.502169 Oct 27 18:47:12.302281 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 309/622] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:11 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1478 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:12.366471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-67274987-ae69-4356-aca6-a88cadf9e89e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:12.367233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-67274987-ae69-4356-aca6-a88cadf9e89e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:12.381341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67274987-ae69-4356-aca6-a88cadf9e89e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:12.382665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67274987-ae69-4356-aca6-a88cadf9e89e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:12.384355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67274987-ae69-4356-aca6-a88cadf9e89e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:12.387167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67274987-ae69-4356-aca6-a88cadf9e89e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:12.388279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67274987-ae69-4356-aca6-a88cadf9e89e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:12.389746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67274987-ae69-4356-aca6-a88cadf9e89e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:12.697079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-67274987-ae69-4356-aca6-a88cadf9e89e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:12.710062 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-67274987-ae69-4356-aca6-a88cadf9e89e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1475 microversion: 2.1 time: 0.346984 Oct 27 18:47:12.710708 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 314/623] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:12 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1475 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:12.727212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-41c5add9-554e-4a5e-a16b-1b436c1a2d3b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:12.727823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-41c5add9-554e-4a5e-a16b-1b436c1a2d3b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:12.739653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41c5add9-554e-4a5e-a16b-1b436c1a2d3b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:12.740153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41c5add9-554e-4a5e-a16b-1b436c1a2d3b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:12.740599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41c5add9-554e-4a5e-a16b-1b436c1a2d3b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:12.741314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41c5add9-554e-4a5e-a16b-1b436c1a2d3b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:12.741775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41c5add9-554e-4a5e-a16b-1b436c1a2d3b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:12.742201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41c5add9-554e-4a5e-a16b-1b436c1a2d3b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:13.093778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-41c5add9-554e-4a5e-a16b-1b436c1a2d3b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:13.114169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-41c5add9-554e-4a5e-a16b-1b436c1a2d3b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:13.121151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-41c5add9-554e-4a5e-a16b-1b436c1a2d3b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:13.124686 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-41c5add9-554e-4a5e-a16b-1b436c1a2d3b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1568 microversion: 2.25 time: 0.408813 Oct 27 18:47:13.141300 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 310/624] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:12 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1568 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:13.225661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a7ca17a6-365b-4f8c-bb8e-5752ba4ce6f0 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:13.226886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a7ca17a6-365b-4f8c-bb8e-5752ba4ce6f0 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:13.249838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7ca17a6-365b-4f8c-bb8e-5752ba4ce6f0 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:13.260629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7ca17a6-365b-4f8c-bb8e-5752ba4ce6f0 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:13.266471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7ca17a6-365b-4f8c-bb8e-5752ba4ce6f0 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:13.269590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7ca17a6-365b-4f8c-bb8e-5752ba4ce6f0 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:13.270280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7ca17a6-365b-4f8c-bb8e-5752ba4ce6f0 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:13.273750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7ca17a6-365b-4f8c-bb8e-5752ba4ce6f0 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:13.328517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2f7f6793-47ef-4955-9c46-f78a4fb455e0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:13.329575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2f7f6793-47ef-4955-9c46-f78a4fb455e0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:13.341217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f7f6793-47ef-4955-9c46-f78a4fb455e0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:13.344176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f7f6793-47ef-4955-9c46-f78a4fb455e0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:13.346221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f7f6793-47ef-4955-9c46-f78a4fb455e0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:13.349972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f7f6793-47ef-4955-9c46-f78a4fb455e0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:13.350753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f7f6793-47ef-4955-9c46-f78a4fb455e0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:13.351427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f7f6793-47ef-4955-9c46-f78a4fb455e0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:13.523212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a7ca17a6-365b-4f8c-bb8e-5752ba4ce6f0 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:13.534073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a7ca17a6-365b-4f8c-bb8e-5752ba4ce6f0 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:13.535594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a7ca17a6-365b-4f8c-bb8e-5752ba4ce6f0 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:13.541706 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a7ca17a6-365b-4f8c-bb8e-5752ba4ce6f0 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.323089 Oct 27 18:47:13.545771 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 315/625] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:13 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:13.639045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2f7f6793-47ef-4955-9c46-f78a4fb455e0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:13.653051 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2f7f6793-47ef-4955-9c46-f78a4fb455e0 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1478 microversion: 2.1 time: 0.330263 Oct 27 18:47:13.653536 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 311/626] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:13 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1478 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:47:13.738163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f1dc6c26-6e86-482b-ab5b-24a4b45e7af0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:13.739533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f1dc6c26-6e86-482b-ab5b-24a4b45e7af0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:13.772162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1dc6c26-6e86-482b-ab5b-24a4b45e7af0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:13.774183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1dc6c26-6e86-482b-ab5b-24a4b45e7af0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:13.774842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1dc6c26-6e86-482b-ab5b-24a4b45e7af0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:13.777753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1dc6c26-6e86-482b-ab5b-24a4b45e7af0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:13.778576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1dc6c26-6e86-482b-ab5b-24a4b45e7af0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:13.779329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1dc6c26-6e86-482b-ab5b-24a4b45e7af0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:14.151712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3f7f5702-b7dc-44d5-886d-6c3d5bcb8b3f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:14.153775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3f7f5702-b7dc-44d5-886d-6c3d5bcb8b3f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:14.162942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f7f5702-b7dc-44d5-886d-6c3d5bcb8b3f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:14.163774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f7f5702-b7dc-44d5-886d-6c3d5bcb8b3f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:14.164441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f7f5702-b7dc-44d5-886d-6c3d5bcb8b3f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:14.165415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f7f5702-b7dc-44d5-886d-6c3d5bcb8b3f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:14.166731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f7f5702-b7dc-44d5-886d-6c3d5bcb8b3f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:14.168199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f7f5702-b7dc-44d5-886d-6c3d5bcb8b3f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:14.207934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f1dc6c26-6e86-482b-ab5b-24a4b45e7af0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:14.220612 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f1dc6c26-6e86-482b-ab5b-24a4b45e7af0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1475 microversion: 2.1 time: 0.489179 Oct 27 18:47:14.222157 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 316/627] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:13 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1475 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:14.485862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3f7f5702-b7dc-44d5-886d-6c3d5bcb8b3f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:14.505723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3f7f5702-b7dc-44d5-886d-6c3d5bcb8b3f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:14.512796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3f7f5702-b7dc-44d5-886d-6c3d5bcb8b3f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:14.517849 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3f7f5702-b7dc-44d5-886d-6c3d5bcb8b3f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1568 microversion: 2.25 time: 0.366733 Oct 27 18:47:14.518499 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 312/628] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:14 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1568 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:14.574684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5b72b2ea-7da0-44d0-b5e2-5040cc779093 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:14.575178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5b72b2ea-7da0-44d0-b5e2-5040cc779093 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:14.601057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b72b2ea-7da0-44d0-b5e2-5040cc779093 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:14.601605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b72b2ea-7da0-44d0-b5e2-5040cc779093 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:14.602049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b72b2ea-7da0-44d0-b5e2-5040cc779093 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:14.603019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b72b2ea-7da0-44d0-b5e2-5040cc779093 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:14.603490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b72b2ea-7da0-44d0-b5e2-5040cc779093 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:14.604069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b72b2ea-7da0-44d0-b5e2-5040cc779093 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:14.679148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d86b5c2-80dc-4e38-9492-6a64b06f576a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:14.679914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d86b5c2-80dc-4e38-9492-6a64b06f576a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:14.696143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d86b5c2-80dc-4e38-9492-6a64b06f576a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:14.696657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d86b5c2-80dc-4e38-9492-6a64b06f576a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:14.698540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d86b5c2-80dc-4e38-9492-6a64b06f576a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:14.699369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d86b5c2-80dc-4e38-9492-6a64b06f576a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:14.699944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d86b5c2-80dc-4e38-9492-6a64b06f576a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:14.700260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d86b5c2-80dc-4e38-9492-6a64b06f576a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:14.736818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=18 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:14.737870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:14.854601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=10 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:15.139154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5b72b2ea-7da0-44d0-b5e2-5040cc779093 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:15.149904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5b72b2ea-7da0-44d0-b5e2-5040cc779093 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:15.151401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5b72b2ea-7da0-44d0-b5e2-5040cc779093 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:15.177289 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5b72b2ea-7da0-44d0-b5e2-5040cc779093 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.607535 Oct 27 18:47:15.188676 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 317/629] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:14 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:15.209975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-796d2cea-fcee-4ea6-874e-f2079857f8ff req-7b0347f6-3ecd-48ea-9fb1-9312ed38b7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43e1759-0ffb-423c-8d31-569d5ce79268", "name": "network-vif-unplugged", "status": "completed", "tag": "a4a765b2-af26-4b76-a70c-74d7dc9d17af"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:15.228401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-796d2cea-fcee-4ea6-874e-f2079857f8ff req-7b0347f6-3ecd-48ea-9fb1-9312ed38b7f5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:15.235199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-796d2cea-fcee-4ea6-874e-f2079857f8ff req-7b0347f6-3ecd-48ea-9fb1-9312ed38b7f5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:15.236992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-796d2cea-fcee-4ea6-874e-f2079857f8ff req-7b0347f6-3ecd-48ea-9fb1-9312ed38b7f5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:15.295441 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-796d2cea-fcee-4ea6-874e-f2079857f8ff req-7b0347f6-3ecd-48ea-9fb1-9312ed38b7f5 service nova] Creating event network-vif-unplugged:a4a765b2-af26-4b76-a70c-74d7dc9d17af for instance a43e1759-0ffb-423c-8d31-569d5ce79268 on n-h2-860687-3 Oct 27 18:47:15.315459 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-796d2cea-fcee-4ea6-874e-f2079857f8ff req-7b0347f6-3ecd-48ea-9fb1-9312ed38b7f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121282 Oct 27 18:47:15.317160 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 318/630] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:15.335279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c3598191-06dc-421c-9dc4-baff44ae8cdb tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:15.336403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c3598191-06dc-421c-9dc4-baff44ae8cdb tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:15.349175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3598191-06dc-421c-9dc4-baff44ae8cdb tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:15.350022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3598191-06dc-421c-9dc4-baff44ae8cdb tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:15.350994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3598191-06dc-421c-9dc4-baff44ae8cdb tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:15.351956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3598191-06dc-421c-9dc4-baff44ae8cdb tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:15.352618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3598191-06dc-421c-9dc4-baff44ae8cdb tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:15.353250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3598191-06dc-421c-9dc4-baff44ae8cdb tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:15.510206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d86b5c2-80dc-4e38-9492-6a64b06f576a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:15.532349 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d86b5c2-80dc-4e38-9492-6a64b06f576a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1463 microversion: 2.1 time: 0.857233 Oct 27 18:47:15.533467 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 313/631] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:14 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1463 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:15.547202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-18e1498c-5479-4931-976f-6712ef2962cb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:15.548187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-18e1498c-5479-4931-976f-6712ef2962cb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:15.583522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18e1498c-5479-4931-976f-6712ef2962cb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:15.584395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18e1498c-5479-4931-976f-6712ef2962cb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:15.585781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18e1498c-5479-4931-976f-6712ef2962cb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:15.587569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18e1498c-5479-4931-976f-6712ef2962cb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:15.590219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18e1498c-5479-4931-976f-6712ef2962cb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:15.591425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18e1498c-5479-4931-976f-6712ef2962cb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:15.819940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c3598191-06dc-421c-9dc4-baff44ae8cdb tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:15.832373 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c3598191-06dc-421c-9dc4-baff44ae8cdb tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1475 microversion: 2.1 time: 0.510288 Oct 27 18:47:15.833841 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 319/632] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:15 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1475 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:15.838623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5372697a-ab05-4000-a402-5dbf7c74f3e7 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:15.854227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5372697a-ab05-4000-a402-5dbf7c74f3e7 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:15.875684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5372697a-ab05-4000-a402-5dbf7c74f3e7 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:15.877199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5372697a-ab05-4000-a402-5dbf7c74f3e7 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:15.877903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5372697a-ab05-4000-a402-5dbf7c74f3e7 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:15.880577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5372697a-ab05-4000-a402-5dbf7c74f3e7 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:15.881130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5372697a-ab05-4000-a402-5dbf7c74f3e7 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:15.881815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5372697a-ab05-4000-a402-5dbf7c74f3e7 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:16.076198 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5372697a-ab05-4000-a402-5dbf7c74f3e7 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268/action" status: 202 len: 0 microversion: 2.1 time: 0.238900 Oct 27 18:47:16.083446 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 320/633] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:47:15 2022] POST /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:47:16.087849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-18e1498c-5479-4931-976f-6712ef2962cb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:16.100863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3aee57f7-cb9f-461a-a11d-ac78e3a4b5af tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:16.105981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3aee57f7-cb9f-461a-a11d-ac78e3a4b5af tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:16.135355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3aee57f7-cb9f-461a-a11d-ac78e3a4b5af tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:16.136916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3aee57f7-cb9f-461a-a11d-ac78e3a4b5af tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:16.138676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3aee57f7-cb9f-461a-a11d-ac78e3a4b5af tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:16.141551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3aee57f7-cb9f-461a-a11d-ac78e3a4b5af tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:16.143846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3aee57f7-cb9f-461a-a11d-ac78e3a4b5af tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:16.145038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3aee57f7-cb9f-461a-a11d-ac78e3a4b5af tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:16.211940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-18e1498c-5479-4931-976f-6712ef2962cb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:16.224332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-18e1498c-5479-4931-976f-6712ef2962cb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:16.256490 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-18e1498c-5479-4931-976f-6712ef2962cb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1568 microversion: 2.25 time: 0.712049 Oct 27 18:47:16.257139 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 314/634] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:15 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1568 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:47:16.325871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-53c35c32-4e2a-48dd-8a56-c4d64ff6ed7c tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:16.326813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-53c35c32-4e2a-48dd-8a56-c4d64ff6ed7c tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:16.331097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3aee57f7-cb9f-461a-a11d-ac78e3a4b5af tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:16.331591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3aee57f7-cb9f-461a-a11d-ac78e3a4b5af tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:16.332126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3aee57f7-cb9f-461a-a11d-ac78e3a4b5af tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:16.332589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-3aee57f7-cb9f-461a-a11d-ac78e3a4b5af tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lazy-loading 'fault' on Instance uuid a43e1759-0ffb-423c-8d31-569d5ce79268 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:16.360032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53c35c32-4e2a-48dd-8a56-c4d64ff6ed7c tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:16.360749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53c35c32-4e2a-48dd-8a56-c4d64ff6ed7c tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:16.361486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53c35c32-4e2a-48dd-8a56-c4d64ff6ed7c tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:16.362346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53c35c32-4e2a-48dd-8a56-c4d64ff6ed7c tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:16.365408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53c35c32-4e2a-48dd-8a56-c4d64ff6ed7c tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:16.366795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53c35c32-4e2a-48dd-8a56-c4d64ff6ed7c tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:16.559388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-53c35c32-4e2a-48dd-8a56-c4d64ff6ed7c tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:16.575946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-53c35c32-4e2a-48dd-8a56-c4d64ff6ed7c tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:16.589263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-53c35c32-4e2a-48dd-8a56-c4d64ff6ed7c tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:16.619061 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-53c35c32-4e2a-48dd-8a56-c4d64ff6ed7c tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1447 microversion: 2.75 time: 0.332442 Oct 27 18:47:16.620813 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 315/635] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:16 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1447 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:16.672131 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3aee57f7-cb9f-461a-a11d-ac78e3a4b5af tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1597 microversion: 2.1 time: 0.579850 Oct 27 18:47:16.680672 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 321/636] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:16 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1597 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:16.718038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bee2cdd8-4f4d-419f-879c-69c3b8a249b0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:16.723839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bee2cdd8-4f4d-419f-879c-69c3b8a249b0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:16.791859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bee2cdd8-4f4d-419f-879c-69c3b8a249b0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:16.792349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bee2cdd8-4f4d-419f-879c-69c3b8a249b0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:16.793644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bee2cdd8-4f4d-419f-879c-69c3b8a249b0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:16.796211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bee2cdd8-4f4d-419f-879c-69c3b8a249b0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:16.808796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bee2cdd8-4f4d-419f-879c-69c3b8a249b0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:16.812317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bee2cdd8-4f4d-419f-879c-69c3b8a249b0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:17.120109 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bee2cdd8-4f4d-419f-879c-69c3b8a249b0 tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268/action" status: 202 len: 0 microversion: 2.1 time: 0.414283 Oct 27 18:47:17.123153 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 322/637] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:47:16 2022] POST /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:47:17.130596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-77316368-f3a9-4e56-9664-818397893b46 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:17.131475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-77316368-f3a9-4e56-9664-818397893b46 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:17.177952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77316368-f3a9-4e56-9664-818397893b46 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:17.179957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77316368-f3a9-4e56-9664-818397893b46 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:17.180677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77316368-f3a9-4e56-9664-818397893b46 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:17.185094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77316368-f3a9-4e56-9664-818397893b46 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:17.186727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77316368-f3a9-4e56-9664-818397893b46 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:17.189666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77316368-f3a9-4e56-9664-818397893b46 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:17.212938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1863809558", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:17.419792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:47:18.133094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-77316368-f3a9-4e56-9664-818397893b46 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:18.142416 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-77316368-f3a9-4e56-9664-818397893b46 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1475 microversion: 2.1 time: 1.017697 Oct 27 18:47:18.161233 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 323/638] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:17 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1475 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:18.169115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:47:18.178533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:47:18.179320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:47:18.182524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5c54abe8-8f38-4a6f-95db-61273209701c tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:18.182710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:47:18.183159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:47:18.186220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5c54abe8-8f38-4a6f-95db-61273209701c tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:18.198613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c54abe8-8f38-4a6f-95db-61273209701c tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:18.203527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c54abe8-8f38-4a6f-95db-61273209701c tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:18.204300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c54abe8-8f38-4a6f-95db-61273209701c tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:18.207568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c54abe8-8f38-4a6f-95db-61273209701c tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:18.208360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c54abe8-8f38-4a6f-95db-61273209701c tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:18.209048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c54abe8-8f38-4a6f-95db-61273209701c tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:18.234009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:18.239100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:18.241174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:18.242030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:18.242547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:18.242990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:18.310656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:18.317324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Getting quotas for project f39cc90fd8ad43edadefcc7868adc6be. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:47:18.358496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Getting quotas for user a879659e04494f02a803b823e1fc5f3b and project f39cc90fd8ad43edadefcc7868adc6be. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:47:18.406637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:47:18.421043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:47:18.534454 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bc0f829e-c608-496d-a713-829deb3e3fbd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.912082 Oct 27 18:47:18.535375 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 316/639] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:47:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:47:18.565940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b8797d06-a291-43cd-816e-5b2d8e85489a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:18.566874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b8797d06-a291-43cd-816e-5b2d8e85489a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:18.590238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8797d06-a291-43cd-816e-5b2d8e85489a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:18.602435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8797d06-a291-43cd-816e-5b2d8e85489a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:18.604814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8797d06-a291-43cd-816e-5b2d8e85489a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:18.606015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8797d06-a291-43cd-816e-5b2d8e85489a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:18.608223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8797d06-a291-43cd-816e-5b2d8e85489a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:18.614776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8797d06-a291-43cd-816e-5b2d8e85489a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:18.748202 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5c54abe8-8f38-4a6f-95db-61273209701c tempest-ServersAdminTestJSON-1546844780 tempest-ServersAdminTestJSON-1546844780-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1614 microversion: 2.1 time: 0.568920 Oct 27 18:47:18.748853 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 324/640] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:18 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1614 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:18.758307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9fa95442-0a8b-469a-a271-9d67a34fd1d9 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:18.771224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9fa95442-0a8b-469a-a271-9d67a34fd1d9 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:18.810749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fa95442-0a8b-469a-a271-9d67a34fd1d9 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:18.811257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fa95442-0a8b-469a-a271-9d67a34fd1d9 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:18.811718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fa95442-0a8b-469a-a271-9d67a34fd1d9 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:18.812439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fa95442-0a8b-469a-a271-9d67a34fd1d9 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:18.812902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fa95442-0a8b-469a-a271-9d67a34fd1d9 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:18.826212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fa95442-0a8b-469a-a271-9d67a34fd1d9 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:19.195460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9fa95442-0a8b-469a-a271-9d67a34fd1d9 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:19.196710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b8797d06-a291-43cd-816e-5b2d8e85489a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:19.210222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b8797d06-a291-43cd-816e-5b2d8e85489a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:19.213668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9fa95442-0a8b-469a-a271-9d67a34fd1d9 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:19.215744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9fa95442-0a8b-469a-a271-9d67a34fd1d9 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:19.226891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b8797d06-a291-43cd-816e-5b2d8e85489a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:19.231800 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9fa95442-0a8b-469a-a271-9d67a34fd1d9 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1453 microversion: 2.75 time: 0.478225 Oct 27 18:47:19.233139 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 325/641] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:18 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1453 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:19.234974 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b8797d06-a291-43cd-816e-5b2d8e85489a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1558 microversion: 2.25 time: 0.697357 Oct 27 18:47:19.247123 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 317/642] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:18 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1558 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:19.269284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1f533a6a-5872-4455-9181-bdd50575d971 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:19.269284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1f533a6a-5872-4455-9181-bdd50575d971 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:19.277907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f4160f74-1119-4c13-bc61-d0b0a43919ac tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:19.278156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f4160f74-1119-4c13-bc61-d0b0a43919ac tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:19.329503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f533a6a-5872-4455-9181-bdd50575d971 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:19.334621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f533a6a-5872-4455-9181-bdd50575d971 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:19.343825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f533a6a-5872-4455-9181-bdd50575d971 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:19.346903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f533a6a-5872-4455-9181-bdd50575d971 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:19.353599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f533a6a-5872-4455-9181-bdd50575d971 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:19.356369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f533a6a-5872-4455-9181-bdd50575d971 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:19.465570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1f533a6a-5872-4455-9181-bdd50575d971 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:47:19.516967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f4160f74-1119-4c13-bc61-d0b0a43919ac tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:19.530631 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f4160f74-1119-4c13-bc61-d0b0a43919ac tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1217 microversion: 2.1 time: 0.293962 Oct 27 18:47:19.554590 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 326/643] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:19 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1217 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:19.589165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-036984e7-7db7-486a-967a-fd960dc7a135 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:19.593222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-036984e7-7db7-486a-967a-fd960dc7a135 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:19.620939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-036984e7-7db7-486a-967a-fd960dc7a135 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:19.626592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-036984e7-7db7-486a-967a-fd960dc7a135 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:19.628787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-036984e7-7db7-486a-967a-fd960dc7a135 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:19.634300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-036984e7-7db7-486a-967a-fd960dc7a135 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:19.638326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-036984e7-7db7-486a-967a-fd960dc7a135 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:19.642660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-036984e7-7db7-486a-967a-fd960dc7a135 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:19.859158 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1f533a6a-5872-4455-9181-bdd50575d971 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 204 len: 0 microversion: 2.1 time: 0.606892 Oct 27 18:47:19.862958 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 318/644] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:47:19 2022] DELETE /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:47:19.884388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a5a34fed-a765-4b49-a316-ebfdb0b5a8eb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '.version_select at 0x7fc86b2734c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:19.906527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5a34fed-a765-4b49-a316-ebfdb0b5a8eb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:19.912014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5a34fed-a765-4b49-a316-ebfdb0b5a8eb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:19.915621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5a34fed-a765-4b49-a316-ebfdb0b5a8eb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:20.002372 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a5a34fed-a765-4b49-a316-ebfdb0b5a8eb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 1104 microversion: 2.25 time: 0.129600 Oct 27 18:47:20.003537 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 319/645] 10.222.0.42 () {60 vars in 1184 bytes} [Thu Oct 27 18:47:19 2022] GET /compute/v2.1/os-migrations => generated 1104 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:20.028814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-82fc5b68-db67-44e0-ae56-5df44af3367c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:20.030722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-82fc5b68-db67-44e0-ae56-5df44af3367c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:20.054738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82fc5b68-db67-44e0-ae56-5df44af3367c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:20.069460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82fc5b68-db67-44e0-ae56-5df44af3367c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:20.071197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82fc5b68-db67-44e0-ae56-5df44af3367c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:20.072522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82fc5b68-db67-44e0-ae56-5df44af3367c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:20.077982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82fc5b68-db67-44e0-ae56-5df44af3367c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:20.081066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82fc5b68-db67-44e0-ae56-5df44af3367c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:20.247321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-036984e7-7db7-486a-967a-fd960dc7a135 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:20.254689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:20.272978 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-036984e7-7db7-486a-967a-fd960dc7a135 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1475 microversion: 2.1 time: 0.715723 Oct 27 18:47:20.273579 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 327/646] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:19 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1475 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:20.288222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-31f850d4-b278-4cfc-9cc1-e6834fc8e353 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:20.294650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-31f850d4-b278-4cfc-9cc1-e6834fc8e353 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:20.303749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31f850d4-b278-4cfc-9cc1-e6834fc8e353 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:20.306466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31f850d4-b278-4cfc-9cc1-e6834fc8e353 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:20.308356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31f850d4-b278-4cfc-9cc1-e6834fc8e353 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:20.309890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31f850d4-b278-4cfc-9cc1-e6834fc8e353 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:20.311016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31f850d4-b278-4cfc-9cc1-e6834fc8e353 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:20.312892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31f850d4-b278-4cfc-9cc1-e6834fc8e353 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:20.505303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-82fc5b68-db67-44e0-ae56-5df44af3367c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:20.519131 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-82fc5b68-db67-44e0-ae56-5df44af3367c tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1469 microversion: 2.1 time: 0.508738 Oct 27 18:47:20.532929 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 320/647] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:20 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1469 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:20.560258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d259753a-f8ed-483e-8feb-446038ac44ce tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:20.561160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d259753a-f8ed-483e-8feb-446038ac44ce tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:20.580745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d259753a-f8ed-483e-8feb-446038ac44ce tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:20.581577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d259753a-f8ed-483e-8feb-446038ac44ce tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:20.582359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d259753a-f8ed-483e-8feb-446038ac44ce tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:20.585496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d259753a-f8ed-483e-8feb-446038ac44ce tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:20.588673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d259753a-f8ed-483e-8feb-446038ac44ce tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:20.592931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d259753a-f8ed-483e-8feb-446038ac44ce tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:20.758043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d259753a-f8ed-483e-8feb-446038ac44ce tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:20.772939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d259753a-f8ed-483e-8feb-446038ac44ce tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:20.776741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d259753a-f8ed-483e-8feb-446038ac44ce tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:20.793143 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d259753a-f8ed-483e-8feb-446038ac44ce tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1453 microversion: 2.75 time: 0.258792 Oct 27 18:47:20.794268 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 321/648] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:20 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1453 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:20.799846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-e60b72eb-69c8-42b9-8142-c4f3846f4018 req-80436451-fc50-4c60-abc3-3c518a1ffcc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43e1759-0ffb-423c-8d31-569d5ce79268", "name": "network-vif-plugged", "status": "completed", "tag": "a4a765b2-af26-4b76-a70c-74d7dc9d17af"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:20.815022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e60b72eb-69c8-42b9-8142-c4f3846f4018 req-80436451-fc50-4c60-abc3-3c518a1ffcc0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:20.815755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e60b72eb-69c8-42b9-8142-c4f3846f4018 req-80436451-fc50-4c60-abc3-3c518a1ffcc0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:20.816525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e60b72eb-69c8-42b9-8142-c4f3846f4018 req-80436451-fc50-4c60-abc3-3c518a1ffcc0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:20.845035 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-e60b72eb-69c8-42b9-8142-c4f3846f4018 req-80436451-fc50-4c60-abc3-3c518a1ffcc0 service nova] Creating event network-vif-plugged:a4a765b2-af26-4b76-a70c-74d7dc9d17af for instance a43e1759-0ffb-423c-8d31-569d5ce79268 on n-h2-860687-3 Oct 27 18:47:20.857560 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-e60b72eb-69c8-42b9-8142-c4f3846f4018 req-80436451-fc50-4c60-abc3-3c518a1ffcc0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061616 Oct 27 18:47:20.858712 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 322/649] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:20.866978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb35f184-070c-4a87-9a98-e4c2632dc27e tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:20.868009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb35f184-070c-4a87-9a98-e4c2632dc27e tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:20.888292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb35f184-070c-4a87-9a98-e4c2632dc27e tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:20.890267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb35f184-070c-4a87-9a98-e4c2632dc27e tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:20.893999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb35f184-070c-4a87-9a98-e4c2632dc27e tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:20.895198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb35f184-070c-4a87-9a98-e4c2632dc27e tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:20.896058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb35f184-070c-4a87-9a98-e4c2632dc27e tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:20.898147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb35f184-070c-4a87-9a98-e4c2632dc27e tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:21.036417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-eb35f184-070c-4a87-9a98-e4c2632dc27e tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:21.057024 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb35f184-070c-4a87-9a98-e4c2632dc27e tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1221 microversion: 2.1 time: 0.193531 Oct 27 18:47:21.057876 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 323/650] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:20 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1221 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:21.215692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-31f850d4-b278-4cfc-9cc1-e6834fc8e353 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:21.242717 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-31f850d4-b278-4cfc-9cc1-e6834fc8e353 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 2051 microversion: 2.25 time: 0.967950 Oct 27 18:47:21.243796 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 328/651] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:20 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 2051 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:21.312491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-59cd7731-a964-445b-93c5-b08156d8b1d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:21.313191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-59cd7731-a964-445b-93c5-b08156d8b1d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:21.334956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59cd7731-a964-445b-93c5-b08156d8b1d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:21.337304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59cd7731-a964-445b-93c5-b08156d8b1d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:21.340109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59cd7731-a964-445b-93c5-b08156d8b1d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:21.343289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59cd7731-a964-445b-93c5-b08156d8b1d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:21.344166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59cd7731-a964-445b-93c5-b08156d8b1d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:21.348012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59cd7731-a964-445b-93c5-b08156d8b1d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:21.566793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dafe54f2-318e-489e-b1c0-1fa18ff11cc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:21.567576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dafe54f2-318e-489e-b1c0-1fa18ff11cc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:21.582051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dafe54f2-318e-489e-b1c0-1fa18ff11cc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:21.584472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dafe54f2-318e-489e-b1c0-1fa18ff11cc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:21.587283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dafe54f2-318e-489e-b1c0-1fa18ff11cc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:21.591295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dafe54f2-318e-489e-b1c0-1fa18ff11cc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:21.592973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dafe54f2-318e-489e-b1c0-1fa18ff11cc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:21.595091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dafe54f2-318e-489e-b1c0-1fa18ff11cc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:22.113528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dafe54f2-318e-489e-b1c0-1fa18ff11cc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:22.120281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-59cd7731-a964-445b-93c5-b08156d8b1d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:22.129201 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dafe54f2-318e-489e-b1c0-1fa18ff11cc7 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 200 len: 1469 microversion: 2.1 time: 0.570769 Oct 27 18:47:22.130002 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 329/652] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:21 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 1469 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:22.137993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1722051316", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "339d213d-d58f-44f1-aeaf-54d635220475"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:22.142558 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-59cd7731-a964-445b-93c5-b08156d8b1d8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1475 microversion: 2.1 time: 0.826800 Oct 27 18:47:22.143240 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 324/653] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:21 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1475 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:22.178316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-992e7cf1-d6dc-4528-8c1e-5df63d4a3afc tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:22.179260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-992e7cf1-d6dc-4528-8c1e-5df63d4a3afc tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:22.192298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-992e7cf1-d6dc-4528-8c1e-5df63d4a3afc tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:22.196190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-992e7cf1-d6dc-4528-8c1e-5df63d4a3afc tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:22.197415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-992e7cf1-d6dc-4528-8c1e-5df63d4a3afc tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:22.198342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-992e7cf1-d6dc-4528-8c1e-5df63d4a3afc tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:22.216462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-992e7cf1-d6dc-4528-8c1e-5df63d4a3afc tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:22.218225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-992e7cf1-d6dc-4528-8c1e-5df63d4a3afc tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:22.271688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] validate_networks() for [('339d213d-d58f-44f1-aeaf-54d635220475', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:47:22.809664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-992e7cf1-d6dc-4528-8c1e-5df63d4a3afc tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:22.823839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-992e7cf1-d6dc-4528-8c1e-5df63d4a3afc tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:22.825368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-992e7cf1-d6dc-4528-8c1e-5df63d4a3afc tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:22.861376 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-992e7cf1-d6dc-4528-8c1e-5df63d4a3afc tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1438 microversion: 2.75 time: 0.717005 Oct 27 18:47:22.868138 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 325/654] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:22 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1438 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:22.892104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f3e31e29-566c-4191-844c-66a23707edd1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:22.893695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f3e31e29-566c-4191-844c-66a23707edd1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:22.912783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3e31e29-566c-4191-844c-66a23707edd1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:22.913295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3e31e29-566c-4191-844c-66a23707edd1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:22.913742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3e31e29-566c-4191-844c-66a23707edd1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:22.914491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3e31e29-566c-4191-844c-66a23707edd1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:22.914955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3e31e29-566c-4191-844c-66a23707edd1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:22.925070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3e31e29-566c-4191-844c-66a23707edd1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:23.142994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f3e31e29-566c-4191-844c-66a23707edd1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:23.177180 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f3e31e29-566c-4191-844c-66a23707edd1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1275 microversion: 2.1 time: 0.294231 Oct 27 18:47:23.179734 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 326/655] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:22 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1275 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:23.627060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:23.630153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:23.654671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:23.655431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:23.664740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:23.666451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:23.674633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:23.675298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:24.054477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:47:24.055161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:47:24.055650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:47:24.056359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:47:24.059766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:47:24.260902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:24.275996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:24.278621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:24.279243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:24.290404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:24.291171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:24.292384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:25.066775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:47:25.068441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:47:25.069214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:47:25.069680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:47:25.070113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:47:25.131663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:25.132397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:25.134784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:25.142158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:25.144567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:25.146456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:25.239500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Getting quotas for project a1c89e4b67024f91ae460e3ae3278277. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:47:25.249345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Getting quotas for user c73a9daf485b421c8244f287fee5a942 and project a1c89e4b67024f91ae460e3ae3278277. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:47:25.273711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:47:25.283319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:47:25.340159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:25.366950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:25.387033 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0e8e9257-fe69-4560-bd75-80a7bca0611c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.255675 Oct 27 18:47:25.394020 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 330/656] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 18:47:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3257 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 18:47:25.414102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-1fa5e2e8-f24b-4a14-9de9-8e66be1832cd req-818d47e0-8dca-48f3-9dde-5d7ce3f2272e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d71f0172-5c69-42a1-bb37-d0511f852211", "name": "network-vif-deleted", "tag": "3545f586-170a-4011-93a6-4288e4a5de64"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:25.475839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1fa5e2e8-f24b-4a14-9de9-8e66be1832cd req-818d47e0-8dca-48f3-9dde-5d7ce3f2272e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:25.476357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1fa5e2e8-f24b-4a14-9de9-8e66be1832cd req-818d47e0-8dca-48f3-9dde-5d7ce3f2272e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:25.476806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1fa5e2e8-f24b-4a14-9de9-8e66be1832cd req-818d47e0-8dca-48f3-9dde-5d7ce3f2272e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:25.494858 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-996b7315-17c1-4287-83a8-d715672394f5 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8/action" status: 202 len: 1942 microversion: 2.75 time: 2.303286 Oct 27 18:47:25.496227 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 327/657] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 18:47:23 2022] POST /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8/action => generated 1942 bytes in 2316 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 18:47:25.515788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d5a3a6d0-17ed-4125-a04a-d44046d85b90 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:25.524313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d5a3a6d0-17ed-4125-a04a-d44046d85b90 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: d71f0172-5c69-42a1-bb37-d0511f852211] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:25.546812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5a3a6d0-17ed-4125-a04a-d44046d85b90 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:25.548285 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-1fa5e2e8-f24b-4a14-9de9-8e66be1832cd req-818d47e0-8dca-48f3-9dde-5d7ce3f2272e service nova] Creating event network-vif-deleted:3545f586-170a-4011-93a6-4288e4a5de64 for instance d71f0172-5c69-42a1-bb37-d0511f852211 on n-h2-860687-3 Oct 27 18:47:25.550220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5a3a6d0-17ed-4125-a04a-d44046d85b90 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:25.554141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5a3a6d0-17ed-4125-a04a-d44046d85b90 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:25.559504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5a3a6d0-17ed-4125-a04a-d44046d85b90 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:25.567281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5a3a6d0-17ed-4125-a04a-d44046d85b90 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:25.568091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5a3a6d0-17ed-4125-a04a-d44046d85b90 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:25.573026 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-1fa5e2e8-f24b-4a14-9de9-8e66be1832cd req-818d47e0-8dca-48f3-9dde-5d7ce3f2272e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181359 Oct 27 18:47:25.575533 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 331/658] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:25.591110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2bc4f27c-ec9f-45a7-82b2-da586c9b8f7c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:25.597604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2bc4f27c-ec9f-45a7-82b2-da586c9b8f7c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:25.618293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc4f27c-ec9f-45a7-82b2-da586c9b8f7c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:25.629886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc4f27c-ec9f-45a7-82b2-da586c9b8f7c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:25.632358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc4f27c-ec9f-45a7-82b2-da586c9b8f7c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:25.634249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc4f27c-ec9f-45a7-82b2-da586c9b8f7c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:25.635363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc4f27c-ec9f-45a7-82b2-da586c9b8f7c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:25.637543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc4f27c-ec9f-45a7-82b2-da586c9b8f7c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:25.638278 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d5a3a6d0-17ed-4125-a04a-d44046d85b90 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] HTTP exception thrown: Instance d71f0172-5c69-42a1-bb37-d0511f852211 could not be found. Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d5a3a6d0-17ed-4125-a04a-d44046d85b90 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Request method failure captured: Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 HTTP/1.1 Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGqj4Q3CqbNtbO6a3h2IYdqx5brrQEUa7eNGvDNlL48Uo0ev_JfYCGapuuE9Tkeo_PN12UQQFj7C30wkVWzztl1WDh6ZbDtMtdLsfK0JbG8fXl1x_MjeCLBNU80b2W7in92HNh1Y614LjwcLsKQ1lxLRFwKpRCntcAzAp7s0B9bkFc Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: ee37570c43c8438faad6c2bcdbacce99 Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersAdminTestJSON-983467884 Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:47:25.641066 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:47:25.642533 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ee37570c43c8438faad6c2bcdbacce99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ee37570c43c8438faad6c2bcdbacce99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ee37570c43c8438faad6c2bcdbacce99", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ee37570c43c8438faad6c2bcdbacce99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:25.642533 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersAdminTestJSON-983467884 Oct 27 18:47:25.642533 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: ee37570c43c8438faad6c2bcdbacce99 Oct 27 18:47:25.642533 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersAdminTestJSON-983467884 Oct 27 18:47:25.642533 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersAdminTestJSON-983467884-project Oct 27 18:47:25.642533 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:47:25.642533 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:47:25.642533 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 6a0b4798f17b408dab3af2ae0d2a45b7 Oct 27 18:47:25.642533 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersAdminTestJSON-983467884-project Oct 27 18:47:25.642533 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:47:25.642533 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance d71f0172-5c69-42a1-bb37-d0511f852211 could not be found. Oct 27 18:47:25.642533 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'd71f0172-5c69-42a1-bb37-d0511f852211'} Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d71f0172-5c69-42a1-bb37-d0511f852211 could not be found. Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:25.643623 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d71f0172-5c69-42a1-bb37-d0511f852211 could not be found. Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d71f0172-5c69-42a1-bb37-d0511f852211 could not be found. Oct 27 18:47:25.644995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:25.655989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d5a3a6d0-17ed-4125-a04a-d44046d85b90 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Returning 404 to user: Instance d71f0172-5c69-42a1-bb37-d0511f852211 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:25.658285 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d5a3a6d0-17ed-4125-a04a-d44046d85b90 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211" status: 404 len: 111 microversion: 2.1 time: 0.158752 Oct 27 18:47:25.678521 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 328/659] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:25 2022] GET /compute/v2.1/servers/d71f0172-5c69-42a1-bb37-d0511f852211 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:47:25.695234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1ddcd1e4-618d-4aa1-916e-d62fa84d0af0 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:25.698122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1ddcd1e4-618d-4aa1-916e-d62fa84d0af0 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:25.728053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ddcd1e4-618d-4aa1-916e-d62fa84d0af0 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:25.728557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ddcd1e4-618d-4aa1-916e-d62fa84d0af0 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:25.729001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ddcd1e4-618d-4aa1-916e-d62fa84d0af0 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:25.729725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ddcd1e4-618d-4aa1-916e-d62fa84d0af0 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:25.730502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ddcd1e4-618d-4aa1-916e-d62fa84d0af0 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:25.731063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ddcd1e4-618d-4aa1-916e-d62fa84d0af0 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:26.234651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1ddcd1e4-618d-4aa1-916e-d62fa84d0af0 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:26.247075 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1ddcd1e4-618d-4aa1-916e-d62fa84d0af0 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1317 microversion: 2.1 time: 0.569934 Oct 27 18:47:26.260783 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 329/660] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:25 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:26.274940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-05a979d9-f21c-45f5-b0d4-cf0be4d6da14 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:26.282659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-05a979d9-f21c-45f5-b0d4-cf0be4d6da14 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:26.328265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2bc4f27c-ec9f-45a7-82b2-da586c9b8f7c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:26.336681 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2bc4f27c-ec9f-45a7-82b2-da586c9b8f7c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1475 microversion: 2.1 time: 0.758651 Oct 27 18:47:26.338682 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 332/661] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:25 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1475 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:26.356193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-120112fe-f65e-46df-9ba1-fafd01ab0fca tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:26.357205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-120112fe-f65e-46df-9ba1-fafd01ab0fca tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:26.381538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-120112fe-f65e-46df-9ba1-fafd01ab0fca tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:26.382183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-120112fe-f65e-46df-9ba1-fafd01ab0fca tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:26.385572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-120112fe-f65e-46df-9ba1-fafd01ab0fca tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:26.387902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-120112fe-f65e-46df-9ba1-fafd01ab0fca tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:26.389369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-120112fe-f65e-46df-9ba1-fafd01ab0fca tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:26.390102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-120112fe-f65e-46df-9ba1-fafd01ab0fca tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:26.722689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-120112fe-f65e-46df-9ba1-fafd01ab0fca tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:26.776226 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-120112fe-f65e-46df-9ba1-fafd01ab0fca tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.433722 Oct 27 18:47:26.783491 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 333/662] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:26 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:26.791536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fd5b1f64-c2c9-46a2-ace4-c5b83de61fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:26.793192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fd5b1f64-c2c9-46a2-ace4-c5b83de61fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:26.817879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5b1f64-c2c9-46a2-ace4-c5b83de61fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:26.818960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5b1f64-c2c9-46a2-ace4-c5b83de61fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:26.819643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5b1f64-c2c9-46a2-ace4-c5b83de61fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:26.820651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5b1f64-c2c9-46a2-ace4-c5b83de61fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:26.821424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5b1f64-c2c9-46a2-ace4-c5b83de61fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:26.822100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5b1f64-c2c9-46a2-ace4-c5b83de61fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:26.875817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fd5b1f64-c2c9-46a2-ace4-c5b83de61fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:47:27.060253 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fd5b1f64-c2c9-46a2-ace4-c5b83de61fed tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "DELETE /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 204 len: 0 microversion: 2.1 time: 0.274917 Oct 27 18:47:27.061197 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 334/663] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:47:26 2022] DELETE /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:47:27.234645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-372654804", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "011a081f-3a1d-4a29-beeb-69b643eacdb0"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:27.244169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-05a979d9-f21c-45f5-b0d4-cf0be4d6da14 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:27.277349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-05a979d9-f21c-45f5-b0d4-cf0be4d6da14 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:27.282724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-05a979d9-f21c-45f5-b0d4-cf0be4d6da14 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:27.292358 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-05a979d9-f21c-45f5-b0d4-cf0be4d6da14 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1262 microversion: 2.25 time: 1.027049 Oct 27 18:47:27.294212 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 330/664] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:26 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1262 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:27.320616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ded658e9-0924-41e6-b8a7-bce47450884a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:27.322630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ded658e9-0924-41e6-b8a7-bce47450884a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:27.353712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded658e9-0924-41e6-b8a7-bce47450884a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:27.354295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded658e9-0924-41e6-b8a7-bce47450884a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:27.355464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded658e9-0924-41e6-b8a7-bce47450884a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:27.361507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded658e9-0924-41e6-b8a7-bce47450884a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:27.363958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded658e9-0924-41e6-b8a7-bce47450884a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:27.364694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded658e9-0924-41e6-b8a7-bce47450884a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:27.400433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] validate_networks() for [('011a081f-3a1d-4a29-beeb-69b643eacdb0', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:47:28.004884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ded658e9-0924-41e6-b8a7-bce47450884a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:28.036337 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ded658e9-0924-41e6-b8a7-bce47450884a tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1469 microversion: 2.1 time: 0.720829 Oct 27 18:47:28.040145 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 331/665] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:27 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1469 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:28.048337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f44548f1-797d-4179-9b17-dec180b916c4 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:28.049226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f44548f1-797d-4179-9b17-dec180b916c4 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:28.069090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f44548f1-797d-4179-9b17-dec180b916c4 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:28.087846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f44548f1-797d-4179-9b17-dec180b916c4 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:28.089066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f44548f1-797d-4179-9b17-dec180b916c4 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:28.093698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f44548f1-797d-4179-9b17-dec180b916c4 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:28.094475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f44548f1-797d-4179-9b17-dec180b916c4 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:28.095121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f44548f1-797d-4179-9b17-dec180b916c4 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:28.281227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:28.385154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:47:28.385664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:47:28.387126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:47:28.389697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:47:28.390494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:47:28.414090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:28.414819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:28.415038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:28.415761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:28.416214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:28.416640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:28.491344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Getting quotas for project 154455c389be498e84dc3b0ca4e7ee30. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:47:28.521975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Getting quotas for user 1ea78f6cb7bb4974a7d61d015b6a2faf and project 154455c389be498e84dc3b0ca4e7ee30. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:47:28.586956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:47:28.589644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:47:28.734756 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f4361313-7e67-41b1-b30c-73a102e063b3 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.671842 Oct 27 18:47:28.739034 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 335/666] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:47:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:47:28.746078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-03c0dcd2-5c0f-457e-98d7-eb4146bd0ad5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:28.746653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-03c0dcd2-5c0f-457e-98d7-eb4146bd0ad5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:28.765177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:28.801040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03c0dcd2-5c0f-457e-98d7-eb4146bd0ad5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:28.806707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03c0dcd2-5c0f-457e-98d7-eb4146bd0ad5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:28.807377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03c0dcd2-5c0f-457e-98d7-eb4146bd0ad5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:28.808279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03c0dcd2-5c0f-457e-98d7-eb4146bd0ad5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:28.809114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03c0dcd2-5c0f-457e-98d7-eb4146bd0ad5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:28.809399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03c0dcd2-5c0f-457e-98d7-eb4146bd0ad5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:29.918739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-03c0dcd2-5c0f-457e-98d7-eb4146bd0ad5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:29.934977 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-03c0dcd2-5c0f-457e-98d7-eb4146bd0ad5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1474 microversion: 2.1 time: 1.194684 Oct 27 18:47:29.943594 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 336/667] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:28 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1474 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:29.951506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c843e5a9-dffb-4a24-9d64-6f0c545b9fe8 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:29.955403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f44548f1-797d-4179-9b17-dec180b916c4 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:29.957033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c843e5a9-dffb-4a24-9d64-6f0c545b9fe8 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:29.968227 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f44548f1-797d-4179-9b17-dec180b916c4 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1317 microversion: 2.1 time: 1.926407 Oct 27 18:47:29.974970 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 332/668] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:28 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1317 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:29.985278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-04d36149-6eda-4791-97bb-ddbc5b7888f1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:29.986268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04d36149-6eda-4791-97bb-ddbc5b7888f1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:29.989335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c843e5a9-dffb-4a24-9d64-6f0c545b9fe8 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:29.989889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c843e5a9-dffb-4a24-9d64-6f0c545b9fe8 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:29.990348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c843e5a9-dffb-4a24-9d64-6f0c545b9fe8 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:29.991203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c843e5a9-dffb-4a24-9d64-6f0c545b9fe8 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:29.991842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c843e5a9-dffb-4a24-9d64-6f0c545b9fe8 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:29.993911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c843e5a9-dffb-4a24-9d64-6f0c545b9fe8 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:30.001820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04d36149-6eda-4791-97bb-ddbc5b7888f1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:30.002691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04d36149-6eda-4791-97bb-ddbc5b7888f1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:30.003329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04d36149-6eda-4791-97bb-ddbc5b7888f1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:30.007191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04d36149-6eda-4791-97bb-ddbc5b7888f1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:30.007673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04d36149-6eda-4791-97bb-ddbc5b7888f1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:30.008117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04d36149-6eda-4791-97bb-ddbc5b7888f1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:30.319804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-c843e5a9-dffb-4a24-9d64-6f0c545b9fe8 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:30.402833 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c843e5a9-dffb-4a24-9d64-6f0c545b9fe8 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.457908 Oct 27 18:47:30.407528 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 337/669] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:29 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:30.423506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-b3cdf010-8df1-4748-a4ed-1f9f6586f781 req-f6c9dbc7-f280-4208-b1c0-18e0b8b32421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77a645e2-ba92-42c7-8a35-8aea0ee2f9b9", "tag": "2cf40f9d-6d09-4726-8ad1-d50203aea23c"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:30.468152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b3cdf010-8df1-4748-a4ed-1f9f6586f781 req-f6c9dbc7-f280-4208-b1c0-18e0b8b32421 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:30.468999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b3cdf010-8df1-4748-a4ed-1f9f6586f781 req-f6c9dbc7-f280-4208-b1c0-18e0b8b32421 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:30.470310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b3cdf010-8df1-4748-a4ed-1f9f6586f781 req-f6c9dbc7-f280-4208-b1c0-18e0b8b32421 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:30.508904 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-b3cdf010-8df1-4748-a4ed-1f9f6586f781 req-f6c9dbc7-f280-4208-b1c0-18e0b8b32421 service nova] Creating event network-changed:2cf40f9d-6d09-4726-8ad1-d50203aea23c for instance 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 on n-h2-860687-3 Oct 27 18:47:30.532950 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-b3cdf010-8df1-4748-a4ed-1f9f6586f781 req-f6c9dbc7-f280-4208-b1c0-18e0b8b32421 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123967 Oct 27 18:47:30.533769 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 338/670] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:30.542462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6bf80005-d4ca-42fc-b7c0-a6b71fba5ebf tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:30.545246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6bf80005-d4ca-42fc-b7c0-a6b71fba5ebf tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:30.553389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bf80005-d4ca-42fc-b7c0-a6b71fba5ebf tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:30.554695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bf80005-d4ca-42fc-b7c0-a6b71fba5ebf tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:30.555469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bf80005-d4ca-42fc-b7c0-a6b71fba5ebf tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:30.556541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bf80005-d4ca-42fc-b7c0-a6b71fba5ebf tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:30.557156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bf80005-d4ca-42fc-b7c0-a6b71fba5ebf tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:30.557752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bf80005-d4ca-42fc-b7c0-a6b71fba5ebf tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:31.072548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6bf80005-d4ca-42fc-b7c0-a6b71fba5ebf tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:31.086277 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6bf80005-d4ca-42fc-b7c0-a6b71fba5ebf tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1283 microversion: 2.1 time: 0.549987 Oct 27 18:47:31.089309 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 339/671] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:30 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1283 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:31.096717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2f45c7c2-22d8-446c-b4b3-ab9a573267aa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:31.101543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2f45c7c2-22d8-446c-b4b3-ab9a573267aa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:31.128703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f45c7c2-22d8-446c-b4b3-ab9a573267aa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:31.131293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f45c7c2-22d8-446c-b4b3-ab9a573267aa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:31.133169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f45c7c2-22d8-446c-b4b3-ab9a573267aa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:31.134874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f45c7c2-22d8-446c-b4b3-ab9a573267aa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:31.136942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f45c7c2-22d8-446c-b4b3-ab9a573267aa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:31.138624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f45c7c2-22d8-446c-b4b3-ab9a573267aa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:31.196047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-04d36149-6eda-4791-97bb-ddbc5b7888f1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:31.212102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-04d36149-6eda-4791-97bb-ddbc5b7888f1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:31.218870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-04d36149-6eda-4791-97bb-ddbc5b7888f1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:31.222305 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-04d36149-6eda-4791-97bb-ddbc5b7888f1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1362 microversion: 2.25 time: 1.245914 Oct 27 18:47:31.225766 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 333/672] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:29 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1362 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:31.239515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-276af93b-fe20-4b6f-82f3-bb9459d5d2d3 req-6159ee7d-73c7-4e5b-b0e7-3b2620d91756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901fd413-2d42-4014-86c1-5fe80598f789", "name": "network-vif-unplugged", "status": "completed", "tag": "11fc4a40-18f3-4dcf-b5eb-6e544bd414ef"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:31.269498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-276af93b-fe20-4b6f-82f3-bb9459d5d2d3 req-6159ee7d-73c7-4e5b-b0e7-3b2620d91756 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:31.270995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-276af93b-fe20-4b6f-82f3-bb9459d5d2d3 req-6159ee7d-73c7-4e5b-b0e7-3b2620d91756 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:31.272896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-276af93b-fe20-4b6f-82f3-bb9459d5d2d3 req-6159ee7d-73c7-4e5b-b0e7-3b2620d91756 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:31.304072 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-276af93b-fe20-4b6f-82f3-bb9459d5d2d3 req-6159ee7d-73c7-4e5b-b0e7-3b2620d91756 service nova] Creating event network-vif-unplugged:11fc4a40-18f3-4dcf-b5eb-6e544bd414ef for instance 901fd413-2d42-4014-86c1-5fe80598f789 on n-h1-860687-3 Oct 27 18:47:31.319275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-276af93b-fe20-4b6f-82f3-bb9459d5d2d3 req-6159ee7d-73c7-4e5b-b0e7-3b2620d91756 service nova] Instance 901fd413-2d42-4014-86c1-5fe80598f789 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:47:31.335922 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-276af93b-fe20-4b6f-82f3-bb9459d5d2d3 req-6159ee7d-73c7-4e5b-b0e7-3b2620d91756 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107448 Oct 27 18:47:31.337509 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 334/673] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:31.344894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-119cff14-97a0-4977-94b4-c1e82782ac3b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:31.345871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-119cff14-97a0-4977-94b4-c1e82782ac3b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:31.352677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-119cff14-97a0-4977-94b4-c1e82782ac3b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:31.353420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-119cff14-97a0-4977-94b4-c1e82782ac3b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:31.354011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-119cff14-97a0-4977-94b4-c1e82782ac3b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:31.355476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-119cff14-97a0-4977-94b4-c1e82782ac3b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:31.356772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-119cff14-97a0-4977-94b4-c1e82782ac3b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:31.357430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-119cff14-97a0-4977-94b4-c1e82782ac3b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:31.390433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2f45c7c2-22d8-446c-b4b3-ab9a573267aa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:31.401445 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2f45c7c2-22d8-446c-b4b3-ab9a573267aa tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1427 microversion: 2.1 time: 0.307833 Oct 27 18:47:31.405602 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 340/674] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:31 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1427 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:31.423433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6045a5d3-e6b0-4eb8-9f2d-346a444c1e6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:31.424350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6045a5d3-e6b0-4eb8-9f2d-346a444c1e6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:31.440583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6045a5d3-e6b0-4eb8-9f2d-346a444c1e6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:31.441321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6045a5d3-e6b0-4eb8-9f2d-346a444c1e6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:31.444565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6045a5d3-e6b0-4eb8-9f2d-346a444c1e6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:31.445503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6045a5d3-e6b0-4eb8-9f2d-346a444c1e6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:31.451744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6045a5d3-e6b0-4eb8-9f2d-346a444c1e6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:31.454351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6045a5d3-e6b0-4eb8-9f2d-346a444c1e6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:31.984312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6045a5d3-e6b0-4eb8-9f2d-346a444c1e6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:31.999100 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6045a5d3-e6b0-4eb8-9f2d-346a444c1e6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1317 microversion: 2.1 time: 0.592062 Oct 27 18:47:31.999714 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 341/675] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:31 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1317 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:32.016490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-119cff14-97a0-4977-94b4-c1e82782ac3b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:32.028860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-04f55265-03c1-426a-b82b-a8e21dbb750e tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:32.029489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-04f55265-03c1-426a-b82b-a8e21dbb750e tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:32.030833 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-119cff14-97a0-4977-94b4-c1e82782ac3b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1474 microversion: 2.1 time: 0.691869 Oct 27 18:47:32.034610 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 335/676] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:31 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1474 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:32.050420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04f55265-03c1-426a-b82b-a8e21dbb750e tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:32.051215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04f55265-03c1-426a-b82b-a8e21dbb750e tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:32.051660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04f55265-03c1-426a-b82b-a8e21dbb750e tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:32.055905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04f55265-03c1-426a-b82b-a8e21dbb750e tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:32.056601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04f55265-03c1-426a-b82b-a8e21dbb750e tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:32.059488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04f55265-03c1-426a-b82b-a8e21dbb750e tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:32.113167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-842ecbf7-6e66-4a70-8cf0-2c6c48c5613c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:32.113803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-842ecbf7-6e66-4a70-8cf0-2c6c48c5613c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:32.131877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-842ecbf7-6e66-4a70-8cf0-2c6c48c5613c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:32.135000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-842ecbf7-6e66-4a70-8cf0-2c6c48c5613c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:32.135739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-842ecbf7-6e66-4a70-8cf0-2c6c48c5613c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:32.145606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-842ecbf7-6e66-4a70-8cf0-2c6c48c5613c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:32.146466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-842ecbf7-6e66-4a70-8cf0-2c6c48c5613c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:32.147113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-842ecbf7-6e66-4a70-8cf0-2c6c48c5613c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:32.214073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-04f55265-03c1-426a-b82b-a8e21dbb750e tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:32.273829 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-04f55265-03c1-426a-b82b-a8e21dbb750e tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.272970 Oct 27 18:47:32.275006 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 342/677] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:31 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:32.279972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-240810a6-0f08-457a-b3fc-89d1fa3030f8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:32.280815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-240810a6-0f08-457a-b3fc-89d1fa3030f8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:32.298193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-240810a6-0f08-457a-b3fc-89d1fa3030f8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:32.298955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-240810a6-0f08-457a-b3fc-89d1fa3030f8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:32.299583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-240810a6-0f08-457a-b3fc-89d1fa3030f8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:32.300446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-240810a6-0f08-457a-b3fc-89d1fa3030f8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:32.301557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-240810a6-0f08-457a-b3fc-89d1fa3030f8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:32.302412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-240810a6-0f08-457a-b3fc-89d1fa3030f8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:32.400067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-842ecbf7-6e66-4a70-8cf0-2c6c48c5613c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:32.415423 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-842ecbf7-6e66-4a70-8cf0-2c6c48c5613c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1289 microversion: 2.1 time: 0.306046 Oct 27 18:47:32.427411 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 336/678] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:32 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1289 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:47:32.444080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c90ee140-361a-4a31-ba01-b65d56fb5ffe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:32.449956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c90ee140-361a-4a31-ba01-b65d56fb5ffe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:32.475559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c90ee140-361a-4a31-ba01-b65d56fb5ffe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:32.478162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c90ee140-361a-4a31-ba01-b65d56fb5ffe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:32.479569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c90ee140-361a-4a31-ba01-b65d56fb5ffe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:32.483699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c90ee140-361a-4a31-ba01-b65d56fb5ffe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:32.488510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c90ee140-361a-4a31-ba01-b65d56fb5ffe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:32.492915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c90ee140-361a-4a31-ba01-b65d56fb5ffe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:32.593203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c90ee140-361a-4a31-ba01-b65d56fb5ffe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:32.594181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c90ee140-361a-4a31-ba01-b65d56fb5ffe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:32.594892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c90ee140-361a-4a31-ba01-b65d56fb5ffe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:32.595531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-c90ee140-361a-4a31-ba01-b65d56fb5ffe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lazy-loading 'fault' on Instance uuid 45e16b25-683e-43bf-b5f8-1781478bb25a {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:32.796277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c90ee140-361a-4a31-ba01-b65d56fb5ffe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:32.815639 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c90ee140-361a-4a31-ba01-b65d56fb5ffe tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 200 len: 1303 microversion: 2.1 time: 0.385451 Oct 27 18:47:32.824436 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 337/679] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:32 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 1303 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:32.837377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-8dfc07f3-42e9-4f4e-938a-a8d247724f87 req-588522fd-a50a-4818-b337-56c04d3bd98c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "293448e8-0911-4074-a5d0-d9ff98094843", "tag": "e5835307-83a9-4b59-8ccd-63bd95493e8c"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:32.869148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8dfc07f3-42e9-4f4e-938a-a8d247724f87 req-588522fd-a50a-4818-b337-56c04d3bd98c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:32.869637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8dfc07f3-42e9-4f4e-938a-a8d247724f87 req-588522fd-a50a-4818-b337-56c04d3bd98c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:32.870077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8dfc07f3-42e9-4f4e-938a-a8d247724f87 req-588522fd-a50a-4818-b337-56c04d3bd98c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:32.923267 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-8dfc07f3-42e9-4f4e-938a-a8d247724f87 req-588522fd-a50a-4818-b337-56c04d3bd98c service nova] Creating event network-changed:e5835307-83a9-4b59-8ccd-63bd95493e8c for instance 293448e8-0911-4074-a5d0-d9ff98094843 on n-h1-860687-3 Oct 27 18:47:32.928255 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-8dfc07f3-42e9-4f4e-938a-a8d247724f87 req-588522fd-a50a-4818-b337-56c04d3bd98c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102433 Oct 27 18:47:32.929254 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 338/680] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:32.940011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-240810a6-0f08-457a-b3fc-89d1fa3030f8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:32.956965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-240810a6-0f08-457a-b3fc-89d1fa3030f8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:32.959067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-240810a6-0f08-457a-b3fc-89d1fa3030f8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:32.960404 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-240810a6-0f08-457a-b3fc-89d1fa3030f8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1362 microversion: 2.25 time: 0.684259 Oct 27 18:47:32.973800 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 343/681] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:32 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1362 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:32.977661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-de6b92b9-8c87-4a0f-a5d9-a811102a17a7 req-9921cf3c-49d4-46b4-8b53-c39277908469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e16b25-683e-43bf-b5f8-1781478bb25a", "name": "network-vif-deleted", "tag": "5cfd40ff-4e39-4110-b64b-079f4abd01a6"}, {"name": "network-changed", "server_uuid": "901fd413-2d42-4014-86c1-5fe80598f789", "tag": "11fc4a40-18f3-4dcf-b5eb-6e544bd414ef"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:33.006719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-de6b92b9-8c87-4a0f-a5d9-a811102a17a7 req-9921cf3c-49d4-46b4-8b53-c39277908469 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:33.008482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-de6b92b9-8c87-4a0f-a5d9-a811102a17a7 req-9921cf3c-49d4-46b4-8b53-c39277908469 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:33.010230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-de6b92b9-8c87-4a0f-a5d9-a811102a17a7 req-9921cf3c-49d4-46b4-8b53-c39277908469 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:33.031514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-60119fc4-bafa-4303-be39-c11036cc4cff tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:33.032363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-60119fc4-bafa-4303-be39-c11036cc4cff tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:33.046584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60119fc4-bafa-4303-be39-c11036cc4cff tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:33.046826 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-de6b92b9-8c87-4a0f-a5d9-a811102a17a7 req-9921cf3c-49d4-46b4-8b53-c39277908469 service nova] Creating event network-vif-deleted:5cfd40ff-4e39-4110-b64b-079f4abd01a6 for instance 45e16b25-683e-43bf-b5f8-1781478bb25a on n-h2-860687-3 Oct 27 18:47:33.047151 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-de6b92b9-8c87-4a0f-a5d9-a811102a17a7 req-9921cf3c-49d4-46b4-8b53-c39277908469 service nova] Creating event network-changed:11fc4a40-18f3-4dcf-b5eb-6e544bd414ef for instance 901fd413-2d42-4014-86c1-5fe80598f789 on n-h1-860687-3 Oct 27 18:47:33.048843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60119fc4-bafa-4303-be39-c11036cc4cff tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:33.052635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60119fc4-bafa-4303-be39-c11036cc4cff tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:33.053940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60119fc4-bafa-4303-be39-c11036cc4cff tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:33.056847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60119fc4-bafa-4303-be39-c11036cc4cff tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:33.057441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60119fc4-bafa-4303-be39-c11036cc4cff tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:33.061516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-de6b92b9-8c87-4a0f-a5d9-a811102a17a7 req-9921cf3c-49d4-46b4-8b53-c39277908469 service nova] Instance 901fd413-2d42-4014-86c1-5fe80598f789 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:47:33.069756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:33.094035 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-de6b92b9-8c87-4a0f-a5d9-a811102a17a7 req-9921cf3c-49d4-46b4-8b53-c39277908469 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.136883 Oct 27 18:47:33.095520 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 339/682] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:33.101036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-33955c1e-995d-40e3-9f1e-795faf2a2ec8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:33.101940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-33955c1e-995d-40e3-9f1e-795faf2a2ec8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:33.110596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33955c1e-995d-40e3-9f1e-795faf2a2ec8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:33.111464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33955c1e-995d-40e3-9f1e-795faf2a2ec8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:33.112065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33955c1e-995d-40e3-9f1e-795faf2a2ec8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:33.113504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33955c1e-995d-40e3-9f1e-795faf2a2ec8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:33.114271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33955c1e-995d-40e3-9f1e-795faf2a2ec8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:33.114914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33955c1e-995d-40e3-9f1e-795faf2a2ec8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:33.440591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-60119fc4-bafa-4303-be39-c11036cc4cff tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:33.463479 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-60119fc4-bafa-4303-be39-c11036cc4cff tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1317 microversion: 2.1 time: 0.439667 Oct 27 18:47:33.466612 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 344/683] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:33 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:33.473680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-33955c1e-995d-40e3-9f1e-795faf2a2ec8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:33.477329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-40b60d64-9b85-4ead-ad72-686961cacb6d tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:33.477971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-40b60d64-9b85-4ead-ad72-686961cacb6d tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:33.494737 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-33955c1e-995d-40e3-9f1e-795faf2a2ec8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1474 microversion: 2.1 time: 0.397784 Oct 27 18:47:33.495613 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 340/684] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:33 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1474 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:33.499282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40b60d64-9b85-4ead-ad72-686961cacb6d tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:33.499872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40b60d64-9b85-4ead-ad72-686961cacb6d tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:33.500329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40b60d64-9b85-4ead-ad72-686961cacb6d tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:33.513924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40b60d64-9b85-4ead-ad72-686961cacb6d tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:33.514896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40b60d64-9b85-4ead-ad72-686961cacb6d tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:33.515690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4ff3599b-015b-4167-80f1-1ec8d258a40c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:33.516327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4ff3599b-015b-4167-80f1-1ec8d258a40c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:33.517054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40b60d64-9b85-4ead-ad72-686961cacb6d tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:33.528345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ff3599b-015b-4167-80f1-1ec8d258a40c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:33.528844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ff3599b-015b-4167-80f1-1ec8d258a40c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:33.529495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ff3599b-015b-4167-80f1-1ec8d258a40c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:33.534744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ff3599b-015b-4167-80f1-1ec8d258a40c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:33.535504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ff3599b-015b-4167-80f1-1ec8d258a40c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:33.536355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ff3599b-015b-4167-80f1-1ec8d258a40c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:33.734432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-40b60d64-9b85-4ead-ad72-686961cacb6d tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:33.786884 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-40b60d64-9b85-4ead-ad72-686961cacb6d tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.318435 Oct 27 18:47:33.787730 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 345/685] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:33 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:33.848113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-98db60f9-98cb-4f7a-be45-97295ba61010 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:33.848742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-98db60f9-98cb-4f7a-be45-97295ba61010 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: 45e16b25-683e-43bf-b5f8-1781478bb25a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:33.857980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98db60f9-98cb-4f7a-be45-97295ba61010 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:33.858781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98db60f9-98cb-4f7a-be45-97295ba61010 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:33.860875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98db60f9-98cb-4f7a-be45-97295ba61010 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:33.861794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98db60f9-98cb-4f7a-be45-97295ba61010 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:33.866536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98db60f9-98cb-4f7a-be45-97295ba61010 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:33.867505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98db60f9-98cb-4f7a-be45-97295ba61010 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:33.904544 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-98db60f9-98cb-4f7a-be45-97295ba61010 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] HTTP exception thrown: Instance 45e16b25-683e-43bf-b5f8-1781478bb25a could not be found. Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-98db60f9-98cb-4f7a-be45-97295ba61010 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Request method failure captured: Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a HTTP/1.1 Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtGqj4Q3CqbNtbO6a3h2IYdqx5brrQEUa7eNGvDNlL48Uo0ev_JfYCGapuuE9Tkeo_PN12UQQFj7C30wkVWzztl1WDh6ZbDtMtdLsfK0JbG8fXl1x_MjeCLBNU80b2W7in92HNh1Y614LjwcLsKQ1lxLRFwKpRCntcAzAp7s0B9bkFc Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ee37570c43c8438faad6c2bcdbacce99 Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersAdminTestJSON-983467884 Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:47:33.907214 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:47:33.908885 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ee37570c43c8438faad6c2bcdbacce99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ee37570c43c8438faad6c2bcdbacce99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ee37570c43c8438faad6c2bcdbacce99", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ee37570c43c8438faad6c2bcdbacce99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:33.908885 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersAdminTestJSON-983467884 Oct 27 18:47:33.908885 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ee37570c43c8438faad6c2bcdbacce99 Oct 27 18:47:33.908885 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersAdminTestJSON-983467884 Oct 27 18:47:33.908885 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersAdminTestJSON-983467884-project Oct 27 18:47:33.908885 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:47:33.908885 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:47:33.908885 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 6a0b4798f17b408dab3af2ae0d2a45b7 Oct 27 18:47:33.908885 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersAdminTestJSON-983467884-project Oct 27 18:47:33.908885 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:47:33.908885 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 45e16b25-683e-43bf-b5f8-1781478bb25a could not be found. Oct 27 18:47:33.908885 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '45e16b25-683e-43bf-b5f8-1781478bb25a'} Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e16b25-683e-43bf-b5f8-1781478bb25a could not be found. Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:33.909770 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e16b25-683e-43bf-b5f8-1781478bb25a could not be found. Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e16b25-683e-43bf-b5f8-1781478bb25a could not be found. Oct 27 18:47:33.911320 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:33.913439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-98db60f9-98cb-4f7a-be45-97295ba61010 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Returning 404 to user: Instance 45e16b25-683e-43bf-b5f8-1781478bb25a could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:33.914575 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-98db60f9-98cb-4f7a-be45-97295ba61010 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a" status: 404 len: 111 microversion: 2.1 time: 0.070541 Oct 27 18:47:33.915306 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 346/686] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:33 2022] GET /compute/v2.1/servers/45e16b25-683e-43bf-b5f8-1781478bb25a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:47:33.928696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ba10e6a5-f840-4507-8351-36ed5b9ff37e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:33.937640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ba10e6a5-f840-4507-8351-36ed5b9ff37e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:33.946915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba10e6a5-f840-4507-8351-36ed5b9ff37e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:33.947423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba10e6a5-f840-4507-8351-36ed5b9ff37e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:33.951068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba10e6a5-f840-4507-8351-36ed5b9ff37e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:33.953953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba10e6a5-f840-4507-8351-36ed5b9ff37e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:33.954745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba10e6a5-f840-4507-8351-36ed5b9ff37e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:33.954919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba10e6a5-f840-4507-8351-36ed5b9ff37e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:33.985261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4ff3599b-015b-4167-80f1-1ec8d258a40c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:33.997766 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4ff3599b-015b-4167-80f1-1ec8d258a40c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1331 microversion: 2.1 time: 0.497818 Oct 27 18:47:34.001077 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 341/687] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:33 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1331 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:34.017755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9c30b008-4370-4729-8dec-64cf1f2581e4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:34.018092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ba10e6a5-f840-4507-8351-36ed5b9ff37e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:47:34.024303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9c30b008-4370-4729-8dec-64cf1f2581e4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:34.039968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c30b008-4370-4729-8dec-64cf1f2581e4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:34.040631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c30b008-4370-4729-8dec-64cf1f2581e4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:34.041192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c30b008-4370-4729-8dec-64cf1f2581e4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:34.048050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c30b008-4370-4729-8dec-64cf1f2581e4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:34.049205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c30b008-4370-4729-8dec-64cf1f2581e4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:34.049859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c30b008-4370-4729-8dec-64cf1f2581e4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:34.171142 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ba10e6a5-f840-4507-8351-36ed5b9ff37e tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 204 len: 0 microversion: 2.1 time: 0.249598 Oct 27 18:47:34.172714 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 347/688] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:47:33 2022] DELETE /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:47:34.185842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7e2dd276-bdde-4c04-9092-c4705fa6f8b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:34.187502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7e2dd276-bdde-4c04-9092-c4705fa6f8b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:34.196945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e2dd276-bdde-4c04-9092-c4705fa6f8b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:34.197692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e2dd276-bdde-4c04-9092-c4705fa6f8b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:34.199003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e2dd276-bdde-4c04-9092-c4705fa6f8b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:34.200015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e2dd276-bdde-4c04-9092-c4705fa6f8b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:34.200675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e2dd276-bdde-4c04-9092-c4705fa6f8b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:34.201341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e2dd276-bdde-4c04-9092-c4705fa6f8b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:34.266710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9c30b008-4370-4729-8dec-64cf1f2581e4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:34.277590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9c30b008-4370-4729-8dec-64cf1f2581e4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:34.279413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9c30b008-4370-4729-8dec-64cf1f2581e4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:34.280953 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9c30b008-4370-4729-8dec-64cf1f2581e4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1362 microversion: 2.25 time: 0.277275 Oct 27 18:47:34.292621 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 342/689] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:34 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:34.493100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a233583d-b508-4736-871a-0a2e643c5a6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:34.496577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a233583d-b508-4736-871a-0a2e643c5a6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:34.504940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a233583d-b508-4736-871a-0a2e643c5a6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:34.505667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a233583d-b508-4736-871a-0a2e643c5a6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:34.506293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a233583d-b508-4736-871a-0a2e643c5a6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:34.507191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a233583d-b508-4736-871a-0a2e643c5a6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:34.507802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a233583d-b508-4736-871a-0a2e643c5a6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:34.508519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a233583d-b508-4736-871a-0a2e643c5a6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:34.657859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7e2dd276-bdde-4c04-9092-c4705fa6f8b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:34.669742 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7e2dd276-bdde-4c04-9092-c4705fa6f8b9 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1469 microversion: 2.1 time: 0.488459 Oct 27 18:47:34.669742 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 348/690] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:34 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1469 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:34.681340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5028cda2-0bb6-46aa-b9ff-7ee89dedd790 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:34.682066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5028cda2-0bb6-46aa-b9ff-7ee89dedd790 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:34.697272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5028cda2-0bb6-46aa-b9ff-7ee89dedd790 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:34.697272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5028cda2-0bb6-46aa-b9ff-7ee89dedd790 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:34.697272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5028cda2-0bb6-46aa-b9ff-7ee89dedd790 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:34.697272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5028cda2-0bb6-46aa-b9ff-7ee89dedd790 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:34.697779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5028cda2-0bb6-46aa-b9ff-7ee89dedd790 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:34.697779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5028cda2-0bb6-46aa-b9ff-7ee89dedd790 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:34.706965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a233583d-b508-4736-871a-0a2e643c5a6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:34.724517 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a233583d-b508-4736-871a-0a2e643c5a6b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1317 microversion: 2.1 time: 0.235222 Oct 27 18:47:34.731008 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 343/691] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:34 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:47:34.826224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dcc4df27-6813-4ff3-a9ec-261c17d8b641 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:34.827215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dcc4df27-6813-4ff3-a9ec-261c17d8b641 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:34.837664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcc4df27-6813-4ff3-a9ec-261c17d8b641 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:34.838852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcc4df27-6813-4ff3-a9ec-261c17d8b641 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:34.840262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcc4df27-6813-4ff3-a9ec-261c17d8b641 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:34.842736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcc4df27-6813-4ff3-a9ec-261c17d8b641 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:34.843368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcc4df27-6813-4ff3-a9ec-261c17d8b641 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:34.848447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcc4df27-6813-4ff3-a9ec-261c17d8b641 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:34.966841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-dcc4df27-6813-4ff3-a9ec-261c17d8b641 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:34.970889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5028cda2-0bb6-46aa-b9ff-7ee89dedd790 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:34.982503 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5028cda2-0bb6-46aa-b9ff-7ee89dedd790 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1472 microversion: 2.1 time: 0.313563 Oct 27 18:47:34.983325 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 349/692] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:34 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1472 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:35.003386 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dcc4df27-6813-4ff3-a9ec-261c17d8b641 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.187246 Oct 27 18:47:35.004330 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 344/693] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:34 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:47:35.030076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9745d0e4-db31-4851-9a2b-511db30409a8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:35.030731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9745d0e4-db31-4851-9a2b-511db30409a8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:35.038698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9745d0e4-db31-4851-9a2b-511db30409a8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:35.039192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9745d0e4-db31-4851-9a2b-511db30409a8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:35.039629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9745d0e4-db31-4851-9a2b-511db30409a8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:35.040332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9745d0e4-db31-4851-9a2b-511db30409a8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:35.040784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9745d0e4-db31-4851-9a2b-511db30409a8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:35.041211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9745d0e4-db31-4851-9a2b-511db30409a8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:35.243097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b9a4f570-4b13-46c8-8dfd-5805e6a05176 req-4755a759-f76f-474d-9b37-f615f8f42fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0356d2-73d5-47bb-a499-17b029d1dad1", "tag": "1f181151-81f9-4cf5-a37c-a15ffbe32f2e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:35.258410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b9a4f570-4b13-46c8-8dfd-5805e6a05176 req-4755a759-f76f-474d-9b37-f615f8f42fc6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:35.259150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b9a4f570-4b13-46c8-8dfd-5805e6a05176 req-4755a759-f76f-474d-9b37-f615f8f42fc6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:35.259735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b9a4f570-4b13-46c8-8dfd-5805e6a05176 req-4755a759-f76f-474d-9b37-f615f8f42fc6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:35.273884 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b9a4f570-4b13-46c8-8dfd-5805e6a05176 req-4755a759-f76f-474d-9b37-f615f8f42fc6 service nova] Creating event network-changed:1f181151-81f9-4cf5-a37c-a15ffbe32f2e for instance 7f0356d2-73d5-47bb-a499-17b029d1dad1 on n-h1-860687-3 Oct 27 18:47:35.280335 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b9a4f570-4b13-46c8-8dfd-5805e6a05176 req-4755a759-f76f-474d-9b37-f615f8f42fc6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040872 Oct 27 18:47:35.281029 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 345/694] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:35.297709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9745d0e4-db31-4851-9a2b-511db30409a8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:35.307624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-628940fc-339c-4c72-850e-bcfe4190c2c3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:35.309117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-628940fc-339c-4c72-850e-bcfe4190c2c3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:35.316669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-628940fc-339c-4c72-850e-bcfe4190c2c3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:35.317505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-628940fc-339c-4c72-850e-bcfe4190c2c3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:35.318129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-628940fc-339c-4c72-850e-bcfe4190c2c3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:35.319028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-628940fc-339c-4c72-850e-bcfe4190c2c3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:35.319632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-628940fc-339c-4c72-850e-bcfe4190c2c3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:35.320210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-628940fc-339c-4c72-850e-bcfe4190c2c3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:35.320329 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9745d0e4-db31-4851-9a2b-511db30409a8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1331 microversion: 2.1 time: 0.303081 Oct 27 18:47:35.321750 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 350/695] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:35 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1331 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:35.466092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-628940fc-339c-4c72-850e-bcfe4190c2c3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:35.474833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-628940fc-339c-4c72-850e-bcfe4190c2c3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:35.476215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-628940fc-339c-4c72-850e-bcfe4190c2c3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:35.477361 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-628940fc-339c-4c72-850e-bcfe4190c2c3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1362 microversion: 2.25 time: 0.173996 Oct 27 18:47:35.477937 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 346/696] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:35 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:35.690847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-881b388d-965e-4c88-9002-38730a766184 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:35.691458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-881b388d-965e-4c88-9002-38730a766184 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:35.697413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-881b388d-965e-4c88-9002-38730a766184 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:35.697893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-881b388d-965e-4c88-9002-38730a766184 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:35.698324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-881b388d-965e-4c88-9002-38730a766184 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:35.699086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-881b388d-965e-4c88-9002-38730a766184 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:35.699537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-881b388d-965e-4c88-9002-38730a766184 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:35.699965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-881b388d-965e-4c88-9002-38730a766184 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:35.757328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2a3fcf6f-bbdf-490e-af8a-c8692cae67c7 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:35.758973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2a3fcf6f-bbdf-490e-af8a-c8692cae67c7 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:35.765823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a3fcf6f-bbdf-490e-af8a-c8692cae67c7 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:35.766634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a3fcf6f-bbdf-490e-af8a-c8692cae67c7 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:35.767373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a3fcf6f-bbdf-490e-af8a-c8692cae67c7 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:35.769253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a3fcf6f-bbdf-490e-af8a-c8692cae67c7 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:35.774491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a3fcf6f-bbdf-490e-af8a-c8692cae67c7 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:35.775328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a3fcf6f-bbdf-490e-af8a-c8692cae67c7 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:35.834372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:35.909547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-881b388d-965e-4c88-9002-38730a766184 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:35.920459 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-881b388d-965e-4c88-9002-38730a766184 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1469 microversion: 2.1 time: 0.233434 Oct 27 18:47:35.924932 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 351/697] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:35 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1469 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:35.980687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2a3fcf6f-bbdf-490e-af8a-c8692cae67c7 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:35.989418 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2a3fcf6f-bbdf-490e-af8a-c8692cae67c7 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1317 microversion: 2.1 time: 0.239454 Oct 27 18:47:35.989717 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 347/698] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:35 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:36.008436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-07939117-0739-4ad6-aa18-2afcd2935691 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:36.009546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-07939117-0739-4ad6-aa18-2afcd2935691 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:36.016485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07939117-0739-4ad6-aa18-2afcd2935691 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:36.017207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07939117-0739-4ad6-aa18-2afcd2935691 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:36.017846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07939117-0739-4ad6-aa18-2afcd2935691 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:36.018593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07939117-0739-4ad6-aa18-2afcd2935691 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:36.019359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07939117-0739-4ad6-aa18-2afcd2935691 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:36.019951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07939117-0739-4ad6-aa18-2afcd2935691 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:36.032238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ab798e66-643f-459b-b4d2-587231e68615 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:36.032856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ab798e66-643f-459b-b4d2-587231e68615 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:36.039182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab798e66-643f-459b-b4d2-587231e68615 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:36.049189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab798e66-643f-459b-b4d2-587231e68615 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:36.049894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab798e66-643f-459b-b4d2-587231e68615 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:36.050694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab798e66-643f-459b-b4d2-587231e68615 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:36.051158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab798e66-643f-459b-b4d2-587231e68615 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:36.051597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab798e66-643f-459b-b4d2-587231e68615 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:36.151093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-ab798e66-643f-459b-b4d2-587231e68615 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:36.170256 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ab798e66-643f-459b-b4d2-587231e68615 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.141618 Oct 27 18:47:36.186753 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 348/699] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:36 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:47:36.214850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-07939117-0739-4ad6-aa18-2afcd2935691 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:36.223299 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-07939117-0739-4ad6-aa18-2afcd2935691 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1472 microversion: 2.1 time: 0.219027 Oct 27 18:47:36.224201 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 352/700] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:36 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1472 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:36.349691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-82aa74de-b153-44a2-879d-4a773ea9b2b8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:36.350747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-82aa74de-b153-44a2-879d-4a773ea9b2b8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:36.360870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82aa74de-b153-44a2-879d-4a773ea9b2b8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:36.361652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82aa74de-b153-44a2-879d-4a773ea9b2b8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:36.362271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82aa74de-b153-44a2-879d-4a773ea9b2b8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:36.363211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82aa74de-b153-44a2-879d-4a773ea9b2b8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:36.363681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82aa74de-b153-44a2-879d-4a773ea9b2b8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:36.364120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82aa74de-b153-44a2-879d-4a773ea9b2b8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:36.513784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-893b311c-c898-4720-ab5b-e9e949204b2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:36.515446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-893b311c-c898-4720-ab5b-e9e949204b2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:36.530522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-893b311c-c898-4720-ab5b-e9e949204b2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:36.531726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-893b311c-c898-4720-ab5b-e9e949204b2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:36.532387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-893b311c-c898-4720-ab5b-e9e949204b2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:36.533955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-893b311c-c898-4720-ab5b-e9e949204b2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:36.534825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-893b311c-c898-4720-ab5b-e9e949204b2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:36.535525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-893b311c-c898-4720-ab5b-e9e949204b2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:36.663323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-82aa74de-b153-44a2-879d-4a773ea9b2b8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:36.681685 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-82aa74de-b153-44a2-879d-4a773ea9b2b8 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1331 microversion: 2.1 time: 0.337332 Oct 27 18:47:36.686811 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 349/701] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:36 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1331 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:36.748879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-893b311c-c898-4720-ab5b-e9e949204b2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:36.757635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-893b311c-c898-4720-ab5b-e9e949204b2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:36.759150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-893b311c-c898-4720-ab5b-e9e949204b2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:36.760377 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-893b311c-c898-4720-ab5b-e9e949204b2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1362 microversion: 2.25 time: 0.255833 Oct 27 18:47:36.761241 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 353/702] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:36 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:36.946786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0bece3c6-12e4-4912-9fa2-7bf14e5043ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:36.947998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0bece3c6-12e4-4912-9fa2-7bf14e5043ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:36.958682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:36.962624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bece3c6-12e4-4912-9fa2-7bf14e5043ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:36.963434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bece3c6-12e4-4912-9fa2-7bf14e5043ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:36.964769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bece3c6-12e4-4912-9fa2-7bf14e5043ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:36.966770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bece3c6-12e4-4912-9fa2-7bf14e5043ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:36.967529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bece3c6-12e4-4912-9fa2-7bf14e5043ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:36.968136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bece3c6-12e4-4912-9fa2-7bf14e5043ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:37.015415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b6e7ff36-d5b5-4f75-addb-74954d57e9bd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:37.016290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b6e7ff36-d5b5-4f75-addb-74954d57e9bd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:37.024384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6e7ff36-d5b5-4f75-addb-74954d57e9bd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:37.033664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6e7ff36-d5b5-4f75-addb-74954d57e9bd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:37.036187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6e7ff36-d5b5-4f75-addb-74954d57e9bd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:37.037973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6e7ff36-d5b5-4f75-addb-74954d57e9bd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:37.040383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6e7ff36-d5b5-4f75-addb-74954d57e9bd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:37.043287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6e7ff36-d5b5-4f75-addb-74954d57e9bd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:37.253714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:37.797269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b6e7ff36-d5b5-4f75-addb-74954d57e9bd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:37.813183 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b6e7ff36-d5b5-4f75-addb-74954d57e9bd tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1317 microversion: 2.1 time: 0.800336 Oct 27 18:47:37.828735 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 354/703] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:37 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1317 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:37.828735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2af9cdc6-e67c-48a7-8511-41e7d2c5cd62 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:37.829079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2af9cdc6-e67c-48a7-8511-41e7d2c5cd62 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:37.835400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2af9cdc6-e67c-48a7-8511-41e7d2c5cd62 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:37.835898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2af9cdc6-e67c-48a7-8511-41e7d2c5cd62 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:37.836346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2af9cdc6-e67c-48a7-8511-41e7d2c5cd62 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:37.837069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2af9cdc6-e67c-48a7-8511-41e7d2c5cd62 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:37.837536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2af9cdc6-e67c-48a7-8511-41e7d2c5cd62 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:37.837971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2af9cdc6-e67c-48a7-8511-41e7d2c5cd62 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:38.068752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0bece3c6-12e4-4912-9fa2-7bf14e5043ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:38.078091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-2af9cdc6-e67c-48a7-8511-41e7d2c5cd62 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:38.083591 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0bece3c6-12e4-4912-9fa2-7bf14e5043ae tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1469 microversion: 2.1 time: 1.142629 Oct 27 18:47:38.084311 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 350/704] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:36 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1469 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:38.093951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ded7f238-ccdd-4e60-8461-39618c3345a9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:38.096547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ded7f238-ccdd-4e60-8461-39618c3345a9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:38.107894 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2af9cdc6-e67c-48a7-8511-41e7d2c5cd62 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.283143 Oct 27 18:47:38.108827 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 355/705] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:37 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:38.113727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3610108c-9a91-440e-81f0-4028f06869b9 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:38.114854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3610108c-9a91-440e-81f0-4028f06869b9 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:38.123648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3610108c-9a91-440e-81f0-4028f06869b9 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:38.124446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3610108c-9a91-440e-81f0-4028f06869b9 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:38.126449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3610108c-9a91-440e-81f0-4028f06869b9 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:38.127813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3610108c-9a91-440e-81f0-4028f06869b9 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:38.128535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3610108c-9a91-440e-81f0-4028f06869b9 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:38.129190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3610108c-9a91-440e-81f0-4028f06869b9 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:38.156978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded7f238-ccdd-4e60-8461-39618c3345a9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:38.157511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded7f238-ccdd-4e60-8461-39618c3345a9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:38.157974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded7f238-ccdd-4e60-8461-39618c3345a9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:38.158764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded7f238-ccdd-4e60-8461-39618c3345a9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:38.167032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded7f238-ccdd-4e60-8461-39618c3345a9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:38.167817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded7f238-ccdd-4e60-8461-39618c3345a9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:38.362791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ded7f238-ccdd-4e60-8461-39618c3345a9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:38.372911 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ded7f238-ccdd-4e60-8461-39618c3345a9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1469 microversion: 2.1 time: 0.286000 Oct 27 18:47:38.375924 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 351/706] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:38 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1469 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:38.385122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7e9f20e8-da6e-4bcc-a6a2-fe5c0214d8bc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:38.385834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7e9f20e8-da6e-4bcc-a6a2-fe5c0214d8bc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:38.391935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e9f20e8-da6e-4bcc-a6a2-fe5c0214d8bc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:38.392699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e9f20e8-da6e-4bcc-a6a2-fe5c0214d8bc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:38.393369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e9f20e8-da6e-4bcc-a6a2-fe5c0214d8bc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:38.394325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e9f20e8-da6e-4bcc-a6a2-fe5c0214d8bc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:38.395030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e9f20e8-da6e-4bcc-a6a2-fe5c0214d8bc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:38.395677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e9f20e8-da6e-4bcc-a6a2-fe5c0214d8bc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:38.436549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:38.553745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=14 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:38.560863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7e9f20e8-da6e-4bcc-a6a2-fe5c0214d8bc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:38.576532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7e9f20e8-da6e-4bcc-a6a2-fe5c0214d8bc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:38.578804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7e9f20e8-da6e-4bcc-a6a2-fe5c0214d8bc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:38.580105 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7e9f20e8-da6e-4bcc-a6a2-fe5c0214d8bc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1362 microversion: 2.25 time: 0.202841 Oct 27 18:47:38.593311 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 352/707] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:38 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:38.598135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f25625ed-77bb-4559-be72-18eb761162f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:38.598957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f25625ed-77bb-4559-be72-18eb761162f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:38.608050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f25625ed-77bb-4559-be72-18eb761162f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:38.608771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f25625ed-77bb-4559-be72-18eb761162f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:38.609336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f25625ed-77bb-4559-be72-18eb761162f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:38.610134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f25625ed-77bb-4559-be72-18eb761162f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:38.610738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f25625ed-77bb-4559-be72-18eb761162f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:38.611263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f25625ed-77bb-4559-be72-18eb761162f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:38.759588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3610108c-9a91-440e-81f0-4028f06869b9 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:38.771587 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3610108c-9a91-440e-81f0-4028f06869b9 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1331 microversion: 2.1 time: 0.661486 Oct 27 18:47:38.772185 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 356/708] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:38 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1331 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:38.798201 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f25625ed-77bb-4559-be72-18eb761162f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "POST /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789/action" status: 204 len: 0 microversion: 2.1 time: 0.215812 Oct 27 18:47:38.799066 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 353/709] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:47:38 2022] POST /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789/action => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:47:38.817643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a028c91c-e46a-4100-85ed-6ca4286b12fa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:38.820035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a028c91c-e46a-4100-85ed-6ca4286b12fa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:38.834598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70a1adb5-e5c0-448c-9fb7-8fa65262d7ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:38.835408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-70a1adb5-e5c0-448c-9fb7-8fa65262d7ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:38.846698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a028c91c-e46a-4100-85ed-6ca4286b12fa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:38.850658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a028c91c-e46a-4100-85ed-6ca4286b12fa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:38.853895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a028c91c-e46a-4100-85ed-6ca4286b12fa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:38.859839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a028c91c-e46a-4100-85ed-6ca4286b12fa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:38.861295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a028c91c-e46a-4100-85ed-6ca4286b12fa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:38.863185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a028c91c-e46a-4100-85ed-6ca4286b12fa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:38.864522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70a1adb5-e5c0-448c-9fb7-8fa65262d7ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:38.865024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70a1adb5-e5c0-448c-9fb7-8fa65262d7ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:38.865476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70a1adb5-e5c0-448c-9fb7-8fa65262d7ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:38.876305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70a1adb5-e5c0-448c-9fb7-8fa65262d7ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:38.876988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70a1adb5-e5c0-448c-9fb7-8fa65262d7ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:38.877460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70a1adb5-e5c0-448c-9fb7-8fa65262d7ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:38.980075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a028c91c-e46a-4100-85ed-6ca4286b12fa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:47:39.056084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:39.151174 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a028c91c-e46a-4100-85ed-6ca4286b12fa tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 204 len: 0 microversion: 2.1 time: 0.358418 Oct 27 18:47:39.157852 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 357/710] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:47:38 2022] DELETE /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:47:39.163565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5c769aba-5a13-4580-a913-fb71adffc0ae tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:39.164411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5c769aba-5a13-4580-a913-fb71adffc0ae tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:39.186185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c769aba-5a13-4580-a913-fb71adffc0ae tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:39.188052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c769aba-5a13-4580-a913-fb71adffc0ae tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:39.189410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c769aba-5a13-4580-a913-fb71adffc0ae tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:39.193117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c769aba-5a13-4580-a913-fb71adffc0ae tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:39.193890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c769aba-5a13-4580-a913-fb71adffc0ae tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:39.194457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c769aba-5a13-4580-a913-fb71adffc0ae tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:39.220942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-70a1adb5-e5c0-448c-9fb7-8fa65262d7ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:39.238197 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70a1adb5-e5c0-448c-9fb7-8fa65262d7ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1469 microversion: 2.1 time: 0.430127 Oct 27 18:47:39.239207 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 354/711] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:38 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1469 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:39.252637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b44e6310-4106-461c-a20e-9a877deef1b6 req-bcd81df1-7b66-4dfd-875a-26ce6c953ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43e1759-0ffb-423c-8d31-569d5ce79268", "name": "network-vif-deleted", "tag": "a4a765b2-af26-4b76-a70c-74d7dc9d17af"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:39.287570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b44e6310-4106-461c-a20e-9a877deef1b6 req-bcd81df1-7b66-4dfd-875a-26ce6c953ddf service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:39.288053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b44e6310-4106-461c-a20e-9a877deef1b6 req-bcd81df1-7b66-4dfd-875a-26ce6c953ddf service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:39.288493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b44e6310-4106-461c-a20e-9a877deef1b6 req-bcd81df1-7b66-4dfd-875a-26ce6c953ddf service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:39.321272 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b44e6310-4106-461c-a20e-9a877deef1b6 req-bcd81df1-7b66-4dfd-875a-26ce6c953ddf service nova] Creating event network-vif-deleted:a4a765b2-af26-4b76-a70c-74d7dc9d17af for instance a43e1759-0ffb-423c-8d31-569d5ce79268 on n-h2-860687-3 Oct 27 18:47:39.340415 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b44e6310-4106-461c-a20e-9a877deef1b6 req-bcd81df1-7b66-4dfd-875a-26ce6c953ddf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098601 Oct 27 18:47:39.341280 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 355/712] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:39.350617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-18922963-7210-45b3-b731-3c2db44f3478 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:39.351225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-18922963-7210-45b3-b731-3c2db44f3478 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:39.368823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18922963-7210-45b3-b731-3c2db44f3478 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:39.369732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18922963-7210-45b3-b731-3c2db44f3478 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:39.370667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18922963-7210-45b3-b731-3c2db44f3478 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:39.371628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18922963-7210-45b3-b731-3c2db44f3478 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:39.372450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18922963-7210-45b3-b731-3c2db44f3478 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:39.373129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18922963-7210-45b3-b731-3c2db44f3478 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:39.427346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18922963-7210-45b3-b731-3c2db44f3478 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:39.428067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18922963-7210-45b3-b731-3c2db44f3478 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:39.428676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18922963-7210-45b3-b731-3c2db44f3478 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:39.429323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-18922963-7210-45b3-b731-3c2db44f3478 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lazy-loading 'fault' on Instance uuid a43e1759-0ffb-423c-8d31-569d5ce79268 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:39.492206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-18922963-7210-45b3-b731-3c2db44f3478 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0b4798f17b408dab3af2ae0d2a45b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee37570c43c8438faad6c2bcdbacce99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:39.503368 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-18922963-7210-45b3-b731-3c2db44f3478 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 200 len: 1303 microversion: 2.1 time: 0.160454 Oct 27 18:47:39.504274 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 356/713] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:39 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 1303 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:39.523539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-81c01c71-0126-4f44-8aaf-a127ddb419f9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:39.524136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-81c01c71-0126-4f44-8aaf-a127ddb419f9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:39.533782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81c01c71-0126-4f44-8aaf-a127ddb419f9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:39.534907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81c01c71-0126-4f44-8aaf-a127ddb419f9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:39.535380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81c01c71-0126-4f44-8aaf-a127ddb419f9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:39.536119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81c01c71-0126-4f44-8aaf-a127ddb419f9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:39.536593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81c01c71-0126-4f44-8aaf-a127ddb419f9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:39.537121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81c01c71-0126-4f44-8aaf-a127ddb419f9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:39.571718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5c769aba-5a13-4580-a913-fb71adffc0ae tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:39.587509 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5c769aba-5a13-4580-a913-fb71adffc0ae tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1317 microversion: 2.1 time: 0.428476 Oct 27 18:47:39.588329 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 358/714] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:39 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:39.593300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ad9b1101-0f8d-477d-a2c4-cb46d3fc9896 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:39.594309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ad9b1101-0f8d-477d-a2c4-cb46d3fc9896 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:39.601968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad9b1101-0f8d-477d-a2c4-cb46d3fc9896 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:39.602887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad9b1101-0f8d-477d-a2c4-cb46d3fc9896 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:39.603609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad9b1101-0f8d-477d-a2c4-cb46d3fc9896 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:39.604565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad9b1101-0f8d-477d-a2c4-cb46d3fc9896 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:39.605840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad9b1101-0f8d-477d-a2c4-cb46d3fc9896 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:39.606693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad9b1101-0f8d-477d-a2c4-cb46d3fc9896 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:39.638218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-81c01c71-0126-4f44-8aaf-a127ddb419f9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:39.671215 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-81c01c71-0126-4f44-8aaf-a127ddb419f9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.165859 Oct 27 18:47:39.681696 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 357/715] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:39 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:39.681989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b25e1160-ffc9-4217-b42d-b52ba6d0d1de tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:39.685462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b25e1160-ffc9-4217-b42d-b52ba6d0d1de tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:39.696092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b25e1160-ffc9-4217-b42d-b52ba6d0d1de tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:39.696092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b25e1160-ffc9-4217-b42d-b52ba6d0d1de tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:39.696092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b25e1160-ffc9-4217-b42d-b52ba6d0d1de tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:39.696092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b25e1160-ffc9-4217-b42d-b52ba6d0d1de tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:39.696480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b25e1160-ffc9-4217-b42d-b52ba6d0d1de tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:39.696480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b25e1160-ffc9-4217-b42d-b52ba6d0d1de tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:39.920677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b25e1160-ffc9-4217-b42d-b52ba6d0d1de tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:39.931859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b25e1160-ffc9-4217-b42d-b52ba6d0d1de tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:39.934834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b25e1160-ffc9-4217-b42d-b52ba6d0d1de tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:39.936308 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b25e1160-ffc9-4217-b42d-b52ba6d0d1de tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1362 microversion: 2.25 time: 0.262970 Oct 27 18:47:39.953200 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 358/716] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:39 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:39.966681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ad9b1101-0f8d-477d-a2c4-cb46d3fc9896 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:39.968682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28eacb33-e0c7-4033-9d4e-c51213599e49 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:39.971033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-28eacb33-e0c7-4033-9d4e-c51213599e49 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:39.980020 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ad9b1101-0f8d-477d-a2c4-cb46d3fc9896 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1712 microversion: 2.1 time: 0.390193 Oct 27 18:47:39.981774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28eacb33-e0c7-4033-9d4e-c51213599e49 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:39.983094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28eacb33-e0c7-4033-9d4e-c51213599e49 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:39.983809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28eacb33-e0c7-4033-9d4e-c51213599e49 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:39.985595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28eacb33-e0c7-4033-9d4e-c51213599e49 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:39.986751 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 359/717] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:39 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1712 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:39.987428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28eacb33-e0c7-4033-9d4e-c51213599e49 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:39.988074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28eacb33-e0c7-4033-9d4e-c51213599e49 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:40.015397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6d3585ac-d8af-4dba-b9fe-f1622fdbf78f req-d4f55a22-a8d1-43dd-833f-f5e2289b0857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a645e2-ba92-42c7-8a35-8aea0ee2f9b9", "name": "network-vif-plugged", "status": "completed", "tag": "2cf40f9d-6d09-4726-8ad1-d50203aea23c"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:40.040884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6d3585ac-d8af-4dba-b9fe-f1622fdbf78f req-d4f55a22-a8d1-43dd-833f-f5e2289b0857 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:40.041621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6d3585ac-d8af-4dba-b9fe-f1622fdbf78f req-d4f55a22-a8d1-43dd-833f-f5e2289b0857 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:40.042873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6d3585ac-d8af-4dba-b9fe-f1622fdbf78f req-d4f55a22-a8d1-43dd-833f-f5e2289b0857 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:40.065075 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6d3585ac-d8af-4dba-b9fe-f1622fdbf78f req-d4f55a22-a8d1-43dd-833f-f5e2289b0857 service nova] Creating event network-vif-plugged:2cf40f9d-6d09-4726-8ad1-d50203aea23c for instance 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 on n-h2-860687-3 Oct 27 18:47:40.074531 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6d3585ac-d8af-4dba-b9fe-f1622fdbf78f req-d4f55a22-a8d1-43dd-833f-f5e2289b0857 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060420 Oct 27 18:47:40.075790 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 360/718] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:47:40.264133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae89e6d7-4537-42ea-a051-cc84a440cdaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:40.264757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ae89e6d7-4537-42ea-a051-cc84a440cdaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:40.282140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae89e6d7-4537-42ea-a051-cc84a440cdaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:40.282912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae89e6d7-4537-42ea-a051-cc84a440cdaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:40.283516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae89e6d7-4537-42ea-a051-cc84a440cdaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:40.284391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae89e6d7-4537-42ea-a051-cc84a440cdaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:40.285006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae89e6d7-4537-42ea-a051-cc84a440cdaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:40.285587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae89e6d7-4537-42ea-a051-cc84a440cdaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:40.296151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-28eacb33-e0c7-4033-9d4e-c51213599e49 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:40.312220 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-28eacb33-e0c7-4033-9d4e-c51213599e49 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1331 microversion: 2.1 time: 0.357500 Oct 27 18:47:40.318716 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 359/719] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:39 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1331 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:40.531337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-09bc0c49-599c-4ed8-8a75-c9fd32a5d5c2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:40.532851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-09bc0c49-599c-4ed8-8a75-c9fd32a5d5c2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] [instance: a43e1759-0ffb-423c-8d31-569d5ce79268] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:40.540104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09bc0c49-599c-4ed8-8a75-c9fd32a5d5c2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:40.554737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09bc0c49-599c-4ed8-8a75-c9fd32a5d5c2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:40.556469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09bc0c49-599c-4ed8-8a75-c9fd32a5d5c2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:40.559295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09bc0c49-599c-4ed8-8a75-c9fd32a5d5c2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:40.560021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09bc0c49-599c-4ed8-8a75-c9fd32a5d5c2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:40.560461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09bc0c49-599c-4ed8-8a75-c9fd32a5d5c2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:40.576321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ae89e6d7-4537-42ea-a051-cc84a440cdaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:40.587193 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ae89e6d7-4537-42ea-a051-cc84a440cdaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1469 microversion: 2.1 time: 0.328399 Oct 27 18:47:40.588431 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 361/720] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:40 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1469 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:40.590467 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-09bc0c49-599c-4ed8-8a75-c9fd32a5d5c2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] HTTP exception thrown: Instance a43e1759-0ffb-423c-8d31-569d5ce79268 could not be found. Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-09bc0c49-599c-4ed8-8a75-c9fd32a5d5c2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Request method failure captured: Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 HTTP/1.1 Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtGqj4Q3CqbNtbO6a3h2IYdqx5brrQEUa7eNGvDNlL48Uo0ev_JfYCGapuuE9Tkeo_PN12UQQFj7C30wkVWzztl1WDh6ZbDtMtdLsfK0JbG8fXl1x_MjeCLBNU80b2W7in92HNh1Y614LjwcLsKQ1lxLRFwKpRCntcAzAp7s0B9bkFc Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: ee37570c43c8438faad6c2bcdbacce99 Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersAdminTestJSON-983467884 Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:47:40.592175 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:47:40.593412 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ee37570c43c8438faad6c2bcdbacce99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ee37570c43c8438faad6c2bcdbacce99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ee37570c43c8438faad6c2bcdbacce99", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ee37570c43c8438faad6c2bcdbacce99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:40.593412 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersAdminTestJSON-983467884 Oct 27 18:47:40.593412 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: ee37570c43c8438faad6c2bcdbacce99 Oct 27 18:47:40.593412 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersAdminTestJSON-983467884 Oct 27 18:47:40.593412 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersAdminTestJSON-983467884-project Oct 27 18:47:40.593412 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:47:40.593412 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:47:40.593412 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 6a0b4798f17b408dab3af2ae0d2a45b7 Oct 27 18:47:40.593412 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersAdminTestJSON-983467884-project Oct 27 18:47:40.593412 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:47:40.593412 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance a43e1759-0ffb-423c-8d31-569d5ce79268 could not be found. Oct 27 18:47:40.593412 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a43e1759-0ffb-423c-8d31-569d5ce79268'} Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a43e1759-0ffb-423c-8d31-569d5ce79268 could not be found. Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:40.594095 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a43e1759-0ffb-423c-8d31-569d5ce79268 could not be found. Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a43e1759-0ffb-423c-8d31-569d5ce79268 could not be found. Oct 27 18:47:40.595605 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:40.596961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-09bc0c49-599c-4ed8-8a75-c9fd32a5d5c2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] Returning 404 to user: Instance a43e1759-0ffb-423c-8d31-569d5ce79268 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:40.596961 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-09bc0c49-599c-4ed8-8a75-c9fd32a5d5c2 tempest-ServersAdminTestJSON-983467884 tempest-ServersAdminTestJSON-983467884-project] 10.222.0.42 "GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268" status: 404 len: 111 microversion: 2.1 time: 0.067310 Oct 27 18:47:40.596961 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 360/721] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:40 2022] GET /compute/v2.1/servers/a43e1759-0ffb-423c-8d31-569d5ce79268 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:47:40.615573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c671a8be-aeff-477b-ae53-54d0264617d9 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:40.616596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c671a8be-aeff-477b-ae53-54d0264617d9 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:40.624718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c671a8be-aeff-477b-ae53-54d0264617d9 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:40.625549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c671a8be-aeff-477b-ae53-54d0264617d9 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:40.625992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c671a8be-aeff-477b-ae53-54d0264617d9 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:40.626734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c671a8be-aeff-477b-ae53-54d0264617d9 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:40.627198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c671a8be-aeff-477b-ae53-54d0264617d9 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:40.627630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c671a8be-aeff-477b-ae53-54d0264617d9 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:40.713306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-61e1c0d7-a586-4488-8596-e4ab4b180423 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:40.716670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-61e1c0d7-a586-4488-8596-e4ab4b180423 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:40.730439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61e1c0d7-a586-4488-8596-e4ab4b180423 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:40.731430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61e1c0d7-a586-4488-8596-e4ab4b180423 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:40.732094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61e1c0d7-a586-4488-8596-e4ab4b180423 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:40.733562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61e1c0d7-a586-4488-8596-e4ab4b180423 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:40.734248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61e1c0d7-a586-4488-8596-e4ab4b180423 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:40.736237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61e1c0d7-a586-4488-8596-e4ab4b180423 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:40.905945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c671a8be-aeff-477b-ae53-54d0264617d9 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:40.911399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-61e1c0d7-a586-4488-8596-e4ab4b180423 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:40.916468 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c671a8be-aeff-477b-ae53-54d0264617d9 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1317 microversion: 2.1 time: 0.306855 Oct 27 18:47:40.918019 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 362/722] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:40 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:40.933983 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-61e1c0d7-a586-4488-8596-e4ab4b180423 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.225389 Oct 27 18:47:40.938431 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 361/723] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:40 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:40.961774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bc996434-f4e5-48a1-b614-8f50a962889d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:40.962983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bc996434-f4e5-48a1-b614-8f50a962889d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:40.971514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc996434-f4e5-48a1-b614-8f50a962889d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:40.973270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc996434-f4e5-48a1-b614-8f50a962889d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:40.973959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc996434-f4e5-48a1-b614-8f50a962889d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:40.974959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc996434-f4e5-48a1-b614-8f50a962889d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:40.975617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc996434-f4e5-48a1-b614-8f50a962889d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:40.976292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc996434-f4e5-48a1-b614-8f50a962889d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:41.017250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d0cfa661-f78d-42ab-8201-95b87c4a7177 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:41.018701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d0cfa661-f78d-42ab-8201-95b87c4a7177 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:41.025334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0cfa661-f78d-42ab-8201-95b87c4a7177 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:41.025829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0cfa661-f78d-42ab-8201-95b87c4a7177 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:41.026271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0cfa661-f78d-42ab-8201-95b87c4a7177 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:41.028374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0cfa661-f78d-42ab-8201-95b87c4a7177 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:41.028830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0cfa661-f78d-42ab-8201-95b87c4a7177 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:41.029265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0cfa661-f78d-42ab-8201-95b87c4a7177 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:41.152222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bc996434-f4e5-48a1-b614-8f50a962889d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:41.162026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bc996434-f4e5-48a1-b614-8f50a962889d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:41.164000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bc996434-f4e5-48a1-b614-8f50a962889d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:41.166249 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bc996434-f4e5-48a1-b614-8f50a962889d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1362 microversion: 2.25 time: 0.208396 Oct 27 18:47:41.167046 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 363/724] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:40 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:41.249456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d0cfa661-f78d-42ab-8201-95b87c4a7177 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:41.259439 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d0cfa661-f78d-42ab-8201-95b87c4a7177 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1712 microversion: 2.1 time: 0.248360 Oct 27 18:47:41.260521 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 362/725] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:41 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1712 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:41.342251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d1402e73-ec02-4186-bb12-34d013fbf1fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:41.343204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d1402e73-ec02-4186-bb12-34d013fbf1fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:41.350750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1402e73-ec02-4186-bb12-34d013fbf1fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:41.352175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1402e73-ec02-4186-bb12-34d013fbf1fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:41.352729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1402e73-ec02-4186-bb12-34d013fbf1fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:41.353569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1402e73-ec02-4186-bb12-34d013fbf1fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:41.354118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1402e73-ec02-4186-bb12-34d013fbf1fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:41.355378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1402e73-ec02-4186-bb12-34d013fbf1fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:41.621424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-74b4548e-6471-4dab-91ca-6ac7d0d54e5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:41.622055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-74b4548e-6471-4dab-91ca-6ac7d0d54e5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:41.632511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74b4548e-6471-4dab-91ca-6ac7d0d54e5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:41.633014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74b4548e-6471-4dab-91ca-6ac7d0d54e5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:41.633457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74b4548e-6471-4dab-91ca-6ac7d0d54e5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:41.634175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74b4548e-6471-4dab-91ca-6ac7d0d54e5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:41.634662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74b4548e-6471-4dab-91ca-6ac7d0d54e5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:41.640058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74b4548e-6471-4dab-91ca-6ac7d0d54e5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:41.644304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:41.773844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d1402e73-ec02-4186-bb12-34d013fbf1fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:41.785123 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d1402e73-ec02-4186-bb12-34d013fbf1fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1331 microversion: 2.1 time: 0.447798 Oct 27 18:47:41.785718 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 364/726] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:41 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1331 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:41.944323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-60936fb4-bb1e-4806-a5cc-1a60eabbfb24 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:41.944985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-60936fb4-bb1e-4806-a5cc-1a60eabbfb24 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:41.956876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60936fb4-bb1e-4806-a5cc-1a60eabbfb24 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:41.958969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60936fb4-bb1e-4806-a5cc-1a60eabbfb24 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:41.959819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60936fb4-bb1e-4806-a5cc-1a60eabbfb24 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:41.963548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60936fb4-bb1e-4806-a5cc-1a60eabbfb24 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:41.964842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60936fb4-bb1e-4806-a5cc-1a60eabbfb24 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:41.965848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60936fb4-bb1e-4806-a5cc-1a60eabbfb24 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:41.975315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-74b4548e-6471-4dab-91ca-6ac7d0d54e5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:41.989908 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-74b4548e-6471-4dab-91ca-6ac7d0d54e5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1469 microversion: 2.1 time: 0.373769 Oct 27 18:47:41.990842 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 363/727] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:41 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:42.009221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2a7d23cf-7485-42e6-9ab6-78b18e01abd9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:42.009844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2a7d23cf-7485-42e6-9ab6-78b18e01abd9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:42.023457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a7d23cf-7485-42e6-9ab6-78b18e01abd9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:42.023967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a7d23cf-7485-42e6-9ab6-78b18e01abd9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:42.024405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a7d23cf-7485-42e6-9ab6-78b18e01abd9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:42.025242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a7d23cf-7485-42e6-9ab6-78b18e01abd9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:42.025769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a7d23cf-7485-42e6-9ab6-78b18e01abd9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:42.028719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a7d23cf-7485-42e6-9ab6-78b18e01abd9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:42.164386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-2a7d23cf-7485-42e6-9ab6-78b18e01abd9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:42.201547 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2a7d23cf-7485-42e6-9ab6-78b18e01abd9 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.209600 Oct 27 18:47:42.202480 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 364/728] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:41 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:42.208224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-a20196d3-3e9e-4281-8ad3-f5b3f8f0d9e4 req-e6d10cec-543e-40d6-87be-c265f70aeb60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901fd413-2d42-4014-86c1-5fe80598f789", "name": "network-vif-plugged", "status": "completed", "tag": "11fc4a40-18f3-4dcf-b5eb-6e544bd414ef"}, {"server_uuid": "293448e8-0911-4074-a5d0-d9ff98094843", "name": "network-vif-plugged", "status": "completed", "tag": "e5835307-83a9-4b59-8ccd-63bd95493e8c"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:42.222032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a20196d3-3e9e-4281-8ad3-f5b3f8f0d9e4 req-e6d10cec-543e-40d6-87be-c265f70aeb60 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:42.222790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a20196d3-3e9e-4281-8ad3-f5b3f8f0d9e4 req-e6d10cec-543e-40d6-87be-c265f70aeb60 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:42.223369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a20196d3-3e9e-4281-8ad3-f5b3f8f0d9e4 req-e6d10cec-543e-40d6-87be-c265f70aeb60 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:42.239832 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a20196d3-3e9e-4281-8ad3-f5b3f8f0d9e4 req-e6d10cec-543e-40d6-87be-c265f70aeb60 service nova] Creating event network-vif-plugged:11fc4a40-18f3-4dcf-b5eb-6e544bd414ef for instance 901fd413-2d42-4014-86c1-5fe80598f789 on n-h1-860687-3 Oct 27 18:47:42.240909 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a20196d3-3e9e-4281-8ad3-f5b3f8f0d9e4 req-e6d10cec-543e-40d6-87be-c265f70aeb60 service nova] Creating event network-vif-plugged:e5835307-83a9-4b59-8ccd-63bd95493e8c for instance 293448e8-0911-4074-a5d0-d9ff98094843 on n-h1-860687-3 Oct 27 18:47:42.248362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-a20196d3-3e9e-4281-8ad3-f5b3f8f0d9e4 req-e6d10cec-543e-40d6-87be-c265f70aeb60 service nova] Instance 901fd413-2d42-4014-86c1-5fe80598f789 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:47:42.264416 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-a20196d3-3e9e-4281-8ad3-f5b3f8f0d9e4 req-e6d10cec-543e-40d6-87be-c265f70aeb60 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059859 Oct 27 18:47:42.270626 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 365/729] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:42.279263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1b939943-c4ef-462b-ab3c-ba070213930d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:42.280225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1b939943-c4ef-462b-ab3c-ba070213930d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:42.287975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b939943-c4ef-462b-ab3c-ba070213930d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:42.289058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b939943-c4ef-462b-ab3c-ba070213930d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:42.289793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b939943-c4ef-462b-ab3c-ba070213930d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:42.291538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b939943-c4ef-462b-ab3c-ba070213930d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:42.292562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b939943-c4ef-462b-ab3c-ba070213930d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:42.293174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b939943-c4ef-462b-ab3c-ba070213930d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:42.298882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-60936fb4-bb1e-4806-a5cc-1a60eabbfb24 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:42.313986 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-60936fb4-bb1e-4806-a5cc-1a60eabbfb24 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1466 microversion: 2.1 time: 0.371637 Oct 27 18:47:42.315223 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 365/730] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:41 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1466 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:42.325905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3e84c298-4826-433b-95f4-6252368c8788 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:42.327914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3e84c298-4826-433b-95f4-6252368c8788 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:42.348635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e84c298-4826-433b-95f4-6252368c8788 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:42.349465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e84c298-4826-433b-95f4-6252368c8788 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:42.350142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e84c298-4826-433b-95f4-6252368c8788 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:42.351114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e84c298-4826-433b-95f4-6252368c8788 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:42.351784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e84c298-4826-433b-95f4-6252368c8788 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:42.352422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e84c298-4826-433b-95f4-6252368c8788 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:42.636651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1b939943-c4ef-462b-ab3c-ba070213930d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:42.646853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1b939943-c4ef-462b-ab3c-ba070213930d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:42.649455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1b939943-c4ef-462b-ab3c-ba070213930d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:42.657161 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1b939943-c4ef-462b-ab3c-ba070213930d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1362 microversion: 2.25 time: 0.383868 Oct 27 18:47:42.658634 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 366/731] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:42 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:42.669569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2578d5a7-012f-4946-ad27-ae56ef5716c1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1348204663", "metadata": {"image_type": "test"}}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:42.672717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2578d5a7-012f-4946-ad27-ae56ef5716c1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:42.687900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3e84c298-4826-433b-95f4-6252368c8788 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:42.691246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2578d5a7-012f-4946-ad27-ae56ef5716c1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:42.692682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2578d5a7-012f-4946-ad27-ae56ef5716c1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:42.693271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2578d5a7-012f-4946-ad27-ae56ef5716c1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:42.696064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2578d5a7-012f-4946-ad27-ae56ef5716c1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:42.696922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2578d5a7-012f-4946-ad27-ae56ef5716c1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:42.698848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2578d5a7-012f-4946-ad27-ae56ef5716c1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:42.700177 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3e84c298-4826-433b-95f4-6252368c8788 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1712 microversion: 2.1 time: 0.381305 Oct 27 18:47:42.701011 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 366/732] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:42 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1712 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:42.750980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-2578d5a7-012f-4946-ad27-ae56ef5716c1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Getting quotas for project f39cc90fd8ad43edadefcc7868adc6be. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:47:42.755821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-2578d5a7-012f-4946-ad27-ae56ef5716c1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Getting quotas for user a879659e04494f02a803b823e1fc5f3b and project f39cc90fd8ad43edadefcc7868adc6be. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:47:42.813749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2de9fa0f-162c-4708-869f-49df5a26aa28 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:42.814618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2de9fa0f-162c-4708-869f-49df5a26aa28 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:42.829441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2de9fa0f-162c-4708-869f-49df5a26aa28 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:42.833509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2de9fa0f-162c-4708-869f-49df5a26aa28 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:42.834160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2de9fa0f-162c-4708-869f-49df5a26aa28 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:42.835470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2de9fa0f-162c-4708-869f-49df5a26aa28 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:42.837449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2de9fa0f-162c-4708-869f-49df5a26aa28 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:42.838149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2de9fa0f-162c-4708-869f-49df5a26aa28 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:43.244012 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2578d5a7-012f-4946-ad27-ae56ef5716c1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "POST /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9/action" status: 202 len: 0 microversion: 2.1 time: 0.576131 Oct 27 18:47:43.244747 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 367/733] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:47:42 2022] POST /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 18:47:43.267780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d5909df-3899-4a35-bfea-1ccc3f53cc83 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:43.268787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d5909df-3899-4a35-bfea-1ccc3f53cc83 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:43.297220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d5909df-3899-4a35-bfea-1ccc3f53cc83 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:43.299330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d5909df-3899-4a35-bfea-1ccc3f53cc83 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:43.301461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d5909df-3899-4a35-bfea-1ccc3f53cc83 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:43.304512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d5909df-3899-4a35-bfea-1ccc3f53cc83 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:43.305499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d5909df-3899-4a35-bfea-1ccc3f53cc83 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:43.307507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d5909df-3899-4a35-bfea-1ccc3f53cc83 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:43.495807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2de9fa0f-162c-4708-869f-49df5a26aa28 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:43.507568 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2de9fa0f-162c-4708-869f-49df5a26aa28 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1331 microversion: 2.1 time: 0.698002 Oct 27 18:47:43.514514 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 367/734] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:42 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1331 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:47:43.554335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a743ca79-d763-4e11-b320-9a726db6eca6 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:43.556328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a743ca79-d763-4e11-b320-9a726db6eca6 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:43.588832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a743ca79-d763-4e11-b320-9a726db6eca6 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:43.597762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a743ca79-d763-4e11-b320-9a726db6eca6 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:43.598641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a743ca79-d763-4e11-b320-9a726db6eca6 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:43.600720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a743ca79-d763-4e11-b320-9a726db6eca6 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:43.602492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a743ca79-d763-4e11-b320-9a726db6eca6 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:43.603188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a743ca79-d763-4e11-b320-9a726db6eca6 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:43.753915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-a743ca79-d763-4e11-b320-9a726db6eca6 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:43.811295 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a743ca79-d763-4e11-b320-9a726db6eca6 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.270684 Oct 27 18:47:43.818543 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 368/735] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:43 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:43.826936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9ddf5301-e6fa-4d6a-8ffc-bbffeb252c71 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b4a8c10>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:43.859869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6d5909df-3899-4a35-bfea-1ccc3f53cc83 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:43.897954 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d5909df-3899-4a35-bfea-1ccc3f53cc83 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1461 microversion: 2.1 time: 0.636405 Oct 27 18:47:43.907264 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 368/736] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:43 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1461 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:43.909089 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9ddf5301-e6fa-4d6a-8ffc-bbffeb252c71 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae" status: 200 len: 1422 microversion: 2.1 time: 0.088619 Oct 27 18:47:43.914011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b69a2292-f1ef-4c36-b697-7e01dee28771 req-1507f397-2e60-44c7-a648-078050c94bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c245477e-5ecc-4296-9557-8dfef9214334", "name": "network-vif-deleted", "tag": "5d609ce6-6650-4772-b209-a042e0c43787"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:43.918775 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 369/737] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:47:43 2022] GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae => generated 1422 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:43.928107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f40dcc25-5765-47d6-8b9f-fa3b402e0c1f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:43.931602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f40dcc25-5765-47d6-8b9f-fa3b402e0c1f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:43.932339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b69a2292-f1ef-4c36-b697-7e01dee28771 req-1507f397-2e60-44c7-a648-078050c94bda service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:43.933156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b69a2292-f1ef-4c36-b697-7e01dee28771 req-1507f397-2e60-44c7-a648-078050c94bda service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:43.933822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b69a2292-f1ef-4c36-b697-7e01dee28771 req-1507f397-2e60-44c7-a648-078050c94bda service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:43.951698 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b69a2292-f1ef-4c36-b697-7e01dee28771 req-1507f397-2e60-44c7-a648-078050c94bda service nova] Creating event network-vif-deleted:5d609ce6-6650-4772-b209-a042e0c43787 for instance c245477e-5ecc-4296-9557-8dfef9214334 on n-h1-860687-3 Oct 27 18:47:43.952098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f40dcc25-5765-47d6-8b9f-fa3b402e0c1f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:43.953345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f40dcc25-5765-47d6-8b9f-fa3b402e0c1f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:43.954663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f40dcc25-5765-47d6-8b9f-fa3b402e0c1f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:43.955589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f40dcc25-5765-47d6-8b9f-fa3b402e0c1f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:43.956353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f40dcc25-5765-47d6-8b9f-fa3b402e0c1f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:43.956928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f40dcc25-5765-47d6-8b9f-fa3b402e0c1f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:43.966514 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b69a2292-f1ef-4c36-b697-7e01dee28771 req-1507f397-2e60-44c7-a648-078050c94bda service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055679 Oct 27 18:47:43.967405 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 369/738] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:43.982923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5f7f3d40-677c-41f0-92f5-5e199f6c988d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:43.987364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5f7f3d40-677c-41f0-92f5-5e199f6c988d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:43.996004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f7f3d40-677c-41f0-92f5-5e199f6c988d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:43.997332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f7f3d40-677c-41f0-92f5-5e199f6c988d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:43.998174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f7f3d40-677c-41f0-92f5-5e199f6c988d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:43.999111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f7f3d40-677c-41f0-92f5-5e199f6c988d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:43.999786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f7f3d40-677c-41f0-92f5-5e199f6c988d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:44.000494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f7f3d40-677c-41f0-92f5-5e199f6c988d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:44.092744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f7f3d40-677c-41f0-92f5-5e199f6c988d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:44.096735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f7f3d40-677c-41f0-92f5-5e199f6c988d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:44.099752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f7f3d40-677c-41f0-92f5-5e199f6c988d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:44.102475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-5f7f3d40-677c-41f0-92f5-5e199f6c988d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lazy-loading 'fault' on Instance uuid c245477e-5ecc-4296-9557-8dfef9214334 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:44.204176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5f7f3d40-677c-41f0-92f5-5e199f6c988d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a85e281f544f4aa49b27cd776c849a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f976057610c846c3b9caaf190a4abc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:44.222261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f40dcc25-5765-47d6-8b9f-fa3b402e0c1f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:44.225119 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5f7f3d40-677c-41f0-92f5-5e199f6c988d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 200 len: 1353 microversion: 2.1 time: 0.254616 Oct 27 18:47:44.228446 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 370/739] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:43 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 1353 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:44.235839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd2e2388-5843-4ef0-85a8-188831fce24b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:44.236727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dd2e2388-5843-4ef0-85a8-188831fce24b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:44.246232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd2e2388-5843-4ef0-85a8-188831fce24b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:44.247103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd2e2388-5843-4ef0-85a8-188831fce24b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:44.247713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd2e2388-5843-4ef0-85a8-188831fce24b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:44.251561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd2e2388-5843-4ef0-85a8-188831fce24b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:44.252248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd2e2388-5843-4ef0-85a8-188831fce24b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:44.253360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd2e2388-5843-4ef0-85a8-188831fce24b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:44.259447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f40dcc25-5765-47d6-8b9f-fa3b402e0c1f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:44.261073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f40dcc25-5765-47d6-8b9f-fa3b402e0c1f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:44.262494 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f40dcc25-5765-47d6-8b9f-fa3b402e0c1f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1362 microversion: 2.25 time: 0.342597 Oct 27 18:47:44.285733 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 370/740] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:43 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:44.411789 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dd2e2388-5843-4ef0-85a8-188831fce24b tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1612 microversion: 2.1 time: 0.181045 Oct 27 18:47:44.413780 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 371/741] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:44 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1612 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:44.442922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7a6ec183-e951-4e29-a29a-6c58c33a43f8 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Calling method '.version_select at 0x7fc86b1c2d30>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:44.446728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a6ec183-e951-4e29-a29a-6c58c33a43f8 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:44.447386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a6ec183-e951-4e29-a29a-6c58c33a43f8 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:44.448006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a6ec183-e951-4e29-a29a-6c58c33a43f8 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:44.471230 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7a6ec183-e951-4e29-a29a-6c58c33a43f8 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.033216 Oct 27 18:47:44.475672 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 371/742] 10.222.0.42 () {58 vars in 1143 bytes} [Thu Oct 27 18:47:44 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:44.546130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-507f65bb-472d-4567-9975-0ff26af0a987 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:44.546790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-507f65bb-472d-4567-9975-0ff26af0a987 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:44.563965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-507f65bb-472d-4567-9975-0ff26af0a987 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:44.566440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-507f65bb-472d-4567-9975-0ff26af0a987 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:44.567075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-507f65bb-472d-4567-9975-0ff26af0a987 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:44.568565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-507f65bb-472d-4567-9975-0ff26af0a987 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:44.570359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-507f65bb-472d-4567-9975-0ff26af0a987 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:44.572823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-507f65bb-472d-4567-9975-0ff26af0a987 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:44.672112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-904408493", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:44.781332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:47:44.860550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-507f65bb-472d-4567-9975-0ff26af0a987 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:44.869377 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-507f65bb-472d-4567-9975-0ff26af0a987 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1331 microversion: 2.1 time: 0.329873 Oct 27 18:47:44.869962 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 372/743] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:44 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1331 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:44.879039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f8efb928-b149-429c-bcf3-28d625461713 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:44.885662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f8efb928-b149-429c-bcf3-28d625461713 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:44.905392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8efb928-b149-429c-bcf3-28d625461713 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:44.906111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8efb928-b149-429c-bcf3-28d625461713 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:44.906728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8efb928-b149-429c-bcf3-28d625461713 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:44.908295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8efb928-b149-429c-bcf3-28d625461713 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:44.910667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8efb928-b149-429c-bcf3-28d625461713 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:44.911294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8efb928-b149-429c-bcf3-28d625461713 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:45.049184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-f8efb928-b149-429c-bcf3-28d625461713 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:45.078097 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f8efb928-b149-429c-bcf3-28d625461713 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.202607 Oct 27 18:47:45.079910 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 373/744] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:44 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:45.085574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-658950b3-73fb-4696-992d-b7edca54ce70 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc870fd0dc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:45.093590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:47:45.094027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:47:45.094673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:47:45.095134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:47:45.097424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:47:45.109104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:45.115798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:45.116802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:45.119901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:45.122476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:45.123240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:45.154021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Getting quotas for project 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:47:45.159314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Getting quotas for user 1917ae65262c40b792c28c2aa4d44b44 and project 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:47:45.187309 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-658950b3-73fb-4696-992d-b7edca54ce70 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae" status: 200 len: 1422 microversion: 2.1 time: 0.106110 Oct 27 18:47:45.189939 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 374/745] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:47:45 2022] GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae => generated 1422 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:45.217321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:45.218787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:47:45.221709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:47:45.255782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13c10f99-898c-473e-8132-b18e7801280e tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:45.256783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-13c10f99-898c-473e-8132-b18e7801280e tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:45.268371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13c10f99-898c-473e-8132-b18e7801280e tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:45.274869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13c10f99-898c-473e-8132-b18e7801280e tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:45.275333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13c10f99-898c-473e-8132-b18e7801280e tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:45.276082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13c10f99-898c-473e-8132-b18e7801280e tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:45.277293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13c10f99-898c-473e-8132-b18e7801280e tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:45.277740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13c10f99-898c-473e-8132-b18e7801280e tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:45.281116 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-27e86390-f29f-4bab-bc18-164b7ec95aee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614530 Oct 27 18:47:45.281832 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 372/746] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:47:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:47:45.298200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-87651e2b-7775-43eb-83d8-7fbf17dbc8fd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:45.299024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-87651e2b-7775-43eb-83d8-7fbf17dbc8fd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:45.308865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87651e2b-7775-43eb-83d8-7fbf17dbc8fd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:45.309867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87651e2b-7775-43eb-83d8-7fbf17dbc8fd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:45.310978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87651e2b-7775-43eb-83d8-7fbf17dbc8fd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:45.313673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87651e2b-7775-43eb-83d8-7fbf17dbc8fd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:45.315015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87651e2b-7775-43eb-83d8-7fbf17dbc8fd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:45.315673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87651e2b-7775-43eb-83d8-7fbf17dbc8fd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:45.325859 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-13c10f99-898c-473e-8132-b18e7801280e tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] HTTP exception thrown: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13c10f99-898c-473e-8132-b18e7801280e tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Request method failure captured: Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 HTTP/1.1 Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtHJWWvDnGljVkhBePVOx7R_NC6Et3zM_JVghtIJ4pLIGPqEhycn49cJjd7U3YeqK1jItLjIx6zmEdIwjGfrb2L7D-Pljn4T3tuaJX9QpX9WGQ1tmiFZBEpa_JFw-i_5aAhTr5t5kzfDbTeyQI4c5qM6gXGWV9hborOdD2OJAc1CXVU Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f976057610c846c3b9caaf190a4abc89 Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:47:45.327576 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:47:45.328774 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f976057610c846c3b9caaf190a4abc89", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:45.328774 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:45.328774 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f976057610c846c3b9caaf190a4abc89 Oct 27 18:47:45.328774 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:45.328774 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersWithSpecificFlavorTestJSON-657034950-project Oct 27 18:47:45.328774 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:47:45.328774 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:47:45.328774 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 97a85e281f544f4aa49b27cd776c849a Oct 27 18:47:45.328774 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950-project Oct 27 18:47:45.328774 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:47:45.328774 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:45.328774 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'c245477e-5ecc-4296-9557-8dfef9214334'} Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:45.329483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:45.331213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.332293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13c10f99-898c-473e-8132-b18e7801280e tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Returning 404 to user: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:45.332293 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-13c10f99-898c-473e-8132-b18e7801280e tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 404 len: 111 microversion: 2.1 time: 0.078000 Oct 27 18:47:45.334140 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 375/747] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:45 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:47:45.350504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b8fd2ea8-fca0-4b12-b649-f0f633f92898 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:45.351157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b8fd2ea8-fca0-4b12-b649-f0f633f92898 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:45.433417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b8fd2ea8-fca0-4b12-b649-f0f633f92898 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:45.441151 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b8fd2ea8-fca0-4b12-b649-f0f633f92898 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1212 microversion: 2.1 time: 0.099837 Oct 27 18:47:45.441734 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 376/748] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:45 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1212 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:45.457483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e2297663-eb2e-40d3-98ad-82d0460da19d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:45.458218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e2297663-eb2e-40d3-98ad-82d0460da19d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:45.467738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2297663-eb2e-40d3-98ad-82d0460da19d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:45.471887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2297663-eb2e-40d3-98ad-82d0460da19d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:45.472591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2297663-eb2e-40d3-98ad-82d0460da19d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:45.473552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2297663-eb2e-40d3-98ad-82d0460da19d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:45.478068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2297663-eb2e-40d3-98ad-82d0460da19d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:45.478717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2297663-eb2e-40d3-98ad-82d0460da19d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:45.500704 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-e2297663-eb2e-40d3-98ad-82d0460da19d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] HTTP exception thrown: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e2297663-eb2e-40d3-98ad-82d0460da19d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Request method failure captured: Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f HTTP/1.1 Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtHJWWvDnGljVkhBePVOx7R_NC6Et3zM_JVghtIJ4pLIGPqEhycn49cJjd7U3YeqK1jItLjIx6zmEdIwjGfrb2L7D-Pljn4T3tuaJX9QpX9WGQ1tmiFZBEpa_JFw-i_5aAhTr5t5kzfDbTeyQI4c5qM6gXGWV9hborOdD2OJAc1CXVU Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f976057610c846c3b9caaf190a4abc89 Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:47:45.515980 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:47:45.517465 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f976057610c846c3b9caaf190a4abc89", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:45.517465 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:45.517465 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f976057610c846c3b9caaf190a4abc89 Oct 27 18:47:45.517465 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:45.517465 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersWithSpecificFlavorTestJSON-657034950-project Oct 27 18:47:45.517465 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:47:45.517465 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:47:45.517465 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 97a85e281f544f4aa49b27cd776c849a Oct 27 18:47:45.517465 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950-project Oct 27 18:47:45.517465 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:47:45.517465 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:45.517465 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'c0ec313b-f165-450a-92ba-215e7989df1f'} Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:45.518286 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:45.519680 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.521019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e2297663-eb2e-40d3-98ad-82d0460da19d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Returning 404 to user: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:45.521019 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e2297663-eb2e-40d3-98ad-82d0460da19d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 404 len: 111 microversion: 2.1 time: 0.063850 Oct 27 18:47:45.521019 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 377/749] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:47:45 2022] DELETE /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:47:45.533978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-32beb378-07e3-48a8-8eae-3cdc6c563be1 req-b974e1d5-d1f3-43c4-b72e-7c9b5ca694ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0356d2-73d5-47bb-a499-17b029d1dad1", "name": "network-vif-plugged", "status": "completed", "tag": "1f181151-81f9-4cf5-a37c-a15ffbe32f2e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:45.575618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-32beb378-07e3-48a8-8eae-3cdc6c563be1 req-b974e1d5-d1f3-43c4-b72e-7c9b5ca694ed service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:45.576123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-32beb378-07e3-48a8-8eae-3cdc6c563be1 req-b974e1d5-d1f3-43c4-b72e-7c9b5ca694ed service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:45.576569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-32beb378-07e3-48a8-8eae-3cdc6c563be1 req-b974e1d5-d1f3-43c4-b72e-7c9b5ca694ed service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:45.596079 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-32beb378-07e3-48a8-8eae-3cdc6c563be1 req-b974e1d5-d1f3-43c4-b72e-7c9b5ca694ed service nova] Creating event network-vif-plugged:1f181151-81f9-4cf5-a37c-a15ffbe32f2e for instance 7f0356d2-73d5-47bb-a499-17b029d1dad1 on n-h1-860687-3 Oct 27 18:47:45.617154 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-32beb378-07e3-48a8-8eae-3cdc6c563be1 req-b974e1d5-d1f3-43c4-b72e-7c9b5ca694ed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090852 Oct 27 18:47:45.622249 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 378/750] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:45.631832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e5418321-19bf-4f74-91f7-94714832d973 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:45.632560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e5418321-19bf-4f74-91f7-94714832d973 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:45.656434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5418321-19bf-4f74-91f7-94714832d973 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:45.657013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5418321-19bf-4f74-91f7-94714832d973 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:45.657928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-87651e2b-7775-43eb-83d8-7fbf17dbc8fd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:45.658620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5418321-19bf-4f74-91f7-94714832d973 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:45.659427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5418321-19bf-4f74-91f7-94714832d973 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:45.661587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5418321-19bf-4f74-91f7-94714832d973 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:45.661587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5418321-19bf-4f74-91f7-94714832d973 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:45.673073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-87651e2b-7775-43eb-83d8-7fbf17dbc8fd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:45.678103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-87651e2b-7775-43eb-83d8-7fbf17dbc8fd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:45.684842 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-87651e2b-7775-43eb-83d8-7fbf17dbc8fd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1557 microversion: 2.25 time: 0.392332 Oct 27 18:47:45.685286 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 373/751] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:45 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1557 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:45.724407 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-e5418321-19bf-4f74-91f7-94714832d973 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] HTTP exception thrown: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e5418321-19bf-4f74-91f7-94714832d973 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Request method failure captured: Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f HTTP/1.1 Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtHJWWvDnGljVkhBePVOx7R_NC6Et3zM_JVghtIJ4pLIGPqEhycn49cJjd7U3YeqK1jItLjIx6zmEdIwjGfrb2L7D-Pljn4T3tuaJX9QpX9WGQ1tmiFZBEpa_JFw-i_5aAhTr5t5kzfDbTeyQI4c5qM6gXGWV9hborOdD2OJAc1CXVU Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f976057610c846c3b9caaf190a4abc89 Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:47:45.739315 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:47:45.740934 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f976057610c846c3b9caaf190a4abc89", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:45.740934 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:45.740934 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f976057610c846c3b9caaf190a4abc89 Oct 27 18:47:45.740934 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:45.740934 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersWithSpecificFlavorTestJSON-657034950-project Oct 27 18:47:45.740934 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:47:45.740934 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:47:45.740934 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 97a85e281f544f4aa49b27cd776c849a Oct 27 18:47:45.740934 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950-project Oct 27 18:47:45.740934 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:47:45.740934 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:45.740934 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'c0ec313b-f165-450a-92ba-215e7989df1f'} Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:45.741793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:45.743205 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:45.744507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e5418321-19bf-4f74-91f7-94714832d973 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Returning 404 to user: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:45.745169 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e5418321-19bf-4f74-91f7-94714832d973 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 404 len: 111 microversion: 2.1 time: 0.121672 Oct 27 18:47:45.751818 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 379/752] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:45 2022] GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:47:45.766305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4eb3b27d-3566-4715-8ecf-da9d2b922d1d tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:45.767173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4eb3b27d-3566-4715-8ecf-da9d2b922d1d tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:45.780478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4eb3b27d-3566-4715-8ecf-da9d2b922d1d tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:45.782113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4eb3b27d-3566-4715-8ecf-da9d2b922d1d tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:45.782858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4eb3b27d-3566-4715-8ecf-da9d2b922d1d tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:45.785411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4eb3b27d-3566-4715-8ecf-da9d2b922d1d tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:45.786997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4eb3b27d-3566-4715-8ecf-da9d2b922d1d tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:45.787656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4eb3b27d-3566-4715-8ecf-da9d2b922d1d tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:45.979409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-429219142", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:46.088088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-4eb3b27d-3566-4715-8ecf-da9d2b922d1d tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 293448e8-0911-4074-a5d0-d9ff98094843 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:46.090909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:47:46.106857 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4eb3b27d-3566-4715-8ecf-da9d2b922d1d tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 2050 microversion: 2.25 time: 0.350083 Oct 27 18:47:46.107891 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 380/753] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:45 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 2050 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:46.112936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-049f06d5-f5d7-44c2-ba5e-1a07763e2682 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '.version_select at 0x7fc86b9cdca0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:46.157633 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-049f06d5-f5d7-44c2-ba5e-1a07763e2682 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180244837" status: 202 len: 0 microversion: 2.1 time: 0.048451 Oct 27 18:47:46.158932 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 381/754] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 18:47:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180244837 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:47:46.173763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-98c9cedb-965e-4ed3-9b46-9c6254900d05 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:46.190248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-98c9cedb-965e-4ed3-9b46-9c6254900d05 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:46.202932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98c9cedb-965e-4ed3-9b46-9c6254900d05 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:46.206894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98c9cedb-965e-4ed3-9b46-9c6254900d05 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:46.209555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98c9cedb-965e-4ed3-9b46-9c6254900d05 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:46.210422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98c9cedb-965e-4ed3-9b46-9c6254900d05 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:46.222848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98c9cedb-965e-4ed3-9b46-9c6254900d05 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:46.223610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98c9cedb-965e-4ed3-9b46-9c6254900d05 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:46.444804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:47:46.445238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:47:46.445724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:47:46.446141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:47:46.446750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:47:46.473609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:46.474102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:46.474586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:46.476765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:46.477723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:46.478340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:46.511965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Getting quotas for project 2e625a0c7d6544639b0066d000dc6794. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:47:46.518175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Getting quotas for user 14e9c0b3a99d41a9ac42eb5a092be2c6 and project 2e625a0c7d6544639b0066d000dc6794. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:47:46.519184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-98c9cedb-965e-4ed3-9b46-9c6254900d05 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:46.532699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:47:46.532890 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-98c9cedb-965e-4ed3-9b46-9c6254900d05 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1331 microversion: 2.1 time: 0.367911 Oct 27 18:47:46.533350 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 382/755] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:46 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1331 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:46.535484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:47:46.559381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0ac74eca-959d-4458-8303-7ab0311421dd tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:46.560006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0ac74eca-959d-4458-8303-7ab0311421dd tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:46.579085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ac74eca-959d-4458-8303-7ab0311421dd tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:46.579629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ac74eca-959d-4458-8303-7ab0311421dd tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:46.580081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ac74eca-959d-4458-8303-7ab0311421dd tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:46.581043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ac74eca-959d-4458-8303-7ab0311421dd tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:46.582130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ac74eca-959d-4458-8303-7ab0311421dd tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:46.583510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ac74eca-959d-4458-8303-7ab0311421dd tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:46.588501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:46.606819 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ba6e846f-e517-4687-b19e-8ca218266e26 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920301 Oct 27 18:47:46.610653 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 374/756] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:47:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:47:46.620824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de913e9f-7ae3-4c78-af31-bed80457143a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:46.621099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-de913e9f-7ae3-4c78-af31-bed80457143a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:46.635753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de913e9f-7ae3-4c78-af31-bed80457143a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:46.636389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de913e9f-7ae3-4c78-af31-bed80457143a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:46.636756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de913e9f-7ae3-4c78-af31-bed80457143a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:46.637473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de913e9f-7ae3-4c78-af31-bed80457143a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:46.637934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de913e9f-7ae3-4c78-af31-bed80457143a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:46.642672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de913e9f-7ae3-4c78-af31-bed80457143a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:46.746239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-0ac74eca-959d-4458-8303-7ab0311421dd tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:46.779663 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0ac74eca-959d-4458-8303-7ab0311421dd tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.224449 Oct 27 18:47:46.781722 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 383/757] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:46 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:46.799754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9585d94b-ac13-4392-97fe-f1e2fa5f7f34 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b80a040>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:46.883764 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9585d94b-ac13-4392-97fe-f1e2fa5f7f34 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae" status: 200 len: 1422 microversion: 2.1 time: 0.100220 Oct 27 18:47:46.906199 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 384/758] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:47:46 2022] GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae => generated 1422 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:46.926486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a2e2b01d-4205-4c5f-a143-950c0f6bd028 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:46.927130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a2e2b01d-4205-4c5f-a143-950c0f6bd028 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:46.942114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2e2b01d-4205-4c5f-a143-950c0f6bd028 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:46.942649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2e2b01d-4205-4c5f-a143-950c0f6bd028 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:46.943095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2e2b01d-4205-4c5f-a143-950c0f6bd028 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:46.943806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2e2b01d-4205-4c5f-a143-950c0f6bd028 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:46.944466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2e2b01d-4205-4c5f-a143-950c0f6bd028 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:46.953236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2e2b01d-4205-4c5f-a143-950c0f6bd028 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:47.053020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a2e2b01d-4205-4c5f-a143-950c0f6bd028 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:47.063473 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a2e2b01d-4205-4c5f-a143-950c0f6bd028 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1264 microversion: 2.1 time: 0.155693 Oct 27 18:47:47.064709 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 385/759] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:46 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:47.081147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8a449423-0ea2-4657-a437-89125be358fb tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:47.081785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8a449423-0ea2-4657-a437-89125be358fb tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:47.216018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8a449423-0ea2-4657-a437-89125be358fb tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e9c0b3a99d41a9ac42eb5a092be2c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e625a0c7d6544639b0066d000dc6794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:47.226047 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8a449423-0ea2-4657-a437-89125be358fb tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 200 len: 1213 microversion: 2.1 time: 0.160073 Oct 27 18:47:47.228819 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 386/760] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:47 2022] GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 1213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:47.271849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-de913e9f-7ae3-4c78-af31-bed80457143a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 293448e8-0911-4074-a5d0-d9ff98094843 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:47.307120 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-de913e9f-7ae3-4c78-af31-bed80457143a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 2050 microversion: 2.25 time: 0.694492 Oct 27 18:47:47.332380 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 375/761] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:46 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 2050 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:47.337511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e72454b3-61a9-4a84-8d84-cf2903301179 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:47.344455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e72454b3-61a9-4a84-8d84-cf2903301179 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:47.345394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e72454b3-61a9-4a84-8d84-cf2903301179 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:47.346034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e72454b3-61a9-4a84-8d84-cf2903301179 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:47.349255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e72454b3-61a9-4a84-8d84-cf2903301179 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:47.350056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e72454b3-61a9-4a84-8d84-cf2903301179 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:47.350749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e72454b3-61a9-4a84-8d84-cf2903301179 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:47.386671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:47.394668 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e72454b3-61a9-4a84-8d84-cf2903301179 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.060509 Oct 27 18:47:47.395980 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 387/762] 10.222.0.42 () {60 vars in 1217 bytes} [Thu Oct 27 18:47:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:47:47.412917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-beff80c8-3b29-498b-bfa8-8bec197c3332 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:47.414577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-beff80c8-3b29-498b-bfa8-8bec197c3332 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:47.428136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-beff80c8-3b29-498b-bfa8-8bec197c3332 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:47.429221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-beff80c8-3b29-498b-bfa8-8bec197c3332 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:47.430172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-beff80c8-3b29-498b-bfa8-8bec197c3332 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:47.432451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-beff80c8-3b29-498b-bfa8-8bec197c3332 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:47.433383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-beff80c8-3b29-498b-bfa8-8bec197c3332 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:47.434045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-beff80c8-3b29-498b-bfa8-8bec197c3332 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:47.510398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:47.600699 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-beff80c8-3b29-498b-bfa8-8bec197c3332 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843/action" status: 202 len: 0 microversion: 2.25 time: 0.195087 Oct 27 18:47:47.603756 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 376/763] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 18:47:47 2022] POST /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:47:47.620795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d442b3a6-a0f4-4f02-a220-24830978e175 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:47.624177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d442b3a6-a0f4-4f02-a220-24830978e175 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:47.630205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2261003a-9bf0-4a98-ad0c-c77ead957f4f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:47.630894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2261003a-9bf0-4a98-ad0c-c77ead957f4f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:47.659267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2261003a-9bf0-4a98-ad0c-c77ead957f4f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:47.659896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2261003a-9bf0-4a98-ad0c-c77ead957f4f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:47.661842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2261003a-9bf0-4a98-ad0c-c77ead957f4f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:47.662170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d442b3a6-a0f4-4f02-a220-24830978e175 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:47.662782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d442b3a6-a0f4-4f02-a220-24830978e175 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:47.663988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d442b3a6-a0f4-4f02-a220-24830978e175 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:47.668949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d442b3a6-a0f4-4f02-a220-24830978e175 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:47.669130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2261003a-9bf0-4a98-ad0c-c77ead957f4f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:47.670679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d442b3a6-a0f4-4f02-a220-24830978e175 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:47.671064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2261003a-9bf0-4a98-ad0c-c77ead957f4f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:47.671205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d442b3a6-a0f4-4f02-a220-24830978e175 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:47.671522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2261003a-9bf0-4a98-ad0c-c77ead957f4f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:47.951414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2261003a-9bf0-4a98-ad0c-c77ead957f4f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:47.964830 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2261003a-9bf0-4a98-ad0c-c77ead957f4f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1534 microversion: 2.1 time: 0.400935 Oct 27 18:47:47.983814 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 388/764] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:47 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1534 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:47.992680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b2b4df12-1016-4a62-8d42-3dc07c74c6c7 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:47.993647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b2b4df12-1016-4a62-8d42-3dc07c74c6c7 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:48.001058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2b4df12-1016-4a62-8d42-3dc07c74c6c7 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:48.001849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2b4df12-1016-4a62-8d42-3dc07c74c6c7 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:48.002739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2b4df12-1016-4a62-8d42-3dc07c74c6c7 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:48.003644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2b4df12-1016-4a62-8d42-3dc07c74c6c7 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:48.004296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2b4df12-1016-4a62-8d42-3dc07c74c6c7 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:48.004887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2b4df12-1016-4a62-8d42-3dc07c74c6c7 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:48.138429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-b2b4df12-1016-4a62-8d42-3dc07c74c6c7 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:48.161430 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b2b4df12-1016-4a62-8d42-3dc07c74c6c7 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.176031 Oct 27 18:47:48.162488 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 389/765] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:47 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:48.188670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9a302b71-4adc-481c-8814-c826b0d89fe5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b80a040>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:48.267618 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9a302b71-4adc-481c-8814-c826b0d89fe5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae" status: 200 len: 1422 microversion: 2.1 time: 0.103993 Oct 27 18:47:48.268227 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 390/766] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:47:48 2022] GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae => generated 1422 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:48.272922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2a3a7bbf-c346-44e1-a410-df7bc11321cd tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Action: 'create', calling method: .version_select at 0x7fc86b7dd790>, body: {"pool": "7df642ec-8467-4952-9b8b-a0179be2d86e"} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:48.498431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-d442b3a6-a0f4-4f02-a220-24830978e175 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 293448e8-0911-4074-a5d0-d9ff98094843 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:48.531493 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d442b3a6-a0f4-4f02-a220-24830978e175 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 2055 microversion: 2.25 time: 0.920605 Oct 27 18:47:48.547000 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 377/767] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:47 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 2055 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:48.569615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6cab38d4-5648-4673-841a-0dae52569713 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:48.570370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6cab38d4-5648-4673-841a-0dae52569713 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:48.594316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cab38d4-5648-4673-841a-0dae52569713 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:48.595741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cab38d4-5648-4673-841a-0dae52569713 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:48.596453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cab38d4-5648-4673-841a-0dae52569713 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:48.597682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cab38d4-5648-4673-841a-0dae52569713 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:48.598477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cab38d4-5648-4673-841a-0dae52569713 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:48.598941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cab38d4-5648-4673-841a-0dae52569713 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:48.731193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6cab38d4-5648-4673-841a-0dae52569713 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:48.742358 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6cab38d4-5648-4673-841a-0dae52569713 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1270 microversion: 2.1 time: 0.193137 Oct 27 18:47:48.746350 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 378/768] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:48 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1270 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:48.751119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4fcbd4cb-fe45-4972-9a02-6674214535b1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:48.751741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4fcbd4cb-fe45-4972-9a02-6674214535b1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:48.762304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fcbd4cb-fe45-4972-9a02-6674214535b1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:48.762848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fcbd4cb-fe45-4972-9a02-6674214535b1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:48.763322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fcbd4cb-fe45-4972-9a02-6674214535b1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:48.771299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fcbd4cb-fe45-4972-9a02-6674214535b1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:48.771869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fcbd4cb-fe45-4972-9a02-6674214535b1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:48.772347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fcbd4cb-fe45-4972-9a02-6674214535b1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:48.878996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4fcbd4cb-fe45-4972-9a02-6674214535b1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e9c0b3a99d41a9ac42eb5a092be2c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e625a0c7d6544639b0066d000dc6794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:48.907332 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4fcbd4cb-fe45-4972-9a02-6674214535b1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 200 len: 1273 microversion: 2.1 time: 0.159289 Oct 27 18:47:48.907884 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 379/769] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:48 2022] GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:48.920351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e8979fc7-a437-47c8-8886-e1118e71d963 tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:48.967173 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e8979fc7-a437-47c8-8886-e1118e71d963 tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/619435472" status: 202 len: 0 microversion: 2.1 time: 0.055839 Oct 27 18:47:48.968711 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 380/770] 10.222.0.42 () {58 vars in 1158 bytes} [Thu Oct 27 18:47:48 2022] DELETE /compute/v2.1/flavors/619435472 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:47:49.123379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c52ebf40-f9ef-4fcf-8596-319a3aec7423 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Action: 'create', calling method: .version_select at 0x7fc86b2923a0>, body: {"keypair": {"name": "tempest-keypair-923557536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwSoViHlHFikPXazV147nPqNa6fAbAMqnYDWljOy2iGEX7XwMYg9ozgdgY3JeBxUaGvfT5eDQJps7KfjfiZ9LTuQabnlmLOK8tce5HGIS2I4zPosfNB4KYAsRCs9oUd6Q=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:49.145559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-c52ebf40-f9ef-4fcf-8596-319a3aec7423 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Getting quotas for project f935076689d74e1e9089d516caca1cc4. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:47:49.150702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-c52ebf40-f9ef-4fcf-8596-319a3aec7423 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Getting quotas for user 18ce178d2f1b40ecbf7dd294d7da4748 and project f935076689d74e1e9089d516caca1cc4. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:47:49.186074 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c52ebf40-f9ef-4fcf-8596-319a3aec7423 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.215899 Oct 27 18:47:49.186923 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 381/771] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:47:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:49.193053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-38594562-7626-4686-8e62-40589714824f tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:49.218712 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-38594562-7626-4686-8e62-40589714824f tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.030366 Oct 27 18:47:49.219153 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 382/772] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:47:49 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:49.223773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c46e3e09-3216-492d-a63e-b301e703c2d0 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:49.224691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c46e3e09-3216-492d-a63e-b301e703c2d0 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:49.231334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c46e3e09-3216-492d-a63e-b301e703c2d0 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:49.231839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c46e3e09-3216-492d-a63e-b301e703c2d0 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:49.232284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c46e3e09-3216-492d-a63e-b301e703c2d0 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:49.233081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c46e3e09-3216-492d-a63e-b301e703c2d0 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:49.233553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c46e3e09-3216-492d-a63e-b301e703c2d0 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:49.233987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c46e3e09-3216-492d-a63e-b301e703c2d0 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:49.436061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-c46e3e09-3216-492d-a63e-b301e703c2d0 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:49.481613 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c46e3e09-3216-492d-a63e-b301e703c2d0 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.261372 Oct 27 18:47:49.484601 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 383/773] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:49 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:49.505743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6000026d-bb67-4c33-8957-c8d0d0abce36 tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:49.547528 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6000026d-bb67-4c33-8957-c8d0d0abce36 tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/547218031" status: 202 len: 0 microversion: 2.1 time: 0.060442 Oct 27 18:47:49.548041 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 384/774] 10.222.0.42 () {58 vars in 1158 bytes} [Thu Oct 27 18:47:49 2022] DELETE /compute/v2.1/flavors/547218031 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:47:49.566230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b53183c5-7b15-478e-b261-2ca311ef24ce tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b1a88b0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:49.640114 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b53183c5-7b15-478e-b261-2ca311ef24ce tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae" status: 200 len: 1422 microversion: 2.1 time: 0.082353 Oct 27 18:47:49.640972 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 385/775] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:47:49 2022] GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:49.648874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a420e6d6-fc4b-4d73-a1dd-a557e50cc22c req-f70ad69e-2bc9-4166-9354-86b4e2bd47af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a645e2-ba92-42c7-8a35-8aea0ee2f9b9", "name": "network-vif-plugged", "status": "completed", "tag": "2cf40f9d-6d09-4726-8ad1-d50203aea23c"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:49.664193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a420e6d6-fc4b-4d73-a1dd-a557e50cc22c req-f70ad69e-2bc9-4166-9354-86b4e2bd47af service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:49.665051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a420e6d6-fc4b-4d73-a1dd-a557e50cc22c req-f70ad69e-2bc9-4166-9354-86b4e2bd47af service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:49.665778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a420e6d6-fc4b-4d73-a1dd-a557e50cc22c req-f70ad69e-2bc9-4166-9354-86b4e2bd47af service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:49.681567 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a420e6d6-fc4b-4d73-a1dd-a557e50cc22c req-f70ad69e-2bc9-4166-9354-86b4e2bd47af service nova] Creating event network-vif-plugged:2cf40f9d-6d09-4726-8ad1-d50203aea23c for instance 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 on n-h2-860687-3 Oct 27 18:47:49.690102 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a420e6d6-fc4b-4d73-a1dd-a557e50cc22c req-f70ad69e-2bc9-4166-9354-86b4e2bd47af service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046530 Oct 27 18:47:49.691502 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 386/776] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:49.697272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e07e507d-d2e0-428e-832c-a8358ed9028e tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:49.729059 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e07e507d-d2e0-428e-832c-a8358ed9028e tempest-ServersWithSpecificFlavorTestJSON-428746131 tempest-ServersWithSpecificFlavorTestJSON-428746131-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035936 Oct 27 18:47:49.735933 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 387/777] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:47:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:49.755906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-29c57b83-4211-4f25-9089-65021cf0bdfb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:49.758939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-29c57b83-4211-4f25-9089-65021cf0bdfb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:49.768699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29c57b83-4211-4f25-9089-65021cf0bdfb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:49.769335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29c57b83-4211-4f25-9089-65021cf0bdfb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:49.769876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29c57b83-4211-4f25-9089-65021cf0bdfb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:49.770748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29c57b83-4211-4f25-9089-65021cf0bdfb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:49.771211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29c57b83-4211-4f25-9089-65021cf0bdfb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:49.771733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29c57b83-4211-4f25-9089-65021cf0bdfb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:50.049203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-29c57b83-4211-4f25-9089-65021cf0bdfb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 293448e8-0911-4074-a5d0-d9ff98094843 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:50.068052 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-29c57b83-4211-4f25-9089-65021cf0bdfb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 2035 microversion: 2.25 time: 0.336240 Oct 27 18:47:50.083297 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 388/778] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:49 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 2035 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:50.098102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6abd3b2-5ac2-4912-9d91-b5b3977e9ca6 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:50.098933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d6abd3b2-5ac2-4912-9d91-b5b3977e9ca6 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:50.110996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6abd3b2-5ac2-4912-9d91-b5b3977e9ca6 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:50.111634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6abd3b2-5ac2-4912-9d91-b5b3977e9ca6 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:50.112159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6abd3b2-5ac2-4912-9d91-b5b3977e9ca6 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:50.112961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6abd3b2-5ac2-4912-9d91-b5b3977e9ca6 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:50.113637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6abd3b2-5ac2-4912-9d91-b5b3977e9ca6 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:50.114172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6abd3b2-5ac2-4912-9d91-b5b3977e9ca6 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:50.135055 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-d6abd3b2-5ac2-4912-9d91-b5b3977e9ca6 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] HTTP exception thrown: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6abd3b2-5ac2-4912-9d91-b5b3977e9ca6 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Request method failure captured: Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 HTTP/1.1 Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtHJWWvDnGljVkhBePVOx7R_NC6Et3zM_JVghtIJ4pLIGPqEhycn49cJjd7U3YeqK1jItLjIx6zmEdIwjGfrb2L7D-Pljn4T3tuaJX9QpX9WGQ1tmiFZBEpa_JFw-i_5aAhTr5t5kzfDbTeyQI4c5qM6gXGWV9hborOdD2OJAc1CXVU Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f976057610c846c3b9caaf190a4abc89 Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:47:50.137671 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:47:50.138986 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f976057610c846c3b9caaf190a4abc89", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:50.138986 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:50.138986 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f976057610c846c3b9caaf190a4abc89 Oct 27 18:47:50.138986 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:50.138986 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersWithSpecificFlavorTestJSON-657034950-project Oct 27 18:47:50.138986 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:47:50.138986 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:47:50.138986 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 97a85e281f544f4aa49b27cd776c849a Oct 27 18:47:50.138986 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950-project Oct 27 18:47:50.138986 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:47:50.138986 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:50.138986 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'c245477e-5ecc-4296-9557-8dfef9214334'} Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:50.140041 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:50.141223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:50.142985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6abd3b2-5ac2-4912-9d91-b5b3977e9ca6 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Returning 404 to user: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:50.142985 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d6abd3b2-5ac2-4912-9d91-b5b3977e9ca6 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 404 len: 111 microversion: 2.1 time: 0.054517 Oct 27 18:47:50.142985 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 389/779] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:47:50 2022] DELETE /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:47:50.147645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0467644c-bc75-41c6-b7ea-6d247eb859dc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:50.148252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0467644c-bc75-41c6-b7ea-6d247eb859dc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:50.156017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0467644c-bc75-41c6-b7ea-6d247eb859dc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:50.156595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0467644c-bc75-41c6-b7ea-6d247eb859dc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:50.157854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0467644c-bc75-41c6-b7ea-6d247eb859dc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:50.157854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0467644c-bc75-41c6-b7ea-6d247eb859dc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:50.158167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0467644c-bc75-41c6-b7ea-6d247eb859dc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:50.158636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0467644c-bc75-41c6-b7ea-6d247eb859dc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:50.578945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0467644c-bc75-41c6-b7ea-6d247eb859dc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:50.587444 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0467644c-bc75-41c6-b7ea-6d247eb859dc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1312 microversion: 2.1 time: 0.443445 Oct 27 18:47:50.604158 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 390/780] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:50 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1312 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:50.610206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-469a2a55-a51e-46ba-8a48-c895e06757fa tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:50.611101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-469a2a55-a51e-46ba-8a48-c895e06757fa tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:50.617873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-469a2a55-a51e-46ba-8a48-c895e06757fa tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:50.618625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-469a2a55-a51e-46ba-8a48-c895e06757fa tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:50.619221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-469a2a55-a51e-46ba-8a48-c895e06757fa tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:50.620090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-469a2a55-a51e-46ba-8a48-c895e06757fa tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:50.622155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-469a2a55-a51e-46ba-8a48-c895e06757fa tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:50.622865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-469a2a55-a51e-46ba-8a48-c895e06757fa tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:50.625201 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2a3a7bbf-c346-44e1-a410-df7bc11321cd tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.355723 Oct 27 18:47:50.626847 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 391/781] 10.222.0.42 () {60 vars in 1170 bytes} [Thu Oct 27 18:47:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:50.643577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f8d0f05e-cee7-4273-be5e-a82ae67cd65b tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860687-3", "block_migration": "auto"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:50.653149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f8d0f05e-cee7-4273-be5e-a82ae67cd65b tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:50.663161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8d0f05e-cee7-4273-be5e-a82ae67cd65b tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:50.663938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8d0f05e-cee7-4273-be5e-a82ae67cd65b tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:50.664492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8d0f05e-cee7-4273-be5e-a82ae67cd65b tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:50.665325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8d0f05e-cee7-4273-be5e-a82ae67cd65b tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:50.666074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8d0f05e-cee7-4273-be5e-a82ae67cd65b tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:50.666766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8d0f05e-cee7-4273-be5e-a82ae67cd65b tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:50.801674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-f8d0f05e-cee7-4273-be5e-a82ae67cd65b tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'flavor' on Instance uuid 293448e8-0911-4074-a5d0-d9ff98094843 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:50.879581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f8d0f05e-cee7-4273-be5e-a82ae67cd65b tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Going to try to live migrate instance to n-h2-860687-3 {{(pid=127028) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 18:47:51.272294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-469a2a55-a51e-46ba-8a48-c895e06757fa tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e9c0b3a99d41a9ac42eb5a092be2c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e625a0c7d6544639b0066d000dc6794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:51.281679 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-469a2a55-a51e-46ba-8a48-c895e06757fa tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 200 len: 1313 microversion: 2.1 time: 0.675922 Oct 27 18:47:51.282261 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 391/782] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:50 2022] GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 1313 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:51.306818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-31282da8-c883-4e3a-920e-f85d4e53f1c5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:51.307835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-31282da8-c883-4e3a-920e-f85d4e53f1c5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c245477e-5ecc-4296-9557-8dfef9214334] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:51.323144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31282da8-c883-4e3a-920e-f85d4e53f1c5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:51.332327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31282da8-c883-4e3a-920e-f85d4e53f1c5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:51.335899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31282da8-c883-4e3a-920e-f85d4e53f1c5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:51.338153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31282da8-c883-4e3a-920e-f85d4e53f1c5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:51.340422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31282da8-c883-4e3a-920e-f85d4e53f1c5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:51.343537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31282da8-c883-4e3a-920e-f85d4e53f1c5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:51.393173 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-31282da8-c883-4e3a-920e-f85d4e53f1c5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] HTTP exception thrown: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-31282da8-c883-4e3a-920e-f85d4e53f1c5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Request method failure captured: Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 HTTP/1.1 Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtHJWWvDnGljVkhBePVOx7R_NC6Et3zM_JVghtIJ4pLIGPqEhycn49cJjd7U3YeqK1jItLjIx6zmEdIwjGfrb2L7D-Pljn4T3tuaJX9QpX9WGQ1tmiFZBEpa_JFw-i_5aAhTr5t5kzfDbTeyQI4c5qM6gXGWV9hborOdD2OJAc1CXVU Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f976057610c846c3b9caaf190a4abc89 Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:47:51.394929 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:47:51.396247 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f976057610c846c3b9caaf190a4abc89", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:51.396247 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:51.396247 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f976057610c846c3b9caaf190a4abc89 Oct 27 18:47:51.396247 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:51.396247 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersWithSpecificFlavorTestJSON-657034950-project Oct 27 18:47:51.396247 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:47:51.396247 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:47:51.396247 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 97a85e281f544f4aa49b27cd776c849a Oct 27 18:47:51.396247 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950-project Oct 27 18:47:51.396247 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:47:51.396247 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:51.396247 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'c245477e-5ecc-4296-9557-8dfef9214334'} Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:51.397016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. Oct 27 18:47:51.403417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:47:51.404604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-31282da8-c883-4e3a-920e-f85d4e53f1c5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Returning 404 to user: Instance c245477e-5ecc-4296-9557-8dfef9214334 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:51.404604 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-31282da8-c883-4e3a-920e-f85d4e53f1c5 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334" status: 404 len: 111 microversion: 2.1 time: 0.102145 Oct 27 18:47:51.406175 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 392/783] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:51 2022] GET /compute/v2.1/servers/c245477e-5ecc-4296-9557-8dfef9214334 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:47:51.420071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bf2ca983-3474-4781-b599-f7d5819e4097 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:51.421096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bf2ca983-3474-4781-b599-f7d5819e4097 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:51.445586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf2ca983-3474-4781-b599-f7d5819e4097 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:51.446430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf2ca983-3474-4781-b599-f7d5819e4097 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:51.447079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf2ca983-3474-4781-b599-f7d5819e4097 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:51.448346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf2ca983-3474-4781-b599-f7d5819e4097 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:51.449162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf2ca983-3474-4781-b599-f7d5819e4097 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:51.449888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf2ca983-3474-4781-b599-f7d5819e4097 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:51.619291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-bf2ca983-3474-4781-b599-f7d5819e4097 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:51.650752 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bf2ca983-3474-4781-b599-f7d5819e4097 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.243310 Oct 27 18:47:51.662248 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 393/784] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:51 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:51.667985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3488942b-d64b-4642-b5d4-045e5d8ad8ed tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Action: 'action', calling method: .version_select at 0x7fc870d7eaf0>, body: {"addFloatingIp": {"address": "172.25.9.174"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:51.670588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3488942b-d64b-4642-b5d4-045e5d8ad8ed tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:51.692216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3488942b-d64b-4642-b5d4-045e5d8ad8ed tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:51.692733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3488942b-d64b-4642-b5d4-045e5d8ad8ed tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:51.693188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3488942b-d64b-4642-b5d4-045e5d8ad8ed tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:51.693915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3488942b-d64b-4642-b5d4-045e5d8ad8ed tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:51.694399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3488942b-d64b-4642-b5d4-045e5d8ad8ed tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:51.694888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3488942b-d64b-4642-b5d4-045e5d8ad8ed tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:51.853165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3488942b-d64b-4642-b5d4-045e5d8ad8ed tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "refresh_cache-7f0356d2-73d5-47bb-a499-17b029d1dad1" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 18:47:51.853863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3488942b-d64b-4642-b5d4-045e5d8ad8ed tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquired lock "refresh_cache-7f0356d2-73d5-47bb-a499-17b029d1dad1" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 18:47:54.084683 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f8d0f05e-cee7-4273-be5e-a82ae67cd65b tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843/action" status: 202 len: 0 microversion: 2.25 time: 3.453514 Oct 27 18:47:54.086229 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 392/785] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 18:47:50 2022] POST /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843/action => generated 0 bytes in 3458 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:47:54.092625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-88247812-2d88-434a-9dae-6b26c025f10b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86ba62af0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:54.167136 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-88247812-2d88-434a-9dae-6b26c025f10b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae" status: 200 len: 1422 microversion: 2.1 time: 0.078987 Oct 27 18:47:54.177156 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 393/786] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:47:54 2022] GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:54.183907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-33d8a45c-7a3a-40ee-890d-88b645fbd040 req-36fb6a0a-eef9-4dfc-b490-dd01ee776e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3b19c1-802b-4c1e-9ac3-6f795e307b2d", "tag": "c2767add-2352-4e4a-b9c7-583a3ba6d7cf"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:54.195054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-33d8a45c-7a3a-40ee-890d-88b645fbd040 req-36fb6a0a-eef9-4dfc-b490-dd01ee776e1d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:54.196096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-33d8a45c-7a3a-40ee-890d-88b645fbd040 req-36fb6a0a-eef9-4dfc-b490-dd01ee776e1d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:54.196780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-33d8a45c-7a3a-40ee-890d-88b645fbd040 req-36fb6a0a-eef9-4dfc-b490-dd01ee776e1d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:54.218956 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-33d8a45c-7a3a-40ee-890d-88b645fbd040 req-36fb6a0a-eef9-4dfc-b490-dd01ee776e1d service nova] Creating event network-changed:c2767add-2352-4e4a-b9c7-583a3ba6d7cf for instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d on n-h2-860687-3 Oct 27 18:47:54.224526 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-33d8a45c-7a3a-40ee-890d-88b645fbd040 req-36fb6a0a-eef9-4dfc-b490-dd01ee776e1d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045643 Oct 27 18:47:54.225453 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 394/787] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:54.231475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-355257c0-8b36-4eb0-a0f9-6a8962bfc51d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:54.232471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-355257c0-8b36-4eb0-a0f9-6a8962bfc51d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:54.239500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-355257c0-8b36-4eb0-a0f9-6a8962bfc51d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:54.239988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-355257c0-8b36-4eb0-a0f9-6a8962bfc51d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:54.240900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-355257c0-8b36-4eb0-a0f9-6a8962bfc51d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:54.241406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-355257c0-8b36-4eb0-a0f9-6a8962bfc51d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:54.241981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-355257c0-8b36-4eb0-a0f9-6a8962bfc51d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:54.242547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-355257c0-8b36-4eb0-a0f9-6a8962bfc51d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:54.258533 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-355257c0-8b36-4eb0-a0f9-6a8962bfc51d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] HTTP exception thrown: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-355257c0-8b36-4eb0-a0f9-6a8962bfc51d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Request method failure captured: Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f HTTP/1.1 Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtHJWWvDnGljVkhBePVOx7R_NC6Et3zM_JVghtIJ4pLIGPqEhycn49cJjd7U3YeqK1jItLjIx6zmEdIwjGfrb2L7D-Pljn4T3tuaJX9QpX9WGQ1tmiFZBEpa_JFw-i_5aAhTr5t5kzfDbTeyQI4c5qM6gXGWV9hborOdD2OJAc1CXVU Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f976057610c846c3b9caaf190a4abc89 Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:47:54.260321 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:47:54.262512 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f976057610c846c3b9caaf190a4abc89", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:54.262512 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:54.262512 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f976057610c846c3b9caaf190a4abc89 Oct 27 18:47:54.262512 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:54.262512 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersWithSpecificFlavorTestJSON-657034950-project Oct 27 18:47:54.262512 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:47:54.262512 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:47:54.262512 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 97a85e281f544f4aa49b27cd776c849a Oct 27 18:47:54.262512 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950-project Oct 27 18:47:54.262512 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:47:54.262512 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:54.262512 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'c0ec313b-f165-450a-92ba-215e7989df1f'} Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:54.263338 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:54.264703 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:54.266022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-355257c0-8b36-4eb0-a0f9-6a8962bfc51d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Returning 404 to user: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:54.266947 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-355257c0-8b36-4eb0-a0f9-6a8962bfc51d tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 404 len: 111 microversion: 2.1 time: 0.040170 Oct 27 18:47:54.267631 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 395/788] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:47:54 2022] DELETE /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:47:54.275267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d21fffbc-4afb-4dcd-9238-a9e54aeec39b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:54.276113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d21fffbc-4afb-4dcd-9238-a9e54aeec39b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:54.282348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d21fffbc-4afb-4dcd-9238-a9e54aeec39b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:54.283984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d21fffbc-4afb-4dcd-9238-a9e54aeec39b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:54.284677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d21fffbc-4afb-4dcd-9238-a9e54aeec39b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:54.285620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d21fffbc-4afb-4dcd-9238-a9e54aeec39b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:54.286315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d21fffbc-4afb-4dcd-9238-a9e54aeec39b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:54.286884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d21fffbc-4afb-4dcd-9238-a9e54aeec39b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:54.468000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d21fffbc-4afb-4dcd-9238-a9e54aeec39b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:54.485642 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d21fffbc-4afb-4dcd-9238-a9e54aeec39b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1312 microversion: 2.1 time: 0.213992 Oct 27 18:47:54.486855 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 396/789] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:54 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1312 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:54.503513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-39b799db-43ad-43d1-842b-18b09b937445 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:54.504547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-39b799db-43ad-43d1-842b-18b09b937445 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:54.513465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39b799db-43ad-43d1-842b-18b09b937445 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:54.514405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39b799db-43ad-43d1-842b-18b09b937445 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:54.515004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39b799db-43ad-43d1-842b-18b09b937445 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:54.515960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39b799db-43ad-43d1-842b-18b09b937445 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:54.516759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39b799db-43ad-43d1-842b-18b09b937445 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:54.517346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39b799db-43ad-43d1-842b-18b09b937445 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:54.700080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-39b799db-43ad-43d1-842b-18b09b937445 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e9c0b3a99d41a9ac42eb5a092be2c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e625a0c7d6544639b0066d000dc6794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:54.708674 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-39b799db-43ad-43d1-842b-18b09b937445 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 200 len: 1313 microversion: 2.1 time: 0.220620 Oct 27 18:47:54.709893 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 397/790] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:54 2022] GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:54.715295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-bd7c7b88-66fa-4476-a17a-a961f9458b72 req-0ad403f1-eba8-482f-82be-3ba3998554be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15000861-ac47-42c5-a2c6-b22b490700e8", "tag": "a742b2fe-989c-4e19-b041-5847e5e2036d"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:54.725342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bd7c7b88-66fa-4476-a17a-a961f9458b72 req-0ad403f1-eba8-482f-82be-3ba3998554be service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:54.726060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bd7c7b88-66fa-4476-a17a-a961f9458b72 req-0ad403f1-eba8-482f-82be-3ba3998554be service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:54.726694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bd7c7b88-66fa-4476-a17a-a961f9458b72 req-0ad403f1-eba8-482f-82be-3ba3998554be service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:54.742836 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-bd7c7b88-66fa-4476-a17a-a961f9458b72 req-0ad403f1-eba8-482f-82be-3ba3998554be service nova] Creating event network-changed:a742b2fe-989c-4e19-b041-5847e5e2036d for instance 15000861-ac47-42c5-a2c6-b22b490700e8 on n-h2-860687-3 Oct 27 18:47:54.757452 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-bd7c7b88-66fa-4476-a17a-a961f9458b72 req-0ad403f1-eba8-482f-82be-3ba3998554be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046107 Oct 27 18:47:54.758161 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 398/791] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:54.765532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8c9244e1-8ea2-4b66-bac9-68f3cd96b507 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:54.766453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8c9244e1-8ea2-4b66-bac9-68f3cd96b507 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:54.772922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c9244e1-8ea2-4b66-bac9-68f3cd96b507 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:54.773594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c9244e1-8ea2-4b66-bac9-68f3cd96b507 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:54.774220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c9244e1-8ea2-4b66-bac9-68f3cd96b507 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:54.775263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c9244e1-8ea2-4b66-bac9-68f3cd96b507 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:54.775880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c9244e1-8ea2-4b66-bac9-68f3cd96b507 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:54.777007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c9244e1-8ea2-4b66-bac9-68f3cd96b507 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:54.859816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-8c9244e1-8ea2-4b66-bac9-68f3cd96b507 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:54.882338 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8c9244e1-8ea2-4b66-bac9-68f3cd96b507 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.121306 Oct 27 18:47:54.883471 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 399/792] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:54 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:54.888785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d8e7ab9b-b5c8-4ca1-b83c-847a9e9e3af6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:54.889635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d8e7ab9b-b5c8-4ca1-b83c-847a9e9e3af6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:54.895906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8e7ab9b-b5c8-4ca1-b83c-847a9e9e3af6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:54.896431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8e7ab9b-b5c8-4ca1-b83c-847a9e9e3af6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:54.896875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8e7ab9b-b5c8-4ca1-b83c-847a9e9e3af6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:54.897619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8e7ab9b-b5c8-4ca1-b83c-847a9e9e3af6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:54.898081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8e7ab9b-b5c8-4ca1-b83c-847a9e9e3af6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:54.898551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8e7ab9b-b5c8-4ca1-b83c-847a9e9e3af6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:54.906181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-3488942b-d64b-4642-b5d4-045e5d8ad8ed tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Building network info cache for instance {{(pid=127029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 18:47:55.083615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d8e7ab9b-b5c8-4ca1-b83c-847a9e9e3af6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:55.101234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d8e7ab9b-b5c8-4ca1-b83c-847a9e9e3af6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:55.102912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d8e7ab9b-b5c8-4ca1-b83c-847a9e9e3af6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:55.104244 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d8e7ab9b-b5c8-4ca1-b83c-847a9e9e3af6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1567 microversion: 2.25 time: 0.219632 Oct 27 18:47:55.106336 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 400/793] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:54 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:55.123896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-08e2c998-d4ef-4458-b45c-43fe183080b7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:55.124652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-08e2c998-d4ef-4458-b45c-43fe183080b7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] [instance: c0ec313b-f165-450a-92ba-215e7989df1f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:55.135666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08e2c998-d4ef-4458-b45c-43fe183080b7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:55.138875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08e2c998-d4ef-4458-b45c-43fe183080b7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:55.140146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08e2c998-d4ef-4458-b45c-43fe183080b7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:55.142101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08e2c998-d4ef-4458-b45c-43fe183080b7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:55.142863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08e2c998-d4ef-4458-b45c-43fe183080b7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:55.147581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08e2c998-d4ef-4458-b45c-43fe183080b7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:55.179776 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-08e2c998-d4ef-4458-b45c-43fe183080b7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] HTTP exception thrown: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-08e2c998-d4ef-4458-b45c-43fe183080b7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Request method failure captured: Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f HTTP/1.1 Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtHJWWvDnGljVkhBePVOx7R_NC6Et3zM_JVghtIJ4pLIGPqEhycn49cJjd7U3YeqK1jItLjIx6zmEdIwjGfrb2L7D-Pljn4T3tuaJX9QpX9WGQ1tmiFZBEpa_JFw-i_5aAhTr5t5kzfDbTeyQI4c5qM6gXGWV9hborOdD2OJAc1CXVU Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f976057610c846c3b9caaf190a4abc89 Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:47:55.181773 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:47:55.183876 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f976057610c846c3b9caaf190a4abc89", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f976057610c846c3b9caaf190a4abc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:47:55.183876 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:55.183876 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f976057610c846c3b9caaf190a4abc89 Oct 27 18:47:55.183876 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950 Oct 27 18:47:55.183876 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersWithSpecificFlavorTestJSON-657034950-project Oct 27 18:47:55.183876 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:47:55.183876 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:47:55.183876 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 97a85e281f544f4aa49b27cd776c849a Oct 27 18:47:55.183876 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-657034950-project Oct 27 18:47:55.183876 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:47:55.183876 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:55.183876 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'c0ec313b-f165-450a-92ba-215e7989df1f'} Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:47:55.184663 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. Oct 27 18:47:55.186040 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:47:55.191189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-08e2c998-d4ef-4458-b45c-43fe183080b7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] Returning 404 to user: Instance c0ec313b-f165-450a-92ba-215e7989df1f could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:47:55.192093 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-08e2c998-d4ef-4458-b45c-43fe183080b7 tempest-ServersWithSpecificFlavorTestJSON-657034950 tempest-ServersWithSpecificFlavorTestJSON-657034950-project] 10.222.0.42 "GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f" status: 404 len: 111 microversion: 2.1 time: 0.084491 Oct 27 18:47:55.192683 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 401/794] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:55 2022] GET /compute/v2.1/servers/c0ec313b-f165-450a-92ba-215e7989df1f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:47:55.205558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1405589824", "imageRef": "d1c0d816-1692-44c9-9544-2e1f24765fee", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7fac7d43-0adb-45c9-83f6-f0877e355a67"}], "security_groups": [{"name": "tempest-securitygroup--1846173268"}], "key_name": "tempest-keypair-923557536", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:55.505099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] validate_networks() for [('7fac7d43-0adb-45c9-83f6-f0877e355a67', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:47:56.106555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-3488942b-d64b-4642-b5d4-045e5d8ad8ed tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Updating instance_info_cache with network_info: [{"id": "1f181151-81f9-4cf5-a37c-a15ffbe32f2e", "address": "fa:16:3e:06:8b:3c", "network": {"id": "011a081f-3a1d-4a29-beeb-69b643eacdb0", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-346257061-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "154455c389be498e84dc3b0ca4e7ee30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1f181151-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 18:47:56.131101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3488942b-d64b-4642-b5d4-045e5d8ad8ed tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Releasing lock "refresh_cache-7f0356d2-73d5-47bb-a499-17b029d1dad1" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 18:47:56.133616 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3488942b-d64b-4642-b5d4-045e5d8ad8ed tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action" status: 202 len: 0 microversion: 2.1 time: 4.470107 Oct 27 18:47:56.134721 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 394/795] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:47:51 2022] POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action => generated 0 bytes in 4472 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 18:47:56.141795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b98d697b-707f-43c4-a5eb-a0ea61a7fd31 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b784e50>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:56.210730 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b98d697b-707f-43c4-a5eb-a0ea61a7fd31 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae" status: 200 len: 1422 microversion: 2.1 time: 0.074608 Oct 27 18:47:56.220704 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 395/796] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:47:56 2022] GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae => generated 1422 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:56.231728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d274c702-5e64-4a1f-a0f0-ff163063cb92 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:56.233158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d274c702-5e64-4a1f-a0f0-ff163063cb92 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:56.245001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d274c702-5e64-4a1f-a0f0-ff163063cb92 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:56.247235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d274c702-5e64-4a1f-a0f0-ff163063cb92 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:56.248574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d274c702-5e64-4a1f-a0f0-ff163063cb92 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:56.249604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d274c702-5e64-4a1f-a0f0-ff163063cb92 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:56.250293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d274c702-5e64-4a1f-a0f0-ff163063cb92 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:56.252300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d274c702-5e64-4a1f-a0f0-ff163063cb92 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:56.444831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d274c702-5e64-4a1f-a0f0-ff163063cb92 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:56.455239 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d274c702-5e64-4a1f-a0f0-ff163063cb92 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1312 microversion: 2.1 time: 0.232871 Oct 27 18:47:56.456659 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 396/797] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:56 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1312 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:56.461373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6ec400cc-6de2-49a6-a173-52afd3d2d338 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:56.462208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6ec400cc-6de2-49a6-a173-52afd3d2d338 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:56.468658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ec400cc-6de2-49a6-a173-52afd3d2d338 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:56.469426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ec400cc-6de2-49a6-a173-52afd3d2d338 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:56.470133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ec400cc-6de2-49a6-a173-52afd3d2d338 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:56.471049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ec400cc-6de2-49a6-a173-52afd3d2d338 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:56.471689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ec400cc-6de2-49a6-a173-52afd3d2d338 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:56.472296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ec400cc-6de2-49a6-a173-52afd3d2d338 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:56.491137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:56.552300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:47:56.552788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:47:56.553348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:47:56.554603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:47:56.566120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:47:56.584900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:56.585466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:56.586476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:56.587585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:56.588379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:56.589101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:56.617948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Getting quotas for project f935076689d74e1e9089d516caca1cc4. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:47:56.625601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Getting quotas for user 18ce178d2f1b40ecbf7dd294d7da4748 and project f935076689d74e1e9089d516caca1cc4. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:47:56.654816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:47:56.658169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1c0d816-1692-44c9-9544-2e1f24765fee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:47:56.697516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6ec400cc-6de2-49a6-a173-52afd3d2d338 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e9c0b3a99d41a9ac42eb5a092be2c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e625a0c7d6544639b0066d000dc6794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:56.708808 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6ec400cc-6de2-49a6-a173-52afd3d2d338 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 200 len: 1313 microversion: 2.1 time: 0.250918 Oct 27 18:47:56.725837 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 397/798] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:56 2022] GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:56.739449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-46d847d1-b6ca-4f69-b35d-709181f59c39 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:56.740673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-46d847d1-b6ca-4f69-b35d-709181f59c39 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:56.750285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46d847d1-b6ca-4f69-b35d-709181f59c39 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:56.751177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46d847d1-b6ca-4f69-b35d-709181f59c39 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:56.751866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46d847d1-b6ca-4f69-b35d-709181f59c39 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:56.752799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46d847d1-b6ca-4f69-b35d-709181f59c39 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:56.753472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46d847d1-b6ca-4f69-b35d-709181f59c39 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:56.754114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46d847d1-b6ca-4f69-b35d-709181f59c39 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:56.771196 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85e10bd5-ad89-47bc-bd35-739b63a6b0a8 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.575390 Oct 27 18:47:56.775624 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 402/799] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:47:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:47:56.789108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6ad2536b-b9e8-4a5d-a805-976c5bb49630 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:56.789877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6ad2536b-b9e8-4a5d-a805-976c5bb49630 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:56.807939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ad2536b-b9e8-4a5d-a805-976c5bb49630 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:56.808446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ad2536b-b9e8-4a5d-a805-976c5bb49630 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:56.813280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ad2536b-b9e8-4a5d-a805-976c5bb49630 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:56.814125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ad2536b-b9e8-4a5d-a805-976c5bb49630 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:56.823105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ad2536b-b9e8-4a5d-a805-976c5bb49630 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:56.824335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ad2536b-b9e8-4a5d-a805-976c5bb49630 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:56.903065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-46d847d1-b6ca-4f69-b35d-709181f59c39 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:47:56.939205 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-46d847d1-b6ca-4f69-b35d-709181f59c39 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1929 microversion: 2.75 time: 0.211651 Oct 27 18:47:56.941021 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 398/800] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:56 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1929 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:56.956304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9cd2ca7-07c7-4402-8580-4ee3f06537ba tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Action: 'create', calling method: .version_select at 0x7fc86b2925e0>, body: {"pool": "7df642ec-8467-4952-9b8b-a0179be2d86e"} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:57.342011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6ad2536b-b9e8-4a5d-a805-976c5bb49630 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:57.377806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6ad2536b-b9e8-4a5d-a805-976c5bb49630 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:57.381262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6ad2536b-b9e8-4a5d-a805-976c5bb49630 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:57.394499 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6ad2536b-b9e8-4a5d-a805-976c5bb49630 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1567 microversion: 2.25 time: 0.617496 Oct 27 18:47:57.395432 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 403/801] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:47:56 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1567 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:47:57.420214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c0e8f9c2-fd84-4af9-8dcd-bff610ca23cd req-dd12bd13-8315-4b12-83ad-525ca27d49b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0356d2-73d5-47bb-a499-17b029d1dad1", "tag": "1f181151-81f9-4cf5-a37c-a15ffbe32f2e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:47:57.445623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c0e8f9c2-fd84-4af9-8dcd-bff610ca23cd req-dd12bd13-8315-4b12-83ad-525ca27d49b1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:57.450601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c0e8f9c2-fd84-4af9-8dcd-bff610ca23cd req-dd12bd13-8315-4b12-83ad-525ca27d49b1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:57.455114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c0e8f9c2-fd84-4af9-8dcd-bff610ca23cd req-dd12bd13-8315-4b12-83ad-525ca27d49b1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:57.504261 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c0e8f9c2-fd84-4af9-8dcd-bff610ca23cd req-dd12bd13-8315-4b12-83ad-525ca27d49b1 service nova] Creating event network-changed:1f181151-81f9-4cf5-a37c-a15ffbe32f2e for instance 7f0356d2-73d5-47bb-a499-17b029d1dad1 on n-h1-860687-3 Oct 27 18:47:57.524566 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c0e8f9c2-fd84-4af9-8dcd-bff610ca23cd req-dd12bd13-8315-4b12-83ad-525ca27d49b1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125365 Oct 27 18:47:57.525760 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 404/802] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:47:57.540067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9daab7a4-cc25-4466-bae2-b9e274d5ceff tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:57.542847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9daab7a4-cc25-4466-bae2-b9e274d5ceff tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:58.231066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9daab7a4-cc25-4466-bae2-b9e274d5ceff tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:58.242632 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9daab7a4-cc25-4466-bae2-b9e274d5ceff tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1245 microversion: 2.1 time: 0.711595 Oct 27 18:47:58.244254 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 405/803] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:57 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1245 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:58.254704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d09c5ea2-000d-4c0a-b25c-7b90fdf2f73f tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b9cda60>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:58.416940 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d09c5ea2-000d-4c0a-b25c-7b90fdf2f73f tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae" status: 200 len: 1422 microversion: 2.1 time: 0.171174 Oct 27 18:47:58.420421 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 406/804] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:47:58 2022] GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae => generated 1422 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:58.434112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-15e5d98f-8b85-4db7-9377-4e9d14a2f8c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:58.440212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-15e5d98f-8b85-4db7-9377-4e9d14a2f8c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:58.448768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e5d98f-8b85-4db7-9377-4e9d14a2f8c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:58.449550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e5d98f-8b85-4db7-9377-4e9d14a2f8c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:58.450167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e5d98f-8b85-4db7-9377-4e9d14a2f8c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:58.451118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e5d98f-8b85-4db7-9377-4e9d14a2f8c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:58.451739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e5d98f-8b85-4db7-9377-4e9d14a2f8c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:58.452330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e5d98f-8b85-4db7-9377-4e9d14a2f8c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:59.097850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-15e5d98f-8b85-4db7-9377-4e9d14a2f8c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:47:59.118364 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-15e5d98f-8b85-4db7-9377-4e9d14a2f8c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1312 microversion: 2.1 time: 0.696669 Oct 27 18:47:59.127571 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 407/805] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:58 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1312 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:47:59.138274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4a1a84c1-d408-4ba3-b2cf-3ed2ae5c8b5b tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:47:59.141111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4a1a84c1-d408-4ba3-b2cf-3ed2ae5c8b5b tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:47:59.148115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a1a84c1-d408-4ba3-b2cf-3ed2ae5c8b5b tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:59.150228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a1a84c1-d408-4ba3-b2cf-3ed2ae5c8b5b tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:59.150956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a1a84c1-d408-4ba3-b2cf-3ed2ae5c8b5b tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:59.152631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a1a84c1-d408-4ba3-b2cf-3ed2ae5c8b5b tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:47:59.153641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a1a84c1-d408-4ba3-b2cf-3ed2ae5c8b5b tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:47:59.154623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a1a84c1-d408-4ba3-b2cf-3ed2ae5c8b5b tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:47:59.161516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=16 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:47:59.180920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:00.039128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4a1a84c1-d408-4ba3-b2cf-3ed2ae5c8b5b tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e9c0b3a99d41a9ac42eb5a092be2c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e625a0c7d6544639b0066d000dc6794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:00.049336 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4a1a84c1-d408-4ba3-b2cf-3ed2ae5c8b5b tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 200 len: 1313 microversion: 2.1 time: 0.920008 Oct 27 18:48:00.050523 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 408/806] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:47:59 2022] GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 1313 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:00.066795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-40e9528d-3315-42d8-aa15-e66e00a29037 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:00.067423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-40e9528d-3315-42d8-aa15-e66e00a29037 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:00.077549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40e9528d-3315-42d8-aa15-e66e00a29037 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:00.078055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40e9528d-3315-42d8-aa15-e66e00a29037 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:00.078547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40e9528d-3315-42d8-aa15-e66e00a29037 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:00.079280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40e9528d-3315-42d8-aa15-e66e00a29037 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:00.079743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40e9528d-3315-42d8-aa15-e66e00a29037 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:00.080180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40e9528d-3315-42d8-aa15-e66e00a29037 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:00.262489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-40e9528d-3315-42d8-aa15-e66e00a29037 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:48:00.309441 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-40e9528d-3315-42d8-aa15-e66e00a29037 tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1935 microversion: 2.75 time: 0.252857 Oct 27 18:48:00.315013 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 409/807] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:00 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1935 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:00.329035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ada76029-3627-4a62-bd64-bca5d505b4cd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:00.330058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ada76029-3627-4a62-bd64-bca5d505b4cd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:00.357354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ada76029-3627-4a62-bd64-bca5d505b4cd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:00.359276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ada76029-3627-4a62-bd64-bca5d505b4cd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:00.360002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ada76029-3627-4a62-bd64-bca5d505b4cd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:00.361834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ada76029-3627-4a62-bd64-bca5d505b4cd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:00.362539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ada76029-3627-4a62-bd64-bca5d505b4cd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:00.363274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ada76029-3627-4a62-bd64-bca5d505b4cd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:00.909814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ada76029-3627-4a62-bd64-bca5d505b4cd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:00.924979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ada76029-3627-4a62-bd64-bca5d505b4cd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:00.935301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ada76029-3627-4a62-bd64-bca5d505b4cd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:00.936792 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ada76029-3627-4a62-bd64-bca5d505b4cd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1567 microversion: 2.25 time: 0.620179 Oct 27 18:48:00.937489 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 410/808] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:00 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1567 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:00.943012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7f83e135-b69f-44bf-a5fc-2282cfba61bd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:00.949145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7f83e135-b69f-44bf-a5fc-2282cfba61bd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:00.965125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f83e135-b69f-44bf-a5fc-2282cfba61bd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:00.965721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f83e135-b69f-44bf-a5fc-2282cfba61bd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:00.966309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f83e135-b69f-44bf-a5fc-2282cfba61bd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:00.968848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f83e135-b69f-44bf-a5fc-2282cfba61bd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:00.968848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f83e135-b69f-44bf-a5fc-2282cfba61bd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:00.968848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f83e135-b69f-44bf-a5fc-2282cfba61bd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:01.157110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7f83e135-b69f-44bf-a5fc-2282cfba61bd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:01.166627 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7f83e135-b69f-44bf-a5fc-2282cfba61bd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1303 microversion: 2.1 time: 0.227843 Oct 27 18:48:01.182306 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 411/809] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:00 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1303 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:01.182306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c95169fa-bc99-47dc-afdb-c7930709e26f tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b4b6b80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:01.599537 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c9cd2ca7-07c7-4402-8580-4ee3f06537ba tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.655947 Oct 27 18:48:01.600712 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 399/810] 10.222.0.42 () {60 vars in 1170 bytes} [Thu Oct 27 18:47:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:01.611856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5a216734-9b0a-4463-b765-eb500c48a5bf req-0d187ea0-a7f5-4761-b4f4-86d4f11f9029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3b19c1-802b-4c1e-9ac3-6f795e307b2d", "name": "network-vif-plugged", "status": "completed", "tag": "c2767add-2352-4e4a-b9c7-583a3ba6d7cf"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:01.685366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5a216734-9b0a-4463-b765-eb500c48a5bf req-0d187ea0-a7f5-4761-b4f4-86d4f11f9029 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:01.704768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5a216734-9b0a-4463-b765-eb500c48a5bf req-0d187ea0-a7f5-4761-b4f4-86d4f11f9029 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:01.707370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5a216734-9b0a-4463-b765-eb500c48a5bf req-0d187ea0-a7f5-4761-b4f4-86d4f11f9029 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:01.779047 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5a216734-9b0a-4463-b765-eb500c48a5bf req-0d187ea0-a7f5-4761-b4f4-86d4f11f9029 service nova] Creating event network-vif-plugged:c2767add-2352-4e4a-b9c7-583a3ba6d7cf for instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d on n-h2-860687-3 Oct 27 18:48:01.827381 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5a216734-9b0a-4463-b765-eb500c48a5bf req-0d187ea0-a7f5-4761-b4f4-86d4f11f9029 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224931 Oct 27 18:48:01.828570 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 400/811] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:01.852311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-543caaac-f3a6-4cd5-a07b-ef6356e169b2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:01.853282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-543caaac-f3a6-4cd5-a07b-ef6356e169b2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:01.874444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-543caaac-f3a6-4cd5-a07b-ef6356e169b2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:01.876951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-543caaac-f3a6-4cd5-a07b-ef6356e169b2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:01.878146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-543caaac-f3a6-4cd5-a07b-ef6356e169b2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:01.881549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-543caaac-f3a6-4cd5-a07b-ef6356e169b2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:01.882625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-543caaac-f3a6-4cd5-a07b-ef6356e169b2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:01.885209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-543caaac-f3a6-4cd5-a07b-ef6356e169b2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:01.906132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:02.429120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-543caaac-f3a6-4cd5-a07b-ef6356e169b2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:02.438012 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-543caaac-f3a6-4cd5-a07b-ef6356e169b2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1312 microversion: 2.1 time: 0.607857 Oct 27 18:48:02.451604 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 401/812] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:01 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1312 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:02.468194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e657e1e2-dcac-47cc-9e24-82f328815e22 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:02.469114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e657e1e2-dcac-47cc-9e24-82f328815e22 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:02.478493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e657e1e2-dcac-47cc-9e24-82f328815e22 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:02.482930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e657e1e2-dcac-47cc-9e24-82f328815e22 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:02.484776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e657e1e2-dcac-47cc-9e24-82f328815e22 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:02.490773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e657e1e2-dcac-47cc-9e24-82f328815e22 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:02.492799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e657e1e2-dcac-47cc-9e24-82f328815e22 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:02.496330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e657e1e2-dcac-47cc-9e24-82f328815e22 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:02.985234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e657e1e2-dcac-47cc-9e24-82f328815e22 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e9c0b3a99d41a9ac42eb5a092be2c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e625a0c7d6544639b0066d000dc6794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:02.993412 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e657e1e2-dcac-47cc-9e24-82f328815e22 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 200 len: 1313 microversion: 2.1 time: 0.538130 Oct 27 18:48:02.993995 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 402/813] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:02 2022] GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:03.002454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-460683c0-81e5-46bb-968d-ad8ff44e0b8a tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:03.007134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-460683c0-81e5-46bb-968d-ad8ff44e0b8a tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:03.016065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:03.024110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-460683c0-81e5-46bb-968d-ad8ff44e0b8a tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:03.025537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-460683c0-81e5-46bb-968d-ad8ff44e0b8a tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:03.026142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-460683c0-81e5-46bb-968d-ad8ff44e0b8a tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:03.027618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-460683c0-81e5-46bb-968d-ad8ff44e0b8a tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:03.032293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-460683c0-81e5-46bb-968d-ad8ff44e0b8a tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:03.033099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-460683c0-81e5-46bb-968d-ad8ff44e0b8a tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:03.279818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-460683c0-81e5-46bb-968d-ad8ff44e0b8a tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] Lazy-loading 'services' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:48:03.331581 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-460683c0-81e5-46bb-968d-ad8ff44e0b8a tempest-ServersAdmin275Test-1480401687 tempest-ServersAdmin275Test-1480401687-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1920 microversion: 2.75 time: 0.332552 Oct 27 18:48:03.334679 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 403/814] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:02 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1920 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:03.344210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.115"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:03.347036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:03.362666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:03.363630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:03.364309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:03.365450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:03.366259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:03.366915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:03.404133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "refresh_cache-7f0356d2-73d5-47bb-a499-17b029d1dad1" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 18:48:03.404534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquired lock "refresh_cache-7f0356d2-73d5-47bb-a499-17b029d1dad1" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 18:48:05.122993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.115 (9a52f966-51c1-42c3-a6ca-afd1db377c3f) with port 1f181151-81f9-4cf5-a37c-a15ffbe32f2e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 7df642ec-8467-4952-9b8b-a0179be2d86e.", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:48:05.124528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Releasing lock "refresh_cache-7f0356d2-73d5-47bb-a499-17b029d1dad1" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 18:48:05.125798 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.115 (9a52f966-51c1-42c3-a6ca-afd1db377c3f) with port 1f181151-81f9-4cf5-a37c-a15ffbe32f2e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 7df642ec-8467-4952-9b8b-a0179be2d86e. Oct 27 18:48:05.125798 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-bcea0a77-34af-445c-9bf3-3d74c612709e'] Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Request method failure captured: Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action HTTP/1.1 Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 46 Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtI-h48urHHPiNpbikDIR2FBJhWuMrtfuBNwB4zWb_lMw6Q8UiTlNiUnllkkl8vg-rFSP5fc4IzEXLiISJy7IbZf6kiWgJT53nuhM-mzjQfl5ZQM142h3AqegI1P7JzoTHHFO-gWoQW42gVcqjjp_-fku_dWUiGALN2HGTtqlqZQhxE Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 154455c389be498e84dc3b0ca4e7ee30 Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:48:05.131502 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:48:05.132914 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_154455c389be498e84dc3b0ca4e7ee30", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:48:05.132914 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:05.132914 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 154455c389be498e84dc3b0ca4e7ee30 Oct 27 18:48:05.132914 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:05.132914 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project Oct 27 18:48:05.132914 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:48:05.132914 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:48:05.132914 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 1ea78f6cb7bb4974a7d61d015b6a2faf Oct 27 18:48:05.132914 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project Oct 27 18:48:05.132914 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:48:05.132914 n-d-860687-3 devstack@n-api.service[127029]: {"addFloatingIp": {"address": "172.25.9.115"}} Oct 27 18:48:05.132914 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: exception: Cannot associate floating IP 172.25.9.115 (9a52f966-51c1-42c3-a6ca-afd1db377c3f) with port 1f181151-81f9-4cf5-a37c-a15ffbe32f2e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 7df642ec-8467-4952-9b8b-a0179be2d86e. Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-bcea0a77-34af-445c-9bf3-3d74c612709e'] Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '7f0356d2-73d5-47bb-a499-17b029d1dad1', 'body': {'addFloatingIp': {'address': '172.25.9.115'}}} Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:48:05.133713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:48:05.134776 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.115 (9a52f966-51c1-42c3-a6ca-afd1db377c3f) with port 1f181151-81f9-4cf5-a37c-a15ffbe32f2e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 7df642ec-8467-4952-9b8b-a0179be2d86e. Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcea0a77-34af-445c-9bf3-3d74c612709e'] Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.115 (9a52f966-51c1-42c3-a6ca-afd1db377c3f) with port 1f181151-81f9-4cf5-a37c-a15ffbe32f2e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 7df642ec-8467-4952-9b8b-a0179be2d86e. Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcea0a77-34af-445c-9bf3-3d74c612709e'] Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:05.135737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.115 (9a52f966-51c1-42c3-a6ca-afd1db377c3f) with port 1f181151-81f9-4cf5-a37c-a15ffbe32f2e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 7df642ec-8467-4952-9b8b-a0179be2d86e. Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcea0a77-34af-445c-9bf3-3d74c612709e'] Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:05.136706 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:05.137775 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:05.137775 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:05.137775 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:05.137775 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:05.137775 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:48:05.137775 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:48:05.137775 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.115 (9a52f966-51c1-42c3-a6ca-afd1db377c3f) with port 1f181151-81f9-4cf5-a37c-a15ffbe32f2e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 7df642ec-8467-4952-9b8b-a0179be2d86e. Oct 27 18:48:05.137775 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcea0a77-34af-445c-9bf3-3d74c612709e'] Oct 27 18:48:05.137775 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:05.147279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Returning 400 to user: Cannot associate floating IP 172.25.9.115 (9a52f966-51c1-42c3-a6ca-afd1db377c3f) with port 1f181151-81f9-4cf5-a37c-a15ffbe32f2e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 7df642ec-8467-4952-9b8b-a0179be2d86e. Oct 27 18:48:05.147279 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-bcea0a77-34af-445c-9bf3-3d74c612709e'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:48:05.150644 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c6b41670-e3b4-493b-9a69-c4dec9f9903f tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action" status: 400 len: 381 microversion: 2.1 time: 1.810252 Oct 27 18:48:05.156836 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 404/815] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:48:03 2022] POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action => generated 381 bytes in 1821 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:48:05.168770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-074087ef-4b02-499b-99a1-e00effd296da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:05.172217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-074087ef-4b02-499b-99a1-e00effd296da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:05.186322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-074087ef-4b02-499b-99a1-e00effd296da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:05.187132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-074087ef-4b02-499b-99a1-e00effd296da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:05.191110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-074087ef-4b02-499b-99a1-e00effd296da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:05.192309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-074087ef-4b02-499b-99a1-e00effd296da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:05.193013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-074087ef-4b02-499b-99a1-e00effd296da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:05.193771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-074087ef-4b02-499b-99a1-e00effd296da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:05.517652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-074087ef-4b02-499b-99a1-e00effd296da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:05.529146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-074087ef-4b02-499b-99a1-e00effd296da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:05.530680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-074087ef-4b02-499b-99a1-e00effd296da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:05.534667 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-074087ef-4b02-499b-99a1-e00effd296da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1567 microversion: 2.25 time: 0.375248 Oct 27 18:48:05.539524 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 405/816] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:05 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1567 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:05.545747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eaca7c72-94d0-4a4c-a821-22c42220cf98 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:05.548561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-eaca7c72-94d0-4a4c-a821-22c42220cf98 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:05.574574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaca7c72-94d0-4a4c-a821-22c42220cf98 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:05.575449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaca7c72-94d0-4a4c-a821-22c42220cf98 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:05.576143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaca7c72-94d0-4a4c-a821-22c42220cf98 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:05.577169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaca7c72-94d0-4a4c-a821-22c42220cf98 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:05.584378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaca7c72-94d0-4a4c-a821-22c42220cf98 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:05.585090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaca7c72-94d0-4a4c-a821-22c42220cf98 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:05.910423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-eaca7c72-94d0-4a4c-a821-22c42220cf98 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:05.929486 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eaca7c72-94d0-4a4c-a821-22c42220cf98 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1371 microversion: 2.1 time: 0.386593 Oct 27 18:48:05.930369 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 406/817] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:05 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1371 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:05.945147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-c2e3226f-6915-494e-ba88-9682eefe05c9 req-6052b2ff-74e9-437a-af53-4c995bc1b073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293448e8-0911-4074-a5d0-d9ff98094843", "name": "network-vif-unplugged", "status": "completed", "tag": "e5835307-83a9-4b59-8ccd-63bd95493e8c"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:05.977143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c2e3226f-6915-494e-ba88-9682eefe05c9 req-6052b2ff-74e9-437a-af53-4c995bc1b073 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:05.977928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c2e3226f-6915-494e-ba88-9682eefe05c9 req-6052b2ff-74e9-437a-af53-4c995bc1b073 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:05.978631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c2e3226f-6915-494e-ba88-9682eefe05c9 req-6052b2ff-74e9-437a-af53-4c995bc1b073 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:05.998748 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-c2e3226f-6915-494e-ba88-9682eefe05c9 req-6052b2ff-74e9-437a-af53-4c995bc1b073 service nova] Creating event network-vif-unplugged:e5835307-83a9-4b59-8ccd-63bd95493e8c for instance 293448e8-0911-4074-a5d0-d9ff98094843 on n-h1-860687-3 Oct 27 18:48:06.006299 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-c2e3226f-6915-494e-ba88-9682eefe05c9 req-6052b2ff-74e9-437a-af53-4c995bc1b073 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072309 Oct 27 18:48:06.006942 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 407/818] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:06.016342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9482b040-fcac-4de6-bf78-59bda196a80d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:06.016946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9482b040-fcac-4de6-bf78-59bda196a80d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:06.046319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9482b040-fcac-4de6-bf78-59bda196a80d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:06.046850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9482b040-fcac-4de6-bf78-59bda196a80d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:06.047292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9482b040-fcac-4de6-bf78-59bda196a80d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:06.048013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9482b040-fcac-4de6-bf78-59bda196a80d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:06.048469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9482b040-fcac-4de6-bf78-59bda196a80d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:06.048901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9482b040-fcac-4de6-bf78-59bda196a80d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:06.122784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9482b040-fcac-4de6-bf78-59bda196a80d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:48:06.286737 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9482b040-fcac-4de6-bf78-59bda196a80d tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "DELETE /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 204 len: 0 microversion: 2.75 time: 0.276956 Oct 27 18:48:06.292576 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 408/819] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:48:06 2022] DELETE /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 18:48:06.300065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2ea019be-2bdc-464a-829d-c032b019bcb3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:06.301679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2ea019be-2bdc-464a-829d-c032b019bcb3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:06.311526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea019be-2bdc-464a-829d-c032b019bcb3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:06.312756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea019be-2bdc-464a-829d-c032b019bcb3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:06.313985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea019be-2bdc-464a-829d-c032b019bcb3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:06.315455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea019be-2bdc-464a-829d-c032b019bcb3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:06.317957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea019be-2bdc-464a-829d-c032b019bcb3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:06.318441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea019be-2bdc-464a-829d-c032b019bcb3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:06.609168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:06.658789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2ea019be-2bdc-464a-829d-c032b019bcb3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:06.673713 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2ea019be-2bdc-464a-829d-c032b019bcb3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1461 microversion: 2.1 time: 0.378828 Oct 27 18:48:06.679741 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 409/820] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:06 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1461 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:06.685376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ad4941a5-84a1-4449-a8fd-ba37ab79331a tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:06.692228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ad4941a5-84a1-4449-a8fd-ba37ab79331a tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:06.703401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad4941a5-84a1-4449-a8fd-ba37ab79331a tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:06.704183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad4941a5-84a1-4449-a8fd-ba37ab79331a tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:06.707968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad4941a5-84a1-4449-a8fd-ba37ab79331a tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:06.708901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad4941a5-84a1-4449-a8fd-ba37ab79331a tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:06.709540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad4941a5-84a1-4449-a8fd-ba37ab79331a tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:06.710142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad4941a5-84a1-4449-a8fd-ba37ab79331a tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:07.174979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ad4941a5-84a1-4449-a8fd-ba37ab79331a tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e9c0b3a99d41a9ac42eb5a092be2c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e625a0c7d6544639b0066d000dc6794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:07.186954 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ad4941a5-84a1-4449-a8fd-ba37ab79331a tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 200 len: 1313 microversion: 2.1 time: 0.505392 Oct 27 18:48:07.190528 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 410/821] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:06 2022] GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:07.199651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-32492968-29de-4bf5-a085-940183b3ac57 req-c3d0f593-7ceb-4cc8-a66e-32998d50437e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15000861-ac47-42c5-a2c6-b22b490700e8", "name": "network-vif-plugged", "status": "completed", "tag": "a742b2fe-989c-4e19-b041-5847e5e2036d"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:07.217489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-32492968-29de-4bf5-a085-940183b3ac57 req-c3d0f593-7ceb-4cc8-a66e-32998d50437e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:07.218723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-32492968-29de-4bf5-a085-940183b3ac57 req-c3d0f593-7ceb-4cc8-a66e-32998d50437e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:07.219849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-32492968-29de-4bf5-a085-940183b3ac57 req-c3d0f593-7ceb-4cc8-a66e-32998d50437e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:07.236768 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-32492968-29de-4bf5-a085-940183b3ac57 req-c3d0f593-7ceb-4cc8-a66e-32998d50437e service nova] Creating event network-vif-plugged:a742b2fe-989c-4e19-b041-5847e5e2036d for instance 15000861-ac47-42c5-a2c6-b22b490700e8 on n-h2-860687-3 Oct 27 18:48:07.245824 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-32492968-29de-4bf5-a085-940183b3ac57 req-c3d0f593-7ceb-4cc8-a66e-32998d50437e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052454 Oct 27 18:48:07.247234 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 411/822] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:07.255150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f6fcc922-ba35-47bb-8e9d-a075b24846a9 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '.version_select at 0x7fc86b0730d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:07.398919 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c95169fa-bc99-47dc-afdb-c7930709e26f tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae" status: 200 len: 1431 microversion: 2.1 time: 6.227860 Oct 27 18:48:07.399733 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 412/823] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:01 2022] GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae => generated 1431 bytes in 6229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:07.421481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ae69b939-9f39-417d-a90c-b7230823d117 req-69cadafb-8b25-49c5-a2f1-7fb9872ecfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52680d12-70da-485a-b4a1-172a49b7b959", "tag": "139bf86c-c95b-4317-8732-1c00618e5db8"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:07.435303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ae69b939-9f39-417d-a90c-b7230823d117 req-69cadafb-8b25-49c5-a2f1-7fb9872ecfd7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:07.436090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ae69b939-9f39-417d-a90c-b7230823d117 req-69cadafb-8b25-49c5-a2f1-7fb9872ecfd7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:07.436693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ae69b939-9f39-417d-a90c-b7230823d117 req-69cadafb-8b25-49c5-a2f1-7fb9872ecfd7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:07.454984 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ae69b939-9f39-417d-a90c-b7230823d117 req-69cadafb-8b25-49c5-a2f1-7fb9872ecfd7 service nova] Creating event network-changed:139bf86c-c95b-4317-8732-1c00618e5db8 for instance 52680d12-70da-485a-b4a1-172a49b7b959 on n-h1-860687-3 Oct 27 18:48:07.463446 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ae69b939-9f39-417d-a90c-b7230823d117 req-69cadafb-8b25-49c5-a2f1-7fb9872ecfd7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061354 Oct 27 18:48:07.464537 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 413/824] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:07.472614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9736e3d0-163b-4a71-ae0c-11195becd5b6 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:07.473540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9736e3d0-163b-4a71-ae0c-11195becd5b6 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:07.481533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9736e3d0-163b-4a71-ae0c-11195becd5b6 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:07.482375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9736e3d0-163b-4a71-ae0c-11195becd5b6 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:07.483763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9736e3d0-163b-4a71-ae0c-11195becd5b6 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:07.484964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9736e3d0-163b-4a71-ae0c-11195becd5b6 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:07.485623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9736e3d0-163b-4a71-ae0c-11195becd5b6 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:07.486220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9736e3d0-163b-4a71-ae0c-11195becd5b6 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:07.571983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9736e3d0-163b-4a71-ae0c-11195becd5b6 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:07.595942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9736e3d0-163b-4a71-ae0c-11195becd5b6 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:07.599087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9736e3d0-163b-4a71-ae0c-11195becd5b6 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:07.612991 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9736e3d0-163b-4a71-ae0c-11195becd5b6 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1444 microversion: 2.75 time: 0.146319 Oct 27 18:48:07.619546 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 414/825] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:07 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:07.626243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-df50a7eb-2c63-4373-9b2c-8328a97d1504 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:07.630289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-df50a7eb-2c63-4373-9b2c-8328a97d1504 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:07.641161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df50a7eb-2c63-4373-9b2c-8328a97d1504 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:07.644276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df50a7eb-2c63-4373-9b2c-8328a97d1504 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:07.644915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df50a7eb-2c63-4373-9b2c-8328a97d1504 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:07.646006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df50a7eb-2c63-4373-9b2c-8328a97d1504 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:07.650615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df50a7eb-2c63-4373-9b2c-8328a97d1504 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:07.651919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df50a7eb-2c63-4373-9b2c-8328a97d1504 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:07.921250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-df50a7eb-2c63-4373-9b2c-8328a97d1504 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:07.930700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-df50a7eb-2c63-4373-9b2c-8328a97d1504 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:07.934783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-df50a7eb-2c63-4373-9b2c-8328a97d1504 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:07.936557 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-df50a7eb-2c63-4373-9b2c-8328a97d1504 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1567 microversion: 2.25 time: 0.315035 Oct 27 18:48:07.937690 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 415/826] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:07 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1567 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:07.943020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:07.945586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:07.952928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:07.953747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:07.954423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:07.955374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:07.956044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:07.956846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:08.060375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:08.067515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Old instance type m1.heat2, new instance type m1.heat {{(pid=127028) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 18:48:08.075864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:48:08.076407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:48:08.076805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:48:08.077173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:48:08.077597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:48:08.233159 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ad6dec1-d471-4be5-8b00-6484b72b568e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "POST /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d/action" status: 202 len: 0 microversion: 2.1 time: 0.293998 Oct 27 18:48:08.233991 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 416/827] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:48:07 2022] POST /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:48:08.239657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=12 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:08.254496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b984aab6-432b-4776-8446-5df14ee1da27 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:08.256671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b984aab6-432b-4776-8446-5df14ee1da27 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:08.263519 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f6fcc922-ba35-47bb-8e9d-a075b24846a9 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/9a52f966-51c1-42c3-a6ca-afd1db377c3f" status: 202 len: 0 microversion: 2.1 time: 1.014737 Oct 27 18:48:08.267951 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 412/828] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 18:48:07 2022] DELETE /compute/v2.1/os-floating-ips/9a52f966-51c1-42c3-a6ca-afd1db377c3f => generated 0 bytes in 1020 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:48:08.269509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b984aab6-432b-4776-8446-5df14ee1da27 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:08.270422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b984aab6-432b-4776-8446-5df14ee1da27 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:08.272057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b984aab6-432b-4776-8446-5df14ee1da27 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:08.272945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b984aab6-432b-4776-8446-5df14ee1da27 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:08.273421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b984aab6-432b-4776-8446-5df14ee1da27 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:08.273865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b984aab6-432b-4776-8446-5df14ee1da27 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:08.275082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-714d42a6-386a-42a3-9dd6-c28c8d891bfe tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc876678b80>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:08.336002 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-714d42a6-386a-42a3-9dd6-c28c8d891bfe tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae" status: 200 len: 1431 microversion: 2.1 time: 0.066336 Oct 27 18:48:08.336869 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 413/829] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:08 2022] GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae => generated 1431 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:08.343920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ad49b6d0-588d-4a7b-b7c0-317ba2caea11 req-7d785581-7358-4114-9567-fd67fc21ef6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "293448e8-0911-4074-a5d0-d9ff98094843", "tag": "e5835307-83a9-4b59-8ccd-63bd95493e8c"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:08.355336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ad49b6d0-588d-4a7b-b7c0-317ba2caea11 req-7d785581-7358-4114-9567-fd67fc21ef6a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:08.356335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ad49b6d0-588d-4a7b-b7c0-317ba2caea11 req-7d785581-7358-4114-9567-fd67fc21ef6a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:08.357011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ad49b6d0-588d-4a7b-b7c0-317ba2caea11 req-7d785581-7358-4114-9567-fd67fc21ef6a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:08.369416 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ad49b6d0-588d-4a7b-b7c0-317ba2caea11 req-7d785581-7358-4114-9567-fd67fc21ef6a service nova] Creating event network-changed:e5835307-83a9-4b59-8ccd-63bd95493e8c for instance 293448e8-0911-4074-a5d0-d9ff98094843 on n-h1-860687-3 Oct 27 18:48:08.386617 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ad49b6d0-588d-4a7b-b7c0-317ba2caea11 req-7d785581-7358-4114-9567-fd67fc21ef6a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047887 Oct 27 18:48:08.388089 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 414/830] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:08.402323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b9cab80e-58b2-4c25-93dc-39f35552900d tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:08.403176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b9cab80e-58b2-4c25-93dc-39f35552900d tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:08.411297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9cab80e-58b2-4c25-93dc-39f35552900d tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:08.412046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9cab80e-58b2-4c25-93dc-39f35552900d tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:08.412692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9cab80e-58b2-4c25-93dc-39f35552900d tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:08.413630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9cab80e-58b2-4c25-93dc-39f35552900d tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:08.414259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9cab80e-58b2-4c25-93dc-39f35552900d tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:08.414736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9cab80e-58b2-4c25-93dc-39f35552900d tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:08.520243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b984aab6-432b-4776-8446-5df14ee1da27 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:08.535163 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b984aab6-432b-4776-8446-5df14ee1da27 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1371 microversion: 2.1 time: 0.294704 Oct 27 18:48:08.543466 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 417/831] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:08 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:08.550510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a68778ac-30a8-458a-be86-6267734d2626 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:08.551745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a68778ac-30a8-458a-be86-6267734d2626 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:08.576666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a68778ac-30a8-458a-be86-6267734d2626 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:08.577172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a68778ac-30a8-458a-be86-6267734d2626 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:08.582715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a68778ac-30a8-458a-be86-6267734d2626 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:08.583825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a68778ac-30a8-458a-be86-6267734d2626 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:08.584504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a68778ac-30a8-458a-be86-6267734d2626 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:08.585103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a68778ac-30a8-458a-be86-6267734d2626 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:09.207498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b9cab80e-58b2-4c25-93dc-39f35552900d tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e9c0b3a99d41a9ac42eb5a092be2c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e625a0c7d6544639b0066d000dc6794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:09.239576 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b9cab80e-58b2-4c25-93dc-39f35552900d tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 200 len: 1313 microversion: 2.1 time: 0.848526 Oct 27 18:48:09.241637 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 415/832] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:08 2022] GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 1313 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:09.272675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-39290019-62dd-4ac6-9ea5-5721d71209fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Action: 'action', calling method: .version_select at 0x7fc870d7ec10>, body: {"removeFloatingIp": {"address": "172.25.9.174"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:09.482281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a68778ac-30a8-458a-be86-6267734d2626 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:09.507931 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a68778ac-30a8-458a-be86-6267734d2626 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1470 microversion: 2.1 time: 0.947826 Oct 27 18:48:09.509732 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 418/833] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:08 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1470 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:09.521239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-33142c3e-ca5a-4bf5-ac5d-89fbfe612ec5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:09.526008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-33142c3e-ca5a-4bf5-ac5d-89fbfe612ec5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:09.552096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33142c3e-ca5a-4bf5-ac5d-89fbfe612ec5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:09.556991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33142c3e-ca5a-4bf5-ac5d-89fbfe612ec5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:09.560223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33142c3e-ca5a-4bf5-ac5d-89fbfe612ec5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:09.561255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33142c3e-ca5a-4bf5-ac5d-89fbfe612ec5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:09.562610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33142c3e-ca5a-4bf5-ac5d-89fbfe612ec5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:09.575897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33142c3e-ca5a-4bf5-ac5d-89fbfe612ec5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:10.177036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-39290019-62dd-4ac6-9ea5-5721d71209fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:10.183581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39290019-62dd-4ac6-9ea5-5721d71209fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:10.184419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39290019-62dd-4ac6-9ea5-5721d71209fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:10.185122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39290019-62dd-4ac6-9ea5-5721d71209fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:10.190684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39290019-62dd-4ac6-9ea5-5721d71209fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:10.191457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39290019-62dd-4ac6-9ea5-5721d71209fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:10.192054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39290019-62dd-4ac6-9ea5-5721d71209fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:10.612914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-33142c3e-ca5a-4bf5-ac5d-89fbfe612ec5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:10.624332 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-33142c3e-ca5a-4bf5-ac5d-89fbfe612ec5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1466 microversion: 2.1 time: 1.111905 Oct 27 18:48:10.633173 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 419/834] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:09 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1466 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:10.644924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:10.645801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:10.672655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:10.677696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:10.678932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:10.693378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:10.700493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39290019-62dd-4ac6-9ea5-5721d71209fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "refresh_cache-7f0356d2-73d5-47bb-a499-17b029d1dad1" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 18:48:10.701013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39290019-62dd-4ac6-9ea5-5721d71209fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquired lock "refresh_cache-7f0356d2-73d5-47bb-a499-17b029d1dad1" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 18:48:10.701729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:10.702520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:10.816634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:10.817154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:10.817601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:10.818070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lazy-loading 'fault' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:48:10.908949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:10.922129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:10.924553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:10.930077 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5ab92ab0-6137-4233-a117-0ee7b48cb475 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1449 microversion: 2.75 time: 0.294577 Oct 27 18:48:10.930761 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 420/835] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:10 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1449 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:10.937718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4a3115b4-3264-4b6e-91b5-d2931400a58d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:10.938669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4a3115b4-3264-4b6e-91b5-d2931400a58d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:10.945845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a3115b4-3264-4b6e-91b5-d2931400a58d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:10.946698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a3115b4-3264-4b6e-91b5-d2931400a58d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:10.947373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a3115b4-3264-4b6e-91b5-d2931400a58d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:10.948321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a3115b4-3264-4b6e-91b5-d2931400a58d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:10.948979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a3115b4-3264-4b6e-91b5-d2931400a58d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:10.949620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a3115b4-3264-4b6e-91b5-d2931400a58d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:11.316283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4a3115b4-3264-4b6e-91b5-d2931400a58d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:11.327794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4a3115b4-3264-4b6e-91b5-d2931400a58d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:11.329279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4a3115b4-3264-4b6e-91b5-d2931400a58d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:11.331708 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4a3115b4-3264-4b6e-91b5-d2931400a58d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1567 microversion: 2.25 time: 0.398501 Oct 27 18:48:11.332241 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 421/836] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:10 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1567 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:11.337061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5aeec026-e827-4d87-8bed-f1365bedbc99 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:11.337685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5aeec026-e827-4d87-8bed-f1365bedbc99 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:11.345898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeec026-e827-4d87-8bed-f1365bedbc99 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:11.346528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeec026-e827-4d87-8bed-f1365bedbc99 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:11.346869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeec026-e827-4d87-8bed-f1365bedbc99 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:11.347592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeec026-e827-4d87-8bed-f1365bedbc99 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:11.348154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeec026-e827-4d87-8bed-f1365bedbc99 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:11.348596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeec026-e827-4d87-8bed-f1365bedbc99 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:11.530034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5aeec026-e827-4d87-8bed-f1365bedbc99 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:11.537939 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5aeec026-e827-4d87-8bed-f1365bedbc99 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1371 microversion: 2.1 time: 0.204639 Oct 27 18:48:11.554413 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 422/837] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:11 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:11.554413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-93dc259d-8b53-4332-8d9d-ccad69752f9f tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:11.554413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-93dc259d-8b53-4332-8d9d-ccad69752f9f tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:11.554413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93dc259d-8b53-4332-8d9d-ccad69752f9f tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:11.554413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93dc259d-8b53-4332-8d9d-ccad69752f9f tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:11.555031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93dc259d-8b53-4332-8d9d-ccad69752f9f tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:11.555031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93dc259d-8b53-4332-8d9d-ccad69752f9f tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:11.555031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93dc259d-8b53-4332-8d9d-ccad69752f9f tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:11.555031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93dc259d-8b53-4332-8d9d-ccad69752f9f tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:11.766830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-93dc259d-8b53-4332-8d9d-ccad69752f9f tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e9c0b3a99d41a9ac42eb5a092be2c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e625a0c7d6544639b0066d000dc6794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:11.775564 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-93dc259d-8b53-4332-8d9d-ccad69752f9f tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 200 len: 1462 microversion: 2.1 time: 0.234847 Oct 27 18:48:11.776203 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 423/838] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:11 2022] GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 1462 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:11.790435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-541dcaae-05cb-4b3f-b31f-18d0e85019b3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:11.791329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-541dcaae-05cb-4b3f-b31f-18d0e85019b3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:11.804553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:11.806409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-541dcaae-05cb-4b3f-b31f-18d0e85019b3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:11.808800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-541dcaae-05cb-4b3f-b31f-18d0e85019b3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:11.811097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-541dcaae-05cb-4b3f-b31f-18d0e85019b3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:11.812061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-541dcaae-05cb-4b3f-b31f-18d0e85019b3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:11.815025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-541dcaae-05cb-4b3f-b31f-18d0e85019b3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:11.815510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-541dcaae-05cb-4b3f-b31f-18d0e85019b3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:12.013675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-541dcaae-05cb-4b3f-b31f-18d0e85019b3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:12.016492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:12.041089 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-541dcaae-05cb-4b3f-b31f-18d0e85019b3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1470 microversion: 2.1 time: 0.261138 Oct 27 18:48:12.041989 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 424/839] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:11 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1470 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:12.055017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c2d2e2a4-6f9a-43d4-9a0f-761c250ec486 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b04f790>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:12.179116 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c2d2e2a4-6f9a-43d4-9a0f-761c250ec486 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/77589569-9b6a-4afc-8af7-7a43ef9ebc00" status: 200 len: 784 microversion: 2.1 time: 0.135236 Oct 27 18:48:12.190114 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 425/840] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:12 2022] GET /compute/v2.1/images/77589569-9b6a-4afc-8af7-7a43ef9ebc00 => generated 784 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:12.300234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-39290019-62dd-4ac6-9ea5-5721d71209fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Building network info cache for instance {{(pid=127029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 18:48:12.329110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-26aa4bb1-4abd-4c3e-a45f-7bd062474f87 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] Calling method '.version_select at 0x7fc86af574c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:12.352299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26aa4bb1-4abd-4c3e-a45f-7bd062474f87 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:12.352794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26aa4bb1-4abd-4c3e-a45f-7bd062474f87 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:12.353340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26aa4bb1-4abd-4c3e-a45f-7bd062474f87 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:12.382441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26aa4bb1-4abd-4c3e-a45f-7bd062474f87 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:12.382953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26aa4bb1-4abd-4c3e-a45f-7bd062474f87 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:12.383392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26aa4bb1-4abd-4c3e-a45f-7bd062474f87 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:12.423740 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-26aa4bb1-4abd-4c3e-a45f-7bd062474f87 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage/2e625a0c7d6544639b0066d000dc6794?start=2022-10-26T18%3A48%3A11.795515&end=2022-10-28T18%3A48%3A11.795515" status: 200 len: 694 microversion: 2.1 time: 0.232116 Oct 27 18:48:12.426858 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 426/841] 10.222.0.42 () {58 vars in 1412 bytes} [Thu Oct 27 18:48:12 2022] GET /compute/v2.1/os-simple-tenant-usage/2e625a0c7d6544639b0066d000dc6794?start=2022-10-26T18%3A48%3A11.795515&end=2022-10-28T18%3A48%3A11.795515 => generated 694 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:12.431895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:12.432995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:12.445942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:12.446684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:12.447395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:12.448894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:12.459124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:12.462642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:12.509041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:12.509819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:12.510513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:12.511726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lazy-loading 'fault' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:48:12.657377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:12.670479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:12.671960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:12.687766 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3d03cb2e-786f-4c11-bf73-c3769eb86d80 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1449 microversion: 2.75 time: 0.259526 Oct 27 18:48:12.710557 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 427/842] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:12 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1449 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:12.717851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-1049d938-68db-44e9-aaba-c0404f6fe2db req-bf5291d6-1ea8-4ca3-a329-113fa7c08723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a645e2-ba92-42c7-8a35-8aea0ee2f9b9", "name": "network-vif-unplugged", "status": "completed", "tag": "2cf40f9d-6d09-4726-8ad1-d50203aea23c"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:12.749089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1049d938-68db-44e9-aaba-c0404f6fe2db req-bf5291d6-1ea8-4ca3-a329-113fa7c08723 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:12.755449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1049d938-68db-44e9-aaba-c0404f6fe2db req-bf5291d6-1ea8-4ca3-a329-113fa7c08723 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:12.758986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1049d938-68db-44e9-aaba-c0404f6fe2db req-bf5291d6-1ea8-4ca3-a329-113fa7c08723 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:12.790741 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-1049d938-68db-44e9-aaba-c0404f6fe2db req-bf5291d6-1ea8-4ca3-a329-113fa7c08723 service nova] Creating event network-vif-unplugged:2cf40f9d-6d09-4726-8ad1-d50203aea23c for instance 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 on n-h2-860687-3 Oct 27 18:48:12.797772 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-1049d938-68db-44e9-aaba-c0404f6fe2db req-bf5291d6-1ea8-4ca3-a329-113fa7c08723 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085841 Oct 27 18:48:12.799669 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 428/843] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:12.805166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-09384900-482a-4239-90c7-bb81432392cb tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:12.820104 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-09384900-482a-4239-90c7-bb81432392cb tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018900 Oct 27 18:48:12.821547 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 429/844] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:48:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:12.832065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-8749a185-a648-4ef1-b92f-085d9377fb03 req-8b4f8ad8-2e87-4743-8801-d38d36d0e50e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0356d2-73d5-47bb-a499-17b029d1dad1", "tag": "1f181151-81f9-4cf5-a37c-a15ffbe32f2e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:12.883004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8749a185-a648-4ef1-b92f-085d9377fb03 req-8b4f8ad8-2e87-4743-8801-d38d36d0e50e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:12.886668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8749a185-a648-4ef1-b92f-085d9377fb03 req-8b4f8ad8-2e87-4743-8801-d38d36d0e50e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:12.888718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8749a185-a648-4ef1-b92f-085d9377fb03 req-8b4f8ad8-2e87-4743-8801-d38d36d0e50e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:12.919162 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-8749a185-a648-4ef1-b92f-085d9377fb03 req-8b4f8ad8-2e87-4743-8801-d38d36d0e50e service nova] Creating event network-changed:1f181151-81f9-4cf5-a37c-a15ffbe32f2e for instance 7f0356d2-73d5-47bb-a499-17b029d1dad1 on n-h1-860687-3 Oct 27 18:48:12.932984 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-8749a185-a648-4ef1-b92f-085d9377fb03 req-8b4f8ad8-2e87-4743-8801-d38d36d0e50e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109076 Oct 27 18:48:12.933620 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 430/845] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:12.939081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b4ffee54-2e24-4425-a13b-4f86986814bd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:12.950358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b4ffee54-2e24-4425-a13b-4f86986814bd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:12.957716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4ffee54-2e24-4425-a13b-4f86986814bd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:12.958293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4ffee54-2e24-4425-a13b-4f86986814bd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:12.962559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4ffee54-2e24-4425-a13b-4f86986814bd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:12.963937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4ffee54-2e24-4425-a13b-4f86986814bd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:12.966117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4ffee54-2e24-4425-a13b-4f86986814bd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:12.966822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4ffee54-2e24-4425-a13b-4f86986814bd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:13.388669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b4ffee54-2e24-4425-a13b-4f86986814bd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:13.400692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b4ffee54-2e24-4425-a13b-4f86986814bd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:13.406066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b4ffee54-2e24-4425-a13b-4f86986814bd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:13.406986 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b4ffee54-2e24-4425-a13b-4f86986814bd tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1567 microversion: 2.25 time: 0.472252 Oct 27 18:48:13.416528 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 431/846] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:12 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1567 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:13.425625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-39290019-62dd-4ac6-9ea5-5721d71209fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Updating instance_info_cache with network_info: [{"id": "1f181151-81f9-4cf5-a37c-a15ffbe32f2e", "address": "fa:16:3e:06:8b:3c", "network": {"id": "011a081f-3a1d-4a29-beeb-69b643eacdb0", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-346257061-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "154455c389be498e84dc3b0ca4e7ee30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1f181151-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 18:48:13.436412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3cb08504-c84d-4d30-a2b8-550770e1c0e2 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '.version_select at 0x7fc86b1b9820>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:13.451980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39290019-62dd-4ac6-9ea5-5721d71209fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Releasing lock "refresh_cache-7f0356d2-73d5-47bb-a499-17b029d1dad1" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 18:48:13.452920 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-39290019-62dd-4ac6-9ea5-5721d71209fb tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action" status: 202 len: 0 microversion: 2.1 time: 4.190970 Oct 27 18:48:13.455428 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 416/847] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:48:09 2022] POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action => generated 0 bytes in 4213 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 18:48:13.461293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5fa794a8-14eb-4fa4-9601-bce248c98531 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:13.462157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5fa794a8-14eb-4fa4-9601-bce248c98531 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:13.467097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cb08504-c84d-4d30-a2b8-550770e1c0e2 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:13.469769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cb08504-c84d-4d30-a2b8-550770e1c0e2 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:13.471262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cb08504-c84d-4d30-a2b8-550770e1c0e2 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:13.478189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fa794a8-14eb-4fa4-9601-bce248c98531 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:13.479008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fa794a8-14eb-4fa4-9601-bce248c98531 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:13.480767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fa794a8-14eb-4fa4-9601-bce248c98531 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:13.481674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fa794a8-14eb-4fa4-9601-bce248c98531 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:13.483058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fa794a8-14eb-4fa4-9601-bce248c98531 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:13.484971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fa794a8-14eb-4fa4-9601-bce248c98531 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:13.494042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cb08504-c84d-4d30-a2b8-550770e1c0e2 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:13.496117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cb08504-c84d-4d30-a2b8-550770e1c0e2 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:13.496117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cb08504-c84d-4d30-a2b8-550770e1c0e2 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:13.530426 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3cb08504-c84d-4d30-a2b8-550770e1c0e2 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage/2e625a0c7d6544639b0066d000dc6794?start=2022-10-26T18%3A48%3A11.795515&end=2022-10-28T18%3A48%3A11.795515" status: 200 len: 690 microversion: 2.1 time: 0.107607 Oct 27 18:48:13.532942 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 432/848] 10.222.0.42 () {58 vars in 1412 bytes} [Thu Oct 27 18:48:13 2022] GET /compute/v2.1/os-simple-tenant-usage/2e625a0c7d6544639b0066d000dc6794?start=2022-10-26T18%3A48%3A11.795515&end=2022-10-28T18%3A48%3A11.795515 => generated 690 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:13.548979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0eab81a9-a3ce-49e6-8e3f-93751bc877bc tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b01eb80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:13.873179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5fa794a8-14eb-4fa4-9601-bce248c98531 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:13.881237 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5fa794a8-14eb-4fa4-9601-bce248c98531 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1371 microversion: 2.1 time: 0.424491 Oct 27 18:48:13.881824 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 417/849] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:13 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1371 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:13.905256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e3b5c12e-d139-4b33-8399-5a41b24b79e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:13.906960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e3b5c12e-d139-4b33-8399-5a41b24b79e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:13.925810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3b5c12e-d139-4b33-8399-5a41b24b79e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:13.926141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3b5c12e-d139-4b33-8399-5a41b24b79e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:13.926662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3b5c12e-d139-4b33-8399-5a41b24b79e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:13.927387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3b5c12e-d139-4b33-8399-5a41b24b79e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:13.927919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3b5c12e-d139-4b33-8399-5a41b24b79e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:13.929254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3b5c12e-d139-4b33-8399-5a41b24b79e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:14.212724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e3b5c12e-d139-4b33-8399-5a41b24b79e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:14.241046 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e3b5c12e-d139-4b33-8399-5a41b24b79e6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1470 microversion: 2.1 time: 0.342863 Oct 27 18:48:14.257822 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 418/850] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:13 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1470 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:14.273840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-314d906f-ecf9-4563-9487-5ea6922fd1d2 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '.version_select at 0x7fc86b1c2d30>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:14.622267 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0eab81a9-a3ce-49e6-8e3f-93751bc877bc tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "DELETE /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae" status: 204 len: 0 microversion: 2.1 time: 1.088102 Oct 27 18:48:14.623879 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 433/851] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:13 2022] DELETE /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae => generated 0 bytes in 1090 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:48:14.629844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c073a2e7-2f56-4716-a871-3c2f11d53b01 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] Calling method '.version_select at 0x7fc86b014d30>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:14.674348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c073a2e7-2f56-4716-a871-3c2f11d53b01 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:14.678034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c073a2e7-2f56-4716-a871-3c2f11d53b01 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:14.678550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c073a2e7-2f56-4716-a871-3c2f11d53b01 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:14.719719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c073a2e7-2f56-4716-a871-3c2f11d53b01 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:14.720761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c073a2e7-2f56-4716-a871-3c2f11d53b01 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:14.721376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c073a2e7-2f56-4716-a871-3c2f11d53b01 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:14.813273 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c073a2e7-2f56-4716-a871-3c2f11d53b01 tempest-TenantUsagesTestJSON-1841012224 tempest-TenantUsagesTestJSON-1841012224-project-admin] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T18%3A48%3A11.795515&end=2022-10-28T18%3A48%3A11.795515&detailed=1" status: 200 len: 9923 microversion: 2.1 time: 0.188144 Oct 27 18:48:14.827566 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 434/852] 10.222.0.42 () {58 vars in 1335 bytes} [Thu Oct 27 18:48:14 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T18%3A48%3A11.795515&end=2022-10-28T18%3A48%3A11.795515&detailed=1 => generated 9923 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:14.833245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:14.834117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:14.844058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:14.844867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:14.845490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:14.846423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:14.847737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:14.849067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:14.930167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:14.931021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:14.931472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:14.931930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lazy-loading 'fault' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:48:15.060900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:15.072848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:15.078305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:15.095969 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9dba0dc8-147a-45e8-b69c-2e325684dfab tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1449 microversion: 2.75 time: 0.266896 Oct 27 18:48:15.099645 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 435/853] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:14 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1449 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:15.113739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b0f0dfc5-87f1-4ad4-a2db-df3db9c4cb7c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:15.114360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0f0dfc5-87f1-4ad4-a2db-df3db9c4cb7c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:15.131859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0f0dfc5-87f1-4ad4-a2db-df3db9c4cb7c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:15.134278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0f0dfc5-87f1-4ad4-a2db-df3db9c4cb7c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:15.134777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0f0dfc5-87f1-4ad4-a2db-df3db9c4cb7c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:15.135538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0f0dfc5-87f1-4ad4-a2db-df3db9c4cb7c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:15.136749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0f0dfc5-87f1-4ad4-a2db-df3db9c4cb7c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:15.137191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0f0dfc5-87f1-4ad4-a2db-df3db9c4cb7c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:15.491804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0f0dfc5-87f1-4ad4-a2db-df3db9c4cb7c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:15.502937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0f0dfc5-87f1-4ad4-a2db-df3db9c4cb7c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:15.504355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0f0dfc5-87f1-4ad4-a2db-df3db9c4cb7c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:15.514973 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b0f0dfc5-87f1-4ad4-a2db-df3db9c4cb7c tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1567 microversion: 2.25 time: 0.413838 Oct 27 18:48:15.516449 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 436/854] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:15 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1567 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:15.531793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d2405715-341c-4a3a-98ba-62b29ae7dfd3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b0728b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:15.592319 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d2405715-341c-4a3a-98ba-62b29ae7dfd3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] HTTP exception thrown: Image not found. Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d2405715-341c-4a3a-98ba-62b29ae7dfd3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Request method failure captured: Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae HTTP/1.1 Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtIzAaBfHlwFyJzWmBsEcUEOFyzGkiPPGQOw8kXdG6UwhDkJLdYxjaPLc3DH8z-_Pm2s5SIC2khwdOX2Ns-l2SHKQcal_j7nVoTeU6V45aQfpJxt5nzTKgc8Gz1Y2Nwg_mbI10lMNZwW0lt83ofLrErbAziU6_75ilt-dXTpXKE4hvU Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f39cc90fd8ad43edadefcc7868adc6be Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesOneServerTestJSON-354488036 Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:48:15.634138 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:48:15.636962 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f39cc90fd8ad43edadefcc7868adc6be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f39cc90fd8ad43edadefcc7868adc6be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f39cc90fd8ad43edadefcc7868adc6be", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f39cc90fd8ad43edadefcc7868adc6be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:48:15.636962 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesOneServerTestJSON-354488036 Oct 27 18:48:15.636962 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f39cc90fd8ad43edadefcc7868adc6be Oct 27 18:48:15.636962 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-354488036 Oct 27 18:48:15.636962 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesOneServerTestJSON-354488036-project Oct 27 18:48:15.636962 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:48:15.636962 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:48:15.636962 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: a879659e04494f02a803b823e1fc5f3b Oct 27 18:48:15.636962 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesOneServerTestJSON-354488036-project Oct 27 18:48:15.636962 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:48:15.636962 n-d-860687-3 devstack@n-api.service[127028]: exception: Image not found. Oct 27 18:48:15.636962 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'ba68b577-d249-47e4-83ce-993e2a0a83ae'} Oct 27 18:48:15.636962 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:48:15.637980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ba68b577-d249-47e4-83ce-993e2a0a83ae Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:48:15.641418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ba68b577-d249-47e4-83ce-993e2a0a83ae could not be found. Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:48:15.644417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d2405715-341c-4a3a-98ba-62b29ae7dfd3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Returning 404 to user: Image not found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:48:15.647181 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d2405715-341c-4a3a-98ba-62b29ae7dfd3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae" status: 404 len: 62 microversion: 2.1 time: 0.123947 Oct 27 18:48:15.649488 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 437/855] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:15 2022] GET /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae => generated 62 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:48:15.649488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4c621f65-d493-4131-b7d3-d691b77eb374 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:15.649488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4c621f65-d493-4131-b7d3-d691b77eb374 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:15.656009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c621f65-d493-4131-b7d3-d691b77eb374 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:15.656819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c621f65-d493-4131-b7d3-d691b77eb374 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:15.656945 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-314d906f-ecf9-4563-9487-5ea6922fd1d2 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/88df27a6-2c6a-4efe-9170-d8f10f1ce139" status: 202 len: 0 microversion: 2.1 time: 1.397255 Oct 27 18:48:15.657369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c621f65-d493-4131-b7d3-d691b77eb374 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:15.657450 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 419/856] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 18:48:14 2022] DELETE /compute/v2.1/os-floating-ips/88df27a6-2c6a-4efe-9170-d8f10f1ce139 => generated 0 bytes in 1399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:48:15.658322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c621f65-d493-4131-b7d3-d691b77eb374 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:15.658999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c621f65-d493-4131-b7d3-d691b77eb374 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:15.659360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c621f65-d493-4131-b7d3-d691b77eb374 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:15.664945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f863670a-9cf1-4552-85a4-d1ee3f832c2d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:15.665571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f863670a-9cf1-4552-85a4-d1ee3f832c2d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:15.680357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f863670a-9cf1-4552-85a4-d1ee3f832c2d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:15.680870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f863670a-9cf1-4552-85a4-d1ee3f832c2d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:15.681309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f863670a-9cf1-4552-85a4-d1ee3f832c2d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:15.682021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f863670a-9cf1-4552-85a4-d1ee3f832c2d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:15.688297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f863670a-9cf1-4552-85a4-d1ee3f832c2d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:15.688881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f863670a-9cf1-4552-85a4-d1ee3f832c2d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:15.693117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4c621f65-d493-4131-b7d3-d691b77eb374 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:48:15.721346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:15.812563 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4c621f65-d493-4131-b7d3-d691b77eb374 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "DELETE /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 204 len: 0 microversion: 2.1 time: 0.168963 Oct 27 18:48:15.816389 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 438/857] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:48:15 2022] DELETE /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:48:15.822061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-007663fe-ab26-45f0-a3f6-a220cffe483b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:15.823483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-007663fe-ab26-45f0-a3f6-a220cffe483b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:15.830411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-007663fe-ab26-45f0-a3f6-a220cffe483b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:15.830999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-007663fe-ab26-45f0-a3f6-a220cffe483b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:15.831892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-007663fe-ab26-45f0-a3f6-a220cffe483b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:15.832220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-007663fe-ab26-45f0-a3f6-a220cffe483b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:15.832681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-007663fe-ab26-45f0-a3f6-a220cffe483b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:15.833114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-007663fe-ab26-45f0-a3f6-a220cffe483b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:15.878492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f863670a-9cf1-4552-85a4-d1ee3f832c2d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:15.886662 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f863670a-9cf1-4552-85a4-d1ee3f832c2d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1371 microversion: 2.1 time: 0.228174 Oct 27 18:48:15.887315 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 420/858] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:15 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:15.891905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b49fcb86-c839-4073-bd92-c521bab9a822 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1767591941"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:15.894376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b49fcb86-c839-4073-bd92-c521bab9a822 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:15.900372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b49fcb86-c839-4073-bd92-c521bab9a822 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:15.900942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b49fcb86-c839-4073-bd92-c521bab9a822 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:15.901582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b49fcb86-c839-4073-bd92-c521bab9a822 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:15.902335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b49fcb86-c839-4073-bd92-c521bab9a822 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:15.903047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b49fcb86-c839-4073-bd92-c521bab9a822 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:15.903682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b49fcb86-c839-4073-bd92-c521bab9a822 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.036950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-007663fe-ab26-45f0-a3f6-a220cffe483b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:16.046260 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-007663fe-ab26-45f0-a3f6-a220cffe483b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1470 microversion: 2.1 time: 0.228586 Oct 27 18:48:16.059103 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 439/859] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:15 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1470 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:16.069144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5a3ec44b-ab5c-4b2e-9062-e17d012e4ecc tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Action: 'action', calling method: .version_select at 0x7fc870d7faf0>, body: {"addFloatingIp": {"address": ""}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5a3ec44b-ab5c-4b2e-9062-e17d012e4ecc tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Request method failure captured: Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action HTTP/1.1 Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 34 Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtI-h48urHHPiNpbikDIR2FBJhWuMrtfuBNwB4zWb_lMw6Q8UiTlNiUnllkkl8vg-rFSP5fc4IzEXLiISJy7IbZf6kiWgJT53nuhM-mzjQfl5ZQM142h3AqegI1P7JzoTHHFO-gWoQW42gVcqjjp_-fku_dWUiGALN2HGTtqlqZQhxE Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 154455c389be498e84dc3b0ca4e7ee30 Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:48:16.073288 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:48:16.074812 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_154455c389be498e84dc3b0ca4e7ee30", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:48:16.074812 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:16.074812 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 154455c389be498e84dc3b0ca4e7ee30 Oct 27 18:48:16.074812 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:16.074812 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project Oct 27 18:48:16.074812 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:48:16.074812 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:48:16.074812 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 1ea78f6cb7bb4974a7d61d015b6a2faf Oct 27 18:48:16.074812 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project Oct 27 18:48:16.074812 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:48:16.074812 n-d-860687-3 devstack@n-api.service[127028]: {"addFloatingIp": {"address": ""}} Oct 27 18:48:16.074812 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:48:16.074812 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '7f0356d2-73d5-47bb-a499-17b029d1dad1', 'body': {'addFloatingIp': {'address': ''}}} Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi '' Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:48:16.075609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:48:16.076872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:48:16.077973 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 27 18:48:16.077973 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.079488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5a3ec44b-ab5c-4b2e-9062-e17d012e4ecc tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:48:16.080580 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5a3ec44b-ab5c-4b2e-9062-e17d012e4ecc tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action" status: 400 len: 142 microversion: 2.1 time: 0.020236 Oct 27 18:48:16.085211 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 440/860] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:48:16 2022] POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action => generated 142 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:48:16.089716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-244353e7-29bc-4a1c-817d-0a6b35f5f4a3 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:16.090489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-244353e7-29bc-4a1c-817d-0a6b35f5f4a3 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:16.097687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-244353e7-29bc-4a1c-817d-0a6b35f5f4a3 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.098316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-244353e7-29bc-4a1c-817d-0a6b35f5f4a3 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.098888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-244353e7-29bc-4a1c-817d-0a6b35f5f4a3 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.099726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-244353e7-29bc-4a1c-817d-0a6b35f5f4a3 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.100254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-244353e7-29bc-4a1c-817d-0a6b35f5f4a3 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.100773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-244353e7-29bc-4a1c-817d-0a6b35f5f4a3 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.152468 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b49fcb86-c839-4073-bd92-c521bab9a822 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "POST /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9/action" status: 202 len: 0 microversion: 2.1 time: 0.263058 Oct 27 18:48:16.159212 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 421/861] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:48:15 2022] POST /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 18:48:16.166835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:16.170273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:16.180021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.180299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.180743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.181472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.183867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.184507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.237573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "refresh_cache-7f0356d2-73d5-47bb-a499-17b029d1dad1" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 18:48:16.237573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquired lock "refresh_cache-7f0356d2-73d5-47bb-a499-17b029d1dad1" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 18:48:16.398821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-244353e7-29bc-4a1c-817d-0a6b35f5f4a3 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e9c0b3a99d41a9ac42eb5a092be2c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e625a0c7d6544639b0066d000dc6794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:16.408990 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-244353e7-29bc-4a1c-817d-0a6b35f5f4a3 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 200 len: 1468 microversion: 2.1 time: 0.326421 Oct 27 18:48:16.410375 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 441/862] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:16 2022] GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 1468 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:16.415745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:16.416602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:16.425121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.425624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.426067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.426845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.427252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.427680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.466586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.467105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.467551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.468009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lazy-loading 'fault' on Instance uuid 71963e3a-3e20-450a-8881-9c45fa6633d8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:48:16.503921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Releasing lock "refresh_cache-7f0356d2-73d5-47bb-a499-17b029d1dad1" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 18:48:16.504551 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] HTTP exception thrown: floating IP not found Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Request method failure captured: Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action HTTP/1.1 Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 41 Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtI-h48urHHPiNpbikDIR2FBJhWuMrtfuBNwB4zWb_lMw6Q8UiTlNiUnllkkl8vg-rFSP5fc4IzEXLiISJy7IbZf6kiWgJT53nuhM-mzjQfl5ZQM142h3AqegI1P7JzoTHHFO-gWoQW42gVcqjjp_-fku_dWUiGALN2HGTtqlqZQhxE Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 154455c389be498e84dc3b0ca4e7ee30 Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:48:16.506730 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:48:16.508007 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_154455c389be498e84dc3b0ca4e7ee30", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:48:16.508007 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:16.508007 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 154455c389be498e84dc3b0ca4e7ee30 Oct 27 18:48:16.508007 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:16.508007 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project Oct 27 18:48:16.508007 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:48:16.508007 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:48:16.508007 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 1ea78f6cb7bb4974a7d61d015b6a2faf Oct 27 18:48:16.508007 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project Oct 27 18:48:16.508007 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:48:16.508007 n-d-860687-3 devstack@n-api.service[127029]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 27 18:48:16.508007 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:48:16.508007 n-d-860687-3 devstack@n-api.service[127029]: exception: floating IP not found Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '7f0356d2-73d5-47bb-a499-17b029d1dad1', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:16.508875 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 27 18:48:16.510023 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.511606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Returning 404 to user: floating IP not found {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:48:16.511606 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0f6499c0-4a6f-4d5e-8112-9b6eaab5c002 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action" status: 404 len: 67 microversion: 2.1 time: 0.347773 Oct 27 18:48:16.511606 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 422/863] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:48:16 2022] POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action => generated 67 bytes in 349 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:48:16.515001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-27014ab5-3482-4df5-af43-3c74354804ca tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b12bdc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:16.529973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:16.538378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:16.540103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c713bf0a611a404a8779158825869b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b268c59fc44c4f3993f0861c71a2519a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:16.546858 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-501edf93-b54d-4497-8e9d-89b5f30a49ec tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 200 len: 1449 microversion: 2.75 time: 0.135052 Oct 27 18:48:16.551142 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 442/864] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:16 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 1449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:16.557663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-765bec80-dd94-4540-aa97-ee520d699f70 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Action: 'action', calling method: .version_select at 0x7fc870d7fc10>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:16.589477 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-27014ab5-3482-4df5-af43-3c74354804ca tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.079684 Oct 27 18:48:16.590994 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 423/865] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:16 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:16.596239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9c8792f-5ab4-4a32-a885-75f72dffc4e8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:16.597088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c9c8792f-5ab4-4a32-a885-75f72dffc4e8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:16.603218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c8792f-5ab4-4a32-a885-75f72dffc4e8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.603783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c8792f-5ab4-4a32-a885-75f72dffc4e8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.604871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c8792f-5ab4-4a32-a885-75f72dffc4e8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.605837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c8792f-5ab4-4a32-a885-75f72dffc4e8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.606366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c8792f-5ab4-4a32-a885-75f72dffc4e8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.607049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c8792f-5ab4-4a32-a885-75f72dffc4e8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.618400 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-765bec80-dd94-4540-aa97-ee520d699f70 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-765bec80-dd94-4540-aa97-ee520d699f70 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Request method failure captured: Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action HTTP/1.1 Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 44 Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtI-h48urHHPiNpbikDIR2FBJhWuMrtfuBNwB4zWb_lMw6Q8UiTlNiUnllkkl8vg-rFSP5fc4IzEXLiISJy7IbZf6kiWgJT53nuhM-mzjQfl5ZQM142h3AqegI1P7JzoTHHFO-gWoQW42gVcqjjp_-fku_dWUiGALN2HGTtqlqZQhxE Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 154455c389be498e84dc3b0ca4e7ee30 Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:48:16.620354 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:48:16.621605 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_154455c389be498e84dc3b0ca4e7ee30", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:48:16.621605 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:16.621605 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 154455c389be498e84dc3b0ca4e7ee30 Oct 27 18:48:16.621605 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:16.621605 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project Oct 27 18:48:16.621605 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:48:16.621605 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:48:16.621605 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 1ea78f6cb7bb4974a7d61d015b6a2faf Oct 27 18:48:16.621605 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project Oct 27 18:48:16.621605 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:48:16.621605 n-d-860687-3 devstack@n-api.service[127028]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 27 18:48:16.621605 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:48:16.621605 n-d-860687-3 devstack@n-api.service[127028]: exception: Floating IP not found for address 0.0.0.0. Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '7f0356d2-73d5-47bb-a499-17b029d1dad1', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:48:16.622365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 27 18:48:16.623586 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:16.626792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-765bec80-dd94-4540-aa97-ee520d699f70 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:48:16.628269 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-765bec80-dd94-4540-aa97-ee520d699f70 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action" status: 404 len: 88 microversion: 2.1 time: 0.075717 Oct 27 18:48:16.629018 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 443/866] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:48:16 2022] POST /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1/action => generated 88 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:48:16.638863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f358f6a1-0ff7-4fb0-9b5d-8b0ef213ac65 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:16.640089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f358f6a1-0ff7-4fb0-9b5d-8b0ef213ac65 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:16.647743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f358f6a1-0ff7-4fb0-9b5d-8b0ef213ac65 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.648749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f358f6a1-0ff7-4fb0-9b5d-8b0ef213ac65 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.650900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f358f6a1-0ff7-4fb0-9b5d-8b0ef213ac65 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.652052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f358f6a1-0ff7-4fb0-9b5d-8b0ef213ac65 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.652569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f358f6a1-0ff7-4fb0-9b5d-8b0ef213ac65 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.652961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f358f6a1-0ff7-4fb0-9b5d-8b0ef213ac65 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.686275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f358f6a1-0ff7-4fb0-9b5d-8b0ef213ac65 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:48:16.753152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c9c8792f-5ab4-4a32-a885-75f72dffc4e8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:16.764457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c9c8792f-5ab4-4a32-a885-75f72dffc4e8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:16.767405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c9c8792f-5ab4-4a32-a885-75f72dffc4e8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:16.769117 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c9c8792f-5ab4-4a32-a885-75f72dffc4e8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1567 microversion: 2.25 time: 0.176890 Oct 27 18:48:16.770193 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 424/867] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:16 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:16.786486 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f358f6a1-0ff7-4fb0-9b5d-8b0ef213ac65 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 204 len: 0 microversion: 2.1 time: 0.151948 Oct 27 18:48:16.787403 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 444/868] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:48:16 2022] DELETE /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 18:48:16.796642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fd7a8e64-fbe4-412d-a914-0a1ce8fc6d46 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:16.797320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fd7a8e64-fbe4-412d-a914-0a1ce8fc6d46 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:16.803182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd7a8e64-fbe4-412d-a914-0a1ce8fc6d46 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.803660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd7a8e64-fbe4-412d-a914-0a1ce8fc6d46 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.804101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd7a8e64-fbe4-412d-a914-0a1ce8fc6d46 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.804788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd7a8e64-fbe4-412d-a914-0a1ce8fc6d46 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.805329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd7a8e64-fbe4-412d-a914-0a1ce8fc6d46 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.805712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd7a8e64-fbe4-412d-a914-0a1ce8fc6d46 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.911370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ba4fadd8-23ab-43f3-8de6-3e782abaeca9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:16.912179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ba4fadd8-23ab-43f3-8de6-3e782abaeca9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:16.922027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba4fadd8-23ab-43f3-8de6-3e782abaeca9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.922559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba4fadd8-23ab-43f3-8de6-3e782abaeca9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.923411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba4fadd8-23ab-43f3-8de6-3e782abaeca9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.924325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba4fadd8-23ab-43f3-8de6-3e782abaeca9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:16.925737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba4fadd8-23ab-43f3-8de6-3e782abaeca9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:16.926743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba4fadd8-23ab-43f3-8de6-3e782abaeca9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:16.950520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fd7a8e64-fbe4-412d-a914-0a1ce8fc6d46 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:16.962344 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fd7a8e64-fbe4-412d-a914-0a1ce8fc6d46 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1540 microversion: 2.1 time: 0.170440 Oct 27 18:48:16.962973 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 425/869] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:16 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1540 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:17.081093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-06618b92-3010-4fe4-8a4b-bb38658929cd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:17.082899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-06618b92-3010-4fe4-8a4b-bb38658929cd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:17.099610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06618b92-3010-4fe4-8a4b-bb38658929cd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:17.100332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06618b92-3010-4fe4-8a4b-bb38658929cd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:17.102959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06618b92-3010-4fe4-8a4b-bb38658929cd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:17.103881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06618b92-3010-4fe4-8a4b-bb38658929cd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:17.104844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06618b92-3010-4fe4-8a4b-bb38658929cd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:17.105714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06618b92-3010-4fe4-8a4b-bb38658929cd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:17.162748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ba4fadd8-23ab-43f3-8de6-3e782abaeca9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:17.173662 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ba4fadd8-23ab-43f3-8de6-3e782abaeca9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1371 microversion: 2.1 time: 0.267245 Oct 27 18:48:17.175015 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 445/870] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:16 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:48:17.251903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-06618b92-3010-4fe4-8a4b-bb38658929cd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:17.260158 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-06618b92-3010-4fe4-8a4b-bb38658929cd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1470 microversion: 2.1 time: 0.191084 Oct 27 18:48:17.262491 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 426/871] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:17 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:48:17.435358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-37a69115-1800-4dc9-bc43-ea2ffaa8a417 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:17.436436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-37a69115-1800-4dc9-bc43-ea2ffaa8a417 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:17.451612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37a69115-1800-4dc9-bc43-ea2ffaa8a417 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:17.452338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37a69115-1800-4dc9-bc43-ea2ffaa8a417 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:17.452779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37a69115-1800-4dc9-bc43-ea2ffaa8a417 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:17.453497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37a69115-1800-4dc9-bc43-ea2ffaa8a417 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:17.453954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37a69115-1800-4dc9-bc43-ea2ffaa8a417 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:17.454396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37a69115-1800-4dc9-bc43-ea2ffaa8a417 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:17.471682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:17.577192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ffe164b1-579f-45ff-96ed-235268810467 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:17.583928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ffe164b1-579f-45ff-96ed-235268810467 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] [instance: 71963e3a-3e20-450a-8881-9c45fa6633d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:17.591870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffe164b1-579f-45ff-96ed-235268810467 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:17.592359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffe164b1-579f-45ff-96ed-235268810467 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:17.592815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffe164b1-579f-45ff-96ed-235268810467 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:17.593563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffe164b1-579f-45ff-96ed-235268810467 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:17.594021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffe164b1-579f-45ff-96ed-235268810467 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:17.594465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffe164b1-579f-45ff-96ed-235268810467 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:17.598690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-37a69115-1800-4dc9-bc43-ea2ffaa8a417 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e9c0b3a99d41a9ac42eb5a092be2c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e625a0c7d6544639b0066d000dc6794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:17.608610 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-37a69115-1800-4dc9-bc43-ea2ffaa8a417 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 200 len: 1468 microversion: 2.1 time: 0.177598 Oct 27 18:48:17.609965 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 446/872] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:17 2022] GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 1468 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:17.614074 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-ffe164b1-579f-45ff-96ed-235268810467 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] HTTP exception thrown: Instance 71963e3a-3e20-450a-8881-9c45fa6633d8 could not be found. Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ffe164b1-579f-45ff-96ed-235268810467 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Request method failure captured: Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 HTTP/1.1 Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIQ2gbDPVAeMNdhLb2ZOyzYAuMvId-sVNDsWFRB36AfOKOCuntseAgRMgtz4f--ZHeNkmFujHgymmnj8YoN-VOqBsyd-xmww5rQxJXLovm-9SqQEL8OWecvJDxI7rmEesGH76PaZwk-Js4Q-VDp53dL11jCb7KmKs9zBKQWRPE5Wsk Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.75 Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: b268c59fc44c4f3993f0861c71a2519a Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersAdmin275Test-106999397 Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:48:17.615860 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:48:17.617222 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b268c59fc44c4f3993f0861c71a2519a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b268c59fc44c4f3993f0861c71a2519a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b268c59fc44c4f3993f0861c71a2519a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b268c59fc44c4f3993f0861c71a2519a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:48:17.617222 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersAdmin275Test-106999397 Oct 27 18:48:17.617222 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: b268c59fc44c4f3993f0861c71a2519a Oct 27 18:48:17.617222 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersAdmin275Test-106999397 Oct 27 18:48:17.617222 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersAdmin275Test-106999397-project Oct 27 18:48:17.617222 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:48:17.617222 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:48:17.617222 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c713bf0a611a404a8779158825869b50 Oct 27 18:48:17.617222 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersAdmin275Test-106999397-project Oct 27 18:48:17.617222 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:48:17.617222 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 71963e3a-3e20-450a-8881-9c45fa6633d8 could not be found. Oct 27 18:48:17.617222 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '71963e3a-3e20-450a-8881-9c45fa6633d8'} Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71963e3a-3e20-450a-8881-9c45fa6633d8 could not be found. Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:48:17.617955 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71963e3a-3e20-450a-8881-9c45fa6633d8 could not be found. Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71963e3a-3e20-450a-8881-9c45fa6633d8 could not be found. Oct 27 18:48:17.619405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:17.621528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f1d7698-4f38-4d12-9fd1-82a90397ac43 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b01eaf0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:17.622707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ffe164b1-579f-45ff-96ed-235268810467 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] Returning 404 to user: Instance 71963e3a-3e20-450a-8881-9c45fa6633d8 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:48:17.623752 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ffe164b1-579f-45ff-96ed-235268810467 tempest-ServersAdmin275Test-106999397 tempest-ServersAdmin275Test-106999397-project] 10.222.0.42 "GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8" status: 404 len: 111 microversion: 2.75 time: 0.051256 Oct 27 18:48:17.624856 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 427/873] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:17 2022] GET /compute/v2.1/servers/71963e3a-3e20-450a-8881-9c45fa6633d8 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:48:17.673001 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0f1d7698-4f38-4d12-9fd1-82a90397ac43 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.061448 Oct 27 18:48:17.673991 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 447/874] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:17 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:17.792735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-834eabaf-8ad1-4df5-9721-b10893635431 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-403918565", "id": 614253958, "os-flavor-access:is_public": "False"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:17.796961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9438578b-0497-424f-8d94-b1ddf237da19 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:17.797586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9438578b-0497-424f-8d94-b1ddf237da19 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:17.809942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9438578b-0497-424f-8d94-b1ddf237da19 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:17.810498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9438578b-0497-424f-8d94-b1ddf237da19 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:17.811095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9438578b-0497-424f-8d94-b1ddf237da19 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:17.811845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9438578b-0497-424f-8d94-b1ddf237da19 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:17.812299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9438578b-0497-424f-8d94-b1ddf237da19 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:17.812995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9438578b-0497-424f-8d94-b1ddf237da19 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:17.816550 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-834eabaf-8ad1-4df5-9721-b10893635431 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.189386 Oct 27 18:48:17.817701 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 428/875] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:48:17 2022] POST /compute/v2.1/flavors => generated 427 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:48:17.838986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-67508ab2-b507-4df9-80a6-53d5d88b4650 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7c8d9c07c885414f9dd1ea0fca08ad15"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:18.117744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9438578b-0497-424f-8d94-b1ddf237da19 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:18.128933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9438578b-0497-424f-8d94-b1ddf237da19 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:18.130441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9438578b-0497-424f-8d94-b1ddf237da19 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:18.133670 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9438578b-0497-424f-8d94-b1ddf237da19 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1567 microversion: 2.25 time: 0.341198 Oct 27 18:48:18.137299 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 448/876] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:17 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1567 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:18.143731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fe55426b-deca-4907-976d-23dcb1809585 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:18.144534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fe55426b-deca-4907-976d-23dcb1809585 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:18.152761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe55426b-deca-4907-976d-23dcb1809585 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:18.153533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe55426b-deca-4907-976d-23dcb1809585 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:18.154162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe55426b-deca-4907-976d-23dcb1809585 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:18.155105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe55426b-deca-4907-976d-23dcb1809585 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:18.162561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe55426b-deca-4907-976d-23dcb1809585 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:18.164502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe55426b-deca-4907-976d-23dcb1809585 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:18.167706 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-67508ab2-b507-4df9-80a6-53d5d88b4650 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/614253958/action" status: 200 len: 96 microversion: 2.1 time: 0.335301 Oct 27 18:48:18.169334 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 429/877] 10.222.0.42 () {60 vars in 1197 bytes} [Thu Oct 27 18:48:17 2022] POST /compute/v2.1/flavors/614253958/action => generated 96 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:18.382063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fe55426b-deca-4907-976d-23dcb1809585 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:18.391249 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fe55426b-deca-4907-976d-23dcb1809585 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1540 microversion: 2.1 time: 0.251217 Oct 27 18:48:18.406850 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 449/878] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:18 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1540 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:18.416297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85c7bfa3-0b64-4149-86b1-bfc4d95984c9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:18.424903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85c7bfa3-0b64-4149-86b1-bfc4d95984c9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:18.443085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85c7bfa3-0b64-4149-86b1-bfc4d95984c9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:18.443869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85c7bfa3-0b64-4149-86b1-bfc4d95984c9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:18.444455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85c7bfa3-0b64-4149-86b1-bfc4d95984c9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:18.445319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85c7bfa3-0b64-4149-86b1-bfc4d95984c9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:18.445924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85c7bfa3-0b64-4149-86b1-bfc4d95984c9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:18.446527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85c7bfa3-0b64-4149-86b1-bfc4d95984c9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:18.484839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6c928a25-148c-4309-bac3-bbb8a34e37b2 tempest-FlavorsAccessTestJSON-1764246807 tempest-FlavorsAccessTestJSON-1764246807-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:18.538815 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6c928a25-148c-4309-bac3-bbb8a34e37b2 tempest-FlavorsAccessTestJSON-1764246807 tempest-FlavorsAccessTestJSON-1764246807-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.362808 Oct 27 18:48:18.551455 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 430/879] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:48:18 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:48:18.583246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b34ab85d-ff37-4e90-b0a6-25a744427787 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:18.584213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b34ab85d-ff37-4e90-b0a6-25a744427787 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:18.601745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b34ab85d-ff37-4e90-b0a6-25a744427787 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:18.602167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b34ab85d-ff37-4e90-b0a6-25a744427787 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:18.604905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b34ab85d-ff37-4e90-b0a6-25a744427787 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:18.605839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b34ab85d-ff37-4e90-b0a6-25a744427787 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:18.606307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b34ab85d-ff37-4e90-b0a6-25a744427787 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:18.607915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b34ab85d-ff37-4e90-b0a6-25a744427787 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:18.820056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-85c7bfa3-0b64-4149-86b1-bfc4d95984c9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:18.832841 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85c7bfa3-0b64-4149-86b1-bfc4d95984c9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1371 microversion: 2.1 time: 0.422201 Oct 27 18:48:18.835911 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 450/880] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:18 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1371 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:18.842598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c50b6095-65f7-4fb7-a155-4775b1fb8c1c req-73250d78-10d5-4935-b3fb-590f7c86710b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15000861-ac47-42c5-a2c6-b22b490700e8", "name": "network-vif-deleted", "tag": "a742b2fe-989c-4e19-b041-5847e5e2036d"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:18.860691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c50b6095-65f7-4fb7-a155-4775b1fb8c1c req-73250d78-10d5-4935-b3fb-590f7c86710b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:18.861506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c50b6095-65f7-4fb7-a155-4775b1fb8c1c req-73250d78-10d5-4935-b3fb-590f7c86710b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:18.862161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c50b6095-65f7-4fb7-a155-4775b1fb8c1c req-73250d78-10d5-4935-b3fb-590f7c86710b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:18.877285 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c50b6095-65f7-4fb7-a155-4775b1fb8c1c req-73250d78-10d5-4935-b3fb-590f7c86710b service nova] Creating event network-vif-deleted:a742b2fe-989c-4e19-b041-5847e5e2036d for instance 15000861-ac47-42c5-a2c6-b22b490700e8 on n-h2-860687-3 Oct 27 18:48:18.883694 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c50b6095-65f7-4fb7-a155-4775b1fb8c1c req-73250d78-10d5-4935-b3fb-590f7c86710b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046232 Oct 27 18:48:18.886215 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 451/881] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:18.892241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f92583b9-231b-4c51-87a8-05b8c22d119b tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7c8d9c07c885414f9dd1ea0fca08ad15"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:18.984358 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f92583b9-231b-4c51-87a8-05b8c22d119b tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/614253958/action" status: 200 len: 21 microversion: 2.1 time: 0.096307 Oct 27 18:48:18.990212 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 452/882] 10.222.0.42 () {60 vars in 1197 bytes} [Thu Oct 27 18:48:18 2022] POST /compute/v2.1/flavors/614253958/action => generated 21 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:18.997815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a0fda568-468f-4fdb-86aa-6c13d3cfa6f1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:18.998767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a0fda568-468f-4fdb-86aa-6c13d3cfa6f1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:19.005330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0fda568-468f-4fdb-86aa-6c13d3cfa6f1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:19.006033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0fda568-468f-4fdb-86aa-6c13d3cfa6f1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:19.006661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0fda568-468f-4fdb-86aa-6c13d3cfa6f1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:19.007760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0fda568-468f-4fdb-86aa-6c13d3cfa6f1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:19.008328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0fda568-468f-4fdb-86aa-6c13d3cfa6f1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:19.008954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0fda568-468f-4fdb-86aa-6c13d3cfa6f1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:19.088128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0fda568-468f-4fdb-86aa-6c13d3cfa6f1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:19.090803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0fda568-468f-4fdb-86aa-6c13d3cfa6f1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:19.096757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0fda568-468f-4fdb-86aa-6c13d3cfa6f1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:19.098980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-a0fda568-468f-4fdb-86aa-6c13d3cfa6f1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lazy-loading 'fault' on Instance uuid 15000861-ac47-42c5-a2c6-b22b490700e8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:48:19.205847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0fda568-468f-4fdb-86aa-6c13d3cfa6f1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e9c0b3a99d41a9ac42eb5a092be2c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e625a0c7d6544639b0066d000dc6794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:19.221971 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a0fda568-468f-4fdb-86aa-6c13d3cfa6f1 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 200 len: 1303 microversion: 2.1 time: 0.228238 Oct 27 18:48:19.232109 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 453/883] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:18 2022] GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 1303 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:19.259546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ac9439f-fcc7-49af-ac6a-120e5b69fa21 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86af57e50>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:19.341118 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3ac9439f-fcc7-49af-ac6a-120e5b69fa21 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.105340 Oct 27 18:48:19.350583 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 454/884] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:19 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:19.359536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0a45ea99-e6c6-4ba4-954d-3dfcc99f6bea tempest-FlavorsAccessTestJSON-1764246807 tempest-FlavorsAccessTestJSON-1764246807-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:19.409878 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0a45ea99-e6c6-4ba4-954d-3dfcc99f6bea tempest-FlavorsAccessTestJSON-1764246807 tempest-FlavorsAccessTestJSON-1764246807-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058052 Oct 27 18:48:19.410508 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 455/885] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:48:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:19.427955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-44c43a7c-a278-4d30-b567-ee6789314550 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:19.428889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-44c43a7c-a278-4d30-b567-ee6789314550 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:19.435877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44c43a7c-a278-4d30-b567-ee6789314550 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:19.436648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44c43a7c-a278-4d30-b567-ee6789314550 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:19.437314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44c43a7c-a278-4d30-b567-ee6789314550 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:19.438232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44c43a7c-a278-4d30-b567-ee6789314550 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:19.438903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44c43a7c-a278-4d30-b567-ee6789314550 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:19.439525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44c43a7c-a278-4d30-b567-ee6789314550 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:19.586480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b34ab85d-ff37-4e90-b0a6-25a744427787 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:19.596373 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b34ab85d-ff37-4e90-b0a6-25a744427787 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1470 microversion: 2.1 time: 1.043368 Oct 27 18:48:19.611728 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 431/886] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:18 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1470 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:19.622958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7bee1c7f-518c-4783-86f8-b7368a28bb9a tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:19.623836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7bee1c7f-518c-4783-86f8-b7368a28bb9a tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:19.632901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bee1c7f-518c-4783-86f8-b7368a28bb9a tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:19.633693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bee1c7f-518c-4783-86f8-b7368a28bb9a tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:19.634332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bee1c7f-518c-4783-86f8-b7368a28bb9a tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:19.636363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bee1c7f-518c-4783-86f8-b7368a28bb9a tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:19.637887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bee1c7f-518c-4783-86f8-b7368a28bb9a tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:19.638618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bee1c7f-518c-4783-86f8-b7368a28bb9a tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:19.788749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-44c43a7c-a278-4d30-b567-ee6789314550 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:19.798097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-44c43a7c-a278-4d30-b567-ee6789314550 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:19.799890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-44c43a7c-a278-4d30-b567-ee6789314550 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:19.801309 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-44c43a7c-a278-4d30-b567-ee6789314550 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1542 microversion: 2.25 time: 0.385652 Oct 27 18:48:19.802686 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 456/887] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:19 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1542 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:19.808064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a690837a-72d2-449e-af26-01fd4fe77684 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:19.819575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7bee1c7f-518c-4783-86f8-b7368a28bb9a tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:19.828762 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7bee1c7f-518c-4783-86f8-b7368a28bb9a tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1498 microversion: 2.1 time: 0.215677 Oct 27 18:48:19.846778 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 432/888] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:19 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1498 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:19.854665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e75f969c-2a09-44ee-acd6-e19cb6c76305 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '.version_select at 0x7fc86b12bdc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:19.855016 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a690837a-72d2-449e-af26-01fd4fe77684 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/614253958" status: 202 len: 0 microversion: 2.1 time: 0.050664 Oct 27 18:48:19.859007 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 457/889] 10.222.0.42 () {58 vars in 1158 bytes} [Thu Oct 27 18:48:19 2022] DELETE /compute/v2.1/flavors/614253958 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:48:19.862972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e75f969c-2a09-44ee-acd6-e19cb6c76305 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:19.863752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e75f969c-2a09-44ee-acd6-e19cb6c76305 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:19.864693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e75f969c-2a09-44ee-acd6-e19cb6c76305 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:19.868045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a0957efa-ae7e-402a-8c19-186ae8a10e76 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:19.869258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a0957efa-ae7e-402a-8c19-186ae8a10e76 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:19.877690 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e75f969c-2a09-44ee-acd6-e19cb6c76305 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 1949 microversion: 2.25 time: 0.029265 Oct 27 18:48:19.877866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0957efa-ae7e-402a-8c19-186ae8a10e76 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:19.879090 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 433/890] 10.222.0.42 () {60 vars in 1184 bytes} [Thu Oct 27 18:48:19 2022] GET /compute/v2.1/os-migrations => generated 1949 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:19.884881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ea951b36-7edd-4528-ad6f-cfb99ff49c51 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:19.896619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0957efa-ae7e-402a-8c19-186ae8a10e76 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:19.900558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0957efa-ae7e-402a-8c19-186ae8a10e76 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:19.904369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0957efa-ae7e-402a-8c19-186ae8a10e76 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:19.904837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0957efa-ae7e-402a-8c19-186ae8a10e76 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:19.905288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0957efa-ae7e-402a-8c19-186ae8a10e76 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:19.920837 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ea951b36-7edd-4528-ad6f-cfb99ff49c51 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040258 Oct 27 18:48:19.921872 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 434/891] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:48:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:19.927520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4bf6b55f-6051-4a21-8e72-595fdbdd1af1 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:19.928386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4bf6b55f-6051-4a21-8e72-595fdbdd1af1 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:19.934927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bf6b55f-6051-4a21-8e72-595fdbdd1af1 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:19.935756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bf6b55f-6051-4a21-8e72-595fdbdd1af1 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:19.936659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bf6b55f-6051-4a21-8e72-595fdbdd1af1 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:19.937762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bf6b55f-6051-4a21-8e72-595fdbdd1af1 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:19.938601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bf6b55f-6051-4a21-8e72-595fdbdd1af1 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:19.939251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bf6b55f-6051-4a21-8e72-595fdbdd1af1 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:20.208284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-4bf6b55f-6051-4a21-8e72-595fdbdd1af1 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 293448e8-0911-4074-a5d0-d9ff98094843 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:48:20.222493 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4bf6b55f-6051-4a21-8e72-595fdbdd1af1 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 2035 microversion: 2.25 time: 0.299276 Oct 27 18:48:20.223249 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 435/892] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:19 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 2035 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:20.228960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-042baed5-b6ae-4f5d-849d-ba8749e41180 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-80330043", "id": 685260301, "os-flavor-access:is_public": "False"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:20.244302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0957efa-ae7e-402a-8c19-186ae8a10e76 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:20.252160 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-042baed5-b6ae-4f5d-849d-ba8749e41180 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.027656 Oct 27 18:48:20.252761 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 436/893] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:48:20 2022] POST /compute/v2.1/flavors => generated 426 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:20.257358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-681de31f-664e-420a-93c8-bc3c48461dd1 req-0a0d73bc-3657-4217-a2bf-d01477e98240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0356d2-73d5-47bb-a499-17b029d1dad1", "name": "network-vif-deleted", "tag": "1f181151-81f9-4cf5-a37c-a15ffbe32f2e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:20.264397 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a0957efa-ae7e-402a-8c19-186ae8a10e76 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1371 microversion: 2.1 time: 0.407252 Oct 27 18:48:20.265429 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 458/894] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:19 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:20.274761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-681de31f-664e-420a-93c8-bc3c48461dd1 req-0a0d73bc-3657-4217-a2bf-d01477e98240 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:20.275253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-681de31f-664e-420a-93c8-bc3c48461dd1 req-0a0d73bc-3657-4217-a2bf-d01477e98240 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:20.275695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-681de31f-664e-420a-93c8-bc3c48461dd1 req-0a0d73bc-3657-4217-a2bf-d01477e98240 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:20.282877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5688cc48-216f-428f-b8b8-7d208357c520 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:20.284064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5688cc48-216f-428f-b8b8-7d208357c520 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] [instance: 15000861-ac47-42c5-a2c6-b22b490700e8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:20.294045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5688cc48-216f-428f-b8b8-7d208357c520 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:20.295650 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-681de31f-664e-420a-93c8-bc3c48461dd1 req-0a0d73bc-3657-4217-a2bf-d01477e98240 service nova] Creating event network-vif-deleted:1f181151-81f9-4cf5-a37c-a15ffbe32f2e for instance 7f0356d2-73d5-47bb-a499-17b029d1dad1 on n-h1-860687-3 Oct 27 18:48:20.296336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5688cc48-216f-428f-b8b8-7d208357c520 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:20.296792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5688cc48-216f-428f-b8b8-7d208357c520 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:20.297551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5688cc48-216f-428f-b8b8-7d208357c520 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:20.298017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5688cc48-216f-428f-b8b8-7d208357c520 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:20.298484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5688cc48-216f-428f-b8b8-7d208357c520 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:20.302834 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-681de31f-664e-420a-93c8-bc3c48461dd1 req-0a0d73bc-3657-4217-a2bf-d01477e98240 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048556 Oct 27 18:48:20.305283 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 437/895] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:20.315836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6043765-d5ef-4ffa-8e81-c9bedc6847c5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Action: 'create', calling method: .version_select at 0x7fc86b3c7f70>, body: {"keypair": {"name": "tempest-keypair-15047669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgM1a+cKGa+cq3jiwQiyjtKjCk29DDdTnajm54hNFnsdIL4mQoWm1FIebKiEbNObKNLVGa0OjC+sID2Mmjvh8Sn10Xr2bc8M7jmUCvvoJU4OE1keUw4PmgYNVZxRuKZJA=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:20.326109 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-5688cc48-216f-428f-b8b8-7d208357c520 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] HTTP exception thrown: Instance 15000861-ac47-42c5-a2c6-b22b490700e8 could not be found. Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5688cc48-216f-428f-b8b8-7d208357c520 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Request method failure captured: Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 HTTP/1.1 Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtJQjGUA6gC2q4Z_A0WaOz7srYrSDb6xZgsDBDbcuVWBA--luaWFUtDSy2O6l9F8keo0nM4PbsKU1p3X46SnraGiX_H71VnPJzihiQ03dpv95zv_bpeP496m4giohfebg0AI_vBrLh1wGAzbpr0idbiXLhf7ISJO65fAw-5tvfhXDOE Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 2e625a0c7d6544639b0066d000dc6794 Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TenantUsagesTestJSON-1596754169 Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:48:20.329072 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:48:20.330489 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2e625a0c7d6544639b0066d000dc6794"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2e625a0c7d6544639b0066d000dc6794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2e625a0c7d6544639b0066d000dc6794", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2e625a0c7d6544639b0066d000dc6794"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:48:20.330489 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TenantUsagesTestJSON-1596754169 Oct 27 18:48:20.330489 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 2e625a0c7d6544639b0066d000dc6794 Oct 27 18:48:20.330489 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1596754169 Oct 27 18:48:20.330489 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TenantUsagesTestJSON-1596754169-project Oct 27 18:48:20.330489 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:48:20.330489 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:48:20.330489 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 14e9c0b3a99d41a9ac42eb5a092be2c6 Oct 27 18:48:20.330489 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TenantUsagesTestJSON-1596754169-project Oct 27 18:48:20.330489 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:48:20.330489 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 15000861-ac47-42c5-a2c6-b22b490700e8 could not be found. Oct 27 18:48:20.330489 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '15000861-ac47-42c5-a2c6-b22b490700e8'} Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15000861-ac47-42c5-a2c6-b22b490700e8 could not be found. Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:48:20.331281 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15000861-ac47-42c5-a2c6-b22b490700e8 could not be found. Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15000861-ac47-42c5-a2c6-b22b490700e8 could not be found. Oct 27 18:48:20.332424 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:20.334803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5688cc48-216f-428f-b8b8-7d208357c520 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] Returning 404 to user: Instance 15000861-ac47-42c5-a2c6-b22b490700e8 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:48:20.334803 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5688cc48-216f-428f-b8b8-7d208357c520 tempest-TenantUsagesTestJSON-1596754169 tempest-TenantUsagesTestJSON-1596754169-project] 10.222.0.42 "GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8" status: 404 len: 111 microversion: 2.1 time: 0.065498 Oct 27 18:48:20.340148 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 459/896] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:20 2022] GET /compute/v2.1/servers/15000861-ac47-42c5-a2c6-b22b490700e8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:48:20.346821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-c6043765-d5ef-4ffa-8e81-c9bedc6847c5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Getting quotas for project a1c89e4b67024f91ae460e3ae3278277. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:20.359807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-68c5a619-b3d6-40e6-9377-ee64bc27f6c7 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:20.365978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-c6043765-d5ef-4ffa-8e81-c9bedc6847c5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Getting quotas for user c73a9daf485b421c8244f287fee5a942 and project a1c89e4b67024f91ae460e3ae3278277. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:20.387209 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-68c5a619-b3d6-40e6-9377-ee64bc27f6c7 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/685260301/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.049933 Oct 27 18:48:20.387791 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 460/897] 10.222.0.42 () {58 vars in 1206 bytes} [Thu Oct 27 18:48:20 2022] GET /compute/v2.1/flavors/685260301/os-flavor-access => generated 21 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:20.399019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b89d00af-3c0e-4adb-936f-853b8a5a4657 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86ae60b80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:20.413493 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c6043765-d5ef-4ffa-8e81-c9bedc6847c5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.25 time: 0.106648 Oct 27 18:48:20.415301 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 438/898] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Oct 27 18:48:20 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 18:48:20.432086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dd61cd11-0b2e-4520-9851-185cb6d5eb91 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:20.464895 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dd61cd11-0b2e-4520-9851-185cb6d5eb91 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/685260301" status: 202 len: 0 microversion: 2.1 time: 0.045159 Oct 27 18:48:20.470176 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 439/899] 10.222.0.42 () {58 vars in 1158 bytes} [Thu Oct 27 18:48:20 2022] DELETE /compute/v2.1/flavors/685260301 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:48:20.478269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9474a943-9504-416a-a3be-a064515a91f8 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:20.497839 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b89d00af-3c0e-4adb-936f-853b8a5a4657 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.105496 Oct 27 18:48:20.506795 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 461/900] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:20 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:20.548105 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9474a943-9504-416a-a3be-a064515a91f8 tempest-FlavorsAccessTestJSON-578133423 tempest-FlavorsAccessTestJSON-578133423-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076710 Oct 27 18:48:20.565692 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 440/901] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:48:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:20.627258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-30856f4d-020e-440f-aa47-133dbebaa5f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:20.628081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-30856f4d-020e-440f-aa47-133dbebaa5f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:20.642545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30856f4d-020e-440f-aa47-133dbebaa5f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:20.642901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30856f4d-020e-440f-aa47-133dbebaa5f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:20.643357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30856f4d-020e-440f-aa47-133dbebaa5f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:20.644085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30856f4d-020e-440f-aa47-133dbebaa5f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:20.644610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30856f4d-020e-440f-aa47-133dbebaa5f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:20.645106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30856f4d-020e-440f-aa47-133dbebaa5f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:20.861446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e1ae1e84-733a-479e-afa7-25762afe9b5c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:20.862195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e1ae1e84-733a-479e-afa7-25762afe9b5c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:20.880420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e84-733a-479e-afa7-25762afe9b5c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:20.880930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e84-733a-479e-afa7-25762afe9b5c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:20.881376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e84-733a-479e-afa7-25762afe9b5c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:20.882106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e84-733a-479e-afa7-25762afe9b5c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:20.887739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e84-733a-479e-afa7-25762afe9b5c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:20.888260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e84-733a-479e-afa7-25762afe9b5c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:20.957311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e84-733a-479e-afa7-25762afe9b5c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:20.957814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e84-733a-479e-afa7-25762afe9b5c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:20.958496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e84-733a-479e-afa7-25762afe9b5c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:20.959158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-e1ae1e84-733a-479e-afa7-25762afe9b5c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lazy-loading 'fault' on Instance uuid 7f0356d2-73d5-47bb-a499-17b029d1dad1 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:48:20.967959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-30856f4d-020e-440f-aa47-133dbebaa5f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:20.978319 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-30856f4d-020e-440f-aa47-133dbebaa5f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1470 microversion: 2.1 time: 0.354028 Oct 27 18:48:21.001166 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 462/902] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:20 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1470 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:48:21.062704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1ae1e84-733a-479e-afa7-25762afe9b5c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea78f6cb7bb4974a7d61d015b6a2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154455c389be498e84dc3b0ca4e7ee30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:21.072055 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e1ae1e84-733a-479e-afa7-25762afe9b5c tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 200 len: 1503 microversion: 2.1 time: 0.213957 Oct 27 18:48:21.074675 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 441/903] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:20 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 1503 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:48:21.271935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ca049fb4-7d8d-4176-9051-81848f14d0a7 req-ecd9e49b-376f-42d4-be2f-4c97f39aa9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52680d12-70da-485a-b4a1-172a49b7b959", "name": "network-vif-plugged", "status": "completed", "tag": "139bf86c-c95b-4317-8732-1c00618e5db8"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:21.289264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-573e1a24-85c4-40ba-9c23-3fc7a1b4cb0a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:21.289878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-573e1a24-85c4-40ba-9c23-3fc7a1b4cb0a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:21.305099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:21.307094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ca049fb4-7d8d-4176-9051-81848f14d0a7 req-ecd9e49b-376f-42d4-be2f-4c97f39aa9e3 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:21.311091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ca049fb4-7d8d-4176-9051-81848f14d0a7 req-ecd9e49b-376f-42d4-be2f-4c97f39aa9e3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:21.311555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ca049fb4-7d8d-4176-9051-81848f14d0a7 req-ecd9e49b-376f-42d4-be2f-4c97f39aa9e3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:21.315172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-573e1a24-85c4-40ba-9c23-3fc7a1b4cb0a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:21.315684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-573e1a24-85c4-40ba-9c23-3fc7a1b4cb0a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:21.316265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-573e1a24-85c4-40ba-9c23-3fc7a1b4cb0a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:21.317056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-573e1a24-85c4-40ba-9c23-3fc7a1b4cb0a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:21.319537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-573e1a24-85c4-40ba-9c23-3fc7a1b4cb0a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:21.319992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-573e1a24-85c4-40ba-9c23-3fc7a1b4cb0a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:21.347506 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ca049fb4-7d8d-4176-9051-81848f14d0a7 req-ecd9e49b-376f-42d4-be2f-4c97f39aa9e3 service nova] Creating event network-vif-plugged:139bf86c-c95b-4317-8732-1c00618e5db8 for instance 52680d12-70da-485a-b4a1-172a49b7b959 on n-h1-860687-3 Oct 27 18:48:21.361474 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ca049fb4-7d8d-4176-9051-81848f14d0a7 req-ecd9e49b-376f-42d4-be2f-4c97f39aa9e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093187 Oct 27 18:48:21.363223 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 463/904] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:21.515335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-35f13163-7647-42a4-99ea-aa1699f6bb5a tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86ae51550>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:21.606732 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-35f13163-7647-42a4-99ea-aa1699f6bb5a tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.096481 Oct 27 18:48:21.610621 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 464/905] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:21 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:48:21.935813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-573e1a24-85c4-40ba-9c23-3fc7a1b4cb0a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:21.966911 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-573e1a24-85c4-40ba-9c23-3fc7a1b4cb0a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1371 microversion: 2.1 time: 0.681349 Oct 27 18:48:21.971371 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 442/906] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:21 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1371 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:48:22.008835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-872fccc4-e8f5-4720-8305-45b1e01ed92c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:22.009593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-872fccc4-e8f5-4720-8305-45b1e01ed92c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:22.019443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:22.025316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-872fccc4-e8f5-4720-8305-45b1e01ed92c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:22.025860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-872fccc4-e8f5-4720-8305-45b1e01ed92c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:22.026583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-872fccc4-e8f5-4720-8305-45b1e01ed92c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:22.027485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-872fccc4-e8f5-4720-8305-45b1e01ed92c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:22.029422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-872fccc4-e8f5-4720-8305-45b1e01ed92c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:22.031776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-872fccc4-e8f5-4720-8305-45b1e01ed92c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:22.098111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f64dc9d7-92be-46a0-a98e-a2661e6dc785 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:22.099041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f64dc9d7-92be-46a0-a98e-a2661e6dc785 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] [instance: 7f0356d2-73d5-47bb-a499-17b029d1dad1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:22.112933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f64dc9d7-92be-46a0-a98e-a2661e6dc785 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:22.113701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f64dc9d7-92be-46a0-a98e-a2661e6dc785 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:22.118813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f64dc9d7-92be-46a0-a98e-a2661e6dc785 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:22.119905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f64dc9d7-92be-46a0-a98e-a2661e6dc785 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:22.120942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f64dc9d7-92be-46a0-a98e-a2661e6dc785 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:22.121054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f64dc9d7-92be-46a0-a98e-a2661e6dc785 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:22.157544 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-f64dc9d7-92be-46a0-a98e-a2661e6dc785 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] HTTP exception thrown: Instance 7f0356d2-73d5-47bb-a499-17b029d1dad1 could not be found. Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f64dc9d7-92be-46a0-a98e-a2661e6dc785 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Request method failure captured: Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 HTTP/1.1 Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtI-h48urHHPiNpbikDIR2FBJhWuMrtfuBNwB4zWb_lMw6Q8UiTlNiUnllkkl8vg-rFSP5fc4IzEXLiISJy7IbZf6kiWgJT53nuhM-mzjQfl5ZQM142h3AqegI1P7JzoTHHFO-gWoQW42gVcqjjp_-fku_dWUiGALN2HGTtqlqZQhxE Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 154455c389be498e84dc3b0ca4e7ee30 Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:48:22.167772 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:48:22.169689 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_154455c389be498e84dc3b0ca4e7ee30", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154455c389be498e84dc3b0ca4e7ee30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:48:22.169689 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:22.169689 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 154455c389be498e84dc3b0ca4e7ee30 Oct 27 18:48:22.169689 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 Oct 27 18:48:22.169689 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project Oct 27 18:48:22.169689 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:48:22.169689 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:48:22.169689 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 1ea78f6cb7bb4974a7d61d015b6a2faf Oct 27 18:48:22.169689 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project Oct 27 18:48:22.169689 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:48:22.169689 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 7f0356d2-73d5-47bb-a499-17b029d1dad1 could not be found. Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '7f0356d2-73d5-47bb-a499-17b029d1dad1'} Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0356d2-73d5-47bb-a499-17b029d1dad1 could not be found. Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:48:22.170487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0356d2-73d5-47bb-a499-17b029d1dad1 could not be found. Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0356d2-73d5-47bb-a499-17b029d1dad1 could not be found. Oct 27 18:48:22.172006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:22.174147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f64dc9d7-92be-46a0-a98e-a2661e6dc785 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] Returning 404 to user: Instance 7f0356d2-73d5-47bb-a499-17b029d1dad1 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:48:22.175065 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f64dc9d7-92be-46a0-a98e-a2661e6dc785 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357 tempest-FloatingIPsAssociationNegativeTestJSON-1629653357-project] 10.222.0.42 "GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1" status: 404 len: 111 microversion: 2.1 time: 0.081352 Oct 27 18:48:22.175960 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 443/907] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:22 2022] GET /compute/v2.1/servers/7f0356d2-73d5-47bb-a499-17b029d1dad1 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:48:22.624111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-61b5f8cf-0d54-4234-8dac-4583cc717fd2 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b0071f0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:22.692953 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-61b5f8cf-0d54-4234-8dac-4583cc717fd2 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.074045 Oct 27 18:48:22.693949 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 444/908] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:22 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:48:22.733582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-872fccc4-e8f5-4720-8305-45b1e01ed92c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:22.752838 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-872fccc4-e8f5-4720-8305-45b1e01ed92c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1475 microversion: 2.1 time: 0.748159 Oct 27 18:48:22.777379 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 465/909] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:22 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1475 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:22.993848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ebcc1835-2d48-4e16-8b5e-301635f7c091 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:22.995661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ebcc1835-2d48-4e16-8b5e-301635f7c091 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:23.003517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebcc1835-2d48-4e16-8b5e-301635f7c091 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:23.004282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebcc1835-2d48-4e16-8b5e-301635f7c091 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:23.004900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebcc1835-2d48-4e16-8b5e-301635f7c091 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:23.005928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebcc1835-2d48-4e16-8b5e-301635f7c091 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:23.007030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebcc1835-2d48-4e16-8b5e-301635f7c091 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:23.007740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebcc1835-2d48-4e16-8b5e-301635f7c091 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:23.204624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-110277360", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "339d213d-d58f-44f1-aeaf-54d635220475"}], "security_groups": [{"name": "tempest-securitygroup--1376120446"}], "key_name": "tempest-keypair-15047669", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:23.410657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] validate_networks() for [('339d213d-d58f-44f1-aeaf-54d635220475', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:48:23.432882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ebcc1835-2d48-4e16-8b5e-301635f7c091 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:23.440879 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ebcc1835-2d48-4e16-8b5e-301635f7c091 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1557 microversion: 2.1 time: 0.451648 Oct 27 18:48:23.457310 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 445/910] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:22 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1557 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:23.471695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-12f51564-a60c-452f-a27b-1bfdcaf3a241 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:23.472131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-12f51564-a60c-452f-a27b-1bfdcaf3a241 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:23.478241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12f51564-a60c-452f-a27b-1bfdcaf3a241 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:23.478984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12f51564-a60c-452f-a27b-1bfdcaf3a241 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:23.479654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12f51564-a60c-452f-a27b-1bfdcaf3a241 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:23.480546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12f51564-a60c-452f-a27b-1bfdcaf3a241 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:23.481257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12f51564-a60c-452f-a27b-1bfdcaf3a241 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:23.481908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12f51564-a60c-452f-a27b-1bfdcaf3a241 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:23.707001 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-12f51564-a60c-452f-a27b-1bfdcaf3a241 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.238296 Oct 27 18:48:23.708816 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 446/911] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 18:48:23 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959/os-interface => generated 284 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:23.714267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9e896a5c-68cd-493c-9c4e-a980a0202a44 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b1b01f0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:23.794693 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9e896a5c-68cd-493c-9c4e-a980a0202a44 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.084516 Oct 27 18:48:23.795595 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 447/912] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:23 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:23.801073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-78bca3f2-bed7-4166-8be1-02fd01a87f40 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:23.802180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-78bca3f2-bed7-4166-8be1-02fd01a87f40 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:23.822693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78bca3f2-bed7-4166-8be1-02fd01a87f40 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:23.823674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78bca3f2-bed7-4166-8be1-02fd01a87f40 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:23.824516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78bca3f2-bed7-4166-8be1-02fd01a87f40 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:23.825506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78bca3f2-bed7-4166-8be1-02fd01a87f40 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:23.826245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78bca3f2-bed7-4166-8be1-02fd01a87f40 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:23.826966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78bca3f2-bed7-4166-8be1-02fd01a87f40 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:24.095686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:48:24.096597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:48:24.097312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:48:24.097978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:48:24.098734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:48:24.114740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:24.115853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:24.118218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:24.119468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:24.121420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:24.122277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:24.156940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Getting quotas for project a1c89e4b67024f91ae460e3ae3278277. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:24.163511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Getting quotas for user c73a9daf485b421c8244f287fee5a942 and project a1c89e4b67024f91ae460e3ae3278277. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:24.180242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:48:24.184265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:48:24.324886 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-87dbf1b3-55f9-4932-8246-0114e36ebbc2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.124500 Oct 27 18:48:24.331961 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 466/913] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 18:48:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 18:48:24.353338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-a5de99f7-5be6-42cf-aaa8-52284262cacb req-475b2782-373a-41a2-8604-5ba9b1b974b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a645e2-ba92-42c7-8a35-8aea0ee2f9b9", "name": "network-vif-plugged", "status": "completed", "tag": "2cf40f9d-6d09-4726-8ad1-d50203aea23c"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:24.394861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a5de99f7-5be6-42cf-aaa8-52284262cacb req-475b2782-373a-41a2-8604-5ba9b1b974b5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:24.395849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a5de99f7-5be6-42cf-aaa8-52284262cacb req-475b2782-373a-41a2-8604-5ba9b1b974b5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:24.396494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a5de99f7-5be6-42cf-aaa8-52284262cacb req-475b2782-373a-41a2-8604-5ba9b1b974b5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:24.440377 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a5de99f7-5be6-42cf-aaa8-52284262cacb req-475b2782-373a-41a2-8604-5ba9b1b974b5 service nova] Creating event network-vif-plugged:2cf40f9d-6d09-4726-8ad1-d50203aea23c for instance 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 on n-h2-860687-3 Oct 27 18:48:24.461945 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-a5de99f7-5be6-42cf-aaa8-52284262cacb req-475b2782-373a-41a2-8604-5ba9b1b974b5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127385 Oct 27 18:48:24.461945 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 467/914] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:24.475824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-84dab8d4-0d13-43fa-b196-29d79248f2fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:24.480110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-84dab8d4-0d13-43fa-b196-29d79248f2fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:24.673256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-84dab8d4-0d13-43fa-b196-29d79248f2fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:24.688441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-84dab8d4-0d13-43fa-b196-29d79248f2fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:24.692374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-84dab8d4-0d13-43fa-b196-29d79248f2fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:24.693558 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-84dab8d4-0d13-43fa-b196-29d79248f2fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1283 microversion: 2.25 time: 0.230448 Oct 27 18:48:24.705022 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 468/915] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:24 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1283 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:24.811087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-934b4184-6475-4445-84b0-b49299547c82 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86aeab4c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:24.884891 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-934b4184-6475-4445-84b0-b49299547c82 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.078300 Oct 27 18:48:24.886153 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 469/916] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:24 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:48:25.060944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-78bca3f2-bed7-4166-8be1-02fd01a87f40 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:25.081005 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-78bca3f2-bed7-4166-8be1-02fd01a87f40 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1475 microversion: 2.1 time: 1.282206 Oct 27 18:48:25.081822 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 448/917] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:23 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1475 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:25.730143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fd78d7da-6ad0-4760-8408-18f77cbc88cf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:25.739383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fd78d7da-6ad0-4760-8408-18f77cbc88cf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:25.757806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd78d7da-6ad0-4760-8408-18f77cbc88cf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:25.759978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd78d7da-6ad0-4760-8408-18f77cbc88cf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:25.760659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd78d7da-6ad0-4760-8408-18f77cbc88cf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:25.762450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd78d7da-6ad0-4760-8408-18f77cbc88cf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:25.764305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd78d7da-6ad0-4760-8408-18f77cbc88cf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:25.766903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd78d7da-6ad0-4760-8408-18f77cbc88cf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:25.904376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3a2db41d-402e-4de3-b38a-8c09e7a3c6b5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b3c78b0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:25.958236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd78d7da-6ad0-4760-8408-18f77cbc88cf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:25.977074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd78d7da-6ad0-4760-8408-18f77cbc88cf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:25.981044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd78d7da-6ad0-4760-8408-18f77cbc88cf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:25.991923 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fd78d7da-6ad0-4760-8408-18f77cbc88cf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1335 microversion: 2.25 time: 0.273526 Oct 27 18:48:26.012491 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3a2db41d-402e-4de3-b38a-8c09e7a3c6b5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.114187 Oct 27 18:48:26.021603 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 449/918] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:25 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:26.022885 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 470/919] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:25 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1335 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:26.107608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-55ad7cac-0aef-4346-958d-4f4e84f4dd2b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:26.108866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-55ad7cac-0aef-4346-958d-4f4e84f4dd2b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:26.118695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55ad7cac-0aef-4346-958d-4f4e84f4dd2b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:26.121206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55ad7cac-0aef-4346-958d-4f4e84f4dd2b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:26.131107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55ad7cac-0aef-4346-958d-4f4e84f4dd2b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:26.132157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55ad7cac-0aef-4346-958d-4f4e84f4dd2b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:26.132817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55ad7cac-0aef-4346-958d-4f4e84f4dd2b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:26.133413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55ad7cac-0aef-4346-958d-4f4e84f4dd2b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:26.139884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:26.553756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-55ad7cac-0aef-4346-958d-4f4e84f4dd2b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:26.566750 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-55ad7cac-0aef-4346-958d-4f4e84f4dd2b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1475 microversion: 2.1 time: 0.464700 Oct 27 18:48:26.567365 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 450/920] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:26 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1475 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:27.029533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fe71a69e-1d25-4572-9720-1a96d3d44411 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86ae6fdc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:27.038224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bbdfd7f1-df27-4671-b87b-11be469fac52 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:27.039943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bbdfd7f1-df27-4671-b87b-11be469fac52 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:27.058455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbdfd7f1-df27-4671-b87b-11be469fac52 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:27.062400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbdfd7f1-df27-4671-b87b-11be469fac52 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:27.063126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbdfd7f1-df27-4671-b87b-11be469fac52 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:27.064617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbdfd7f1-df27-4671-b87b-11be469fac52 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:27.071951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbdfd7f1-df27-4671-b87b-11be469fac52 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:27.072550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbdfd7f1-df27-4671-b87b-11be469fac52 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:27.308715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bbdfd7f1-df27-4671-b87b-11be469fac52 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:27.325388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bbdfd7f1-df27-4671-b87b-11be469fac52 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:27.335112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bbdfd7f1-df27-4671-b87b-11be469fac52 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:27.336663 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bbdfd7f1-df27-4671-b87b-11be469fac52 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1341 microversion: 2.25 time: 0.302363 Oct 27 18:48:27.337635 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 451/921] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:27 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1341 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:48:27.648391 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fe71a69e-1d25-4572-9720-1a96d3d44411 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.623384 Oct 27 18:48:27.661406 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 471/922] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:27 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:27.669282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8b72a9af-d9e9-4eac-85f5-919f89dee5c4 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Calling method '.version_select at 0x7fc86ae6de50>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:27.736595 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8b72a9af-d9e9-4eac-85f5-919f89dee5c4 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "GET /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861" status: 200 len: 636 microversion: 2.1 time: 0.073777 Oct 27 18:48:27.743019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d377f22c-396a-4b70-9456-aa8486aa6ecb tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Calling method '.version_select at 0x7fc86afc89d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:27.745840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d377f22c-396a-4b70-9456-aa8486aa6ecb tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:27.746654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d377f22c-396a-4b70-9456-aa8486aa6ecb tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:27.747496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d377f22c-396a-4b70-9456-aa8486aa6ecb tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:27.750302 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 472/923] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:27 2022] GET /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861 => generated 636 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:27.779210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c7615a5c-c350-4748-91b9-02feee863782 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:27.789165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c7615a5c-c350-4748-91b9-02feee863782 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:27.807868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7615a5c-c350-4748-91b9-02feee863782 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:27.808615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7615a5c-c350-4748-91b9-02feee863782 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:27.809264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d377f22c-396a-4b70-9456-aa8486aa6ecb tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:27.809943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7615a5c-c350-4748-91b9-02feee863782 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:27.810775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d377f22c-396a-4b70-9456-aa8486aa6ecb tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:27.811773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7615a5c-c350-4748-91b9-02feee863782 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:27.812488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d377f22c-396a-4b70-9456-aa8486aa6ecb tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:27.816004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7615a5c-c350-4748-91b9-02feee863782 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:27.816756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7615a5c-c350-4748-91b9-02feee863782 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:27.849336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d377f22c-396a-4b70-9456-aa8486aa6ecb tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:27.850235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d377f22c-396a-4b70-9456-aa8486aa6ecb tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:27.853952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d377f22c-396a-4b70-9456-aa8486aa6ecb tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:27.870001 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d377f22c-396a-4b70-9456-aa8486aa6ecb tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.530353 Oct 27 18:48:27.873290 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 452/924] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:48:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:27.889047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e66cb20f-f06b-4a30-aa91-32b47545979e tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Action: 'update_all', calling method: .version_select at 0x7fc86afc8160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:27.976186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-e66cb20f-f06b-4a30-aa91-32b47545979e tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:27.988467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-e66cb20f-f06b-4a30-aa91-32b47545979e tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for user e089973a345d4dde96776ee6ae422148 and project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:28.446130 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e66cb20f-f06b-4a30-aa91-32b47545979e tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata" status: 200 len: 61 microversion: 2.1 time: 0.570089 Oct 27 18:48:28.448297 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 453/925] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:48:27 2022] PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata => generated 61 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:28.506038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c7615a5c-c350-4748-91b9-02feee863782 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:28.524922 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c7615a5c-c350-4748-91b9-02feee863782 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1475 microversion: 2.1 time: 0.767541 Oct 27 18:48:28.544690 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 473/926] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:27 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1475 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:28.560856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ee62d281-e023-4a43-9ae3-97362fb3ff9c req-42af9572-2905-4a79-be8e-5a427939ef97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52680d12-70da-485a-b4a1-172a49b7b959", "tag": "139bf86c-c95b-4317-8732-1c00618e5db8"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:28.614368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ee62d281-e023-4a43-9ae3-97362fb3ff9c req-42af9572-2905-4a79-be8e-5a427939ef97 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:28.615993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ee62d281-e023-4a43-9ae3-97362fb3ff9c req-42af9572-2905-4a79-be8e-5a427939ef97 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:28.618867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ee62d281-e023-4a43-9ae3-97362fb3ff9c req-42af9572-2905-4a79-be8e-5a427939ef97 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:28.646335 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ee62d281-e023-4a43-9ae3-97362fb3ff9c req-42af9572-2905-4a79-be8e-5a427939ef97 service nova] Creating event network-changed:139bf86c-c95b-4317-8732-1c00618e5db8 for instance 52680d12-70da-485a-b4a1-172a49b7b959 on n-h1-860687-3 Oct 27 18:48:28.662045 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ee62d281-e023-4a43-9ae3-97362fb3ff9c req-42af9572-2905-4a79-be8e-5a427939ef97 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115396 Oct 27 18:48:28.662953 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 474/927] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:28.669633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b0d93101-cd00-48da-b491-06e1e7883f7e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:28.671413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0d93101-cd00-48da-b491-06e1e7883f7e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:28.678431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0d93101-cd00-48da-b491-06e1e7883f7e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:28.679298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0d93101-cd00-48da-b491-06e1e7883f7e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:28.680000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0d93101-cd00-48da-b491-06e1e7883f7e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:28.681256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0d93101-cd00-48da-b491-06e1e7883f7e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:28.681942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0d93101-cd00-48da-b491-06e1e7883f7e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:28.683646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0d93101-cd00-48da-b491-06e1e7883f7e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:28.742896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b328945a-7de2-4d45-8122-8cf1b1726443 tempest-HypervisorAdminNegativeUnderV252Test-536407273 tempest-HypervisorAdminNegativeUnderV252Test-536407273-project] Calling method '.version_select at 0x7fc86afc8280>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:28.745660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b328945a-7de2-4d45-8122-8cf1b1726443 tempest-HypervisorAdminNegativeUnderV252Test-536407273 tempest-HypervisorAdminNegativeUnderV252Test-536407273-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'cb5e6ebf12664a1ea50ccd0a729a5c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5d6266f9484e8bb8a5ace4103d1265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b328945a-7de2-4d45-8122-8cf1b1726443 tempest-HypervisorAdminNegativeUnderV252Test-536407273 tempest-HypervisorAdminNegativeUnderV252Test-536407273-project] Request method failure captured: Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-hypervisors/n-h1-860687-3/search HTTP/1.1 Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtJ5Hy_cFZ0Ocd3an6vZdlez3l2kYjf0dTbyJeIQ7jhQitgMRZ57utKeNVeUOeDKfR_md7Q3Gutx13tFgzcOa3ULJG1jSQPcdcdr3JQMhbbH0R0AWZxaRDonbKSA03tzMi9fAVOMOUray_4F2_0TzEobC5XMJEOW4ctIwhl7u0o6ARE Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 3c5d6266f9484e8bb8a5ace4103d1265 Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-536407273 Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:48:28.747618 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:48:28.748912 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c5d6266f9484e8bb8a5ace4103d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c5d6266f9484e8bb8a5ace4103d1265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c5d6266f9484e8bb8a5ace4103d1265", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c5d6266f9484e8bb8a5ace4103d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:48:28.748912 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-536407273 Oct 27 18:48:28.748912 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 3c5d6266f9484e8bb8a5ace4103d1265 Oct 27 18:48:28.748912 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-536407273 Oct 27 18:48:28.748912 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-536407273-project Oct 27 18:48:28.748912 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:48:28.748912 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:48:28.748912 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: cb5e6ebf12664a1ea50ccd0a729a5c79 Oct 27 18:48:28.748912 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-536407273-project Oct 27 18:48:28.748912 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:48:28.748912 n-d-860687-3 devstack@n-api.service[127029]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 27 18:48:28.748912 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'n-h1-860687-3'} Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:48:28.749655 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 27 18:48:28.750803 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:28.759370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b328945a-7de2-4d45-8122-8cf1b1726443 tempest-HypervisorAdminNegativeUnderV252Test-536407273 tempest-HypervisorAdminNegativeUnderV252Test-536407273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:48:28.763536 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b328945a-7de2-4d45-8122-8cf1b1726443 tempest-HypervisorAdminNegativeUnderV252Test-536407273 tempest-HypervisorAdminNegativeUnderV252Test-536407273-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/n-h1-860687-3/search" status: 403 len: 117 microversion: 2.1 time: 0.313486 Oct 27 18:48:28.767286 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 454/928] 10.222.0.42 () {58 vars in 1209 bytes} [Thu Oct 27 18:48:28 2022] GET /compute/v2.1/os-hypervisors/n-h1-860687-3/search => generated 117 bytes in 318 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:48:28.776785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5ff0a1a4-3c7a-4d18-b392-a0866732d3ca tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Calling method '.version_select at 0x7fc86b073670>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:29.303749 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5ff0a1a4-3c7a-4d18-b392-a0866732d3ca tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "DELETE /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.534600 Oct 27 18:48:29.305385 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 455/929] 10.222.0.42 () {58 vars in 1296 bytes} [Thu Oct 27 18:48:28 2022] DELETE /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata/os_version => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:48:29.318056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-755bbb72-e3cc-4129-a356-beeadb7abfea tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b039430>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:29.381577 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-755bbb72-e3cc-4129-a356-beeadb7abfea tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.074957 Oct 27 18:48:29.390601 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 456/930] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:29 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:29.395621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3e484254-1d12-4e1d-891d-8894761d1ec4 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Calling method '.version_select at 0x7fc86b12bb80>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:29.397720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e484254-1d12-4e1d-891d-8894761d1ec4 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:29.398615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e484254-1d12-4e1d-891d-8894761d1ec4 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:29.399307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e484254-1d12-4e1d-891d-8894761d1ec4 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:29.408434 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-3e484254-1d12-4e1d-891d-8894761d1ec4 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3e484254-1d12-4e1d-891d-8894761d1ec4 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Request method failure captured: Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtJ6fUj4wSdaXFdLB95gKe-N41pwaQgO-s0_jW7tpwlLuS6SaiX6z5GF6B1XuyBJz0hKNcgo6qy1BlCu5_vPgF0uVoR7wYI7h6ml2eycPF-1RcGnlqD2G7kQuvG44DoyVwY4wEhWbCfDoyKBjuSx0KYmEL_2uT8l_BZiUT3X8pOCHoA Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: d981d3ad4ad34ee1bf2317387a940b61 Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-532132723 Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:48:29.410217 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:48:29.411580 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d981d3ad4ad34ee1bf2317387a940b61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d981d3ad4ad34ee1bf2317387a940b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d981d3ad4ad34ee1bf2317387a940b61", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d981d3ad4ad34ee1bf2317387a940b61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:48:29.411580 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-532132723 Oct 27 18:48:29.411580 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: d981d3ad4ad34ee1bf2317387a940b61 Oct 27 18:48:29.411580 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-532132723 Oct 27 18:48:29.411580 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin Oct 27 18:48:29.411580 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:48:29.411580 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:48:29.411580 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a2171401f19d4878869675b4dcae281d Oct 27 18:48:29.411580 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin Oct 27 18:48:29.411580 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:48:29.411580 n-d-860687-3 devstack@n-api.service[127029]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 18:48:29.411580 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:29.412310 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:29.413871 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:29.413871 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:48:29.413871 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:48:29.413871 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 18:48:29.413871 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:29.415919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3e484254-1d12-4e1d-891d-8894761d1ec4 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:48:29.417556 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3e484254-1d12-4e1d-891d-8894761d1ec4 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.025641 Oct 27 18:48:29.418949 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 457/931] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 18:48:29 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:48:29.426618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4af62f68-7546-42b9-a7c8-5c07cf2d2147 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Calling method '.version_select at 0x7fc86b0071f0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:29.486923 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4af62f68-7546-42b9-a7c8-5c07cf2d2147 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "GET /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata" status: 200 len: 37 microversion: 2.1 time: 0.066348 Oct 27 18:48:29.488298 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 458/932] 10.222.0.42 () {58 vars in 1260 bytes} [Thu Oct 27 18:48:29 2022] GET /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata => generated 37 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:29.495636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e3c017f5-a354-4cfa-b902-ea15090e4861 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Calling method '.version_select at 0x7fc86b12b790>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:29.498012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3c017f5-a354-4cfa-b902-ea15090e4861 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:29.498790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3c017f5-a354-4cfa-b902-ea15090e4861 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:29.500041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3c017f5-a354-4cfa-b902-ea15090e4861 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:29.527564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3c017f5-a354-4cfa-b902-ea15090e4861 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:29.529613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3c017f5-a354-4cfa-b902-ea15090e4861 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:29.530866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3c017f5-a354-4cfa-b902-ea15090e4861 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:29.569208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3c017f5-a354-4cfa-b902-ea15090e4861 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:29.570031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3c017f5-a354-4cfa-b902-ea15090e4861 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:29.570700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3c017f5-a354-4cfa-b902-ea15090e4861 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:29.582219 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e3c017f5-a354-4cfa-b902-ea15090e4861 tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.092490 Oct 27 18:48:29.583516 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 459/933] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:48:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:29.594686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7d2f536d-5f84-42a9-9375-562a26c4942b tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Action: 'update_all', calling method: .version_select at 0x7fc86b058430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:29.719150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-7d2f536d-5f84-42a9-9375-562a26c4942b tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:29.727864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-7d2f536d-5f84-42a9-9375-562a26c4942b tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for user e089973a345d4dde96776ee6ae422148 and project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:30.189207 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7d2f536d-5f84-42a9-9375-562a26c4942b tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata" status: 200 len: 61 microversion: 2.1 time: 0.603034 Oct 27 18:48:30.194011 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 460/934] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:48:29 2022] PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata => generated 61 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:30.197267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d39b2476-dd2f-4804-aa4e-5ddb43a5b649 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:30.198096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d39b2476-dd2f-4804-aa4e-5ddb43a5b649 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:30.207753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d39b2476-dd2f-4804-aa4e-5ddb43a5b649 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:30.209163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d39b2476-dd2f-4804-aa4e-5ddb43a5b649 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:30.210291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d39b2476-dd2f-4804-aa4e-5ddb43a5b649 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:30.211390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d39b2476-dd2f-4804-aa4e-5ddb43a5b649 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:30.212274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d39b2476-dd2f-4804-aa4e-5ddb43a5b649 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:30.212873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d39b2476-dd2f-4804-aa4e-5ddb43a5b649 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:30.491774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0d93101-cd00-48da-b491-06e1e7883f7e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:30.507888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0d93101-cd00-48da-b491-06e1e7883f7e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:30.515240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0d93101-cd00-48da-b491-06e1e7883f7e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:30.516519 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b0d93101-cd00-48da-b491-06e1e7883f7e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1409 microversion: 2.25 time: 1.852151 Oct 27 18:48:30.524840 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 475/935] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:28 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1409 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:30.531240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d98bac9f-3071-462e-b5ea-41cfe59e8b3a tempest-HypervisorAdminNegativeUnderV252Test-536407273 tempest-HypervisorAdminNegativeUnderV252Test-536407273-project] Calling method '.version_select at 0x7fc86ae60a60>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:30.540114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d98bac9f-3071-462e-b5ea-41cfe59e8b3a tempest-HypervisorAdminNegativeUnderV252Test-536407273 tempest-HypervisorAdminNegativeUnderV252Test-536407273-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'cb5e6ebf12664a1ea50ccd0a729a5c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5d6266f9484e8bb8a5ace4103d1265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d98bac9f-3071-462e-b5ea-41cfe59e8b3a tempest-HypervisorAdminNegativeUnderV252Test-536407273 tempest-HypervisorAdminNegativeUnderV252Test-536407273-project] Request method failure captured: Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtJ5Hy_cFZ0Ocd3an6vZdlez3l2kYjf0dTbyJeIQ7jhQitgMRZ57utKeNVeUOeDKfR_md7Q3Gutx13tFgzcOa3ULJG1jSQPcdcdr3JQMhbbH0R0AWZxaRDonbKSA03tzMi9fAVOMOUray_4F2_0TzEobC5XMJEOW4ctIwhl7u0o6ARE Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 3c5d6266f9484e8bb8a5ace4103d1265 Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-536407273 Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:48:30.543691 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:48:30.544993 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c5d6266f9484e8bb8a5ace4103d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c5d6266f9484e8bb8a5ace4103d1265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c5d6266f9484e8bb8a5ace4103d1265", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c5d6266f9484e8bb8a5ace4103d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:48:30.544993 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-536407273 Oct 27 18:48:30.544993 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 3c5d6266f9484e8bb8a5ace4103d1265 Oct 27 18:48:30.544993 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-536407273 Oct 27 18:48:30.544993 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-536407273-project Oct 27 18:48:30.544993 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:48:30.544993 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:48:30.544993 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: cb5e6ebf12664a1ea50ccd0a729a5c79 Oct 27 18:48:30.544993 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-536407273-project Oct 27 18:48:30.544993 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:48:30.544993 n-d-860687-3 devstack@n-api.service[127028]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 27 18:48:30.544993 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '1'} Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:48:30.545696 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 27 18:48:30.546884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:30.547934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d98bac9f-3071-462e-b5ea-41cfe59e8b3a tempest-HypervisorAdminNegativeUnderV252Test-536407273 tempest-HypervisorAdminNegativeUnderV252Test-536407273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:48:30.547934 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d98bac9f-3071-462e-b5ea-41cfe59e8b3a tempest-HypervisorAdminNegativeUnderV252Test-536407273 tempest-HypervisorAdminNegativeUnderV252Test-536407273-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.020449 Oct 27 18:48:30.548193 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 476/936] 10.222.0.42 () {58 vars in 1176 bytes} [Thu Oct 27 18:48:30 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:48:30.568300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a9a3a7cf-5642-44bd-b364-eda582c67230 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Calling method '.version_select at 0x7fc86aeab310>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:30.640508 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a9a3a7cf-5642-44bd-b364-eda582c67230 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "GET /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.090418 Oct 27 18:48:30.641933 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 477/937] 10.222.0.42 () {58 vars in 1290 bytes} [Thu Oct 27 18:48:30 2022] GET /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata/os_distro => generated 33 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:30.661792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-341b790b-e446-4812-b51d-3cc85ab33bb1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86ae60d30>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:30.725734 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-341b790b-e446-4812-b51d-3cc85ab33bb1 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.082132 Oct 27 18:48:30.726321 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 478/938] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:30 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:30.741678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-14d1d72b-3ca3-4531-924f-7991bee6336f tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Calling method '.version_select at 0x7fc86b072790>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:30.744417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14d1d72b-3ca3-4531-924f-7991bee6336f tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:30.745310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14d1d72b-3ca3-4531-924f-7991bee6336f tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:30.746095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14d1d72b-3ca3-4531-924f-7991bee6336f tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:30.754540 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-14d1d72b-3ca3-4531-924f-7991bee6336f tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] HTTP exception thrown: No hypervisor matching '1f910da7-4fbb-44ca-9205-0341b8b1768e' could be found. Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-14d1d72b-3ca3-4531-924f-7991bee6336f tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Request method failure captured: Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-hypervisors/1f910da7-4fbb-44ca-9205-0341b8b1768e/servers HTTP/1.1 Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtJ6fUj4wSdaXFdLB95gKe-N41pwaQgO-s0_jW7tpwlLuS6SaiX6z5GF6B1XuyBJz0hKNcgo6qy1BlCu5_vPgF0uVoR7wYI7h6ml2eycPF-1RcGnlqD2G7kQuvG44DoyVwY4wEhWbCfDoyKBjuSx0KYmEL_2uT8l_BZiUT3X8pOCHoA Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: d981d3ad4ad34ee1bf2317387a940b61 Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-532132723 Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 18:48:30.756430 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 18:48:30.757844 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d981d3ad4ad34ee1bf2317387a940b61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d981d3ad4ad34ee1bf2317387a940b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d981d3ad4ad34ee1bf2317387a940b61", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d981d3ad4ad34ee1bf2317387a940b61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:48:30.757844 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-532132723 Oct 27 18:48:30.757844 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: d981d3ad4ad34ee1bf2317387a940b61 Oct 27 18:48:30.757844 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-532132723 Oct 27 18:48:30.757844 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin Oct 27 18:48:30.757844 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:48:30.757844 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:48:30.757844 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: a2171401f19d4878869675b4dcae281d Oct 27 18:48:30.757844 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin Oct 27 18:48:30.757844 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:48:30.757844 n-d-860687-3 devstack@n-api.service[127028]: exception: No hypervisor matching '1f910da7-4fbb-44ca-9205-0341b8b1768e' could be found. Oct 27 18:48:30.757844 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '1f910da7-4fbb-44ca-9205-0341b8b1768e'} Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '1f910da7-4fbb-44ca-9205-0341b8b1768e' could be found. Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:30.758598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:30.759693 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:30.759693 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:30.759693 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:48:30.759693 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:48:30.759693 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '1f910da7-4fbb-44ca-9205-0341b8b1768e' could be found. Oct 27 18:48:30.759693 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:48:30.765042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-14d1d72b-3ca3-4531-924f-7991bee6336f tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] Returning 404 to user: No hypervisor matching '1f910da7-4fbb-44ca-9205-0341b8b1768e' could be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:48:30.766370 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-14d1d72b-3ca3-4531-924f-7991bee6336f tempest-HypervisorAdminNegativeUnderV252Test-532132723 tempest-HypervisorAdminNegativeUnderV252Test-532132723-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1f910da7-4fbb-44ca-9205-0341b8b1768e/servers" status: 404 len: 123 microversion: 2.1 time: 0.028511 Oct 27 18:48:30.767303 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 479/939] 10.222.0.42 () {58 vars in 1281 bytes} [Thu Oct 27 18:48:30 2022] GET /compute/v2.1/os-hypervisors/1f910da7-4fbb-44ca-9205-0341b8b1768e/servers => generated 123 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:48:30.785789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4fd13c71-7e18-4054-b144-be2a569fd259 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Action: 'update_all', calling method: .version_select at 0x7fc86ae6da60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:30.879893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-4fd13c71-7e18-4054-b144-be2a569fd259 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:30.891716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-4fd13c71-7e18-4054-b144-be2a569fd259 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for user e089973a345d4dde96776ee6ae422148 and project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:31.243998 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4fd13c71-7e18-4054-b144-be2a569fd259 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata" status: 200 len: 61 microversion: 2.1 time: 0.475324 Oct 27 18:48:31.249987 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 480/940] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:48:30 2022] PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata => generated 61 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:31.255634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f78a7993-eacd-4115-8ef9-d17bbea21aa0 req-4a511ded-ac45-4712-a0ce-d8919d237088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d5439d-efc3-4e29-a439-7b8b40177342", "tag": "cb412b3e-6a21-4028-8662-7d6ffba2fede"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:31.266224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d39b2476-dd2f-4804-aa4e-5ddb43a5b649 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:31.277543 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d39b2476-dd2f-4804-aa4e-5ddb43a5b649 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1475 microversion: 2.1 time: 1.086234 Oct 27 18:48:31.281636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f78a7993-eacd-4115-8ef9-d17bbea21aa0 req-4a511ded-ac45-4712-a0ce-d8919d237088 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:31.282161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f78a7993-eacd-4115-8ef9-d17bbea21aa0 req-4a511ded-ac45-4712-a0ce-d8919d237088 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:31.282641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f78a7993-eacd-4115-8ef9-d17bbea21aa0 req-4a511ded-ac45-4712-a0ce-d8919d237088 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:31.285315 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 461/941] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:30 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1475 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:31.300025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-00d1e213-b021-46fa-ba0e-2207581cbe58 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Calling method '.version_select at 0x7fc86b153310>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:31.321323 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f78a7993-eacd-4115-8ef9-d17bbea21aa0 req-4a511ded-ac45-4712-a0ce-d8919d237088 service nova] Creating event network-changed:cb412b3e-6a21-4028-8662-7d6ffba2fede for instance 26d5439d-efc3-4e29-a439-7b8b40177342 on n-h1-860687-3 Oct 27 18:48:31.343388 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f78a7993-eacd-4115-8ef9-d17bbea21aa0 req-4a511ded-ac45-4712-a0ce-d8919d237088 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091984 Oct 27 18:48:31.350023 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 481/942] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:31.381516 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-00d1e213-b021-46fa-ba0e-2207581cbe58 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "GET /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata" status: 200 len: 61 microversion: 2.1 time: 0.094803 Oct 27 18:48:31.383101 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 462/943] 10.222.0.42 () {58 vars in 1260 bytes} [Thu Oct 27 18:48:31 2022] GET /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata => generated 61 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:31.395098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f714f72b-e2f8-4231-ad78-d6da2e7f9a9e tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Action: 'update_all', calling method: .version_select at 0x7fc86aeabf70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:31.482923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-f714f72b-e2f8-4231-ad78-d6da2e7f9a9e tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:31.492735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-f714f72b-e2f8-4231-ad78-d6da2e7f9a9e tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for user e089973a345d4dde96776ee6ae422148 and project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:31.548864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-867a909c-6bf0-40e3-8ead-47c20403b3d7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:31.549522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-867a909c-6bf0-40e3-8ead-47c20403b3d7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:31.564863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-867a909c-6bf0-40e3-8ead-47c20403b3d7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:31.565467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-867a909c-6bf0-40e3-8ead-47c20403b3d7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:31.566169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-867a909c-6bf0-40e3-8ead-47c20403b3d7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:31.566706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-867a909c-6bf0-40e3-8ead-47c20403b3d7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:31.567191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-867a909c-6bf0-40e3-8ead-47c20403b3d7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:31.567628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-867a909c-6bf0-40e3-8ead-47c20403b3d7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:31.877586 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f714f72b-e2f8-4231-ad78-d6da2e7f9a9e tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata" status: 200 len: 61 microversion: 2.1 time: 0.487328 Oct 27 18:48:31.878191 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 482/944] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:48:31 2022] PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata => generated 61 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:31.883272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-995ed07c-6cbb-41de-9073-aa8bc0f317b0 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86aeab820>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:31.968561 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-995ed07c-6cbb-41de-9073-aa8bc0f317b0 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.089169 Oct 27 18:48:31.971402 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 483/945] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:31 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:31.989775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e961e998-cb2d-40a2-9cbf-2e2380924503 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Action: 'update_all', calling method: .version_select at 0x7fc86ae05040>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:32.089729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e961e998-cb2d-40a2-9cbf-2e2380924503 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:32.096397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e961e998-cb2d-40a2-9cbf-2e2380924503 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for user e089973a345d4dde96776ee6ae422148 and project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:32.259964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-867a909c-6bf0-40e3-8ead-47c20403b3d7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:32.282745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-867a909c-6bf0-40e3-8ead-47c20403b3d7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:32.284375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-867a909c-6bf0-40e3-8ead-47c20403b3d7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:32.296314 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-867a909c-6bf0-40e3-8ead-47c20403b3d7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1409 microversion: 2.25 time: 0.751928 Oct 27 18:48:32.296958 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 463/946] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:31 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1409 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:48:32.320405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-467a39af-47cc-4f5d-92fc-138402d8aca7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:32.324448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-467a39af-47cc-4f5d-92fc-138402d8aca7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:32.342237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-467a39af-47cc-4f5d-92fc-138402d8aca7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:32.342716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-467a39af-47cc-4f5d-92fc-138402d8aca7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:32.345691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-467a39af-47cc-4f5d-92fc-138402d8aca7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:32.347874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-467a39af-47cc-4f5d-92fc-138402d8aca7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:32.349397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-467a39af-47cc-4f5d-92fc-138402d8aca7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:32.350171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-467a39af-47cc-4f5d-92fc-138402d8aca7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:32.813321 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e961e998-cb2d-40a2-9cbf-2e2380924503 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata" status: 200 len: 64 microversion: 2.1 time: 0.833608 Oct 27 18:48:32.817132 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 484/947] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:48:31 2022] PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata => generated 64 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:32.824438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-208802a2-39b4-4a95-80f7-9b284808937c tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Calling method '.version_select at 0x7fc86aeabdc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:32.902946 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-208802a2-39b4-4a95-80f7-9b284808937c tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "GET /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata" status: 200 len: 64 microversion: 2.1 time: 0.083012 Oct 27 18:48:32.904470 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 485/948] 10.222.0.42 () {58 vars in 1260 bytes} [Thu Oct 27 18:48:32 2022] GET /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata => generated 64 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:32.913228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-467a39af-47cc-4f5d-92fc-138402d8aca7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:32.939090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a12c46a0-485f-4172-ac2a-45e8b4f48c93 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Action: 'update_all', calling method: .version_select at 0x7fc86ae6ddc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:32.944667 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-467a39af-47cc-4f5d-92fc-138402d8aca7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1475 microversion: 2.1 time: 0.634632 Oct 27 18:48:32.956590 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 464/949] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:32 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1475 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:32.989411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-547423c7-3405-48d0-84d4-6dfbdc51d4db tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b007dc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:33.095355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-a12c46a0-485f-4172-ac2a-45e8b4f48c93 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:33.112140 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-547423c7-3405-48d0-84d4-6dfbdc51d4db tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.127580 Oct 27 18:48:33.113964 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 465/950] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:32 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:48:33.122076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-a12c46a0-485f-4172-ac2a-45e8b4f48c93 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for user e089973a345d4dde96776ee6ae422148 and project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:33.330545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d4c4e0c0-467a-4ba0-901e-388310c21104 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:33.331872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d4c4e0c0-467a-4ba0-901e-388310c21104 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:33.351096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4c4e0c0-467a-4ba0-901e-388310c21104 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:33.352383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4c4e0c0-467a-4ba0-901e-388310c21104 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:33.353079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4c4e0c0-467a-4ba0-901e-388310c21104 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:33.355540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4c4e0c0-467a-4ba0-901e-388310c21104 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:33.356473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4c4e0c0-467a-4ba0-901e-388310c21104 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:33.358598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4c4e0c0-467a-4ba0-901e-388310c21104 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:33.783341 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a12c46a0-485f-4172-ac2a-45e8b4f48c93 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata" status: 200 len: 61 microversion: 2.1 time: 0.863334 Oct 27 18:48:33.788486 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 486/951] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:48:32 2022] PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata => generated 61 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:33.798024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-86b10ae3-cafc-4f50-b99a-02d74e7f5a3c tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Action: 'update', calling method: .version_select at 0x7fc86ae06ca0>, body: {"meta": {"os_version": "alt"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:33.895258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-86b10ae3-cafc-4f50-b99a-02d74e7f5a3c tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:33.916339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-86b10ae3-cafc-4f50-b99a-02d74e7f5a3c tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for user e089973a345d4dde96776ee6ae422148 and project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:34.145911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:34.289617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d4c4e0c0-467a-4ba0-901e-388310c21104 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:34.305650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d4c4e0c0-467a-4ba0-901e-388310c21104 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:34.309755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d4c4e0c0-467a-4ba0-901e-388310c21104 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:34.311224 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d4c4e0c0-467a-4ba0-901e-388310c21104 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1409 microversion: 2.25 time: 0.989955 Oct 27 18:48:34.312391 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 466/952] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:33 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1409 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:34.318457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f09c8586-f661-4561-a6ce-a9ebdcba8c74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:34.319329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f09c8586-f661-4561-a6ce-a9ebdcba8c74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:34.329090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f09c8586-f661-4561-a6ce-a9ebdcba8c74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:34.330308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f09c8586-f661-4561-a6ce-a9ebdcba8c74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:34.331674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f09c8586-f661-4561-a6ce-a9ebdcba8c74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:34.333850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f09c8586-f661-4561-a6ce-a9ebdcba8c74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:34.334925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f09c8586-f661-4561-a6ce-a9ebdcba8c74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:34.335747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f09c8586-f661-4561-a6ce-a9ebdcba8c74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:34.642876 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-86b10ae3-cafc-4f50-b99a-02d74e7f5a3c tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.852718 Oct 27 18:48:34.643670 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 487/953] 10.222.0.42 () {60 vars in 1313 bytes} [Thu Oct 27 18:48:33 2022] PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata/os_version => generated 31 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:34.649234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3adb2737-d35d-4055-bd42-8ef0f8736121 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86ae60f70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:34.726314 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3adb2737-d35d-4055-bd42-8ef0f8736121 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.081400 Oct 27 18:48:34.727600 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 488/954] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:34 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:34.736760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7fe2e229-a266-4d3b-b168-981de203c249 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Calling method '.version_select at 0x7fc86ae60670>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:34.822329 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7fe2e229-a266-4d3b-b168-981de203c249 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "GET /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata" status: 200 len: 58 microversion: 2.1 time: 0.093773 Oct 27 18:48:34.832730 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 489/955] 10.222.0.42 () {58 vars in 1260 bytes} [Thu Oct 27 18:48:34 2022] GET /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata => generated 58 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:34.846181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a52a0d84-0bbe-4e46-999f-86b63b34ea8d tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Action: 'update_all', calling method: .version_select at 0x7fc86ae603a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:34.935321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-a52a0d84-0bbe-4e46-999f-86b63b34ea8d tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:34.944771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-a52a0d84-0bbe-4e46-999f-86b63b34ea8d tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for user e089973a345d4dde96776ee6ae422148 and project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:35.376581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f09c8586-f661-4561-a6ce-a9ebdcba8c74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:35.391442 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f09c8586-f661-4561-a6ce-a9ebdcba8c74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1475 microversion: 2.1 time: 1.077400 Oct 27 18:48:35.393327 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a52a0d84-0bbe-4e46-999f-86b63b34ea8d tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata" status: 200 len: 61 microversion: 2.1 time: 0.551753 Oct 27 18:48:35.394536 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 490/956] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:48:34 2022] PUT /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata => generated 61 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:35.403688 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 467/957] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:34 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1475 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:35.408408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-31fd9d2e-c861-4dbd-a539-d824e8fa27d5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:35.409349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-31fd9d2e-c861-4dbd-a539-d824e8fa27d5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:35.425499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31fd9d2e-c861-4dbd-a539-d824e8fa27d5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:35.426175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31fd9d2e-c861-4dbd-a539-d824e8fa27d5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:35.427108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31fd9d2e-c861-4dbd-a539-d824e8fa27d5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:35.428728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31fd9d2e-c861-4dbd-a539-d824e8fa27d5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:35.429401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31fd9d2e-c861-4dbd-a539-d824e8fa27d5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:35.429525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6575ce47-4825-49b4-bf29-ccfaf5205c5c tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Action: 'create', calling method: .version_select at 0x7fc86bb2f1f0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:35.430215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31fd9d2e-c861-4dbd-a539-d824e8fa27d5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:35.542068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-6575ce47-4825-49b4-bf29-ccfaf5205c5c tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:35.556805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-6575ce47-4825-49b4-bf29-ccfaf5205c5c tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Getting quotas for user e089973a345d4dde96776ee6ae422148 and project 6a6d1886ca074aac86e5274ef9e66f47. Resources: dict_keys(['metadata_items']) {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:36.179639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-31fd9d2e-c861-4dbd-a539-d824e8fa27d5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:36.204159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-31fd9d2e-c861-4dbd-a539-d824e8fa27d5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:36.209915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-31fd9d2e-c861-4dbd-a539-d824e8fa27d5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:36.229604 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-31fd9d2e-c861-4dbd-a539-d824e8fa27d5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1409 microversion: 2.25 time: 0.833382 Oct 27 18:48:36.237165 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 491/958] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:35 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1409 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:36.246075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3a49292f-5af2-4fac-8f11-9f53e619b870 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86ae609d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:36.446210 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6575ce47-4825-49b4-bf29-ccfaf5205c5c tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "POST /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata" status: 200 len: 85 microversion: 2.1 time: 1.028059 Oct 27 18:48:36.446742 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 468/959] 10.222.0.42 () {60 vars in 1281 bytes} [Thu Oct 27 18:48:35 2022] POST /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata => generated 85 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:36.457422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f06dd779-7179-40d3-9635-394e70aee900 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:36.458046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f06dd779-7179-40d3-9635-394e70aee900 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:36.470629 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3a49292f-5af2-4fac-8f11-9f53e619b870 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.228537 Oct 27 18:48:36.479694 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 492/960] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:36 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:36.488371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f06dd779-7179-40d3-9635-394e70aee900 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:36.488872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f06dd779-7179-40d3-9635-394e70aee900 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:36.489316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f06dd779-7179-40d3-9635-394e70aee900 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:36.490027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f06dd779-7179-40d3-9635-394e70aee900 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:36.490508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f06dd779-7179-40d3-9635-394e70aee900 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:36.490942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f06dd779-7179-40d3-9635-394e70aee900 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:36.491591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-89fbfd5f-b79a-4ceb-98fe-18ed5d597af8 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] Calling method '.version_select at 0x7fc86af083a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:36.595079 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-89fbfd5f-b79a-4ceb-98fe-18ed5d597af8 tempest-ImagesMetadataTestJSON-1847561625 tempest-ImagesMetadataTestJSON-1847561625-project] 10.222.0.42 "GET /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata" status: 200 len: 85 microversion: 2.1 time: 0.109038 Oct 27 18:48:36.595803 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 493/961] 10.222.0.42 () {58 vars in 1260 bytes} [Thu Oct 27 18:48:36 2022] GET /compute/v2.1/images/bf82459c-cf44-4cb4-9db6-f00c5c34b861/metadata => generated 85 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:48:37.017155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f06dd779-7179-40d3-9635-394e70aee900 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:37.025643 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f06dd779-7179-40d3-9635-394e70aee900 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1475 microversion: 2.1 time: 0.573349 Oct 27 18:48:37.047020 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 469/962] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:36 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1475 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:37.269838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-937f97c2-7103-46f4-ae89-6f8a6a087336 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:37.271466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-937f97c2-7103-46f4-ae89-6f8a6a087336 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:37.295640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-937f97c2-7103-46f4-ae89-6f8a6a087336 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:37.296131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-937f97c2-7103-46f4-ae89-6f8a6a087336 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:37.296588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-937f97c2-7103-46f4-ae89-6f8a6a087336 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:37.297375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-937f97c2-7103-46f4-ae89-6f8a6a087336 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:37.297785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-937f97c2-7103-46f4-ae89-6f8a6a087336 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:37.298266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-937f97c2-7103-46f4-ae89-6f8a6a087336 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:37.486985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-59fe0aa1-74e3-4c6b-a597-9979910700d6 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86afc8310>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:37.586821 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-59fe0aa1-74e3-4c6b-a597-9979910700d6 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.103512 Oct 27 18:48:37.598498 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 470/963] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:37 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:37.688148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-937f97c2-7103-46f4-ae89-6f8a6a087336 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:37.703582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-937f97c2-7103-46f4-ae89-6f8a6a087336 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:37.708112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-937f97c2-7103-46f4-ae89-6f8a6a087336 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:37.710158 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-937f97c2-7103-46f4-ae89-6f8a6a087336 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1409 microversion: 2.25 time: 0.444605 Oct 27 18:48:37.711375 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 494/964] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:37 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1409 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:37.762782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e9bb5fd7-c709-46fa-ba4d-b51234218cd0 req-731acd1d-9315-430e-be21-41a4f0f9d259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d5439d-efc3-4e29-a439-7b8b40177342", "name": "network-vif-plugged", "status": "completed", "tag": "cb412b3e-6a21-4028-8662-7d6ffba2fede"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:37.822265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e9bb5fd7-c709-46fa-ba4d-b51234218cd0 req-731acd1d-9315-430e-be21-41a4f0f9d259 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:37.827420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e9bb5fd7-c709-46fa-ba4d-b51234218cd0 req-731acd1d-9315-430e-be21-41a4f0f9d259 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:37.829878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e9bb5fd7-c709-46fa-ba4d-b51234218cd0 req-731acd1d-9315-430e-be21-41a4f0f9d259 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:37.867306 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e9bb5fd7-c709-46fa-ba4d-b51234218cd0 req-731acd1d-9315-430e-be21-41a4f0f9d259 service nova] Creating event network-vif-plugged:cb412b3e-6a21-4028-8662-7d6ffba2fede for instance 26d5439d-efc3-4e29-a439-7b8b40177342 on n-h1-860687-3 Oct 27 18:48:37.881980 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e9bb5fd7-c709-46fa-ba4d-b51234218cd0 req-731acd1d-9315-430e-be21-41a4f0f9d259 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123449 Oct 27 18:48:37.882647 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 471/965] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:38.050170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c7d39993-ced4-44d7-81dc-7cdb99959cef tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:38.054689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c7d39993-ced4-44d7-81dc-7cdb99959cef tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:38.073551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7d39993-ced4-44d7-81dc-7cdb99959cef tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:38.074580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7d39993-ced4-44d7-81dc-7cdb99959cef tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:38.076401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7d39993-ced4-44d7-81dc-7cdb99959cef tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:38.081372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7d39993-ced4-44d7-81dc-7cdb99959cef tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:38.082192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7d39993-ced4-44d7-81dc-7cdb99959cef tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:38.084011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7d39993-ced4-44d7-81dc-7cdb99959cef tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:38.163988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:38.482629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c7d39993-ced4-44d7-81dc-7cdb99959cef tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:38.499695 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c7d39993-ced4-44d7-81dc-7cdb99959cef tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1475 microversion: 2.1 time: 0.450051 Oct 27 18:48:38.502083 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 495/966] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:38 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1475 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:38.612389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e0c6d752-c13d-416e-b282-ce9cc9a1508f tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b1b0160>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:38.704276 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e0c6d752-c13d-416e-b282-ce9cc9a1508f tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.102337 Oct 27 18:48:38.707923 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 472/967] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:38 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:38.751543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0027bb23-a31c-4322-9ee4-a464a567b568 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:38.752399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0027bb23-a31c-4322-9ee4-a464a567b568 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:38.761177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0027bb23-a31c-4322-9ee4-a464a567b568 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:38.765235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0027bb23-a31c-4322-9ee4-a464a567b568 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:38.766834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0027bb23-a31c-4322-9ee4-a464a567b568 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:38.769153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0027bb23-a31c-4322-9ee4-a464a567b568 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:38.770843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0027bb23-a31c-4322-9ee4-a464a567b568 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:38.774252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0027bb23-a31c-4322-9ee4-a464a567b568 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:39.257185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-24bce5f9-c960-4bdc-b7f0-6681f71c1b8d tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Action: 'create', calling method: .version_select at 0x7fc86b3c73a0>, body: {"keypair": {"name": "tempest-keypair-143857837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGdJ3K4Oj6dkmE6d+zNWT6pEbrp35KaX9lVxjcI8J7SAT0SYanGNN8eqiLiw+YlX7eorPEFlgmdd8HCc1B2xmdhmYVNiCRH2vlanNoG4Qy5yStSudRFvOiMoKKwUTQ6CA=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:39.305012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-24bce5f9-c960-4bdc-b7f0-6681f71c1b8d tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Getting quotas for project ef82b88742c343a180c0a96b78bc1d9b. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:39.316307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-24bce5f9-c960-4bdc-b7f0-6681f71c1b8d tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Getting quotas for user c2f9f4cb09b54703a2e39ae2dd7ec283 and project ef82b88742c343a180c0a96b78bc1d9b. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:39.367741 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-24bce5f9-c960-4bdc-b7f0-6681f71c1b8d tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.412272 Oct 27 18:48:39.368369 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 473/968] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:48:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:39.394954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-03db5e25-d84f-40d7-a94e-1eddd08e0306 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Calling method '.version_select at 0x7fc86b039d30>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:39.435127 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-03db5e25-d84f-40d7-a94e-1eddd08e0306 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-143857837" status: 200 len: 496 microversion: 2.1 time: 0.058730 Oct 27 18:48:39.441836 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 474/969] 10.222.0.42 () {58 vars in 1215 bytes} [Thu Oct 27 18:48:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-143857837 => generated 496 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:39.447888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-317c7f38-495d-4d8f-8e95-092ebc111132 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Calling method '.version_select at 0x7fc86afd0940>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:39.493591 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-317c7f38-495d-4d8f-8e95-092ebc111132 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-143857837" status: 202 len: 0 microversion: 2.1 time: 0.050289 Oct 27 18:48:39.497944 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 475/970] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Oct 27 18:48:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-143857837 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 18:48:39.503423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0027bb23-a31c-4322-9ee4-a464a567b568 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:39.511713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-89702643-b64d-4c94-b16d-3dc09df4f6b4 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Action: 'create', calling method: .version_select at 0x7fc86afd89d0>, body: {"keypair": {"name": "tempest-keypair-1223176118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYX7bMPHIcDC/WEiXkOif/TW9fdi+qCEfqkFUcKoU9QiXJLvM9xSH5eGFZoQ+6so8KihsTnGghAGW6OhTkdTTxQLQjOSsCxNV2x/WMmPmniqIfrHJ/iyYesBoveAgRjpg=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:39.517527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0027bb23-a31c-4322-9ee4-a464a567b568 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:39.523554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0027bb23-a31c-4322-9ee4-a464a567b568 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:39.524978 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0027bb23-a31c-4322-9ee4-a464a567b568 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1409 microversion: 2.25 time: 0.788346 Oct 27 18:48:39.538244 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 496/971] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:38 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1409 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:39.544567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-89702643-b64d-4c94-b16d-3dc09df4f6b4 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Getting quotas for project ef82b88742c343a180c0a96b78bc1d9b. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:39.549837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-89702643-b64d-4c94-b16d-3dc09df4f6b4 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Getting quotas for user c2f9f4cb09b54703a2e39ae2dd7ec283 and project ef82b88742c343a180c0a96b78bc1d9b. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:39.551954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ec048a65-cd3e-45ff-bbc0-9f81945f10a4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:39.552567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ec048a65-cd3e-45ff-bbc0-9f81945f10a4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:39.587375 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-89702643-b64d-4c94-b16d-3dc09df4f6b4 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.081111 Oct 27 18:48:39.589232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec048a65-cd3e-45ff-bbc0-9f81945f10a4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:39.589232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec048a65-cd3e-45ff-bbc0-9f81945f10a4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:39.589716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec048a65-cd3e-45ff-bbc0-9f81945f10a4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:39.590750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec048a65-cd3e-45ff-bbc0-9f81945f10a4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:39.591510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec048a65-cd3e-45ff-bbc0-9f81945f10a4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:39.592081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec048a65-cd3e-45ff-bbc0-9f81945f10a4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:39.598677 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 476/972] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:48:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:40.136825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-612775812", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "41cb3454-066d-4fcf-bf2e-ef5cb51d55c0"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:40.227557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] validate_networks() for [('41cb3454-066d-4fcf-bf2e-ef5cb51d55c0', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:48:40.246781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ec048a65-cd3e-45ff-bbc0-9f81945f10a4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:40.255534 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ec048a65-cd3e-45ff-bbc0-9f81945f10a4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1474 microversion: 2.1 time: 0.707349 Oct 27 18:48:40.256116 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 497/973] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:39 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1474 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:40.286498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d2c5e8c-0eac-4040-a7b7-a98b8dbad024 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Calling method '.version_select at 0x7fc86ae98550>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:40.333735 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d2c5e8c-0eac-4040-a7b7-a98b8dbad024 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1223176118" status: 202 len: 0 microversion: 2.1 time: 0.055012 Oct 27 18:48:40.334917 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 498/974] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 18:48:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1223176118 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:48:40.348261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8c2344d9-494e-4a02-a8f8-4bbb40c546b5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86ae02160>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:40.431313 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8c2344d9-494e-4a02-a8f8-4bbb40c546b5 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.094877 Oct 27 18:48:40.431666 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 499/975] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:40 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:40.446029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-02f78078-0ce7-4c5c-8bc5-7726553c1e37 req-812cc027-5649-4168-a742-f602dae5376a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3b19c1-802b-4c1e-9ac3-6f795e307b2d", "name": "network-vif-unplugged", "status": "completed", "tag": "c2767add-2352-4e4a-b9c7-583a3ba6d7cf"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:40.464312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-02f78078-0ce7-4c5c-8bc5-7726553c1e37 req-812cc027-5649-4168-a742-f602dae5376a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:40.465371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-02f78078-0ce7-4c5c-8bc5-7726553c1e37 req-812cc027-5649-4168-a742-f602dae5376a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:40.466001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-02f78078-0ce7-4c5c-8bc5-7726553c1e37 req-812cc027-5649-4168-a742-f602dae5376a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:40.496810 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-02f78078-0ce7-4c5c-8bc5-7726553c1e37 req-812cc027-5649-4168-a742-f602dae5376a service nova] Creating event network-vif-unplugged:c2767add-2352-4e4a-b9c7-583a3ba6d7cf for instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d on n-h1-860687-3 Oct 27 18:48:40.509244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-02f78078-0ce7-4c5c-8bc5-7726553c1e37 req-812cc027-5649-4168-a742-f602dae5376a service nova] Instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:48:40.544858 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-02f78078-0ce7-4c5c-8bc5-7726553c1e37 req-812cc027-5649-4168-a742-f602dae5376a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110327 Oct 27 18:48:40.548262 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 500/976] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:40.558553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4e9db075-e029-4670-aa63-15505979e0c2 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Action: 'create', calling method: .version_select at 0x7fc86b381040>, body: {"keypair": {"name": "tempest-keypair-1421657766", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:40.580478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:40.605868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-4e9db075-e029-4670-aa63-15505979e0c2 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Getting quotas for project ef82b88742c343a180c0a96b78bc1d9b. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:40.615932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-4e9db075-e029-4670-aa63-15505979e0c2 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Getting quotas for user c2f9f4cb09b54703a2e39ae2dd7ec283 and project ef82b88742c343a180c0a96b78bc1d9b. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:40.670691 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4e9db075-e029-4670-aa63-15505979e0c2 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.119184 Oct 27 18:48:40.675793 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 501/977] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:48:40 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:40.690732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-42ec0927-7686-4aac-a973-cca746975c30 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:40.691717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-42ec0927-7686-4aac-a973-cca746975c30 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:40.710133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42ec0927-7686-4aac-a973-cca746975c30 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:40.711288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42ec0927-7686-4aac-a973-cca746975c30 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:40.712637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42ec0927-7686-4aac-a973-cca746975c30 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:40.714319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42ec0927-7686-4aac-a973-cca746975c30 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:40.717285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42ec0927-7686-4aac-a973-cca746975c30 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:40.718903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42ec0927-7686-4aac-a973-cca746975c30 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:40.928743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:48:40.929724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:48:40.930600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:48:40.931351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:48:40.932521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:48:40.953888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:40.955046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:40.958346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:40.960698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:40.962050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:40.963640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:41.016684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Getting quotas for project d7e4d40daccf4e27a5e61093cd62dea8. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:41.027089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Getting quotas for user a7517e24516c4b75a2553b9521d5c38e and project d7e4d40daccf4e27a5e61093cd62dea8. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:41.052687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:41.060384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:48:41.064868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:48:41.143526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-42ec0927-7686-4aac-a973-cca746975c30 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:41.160727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-42ec0927-7686-4aac-a973-cca746975c30 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:41.162525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-42ec0927-7686-4aac-a973-cca746975c30 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:41.164032 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-42ec0927-7686-4aac-a973-cca746975c30 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1604 microversion: 2.25 time: 0.486893 Oct 27 18:48:41.164831 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 502/978] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:48:40 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1604 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:48:41.178623 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4eaf67ca-693b-4f64-80d5-437527d96454 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566509 Oct 27 18:48:41.178623 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 477/979] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:48:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:48:41.178623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-25b49ae3-855b-470a-8e4c-799024293523 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Calling method '.version_select at 0x7fc86afd60d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:41.238496 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-25b49ae3-855b-470a-8e4c-799024293523 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1421657766" status: 202 len: 0 microversion: 2.1 time: 0.065349 Oct 27 18:48:41.239927 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 478/980] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 18:48:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1421657766 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:48:41.250223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-40496eec-f869-48c6-9a9a-74c553434e7c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:41.251194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-40496eec-f869-48c6-9a9a-74c553434e7c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:41.342066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-40496eec-f869-48c6-9a9a-74c553434e7c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:41.357141 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-40496eec-f869-48c6-9a9a-74c553434e7c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1223 microversion: 2.1 time: 0.115778 Oct 27 18:48:41.359245 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 479/981] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:41 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1223 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:41.368307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7534171a-54c2-484c-aaf3-f8f7436fef8d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:41.369070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7534171a-54c2-484c-aaf3-f8f7436fef8d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:41.379148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7534171a-54c2-484c-aaf3-f8f7436fef8d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:41.380138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7534171a-54c2-484c-aaf3-f8f7436fef8d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:41.381233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7534171a-54c2-484c-aaf3-f8f7436fef8d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:41.382861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7534171a-54c2-484c-aaf3-f8f7436fef8d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:41.383429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7534171a-54c2-484c-aaf3-f8f7436fef8d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:41.384036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7534171a-54c2-484c-aaf3-f8f7436fef8d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:41.584151 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7534171a-54c2-484c-aaf3-f8f7436fef8d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.223085 Oct 27 18:48:41.585486 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 480/982] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Oct 27 18:48:41 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-interface => generated 284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:48:41.599397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-59bc72b3-6bb6-47b4-99f8-94aef166acaf tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Action: 'create', calling method: .version_select at 0x7fc86afd8040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-369095517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSgHBU5EPu9+u7YQg0DcgDqaKGLAEdcwCg9ChThzLz1AaojX1yHCstk/SO77yowmVUR1BGd06StL7pKIgajAlgoEaVgapVBVJN5YZaPy/1GEN27WQfenGXRo/5XCdhxZg=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:41.619300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-59bc72b3-6bb6-47b4-99f8-94aef166acaf tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Getting quotas for project ef82b88742c343a180c0a96b78bc1d9b. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:41.625303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-59bc72b3-6bb6-47b4-99f8-94aef166acaf tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Getting quotas for user c2f9f4cb09b54703a2e39ae2dd7ec283 and project ef82b88742c343a180c0a96b78bc1d9b. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:41.676720 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-59bc72b3-6bb6-47b4-99f8-94aef166acaf tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.088722 Oct 27 18:48:41.678064 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 481/983] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:48:41 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:41.684477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c41a789b-6d13-4412-8d35-b0b3766368cc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:41.692299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c41a789b-6d13-4412-8d35-b0b3766368cc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:41.705251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c41a789b-6d13-4412-8d35-b0b3766368cc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:41.707339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c41a789b-6d13-4412-8d35-b0b3766368cc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:41.708177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c41a789b-6d13-4412-8d35-b0b3766368cc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:41.710328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c41a789b-6d13-4412-8d35-b0b3766368cc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:41.712813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c41a789b-6d13-4412-8d35-b0b3766368cc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:41.714142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c41a789b-6d13-4412-8d35-b0b3766368cc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:41.756089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70181bd8-efc5-4222-b19e-90634d2be452 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Calling method '.version_select at 0x7fc86ba62c10>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:42.111273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c41a789b-6d13-4412-8d35-b0b3766368cc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:42.125917 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c41a789b-6d13-4412-8d35-b0b3766368cc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1474 microversion: 2.1 time: 0.445765 Oct 27 18:48:42.128645 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 482/984] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:41 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1474 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:42.155936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c236e5f8-b497-4909-9c6d-42ad5dbd17ee tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86afd8430>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:42.228615 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c236e5f8-b497-4909-9c6d-42ad5dbd17ee tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.088246 Oct 27 18:48:42.231193 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 483/985] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:42 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:42.242191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7e92a7ee-a3ef-41cf-8d9b-fd9b9265b322 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Action: 'create', calling method: .version_select at 0x7fc86afd8670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-615110544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8MkKwNHsGv/Hz/pkIQuiGsSWrJhsFaGO0V94TFZRtWF3fUNcOASX2Fsq2H+QJ2n8aVPykJCznF3wsYjYrn+Cgai3YZkCmCZy1RAzkUoLJXjl0X9b0b/+XQiPumWYf2LQ=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:42.286067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-7e92a7ee-a3ef-41cf-8d9b-fd9b9265b322 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Getting quotas for project ef82b88742c343a180c0a96b78bc1d9b. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:42.296193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-7e92a7ee-a3ef-41cf-8d9b-fd9b9265b322 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Getting quotas for user c2f9f4cb09b54703a2e39ae2dd7ec283 and project ef82b88742c343a180c0a96b78bc1d9b. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:42.353169 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7e92a7ee-a3ef-41cf-8d9b-fd9b9265b322 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.120712 Oct 27 18:48:42.357257 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 484/986] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:48:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:42.371590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-79b3bb9f-939f-4d8c-921a-2ded000fb55d tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Action: 'create', calling method: .version_select at 0x7fc86afc8550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1406379391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBvlfbgYsnk81IN5EhG4mgIGxyx4Z4/tFuxcxnGbsZKQhPn6dFyZK0pbbKFXvRyn39LxHWQSyZMmifES/1o5CMCbxq5GlHUnarPL1LA+hRbycESlhSSQtPaNFpFYIf8pg=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:42.415033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-79b3bb9f-939f-4d8c-921a-2ded000fb55d tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Getting quotas for project ef82b88742c343a180c0a96b78bc1d9b. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:42.422360 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70181bd8-efc5-4222-b19e-90634d2be452 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/07805c7b821546eca5e27562abfecba2" status: 200 len: 371 microversion: 2.1 time: 1.240441 Oct 27 18:48:42.423260 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 503/987] 10.222.0.42 () {58 vars in 1242 bytes} [Thu Oct 27 18:48:41 2022] GET /compute/v2.1/os-quota-sets/07805c7b821546eca5e27562abfecba2 => generated 371 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:42.424550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-79b3bb9f-939f-4d8c-921a-2ded000fb55d tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Getting quotas for user c2f9f4cb09b54703a2e39ae2dd7ec283 and project ef82b88742c343a180c0a96b78bc1d9b. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:42.439049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-16c150a3-89f1-4686-9958-00be1f434712 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:42.442045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-16c150a3-89f1-4686-9958-00be1f434712 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:42.465077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16c150a3-89f1-4686-9958-00be1f434712 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:42.465926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16c150a3-89f1-4686-9958-00be1f434712 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:42.467854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16c150a3-89f1-4686-9958-00be1f434712 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:42.469371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16c150a3-89f1-4686-9958-00be1f434712 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:42.475016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16c150a3-89f1-4686-9958-00be1f434712 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:42.476029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16c150a3-89f1-4686-9958-00be1f434712 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:42.482357 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-79b3bb9f-939f-4d8c-921a-2ded000fb55d tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.116141 Oct 27 18:48:42.486435 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 485/988] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:48:42 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:48:42.493565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d5ba0038-fdba-49f9-9b6c-a674509ecbc6 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Action: 'update', calling method: .version_select at 0x7fc86afc89d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:42.780397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5ba0038-fdba-49f9-9b6c-a674509ecbc6 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:42.780890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5ba0038-fdba-49f9-9b6c-a674509ecbc6 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:42.781332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5ba0038-fdba-49f9-9b6c-a674509ecbc6 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:42.782068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5ba0038-fdba-49f9-9b6c-a674509ecbc6 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:42.782555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5ba0038-fdba-49f9-9b6c-a674509ecbc6 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:42.782988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5ba0038-fdba-49f9-9b6c-a674509ecbc6 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:42.842569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-16c150a3-89f1-4686-9958-00be1f434712 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:42.860732 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-16c150a3-89f1-4686-9958-00be1f434712 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1219 microversion: 2.1 time: 0.435789 Oct 27 18:48:42.861702 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 504/989] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:42 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1219 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:42.866587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3c42c295-68fd-4161-852f-7a62dcd0eb89 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Calling method '.version_select at 0x7fc86af57f70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:42.871705 n-d-860687-3 devstack@n-api.service[127028]: WARNING oslo_db.sqlalchemy.utils [None req-3c42c295-68fd-4161-852f-7a62dcd0eb89 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 18:48:42.912979 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3c42c295-68fd-4161-852f-7a62dcd0eb89 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.048164 Oct 27 18:48:42.914023 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 505/990] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:48:42 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:42.934223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-8d5bc2ab-f3ad-4730-a8a7-7828fc2e8c30 req-8c11ae95-0fb1-4407-bdd4-615e7cc25845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3b19c1-802b-4c1e-9ac3-6f795e307b2d", "tag": "c2767add-2352-4e4a-b9c7-583a3ba6d7cf"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:42.963542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8d5bc2ab-f3ad-4730-a8a7-7828fc2e8c30 req-8c11ae95-0fb1-4407-bdd4-615e7cc25845 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:42.966838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8d5bc2ab-f3ad-4730-a8a7-7828fc2e8c30 req-8c11ae95-0fb1-4407-bdd4-615e7cc25845 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:42.967657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8d5bc2ab-f3ad-4730-a8a7-7828fc2e8c30 req-8c11ae95-0fb1-4407-bdd4-615e7cc25845 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:42.969238 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d5ba0038-fdba-49f9-9b6c-a674509ecbc6 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/07805c7b821546eca5e27562abfecba2" status: 200 len: 328 microversion: 2.1 time: 0.484849 Oct 27 18:48:42.972508 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 486/991] 10.222.0.42 () {60 vars in 1262 bytes} [Thu Oct 27 18:48:42 2022] PUT /compute/v2.1/os-quota-sets/07805c7b821546eca5e27562abfecba2 => generated 328 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:42.987060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c332bdd7-865e-4720-a8e3-b092019cd9dd tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Calling method '.version_select at 0x7fc86afd8310>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:42.989942 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-8d5bc2ab-f3ad-4730-a8a7-7828fc2e8c30 req-8c11ae95-0fb1-4407-bdd4-615e7cc25845 service nova] Creating event network-changed:c2767add-2352-4e4a-b9c7-583a3ba6d7cf for instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d on n-h1-860687-3 Oct 27 18:48:42.997809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-8d5bc2ab-f3ad-4730-a8a7-7828fc2e8c30 req-8c11ae95-0fb1-4407-bdd4-615e7cc25845 service nova] Instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:48:43.010926 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-8d5bc2ab-f3ad-4730-a8a7-7828fc2e8c30 req-8c11ae95-0fb1-4407-bdd4-615e7cc25845 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085364 Oct 27 18:48:43.012315 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 506/992] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:43.020802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c74a8a42-4666-49d0-95c8-1e805926c3a9 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:43.038790 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c332bdd7-865e-4720-a8e3-b092019cd9dd tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1406379391" status: 202 len: 0 microversion: 2.1 time: 0.062959 Oct 27 18:48:43.043689 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 487/993] 10.222.0.42 () {58 vars in 1278 bytes} [Thu Oct 27 18:48:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1406379391 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:48:43.049759 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c74a8a42-4666-49d0-95c8-1e805926c3a9 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-quota-sets/07805c7b821546eca5e27562abfecba2" status: 202 len: 0 microversion: 2.1 time: 0.035117 Oct 27 18:48:43.051624 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 507/994] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 18:48:43 2022] DELETE /compute/v2.1/os-quota-sets/07805c7b821546eca5e27562abfecba2 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:48:43.053955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c069837f-efd9-4af7-bc00-2bfa20b684b5 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Calling method '.version_select at 0x7fc86afc8790>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:43.084252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-730e0fd5-5987-4847-9984-65ca1c860882 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Calling method '.version_select at 0x7fc86ae6df70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:43.120398 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c069837f-efd9-4af7-bc00-2bfa20b684b5 tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-615110544" status: 202 len: 0 microversion: 2.1 time: 0.073241 Oct 27 18:48:43.120980 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 488/995] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 18:48:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-615110544 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 18:48:43.152693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f73d1273-3fa7-4da2-85fe-7b448cd8e67c tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] Calling method '.version_select at 0x7fc86b0391f0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:43.258273 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f73d1273-3fa7-4da2-85fe-7b448cd8e67c tempest-KeyPairsV2TestJSON-1925680141 tempest-KeyPairsV2TestJSON-1925680141-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-369095517" status: 202 len: 0 microversion: 2.1 time: 0.129012 Oct 27 18:48:43.258957 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 489/996] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 18:48:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-369095517 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:48:43.294777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8e1763ba-6da7-4066-921b-7c373b2e0a34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:43.308888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8e1763ba-6da7-4066-921b-7c373b2e0a34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:43.321232 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-730e0fd5-5987-4847-9984-65ca1c860882 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/07805c7b821546eca5e27562abfecba2" status: 200 len: 371 microversion: 2.1 time: 0.265007 Oct 27 18:48:43.325462 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 508/997] 10.222.0.42 () {58 vars in 1242 bytes} [Thu Oct 27 18:48:43 2022] GET /compute/v2.1/os-quota-sets/07805c7b821546eca5e27562abfecba2 => generated 371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:43.345847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aa34e106-6e26-4317-8fad-cf3e00fe8c93 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86ae608b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:43.355995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e1763ba-6da7-4066-921b-7c373b2e0a34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:43.356419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e1763ba-6da7-4066-921b-7c373b2e0a34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:43.356880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e1763ba-6da7-4066-921b-7c373b2e0a34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:43.360257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e1763ba-6da7-4066-921b-7c373b2e0a34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:43.362324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e1763ba-6da7-4066-921b-7c373b2e0a34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:43.363362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e1763ba-6da7-4066-921b-7c373b2e0a34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:43.523001 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aa34e106-6e26-4317-8fad-cf3e00fe8c93 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.195228 Oct 27 18:48:43.524208 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 509/998] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:43 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:43.678417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4dcea499-66fd-4ea5-ad01-5fe1e3e730e9 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Calling method '.version_select at 0x7fc86ae6df70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:44.141849 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4dcea499-66fd-4ea5-ad01-5fe1e3e730e9 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/1c949a0db2054c86bc4b122c040236bc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.471335 Oct 27 18:48:44.151337 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 510/999] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 18:48:43 2022] GET /compute/v2.1/os-quota-sets/1c949a0db2054c86bc4b122c040236bc/defaults => generated 371 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:44.157605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-211ebc8a-a482-4856-9f0e-ade544901e64 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:44.171470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-211ebc8a-a482-4856-9f0e-ade544901e64 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:44.199376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-211ebc8a-a482-4856-9f0e-ade544901e64 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:44.199878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-211ebc8a-a482-4856-9f0e-ade544901e64 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:44.200324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-211ebc8a-a482-4856-9f0e-ade544901e64 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:44.201046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-211ebc8a-a482-4856-9f0e-ade544901e64 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:44.207047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-211ebc8a-a482-4856-9f0e-ade544901e64 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:44.207712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-211ebc8a-a482-4856-9f0e-ade544901e64 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:44.551812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8e1763ba-6da7-4066-921b-7c373b2e0a34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:44.563413 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8e1763ba-6da7-4066-921b-7c373b2e0a34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1474 microversion: 2.1 time: 1.289941 Oct 27 18:48:44.578820 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 490/1000] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:43 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1474 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:44.578820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dd9afa4c-907e-433b-8db6-0ad58692e76d tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b12bb80>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:44.602016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-211ebc8a-a482-4856-9f0e-ade544901e64 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:44.612122 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-211ebc8a-a482-4856-9f0e-ade544901e64 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1281 microversion: 2.1 time: 0.458794 Oct 27 18:48:44.618139 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 511/1001] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:44 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1281 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:44.661988 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dd9afa4c-907e-433b-8db6-0ad58692e76d tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.087320 Oct 27 18:48:44.665673 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 491/1002] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:44 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:44.788716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a3d2b7a3-1dc3-4fac-a607-a5fa4ece55e9 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Action: 'update', calling method: .version_select at 0x7fc86ae6dd30>, body: {"quota_set": {"ram": "5120"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:45.059617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3d2b7a3-1dc3-4fac-a607-a5fa4ece55e9 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:45.061397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3d2b7a3-1dc3-4fac-a607-a5fa4ece55e9 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:45.063203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3d2b7a3-1dc3-4fac-a607-a5fa4ece55e9 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:45.065472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3d2b7a3-1dc3-4fac-a607-a5fa4ece55e9 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:45.069623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3d2b7a3-1dc3-4fac-a607-a5fa4ece55e9 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:45.070823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3d2b7a3-1dc3-4fac-a607-a5fa4ece55e9 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:45.215382 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a3d2b7a3-1dc3-4fac-a607-a5fa4ece55e9 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/ad4b5748bd2c4159bb9fe0df832b9018" status: 200 len: 328 microversion: 2.1 time: 0.430782 Oct 27 18:48:45.223585 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 512/1003] 10.222.0.42 () {60 vars in 1262 bytes} [Thu Oct 27 18:48:44 2022] PUT /compute/v2.1/os-quota-sets/ad4b5748bd2c4159bb9fe0df832b9018 => generated 328 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:45.227991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f28ebb78-28c7-40a4-826d-7d57c3e10166 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Calling method '.version_select at 0x7fc86afd60d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:45.348942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f28ebb78-28c7-40a4-826d-7d57c3e10166 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:45.349817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f28ebb78-28c7-40a4-826d-7d57c3e10166 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:45.350621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f28ebb78-28c7-40a4-826d-7d57c3e10166 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:45.351910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f28ebb78-28c7-40a4-826d-7d57c3e10166 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:45.352612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f28ebb78-28c7-40a4-826d-7d57c3e10166 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:45.353531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f28ebb78-28c7-40a4-826d-7d57c3e10166 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:45.377780 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f28ebb78-28c7-40a4-826d-7d57c3e10166 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/ad4b5748bd2c4159bb9fe0df832b9018/detail" status: 200 len: 916 microversion: 2.1 time: 0.153441 Oct 27 18:48:45.379325 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 492/1004] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 18:48:45 2022] GET /compute/v2.1/os-quota-sets/ad4b5748bd2c4159bb9fe0df832b9018/detail => generated 916 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:48:45.612653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-18f087b4-d69c-4866-b38d-a762ba44857c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:45.615045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-18f087b4-d69c-4866-b38d-a762ba44857c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:45.615227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-47117c63-d110-47d4-a7eb-2bc4f06ab8e8 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b314160>, body: {"quota_set": {"ram": "2048"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:45.651809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18f087b4-d69c-4866-b38d-a762ba44857c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:45.655395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18f087b4-d69c-4866-b38d-a762ba44857c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:45.665130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18f087b4-d69c-4866-b38d-a762ba44857c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:45.669740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18f087b4-d69c-4866-b38d-a762ba44857c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:45.670485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18f087b4-d69c-4866-b38d-a762ba44857c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:45.671102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18f087b4-d69c-4866-b38d-a762ba44857c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:45.903816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47117c63-d110-47d4-a7eb-2bc4f06ab8e8 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:45.904341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47117c63-d110-47d4-a7eb-2bc4f06ab8e8 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:45.904773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47117c63-d110-47d4-a7eb-2bc4f06ab8e8 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:45.905529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47117c63-d110-47d4-a7eb-2bc4f06ab8e8 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:45.905973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47117c63-d110-47d4-a7eb-2bc4f06ab8e8 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:45.911709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47117c63-d110-47d4-a7eb-2bc4f06ab8e8 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:46.003839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47117c63-d110-47d4-a7eb-2bc4f06ab8e8 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:46.004800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47117c63-d110-47d4-a7eb-2bc4f06ab8e8 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:46.005438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47117c63-d110-47d4-a7eb-2bc4f06ab8e8 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:46.006331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47117c63-d110-47d4-a7eb-2bc4f06ab8e8 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:46.006958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47117c63-d110-47d4-a7eb-2bc4f06ab8e8 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:46.007552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47117c63-d110-47d4-a7eb-2bc4f06ab8e8 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:46.064964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:46.164363 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-47117c63-d110-47d4-a7eb-2bc4f06ab8e8 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/ad4b5748bd2c4159bb9fe0df832b9018?user_id=702e226872074ff2931c8463fc0d1d01" status: 200 len: 328 microversion: 2.1 time: 0.560848 Oct 27 18:48:46.175271 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 493/1005] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 18:48:45 2022] PUT /compute/v2.1/os-quota-sets/ad4b5748bd2c4159bb9fe0df832b9018?user_id=702e226872074ff2931c8463fc0d1d01 => generated 328 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:46.189556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6349ad1-1c82-434a-ab75-482dd21b7d12 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:46.209890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d6349ad1-1c82-434a-ab75-482dd21b7d12 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:46.223174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6349ad1-1c82-434a-ab75-482dd21b7d12 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:46.223684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6349ad1-1c82-434a-ab75-482dd21b7d12 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:46.224236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6349ad1-1c82-434a-ab75-482dd21b7d12 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:46.224963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6349ad1-1c82-434a-ab75-482dd21b7d12 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:46.225421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6349ad1-1c82-434a-ab75-482dd21b7d12 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:46.225848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6349ad1-1c82-434a-ab75-482dd21b7d12 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:46.703687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d6349ad1-1c82-434a-ab75-482dd21b7d12 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:46.721349 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d6349ad1-1c82-434a-ab75-482dd21b7d12 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1323 microversion: 2.1 time: 0.544693 Oct 27 18:48:46.722973 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 494/1006] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:46 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1323 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:46.734032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0369ddb0-174c-45c2-92fe-311262e68229 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b073280>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:46.798606 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0369ddb0-174c-45c2-92fe-311262e68229 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.073647 Oct 27 18:48:46.799202 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 495/1007] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:46 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:46.814954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-831bbe8b-b241-4b9f-9544-1793213f7204 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Calling method '.version_select at 0x7fc86b039160>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:46.912461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-18f087b4-d69c-4866-b38d-a762ba44857c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:46.946305 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-18f087b4-d69c-4866-b38d-a762ba44857c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1472 microversion: 2.1 time: 1.351121 Oct 27 18:48:46.947157 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 513/1008] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:45 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1472 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:47.000550 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-831bbe8b-b241-4b9f-9544-1793213f7204 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/ad4b5748bd2c4159bb9fe0df832b9018?user_id=702e226872074ff2931c8463fc0d1d01" status: 200 len: 370 microversion: 2.1 time: 0.200271 Oct 27 18:48:47.008889 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 496/1009] 10.222.0.42 () {58 vars in 1323 bytes} [Thu Oct 27 18:48:46 2022] GET /compute/v2.1/os-quota-sets/ad4b5748bd2c4159bb9fe0df832b9018?user_id=702e226872074ff2931c8463fc0d1d01 => generated 370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:47.768002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f482b948-0f16-4f8e-a72a-e1d2f9dcd131 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:47.769753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f482b948-0f16-4f8e-a72a-e1d2f9dcd131 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:47.799665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f482b948-0f16-4f8e-a72a-e1d2f9dcd131 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:47.800223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f482b948-0f16-4f8e-a72a-e1d2f9dcd131 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:47.800999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f482b948-0f16-4f8e-a72a-e1d2f9dcd131 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:47.802230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f482b948-0f16-4f8e-a72a-e1d2f9dcd131 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:47.802742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f482b948-0f16-4f8e-a72a-e1d2f9dcd131 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:47.804753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f482b948-0f16-4f8e-a72a-e1d2f9dcd131 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:47.815678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cabf75a8-e845-4e9f-81ef-98531ac1d75f tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86afc88b0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:47.978156 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cabf75a8-e845-4e9f-81ef-98531ac1d75f tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.165882 Oct 27 18:48:47.983273 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 497/1010] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:47 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:48.016226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-882944e4-9da2-4550-b9ee-107f16dce17d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:48.022983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-882944e4-9da2-4550-b9ee-107f16dce17d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:48.046973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-882944e4-9da2-4550-b9ee-107f16dce17d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:48.047743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-882944e4-9da2-4550-b9ee-107f16dce17d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:48.050686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-882944e4-9da2-4550-b9ee-107f16dce17d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:48.053646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-882944e4-9da2-4550-b9ee-107f16dce17d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:48.054513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-882944e4-9da2-4550-b9ee-107f16dce17d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:48.055323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-882944e4-9da2-4550-b9ee-107f16dce17d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:48.246069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f482b948-0f16-4f8e-a72a-e1d2f9dcd131 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:48.256049 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f482b948-0f16-4f8e-a72a-e1d2f9dcd131 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1323 microversion: 2.1 time: 0.510003 Oct 27 18:48:48.262644 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 514/1011] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:47 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1323 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:48.272204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b511bde2-047b-44ec-b31d-387d33482f87 req-ea1169ec-7f24-4fc7-983f-3e13e4b98c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d5439d-efc3-4e29-a439-7b8b40177342", "tag": "cb412b3e-6a21-4028-8662-7d6ffba2fede"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:48.301982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b511bde2-047b-44ec-b31d-387d33482f87 req-ea1169ec-7f24-4fc7-983f-3e13e4b98c9c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:48.302521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b511bde2-047b-44ec-b31d-387d33482f87 req-ea1169ec-7f24-4fc7-983f-3e13e4b98c9c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:48.305472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b511bde2-047b-44ec-b31d-387d33482f87 req-ea1169ec-7f24-4fc7-983f-3e13e4b98c9c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:48.344416 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b511bde2-047b-44ec-b31d-387d33482f87 req-ea1169ec-7f24-4fc7-983f-3e13e4b98c9c service nova] Creating event network-changed:cb412b3e-6a21-4028-8662-7d6ffba2fede for instance 26d5439d-efc3-4e29-a439-7b8b40177342 on n-h1-860687-3 Oct 27 18:48:48.366555 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b511bde2-047b-44ec-b31d-387d33482f87 req-ea1169ec-7f24-4fc7-983f-3e13e4b98c9c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102482 Oct 27 18:48:48.381033 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 515/1012] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:48.410820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dc7b73b4-2fa6-43d3-bb4d-8182185cba46 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Calling method '.version_select at 0x7fc86aeb64c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:49.090160 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dc7b73b4-2fa6-43d3-bb4d-8182185cba46 tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/1c949a0db2054c86bc4b122c040236bc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.693093 Oct 27 18:48:49.113861 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 516/1013] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 18:48:48 2022] GET /compute/v2.1/os-quota-sets/1c949a0db2054c86bc4b122c040236bc/defaults => generated 371 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:49.124456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ecc4aadf-8037-4a4d-b0d4-d970bf695eaf tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86ae06790>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:49.150619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-882944e4-9da2-4550-b9ee-107f16dce17d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:49.153787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:49.177871 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-882944e4-9da2-4550-b9ee-107f16dce17d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1469 microversion: 2.1 time: 1.192485 Oct 27 18:48:49.185346 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 498/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:47 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1469 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:49.210245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5566f29d-c2b5-45d9-b136-026288fd76ea tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b022af0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:49.251063 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ecc4aadf-8037-4a4d-b0d4-d970bf695eaf tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.129514 Oct 27 18:48:49.251725 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 517/1015] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:49 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:49.269184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9f0ed77b-0823-42e0-a03a-3e5ec5205774 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:49.270456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9f0ed77b-0823-42e0-a03a-3e5ec5205774 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:49.279829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f0ed77b-0823-42e0-a03a-3e5ec5205774 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:49.280661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f0ed77b-0823-42e0-a03a-3e5ec5205774 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:49.281456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f0ed77b-0823-42e0-a03a-3e5ec5205774 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:49.283306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f0ed77b-0823-42e0-a03a-3e5ec5205774 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:49.283934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f0ed77b-0823-42e0-a03a-3e5ec5205774 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:49.285327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f0ed77b-0823-42e0-a03a-3e5ec5205774 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:49.427265 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9f0ed77b-0823-42e0-a03a-3e5ec5205774 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "POST /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d/action" status: 204 len: 0 microversion: 2.1 time: 0.164380 Oct 27 18:48:49.428689 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 518/1016] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:48:49 2022] POST /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d/action => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:48:49.440279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-738bba2f-5e4f-492a-881e-822306ccd602 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:49.443537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-738bba2f-5e4f-492a-881e-822306ccd602 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:49.460705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-738bba2f-5e4f-492a-881e-822306ccd602 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:49.464430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-738bba2f-5e4f-492a-881e-822306ccd602 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:49.465205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-738bba2f-5e4f-492a-881e-822306ccd602 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:49.466169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-738bba2f-5e4f-492a-881e-822306ccd602 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:49.469697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-738bba2f-5e4f-492a-881e-822306ccd602 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:49.470413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-738bba2f-5e4f-492a-881e-822306ccd602 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:49.641573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=71 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:49.663416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5566f29d-c2b5-45d9-b136-026288fd76ea tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:49.665080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5566f29d-c2b5-45d9-b136-026288fd76ea tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:49.667734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5566f29d-c2b5-45d9-b136-026288fd76ea tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:49.673311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5566f29d-c2b5-45d9-b136-026288fd76ea tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:49.677992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5566f29d-c2b5-45d9-b136-026288fd76ea tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:49.678539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5566f29d-c2b5-45d9-b136-026288fd76ea tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:50.152521 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5566f29d-c2b5-45d9-b136-026288fd76ea tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/1c949a0db2054c86bc4b122c040236bc" status: 200 len: 329 microversion: 2.1 time: 0.964365 Oct 27 18:48:50.153799 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 499/1017] 10.222.0.42 () {60 vars in 1263 bytes} [Thu Oct 27 18:48:49 2022] PUT /compute/v2.1/os-quota-sets/1c949a0db2054c86bc4b122c040236bc => generated 329 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:50.160837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13127e43-c3ac-4a21-acbe-1003729b3d45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:50.162130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-13127e43-c3ac-4a21-acbe-1003729b3d45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:50.173573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13127e43-c3ac-4a21-acbe-1003729b3d45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:50.174941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13127e43-c3ac-4a21-acbe-1003729b3d45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:50.175692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13127e43-c3ac-4a21-acbe-1003729b3d45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:50.177926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13127e43-c3ac-4a21-acbe-1003729b3d45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:50.178769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13127e43-c3ac-4a21-acbe-1003729b3d45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:50.179269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13127e43-c3ac-4a21-acbe-1003729b3d45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:50.333555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-738bba2f-5e4f-492a-881e-822306ccd602 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:50.343325 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-738bba2f-5e4f-492a-881e-822306ccd602 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1323 microversion: 2.1 time: 0.913255 Oct 27 18:48:50.343918 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 519/1018] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:49 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1323 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:50.539459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0afa978e-f7de-41d9-b33a-ecda55cab588 tempest-AbsoluteLimitsTestJSON-886582844 tempest-AbsoluteLimitsTestJSON-886582844-project] Calling method '.version_select at 0x7fc86ae608b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:50.550054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=49 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:50.553693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0afa978e-f7de-41d9-b33a-ecda55cab588 tempest-AbsoluteLimitsTestJSON-886582844 tempest-AbsoluteLimitsTestJSON-886582844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:50.554621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0afa978e-f7de-41d9-b33a-ecda55cab588 tempest-AbsoluteLimitsTestJSON-886582844 tempest-AbsoluteLimitsTestJSON-886582844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:50.555269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0afa978e-f7de-41d9-b33a-ecda55cab588 tempest-AbsoluteLimitsTestJSON-886582844 tempest-AbsoluteLimitsTestJSON-886582844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:50.556383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0afa978e-f7de-41d9-b33a-ecda55cab588 tempest-AbsoluteLimitsTestJSON-886582844 tempest-AbsoluteLimitsTestJSON-886582844-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:50.557635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0afa978e-f7de-41d9-b33a-ecda55cab588 tempest-AbsoluteLimitsTestJSON-886582844 tempest-AbsoluteLimitsTestJSON-886582844-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:50.558439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0afa978e-f7de-41d9-b33a-ecda55cab588 tempest-AbsoluteLimitsTestJSON-886582844 tempest-AbsoluteLimitsTestJSON-886582844-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:50.580547 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0afa978e-f7de-41d9-b33a-ecda55cab588 tempest-AbsoluteLimitsTestJSON-886582844 tempest-AbsoluteLimitsTestJSON-886582844-project] 10.222.0.42 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.235542 Oct 27 18:48:50.593585 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 520/1019] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Oct 27 18:48:50 2022] GET /compute/v2.1/limits => generated 511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:50.599179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6aaf7448-bbf9-42cd-a514-876b0b68be6e tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Action: 'update', calling method: .version_select at 0x7fc86ae06af0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:50.801638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6aaf7448-bbf9-42cd-a514-876b0b68be6e tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:50.804882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6aaf7448-bbf9-42cd-a514-876b0b68be6e tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:50.805660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6aaf7448-bbf9-42cd-a514-876b0b68be6e tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:50.808574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6aaf7448-bbf9-42cd-a514-876b0b68be6e tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:50.809264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6aaf7448-bbf9-42cd-a514-876b0b68be6e tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:50.809863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6aaf7448-bbf9-42cd-a514-876b0b68be6e tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:51.118734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9,nova_api:DELETE=2,nova_api:UPDATE=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:51.298711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-13127e43-c3ac-4a21-acbe-1003729b3d45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:51.307464 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13127e43-c3ac-4a21-acbe-1003729b3d45 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1469 microversion: 2.1 time: 1.151674 Oct 27 18:48:51.332769 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 500/1020] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:50 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1469 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:51.338621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-f6ddb602-33a0-4328-8703-1468877c4ab6 req-26373027-c326-4bed-b70b-afcdb8162836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef3dc71-9730-4658-aa69-ff8704cdfb8c", "tag": "a8a13994-bd8c-4fec-909b-fef9e45546f0"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:51.362225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f6ddb602-33a0-4328-8703-1468877c4ab6 req-26373027-c326-4bed-b70b-afcdb8162836 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:51.363314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f6ddb602-33a0-4328-8703-1468877c4ab6 req-26373027-c326-4bed-b70b-afcdb8162836 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:51.364163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f6ddb602-33a0-4328-8703-1468877c4ab6 req-26373027-c326-4bed-b70b-afcdb8162836 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:51.390488 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-f6ddb602-33a0-4328-8703-1468877c4ab6 req-26373027-c326-4bed-b70b-afcdb8162836 service nova] Creating event network-changed:a8a13994-bd8c-4fec-909b-fef9e45546f0 for instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c on n-h2-860687-3 Oct 27 18:48:51.395864 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-f6ddb602-33a0-4328-8703-1468877c4ab6 req-26373027-c326-4bed-b70b-afcdb8162836 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061464 Oct 27 18:48:51.401391 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 501/1021] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:51.413697 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6aaf7448-bbf9-42cd-a514-876b0b68be6e tempest-QuotasAdminTestJSON-1812829889 tempest-QuotasAdminTestJSON-1812829889-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/1c949a0db2054c86bc4b122c040236bc" status: 200 len: 329 microversion: 2.1 time: 0.818224 Oct 27 18:48:51.416954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9c9f102c-1531-446c-b474-615510209298 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b039160>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:51.423870 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 521/1022] 10.222.0.42 () {60 vars in 1263 bytes} [Thu Oct 27 18:48:50 2022] PUT /compute/v2.1/os-quota-sets/1c949a0db2054c86bc4b122c040236bc => generated 329 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:51.449622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7270cc04-4209-4f8f-bb41-8f28735cbb1a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:51.452562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7270cc04-4209-4f8f-bb41-8f28735cbb1a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:51.474524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7270cc04-4209-4f8f-bb41-8f28735cbb1a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:51.482960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7270cc04-4209-4f8f-bb41-8f28735cbb1a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:51.483629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7270cc04-4209-4f8f-bb41-8f28735cbb1a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:51.486688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7270cc04-4209-4f8f-bb41-8f28735cbb1a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:51.487179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7270cc04-4209-4f8f-bb41-8f28735cbb1a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:51.487622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7270cc04-4209-4f8f-bb41-8f28735cbb1a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:51.507415 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9c9f102c-1531-446c-b474-615510209298 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.104290 Oct 27 18:48:51.508009 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 502/1023] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:51 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:51.873356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-aa084b1a-8334-4993-bd3e-ca37ef61507b req-a91e4367-c339-4e0a-a202-01d2cf0fca07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3b19c1-802b-4c1e-9ac3-6f795e307b2d", "name": "network-vif-plugged", "status": "completed", "tag": "c2767add-2352-4e4a-b9c7-583a3ba6d7cf"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:51.895977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-aa084b1a-8334-4993-bd3e-ca37ef61507b req-a91e4367-c339-4e0a-a202-01d2cf0fca07 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:51.899087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-aa084b1a-8334-4993-bd3e-ca37ef61507b req-a91e4367-c339-4e0a-a202-01d2cf0fca07 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:51.900071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-aa084b1a-8334-4993-bd3e-ca37ef61507b req-a91e4367-c339-4e0a-a202-01d2cf0fca07 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:51.929486 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-aa084b1a-8334-4993-bd3e-ca37ef61507b req-a91e4367-c339-4e0a-a202-01d2cf0fca07 service nova] Creating event network-vif-plugged:c2767add-2352-4e4a-b9c7-583a3ba6d7cf for instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d on n-h1-860687-3 Oct 27 18:48:51.951318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-aa084b1a-8334-4993-bd3e-ca37ef61507b req-a91e4367-c339-4e0a-a202-01d2cf0fca07 service nova] Instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:48:51.980285 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-aa084b1a-8334-4993-bd3e-ca37ef61507b req-a91e4367-c339-4e0a-a202-01d2cf0fca07 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108540 Oct 27 18:48:51.984642 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 503/1024] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:48:52.001761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7270cc04-4209-4f8f-bb41-8f28735cbb1a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:52.016240 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7270cc04-4209-4f8f-bb41-8f28735cbb1a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1323 microversion: 2.1 time: 0.586351 Oct 27 18:48:52.039299 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 522/1025] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:51 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1323 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:52.341454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2fbe25c1-571a-4932-ae42-e00f0e112404 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:52.343597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2fbe25c1-571a-4932-ae42-e00f0e112404 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:52.386960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fbe25c1-571a-4932-ae42-e00f0e112404 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:52.391568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fbe25c1-571a-4932-ae42-e00f0e112404 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:52.395055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fbe25c1-571a-4932-ae42-e00f0e112404 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:52.401865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fbe25c1-571a-4932-ae42-e00f0e112404 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:52.403504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fbe25c1-571a-4932-ae42-e00f0e112404 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:52.408399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fbe25c1-571a-4932-ae42-e00f0e112404 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:52.524085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2b060571-a26a-470a-ae5f-6cf8677ee549 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86ae60940>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:52.600559 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2b060571-a26a-470a-ae5f-6cf8677ee549 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.080101 Oct 27 18:48:52.604899 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 523/1026] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:52 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:48:52.876840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2fbe25c1-571a-4932-ae42-e00f0e112404 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:52.886228 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2fbe25c1-571a-4932-ae42-e00f0e112404 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1469 microversion: 2.1 time: 0.555885 Oct 27 18:48:52.906831 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 504/1027] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:52 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1469 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:53.046200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5108e677-2d52-4e46-9baf-e379f28da765 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:53.047413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5108e677-2d52-4e46-9baf-e379f28da765 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:53.100252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5108e677-2d52-4e46-9baf-e379f28da765 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:53.101337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5108e677-2d52-4e46-9baf-e379f28da765 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:53.105762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5108e677-2d52-4e46-9baf-e379f28da765 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:53.108958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5108e677-2d52-4e46-9baf-e379f28da765 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:53.111970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5108e677-2d52-4e46-9baf-e379f28da765 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:53.115156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5108e677-2d52-4e46-9baf-e379f28da765 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:53.384577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5108e677-2d52-4e46-9baf-e379f28da765 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:53.399685 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5108e677-2d52-4e46-9baf-e379f28da765 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1323 microversion: 2.1 time: 0.358161 Oct 27 18:48:53.416064 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 524/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:53 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1323 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:53.623023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3c996bc1-eb66-40e0-9d30-3277841a772c tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b073670>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:53.798201 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3c996bc1-eb66-40e0-9d30-3277841a772c tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.180817 Oct 27 18:48:53.799668 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 505/1029] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:53 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:53.918324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b2f6563f-012f-41a0-86f3-c2d8ba80eace tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:53.920152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b2f6563f-012f-41a0-86f3-c2d8ba80eace tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:53.934146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2f6563f-012f-41a0-86f3-c2d8ba80eace tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:53.935050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2f6563f-012f-41a0-86f3-c2d8ba80eace tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:53.935708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2f6563f-012f-41a0-86f3-c2d8ba80eace tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:53.936678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2f6563f-012f-41a0-86f3-c2d8ba80eace tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:53.937373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2f6563f-012f-41a0-86f3-c2d8ba80eace tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:53.938008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2f6563f-012f-41a0-86f3-c2d8ba80eace tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:54.429940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4e664734-7d86-4ad3-9429-695d76da5b0a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:54.431041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4e664734-7d86-4ad3-9429-695d76da5b0a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:54.460589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e664734-7d86-4ad3-9429-695d76da5b0a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:54.466894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e664734-7d86-4ad3-9429-695d76da5b0a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:54.467417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e664734-7d86-4ad3-9429-695d76da5b0a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:54.470953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e664734-7d86-4ad3-9429-695d76da5b0a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:54.471526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e664734-7d86-4ad3-9429-695d76da5b0a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:54.472030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e664734-7d86-4ad3-9429-695d76da5b0a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:54.493479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b2f6563f-012f-41a0-86f3-c2d8ba80eace tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:54.500939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:54.519786 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b2f6563f-012f-41a0-86f3-c2d8ba80eace tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1469 microversion: 2.1 time: 0.606470 Oct 27 18:48:54.524413 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 525/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:53 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1469 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:54.815854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb4139c3-5830-482a-884a-25ba9d57ab5f tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86ae603a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:54.929810 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fb4139c3-5830-482a-884a-25ba9d57ab5f tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1427 microversion: 2.1 time: 0.119095 Oct 27 18:48:54.933126 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 526/1031] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:54 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:48:55.280589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4e664734-7d86-4ad3-9429-695d76da5b0a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:55.290871 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4e664734-7d86-4ad3-9429-695d76da5b0a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1323 microversion: 2.1 time: 0.865650 Oct 27 18:48:55.295849 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 506/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:54 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1323 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:48:55.547286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-334f47ce-a51b-4d5d-af41-f207300e52ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:55.548005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-334f47ce-a51b-4d5d-af41-f207300e52ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:55.565369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-334f47ce-a51b-4d5d-af41-f207300e52ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:55.566062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-334f47ce-a51b-4d5d-af41-f207300e52ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:55.566614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-334f47ce-a51b-4d5d-af41-f207300e52ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:55.567409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-334f47ce-a51b-4d5d-af41-f207300e52ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:55.567960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-334f47ce-a51b-4d5d-af41-f207300e52ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:55.568449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-334f47ce-a51b-4d5d-af41-f207300e52ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:55.946733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c7f50416-b87c-4679-81a7-5aa170ccff98 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86afc8d30>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:56.042968 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c7f50416-b87c-4679-81a7-5aa170ccff98 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1436 microversion: 2.1 time: 0.099798 Oct 27 18:48:56.044430 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 507/1033] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:55 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1436 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:48:56.060011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e31d400c-7770-4fcc-9919-341f5b47a0af tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86b12b8b0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:56.075690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-334f47ce-a51b-4d5d-af41-f207300e52ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:56.089172 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-334f47ce-a51b-4d5d-af41-f207300e52ab tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1461 microversion: 2.1 time: 0.547774 Oct 27 18:48:56.089867 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 527/1034] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:55 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1461 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:56.118292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-385d393c-ce03-4b6b-8af9-57fa2ef662a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:56.118973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-385d393c-ce03-4b6b-8af9-57fa2ef662a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:56.142341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-385d393c-ce03-4b6b-8af9-57fa2ef662a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:56.152032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-385d393c-ce03-4b6b-8af9-57fa2ef662a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:56.158372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-385d393c-ce03-4b6b-8af9-57fa2ef662a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:56.159067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-385d393c-ce03-4b6b-8af9-57fa2ef662a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:56.159555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-385d393c-ce03-4b6b-8af9-57fa2ef662a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:56.163825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-385d393c-ce03-4b6b-8af9-57fa2ef662a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:56.174316 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e31d400c-7770-4fcc-9919-341f5b47a0af tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 200 len: 1436 microversion: 2.1 time: 0.120093 Oct 27 18:48:56.184590 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 508/1035] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:48:56 2022] GET /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 1436 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:56.212041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-08255a25-1275-4f48-b373-e1b85f628ef8 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:56.212676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-08255a25-1275-4f48-b373-e1b85f628ef8 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:56.225010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08255a25-1275-4f48-b373-e1b85f628ef8 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:56.228075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08255a25-1275-4f48-b373-e1b85f628ef8 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:56.231891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08255a25-1275-4f48-b373-e1b85f628ef8 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:56.237211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08255a25-1275-4f48-b373-e1b85f628ef8 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:56.237994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08255a25-1275-4f48-b373-e1b85f628ef8 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:56.238675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08255a25-1275-4f48-b373-e1b85f628ef8 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:56.529097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-08255a25-1275-4f48-b373-e1b85f628ef8 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:56.537839 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-08255a25-1275-4f48-b373-e1b85f628ef8 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1466 microversion: 2.1 time: 0.352550 Oct 27 18:48:56.544453 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 509/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:56 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1466 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:56.554371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-906eb8fa-3201-4b14-8159-3f6ed3a990cf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:56.558695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-906eb8fa-3201-4b14-8159-3f6ed3a990cf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:56.581860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-906eb8fa-3201-4b14-8159-3f6ed3a990cf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:56.585241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-906eb8fa-3201-4b14-8159-3f6ed3a990cf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:56.589571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-906eb8fa-3201-4b14-8159-3f6ed3a990cf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:56.590600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-385d393c-ce03-4b6b-8af9-57fa2ef662a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:56.590902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-906eb8fa-3201-4b14-8159-3f6ed3a990cf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:56.594119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-906eb8fa-3201-4b14-8159-3f6ed3a990cf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:56.595670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-906eb8fa-3201-4b14-8159-3f6ed3a990cf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:56.605143 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-385d393c-ce03-4b6b-8af9-57fa2ef662a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1461 microversion: 2.1 time: 0.489409 Oct 27 18:48:56.607215 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 528/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:56 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1461 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:56.618119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1e299263-f725-4203-9fbf-b10a28400938 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86ae603a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:56.868619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-906eb8fa-3201-4b14-8159-3f6ed3a990cf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:56.892190 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-906eb8fa-3201-4b14-8159-3f6ed3a990cf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1323 microversion: 2.1 time: 0.337616 Oct 27 18:48:56.903783 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 510/1038] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:56 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1323 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:56.919878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7aa6ed80-1a02-4f26-a5a6-a7a232046c6f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Action: 'create', calling method: .version_select at 0x7fc86b0079d0>, body: {"keypair": {"name": "tempest-keypair-1867489722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFd8HCGEmZRDJ/CDhA1V9vVMFzuYqKxkbs7hUJzPwdzjfSpbbP1nrp67KjRd5oFpluxvoHuZ1GdzRRqWZZnr20dF+y9nfpuzDujMg3NlzPOKdY8yrz/tXXKD1KiwEqfoRA=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:56.960684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-7aa6ed80-1a02-4f26-a5a6-a7a232046c6f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Getting quotas for project 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:48:56.971844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-7aa6ed80-1a02-4f26-a5a6-a7a232046c6f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Getting quotas for user 1917ae65262c40b792c28c2aa4d44b44 and project 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:48:57.002167 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7aa6ed80-1a02-4f26-a5a6-a7a232046c6f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097170 Oct 27 18:48:57.009372 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 511/1039] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:48:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:57.699492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2dbc822c-09cb-4b17-a314-b4967a407c8b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'create', calling method: .version_select at 0x7fc86afd0040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-981334731", "description": "tempest-description-2145740928"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:57.970987 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2dbc822c-09cb-4b17-a314-b4967a407c8b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.959305 Oct 27 18:48:57.972031 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 512/1040] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:48:57 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:58.109896 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1e299263-f725-4203-9fbf-b10a28400938 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "DELETE /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2" status: 204 len: 0 microversion: 2.1 time: 1.498225 Oct 27 18:48:58.111450 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 529/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:56 2022] DELETE /compute/v2.1/images/0d91df7a-5c9c-4111-b26b-feae2cfd8fa2 => generated 0 bytes in 1501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:48:58.118879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fd8d7107-9a7b-4366-b56b-b86f91eb7aa3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:58.120403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fd8d7107-9a7b-4366-b56b-b86f91eb7aa3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:58.136540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd8d7107-9a7b-4366-b56b-b86f91eb7aa3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:58.139069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd8d7107-9a7b-4366-b56b-b86f91eb7aa3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:58.140203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd8d7107-9a7b-4366-b56b-b86f91eb7aa3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:58.141277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd8d7107-9a7b-4366-b56b-b86f91eb7aa3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:58.143053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd8d7107-9a7b-4366-b56b-b86f91eb7aa3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:58.143518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd8d7107-9a7b-4366-b56b-b86f91eb7aa3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:58.284206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4fab8ba9-2975-4b7b-b51f-471a0c0e75c9 tempest-SecurityGroupsTestAdminJSON-1614989928 tempest-SecurityGroupsTestAdminJSON-1614989928-project] Action: 'create', calling method: .version_select at 0x7fc86afc8160>, body: {"security_group": {"name": "tempest-securitygroup-1109426954", "description": "tempest-description-1409600106"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:58.457744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd8d7107-9a7b-4366-b56b-b86f91eb7aa3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:48:58.468544 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fd8d7107-9a7b-4366-b56b-b86f91eb7aa3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1323 microversion: 2.1 time: 0.355706 Oct 27 18:48:58.469903 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 530/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:58 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1323 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:48:58.476720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-171b8fb2-f890-4ab5-83fc-4b93940a3fd1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'create', calling method: .version_select at 0x7fc86ae51550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-792526380", "description": "tempest-description-122038366"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:58.613160 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4fab8ba9-2975-4b7b-b51f-471a0c0e75c9 tempest-SecurityGroupsTestAdminJSON-1614989928 tempest-SecurityGroupsTestAdminJSON-1614989928-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.640044 Oct 27 18:48:58.613764 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 513/1043] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:48:57 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:58.622958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6af61036-4a92-447c-b313-469dd7aa936c tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '.version_select at 0x7fc86afc8d30>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:58.688759 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-6af61036-4a92-447c-b313-469dd7aa936c tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] HTTP exception thrown: Image not found. Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6af61036-4a92-447c-b313-469dd7aa936c tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Request method failure captured: Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae HTTP/1.1 Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIzAaBfHlwFyJzWmBsEcUEOFyzGkiPPGQOw8kXdG6UwhDkJLdYxjaPLc3DH8z-_Pm2s5SIC2khwdOX2Ns-l2SHKQcal_j7nVoTeU6V45aQfpJxt5nzTKgc8Gz1Y2Nwg_mbI10lMNZwW0lt83ofLrErbAziU6_75ilt-dXTpXKE4hvU Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f39cc90fd8ad43edadefcc7868adc6be Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesOneServerTestJSON-354488036 Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:48:58.701337 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:48:58.703509 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f39cc90fd8ad43edadefcc7868adc6be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f39cc90fd8ad43edadefcc7868adc6be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f39cc90fd8ad43edadefcc7868adc6be", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f39cc90fd8ad43edadefcc7868adc6be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:48:58.703509 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesOneServerTestJSON-354488036 Oct 27 18:48:58.703509 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f39cc90fd8ad43edadefcc7868adc6be Oct 27 18:48:58.703509 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-354488036 Oct 27 18:48:58.703509 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesOneServerTestJSON-354488036-project Oct 27 18:48:58.703509 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:48:58.703509 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:48:58.703509 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a879659e04494f02a803b823e1fc5f3b Oct 27 18:48:58.703509 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesOneServerTestJSON-354488036-project Oct 27 18:48:58.703509 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:48:58.703509 n-d-860687-3 devstack@n-api.service[127029]: exception: Image not found. Oct 27 18:48:58.703509 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'ba68b577-d249-47e4-83ce-993e2a0a83ae'} Oct 27 18:48:58.703509 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ba68b577-d249-47e4-83ce-993e2a0a83ae to delete Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:58.704432 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ba68b577-d249-47e4-83ce-993e2a0a83ae could not be found. Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:48:58.710418 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:48:58.717635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 18:48:58.717635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 18:48:58.717635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 18:48:58.717635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:58.717635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:48:58.717635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:58.717635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:48:58.717635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:48:58.717635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:48:58.717635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:48:58.717635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:48:58.717635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 18:48:58.717635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:48:58.721758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6af61036-4a92-447c-b313-469dd7aa936c tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Returning 404 to user: Image not found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:48:58.723395 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6af61036-4a92-447c-b313-469dd7aa936c tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "DELETE /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae" status: 404 len: 62 microversion: 2.1 time: 0.107677 Oct 27 18:48:58.724218 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 514/1044] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:58 2022] DELETE /compute/v2.1/images/ba68b577-d249-47e4-83ce-993e2a0a83ae => generated 62 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:48:58.729819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dd378556-9ab8-4cfe-8986-7a0e58533604 tempest-SecurityGroupsTestAdminJSON-1614989928 tempest-SecurityGroupsTestAdminJSON-1614989928-project] Action: 'create', calling method: .version_select at 0x7fc86b007e50>, body: {"security_group": {"name": "tempest-securitygroup-831829549", "description": "tempest-description-1781582749"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:58.952592 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-171b8fb2-f890-4ab5-83fc-4b93940a3fd1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.481153 Oct 27 18:48:58.953206 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 531/1045] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:48:58 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:58.962407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d1cb8a89-92ee-4c1f-90fd-9e0900088e04 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:58.962927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d1cb8a89-92ee-4c1f-90fd-9e0900088e04 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:58.973636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1cb8a89-92ee-4c1f-90fd-9e0900088e04 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:58.974140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1cb8a89-92ee-4c1f-90fd-9e0900088e04 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:58.975338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1cb8a89-92ee-4c1f-90fd-9e0900088e04 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:58.976071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1cb8a89-92ee-4c1f-90fd-9e0900088e04 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:58.979550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1cb8a89-92ee-4c1f-90fd-9e0900088e04 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:58.980193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1cb8a89-92ee-4c1f-90fd-9e0900088e04 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:59.040803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d1cb8a89-92ee-4c1f-90fd-9e0900088e04 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:48:59.151402 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dd378556-9ab8-4cfe-8986-7a0e58533604 tempest-SecurityGroupsTestAdminJSON-1614989928 tempest-SecurityGroupsTestAdminJSON-1614989928-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.425339 Oct 27 18:48:59.152569 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 515/1046] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:48:58 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:59.165798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-2fc7180f-2a50-4b58-bb85-2a81e46f7179 req-3fe7f189-0934-47ea-a93b-4b0f51b24b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef3dc71-9730-4658-aa69-ff8704cdfb8c", "name": "network-vif-plugged", "status": "completed", "tag": "a8a13994-bd8c-4fec-909b-fef9e45546f0"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:59.228305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2fc7180f-2a50-4b58-bb85-2a81e46f7179 req-3fe7f189-0934-47ea-a93b-4b0f51b24b33 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:59.230708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2fc7180f-2a50-4b58-bb85-2a81e46f7179 req-3fe7f189-0934-47ea-a93b-4b0f51b24b33 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:59.231433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2fc7180f-2a50-4b58-bb85-2a81e46f7179 req-3fe7f189-0934-47ea-a93b-4b0f51b24b33 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:59.274128 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-2fc7180f-2a50-4b58-bb85-2a81e46f7179 req-3fe7f189-0934-47ea-a93b-4b0f51b24b33 service nova] Creating event network-vif-plugged:a8a13994-bd8c-4fec-909b-fef9e45546f0 for instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c on n-h2-860687-3 Oct 27 18:48:59.283056 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-2fc7180f-2a50-4b58-bb85-2a81e46f7179 req-3fe7f189-0934-47ea-a93b-4b0f51b24b33 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128014 Oct 27 18:48:59.284445 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 516/1047] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:59.309409 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d1cb8a89-92ee-4c1f-90fd-9e0900088e04 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 204 len: 0 microversion: 2.1 time: 0.351430 Oct 27 18:48:59.311406 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 532/1048] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:48:58 2022] DELETE /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:48:59.328870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1861333950", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "693cb2fd-2856-4a35-bd58-7aabb4a7fece"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:59.368560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0cee4c68-f0c5-4776-a806-0e3cb4944c1b tempest-SecurityGroupsTestAdminJSON-1871052841 tempest-SecurityGroupsTestAdminJSON-1871052841-project-admin] Action: 'create', calling method: .version_select at 0x7fc86afd0940>, body: {"security_group": {"name": "tempest-securitygroup-1580141140", "description": "tempest-description-1619481239"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:48:59.449823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] validate_networks() for [('693cb2fd-2856-4a35-bd58-7aabb4a7fece', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:48:59.698168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=13 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:48:59.951721 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0cee4c68-f0c5-4776-a806-0e3cb4944c1b tempest-SecurityGroupsTestAdminJSON-1871052841 tempest-SecurityGroupsTestAdminJSON-1871052841-project-admin] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.665296 Oct 27 18:48:59.953942 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 517/1049] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:48:59 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:48:59.959740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-077b0373-498e-4721-93a5-e1cab8f8110b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:48:59.964394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-077b0373-498e-4721-93a5-e1cab8f8110b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:48:59.981143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-077b0373-498e-4721-93a5-e1cab8f8110b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:59.982357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-077b0373-498e-4721-93a5-e1cab8f8110b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:59.983243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-077b0373-498e-4721-93a5-e1cab8f8110b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:48:59.984580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-077b0373-498e-4721-93a5-e1cab8f8110b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:48:59.985551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-077b0373-498e-4721-93a5-e1cab8f8110b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:48:59.986253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-077b0373-498e-4721-93a5-e1cab8f8110b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:00.188833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-077b0373-498e-4721-93a5-e1cab8f8110b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:00.201386 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-077b0373-498e-4721-93a5-e1cab8f8110b tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1472 microversion: 2.1 time: 0.244691 Oct 27 18:49:00.203370 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 518/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:48:59 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:00.216706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8aa54495-38cb-4131-977b-f1721c477397 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:00.218045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8aa54495-38cb-4131-977b-f1721c477397 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:00.226787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8aa54495-38cb-4131-977b-f1721c477397 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:00.227237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8aa54495-38cb-4131-977b-f1721c477397 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:00.228014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8aa54495-38cb-4131-977b-f1721c477397 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:00.230200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8aa54495-38cb-4131-977b-f1721c477397 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:00.231334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8aa54495-38cb-4131-977b-f1721c477397 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:00.232054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8aa54495-38cb-4131-977b-f1721c477397 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:00.393817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8aa54495-38cb-4131-977b-f1721c477397 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:00.402569 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8aa54495-38cb-4131-977b-f1721c477397 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1323 microversion: 2.1 time: 0.197641 Oct 27 18:49:00.404804 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 519/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:00 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1323 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:00.409587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3dad8cda-637f-4f49-93aa-61e7337615fe tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Calling method '.version_select at 0x7fc86afd0040>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:00.414087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dad8cda-637f-4f49-93aa-61e7337615fe tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:00.414831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dad8cda-637f-4f49-93aa-61e7337615fe tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:00.415646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dad8cda-637f-4f49-93aa-61e7337615fe tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:00.429250 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3dad8cda-637f-4f49-93aa-61e7337615fe tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.023106 Oct 27 18:49:00.430265 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 520/1052] 10.222.0.42 () {58 vars in 1143 bytes} [Thu Oct 27 18:49:00 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:00.435819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3f333287-1af4-46d9-8e5e-d80e6c74af17 tempest-SecurityGroupsTestAdminJSON-1871052841 tempest-SecurityGroupsTestAdminJSON-1871052841-project-admin] Action: 'create', calling method: .version_select at 0x7fc86afc84c0>, body: {"security_group": {"name": "tempest-securitygroup-2007949602", "description": "tempest-description-134096256"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:00.564802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:49:00.565268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:49:00.565737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:49:00.566241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:49:00.566691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:49:00.592971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:00.593478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:00.593921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:00.598311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:00.598877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:00.600078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:00.649636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Getting quotas for project 582be696729849069dc5b7d51598d2ed. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:49:00.659243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Getting quotas for user 2fb341748c5a45d5a36b398bc305feb3 and project 582be696729849069dc5b7d51598d2ed. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:49:00.691424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:49:00.695282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:49:00.708458 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3f333287-1af4-46d9-8e5e-d80e6c74af17 tempest-SecurityGroupsTestAdminJSON-1871052841 tempest-SecurityGroupsTestAdminJSON-1871052841-project-admin] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.276751 Oct 27 18:49:00.709840 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 521/1053] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:49:00 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:00.714714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e92f299e-4c8a-428b-94d7-0c6a6a29bca9 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:00.731336 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e92f299e-4c8a-428b-94d7-0c6a6a29bca9 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019826 Oct 27 18:49:00.738748 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 522/1054] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:49:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:00.743273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c92e6ea7-405f-404a-a4c6-989e9fe97daa tempest-SecurityGroupsTestAdminJSON-1871052841 tempest-SecurityGroupsTestAdminJSON-1871052841-project-admin] Calling method '.version_select at 0x7fc86afd8670>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:00.815500 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-405047dc-6b8c-42d5-bf10-f999fa23d908 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.502775 Oct 27 18:49:00.818119 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 533/1055] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:48:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:49:00.830519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-166ec048-513f-409b-9086-f1d18f8e1387 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1762637886", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:00.873747 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-166ec048-513f-409b-9086-f1d18f8e1387 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.050468 Oct 27 18:49:00.875094 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 534/1056] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Oct 27 18:49:00 2022] POST /compute/v2.1/flavors => generated 499 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:00.888308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3e8e3ea1-093b-4a51-9f7c-2598a16c4eeb tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:00.889972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3e8e3ea1-093b-4a51-9f7c-2598a16c4eeb tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:01.375347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3e8e3ea1-093b-4a51-9f7c-2598a16c4eeb tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:01.383316 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3e8e3ea1-093b-4a51-9f7c-2598a16c4eeb tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9" status: 200 len: 1216 microversion: 2.1 time: 0.506540 Oct 27 18:49:01.384134 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 535/1057] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:00 2022] GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 => generated 1216 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:01.389557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d8b444e-1e64-4afe-82ee-fc535414ae1e tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:01.421660 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d8b444e-1e64-4afe-82ee-fc535414ae1e tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036267 Oct 27 18:49:01.437028 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 536/1058] 10.222.0.42 () {58 vars in 1182 bytes} [Thu Oct 27 18:49:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:49:01.465715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ec042d75-a036-4954-a4a8-7ae3587ca4d3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:01.467270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ec042d75-a036-4954-a4a8-7ae3587ca4d3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:01.495949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec042d75-a036-4954-a4a8-7ae3587ca4d3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:01.496708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec042d75-a036-4954-a4a8-7ae3587ca4d3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:01.497231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec042d75-a036-4954-a4a8-7ae3587ca4d3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:01.499251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec042d75-a036-4954-a4a8-7ae3587ca4d3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:01.502290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec042d75-a036-4954-a4a8-7ae3587ca4d3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:01.502956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec042d75-a036-4954-a4a8-7ae3587ca4d3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:02.140033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ec042d75-a036-4954-a4a8-7ae3587ca4d3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:02.171322 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ec042d75-a036-4954-a4a8-7ae3587ca4d3 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1472 microversion: 2.1 time: 0.733083 Oct 27 18:49:02.174106 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 537/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:01 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1472 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:02.199578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f008b794-0e7e-478b-a27e-cd1376ae4d12 req-dc89330b-f0f1-4f72-8e90-e91927f5e514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a645e2-ba92-42c7-8a35-8aea0ee2f9b9", "name": "network-vif-unplugged", "status": "completed", "tag": "2cf40f9d-6d09-4726-8ad1-d50203aea23c"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:02.211057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f008b794-0e7e-478b-a27e-cd1376ae4d12 req-dc89330b-f0f1-4f72-8e90-e91927f5e514 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:02.211840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f008b794-0e7e-478b-a27e-cd1376ae4d12 req-dc89330b-f0f1-4f72-8e90-e91927f5e514 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:02.213335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f008b794-0e7e-478b-a27e-cd1376ae4d12 req-dc89330b-f0f1-4f72-8e90-e91927f5e514 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:02.242341 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f008b794-0e7e-478b-a27e-cd1376ae4d12 req-dc89330b-f0f1-4f72-8e90-e91927f5e514 service nova] Creating event network-vif-unplugged:2cf40f9d-6d09-4726-8ad1-d50203aea23c for instance 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 on n-h2-860687-3 Oct 27 18:49:02.254509 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f008b794-0e7e-478b-a27e-cd1376ae4d12 req-dc89330b-f0f1-4f72-8e90-e91927f5e514 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063991 Oct 27 18:49:02.256992 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 538/1060] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:02.273250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8f0b43c6-5e91-435b-a19f-408b75eec435 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:02.275170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8f0b43c6-5e91-435b-a19f-408b75eec435 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:02.288666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f0b43c6-5e91-435b-a19f-408b75eec435 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:02.289166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f0b43c6-5e91-435b-a19f-408b75eec435 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:02.289616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f0b43c6-5e91-435b-a19f-408b75eec435 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:02.290331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f0b43c6-5e91-435b-a19f-408b75eec435 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:02.299225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f0b43c6-5e91-435b-a19f-408b75eec435 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:02.304311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f0b43c6-5e91-435b-a19f-408b75eec435 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:02.877539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8f0b43c6-5e91-435b-a19f-408b75eec435 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:02.891295 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8f0b43c6-5e91-435b-a19f-408b75eec435 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1323 microversion: 2.1 time: 0.631999 Oct 27 18:49:02.898183 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 539/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:02 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1323 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:02.918193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1432723551", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "4bffb839-ba43-4979-986c-23093713dafb"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:03.024803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:49:03.644267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:49:03.645461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:49:03.646059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:49:03.646671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:49:03.647315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:49:03.660965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:03.670034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:03.670920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:03.671855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:03.675893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:03.676685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:03.730188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Getting quotas for project 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:49:03.741704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Getting quotas for user 1917ae65262c40b792c28c2aa4d44b44 and project 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:49:03.776271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:49:03.783649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:49:03.811232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=9,nova_api:INSERT=12 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:03.945229 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b05cb800-bc9a-400c-a8a1-8008572a2d55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.034820 Oct 27 18:49:03.946333 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 540/1062] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:49:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:49:03.988733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bc4d9f12-beab-4b0f-92d8-6e34869304c8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:03.989526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bc4d9f12-beab-4b0f-92d8-6e34869304c8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:04.003040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc4d9f12-beab-4b0f-92d8-6e34869304c8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:04.003985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc4d9f12-beab-4b0f-92d8-6e34869304c8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:04.007399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc4d9f12-beab-4b0f-92d8-6e34869304c8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:04.009464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc4d9f12-beab-4b0f-92d8-6e34869304c8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:04.010307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc4d9f12-beab-4b0f-92d8-6e34869304c8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:04.011272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc4d9f12-beab-4b0f-92d8-6e34869304c8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:04.280388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bc4d9f12-beab-4b0f-92d8-6e34869304c8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:04.288672 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bc4d9f12-beab-4b0f-92d8-6e34869304c8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9" status: 200 len: 1274 microversion: 2.1 time: 0.332797 Oct 27 18:49:04.322528 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 541/1063] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:03 2022] GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 => generated 1274 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:04.333104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dfba1e7e-0503-4cfe-ac49-e27289312f47 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:04.335998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dfba1e7e-0503-4cfe-ac49-e27289312f47 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:04.354914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfba1e7e-0503-4cfe-ac49-e27289312f47 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:04.355404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfba1e7e-0503-4cfe-ac49-e27289312f47 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:04.355932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfba1e7e-0503-4cfe-ac49-e27289312f47 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:04.356741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfba1e7e-0503-4cfe-ac49-e27289312f47 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:04.370163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfba1e7e-0503-4cfe-ac49-e27289312f47 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:04.370803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfba1e7e-0503-4cfe-ac49-e27289312f47 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:04.458631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfba1e7e-0503-4cfe-ac49-e27289312f47 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:04.459334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfba1e7e-0503-4cfe-ac49-e27289312f47 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:04.459955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfba1e7e-0503-4cfe-ac49-e27289312f47 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:04.461914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-dfba1e7e-0503-4cfe-ac49-e27289312f47 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lazy-loading 'fault' on Instance uuid 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:49:04.703149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dfba1e7e-0503-4cfe-ac49-e27289312f47 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a879659e04494f02a803b823e1fc5f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39cc90fd8ad43edadefcc7868adc6be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:04.711892 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dfba1e7e-0503-4cfe-ac49-e27289312f47 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 200 len: 1307 microversion: 2.1 time: 0.387466 Oct 27 18:49:04.719553 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 542/1064] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:04 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 1307 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:04.730294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-93c4ed18-0acc-45b1-9fd3-1a41830fd42a req-da84d5eb-c1e4-4de8-b526-120ee4c87ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a645e2-ba92-42c7-8a35-8aea0ee2f9b9", "name": "network-vif-deleted", "tag": "2cf40f9d-6d09-4726-8ad1-d50203aea23c"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:04.749568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-93c4ed18-0acc-45b1-9fd3-1a41830fd42a req-da84d5eb-c1e4-4de8-b526-120ee4c87ab6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:04.753966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-93c4ed18-0acc-45b1-9fd3-1a41830fd42a req-da84d5eb-c1e4-4de8-b526-120ee4c87ab6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:04.754854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-93c4ed18-0acc-45b1-9fd3-1a41830fd42a req-da84d5eb-c1e4-4de8-b526-120ee4c87ab6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:04.784723 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-93c4ed18-0acc-45b1-9fd3-1a41830fd42a req-da84d5eb-c1e4-4de8-b526-120ee4c87ab6 service nova] Creating event network-vif-deleted:2cf40f9d-6d09-4726-8ad1-d50203aea23c for instance 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 on n-h2-860687-3 Oct 27 18:49:04.806725 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-93c4ed18-0acc-45b1-9fd3-1a41830fd42a req-da84d5eb-c1e4-4de8-b526-120ee4c87ab6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085387 Oct 27 18:49:04.810400 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 543/1065] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:04.820373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-76e17b97-aeb6-4455-8faa-ef5085e34f0d tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:04.824004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-76e17b97-aeb6-4455-8faa-ef5085e34f0d tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:04.835897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76e17b97-aeb6-4455-8faa-ef5085e34f0d tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:04.846861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76e17b97-aeb6-4455-8faa-ef5085e34f0d tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:04.847742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76e17b97-aeb6-4455-8faa-ef5085e34f0d tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:04.848929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76e17b97-aeb6-4455-8faa-ef5085e34f0d tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:04.849785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76e17b97-aeb6-4455-8faa-ef5085e34f0d tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:04.858647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76e17b97-aeb6-4455-8faa-ef5085e34f0d tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:05.875881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-76e17b97-aeb6-4455-8faa-ef5085e34f0d tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:05.886178 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-76e17b97-aeb6-4455-8faa-ef5085e34f0d tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1519 microversion: 2.1 time: 1.073343 Oct 27 18:49:05.888132 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 544/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:04 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1519 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:05.893174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d94811d-71a0-4de8-b8dd-780108e19f44 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:05.893979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d94811d-71a0-4de8-b8dd-780108e19f44 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:05.914981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d94811d-71a0-4de8-b8dd-780108e19f44 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:05.915718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d94811d-71a0-4de8-b8dd-780108e19f44 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:05.916796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d94811d-71a0-4de8-b8dd-780108e19f44 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:05.917680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d94811d-71a0-4de8-b8dd-780108e19f44 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:05.918413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d94811d-71a0-4de8-b8dd-780108e19f44 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:05.920371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d94811d-71a0-4de8-b8dd-780108e19f44 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:06.012917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6d94811d-71a0-4de8-b8dd-780108e19f44 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:06.028104 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d94811d-71a0-4de8-b8dd-780108e19f44 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1331 microversion: 2.1 time: 0.137888 Oct 27 18:49:06.035470 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 545/1067] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:05 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1331 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:06.049838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00627235-fd14-4a41-ba3b-d111356048cc tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:06.051739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-00627235-fd14-4a41-ba3b-d111356048cc tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:06.068405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00627235-fd14-4a41-ba3b-d111356048cc tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:06.069450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00627235-fd14-4a41-ba3b-d111356048cc tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:06.070148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00627235-fd14-4a41-ba3b-d111356048cc tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:06.071132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00627235-fd14-4a41-ba3b-d111356048cc tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:06.071812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00627235-fd14-4a41-ba3b-d111356048cc tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:06.073192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00627235-fd14-4a41-ba3b-d111356048cc tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:06.155406 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c92e6ea7-405f-404a-a4c6-989e9fe97daa tempest-SecurityGroupsTestAdminJSON-1871052841 tempest-SecurityGroupsTestAdminJSON-1871052841-project-admin] 10.222.0.42 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13435 microversion: 2.1 time: 5.420724 Oct 27 18:49:06.174509 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 523/1068] 10.222.0.42 () {58 vars in 1191 bytes} [Thu Oct 27 18:49:00 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13435 bytes in 5423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:49:06.174509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-35192a24-54ab-4ef6-a6c6-e50dc4cf0790 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:06.174509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-35192a24-54ab-4ef6-a6c6-e50dc4cf0790 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] [instance: 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:06.191723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35192a24-54ab-4ef6-a6c6-e50dc4cf0790 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:06.194303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35192a24-54ab-4ef6-a6c6-e50dc4cf0790 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:06.199852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35192a24-54ab-4ef6-a6c6-e50dc4cf0790 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:06.200890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35192a24-54ab-4ef6-a6c6-e50dc4cf0790 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:06.201580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35192a24-54ab-4ef6-a6c6-e50dc4cf0790 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:06.202753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35192a24-54ab-4ef6-a6c6-e50dc4cf0790 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:06.243852 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-35192a24-54ab-4ef6-a6c6-e50dc4cf0790 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] HTTP exception thrown: Instance 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 could not be found. Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-35192a24-54ab-4ef6-a6c6-e50dc4cf0790 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Request method failure captured: Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 HTTP/1.1 Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIzAaBfHlwFyJzWmBsEcUEOFyzGkiPPGQOw8kXdG6UwhDkJLdYxjaPLc3DH8z-_Pm2s5SIC2khwdOX2Ns-l2SHKQcal_j7nVoTeU6V45aQfpJxt5nzTKgc8Gz1Y2Nwg_mbI10lMNZwW0lt83ofLrErbAziU6_75ilt-dXTpXKE4hvU Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f39cc90fd8ad43edadefcc7868adc6be Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesOneServerTestJSON-354488036 Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:49:06.250525 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:49:06.252211 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f39cc90fd8ad43edadefcc7868adc6be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f39cc90fd8ad43edadefcc7868adc6be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f39cc90fd8ad43edadefcc7868adc6be", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f39cc90fd8ad43edadefcc7868adc6be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:06.252211 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesOneServerTestJSON-354488036 Oct 27 18:49:06.252211 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f39cc90fd8ad43edadefcc7868adc6be Oct 27 18:49:06.252211 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-354488036 Oct 27 18:49:06.252211 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesOneServerTestJSON-354488036-project Oct 27 18:49:06.252211 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:49:06.252211 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:49:06.252211 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a879659e04494f02a803b823e1fc5f3b Oct 27 18:49:06.252211 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesOneServerTestJSON-354488036-project Oct 27 18:49:06.252211 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:49:06.252211 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 could not be found. Oct 27 18:49:06.252211 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '77a645e2-ba92-42c7-8a35-8aea0ee2f9b9'} Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 could not be found. Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:06.253187 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 could not be found. Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 could not be found. Oct 27 18:49:06.255635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:06.258614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-35192a24-54ab-4ef6-a6c6-e50dc4cf0790 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] Returning 404 to user: Instance 77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:06.266336 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-35192a24-54ab-4ef6-a6c6-e50dc4cf0790 tempest-ImagesOneServerTestJSON-354488036 tempest-ImagesOneServerTestJSON-354488036-project] 10.222.0.42 "GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9" status: 404 len: 111 microversion: 2.1 time: 0.102212 Oct 27 18:49:06.272908 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 524/1069] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:06 2022] GET /compute/v2.1/servers/77a645e2-ba92-42c7-8a35-8aea0ee2f9b9 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:49:06.280637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e92260ed-5d59-4263-be7f-4ccc3d78190e tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Action: 'create', calling method: .version_select at 0x7fc86afd0dc0>, body: {"pool": null} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:06.323651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-00627235-fd14-4a41-ba3b-d111356048cc tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:06.346530 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-00627235-fd14-4a41-ba3b-d111356048cc tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9" status: 200 len: 1274 microversion: 2.1 time: 0.309228 Oct 27 18:49:06.366941 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 546/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:06 2022] GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 => generated 1274 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:06.393380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0cecd7c9-5205-4bd3-948e-7768a4f4c6ba tempest-SecurityGroupsTestAdminJSON-1614989928 tempest-SecurityGroupsTestAdminJSON-1614989928-project] Calling method '.version_select at 0x7fc86ae34b80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:06.982224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=37 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:06.983608 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0cecd7c9-5205-4bd3-948e-7768a4f4c6ba tempest-SecurityGroupsTestAdminJSON-1614989928 tempest-SecurityGroupsTestAdminJSON-1614989928-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.615553 Oct 27 18:49:06.984749 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 547/1071] 10.222.0.42 () {58 vars in 1191 bytes} [Thu Oct 27 18:49:06 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:07.000817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9a484162-0ac7-4b4a-b1d7-23d7c2274ada tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2740add1-bb8b-4738-89af-00e133b143a5"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:07.005878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9a484162-0ac7-4b4a-b1d7-23d7c2274ada tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:07.025284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a484162-0ac7-4b4a-b1d7-23d7c2274ada tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:07.026616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a484162-0ac7-4b4a-b1d7-23d7c2274ada tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:07.027312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a484162-0ac7-4b4a-b1d7-23d7c2274ada tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:07.028229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a484162-0ac7-4b4a-b1d7-23d7c2274ada tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:07.035263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a484162-0ac7-4b4a-b1d7-23d7c2274ada tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:07.035935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a484162-0ac7-4b4a-b1d7-23d7c2274ada tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:07.625099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:07.646936 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9a484162-0ac7-4b4a-b1d7-23d7c2274ada tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "POST /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.649663 Oct 27 18:49:07.648578 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 548/1072] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 18:49:06 2022] POST /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959/os-volume_attachments => generated 194 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:08.293190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-330649609", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "9031293e-e338-4b42-a0af-544dcfce5318"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:08.455356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] validate_networks() for [('9031293e-e338-4b42-a0af-544dcfce5318', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:49:09.100445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:49:09.100825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:49:09.101318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:49:09.101735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:49:09.102152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:49:09.124850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:09.126836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:09.127295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:09.128051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:09.128526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:09.128964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:09.162068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Getting quotas for project 60af6e89111c4ea886cd03dfd18e20d1. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:49:09.167371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Getting quotas for user ab0bd7aab43d43d2b172fcd4935813f9 and project 60af6e89111c4ea886cd03dfd18e20d1. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:49:09.179672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Going to run 3 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:49:09.182601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 9fd25663-2c8a-4c1f-b5e3-231e38afed4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:49:09.224562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 09d2d6e6-9f89-45ca-8353-d0d549e82086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=9fd25663-2c8a-4c1f-b5e3-231e38afed4c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:49:09.273087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=09d2d6e6-9f89-45ca-8353-d0d549e82086,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:49:09.361484 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3be8bf08-050b-459e-a529-6a55978dcd17 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.708754 Oct 27 18:49:09.362243 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 549/1073] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:49:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:49:09.367293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-72891ee4-f528-43ce-9496-a41dbae3b2f4 tempest-SecurityGroupsTestAdminJSON-1871052841 tempest-SecurityGroupsTestAdminJSON-1871052841-project-admin] Calling method '.version_select at 0x7fc86b4b6ee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:09.429893 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e92260ed-5d59-4263-be7f-4ccc3d78190e tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.155592 Oct 27 18:49:09.435346 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 525/1074] 10.222.0.42 () {60 vars in 1170 bytes} [Thu Oct 27 18:49:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:09.441315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-11fb2bf6-f856-4842-ad62-13944ccfcfd7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:09.442466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-11fb2bf6-f856-4842-ad62-13944ccfcfd7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:09.452010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11fb2bf6-f856-4842-ad62-13944ccfcfd7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:09.452824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11fb2bf6-f856-4842-ad62-13944ccfcfd7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:09.455130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11fb2bf6-f856-4842-ad62-13944ccfcfd7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:09.456090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11fb2bf6-f856-4842-ad62-13944ccfcfd7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:09.457009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11fb2bf6-f856-4842-ad62-13944ccfcfd7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:09.457853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11fb2bf6-f856-4842-ad62-13944ccfcfd7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:09.695956 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-72891ee4-f528-43ce-9496-a41dbae3b2f4 tempest-SecurityGroupsTestAdminJSON-1871052841 tempest-SecurityGroupsTestAdminJSON-1871052841-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/c2d82d57-a0de-4e1f-97a5-3a709a16a4cf" status: 202 len: 0 microversion: 2.1 time: 0.332544 Oct 27 18:49:09.700452 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 550/1075] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:09 2022] DELETE /compute/v2.1/os-security-groups/c2d82d57-a0de-4e1f-97a5-3a709a16a4cf => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:09.703575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b4ffc0d-3cb4-4e0f-b0e1-32df6ac1c845 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:09.707309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7b4ffc0d-3cb4-4e0f-b0e1-32df6ac1c845 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:09.718791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b4ffc0d-3cb4-4e0f-b0e1-32df6ac1c845 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:09.719298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b4ffc0d-3cb4-4e0f-b0e1-32df6ac1c845 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:09.719807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b4ffc0d-3cb4-4e0f-b0e1-32df6ac1c845 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:09.720663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b4ffc0d-3cb4-4e0f-b0e1-32df6ac1c845 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:09.721155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b4ffc0d-3cb4-4e0f-b0e1-32df6ac1c845 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:09.721877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b4ffc0d-3cb4-4e0f-b0e1-32df6ac1c845 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:09.901697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-11fb2bf6-f856-4842-ad62-13944ccfcfd7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:09.913805 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-11fb2bf6-f856-4842-ad62-13944ccfcfd7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1379 microversion: 2.1 time: 0.477038 Oct 27 18:49:09.930272 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 526/1076] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:09 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1379 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:09.935805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5382b36a-b91c-4dcf-8727-647b9aceb079 req-d438477e-5d38-439e-9332-c6bd625f335c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc7b6449-5aab-4b34-ab36-79dacd8893a9", "tag": "5264c280-364d-4964-af91-6ca4d4a1758a"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:09.942275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=16 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:09.944785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7b4ffc0d-3cb4-4e0f-b0e1-32df6ac1c845 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:09.946982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5382b36a-b91c-4dcf-8727-647b9aceb079 req-d438477e-5d38-439e-9332-c6bd625f335c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:09.948435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5382b36a-b91c-4dcf-8727-647b9aceb079 req-d438477e-5d38-439e-9332-c6bd625f335c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:09.949263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5382b36a-b91c-4dcf-8727-647b9aceb079 req-d438477e-5d38-439e-9332-c6bd625f335c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:09.954974 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7b4ffc0d-3cb4-4e0f-b0e1-32df6ac1c845 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9" status: 200 len: 1316 microversion: 2.1 time: 0.256160 Oct 27 18:49:09.956934 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 551/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:09 2022] GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:09.966330 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5382b36a-b91c-4dcf-8727-647b9aceb079 req-d438477e-5d38-439e-9332-c6bd625f335c service nova] Creating event network-changed:5264c280-364d-4964-af91-6ca4d4a1758a for instance bc7b6449-5aab-4b34-ab36-79dacd8893a9 on n-h1-860687-3 Oct 27 18:49:09.972774 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5382b36a-b91c-4dcf-8727-647b9aceb079 req-d438477e-5d38-439e-9332-c6bd625f335c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040735 Oct 27 18:49:09.973604 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 527/1078] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:09.982824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e69fabf3-6edb-4e55-8b40-d9915f07791e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:09.998084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e69fabf3-6edb-4e55-8b40-d9915f07791e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:10.001682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e69fabf3-6edb-4e55-8b40-d9915f07791e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Searching by: {'deleted': False, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:49:10.042583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e69fabf3-6edb-4e55-8b40-d9915f07791e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:10.043437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e69fabf3-6edb-4e55-8b40-d9915f07791e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:10.044397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e69fabf3-6edb-4e55-8b40-d9915f07791e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:10.045385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e69fabf3-6edb-4e55-8b40-d9915f07791e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:10.046141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e69fabf3-6edb-4e55-8b40-d9915f07791e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:10.046951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e69fabf3-6edb-4e55-8b40-d9915f07791e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:10.236972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03f211e3-1022-44c5-a33c-bf8681435d64 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Action: 'create', calling method: .version_select at 0x7fc86ae0df70>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDl+IHu6e4oBbkwgMk0DDZ1mNC+fZsIQ+68KDmTSacZ+we0mL/ZvXPbvT4qWyvVJVrCbzMwRiy4SbJdMd0sbiSsV8Z4++r0mi3ymNPD3ZKODG2hiFrDODC6qYljSgu11A=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03f211e3-1022-44c5-a33c-bf8681435d64 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Request method failure captured: Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 257 Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKkPm-1UIiCY1Y9BT9Kblq_6Z1I1GO0RMNZoGvJvc16aG0gm-UJ55BWlQuY-jI7_7IGQVkHgOrl1Ga_GKF6wEUw_fPETT9XBmcpv6bfvtnrpFy0C0O7rc4ospkQiSW7vwL_vgk5JjlMI_GX8oDGBXtAYlj8DBXGF2IKwQmujDQIP28 Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:49:10.242327 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:49:10.243670 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13f0d758100342feb7ef9b256f3ebd76", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:10.243670 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:10.243670 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:10.243670 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:10.243670 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:10.243670 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:49:10.243670 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:49:10.243670 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 467cffea6e71420aade287b6c5410c13 Oct 27 18:49:10.243670 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:10.243670 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:49:10.243670 n-d-860687-3 devstack@n-api.service[127028]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDl+IHu6e4oBbkwgMk0DDZ1mNC+fZsIQ+68KDmTSacZ+we0mL/ZvXPbvT4qWyvVJVrCbzMwRiy4SbJdMd0sbiSsV8Z4++r0mi3ymNPD3ZKODG2hiFrDODC6qYljSgu11A=="}} Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDl+IHu6e4oBbkwgMk0DDZ1mNC+fZsIQ+68KDmTSacZ+we0mL/ZvXPbvT4qWyvVJVrCbzMwRiy4SbJdMd0sbiSsV8Z4++r0mi3ymNPD3ZKODG2hiFrDODC6qYljSgu11A=='}}} Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:10.244934 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:10.245968 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:49:10.247373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:49:10.256884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 18:49:10.256884 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:10.256884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03f211e3-1022-44c5-a33c-bf8681435d64 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:10.257333 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e69fabf3-6edb-4e55-8b40-d9915f07791e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.269884 Oct 27 18:49:10.257488 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-03f211e3-1022-44c5-a33c-bf8681435d64 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.284592 Oct 27 18:49:10.257488 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 552/1079] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:49:09 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 290 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:49:10.257793 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 528/1080] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 18:49:09 2022] GET /compute/v2.1/servers => generated 1015 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:10.260230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8938d0a9-474d-40c8-ae4b-4fd763658396 tempest-SecurityGroupsTestAdminJSON-1871052841 tempest-SecurityGroupsTestAdminJSON-1871052841-project-admin] Calling method '.version_select at 0x7fc86b3c73a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:10.261276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1887229288", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "41cb3454-066d-4fcf-bf2e-ef5cb51d55c0"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:10.379633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] validate_networks() for [('41cb3454-066d-4fcf-bf2e-ef5cb51d55c0', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:49:11.176761 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8938d0a9-474d-40c8-ae4b-4fd763658396 tempest-SecurityGroupsTestAdminJSON-1871052841 tempest-SecurityGroupsTestAdminJSON-1871052841-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/476e9589-e48c-496f-aa15-214f4562436d" status: 202 len: 0 microversion: 2.1 time: 0.924594 Oct 27 18:49:11.177358 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 529/1081] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:10 2022] DELETE /compute/v2.1/os-security-groups/476e9589-e48c-496f-aa15-214f4562436d => generated 0 bytes in 927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:11.183018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-340ac346-83a5-457b-a510-10fc950b8df5 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Action: 'create', calling method: .version_select at 0x7fc86af71b80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1529688728", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:11.225579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-340ac346-83a5-457b-a510-10fc950b8df5 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Getting quotas for project 13f0d758100342feb7ef9b256f3ebd76. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:49:11.241472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-340ac346-83a5-457b-a510-10fc950b8df5 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Getting quotas for user 467cffea6e71420aade287b6c5410c13 and project 13f0d758100342feb7ef9b256f3ebd76. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:49:11.274059 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-340ac346-83a5-457b-a510-10fc950b8df5 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-340ac346-83a5-457b-a510-10fc950b8df5 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Request method failure captured: Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 2167 Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtKkPm-1UIiCY1Y9BT9Kblq_6Z1I1GO0RMNZoGvJvc16aG0gm-UJ55BWlQuY-jI7_7IGQVkHgOrl1Ga_GKF6wEUw_fPETT9XBmcpv6bfvtnrpFy0C0O7rc4ospkQiSW7vwL_vgk5JjlMI_GX8oDGBXtAYlj8DBXGF2IKwQmujDQIP28 Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13f0d758100342feb7ef9b256f3ebd76", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 467cffea6e71420aade287b6c5410c13 Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1529688728", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:49:11.294080 n-d-860687-3 devstack@n-api.service[127029]: exception: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1529688728', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:11.296745 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-340ac346-83a5-457b-a510-10fc950b8df5 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:11.300056 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-340ac346-83a5-457b-a510-10fc950b8df5 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.117527 Oct 27 18:49:11.303956 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 530/1082] 10.222.0.42 () {60 vars in 1160 bytes} [Thu Oct 27 18:49:11 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:49:11.317492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2a130edd-bf03-4b2b-9879-0817d3c16a66 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:11.321434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2a130edd-bf03-4b2b-9879-0817d3c16a66 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:11.355274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a130edd-bf03-4b2b-9879-0817d3c16a66 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:11.356242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a130edd-bf03-4b2b-9879-0817d3c16a66 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:11.358682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a130edd-bf03-4b2b-9879-0817d3c16a66 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:11.359459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a130edd-bf03-4b2b-9879-0817d3c16a66 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:11.364702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a130edd-bf03-4b2b-9879-0817d3c16a66 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:11.366641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a130edd-bf03-4b2b-9879-0817d3c16a66 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:11.504499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2a130edd-bf03-4b2b-9879-0817d3c16a66 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:11.521546 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2a130edd-bf03-4b2b-9879-0817d3c16a66 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 200 len: 1218 microversion: 2.1 time: 0.214682 Oct 27 18:49:11.523384 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 531/1083] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:11 2022] GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 1218 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:11.536996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-2ae65373-6a75-400b-8131-150fa83f19bb req-2abe0d88-85d4-4584-84e2-112e21044eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873ced30-1179-4f52-9356-8e2f6c310959", "tag": "fc24a5e3-d26b-4205-b920-4db5d5e6467b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:11.564854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2ae65373-6a75-400b-8131-150fa83f19bb req-2abe0d88-85d4-4584-84e2-112e21044eeb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:11.567856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2ae65373-6a75-400b-8131-150fa83f19bb req-2abe0d88-85d4-4584-84e2-112e21044eeb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:11.568533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2ae65373-6a75-400b-8131-150fa83f19bb req-2abe0d88-85d4-4584-84e2-112e21044eeb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:11.597976 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-2ae65373-6a75-400b-8131-150fa83f19bb req-2abe0d88-85d4-4584-84e2-112e21044eeb service nova] Creating event network-changed:fc24a5e3-d26b-4205-b920-4db5d5e6467b for instance 873ced30-1179-4f52-9356-8e2f6c310959 on n-h2-860687-3 Oct 27 18:49:11.615960 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-2ae65373-6a75-400b-8131-150fa83f19bb req-2abe0d88-85d4-4584-84e2-112e21044eeb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080317 Oct 27 18:49:11.616622 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 532/1084] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:11.637106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a1918bdf-8a9f-49fb-9244-a107d870bfaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:11.642931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a1918bdf-8a9f-49fb-9244-a107d870bfaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:11.655938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1918bdf-8a9f-49fb-9244-a107d870bfaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:11.658238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1918bdf-8a9f-49fb-9244-a107d870bfaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:11.658869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1918bdf-8a9f-49fb-9244-a107d870bfaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:11.659624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1918bdf-8a9f-49fb-9244-a107d870bfaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:11.660086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1918bdf-8a9f-49fb-9244-a107d870bfaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:11.660517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1918bdf-8a9f-49fb-9244-a107d870bfaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:11.868485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:49:11.870707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:49:11.871675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:49:11.872917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:49:11.873558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:49:11.898006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:11.898916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:11.900164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:11.901863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:11.902624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:11.903518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:11.924492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Getting quotas for project d7e4d40daccf4e27a5e61093cd62dea8. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:49:11.929881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Getting quotas for user a7517e24516c4b75a2553b9521d5c38e and project d7e4d40daccf4e27a5e61093cd62dea8. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:49:11.942985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:49:11.945784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:49:12.030263 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ab021420-6840-40b3-8788-5ed60a5a8fd9 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.780899 Oct 27 18:49:12.034070 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 553/1085] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:49:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:49:12.045608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4bee26dc-f004-42c2-9f7e-263276e9cff5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:12.047389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4bee26dc-f004-42c2-9f7e-263276e9cff5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:12.065936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bee26dc-f004-42c2-9f7e-263276e9cff5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:12.085478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bee26dc-f004-42c2-9f7e-263276e9cff5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:12.089105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bee26dc-f004-42c2-9f7e-263276e9cff5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:12.090783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bee26dc-f004-42c2-9f7e-263276e9cff5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:12.093743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bee26dc-f004-42c2-9f7e-263276e9cff5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:12.096766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bee26dc-f004-42c2-9f7e-263276e9cff5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:12.234815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1918bdf-8a9f-49fb-9244-a107d870bfaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:12.243432 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a1918bdf-8a9f-49fb-9244-a107d870bfaf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1379 microversion: 2.1 time: 0.624605 Oct 27 18:49:12.274681 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 533/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:11 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1379 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:12.286436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3861e951-1077-424a-9ae1-aab86461da82 tempest-SecurityGroupsTestAdminJSON-1614989928 tempest-SecurityGroupsTestAdminJSON-1614989928-project] Calling method '.version_select at 0x7fc86af91550>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:12.492938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4bee26dc-f004-42c2-9f7e-263276e9cff5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:12.508039 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4bee26dc-f004-42c2-9f7e-263276e9cff5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9" status: 200 len: 1316 microversion: 2.1 time: 0.471154 Oct 27 18:49:12.509535 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 554/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:12 2022] GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:12.515863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ffdba337-7421-46cc-98c1-94add9eb1928 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Action: 'create', calling method: .version_select at 0x7fc86ad9fe50>, body: {"keypair": {"name": "tempest-keypair-1474483571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhztnuOu1TTrHmpndoaG65+bgShIxY/T8Mu/B0cdAWMStLWJKU7Od5H9md82ryLUkUy0gEVVoQNg22qxsvmGFWAPygvmDkJm8xanulPIrWzDooByIrf5FcdQeLG56MGjQ=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:12.537770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-ffdba337-7421-46cc-98c1-94add9eb1928 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Getting quotas for project 13f0d758100342feb7ef9b256f3ebd76. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:49:12.546428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-ffdba337-7421-46cc-98c1-94add9eb1928 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Getting quotas for user 467cffea6e71420aade287b6c5410c13 and project 13f0d758100342feb7ef9b256f3ebd76. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:49:12.581948 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ffdba337-7421-46cc-98c1-94add9eb1928 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071056 Oct 27 18:49:12.597253 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 555/1088] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:49:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:12.602085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6bbcc8fb-4732-457e-8b3b-16c8f9cd7bf5 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:12.605916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6bbcc8fb-4732-457e-8b3b-16c8f9cd7bf5 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:12.726868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6bbcc8fb-4732-457e-8b3b-16c8f9cd7bf5 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:12.741577 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6bbcc8fb-4732-457e-8b3b-16c8f9cd7bf5 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1224 microversion: 2.1 time: 0.151929 Oct 27 18:49:12.759282 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 556/1089] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:12 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1224 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:12.769897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-89f31157-786c-4639-a14e-9c5ebcd84a82 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:12.770555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-89f31157-786c-4639-a14e-9c5ebcd84a82 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:12.778638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89f31157-786c-4639-a14e-9c5ebcd84a82 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:12.779201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89f31157-786c-4639-a14e-9c5ebcd84a82 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:12.779640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89f31157-786c-4639-a14e-9c5ebcd84a82 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:12.780357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89f31157-786c-4639-a14e-9c5ebcd84a82 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:12.780810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89f31157-786c-4639-a14e-9c5ebcd84a82 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:12.781235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89f31157-786c-4639-a14e-9c5ebcd84a82 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:12.887616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-89f31157-786c-4639-a14e-9c5ebcd84a82 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:12.900927 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-89f31157-786c-4639-a14e-9c5ebcd84a82 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 200 len: 1274 microversion: 2.1 time: 0.136271 Oct 27 18:49:12.903457 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 557/1090] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:12 2022] GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 1274 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:12.909931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aa332747-4e3e-4696-9eb7-7bc6aaf765f0 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Action: 'create', calling method: .version_select at 0x7fc86ad418b0>, body: {"keypair": {"name": "tempest-keypair-1474483571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWXpUuFAfkDPUNqr4Ev+n6/Ot6YXS3VnVD0m/+0wkhoP6+mlwNcGNLihiMnaGdFPhrhWl8I7i3DlpvSGx+RKhQF8065cMeasT+gZX5WC1GMv9QS8OhB3v88XYsiiV0EWA=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:12.937870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-aa332747-4e3e-4696-9eb7-7bc6aaf765f0 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Getting quotas for project 13f0d758100342feb7ef9b256f3ebd76. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:49:12.943685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-aa332747-4e3e-4696-9eb7-7bc6aaf765f0 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Getting quotas for user 467cffea6e71420aade287b6c5410c13 and project 13f0d758100342feb7ef9b256f3ebd76. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:49:12.974616 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-aa332747-4e3e-4696-9eb7-7bc6aaf765f0 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] HTTP exception thrown: Key pair 'tempest-keypair-1474483571' already exists. Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aa332747-4e3e-4696-9eb7-7bc6aaf765f0 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Request method failure captured: Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 273 Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKkPm-1UIiCY1Y9BT9Kblq_6Z1I1GO0RMNZoGvJvc16aG0gm-UJ55BWlQuY-jI7_7IGQVkHgOrl1Ga_GKF6wEUw_fPETT9XBmcpv6bfvtnrpFy0C0O7rc4ospkQiSW7vwL_vgk5JjlMI_GX8oDGBXtAYlj8DBXGF2IKwQmujDQIP28 Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13f0d758100342feb7ef9b256f3ebd76", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 467cffea6e71420aade287b6c5410c13 Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: {"keypair": {"name": "tempest-keypair-1474483571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWXpUuFAfkDPUNqr4Ev+n6/Ot6YXS3VnVD0m/+0wkhoP6+mlwNcGNLihiMnaGdFPhrhWl8I7i3DlpvSGx+RKhQF8065cMeasT+gZX5WC1GMv9QS8OhB3v88XYsiiV0EWA=="}} Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: exception: Key pair 'tempest-keypair-1474483571' already exists. Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1474483571', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWXpUuFAfkDPUNqr4Ev+n6/Ot6YXS3VnVD0m/+0wkhoP6+mlwNcGNLihiMnaGdFPhrhWl8I7i3DlpvSGx+RKhQF8065cMeasT+gZX5WC1GMv9QS8OhB3v88XYsiiV0EWA=='}}} Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result.read() Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '467cffea6e71420aade287b6c5410c13-tempest-keypair-1474483571' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 27 18:49:12.991979 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi session.flush() Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result.read() Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 18:49:12.996189 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '467cffea6e71420aade287b6c5410c13-tempest-keypair-1474483571' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 27, 18, 49, 12, 962537), 'updated_at': None, 'name': 'tempest-keypair-1474483571', 'user_id': '467cffea6e71420aade287b6c5410c13', 'fingerprint': '06:fe:5c:50:db:59:1e:37:08:29:7e:64:b4:d0:da:68', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWXpUuFAfkDPUNqr4Ev+n6/Ot6YXS3VnVD0m/+0wkhoP6+mlwNcGNLihiMnaGdFPhrhWl8I7i3DlpvSGx+RKhQF8065cMeasT+gZX5WC1GMv9QS8OhB3v88XYsiiV0EWA==', 'type': 'ssh'}] Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi keypair.create() Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._create() Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1474483571' already exists. Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 27 18:49:12.999638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1474483571' already exists. Oct 27 18:49:13.005223 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.005223 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:13.005223 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.005223 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.005223 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:13.005223 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:13.005223 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:13.005223 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:13.005223 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1474483571' already exists. Oct 27 18:49:13.005223 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.005223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aa332747-4e3e-4696-9eb7-7bc6aaf765f0 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Returning 409 to user: Key pair 'tempest-keypair-1474483571' already exists. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:13.005223 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aa332747-4e3e-4696-9eb7-7bc6aaf765f0 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.088894 Oct 27 18:49:13.005223 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 558/1091] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:49:12 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:49:13.013400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8b397fe1-210e-4f9d-8836-f4933ac48793 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Calling method '.version_select at 0x7fc86ad41820>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:13.047364 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8b397fe1-210e-4f9d-8836-f4933ac48793 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474483571" status: 202 len: 0 microversion: 2.1 time: 0.042824 Oct 27 18:49:13.049142 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 559/1092] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 18:49:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474483571 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:13.064522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1e22780c-57c3-461c-908c-aa98f631ceaf tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Action: 'create', calling method: .version_select at 0x7fc86ad75280>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNf7x11La8b1ouJrJnJB6VYyPKgJ2yqTRAqnHUhq2Uj/d++zIy8kTX6U0cl4P7CYcJEnYnQevW1XDu/6fkOgjgQHu5qa/woxImUcRFsMhxAcI3bf+mniUN87hKm8NY3FOA=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1e22780c-57c3-461c-908c-aa98f631ceaf tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Request method failure captured: Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 247 Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKkPm-1UIiCY1Y9BT9Kblq_6Z1I1GO0RMNZoGvJvc16aG0gm-UJ55BWlQuY-jI7_7IGQVkHgOrl1Ga_GKF6wEUw_fPETT9XBmcpv6bfvtnrpFy0C0O7rc4ospkQiSW7vwL_vgk5JjlMI_GX8oDGBXtAYlj8DBXGF2IKwQmujDQIP28 Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13f0d758100342feb7ef9b256f3ebd76", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 467cffea6e71420aade287b6c5410c13 Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNf7x11La8b1ouJrJnJB6VYyPKgJ2yqTRAqnHUhq2Uj/d++zIy8kTX6U0cl4P7CYcJEnYnQevW1XDu/6fkOgjgQHu5qa/woxImUcRFsMhxAcI3bf+mniUN87hKm8NY3FOA=="}} Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNf7x11La8b1ouJrJnJB6VYyPKgJ2yqTRAqnHUhq2Uj/d++zIy8kTX6U0cl4P7CYcJEnYnQevW1XDu/6fkOgjgQHu5qa/woxImUcRFsMhxAcI3bf+mniUN87hKm8NY3FOA=='}}} Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi '' Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:49:13.069240 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 18:49:13.075200 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.078634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1e22780c-57c3-461c-908c-aa98f631ceaf tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:13.079722 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1e22780c-57c3-461c-908c-aa98f631ceaf tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.019939 Oct 27 18:49:13.080729 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3861e951-1077-424a-9ae1-aab86461da82 tempest-SecurityGroupsTestAdminJSON-1614989928 tempest-SecurityGroupsTestAdminJSON-1614989928-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/ab5cc1e2-bc42-41c0-8145-4fdd11a571c8" status: 202 len: 0 microversion: 2.1 time: 0.805406 Oct 27 18:49:13.081785 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 534/1093] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:12 2022] DELETE /compute/v2.1/os-security-groups/ab5cc1e2-bc42-41c0-8145-4fdd11a571c8 => generated 0 bytes in 807 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:13.090480 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 560/1094] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:49:13 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:49:13.093481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14525303-c205-4cd3-a86c-7ffc59108cd1 tempest-SecurityGroupsTestAdminJSON-1614989928 tempest-SecurityGroupsTestAdminJSON-1614989928-project] Calling method '.version_select at 0x7fc86af911f0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:13.095328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-66bdd11b-3e94-4096-b93b-1a4e3871ace0 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Action: 'create', calling method: .version_select at 0x7fc86ae6f790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1466373148", "public_key": " "}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:13.118861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:INSERT=16,nova_api:SELECT=83,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:13.128793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-66bdd11b-3e94-4096-b93b-1a4e3871ace0 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Getting quotas for project 13f0d758100342feb7ef9b256f3ebd76. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:49:13.134909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-66bdd11b-3e94-4096-b93b-1a4e3871ace0 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Getting quotas for user 467cffea6e71420aade287b6c5410c13 and project 13f0d758100342feb7ef9b256f3ebd76. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:49:13.202847 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-66bdd11b-3e94-4096-b93b-1a4e3871ace0 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-66bdd11b-3e94-4096-b93b-1a4e3871ace0 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Request method failure captured: Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 95 Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKkPm-1UIiCY1Y9BT9Kblq_6Z1I1GO0RMNZoGvJvc16aG0gm-UJ55BWlQuY-jI7_7IGQVkHgOrl1Ga_GKF6wEUw_fPETT9XBmcpv6bfvtnrpFy0C0O7rc4ospkQiSW7vwL_vgk5JjlMI_GX8oDGBXtAYlj8DBXGF2IKwQmujDQIP28 Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13f0d758100342feb7ef9b256f3ebd76", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 467cffea6e71420aade287b6c5410c13 Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1466373148", "public_key": " "}} Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: exception: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1466373148', 'public_key': ' '}}} Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:13.206222 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-66bdd11b-3e94-4096-b93b-1a4e3871ace0 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-66bdd11b-3e94-4096-b93b-1a4e3871ace0 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.116238 Oct 27 18:49:13.210323 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 561/1095] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Oct 27 18:49:13 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:49:13.231511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-02f33f2c-108d-4b42-80dc-14664ca670a8 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Action: 'create', calling method: .version_select at 0x7fc86ae6f3a0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4J9bxdFLgd4qvLADsbWb5Vo1coy4JMZqB9PPF4vN6PTnZSSvrmgZGfCucG1DCklIIFiT78pU19I0CieE4sqaWwnalDQXMbuspL4WgIf7y7zQicv0YkRI5tQLFk7xtygg=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-02f33f2c-108d-4b42-80dc-14664ca670a8 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Request method failure captured: Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 507 Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKkPm-1UIiCY1Y9BT9Kblq_6Z1I1GO0RMNZoGvJvc16aG0gm-UJ55BWlQuY-jI7_7IGQVkHgOrl1Ga_GKF6wEUw_fPETT9XBmcpv6bfvtnrpFy0C0O7rc4ospkQiSW7vwL_vgk5JjlMI_GX8oDGBXtAYlj8DBXGF2IKwQmujDQIP28 Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13f0d758100342feb7ef9b256f3ebd76", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 467cffea6e71420aade287b6c5410c13 Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4J9bxdFLgd4qvLADsbWb5Vo1coy4JMZqB9PPF4vN6PTnZSSvrmgZGfCucG1DCklIIFiT78pU19I0CieE4sqaWwnalDQXMbuspL4WgIf7y7zQicv0YkRI5tQLFk7xtygg=="}} Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4J9bxdFLgd4qvLADsbWb5Vo1coy4JMZqB9PPF4vN6PTnZSSvrmgZGfCucG1DCklIIFiT78pU19I0CieE4sqaWwnalDQXMbuspL4WgIf7y7zQicv0YkRI5tQLFk7xtygg=='}}} Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 27 18:49:13.252580 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 18:49:13.255652 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.262847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-02f33f2c-108d-4b42-80dc-14664ca670a8 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:13.264000 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-02f33f2c-108d-4b42-80dc-14664ca670a8 tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.047135 Oct 27 18:49:13.270811 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 562/1096] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:49:13 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:49:13.286967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bfbce0b2-d8ce-4d5e-b082-da122d0c9f9e tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Action: 'create', calling method: .version_select at 0x7fc86b014ee0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1871616814", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:13.335048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-bfbce0b2-d8ce-4d5e-b082-da122d0c9f9e tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Getting quotas for project 13f0d758100342feb7ef9b256f3ebd76. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:49:13.345637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-bfbce0b2-d8ce-4d5e-b082-da122d0c9f9e tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Getting quotas for user 467cffea6e71420aade287b6c5410c13 and project 13f0d758100342feb7ef9b256f3ebd76. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:49:13.366820 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-bfbce0b2-d8ce-4d5e-b082-da122d0c9f9e tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bfbce0b2-d8ce-4d5e-b082-da122d0c9f9e tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Request method failure captured: Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 118 Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKkPm-1UIiCY1Y9BT9Kblq_6Z1I1GO0RMNZoGvJvc16aG0gm-UJ55BWlQuY-jI7_7IGQVkHgOrl1Ga_GKF6wEUw_fPETT9XBmcpv6bfvtnrpFy0C0O7rc4ospkQiSW7vwL_vgk5JjlMI_GX8oDGBXtAYlj8DBXGF2IKwQmujDQIP28 Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13f0d758100342feb7ef9b256f3ebd76", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 467cffea6e71420aade287b6c5410c13 Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1871616814", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: exception: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1871616814', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 27 18:49:13.371854 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bfbce0b2-d8ce-4d5e-b082-da122d0c9f9e tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:13.375743 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bfbce0b2-d8ce-4d5e-b082-da122d0c9f9e tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.096580 Oct 27 18:49:13.382287 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 563/1097] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:49:13 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:49:13.387056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-15a814e3-beb5-4579-94f5-b2035866cb4f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:13.387695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-15a814e3-beb5-4579-94f5-b2035866cb4f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:13.394224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15a814e3-beb5-4579-94f5-b2035866cb4f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:13.394723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15a814e3-beb5-4579-94f5-b2035866cb4f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:13.395162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15a814e3-beb5-4579-94f5-b2035866cb4f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:13.405540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15a814e3-beb5-4579-94f5-b2035866cb4f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:13.406084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15a814e3-beb5-4579-94f5-b2035866cb4f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:13.406638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15a814e3-beb5-4579-94f5-b2035866cb4f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:13.687479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-15a814e3-beb5-4579-94f5-b2035866cb4f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:13.711077 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-15a814e3-beb5-4579-94f5-b2035866cb4f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1379 microversion: 2.1 time: 0.327855 Oct 27 18:49:13.712091 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 564/1098] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:13 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1379 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:13.719983 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-14525303-c205-4cd3-a86c-7ffc59108cd1 tempest-SecurityGroupsTestAdminJSON-1614989928 tempest-SecurityGroupsTestAdminJSON-1614989928-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/68e3e691-7963-40e9-9b8e-773e9e7a6d94" status: 202 len: 0 microversion: 2.1 time: 0.633529 Oct 27 18:49:13.724894 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 535/1099] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:13 2022] DELETE /compute/v2.1/os-security-groups/68e3e691-7963-40e9-9b8e-773e9e7a6d94 => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:13.729383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-46a5f9be-6a4c-4296-88aa-2fbccdeeaba2 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:13.730138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-46a5f9be-6a4c-4296-88aa-2fbccdeeaba2 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:13.745501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-86ae250e-a917-4fd4-857f-5656c3ee291a tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Calling method '.version_select at 0x7fc86ae10e50>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:13.748708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46a5f9be-6a4c-4296-88aa-2fbccdeeaba2 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:13.748865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46a5f9be-6a4c-4296-88aa-2fbccdeeaba2 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:13.763356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46a5f9be-6a4c-4296-88aa-2fbccdeeaba2 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:13.767222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46a5f9be-6a4c-4296-88aa-2fbccdeeaba2 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:13.768209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46a5f9be-6a4c-4296-88aa-2fbccdeeaba2 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:13.771350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46a5f9be-6a4c-4296-88aa-2fbccdeeaba2 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:13.795900 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-86ae250e-a917-4fd4-857f-5656c3ee291a tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-480151325 not found for user 467cffea6e71420aade287b6c5410c13 Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-86ae250e-a917-4fd4-857f-5656c3ee291a tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Request method failure captured: Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-480151325 HTTP/1.1 Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKkPm-1UIiCY1Y9BT9Kblq_6Z1I1GO0RMNZoGvJvc16aG0gm-UJ55BWlQuY-jI7_7IGQVkHgOrl1Ga_GKF6wEUw_fPETT9XBmcpv6bfvtnrpFy0C0O7rc4ospkQiSW7vwL_vgk5JjlMI_GX8oDGBXtAYlj8DBXGF2IKwQmujDQIP28 Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13f0d758100342feb7ef9b256f3ebd76", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13f0d758100342feb7ef9b256f3ebd76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 13f0d758100342feb7ef9b256f3ebd76 Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1528509542 Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 467cffea6e71420aade287b6c5410c13 Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1528509542-project Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: exception: Keypair tempest-keypair-non-existent-480151325 not found for user 467cffea6e71420aade287b6c5410c13 Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'tempest-keypair-non-existent-480151325'} Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-480151325 not found for user 467cffea6e71420aade287b6c5410c13 Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.799777 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-480151325 not found for user 467cffea6e71420aade287b6c5410c13 Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-480151325 not found for user 467cffea6e71420aade287b6c5410c13 Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-86ae250e-a917-4fd4-857f-5656c3ee291a tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] Returning 404 to user: Keypair tempest-keypair-non-existent-480151325 not found for user 467cffea6e71420aade287b6c5410c13 {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:13.804539 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-86ae250e-a917-4fd4-857f-5656c3ee291a tempest-KeyPairsNegativeTestJSON-1528509542 tempest-KeyPairsNegativeTestJSON-1528509542-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-480151325" status: 404 len: 144 microversion: 2.1 time: 0.087714 Oct 27 18:49:13.806248 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 565/1100] 10.222.0.42 () {58 vars in 1257 bytes} [Thu Oct 27 18:49:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-480151325 => generated 144 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:49:13.817425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-01cf435e-3dd5-495c-9433-00de784d46d1 req-05637c4d-ee11-4aa5-9443-500fec85d82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7b6449-5aab-4b34-ab36-79dacd8893a9", "name": "network-vif-plugged", "status": "completed", "tag": "5264c280-364d-4964-af91-6ca4d4a1758a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:13.843789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-01cf435e-3dd5-495c-9433-00de784d46d1 req-05637c4d-ee11-4aa5-9443-500fec85d82f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:13.844987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-01cf435e-3dd5-495c-9433-00de784d46d1 req-05637c4d-ee11-4aa5-9443-500fec85d82f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:13.844987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-01cf435e-3dd5-495c-9433-00de784d46d1 req-05637c4d-ee11-4aa5-9443-500fec85d82f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:13.887030 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-01cf435e-3dd5-495c-9433-00de784d46d1 req-05637c4d-ee11-4aa5-9443-500fec85d82f service nova] Creating event network-vif-plugged:5264c280-364d-4964-af91-6ca4d4a1758a for instance bc7b6449-5aab-4b34-ab36-79dacd8893a9 on n-h1-860687-3 Oct 27 18:49:13.893290 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-01cf435e-3dd5-495c-9433-00de784d46d1 req-05637c4d-ee11-4aa5-9443-500fec85d82f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085247 Oct 27 18:49:13.894696 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 566/1101] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:13.909910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ec2ea94d-ec4f-4764-8031-9d0337620f79 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:13.911344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ec2ea94d-ec4f-4764-8031-9d0337620f79 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:13.936193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec2ea94d-ec4f-4764-8031-9d0337620f79 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:13.938688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec2ea94d-ec4f-4764-8031-9d0337620f79 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:13.939610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec2ea94d-ec4f-4764-8031-9d0337620f79 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:13.941465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec2ea94d-ec4f-4764-8031-9d0337620f79 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:13.943159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec2ea94d-ec4f-4764-8031-9d0337620f79 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:13.945818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec2ea94d-ec4f-4764-8031-9d0337620f79 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:14.339938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-46a5f9be-6a4c-4296-88aa-2fbccdeeaba2 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:14.356311 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-46a5f9be-6a4c-4296-88aa-2fbccdeeaba2 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9" status: 200 len: 1316 microversion: 2.1 time: 0.631193 Oct 27 18:49:14.360109 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 536/1102] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:13 2022] GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 => generated 1316 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:14.381769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-873a3fe2-d986-4909-af18-12e39023d9c8 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:14.387537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-873a3fe2-d986-4909-af18-12e39023d9c8 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:14.406445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-873a3fe2-d986-4909-af18-12e39023d9c8 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:14.406971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-873a3fe2-d986-4909-af18-12e39023d9c8 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:14.407389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-873a3fe2-d986-4909-af18-12e39023d9c8 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:14.410319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-873a3fe2-d986-4909-af18-12e39023d9c8 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:14.410819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-873a3fe2-d986-4909-af18-12e39023d9c8 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:14.411263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-873a3fe2-d986-4909-af18-12e39023d9c8 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:14.711686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ec2ea94d-ec4f-4764-8031-9d0337620f79 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:14.724826 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ec2ea94d-ec4f-4764-8031-9d0337620f79 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1228 microversion: 2.1 time: 0.819629 Oct 27 18:49:14.727491 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 567/1103] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:13 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1228 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:14.748871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1624661a-9a52-41d0-9db5-2dc135472437 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:14.750237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1624661a-9a52-41d0-9db5-2dc135472437 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:14.757018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1624661a-9a52-41d0-9db5-2dc135472437 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:14.758006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1624661a-9a52-41d0-9db5-2dc135472437 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:14.758513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1624661a-9a52-41d0-9db5-2dc135472437 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:14.759290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1624661a-9a52-41d0-9db5-2dc135472437 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:14.760521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1624661a-9a52-41d0-9db5-2dc135472437 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:14.760968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1624661a-9a52-41d0-9db5-2dc135472437 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:14.773923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-873a3fe2-d986-4909-af18-12e39023d9c8 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:14.805594 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-873a3fe2-d986-4909-af18-12e39023d9c8 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 200 len: 1280 microversion: 2.1 time: 0.443868 Oct 27 18:49:14.806224 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 537/1104] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:14 2022] GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 1280 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:15.269024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1624661a-9a52-41d0-9db5-2dc135472437 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:15.278163 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1624661a-9a52-41d0-9db5-2dc135472437 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1379 microversion: 2.1 time: 0.540688 Oct 27 18:49:15.279357 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 568/1105] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:14 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1379 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:49:15.385418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a0f60de8-b128-4c6b-96e1-9843c2452cc0 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:15.386047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a0f60de8-b128-4c6b-96e1-9843c2452cc0 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:15.402520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0f60de8-b128-4c6b-96e1-9843c2452cc0 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:15.403028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0f60de8-b128-4c6b-96e1-9843c2452cc0 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:15.404911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0f60de8-b128-4c6b-96e1-9843c2452cc0 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:15.411427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0f60de8-b128-4c6b-96e1-9843c2452cc0 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:15.412346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0f60de8-b128-4c6b-96e1-9843c2452cc0 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:15.412814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0f60de8-b128-4c6b-96e1-9843c2452cc0 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:15.751670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d24aee9f-8714-4214-942b-fc05094cb33e tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:15.752290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d24aee9f-8714-4214-942b-fc05094cb33e tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:15.764123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d24aee9f-8714-4214-942b-fc05094cb33e tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:15.764623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d24aee9f-8714-4214-942b-fc05094cb33e tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:15.765067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d24aee9f-8714-4214-942b-fc05094cb33e tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:15.765787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d24aee9f-8714-4214-942b-fc05094cb33e tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:15.766243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d24aee9f-8714-4214-942b-fc05094cb33e tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:15.777138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d24aee9f-8714-4214-942b-fc05094cb33e tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:15.858560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a0f60de8-b128-4c6b-96e1-9843c2452cc0 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:15.871305 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a0f60de8-b128-4c6b-96e1-9843c2452cc0 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9" status: 200 len: 1316 microversion: 2.1 time: 0.489841 Oct 27 18:49:15.873064 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 538/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:15 2022] GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:15.891983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a739ddf-18da-4f80-b07c-47266998e294 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:15.892972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8a739ddf-18da-4f80-b07c-47266998e294 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:15.917470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a739ddf-18da-4f80-b07c-47266998e294 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:15.922122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a739ddf-18da-4f80-b07c-47266998e294 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:15.924264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a739ddf-18da-4f80-b07c-47266998e294 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:15.926245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a739ddf-18da-4f80-b07c-47266998e294 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:15.928359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a739ddf-18da-4f80-b07c-47266998e294 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:15.931244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a739ddf-18da-4f80-b07c-47266998e294 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:15.942820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:16.187216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d24aee9f-8714-4214-942b-fc05094cb33e tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:16.197460 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d24aee9f-8714-4214-942b-fc05094cb33e tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1284 microversion: 2.1 time: 0.448682 Oct 27 18:49:16.217177 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 569/1107] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:15 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1284 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:16.303321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-854606ce-ace5-4975-a3ef-be555618bcee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:16.305398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-854606ce-ace5-4975-a3ef-be555618bcee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:16.325447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-854606ce-ace5-4975-a3ef-be555618bcee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:16.326437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-854606ce-ace5-4975-a3ef-be555618bcee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:16.327143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-854606ce-ace5-4975-a3ef-be555618bcee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:16.328092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-854606ce-ace5-4975-a3ef-be555618bcee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:16.328846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-854606ce-ace5-4975-a3ef-be555618bcee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:16.329511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-854606ce-ace5-4975-a3ef-be555618bcee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:16.446294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8a739ddf-18da-4f80-b07c-47266998e294 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:16.459211 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8a739ddf-18da-4f80-b07c-47266998e294 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 200 len: 1322 microversion: 2.1 time: 0.582008 Oct 27 18:49:16.483079 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 539/1108] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:15 2022] GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:16.642329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d4b07027-f7ef-4e03-917c-9f470d3fd380 req-aaa2b3e4-caa7-416c-8a32-5a10a57b40d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fd25663-2c8a-4c1f-b5e3-231e38afed4c", "tag": "0cc38cfe-0045-4c12-a338-86776d8cd938"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:16.676348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d4b07027-f7ef-4e03-917c-9f470d3fd380 req-aaa2b3e4-caa7-416c-8a32-5a10a57b40d0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:16.677751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d4b07027-f7ef-4e03-917c-9f470d3fd380 req-aaa2b3e4-caa7-416c-8a32-5a10a57b40d0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:16.678670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d4b07027-f7ef-4e03-917c-9f470d3fd380 req-aaa2b3e4-caa7-416c-8a32-5a10a57b40d0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:16.693126 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d4b07027-f7ef-4e03-917c-9f470d3fd380 req-aaa2b3e4-caa7-416c-8a32-5a10a57b40d0 service nova] Creating event network-changed:0cc38cfe-0045-4c12-a338-86776d8cd938 for instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c on n-h1-860687-3 Oct 27 18:49:16.700184 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d4b07027-f7ef-4e03-917c-9f470d3fd380 req-aaa2b3e4-caa7-416c-8a32-5a10a57b40d0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062631 Oct 27 18:49:16.702267 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 540/1109] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:16.913238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ab32e4bc-8a10-4b6e-89c5-e4f64621cd03 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:16.913962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ab32e4bc-8a10-4b6e-89c5-e4f64621cd03 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:16.927019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab32e4bc-8a10-4b6e-89c5-e4f64621cd03 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:16.927945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab32e4bc-8a10-4b6e-89c5-e4f64621cd03 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:16.929791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab32e4bc-8a10-4b6e-89c5-e4f64621cd03 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:16.931464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab32e4bc-8a10-4b6e-89c5-e4f64621cd03 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:16.931981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab32e4bc-8a10-4b6e-89c5-e4f64621cd03 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:16.933513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab32e4bc-8a10-4b6e-89c5-e4f64621cd03 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:17.183755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-854606ce-ace5-4975-a3ef-be555618bcee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:17.198334 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-854606ce-ace5-4975-a3ef-be555618bcee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1379 microversion: 2.1 time: 0.897318 Oct 27 18:49:17.210642 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 570/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:16 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1379 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:17.222856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e67c92d-b317-42bb-9dad-134a62e2dd78 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:17.223585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e67c92d-b317-42bb-9dad-134a62e2dd78 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:17.232021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e67c92d-b317-42bb-9dad-134a62e2dd78 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:17.232510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e67c92d-b317-42bb-9dad-134a62e2dd78 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:17.233986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e67c92d-b317-42bb-9dad-134a62e2dd78 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:17.235556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e67c92d-b317-42bb-9dad-134a62e2dd78 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:17.236317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e67c92d-b317-42bb-9dad-134a62e2dd78 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:17.237069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e67c92d-b317-42bb-9dad-134a62e2dd78 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:17.239660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ab32e4bc-8a10-4b6e-89c5-e4f64621cd03 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:17.251731 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ab32e4bc-8a10-4b6e-89c5-e4f64621cd03 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9" status: 200 len: 1505 microversion: 2.1 time: 0.355344 Oct 27 18:49:17.255960 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 541/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:16 2022] GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:49:17.280448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4a93ffce-2801-4956-af65-fbcfaf5d0b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-981334731"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:17.283056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4a93ffce-2801-4956-af65-fbcfaf5d0b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:17.290557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a93ffce-2801-4956-af65-fbcfaf5d0b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:17.291535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a93ffce-2801-4956-af65-fbcfaf5d0b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:17.292132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a93ffce-2801-4956-af65-fbcfaf5d0b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:17.293186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a93ffce-2801-4956-af65-fbcfaf5d0b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:17.293848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a93ffce-2801-4956-af65-fbcfaf5d0b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:17.295146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a93ffce-2801-4956-af65-fbcfaf5d0b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:17.423740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e67c92d-b317-42bb-9dad-134a62e2dd78 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:17.453773 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e67c92d-b317-42bb-9dad-134a62e2dd78 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1282 microversion: 2.1 time: 0.234778 Oct 27 18:49:17.464672 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 571/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:17 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1282 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:17.489024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b1639c43-84b1-4d1e-b75b-e8789457781d tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:17.490011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b1639c43-84b1-4d1e-b75b-e8789457781d tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:17.499447 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.network.security_group_api [None req-4a93ffce-2801-4956-af65-fbcfaf5d0b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Adding security group dd40ffcd-0efa-4cb8-b60f-f45b33607aeb to port 5264c280-364d-4964-af91-6ca4d4a1758a Oct 27 18:49:17.500671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1639c43-84b1-4d1e-b75b-e8789457781d tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:17.501179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1639c43-84b1-4d1e-b75b-e8789457781d tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:17.501633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1639c43-84b1-4d1e-b75b-e8789457781d tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:17.502360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1639c43-84b1-4d1e-b75b-e8789457781d tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:17.502852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1639c43-84b1-4d1e-b75b-e8789457781d tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:17.503287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1639c43-84b1-4d1e-b75b-e8789457781d tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:17.941836 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4a93ffce-2801-4956-af65-fbcfaf5d0b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9/action" status: 202 len: 0 microversion: 2.1 time: 0.666604 Oct 27 18:49:17.942477 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 542/1113] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:49:17 2022] POST /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 18:49:17.952502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2c85b34a-31cb-460b-b274-b772a1f7b3cb tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-792526380"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:17.953062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2c85b34a-31cb-460b-b274-b772a1f7b3cb tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:17.971048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c85b34a-31cb-460b-b274-b772a1f7b3cb tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:17.971563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c85b34a-31cb-460b-b274-b772a1f7b3cb tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:17.974673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c85b34a-31cb-460b-b274-b772a1f7b3cb tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:17.976418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c85b34a-31cb-460b-b274-b772a1f7b3cb tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:17.982457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c85b34a-31cb-460b-b274-b772a1f7b3cb tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:17.983338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c85b34a-31cb-460b-b274-b772a1f7b3cb tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:17.997868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b1639c43-84b1-4d1e-b75b-e8789457781d tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:18.022459 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b1639c43-84b1-4d1e-b75b-e8789457781d tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 200 len: 1322 microversion: 2.1 time: 0.536272 Oct 27 18:49:18.024537 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 572/1114] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:17 2022] GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 1322 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:49:18.224490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3b100c2c-9559-456e-8292-8aff581872ba tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:18.225228 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.network.security_group_api [None req-2c85b34a-31cb-460b-b274-b772a1f7b3cb tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Adding security group 85a47f57-c19f-417a-bea1-a39ca4b251d9 to port 5264c280-364d-4964-af91-6ca4d4a1758a Oct 27 18:49:18.225384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3b100c2c-9559-456e-8292-8aff581872ba tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:18.233607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b100c2c-9559-456e-8292-8aff581872ba tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:18.236173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b100c2c-9559-456e-8292-8aff581872ba tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:18.238583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b100c2c-9559-456e-8292-8aff581872ba tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:18.239530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b100c2c-9559-456e-8292-8aff581872ba tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:18.240120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b100c2c-9559-456e-8292-8aff581872ba tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:18.241395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b100c2c-9559-456e-8292-8aff581872ba tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:18.880586 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2c85b34a-31cb-460b-b274-b772a1f7b3cb tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9/action" status: 202 len: 0 microversion: 2.1 time: 0.933799 Oct 27 18:49:18.881965 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 543/1115] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:49:17 2022] POST /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9/action => generated 0 bytes in 935 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 18:49:18.887806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a37b85c7-7bb0-4a10-b54b-9aa2ff8d4b27 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:18.888435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a37b85c7-7bb0-4a10-b54b-9aa2ff8d4b27 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:18.898667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a37b85c7-7bb0-4a10-b54b-9aa2ff8d4b27 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:18.899440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a37b85c7-7bb0-4a10-b54b-9aa2ff8d4b27 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:18.901500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a37b85c7-7bb0-4a10-b54b-9aa2ff8d4b27 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:18.902904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a37b85c7-7bb0-4a10-b54b-9aa2ff8d4b27 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:18.903608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a37b85c7-7bb0-4a10-b54b-9aa2ff8d4b27 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:18.904476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a37b85c7-7bb0-4a10-b54b-9aa2ff8d4b27 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:18.965548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3b100c2c-9559-456e-8292-8aff581872ba tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:18.977932 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3b100c2c-9559-456e-8292-8aff581872ba tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1379 microversion: 2.1 time: 0.758183 Oct 27 18:49:18.979112 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 573/1116] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:18 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1379 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:49:18.992642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-29d62de1-d396-4eb6-ab43-f02fc052f57c req-fee65d91-e655-4c5f-9e1a-94305246a95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc7b6449-5aab-4b34-ab36-79dacd8893a9", "tag": "5264c280-364d-4964-af91-6ca4d4a1758a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:19.008095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-29d62de1-d396-4eb6-ab43-f02fc052f57c req-fee65d91-e655-4c5f-9e1a-94305246a95b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:19.008854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-29d62de1-d396-4eb6-ab43-f02fc052f57c req-fee65d91-e655-4c5f-9e1a-94305246a95b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:19.009542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-29d62de1-d396-4eb6-ab43-f02fc052f57c req-fee65d91-e655-4c5f-9e1a-94305246a95b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:19.028988 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-29d62de1-d396-4eb6-ab43-f02fc052f57c req-fee65d91-e655-4c5f-9e1a-94305246a95b service nova] Creating event network-changed:5264c280-364d-4964-af91-6ca4d4a1758a for instance bc7b6449-5aab-4b34-ab36-79dacd8893a9 on n-h1-860687-3 Oct 27 18:49:19.034935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a37b85c7-7bb0-4a10-b54b-9aa2ff8d4b27 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:19.036430 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-29d62de1-d396-4eb6-ab43-f02fc052f57c req-fee65d91-e655-4c5f-9e1a-94305246a95b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052565 Oct 27 18:49:19.037782 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 574/1117] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:19.048951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-285f2b26-3d97-4e36-8a81-41b44db36f97 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:19.049788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-285f2b26-3d97-4e36-8a81-41b44db36f97 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:19.059345 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a37b85c7-7bb0-4a10-b54b-9aa2ff8d4b27 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1282 microversion: 2.1 time: 0.175553 Oct 27 18:49:19.059949 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 544/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:18 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1282 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:19.075397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-285f2b26-3d97-4e36-8a81-41b44db36f97 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:19.076069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-285f2b26-3d97-4e36-8a81-41b44db36f97 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:19.076744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-07c13b2c-d1e0-429e-8463-3eb9a977e593 req-84fd4511-81a9-4aa5-983c-5234490e9599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873ced30-1179-4f52-9356-8e2f6c310959", "name": "network-vif-plugged", "status": "completed", "tag": "fc24a5e3-d26b-4205-b920-4db5d5e6467b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:19.076994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-285f2b26-3d97-4e36-8a81-41b44db36f97 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:19.077937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-285f2b26-3d97-4e36-8a81-41b44db36f97 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:19.079641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-285f2b26-3d97-4e36-8a81-41b44db36f97 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:19.080488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-285f2b26-3d97-4e36-8a81-41b44db36f97 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:19.109902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-07c13b2c-d1e0-429e-8463-3eb9a977e593 req-84fd4511-81a9-4aa5-983c-5234490e9599 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:19.110422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-07c13b2c-d1e0-429e-8463-3eb9a977e593 req-84fd4511-81a9-4aa5-983c-5234490e9599 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:19.116020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-07c13b2c-d1e0-429e-8463-3eb9a977e593 req-84fd4511-81a9-4aa5-983c-5234490e9599 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:19.143502 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-07c13b2c-d1e0-429e-8463-3eb9a977e593 req-84fd4511-81a9-4aa5-983c-5234490e9599 service nova] Creating event network-vif-plugged:fc24a5e3-d26b-4205-b920-4db5d5e6467b for instance 873ced30-1179-4f52-9356-8e2f6c310959 on n-h2-860687-3 Oct 27 18:49:19.149648 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-07c13b2c-d1e0-429e-8463-3eb9a977e593 req-84fd4511-81a9-4aa5-983c-5234490e9599 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084790 Oct 27 18:49:19.152266 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 545/1119] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:19.158732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f33f684-81bf-4da1-821e-4254fa63fc5a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:19.160612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6f33f684-81bf-4da1-821e-4254fa63fc5a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:19.170627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f33f684-81bf-4da1-821e-4254fa63fc5a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:19.171417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f33f684-81bf-4da1-821e-4254fa63fc5a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:19.172800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f33f684-81bf-4da1-821e-4254fa63fc5a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:19.174423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f33f684-81bf-4da1-821e-4254fa63fc5a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:19.190720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f33f684-81bf-4da1-821e-4254fa63fc5a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:19.191576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f33f684-81bf-4da1-821e-4254fa63fc5a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:19.944851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6f33f684-81bf-4da1-821e-4254fa63fc5a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:19.953735 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6f33f684-81bf-4da1-821e-4254fa63fc5a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 200 len: 1322 microversion: 2.1 time: 0.799857 Oct 27 18:49:19.954697 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 546/1120] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:19 2022] GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 1322 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:20.002465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-560514fb-4840-496f-b840-034c45673c55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:20.003206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-560514fb-4840-496f-b840-034c45673c55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:20.014949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-560514fb-4840-496f-b840-034c45673c55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:20.015691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-560514fb-4840-496f-b840-034c45673c55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:20.016246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-560514fb-4840-496f-b840-034c45673c55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:20.017058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-560514fb-4840-496f-b840-034c45673c55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:20.017579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-560514fb-4840-496f-b840-034c45673c55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:20.018078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-560514fb-4840-496f-b840-034c45673c55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:20.150035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:20.153702 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-285f2b26-3d97-4e36-8a81-41b44db36f97 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 1.110360 Oct 27 18:49:20.154996 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 575/1121] 10.222.0.42 () {58 vars in 1293 bytes} [Thu Oct 27 18:49:19 2022] GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9/os-security-groups => generated 1156 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:20.162019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c72e2486-44a3-483b-9d33-f313ffe4d871 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:20.162974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c72e2486-44a3-483b-9d33-f313ffe4d871 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:20.180304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c72e2486-44a3-483b-9d33-f313ffe4d871 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:20.180978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c72e2486-44a3-483b-9d33-f313ffe4d871 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:20.181984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c72e2486-44a3-483b-9d33-f313ffe4d871 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:20.183213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c72e2486-44a3-483b-9d33-f313ffe4d871 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:20.183842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c72e2486-44a3-483b-9d33-f313ffe4d871 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:20.184444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c72e2486-44a3-483b-9d33-f313ffe4d871 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:20.331323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-560514fb-4840-496f-b840-034c45673c55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:20.343753 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-560514fb-4840-496f-b840-034c45673c55 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1379 microversion: 2.1 time: 0.346206 Oct 27 18:49:20.344557 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 547/1122] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:19 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1379 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:20.357335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fff877d5-23b1-4bbe-8bc5-203becaa0b27 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'create', calling method: .version_select at 0x7fc86b3c78b0>, body: {"security_group": {"name": " tempest-securitygroup -1387154370 ", "description": "tempest-description-349067905"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:20.636316 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fff877d5-23b1-4bbe-8bc5-203becaa0b27 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.290357 Oct 27 18:49:20.638185 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 548/1123] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:49:20 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:20.652239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b61dd355-f493-4f5b-bcf1-ffab60bff044 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86aeee820>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:20.706981 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b61dd355-f493-4f5b-bcf1-ffab60bff044 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/c7450720-f9b2-42ff-a356-27bc81cfbd0a" status: 200 len: 223 microversion: 2.1 time: 0.059316 Oct 27 18:49:20.707676 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 549/1124] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 18:49:20 2022] GET /compute/v2.1/os-security-groups/c7450720-f9b2-42ff-a356-27bc81cfbd0a => generated 223 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:20.722224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dbf0eaac-a7ca-46ba-a953-de756ee7b622 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86aef8ee0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:20.826131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c72e2486-44a3-483b-9d33-f313ffe4d871 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:20.835272 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c72e2486-44a3-483b-9d33-f313ffe4d871 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1324 microversion: 2.1 time: 0.678927 Oct 27 18:49:20.836367 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 576/1125] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:20 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1324 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:20.841758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d08e9a87-06f0-49fd-a07a-e935cc9726fe tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:20.843202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d08e9a87-06f0-49fd-a07a-e935cc9726fe tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:20.849761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d08e9a87-06f0-49fd-a07a-e935cc9726fe tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:20.850576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d08e9a87-06f0-49fd-a07a-e935cc9726fe tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:20.851243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d08e9a87-06f0-49fd-a07a-e935cc9726fe tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:20.852272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d08e9a87-06f0-49fd-a07a-e935cc9726fe tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:20.852954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d08e9a87-06f0-49fd-a07a-e935cc9726fe tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:20.854235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d08e9a87-06f0-49fd-a07a-e935cc9726fe tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:20.941313 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dbf0eaac-a7ca-46ba-a953-de756ee7b622 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/c7450720-f9b2-42ff-a356-27bc81cfbd0a" status: 202 len: 0 microversion: 2.1 time: 0.223456 Oct 27 18:49:20.942773 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 550/1126] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:20 2022] DELETE /compute/v2.1/os-security-groups/c7450720-f9b2-42ff-a356-27bc81cfbd0a => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:20.952190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b454d49-e64c-4ac7-b945-bf31cedfd841 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86aef8b80>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:20.985089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-1b454d49-e64c-4ac7-b945-bf31cedfd841 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:49:20.985988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.security_group_api [None req-1b454d49-e64c-4ac7-b945-bf31cedfd841 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Neutron security group c7450720-f9b2-42ff-a356-27bc81cfbd0a not found {{(pid=127029) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:49:20.987425 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-1b454d49-e64c-4ac7-b945-bf31cedfd841 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist Oct 27 18:49:20.987425 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-4054a952-2668-49dd-a1fc-43c4961251bd'] Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b454d49-e64c-4ac7-b945-bf31cedfd841 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-security-groups/c7450720-f9b2-42ff-a356-27bc81cfbd0a HTTP/1.1 Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: exception: Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-4054a952-2668-49dd-a1fc-43c4961251bd'] Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'c7450720-f9b2-42ff-a356-27bc81cfbd0a'} Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:49:20.999123 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4054a952-2668-49dd-a1fc-43c4961251bd'] Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4054a952-2668-49dd-a1fc-43c4961251bd'] Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4054a952-2668-49dd-a1fc-43c4961251bd'] Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4054a952-2668-49dd-a1fc-43c4961251bd'] Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b454d49-e64c-4ac7-b945-bf31cedfd841 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 404 to user: Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-4054a952-2668-49dd-a1fc-43c4961251bd'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1b454d49-e64c-4ac7-b945-bf31cedfd841 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/c7450720-f9b2-42ff-a356-27bc81cfbd0a" status: 404 len: 194 microversion: 2.1 time: 0.054031 Oct 27 18:49:21.004347 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 551/1127] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 18:49:20 2022] GET /compute/v2.1/os-security-groups/c7450720-f9b2-42ff-a356-27bc81cfbd0a => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:49:21.013006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dcea2404-c9a4-48db-8ad0-715519526745 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:21.013961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dcea2404-c9a4-48db-8ad0-715519526745 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:21.021781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcea2404-c9a4-48db-8ad0-715519526745 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:21.022298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcea2404-c9a4-48db-8ad0-715519526745 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:21.023211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcea2404-c9a4-48db-8ad0-715519526745 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:21.025212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcea2404-c9a4-48db-8ad0-715519526745 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:21.026408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcea2404-c9a4-48db-8ad0-715519526745 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:21.027156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcea2404-c9a4-48db-8ad0-715519526745 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:21.255319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dcea2404-c9a4-48db-8ad0-715519526745 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:21.259370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:21.274463 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dcea2404-c9a4-48db-8ad0-715519526745 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 200 len: 1322 microversion: 2.1 time: 0.270831 Oct 27 18:49:21.283774 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 552/1128] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:21 2022] GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:21.300011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-62912380-d8c7-43de-ac28-a671699c0cd9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'create', calling method: .version_select at 0x7fc86aef83a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2120867613", "description": "tempest-description-1857302162"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:21.454595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-d08e9a87-06f0-49fd-a07a-e935cc9726fe tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 26d5439d-efc3-4e29-a439-7b8b40177342 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:49:21.480950 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d08e9a87-06f0-49fd-a07a-e935cc9726fe tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 2340 microversion: 2.25 time: 0.643181 Oct 27 18:49:21.490845 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 577/1129] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:49:20 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 2340 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:49:21.499502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ba3e9dde-7cf6-47d7-8097-374c1155083d req-d5c82a39-fb2c-4663-be33-e3b4400a4ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc7b6449-5aab-4b34-ab36-79dacd8893a9", "tag": "5264c280-364d-4964-af91-6ca4d4a1758a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:21.542168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ba3e9dde-7cf6-47d7-8097-374c1155083d req-d5c82a39-fb2c-4663-be33-e3b4400a4ad1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:21.544500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ba3e9dde-7cf6-47d7-8097-374c1155083d req-d5c82a39-fb2c-4663-be33-e3b4400a4ad1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:21.545148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ba3e9dde-7cf6-47d7-8097-374c1155083d req-d5c82a39-fb2c-4663-be33-e3b4400a4ad1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:21.560300 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ba3e9dde-7cf6-47d7-8097-374c1155083d req-d5c82a39-fb2c-4663-be33-e3b4400a4ad1 service nova] Creating event network-changed:5264c280-364d-4964-af91-6ca4d4a1758a for instance bc7b6449-5aab-4b34-ab36-79dacd8893a9 on n-h1-860687-3 Oct 27 18:49:21.565879 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ba3e9dde-7cf6-47d7-8097-374c1155083d req-d5c82a39-fb2c-4663-be33-e3b4400a4ad1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072748 Oct 27 18:49:21.566806 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 578/1130] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:21.572003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-5931296c-f14a-40a7-9c91-6cc8fd381363 req-3f1b0633-fefc-4d4d-b85b-4b62961d32bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4bfb98b-fb9e-4935-88a6-584dbc8b63c1", "tag": "734cc691-defa-4e54-ae96-4dfa0f7cccb6"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:21.586308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5931296c-f14a-40a7-9c91-6cc8fd381363 req-3f1b0633-fefc-4d4d-b85b-4b62961d32bc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:21.586749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5931296c-f14a-40a7-9c91-6cc8fd381363 req-3f1b0633-fefc-4d4d-b85b-4b62961d32bc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:21.587388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5931296c-f14a-40a7-9c91-6cc8fd381363 req-3f1b0633-fefc-4d4d-b85b-4b62961d32bc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:21.608469 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5931296c-f14a-40a7-9c91-6cc8fd381363 req-3f1b0633-fefc-4d4d-b85b-4b62961d32bc service nova] Creating event network-changed:734cc691-defa-4e54-ae96-4dfa0f7cccb6 for instance a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 on n-h1-860687-3 Oct 27 18:49:21.614701 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-5931296c-f14a-40a7-9c91-6cc8fd381363 req-3f1b0633-fefc-4d4d-b85b-4b62961d32bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046248 Oct 27 18:49:21.615832 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 579/1131] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:21.623081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f969fd7d-bfc3-43b1-9019-a0114f03dcb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:21.624144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f969fd7d-bfc3-43b1-9019-a0114f03dcb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:21.631976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f969fd7d-bfc3-43b1-9019-a0114f03dcb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:21.632944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f969fd7d-bfc3-43b1-9019-a0114f03dcb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:21.633644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f969fd7d-bfc3-43b1-9019-a0114f03dcb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:21.635340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f969fd7d-bfc3-43b1-9019-a0114f03dcb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:21.636381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f969fd7d-bfc3-43b1-9019-a0114f03dcb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:21.637088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f969fd7d-bfc3-43b1-9019-a0114f03dcb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:21.669675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:21.719570 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-62912380-d8c7-43de-ac28-a671699c0cd9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.434208 Oct 27 18:49:21.731972 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 553/1132] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:49:21 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:21.738634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-71da2ee1-74b4-444b-85ed-e11d81661ae4 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:21.745532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71da2ee1-74b4-444b-85ed-e11d81661ae4 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:21.746499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71da2ee1-74b4-444b-85ed-e11d81661ae4 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:21.747476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71da2ee1-74b4-444b-85ed-e11d81661ae4 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:21.749536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71da2ee1-74b4-444b-85ed-e11d81661ae4 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:21.750620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71da2ee1-74b4-444b-85ed-e11d81661ae4 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:21.751437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71da2ee1-74b4-444b-85ed-e11d81661ae4 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:21.804865 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-71da2ee1-74b4-444b-85ed-e11d81661ae4 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.070653 Oct 27 18:49:21.813088 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 554/1133] 10.222.0.42 () {60 vars in 1217 bytes} [Thu Oct 27 18:49:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:49:21.819560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-33b33901-7700-421d-b16f-5d200028d79b req-54d1e157-0a6e-4736-975c-67225290332f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd25663-2c8a-4c1f-b5e3-231e38afed4c", "name": "network-vif-plugged", "status": "completed", "tag": "0cc38cfe-0045-4c12-a338-86776d8cd938"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:21.831805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-33b33901-7700-421d-b16f-5d200028d79b req-54d1e157-0a6e-4736-975c-67225290332f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:21.832800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-33b33901-7700-421d-b16f-5d200028d79b req-54d1e157-0a6e-4736-975c-67225290332f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:21.833444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-33b33901-7700-421d-b16f-5d200028d79b req-54d1e157-0a6e-4736-975c-67225290332f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:21.849601 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-33b33901-7700-421d-b16f-5d200028d79b req-54d1e157-0a6e-4736-975c-67225290332f service nova] Creating event network-vif-plugged:0cc38cfe-0045-4c12-a338-86776d8cd938 for instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c on n-h1-860687-3 Oct 27 18:49:21.857382 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-33b33901-7700-421d-b16f-5d200028d79b req-54d1e157-0a6e-4736-975c-67225290332f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041757 Oct 27 18:49:21.858892 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 555/1134] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:21.865997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-03575469-ffd3-44dc-8bbd-5b4183d53a3b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'create', calling method: .version_select at 0x7fc86af910d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1176848437", "description": "tempest-description-844922613"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:21.913112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=14 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:22.222670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f969fd7d-bfc3-43b1-9019-a0114f03dcb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:22.236302 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f969fd7d-bfc3-43b1-9019-a0114f03dcb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1528 microversion: 2.1 time: 0.618848 Oct 27 18:49:22.251532 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 580/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:21 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1528 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:22.262339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4151b773-0b15-43d7-97e0-d07632511be1 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:22.263296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4151b773-0b15-43d7-97e0-d07632511be1 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:22.269590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4151b773-0b15-43d7-97e0-d07632511be1 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:22.270374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4151b773-0b15-43d7-97e0-d07632511be1 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:22.270993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4151b773-0b15-43d7-97e0-d07632511be1 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:22.271872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4151b773-0b15-43d7-97e0-d07632511be1 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:22.272557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4151b773-0b15-43d7-97e0-d07632511be1 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:22.273187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4151b773-0b15-43d7-97e0-d07632511be1 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:22.738733 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-03575469-ffd3-44dc-8bbd-5b4183d53a3b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.878137 Oct 27 18:49:22.739322 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 556/1136] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:49:21 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:22.749836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-33eccdd2-0d72-4cb3-91bd-adfcb7603ae1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:22.753488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-33eccdd2-0d72-4cb3-91bd-adfcb7603ae1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:22.769952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33eccdd2-0d72-4cb3-91bd-adfcb7603ae1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:22.770502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33eccdd2-0d72-4cb3-91bd-adfcb7603ae1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:22.770952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33eccdd2-0d72-4cb3-91bd-adfcb7603ae1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:22.771735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33eccdd2-0d72-4cb3-91bd-adfcb7603ae1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:22.773000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33eccdd2-0d72-4cb3-91bd-adfcb7603ae1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:22.774101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33eccdd2-0d72-4cb3-91bd-adfcb7603ae1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:23.144833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-33eccdd2-0d72-4cb3-91bd-adfcb7603ae1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:23.155512 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-33eccdd2-0d72-4cb3-91bd-adfcb7603ae1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1528 microversion: 2.1 time: 0.413035 Oct 27 18:49:23.160259 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 557/1137] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:22 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1528 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:23.172813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5037c6d4-2ff3-465b-880f-c455a34a4918 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:23.173752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5037c6d4-2ff3-465b-880f-c455a34a4918 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:23.187637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5037c6d4-2ff3-465b-880f-c455a34a4918 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:23.188791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5037c6d4-2ff3-465b-880f-c455a34a4918 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:23.191022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5037c6d4-2ff3-465b-880f-c455a34a4918 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:23.191960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5037c6d4-2ff3-465b-880f-c455a34a4918 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:23.194356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5037c6d4-2ff3-465b-880f-c455a34a4918 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:23.194981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5037c6d4-2ff3-465b-880f-c455a34a4918 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:23.232101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4151b773-0b15-43d7-97e0-d07632511be1 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:23.243289 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4151b773-0b15-43d7-97e0-d07632511be1 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1324 microversion: 2.1 time: 0.988221 Oct 27 18:49:23.266710 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 581/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:22 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1324 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:23.273252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-426ef930-1903-411c-8b58-e1c657000a5e tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'create', calling method: .version_select at 0x7fc86ae34f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1251815962", "description": "tempest-description-381595305"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:23.356274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=79 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:24.097155 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-426ef930-1903-411c-8b58-e1c657000a5e tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.825763 Oct 27 18:49:24.098764 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 582/1139] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:49:23 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:24.106231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ed296a7b-e7f4-4095-9a2f-d54878dbdee7 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:24.238202 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ed296a7b-e7f4-4095-9a2f-d54878dbdee7 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/4bffb839-ba43-4979-986c-23093713dafb" status: 202 len: 0 microversion: 2.1 time: 0.134964 Oct 27 18:49:24.243214 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 583/1140] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:49:24 2022] DELETE /compute/v2.1/flavors/4bffb839-ba43-4979-986c-23093713dafb => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:24.256134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c5e6cfac-218f-4576-ac27-0e5360ae44e9 req-350161d5-6775-4f1c-967b-3c69e9dcd660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d2d6e6-9f89-45ca-8353-d0d549e82086", "tag": "aaab970e-7faa-44e8-8d77-661cb812f9b6"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:24.299477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c5e6cfac-218f-4576-ac27-0e5360ae44e9 req-350161d5-6775-4f1c-967b-3c69e9dcd660 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:24.300471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c5e6cfac-218f-4576-ac27-0e5360ae44e9 req-350161d5-6775-4f1c-967b-3c69e9dcd660 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:24.301264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c5e6cfac-218f-4576-ac27-0e5360ae44e9 req-350161d5-6775-4f1c-967b-3c69e9dcd660 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:24.334903 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c5e6cfac-218f-4576-ac27-0e5360ae44e9 req-350161d5-6775-4f1c-967b-3c69e9dcd660 service nova] Creating event network-changed:aaab970e-7faa-44e8-8d77-661cb812f9b6 for instance 09d2d6e6-9f89-45ca-8353-d0d549e82086 on n-h2-860687-3 Oct 27 18:49:24.347780 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c5e6cfac-218f-4576-ac27-0e5360ae44e9 req-350161d5-6775-4f1c-967b-3c69e9dcd660 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101955 Oct 27 18:49:24.348915 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 584/1141] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:24.357251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8f9880a9-7e94-4394-b744-5825985a4dc4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86ad8fdc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:24.472293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5037c6d4-2ff3-465b-880f-c455a34a4918 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:24.505029 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5037c6d4-2ff3-465b-880f-c455a34a4918 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 200 len: 1322 microversion: 2.1 time: 1.343345 Oct 27 18:49:24.505591 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 558/1142] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:23 2022] GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 1322 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:24.540809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-618d8a6f-7927-432b-bcfc-2d278cd8bcb6 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:24.573637 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-618d8a6f-7927-432b-bcfc-2d278cd8bcb6 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043210 Oct 27 18:49:24.574800 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 559/1143] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:49:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:24.581200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b571e43c-9a5c-407b-93bb-9ce4b7bffa29 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:24.582330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b571e43c-9a5c-407b-93bb-9ce4b7bffa29 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:24.591650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b571e43c-9a5c-407b-93bb-9ce4b7bffa29 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:24.592622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b571e43c-9a5c-407b-93bb-9ce4b7bffa29 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:24.593681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b571e43c-9a5c-407b-93bb-9ce4b7bffa29 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:24.594710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b571e43c-9a5c-407b-93bb-9ce4b7bffa29 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:24.595445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b571e43c-9a5c-407b-93bb-9ce4b7bffa29 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:24.596377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b571e43c-9a5c-407b-93bb-9ce4b7bffa29 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:25.133504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b571e43c-9a5c-407b-93bb-9ce4b7bffa29 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:25.150052 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b571e43c-9a5c-407b-93bb-9ce4b7bffa29 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1324 microversion: 2.1 time: 0.573881 Oct 27 18:49:25.152665 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 560/1144] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:24 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1324 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:25.159070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:25.162092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:25.171364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:25.172564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:25.173612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:25.174725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:25.176552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:25.177586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:25.435602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:25.443378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Old instance type tempest-test_resize_flavor_-1762637886, new instance type m1.heat {{(pid=127029) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 18:49:25.472933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:49:25.472933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:49:25.477785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:49:25.479611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:49:25.480060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:49:25.768106 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4149b95a-3e52-4b28-bb8b-b9254f6db943 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "POST /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959/action" status: 202 len: 0 microversion: 2.1 time: 0.614028 Oct 27 18:49:25.772933 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 561/1145] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:49:25 2022] POST /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:25.778720 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8f9880a9-7e94-4394-b744-5825985a4dc4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 1.428227 Oct 27 18:49:25.780057 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 585/1146] 10.222.0.42 () {58 vars in 1158 bytes} [Thu Oct 27 18:49:24 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:25.793847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-542210dd-9c8e-4ce5-9c14-029374ecf94d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:25.802770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-542210dd-9c8e-4ce5-9c14-029374ecf94d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:25.807597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-32fbcb86-649e-4b54-ad51-e767efa31cf9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ade13784-8206-4012-8f70-d37dadeb7a86", "device": "/dev/xvdb"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:25.814872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-32fbcb86-649e-4b54-ad51-e767efa31cf9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:25.824121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-542210dd-9c8e-4ce5-9c14-029374ecf94d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:25.825035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-542210dd-9c8e-4ce5-9c14-029374ecf94d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:25.826319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-542210dd-9c8e-4ce5-9c14-029374ecf94d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:25.827566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-542210dd-9c8e-4ce5-9c14-029374ecf94d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:25.828523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-542210dd-9c8e-4ce5-9c14-029374ecf94d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:25.829629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32fbcb86-649e-4b54-ad51-e767efa31cf9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:25.830136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32fbcb86-649e-4b54-ad51-e767efa31cf9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:25.830598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-542210dd-9c8e-4ce5-9c14-029374ecf94d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:25.834514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32fbcb86-649e-4b54-ad51-e767efa31cf9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:25.835347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32fbcb86-649e-4b54-ad51-e767efa31cf9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:25.835816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32fbcb86-649e-4b54-ad51-e767efa31cf9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:25.836274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32fbcb86-649e-4b54-ad51-e767efa31cf9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:25.873650 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-542210dd-9c8e-4ce5-9c14-029374ecf94d tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092361 Oct 27 18:49:25.875009 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 586/1147] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:49:25 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:25.880447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-65cbf301-e5c9-4133-a949-5f35879cbdb1 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:25.881911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-65cbf301-e5c9-4133-a949-5f35879cbdb1 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:25.889601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65cbf301-e5c9-4133-a949-5f35879cbdb1 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:25.890831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65cbf301-e5c9-4133-a949-5f35879cbdb1 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:25.892095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65cbf301-e5c9-4133-a949-5f35879cbdb1 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:25.893565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65cbf301-e5c9-4133-a949-5f35879cbdb1 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:25.894497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65cbf301-e5c9-4133-a949-5f35879cbdb1 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:25.895247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65cbf301-e5c9-4133-a949-5f35879cbdb1 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:26.371699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-65cbf301-e5c9-4133-a949-5f35879cbdb1 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:26.380506 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-65cbf301-e5c9-4133-a949-5f35879cbdb1 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 200 len: 1322 microversion: 2.1 time: 0.504141 Oct 27 18:49:26.381416 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 587/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:25 2022] GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 1322 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:26.394235 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-32fbcb86-649e-4b54-ad51-e767efa31cf9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "POST /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.620212 Oct 27 18:49:26.395149 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 562/1149] 10.222.0.42 () {62 vars in 1364 bytes} [Thu Oct 27 18:49:25 2022] POST /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments => generated 194 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:49:26.398286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-68640b2e-21db-4777-9dac-19f2124b1ec0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:26.398942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-68640b2e-21db-4777-9dac-19f2124b1ec0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:26.406173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-730c6201-7ef0-4da1-8318-d91e52ad79c7 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86adb3940>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:26.415372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68640b2e-21db-4777-9dac-19f2124b1ec0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:26.416421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68640b2e-21db-4777-9dac-19f2124b1ec0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:26.419496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68640b2e-21db-4777-9dac-19f2124b1ec0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:26.420411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68640b2e-21db-4777-9dac-19f2124b1ec0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:26.422375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68640b2e-21db-4777-9dac-19f2124b1ec0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:26.423033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68640b2e-21db-4777-9dac-19f2124b1ec0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:26.637862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-68640b2e-21db-4777-9dac-19f2124b1ec0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:26.657080 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-68640b2e-21db-4777-9dac-19f2124b1ec0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1537 microversion: 2.1 time: 0.274493 Oct 27 18:49:26.659441 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 588/1150] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:26 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1537 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:26.677109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2f053f84-2f20-47c8-bd84-d6c06dca59ab tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:26.677109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2f053f84-2f20-47c8-bd84-d6c06dca59ab tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:26.691841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f053f84-2f20-47c8-bd84-d6c06dca59ab tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:26.692486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f053f84-2f20-47c8-bd84-d6c06dca59ab tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:26.693034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f053f84-2f20-47c8-bd84-d6c06dca59ab tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:26.693857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f053f84-2f20-47c8-bd84-d6c06dca59ab tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:26.694448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f053f84-2f20-47c8-bd84-d6c06dca59ab tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:26.695003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f053f84-2f20-47c8-bd84-d6c06dca59ab tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:26.880953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-2f053f84-2f20-47c8-bd84-d6c06dca59ab tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lazy-loading 'services' on Instance uuid 52680d12-70da-485a-b4a1-172a49b7b959 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:49:27.059137 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2f053f84-2f20-47c8-bd84-d6c06dca59ab tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "DELETE /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959/os-volume_attachments/2740add1-bb8b-4738-89af-00e133b143a5" status: 202 len: 0 microversion: 2.1 time: 0.397294 Oct 27 18:49:27.063369 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 589/1151] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 18:49:26 2022] DELETE /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959/os-volume_attachments/2740add1-bb8b-4738-89af-00e133b143a5 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:27.092710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9545e152-3260-4308-83cb-2659a5fa3fba tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:27.093446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9545e152-3260-4308-83cb-2659a5fa3fba tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:27.109175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9545e152-3260-4308-83cb-2659a5fa3fba tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:27.109525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9545e152-3260-4308-83cb-2659a5fa3fba tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:27.109976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9545e152-3260-4308-83cb-2659a5fa3fba tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:27.116876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9545e152-3260-4308-83cb-2659a5fa3fba tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:27.117712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9545e152-3260-4308-83cb-2659a5fa3fba tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:27.118163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9545e152-3260-4308-83cb-2659a5fa3fba tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:27.399205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9545e152-3260-4308-83cb-2659a5fa3fba tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:27.414998 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9545e152-3260-4308-83cb-2659a5fa3fba tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1324 microversion: 2.1 time: 0.349835 Oct 27 18:49:27.415590 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 590/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:27 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1324 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:27.420756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c1350072-908a-4c0a-b3f2-0bc00c622a71 req-8268077f-78b9-47b5-90c3-ddf938f273ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "544f4ef4-fdfc-4e55-a247-7c210300d932", "tag": "50d7433e-4e6d-4e9a-9b35-21b455c67c5e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:27.444345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c1350072-908a-4c0a-b3f2-0bc00c622a71 req-8268077f-78b9-47b5-90c3-ddf938f273ce service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:27.445791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c1350072-908a-4c0a-b3f2-0bc00c622a71 req-8268077f-78b9-47b5-90c3-ddf938f273ce service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:27.447944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c1350072-908a-4c0a-b3f2-0bc00c622a71 req-8268077f-78b9-47b5-90c3-ddf938f273ce service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:27.476160 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c1350072-908a-4c0a-b3f2-0bc00c622a71 req-8268077f-78b9-47b5-90c3-ddf938f273ce service nova] Creating event network-changed:50d7433e-4e6d-4e9a-9b35-21b455c67c5e for instance 544f4ef4-fdfc-4e55-a247-7c210300d932 on n-h2-860687-3 Oct 27 18:49:27.482891 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c1350072-908a-4c0a-b3f2-0bc00c622a71 req-8268077f-78b9-47b5-90c3-ddf938f273ce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065739 Oct 27 18:49:27.484062 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 591/1153] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:27.489218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-412f387a-5eba-41d1-9ae0-100d4db5b4e4 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:27.490168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-412f387a-5eba-41d1-9ae0-100d4db5b4e4 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:27.508352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-412f387a-5eba-41d1-9ae0-100d4db5b4e4 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:27.508914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-412f387a-5eba-41d1-9ae0-100d4db5b4e4 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:27.509364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-412f387a-5eba-41d1-9ae0-100d4db5b4e4 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:27.510454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-412f387a-5eba-41d1-9ae0-100d4db5b4e4 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:27.513103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-412f387a-5eba-41d1-9ae0-100d4db5b4e4 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:27.513568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-412f387a-5eba-41d1-9ae0-100d4db5b4e4 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:27.745887 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-730c6201-7ef0-4da1-8318-d91e52ad79c7 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b" status: 202 len: 0 microversion: 2.1 time: 1.345646 Oct 27 18:49:27.747605 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 563/1154] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:26 2022] DELETE /compute/v2.1/os-security-groups/a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b => generated 0 bytes in 1352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:27.754234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fe428d7f-4b83-4156-97c9-3326cbed766a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:27.754869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fe428d7f-4b83-4156-97c9-3326cbed766a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:27.767742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe428d7f-4b83-4156-97c9-3326cbed766a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:27.768353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe428d7f-4b83-4156-97c9-3326cbed766a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:27.768798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe428d7f-4b83-4156-97c9-3326cbed766a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:27.769569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe428d7f-4b83-4156-97c9-3326cbed766a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:27.770175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe428d7f-4b83-4156-97c9-3326cbed766a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:27.770862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe428d7f-4b83-4156-97c9-3326cbed766a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:27.772421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-412f387a-5eba-41d1-9ae0-100d4db5b4e4 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:27.790156 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-412f387a-5eba-41d1-9ae0-100d4db5b4e4 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 200 len: 1322 microversion: 2.1 time: 0.302257 Oct 27 18:49:27.792471 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 592/1155] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:27 2022] GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:27.796797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:27.824070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b1f5804f-22e8-4f6a-99bb-1b91274cc448 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86ba62f70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:27.865102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG neutronclient.v2_0.client [None req-b1f5804f-22e8-4f6a-99bb-1b91274cc448 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist", "detail": ""}} {{(pid=127028) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:49:27.866582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.security_group_api [None req-b1f5804f-22e8-4f6a-99bb-1b91274cc448 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Neutron security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b not found {{(pid=127028) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:49:27.867481 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-b1f5804f-22e8-4f6a-99bb-1b91274cc448 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist Oct 27 18:49:27.867481 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-d939a5df-9d7c-4476-8cab-efce1fe8ce18'] Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b1f5804f-22e8-4f6a-99bb-1b91274cc448 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-security-groups/a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b HTTP/1.1 Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: exception: Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-d939a5df-9d7c-4476-8cab-efce1fe8ce18'] Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b'} Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:49:27.876562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d939a5df-9d7c-4476-8cab-efce1fe8ce18'] Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d939a5df-9d7c-4476-8cab-efce1fe8ce18'] Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d939a5df-9d7c-4476-8cab-efce1fe8ce18'] Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d939a5df-9d7c-4476-8cab-efce1fe8ce18'] Oct 27 18:49:27.880577 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:27.885405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b1f5804f-22e8-4f6a-99bb-1b91274cc448 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 404 to user: Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist Oct 27 18:49:27.885405 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-d939a5df-9d7c-4476-8cab-efce1fe8ce18'] {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:27.886292 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b1f5804f-22e8-4f6a-99bb-1b91274cc448 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b" status: 404 len: 194 microversion: 2.1 time: 0.076457 Oct 27 18:49:27.887079 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 593/1156] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 18:49:27 2022] GET /compute/v2.1/os-security-groups/a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:49:27.913379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1c4cd39d-8212-40af-b483-32ba145fc7f3 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86ae16af0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:28.213388 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1c4cd39d-8212-40af-b483-32ba145fc7f3 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/e900be8b-8055-49bc-afea-c3b7c32ea694" status: 202 len: 0 microversion: 2.1 time: 0.321100 Oct 27 18:49:28.214234 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 594/1157] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:27 2022] DELETE /compute/v2.1/os-security-groups/e900be8b-8055-49bc-afea-c3b7c32ea694 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 18:49:28.225358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-32139413-88e6-4205-ab6e-b9ad31cf0616 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86ae16670>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:28.265227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG neutronclient.v2_0.client [None req-32139413-88e6-4205-ab6e-b9ad31cf0616 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist", "detail": ""}} {{(pid=127028) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:49:28.265860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.security_group_api [None req-32139413-88e6-4205-ab6e-b9ad31cf0616 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Neutron security group e900be8b-8055-49bc-afea-c3b7c32ea694 not found {{(pid=127028) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:49:28.266427 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-32139413-88e6-4205-ab6e-b9ad31cf0616 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist Oct 27 18:49:28.266427 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-fb73d7f0-8847-40d3-85eb-0231c7cf166c'] Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-32139413-88e6-4205-ab6e-b9ad31cf0616 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-security-groups/e900be8b-8055-49bc-afea-c3b7c32ea694 HTTP/1.1 Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: exception: Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-fb73d7f0-8847-40d3-85eb-0231c7cf166c'] Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'e900be8b-8055-49bc-afea-c3b7c32ea694'} Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:49:28.268348 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb73d7f0-8847-40d3-85eb-0231c7cf166c'] Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb73d7f0-8847-40d3-85eb-0231c7cf166c'] Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb73d7f0-8847-40d3-85eb-0231c7cf166c'] Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb73d7f0-8847-40d3-85eb-0231c7cf166c'] Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-32139413-88e6-4205-ab6e-b9ad31cf0616 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 404 to user: Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-fb73d7f0-8847-40d3-85eb-0231c7cf166c'] {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:28.272134 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-32139413-88e6-4205-ab6e-b9ad31cf0616 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/e900be8b-8055-49bc-afea-c3b7c32ea694" status: 404 len: 194 microversion: 2.1 time: 0.051852 Oct 27 18:49:28.275986 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 595/1158] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 18:49:28 2022] GET /compute/v2.1/os-security-groups/e900be8b-8055-49bc-afea-c3b7c32ea694 => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:49:28.282157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-efc31597-2954-4080-91a0-f3e3d8a545e7 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86ad754c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:28.575338 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-efc31597-2954-4080-91a0-f3e3d8a545e7 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/3e552394-1166-4e09-9049-7cb585eeaf8b" status: 202 len: 0 microversion: 2.1 time: 0.297643 Oct 27 18:49:28.576687 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 596/1159] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:28 2022] DELETE /compute/v2.1/os-security-groups/3e552394-1166-4e09-9049-7cb585eeaf8b => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:28.590455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1a96904f-e85a-49a7-b183-6b63c2f49c19 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:28.591251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1a96904f-e85a-49a7-b183-6b63c2f49c19 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:28.604047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fe428d7f-4b83-4156-97c9-3326cbed766a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:28.607218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a96904f-e85a-49a7-b183-6b63c2f49c19 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:28.609201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a96904f-e85a-49a7-b183-6b63c2f49c19 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:28.609831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a96904f-e85a-49a7-b183-6b63c2f49c19 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:28.612418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a96904f-e85a-49a7-b183-6b63c2f49c19 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:28.613226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a96904f-e85a-49a7-b183-6b63c2f49c19 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:28.613836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a96904f-e85a-49a7-b183-6b63c2f49c19 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:28.617694 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fe428d7f-4b83-4156-97c9-3326cbed766a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1537 microversion: 2.1 time: 0.868676 Oct 27 18:49:28.618660 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 564/1160] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:27 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1537 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:28.623854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-33b1bf7f-86b6-4da7-a1a6-c5f0a4d019d1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86adb3b80>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:28.716875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-33b1bf7f-86b6-4da7-a1a6-c5f0a4d019d1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:49:28.719787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.security_group_api [None req-33b1bf7f-86b6-4da7-a1a6-c5f0a4d019d1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Neutron security group 3e552394-1166-4e09-9049-7cb585eeaf8b not found {{(pid=127029) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:49:28.721888 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-33b1bf7f-86b6-4da7-a1a6-c5f0a4d019d1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist Oct 27 18:49:28.721888 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-4244145b-e0c8-41c5-a676-a8f39e7f0a16'] Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-33b1bf7f-86b6-4da7-a1a6-c5f0a4d019d1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-security-groups/3e552394-1166-4e09-9049-7cb585eeaf8b HTTP/1.1 Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: exception: Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-4244145b-e0c8-41c5-a676-a8f39e7f0a16'] Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '3e552394-1166-4e09-9049-7cb585eeaf8b'} Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:49:28.724405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4244145b-e0c8-41c5-a676-a8f39e7f0a16'] Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4244145b-e0c8-41c5-a676-a8f39e7f0a16'] Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4244145b-e0c8-41c5-a676-a8f39e7f0a16'] Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4244145b-e0c8-41c5-a676-a8f39e7f0a16'] Oct 27 18:49:28.729087 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:28.736924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-33b1bf7f-86b6-4da7-a1a6-c5f0a4d019d1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 404 to user: Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist Oct 27 18:49:28.736924 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-4244145b-e0c8-41c5-a676-a8f39e7f0a16'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:28.738198 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-33b1bf7f-86b6-4da7-a1a6-c5f0a4d019d1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/3e552394-1166-4e09-9049-7cb585eeaf8b" status: 404 len: 194 microversion: 2.1 time: 0.118191 Oct 27 18:49:28.739527 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 565/1161] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 18:49:28 2022] GET /compute/v2.1/os-security-groups/3e552394-1166-4e09-9049-7cb585eeaf8b => generated 194 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:49:28.747369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7c194da8-36a8-4bb1-a6b4-f8a265e93dc4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86ad555e0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:29.042473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1a96904f-e85a-49a7-b183-6b63c2f49c19 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:29.063239 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1a96904f-e85a-49a7-b183-6b63c2f49c19 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1324 microversion: 2.1 time: 0.478081 Oct 27 18:49:29.064164 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 597/1162] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:28 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1324 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:29.068777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-727d0d5d-a3a0-4e5b-bfaa-57270768e411 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:29.069392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-727d0d5d-a3a0-4e5b-bfaa-57270768e411 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:29.082017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-727d0d5d-a3a0-4e5b-bfaa-57270768e411 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:29.082568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-727d0d5d-a3a0-4e5b-bfaa-57270768e411 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:29.083015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-727d0d5d-a3a0-4e5b-bfaa-57270768e411 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:29.083744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-727d0d5d-a3a0-4e5b-bfaa-57270768e411 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:29.084199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-727d0d5d-a3a0-4e5b-bfaa-57270768e411 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:29.084629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-727d0d5d-a3a0-4e5b-bfaa-57270768e411 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:29.290057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-727d0d5d-a3a0-4e5b-bfaa-57270768e411 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:29.300325 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-727d0d5d-a3a0-4e5b-bfaa-57270768e411 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 200 len: 1322 microversion: 2.1 time: 0.235092 Oct 27 18:49:29.301506 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 598/1163] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:29 2022] GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:29.501548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-4fd40a70-0005-4181-91b6-272cd0017e48 req-3c527126-174f-4a27-bb0a-4a1d9238063d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bfb98b-fb9e-4935-88a6-584dbc8b63c1", "name": "network-vif-plugged", "status": "completed", "tag": "734cc691-defa-4e54-ae96-4dfa0f7cccb6"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:29.515502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4fd40a70-0005-4181-91b6-272cd0017e48 req-3c527126-174f-4a27-bb0a-4a1d9238063d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:29.516645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4fd40a70-0005-4181-91b6-272cd0017e48 req-3c527126-174f-4a27-bb0a-4a1d9238063d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:29.517575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4fd40a70-0005-4181-91b6-272cd0017e48 req-3c527126-174f-4a27-bb0a-4a1d9238063d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:29.536395 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-4fd40a70-0005-4181-91b6-272cd0017e48 req-3c527126-174f-4a27-bb0a-4a1d9238063d service nova] Creating event network-vif-plugged:734cc691-defa-4e54-ae96-4dfa0f7cccb6 for instance a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 on n-h1-860687-3 Oct 27 18:49:29.544338 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-4fd40a70-0005-4181-91b6-272cd0017e48 req-3c527126-174f-4a27-bb0a-4a1d9238063d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047046 Oct 27 18:49:29.545841 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 599/1164] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:49:29.576160 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7c194da8-36a8-4bb1-a6b4-f8a265e93dc4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.831045 Oct 27 18:49:29.585751 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 566/1165] 10.222.0.42 () {58 vars in 1158 bytes} [Thu Oct 27 18:49:28 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:49:29.598991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-02379fb7-a985-43e8-b337-9d419871b942 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'create', calling method: .version_select at 0x7fc86ae38310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-972295710", "description": "tempest-description-71062603"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:29.647449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bc9601bc-d381-4fff-a6de-a893b3b51c35 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:29.648375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bc9601bc-d381-4fff-a6de-a893b3b51c35 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:29.659101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc9601bc-d381-4fff-a6de-a893b3b51c35 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:29.660993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc9601bc-d381-4fff-a6de-a893b3b51c35 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:29.662794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc9601bc-d381-4fff-a6de-a893b3b51c35 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:29.663767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc9601bc-d381-4fff-a6de-a893b3b51c35 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:29.667322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc9601bc-d381-4fff-a6de-a893b3b51c35 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:29.668016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc9601bc-d381-4fff-a6de-a893b3b51c35 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:29.828383 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-02379fb7-a985-43e8-b337-9d419871b942 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.241580 Oct 27 18:49:29.829328 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 600/1166] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:49:29 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:29.844265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d74c8718-986f-450d-9276-8bf5231c0059 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'create', calling method: .version_select at 0x7fc86ad28a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1594394263", "description": "tempest-description-1191328884"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:30.004207 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d74c8718-986f-450d-9276-8bf5231c0059 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.165628 Oct 27 18:49:30.014986 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 601/1167] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:49:29 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:30.032609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bc9601bc-d381-4fff-a6de-a893b3b51c35 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:30.044988 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bc9601bc-d381-4fff-a6de-a893b3b51c35 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1537 microversion: 2.1 time: 0.399525 Oct 27 18:49:30.044988 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 567/1168] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:29 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1537 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:49:30.086283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b7428c96-e11c-4295-94ef-41c10602492b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:30.087807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b7428c96-e11c-4295-94ef-41c10602492b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:30.121744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7428c96-e11c-4295-94ef-41c10602492b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:30.122154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7428c96-e11c-4295-94ef-41c10602492b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:30.127204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7428c96-e11c-4295-94ef-41c10602492b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:30.128474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7428c96-e11c-4295-94ef-41c10602492b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:30.128474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7428c96-e11c-4295-94ef-41c10602492b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:30.128879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7428c96-e11c-4295-94ef-41c10602492b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:30.161857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1417078486", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "693cb2fd-2856-4a35-bd58-7aabb4a7fece"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:30.253995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] validate_networks() for [('693cb2fd-2856-4a35-bd58-7aabb4a7fece', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:49:30.537995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b7428c96-e11c-4295-94ef-41c10602492b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:30.554016 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b7428c96-e11c-4295-94ef-41c10602492b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1324 microversion: 2.1 time: 0.472414 Oct 27 18:49:30.559212 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 602/1169] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:30 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:30.580738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-351be62d-44d9-4afd-9982-301ea41ca5bc tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:30.586178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-351be62d-44d9-4afd-9982-301ea41ca5bc tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:30.605313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-351be62d-44d9-4afd-9982-301ea41ca5bc tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:30.606543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-351be62d-44d9-4afd-9982-301ea41ca5bc tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:30.607236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-351be62d-44d9-4afd-9982-301ea41ca5bc tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:30.613474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-351be62d-44d9-4afd-9982-301ea41ca5bc tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:30.614243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-351be62d-44d9-4afd-9982-301ea41ca5bc tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:30.614914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-351be62d-44d9-4afd-9982-301ea41ca5bc tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:30.908725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-351be62d-44d9-4afd-9982-301ea41ca5bc tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:30.924521 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-351be62d-44d9-4afd-9982-301ea41ca5bc tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 200 len: 1322 microversion: 2.1 time: 0.363863 Oct 27 18:49:30.925792 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 603/1170] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:30 2022] GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:31.068371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-24ac1357-c34b-4354-8baa-943520390661 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:31.069321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-24ac1357-c34b-4354-8baa-943520390661 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:31.081010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24ac1357-c34b-4354-8baa-943520390661 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:31.083657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24ac1357-c34b-4354-8baa-943520390661 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:31.084297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24ac1357-c34b-4354-8baa-943520390661 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:31.090105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24ac1357-c34b-4354-8baa-943520390661 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:31.090737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24ac1357-c34b-4354-8baa-943520390661 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:31.091282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24ac1357-c34b-4354-8baa-943520390661 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:31.518654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-24ac1357-c34b-4354-8baa-943520390661 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:31.529139 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-24ac1357-c34b-4354-8baa-943520390661 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1537 microversion: 2.1 time: 0.465007 Oct 27 18:49:31.532470 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 604/1171] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:31 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1537 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:31.536506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:49:31.537503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:49:31.538256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:49:31.538883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:49:31.539469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:49:31.563259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:31.564569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:31.567623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:31.568713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:31.573325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:31.574276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:31.581984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-456f39a5-dce4-4991-b971-a123f47f81e8 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:31.586109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-456f39a5-dce4-4991-b971-a123f47f81e8 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:31.599729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-456f39a5-dce4-4991-b971-a123f47f81e8 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:31.600633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-456f39a5-dce4-4991-b971-a123f47f81e8 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:31.601328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-456f39a5-dce4-4991-b971-a123f47f81e8 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:31.602273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-456f39a5-dce4-4991-b971-a123f47f81e8 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:31.602994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-456f39a5-dce4-4991-b971-a123f47f81e8 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:31.604194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-456f39a5-dce4-4991-b971-a123f47f81e8 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:31.613189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Getting quotas for project 582be696729849069dc5b7d51598d2ed. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:49:31.618335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Getting quotas for user 2fb341748c5a45d5a36b398bc305feb3 and project 582be696729849069dc5b7d51598d2ed. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:49:31.632755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:49:31.642181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:49:31.796558 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1501abba-c7f8-48dd-af4d-9c45406cdc96 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.638462 Oct 27 18:49:31.806604 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 568/1172] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:49:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:49:31.820481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce040a72-a62c-4452-8cc5-efda1cbfb581 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:31.821472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ce040a72-a62c-4452-8cc5-efda1cbfb581 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:32.068436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ce040a72-a62c-4452-8cc5-efda1cbfb581 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:32.079792 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce040a72-a62c-4452-8cc5-efda1cbfb581 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1216 microversion: 2.1 time: 0.271351 Oct 27 18:49:32.102493 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 569/1173] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:31 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1216 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:32.108312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4dd5228c-0d9e-4325-900e-4dbd236295ff tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:32.116782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4dd5228c-0d9e-4325-900e-4dbd236295ff tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:32.129637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dd5228c-0d9e-4325-900e-4dbd236295ff tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:32.130318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dd5228c-0d9e-4325-900e-4dbd236295ff tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:32.130802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dd5228c-0d9e-4325-900e-4dbd236295ff tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:32.131520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dd5228c-0d9e-4325-900e-4dbd236295ff tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:32.131978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dd5228c-0d9e-4325-900e-4dbd236295ff tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:32.132407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dd5228c-0d9e-4325-900e-4dbd236295ff tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:32.562955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4dd5228c-0d9e-4325-900e-4dbd236295ff tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:32.575992 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4dd5228c-0d9e-4325-900e-4dbd236295ff tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 200 len: 1515 microversion: 2.1 time: 0.472269 Oct 27 18:49:32.591721 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 570/1174] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:32 2022] GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 1515 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:32.609402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-18dcab29-ee1e-441c-9d0f-ea13d06946d2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:32.614074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-18dcab29-ee1e-441c-9d0f-ea13d06946d2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:32.628045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18dcab29-ee1e-441c-9d0f-ea13d06946d2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:32.630649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18dcab29-ee1e-441c-9d0f-ea13d06946d2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:32.632300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18dcab29-ee1e-441c-9d0f-ea13d06946d2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:32.636410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18dcab29-ee1e-441c-9d0f-ea13d06946d2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:32.637162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18dcab29-ee1e-441c-9d0f-ea13d06946d2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:32.637777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18dcab29-ee1e-441c-9d0f-ea13d06946d2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:33.023686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-456f39a5-dce4-4991-b971-a123f47f81e8 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:33.042825 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-456f39a5-dce4-4991-b971-a123f47f81e8 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1324 microversion: 2.1 time: 1.464875 Oct 27 18:49:33.047955 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 605/1175] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:31 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1324 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:33.063965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d6ffb3b-17ae-4620-9528-ec4ff09361d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:33.067410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-18dcab29-ee1e-441c-9d0f-ea13d06946d2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:33.071602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d6ffb3b-17ae-4620-9528-ec4ff09361d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 09d2d6e6-9f89-45ca-8353-d0d549e82086] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:33.083903 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-18dcab29-ee1e-441c-9d0f-ea13d06946d2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1537 microversion: 2.1 time: 0.490733 Oct 27 18:49:33.087182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d6ffb3b-17ae-4620-9528-ec4ff09361d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:33.088891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d6ffb3b-17ae-4620-9528-ec4ff09361d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:33.091082 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 571/1176] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:32 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1537 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:33.100486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d6ffb3b-17ae-4620-9528-ec4ff09361d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:33.102360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d6ffb3b-17ae-4620-9528-ec4ff09361d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:33.105523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d8f2bbd7-2602-4467-a87c-d15be72a0ce5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:33.107081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d6ffb3b-17ae-4620-9528-ec4ff09361d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:33.107548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d6ffb3b-17ae-4620-9528-ec4ff09361d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:33.120035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d8f2bbd7-2602-4467-a87c-d15be72a0ce5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:33.188779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8f2bbd7-2602-4467-a87c-d15be72a0ce5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:33.190807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8f2bbd7-2602-4467-a87c-d15be72a0ce5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:33.191552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8f2bbd7-2602-4467-a87c-d15be72a0ce5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:33.194698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8f2bbd7-2602-4467-a87c-d15be72a0ce5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:33.195450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8f2bbd7-2602-4467-a87c-d15be72a0ce5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:33.196713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8f2bbd7-2602-4467-a87c-d15be72a0ce5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:33.676917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d8f2bbd7-2602-4467-a87c-d15be72a0ce5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:33.692708 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d8f2bbd7-2602-4467-a87c-d15be72a0ce5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1212 microversion: 2.1 time: 0.586705 Oct 27 18:49:33.693956 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 572/1177] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:33 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1212 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:49:34.072299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-931535d1-13b1-4d6e-af12-82cb91beece0 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:34.073146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-931535d1-13b1-4d6e-af12-82cb91beece0 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:34.085595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-931535d1-13b1-4d6e-af12-82cb91beece0 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:34.086803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-931535d1-13b1-4d6e-af12-82cb91beece0 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:34.093318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-931535d1-13b1-4d6e-af12-82cb91beece0 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:34.094420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-931535d1-13b1-4d6e-af12-82cb91beece0 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:34.095333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-931535d1-13b1-4d6e-af12-82cb91beece0 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:34.098862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-931535d1-13b1-4d6e-af12-82cb91beece0 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:34.173043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d6ffb3b-17ae-4620-9528-ec4ff09361d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:34.185678 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d6ffb3b-17ae-4620-9528-ec4ff09361d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086" status: 200 len: 1322 microversion: 2.1 time: 1.133040 Oct 27 18:49:34.187546 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 606/1178] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:33 2022] GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086 => generated 1322 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:34.207676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-15e2537f-223b-493f-98e5-71d2b50c6a86 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:34.225703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-15e2537f-223b-493f-98e5-71d2b50c6a86 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:34.239969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e2537f-223b-493f-98e5-71d2b50c6a86 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:34.251250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e2537f-223b-493f-98e5-71d2b50c6a86 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:34.252972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e2537f-223b-493f-98e5-71d2b50c6a86 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:34.259340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e2537f-223b-493f-98e5-71d2b50c6a86 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:34.261490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e2537f-223b-493f-98e5-71d2b50c6a86 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:34.263534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e2537f-223b-493f-98e5-71d2b50c6a86 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:34.320781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:34.620180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-931535d1-13b1-4d6e-af12-82cb91beece0 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:34.634259 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-931535d1-13b1-4d6e-af12-82cb91beece0 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1324 microversion: 2.1 time: 0.565455 Oct 27 18:49:34.637392 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 573/1179] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:34 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1324 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:34.720290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-faa0a43d-ef06-4d8a-b90d-c92f798682a9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:34.721082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-faa0a43d-ef06-4d8a-b90d-c92f798682a9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:34.724318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:34.741388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faa0a43d-ef06-4d8a-b90d-c92f798682a9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:34.742268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faa0a43d-ef06-4d8a-b90d-c92f798682a9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:34.743440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faa0a43d-ef06-4d8a-b90d-c92f798682a9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:34.744453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faa0a43d-ef06-4d8a-b90d-c92f798682a9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:34.747301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faa0a43d-ef06-4d8a-b90d-c92f798682a9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:34.748264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faa0a43d-ef06-4d8a-b90d-c92f798682a9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:34.893528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-15e2537f-223b-493f-98e5-71d2b50c6a86 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:34.915693 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-15e2537f-223b-493f-98e5-71d2b50c6a86 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1542 microversion: 2.1 time: 0.715881 Oct 27 18:49:34.917059 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 607/1180] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:34 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1542 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:35.217598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dc5d601f-55cf-439b-abc3-080371a4253c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:35.218887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dc5d601f-55cf-439b-abc3-080371a4253c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 09d2d6e6-9f89-45ca-8353-d0d549e82086] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:35.234376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc5d601f-55cf-439b-abc3-080371a4253c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:35.235095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc5d601f-55cf-439b-abc3-080371a4253c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:35.235560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc5d601f-55cf-439b-abc3-080371a4253c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:35.236320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc5d601f-55cf-439b-abc3-080371a4253c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:35.236774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc5d601f-55cf-439b-abc3-080371a4253c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:35.245491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc5d601f-55cf-439b-abc3-080371a4253c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:35.396392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-faa0a43d-ef06-4d8a-b90d-c92f798682a9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:35.405473 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-faa0a43d-ef06-4d8a-b90d-c92f798682a9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1286 microversion: 2.1 time: 0.689658 Oct 27 18:49:35.406052 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 574/1181] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:34 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1286 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:35.689124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dc5d601f-55cf-439b-abc3-080371a4253c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:35.706829 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dc5d601f-55cf-439b-abc3-080371a4253c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086" status: 200 len: 1322 microversion: 2.1 time: 0.495191 Oct 27 18:49:35.709447 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 608/1182] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:35 2022] GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086 => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:35.715910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-62c6d4a2-4714-4609-8441-24e8ec06c810 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:35.731687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-62c6d4a2-4714-4609-8441-24e8ec06c810 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:35.752208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-62c6d4a2-4714-4609-8441-24e8ec06c810 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:35.758783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-62c6d4a2-4714-4609-8441-24e8ec06c810 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:35.758783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-62c6d4a2-4714-4609-8441-24e8ec06c810 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:35.759571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-62c6d4a2-4714-4609-8441-24e8ec06c810 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:35.762725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-62c6d4a2-4714-4609-8441-24e8ec06c810 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:35.763494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-62c6d4a2-4714-4609-8441-24e8ec06c810 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:35.846274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-53ad6cb8-62cf-49c7-a30b-ad6c0028fd93 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Action: 'create', calling method: .version_select at 0x7fc86ad7ab80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1775024048", "description": "tempest-description-855769845"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:36.149243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-62c6d4a2-4714-4609-8441-24e8ec06c810 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:36.174223 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-62c6d4a2-4714-4609-8441-24e8ec06c810 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1324 microversion: 2.1 time: 0.462510 Oct 27 18:49:36.177743 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 609/1183] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:35 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1324 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:36.202561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-7a53c8f6-d291-4a50-a790-8cf9c293e4a2 req-4d92aeb2-d972-4f7f-821a-e0f8693ec13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d2d6e6-9f89-45ca-8353-d0d549e82086", "name": "network-vif-plugged", "status": "completed", "tag": "aaab970e-7faa-44e8-8d77-661cb812f9b6"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:36.234712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7a53c8f6-d291-4a50-a790-8cf9c293e4a2 req-4d92aeb2-d972-4f7f-821a-e0f8693ec13e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:36.235338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7a53c8f6-d291-4a50-a790-8cf9c293e4a2 req-4d92aeb2-d972-4f7f-821a-e0f8693ec13e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:36.235881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7a53c8f6-d291-4a50-a790-8cf9c293e4a2 req-4d92aeb2-d972-4f7f-821a-e0f8693ec13e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:36.255216 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-7a53c8f6-d291-4a50-a790-8cf9c293e4a2 req-4d92aeb2-d972-4f7f-821a-e0f8693ec13e service nova] Creating event network-vif-plugged:aaab970e-7faa-44e8-8d77-661cb812f9b6 for instance 09d2d6e6-9f89-45ca-8353-d0d549e82086 on n-h2-860687-3 Oct 27 18:49:36.261681 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-7a53c8f6-d291-4a50-a790-8cf9c293e4a2 req-4d92aeb2-d972-4f7f-821a-e0f8693ec13e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081426 Oct 27 18:49:36.263276 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 610/1184] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:36.269045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ad93818-c858-4dc2-a98f-0887e8c3892a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:36.270726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5ad93818-c858-4dc2-a98f-0887e8c3892a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:36.277248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:36.279364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ad93818-c858-4dc2-a98f-0887e8c3892a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:36.280217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ad93818-c858-4dc2-a98f-0887e8c3892a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:36.280902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ad93818-c858-4dc2-a98f-0887e8c3892a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:36.281875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ad93818-c858-4dc2-a98f-0887e8c3892a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:36.282627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ad93818-c858-4dc2-a98f-0887e8c3892a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:36.283483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ad93818-c858-4dc2-a98f-0887e8c3892a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:36.770671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5ad93818-c858-4dc2-a98f-0887e8c3892a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:36.782894 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5ad93818-c858-4dc2-a98f-0887e8c3892a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1542 microversion: 2.1 time: 0.518037 Oct 27 18:49:36.799445 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 611/1185] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:36 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1542 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:36.817720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2ed23ee7-c252-4352-8437-00dbb84630c4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:36.818540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2ed23ee7-c252-4352-8437-00dbb84630c4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:36.836178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ed23ee7-c252-4352-8437-00dbb84630c4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:36.836697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ed23ee7-c252-4352-8437-00dbb84630c4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:36.837148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ed23ee7-c252-4352-8437-00dbb84630c4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:36.838063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ed23ee7-c252-4352-8437-00dbb84630c4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:36.838552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ed23ee7-c252-4352-8437-00dbb84630c4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:36.839976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ed23ee7-c252-4352-8437-00dbb84630c4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:36.953503 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-53ad6cb8-62cf-49c7-a30b-ad6c0028fd93 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.370033 Oct 27 18:49:36.954358 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 575/1186] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:49:35 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:36.959865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0e1ffc1-a811-46c6-89db-9630a1894976 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:36.961324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f0e1ffc1-a811-46c6-89db-9630a1894976 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 09d2d6e6-9f89-45ca-8353-d0d549e82086] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:36.976576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0e1ffc1-a811-46c6-89db-9630a1894976 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:36.980017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0e1ffc1-a811-46c6-89db-9630a1894976 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:36.980751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0e1ffc1-a811-46c6-89db-9630a1894976 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:36.983674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0e1ffc1-a811-46c6-89db-9630a1894976 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:36.984470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0e1ffc1-a811-46c6-89db-9630a1894976 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:36.985173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0e1ffc1-a811-46c6-89db-9630a1894976 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:37.179596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2ed23ee7-c252-4352-8437-00dbb84630c4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:37.192321 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2ed23ee7-c252-4352-8437-00dbb84630c4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1316 microversion: 2.1 time: 0.391607 Oct 27 18:49:37.208536 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 612/1187] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:36 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:37.219902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-caeb3955-3a6d-439b-a4f0-9dbc17e989e6 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Action: 'create', calling method: .version_select at 0x7fc86ad75280>, body: {"security_group_rule": {"parent_group_id": "583bd7de-c346-4398-be78-2c68b1f75cc1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:37.392734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f0e1ffc1-a811-46c6-89db-9630a1894976 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:37.401970 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f0e1ffc1-a811-46c6-89db-9630a1894976 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086" status: 200 len: 1322 microversion: 2.1 time: 0.446210 Oct 27 18:49:37.414741 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 576/1188] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:36 2022] GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086 => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:37.414741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9840d662-4cdb-44ac-af40-d6ac84493d21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:37.414741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9840d662-4cdb-44ac-af40-d6ac84493d21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:37.421774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9840d662-4cdb-44ac-af40-d6ac84493d21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:37.421774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9840d662-4cdb-44ac-af40-d6ac84493d21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:37.421774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9840d662-4cdb-44ac-af40-d6ac84493d21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:37.421774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9840d662-4cdb-44ac-af40-d6ac84493d21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:37.422074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9840d662-4cdb-44ac-af40-d6ac84493d21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:37.422541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9840d662-4cdb-44ac-af40-d6ac84493d21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:37.813553 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-caeb3955-3a6d-439b-a4f0-9dbc17e989e6 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.601722 Oct 27 18:49:37.815239 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 613/1189] 10.222.0.42 () {60 vars in 1195 bytes} [Thu Oct 27 18:49:37 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:37.823945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-39429cd8-b3bc-4b28-a476-47c02284b9b6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:37.825273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-39429cd8-b3bc-4b28-a476-47c02284b9b6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:37.844637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39429cd8-b3bc-4b28-a476-47c02284b9b6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:37.847829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39429cd8-b3bc-4b28-a476-47c02284b9b6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:37.848338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39429cd8-b3bc-4b28-a476-47c02284b9b6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:37.850992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39429cd8-b3bc-4b28-a476-47c02284b9b6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:37.852420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39429cd8-b3bc-4b28-a476-47c02284b9b6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:37.854786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39429cd8-b3bc-4b28-a476-47c02284b9b6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:37.980492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9840d662-4cdb-44ac-af40-d6ac84493d21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:37.998059 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9840d662-4cdb-44ac-af40-d6ac84493d21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1324 microversion: 2.1 time: 0.591976 Oct 27 18:49:38.014411 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 577/1190] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:37 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1324 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:38.018704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b5cfe05b-3903-493c-9504-028a24fc6541 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Action: 'create', calling method: .version_select at 0x7fc86ad5f700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1631369926", "description": "tempest-description-625949158"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:38.161874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-39429cd8-b3bc-4b28-a476-47c02284b9b6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:38.173502 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-39429cd8-b3bc-4b28-a476-47c02284b9b6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1542 microversion: 2.1 time: 0.356415 Oct 27 18:49:38.175608 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 614/1191] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:37 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1542 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:38.220029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9c139f16-e518-4821-b674-fe93e371ea9a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:38.220700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9c139f16-e518-4821-b674-fe93e371ea9a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:38.228722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c139f16-e518-4821-b674-fe93e371ea9a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:38.229447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c139f16-e518-4821-b674-fe93e371ea9a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:38.233908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c139f16-e518-4821-b674-fe93e371ea9a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:38.235425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c139f16-e518-4821-b674-fe93e371ea9a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:38.235908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c139f16-e518-4821-b674-fe93e371ea9a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:38.236350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c139f16-e518-4821-b674-fe93e371ea9a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:38.399194 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b5cfe05b-3903-493c-9504-028a24fc6541 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.395017 Oct 27 18:49:38.399871 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 578/1192] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:49:38 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:38.413051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cd8ec5ab-51b0-4bac-be3f-568b9c520f20 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Action: 'create', calling method: .version_select at 0x7fc86adfbdc0>, body: {"security_group_rule": {"parent_group_id": "23b14042-acc0-4f46-8122-007ca0bc22a5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:38.642606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9c139f16-e518-4821-b674-fe93e371ea9a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:38.657492 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9c139f16-e518-4821-b674-fe93e371ea9a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1316 microversion: 2.1 time: 0.441427 Oct 27 18:49:38.679001 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 615/1193] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:38 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:38.688574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e2ff403b-7421-4a32-a6b5-b73305e75316 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:38.689693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e2ff403b-7421-4a32-a6b5-b73305e75316 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 09d2d6e6-9f89-45ca-8353-d0d549e82086] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:38.698741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2ff403b-7421-4a32-a6b5-b73305e75316 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:38.699765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2ff403b-7421-4a32-a6b5-b73305e75316 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:38.700747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2ff403b-7421-4a32-a6b5-b73305e75316 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:38.701955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2ff403b-7421-4a32-a6b5-b73305e75316 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:38.702854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2ff403b-7421-4a32-a6b5-b73305e75316 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:38.703511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2ff403b-7421-4a32-a6b5-b73305e75316 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:38.910259 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cd8ec5ab-51b0-4bac-be3f-568b9c520f20 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.501276 Oct 27 18:49:38.911726 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 579/1194] 10.222.0.42 () {60 vars in 1195 bytes} [Thu Oct 27 18:49:38 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:38.916436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-8ad1e9b4-bae4-42ab-8157-7095b2b4d676 req-35aa7d99-8396-42f0-ae62-bdbbfe4c7073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "544f4ef4-fdfc-4e55-a247-7c210300d932", "name": "network-vif-plugged", "status": "completed", "tag": "50d7433e-4e6d-4e9a-9b35-21b455c67c5e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:38.945992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8ad1e9b4-bae4-42ab-8157-7095b2b4d676 req-35aa7d99-8396-42f0-ae62-bdbbfe4c7073 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:38.946716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8ad1e9b4-bae4-42ab-8157-7095b2b4d676 req-35aa7d99-8396-42f0-ae62-bdbbfe4c7073 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:38.948527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8ad1e9b4-bae4-42ab-8157-7095b2b4d676 req-35aa7d99-8396-42f0-ae62-bdbbfe4c7073 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:38.963254 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8ad1e9b4-bae4-42ab-8157-7095b2b4d676 req-35aa7d99-8396-42f0-ae62-bdbbfe4c7073 service nova] Creating event network-vif-plugged:50d7433e-4e6d-4e9a-9b35-21b455c67c5e for instance 544f4ef4-fdfc-4e55-a247-7c210300d932 on n-h2-860687-3 Oct 27 18:49:38.984174 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-8ad1e9b4-bae4-42ab-8157-7095b2b4d676 req-35aa7d99-8396-42f0-ae62-bdbbfe4c7073 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071029 Oct 27 18:49:38.990520 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 580/1195] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:39.003860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-067f5218-a933-4535-a46e-2945bca553f4 req-1d950691-794f-4455-a553-85937d15e0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2f8430-f7aa-4b29-b980-d0860fcc7123", "tag": "4776f52b-b794-46a8-b2e7-8668af766e21"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:39.016319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-067f5218-a933-4535-a46e-2945bca553f4 req-1d950691-794f-4455-a553-85937d15e0fb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:39.017238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-067f5218-a933-4535-a46e-2945bca553f4 req-1d950691-794f-4455-a553-85937d15e0fb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:39.017907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-067f5218-a933-4535-a46e-2945bca553f4 req-1d950691-794f-4455-a553-85937d15e0fb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:39.034139 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-067f5218-a933-4535-a46e-2945bca553f4 req-1d950691-794f-4455-a553-85937d15e0fb service nova] Creating event network-changed:4776f52b-b794-46a8-b2e7-8668af766e21 for instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 on n-h1-860687-3 Oct 27 18:49:39.084698 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-067f5218-a933-4535-a46e-2945bca553f4 req-1d950691-794f-4455-a553-85937d15e0fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091775 Oct 27 18:49:39.089477 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 581/1196] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:39.097791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5d0194e7-92f3-45ad-b954-babf42a5de1c tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Action: 'create', calling method: .version_select at 0x7fc86ad08a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-191295988", "description": "tempest-description-881902567"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:39.188191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e2ff403b-7421-4a32-a6b5-b73305e75316 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:39.198464 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e2ff403b-7421-4a32-a6b5-b73305e75316 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086" status: 200 len: 1515 microversion: 2.1 time: 0.516926 Oct 27 18:49:39.199015 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 616/1197] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:38 2022] GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086 => generated 1515 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:39.226942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3135411c-45b1-4f5d-ba42-904727f8c39c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:39.227829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3135411c-45b1-4f5d-ba42-904727f8c39c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:39.240307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3135411c-45b1-4f5d-ba42-904727f8c39c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:39.241097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3135411c-45b1-4f5d-ba42-904727f8c39c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:39.241849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3135411c-45b1-4f5d-ba42-904727f8c39c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:39.242891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3135411c-45b1-4f5d-ba42-904727f8c39c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:39.243575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3135411c-45b1-4f5d-ba42-904727f8c39c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:39.244350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3135411c-45b1-4f5d-ba42-904727f8c39c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:39.561878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3135411c-45b1-4f5d-ba42-904727f8c39c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:39.589397 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3135411c-45b1-4f5d-ba42-904727f8c39c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1324 microversion: 2.1 time: 0.389027 Oct 27 18:49:39.590682 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 617/1198] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:39 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1324 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:39.596641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8967a75b-2c98-42b8-a08e-10083fdfd56a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:39.597503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8967a75b-2c98-42b8-a08e-10083fdfd56a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:39.605169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8967a75b-2c98-42b8-a08e-10083fdfd56a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:39.605960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8967a75b-2c98-42b8-a08e-10083fdfd56a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:39.606925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8967a75b-2c98-42b8-a08e-10083fdfd56a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:39.607940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8967a75b-2c98-42b8-a08e-10083fdfd56a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:39.615888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8967a75b-2c98-42b8-a08e-10083fdfd56a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:39.617065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8967a75b-2c98-42b8-a08e-10083fdfd56a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:39.706866 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5d0194e7-92f3-45ad-b954-babf42a5de1c tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.614444 Oct 27 18:49:39.707905 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 582/1199] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:49:39 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:39.716840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b7736ce7-d7bf-4bad-88fd-a7056cc1d628 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:39.720855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b7736ce7-d7bf-4bad-88fd-a7056cc1d628 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 9fd25663-2c8a-4c1f-b5e3-231e38afed4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:39.741498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7736ce7-d7bf-4bad-88fd-a7056cc1d628 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:39.742314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7736ce7-d7bf-4bad-88fd-a7056cc1d628 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:39.742803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7736ce7-d7bf-4bad-88fd-a7056cc1d628 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:39.743530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7736ce7-d7bf-4bad-88fd-a7056cc1d628 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:39.744934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7736ce7-d7bf-4bad-88fd-a7056cc1d628 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:39.745391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7736ce7-d7bf-4bad-88fd-a7056cc1d628 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:39.865262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8967a75b-2c98-42b8-a08e-10083fdfd56a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:39.877157 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8967a75b-2c98-42b8-a08e-10083fdfd56a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1542 microversion: 2.1 time: 0.284858 Oct 27 18:49:39.877826 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 618/1200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:39 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1542 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:39.887891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e1d603cc-66b8-4a82-802b-1bdaa7e40cf5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:39.888868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e1d603cc-66b8-4a82-802b-1bdaa7e40cf5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:39.902759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1d603cc-66b8-4a82-802b-1bdaa7e40cf5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:39.904935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1d603cc-66b8-4a82-802b-1bdaa7e40cf5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:39.906132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1d603cc-66b8-4a82-802b-1bdaa7e40cf5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:39.908471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1d603cc-66b8-4a82-802b-1bdaa7e40cf5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:39.910345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1d603cc-66b8-4a82-802b-1bdaa7e40cf5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:39.911061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1d603cc-66b8-4a82-802b-1bdaa7e40cf5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:40.189575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e1d603cc-66b8-4a82-802b-1bdaa7e40cf5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:40.203813 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e1d603cc-66b8-4a82-802b-1bdaa7e40cf5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1316 microversion: 2.1 time: 0.324502 Oct 27 18:49:40.204522 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 619/1201] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:39 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:40.231307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4a6af2bf-9dfb-48cf-8a87-d3030ca1de65 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Action: 'create', calling method: .version_select at 0x7fc86af70dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-172984693", "description": "tempest-description-34678150"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:40.543904 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4a6af2bf-9dfb-48cf-8a87-d3030ca1de65 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.325373 Oct 27 18:49:40.544976 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 620/1202] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:49:40 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:40.557796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa4b19d6-d2a1-44b5-a491-32e289e0eb9e tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:40.560918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa4b19d6-d2a1-44b5-a491-32e289e0eb9e tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:40.570445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa4b19d6-d2a1-44b5-a491-32e289e0eb9e tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:40.571315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa4b19d6-d2a1-44b5-a491-32e289e0eb9e tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:40.572852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa4b19d6-d2a1-44b5-a491-32e289e0eb9e tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:40.573742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa4b19d6-d2a1-44b5-a491-32e289e0eb9e tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:40.574356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa4b19d6-d2a1-44b5-a491-32e289e0eb9e tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:40.575791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa4b19d6-d2a1-44b5-a491-32e289e0eb9e tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:40.660411 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fa4b19d6-d2a1-44b5-a491-32e289e0eb9e tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106715 Oct 27 18:49:40.661710 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 621/1203] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:49:40 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:49:40.667581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c7e90fc1-d1e8-404c-b3f1-3bf8ed338a64 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Action: 'create', calling method: .version_select at 0x7fc86ad7c5e0>, body: {"security_group_rule": {"parent_group_id": "492e297f-7c07-40dd-8699-6928aede02e0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "f3e6130f-37f4-4784-98b7-f108463acf1f"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:40.777771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b7736ce7-d7bf-4bad-88fd-a7056cc1d628 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:40.791716 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b7736ce7-d7bf-4bad-88fd-a7056cc1d628 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c" status: 200 len: 1514 microversion: 2.1 time: 1.081540 Oct 27 18:49:40.792980 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 583/1204] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:39 2022] GET /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c => generated 1514 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:40.805188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-43cc9bcb-dbb8-4a8c-b110-2b7c64fefce6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:40.805823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-43cc9bcb-dbb8-4a8c-b110-2b7c64fefce6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:40.821856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43cc9bcb-dbb8-4a8c-b110-2b7c64fefce6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:40.822369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43cc9bcb-dbb8-4a8c-b110-2b7c64fefce6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:40.825674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43cc9bcb-dbb8-4a8c-b110-2b7c64fefce6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:40.826472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43cc9bcb-dbb8-4a8c-b110-2b7c64fefce6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:40.827890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43cc9bcb-dbb8-4a8c-b110-2b7c64fefce6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:40.829482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43cc9bcb-dbb8-4a8c-b110-2b7c64fefce6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:41.358773 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c7e90fc1-d1e8-404c-b3f1-3bf8ed338a64 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.695600 Oct 27 18:49:41.359403 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 622/1205] 10.222.0.42 () {60 vars in 1195 bytes} [Thu Oct 27 18:49:40 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:41.364131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a2f7d834-b512-4f7c-9330-54f7339b16b9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:41.370246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a2f7d834-b512-4f7c-9330-54f7339b16b9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:41.387554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2f7d834-b512-4f7c-9330-54f7339b16b9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:41.389302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2f7d834-b512-4f7c-9330-54f7339b16b9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:41.389922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2f7d834-b512-4f7c-9330-54f7339b16b9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:41.391006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2f7d834-b512-4f7c-9330-54f7339b16b9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:41.391626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2f7d834-b512-4f7c-9330-54f7339b16b9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:41.392202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2f7d834-b512-4f7c-9330-54f7339b16b9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:41.430630 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a2f7d834-b512-4f7c-9330-54f7339b16b9 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070111 Oct 27 18:49:41.431974 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 623/1206] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:49:41 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:49:41.437039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb4ce950-6e57-4044-835d-0e2e8873515e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:41.437792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cb4ce950-6e57-4044-835d-0e2e8873515e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 9fd25663-2c8a-4c1f-b5e3-231e38afed4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:41.447478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb4ce950-6e57-4044-835d-0e2e8873515e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:41.448221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb4ce950-6e57-4044-835d-0e2e8873515e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:41.449114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb4ce950-6e57-4044-835d-0e2e8873515e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:41.450066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb4ce950-6e57-4044-835d-0e2e8873515e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:41.450756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb4ce950-6e57-4044-835d-0e2e8873515e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:41.451376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb4ce950-6e57-4044-835d-0e2e8873515e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:41.495994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cb4ce950-6e57-4044-835d-0e2e8873515e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 9fd25663-2c8a-4c1f-b5e3-231e38afed4c] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:49:41.600841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:41.621739 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cb4ce950-6e57-4044-835d-0e2e8873515e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c" status: 204 len: 0 microversion: 2.1 time: 0.188187 Oct 27 18:49:41.622984 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 624/1207] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:49:41 2022] DELETE /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:49:41.629509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5534a10e-cd3c-4472-a437-e482418a32f5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:41.630608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5534a10e-cd3c-4472-a437-e482418a32f5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:41.638990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5534a10e-cd3c-4472-a437-e482418a32f5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:41.639497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5534a10e-cd3c-4472-a437-e482418a32f5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:41.640044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5534a10e-cd3c-4472-a437-e482418a32f5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:41.640984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5534a10e-cd3c-4472-a437-e482418a32f5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:41.642127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5534a10e-cd3c-4472-a437-e482418a32f5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:41.642777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5534a10e-cd3c-4472-a437-e482418a32f5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:41.797152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-43cc9bcb-dbb8-4a8c-b110-2b7c64fefce6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:41.808002 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-43cc9bcb-dbb8-4a8c-b110-2b7c64fefce6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1324 microversion: 2.1 time: 1.013683 Oct 27 18:49:41.812604 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 584/1208] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:40 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1324 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:41.819698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b43a26ee-a846-4910-81b2-8cdba0094969 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:41.820324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b43a26ee-a846-4910-81b2-8cdba0094969 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:41.842327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b43a26ee-a846-4910-81b2-8cdba0094969 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:41.843214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b43a26ee-a846-4910-81b2-8cdba0094969 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:41.843846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b43a26ee-a846-4910-81b2-8cdba0094969 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:41.844842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b43a26ee-a846-4910-81b2-8cdba0094969 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:41.845494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b43a26ee-a846-4910-81b2-8cdba0094969 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:41.846097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b43a26ee-a846-4910-81b2-8cdba0094969 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:41.847875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5534a10e-cd3c-4472-a437-e482418a32f5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:41.872750 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5534a10e-cd3c-4472-a437-e482418a32f5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1542 microversion: 2.1 time: 0.247679 Oct 27 18:49:41.887797 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 625/1209] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:41 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1542 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:41.902226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bdd9a577-f52d-4566-902b-6671891c77c2 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Action: 'create', calling method: .version_select at 0x7fc86b072790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1011475969", "description": "tempest-description-1326462398"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:42.076084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b43a26ee-a846-4910-81b2-8cdba0094969 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:42.084427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:42.089581 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b43a26ee-a846-4910-81b2-8cdba0094969 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1316 microversion: 2.1 time: 0.275796 Oct 27 18:49:42.103803 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 585/1210] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:41 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:42.112292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-93185ea7-7a05-4a44-85c0-51186fdb72f0 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:42.113402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-93185ea7-7a05-4a44-85c0-51186fdb72f0 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:42.121322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93185ea7-7a05-4a44-85c0-51186fdb72f0 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:42.124903 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bdd9a577-f52d-4566-902b-6671891c77c2 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.235929 Oct 27 18:49:42.125545 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 626/1211] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:49:41 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:42.130288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3668f355-ec90-4b07-8199-4dda6c3e47fd tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:42.131001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3668f355-ec90-4b07-8199-4dda6c3e47fd tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 9fd25663-2c8a-4c1f-b5e3-231e38afed4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:42.133750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93185ea7-7a05-4a44-85c0-51186fdb72f0 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:42.134204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93185ea7-7a05-4a44-85c0-51186fdb72f0 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:42.138319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93185ea7-7a05-4a44-85c0-51186fdb72f0 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:42.140239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93185ea7-7a05-4a44-85c0-51186fdb72f0 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:42.142065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93185ea7-7a05-4a44-85c0-51186fdb72f0 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:42.148269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3668f355-ec90-4b07-8199-4dda6c3e47fd tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:42.154900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3668f355-ec90-4b07-8199-4dda6c3e47fd tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:42.155878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3668f355-ec90-4b07-8199-4dda6c3e47fd tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:42.158352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3668f355-ec90-4b07-8199-4dda6c3e47fd tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:42.159105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3668f355-ec90-4b07-8199-4dda6c3e47fd tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:42.168063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3668f355-ec90-4b07-8199-4dda6c3e47fd tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:42.183518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:42.201206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-93185ea7-7a05-4a44-85c0-51186fdb72f0 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:49:42.393788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3668f355-ec90-4b07-8199-4dda6c3e47fd tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:42.404026 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-93185ea7-7a05-4a44-85c0-51186fdb72f0 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "DELETE /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 204 len: 0 microversion: 2.1 time: 0.298587 Oct 27 18:49:42.404833 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 586/1212] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:49:42 2022] DELETE /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:49:42.406377 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3668f355-ec90-4b07-8199-4dda6c3e47fd tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c" status: 200 len: 1520 microversion: 2.1 time: 0.279685 Oct 27 18:49:42.407473 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 627/1213] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:42 2022] GET /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:42.414788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-360acbf0-e862-4740-8d4f-0be3a2895311 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:42.415815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-360acbf0-e862-4740-8d4f-0be3a2895311 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:42.416942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a94b74f5-190b-4113-a5f5-c53eeed33140 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Action: 'create', calling method: .version_select at 0x7fc86adbfaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1285248573", "description": "tempest-description-1675062835"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:42.431178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-360acbf0-e862-4740-8d4f-0be3a2895311 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:42.432217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-360acbf0-e862-4740-8d4f-0be3a2895311 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:42.432650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-360acbf0-e862-4740-8d4f-0be3a2895311 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:42.433390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-360acbf0-e862-4740-8d4f-0be3a2895311 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:42.433843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-360acbf0-e862-4740-8d4f-0be3a2895311 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:42.440187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-360acbf0-e862-4740-8d4f-0be3a2895311 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:42.730409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-360acbf0-e862-4740-8d4f-0be3a2895311 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:42.745127 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-360acbf0-e862-4740-8d4f-0be3a2895311 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1682 microversion: 2.1 time: 0.332588 Oct 27 18:49:42.746462 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 628/1214] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:42 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1682 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:42.835729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-448f62e3-35f6-4b9e-a169-f98056468c0c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:42.836366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-448f62e3-35f6-4b9e-a169-f98056468c0c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:42.857708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-448f62e3-35f6-4b9e-a169-f98056468c0c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:42.861505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-448f62e3-35f6-4b9e-a169-f98056468c0c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:42.863672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-448f62e3-35f6-4b9e-a169-f98056468c0c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:42.865465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-448f62e3-35f6-4b9e-a169-f98056468c0c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:42.867825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-448f62e3-35f6-4b9e-a169-f98056468c0c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:42.868397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-448f62e3-35f6-4b9e-a169-f98056468c0c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:43.012908 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a94b74f5-190b-4113-a5f5-c53eeed33140 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.606633 Oct 27 18:49:43.014861 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 587/1215] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:49:42 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:43.022433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2a0fd9ed-aae7-493b-ae9f-fd9defcb9694 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:43.025296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2a0fd9ed-aae7-493b-ae9f-fd9defcb9694 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:43.034234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a0fd9ed-aae7-493b-ae9f-fd9defcb9694 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:43.034755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a0fd9ed-aae7-493b-ae9f-fd9defcb9694 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:43.035197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a0fd9ed-aae7-493b-ae9f-fd9defcb9694 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:43.035910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a0fd9ed-aae7-493b-ae9f-fd9defcb9694 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:43.036490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a0fd9ed-aae7-493b-ae9f-fd9defcb9694 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:43.036926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a0fd9ed-aae7-493b-ae9f-fd9defcb9694 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:43.104187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-448f62e3-35f6-4b9e-a169-f98056468c0c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:43.114749 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-448f62e3-35f6-4b9e-a169-f98056468c0c tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 200 len: 1521 microversion: 2.1 time: 0.283932 Oct 27 18:49:43.119337 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 629/1216] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:42 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:49:43.120528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8452ee66-99dd-4934-b644-05faf6a47d6e tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Action: 'create', calling method: .version_select at 0x7fc86acb4940>, body: {"security_group_rule": {"parent_group_id": "0d113d44-ffa4-42bd-97ce-40ff9f40ec6c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "185cd37a-5980-491c-b360-91f651eced35"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:43.293765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2a0fd9ed-aae7-493b-ae9f-fd9defcb9694 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:43.305632 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2a0fd9ed-aae7-493b-ae9f-fd9defcb9694 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1542 microversion: 2.1 time: 0.289035 Oct 27 18:49:43.307909 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 588/1217] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:43 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1542 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:43.315458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-768b9e2d-f1cc-4822-a60f-89b47974dd01 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:43.316592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-768b9e2d-f1cc-4822-a60f-89b47974dd01 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:43.327233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-768b9e2d-f1cc-4822-a60f-89b47974dd01 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:43.328058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-768b9e2d-f1cc-4822-a60f-89b47974dd01 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:43.328809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-768b9e2d-f1cc-4822-a60f-89b47974dd01 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:43.329710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-768b9e2d-f1cc-4822-a60f-89b47974dd01 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:43.330364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-768b9e2d-f1cc-4822-a60f-89b47974dd01 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:43.341602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-768b9e2d-f1cc-4822-a60f-89b47974dd01 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:43.384086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:43.525206 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8452ee66-99dd-4934-b644-05faf6a47d6e tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.407250 Oct 27 18:49:43.525977 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 630/1218] 10.222.0.42 () {60 vars in 1195 bytes} [Thu Oct 27 18:49:43 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:43.540115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a136b1ac-c750-45b1-a5ef-8cb3ddb95335 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.121"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:43.545061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a136b1ac-c750-45b1-a5ef-8cb3ddb95335 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:43.570756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a136b1ac-c750-45b1-a5ef-8cb3ddb95335 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:43.572703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a136b1ac-c750-45b1-a5ef-8cb3ddb95335 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:43.573612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a136b1ac-c750-45b1-a5ef-8cb3ddb95335 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:43.574596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a136b1ac-c750-45b1-a5ef-8cb3ddb95335 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:43.575546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a136b1ac-c750-45b1-a5ef-8cb3ddb95335 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:43.576173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a136b1ac-c750-45b1-a5ef-8cb3ddb95335 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:43.662800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a136b1ac-c750-45b1-a5ef-8cb3ddb95335 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "refresh_cache-5ef3dc71-9730-4658-aa69-ff8704cdfb8c" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 18:49:43.663611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a136b1ac-c750-45b1-a5ef-8cb3ddb95335 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquired lock "refresh_cache-5ef3dc71-9730-4658-aa69-ff8704cdfb8c" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 18:49:43.675326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-768b9e2d-f1cc-4822-a60f-89b47974dd01 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:43.688611 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-768b9e2d-f1cc-4822-a60f-89b47974dd01 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1316 microversion: 2.1 time: 0.376027 Oct 27 18:49:43.689267 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 589/1219] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:43 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:43.702275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9953618a-86e3-4b7d-84e2-4be23077f00b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:43.702937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9953618a-86e3-4b7d-84e2-4be23077f00b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 9fd25663-2c8a-4c1f-b5e3-231e38afed4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:43.715387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9953618a-86e3-4b7d-84e2-4be23077f00b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:43.715883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9953618a-86e3-4b7d-84e2-4be23077f00b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:43.716515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9953618a-86e3-4b7d-84e2-4be23077f00b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:43.717383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9953618a-86e3-4b7d-84e2-4be23077f00b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:43.717998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9953618a-86e3-4b7d-84e2-4be23077f00b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:43.718679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9953618a-86e3-4b7d-84e2-4be23077f00b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:43.873405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9953618a-86e3-4b7d-84e2-4be23077f00b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:43.885488 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9953618a-86e3-4b7d-84e2-4be23077f00b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c" status: 200 len: 1520 microversion: 2.1 time: 0.193906 Oct 27 18:49:43.886949 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 590/1220] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:43 2022] GET /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:43.892641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8f58ef90-6e4e-4faa-8ca9-8fa6295f95af tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Calling method '.version_select at 0x7fc86acc83a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:44.183837 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8f58ef90-6e4e-4faa-8ca9-8fa6295f95af tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/185cd37a-5980-491c-b360-91f651eced35" status: 202 len: 0 microversion: 2.1 time: 0.295393 Oct 27 18:49:44.184410 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 591/1221] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:43 2022] DELETE /compute/v2.1/os-security-groups/185cd37a-5980-491c-b360-91f651eced35 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:44.189699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cd7720e2-91b2-47b7-a722-5ad5ee1e4797 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:44.190711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cd7720e2-91b2-47b7-a722-5ad5ee1e4797 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:44.207449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd7720e2-91b2-47b7-a722-5ad5ee1e4797 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:44.207967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd7720e2-91b2-47b7-a722-5ad5ee1e4797 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:44.208419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd7720e2-91b2-47b7-a722-5ad5ee1e4797 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:44.209148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd7720e2-91b2-47b7-a722-5ad5ee1e4797 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:44.209616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd7720e2-91b2-47b7-a722-5ad5ee1e4797 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:44.210050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd7720e2-91b2-47b7-a722-5ad5ee1e4797 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:44.452957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cd7720e2-91b2-47b7-a722-5ad5ee1e4797 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:44.461826 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cd7720e2-91b2-47b7-a722-5ad5ee1e4797 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1682 microversion: 2.1 time: 0.276377 Oct 27 18:49:44.463335 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 592/1222] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:44 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1682 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:44.468553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c2e75a73-8aac-44fc-ba1a-f11a0501c189 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Calling method '.version_select at 0x7fc86ad5f670>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:44.539342 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c2e75a73-8aac-44fc-ba1a-f11a0501c189 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/0d113d44-ffa4-42bd-97ce-40ff9f40ec6c" status: 200 len: 248 microversion: 2.1 time: 0.074522 Oct 27 18:49:44.551164 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 593/1223] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 18:49:44 2022] GET /compute/v2.1/os-security-groups/0d113d44-ffa4-42bd-97ce-40ff9f40ec6c => generated 248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:44.556182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-60b4349f-5e1a-4aca-8c9d-799791b88186 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:44.557670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-60b4349f-5e1a-4aca-8c9d-799791b88186 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:44.572611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60b4349f-5e1a-4aca-8c9d-799791b88186 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:44.575058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60b4349f-5e1a-4aca-8c9d-799791b88186 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:44.578746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60b4349f-5e1a-4aca-8c9d-799791b88186 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:44.579756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60b4349f-5e1a-4aca-8c9d-799791b88186 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:44.580440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60b4349f-5e1a-4aca-8c9d-799791b88186 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:44.582249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60b4349f-5e1a-4aca-8c9d-799791b88186 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:45.312359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-60b4349f-5e1a-4aca-8c9d-799791b88186 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:45.323091 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-60b4349f-5e1a-4aca-8c9d-799791b88186 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1542 microversion: 2.1 time: 0.770752 Oct 27 18:49:45.324314 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 594/1224] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:44 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1542 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:45.329388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f2eb15b6-f9f8-4539-8e87-c66c9396e6b3 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Action: 'create', calling method: .version_select at 0x7fc86acc8790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1567036891", "description": "tempest-description-137764468"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:46.162802 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f2eb15b6-f9f8-4539-8e87-c66c9396e6b3 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.837130 Oct 27 18:49:46.163404 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 595/1225] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:49:45 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:46.177594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2170553f-6e60-4b77-b9c1-2d27e22bcea1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:46.178220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2170553f-6e60-4b77-b9c1-2d27e22bcea1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:46.208361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2170553f-6e60-4b77-b9c1-2d27e22bcea1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:46.209059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2170553f-6e60-4b77-b9c1-2d27e22bcea1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:46.209664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2170553f-6e60-4b77-b9c1-2d27e22bcea1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:46.210613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2170553f-6e60-4b77-b9c1-2d27e22bcea1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:46.211239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2170553f-6e60-4b77-b9c1-2d27e22bcea1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:46.211893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2170553f-6e60-4b77-b9c1-2d27e22bcea1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:46.575407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2170553f-6e60-4b77-b9c1-2d27e22bcea1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:46.587294 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2170553f-6e60-4b77-b9c1-2d27e22bcea1 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1316 microversion: 2.1 time: 0.413418 Oct 27 18:49:46.588166 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 596/1226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:46 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:46.596539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7571d0ff-2736-413e-8333-a4a35c00384b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:46.597379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7571d0ff-2736-413e-8333-a4a35c00384b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 9fd25663-2c8a-4c1f-b5e3-231e38afed4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:46.617940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7571d0ff-2736-413e-8333-a4a35c00384b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:46.625753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7571d0ff-2736-413e-8333-a4a35c00384b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:46.626454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7571d0ff-2736-413e-8333-a4a35c00384b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:46.627228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7571d0ff-2736-413e-8333-a4a35c00384b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:46.627706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7571d0ff-2736-413e-8333-a4a35c00384b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:46.628145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7571d0ff-2736-413e-8333-a4a35c00384b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:46.704456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7571d0ff-2736-413e-8333-a4a35c00384b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:46.705145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7571d0ff-2736-413e-8333-a4a35c00384b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:46.705593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7571d0ff-2736-413e-8333-a4a35c00384b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:46.706064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-7571d0ff-2736-413e-8333-a4a35c00384b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lazy-loading 'fault' on Instance uuid 9fd25663-2c8a-4c1f-b5e3-231e38afed4c {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:49:46.933540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7571d0ff-2736-413e-8333-a4a35c00384b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:46.944963 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7571d0ff-2736-413e-8333-a4a35c00384b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c" status: 200 len: 1312 microversion: 2.1 time: 0.355333 Oct 27 18:49:46.945850 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 597/1227] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:46 2022] GET /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c => generated 1312 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:46.954248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ca0e890a-5239-4ced-9bbe-79692997c6d5 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:46.966249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ca0e890a-5239-4ced-9bbe-79692997c6d5 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:46.985586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca0e890a-5239-4ced-9bbe-79692997c6d5 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:46.986249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca0e890a-5239-4ced-9bbe-79692997c6d5 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:46.986859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca0e890a-5239-4ced-9bbe-79692997c6d5 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:46.987624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca0e890a-5239-4ced-9bbe-79692997c6d5 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:46.988293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca0e890a-5239-4ced-9bbe-79692997c6d5 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:46.991109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca0e890a-5239-4ced-9bbe-79692997c6d5 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:47.096608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ca0e890a-5239-4ced-9bbe-79692997c6d5 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:47.108556 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ca0e890a-5239-4ced-9bbe-79692997c6d5 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1614 microversion: 2.1 time: 0.160840 Oct 27 18:49:47.118426 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 598/1228] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:46 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1614 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:47.130860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-7134e512-1b90-4e97-b8dd-dac11d8419a6 req-018fc819-1ee4-43fc-b5d4-64dc023f09c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2f8430-f7aa-4b29-b980-d0860fcc7123", "name": "network-vif-plugged", "status": "completed", "tag": "4776f52b-b794-46a8-b2e7-8668af766e21"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:47.167601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7134e512-1b90-4e97-b8dd-dac11d8419a6 req-018fc819-1ee4-43fc-b5d4-64dc023f09c0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:47.168113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7134e512-1b90-4e97-b8dd-dac11d8419a6 req-018fc819-1ee4-43fc-b5d4-64dc023f09c0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:47.168556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7134e512-1b90-4e97-b8dd-dac11d8419a6 req-018fc819-1ee4-43fc-b5d4-64dc023f09c0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:47.194901 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-7134e512-1b90-4e97-b8dd-dac11d8419a6 req-018fc819-1ee4-43fc-b5d4-64dc023f09c0 service nova] Creating event network-vif-plugged:4776f52b-b794-46a8-b2e7-8668af766e21 for instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 on n-h1-860687-3 Oct 27 18:49:47.203481 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-7134e512-1b90-4e97-b8dd-dac11d8419a6 req-018fc819-1ee4-43fc-b5d4-64dc023f09c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089764 Oct 27 18:49:47.206228 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 599/1229] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:47.227650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-58906423-2148-4bfb-a281-76b6263278ad req-76f6f572-47b0-44e1-850d-eab7a448bfa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd25663-2c8a-4c1f-b5e3-231e38afed4c", "name": "network-vif-deleted", "tag": "0cc38cfe-0045-4c12-a338-86776d8cd938"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:47.242073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-58906423-2148-4bfb-a281-76b6263278ad req-76f6f572-47b0-44e1-850d-eab7a448bfa3 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:47.242686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-58906423-2148-4bfb-a281-76b6263278ad req-76f6f572-47b0-44e1-850d-eab7a448bfa3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:47.243516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-58906423-2148-4bfb-a281-76b6263278ad req-76f6f572-47b0-44e1-850d-eab7a448bfa3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:47.262185 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-58906423-2148-4bfb-a281-76b6263278ad req-76f6f572-47b0-44e1-850d-eab7a448bfa3 service nova] Creating event network-vif-deleted:0cc38cfe-0045-4c12-a338-86776d8cd938 for instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c on n-h1-860687-3 Oct 27 18:49:47.271107 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-58906423-2148-4bfb-a281-76b6263278ad req-76f6f572-47b0-44e1-850d-eab7a448bfa3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061726 Oct 27 18:49:47.272293 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 600/1230] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:47.280394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3ccb2d5b-3e15-4984-be5e-178545406b83 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Action: 'create', calling method: .version_select at 0x7fc86ad9ac10>, body: {"security_group_rule": {"parent_group_id": "6fd4414b-bd2e-464b-b888-b92b5e21eeba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:47.604416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-a136b1ac-c750-45b1-a5ef-8cb3ddb95335 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Building network info cache for instance {{(pid=127028) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 18:49:47.673395 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3ccb2d5b-3e15-4984-be5e-178545406b83 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.398952 Oct 27 18:49:47.674005 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 601/1231] 10.222.0.42 () {60 vars in 1195 bytes} [Thu Oct 27 18:49:47 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:47.678691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-584945bc-ce6c-4fda-91a6-d9e9b910365b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:47.679582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-584945bc-ce6c-4fda-91a6-d9e9b910365b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:47.693478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-584945bc-ce6c-4fda-91a6-d9e9b910365b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:47.694791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-584945bc-ce6c-4fda-91a6-d9e9b910365b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:47.695848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-584945bc-ce6c-4fda-91a6-d9e9b910365b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:47.696788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-584945bc-ce6c-4fda-91a6-d9e9b910365b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:47.697772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-584945bc-ce6c-4fda-91a6-d9e9b910365b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:47.698414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-584945bc-ce6c-4fda-91a6-d9e9b910365b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:48.017935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-584945bc-ce6c-4fda-91a6-d9e9b910365b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:48.027469 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-584945bc-ce6c-4fda-91a6-d9e9b910365b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1542 microversion: 2.1 time: 0.352187 Oct 27 18:49:48.028528 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 602/1232] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:47 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1542 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:48.033346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-96ef761d-ab8f-4f64-a705-4ee001b27e0d req-15653167-a3ca-49d1-a03a-5b778eff27db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52680d12-70da-485a-b4a1-172a49b7b959", "name": "network-vif-deleted", "tag": "139bf86c-c95b-4317-8732-1c00618e5db8"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:48.045812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-96ef761d-ab8f-4f64-a705-4ee001b27e0d req-15653167-a3ca-49d1-a03a-5b778eff27db service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:48.046954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-96ef761d-ab8f-4f64-a705-4ee001b27e0d req-15653167-a3ca-49d1-a03a-5b778eff27db service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:48.047631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-96ef761d-ab8f-4f64-a705-4ee001b27e0d req-15653167-a3ca-49d1-a03a-5b778eff27db service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:48.072766 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-96ef761d-ab8f-4f64-a705-4ee001b27e0d req-15653167-a3ca-49d1-a03a-5b778eff27db service nova] Creating event network-vif-deleted:139bf86c-c95b-4317-8732-1c00618e5db8 for instance 52680d12-70da-485a-b4a1-172a49b7b959 on n-h1-860687-3 Oct 27 18:49:48.094143 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-96ef761d-ab8f-4f64-a705-4ee001b27e0d req-15653167-a3ca-49d1-a03a-5b778eff27db service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054227 Oct 27 18:49:48.095970 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 603/1233] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:48.105363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8349df9b-2136-4dda-a608-743f31959199 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:48.108044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8349df9b-2136-4dda-a608-743f31959199 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:48.116647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8349df9b-2136-4dda-a608-743f31959199 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:48.117715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8349df9b-2136-4dda-a608-743f31959199 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:48.118376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8349df9b-2136-4dda-a608-743f31959199 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:48.119971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8349df9b-2136-4dda-a608-743f31959199 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:48.120862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8349df9b-2136-4dda-a608-743f31959199 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:48.121537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8349df9b-2136-4dda-a608-743f31959199 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:48.348848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8349df9b-2136-4dda-a608-743f31959199 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:48.373491 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8349df9b-2136-4dda-a608-743f31959199 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1316 microversion: 2.1 time: 0.260938 Oct 27 18:49:48.377248 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 604/1234] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:48 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:48.383796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3f051839-10eb-4492-834d-6bd1e7d5285a tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Action: 'create', calling method: .version_select at 0x7fc86ad9a700>, body: {"security_group_rule": {"parent_group_id": "6fd4414b-bd2e-464b-b888-b92b5e21eeba", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:48.719643 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3f051839-10eb-4492-834d-6bd1e7d5285a tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.341023 Oct 27 18:49:48.720245 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 605/1235] 10.222.0.42 () {60 vars in 1195 bytes} [Thu Oct 27 18:49:48 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:48.726370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-696acbee-7026-49e9-9481-b5ea61f86b55 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:48.727721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-696acbee-7026-49e9-9481-b5ea61f86b55 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 9fd25663-2c8a-4c1f-b5e3-231e38afed4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:48.736654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-696acbee-7026-49e9-9481-b5ea61f86b55 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:48.737174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-696acbee-7026-49e9-9481-b5ea61f86b55 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:48.738283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-696acbee-7026-49e9-9481-b5ea61f86b55 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:48.739084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-696acbee-7026-49e9-9481-b5ea61f86b55 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:48.739558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-696acbee-7026-49e9-9481-b5ea61f86b55 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:48.740051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-696acbee-7026-49e9-9481-b5ea61f86b55 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:48.755936 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-696acbee-7026-49e9-9481-b5ea61f86b55 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] HTTP exception thrown: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-696acbee-7026-49e9-9481-b5ea61f86b55 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Request method failure captured: Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c HTTP/1.1 Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtKiXEumbw4w9vI3EnDpsApwTBMd5wSRCdFBmxO1Yutz4XEIZehE2ZpuSsKXVghur3HqZcTSCtk3McmsOabzqKxdwJrdVnuJv0zZYPH3e5GTqlhSeHY1OX1v_YjKShlDjyRLeFbHUnnbsyxtXzaZlgkg6Jx_cORdrSgGQ9tEHjFkrCk Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_60af6e89111c4ea886cd03dfd18e20d1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ab0bd7aab43d43d2b172fcd4935813f9 Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '9fd25663-2c8a-4c1f-b5e3-231e38afed4c'} Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:48.757643 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:48.764549 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:48.764549 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:48.764549 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:48.764549 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:48.764549 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:48.764549 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:48.764549 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:49:48.764549 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:48.766663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-696acbee-7026-49e9-9481-b5ea61f86b55 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Returning 404 to user: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:48.767713 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-696acbee-7026-49e9-9481-b5ea61f86b55 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c" status: 404 len: 111 microversion: 2.1 time: 0.045820 Oct 27 18:49:48.773371 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 606/1236] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:48 2022] GET /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:49:48.782357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13dfc539-c937-42e6-889c-be70d195260a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:48.783017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-13dfc539-c937-42e6-889c-be70d195260a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:48.789458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dfc539-c937-42e6-889c-be70d195260a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:48.789950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dfc539-c937-42e6-889c-be70d195260a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:48.791160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dfc539-c937-42e6-889c-be70d195260a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:48.791895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dfc539-c937-42e6-889c-be70d195260a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:48.795145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dfc539-c937-42e6-889c-be70d195260a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:48.795931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dfc539-c937-42e6-889c-be70d195260a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:48.840328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dfc539-c937-42e6-889c-be70d195260a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:48.840850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dfc539-c937-42e6-889c-be70d195260a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:48.841483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dfc539-c937-42e6-889c-be70d195260a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:48.841958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-13dfc539-c937-42e6-889c-be70d195260a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lazy-loading 'fault' on Instance uuid 52680d12-70da-485a-b4a1-172a49b7b959 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:49:48.878644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-a136b1ac-c750-45b1-a5ef-8cb3ddb95335 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Updating instance_info_cache with network_info: [{"id": "a8a13994-bd8c-4fec-909b-fef9e45546f0", "address": "fa:16:3e:93:ef:f1", "network": {"id": "41cb3454-066d-4fcf-bf2e-ef5cb51d55c0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1462812452-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d7e4d40daccf4e27a5e61093cd62dea8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa8a13994-bd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127028) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 18:49:48.939628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a136b1ac-c750-45b1-a5ef-8cb3ddb95335 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Releasing lock "refresh_cache-5ef3dc71-9730-4658-aa69-ff8704cdfb8c" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 18:49:48.941033 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a136b1ac-c750-45b1-a5ef-8cb3ddb95335 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "POST /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c/action" status: 202 len: 0 microversion: 2.1 time: 5.404914 Oct 27 18:49:48.941179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-13dfc539-c937-42e6-889c-be70d195260a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ce178d2f1b40ecbf7dd294d7da4748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f935076689d74e1e9089d516caca1cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:48.943112 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 631/1237] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:49:43 2022] POST /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c/action => generated 0 bytes in 5416 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 18:49:48.953101 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13dfc539-c937-42e6-889c-be70d195260a tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 200 len: 1331 microversion: 2.1 time: 0.177731 Oct 27 18:49:48.953748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd50abdf-cd62-4bd5-b1da-39589cd1c3a6 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Calling method '.version_select at 0x7fc86ad55550>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:48.956378 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 607/1238] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:48 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 1331 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:48.965918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0a34e866-6c85-4009-bfdd-6b63e6ddb929 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:48.972705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0a34e866-6c85-4009-bfdd-6b63e6ddb929 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:48.973750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0a34e866-6c85-4009-bfdd-6b63e6ddb929 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '60af6e89111c4ea886cd03dfd18e20d1'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:49:48.983357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a34e866-6c85-4009-bfdd-6b63e6ddb929 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:48.983934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a34e866-6c85-4009-bfdd-6b63e6ddb929 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:48.984477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a34e866-6c85-4009-bfdd-6b63e6ddb929 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:48.985297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a34e866-6c85-4009-bfdd-6b63e6ddb929 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:48.985766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a34e866-6c85-4009-bfdd-6b63e6ddb929 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:48.986202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a34e866-6c85-4009-bfdd-6b63e6ddb929 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:49.076145 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dd50abdf-cd62-4bd5-b1da-39589cd1c3a6 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/6fd4414b-bd2e-464b-b888-b92b5e21eeba" status: 200 len: 664 microversion: 2.1 time: 0.131561 Oct 27 18:49:49.076745 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 632/1239] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 18:49:48 2022] GET /compute/v2.1/os-security-groups/6fd4414b-bd2e-464b-b888-b92b5e21eeba => generated 664 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:49.081756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.121"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:49.091538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:49.103698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:49.104607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:49.105234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:49.106152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:49.106653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:49.107087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:49.185391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "refresh_cache-544f4ef4-fdfc-4e55-a247-7c210300d932" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 18:49:49.186199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquired lock "refresh_cache-544f4ef4-fdfc-4e55-a247-7c210300d932" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 18:49:49.441491 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0a34e866-6c85-4009-bfdd-6b63e6ddb929 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.483714 Oct 27 18:49:49.451664 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 608/1240] 10.222.0.42 () {58 vars in 1230 bytes} [Thu Oct 27 18:49:48 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:49:49.457572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5354d3cc-9827-49aa-bb3c-b83c549c9c69 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:49.458727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5354d3cc-9827-49aa-bb3c-b83c549c9c69 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:49.467527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5354d3cc-9827-49aa-bb3c-b83c549c9c69 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:49.468332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5354d3cc-9827-49aa-bb3c-b83c549c9c69 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:49.468942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5354d3cc-9827-49aa-bb3c-b83c549c9c69 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:49.469874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5354d3cc-9827-49aa-bb3c-b83c549c9c69 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:49.470527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5354d3cc-9827-49aa-bb3c-b83c549c9c69 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:49.471958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5354d3cc-9827-49aa-bb3c-b83c549c9c69 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:49.644834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5354d3cc-9827-49aa-bb3c-b83c549c9c69 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:49.653487 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5354d3cc-9827-49aa-bb3c-b83c549c9c69 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1542 microversion: 2.1 time: 0.200272 Oct 27 18:49:49.654059 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 609/1241] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:49 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1542 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:49.659063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-747276c5-e5ea-4486-a924-20e5f7cd6c35 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Calling method '.version_select at 0x7fc86ad081f0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:49.825135 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-747276c5-e5ea-4486-a924-20e5f7cd6c35 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-group-rules/59d3700b-e20b-4fa0-aca9-1e9f2879193a" status: 202 len: 0 microversion: 2.1 time: 0.169530 Oct 27 18:49:49.825722 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 610/1242] 10.222.0.42 () {58 vars in 1287 bytes} [Thu Oct 27 18:49:49 2022] DELETE /compute/v2.1/os-security-group-rules/59d3700b-e20b-4fa0-aca9-1e9f2879193a => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:49.831226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5744af96-10d3-4e73-9ff1-970cdbb9be4a req-1ee5b0b9-04ad-4182-95ab-e15bd6b232fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef3dc71-9730-4658-aa69-ff8704cdfb8c", "tag": "a8a13994-bd8c-4fec-909b-fef9e45546f0"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:49.842576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5744af96-10d3-4e73-9ff1-970cdbb9be4a req-1ee5b0b9-04ad-4182-95ab-e15bd6b232fb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:49.843065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5744af96-10d3-4e73-9ff1-970cdbb9be4a req-1ee5b0b9-04ad-4182-95ab-e15bd6b232fb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:49.843552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5744af96-10d3-4e73-9ff1-970cdbb9be4a req-1ee5b0b9-04ad-4182-95ab-e15bd6b232fb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:49.857234 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5744af96-10d3-4e73-9ff1-970cdbb9be4a req-1ee5b0b9-04ad-4182-95ab-e15bd6b232fb service nova] Creating event network-changed:a8a13994-bd8c-4fec-909b-fef9e45546f0 for instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c on n-h2-860687-3 Oct 27 18:49:49.862486 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5744af96-10d3-4e73-9ff1-970cdbb9be4a req-1ee5b0b9-04ad-4182-95ab-e15bd6b232fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035100 Oct 27 18:49:49.863571 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 611/1243] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:49.869283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-99a38a61-e5d4-416d-9539-c43ad7b9da13 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:49.870399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-99a38a61-e5d4-416d-9539-c43ad7b9da13 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:49.877094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99a38a61-e5d4-416d-9539-c43ad7b9da13 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:49.877846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99a38a61-e5d4-416d-9539-c43ad7b9da13 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:49.878540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99a38a61-e5d4-416d-9539-c43ad7b9da13 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:49.879454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99a38a61-e5d4-416d-9539-c43ad7b9da13 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:49.880108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99a38a61-e5d4-416d-9539-c43ad7b9da13 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:49.880740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99a38a61-e5d4-416d-9539-c43ad7b9da13 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:50.044709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-99a38a61-e5d4-416d-9539-c43ad7b9da13 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:50.054494 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-99a38a61-e5d4-416d-9539-c43ad7b9da13 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1504 microversion: 2.1 time: 0.189361 Oct 27 18:49:50.055257 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 612/1244] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:49 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:50.318584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e4c49224-8370-4fb6-aa6f-8743d825fd77 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Action: 'create', calling method: .version_select at 0x7fc86ad08af0>, body: {"keypair": {"name": "tempest-keypair-1357184221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuX6ovu+LFV9U4irJY/AVs2jgG4QiM24vVRJ+ONq7lOIK4lgl5QeBIFxbvhOyhbhH8MyWIL0bDV89RWuT83gvR+ANr33ybaoz7PswzO8Etn1mosnbgp1woCFm3OyvUO5w=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:50.335123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-e4c49224-8370-4fb6-aa6f-8743d825fd77 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Getting quotas for project 366d94ed2eb14e759c191e32c65b187a. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:49:50.339471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-e4c49224-8370-4fb6-aa6f-8743d825fd77 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Getting quotas for user 878d41625de6498283fde8fb05a4bbf6 and project 366d94ed2eb14e759c191e32c65b187a. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:49:50.370897 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e4c49224-8370-4fb6-aa6f-8743d825fd77 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.314187 Oct 27 18:49:50.371511 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 613/1245] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:49:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:50.377915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c0fc3ff4-2b20-4e60-ad63-cec71c812bdc tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c0fc3ff4-2b20-4e60-ad63-cec71c812bdc tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Request method failure captured: Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtKiXEumbw4w9vI3EnDpsApwTBMd5wSRCdFBmxO1Yutz4XEIZehE2ZpuSsKXVghur3HqZcTSCtk3McmsOabzqKxdwJrdVnuJv0zZYPH3e5GTqlhSeHY1OX1v_YjKShlDjyRLeFbHUnnbsyxtXzaZlgkg6Jx_cORdrSgGQ9tEHjFkrCk Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_60af6e89111c4ea886cd03dfd18e20d1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ab0bd7aab43d43d2b172fcd4935813f9 Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: action_args: {} Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 27 18:49:50.383021 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:50.387564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c0fc3ff4-2b20-4e60-ad63-cec71c812bdc tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:50.389500 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c0fc3ff4-2b20-4e60-ad63-cec71c812bdc tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.015391 Oct 27 18:49:50.395316 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 614/1246] 10.222.0.42 () {58 vars in 1182 bytes} [Thu Oct 27 18:49:50 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:49:50.398343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce59486b-24b6-4aff-9b28-456c6ab98dac tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Calling method '.version_select at 0x7fc86af91dc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:50.763421 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce59486b-24b6-4aff-9b28-456c6ab98dac tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/6fd4414b-bd2e-464b-b888-b92b5e21eeba" status: 202 len: 0 microversion: 2.1 time: 0.372043 Oct 27 18:49:50.764933 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 615/1247] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:50 2022] DELETE /compute/v2.1/os-security-groups/6fd4414b-bd2e-464b-b888-b92b5e21eeba => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:50.780675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-317966ca-2eba-4dba-b2f5-efc0ce4ead69 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:50.782717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-317966ca-2eba-4dba-b2f5-efc0ce4ead69 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:50.808309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-317966ca-2eba-4dba-b2f5-efc0ce4ead69 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:50.809246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-317966ca-2eba-4dba-b2f5-efc0ce4ead69 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:50.810516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-317966ca-2eba-4dba-b2f5-efc0ce4ead69 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:50.814172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-317966ca-2eba-4dba-b2f5-efc0ce4ead69 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:50.815415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-317966ca-2eba-4dba-b2f5-efc0ce4ead69 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:50.816112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-317966ca-2eba-4dba-b2f5-efc0ce4ead69 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:50.854403 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-317966ca-2eba-4dba-b2f5-efc0ce4ead69 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] HTTP exception thrown: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-317966ca-2eba-4dba-b2f5-efc0ce4ead69 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Request method failure captured: Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 HTTP/1.1 Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtImBwzJd29xqm1Hw5vl2Y7iRGG9bs0BUQYGf8a5lggKK4YtWIfI7H30usqmngE0QpTMy9LcFe3LgjjKbtfW2V0Cbc42nGsLPuFJKQ3Lw9C4GhwYyqj60Fa9SVQGn0icfGbGbFj03SsFKwEJlEoWEJGjWsV0Wozvd9_0l4TyTB4Fy_E Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f935076689d74e1e9089d516caca1cc4 Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-651785775 Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f935076689d74e1e9089d516caca1cc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f935076689d74e1e9089d516caca1cc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f935076689d74e1e9089d516caca1cc4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f935076689d74e1e9089d516caca1cc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-651785775 Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f935076689d74e1e9089d516caca1cc4 Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-651785775 Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachSCSIVolumeTestJSON-651785775-project Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 18ce178d2f1b40ecbf7dd294d7da4748 Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-651785775-project Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '52680d12-70da-485a-b4a1-172a49b7b959'} Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:50.856862 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:50.861476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:50.861476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:50.861476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:50.861476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:50.861476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:50.861476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:49:50.861476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:50.863283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-317966ca-2eba-4dba-b2f5-efc0ce4ead69 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Returning 404 to user: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:50.864685 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-317966ca-2eba-4dba-b2f5-efc0ce4ead69 tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 404 len: 111 microversion: 2.1 time: 0.093505 Oct 27 18:49:50.865439 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 616/1248] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:50 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:49:50.871488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84dc1492-dc84-47d6-b8ea-c849690b14b9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-972295710"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:50.872300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-84dc1492-dc84-47d6-b8ea-c849690b14b9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:50.879145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84dc1492-dc84-47d6-b8ea-c849690b14b9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:50.880075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84dc1492-dc84-47d6-b8ea-c849690b14b9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:50.880750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84dc1492-dc84-47d6-b8ea-c849690b14b9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:50.881691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84dc1492-dc84-47d6-b8ea-c849690b14b9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:50.882358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84dc1492-dc84-47d6-b8ea-c849690b14b9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:50.883213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84dc1492-dc84-47d6-b8ea-c849690b14b9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:51.067900 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.network.security_group_api [None req-84dc1492-dc84-47d6-b8ea-c849690b14b9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Adding security group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 to port 4776f52b-b794-46a8-b2e7-8668af766e21 Oct 27 18:49:51.623562 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-84dc1492-dc84-47d6-b8ea-c849690b14b9 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123/action" status: 202 len: 0 microversion: 2.1 time: 0.756788 Oct 27 18:49:51.627520 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 617/1249] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:49:50 2022] POST /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:51.630530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b0158539-cb1d-403f-869d-ae3e3da43e0a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:51.638970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b0158539-cb1d-403f-869d-ae3e3da43e0a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:51.639774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b0158539-cb1d-403f-869d-ae3e3da43e0a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Searching by: {'deleted': False, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:49:51.654934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0158539-cb1d-403f-869d-ae3e3da43e0a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:51.655731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0158539-cb1d-403f-869d-ae3e3da43e0a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:51.656427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0158539-cb1d-403f-869d-ae3e3da43e0a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:51.657392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0158539-cb1d-403f-869d-ae3e3da43e0a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:51.659783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0158539-cb1d-403f-869d-ae3e3da43e0a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:51.660468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0158539-cb1d-403f-869d-ae3e3da43e0a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:51.720744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-b0158539-cb1d-403f-869d-ae3e3da43e0a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:49:51.858576 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b0158539-cb1d-403f-869d-ae3e3da43e0a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.229138 Oct 27 18:49:51.865794 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 618/1250] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 18:49:51 2022] GET /compute/v2.1/servers => generated 681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:51.870526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2cb3f200-284e-4f53-a8d8-32d748b03bdd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:51.871175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2cb3f200-284e-4f53-a8d8-32d748b03bdd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:51.889252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2cb3f200-284e-4f53-a8d8-32d748b03bdd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:51.889767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2cb3f200-284e-4f53-a8d8-32d748b03bdd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:51.890937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2cb3f200-284e-4f53-a8d8-32d748b03bdd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:51.891699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2cb3f200-284e-4f53-a8d8-32d748b03bdd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:51.894024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2cb3f200-284e-4f53-a8d8-32d748b03bdd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:51.894766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2cb3f200-284e-4f53-a8d8-32d748b03bdd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:51.906861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:52.047827 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.network.neutron [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] re-assign floating IP 172.25.9.121 from instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c Oct 27 18:49:52.396934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2cb3f200-284e-4f53-a8d8-32d748b03bdd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:52.405549 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2cb3f200-284e-4f53-a8d8-32d748b03bdd tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1541 microversion: 2.1 time: 0.543983 Oct 27 18:49:52.406151 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 619/1251] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:51 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1541 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:52.421350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-383f3f74-6e6f-4a46-aa5e-a546affba6b5 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Calling method '.version_select at 0x7fc86afc81f0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:52.444521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Building network info cache for instance {{(pid=127028) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 18:49:52.539504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-383f3f74-6e6f-4a46-aa5e-a546affba6b5 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 185cd37a-5980-491c-b360-91f651eced35 does not exist", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:49:52.541077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.security_group_api [None req-383f3f74-6e6f-4a46-aa5e-a546affba6b5 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Neutron security group 185cd37a-5980-491c-b360-91f651eced35 not found {{(pid=127029) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:49:52.541991 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-383f3f74-6e6f-4a46-aa5e-a546affba6b5 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] HTTP exception thrown: Security group 185cd37a-5980-491c-b360-91f651eced35 does not exist Oct 27 18:49:52.541991 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-aa510650-12b2-4b02-acce-a6218e45f85e'] Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-383f3f74-6e6f-4a46-aa5e-a546affba6b5 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Request method failure captured: Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-security-groups/185cd37a-5980-491c-b360-91f651eced35 HTTP/1.1 Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtK_nWZtEcS1u2gZiX7zdnPeSpDSbE16WdlBAyTsNHfBwFMzRk3dFuowVh27sKc_0h-39PZ3EbF65NmffaMTRjX9ESSzXx_Nw87mDq045_OQ1rseLCvj8eLLp6-PQBQP2m3JnR5WduOPCCerg_qStP-TVrbes8YXHqqrQl9LOid3oJ0 Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ba8b4178fab14a718968099a91a134ff Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-598965226 Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ba8b4178fab14a718968099a91a134ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ba8b4178fab14a718968099a91a134ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ba8b4178fab14a718968099a91a134ff", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ba8b4178fab14a718968099a91a134ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupRulesTestJSON-598965226 Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ba8b4178fab14a718968099a91a134ff Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-598965226 Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupRulesTestJSON-598965226-project Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 7788baf0c7754c879287e3aca7090b92 Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupRulesTestJSON-598965226-project Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: exception: Security group 185cd37a-5980-491c-b360-91f651eced35 does not exist Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-aa510650-12b2-4b02-acce-a6218e45f85e'] Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '185cd37a-5980-491c-b360-91f651eced35'} Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:49:52.544717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 185cd37a-5980-491c-b360-91f651eced35 does not exist Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa510650-12b2-4b02-acce-a6218e45f85e'] Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 185cd37a-5980-491c-b360-91f651eced35 does not exist Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa510650-12b2-4b02-acce-a6218e45f85e'] Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 185cd37a-5980-491c-b360-91f651eced35 does not exist Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa510650-12b2-4b02-acce-a6218e45f85e'] Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 185cd37a-5980-491c-b360-91f651eced35 does not exist Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa510650-12b2-4b02-acce-a6218e45f85e'] Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-383f3f74-6e6f-4a46-aa5e-a546affba6b5 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Returning 404 to user: Security group 185cd37a-5980-491c-b360-91f651eced35 does not exist Oct 27 18:49:52.552264 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-aa510650-12b2-4b02-acce-a6218e45f85e'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:52.560884 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-383f3f74-6e6f-4a46-aa5e-a546affba6b5 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/185cd37a-5980-491c-b360-91f651eced35" status: 404 len: 194 microversion: 2.1 time: 0.138056 Oct 27 18:49:52.560884 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 620/1252] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:52 2022] DELETE /compute/v2.1/os-security-groups/185cd37a-5980-491c-b360-91f651eced35 => generated 194 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:49:52.577306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-22b1aac9-bbd9-444a-aef5-0d42f451b8be tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '.version_select at 0x7fc86ad35280>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:52.601467 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-22b1aac9-bbd9-444a-aef5-0d42f451b8be tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-923557536" status: 202 len: 0 microversion: 2.1 time: 0.032375 Oct 27 18:49:52.607173 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 621/1253] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Oct 27 18:49:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-923557536 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:52.616940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6901acee-d773-4047-abd1-6b20a22c0a1a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:52.617664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6901acee-d773-4047-abd1-6b20a22c0a1a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:52.631523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6901acee-d773-4047-abd1-6b20a22c0a1a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:52.632160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6901acee-d773-4047-abd1-6b20a22c0a1a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:52.632682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6901acee-d773-4047-abd1-6b20a22c0a1a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:52.633694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6901acee-d773-4047-abd1-6b20a22c0a1a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:52.634452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6901acee-d773-4047-abd1-6b20a22c0a1a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:52.635127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6901acee-d773-4047-abd1-6b20a22c0a1a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:53.224965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-6901acee-d773-4047-abd1-6b20a22c0a1a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 26d5439d-efc3-4e29-a439-7b8b40177342 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:49:53.253949 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6901acee-d773-4047-abd1-6b20a22c0a1a tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 2418 microversion: 2.25 time: 0.645370 Oct 27 18:49:53.266803 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 622/1254] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:49:52 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 2418 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:49:53.280106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b8fc5215-d989-43e9-8a2a-9d3fc9cf475d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86b007c10>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:53.708607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Updating instance_info_cache with network_info: [{"id": "a8a13994-bd8c-4fec-909b-fef9e45546f0", "address": "fa:16:3e:93:ef:f1", "network": {"id": "41cb3454-066d-4fcf-bf2e-ef5cb51d55c0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1462812452-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d7e4d40daccf4e27a5e61093cd62dea8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa8a13994-bd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127028) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 18:49:53.724963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Building network info cache for instance {{(pid=127028) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 18:49:54.088426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-b8fc5215-d989-43e9-8a2a-9d3fc9cf475d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 in use.", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:49:54.090598 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-b8fc5215-d989-43e9-8a2a-9d3fc9cf475d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Security Group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 in use. Oct 27 18:49:54.090598 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-f93c000e-06e1-4f77-a0cb-7a1d7b13483c'] Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b8fc5215-d989-43e9-8a2a-9d3fc9cf475d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-security-groups/56e48ef1-e38b-434b-b89c-897dbe14f9e2 HTTP/1.1 Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: exception: Security Group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 in use. Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-f93c000e-06e1-4f77-a0cb-7a1d7b13483c'] Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '56e48ef1-e38b-434b-b89c-897dbe14f9e2'} Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:49:54.095142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 in use. Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f93c000e-06e1-4f77-a0cb-7a1d7b13483c'] Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 in use. Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f93c000e-06e1-4f77-a0cb-7a1d7b13483c'] Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 in use. Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f93c000e-06e1-4f77-a0cb-7a1d7b13483c'] Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 in use. Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f93c000e-06e1-4f77-a0cb-7a1d7b13483c'] Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b8fc5215-d989-43e9-8a2a-9d3fc9cf475d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 400 to user: Security Group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 in use. Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-f93c000e-06e1-4f77-a0cb-7a1d7b13483c'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b8fc5215-d989-43e9-8a2a-9d3fc9cf475d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/56e48ef1-e38b-434b-b89c-897dbe14f9e2" status: 400 len: 185 microversion: 2.1 time: 0.829834 Oct 27 18:49:54.100283 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 623/1255] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:53 2022] DELETE /compute/v2.1/os-security-groups/56e48ef1-e38b-434b-b89c-897dbe14f9e2 => generated 185 bytes in 832 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:49:54.116658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-0d5650f5-d649-4cc1-bf0f-6f92dd469733 req-9b89c527-5faa-42be-a05a-1faea8af3f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2f8430-f7aa-4b29-b980-d0860fcc7123", "tag": "4776f52b-b794-46a8-b2e7-8668af766e21"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:54.183993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0d5650f5-d649-4cc1-bf0f-6f92dd469733 req-9b89c527-5faa-42be-a05a-1faea8af3f4c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:54.184496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0d5650f5-d649-4cc1-bf0f-6f92dd469733 req-9b89c527-5faa-42be-a05a-1faea8af3f4c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:54.185999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0d5650f5-d649-4cc1-bf0f-6f92dd469733 req-9b89c527-5faa-42be-a05a-1faea8af3f4c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:54.209512 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-0d5650f5-d649-4cc1-bf0f-6f92dd469733 req-9b89c527-5faa-42be-a05a-1faea8af3f4c service nova] Creating event network-changed:4776f52b-b794-46a8-b2e7-8668af766e21 for instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 on n-h1-860687-3 Oct 27 18:49:54.224714 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-0d5650f5-d649-4cc1-bf0f-6f92dd469733 req-9b89c527-5faa-42be-a05a-1faea8af3f4c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114398 Oct 27 18:49:54.225191 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 624/1256] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:54.242986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-74aa18d0-53c6-41fa-bba1-009b8940ea13 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:54.258143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-74aa18d0-53c6-41fa-bba1-009b8940ea13 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:54.259862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.compute.servers [None req-74aa18d0-53c6-41fa-bba1-009b8940ea13 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Removing options 'limit' from query {{(pid=127029) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 18:49:54.263546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-74aa18d0-53c6-41fa-bba1-009b8940ea13 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Searching by: {'deleted': False, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:49:54.316452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74aa18d0-53c6-41fa-bba1-009b8940ea13 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:54.317026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74aa18d0-53c6-41fa-bba1-009b8940ea13 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:54.317483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74aa18d0-53c6-41fa-bba1-009b8940ea13 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:54.318283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74aa18d0-53c6-41fa-bba1-009b8940ea13 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:54.318896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74aa18d0-53c6-41fa-bba1-009b8940ea13 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:54.319333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74aa18d0-53c6-41fa-bba1-009b8940ea13 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:54.352621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-74aa18d0-53c6-41fa-bba1-009b8940ea13 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:49:54.418771 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-74aa18d0-53c6-41fa-bba1-009b8940ea13 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.187453 Oct 27 18:49:54.429691 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 625/1257] 10.222.0.42 () {58 vars in 1144 bytes} [Thu Oct 27 18:49:54 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:54.429691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-8b45b924-e5b8-44d3-aa6c-065e79bcfba4 req-f509732a-b6c6-4415-a3fb-7e42037e9890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef3dc71-9730-4658-aa69-ff8704cdfb8c", "tag": "a8a13994-bd8c-4fec-909b-fef9e45546f0"}, {"name": "network-changed", "server_uuid": "544f4ef4-fdfc-4e55-a247-7c210300d932", "tag": "50d7433e-4e6d-4e9a-9b35-21b455c67c5e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:54.459237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8b45b924-e5b8-44d3-aa6c-065e79bcfba4 req-f509732a-b6c6-4415-a3fb-7e42037e9890 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:54.459828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8b45b924-e5b8-44d3-aa6c-065e79bcfba4 req-f509732a-b6c6-4415-a3fb-7e42037e9890 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:54.463273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8b45b924-e5b8-44d3-aa6c-065e79bcfba4 req-f509732a-b6c6-4415-a3fb-7e42037e9890 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:54.505888 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8b45b924-e5b8-44d3-aa6c-065e79bcfba4 req-f509732a-b6c6-4415-a3fb-7e42037e9890 service nova] Creating event network-changed:a8a13994-bd8c-4fec-909b-fef9e45546f0 for instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c on n-h2-860687-3 Oct 27 18:49:54.509506 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8b45b924-e5b8-44d3-aa6c-065e79bcfba4 req-f509732a-b6c6-4415-a3fb-7e42037e9890 service nova] Creating event network-changed:50d7433e-4e6d-4e9a-9b35-21b455c67c5e for instance 544f4ef4-fdfc-4e55-a247-7c210300d932 on n-h2-860687-3 Oct 27 18:49:54.524611 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-8b45b924-e5b8-44d3-aa6c-065e79bcfba4 req-f509732a-b6c6-4415-a3fb-7e42037e9890 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.099014 Oct 27 18:49:54.526214 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 626/1258] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:54.546700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b8f570d-4756-4de8-874c-53411388e677 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Calling method '.version_select at 0x7fc86ad274c0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:55.387212 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1b8f570d-4756-4de8-874c-53411388e677 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/0d113d44-ffa4-42bd-97ce-40ff9f40ec6c" status: 202 len: 0 microversion: 2.1 time: 0.857751 Oct 27 18:49:55.387798 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 627/1259] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:54 2022] DELETE /compute/v2.1/os-security-groups/0d113d44-ffa4-42bd-97ce-40ff9f40ec6c => generated 0 bytes in 861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:55.406066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-16a42abf-67cc-43f9-b0b3-67ab9fde11c3 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860687-3", "block_migration": "auto"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:55.414629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-16a42abf-67cc-43f9-b0b3-67ab9fde11c3 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:55.422255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16a42abf-67cc-43f9-b0b3-67ab9fde11c3 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:55.423131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16a42abf-67cc-43f9-b0b3-67ab9fde11c3 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:55.423737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16a42abf-67cc-43f9-b0b3-67ab9fde11c3 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:55.424623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16a42abf-67cc-43f9-b0b3-67ab9fde11c3 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:55.425249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16a42abf-67cc-43f9-b0b3-67ab9fde11c3 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:55.425847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16a42abf-67cc-43f9-b0b3-67ab9fde11c3 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:55.467461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-16a42abf-67cc-43f9-b0b3-67ab9fde11c3 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'flavor' on Instance uuid 26d5439d-efc3-4e29-a439-7b8b40177342 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:49:55.484574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-16a42abf-67cc-43f9-b0b3-67ab9fde11c3 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Going to try to live migrate instance to n-h2-860687-3 {{(pid=127029) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 18:49:55.496928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Updating instance_info_cache with network_info: [{"id": "50d7433e-4e6d-4e9a-9b35-21b455c67c5e", "address": "fa:16:3e:8b:84:98", "network": {"id": "41cb3454-066d-4fcf-bf2e-ef5cb51d55c0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1462812452-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d7e4d40daccf4e27a5e61093cd62dea8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap50d7433e-4e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127028) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 18:49:55.501095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:49:55.568391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Releasing lock "refresh_cache-544f4ef4-fdfc-4e55-a247-7c210300d932" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 18:49:55.577970 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-365c9d2e-887d-4fbd-9752-c52f34ea6287 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "POST /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932/action" status: 202 len: 0 microversion: 2.1 time: 6.500073 Oct 27 18:49:55.583838 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 633/1260] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:49:49 2022] POST /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932/action => generated 0 bytes in 6507 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 18:49:55.608051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2035fc92-99d0-45f8-99ce-f38fdbcf27b9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:55.608676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2035fc92-99d0-45f8-99ce-f38fdbcf27b9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:55.637327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2035fc92-99d0-45f8-99ce-f38fdbcf27b9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:55.637836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2035fc92-99d0-45f8-99ce-f38fdbcf27b9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:55.650057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2035fc92-99d0-45f8-99ce-f38fdbcf27b9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:55.650973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2035fc92-99d0-45f8-99ce-f38fdbcf27b9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:55.651451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2035fc92-99d0-45f8-99ce-f38fdbcf27b9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:55.651881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2035fc92-99d0-45f8-99ce-f38fdbcf27b9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:56.095212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2035fc92-99d0-45f8-99ce-f38fdbcf27b9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:56.123837 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2035fc92-99d0-45f8-99ce-f38fdbcf27b9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1541 microversion: 2.1 time: 0.533974 Oct 27 18:49:56.138992 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 634/1261] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:55 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1541 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:56.151627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03fd2ba5-e7a3-487a-99f9-e50e1f7c9eef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:56.166590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-03fd2ba5-e7a3-487a-99f9-e50e1f7c9eef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:56.191981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03fd2ba5-e7a3-487a-99f9-e50e1f7c9eef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:56.192497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03fd2ba5-e7a3-487a-99f9-e50e1f7c9eef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:56.192958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03fd2ba5-e7a3-487a-99f9-e50e1f7c9eef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:56.193701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03fd2ba5-e7a3-487a-99f9-e50e1f7c9eef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:56.194175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03fd2ba5-e7a3-487a-99f9-e50e1f7c9eef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:56.194644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03fd2ba5-e7a3-487a-99f9-e50e1f7c9eef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:56.308513 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-03fd2ba5-e7a3-487a-99f9-e50e1f7c9eef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123/action" status: 202 len: 0 microversion: 2.1 time: 0.167416 Oct 27 18:49:56.309533 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 635/1262] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:49:56 2022] POST /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:56.324201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-24507a7d-2ef7-4f66-b883-8ce3a6cbe050 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-24507a7d-2ef7-4f66-b883-8ce3a6cbe050 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Request method failure captured: Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKiXEumbw4w9vI3EnDpsApwTBMd5wSRCdFBmxO1Yutz4XEIZehE2ZpuSsKXVghur3HqZcTSCtk3McmsOabzqKxdwJrdVnuJv0zZYPH3e5GTqlhSeHY1OX1v_YjKShlDjyRLeFbHUnnbsyxtXzaZlgkg6Jx_cORdrSgGQ9tEHjFkrCk Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_60af6e89111c4ea886cd03dfd18e20d1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ab0bd7aab43d43d2b172fcd4935813f9 Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: action_args: {} Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi '-1' Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 27 18:49:56.329391 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 27 18:49:56.333631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:56.337473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-24507a7d-2ef7-4f66-b883-8ce3a6cbe050 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:56.338819 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-24507a7d-2ef7-4f66-b883-8ce3a6cbe050 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.022392 Oct 27 18:49:56.340075 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 636/1263] 10.222.0.42 () {58 vars in 1142 bytes} [Thu Oct 27 18:49:56 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:49:56.352189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-69284193-e6d5-452e-b91c-20da282eac18 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Calling method '.version_select at 0x7fc86ac3fee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:57.052622 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-69284193-e6d5-452e-b91c-20da282eac18 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/f3e6130f-37f4-4784-98b7-f108463acf1f" status: 202 len: 0 microversion: 2.1 time: 0.704722 Oct 27 18:49:57.055242 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 637/1264] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:56 2022] DELETE /compute/v2.1/os-security-groups/f3e6130f-37f4-4784-98b7-f108463acf1f => generated 0 bytes in 708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:57.061572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-442bb657-4982-4d09-b363-e6e87a759b4b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.121"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:57.277544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-442bb657-4982-4d09-b363-e6e87a759b4b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:57.285420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-442bb657-4982-4d09-b363-e6e87a759b4b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:57.287003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-442bb657-4982-4d09-b363-e6e87a759b4b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:57.287950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-442bb657-4982-4d09-b363-e6e87a759b4b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:57.289377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-442bb657-4982-4d09-b363-e6e87a759b4b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:57.290052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-442bb657-4982-4d09-b363-e6e87a759b4b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:57.292349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-442bb657-4982-4d09-b363-e6e87a759b4b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:57.302133 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-16a42abf-67cc-43f9-b0b3-67ab9fde11c3 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/action" status: 202 len: 0 microversion: 2.25 time: 1.899657 Oct 27 18:49:57.302843 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 628/1265] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 18:49:55 2022] POST /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/action => generated 0 bytes in 1915 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:49:57.309969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2052943369", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "0f010104-9a93-40d2-a889-3691cdaf1b69"}], "security_groups": [{"name": "tempest-securitygroup--1526318985"}], "key_name": "tempest-keypair-1357184221", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:57.429269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] validate_networks() for [('0f010104-9a93-40d2-a889-3691cdaf1b69', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:49:57.558597 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-442bb657-4982-4d09-b363-e6e87a759b4b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] HTTP exception thrown: Floating IP 172.25.9.121 is not associated with instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c. Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-442bb657-4982-4d09-b363-e6e87a759b4b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Request method failure captured: Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c/action HTTP/1.1 Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 49 Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKHH8IjtkkaDXJq96UykJiHbjF02o-LZdd4rn1NkDLrprNVwiIhKr2qa3Hg8gukr01adRY9kfsqxfSsc7HTFOdPYG0vDLsgeHpj1_lo8SSBtCXmD7snvs2NYdXHi9sZUY0tuhk64xJNRwnZNrJ7vzaaE55lsbBsC9KZDPBIOJWE39k Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: d7e4d40daccf4e27a5e61093cd62dea8 Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1065195858 Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d7e4d40daccf4e27a5e61093cd62dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d7e4d40daccf4e27a5e61093cd62dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d7e4d40daccf4e27a5e61093cd62dea8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d7e4d40daccf4e27a5e61093cd62dea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1065195858 Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: d7e4d40daccf4e27a5e61093cd62dea8 Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1065195858 Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FloatingIPsAssociationTestJSON-1065195858-project Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: a7517e24516c4b75a2553b9521d5c38e Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1065195858-project Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: {"removeFloatingIp": {"address": "172.25.9.121"}} Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: exception: Floating IP 172.25.9.121 is not associated with instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c. Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '5ef3dc71-9730-4658-aa69-ff8704cdfb8c', 'body': {'removeFloatingIp': {'address': '172.25.9.121'}}} Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.121 is not associated with instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c. Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.121 is not associated with instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c. Oct 27 18:49:57.560055 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:57.564124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-442bb657-4982-4d09-b363-e6e87a759b4b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Returning 409 to user: Floating IP 172.25.9.121 is not associated with instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:57.564124 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-442bb657-4982-4d09-b363-e6e87a759b4b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "POST /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c/action" status: 409 len: 146 microversion: 2.1 time: 0.505042 Oct 27 18:49:57.564124 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 638/1266] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:49:57 2022] POST /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c/action => generated 146 bytes in 506 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:49:57.569888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-72945f74-f0ca-4c48-8817-cea3872475c4 req-ebe04526-1344-488b-a01d-7a11710a884b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873ced30-1179-4f52-9356-8e2f6c310959", "name": "network-vif-unplugged", "status": "completed", "tag": "fc24a5e3-d26b-4205-b920-4db5d5e6467b"}, {"name": "network-changed", "server_uuid": "873ced30-1179-4f52-9356-8e2f6c310959", "tag": "fc24a5e3-d26b-4205-b920-4db5d5e6467b"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:57.581423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-72945f74-f0ca-4c48-8817-cea3872475c4 req-ebe04526-1344-488b-a01d-7a11710a884b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:57.581918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-72945f74-f0ca-4c48-8817-cea3872475c4 req-ebe04526-1344-488b-a01d-7a11710a884b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:57.582358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-72945f74-f0ca-4c48-8817-cea3872475c4 req-ebe04526-1344-488b-a01d-7a11710a884b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:57.600531 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-72945f74-f0ca-4c48-8817-cea3872475c4 req-ebe04526-1344-488b-a01d-7a11710a884b service nova] Creating event network-vif-unplugged:fc24a5e3-d26b-4205-b920-4db5d5e6467b for instance 873ced30-1179-4f52-9356-8e2f6c310959 on n-h1-860687-3 Oct 27 18:49:57.601306 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-72945f74-f0ca-4c48-8817-cea3872475c4 req-ebe04526-1344-488b-a01d-7a11710a884b service nova] Creating event network-changed:fc24a5e3-d26b-4205-b920-4db5d5e6467b for instance 873ced30-1179-4f52-9356-8e2f6c310959 on n-h1-860687-3 Oct 27 18:49:57.611121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-72945f74-f0ca-4c48-8817-cea3872475c4 req-ebe04526-1344-488b-a01d-7a11710a884b service nova] Instance 873ced30-1179-4f52-9356-8e2f6c310959 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:49:57.624417 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-72945f74-f0ca-4c48-8817-cea3872475c4 req-ebe04526-1344-488b-a01d-7a11710a884b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.057626 Oct 27 18:49:57.625790 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 639/1267] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:49:57.631866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0ff5d52e-8052-4b46-9664-682a82bc747f tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:57.632693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0ff5d52e-8052-4b46-9664-682a82bc747f tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:57.641060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ff5d52e-8052-4b46-9664-682a82bc747f tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:57.641787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ff5d52e-8052-4b46-9664-682a82bc747f tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:57.642405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ff5d52e-8052-4b46-9664-682a82bc747f tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:57.643293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ff5d52e-8052-4b46-9664-682a82bc747f tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:57.644729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ff5d52e-8052-4b46-9664-682a82bc747f tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:57.645455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ff5d52e-8052-4b46-9664-682a82bc747f tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:57.873377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:49:57.874326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:49:57.875325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:49:57.876336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:49:57.876921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:49:57.887093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0ff5d52e-8052-4b46-9664-682a82bc747f tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:57.894817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:57.895035 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0ff5d52e-8052-4b46-9664-682a82bc747f tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1574 microversion: 2.1 time: 0.267855 Oct 27 18:49:57.895743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:57.896348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:57.897538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:57.898169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:57.898777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:57.912415 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 640/1268] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:57 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1574 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:57.918191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc0930d1-82cd-48d8-ac5b-eb703b9ee3cd tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:57.920820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Getting quotas for project 366d94ed2eb14e759c191e32c65b187a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc0930d1-82cd-48d8-ac5b-eb703b9ee3cd tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Request method failure captured: Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKiXEumbw4w9vI3EnDpsApwTBMd5wSRCdFBmxO1Yutz4XEIZehE2ZpuSsKXVghur3HqZcTSCtk3McmsOabzqKxdwJrdVnuJv0zZYPH3e5GTqlhSeHY1OX1v_YjKShlDjyRLeFbHUnnbsyxtXzaZlgkg6Jx_cORdrSgGQ9tEHjFkrCk Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_60af6e89111c4ea886cd03dfd18e20d1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ab0bd7aab43d43d2b172fcd4935813f9 Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: action_args: {} Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'testing' Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 27 18:49:57.923410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 27 18:49:57.928154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:49:57.929054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Getting quotas for user 878d41625de6498283fde8fb05a4bbf6 and project 366d94ed2eb14e759c191e32c65b187a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:49:57.930342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc0930d1-82cd-48d8-ac5b-eb703b9ee3cd tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:49:57.932299 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc0930d1-82cd-48d8-ac5b-eb703b9ee3cd tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.017800 Oct 27 18:49:57.933046 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 641/1269] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:49:57 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:49:57.937888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-288d86d0-d4c9-44f5-a846-516584d85e04 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Calling method '.version_select at 0x7fc86ae16940>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:57.944349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:49:57.947286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:49:57.998896 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9aa2ebd3-57f4-4059-99e7-68b5b8a43f2c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.694749 Oct 27 18:49:58.005756 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 629/1270] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:49:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:49:58.011289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fa77cf74-28f6-4a53-a845-bcdab54d50ee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:58.011918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fa77cf74-28f6-4a53-a845-bcdab54d50ee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:58.025768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa77cf74-28f6-4a53-a845-bcdab54d50ee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:58.026278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa77cf74-28f6-4a53-a845-bcdab54d50ee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:58.026752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa77cf74-28f6-4a53-a845-bcdab54d50ee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:58.027470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa77cf74-28f6-4a53-a845-bcdab54d50ee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:58.028090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa77cf74-28f6-4a53-a845-bcdab54d50ee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:58.028631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa77cf74-28f6-4a53-a845-bcdab54d50ee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:58.197762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fa77cf74-28f6-4a53-a845-bcdab54d50ee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:58.209454 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fa77cf74-28f6-4a53-a845-bcdab54d50ee tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1473 microversion: 2.1 time: 0.202069 Oct 27 18:49:58.210247 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 630/1271] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:58 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1473 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:58.216214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d8c1ecbf-b6de-4a51-9f3f-5562a489a8ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:58.217043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d8c1ecbf-b6de-4a51-9f3f-5562a489a8ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:58.226186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8c1ecbf-b6de-4a51-9f3f-5562a489a8ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:58.226937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8c1ecbf-b6de-4a51-9f3f-5562a489a8ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:58.227612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8c1ecbf-b6de-4a51-9f3f-5562a489a8ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:58.229198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8c1ecbf-b6de-4a51-9f3f-5562a489a8ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:58.229731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8c1ecbf-b6de-4a51-9f3f-5562a489a8ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:58.230230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8c1ecbf-b6de-4a51-9f3f-5562a489a8ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:58.446508 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-288d86d0-d4c9-44f5-a846-516584d85e04 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/492e297f-7c07-40dd-8699-6928aede02e0" status: 202 len: 0 microversion: 2.1 time: 0.512137 Oct 27 18:49:58.450242 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 642/1272] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:57 2022] DELETE /compute/v2.1/os-security-groups/492e297f-7c07-40dd-8699-6928aede02e0 => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:58.455292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7e1b230c-e239-4e2d-953f-9c9eb4b11107 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.121"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:49:58.527212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d8c1ecbf-b6de-4a51-9f3f-5562a489a8ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:58.542074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d8c1ecbf-b6de-4a51-9f3f-5562a489a8ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:58.544531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d8c1ecbf-b6de-4a51-9f3f-5562a489a8ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:58.546819 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d8c1ecbf-b6de-4a51-9f3f-5562a489a8ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.335244 Oct 27 18:49:58.560891 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 631/1273] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:49:58 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:49:58.580522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-78f798d1-ea3c-40e2-8ae8-e6a731b1b1ef tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:58.598635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-78f798d1-ea3c-40e2-8ae8-e6a731b1b1ef tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:58.600134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-78f798d1-ea3c-40e2-8ae8-e6a731b1b1ef tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:49:58.621521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.compute.servers [None req-78f798d1-ea3c-40e2-8ae8-e6a731b1b1ef tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Flavor 'non_existing_flavor' could not be found {{(pid=127029) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 27 18:49:58.623907 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-78f798d1-ea3c-40e2-8ae8-e6a731b1b1ef tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.060620 Oct 27 18:49:58.628217 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 632/1274] 10.222.0.42 () {58 vars in 1178 bytes} [Thu Oct 27 18:49:58 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:49:58.633306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ac475291-9cee-4639-ad64-98618c007fd6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:58.642905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ac475291-9cee-4639-ad64-98618c007fd6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:58.730840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ac475291-9cee-4639-ad64-98618c007fd6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:58.750953 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ac475291-9cee-4639-ad64-98618c007fd6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1242 microversion: 2.1 time: 0.120256 Oct 27 18:49:58.763176 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 633/1275] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:58 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1242 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:49:58.779886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a44e2840-50d3-49b2-b20b-07d322ee3588 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Calling method '.version_select at 0x7fc86ad27af0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:59.035261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7e1b230c-e239-4e2d-953f-9c9eb4b11107 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:59.042645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e1b230c-e239-4e2d-953f-9c9eb4b11107 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:59.043147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e1b230c-e239-4e2d-953f-9c9eb4b11107 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:59.043611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e1b230c-e239-4e2d-953f-9c9eb4b11107 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:59.044353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e1b230c-e239-4e2d-953f-9c9eb4b11107 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:59.045066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e1b230c-e239-4e2d-953f-9c9eb4b11107 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:59.045499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e1b230c-e239-4e2d-953f-9c9eb4b11107 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:59.326204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e1b230c-e239-4e2d-953f-9c9eb4b11107 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "refresh_cache-544f4ef4-fdfc-4e55-a247-7c210300d932" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 18:49:59.326697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e1b230c-e239-4e2d-953f-9c9eb4b11107 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquired lock "refresh_cache-544f4ef4-fdfc-4e55-a247-7c210300d932" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 18:49:59.721265 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a44e2840-50d3-49b2-b20b-07d322ee3588 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/23b14042-acc0-4f46-8122-007ca0bc22a5" status: 202 len: 0 microversion: 2.1 time: 0.949009 Oct 27 18:49:59.726235 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 634/1276] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:49:58 2022] DELETE /compute/v2.1/os-security-groups/23b14042-acc0-4f46-8122-007ca0bc22a5 => generated 0 bytes in 955 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:49:59.732639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9da555d9-6a82-4b2f-bb6f-4459bf22e3b2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:59.754995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9da555d9-6a82-4b2f-bb6f-4459bf22e3b2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:49:59.757146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9da555d9-6a82-4b2f-bb6f-4459bf22e3b2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:49:59.771212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9da555d9-6a82-4b2f-bb6f-4459bf22e3b2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:59.772063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9da555d9-6a82-4b2f-bb6f-4459bf22e3b2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:59.772808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9da555d9-6a82-4b2f-bb6f-4459bf22e3b2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:59.773800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9da555d9-6a82-4b2f-bb6f-4459bf22e3b2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:59.774569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9da555d9-6a82-4b2f-bb6f-4459bf22e3b2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:59.775349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9da555d9-6a82-4b2f-bb6f-4459bf22e3b2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:59.926406 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9da555d9-6a82-4b2f-bb6f-4459bf22e3b2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.198677 Oct 27 18:49:59.927635 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 635/1277] 10.222.0.42 () {58 vars in 1174 bytes} [Thu Oct 27 18:49:59 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:49:59.934069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f8ad2700-f99e-4f34-b1e8-dc52412f057a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:49:59.934991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f8ad2700-f99e-4f34-b1e8-dc52412f057a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:49:59.941700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8ad2700-f99e-4f34-b1e8-dc52412f057a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:59.942542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8ad2700-f99e-4f34-b1e8-dc52412f057a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:59.943365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8ad2700-f99e-4f34-b1e8-dc52412f057a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:49:59.944326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8ad2700-f99e-4f34-b1e8-dc52412f057a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:49:59.944988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8ad2700-f99e-4f34-b1e8-dc52412f057a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:49:59.945613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8ad2700-f99e-4f34-b1e8-dc52412f057a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:00.287763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f8ad2700-f99e-4f34-b1e8-dc52412f057a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:00.301447 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f8ad2700-f99e-4f34-b1e8-dc52412f057a tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1572 microversion: 2.1 time: 0.371722 Oct 27 18:50:00.302811 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 636/1278] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:49:59 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1572 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:00.312480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dd9e9757-15d4-4dd8-91ce-dcb602037a70 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:00.313315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dd9e9757-15d4-4dd8-91ce-dcb602037a70 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:00.322441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd9e9757-15d4-4dd8-91ce-dcb602037a70 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:00.323626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd9e9757-15d4-4dd8-91ce-dcb602037a70 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:00.324192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd9e9757-15d4-4dd8-91ce-dcb602037a70 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:00.325026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd9e9757-15d4-4dd8-91ce-dcb602037a70 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:00.325670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd9e9757-15d4-4dd8-91ce-dcb602037a70 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:00.326431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd9e9757-15d4-4dd8-91ce-dcb602037a70 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:00.577048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dd9e9757-15d4-4dd8-91ce-dcb602037a70 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:00.592487 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dd9e9757-15d4-4dd8-91ce-dcb602037a70 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1470 microversion: 2.1 time: 0.288452 Oct 27 18:50:00.593656 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 637/1279] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:00 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1470 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:00.598456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c0595ac0-ee94-4f33-90f4-1fdf55c16a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:00.599233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c0595ac0-ee94-4f33-90f4-1fdf55c16a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:00.613368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0595ac0-ee94-4f33-90f4-1fdf55c16a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:00.613956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0595ac0-ee94-4f33-90f4-1fdf55c16a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:00.614782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0595ac0-ee94-4f33-90f4-1fdf55c16a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:00.615603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0595ac0-ee94-4f33-90f4-1fdf55c16a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:00.616082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0595ac0-ee94-4f33-90f4-1fdf55c16a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:00.616919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0595ac0-ee94-4f33-90f4-1fdf55c16a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:00.786729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c0595ac0-ee94-4f33-90f4-1fdf55c16a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:00.797677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-7e1b230c-e239-4e2d-953f-9c9eb4b11107 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Building network info cache for instance {{(pid=127028) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 18:50:00.800266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c0595ac0-ee94-4f33-90f4-1fdf55c16a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:00.802009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c0595ac0-ee94-4f33-90f4-1fdf55c16a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:00.803925 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c0595ac0-ee94-4f33-90f4-1fdf55c16a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.208645 Oct 27 18:50:00.816379 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 638/1280] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:00 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:00.829827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0fc48bd8-b9d0-425a-a3c7-c2dc642a25b3 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] Calling method '.version_select at 0x7fc86b007c10>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:01.090506 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0fc48bd8-b9d0-425a-a3c7-c2dc642a25b3 tempest-SecurityGroupRulesTestJSON-598965226 tempest-SecurityGroupRulesTestJSON-598965226-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/583bd7de-c346-4398-be78-2c68b1f75cc1" status: 202 len: 0 microversion: 2.1 time: 0.272615 Oct 27 18:50:01.091122 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 639/1281] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:50:00 2022] DELETE /compute/v2.1/os-security-groups/583bd7de-c346-4398-be78-2c68b1f75cc1 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:50:01.096926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2b019939-3d0a-43d0-bf40-0464b5ff0c10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:01.097708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2b019939-3d0a-43d0-bf40-0464b5ff0c10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:01.115996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b019939-3d0a-43d0-bf40-0464b5ff0c10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:01.116850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b019939-3d0a-43d0-bf40-0464b5ff0c10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:01.117509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b019939-3d0a-43d0-bf40-0464b5ff0c10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:01.118276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b019939-3d0a-43d0-bf40-0464b5ff0c10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:01.119516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b019939-3d0a-43d0-bf40-0464b5ff0c10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:01.120537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b019939-3d0a-43d0-bf40-0464b5ff0c10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:01.223174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2b019939-3d0a-43d0-bf40-0464b5ff0c10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:01.232570 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2b019939-3d0a-43d0-bf40-0464b5ff0c10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1300 microversion: 2.1 time: 0.140374 Oct 27 18:50:01.234176 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 640/1282] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:01 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1300 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:01.240466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85b31a54-4dbe-40e0-b0bb-8705f6e744e9 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:01.248965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-85b31a54-4dbe-40e0-b0bb-8705f6e744e9 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:01.249658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-85b31a54-4dbe-40e0-b0bb-8705f6e744e9 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:50:01.256537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b31a54-4dbe-40e0-b0bb-8705f6e744e9 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:01.257049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b31a54-4dbe-40e0-b0bb-8705f6e744e9 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:01.257504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b31a54-4dbe-40e0-b0bb-8705f6e744e9 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:01.258259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b31a54-4dbe-40e0-b0bb-8705f6e744e9 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:01.258774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b31a54-4dbe-40e0-b0bb-8705f6e744e9 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:01.259378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b31a54-4dbe-40e0-b0bb-8705f6e744e9 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:01.420806 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-85b31a54-4dbe-40e0-b0bb-8705f6e744e9 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.185084 Oct 27 18:50:01.428241 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 641/1283] 10.222.0.42 () {58 vars in 1184 bytes} [Thu Oct 27 18:50:01 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:50:01.434609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-979e3483-7dd3-4400-a806-a9a2f35a88ae tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:01.435258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-979e3483-7dd3-4400-a806-a9a2f35a88ae tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:01.450825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-979e3483-7dd3-4400-a806-a9a2f35a88ae tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:01.451692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-979e3483-7dd3-4400-a806-a9a2f35a88ae tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:01.452417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-979e3483-7dd3-4400-a806-a9a2f35a88ae tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:01.453367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-979e3483-7dd3-4400-a806-a9a2f35a88ae tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:01.453934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-979e3483-7dd3-4400-a806-a9a2f35a88ae tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:01.454492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-979e3483-7dd3-4400-a806-a9a2f35a88ae tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:01.477754 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-979e3483-7dd3-4400-a806-a9a2f35a88ae tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] HTTP exception thrown: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-979e3483-7dd3-4400-a806-a9a2f35a88ae tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Request method failure captured: Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 HTTP/1.1 Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtImBwzJd29xqm1Hw5vl2Y7iRGG9bs0BUQYGf8a5lggKK4YtWIfI7H30usqmngE0QpTMy9LcFe3LgjjKbtfW2V0Cbc42nGsLPuFJKQ3Lw9C4GhwYyqj60Fa9SVQGn0icfGbGbFj03SsFKwEJlEoWEJGjWsV0Wozvd9_0l4TyTB4Fy_E Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f935076689d74e1e9089d516caca1cc4 Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-651785775 Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f935076689d74e1e9089d516caca1cc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f935076689d74e1e9089d516caca1cc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f935076689d74e1e9089d516caca1cc4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f935076689d74e1e9089d516caca1cc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-651785775 Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f935076689d74e1e9089d516caca1cc4 Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-651785775 Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachSCSIVolumeTestJSON-651785775-project Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 18ce178d2f1b40ecbf7dd294d7da4748 Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-651785775-project Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '52680d12-70da-485a-b4a1-172a49b7b959'} Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:50:01.480476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:50:01.484755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:50:01.484755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:01.484755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:01.484755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:01.484755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:01.484755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:01.484755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:01.484755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:01.484755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:01.484755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:50:01.484755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:01.484755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-979e3483-7dd3-4400-a806-a9a2f35a88ae tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Returning 404 to user: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:01.484755 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-979e3483-7dd3-4400-a806-a9a2f35a88ae tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "DELETE /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 404 len: 111 microversion: 2.1 time: 0.060410 Oct 27 18:50:01.484755 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 642/1284] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:50:01 2022] DELETE /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:01.492636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-23817083-a661-499f-8f2b-efb050ce3d43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1594394263"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:01.493515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-23817083-a661-499f-8f2b-efb050ce3d43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:01.501247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23817083-a661-499f-8f2b-efb050ce3d43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:01.501799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23817083-a661-499f-8f2b-efb050ce3d43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:01.502360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23817083-a661-499f-8f2b-efb050ce3d43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:01.504276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23817083-a661-499f-8f2b-efb050ce3d43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:01.504861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23817083-a661-499f-8f2b-efb050ce3d43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:01.505472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23817083-a661-499f-8f2b-efb050ce3d43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:01.686257 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.network.security_group_api [None req-23817083-a661-499f-8f2b-efb050ce3d43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Adding security group 8adb7277-f821-4df7-abcc-7e3f1f484005 to port 4776f52b-b794-46a8-b2e7-8668af766e21 Oct 27 18:50:02.247613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-7e1b230c-e239-4e2d-953f-9c9eb4b11107 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Updating instance_info_cache with network_info: [{"id": "50d7433e-4e6d-4e9a-9b35-21b455c67c5e", "address": "fa:16:3e:8b:84:98", "network": {"id": "41cb3454-066d-4fcf-bf2e-ef5cb51d55c0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1462812452-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d7e4d40daccf4e27a5e61093cd62dea8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap50d7433e-4e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127028) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 18:50:02.268562 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-23817083-a661-499f-8f2b-efb050ce3d43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123/action" status: 202 len: 0 microversion: 2.1 time: 0.783375 Oct 27 18:50:02.269921 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 643/1285] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:50:01 2022] POST /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123/action => generated 0 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:50:02.276584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:02.277390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:02.293052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:02.295811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e1b230c-e239-4e2d-953f-9c9eb4b11107 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Releasing lock "refresh_cache-544f4ef4-fdfc-4e55-a247-7c210300d932" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 18:50:02.296480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:02.297827 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7e1b230c-e239-4e2d-953f-9c9eb4b11107 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "POST /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932/action" status: 202 len: 0 microversion: 2.1 time: 3.846338 Oct 27 18:50:02.298482 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 643/1286] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:49:58 2022] POST /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932/action => generated 0 bytes in 3848 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 18:50:02.298898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:02.299753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:02.303701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:02.304399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:02.312534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f2dec801-90b1-4391-b227-bef98927ffa5 req-5dbc5f91-0a3a-4d85-8d9b-fae40eaef9cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "544f4ef4-fdfc-4e55-a247-7c210300d932", "tag": "50d7433e-4e6d-4e9a-9b35-21b455c67c5e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:02.349601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f2dec801-90b1-4391-b227-bef98927ffa5 req-5dbc5f91-0a3a-4d85-8d9b-fae40eaef9cd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:02.356542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f2dec801-90b1-4391-b227-bef98927ffa5 req-5dbc5f91-0a3a-4d85-8d9b-fae40eaef9cd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:02.359412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f2dec801-90b1-4391-b227-bef98927ffa5 req-5dbc5f91-0a3a-4d85-8d9b-fae40eaef9cd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:02.392781 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f2dec801-90b1-4391-b227-bef98927ffa5 req-5dbc5f91-0a3a-4d85-8d9b-fae40eaef9cd service nova] Creating event network-changed:50d7433e-4e6d-4e9a-9b35-21b455c67c5e for instance 544f4ef4-fdfc-4e55-a247-7c210300d932 on n-h2-860687-3 Oct 27 18:50:02.399690 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f2dec801-90b1-4391-b227-bef98927ffa5 req-5dbc5f91-0a3a-4d85-8d9b-fae40eaef9cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096586 Oct 27 18:50:02.400956 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 644/1287] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:02.422815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:02.429540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:02.430984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Searching by: {'deleted': False, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:50:02.437596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:02.438865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:02.439790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:02.440906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:02.442286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:02.443106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:02.468218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:02.468709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:02.469148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:02.469934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:02.481046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:02.481611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:02.498983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:50:02.508774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:02.557986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Getting quotas for project 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6. Resources: {'cores', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:50:02.571789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Getting quotas for user 1917ae65262c40b792c28c2aa4d44b44 and project 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6. Resources: {'cores', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:50:02.713077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:02.734327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:02.736532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:02.738683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:02.756007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=4,nova_cell1:RELEASE=4,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:02.787121 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d3389619-c064-4fb2-844a-930c1235760e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "POST /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959/action" status: 202 len: 0 microversion: 2.1 time: 0.515419 Oct 27 18:50:02.791070 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 644/1288] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:50:02 2022] POST /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:50:02.797055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3443f337-8156-4d51-aad7-cec6c5df22dd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:02.797780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3443f337-8156-4d51-aad7-cec6c5df22dd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] [instance: 52680d12-70da-485a-b4a1-172a49b7b959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:02.816114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3443f337-8156-4d51-aad7-cec6c5df22dd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:02.816762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3443f337-8156-4d51-aad7-cec6c5df22dd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:02.817219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3443f337-8156-4d51-aad7-cec6c5df22dd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:02.820017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3443f337-8156-4d51-aad7-cec6c5df22dd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:02.820537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3443f337-8156-4d51-aad7-cec6c5df22dd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:02.821026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3443f337-8156-4d51-aad7-cec6c5df22dd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:02.841129 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-3443f337-8156-4d51-aad7-cec6c5df22dd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] HTTP exception thrown: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3443f337-8156-4d51-aad7-cec6c5df22dd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Request method failure captured: Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 HTTP/1.1 Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtImBwzJd29xqm1Hw5vl2Y7iRGG9bs0BUQYGf8a5lggKK4YtWIfI7H30usqmngE0QpTMy9LcFe3LgjjKbtfW2V0Cbc42nGsLPuFJKQ3Lw9C4GhwYyqj60Fa9SVQGn0icfGbGbFj03SsFKwEJlEoWEJGjWsV0Wozvd9_0l4TyTB4Fy_E Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f935076689d74e1e9089d516caca1cc4 Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-651785775 Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f935076689d74e1e9089d516caca1cc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f935076689d74e1e9089d516caca1cc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f935076689d74e1e9089d516caca1cc4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f935076689d74e1e9089d516caca1cc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-651785775 Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f935076689d74e1e9089d516caca1cc4 Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-651785775 Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachSCSIVolumeTestJSON-651785775-project Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 18ce178d2f1b40ecbf7dd294d7da4748 Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-651785775-project Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '52680d12-70da-485a-b4a1-172a49b7b959'} Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:02.844965 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:02.849172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:02.849172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:02.849172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:02.849172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:02.849172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:02.849172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. Oct 27 18:50:02.849172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:02.852509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3443f337-8156-4d51-aad7-cec6c5df22dd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] Returning 404 to user: Instance 52680d12-70da-485a-b4a1-172a49b7b959 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:02.855568 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3443f337-8156-4d51-aad7-cec6c5df22dd tempest-AttachSCSIVolumeTestJSON-651785775 tempest-AttachSCSIVolumeTestJSON-651785775-project] 10.222.0.42 "GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959" status: 404 len: 111 microversion: 2.1 time: 0.064903 Oct 27 18:50:02.860610 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 645/1289] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:02 2022] GET /compute/v2.1/servers/52680d12-70da-485a-b4a1-172a49b7b959 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:02.867706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bad86bd2-0e82-48cb-85ff-39b413036319 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:02.869406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bad86bd2-0e82-48cb-85ff-39b413036319 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:02.879759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bad86bd2-0e82-48cb-85ff-39b413036319 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:02.881263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bad86bd2-0e82-48cb-85ff-39b413036319 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:02.882067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bad86bd2-0e82-48cb-85ff-39b413036319 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:02.887046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bad86bd2-0e82-48cb-85ff-39b413036319 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:02.888927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bad86bd2-0e82-48cb-85ff-39b413036319 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:02.891321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bad86bd2-0e82-48cb-85ff-39b413036319 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:03.225060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bad86bd2-0e82-48cb-85ff-39b413036319 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:03.238252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bad86bd2-0e82-48cb-85ff-39b413036319 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:03.251227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bad86bd2-0e82-48cb-85ff-39b413036319 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:03.252464 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bad86bd2-0e82-48cb-85ff-39b413036319 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.390592 Oct 27 18:50:03.253030 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 646/1290] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:02 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:03.257769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-0b53b6d0-8827-4101-982b-8ea1195b82b0 req-4c10285e-38e6-4fc9-9401-9b82b3b78ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873ced30-1179-4f52-9356-8e2f6c310959", "name": "network-vif-plugged", "status": "completed", "tag": "fc24a5e3-d26b-4205-b920-4db5d5e6467b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:03.284432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0b53b6d0-8827-4101-982b-8ea1195b82b0 req-4c10285e-38e6-4fc9-9401-9b82b3b78ccc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:03.286213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0b53b6d0-8827-4101-982b-8ea1195b82b0 req-4c10285e-38e6-4fc9-9401-9b82b3b78ccc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:03.286972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0b53b6d0-8827-4101-982b-8ea1195b82b0 req-4c10285e-38e6-4fc9-9401-9b82b3b78ccc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:03.302141 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-0b53b6d0-8827-4101-982b-8ea1195b82b0 req-4c10285e-38e6-4fc9-9401-9b82b3b78ccc service nova] Creating event network-vif-plugged:fc24a5e3-d26b-4205-b920-4db5d5e6467b for instance 873ced30-1179-4f52-9356-8e2f6c310959 on n-h1-860687-3 Oct 27 18:50:03.308993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-0b53b6d0-8827-4101-982b-8ea1195b82b0 req-4c10285e-38e6-4fc9-9401-9b82b3b78ccc service nova] Instance 873ced30-1179-4f52-9356-8e2f6c310959 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:50:03.331456 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-0b53b6d0-8827-4101-982b-8ea1195b82b0 req-4c10285e-38e6-4fc9-9401-9b82b3b78ccc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076822 Oct 27 18:50:03.332279 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 647/1291] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:03.342753 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a0616c90-143e-46a3-ab5f-200d3f807efb tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.940323 Oct 27 18:50:03.343343 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 645/1292] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:50:02 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:03.345850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dd751d58-0889-4ed4-968a-a560acf19395 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:03.346635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dd751d58-0889-4ed4-968a-a560acf19395 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:03.348647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-30bf4b11-914d-40e4-8c0c-fb34ca3bdb47 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86ae383a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:03.361957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd751d58-0889-4ed4-968a-a560acf19395 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:03.362506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd751d58-0889-4ed4-968a-a560acf19395 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:03.362967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd751d58-0889-4ed4-968a-a560acf19395 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:03.363694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd751d58-0889-4ed4-968a-a560acf19395 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:03.364161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd751d58-0889-4ed4-968a-a560acf19395 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:03.364600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd751d58-0889-4ed4-968a-a560acf19395 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:03.674671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dd751d58-0889-4ed4-968a-a560acf19395 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:03.687103 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dd751d58-0889-4ed4-968a-a560acf19395 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1368 microversion: 2.1 time: 0.351719 Oct 27 18:50:03.702411 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 648/1293] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:03 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1368 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:03.702411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-853074a3-a708-4bc3-8d94-f91dbbc6034f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:03.702411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-853074a3-a708-4bc3-8d94-f91dbbc6034f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:03.715744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-853074a3-a708-4bc3-8d94-f91dbbc6034f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:03.722125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-853074a3-a708-4bc3-8d94-f91dbbc6034f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:03.722827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-853074a3-a708-4bc3-8d94-f91dbbc6034f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:03.723673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-853074a3-a708-4bc3-8d94-f91dbbc6034f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:03.724233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-853074a3-a708-4bc3-8d94-f91dbbc6034f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:03.724748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-853074a3-a708-4bc3-8d94-f91dbbc6034f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:03.776354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-853074a3-a708-4bc3-8d94-f91dbbc6034f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:50:03.937520 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-853074a3-a708-4bc3-8d94-f91dbbc6034f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "DELETE /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 204 len: 0 microversion: 2.1 time: 0.246687 Oct 27 18:50:03.939498 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 649/1294] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:50:03 2022] DELETE /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:50:03.949844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-00f8d308-a4d4-42ba-a2e4-5bd4f6e24073 req-ac15fb3e-4e92-4635-b9ae-41dc1649fdff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2f8430-f7aa-4b29-b980-d0860fcc7123", "tag": "4776f52b-b794-46a8-b2e7-8668af766e21"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:03.974637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-00f8d308-a4d4-42ba-a2e4-5bd4f6e24073 req-ac15fb3e-4e92-4635-b9ae-41dc1649fdff service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:03.975357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-00f8d308-a4d4-42ba-a2e4-5bd4f6e24073 req-ac15fb3e-4e92-4635-b9ae-41dc1649fdff service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:03.976010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-00f8d308-a4d4-42ba-a2e4-5bd4f6e24073 req-ac15fb3e-4e92-4635-b9ae-41dc1649fdff service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:03.989092 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-00f8d308-a4d4-42ba-a2e4-5bd4f6e24073 req-ac15fb3e-4e92-4635-b9ae-41dc1649fdff service nova] Creating event network-changed:4776f52b-b794-46a8-b2e7-8668af766e21 for instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 on n-h1-860687-3 Oct 27 18:50:03.994426 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-00f8d308-a4d4-42ba-a2e4-5bd4f6e24073 req-ac15fb3e-4e92-4635-b9ae-41dc1649fdff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050744 Oct 27 18:50:03.995789 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 650/1295] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:04.001258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-72709653-f9fd-4f79-9122-8a3ed5b10b8d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:04.002281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-72709653-f9fd-4f79-9122-8a3ed5b10b8d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:04.012195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72709653-f9fd-4f79-9122-8a3ed5b10b8d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:04.013017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72709653-f9fd-4f79-9122-8a3ed5b10b8d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:04.013699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72709653-f9fd-4f79-9122-8a3ed5b10b8d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:04.014904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72709653-f9fd-4f79-9122-8a3ed5b10b8d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:04.015690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72709653-f9fd-4f79-9122-8a3ed5b10b8d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:04.016330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72709653-f9fd-4f79-9122-8a3ed5b10b8d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:04.248948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-72709653-f9fd-4f79-9122-8a3ed5b10b8d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:04.264261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG neutronclient.v2_0.client [None req-30bf4b11-914d-40e4-8c0c-fb34ca3bdb47 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 8adb7277-f821-4df7-abcc-7e3f1f484005 in use.", "detail": ""}} {{(pid=127028) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:50:04.264431 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-72709653-f9fd-4f79-9122-8a3ed5b10b8d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1469 microversion: 2.1 time: 0.267007 Oct 27 18:50:04.265084 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-30bf4b11-914d-40e4-8c0c-fb34ca3bdb47 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Security Group 8adb7277-f821-4df7-abcc-7e3f1f484005 in use. Oct 27 18:50:04.265084 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-22e03d02-1d7d-44e5-be4d-36ff37a4ce36'] Oct 27 18:50:04.265889 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 651/1296] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:03 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1469 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-30bf4b11-914d-40e4-8c0c-fb34ca3bdb47 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/os-security-groups/8adb7277-f821-4df7-abcc-7e3f1f484005 HTTP/1.1 Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: exception: Security Group 8adb7277-f821-4df7-abcc-7e3f1f484005 in use. Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-22e03d02-1d7d-44e5-be4d-36ff37a4ce36'] Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '8adb7277-f821-4df7-abcc-7e3f1f484005'} Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:50:04.267475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 8adb7277-f821-4df7-abcc-7e3f1f484005 in use. Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22e03d02-1d7d-44e5-be4d-36ff37a4ce36'] Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 8adb7277-f821-4df7-abcc-7e3f1f484005 in use. Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22e03d02-1d7d-44e5-be4d-36ff37a4ce36'] Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 8adb7277-f821-4df7-abcc-7e3f1f484005 in use. Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22e03d02-1d7d-44e5-be4d-36ff37a4ce36'] Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 8adb7277-f821-4df7-abcc-7e3f1f484005 in use. Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22e03d02-1d7d-44e5-be4d-36ff37a4ce36'] Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-30bf4b11-914d-40e4-8c0c-fb34ca3bdb47 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 400 to user: Security Group 8adb7277-f821-4df7-abcc-7e3f1f484005 in use. Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-22e03d02-1d7d-44e5-be4d-36ff37a4ce36'] {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-30bf4b11-914d-40e4-8c0c-fb34ca3bdb47 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/8adb7277-f821-4df7-abcc-7e3f1f484005" status: 400 len: 185 microversion: 2.1 time: 0.924475 Oct 27 18:50:04.271537 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 646/1297] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:50:03 2022] DELETE /compute/v2.1/os-security-groups/8adb7277-f821-4df7-abcc-7e3f1f484005 => generated 185 bytes in 925 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:50:04.280800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b24a7924-84d0-4803-9ca9-8fc5f82c4300 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.121"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:04.283687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bd05519c-67ef-4844-98ae-e68e06af3a38 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:04.286750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b24a7924-84d0-4803-9ca9-8fc5f82c4300 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:04.290964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bd05519c-67ef-4844-98ae-e68e06af3a38 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:04.292843 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bd05519c-67ef-4844-98ae-e68e06af3a38 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.025498 Oct 27 18:50:04.293979 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 652/1298] 10.222.0.42 () {58 vars in 1178 bytes} [Thu Oct 27 18:50:04 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:50:04.300024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-59fae16b-2306-46ac-965d-ddd4195efa1b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:04.300314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b24a7924-84d0-4803-9ca9-8fc5f82c4300 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:04.300978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-59fae16b-2306-46ac-965d-ddd4195efa1b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:04.301183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b24a7924-84d0-4803-9ca9-8fc5f82c4300 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:04.301795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b24a7924-84d0-4803-9ca9-8fc5f82c4300 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:04.302861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b24a7924-84d0-4803-9ca9-8fc5f82c4300 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:04.308811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59fae16b-2306-46ac-965d-ddd4195efa1b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:04.309360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b24a7924-84d0-4803-9ca9-8fc5f82c4300 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:04.309598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59fae16b-2306-46ac-965d-ddd4195efa1b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:04.310303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b24a7924-84d0-4803-9ca9-8fc5f82c4300 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:04.310741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59fae16b-2306-46ac-965d-ddd4195efa1b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:04.311598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59fae16b-2306-46ac-965d-ddd4195efa1b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:04.312195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59fae16b-2306-46ac-965d-ddd4195efa1b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:04.312729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59fae16b-2306-46ac-965d-ddd4195efa1b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:04.346714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-59fae16b-2306-46ac-965d-ddd4195efa1b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:50:04.372310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b24a7924-84d0-4803-9ca9-8fc5f82c4300 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "refresh_cache-5ef3dc71-9730-4658-aa69-ff8704cdfb8c" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 18:50:04.372824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b24a7924-84d0-4803-9ca9-8fc5f82c4300 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquired lock "refresh_cache-5ef3dc71-9730-4658-aa69-ff8704cdfb8c" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 18:50:04.460898 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-59fae16b-2306-46ac-965d-ddd4195efa1b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 204 len: 0 microversion: 2.1 time: 0.164770 Oct 27 18:50:04.461809 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 653/1299] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:50:04 2022] DELETE /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:50:04.468337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-10f708c1-c4ac-4bc1-b8be-1734598e2ebf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:04.469189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-10f708c1-c4ac-4bc1-b8be-1734598e2ebf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:04.476153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10f708c1-c4ac-4bc1-b8be-1734598e2ebf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:04.476653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10f708c1-c4ac-4bc1-b8be-1734598e2ebf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:04.477101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10f708c1-c4ac-4bc1-b8be-1734598e2ebf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:04.478359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10f708c1-c4ac-4bc1-b8be-1734598e2ebf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:04.478861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10f708c1-c4ac-4bc1-b8be-1734598e2ebf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:04.479316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10f708c1-c4ac-4bc1-b8be-1734598e2ebf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:04.652166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-10f708c1-c4ac-4bc1-b8be-1734598e2ebf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:04.663336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-10f708c1-c4ac-4bc1-b8be-1734598e2ebf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:04.664877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-10f708c1-c4ac-4bc1-b8be-1734598e2ebf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:04.666926 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-10f708c1-c4ac-4bc1-b8be-1734598e2ebf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.203618 Oct 27 18:50:04.667697 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 654/1300] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:04 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:04.672538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0aa14f26-17f9-4caf-818b-ba07aab0f89e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:04.677847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0aa14f26-17f9-4caf-818b-ba07aab0f89e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:04.678567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0aa14f26-17f9-4caf-818b-ba07aab0f89e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Searching by: {'deleted': False, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:50:04.694845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0aa14f26-17f9-4caf-818b-ba07aab0f89e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:04.701833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0aa14f26-17f9-4caf-818b-ba07aab0f89e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:04.702289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0aa14f26-17f9-4caf-818b-ba07aab0f89e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:04.703118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0aa14f26-17f9-4caf-818b-ba07aab0f89e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:04.703580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0aa14f26-17f9-4caf-818b-ba07aab0f89e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:04.704012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0aa14f26-17f9-4caf-818b-ba07aab0f89e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:04.741820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-0aa14f26-17f9-4caf-818b-ba07aab0f89e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:50:04.778614 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0aa14f26-17f9-4caf-818b-ba07aab0f89e tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.109714 Oct 27 18:50:04.779654 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 655/1301] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 18:50:04 2022] GET /compute/v2.1/servers => generated 681 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:04.785195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a1d7a9d8-31c5-41e4-87d6-77024cff83c5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:04.785894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a1d7a9d8-31c5-41e4-87d6-77024cff83c5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:04.794507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1d7a9d8-31c5-41e4-87d6-77024cff83c5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:04.795325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1d7a9d8-31c5-41e4-87d6-77024cff83c5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:04.795831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1d7a9d8-31c5-41e4-87d6-77024cff83c5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:04.796749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1d7a9d8-31c5-41e4-87d6-77024cff83c5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:04.797281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1d7a9d8-31c5-41e4-87d6-77024cff83c5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:04.797797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1d7a9d8-31c5-41e4-87d6-77024cff83c5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:04.990679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1d7a9d8-31c5-41e4-87d6-77024cff83c5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:04.998985 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a1d7a9d8-31c5-41e4-87d6-77024cff83c5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1647 microversion: 2.1 time: 0.218261 Oct 27 18:50:04.999692 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 656/1302] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:04 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1647 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:05.014533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-432d264d-ea36-442b-8bc5-275cf7ebab07 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:05.014533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-432d264d-ea36-442b-8bc5-275cf7ebab07 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:05.014533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-432d264d-ea36-442b-8bc5-275cf7ebab07 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:05.014533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-432d264d-ea36-442b-8bc5-275cf7ebab07 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:05.014533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-432d264d-ea36-442b-8bc5-275cf7ebab07 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:05.014533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-432d264d-ea36-442b-8bc5-275cf7ebab07 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:05.014533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-432d264d-ea36-442b-8bc5-275cf7ebab07 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:05.014533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-432d264d-ea36-442b-8bc5-275cf7ebab07 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:05.157551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-432d264d-ea36-442b-8bc5-275cf7ebab07 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:05.166659 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-432d264d-ea36-442b-8bc5-275cf7ebab07 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1368 microversion: 2.1 time: 0.165603 Oct 27 18:50:05.168387 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 657/1303] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:04 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:05.176013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85b98a2f-0cf7-4174-a907-800f9e955bb0 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:05.176317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-85b98a2f-0cf7-4174-a907-800f9e955bb0 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 9fd25663-2c8a-4c1f-b5e3-231e38afed4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:05.190972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b98a2f-0cf7-4174-a907-800f9e955bb0 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:05.191527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b98a2f-0cf7-4174-a907-800f9e955bb0 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:05.192121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b98a2f-0cf7-4174-a907-800f9e955bb0 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:05.192975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b98a2f-0cf7-4174-a907-800f9e955bb0 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:05.193438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b98a2f-0cf7-4174-a907-800f9e955bb0 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:05.194335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b98a2f-0cf7-4174-a907-800f9e955bb0 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:05.197917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:05.213701 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-85b98a2f-0cf7-4174-a907-800f9e955bb0 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] HTTP exception thrown: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85b98a2f-0cf7-4174-a907-800f9e955bb0 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Request method failure captured: Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c HTTP/1.1 Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtKiXEumbw4w9vI3EnDpsApwTBMd5wSRCdFBmxO1Yutz4XEIZehE2ZpuSsKXVghur3HqZcTSCtk3McmsOabzqKxdwJrdVnuJv0zZYPH3e5GTqlhSeHY1OX1v_YjKShlDjyRLeFbHUnnbsyxtXzaZlgkg6Jx_cORdrSgGQ9tEHjFkrCk Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_60af6e89111c4ea886cd03dfd18e20d1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ab0bd7aab43d43d2b172fcd4935813f9 Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '9fd25663-2c8a-4c1f-b5e3-231e38afed4c'} Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:50:05.215149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:50:05.219233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:50:05.219233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:05.219233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:05.219233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:05.219233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:05.219233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:05.219233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:05.219233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:05.219233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:05.219233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:50:05.219233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:05.219233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85b98a2f-0cf7-4174-a907-800f9e955bb0 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Returning 404 to user: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:05.219233 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-85b98a2f-0cf7-4174-a907-800f9e955bb0 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c" status: 404 len: 111 microversion: 2.1 time: 0.046983 Oct 27 18:50:05.219233 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 658/1304] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:50:05 2022] DELETE /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:05.229347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9711abf1-38a0-439e-80ad-85065ced934a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:05.229347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9711abf1-38a0-439e-80ad-85065ced934a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 09d2d6e6-9f89-45ca-8353-d0d549e82086] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:05.235831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:05.238116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9711abf1-38a0-439e-80ad-85065ced934a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:05.238728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9711abf1-38a0-439e-80ad-85065ced934a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:05.239639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9711abf1-38a0-439e-80ad-85065ced934a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:05.241326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9711abf1-38a0-439e-80ad-85065ced934a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:05.241326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9711abf1-38a0-439e-80ad-85065ced934a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:05.241326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9711abf1-38a0-439e-80ad-85065ced934a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:05.277435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9711abf1-38a0-439e-80ad-85065ced934a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 09d2d6e6-9f89-45ca-8353-d0d549e82086] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:50:05.390666 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9711abf1-38a0-439e-80ad-85065ced934a tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "DELETE /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086" status: 204 len: 0 microversion: 2.1 time: 0.165538 Oct 27 18:50:05.391501 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 659/1305] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:50:05 2022] DELETE /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 18:50:05.398995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0c47a547-0a66-4b22-8faa-a610d2e41b71 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:05.399575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0c47a547-0a66-4b22-8faa-a610d2e41b71 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:05.408883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c47a547-0a66-4b22-8faa-a610d2e41b71 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:05.409319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c47a547-0a66-4b22-8faa-a610d2e41b71 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:05.410612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c47a547-0a66-4b22-8faa-a610d2e41b71 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:05.411347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c47a547-0a66-4b22-8faa-a610d2e41b71 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:05.411819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c47a547-0a66-4b22-8faa-a610d2e41b71 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:05.412262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c47a547-0a66-4b22-8faa-a610d2e41b71 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:05.592257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0c47a547-0a66-4b22-8faa-a610d2e41b71 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:05.601306 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0c47a547-0a66-4b22-8faa-a610d2e41b71 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1469 microversion: 2.1 time: 0.207942 Oct 27 18:50:05.615364 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 660/1306] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:05 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1469 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:05.623939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ee64e35c-3b85-484a-bc84-c71cddbb3d52 req-997da308-f09e-46cd-9e15-21ae86f56aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e561b8d1-1362-4ae7-8578-5971e739c9e1", "tag": "59ff7efa-692b-4e01-9413-347f3012718e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:05.634330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ee64e35c-3b85-484a-bc84-c71cddbb3d52 req-997da308-f09e-46cd-9e15-21ae86f56aae service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:05.634876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ee64e35c-3b85-484a-bc84-c71cddbb3d52 req-997da308-f09e-46cd-9e15-21ae86f56aae service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:05.635512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ee64e35c-3b85-484a-bc84-c71cddbb3d52 req-997da308-f09e-46cd-9e15-21ae86f56aae service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:05.647918 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ee64e35c-3b85-484a-bc84-c71cddbb3d52 req-997da308-f09e-46cd-9e15-21ae86f56aae service nova] Creating event network-changed:59ff7efa-692b-4e01-9413-347f3012718e for instance e561b8d1-1362-4ae7-8578-5971e739c9e1 on n-h2-860687-3 Oct 27 18:50:05.653501 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ee64e35c-3b85-484a-bc84-c71cddbb3d52 req-997da308-f09e-46cd-9e15-21ae86f56aae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036622 Oct 27 18:50:05.654452 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 661/1307] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:05.659890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7438513c-654a-40cf-9130-9cd83b3b3fc5 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:05.660414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7438513c-654a-40cf-9130-9cd83b3b3fc5 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:05.667733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7438513c-654a-40cf-9130-9cd83b3b3fc5 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:05.668232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7438513c-654a-40cf-9130-9cd83b3b3fc5 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:05.668680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7438513c-654a-40cf-9130-9cd83b3b3fc5 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:05.669427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7438513c-654a-40cf-9130-9cd83b3b3fc5 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:05.670201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7438513c-654a-40cf-9130-9cd83b3b3fc5 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:05.670684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7438513c-654a-40cf-9130-9cd83b3b3fc5 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:05.713816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7438513c-654a-40cf-9130-9cd83b3b3fc5 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:50:05.819591 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7438513c-654a-40cf-9130-9cd83b3b3fc5 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 204 len: 0 microversion: 2.1 time: 0.163695 Oct 27 18:50:05.823514 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 662/1308] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:50:05 2022] DELETE /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:50:05.825932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2312a55c-6c2d-4e19-a6c3-c76a21788bc9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:05.826699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2312a55c-6c2d-4e19-a6c3-c76a21788bc9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:05.834317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2312a55c-6c2d-4e19-a6c3-c76a21788bc9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:05.835507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2312a55c-6c2d-4e19-a6c3-c76a21788bc9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:05.836500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2312a55c-6c2d-4e19-a6c3-c76a21788bc9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:05.838168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2312a55c-6c2d-4e19-a6c3-c76a21788bc9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:05.839131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2312a55c-6c2d-4e19-a6c3-c76a21788bc9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:05.839758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2312a55c-6c2d-4e19-a6c3-c76a21788bc9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:06.018096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2312a55c-6c2d-4e19-a6c3-c76a21788bc9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:06.030441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2312a55c-6c2d-4e19-a6c3-c76a21788bc9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:06.032022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2312a55c-6c2d-4e19-a6c3-c76a21788bc9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:06.033357 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2312a55c-6c2d-4e19-a6c3-c76a21788bc9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.211977 Oct 27 18:50:06.034193 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 663/1309] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:05 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:06.038990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-035b7c6c-9219-4c18-84e5-65fcd0f56be6 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:06.039938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-035b7c6c-9219-4c18-84e5-65fcd0f56be6 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 9fd25663-2c8a-4c1f-b5e3-231e38afed4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:06.047669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-035b7c6c-9219-4c18-84e5-65fcd0f56be6 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:06.048735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-035b7c6c-9219-4c18-84e5-65fcd0f56be6 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:06.048997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-035b7c6c-9219-4c18-84e5-65fcd0f56be6 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:06.049997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-035b7c6c-9219-4c18-84e5-65fcd0f56be6 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:06.050709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-035b7c6c-9219-4c18-84e5-65fcd0f56be6 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:06.051260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-035b7c6c-9219-4c18-84e5-65fcd0f56be6 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:06.071339 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-035b7c6c-9219-4c18-84e5-65fcd0f56be6 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] HTTP exception thrown: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-035b7c6c-9219-4c18-84e5-65fcd0f56be6 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Request method failure captured: Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c HTTP/1.1 Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtKiXEumbw4w9vI3EnDpsApwTBMd5wSRCdFBmxO1Yutz4XEIZehE2ZpuSsKXVghur3HqZcTSCtk3McmsOabzqKxdwJrdVnuJv0zZYPH3e5GTqlhSeHY1OX1v_YjKShlDjyRLeFbHUnnbsyxtXzaZlgkg6Jx_cORdrSgGQ9tEHjFkrCk Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_60af6e89111c4ea886cd03dfd18e20d1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ab0bd7aab43d43d2b172fcd4935813f9 Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '9fd25663-2c8a-4c1f-b5e3-231e38afed4c'} Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:06.073233 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:06.080822 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:06.080822 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:06.080822 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:06.080822 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:06.080822 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:06.080822 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:06.080822 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. Oct 27 18:50:06.080822 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:06.080822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-035b7c6c-9219-4c18-84e5-65fcd0f56be6 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Returning 404 to user: Instance 9fd25663-2c8a-4c1f-b5e3-231e38afed4c could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:06.080822 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-035b7c6c-9219-4c18-84e5-65fcd0f56be6 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c" status: 404 len: 111 microversion: 2.1 time: 0.043095 Oct 27 18:50:06.082569 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 664/1310] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:06 2022] GET /compute/v2.1/servers/9fd25663-2c8a-4c1f-b5e3-231e38afed4c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:06.087767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9183632a-941b-4098-97a9-f92fad3b844d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:06.088583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9183632a-941b-4098-97a9-f92fad3b844d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:06.095248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9183632a-941b-4098-97a9-f92fad3b844d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:06.095889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9183632a-941b-4098-97a9-f92fad3b844d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:06.096439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9183632a-941b-4098-97a9-f92fad3b844d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:06.097264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9183632a-941b-4098-97a9-f92fad3b844d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:06.097856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9183632a-941b-4098-97a9-f92fad3b844d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:06.098657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9183632a-941b-4098-97a9-f92fad3b844d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:06.327856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9183632a-941b-4098-97a9-f92fad3b844d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:06.340337 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9183632a-941b-4098-97a9-f92fad3b844d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1647 microversion: 2.1 time: 0.256222 Oct 27 18:50:06.350420 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 665/1311] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:06 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1647 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:06.350420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0ee7e3e0-f6b6-4a61-9f0c-5e63bd9d8d01 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:06.350420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0ee7e3e0-f6b6-4a61-9f0c-5e63bd9d8d01 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 09d2d6e6-9f89-45ca-8353-d0d549e82086] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:06.364961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ee7e3e0-f6b6-4a61-9f0c-5e63bd9d8d01 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:06.365469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ee7e3e0-f6b6-4a61-9f0c-5e63bd9d8d01 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:06.365913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ee7e3e0-f6b6-4a61-9f0c-5e63bd9d8d01 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:06.367401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ee7e3e0-f6b6-4a61-9f0c-5e63bd9d8d01 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:06.367868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ee7e3e0-f6b6-4a61-9f0c-5e63bd9d8d01 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:06.368304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ee7e3e0-f6b6-4a61-9f0c-5e63bd9d8d01 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:06.551581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0ee7e3e0-f6b6-4a61-9f0c-5e63bd9d8d01 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:06.587883 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0ee7e3e0-f6b6-4a61-9f0c-5e63bd9d8d01 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086" status: 200 len: 1521 microversion: 2.1 time: 0.244857 Oct 27 18:50:06.589585 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 666/1312] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:06 2022] GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:06.594603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8d694885-3b4d-4c5b-bf4f-c6fb14956c61 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:06.595349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8d694885-3b4d-4c5b-bf4f-c6fb14956c61 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:06.609054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d694885-3b4d-4c5b-bf4f-c6fb14956c61 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:06.609670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d694885-3b4d-4c5b-bf4f-c6fb14956c61 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:06.610205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d694885-3b4d-4c5b-bf4f-c6fb14956c61 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:06.610984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d694885-3b4d-4c5b-bf4f-c6fb14956c61 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:06.611440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d694885-3b4d-4c5b-bf4f-c6fb14956c61 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:06.611892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d694885-3b4d-4c5b-bf4f-c6fb14956c61 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:06.920555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8d694885-3b4d-4c5b-bf4f-c6fb14956c61 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:06.938300 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8d694885-3b4d-4c5b-bf4f-c6fb14956c61 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1368 microversion: 2.1 time: 0.345362 Oct 27 18:50:06.953148 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 667/1313] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:06 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:06.980140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-372034e1-7562-4eae-9cf3-5695d8cdaf85 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:06.981134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-372034e1-7562-4eae-9cf3-5695d8cdaf85 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:06.988895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-372034e1-7562-4eae-9cf3-5695d8cdaf85 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:06.991336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-372034e1-7562-4eae-9cf3-5695d8cdaf85 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:06.992863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-372034e1-7562-4eae-9cf3-5695d8cdaf85 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:06.995412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-372034e1-7562-4eae-9cf3-5695d8cdaf85 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:06.996598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-372034e1-7562-4eae-9cf3-5695d8cdaf85 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:06.997253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-372034e1-7562-4eae-9cf3-5695d8cdaf85 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:07.603693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-372034e1-7562-4eae-9cf3-5695d8cdaf85 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:07.620757 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-372034e1-7562-4eae-9cf3-5695d8cdaf85 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1469 microversion: 2.1 time: 0.646487 Oct 27 18:50:07.623496 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 668/1314] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:06 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1469 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:07.637953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f68892e1-319f-4514-9217-3cd87cca29e0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:07.638908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f68892e1-319f-4514-9217-3cd87cca29e0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:07.649821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f68892e1-319f-4514-9217-3cd87cca29e0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:07.650491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f68892e1-319f-4514-9217-3cd87cca29e0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:07.651142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f68892e1-319f-4514-9217-3cd87cca29e0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:07.652138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f68892e1-319f-4514-9217-3cd87cca29e0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:07.653404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f68892e1-319f-4514-9217-3cd87cca29e0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:07.653536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f68892e1-319f-4514-9217-3cd87cca29e0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:07.863014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f68892e1-319f-4514-9217-3cd87cca29e0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:07.875962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f68892e1-319f-4514-9217-3cd87cca29e0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:07.881105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f68892e1-319f-4514-9217-3cd87cca29e0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:07.882979 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f68892e1-319f-4514-9217-3cd87cca29e0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.258136 Oct 27 18:50:07.883713 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 669/1315] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:07 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:07.910122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ade487b7-5e53-4046-9261-9bac55c744e4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:07.910779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ade487b7-5e53-4046-9261-9bac55c744e4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:07.923035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ade487b7-5e53-4046-9261-9bac55c744e4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:07.923542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ade487b7-5e53-4046-9261-9bac55c744e4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:07.923989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ade487b7-5e53-4046-9261-9bac55c744e4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:07.924710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ade487b7-5e53-4046-9261-9bac55c744e4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:07.925282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ade487b7-5e53-4046-9261-9bac55c744e4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:07.925927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ade487b7-5e53-4046-9261-9bac55c744e4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:08.126509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ade487b7-5e53-4046-9261-9bac55c744e4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:08.135369 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ade487b7-5e53-4046-9261-9bac55c744e4 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1647 microversion: 2.1 time: 0.246243 Oct 27 18:50:08.152214 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 670/1316] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:07 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1647 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:08.157925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0b96d73e-b10d-4f7d-ba6c-f0e665b04793 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:08.158622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0b96d73e-b10d-4f7d-ba6c-f0e665b04793 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 09d2d6e6-9f89-45ca-8353-d0d549e82086] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:08.164944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b96d73e-b10d-4f7d-ba6c-f0e665b04793 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:08.166401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b96d73e-b10d-4f7d-ba6c-f0e665b04793 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:08.167122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b96d73e-b10d-4f7d-ba6c-f0e665b04793 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:08.167976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b96d73e-b10d-4f7d-ba6c-f0e665b04793 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:08.168642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b96d73e-b10d-4f7d-ba6c-f0e665b04793 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:08.169175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b96d73e-b10d-4f7d-ba6c-f0e665b04793 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:08.408103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0b96d73e-b10d-4f7d-ba6c-f0e665b04793 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:08.446188 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0b96d73e-b10d-4f7d-ba6c-f0e665b04793 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086" status: 200 len: 1521 microversion: 2.1 time: 0.288527 Oct 27 18:50:08.449925 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 671/1317] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:08 2022] GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:08.466833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-48e0ab37-1bb2-4f6b-8909-394ae4087d99 req-b3142f0e-9550-471d-9467-9fbe195f14f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "544f4ef4-fdfc-4e55-a247-7c210300d932", "name": "network-vif-deleted", "tag": "50d7433e-4e6d-4e9a-9b35-21b455c67c5e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:08.498212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-48e0ab37-1bb2-4f6b-8909-394ae4087d99 req-b3142f0e-9550-471d-9467-9fbe195f14f5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:08.498731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-48e0ab37-1bb2-4f6b-8909-394ae4087d99 req-b3142f0e-9550-471d-9467-9fbe195f14f5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:08.500436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-48e0ab37-1bb2-4f6b-8909-394ae4087d99 req-b3142f0e-9550-471d-9467-9fbe195f14f5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:08.569668 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-48e0ab37-1bb2-4f6b-8909-394ae4087d99 req-b3142f0e-9550-471d-9467-9fbe195f14f5 service nova] Creating event network-vif-deleted:50d7433e-4e6d-4e9a-9b35-21b455c67c5e for instance 544f4ef4-fdfc-4e55-a247-7c210300d932 on n-h2-860687-3 Oct 27 18:50:08.594307 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-48e0ab37-1bb2-4f6b-8909-394ae4087d99 req-b3142f0e-9550-471d-9467-9fbe195f14f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141450 Oct 27 18:50:08.595344 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 672/1318] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:08.615806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b437b14d-ddaf-496f-9976-367aebeab4ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:08.616679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b437b14d-ddaf-496f-9976-367aebeab4ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:08.626126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b437b14d-ddaf-496f-9976-367aebeab4ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:08.626810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b437b14d-ddaf-496f-9976-367aebeab4ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:08.627416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b437b14d-ddaf-496f-9976-367aebeab4ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:08.629626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b437b14d-ddaf-496f-9976-367aebeab4ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:08.630423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b437b14d-ddaf-496f-9976-367aebeab4ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:08.631208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b437b14d-ddaf-496f-9976-367aebeab4ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:08.756581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=12 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:09.013056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b437b14d-ddaf-496f-9976-367aebeab4ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:09.024247 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b437b14d-ddaf-496f-9976-367aebeab4ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1368 microversion: 2.1 time: 0.427644 Oct 27 18:50:09.033575 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 673/1319] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:08 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1368 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:09.048399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7f722f33-72ea-4be0-a348-6d4e2fc621e1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:09.049105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7f722f33-72ea-4be0-a348-6d4e2fc621e1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:09.057689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f722f33-72ea-4be0-a348-6d4e2fc621e1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:09.058203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f722f33-72ea-4be0-a348-6d4e2fc621e1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:09.058681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f722f33-72ea-4be0-a348-6d4e2fc621e1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:09.060253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f722f33-72ea-4be0-a348-6d4e2fc621e1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:09.060738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f722f33-72ea-4be0-a348-6d4e2fc621e1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:09.061657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f722f33-72ea-4be0-a348-6d4e2fc621e1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:09.089440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:09.334870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7f722f33-72ea-4be0-a348-6d4e2fc621e1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:09.358474 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7f722f33-72ea-4be0-a348-6d4e2fc621e1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1469 microversion: 2.1 time: 0.320713 Oct 27 18:50:09.361114 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 674/1320] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:09 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1469 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:09.386910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-399a4bfd-e5df-437f-85f5-f121ee105cd7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:09.389590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-399a4bfd-e5df-437f-85f5-f121ee105cd7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:09.402328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-399a4bfd-e5df-437f-85f5-f121ee105cd7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:09.404063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-399a4bfd-e5df-437f-85f5-f121ee105cd7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:09.404747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-399a4bfd-e5df-437f-85f5-f121ee105cd7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:09.409295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-399a4bfd-e5df-437f-85f5-f121ee105cd7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:09.410077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-399a4bfd-e5df-437f-85f5-f121ee105cd7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:09.410837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-399a4bfd-e5df-437f-85f5-f121ee105cd7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:09.624162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-b24a7924-84d0-4803-9ca9-8fc5f82c4300 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Building network info cache for instance {{(pid=127028) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 18:50:10.263621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-399a4bfd-e5df-437f-85f5-f121ee105cd7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:10.280270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-399a4bfd-e5df-437f-85f5-f121ee105cd7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:10.282056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-399a4bfd-e5df-437f-85f5-f121ee105cd7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:10.283472 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-399a4bfd-e5df-437f-85f5-f121ee105cd7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.903835 Oct 27 18:50:10.284241 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 675/1321] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:09 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:10.288803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8542fa27-7b7f-4e69-a376-0c9f21a6e612 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:10.292083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8542fa27-7b7f-4e69-a376-0c9f21a6e612 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:10.307193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8542fa27-7b7f-4e69-a376-0c9f21a6e612 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:10.309915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8542fa27-7b7f-4e69-a376-0c9f21a6e612 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:10.311979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8542fa27-7b7f-4e69-a376-0c9f21a6e612 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:10.312901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8542fa27-7b7f-4e69-a376-0c9f21a6e612 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:10.313852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8542fa27-7b7f-4e69-a376-0c9f21a6e612 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:10.318829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8542fa27-7b7f-4e69-a376-0c9f21a6e612 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:10.379133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8542fa27-7b7f-4e69-a376-0c9f21a6e612 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:10.379661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8542fa27-7b7f-4e69-a376-0c9f21a6e612 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:10.380272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8542fa27-7b7f-4e69-a376-0c9f21a6e612 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:10.380825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-8542fa27-7b7f-4e69-a376-0c9f21a6e612 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lazy-loading 'fault' on Instance uuid 7c2f8430-f7aa-4b29-b980-d0860fcc7123 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:50:10.442928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8542fa27-7b7f-4e69-a376-0c9f21a6e612 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:10.468025 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8542fa27-7b7f-4e69-a376-0c9f21a6e612 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 200 len: 1306 microversion: 2.1 time: 0.182513 Oct 27 18:50:10.472245 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 676/1322] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:10 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 1306 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:10.477293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-030c7293-c3d0-4530-bdf6-43b6fddde8d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:10.479206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-030c7293-c3d0-4530-bdf6-43b6fddde8d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 09d2d6e6-9f89-45ca-8353-d0d549e82086] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:10.485833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-030c7293-c3d0-4530-bdf6-43b6fddde8d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:10.487219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-030c7293-c3d0-4530-bdf6-43b6fddde8d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:10.487901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-030c7293-c3d0-4530-bdf6-43b6fddde8d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:10.488870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-030c7293-c3d0-4530-bdf6-43b6fddde8d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:10.489711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-030c7293-c3d0-4530-bdf6-43b6fddde8d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:10.490377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-030c7293-c3d0-4530-bdf6-43b6fddde8d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:10.586274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-030c7293-c3d0-4530-bdf6-43b6fddde8d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:10.595689 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-030c7293-c3d0-4530-bdf6-43b6fddde8d2 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086" status: 200 len: 1479 microversion: 2.1 time: 0.121981 Oct 27 18:50:10.610994 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 677/1323] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:10 2022] GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086 => generated 1479 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:10.622203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-358d9a30-5c55-493e-bd11-5fbef078c790 req-48ccb1a7-c345-482a-b88b-d49dec81d4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef3dc71-9730-4658-aa69-ff8704cdfb8c", "tag": "a8a13994-bd8c-4fec-909b-fef9e45546f0"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:10.636345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-358d9a30-5c55-493e-bd11-5fbef078c790 req-48ccb1a7-c345-482a-b88b-d49dec81d4a9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:10.637220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-358d9a30-5c55-493e-bd11-5fbef078c790 req-48ccb1a7-c345-482a-b88b-d49dec81d4a9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:10.637911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-358d9a30-5c55-493e-bd11-5fbef078c790 req-48ccb1a7-c345-482a-b88b-d49dec81d4a9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:10.652937 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-358d9a30-5c55-493e-bd11-5fbef078c790 req-48ccb1a7-c345-482a-b88b-d49dec81d4a9 service nova] Creating event network-changed:a8a13994-bd8c-4fec-909b-fef9e45546f0 for instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c on n-h2-860687-3 Oct 27 18:50:10.660662 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-358d9a30-5c55-493e-bd11-5fbef078c790 req-48ccb1a7-c345-482a-b88b-d49dec81d4a9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047622 Oct 27 18:50:10.663776 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 678/1324] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:10.676101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b637d3b3-1494-460d-a4d2-d742fa1bb648 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:10.677953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b637d3b3-1494-460d-a4d2-d742fa1bb648 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:10.696086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b637d3b3-1494-460d-a4d2-d742fa1bb648 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:10.697025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b637d3b3-1494-460d-a4d2-d742fa1bb648 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:10.697696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b637d3b3-1494-460d-a4d2-d742fa1bb648 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:10.698685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b637d3b3-1494-460d-a4d2-d742fa1bb648 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:10.699403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b637d3b3-1494-460d-a4d2-d742fa1bb648 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:10.700053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b637d3b3-1494-460d-a4d2-d742fa1bb648 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:10.943904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b637d3b3-1494-460d-a4d2-d742fa1bb648 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:10.943904 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b637d3b3-1494-460d-a4d2-d742fa1bb648 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1368 microversion: 2.1 time: 0.277564 Oct 27 18:50:10.943904 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 679/1325] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:10 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:10.954249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-77ed8a1c-9a47-4f5e-a09f-8f069aafc3f3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:10.954844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-77ed8a1c-9a47-4f5e-a09f-8f069aafc3f3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:10.966795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77ed8a1c-9a47-4f5e-a09f-8f069aafc3f3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:10.967296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77ed8a1c-9a47-4f5e-a09f-8f069aafc3f3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:10.967738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77ed8a1c-9a47-4f5e-a09f-8f069aafc3f3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:10.968462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77ed8a1c-9a47-4f5e-a09f-8f069aafc3f3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:10.968924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77ed8a1c-9a47-4f5e-a09f-8f069aafc3f3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:10.969356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77ed8a1c-9a47-4f5e-a09f-8f069aafc3f3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:11.318966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-77ed8a1c-9a47-4f5e-a09f-8f069aafc3f3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:11.330190 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-77ed8a1c-9a47-4f5e-a09f-8f069aafc3f3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1535 microversion: 2.1 time: 0.385476 Oct 27 18:50:11.333720 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 680/1326] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:10 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1535 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:11.339804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-95936493-0c39-4906-8ea2-7561a2ce0500 req-12a85369-9aba-40a0-8269-b427d8261025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2f8430-f7aa-4b29-b980-d0860fcc7123", "name": "network-vif-deleted", "tag": "4776f52b-b794-46a8-b2e7-8668af766e21"}, {"server_uuid": "a4bfb98b-fb9e-4935-88a6-584dbc8b63c1", "name": "network-vif-deleted", "tag": "734cc691-defa-4e54-ae96-4dfa0f7cccb6"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:11.379630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-95936493-0c39-4906-8ea2-7561a2ce0500 req-12a85369-9aba-40a0-8269-b427d8261025 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:11.380535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-95936493-0c39-4906-8ea2-7561a2ce0500 req-12a85369-9aba-40a0-8269-b427d8261025 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:11.383017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-95936493-0c39-4906-8ea2-7561a2ce0500 req-12a85369-9aba-40a0-8269-b427d8261025 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:11.429609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-b24a7924-84d0-4803-9ca9-8fc5f82c4300 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Updating instance_info_cache with network_info: [{"id": "a8a13994-bd8c-4fec-909b-fef9e45546f0", "address": "fa:16:3e:93:ef:f1", "network": {"id": "41cb3454-066d-4fcf-bf2e-ef5cb51d55c0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1462812452-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d7e4d40daccf4e27a5e61093cd62dea8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa8a13994-bd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127028) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 18:50:11.430068 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-95936493-0c39-4906-8ea2-7561a2ce0500 req-12a85369-9aba-40a0-8269-b427d8261025 service nova] Creating event network-vif-deleted:4776f52b-b794-46a8-b2e7-8668af766e21 for instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 on n-h1-860687-3 Oct 27 18:50:11.430606 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-95936493-0c39-4906-8ea2-7561a2ce0500 req-12a85369-9aba-40a0-8269-b427d8261025 service nova] Creating event network-vif-deleted:734cc691-defa-4e54-ae96-4dfa0f7cccb6 for instance a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 on n-h1-860687-3 Oct 27 18:50:11.448604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b24a7924-84d0-4803-9ca9-8fc5f82c4300 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Releasing lock "refresh_cache-5ef3dc71-9730-4658-aa69-ff8704cdfb8c" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 18:50:11.449298 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-95936493-0c39-4906-8ea2-7561a2ce0500 req-12a85369-9aba-40a0-8269-b427d8261025 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113153 Oct 27 18:50:11.449471 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b24a7924-84d0-4803-9ca9-8fc5f82c4300 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "POST /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c/action" status: 202 len: 0 microversion: 2.1 time: 7.178971 Oct 27 18:50:11.451270 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 681/1327] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:11.453644 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 647/1328] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:50:04 2022] POST /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c/action => generated 0 bytes in 7183 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 18:50:11.461471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-624a61c0-fa2f-4820-b1a1-18bdc3ecce31 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '.version_select at 0x7fc86ac5db80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:11.465388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5e96d0d6-3450-4790-87d6-c001fcc109b6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:11.466237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5e96d0d6-3450-4790-87d6-c001fcc109b6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:11.500694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e96d0d6-3450-4790-87d6-c001fcc109b6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:11.505175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e96d0d6-3450-4790-87d6-c001fcc109b6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:11.506449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e96d0d6-3450-4790-87d6-c001fcc109b6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:11.510468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e96d0d6-3450-4790-87d6-c001fcc109b6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:11.512170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e96d0d6-3450-4790-87d6-c001fcc109b6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:11.514277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e96d0d6-3450-4790-87d6-c001fcc109b6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:12.094833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5e96d0d6-3450-4790-87d6-c001fcc109b6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:12.105780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5e96d0d6-3450-4790-87d6-c001fcc109b6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:12.115687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5e96d0d6-3450-4790-87d6-c001fcc109b6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:12.121932 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5e96d0d6-3450-4790-87d6-c001fcc109b6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.669075 Oct 27 18:50:12.123599 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 682/1329] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:11 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:12.135970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-337b18c1-738d-49ae-81b4-023e75bbcd32 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:12.141426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-337b18c1-738d-49ae-81b4-023e75bbcd32 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:12.158924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-337b18c1-738d-49ae-81b4-023e75bbcd32 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:12.159715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-337b18c1-738d-49ae-81b4-023e75bbcd32 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:12.160180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-337b18c1-738d-49ae-81b4-023e75bbcd32 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:12.160925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-337b18c1-738d-49ae-81b4-023e75bbcd32 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:12.161397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-337b18c1-738d-49ae-81b4-023e75bbcd32 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:12.161839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-337b18c1-738d-49ae-81b4-023e75bbcd32 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:12.186682 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-337b18c1-738d-49ae-81b4-023e75bbcd32 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-337b18c1-738d-49ae-81b4-023e75bbcd32 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 HTTP/1.1 Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '7c2f8430-f7aa-4b29-b980-d0860fcc7123'} Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:12.189119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:12.195024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:12.195024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:12.195024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:12.195024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:12.195024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:12.195024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:12.195024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:12.198310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-337b18c1-738d-49ae-81b4-023e75bbcd32 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 404 to user: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:12.200574 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-337b18c1-738d-49ae-81b4-023e75bbcd32 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 404 len: 111 microversion: 2.1 time: 0.074217 Oct 27 18:50:12.204640 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 683/1330] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:12 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:12.210273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ff452001-99aa-4a3d-a8d6-9ae2127a1901 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:12.211080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ff452001-99aa-4a3d-a8d6-9ae2127a1901 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 09d2d6e6-9f89-45ca-8353-d0d549e82086] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:12.218265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff452001-99aa-4a3d-a8d6-9ae2127a1901 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:12.218814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff452001-99aa-4a3d-a8d6-9ae2127a1901 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:12.219260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff452001-99aa-4a3d-a8d6-9ae2127a1901 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:12.220140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff452001-99aa-4a3d-a8d6-9ae2127a1901 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:12.220604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff452001-99aa-4a3d-a8d6-9ae2127a1901 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:12.221111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff452001-99aa-4a3d-a8d6-9ae2127a1901 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:12.268720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff452001-99aa-4a3d-a8d6-9ae2127a1901 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:12.269346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff452001-99aa-4a3d-a8d6-9ae2127a1901 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:12.270744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff452001-99aa-4a3d-a8d6-9ae2127a1901 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:12.271748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-ff452001-99aa-4a3d-a8d6-9ae2127a1901 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lazy-loading 'fault' on Instance uuid 09d2d6e6-9f89-45ca-8353-d0d549e82086 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:50:12.355886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ff452001-99aa-4a3d-a8d6-9ae2127a1901 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0bd7aab43d43d2b172fcd4935813f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af6e89111c4ea886cd03dfd18e20d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:12.364513 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ff452001-99aa-4a3d-a8d6-9ae2127a1901 tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086" status: 200 len: 1312 microversion: 2.1 time: 0.158675 Oct 27 18:50:12.365086 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 684/1331] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:12 2022] GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086 => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:12.371467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-883152c4-cbfb-4d28-a149-42ffc3b9df3d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:12.372789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-883152c4-cbfb-4d28-a149-42ffc3b9df3d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:12.378692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-883152c4-cbfb-4d28-a149-42ffc3b9df3d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:12.379406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-883152c4-cbfb-4d28-a149-42ffc3b9df3d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:12.379853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-883152c4-cbfb-4d28-a149-42ffc3b9df3d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:12.380747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-883152c4-cbfb-4d28-a149-42ffc3b9df3d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:12.381218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-883152c4-cbfb-4d28-a149-42ffc3b9df3d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:12.381655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-883152c4-cbfb-4d28-a149-42ffc3b9df3d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:12.454042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:12.555290 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-624a61c0-fa2f-4820-b1a1-18bdc3ecce31 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/e2768d06-b2ef-4b2a-9199-9d4704f2092c" status: 200 len: 184 microversion: 2.1 time: 1.099583 Oct 27 18:50:12.557097 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 648/1332] 10.222.0.42 () {58 vars in 1260 bytes} [Thu Oct 27 18:50:11 2022] GET /compute/v2.1/os-floating-ips/e2768d06-b2ef-4b2a-9199-9d4704f2092c => generated 184 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:12.566452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-90e55352-41aa-490d-8f48-8277272560e7 req-412f0fd2-fc18-45d4-8418-1a351e93a40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873ced30-1179-4f52-9356-8e2f6c310959", "name": "network-vif-unplugged", "status": "completed", "tag": "fc24a5e3-d26b-4205-b920-4db5d5e6467b"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:12.580360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:12.582853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-90e55352-41aa-490d-8f48-8277272560e7 req-412f0fd2-fc18-45d4-8418-1a351e93a40e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:12.583581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-90e55352-41aa-490d-8f48-8277272560e7 req-412f0fd2-fc18-45d4-8418-1a351e93a40e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:12.584398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-90e55352-41aa-490d-8f48-8277272560e7 req-412f0fd2-fc18-45d4-8418-1a351e93a40e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:12.603944 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-90e55352-41aa-490d-8f48-8277272560e7 req-412f0fd2-fc18-45d4-8418-1a351e93a40e service nova] Creating event network-vif-unplugged:fc24a5e3-d26b-4205-b920-4db5d5e6467b for instance 873ced30-1179-4f52-9356-8e2f6c310959 on n-h2-860687-3 Oct 27 18:50:12.614212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-90e55352-41aa-490d-8f48-8277272560e7 req-412f0fd2-fc18-45d4-8418-1a351e93a40e service nova] Instance 873ced30-1179-4f52-9356-8e2f6c310959 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:50:12.649293 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-90e55352-41aa-490d-8f48-8277272560e7 req-412f0fd2-fc18-45d4-8418-1a351e93a40e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087775 Oct 27 18:50:12.659100 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 649/1333] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:12.678341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b454c7fb-76eb-49a4-8aff-d9084151729d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86ac5de50>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:12.703890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:12.889724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-883152c4-cbfb-4d28-a149-42ffc3b9df3d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:12.906048 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-883152c4-cbfb-4d28-a149-42ffc3b9df3d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1368 microversion: 2.1 time: 0.538707 Oct 27 18:50:12.906663 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 685/1334] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:12 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1368 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:12.911129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13dc1489-57d5-4ba4-a8f4-a507a7f2ed6f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:12.911935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-13dc1489-57d5-4ba4-a8f4-a507a7f2ed6f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:12.918261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dc1489-57d5-4ba4-a8f4-a507a7f2ed6f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:12.919008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dc1489-57d5-4ba4-a8f4-a507a7f2ed6f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:12.919625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dc1489-57d5-4ba4-a8f4-a507a7f2ed6f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:12.920757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dc1489-57d5-4ba4-a8f4-a507a7f2ed6f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:12.921378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dc1489-57d5-4ba4-a8f4-a507a7f2ed6f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:12.921961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dc1489-57d5-4ba4-a8f4-a507a7f2ed6f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:13.223258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-13dc1489-57d5-4ba4-a8f4-a507a7f2ed6f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:13.233018 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13dc1489-57d5-4ba4-a8f4-a507a7f2ed6f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1535 microversion: 2.1 time: 0.325302 Oct 27 18:50:13.233614 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 686/1335] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:12 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1535 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:13.246616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8c76254e-b846-4112-ba97-ab126c9d0c1f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.121"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:13.279129 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b454c7fb-76eb-49a4-8aff-d9084151729d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/56e48ef1-e38b-434b-b89c-897dbe14f9e2" status: 202 len: 0 microversion: 2.1 time: 0.614470 Oct 27 18:50:13.279782 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 650/1336] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:50:12 2022] DELETE /compute/v2.1/os-security-groups/56e48ef1-e38b-434b-b89c-897dbe14f9e2 => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:50:13.285077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-723af9ef-219b-4f40-ab49-4668c8641dac req-8d0b8234-ed1c-49f2-a807-878725ddbc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d2d6e6-9f89-45ca-8353-d0d549e82086", "name": "network-vif-deleted", "tag": "aaab970e-7faa-44e8-8d77-661cb812f9b6"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:13.309002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-723af9ef-219b-4f40-ab49-4668c8641dac req-8d0b8234-ed1c-49f2-a807-878725ddbc51 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:13.309738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-723af9ef-219b-4f40-ab49-4668c8641dac req-8d0b8234-ed1c-49f2-a807-878725ddbc51 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:13.310327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-723af9ef-219b-4f40-ab49-4668c8641dac req-8d0b8234-ed1c-49f2-a807-878725ddbc51 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:13.332153 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-723af9ef-219b-4f40-ab49-4668c8641dac req-8d0b8234-ed1c-49f2-a807-878725ddbc51 service nova] Creating event network-vif-deleted:aaab970e-7faa-44e8-8d77-661cb812f9b6 for instance 09d2d6e6-9f89-45ca-8353-d0d549e82086 on n-h2-860687-3 Oct 27 18:50:13.341432 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-723af9ef-219b-4f40-ab49-4668c8641dac req-8d0b8234-ed1c-49f2-a807-878725ddbc51 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060056 Oct 27 18:50:13.342972 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 651/1337] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:13.349049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9cb5b56f-8ada-486c-9265-2f711006b224 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:13.351139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9cb5b56f-8ada-486c-9265-2f711006b224 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:13.360163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cb5b56f-8ada-486c-9265-2f711006b224 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:13.364116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cb5b56f-8ada-486c-9265-2f711006b224 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:13.364755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cb5b56f-8ada-486c-9265-2f711006b224 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:13.365672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cb5b56f-8ada-486c-9265-2f711006b224 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:13.366292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cb5b56f-8ada-486c-9265-2f711006b224 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:13.366955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cb5b56f-8ada-486c-9265-2f711006b224 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:13.493998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8c76254e-b846-4112-ba97-ab126c9d0c1f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:13.500510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c76254e-b846-4112-ba97-ab126c9d0c1f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:13.501009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c76254e-b846-4112-ba97-ab126c9d0c1f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:13.501458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c76254e-b846-4112-ba97-ab126c9d0c1f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:13.502180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c76254e-b846-4112-ba97-ab126c9d0c1f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:13.502676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c76254e-b846-4112-ba97-ab126c9d0c1f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:13.503632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c76254e-b846-4112-ba97-ab126c9d0c1f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:13.749599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9cb5b56f-8ada-486c-9265-2f711006b224 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:13.761826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9cb5b56f-8ada-486c-9265-2f711006b224 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:13.763522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9cb5b56f-8ada-486c-9265-2f711006b224 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:13.765410 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9cb5b56f-8ada-486c-9265-2f711006b224 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.420830 Oct 27 18:50:13.766580 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 652/1338] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:13 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:13.771309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dc625d53-021a-4f99-99e7-de9884e78854 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86af084c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:13.845695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c76254e-b846-4112-ba97-ab126c9d0c1f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "refresh_cache-5ef3dc71-9730-4658-aa69-ff8704cdfb8c" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 18:50:13.846673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c76254e-b846-4112-ba97-ab126c9d0c1f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquired lock "refresh_cache-5ef3dc71-9730-4658-aa69-ff8704cdfb8c" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 18:50:14.469359 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dc625d53-021a-4f99-99e7-de9884e78854 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/8adb7277-f821-4df7-abcc-7e3f1f484005" status: 202 len: 0 microversion: 2.1 time: 0.699487 Oct 27 18:50:14.469359 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 653/1339] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:50:13 2022] DELETE /compute/v2.1/os-security-groups/8adb7277-f821-4df7-abcc-7e3f1f484005 => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:50:14.486606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e697a19a-6b0c-402d-85da-56a03934036c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:14.487438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e697a19a-6b0c-402d-85da-56a03934036c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: 09d2d6e6-9f89-45ca-8353-d0d549e82086] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:14.497882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e697a19a-6b0c-402d-85da-56a03934036c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:14.498577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e697a19a-6b0c-402d-85da-56a03934036c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:14.499265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e697a19a-6b0c-402d-85da-56a03934036c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:14.500059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e697a19a-6b0c-402d-85da-56a03934036c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:14.500631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e697a19a-6b0c-402d-85da-56a03934036c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:14.501137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e697a19a-6b0c-402d-85da-56a03934036c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:14.517005 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-e697a19a-6b0c-402d-85da-56a03934036c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] HTTP exception thrown: Instance 09d2d6e6-9f89-45ca-8353-d0d549e82086 could not be found. Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e697a19a-6b0c-402d-85da-56a03934036c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Request method failure captured: Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086 HTTP/1.1 Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKiXEumbw4w9vI3EnDpsApwTBMd5wSRCdFBmxO1Yutz4XEIZehE2ZpuSsKXVghur3HqZcTSCtk3McmsOabzqKxdwJrdVnuJv0zZYPH3e5GTqlhSeHY1OX1v_YjKShlDjyRLeFbHUnnbsyxtXzaZlgkg6Jx_cORdrSgGQ9tEHjFkrCk Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_60af6e89111c4ea886cd03dfd18e20d1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ab0bd7aab43d43d2b172fcd4935813f9 Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 09d2d6e6-9f89-45ca-8353-d0d549e82086 could not be found. Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '09d2d6e6-9f89-45ca-8353-d0d549e82086'} Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d2d6e6-9f89-45ca-8353-d0d549e82086 could not be found. Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d2d6e6-9f89-45ca-8353-d0d549e82086 could not be found. Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:14.519134 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:14.525445 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:14.525445 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:14.525445 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:14.525445 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:14.525445 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:14.525445 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:14.525445 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d2d6e6-9f89-45ca-8353-d0d549e82086 could not be found. Oct 27 18:50:14.525445 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:14.527669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e697a19a-6b0c-402d-85da-56a03934036c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Returning 404 to user: Instance 09d2d6e6-9f89-45ca-8353-d0d549e82086 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:14.528871 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e697a19a-6b0c-402d-85da-56a03934036c tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086" status: 404 len: 111 microversion: 2.1 time: 0.052388 Oct 27 18:50:14.530222 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 654/1340] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:14 2022] GET /compute/v2.1/servers/09d2d6e6-9f89-45ca-8353-d0d549e82086 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:14.537036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-38284fe3-cd08-4937-9228-cb1b6f3c5282 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:14.538652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-38284fe3-cd08-4937-9228-cb1b6f3c5282 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:14.547825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38284fe3-cd08-4937-9228-cb1b6f3c5282 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:14.548480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38284fe3-cd08-4937-9228-cb1b6f3c5282 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:14.549068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38284fe3-cd08-4937-9228-cb1b6f3c5282 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:14.549865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38284fe3-cd08-4937-9228-cb1b6f3c5282 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:14.550611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38284fe3-cd08-4937-9228-cb1b6f3c5282 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:14.551117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38284fe3-cd08-4937-9228-cb1b6f3c5282 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:14.710970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=17 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:14.803057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-38284fe3-cd08-4937-9228-cb1b6f3c5282 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:14.819212 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-38284fe3-cd08-4937-9228-cb1b6f3c5282 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1368 microversion: 2.1 time: 0.287584 Oct 27 18:50:14.819818 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 655/1341] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:14 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:15.032296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-8c994ca3-61bc-462f-8258-2587d082795e req-13cdd5c7-7609-407c-941d-7fe4165b22e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873ced30-1179-4f52-9356-8e2f6c310959", "tag": "fc24a5e3-d26b-4205-b920-4db5d5e6467b"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:15.043358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8c994ca3-61bc-462f-8258-2587d082795e req-13cdd5c7-7609-407c-941d-7fe4165b22e4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:15.044223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8c994ca3-61bc-462f-8258-2587d082795e req-13cdd5c7-7609-407c-941d-7fe4165b22e4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:15.045174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8c994ca3-61bc-462f-8258-2587d082795e req-13cdd5c7-7609-407c-941d-7fe4165b22e4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:15.063157 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-8c994ca3-61bc-462f-8258-2587d082795e req-13cdd5c7-7609-407c-941d-7fe4165b22e4 service nova] Creating event network-changed:fc24a5e3-d26b-4205-b920-4db5d5e6467b for instance 873ced30-1179-4f52-9356-8e2f6c310959 on n-h2-860687-3 Oct 27 18:50:15.070696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-8c994ca3-61bc-462f-8258-2587d082795e req-13cdd5c7-7609-407c-941d-7fe4165b22e4 service nova] Instance 873ced30-1179-4f52-9356-8e2f6c310959 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:50:15.084263 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-8c994ca3-61bc-462f-8258-2587d082795e req-13cdd5c7-7609-407c-941d-7fe4165b22e4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263201 Oct 27 18:50:15.085665 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 656/1342] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:15.092608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9d4e60e-bdfd-44d2-9a68-ec8f527c6390 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:15.093662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d9d4e60e-bdfd-44d2-9a68-ec8f527c6390 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:15.100886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9d4e60e-bdfd-44d2-9a68-ec8f527c6390 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:15.101639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9d4e60e-bdfd-44d2-9a68-ec8f527c6390 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:15.102246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9d4e60e-bdfd-44d2-9a68-ec8f527c6390 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:15.103697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9d4e60e-bdfd-44d2-9a68-ec8f527c6390 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:15.104326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9d4e60e-bdfd-44d2-9a68-ec8f527c6390 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:15.104922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9d4e60e-bdfd-44d2-9a68-ec8f527c6390 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:15.314151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d9d4e60e-bdfd-44d2-9a68-ec8f527c6390 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:15.333328 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d9d4e60e-bdfd-44d2-9a68-ec8f527c6390 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1535 microversion: 2.1 time: 0.245516 Oct 27 18:50:15.346501 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 657/1343] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:15 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1535 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:15.356398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5cd78ceb-f4ad-4591-af47-7c5cc0f94967 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'create', calling method: .version_select at 0x7fc86ae51f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-276041560", "description": "tempest-description-2007333524"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:15.572708 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5cd78ceb-f4ad-4591-af47-7c5cc0f94967 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.232749 Oct 27 18:50:15.573619 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 658/1344] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:50:15 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:15.578210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf466912-04e8-4637-8a6b-aac42bcd508b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:15.578960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf466912-04e8-4637-8a6b-aac42bcd508b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] [instance: a4bfb98b-fb9e-4935-88a6-584dbc8b63c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:15.589084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf466912-04e8-4637-8a6b-aac42bcd508b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:15.589878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf466912-04e8-4637-8a6b-aac42bcd508b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:15.590615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf466912-04e8-4637-8a6b-aac42bcd508b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:15.591593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf466912-04e8-4637-8a6b-aac42bcd508b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:15.592281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf466912-04e8-4637-8a6b-aac42bcd508b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:15.592941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf466912-04e8-4637-8a6b-aac42bcd508b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:15.612379 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-bf466912-04e8-4637-8a6b-aac42bcd508b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] HTTP exception thrown: Instance a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 could not be found. Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf466912-04e8-4637-8a6b-aac42bcd508b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Request method failure captured: Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 HTTP/1.1 Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKiXEumbw4w9vI3EnDpsApwTBMd5wSRCdFBmxO1Yutz4XEIZehE2ZpuSsKXVghur3HqZcTSCtk3McmsOabzqKxdwJrdVnuJv0zZYPH3e5GTqlhSeHY1OX1v_YjKShlDjyRLeFbHUnnbsyxtXzaZlgkg6Jx_cORdrSgGQ9tEHjFkrCk Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_60af6e89111c4ea886cd03dfd18e20d1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/60af6e89111c4ea886cd03dfd18e20d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 60af6e89111c4ea886cd03dfd18e20d1 Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1702014604 Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ab0bd7aab43d43d2b172fcd4935813f9 Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ListServersNegativeTestJSON-1702014604-project Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 could not be found. Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a4bfb98b-fb9e-4935-88a6-584dbc8b63c1'} Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 could not be found. Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 could not be found. Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:15.614335 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:15.619519 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:15.619519 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:15.619519 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:15.619519 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:15.619519 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:15.619519 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:15.619519 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 could not be found. Oct 27 18:50:15.619519 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:15.619519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf466912-04e8-4637-8a6b-aac42bcd508b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] Returning 404 to user: Instance a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:15.619519 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf466912-04e8-4637-8a6b-aac42bcd508b tempest-ListServersNegativeTestJSON-1702014604 tempest-ListServersNegativeTestJSON-1702014604-project] 10.222.0.42 "GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1" status: 404 len: 111 microversion: 2.1 time: 0.041356 Oct 27 18:50:15.622408 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 659/1345] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:15 2022] GET /compute/v2.1/servers/a4bfb98b-fb9e-4935-88a6-584dbc8b63c1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:15.627427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-098e917b-e2fc-4203-9aa6-c8e5ed6ace54 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:15.628279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-098e917b-e2fc-4203-9aa6-c8e5ed6ace54 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:15.637195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-098e917b-e2fc-4203-9aa6-c8e5ed6ace54 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:15.637804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-098e917b-e2fc-4203-9aa6-c8e5ed6ace54 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:15.638300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-098e917b-e2fc-4203-9aa6-c8e5ed6ace54 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:15.639309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-098e917b-e2fc-4203-9aa6-c8e5ed6ace54 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:15.639881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-098e917b-e2fc-4203-9aa6-c8e5ed6ace54 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:15.640400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-098e917b-e2fc-4203-9aa6-c8e5ed6ace54 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:15.880201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-8c76254e-b846-4112-ba97-ab126c9d0c1f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Building network info cache for instance {{(pid=127029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 18:50:16.110952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-098e917b-e2fc-4203-9aa6-c8e5ed6ace54 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:16.128147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-098e917b-e2fc-4203-9aa6-c8e5ed6ace54 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:16.129566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-098e917b-e2fc-4203-9aa6-c8e5ed6ace54 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:16.134556 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-098e917b-e2fc-4203-9aa6-c8e5ed6ace54 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.507301 Oct 27 18:50:16.135518 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 660/1346] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:15 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:16.140163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-bb14e27d-1d83-4c45-b0ee-7ceb0448e7e9 req-575f4463-9c13-49d2-ab73-769b48b30cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e561b8d1-1362-4ae7-8578-5971e739c9e1", "name": "network-vif-plugged", "status": "completed", "tag": "59ff7efa-692b-4e01-9413-347f3012718e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:16.172788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bb14e27d-1d83-4c45-b0ee-7ceb0448e7e9 req-575f4463-9c13-49d2-ab73-769b48b30cc4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:16.173565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bb14e27d-1d83-4c45-b0ee-7ceb0448e7e9 req-575f4463-9c13-49d2-ab73-769b48b30cc4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:16.174196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bb14e27d-1d83-4c45-b0ee-7ceb0448e7e9 req-575f4463-9c13-49d2-ab73-769b48b30cc4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:16.196608 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-bb14e27d-1d83-4c45-b0ee-7ceb0448e7e9 req-575f4463-9c13-49d2-ab73-769b48b30cc4 service nova] Creating event network-vif-plugged:59ff7efa-692b-4e01-9413-347f3012718e for instance e561b8d1-1362-4ae7-8578-5971e739c9e1 on n-h2-860687-3 Oct 27 18:50:16.215423 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-bb14e27d-1d83-4c45-b0ee-7ceb0448e7e9 req-575f4463-9c13-49d2-ab73-769b48b30cc4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078340 Oct 27 18:50:16.216630 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 661/1347] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:16.228969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-df3c2667-e18a-4ec7-8eee-091d39739384 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Action: 'update', calling method: .version_select at 0x7fc86ac5d940>, body: {"security_group": {"name": "tempest-sg-hth-591081324", "description": "tempest-description-hth-1033633323"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:17.363823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-8c76254e-b846-4112-ba97-ab126c9d0c1f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Updating instance_info_cache with network_info: [{"id": "a8a13994-bd8c-4fec-909b-fef9e45546f0", "address": "fa:16:3e:93:ef:f1", "network": {"id": "41cb3454-066d-4fcf-bf2e-ef5cb51d55c0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1462812452-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d7e4d40daccf4e27a5e61093cd62dea8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa8a13994-bd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 18:50:17.386712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c76254e-b846-4112-ba97-ab126c9d0c1f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Releasing lock "refresh_cache-5ef3dc71-9730-4658-aa69-ff8704cdfb8c" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 18:50:17.387693 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8c76254e-b846-4112-ba97-ab126c9d0c1f tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "POST /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c/action" status: 202 len: 0 microversion: 2.1 time: 4.153135 Oct 27 18:50:17.388874 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 687/1348] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:50:13 2022] POST /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c/action => generated 0 bytes in 4155 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 18:50:17.393923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce2eed43-5623-47cd-aa9f-8e8d5c802dda tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:17.394957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ce2eed43-5623-47cd-aa9f-8e8d5c802dda tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:17.413805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce2eed43-5623-47cd-aa9f-8e8d5c802dda tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:17.414320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce2eed43-5623-47cd-aa9f-8e8d5c802dda tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:17.414816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce2eed43-5623-47cd-aa9f-8e8d5c802dda tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:17.416069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce2eed43-5623-47cd-aa9f-8e8d5c802dda tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:17.419095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce2eed43-5623-47cd-aa9f-8e8d5c802dda tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:17.420594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce2eed43-5623-47cd-aa9f-8e8d5c802dda tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:17.637117 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-df3c2667-e18a-4ec7-8eee-091d39739384 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "PUT /compute/v2.1/os-security-groups/71b16a4c-3c99-448e-9053-d5e16aaa8c89" status: 200 len: 217 microversion: 2.1 time: 1.418437 Oct 27 18:50:17.638203 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 662/1349] 10.222.0.42 () {60 vars in 1290 bytes} [Thu Oct 27 18:50:16 2022] PUT /compute/v2.1/os-security-groups/71b16a4c-3c99-448e-9053-d5e16aaa8c89 => generated 217 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:17.645007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ad5e4f23-617b-40ab-b713-dec9e767d62d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:17.646184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ad5e4f23-617b-40ab-b713-dec9e767d62d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:17.654885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad5e4f23-617b-40ab-b713-dec9e767d62d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:17.655380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad5e4f23-617b-40ab-b713-dec9e767d62d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:17.655974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad5e4f23-617b-40ab-b713-dec9e767d62d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:17.656839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad5e4f23-617b-40ab-b713-dec9e767d62d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:17.657967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad5e4f23-617b-40ab-b713-dec9e767d62d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:17.658850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad5e4f23-617b-40ab-b713-dec9e767d62d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:17.692615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ce2eed43-5623-47cd-aa9f-8e8d5c802dda tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:17.706740 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce2eed43-5623-47cd-aa9f-8e8d5c802dda tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1368 microversion: 2.1 time: 0.316415 Oct 27 18:50:17.711588 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 688/1350] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:17 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1368 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:17.716583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-75c132ba-2772-40e7-bd78-3c940ba83c21 req-210126e2-8c39-4715-bf41-6bdc76da7925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef3dc71-9730-4658-aa69-ff8704cdfb8c", "tag": "a8a13994-bd8c-4fec-909b-fef9e45546f0"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:17.733633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-75c132ba-2772-40e7-bd78-3c940ba83c21 req-210126e2-8c39-4715-bf41-6bdc76da7925 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:17.734755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-75c132ba-2772-40e7-bd78-3c940ba83c21 req-210126e2-8c39-4715-bf41-6bdc76da7925 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:17.735199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-75c132ba-2772-40e7-bd78-3c940ba83c21 req-210126e2-8c39-4715-bf41-6bdc76da7925 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:17.749958 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-75c132ba-2772-40e7-bd78-3c940ba83c21 req-210126e2-8c39-4715-bf41-6bdc76da7925 service nova] Creating event network-changed:a8a13994-bd8c-4fec-909b-fef9e45546f0 for instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c on n-h2-860687-3 Oct 27 18:50:17.756081 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-75c132ba-2772-40e7-bd78-3c940ba83c21 req-210126e2-8c39-4715-bf41-6bdc76da7925 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046609 Oct 27 18:50:17.756641 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 689/1351] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:17.943854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-92e5e014-ac42-4512-b836-4f512ac7cee7 req-735feaf4-b540-4b12-b5b9-aa38010bf390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d5439d-efc3-4e29-a439-7b8b40177342", "name": "network-vif-unplugged", "status": "completed", "tag": "cb412b3e-6a21-4028-8662-7d6ffba2fede"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:17.968552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-92e5e014-ac42-4512-b836-4f512ac7cee7 req-735feaf4-b540-4b12-b5b9-aa38010bf390 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:17.981187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-92e5e014-ac42-4512-b836-4f512ac7cee7 req-735feaf4-b540-4b12-b5b9-aa38010bf390 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:17.983176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-92e5e014-ac42-4512-b836-4f512ac7cee7 req-735feaf4-b540-4b12-b5b9-aa38010bf390 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:18.015080 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-92e5e014-ac42-4512-b836-4f512ac7cee7 req-735feaf4-b540-4b12-b5b9-aa38010bf390 service nova] Creating event network-vif-unplugged:cb412b3e-6a21-4028-8662-7d6ffba2fede for instance 26d5439d-efc3-4e29-a439-7b8b40177342 on n-h1-860687-3 Oct 27 18:50:18.033800 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-92e5e014-ac42-4512-b836-4f512ac7cee7 req-735feaf4-b540-4b12-b5b9-aa38010bf390 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.274506 Oct 27 18:50:18.037140 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 690/1352] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:18.050715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bef47ef2-b219-447a-9411-d7a7a0ff39b4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:18.052504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bef47ef2-b219-447a-9411-d7a7a0ff39b4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:18.068535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bef47ef2-b219-447a-9411-d7a7a0ff39b4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:18.069672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bef47ef2-b219-447a-9411-d7a7a0ff39b4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:18.070135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bef47ef2-b219-447a-9411-d7a7a0ff39b4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:18.070901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bef47ef2-b219-447a-9411-d7a7a0ff39b4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:18.072712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bef47ef2-b219-447a-9411-d7a7a0ff39b4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:18.073197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bef47ef2-b219-447a-9411-d7a7a0ff39b4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:18.117889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ad5e4f23-617b-40ab-b713-dec9e767d62d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:18.128148 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ad5e4f23-617b-40ab-b713-dec9e767d62d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1535 microversion: 2.1 time: 0.488341 Oct 27 18:50:18.146568 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 663/1353] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:17 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1535 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:18.171611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2067ea5a-71cb-4882-a73b-4da3e5193f21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:18.172137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2067ea5a-71cb-4882-a73b-4da3e5193f21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:18.201254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2067ea5a-71cb-4882-a73b-4da3e5193f21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:18.202063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2067ea5a-71cb-4882-a73b-4da3e5193f21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:18.202616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2067ea5a-71cb-4882-a73b-4da3e5193f21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:18.203402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2067ea5a-71cb-4882-a73b-4da3e5193f21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:18.204020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2067ea5a-71cb-4882-a73b-4da3e5193f21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:18.204571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2067ea5a-71cb-4882-a73b-4da3e5193f21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:18.260165 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-2067ea5a-71cb-4882-a73b-4da3e5193f21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] HTTP exception thrown: Instance 544f4ef4-fdfc-4e55-a247-7c210300d932 could not be found. Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2067ea5a-71cb-4882-a73b-4da3e5193f21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Request method failure captured: Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 HTTP/1.1 Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKHH8IjtkkaDXJq96UykJiHbjF02o-LZdd4rn1NkDLrprNVwiIhKr2qa3Hg8gukr01adRY9kfsqxfSsc7HTFOdPYG0vDLsgeHpj1_lo8SSBtCXmD7snvs2NYdXHi9sZUY0tuhk64xJNRwnZNrJ7vzaaE55lsbBsC9KZDPBIOJWE39k Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: d7e4d40daccf4e27a5e61093cd62dea8 Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1065195858 Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d7e4d40daccf4e27a5e61093cd62dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d7e4d40daccf4e27a5e61093cd62dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d7e4d40daccf4e27a5e61093cd62dea8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d7e4d40daccf4e27a5e61093cd62dea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1065195858 Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: d7e4d40daccf4e27a5e61093cd62dea8 Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1065195858 Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FloatingIPsAssociationTestJSON-1065195858-project Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: a7517e24516c4b75a2553b9521d5c38e Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1065195858-project Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 544f4ef4-fdfc-4e55-a247-7c210300d932 could not be found. Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '544f4ef4-fdfc-4e55-a247-7c210300d932'} Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544f4ef4-fdfc-4e55-a247-7c210300d932 could not be found. Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:50:18.263517 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:50:18.267888 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544f4ef4-fdfc-4e55-a247-7c210300d932 could not be found. Oct 27 18:50:18.267888 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:18.267888 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:18.267888 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:18.267888 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:18.267888 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:18.267888 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:18.267888 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:18.267888 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:18.267888 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544f4ef4-fdfc-4e55-a247-7c210300d932 could not be found. Oct 27 18:50:18.267888 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:18.271461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2067ea5a-71cb-4882-a73b-4da3e5193f21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Returning 404 to user: Instance 544f4ef4-fdfc-4e55-a247-7c210300d932 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:18.272583 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2067ea5a-71cb-4882-a73b-4da3e5193f21 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "DELETE /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 404 len: 111 microversion: 2.1 time: 0.123987 Oct 27 18:50:18.273438 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 664/1354] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:50:18 2022] DELETE /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:18.280044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1dc95642-c3f3-46a7-b4d9-93b0fba64f28 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86ae163a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:18.303437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bef47ef2-b219-447a-9411-d7a7a0ff39b4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:18.315173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bef47ef2-b219-447a-9411-d7a7a0ff39b4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:18.316942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bef47ef2-b219-447a-9411-d7a7a0ff39b4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:18.318346 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bef47ef2-b219-447a-9411-d7a7a0ff39b4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.279562 Oct 27 18:50:18.319843 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 691/1355] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:18 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:18.326545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c49b6f59-40de-49a3-8075-348557c9b106 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:18.327535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c49b6f59-40de-49a3-8075-348557c9b106 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 544f4ef4-fdfc-4e55-a247-7c210300d932] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:18.334870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c49b6f59-40de-49a3-8075-348557c9b106 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:18.335972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c49b6f59-40de-49a3-8075-348557c9b106 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:18.336496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c49b6f59-40de-49a3-8075-348557c9b106 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:18.338634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c49b6f59-40de-49a3-8075-348557c9b106 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:18.338922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c49b6f59-40de-49a3-8075-348557c9b106 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:18.339476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c49b6f59-40de-49a3-8075-348557c9b106 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:18.355315 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-c49b6f59-40de-49a3-8075-348557c9b106 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] HTTP exception thrown: Instance 544f4ef4-fdfc-4e55-a247-7c210300d932 could not be found. Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c49b6f59-40de-49a3-8075-348557c9b106 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Request method failure captured: Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 HTTP/1.1 Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtKHH8IjtkkaDXJq96UykJiHbjF02o-LZdd4rn1NkDLrprNVwiIhKr2qa3Hg8gukr01adRY9kfsqxfSsc7HTFOdPYG0vDLsgeHpj1_lo8SSBtCXmD7snvs2NYdXHi9sZUY0tuhk64xJNRwnZNrJ7vzaaE55lsbBsC9KZDPBIOJWE39k Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: d7e4d40daccf4e27a5e61093cd62dea8 Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1065195858 Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d7e4d40daccf4e27a5e61093cd62dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d7e4d40daccf4e27a5e61093cd62dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d7e4d40daccf4e27a5e61093cd62dea8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d7e4d40daccf4e27a5e61093cd62dea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1065195858 Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: d7e4d40daccf4e27a5e61093cd62dea8 Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1065195858 Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-FloatingIPsAssociationTestJSON-1065195858-project Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a7517e24516c4b75a2553b9521d5c38e Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1065195858-project Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 544f4ef4-fdfc-4e55-a247-7c210300d932 could not be found. Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '544f4ef4-fdfc-4e55-a247-7c210300d932'} Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544f4ef4-fdfc-4e55-a247-7c210300d932 could not be found. Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544f4ef4-fdfc-4e55-a247-7c210300d932 could not be found. Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:18.357157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:18.361206 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:18.361206 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:18.361206 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:18.361206 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:18.361206 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:18.361206 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:18.361206 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544f4ef4-fdfc-4e55-a247-7c210300d932 could not be found. Oct 27 18:50:18.361206 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:18.361206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c49b6f59-40de-49a3-8075-348557c9b106 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Returning 404 to user: Instance 544f4ef4-fdfc-4e55-a247-7c210300d932 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:18.361206 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c49b6f59-40de-49a3-8075-348557c9b106 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932" status: 404 len: 111 microversion: 2.1 time: 0.037908 Oct 27 18:50:18.361206 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 692/1356] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:18 2022] GET /compute/v2.1/servers/544f4ef4-fdfc-4e55-a247-7c210300d932 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:18.424133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-308936606", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "aa235b23-5297-45df-b06f-85bc27fd9856"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:18.483333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] validate_networks() for [('aa235b23-5297-45df-b06f-85bc27fd9856', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:50:18.505795 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1dc95642-c3f3-46a7-b4d9-93b0fba64f28 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/71b16a4c-3c99-448e-9053-d5e16aaa8c89" status: 200 len: 217 microversion: 2.1 time: 0.230356 Oct 27 18:50:18.507355 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 665/1357] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 18:50:18 2022] GET /compute/v2.1/os-security-groups/71b16a4c-3c99-448e-9053-d5e16aaa8c89 => generated 217 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:18.521783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a36d068c-a21a-444c-94b3-f4fad6415b97 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '.version_select at 0x7fc86ac5da60>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:18.956513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:50:18.957563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:50:18.958072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:50:18.958511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:50:18.958939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:50:18.969901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:18.971015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:18.971703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:18.972731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:18.973060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:18.973580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:18.981776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:19.004994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Getting quotas for project f95230f585d04c83885c8cd68f662e7a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:50:19.011936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Getting quotas for user ba01db4490774dbfb8196cb459c20dd3 and project f95230f585d04c83885c8cd68f662e7a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:50:19.031525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:50:19.033965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:50:19.108651 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d454cf64-9017-45e1-a674-238b7167d521 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748031 Oct 27 18:50:19.109674 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 693/1358] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:50:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:50:19.139835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8524434d-5fa7-4732-9911-ed4765e53653 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc8708a8940>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:19.449192 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8524434d-5fa7-4732-9911-ed4765e53653 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/71b16a4c-3c99-448e-9053-d5e16aaa8c89" status: 202 len: 0 microversion: 2.1 time: 0.338111 Oct 27 18:50:19.450482 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 694/1359] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:50:19 2022] DELETE /compute/v2.1/os-security-groups/71b16a4c-3c99-448e-9053-d5e16aaa8c89 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:50:19.458654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6616b6e-34a8-4831-8fee-ff6bfc94174c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:19.459533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c6616b6e-34a8-4831-8fee-ff6bfc94174c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:19.482683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:19.486505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6616b6e-34a8-4831-8fee-ff6bfc94174c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:19.490340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6616b6e-34a8-4831-8fee-ff6bfc94174c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:19.491672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6616b6e-34a8-4831-8fee-ff6bfc94174c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:19.492720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6616b6e-34a8-4831-8fee-ff6bfc94174c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:19.495870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6616b6e-34a8-4831-8fee-ff6bfc94174c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:19.496285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6616b6e-34a8-4831-8fee-ff6bfc94174c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:19.679729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c6616b6e-34a8-4831-8fee-ff6bfc94174c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:19.691965 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c6616b6e-34a8-4831-8fee-ff6bfc94174c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1368 microversion: 2.1 time: 0.240163 Oct 27 18:50:19.703431 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 695/1360] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:19 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:19.719774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-209fd290-a5ec-43cc-ab47-1452ec1521d1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:19.723260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-209fd290-a5ec-43cc-ab47-1452ec1521d1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:19.739433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-209fd290-a5ec-43cc-ab47-1452ec1521d1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:19.740097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-209fd290-a5ec-43cc-ab47-1452ec1521d1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:19.740641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-209fd290-a5ec-43cc-ab47-1452ec1521d1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:19.741676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-209fd290-a5ec-43cc-ab47-1452ec1521d1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:19.742486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-209fd290-a5ec-43cc-ab47-1452ec1521d1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:19.743148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-209fd290-a5ec-43cc-ab47-1452ec1521d1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:19.971184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-209fd290-a5ec-43cc-ab47-1452ec1521d1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:19.981981 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-209fd290-a5ec-43cc-ab47-1452ec1521d1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1535 microversion: 2.1 time: 0.276709 Oct 27 18:50:19.983376 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 696/1361] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:19 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1535 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:19.988521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1327311763", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "aa235b23-5297-45df-b06f-85bc27fd9856"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:20.057155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] validate_networks() for [('aa235b23-5297-45df-b06f-85bc27fd9856', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:50:20.981318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:50:20.983456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:50:20.984780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:50:20.986007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:50:20.986918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:50:21.012673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:21.014735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:21.015618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:21.016694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:21.017429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:21.018208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:21.046110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Getting quotas for project f95230f585d04c83885c8cd68f662e7a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:50:21.051331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Getting quotas for user ba01db4490774dbfb8196cb459c20dd3 and project f95230f585d04c83885c8cd68f662e7a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:50:21.084757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:50:21.088047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: b93639af-67fe-4725-9626-ed881eef60ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:50:21.161636 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-08a4b2c9-4dfd-4106-9140-bf3ce692112d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.176792 Oct 27 18:50:21.163335 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 697/1362] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:50:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:50:21.169397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-05455f0d-3e0f-4f68-971a-d3b7bc8bce84 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:21.170766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-05455f0d-3e0f-4f68-971a-d3b7bc8bce84 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:21.185484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05455f0d-3e0f-4f68-971a-d3b7bc8bce84 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:21.186422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05455f0d-3e0f-4f68-971a-d3b7bc8bce84 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:21.188179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05455f0d-3e0f-4f68-971a-d3b7bc8bce84 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:21.189594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05455f0d-3e0f-4f68-971a-d3b7bc8bce84 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:21.190276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05455f0d-3e0f-4f68-971a-d3b7bc8bce84 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:21.192385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05455f0d-3e0f-4f68-971a-d3b7bc8bce84 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:21.384013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-05455f0d-3e0f-4f68-971a-d3b7bc8bce84 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:21.396874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-05455f0d-3e0f-4f68-971a-d3b7bc8bce84 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:21.398362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-05455f0d-3e0f-4f68-971a-d3b7bc8bce84 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:21.400717 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-05455f0d-3e0f-4f68-971a-d3b7bc8bce84 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.235874 Oct 27 18:50:21.401951 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 698/1363] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:21 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:21.409794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-51d7cdbc-bc33-4f37-8af0-f93b1663ceb8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:21.410685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-51d7cdbc-bc33-4f37-8af0-f93b1663ceb8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:21.422001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51d7cdbc-bc33-4f37-8af0-f93b1663ceb8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:21.422542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51d7cdbc-bc33-4f37-8af0-f93b1663ceb8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:21.422990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51d7cdbc-bc33-4f37-8af0-f93b1663ceb8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:21.423740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51d7cdbc-bc33-4f37-8af0-f93b1663ceb8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:21.424214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51d7cdbc-bc33-4f37-8af0-f93b1663ceb8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:21.424647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51d7cdbc-bc33-4f37-8af0-f93b1663ceb8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:21.440012 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-51d7cdbc-bc33-4f37-8af0-f93b1663ceb8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-51d7cdbc-bc33-4f37-8af0-f93b1663ceb8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 HTTP/1.1 Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '7c2f8430-f7aa-4b29-b980-d0860fcc7123'} Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:50:21.441596 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:50:21.445713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:21.445713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:21.445713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:21.445713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:21.445713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:21.445713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:21.445713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:21.445713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:21.445713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:21.445713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:21.445713 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:21.445713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-51d7cdbc-bc33-4f37-8af0-f93b1663ceb8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 404 to user: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:21.445713 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-51d7cdbc-bc33-4f37-8af0-f93b1663ceb8 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 404 len: 111 microversion: 2.1 time: 0.038823 Oct 27 18:50:21.447064 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 699/1364] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:50:21 2022] DELETE /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:21.451817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-9fda4b81-2445-4541-a97a-b7cc12fbc8b7 req-44d34946-67c9-477e-8d91-aadba0bade89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d5439d-efc3-4e29-a439-7b8b40177342", "tag": "cb412b3e-6a21-4028-8662-7d6ffba2fede"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:21.463807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9fda4b81-2445-4541-a97a-b7cc12fbc8b7 req-44d34946-67c9-477e-8d91-aadba0bade89 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:21.464569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9fda4b81-2445-4541-a97a-b7cc12fbc8b7 req-44d34946-67c9-477e-8d91-aadba0bade89 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:21.465205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9fda4b81-2445-4541-a97a-b7cc12fbc8b7 req-44d34946-67c9-477e-8d91-aadba0bade89 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:21.480932 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-9fda4b81-2445-4541-a97a-b7cc12fbc8b7 req-44d34946-67c9-477e-8d91-aadba0bade89 service nova] Creating event network-changed:cb412b3e-6a21-4028-8662-7d6ffba2fede for instance 26d5439d-efc3-4e29-a439-7b8b40177342 on n-h1-860687-3 Oct 27 18:50:21.487266 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-9fda4b81-2445-4541-a97a-b7cc12fbc8b7 req-44d34946-67c9-477e-8d91-aadba0bade89 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038267 Oct 27 18:50:21.488853 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 700/1365] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:21.496818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-082162e7-96fa-44e2-b388-a0e30b5c330f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:21.497806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-082162e7-96fa-44e2-b388-a0e30b5c330f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:21.505144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-082162e7-96fa-44e2-b388-a0e30b5c330f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:21.505689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-082162e7-96fa-44e2-b388-a0e30b5c330f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:21.506067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-082162e7-96fa-44e2-b388-a0e30b5c330f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:21.506823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-082162e7-96fa-44e2-b388-a0e30b5c330f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:21.507285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-082162e7-96fa-44e2-b388-a0e30b5c330f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:21.507718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-082162e7-96fa-44e2-b388-a0e30b5c330f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:22.047445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-082162e7-96fa-44e2-b388-a0e30b5c330f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:22.057253 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-082162e7-96fa-44e2-b388-a0e30b5c330f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1559 microversion: 2.1 time: 0.566686 Oct 27 18:50:22.071117 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 701/1366] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:21 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1559 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:22.083711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-04ff913c-4eac-42cd-a576-27636161da3f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:22.084533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-04ff913c-4eac-42cd-a576-27636161da3f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:22.097811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04ff913c-4eac-42cd-a576-27636161da3f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:22.101886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04ff913c-4eac-42cd-a576-27636161da3f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:22.103785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04ff913c-4eac-42cd-a576-27636161da3f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:22.104767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04ff913c-4eac-42cd-a576-27636161da3f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:22.105397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04ff913c-4eac-42cd-a576-27636161da3f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:22.105994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04ff913c-4eac-42cd-a576-27636161da3f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:22.598423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-04ff913c-4eac-42cd-a576-27636161da3f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:22.608396 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-04ff913c-4eac-42cd-a576-27636161da3f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1528 microversion: 2.1 time: 0.535763 Oct 27 18:50:22.611135 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 702/1367] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:22 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1528 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:22.615885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1274157777", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "451", "networks": [{"uuid": "aa235b23-5297-45df-b06f-85bc27fd9856"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:22.717717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] validate_networks() for [('aa235b23-5297-45df-b06f-85bc27fd9856', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:50:22.905800 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a36d068c-a21a-444c-94b3-f4fad6415b97 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/e2768d06-b2ef-4b2a-9199-9d4704f2092c" status: 202 len: 0 microversion: 2.1 time: 4.396780 Oct 27 18:50:22.906562 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 666/1368] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 18:50:18 2022] DELETE /compute/v2.1/os-floating-ips/e2768d06-b2ef-4b2a-9199-9d4704f2092c => generated 0 bytes in 4398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:50:22.911425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28541f65-2527-4aaa-bc14-41009d747b6b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:22.912243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-28541f65-2527-4aaa-bc14-41009d747b6b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: 7c2f8430-f7aa-4b29-b980-d0860fcc7123] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:22.918746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28541f65-2527-4aaa-bc14-41009d747b6b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:22.919477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28541f65-2527-4aaa-bc14-41009d747b6b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:22.920346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28541f65-2527-4aaa-bc14-41009d747b6b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:22.921236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28541f65-2527-4aaa-bc14-41009d747b6b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:22.921860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28541f65-2527-4aaa-bc14-41009d747b6b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:22.922484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28541f65-2527-4aaa-bc14-41009d747b6b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:22.938101 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-28541f65-2527-4aaa-bc14-41009d747b6b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28541f65-2527-4aaa-bc14-41009d747b6b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 HTTP/1.1 Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '7c2f8430-f7aa-4b29-b980-d0860fcc7123'} Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:22.940420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:22.945312 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:22.945312 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:22.945312 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:22.945312 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:22.945312 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:22.945312 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. Oct 27 18:50:22.945312 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:22.946768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28541f65-2527-4aaa-bc14-41009d747b6b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 404 to user: Instance 7c2f8430-f7aa-4b29-b980-d0860fcc7123 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:22.947818 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-28541f65-2527-4aaa-bc14-41009d747b6b tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123" status: 404 len: 111 microversion: 2.1 time: 0.040125 Oct 27 18:50:22.948874 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 667/1369] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:22 2022] GET /compute/v2.1/servers/7c2f8430-f7aa-4b29-b980-d0860fcc7123 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:22.954718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b151f70a-a874-474e-9115-d259549a8221 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:22.955484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b151f70a-a874-474e-9115-d259549a8221 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:22.964219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b151f70a-a874-474e-9115-d259549a8221 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:22.965091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b151f70a-a874-474e-9115-d259549a8221 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:22.965702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b151f70a-a874-474e-9115-d259549a8221 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:22.966617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b151f70a-a874-474e-9115-d259549a8221 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:22.967238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b151f70a-a874-474e-9115-d259549a8221 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:22.967868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b151f70a-a874-474e-9115-d259549a8221 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:23.102020 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b151f70a-a874-474e-9115-d259549a8221 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151153 Oct 27 18:50:23.103377 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 668/1370] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 18:50:22 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:23.111559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-61ffa918-1747-49c5-9933-e8dc1d20a413 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:23.115149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-61ffa918-1747-49c5-9933-e8dc1d20a413 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:23.137064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61ffa918-1747-49c5-9933-e8dc1d20a413 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:23.137782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61ffa918-1747-49c5-9933-e8dc1d20a413 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:23.140122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61ffa918-1747-49c5-9933-e8dc1d20a413 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:23.143266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61ffa918-1747-49c5-9933-e8dc1d20a413 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:23.144009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61ffa918-1747-49c5-9933-e8dc1d20a413 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:23.144624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61ffa918-1747-49c5-9933-e8dc1d20a413 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:23.655278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-61ffa918-1747-49c5-9933-e8dc1d20a413 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:23.669600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-61ffa918-1747-49c5-9933-e8dc1d20a413 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:23.681558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-61ffa918-1747-49c5-9933-e8dc1d20a413 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:23.689347 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-61ffa918-1747-49c5-9933-e8dc1d20a413 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.584520 Oct 27 18:50:23.706496 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 669/1371] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:23 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:23.708680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9150a555-d170-417a-b852-90ec8259b75e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:23.713314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9150a555-d170-417a-b852-90ec8259b75e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:23.739391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9150a555-d170-417a-b852-90ec8259b75e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:23.740033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9150a555-d170-417a-b852-90ec8259b75e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:23.741538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9150a555-d170-417a-b852-90ec8259b75e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:23.742762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9150a555-d170-417a-b852-90ec8259b75e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:23.743696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9150a555-d170-417a-b852-90ec8259b75e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:23.744484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9150a555-d170-417a-b852-90ec8259b75e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:24.166037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9150a555-d170-417a-b852-90ec8259b75e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:24.181920 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9150a555-d170-417a-b852-90ec8259b75e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1528 microversion: 2.1 time: 0.485882 Oct 27 18:50:24.184506 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 670/1372] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:23 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1528 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:24.198375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa91b4b8-7b13-426a-8ca1-6ee2f3aeba9b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:24.199377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa91b4b8-7b13-426a-8ca1-6ee2f3aeba9b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:24.219463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa91b4b8-7b13-426a-8ca1-6ee2f3aeba9b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:24.220278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa91b4b8-7b13-426a-8ca1-6ee2f3aeba9b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:24.220892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa91b4b8-7b13-426a-8ca1-6ee2f3aeba9b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:24.221831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa91b4b8-7b13-426a-8ca1-6ee2f3aeba9b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:24.222623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa91b4b8-7b13-426a-8ca1-6ee2f3aeba9b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:24.223226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa91b4b8-7b13-426a-8ca1-6ee2f3aeba9b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:24.283689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa91b4b8-7b13-426a-8ca1-6ee2f3aeba9b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:50:24.475099 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fa91b4b8-7b13-426a-8ca1-6ee2f3aeba9b tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 204 len: 0 microversion: 2.1 time: 0.288880 Oct 27 18:50:24.475981 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 671/1373] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:50:24 2022] DELETE /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:50:24.485304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb85c60c-8abe-4813-91b3-8cd31ad18c86 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86ae38c10>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:24.954300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG neutronclient.v2_0.client [None req-fb85c60c-8abe-4813-91b3-8cd31ad18c86 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8adb7277-f821-4df7-abcc-7e3f1f484005 does not exist", "detail": ""}} {{(pid=127028) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:50:24.955829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:50:24.956358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:50:24.956999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:50:24.957129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.security_group_api [None req-fb85c60c-8abe-4813-91b3-8cd31ad18c86 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Neutron security group 8adb7277-f821-4df7-abcc-7e3f1f484005 not found {{(pid=127028) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:50:24.957545 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-fb85c60c-8abe-4813-91b3-8cd31ad18c86 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Security group 8adb7277-f821-4df7-abcc-7e3f1f484005 does not exist Oct 27 18:50:24.957545 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-ab3f4667-fb06-4097-8901-219884c9664b'] Oct 27 18:50:24.957933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:50:24.958492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb85c60c-8abe-4813-91b3-8cd31ad18c86 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/os-security-groups/8adb7277-f821-4df7-abcc-7e3f1f484005 HTTP/1.1 Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: exception: Security group 8adb7277-f821-4df7-abcc-7e3f1f484005 does not exist Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-ab3f4667-fb06-4097-8901-219884c9664b'] Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '8adb7277-f821-4df7-abcc-7e3f1f484005'} Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:50:24.961538 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8adb7277-f821-4df7-abcc-7e3f1f484005 does not exist Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab3f4667-fb06-4097-8901-219884c9664b'] Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8adb7277-f821-4df7-abcc-7e3f1f484005 does not exist Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab3f4667-fb06-4097-8901-219884c9664b'] Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8adb7277-f821-4df7-abcc-7e3f1f484005 does not exist Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab3f4667-fb06-4097-8901-219884c9664b'] Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8adb7277-f821-4df7-abcc-7e3f1f484005 does not exist Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab3f4667-fb06-4097-8901-219884c9664b'] Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb85c60c-8abe-4813-91b3-8cd31ad18c86 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 404 to user: Security group 8adb7277-f821-4df7-abcc-7e3f1f484005 does not exist Oct 27 18:50:24.967905 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-ab3f4667-fb06-4097-8901-219884c9664b'] {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:24.978129 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fb85c60c-8abe-4813-91b3-8cd31ad18c86 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/8adb7277-f821-4df7-abcc-7e3f1f484005" status: 404 len: 194 microversion: 2.1 time: 0.487686 Oct 27 18:50:24.978129 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 672/1374] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:50:24 2022] DELETE /compute/v2.1/os-security-groups/8adb7277-f821-4df7-abcc-7e3f1f484005 => generated 194 bytes in 492 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:24.985326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:24.988012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:24.988012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:24.988738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a61d6e82-562e-494d-921c-14af74d55439 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:24.991544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:24.992776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:24.994550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:25.007221 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-a61d6e82-562e-494d-921c-14af74d55439 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] HTTP exception thrown: Flavor 4bffb839-ba43-4979-986c-23093713dafb could not be found. Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a61d6e82-562e-494d-921c-14af74d55439 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Request method failure captured: Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/flavors/4bffb839-ba43-4979-986c-23093713dafb HTTP/1.1 Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtIKWbWOGhA_Ys5CYRoMgz_v5vo95VqMEpMIRS0GH-SyoGaFB8SJGcRWgPr_w2_gIuaoeT-3QPwjD380CX9yA5hYAkJ0DrXvM98mWbWb7NiGouoCRZqm6LJkXGexYwd33oXz8D-WogBezmfvsW1_zA4XiIP-5a5NzgcZpzPR_eiaKCY Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 73930bf034df486bacb5c7ed0e5c2dc6 Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-MigrationsAdminTest-1182023258 Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/73930bf034df486bacb5c7ed0e5c2dc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73930bf034df486bacb5c7ed0e5c2dc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_73930bf034df486bacb5c7ed0e5c2dc6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73930bf034df486bacb5c7ed0e5c2dc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-MigrationsAdminTest-1182023258 Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 73930bf034df486bacb5c7ed0e5c2dc6 Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-MigrationsAdminTest-1182023258 Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-MigrationsAdminTest-1182023258-project-admin Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 01e4ec7a5e11493b936c3b5b1532aafd Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-MigrationsAdminTest-1182023258-project-admin Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: exception: Flavor 4bffb839-ba43-4979-986c-23093713dafb could not be found. Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '4bffb839-ba43-4979-986c-23093713dafb'} Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 4bffb839-ba43-4979-986c-23093713dafb could not be found. Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 4bffb839-ba43-4979-986c-23093713dafb could not be found. Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:25.028952 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:25.034207 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:25.034207 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:25.034207 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:25.034207 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:25.034207 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:25.034207 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:25.034207 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 4bffb839-ba43-4979-986c-23093713dafb could not be found. Oct 27 18:50:25.034207 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:25.034207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a61d6e82-562e-494d-921c-14af74d55439 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Returning 404 to user: Flavor 4bffb839-ba43-4979-986c-23093713dafb could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:25.034207 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a61d6e82-562e-494d-921c-14af74d55439 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/4bffb839-ba43-4979-986c-23093713dafb" status: 404 len: 109 microversion: 2.1 time: 0.058425 Oct 27 18:50:25.048301 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 673/1375] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:50:24 2022] DELETE /compute/v2.1/flavors/4bffb839-ba43-4979-986c-23093713dafb => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:25.053355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a818cbf3-4aa4-433c-ac1c-d75ec5f50af6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:25.054174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a818cbf3-4aa4-433c-ac1c-d75ec5f50af6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:25.058615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Getting quotas for project f95230f585d04c83885c8cd68f662e7a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:50:25.062663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a818cbf3-4aa4-433c-ac1c-d75ec5f50af6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:25.063232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a818cbf3-4aa4-433c-ac1c-d75ec5f50af6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:25.063690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a818cbf3-4aa4-433c-ac1c-d75ec5f50af6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:25.064416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a818cbf3-4aa4-433c-ac1c-d75ec5f50af6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:25.064880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a818cbf3-4aa4-433c-ac1c-d75ec5f50af6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:25.065318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a818cbf3-4aa4-433c-ac1c-d75ec5f50af6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:25.071220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Getting quotas for user ba01db4490774dbfb8196cb459c20dd3 and project f95230f585d04c83885c8cd68f662e7a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:50:25.105135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:50:25.119091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:50:25.226920 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-239cf255-4a04-4495-9152-595ba20ee80b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.609239 Oct 27 18:50:25.235481 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 703/1376] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:50:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:50:25.249087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-4618a003-a1d3-4ba2-a36c-c11811c8d24c req-eb11f1e1-0e0f-4093-b2e7-39c5a00cec97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873ced30-1179-4f52-9356-8e2f6c310959", "name": "network-vif-plugged", "status": "completed", "tag": "fc24a5e3-d26b-4205-b920-4db5d5e6467b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:25.266100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4618a003-a1d3-4ba2-a36c-c11811c8d24c req-eb11f1e1-0e0f-4093-b2e7-39c5a00cec97 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:25.266664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4618a003-a1d3-4ba2-a36c-c11811c8d24c req-eb11f1e1-0e0f-4093-b2e7-39c5a00cec97 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:25.267110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4618a003-a1d3-4ba2-a36c-c11811c8d24c req-eb11f1e1-0e0f-4093-b2e7-39c5a00cec97 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:25.286170 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-4618a003-a1d3-4ba2-a36c-c11811c8d24c req-eb11f1e1-0e0f-4093-b2e7-39c5a00cec97 service nova] Creating event network-vif-plugged:fc24a5e3-d26b-4205-b920-4db5d5e6467b for instance 873ced30-1179-4f52-9356-8e2f6c310959 on n-h2-860687-3 Oct 27 18:50:25.292833 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-4618a003-a1d3-4ba2-a36c-c11811c8d24c req-eb11f1e1-0e0f-4093-b2e7-39c5a00cec97 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050565 Oct 27 18:50:25.299072 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 704/1377] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:25.317087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-50c3a680-8a4b-46e9-9f06-2baabcb3953d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:25.318101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-50c3a680-8a4b-46e9-9f06-2baabcb3953d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:25.328141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50c3a680-8a4b-46e9-9f06-2baabcb3953d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:25.329119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50c3a680-8a4b-46e9-9f06-2baabcb3953d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:25.330236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50c3a680-8a4b-46e9-9f06-2baabcb3953d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:25.331507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50c3a680-8a4b-46e9-9f06-2baabcb3953d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:25.332856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50c3a680-8a4b-46e9-9f06-2baabcb3953d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:25.334295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50c3a680-8a4b-46e9-9f06-2baabcb3953d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:25.726251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a818cbf3-4aa4-433c-ac1c-d75ec5f50af6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:25.735255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:25.755823 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a818cbf3-4aa4-433c-ac1c-d75ec5f50af6 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1525 microversion: 2.1 time: 0.706348 Oct 27 18:50:25.760265 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 674/1378] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:25 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1525 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:25.769737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5301827e-5f66-4b6b-a67e-f2ba2b774346 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86ae0dca0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:25.906025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG neutronclient.v2_0.client [None req-5301827e-5f66-4b6b-a67e-f2ba2b774346 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 does not exist", "detail": ""}} {{(pid=127028) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:50:25.906792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.security_group_api [None req-5301827e-5f66-4b6b-a67e-f2ba2b774346 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Neutron security group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 not found {{(pid=127028) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:50:25.907420 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-5301827e-5f66-4b6b-a67e-f2ba2b774346 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Security group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 does not exist Oct 27 18:50:25.907420 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-62676fdf-d36e-4713-bf89-b7e0b1c6f1d3'] Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5301827e-5f66-4b6b-a67e-f2ba2b774346 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/os-security-groups/56e48ef1-e38b-434b-b89c-897dbe14f9e2 HTTP/1.1 Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: exception: Security group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 does not exist Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-62676fdf-d36e-4713-bf89-b7e0b1c6f1d3'] Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '56e48ef1-e38b-434b-b89c-897dbe14f9e2'} Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:50:25.909547 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 does not exist Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62676fdf-d36e-4713-bf89-b7e0b1c6f1d3'] Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 does not exist Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62676fdf-d36e-4713-bf89-b7e0b1c6f1d3'] Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 does not exist Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62676fdf-d36e-4713-bf89-b7e0b1c6f1d3'] Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 does not exist Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62676fdf-d36e-4713-bf89-b7e0b1c6f1d3'] Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5301827e-5f66-4b6b-a67e-f2ba2b774346 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 404 to user: Security group 56e48ef1-e38b-434b-b89c-897dbe14f9e2 does not exist Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-62676fdf-d36e-4713-bf89-b7e0b1c6f1d3'] {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5301827e-5f66-4b6b-a67e-f2ba2b774346 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/56e48ef1-e38b-434b-b89c-897dbe14f9e2" status: 404 len: 194 microversion: 2.1 time: 0.149823 Oct 27 18:50:25.914435 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 675/1379] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:50:25 2022] DELETE /compute/v2.1/os-security-groups/56e48ef1-e38b-434b-b89c-897dbe14f9e2 => generated 194 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:25.919834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7aba2089-6f27-46f5-aff5-b573e5b5f327 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:25.919834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7aba2089-6f27-46f5-aff5-b573e5b5f327 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:26.048930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7aba2089-6f27-46f5-aff5-b573e5b5f327 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:26.059902 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7aba2089-6f27-46f5-aff5-b573e5b5f327 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1221 microversion: 2.1 time: 0.146609 Oct 27 18:50:26.061984 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 676/1380] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:25 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1221 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:26.072784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1442406350", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:26.151676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:50:26.745811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-50c3a680-8a4b-46e9-9f06-2baabcb3953d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:26.763801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-50c3a680-8a4b-46e9-9f06-2baabcb3953d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:26.766176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-50c3a680-8a4b-46e9-9f06-2baabcb3953d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:26.768417 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-50c3a680-8a4b-46e9-9f06-2baabcb3953d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 1.465837 Oct 27 18:50:26.771186 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 705/1381] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:25 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:26.775881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a9d9b72-5ff8-4f54-bb75-0ae39b374798 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86ab92940>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:26.819445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:50:26.824747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:50:26.828156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:50:26.830653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:50:26.833527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:50:26.854857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-5a9d9b72-5ff8-4f54-bb75-0ae39b374798 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:50:26.855110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.security_group_api [None req-5a9d9b72-5ff8-4f54-bb75-0ae39b374798 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Neutron security group 3e552394-1166-4e09-9049-7cb585eeaf8b not found {{(pid=127029) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:50:26.855826 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-5a9d9b72-5ff8-4f54-bb75-0ae39b374798 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist Oct 27 18:50:26.855826 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-2cef087e-1d4f-453c-a8f2-07f542387381'] Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a9d9b72-5ff8-4f54-bb75-0ae39b374798 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-security-groups/3e552394-1166-4e09-9049-7cb585eeaf8b HTTP/1.1 Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: exception: Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-2cef087e-1d4f-453c-a8f2-07f542387381'] Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '3e552394-1166-4e09-9049-7cb585eeaf8b'} Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:50:26.858039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cef087e-1d4f-453c-a8f2-07f542387381'] Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cef087e-1d4f-453c-a8f2-07f542387381'] Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cef087e-1d4f-453c-a8f2-07f542387381'] Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cef087e-1d4f-453c-a8f2-07f542387381'] Oct 27 18:50:26.862882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:26.866260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:26.866260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:26.866260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:26.866722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:26.867146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:26.868764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:26.868932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a9d9b72-5ff8-4f54-bb75-0ae39b374798 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 404 to user: Security group 3e552394-1166-4e09-9049-7cb585eeaf8b does not exist Oct 27 18:50:26.868932 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-2cef087e-1d4f-453c-a8f2-07f542387381'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:26.869816 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5a9d9b72-5ff8-4f54-bb75-0ae39b374798 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/3e552394-1166-4e09-9049-7cb585eeaf8b" status: 404 len: 194 microversion: 2.1 time: 0.097699 Oct 27 18:50:26.870584 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 706/1382] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:50:26 2022] DELETE /compute/v2.1/os-security-groups/3e552394-1166-4e09-9049-7cb585eeaf8b => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:26.879893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a5dc9ef5-7933-44ee-b409-cf79d4d2959a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:26.881655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a5dc9ef5-7933-44ee-b409-cf79d4d2959a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:26.899472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5dc9ef5-7933-44ee-b409-cf79d4d2959a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:26.901599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5dc9ef5-7933-44ee-b409-cf79d4d2959a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:26.902125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Getting quotas for project 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:50:26.902790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5dc9ef5-7933-44ee-b409-cf79d4d2959a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:26.905515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5dc9ef5-7933-44ee-b409-cf79d4d2959a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:26.908803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5dc9ef5-7933-44ee-b409-cf79d4d2959a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:26.909562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5dc9ef5-7933-44ee-b409-cf79d4d2959a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:26.910682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Getting quotas for user 1917ae65262c40b792c28c2aa4d44b44 and project 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:50:26.936420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:50:26.945270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:50:27.012882 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-84942322-bd4f-4e9e-9f5b-c88cb9c1f3b5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949252 Oct 27 18:50:27.014122 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 677/1383] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:50:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:50:27.020867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9f296cde-ee69-4d18-abc0-037b93738ddf tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86ac3fdc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:27.084983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG neutronclient.v2_0.client [None req-9f296cde-ee69-4d18-abc0-037b93738ddf tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist", "detail": ""}} {{(pid=127028) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:50:27.085845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.security_group_api [None req-9f296cde-ee69-4d18-abc0-037b93738ddf tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Neutron security group e900be8b-8055-49bc-afea-c3b7c32ea694 not found {{(pid=127028) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:50:27.086681 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-9f296cde-ee69-4d18-abc0-037b93738ddf tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist Oct 27 18:50:27.086681 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-a70b0542-61ea-4828-8800-f80f01f4ec1c'] Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9f296cde-ee69-4d18-abc0-037b93738ddf tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/os-security-groups/e900be8b-8055-49bc-afea-c3b7c32ea694 HTTP/1.1 Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: exception: Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-a70b0542-61ea-4828-8800-f80f01f4ec1c'] Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'e900be8b-8055-49bc-afea-c3b7c32ea694'} Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:50:27.089621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a70b0542-61ea-4828-8800-f80f01f4ec1c'] Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a70b0542-61ea-4828-8800-f80f01f4ec1c'] Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a70b0542-61ea-4828-8800-f80f01f4ec1c'] Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a70b0542-61ea-4828-8800-f80f01f4ec1c'] Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9f296cde-ee69-4d18-abc0-037b93738ddf tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 404 to user: Security group e900be8b-8055-49bc-afea-c3b7c32ea694 does not exist Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-a70b0542-61ea-4828-8800-f80f01f4ec1c'] {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9f296cde-ee69-4d18-abc0-037b93738ddf tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/e900be8b-8055-49bc-afea-c3b7c32ea694" status: 404 len: 194 microversion: 2.1 time: 0.076784 Oct 27 18:50:27.097872 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 678/1384] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:50:27 2022] DELETE /compute/v2.1/os-security-groups/e900be8b-8055-49bc-afea-c3b7c32ea694 => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:27.108761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-885df1c3-00ef-4494-9375-9859731672b9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:27.109731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-885df1c3-00ef-4494-9375-9859731672b9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:27.328357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-885df1c3-00ef-4494-9375-9859731672b9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:27.340798 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-885df1c3-00ef-4494-9375-9859731672b9 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1213 microversion: 2.1 time: 0.247057 Oct 27 18:50:27.341812 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 679/1385] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:27 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1213 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:27.363770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-97c1cdc8-3f0f-461d-8a10-74019ca04ee3 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:27.363770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-97c1cdc8-3f0f-461d-8a10-74019ca04ee3 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:27.374562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97c1cdc8-3f0f-461d-8a10-74019ca04ee3 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:27.375217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97c1cdc8-3f0f-461d-8a10-74019ca04ee3 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:27.375694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97c1cdc8-3f0f-461d-8a10-74019ca04ee3 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:27.376502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97c1cdc8-3f0f-461d-8a10-74019ca04ee3 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:27.377001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97c1cdc8-3f0f-461d-8a10-74019ca04ee3 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:27.377682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97c1cdc8-3f0f-461d-8a10-74019ca04ee3 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:27.544124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-97c1cdc8-3f0f-461d-8a10-74019ca04ee3 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:27.556307 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-97c1cdc8-3f0f-461d-8a10-74019ca04ee3 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1281 microversion: 2.1 time: 0.212656 Oct 27 18:50:27.557740 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 680/1386] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:27 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1281 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:27.574854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a9253789-5101-400f-954a-4bb349773113 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86af633a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:27.651908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a5dc9ef5-7933-44ee-b409-cf79d4d2959a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:27.660427 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a5dc9ef5-7933-44ee-b409-cf79d4d2959a tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1525 microversion: 2.1 time: 0.788488 Oct 27 18:50:27.661377 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 707/1387] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:26 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1525 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:27.672768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG neutronclient.v2_0.client [None req-a9253789-5101-400f-954a-4bb349773113 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist", "detail": ""}} {{(pid=127028) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:50:27.673379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.security_group_api [None req-a9253789-5101-400f-954a-4bb349773113 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Neutron security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b not found {{(pid=127028) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:50:27.673924 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-a9253789-5101-400f-954a-4bb349773113 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist Oct 27 18:50:27.673924 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-feb86a2f-fd9b-42d8-af4a-d41fe65aa4c3'] Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a9253789-5101-400f-954a-4bb349773113 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/os-security-groups/a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b HTTP/1.1 Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: exception: Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-feb86a2f-fd9b-42d8-af4a-d41fe65aa4c3'] Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b'} Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:50:27.675976 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-feb86a2f-fd9b-42d8-af4a-d41fe65aa4c3'] Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-feb86a2f-fd9b-42d8-af4a-d41fe65aa4c3'] Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-feb86a2f-fd9b-42d8-af4a-d41fe65aa4c3'] Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-feb86a2f-fd9b-42d8-af4a-d41fe65aa4c3'] Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a9253789-5101-400f-954a-4bb349773113 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 404 to user: Security group a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b does not exist Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: Neutron server returns request_ids: ['req-feb86a2f-fd9b-42d8-af4a-d41fe65aa4c3'] {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:27.680056 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a9253789-5101-400f-954a-4bb349773113 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b" status: 404 len: 194 microversion: 2.1 time: 0.118565 Oct 27 18:50:27.686142 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 681/1388] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:50:27 2022] DELETE /compute/v2.1/os-security-groups/a379c8b6-3d16-4a3d-b21c-5b76e9f5aa6b => generated 194 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:27.690526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d09803a1-2d54-43cb-a2e7-18d429f07b43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86acd1280>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:27.796306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ac54915-d49c-41ee-94eb-f1ee0cdf602f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:27.797365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ac54915-d49c-41ee-94eb-f1ee0cdf602f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:27.804858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ac54915-d49c-41ee-94eb-f1ee0cdf602f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:27.805872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ac54915-d49c-41ee-94eb-f1ee0cdf602f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:27.806685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ac54915-d49c-41ee-94eb-f1ee0cdf602f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:27.807656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ac54915-d49c-41ee-94eb-f1ee0cdf602f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:27.808353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ac54915-d49c-41ee-94eb-f1ee0cdf602f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:27.809038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ac54915-d49c-41ee-94eb-f1ee0cdf602f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:27.949152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-d09803a1-2d54-43cb-a2e7-18d429f07b43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:50:27.950571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.security_group_api [None req-d09803a1-2d54-43cb-a2e7-18d429f07b43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Neutron security group c7450720-f9b2-42ff-a356-27bc81cfbd0a not found {{(pid=127029) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:50:27.951684 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-d09803a1-2d54-43cb-a2e7-18d429f07b43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist Oct 27 18:50:27.951684 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-0f86fb62-7717-494a-9177-b17d868f3235'] Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d09803a1-2d54-43cb-a2e7-18d429f07b43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-security-groups/c7450720-f9b2-42ff-a356-27bc81cfbd0a HTTP/1.1 Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: exception: Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-0f86fb62-7717-494a-9177-b17d868f3235'] Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'c7450720-f9b2-42ff-a356-27bc81cfbd0a'} Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:50:27.953614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f86fb62-7717-494a-9177-b17d868f3235'] Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f86fb62-7717-494a-9177-b17d868f3235'] Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f86fb62-7717-494a-9177-b17d868f3235'] Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f86fb62-7717-494a-9177-b17d868f3235'] Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d09803a1-2d54-43cb-a2e7-18d429f07b43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 404 to user: Security group c7450720-f9b2-42ff-a356-27bc81cfbd0a does not exist Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-0f86fb62-7717-494a-9177-b17d868f3235'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d09803a1-2d54-43cb-a2e7-18d429f07b43 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/c7450720-f9b2-42ff-a356-27bc81cfbd0a" status: 404 len: 194 microversion: 2.1 time: 0.273149 Oct 27 18:50:27.959695 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 708/1389] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:50:27 2022] DELETE /compute/v2.1/os-security-groups/c7450720-f9b2-42ff-a356-27bc81cfbd0a => generated 194 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:27.972006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-c05d2eda-86e1-491c-b75d-acf2db637708 req-ec736022-268c-440f-8dfa-3de5084b849b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef3dc71-9730-4658-aa69-ff8704cdfb8c", "name": "network-vif-deleted", "tag": "a8a13994-bd8c-4fec-909b-fef9e45546f0"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:27.992299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c05d2eda-86e1-491c-b75d-acf2db637708 req-ec736022-268c-440f-8dfa-3de5084b849b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:27.992734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c05d2eda-86e1-491c-b75d-acf2db637708 req-ec736022-268c-440f-8dfa-3de5084b849b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:27.993247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c05d2eda-86e1-491c-b75d-acf2db637708 req-ec736022-268c-440f-8dfa-3de5084b849b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:28.007292 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-c05d2eda-86e1-491c-b75d-acf2db637708 req-ec736022-268c-440f-8dfa-3de5084b849b service nova] Creating event network-vif-deleted:a8a13994-bd8c-4fec-909b-fef9e45546f0 for instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c on n-h2-860687-3 Oct 27 18:50:28.013695 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-c05d2eda-86e1-491c-b75d-acf2db637708 req-ec736022-268c-440f-8dfa-3de5084b849b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054777 Oct 27 18:50:28.014537 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 709/1390] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:28.019758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f37ba213-a231-46c8-bb6b-67b85258dec5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:28.020563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f37ba213-a231-46c8-bb6b-67b85258dec5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:28.028560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f37ba213-a231-46c8-bb6b-67b85258dec5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:28.029354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f37ba213-a231-46c8-bb6b-67b85258dec5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:28.030044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f37ba213-a231-46c8-bb6b-67b85258dec5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:28.031013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f37ba213-a231-46c8-bb6b-67b85258dec5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:28.031886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f37ba213-a231-46c8-bb6b-67b85258dec5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:28.032548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f37ba213-a231-46c8-bb6b-67b85258dec5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:28.090000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9ac54915-d49c-41ee-94eb-f1ee0cdf602f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:28.119772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f37ba213-a231-46c8-bb6b-67b85258dec5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:50:28.122000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9ac54915-d49c-41ee-94eb-f1ee0cdf602f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:28.123592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9ac54915-d49c-41ee-94eb-f1ee0cdf602f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:28.128188 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ac54915-d49c-41ee-94eb-f1ee0cdf602f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.336374 Oct 27 18:50:28.143826 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 682/1391] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:27 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:50:28.339272 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f37ba213-a231-46c8-bb6b-67b85258dec5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9" status: 204 len: 0 microversion: 2.1 time: 0.322938 Oct 27 18:50:28.343600 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 710/1392] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:50:28 2022] DELETE /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:50:28.355105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-597dffd4-da19-4cc6-bda6-18bd309eb568 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:28.356060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-597dffd4-da19-4cc6-bda6-18bd309eb568 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:28.378342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597dffd4-da19-4cc6-bda6-18bd309eb568 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:28.378867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597dffd4-da19-4cc6-bda6-18bd309eb568 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:28.379308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597dffd4-da19-4cc6-bda6-18bd309eb568 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:28.385812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0ae2f030-1e53-41e3-8740-6fb0dd2e6042 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:28.386571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0ae2f030-1e53-41e3-8740-6fb0dd2e6042 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:28.402983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597dffd4-da19-4cc6-bda6-18bd309eb568 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:28.405871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597dffd4-da19-4cc6-bda6-18bd309eb568 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:28.406350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597dffd4-da19-4cc6-bda6-18bd309eb568 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:28.433845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ae2f030-1e53-41e3-8740-6fb0dd2e6042 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:28.440506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ae2f030-1e53-41e3-8740-6fb0dd2e6042 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:28.442841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ae2f030-1e53-41e3-8740-6fb0dd2e6042 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:28.445544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ae2f030-1e53-41e3-8740-6fb0dd2e6042 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:28.446053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ae2f030-1e53-41e3-8740-6fb0dd2e6042 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:28.451982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ae2f030-1e53-41e3-8740-6fb0dd2e6042 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:28.629260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0ae2f030-1e53-41e3-8740-6fb0dd2e6042 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:28.645851 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0ae2f030-1e53-41e3-8740-6fb0dd2e6042 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1265 microversion: 2.1 time: 0.282801 Oct 27 18:50:28.647181 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 711/1393] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:28 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:28.652820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-77bb1b2f-1a5e-438e-beb7-6ec9aec5cc94 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:28.653582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-77bb1b2f-1a5e-438e-beb7-6ec9aec5cc94 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:28.660557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bb1b2f-1a5e-438e-beb7-6ec9aec5cc94 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:28.661190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bb1b2f-1a5e-438e-beb7-6ec9aec5cc94 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:28.661739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bb1b2f-1a5e-438e-beb7-6ec9aec5cc94 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:28.663161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bb1b2f-1a5e-438e-beb7-6ec9aec5cc94 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:28.663756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bb1b2f-1a5e-438e-beb7-6ec9aec5cc94 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:28.665631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bb1b2f-1a5e-438e-beb7-6ec9aec5cc94 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:28.890840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-77bb1b2f-1a5e-438e-beb7-6ec9aec5cc94 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:28.895068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-597dffd4-da19-4cc6-bda6-18bd309eb568 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:28.905458 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-77bb1b2f-1a5e-438e-beb7-6ec9aec5cc94 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1279 microversion: 2.1 time: 0.254664 Oct 27 18:50:28.906485 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 712/1394] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:28 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1279 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:28.909203 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-597dffd4-da19-4cc6-bda6-18bd309eb568 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9" status: 200 len: 1647 microversion: 2.1 time: 0.561123 Oct 27 18:50:28.938202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e66d07f6-e4da-4efb-a39b-035b51699edf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:28.941077 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 683/1395] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:28 2022] GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 => generated 1647 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:28.945407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e66d07f6-e4da-4efb-a39b-035b51699edf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:28.969373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e66d07f6-e4da-4efb-a39b-035b51699edf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:28.970119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e66d07f6-e4da-4efb-a39b-035b51699edf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:28.970685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e66d07f6-e4da-4efb-a39b-035b51699edf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:28.971513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e66d07f6-e4da-4efb-a39b-035b51699edf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:28.974448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e66d07f6-e4da-4efb-a39b-035b51699edf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:28.982502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e66d07f6-e4da-4efb-a39b-035b51699edf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:29.017820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e66d07f6-e4da-4efb-a39b-035b51699edf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:29.018437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e66d07f6-e4da-4efb-a39b-035b51699edf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:29.018948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e66d07f6-e4da-4efb-a39b-035b51699edf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:29.019658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-e66d07f6-e4da-4efb-a39b-035b51699edf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lazy-loading 'fault' on Instance uuid 5ef3dc71-9730-4658-aa69-ff8704cdfb8c {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:50:29.159829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d0ae707b-2df4-49dd-b4c7-9c71419e1040 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:29.162797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d0ae707b-2df4-49dd-b4c7-9c71419e1040 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:29.175495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0ae707b-2df4-49dd-b4c7-9c71419e1040 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:29.176518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0ae707b-2df4-49dd-b4c7-9c71419e1040 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:29.177400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0ae707b-2df4-49dd-b4c7-9c71419e1040 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:29.181986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0ae707b-2df4-49dd-b4c7-9c71419e1040 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:29.183193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0ae707b-2df4-49dd-b4c7-9c71419e1040 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:29.184579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0ae707b-2df4-49dd-b4c7-9c71419e1040 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:29.515628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e66d07f6-e4da-4efb-a39b-035b51699edf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7517e24516c4b75a2553b9521d5c38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e4d40daccf4e27a5e61093cd62dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:29.524036 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e66d07f6-e4da-4efb-a39b-035b51699edf tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 200 len: 1313 microversion: 2.1 time: 0.604140 Oct 27 18:50:29.539007 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 713/1396] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:28 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 1313 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:29.546862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6669ddba-087c-4bf1-8132-a2988dae7114 req-0aedb016-b6a7-44b0-a9b8-a7a39aadf358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e561b8d1-1362-4ae7-8578-5971e739c9e1", "tag": "59ff7efa-692b-4e01-9413-347f3012718e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:29.556753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6669ddba-087c-4bf1-8132-a2988dae7114 req-0aedb016-b6a7-44b0-a9b8-a7a39aadf358 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:29.557493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6669ddba-087c-4bf1-8132-a2988dae7114 req-0aedb016-b6a7-44b0-a9b8-a7a39aadf358 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:29.558081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6669ddba-087c-4bf1-8132-a2988dae7114 req-0aedb016-b6a7-44b0-a9b8-a7a39aadf358 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:29.571626 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6669ddba-087c-4bf1-8132-a2988dae7114 req-0aedb016-b6a7-44b0-a9b8-a7a39aadf358 service nova] Creating event network-changed:59ff7efa-692b-4e01-9413-347f3012718e for instance e561b8d1-1362-4ae7-8578-5971e739c9e1 on n-h2-860687-3 Oct 27 18:50:29.586320 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6669ddba-087c-4bf1-8132-a2988dae7114 req-0aedb016-b6a7-44b0-a9b8-a7a39aadf358 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044140 Oct 27 18:50:29.588147 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 714/1397] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:29.670640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-847e07be-72db-45b3-9f60-01557d7e632d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:29.671633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-847e07be-72db-45b3-9f60-01557d7e632d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:29.678154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-847e07be-72db-45b3-9f60-01557d7e632d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:29.678912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-847e07be-72db-45b3-9f60-01557d7e632d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:29.679512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-847e07be-72db-45b3-9f60-01557d7e632d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:29.680385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-847e07be-72db-45b3-9f60-01557d7e632d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:29.681525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-847e07be-72db-45b3-9f60-01557d7e632d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:29.682209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-847e07be-72db-45b3-9f60-01557d7e632d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:29.789407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-847e07be-72db-45b3-9f60-01557d7e632d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:29.812817 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-847e07be-72db-45b3-9f60-01557d7e632d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1265 microversion: 2.1 time: 0.144286 Oct 27 18:50:29.833805 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 715/1398] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:29 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:50:29.930629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-80b60ed5-357f-48ae-8e04-9e7176ef037f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:29.931460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-80b60ed5-357f-48ae-8e04-9e7176ef037f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:29.947287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-80b60ed5-357f-48ae-8e04-9e7176ef037f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:29.947783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-80b60ed5-357f-48ae-8e04-9e7176ef037f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:29.948447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-80b60ed5-357f-48ae-8e04-9e7176ef037f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:29.949360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-80b60ed5-357f-48ae-8e04-9e7176ef037f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:29.950014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-80b60ed5-357f-48ae-8e04-9e7176ef037f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:29.950703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-80b60ed5-357f-48ae-8e04-9e7176ef037f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:30.006060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:30.135248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-80b60ed5-357f-48ae-8e04-9e7176ef037f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:30.143785 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-80b60ed5-357f-48ae-8e04-9e7176ef037f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1279 microversion: 2.1 time: 0.216904 Oct 27 18:50:30.148326 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 716/1399] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:29 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1279 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:50:30.160275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84550e5a-e962-4997-8401-21009bb406f5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:30.161195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-84550e5a-e962-4997-8401-21009bb406f5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:30.173728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84550e5a-e962-4997-8401-21009bb406f5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:30.178754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84550e5a-e962-4997-8401-21009bb406f5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:30.179401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84550e5a-e962-4997-8401-21009bb406f5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:30.180248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84550e5a-e962-4997-8401-21009bb406f5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:30.187066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84550e5a-e962-4997-8401-21009bb406f5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:30.187624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84550e5a-e962-4997-8401-21009bb406f5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:30.448913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d0ae707b-2df4-49dd-b4c7-9c71419e1040 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:30.461420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d0ae707b-2df4-49dd-b4c7-9c71419e1040 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:30.471838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d0ae707b-2df4-49dd-b4c7-9c71419e1040 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:30.477707 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d0ae707b-2df4-49dd-b4c7-9c71419e1040 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 1.323113 Oct 27 18:50:30.481577 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 684/1400] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:29 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:30.550757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9bbe5b2-4c5a-47a2-a043-c71d880890c3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:30.551384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d9bbe5b2-4c5a-47a2-a043-c71d880890c3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] [instance: 5ef3dc71-9730-4658-aa69-ff8704cdfb8c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:30.566677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9bbe5b2-4c5a-47a2-a043-c71d880890c3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:30.567439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9bbe5b2-4c5a-47a2-a043-c71d880890c3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:30.568059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9bbe5b2-4c5a-47a2-a043-c71d880890c3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:30.568985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9bbe5b2-4c5a-47a2-a043-c71d880890c3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:30.569677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9bbe5b2-4c5a-47a2-a043-c71d880890c3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:30.570294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9bbe5b2-4c5a-47a2-a043-c71d880890c3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:30.613882 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d9bbe5b2-4c5a-47a2-a043-c71d880890c3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] HTTP exception thrown: Instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c could not be found. Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9bbe5b2-4c5a-47a2-a043-c71d880890c3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Request method failure captured: Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c HTTP/1.1 Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKHH8IjtkkaDXJq96UykJiHbjF02o-LZdd4rn1NkDLrprNVwiIhKr2qa3Hg8gukr01adRY9kfsqxfSsc7HTFOdPYG0vDLsgeHpj1_lo8SSBtCXmD7snvs2NYdXHi9sZUY0tuhk64xJNRwnZNrJ7vzaaE55lsbBsC9KZDPBIOJWE39k Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: d7e4d40daccf4e27a5e61093cd62dea8 Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1065195858 Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d7e4d40daccf4e27a5e61093cd62dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d7e4d40daccf4e27a5e61093cd62dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d7e4d40daccf4e27a5e61093cd62dea8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d7e4d40daccf4e27a5e61093cd62dea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1065195858 Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: d7e4d40daccf4e27a5e61093cd62dea8 Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1065195858 Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FloatingIPsAssociationTestJSON-1065195858-project Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: a7517e24516c4b75a2553b9521d5c38e Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1065195858-project Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c could not be found. Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '5ef3dc71-9730-4658-aa69-ff8704cdfb8c'} Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c could not be found. Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c could not be found. Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:30.615574 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:30.620545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:30.620545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:30.620545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:30.620545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:30.620545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:30.620545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:30.620545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c could not be found. Oct 27 18:50:30.620545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:30.622137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9bbe5b2-4c5a-47a2-a043-c71d880890c3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] Returning 404 to user: Instance 5ef3dc71-9730-4658-aa69-ff8704cdfb8c could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:30.623587 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d9bbe5b2-4c5a-47a2-a043-c71d880890c3 tempest-FloatingIPsAssociationTestJSON-1065195858 tempest-FloatingIPsAssociationTestJSON-1065195858-project] 10.222.0.42 "GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c" status: 404 len: 111 microversion: 2.1 time: 0.076420 Oct 27 18:50:30.627269 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 685/1401] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:30 2022] GET /compute/v2.1/servers/5ef3dc71-9730-4658-aa69-ff8704cdfb8c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:50:30.838666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0c3b0f3c-138f-4c0b-a70d-bda30630f4f8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:30.839300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0c3b0f3c-138f-4c0b-a70d-bda30630f4f8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:30.849741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c3b0f3c-138f-4c0b-a70d-bda30630f4f8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:30.856118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c3b0f3c-138f-4c0b-a70d-bda30630f4f8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:30.861994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c3b0f3c-138f-4c0b-a70d-bda30630f4f8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:30.864746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c3b0f3c-138f-4c0b-a70d-bda30630f4f8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:30.871804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c3b0f3c-138f-4c0b-a70d-bda30630f4f8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:30.872671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c3b0f3c-138f-4c0b-a70d-bda30630f4f8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:31.032858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-84550e5a-e962-4997-8401-21009bb406f5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:31.042221 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-84550e5a-e962-4997-8401-21009bb406f5 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9" status: 200 len: 1647 microversion: 2.1 time: 0.892531 Oct 27 18:50:31.054324 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 717/1402] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:30 2022] GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 => generated 1647 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:31.173563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af478727-1d50-41e2-9fd0-0770333a9eb6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:31.175464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-af478727-1d50-41e2-9fd0-0770333a9eb6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:31.184166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af478727-1d50-41e2-9fd0-0770333a9eb6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:31.197062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af478727-1d50-41e2-9fd0-0770333a9eb6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:31.197715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af478727-1d50-41e2-9fd0-0770333a9eb6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:31.198879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af478727-1d50-41e2-9fd0-0770333a9eb6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:31.199463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af478727-1d50-41e2-9fd0-0770333a9eb6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:31.201119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af478727-1d50-41e2-9fd0-0770333a9eb6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:31.311827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0c3b0f3c-138f-4c0b-a70d-bda30630f4f8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:31.334142 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0c3b0f3c-138f-4c0b-a70d-bda30630f4f8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1271 microversion: 2.1 time: 0.496680 Oct 27 18:50:31.352074 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 686/1403] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:30 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1271 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:31.510611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0121a6fd-0160-47f7-aea2-a30b41a4a0a2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:31.511375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0121a6fd-0160-47f7-aea2-a30b41a4a0a2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:31.523576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0121a6fd-0160-47f7-aea2-a30b41a4a0a2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:31.524604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0121a6fd-0160-47f7-aea2-a30b41a4a0a2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:31.525283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0121a6fd-0160-47f7-aea2-a30b41a4a0a2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:31.527191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0121a6fd-0160-47f7-aea2-a30b41a4a0a2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:31.529618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0121a6fd-0160-47f7-aea2-a30b41a4a0a2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:31.530321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0121a6fd-0160-47f7-aea2-a30b41a4a0a2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:32.010254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-af478727-1d50-41e2-9fd0-0770333a9eb6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:32.026878 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-af478727-1d50-41e2-9fd0-0770333a9eb6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1321 microversion: 2.1 time: 0.850929 Oct 27 18:50:32.027619 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 718/1404] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:31 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1321 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:50:32.039562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e051cf66-84b1-4fa1-aa83-fe7bf7f7b5f3 req-6c51a123-b46f-4e48-80cf-2afc75f8b0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b9a4b6f-da4c-442f-9b0c-b1828360eeef", "tag": "ca705bb3-1c42-4e80-9e45-835a7b457c4f"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:32.059264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e051cf66-84b1-4fa1-aa83-fe7bf7f7b5f3 req-6c51a123-b46f-4e48-80cf-2afc75f8b0c6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:32.066075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e051cf66-84b1-4fa1-aa83-fe7bf7f7b5f3 req-6c51a123-b46f-4e48-80cf-2afc75f8b0c6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:32.066881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e051cf66-84b1-4fa1-aa83-fe7bf7f7b5f3 req-6c51a123-b46f-4e48-80cf-2afc75f8b0c6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:32.085985 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e051cf66-84b1-4fa1-aa83-fe7bf7f7b5f3 req-6c51a123-b46f-4e48-80cf-2afc75f8b0c6 service nova] Creating event network-changed:ca705bb3-1c42-4e80-9e45-835a7b457c4f for instance 5b9a4b6f-da4c-442f-9b0c-b1828360eeef on n-h1-860687-3 Oct 27 18:50:32.093522 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e051cf66-84b1-4fa1-aa83-fe7bf7f7b5f3 req-6c51a123-b46f-4e48-80cf-2afc75f8b0c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064611 Oct 27 18:50:32.094479 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 719/1405] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:32.271536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-68376416-5c36-42fb-8837-e2002804f105 tempest-FlavorsV2NegativeTest-831250540 tempest-FlavorsV2NegativeTest-831250540-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:32.282587 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-68376416-5c36-42fb-8837-e2002804f105 tempest-FlavorsV2NegativeTest-831250540 tempest-FlavorsV2NegativeTest-831250540-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.186291 Oct 27 18:50:32.283937 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 720/1406] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:50:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:32.291212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a6dee0b9-9659-4e13-a9c5-3341035d2045 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:32.292776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a6dee0b9-9659-4e13-a9c5-3341035d2045 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:32.301740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6dee0b9-9659-4e13-a9c5-3341035d2045 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:32.302681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6dee0b9-9659-4e13-a9c5-3341035d2045 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:32.303536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6dee0b9-9659-4e13-a9c5-3341035d2045 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:32.306189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6dee0b9-9659-4e13-a9c5-3341035d2045 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:32.319747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6dee0b9-9659-4e13-a9c5-3341035d2045 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:32.322359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6dee0b9-9659-4e13-a9c5-3341035d2045 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:32.836418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0121a6fd-0160-47f7-aea2-a30b41a4a0a2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:32.854714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a6dee0b9-9659-4e13-a9c5-3341035d2045 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:32.895250 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a6dee0b9-9659-4e13-a9c5-3341035d2045 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9" status: 200 len: 1647 microversion: 2.1 time: 0.604713 Oct 27 18:50:32.897696 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 721/1407] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:32 2022] GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 => generated 1647 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:32.900559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0121a6fd-0160-47f7-aea2-a30b41a4a0a2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:32.902885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0121a6fd-0160-47f7-aea2-a30b41a4a0a2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:32.909138 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0121a6fd-0160-47f7-aea2-a30b41a4a0a2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 1.402592 Oct 27 18:50:32.910907 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 687/1408] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:31 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:32.917143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1944811d-f5aa-4da8-8e69-b7a0e09d3e1a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:32.919308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1944811d-f5aa-4da8-8e69-b7a0e09d3e1a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:32.928348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1944811d-f5aa-4da8-8e69-b7a0e09d3e1a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:32.929362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1944811d-f5aa-4da8-8e69-b7a0e09d3e1a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:32.929991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1944811d-f5aa-4da8-8e69-b7a0e09d3e1a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:32.931186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1944811d-f5aa-4da8-8e69-b7a0e09d3e1a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:32.931682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1944811d-f5aa-4da8-8e69-b7a0e09d3e1a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:32.932169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1944811d-f5aa-4da8-8e69-b7a0e09d3e1a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:33.063752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1944811d-f5aa-4da8-8e69-b7a0e09d3e1a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:33.073228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5cebea37-998f-4e37-80c2-962482f6629f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:33.075206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5cebea37-998f-4e37-80c2-962482f6629f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:33.095237 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1944811d-f5aa-4da8-8e69-b7a0e09d3e1a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1271 microversion: 2.1 time: 0.188550 Oct 27 18:50:33.097566 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 722/1409] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:32 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:33.098703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cebea37-998f-4e37-80c2-962482f6629f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:33.099840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cebea37-998f-4e37-80c2-962482f6629f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:33.101329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cebea37-998f-4e37-80c2-962482f6629f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:33.103949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cebea37-998f-4e37-80c2-962482f6629f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:33.104597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cebea37-998f-4e37-80c2-962482f6629f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:33.106094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cebea37-998f-4e37-80c2-962482f6629f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:33.137010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ddde6cd3-cc44-4e39-9a3a-b4ba2997854a tempest-FlavorsV2NegativeTest-831250540 tempest-FlavorsV2NegativeTest-831250540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1207067773", "imageRef": "77c2410e-7d71-494d-9879-b904c81fe2f7", "flavorRef": "452"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:33.221104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-ddde6cd3-cc44-4e39-9a3a-b4ba2997854a tempest-FlavorsV2NegativeTest-831250540 tempest-FlavorsV2NegativeTest-831250540-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:50:33.983998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5cebea37-998f-4e37-80c2-962482f6629f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:33.998042 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5cebea37-998f-4e37-80c2-962482f6629f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1321 microversion: 2.1 time: 0.944706 Oct 27 18:50:33.998691 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-ddde6cd3-cc44-4e39-9a3a-b4ba2997854a tempest-FlavorsV2NegativeTest-831250540 tempest-FlavorsV2NegativeTest-831250540-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 27 18:50:34.000613 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 688/1410] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:33 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1321 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ddde6cd3-cc44-4e39-9a3a-b4ba2997854a tempest-FlavorsV2NegativeTest-831250540 tempest-FlavorsV2NegativeTest-831250540-project] Request method failure captured: Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 143 Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtL39RPJvxO9du5pV71FFlDbWjuySu-D76Cn66llgDTOxl0Q9n7vMD8UCgG9OF9KPnCSCVV_sRxWx9noWoVNhlYhfIUevuaKDdCcMPjk_EWxfY-OCsGAIiWZlVRret-YH1TwY_kjDf-hMTvMeX-VAk9-emmWtCw-wRbgEM9DjVeW0pA Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 228638325b964462a5cbdefed8708865 Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-FlavorsV2NegativeTest-831250540 Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/228638325b964462a5cbdefed8708865"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/228638325b964462a5cbdefed8708865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_228638325b964462a5cbdefed8708865", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/228638325b964462a5cbdefed8708865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-FlavorsV2NegativeTest-831250540 Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 228638325b964462a5cbdefed8708865 Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-831250540 Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-FlavorsV2NegativeTest-831250540-project Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e114664c3e0c4ce9ae7891db12eb0403 Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-FlavorsV2NegativeTest-831250540-project Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1207067773", "imageRef": "77c2410e-7d71-494d-9879-b904c81fe2f7", "flavorRef": "452"}} Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: exception: Flavor's memory is too small for requested image. Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1207067773', 'imageRef': '77c2410e-7d71-494d-9879-b904c81fe2f7', 'flavorRef': '452'}}} Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:50:34.000879 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ddde6cd3-cc44-4e39-9a3a-b4ba2997854a tempest-FlavorsV2NegativeTest-831250540 tempest-FlavorsV2NegativeTest-831250540-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ddde6cd3-cc44-4e39-9a3a-b4ba2997854a tempest-FlavorsV2NegativeTest-831250540 tempest-FlavorsV2NegativeTest-831250540-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.870017 Oct 27 18:50:34.007711 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 723/1411] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:50:33 2022] POST /compute/v2.1/servers => generated 93 bytes in 872 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:50:34.018167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d56f42ff-cc7a-443a-bc55-b4b1168261ef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:34.020436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fae9de31-633b-4935-aeb9-6ebb2337f5c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:34.021760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fae9de31-633b-4935-aeb9-6ebb2337f5c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:34.023079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d56f42ff-cc7a-443a-bc55-b4b1168261ef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:34.049557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fae9de31-633b-4935-aeb9-6ebb2337f5c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:34.050237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d56f42ff-cc7a-443a-bc55-b4b1168261ef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:34.050770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d56f42ff-cc7a-443a-bc55-b4b1168261ef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:34.051213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d56f42ff-cc7a-443a-bc55-b4b1168261ef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:34.051925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d56f42ff-cc7a-443a-bc55-b4b1168261ef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:34.052287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fae9de31-633b-4935-aeb9-6ebb2337f5c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:34.052419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d56f42ff-cc7a-443a-bc55-b4b1168261ef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:34.052795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d56f42ff-cc7a-443a-bc55-b4b1168261ef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:34.055384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fae9de31-633b-4935-aeb9-6ebb2337f5c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:34.056799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fae9de31-633b-4935-aeb9-6ebb2337f5c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:34.059341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fae9de31-633b-4935-aeb9-6ebb2337f5c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:34.059801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fae9de31-633b-4935-aeb9-6ebb2337f5c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:34.811850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fae9de31-633b-4935-aeb9-6ebb2337f5c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:34.825219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fae9de31-633b-4935-aeb9-6ebb2337f5c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:34.827066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fae9de31-633b-4935-aeb9-6ebb2337f5c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:34.834965 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fae9de31-633b-4935-aeb9-6ebb2337f5c6 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.821132 Oct 27 18:50:34.847178 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 689/1412] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:34 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:34.853175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5091f255-d66c-46e5-bf48-2d2528862440 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:34.854005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5091f255-d66c-46e5-bf48-2d2528862440 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:34.861788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5091f255-d66c-46e5-bf48-2d2528862440 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:34.865315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5091f255-d66c-46e5-bf48-2d2528862440 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:34.866051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5091f255-d66c-46e5-bf48-2d2528862440 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:34.866990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5091f255-d66c-46e5-bf48-2d2528862440 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:34.871413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5091f255-d66c-46e5-bf48-2d2528862440 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:34.872054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5091f255-d66c-46e5-bf48-2d2528862440 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:34.892313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d56f42ff-cc7a-443a-bc55-b4b1168261ef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb341748c5a45d5a36b398bc305feb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582be696729849069dc5b7d51598d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:34.901239 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d56f42ff-cc7a-443a-bc55-b4b1168261ef tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9" status: 200 len: 1469 microversion: 2.1 time: 0.897067 Oct 27 18:50:34.901827 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 724/1413] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:34 2022] GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 => generated 1469 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:34.919250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-50e9e23a-46fe-485b-9c6a-40fc6d7753d0 req-6377f731-adc2-4f30-a3ee-b2c2ecf49f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93639af-67fe-4725-9626-ed881eef60ba", "tag": "ba4e40ea-685e-4ca1-932b-b9f6d118d19d"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:34.941602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-50e9e23a-46fe-485b-9c6a-40fc6d7753d0 req-6377f731-adc2-4f30-a3ee-b2c2ecf49f29 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:34.942378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-50e9e23a-46fe-485b-9c6a-40fc6d7753d0 req-6377f731-adc2-4f30-a3ee-b2c2ecf49f29 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:34.943331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-50e9e23a-46fe-485b-9c6a-40fc6d7753d0 req-6377f731-adc2-4f30-a3ee-b2c2ecf49f29 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:34.958991 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-50e9e23a-46fe-485b-9c6a-40fc6d7753d0 req-6377f731-adc2-4f30-a3ee-b2c2ecf49f29 service nova] Creating event network-changed:ba4e40ea-685e-4ca1-932b-b9f6d118d19d for instance b93639af-67fe-4725-9626-ed881eef60ba on n-h2-860687-3 Oct 27 18:50:34.966738 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-50e9e23a-46fe-485b-9c6a-40fc6d7753d0 req-6377f731-adc2-4f30-a3ee-b2c2ecf49f29 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059196 Oct 27 18:50:34.967952 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 725/1414] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:34.974043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5aa50a93-784e-491e-91bb-df97c1be6cf8 req-ecb5ed98-cbf3-4312-ab44-a0d456565257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7b6449-5aab-4b34-ab36-79dacd8893a9", "name": "network-vif-deleted", "tag": "5264c280-364d-4964-af91-6ca4d4a1758a"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:34.989199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5aa50a93-784e-491e-91bb-df97c1be6cf8 req-ecb5ed98-cbf3-4312-ab44-a0d456565257 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:34.990038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5aa50a93-784e-491e-91bb-df97c1be6cf8 req-ecb5ed98-cbf3-4312-ab44-a0d456565257 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:34.990742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5aa50a93-784e-491e-91bb-df97c1be6cf8 req-ecb5ed98-cbf3-4312-ab44-a0d456565257 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:35.003517 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5aa50a93-784e-491e-91bb-df97c1be6cf8 req-ecb5ed98-cbf3-4312-ab44-a0d456565257 service nova] Creating event network-vif-deleted:5264c280-364d-4964-af91-6ca4d4a1758a for instance bc7b6449-5aab-4b34-ab36-79dacd8893a9 on n-h1-860687-3 Oct 27 18:50:35.010143 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5aa50a93-784e-491e-91bb-df97c1be6cf8 req-ecb5ed98-cbf3-4312-ab44-a0d456565257 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040021 Oct 27 18:50:35.011112 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 726/1415] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:35.026579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:35.033899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-43e8d0a2-e43f-40fd-aee5-81a33ccfe60d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:35.037417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-43e8d0a2-e43f-40fd-aee5-81a33ccfe60d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:35.053379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e8d0a2-e43f-40fd-aee5-81a33ccfe60d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:35.054114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e8d0a2-e43f-40fd-aee5-81a33ccfe60d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:35.054842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e8d0a2-e43f-40fd-aee5-81a33ccfe60d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:35.057595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e8d0a2-e43f-40fd-aee5-81a33ccfe60d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:35.060581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e8d0a2-e43f-40fd-aee5-81a33ccfe60d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:35.061349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e8d0a2-e43f-40fd-aee5-81a33ccfe60d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:35.113066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=18 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:35.752446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-43e8d0a2-e43f-40fd-aee5-81a33ccfe60d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:35.764622 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-43e8d0a2-e43f-40fd-aee5-81a33ccfe60d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1321 microversion: 2.1 time: 0.738696 Oct 27 18:50:35.771992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5091f255-d66c-46e5-bf48-2d2528862440 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:35.779407 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 727/1416] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:35 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1321 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:35.784317 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5091f255-d66c-46e5-bf48-2d2528862440 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1313 microversion: 2.1 time: 0.935697 Oct 27 18:50:35.785193 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 690/1417] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:34 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1313 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:35.876925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f9b1ae80-e87f-4882-8327-12a8a8914037 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:35.877615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f9b1ae80-e87f-4882-8327-12a8a8914037 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:35.887936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9b1ae80-e87f-4882-8327-12a8a8914037 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:35.894098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9b1ae80-e87f-4882-8327-12a8a8914037 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:35.894791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9b1ae80-e87f-4882-8327-12a8a8914037 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:35.895425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9b1ae80-e87f-4882-8327-12a8a8914037 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:35.895905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9b1ae80-e87f-4882-8327-12a8a8914037 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:35.896348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9b1ae80-e87f-4882-8327-12a8a8914037 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:35.927389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9753c671-ba78-409b-b346-81b1f01a8b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:35.928542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9753c671-ba78-409b-b346-81b1f01a8b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] [instance: bc7b6449-5aab-4b34-ab36-79dacd8893a9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:35.943191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9753c671-ba78-409b-b346-81b1f01a8b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:35.944019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9753c671-ba78-409b-b346-81b1f01a8b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:35.944690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9753c671-ba78-409b-b346-81b1f01a8b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:35.945605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9753c671-ba78-409b-b346-81b1f01a8b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:35.946813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9753c671-ba78-409b-b346-81b1f01a8b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:35.948031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9753c671-ba78-409b-b346-81b1f01a8b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:35.965285 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-9753c671-ba78-409b-b346-81b1f01a8b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] HTTP exception thrown: Instance bc7b6449-5aab-4b34-ab36-79dacd8893a9 could not be found. Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9753c671-ba78-409b-b346-81b1f01a8b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Request method failure captured: Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 HTTP/1.1 Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtKYobuKZ4q8Zt9hC4uAv1hNgkTVHeNfG8OdE1DnEfP8W8_Gv4XN5GkvXLCFTxeQEamHkKR1CN3aqNjfur43tBBrA2acOlmr7egBx8aeZOXZ-YGYiaqf6ypFVvSX0HXc1YdE2zZ_pOkL6NStN6jT7KI4jrOqoZgokAa3OGY1yIvL4nU Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/582be696729849069dc5b7d51598d2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_582be696729849069dc5b7d51598d2ed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/582be696729849069dc5b7d51598d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 582be696729849069dc5b7d51598d2ed Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1231199335 Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2fb341748c5a45d5a36b398bc305feb3 Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-SecurityGroupsTestJSON-1231199335-project Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance bc7b6449-5aab-4b34-ab36-79dacd8893a9 could not be found. Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'bc7b6449-5aab-4b34-ab36-79dacd8893a9'} Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc7b6449-5aab-4b34-ab36-79dacd8893a9 could not be found. Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc7b6449-5aab-4b34-ab36-79dacd8893a9 could not be found. Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:35.967225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:35.971269 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:35.971269 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:35.971269 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:35.971269 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:35.971269 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:35.971269 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc7b6449-5aab-4b34-ab36-79dacd8893a9 could not be found. Oct 27 18:50:35.971269 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:35.981437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9753c671-ba78-409b-b346-81b1f01a8b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Returning 404 to user: Instance bc7b6449-5aab-4b34-ab36-79dacd8893a9 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:35.982702 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9753c671-ba78-409b-b346-81b1f01a8b6c tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9" status: 404 len: 111 microversion: 2.1 time: 0.059565 Oct 27 18:50:35.983830 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 691/1418] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:35 2022] GET /compute/v2.1/servers/bc7b6449-5aab-4b34-ab36-79dacd8893a9 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:50:35.991556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-39a24ce3-3298-44d7-9bdb-8866cc22a35d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86b4b6c10>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:36.436905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f9b1ae80-e87f-4882-8327-12a8a8914037 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:36.450473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f9b1ae80-e87f-4882-8327-12a8a8914037 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:36.453414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f9b1ae80-e87f-4882-8327-12a8a8914037 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:36.456005 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f9b1ae80-e87f-4882-8327-12a8a8914037 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.583607 Oct 27 18:50:36.456967 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 728/1419] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:35 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:36.608049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-227c67fd-dc56-47a0-84c2-663308f2616f tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-899752609", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:36.611682 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-227c67fd-dc56-47a0-84c2-663308f2616f tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] HTTP exception thrown: min_count must be <= max_count Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-227c67fd-dc56-47a0-84c2-663308f2616f tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Request method failure captured: Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 183 Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtL7Fom1loHsNxwwakbC3sHlaJDV3f0kR3wx2pRbOHHz5F3slm9bEpLgCv3z4DhlLGbcvpsghdTEAPuv72oHiwpGHq1eEABzinsWtpUwtrwmSt5Q4lm7Axdf7EgHIBCE064HOCKZpGYb7iutBFIdCoq7myDvUiqK6MEpNYRCbuNq70Q Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 8ed2c3017f7a45e79060a888286ad76d Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8ed2c3017f7a45e79060a888286ad76d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 8ed2c3017f7a45e79060a888286ad76d Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-MultipleCreateNegativeTestJSON-1727458110-project Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c4b9c73de6024ab08de9883d3e3114e9 Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1727458110-project Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-899752609", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: exception: min_count must be <= max_count Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-899752609', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 27 18:50:36.613218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.619646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-227c67fd-dc56-47a0-84c2-663308f2616f tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Returning 400 to user: min_count must be <= max_count {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:36.620163 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-227c67fd-dc56-47a0-84c2-663308f2616f tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.162250 Oct 27 18:50:36.621053 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 729/1420] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:50:36 2022] POST /compute/v2.1/servers => generated 74 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:50:36.694361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-57e997b9-f805-4f3c-8368-f345b5eb77d6 req-ff2fb2d8-055d-45b4-8345-c69a0a0376b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b9a4b6f-da4c-442f-9b0c-b1828360eeef", "name": "network-vif-plugged", "status": "completed", "tag": "ca705bb3-1c42-4e80-9e45-835a7b457c4f"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:36.701732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:36.707553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-57e997b9-f805-4f3c-8368-f345b5eb77d6 req-ff2fb2d8-055d-45b4-8345-c69a0a0376b0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:36.708040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-57e997b9-f805-4f3c-8368-f345b5eb77d6 req-ff2fb2d8-055d-45b4-8345-c69a0a0376b0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:36.708475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-57e997b9-f805-4f3c-8368-f345b5eb77d6 req-ff2fb2d8-055d-45b4-8345-c69a0a0376b0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:36.720548 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-57e997b9-f805-4f3c-8368-f345b5eb77d6 req-ff2fb2d8-055d-45b4-8345-c69a0a0376b0 service nova] Creating event network-vif-plugged:ca705bb3-1c42-4e80-9e45-835a7b457c4f for instance 5b9a4b6f-da4c-442f-9b0c-b1828360eeef on n-h1-860687-3 Oct 27 18:50:36.725910 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-57e997b9-f805-4f3c-8368-f345b5eb77d6 req-ff2fb2d8-055d-45b4-8345-c69a0a0376b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103698 Oct 27 18:50:36.726796 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 730/1421] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:36.733951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f5d9b8c8-0259-4052-a820-ef1a99501519 tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-44932377", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "max_count": 0}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f5d9b8c8-0259-4052-a820-ef1a99501519 tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Request method failure captured: Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 166 Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtL7Fom1loHsNxwwakbC3sHlaJDV3f0kR3wx2pRbOHHz5F3slm9bEpLgCv3z4DhlLGbcvpsghdTEAPuv72oHiwpGHq1eEABzinsWtpUwtrwmSt5Q4lm7Axdf7EgHIBCE064HOCKZpGYb7iutBFIdCoq7myDvUiqK6MEpNYRCbuNq70Q Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 8ed2c3017f7a45e79060a888286ad76d Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8ed2c3017f7a45e79060a888286ad76d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 8ed2c3017f7a45e79060a888286ad76d Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-MultipleCreateNegativeTestJSON-1727458110-project Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c4b9c73de6024ab08de9883d3e3114e9 Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1727458110-project Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-44932377", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "max_count": 0}} Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-44932377', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'max_count': 0}}} Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 0 Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:50:36.738025 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f5d9b8c8-0259-4052-a820-ef1a99501519 tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f5d9b8c8-0259-4052-a820-ef1a99501519 tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010887 Oct 27 18:50:36.743686 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 731/1422] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:50:36 2022] POST /compute/v2.1/servers => generated 130 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:50:36.794557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3f117585-d476-4a86-b77b-c6e4651a703b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:36.795549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3f117585-d476-4a86-b77b-c6e4651a703b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:36.802876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f117585-d476-4a86-b77b-c6e4651a703b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:36.803345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f117585-d476-4a86-b77b-c6e4651a703b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:36.803714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f117585-d476-4a86-b77b-c6e4651a703b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:36.804606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f117585-d476-4a86-b77b-c6e4651a703b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:36.807225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f117585-d476-4a86-b77b-c6e4651a703b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:36.807225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f117585-d476-4a86-b77b-c6e4651a703b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:36.884831 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-39a24ce3-3298-44d7-9bdb-8866cc22a35d tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/85a47f57-c19f-417a-bea1-a39ca4b251d9" status: 202 len: 0 microversion: 2.1 time: 0.896273 Oct 27 18:50:36.886727 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 692/1423] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:50:35 2022] DELETE /compute/v2.1/os-security-groups/85a47f57-c19f-417a-bea1-a39ca4b251d9 => generated 0 bytes in 899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 18:50:36.888154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:36.894847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-25eb691a-e02d-4afb-b20e-50a61e071e9b tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2133105180", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "max_count": 2.5}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-25eb691a-e02d-4afb-b20e-50a61e071e9b tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Request method failure captured: Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 170 Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtL7Fom1loHsNxwwakbC3sHlaJDV3f0kR3wx2pRbOHHz5F3slm9bEpLgCv3z4DhlLGbcvpsghdTEAPuv72oHiwpGHq1eEABzinsWtpUwtrwmSt5Q4lm7Axdf7EgHIBCE064HOCKZpGYb7iutBFIdCoq7myDvUiqK6MEpNYRCbuNq70Q Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 8ed2c3017f7a45e79060a888286ad76d Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8ed2c3017f7a45e79060a888286ad76d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 8ed2c3017f7a45e79060a888286ad76d Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-MultipleCreateNegativeTestJSON-1727458110-project Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c4b9c73de6024ab08de9883d3e3114e9 Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1727458110-project Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2133105180", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "max_count": 2.5}} Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2133105180', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'max_count': 2.5}}} Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 2.5 Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:50:36.901815 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 18:50:36.906889 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:36.908146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-25eb691a-e02d-4afb-b20e-50a61e071e9b tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:36.908970 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-25eb691a-e02d-4afb-b20e-50a61e071e9b tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021507 Oct 27 18:50:36.910324 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 693/1424] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:50:36 2022] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:50:36.918490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd5ce4af-a767-4cd6-b8f9-f3a2d1a00d64 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:36.919401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dd5ce4af-a767-4cd6-b8f9-f3a2d1a00d64 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:36.931199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd5ce4af-a767-4cd6-b8f9-f3a2d1a00d64 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:36.931933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd5ce4af-a767-4cd6-b8f9-f3a2d1a00d64 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:36.932513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd5ce4af-a767-4cd6-b8f9-f3a2d1a00d64 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:36.933426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd5ce4af-a767-4cd6-b8f9-f3a2d1a00d64 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:36.934336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd5ce4af-a767-4cd6-b8f9-f3a2d1a00d64 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:36.935296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd5ce4af-a767-4cd6-b8f9-f3a2d1a00d64 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:37.062379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3f117585-d476-4a86-b77b-c6e4651a703b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:37.077717 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3f117585-d476-4a86-b77b-c6e4651a703b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1321 microversion: 2.1 time: 0.288979 Oct 27 18:50:37.079225 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 732/1425] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:36 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:50:37.085951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3249bf01-da39-4b1c-9f9a-f3db93c33079 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] Calling method '.version_select at 0x7fc86ba92700>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:37.332534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=10 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:37.341116 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3249bf01-da39-4b1c-9f9a-f3db93c33079 tempest-SecurityGroupsTestJSON-1231199335 tempest-SecurityGroupsTestJSON-1231199335-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/dd40ffcd-0efa-4cb8-b60f-f45b33607aeb" status: 202 len: 0 microversion: 2.1 time: 0.259038 Oct 27 18:50:37.342651 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 733/1426] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:50:37 2022] DELETE /compute/v2.1/os-security-groups/dd40ffcd-0efa-4cb8-b60f-f45b33607aeb => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:50:37.349075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a642c0e7-85b7-40dd-b5f1-3707363aaf45 tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1195424460", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "min_count": 0}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a642c0e7-85b7-40dd-b5f1-3707363aaf45 tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Request method failure captured: Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 168 Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtL7Fom1loHsNxwwakbC3sHlaJDV3f0kR3wx2pRbOHHz5F3slm9bEpLgCv3z4DhlLGbcvpsghdTEAPuv72oHiwpGHq1eEABzinsWtpUwtrwmSt5Q4lm7Axdf7EgHIBCE064HOCKZpGYb7iutBFIdCoq7myDvUiqK6MEpNYRCbuNq70Q Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 8ed2c3017f7a45e79060a888286ad76d Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8ed2c3017f7a45e79060a888286ad76d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 8ed2c3017f7a45e79060a888286ad76d Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-MultipleCreateNegativeTestJSON-1727458110-project Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c4b9c73de6024ab08de9883d3e3114e9 Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1727458110-project Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1195424460", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "min_count": 0}} Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1195424460', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'min_count': 0}}} Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 0 Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:50:37.355226 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 27 18:50:37.360129 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:50:37.363657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a642c0e7-85b7-40dd-b5f1-3707363aaf45 tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:37.368541 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a642c0e7-85b7-40dd-b5f1-3707363aaf45 tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.024045 Oct 27 18:50:37.371473 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 734/1427] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:50:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:50:37.387035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e87bd9b4-8195-4ad1-8e70-6c9bf47b01b3 req-9ac19d42-b16d-4acc-8404-63c9858d54ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55fa833-3cfc-43e2-add7-7e36b04a7316", "tag": "e993fcc5-3b19-4eed-a4aa-58d5f76965f7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:37.413330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e87bd9b4-8195-4ad1-8e70-6c9bf47b01b3 req-9ac19d42-b16d-4acc-8404-63c9858d54ab service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:37.417536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e87bd9b4-8195-4ad1-8e70-6c9bf47b01b3 req-9ac19d42-b16d-4acc-8404-63c9858d54ab service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:37.418131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e87bd9b4-8195-4ad1-8e70-6c9bf47b01b3 req-9ac19d42-b16d-4acc-8404-63c9858d54ab service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:37.437898 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e87bd9b4-8195-4ad1-8e70-6c9bf47b01b3 req-9ac19d42-b16d-4acc-8404-63c9858d54ab service nova] Creating event network-changed:e993fcc5-3b19-4eed-a4aa-58d5f76965f7 for instance e55fa833-3cfc-43e2-add7-7e36b04a7316 on n-h1-860687-3 Oct 27 18:50:37.448098 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e87bd9b4-8195-4ad1-8e70-6c9bf47b01b3 req-9ac19d42-b16d-4acc-8404-63c9858d54ab service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070735 Oct 27 18:50:37.449357 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 735/1428] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:37.486233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a44fdff7-5f57-4fd9-8a65-f9ba438b4a68 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:37.487104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a44fdff7-5f57-4fd9-8a65-f9ba438b4a68 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:37.520598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a44fdff7-5f57-4fd9-8a65-f9ba438b4a68 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:37.524817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a44fdff7-5f57-4fd9-8a65-f9ba438b4a68 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:37.528568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a44fdff7-5f57-4fd9-8a65-f9ba438b4a68 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:37.530419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a44fdff7-5f57-4fd9-8a65-f9ba438b4a68 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:37.535990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a44fdff7-5f57-4fd9-8a65-f9ba438b4a68 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:37.538489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a44fdff7-5f57-4fd9-8a65-f9ba438b4a68 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:37.819768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dd5ce4af-a767-4cd6-b8f9-f3a2d1a00d64 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:37.839091 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dd5ce4af-a767-4cd6-b8f9-f3a2d1a00d64 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1313 microversion: 2.1 time: 0.919071 Oct 27 18:50:37.840297 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 694/1429] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:36 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1313 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:37.845417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-258e9349-9fc8-461b-a7d3-4e8fd358dc7b tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1519506770", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "min_count": 2.5}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-258e9349-9fc8-461b-a7d3-4e8fd358dc7b tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Request method failure captured: Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 170 Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtL7Fom1loHsNxwwakbC3sHlaJDV3f0kR3wx2pRbOHHz5F3slm9bEpLgCv3z4DhlLGbcvpsghdTEAPuv72oHiwpGHq1eEABzinsWtpUwtrwmSt5Q4lm7Axdf7EgHIBCE064HOCKZpGYb7iutBFIdCoq7myDvUiqK6MEpNYRCbuNq70Q Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 8ed2c3017f7a45e79060a888286ad76d Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8ed2c3017f7a45e79060a888286ad76d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8ed2c3017f7a45e79060a888286ad76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 8ed2c3017f7a45e79060a888286ad76d Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1727458110 Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-MultipleCreateNegativeTestJSON-1727458110-project Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c4b9c73de6024ab08de9883d3e3114e9 Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1727458110-project Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1519506770", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "min_count": 2.5}} Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1519506770', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'min_count': 2.5}}} Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 2.5 Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:50:37.855022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 18:50:37.860440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:50:37.866864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-258e9349-9fc8-461b-a7d3-4e8fd358dc7b tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:50:37.869101 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-258e9349-9fc8-461b-a7d3-4e8fd358dc7b tempest-MultipleCreateNegativeTestJSON-1727458110 tempest-MultipleCreateNegativeTestJSON-1727458110-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.027430 Oct 27 18:50:37.873112 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 695/1430] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:50:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:50:38.060654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a44fdff7-5f57-4fd9-8a65-f9ba438b4a68 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:38.071680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a44fdff7-5f57-4fd9-8a65-f9ba438b4a68 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:38.073435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a44fdff7-5f57-4fd9-8a65-f9ba438b4a68 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:38.082618 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a44fdff7-5f57-4fd9-8a65-f9ba438b4a68 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.594632 Oct 27 18:50:38.083206 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 736/1431] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:37 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:38.108687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d111f880-a1c6-4647-bd52-12cf8c0397a2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:38.108687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d111f880-a1c6-4647-bd52-12cf8c0397a2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:38.122926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d111f880-a1c6-4647-bd52-12cf8c0397a2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:38.123648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d111f880-a1c6-4647-bd52-12cf8c0397a2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:38.124170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d111f880-a1c6-4647-bd52-12cf8c0397a2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:38.125137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d111f880-a1c6-4647-bd52-12cf8c0397a2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:38.125774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d111f880-a1c6-4647-bd52-12cf8c0397a2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:38.127231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d111f880-a1c6-4647-bd52-12cf8c0397a2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:38.497559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-52696101-6eab-4963-8a90-0679381327ae req-76cabf82-044c-42ea-9533-5a874f1c747e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8293a368-36ca-4f0c-89b2-8c9f8cd4d83f", "tag": "ef76078a-4991-4a34-a8cf-984da56b97d3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:38.521817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-52696101-6eab-4963-8a90-0679381327ae req-76cabf82-044c-42ea-9533-5a874f1c747e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:38.522783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-52696101-6eab-4963-8a90-0679381327ae req-76cabf82-044c-42ea-9533-5a874f1c747e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:38.523616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-52696101-6eab-4963-8a90-0679381327ae req-76cabf82-044c-42ea-9533-5a874f1c747e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:38.539112 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-52696101-6eab-4963-8a90-0679381327ae req-76cabf82-044c-42ea-9533-5a874f1c747e service nova] Creating event network-changed:ef76078a-4991-4a34-a8cf-984da56b97d3 for instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f on n-h1-860687-3 Oct 27 18:50:38.547198 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-52696101-6eab-4963-8a90-0679381327ae req-76cabf82-044c-42ea-9533-5a874f1c747e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053006 Oct 27 18:50:38.549857 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 737/1432] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:38.696518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d111f880-a1c6-4647-bd52-12cf8c0397a2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:38.708003 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d111f880-a1c6-4647-bd52-12cf8c0397a2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1321 microversion: 2.1 time: 0.608057 Oct 27 18:50:38.709248 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 696/1433] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:38 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1321 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:38.867606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-39a20021-7e7a-40c4-a45e-6ded6aef6a19 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:38.869453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-39a20021-7e7a-40c4-a45e-6ded6aef6a19 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:38.876301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39a20021-7e7a-40c4-a45e-6ded6aef6a19 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:38.876794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39a20021-7e7a-40c4-a45e-6ded6aef6a19 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:38.877237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39a20021-7e7a-40c4-a45e-6ded6aef6a19 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:38.878152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39a20021-7e7a-40c4-a45e-6ded6aef6a19 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:38.878683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39a20021-7e7a-40c4-a45e-6ded6aef6a19 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:38.879117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39a20021-7e7a-40c4-a45e-6ded6aef6a19 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:39.113987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2c44d9f0-abc3-4a07-aa39-5f5c0806a710 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:39.115409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2c44d9f0-abc3-4a07-aa39-5f5c0806a710 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:39.122993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c44d9f0-abc3-4a07-aa39-5f5c0806a710 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:39.124017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c44d9f0-abc3-4a07-aa39-5f5c0806a710 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:39.124754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c44d9f0-abc3-4a07-aa39-5f5c0806a710 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:39.125742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c44d9f0-abc3-4a07-aa39-5f5c0806a710 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:39.126470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c44d9f0-abc3-4a07-aa39-5f5c0806a710 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:39.127153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c44d9f0-abc3-4a07-aa39-5f5c0806a710 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:39.755680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2c44d9f0-abc3-4a07-aa39-5f5c0806a710 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:39.768984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-39a20021-7e7a-40c4-a45e-6ded6aef6a19 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:39.796123 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-39a20021-7e7a-40c4-a45e-6ded6aef6a19 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1313 microversion: 2.1 time: 0.930014 Oct 27 18:50:39.799451 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 738/1434] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:38 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1313 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:39.803024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2c44d9f0-abc3-4a07-aa39-5f5c0806a710 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:39.811678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2c44d9f0-abc3-4a07-aa39-5f5c0806a710 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:39.814779 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2c44d9f0-abc3-4a07-aa39-5f5c0806a710 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.703570 Oct 27 18:50:39.816933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-19f8a666-afae-46ce-b689-ba24256fc01f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:39.817443 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 697/1435] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:39 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:39.818667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-19f8a666-afae-46ce-b689-ba24256fc01f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:39.827738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19f8a666-afae-46ce-b689-ba24256fc01f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:39.828813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19f8a666-afae-46ce-b689-ba24256fc01f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:39.830782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19f8a666-afae-46ce-b689-ba24256fc01f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:39.832037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19f8a666-afae-46ce-b689-ba24256fc01f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:39.832682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19f8a666-afae-46ce-b689-ba24256fc01f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:39.833327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19f8a666-afae-46ce-b689-ba24256fc01f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:40.078977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-44fe96ac-bf3f-440a-b50d-4faa721fc104 req-0323b3d1-33f1-409f-beb1-c02d06df52fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55fa833-3cfc-43e2-add7-7e36b04a7316", "name": "network-vif-plugged", "status": "completed", "tag": "e993fcc5-3b19-4eed-a4aa-58d5f76965f7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:40.108565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-44fe96ac-bf3f-440a-b50d-4faa721fc104 req-0323b3d1-33f1-409f-beb1-c02d06df52fe service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:40.111033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-44fe96ac-bf3f-440a-b50d-4faa721fc104 req-0323b3d1-33f1-409f-beb1-c02d06df52fe service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:40.113456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-44fe96ac-bf3f-440a-b50d-4faa721fc104 req-0323b3d1-33f1-409f-beb1-c02d06df52fe service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:40.137635 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-44fe96ac-bf3f-440a-b50d-4faa721fc104 req-0323b3d1-33f1-409f-beb1-c02d06df52fe service nova] Creating event network-vif-plugged:e993fcc5-3b19-4eed-a4aa-58d5f76965f7 for instance e55fa833-3cfc-43e2-add7-7e36b04a7316 on n-h1-860687-3 Oct 27 18:50:40.144130 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-44fe96ac-bf3f-440a-b50d-4faa721fc104 req-0323b3d1-33f1-409f-beb1-c02d06df52fe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085361 Oct 27 18:50:40.145249 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 698/1436] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:40.574398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-19f8a666-afae-46ce-b689-ba24256fc01f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:40.588705 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-19f8a666-afae-46ce-b689-ba24256fc01f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1321 microversion: 2.1 time: 0.786342 Oct 27 18:50:40.591067 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 739/1437] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:39 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1321 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:40.844678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-313a08c1-3834-4213-b4f9-2e26c80b91f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:40.845514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-313a08c1-3834-4213-b4f9-2e26c80b91f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:40.847638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e794b029-3686-4975-ab13-c2d412281f49 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:40.848330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e794b029-3686-4975-ab13-c2d412281f49 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:40.856553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e794b029-3686-4975-ab13-c2d412281f49 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:40.859413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e794b029-3686-4975-ab13-c2d412281f49 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:40.859931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-313a08c1-3834-4213-b4f9-2e26c80b91f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:40.860082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e794b029-3686-4975-ab13-c2d412281f49 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:40.860655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-313a08c1-3834-4213-b4f9-2e26c80b91f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:40.861170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-313a08c1-3834-4213-b4f9-2e26c80b91f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:40.861994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-313a08c1-3834-4213-b4f9-2e26c80b91f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:40.862489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e794b029-3686-4975-ab13-c2d412281f49 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:40.862972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-313a08c1-3834-4213-b4f9-2e26c80b91f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:40.865560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-313a08c1-3834-4213-b4f9-2e26c80b91f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:40.865754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e794b029-3686-4975-ab13-c2d412281f49 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:40.866280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e794b029-3686-4975-ab13-c2d412281f49 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:41.260921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e794b029-3686-4975-ab13-c2d412281f49 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:41.272478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e794b029-3686-4975-ab13-c2d412281f49 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:41.275355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e794b029-3686-4975-ab13-c2d412281f49 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:41.277457 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e794b029-3686-4975-ab13-c2d412281f49 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1810 microversion: 2.25 time: 0.433647 Oct 27 18:50:41.280690 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 740/1438] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:40 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1810 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:50:41.466684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-313a08c1-3834-4213-b4f9-2e26c80b91f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:41.487369 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-313a08c1-3834-4213-b4f9-2e26c80b91f2 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1313 microversion: 2.1 time: 0.651642 Oct 27 18:50:41.489120 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 699/1439] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:40 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1313 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:41.615745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2430f69d-6451-4cb1-bcd3-dfc045d4bfa0 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:41.616625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2430f69d-6451-4cb1-bcd3-dfc045d4bfa0 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:41.630648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2430f69d-6451-4cb1-bcd3-dfc045d4bfa0 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:41.631430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2430f69d-6451-4cb1-bcd3-dfc045d4bfa0 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:41.632025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2430f69d-6451-4cb1-bcd3-dfc045d4bfa0 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:41.632895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2430f69d-6451-4cb1-bcd3-dfc045d4bfa0 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:41.636574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2430f69d-6451-4cb1-bcd3-dfc045d4bfa0 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:41.637217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2430f69d-6451-4cb1-bcd3-dfc045d4bfa0 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:41.904980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2430f69d-6451-4cb1-bcd3-dfc045d4bfa0 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:41.917171 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2430f69d-6451-4cb1-bcd3-dfc045d4bfa0 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1321 microversion: 2.1 time: 0.305084 Oct 27 18:50:41.918112 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 741/1440] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:41 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:42.312760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-06c85305-9c0d-4a0e-894c-ddbd55a86fa2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:42.313496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-06c85305-9c0d-4a0e-894c-ddbd55a86fa2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:42.316741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:42.340051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06c85305-9c0d-4a0e-894c-ddbd55a86fa2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:42.346417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06c85305-9c0d-4a0e-894c-ddbd55a86fa2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:42.346926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06c85305-9c0d-4a0e-894c-ddbd55a86fa2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:42.352570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06c85305-9c0d-4a0e-894c-ddbd55a86fa2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:42.353133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06c85305-9c0d-4a0e-894c-ddbd55a86fa2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:42.353839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06c85305-9c0d-4a0e-894c-ddbd55a86fa2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:42.410663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-97b9f3c4-2370-4a87-b46c-9d132e5c0519 req-84fe2180-a6e2-4ee2-a48a-d915d8bcc1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93639af-67fe-4725-9626-ed881eef60ba", "name": "network-vif-plugged", "status": "completed", "tag": "ba4e40ea-685e-4ca1-932b-b9f6d118d19d"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:42.441437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-97b9f3c4-2370-4a87-b46c-9d132e5c0519 req-84fe2180-a6e2-4ee2-a48a-d915d8bcc1a7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:42.442312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-97b9f3c4-2370-4a87-b46c-9d132e5c0519 req-84fe2180-a6e2-4ee2-a48a-d915d8bcc1a7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:42.442971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-97b9f3c4-2370-4a87-b46c-9d132e5c0519 req-84fe2180-a6e2-4ee2-a48a-d915d8bcc1a7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:42.477137 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-97b9f3c4-2370-4a87-b46c-9d132e5c0519 req-84fe2180-a6e2-4ee2-a48a-d915d8bcc1a7 service nova] Creating event network-vif-plugged:ba4e40ea-685e-4ca1-932b-b9f6d118d19d for instance b93639af-67fe-4725-9626-ed881eef60ba on n-h2-860687-3 Oct 27 18:50:42.501321 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-97b9f3c4-2370-4a87-b46c-9d132e5c0519 req-84fe2180-a6e2-4ee2-a48a-d915d8bcc1a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090307 Oct 27 18:50:42.503986 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 742/1441] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:50:42.530993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-23c301c7-10f6-4c49-8e12-834254574909 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:42.532036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-23c301c7-10f6-4c49-8e12-834254574909 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:42.543879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23c301c7-10f6-4c49-8e12-834254574909 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:42.547163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23c301c7-10f6-4c49-8e12-834254574909 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:42.547817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23c301c7-10f6-4c49-8e12-834254574909 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:42.550615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23c301c7-10f6-4c49-8e12-834254574909 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:42.551300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23c301c7-10f6-4c49-8e12-834254574909 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:42.553740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23c301c7-10f6-4c49-8e12-834254574909 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:42.608944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:42.874519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-23c301c7-10f6-4c49-8e12-834254574909 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:42.884956 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-23c301c7-10f6-4c49-8e12-834254574909 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1313 microversion: 2.1 time: 0.375595 Oct 27 18:50:42.905631 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 743/1442] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:42 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1313 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:42.948444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e7355447-9c3c-47f5-871f-a7c3da1b2379 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:42.949603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e7355447-9c3c-47f5-871f-a7c3da1b2379 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:42.964527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e7355447-9c3c-47f5-871f-a7c3da1b2379 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:42.965027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e7355447-9c3c-47f5-871f-a7c3da1b2379 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:42.968365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e7355447-9c3c-47f5-871f-a7c3da1b2379 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:42.969297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e7355447-9c3c-47f5-871f-a7c3da1b2379 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:42.969927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e7355447-9c3c-47f5-871f-a7c3da1b2379 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:42.970968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e7355447-9c3c-47f5-871f-a7c3da1b2379 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:43.324195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e7355447-9c3c-47f5-871f-a7c3da1b2379 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:43.343584 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e7355447-9c3c-47f5-871f-a7c3da1b2379 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1511 microversion: 2.1 time: 0.401274 Oct 27 18:50:43.344477 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 744/1443] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:42 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1511 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:50:43.371867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b1f1f8ff-69f9-4967-a795-e3dd58a51488 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:43.372694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b1f1f8ff-69f9-4967-a795-e3dd58a51488 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:43.384734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1f1f8ff-69f9-4967-a795-e3dd58a51488 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:43.385344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1f1f8ff-69f9-4967-a795-e3dd58a51488 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:43.386849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1f1f8ff-69f9-4967-a795-e3dd58a51488 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:43.390743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1f1f8ff-69f9-4967-a795-e3dd58a51488 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:43.391360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1f1f8ff-69f9-4967-a795-e3dd58a51488 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:43.391882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1f1f8ff-69f9-4967-a795-e3dd58a51488 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:43.427985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-06c85305-9c0d-4a0e-894c-ddbd55a86fa2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:43.444600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-06c85305-9c0d-4a0e-894c-ddbd55a86fa2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:43.450759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-06c85305-9c0d-4a0e-894c-ddbd55a86fa2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:43.452163 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-06c85305-9c0d-4a0e-894c-ddbd55a86fa2 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1800 microversion: 2.25 time: 1.145211 Oct 27 18:50:43.452860 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 700/1444] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:42 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1800 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:43.492851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d4143e3-95ff-4b3c-9c59-d8c19d02b04f tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '.version_select at 0x7fc86b472700>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:43.497576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d4143e3-95ff-4b3c-9c59-d8c19d02b04f tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:43.498162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d4143e3-95ff-4b3c-9c59-d8c19d02b04f tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:43.498723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d4143e3-95ff-4b3c-9c59-d8c19d02b04f tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:43.512195 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d4143e3-95ff-4b3c-9c59-d8c19d02b04f tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.028402 Oct 27 18:50:43.513251 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 701/1445] 10.222.0.42 () {60 vars in 1184 bytes} [Thu Oct 27 18:50:43 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:43.537430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b1006a21-189d-4c09-9c1e-954418d47389 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:43.538200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b1006a21-189d-4c09-9c1e-954418d47389 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:43.551771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1006a21-189d-4c09-9c1e-954418d47389 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:43.553733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1006a21-189d-4c09-9c1e-954418d47389 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:43.554366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1006a21-189d-4c09-9c1e-954418d47389 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:43.556051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1006a21-189d-4c09-9c1e-954418d47389 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:43.558032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1006a21-189d-4c09-9c1e-954418d47389 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:43.558848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1006a21-189d-4c09-9c1e-954418d47389 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:43.879658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b1f1f8ff-69f9-4967-a795-e3dd58a51488 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:43.888183 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b1f1f8ff-69f9-4967-a795-e3dd58a51488 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1511 microversion: 2.1 time: 0.520508 Oct 27 18:50:43.889365 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 745/1446] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:43 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1511 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:43.913222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-548ffe24-9040-41fa-8860-91f0c8c79207 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:43.915042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-548ffe24-9040-41fa-8860-91f0c8c79207 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:43.922602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-548ffe24-9040-41fa-8860-91f0c8c79207 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:43.923490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-548ffe24-9040-41fa-8860-91f0c8c79207 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:43.924144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-548ffe24-9040-41fa-8860-91f0c8c79207 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:43.925456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-548ffe24-9040-41fa-8860-91f0c8c79207 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:43.926224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-548ffe24-9040-41fa-8860-91f0c8c79207 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:43.927009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-548ffe24-9040-41fa-8860-91f0c8c79207 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:43.948426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:43.954188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-b1006a21-189d-4c09-9c1e-954418d47389 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 26d5439d-efc3-4e29-a439-7b8b40177342 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:50:43.985195 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b1006a21-189d-4c09-9c1e-954418d47389 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 2418 microversion: 2.25 time: 0.456980 Oct 27 18:50:43.989734 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 702/1447] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:43 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 2418 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:44.006427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e8f90153-43c4-40dd-9a02-2cafd232ee3e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:44.007069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e8f90153-43c4-40dd-9a02-2cafd232ee3e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: b93639af-67fe-4725-9626-ed881eef60ba] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:44.021027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8f90153-43c4-40dd-9a02-2cafd232ee3e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:44.021526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8f90153-43c4-40dd-9a02-2cafd232ee3e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:44.021972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8f90153-43c4-40dd-9a02-2cafd232ee3e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:44.022724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8f90153-43c4-40dd-9a02-2cafd232ee3e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:44.023185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8f90153-43c4-40dd-9a02-2cafd232ee3e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:44.023620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8f90153-43c4-40dd-9a02-2cafd232ee3e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:44.435690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8f90153-43c4-40dd-9a02-2cafd232ee3e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:44.454451 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e8f90153-43c4-40dd-9a02-2cafd232ee3e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba" status: 200 len: 1321 microversion: 2.1 time: 0.463166 Oct 27 18:50:44.465308 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 703/1448] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:43 2022] GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba => generated 1321 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:44.485695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d7329e4-a4d3-4de1-950b-7efe2a00d339 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:44.488207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9d7329e4-a4d3-4de1-950b-7efe2a00d339 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:44.502838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d7329e4-a4d3-4de1-950b-7efe2a00d339 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:44.504708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d7329e4-a4d3-4de1-950b-7efe2a00d339 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:44.511195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d7329e4-a4d3-4de1-950b-7efe2a00d339 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:44.512771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d7329e4-a4d3-4de1-950b-7efe2a00d339 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:44.513766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d7329e4-a4d3-4de1-950b-7efe2a00d339 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:44.518550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d7329e4-a4d3-4de1-950b-7efe2a00d339 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:44.972113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-548ffe24-9040-41fa-8860-91f0c8c79207 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:44.979791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-9d7329e4-a4d3-4de1-950b-7efe2a00d339 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 26d5439d-efc3-4e29-a439-7b8b40177342 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:50:44.996909 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-548ffe24-9040-41fa-8860-91f0c8c79207 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1313 microversion: 2.1 time: 1.083112 Oct 27 18:50:44.997572 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 746/1449] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:43 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1313 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:45.014767 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9d7329e4-a4d3-4de1-950b-7efe2a00d339 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 2418 microversion: 2.25 time: 0.547587 Oct 27 18:50:45.026751 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 704/1450] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:50:44 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 2418 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:50:45.191406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9dc835eb-9461-4bd1-97ee-9b40117372a8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:45.191565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9dc835eb-9461-4bd1-97ee-9b40117372a8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:45.209135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dc835eb-9461-4bd1-97ee-9b40117372a8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:45.209915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dc835eb-9461-4bd1-97ee-9b40117372a8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:45.210815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dc835eb-9461-4bd1-97ee-9b40117372a8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:45.212836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dc835eb-9461-4bd1-97ee-9b40117372a8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:45.213515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dc835eb-9461-4bd1-97ee-9b40117372a8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:45.214110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dc835eb-9461-4bd1-97ee-9b40117372a8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:45.429562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-9dc835eb-9461-4bd1-97ee-9b40117372a8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lazy-loading 'services' on Instance uuid 26d5439d-efc3-4e29-a439-7b8b40177342 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:50:45.491082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-949a65bd-85db-4e86-9e4f-e3c06fbdef4b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:45.491726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-949a65bd-85db-4e86-9e4f-e3c06fbdef4b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: b93639af-67fe-4725-9626-ed881eef60ba] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:45.513994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-949a65bd-85db-4e86-9e4f-e3c06fbdef4b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:45.514522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-949a65bd-85db-4e86-9e4f-e3c06fbdef4b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:45.515137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-949a65bd-85db-4e86-9e4f-e3c06fbdef4b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:45.516046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-949a65bd-85db-4e86-9e4f-e3c06fbdef4b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:45.516657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-949a65bd-85db-4e86-9e4f-e3c06fbdef4b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:45.517247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-949a65bd-85db-4e86-9e4f-e3c06fbdef4b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:45.634314 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9dc835eb-9461-4bd1-97ee-9b40117372a8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "DELETE /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments/ade13784-8206-4012-8f70-d37dadeb7a86" status: 202 len: 0 microversion: 2.25 time: 0.447022 Oct 27 18:50:45.635473 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 747/1451] 10.222.0.42 () {60 vars in 1457 bytes} [Thu Oct 27 18:50:45 2022] DELETE /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments/ade13784-8206-4012-8f70-d37dadeb7a86 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:50:45.648354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b860de5-8c2c-4888-a5f8-4aa553e93497 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:45.654629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b860de5-8c2c-4888-a5f8-4aa553e93497 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:45.686114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b860de5-8c2c-4888-a5f8-4aa553e93497 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:45.687769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b860de5-8c2c-4888-a5f8-4aa553e93497 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:45.688427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b860de5-8c2c-4888-a5f8-4aa553e93497 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:45.690505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b860de5-8c2c-4888-a5f8-4aa553e93497 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:45.693393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b860de5-8c2c-4888-a5f8-4aa553e93497 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:45.694282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b860de5-8c2c-4888-a5f8-4aa553e93497 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:45.755593 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b860de5-8c2c-4888-a5f8-4aa553e93497 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.115183 Oct 27 18:50:45.756747 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 748/1452] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 18:50:45 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:50:46.021123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c453c530-4c9e-4215-a333-ade77ca50815 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:46.023105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c453c530-4c9e-4215-a333-ade77ca50815 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:46.036727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c453c530-4c9e-4215-a333-ade77ca50815 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:46.040290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c453c530-4c9e-4215-a333-ade77ca50815 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:46.040971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c453c530-4c9e-4215-a333-ade77ca50815 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:46.043932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c453c530-4c9e-4215-a333-ade77ca50815 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:46.047603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c453c530-4c9e-4215-a333-ade77ca50815 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:46.050668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c453c530-4c9e-4215-a333-ade77ca50815 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:46.377909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c453c530-4c9e-4215-a333-ade77ca50815 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:46.393378 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c453c530-4c9e-4215-a333-ade77ca50815 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1313 microversion: 2.1 time: 0.376146 Oct 27 18:50:46.399618 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 749/1453] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:46 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:50:46.747830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-949a65bd-85db-4e86-9e4f-e3c06fbdef4b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:46.758077 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-949a65bd-85db-4e86-9e4f-e3c06fbdef4b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba" status: 200 len: 1512 microversion: 2.1 time: 1.270900 Oct 27 18:50:46.759808 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 705/1454] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:45 2022] GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba => generated 1512 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:50:46.779403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4a875db3-8f88-44d6-b772-b9c0130f4538 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:46.781866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4a875db3-8f88-44d6-b772-b9c0130f4538 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:46.787638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:46.795642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:46.796890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:50:46.802313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a875db3-8f88-44d6-b772-b9c0130f4538 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:46.806233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a875db3-8f88-44d6-b772-b9c0130f4538 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:46.806948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a875db3-8f88-44d6-b772-b9c0130f4538 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:46.807881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a875db3-8f88-44d6-b772-b9c0130f4538 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:46.808510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a875db3-8f88-44d6-b772-b9c0130f4538 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:46.809120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a875db3-8f88-44d6-b772-b9c0130f4538 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:46.816304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:46.817190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:46.818858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:46.820407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:46.821296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:46.824880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:46.898339 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4a875db3-8f88-44d6-b772-b9c0130f4538 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.133365 Oct 27 18:50:46.906767 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 750/1455] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 18:50:46 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 18:50:46.983280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:50:47.147966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:47.167662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:47.168161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:47.168609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:47.422851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b2c4dbae-70c1-452c-b66f-00a27546a023 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:47.424118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b2c4dbae-70c1-452c-b66f-00a27546a023 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:47.436149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2c4dbae-70c1-452c-b66f-00a27546a023 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:47.438047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2c4dbae-70c1-452c-b66f-00a27546a023 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:47.439231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2c4dbae-70c1-452c-b66f-00a27546a023 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:47.441143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2c4dbae-70c1-452c-b66f-00a27546a023 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:47.443380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2c4dbae-70c1-452c-b66f-00a27546a023 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:47.443951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2c4dbae-70c1-452c-b66f-00a27546a023 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:47.675339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b2c4dbae-70c1-452c-b66f-00a27546a023 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:47.686268 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b2c4dbae-70c1-452c-b66f-00a27546a023 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1313 microversion: 2.1 time: 0.268990 Oct 27 18:50:47.687505 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 751/1456] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:47 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:47.916653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-534c95da-7fe2-44f9-877e-fdf0926ab8f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:47.929971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-534c95da-7fe2-44f9-877e-fdf0926ab8f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:47.942652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-534c95da-7fe2-44f9-877e-fdf0926ab8f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:47.944454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-534c95da-7fe2-44f9-877e-fdf0926ab8f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:47.945518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-534c95da-7fe2-44f9-877e-fdf0926ab8f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:47.948607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-534c95da-7fe2-44f9-877e-fdf0926ab8f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:47.949235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-534c95da-7fe2-44f9-877e-fdf0926ab8f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:47.949670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-534c95da-7fe2-44f9-877e-fdf0926ab8f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:48.017694 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-534c95da-7fe2-44f9-877e-fdf0926ab8f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109033 Oct 27 18:50:48.019124 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 752/1457] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 18:50:47 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:50:48.037636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-1ff2b942-87c7-4e8b-b974-fc82adcc20e2 req-ce87d46a-9313-4d9d-8ce1-0a41db232528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8293a368-36ca-4f0c-89b2-8c9f8cd4d83f", "name": "network-vif-plugged", "status": "completed", "tag": "ef76078a-4991-4a34-a8cf-984da56b97d3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:48.059346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1ff2b942-87c7-4e8b-b974-fc82adcc20e2 req-ce87d46a-9313-4d9d-8ce1-0a41db232528 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:48.060093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1ff2b942-87c7-4e8b-b974-fc82adcc20e2 req-ce87d46a-9313-4d9d-8ce1-0a41db232528 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:48.061395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1ff2b942-87c7-4e8b-b974-fc82adcc20e2 req-ce87d46a-9313-4d9d-8ce1-0a41db232528 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:48.067501 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-723c3043-20c8-4e96-9dc7-b46488c35d79 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 1.284342 Oct 27 18:50:48.068255 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 706/1458] 10.222.0.42 () {58 vars in 1167 bytes} [Thu Oct 27 18:50:46 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:48.099667 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-1ff2b942-87c7-4e8b-b974-fc82adcc20e2 req-ce87d46a-9313-4d9d-8ce1-0a41db232528 service nova] Creating event network-vif-plugged:ef76078a-4991-4a34-a8cf-984da56b97d3 for instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f on n-h1-860687-3 Oct 27 18:50:48.101905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:48.113925 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-1ff2b942-87c7-4e8b-b974-fc82adcc20e2 req-ce87d46a-9313-4d9d-8ce1-0a41db232528 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080536 Oct 27 18:50:48.117185 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 753/1459] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:48.121331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:48.129372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-308936606', 'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:50:48.154925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:48.156060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:48.159017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:48.160970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:48.163373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:48.164089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:48.381490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:50:48.509712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:48.516466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:48.517152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:48.518649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:48.718109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7583061f-ea69-4f20-a1ac-4d3e95229a5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:48.718875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7583061f-ea69-4f20-a1ac-4d3e95229a5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:48.732722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7583061f-ea69-4f20-a1ac-4d3e95229a5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:48.733224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7583061f-ea69-4f20-a1ac-4d3e95229a5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:48.733671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7583061f-ea69-4f20-a1ac-4d3e95229a5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:48.734378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7583061f-ea69-4f20-a1ac-4d3e95229a5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:48.743371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7583061f-ea69-4f20-a1ac-4d3e95229a5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:48.744044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7583061f-ea69-4f20-a1ac-4d3e95229a5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:48.945896 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-902a9d01-03f5-45e6-a36e-b285132a037e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-308936606" status: 200 len: 1514 microversion: 2.1 time: 0.848611 Oct 27 18:50:48.948145 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 707/1460] 10.222.0.42 () {58 vars in 1261 bytes} [Thu Oct 27 18:50:48 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-308936606 => generated 1514 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:48.976688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:48.987323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:48.988413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:50:48.998340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:49.002903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:49.003517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:49.004575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:49.005041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:49.006425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:49.236442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:50:49.303650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7583061f-ea69-4f20-a1ac-4d3e95229a5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:49.330177 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7583061f-ea69-4f20-a1ac-4d3e95229a5f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1313 microversion: 2.1 time: 0.621630 Oct 27 18:50:49.330824 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 754/1461] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:48 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1313 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:49.337180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-91fc8148-8b09-4019-8639-d1e9ef9dfd9e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:49.343440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-91fc8148-8b09-4019-8639-d1e9ef9dfd9e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:49.353360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91fc8148-8b09-4019-8639-d1e9ef9dfd9e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:49.354283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91fc8148-8b09-4019-8639-d1e9ef9dfd9e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:49.355016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91fc8148-8b09-4019-8639-d1e9ef9dfd9e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:49.356180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91fc8148-8b09-4019-8639-d1e9ef9dfd9e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:49.366170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91fc8148-8b09-4019-8639-d1e9ef9dfd9e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:49.368612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91fc8148-8b09-4019-8639-d1e9ef9dfd9e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:49.455331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:49.472230 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-91fc8148-8b09-4019-8639-d1e9ef9dfd9e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.138831 Oct 27 18:50:49.473633 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 755/1462] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 18:50:49 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:50:49.476133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:49.476624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:49.477674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:50.157455 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d271a85e-b00f-41d3-af8c-68f87ef769d4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 1.185542 Oct 27 18:50:50.158819 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 708/1463] 10.222.0.42 () {58 vars in 1173 bytes} [Thu Oct 27 18:50:48 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:50:50.190901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:50.205605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:50.209803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.compute.servers [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Removing options 'limit' from query {{(pid=127029) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 18:50:50.214905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:50:50.234493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:50.236264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:50.236891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:50.238933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:50.239849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:50.241660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:50.328534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:50.364068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2ad4b9c2-0863-4dff-8d01-83cd9af7f0d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:50.365009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2ad4b9c2-0863-4dff-8d01-83cd9af7f0d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:50.383104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:50.385733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:50.386971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:50.387388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ad4b9c2-0863-4dff-8d01-83cd9af7f0d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:50.403450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ad4b9c2-0863-4dff-8d01-83cd9af7f0d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:50.405431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ad4b9c2-0863-4dff-8d01-83cd9af7f0d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:50.409601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ad4b9c2-0863-4dff-8d01-83cd9af7f0d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:50.412944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ad4b9c2-0863-4dff-8d01-83cd9af7f0d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:50.418030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ad4b9c2-0863-4dff-8d01-83cd9af7f0d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:50.875839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2ad4b9c2-0863-4dff-8d01-83cd9af7f0d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:50.898008 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2ad4b9c2-0863-4dff-8d01-83cd9af7f0d0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1463 microversion: 2.1 time: 0.539344 Oct 27 18:50:50.902302 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 709/1464] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:50 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1463 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:50.907933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-757f1449-c4b7-4f0a-8027-0ac6d9be32df tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:50.912425 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4ee0b25b-0612-48b3-96a5-b296a24cc5bf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.727009 Oct 27 18:50:50.913047 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 756/1465] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:50:50 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:50.936087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-419a716c-a72d-4727-a457-adf848092e4f tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:50.942147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-419a716c-a72d-4727-a457-adf848092e4f tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:50.955705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-757f1449-c4b7-4f0a-8027-0ac6d9be32df tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:50.977957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-419a716c-a72d-4727-a457-adf848092e4f tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:50.978528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-419a716c-a72d-4727-a457-adf848092e4f tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:50.979004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-419a716c-a72d-4727-a457-adf848092e4f tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:50.979711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-419a716c-a72d-4727-a457-adf848092e4f tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:50.987803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-419a716c-a72d-4727-a457-adf848092e4f tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:50.987803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-419a716c-a72d-4727-a457-adf848092e4f tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:50.990899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-757f1449-c4b7-4f0a-8027-0ac6d9be32df tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:50.991466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-757f1449-c4b7-4f0a-8027-0ac6d9be32df tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:50.992182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-757f1449-c4b7-4f0a-8027-0ac6d9be32df tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:50.994294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-757f1449-c4b7-4f0a-8027-0ac6d9be32df tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:50.994934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-757f1449-c4b7-4f0a-8027-0ac6d9be32df tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:50.995382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-757f1449-c4b7-4f0a-8027-0ac6d9be32df tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:51.069494 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-757f1449-c4b7-4f0a-8027-0ac6d9be32df tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.165514 Oct 27 18:50:51.070855 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 710/1466] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 18:50:50 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:50:51.077647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7d02a25f-f8a8-497a-9c10-7cc48b858fed tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:51.107638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7d02a25f-f8a8-497a-9c10-7cc48b858fed tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:51.110101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7d02a25f-f8a8-497a-9c10-7cc48b858fed tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:50:51.128153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d02a25f-f8a8-497a-9c10-7cc48b858fed tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:51.130490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d02a25f-f8a8-497a-9c10-7cc48b858fed tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:51.131134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d02a25f-f8a8-497a-9c10-7cc48b858fed tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:51.137124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d02a25f-f8a8-497a-9c10-7cc48b858fed tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:51.138163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d02a25f-f8a8-497a-9c10-7cc48b858fed tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:51.138840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d02a25f-f8a8-497a-9c10-7cc48b858fed tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:51.188778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-7d02a25f-f8a8-497a-9c10-7cc48b858fed tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:50:51.238969 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7d02a25f-f8a8-497a-9c10-7cc48b858fed tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.166119 Oct 27 18:50:51.240200 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 711/1467] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 18:50:51 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:51.258727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e80be5ee-6226-4dae-8e99-9aaaf3e3b490 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:51.264528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e80be5ee-6226-4dae-8e99-9aaaf3e3b490 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:51.267243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.compute.servers [None req-e80be5ee-6226-4dae-8e99-9aaaf3e3b490 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Removing options 'limit' from query {{(pid=127028) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 18:50:51.272732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e80be5ee-6226-4dae-8e99-9aaaf3e3b490 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:50:51.278532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e80be5ee-6226-4dae-8e99-9aaaf3e3b490 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:51.282719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e80be5ee-6226-4dae-8e99-9aaaf3e3b490 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:51.283263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e80be5ee-6226-4dae-8e99-9aaaf3e3b490 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:51.284134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e80be5ee-6226-4dae-8e99-9aaaf3e3b490 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:51.292929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e80be5ee-6226-4dae-8e99-9aaaf3e3b490 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:51.293475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e80be5ee-6226-4dae-8e99-9aaaf3e3b490 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:51.364705 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-419a716c-a72d-4727-a457-adf848092e4f tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1614 microversion: 2.1 time: 0.445995 Oct 27 18:50:51.368807 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 757/1468] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:50 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1614 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:51.391205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-df1f8fc4-dd8a-447a-8e0c-c92361ade8a3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:51.392066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-df1f8fc4-dd8a-447a-8e0c-c92361ade8a3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:51.403819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df1f8fc4-dd8a-447a-8e0c-c92361ade8a3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:51.406039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df1f8fc4-dd8a-447a-8e0c-c92361ade8a3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:51.406719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df1f8fc4-dd8a-447a-8e0c-c92361ade8a3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:51.408539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df1f8fc4-dd8a-447a-8e0c-c92361ade8a3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:51.409993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df1f8fc4-dd8a-447a-8e0c-c92361ade8a3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:51.411284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df1f8fc4-dd8a-447a-8e0c-c92361ade8a3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:51.462109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-e80be5ee-6226-4dae-8e99-9aaaf3e3b490 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:50:51.549942 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e80be5ee-6226-4dae-8e99-9aaaf3e3b490 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.295273 Oct 27 18:50:51.551168 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 712/1469] 10.222.0.42 () {58 vars in 1150 bytes} [Thu Oct 27 18:50:51 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:50:51.565883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7a506481-7d5a-4371-b228-ec5de84568d1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:51.575878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7a506481-7d5a-4371-b228-ec5de84568d1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:51.578329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7a506481-7d5a-4371-b228-ec5de84568d1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:50:51.589526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a506481-7d5a-4371-b228-ec5de84568d1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:51.593353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a506481-7d5a-4371-b228-ec5de84568d1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:51.595883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a506481-7d5a-4371-b228-ec5de84568d1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:51.597309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a506481-7d5a-4371-b228-ec5de84568d1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:51.599117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a506481-7d5a-4371-b228-ec5de84568d1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:51.600087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a506481-7d5a-4371-b228-ec5de84568d1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:51.608141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-df1f8fc4-dd8a-447a-8e0c-c92361ade8a3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '01e4ec7a5e11493b936c3b5b1532aafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73930bf034df486bacb5c7ed0e5c2dc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:51.612317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-df1f8fc4-dd8a-447a-8e0c-c92361ade8a3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] flavor_id is None. Assuming migration. {{(pid=127029) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 27 18:50:51.613086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-df1f8fc4-dd8a-447a-8e0c-c92361ade8a3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127029) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 18:50:51.645030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-7a506481-7d5a-4371-b228-ec5de84568d1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:50:51.684554 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7a506481-7d5a-4371-b228-ec5de84568d1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.124334 Oct 27 18:50:51.685984 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 713/1470] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 18:50:51 2022] GET /compute/v2.1/servers => generated 1011 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:51.699955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8e00a5b2-6129-4050-a966-3be89854ad99 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:51.706507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8e00a5b2-6129-4050-a966-3be89854ad99 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:51.707475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8e00a5b2-6129-4050-a966-3be89854ad99 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:50:51.720246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e00a5b2-6129-4050-a966-3be89854ad99 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:51.721744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e00a5b2-6129-4050-a966-3be89854ad99 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:51.722378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e00a5b2-6129-4050-a966-3be89854ad99 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:51.723530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e00a5b2-6129-4050-a966-3be89854ad99 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:51.724282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e00a5b2-6129-4050-a966-3be89854ad99 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:51.725527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e00a5b2-6129-4050-a966-3be89854ad99 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:51.858475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-8e00a5b2-6129-4050-a966-3be89854ad99 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:50:52.012292 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8e00a5b2-6129-4050-a966-3be89854ad99 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.316432 Oct 27 18:50:52.015012 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 714/1471] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:50:51 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:50:52.027937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1be3101e-17f5-46e4-99c0-59930c0b1388 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:52.038233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1be3101e-17f5-46e4-99c0-59930c0b1388 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:52.041310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.compute.servers [None req-1be3101e-17f5-46e4-99c0-59930c0b1388 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Removing options 'limit' from query {{(pid=127028) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 18:50:52.042793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1be3101e-17f5-46e4-99c0-59930c0b1388 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:50:52.057253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1be3101e-17f5-46e4-99c0-59930c0b1388 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:52.057864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1be3101e-17f5-46e4-99c0-59930c0b1388 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:52.058344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1be3101e-17f5-46e4-99c0-59930c0b1388 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:52.061414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1be3101e-17f5-46e4-99c0-59930c0b1388 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:52.061906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1be3101e-17f5-46e4-99c0-59930c0b1388 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:52.062553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1be3101e-17f5-46e4-99c0-59930c0b1388 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:52.116647 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1be3101e-17f5-46e4-99c0-59930c0b1388 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.092562 Oct 27 18:50:52.121437 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 715/1472] 10.222.0.42 () {58 vars in 1140 bytes} [Thu Oct 27 18:50:52 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:52.134460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1e0ea5e9-6f57-41dd-bf0d-92bbfa05f3fc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:52.137730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1e0ea5e9-6f57-41dd-bf0d-92bbfa05f3fc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:52.153427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e0ea5e9-6f57-41dd-bf0d-92bbfa05f3fc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:52.153927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e0ea5e9-6f57-41dd-bf0d-92bbfa05f3fc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:52.155620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e0ea5e9-6f57-41dd-bf0d-92bbfa05f3fc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:52.158454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e0ea5e9-6f57-41dd-bf0d-92bbfa05f3fc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:52.159052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e0ea5e9-6f57-41dd-bf0d-92bbfa05f3fc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:52.159374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e0ea5e9-6f57-41dd-bf0d-92bbfa05f3fc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:52.213694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:52.230310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:50:52.241933 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1e0ea5e9-6f57-41dd-bf0d-92bbfa05f3fc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119423 Oct 27 18:50:52.248283 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 716/1473] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 18:50:52 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:50:52.276168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bddeb98c-0951-4668-b816-1772c7287677 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:52.289182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bddeb98c-0951-4668-b816-1772c7287677 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:52.292064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bddeb98c-0951-4668-b816-1772c7287677 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-308936606', 'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:50:52.306804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bddeb98c-0951-4668-b816-1772c7287677 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:52.308644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bddeb98c-0951-4668-b816-1772c7287677 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:52.309497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bddeb98c-0951-4668-b816-1772c7287677 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:52.311086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bddeb98c-0951-4668-b816-1772c7287677 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:52.313422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bddeb98c-0951-4668-b816-1772c7287677 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:52.315157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bddeb98c-0951-4668-b816-1772c7287677 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:52.318237 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-df1f8fc4-dd8a-447a-8e0c-c92361ade8a3 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f/action" status: 202 len: 0 microversion: 2.1 time: 0.928608 Oct 27 18:50:52.323737 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 758/1474] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:50:51 2022] POST /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f/action => generated 0 bytes in 936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:50:52.345682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-86d3d0fa-1973-48f7-8bee-bf3ff83ab481 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:52.345682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-86d3d0fa-1973-48f7-8bee-bf3ff83ab481 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:52.381088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86d3d0fa-1973-48f7-8bee-bf3ff83ab481 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:52.381718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86d3d0fa-1973-48f7-8bee-bf3ff83ab481 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:52.382014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86d3d0fa-1973-48f7-8bee-bf3ff83ab481 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:52.382753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86d3d0fa-1973-48f7-8bee-bf3ff83ab481 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:52.383213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86d3d0fa-1973-48f7-8bee-bf3ff83ab481 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:52.383973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86d3d0fa-1973-48f7-8bee-bf3ff83ab481 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:52.686977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-bddeb98c-0951-4668-b816-1772c7287677 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:50:52.822898 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bddeb98c-0951-4668-b816-1772c7287677 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-308936606" status: 200 len: 345 microversion: 2.1 time: 0.566993 Oct 27 18:50:52.824634 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 717/1475] 10.222.0.42 () {58 vars in 1240 bytes} [Thu Oct 27 18:50:52 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-308936606 => generated 345 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:50:52.843406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c169b3b2-e75e-4ce5-8874-9ee5e24411d5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:52.860339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c169b3b2-e75e-4ce5-8874-9ee5e24411d5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:52.862044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c169b3b2-e75e-4ce5-8874-9ee5e24411d5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:52.862552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c169b3b2-e75e-4ce5-8874-9ee5e24411d5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:53.017195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c169b3b2-e75e-4ce5-8874-9ee5e24411d5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Going to try to stop instance {{(pid=127028) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 18:50:53.163713 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c169b3b2-e75e-4ce5-8874-9ee5e24411d5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "POST /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef/action" status: 202 len: 0 microversion: 2.1 time: 0.329099 Oct 27 18:50:53.167430 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 718/1476] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:50:52 2022] POST /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:50:53.189500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-86631da2-5114-449e-b24f-755a8fa91dec tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:53.194377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-86631da2-5114-449e-b24f-755a8fa91dec tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:53.217644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86631da2-5114-449e-b24f-755a8fa91dec tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:53.225283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86631da2-5114-449e-b24f-755a8fa91dec tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:53.227866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86631da2-5114-449e-b24f-755a8fa91dec tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:53.230139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86631da2-5114-449e-b24f-755a8fa91dec tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:53.230666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86631da2-5114-449e-b24f-755a8fa91dec tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:53.232645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86631da2-5114-449e-b24f-755a8fa91dec tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:53.670269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-86d3d0fa-1973-48f7-8bee-bf3ff83ab481 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:53.683792 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-86d3d0fa-1973-48f7-8bee-bf3ff83ab481 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1472 microversion: 2.1 time: 1.358873 Oct 27 18:50:53.704665 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 759/1477] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:52 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1472 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:53.717695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-11348aa5-25a1-4097-887b-bf4e7b6f18a0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:53.720707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-11348aa5-25a1-4097-887b-bf4e7b6f18a0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:53.734575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11348aa5-25a1-4097-887b-bf4e7b6f18a0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:53.735391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11348aa5-25a1-4097-887b-bf4e7b6f18a0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:53.737704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11348aa5-25a1-4097-887b-bf4e7b6f18a0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:53.738678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11348aa5-25a1-4097-887b-bf4e7b6f18a0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:53.742662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11348aa5-25a1-4097-887b-bf4e7b6f18a0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:53.744047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11348aa5-25a1-4097-887b-bf4e7b6f18a0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:53.816863 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-11348aa5-25a1-4097-887b-bf4e7b6f18a0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111011 Oct 27 18:50:53.817870 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 760/1478] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 18:50:53 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:50:53.907147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-86631da2-5114-449e-b24f-755a8fa91dec tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:53.919064 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-86631da2-5114-449e-b24f-755a8fa91dec tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1521 microversion: 2.1 time: 0.741378 Oct 27 18:50:53.922723 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 719/1479] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:53 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1521 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:54.711623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-19725166-aa1a-487d-95e7-20fc79d31564 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:54.712710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-19725166-aa1a-487d-95e7-20fc79d31564 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:54.728253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19725166-aa1a-487d-95e7-20fc79d31564 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:54.728981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19725166-aa1a-487d-95e7-20fc79d31564 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:54.735905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19725166-aa1a-487d-95e7-20fc79d31564 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:54.738975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19725166-aa1a-487d-95e7-20fc79d31564 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:54.739823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19725166-aa1a-487d-95e7-20fc79d31564 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:54.741448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19725166-aa1a-487d-95e7-20fc79d31564 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:54.831437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d1a36547-136f-4294-aa44-e41c10a261fe tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:54.833581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d1a36547-136f-4294-aa44-e41c10a261fe tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:54.867275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1a36547-136f-4294-aa44-e41c10a261fe tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:54.868432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1a36547-136f-4294-aa44-e41c10a261fe tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:54.869071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1a36547-136f-4294-aa44-e41c10a261fe tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:54.870222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1a36547-136f-4294-aa44-e41c10a261fe tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:54.871035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1a36547-136f-4294-aa44-e41c10a261fe tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:54.877038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1a36547-136f-4294-aa44-e41c10a261fe tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:55.017703 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d1a36547-136f-4294-aa44-e41c10a261fe tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.188685 Oct 27 18:50:55.020116 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 720/1480] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 18:50:54 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:50:55.040144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b237be60-9eb4-4d0e-b15f-dc44370896dc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:55.046357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b237be60-9eb4-4d0e-b15f-dc44370896dc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:55.059887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b237be60-9eb4-4d0e-b15f-dc44370896dc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:55.062704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b237be60-9eb4-4d0e-b15f-dc44370896dc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:55.066290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b237be60-9eb4-4d0e-b15f-dc44370896dc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:55.067343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b237be60-9eb4-4d0e-b15f-dc44370896dc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:55.067996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b237be60-9eb4-4d0e-b15f-dc44370896dc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:55.068622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b237be60-9eb4-4d0e-b15f-dc44370896dc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:55.676507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-19725166-aa1a-487d-95e7-20fc79d31564 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:55.686252 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-19725166-aa1a-487d-95e7-20fc79d31564 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1472 microversion: 2.1 time: 0.978796 Oct 27 18:50:55.688017 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 761/1481] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:54 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1472 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:55.869281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b237be60-9eb4-4d0e-b15f-dc44370896dc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:55.887486 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b237be60-9eb4-4d0e-b15f-dc44370896dc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1521 microversion: 2.1 time: 0.863697 Oct 27 18:50:55.889700 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 721/1482] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:55 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1521 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:56.032700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-04fb81b8-cc96-4594-b127-1dbb3b403c8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:56.041948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-04fb81b8-cc96-4594-b127-1dbb3b403c8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:56.056599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fb81b8-cc96-4594-b127-1dbb3b403c8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:56.057440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fb81b8-cc96-4594-b127-1dbb3b403c8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:56.058071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fb81b8-cc96-4594-b127-1dbb3b403c8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:56.059615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fb81b8-cc96-4594-b127-1dbb3b403c8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:56.060254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fb81b8-cc96-4594-b127-1dbb3b403c8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:56.061251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04fb81b8-cc96-4594-b127-1dbb3b403c8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:56.203825 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-04fb81b8-cc96-4594-b127-1dbb3b403c8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.175626 Oct 27 18:50:56.210532 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 762/1483] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 18:50:56 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342/os-volume_attachments => generated 25 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:56.713049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ada7351c-4667-4c9d-ade4-b0cf953d57c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:56.714236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ada7351c-4667-4c9d-ade4-b0cf953d57c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:56.722873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ada7351c-4667-4c9d-ade4-b0cf953d57c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:56.723858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ada7351c-4667-4c9d-ade4-b0cf953d57c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:56.724801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ada7351c-4667-4c9d-ade4-b0cf953d57c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:56.725753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ada7351c-4667-4c9d-ade4-b0cf953d57c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:56.726397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ada7351c-4667-4c9d-ade4-b0cf953d57c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:56.727186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ada7351c-4667-4c9d-ade4-b0cf953d57c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:56.915868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-599e2900-ac0c-4923-a78c-7b5ffdd3f67c tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:56.916713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-599e2900-ac0c-4923-a78c-7b5ffdd3f67c tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:56.928868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-599e2900-ac0c-4923-a78c-7b5ffdd3f67c tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:56.932525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-599e2900-ac0c-4923-a78c-7b5ffdd3f67c tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:56.934005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-599e2900-ac0c-4923-a78c-7b5ffdd3f67c tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:56.934929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-599e2900-ac0c-4923-a78c-7b5ffdd3f67c tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:56.937664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-599e2900-ac0c-4923-a78c-7b5ffdd3f67c tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:56.938228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-599e2900-ac0c-4923-a78c-7b5ffdd3f67c tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:57.348074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ada7351c-4667-4c9d-ade4-b0cf953d57c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:57.358852 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ada7351c-4667-4c9d-ade4-b0cf953d57c3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1472 microversion: 2.1 time: 0.650107 Oct 27 18:50:57.359320 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 722/1484] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:56 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1472 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:58.089878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-599e2900-ac0c-4923-a78c-7b5ffdd3f67c tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:50:58.113944 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-599e2900-ac0c-4923-a78c-7b5ffdd3f67c tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1521 microversion: 2.1 time: 1.203628 Oct 27 18:50:58.114789 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 763/1485] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:56 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1521 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:50:58.126108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a54d38e2-729b-4f67-ad1f-0d28114698d9 tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] Action: 'create', calling method: .version_select at 0x7fc86b05e550>, body: {"pool": null} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:50:58.390515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5cd3833c-d0c9-4a61-9b33-2158becda633 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:50:58.391434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5cd3833c-d0c9-4a61-9b33-2158becda633 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:50:58.406835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cd3833c-d0c9-4a61-9b33-2158becda633 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:58.409764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cd3833c-d0c9-4a61-9b33-2158becda633 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:58.411637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cd3833c-d0c9-4a61-9b33-2158becda633 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:58.416008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cd3833c-d0c9-4a61-9b33-2158becda633 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:50:58.421523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cd3833c-d0c9-4a61-9b33-2158becda633 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:50:58.422859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cd3833c-d0c9-4a61-9b33-2158becda633 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:50:59.454886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:00.272548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:00.324874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:00.458958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5cd3833c-d0c9-4a61-9b33-2158becda633 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:00.470817 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5cd3833c-d0c9-4a61-9b33-2158becda633 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1472 microversion: 2.1 time: 2.088348 Oct 27 18:51:00.490107 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 764/1486] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:50:58 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1472 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:00.500661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fd867286-f6eb-448d-842c-2a5c03fbb0e8 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:00.516328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fd867286-f6eb-448d-842c-2a5c03fbb0e8 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:00.533171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd867286-f6eb-448d-842c-2a5c03fbb0e8 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:00.533668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd867286-f6eb-448d-842c-2a5c03fbb0e8 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:00.536746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd867286-f6eb-448d-842c-2a5c03fbb0e8 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:00.538876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd867286-f6eb-448d-842c-2a5c03fbb0e8 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:00.540271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd867286-f6eb-448d-842c-2a5c03fbb0e8 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:00.545033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd867286-f6eb-448d-842c-2a5c03fbb0e8 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:00.955267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fd867286-f6eb-448d-842c-2a5c03fbb0e8 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:00.969994 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fd867286-f6eb-448d-842c-2a5c03fbb0e8 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1521 microversion: 2.1 time: 0.477621 Oct 27 18:51:00.971914 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 765/1487] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:00 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:01.013720 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a54d38e2-729b-4f67-ad1f-0d28114698d9 tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.106419 Oct 27 18:51:01.015108 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 723/1488] 10.222.0.42 () {60 vars in 1170 bytes} [Thu Oct 27 18:50:57 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:51:01.028460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2df66297-416f-4a15-9b5b-7132e0726d52 tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] Action: 'create', calling method: .version_select at 0x7fc86aae0040>, body: {"pool": null} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:01.500280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-245176bd-e7c2-4e08-bc23-53b3146f658a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:01.501290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-245176bd-e7c2-4e08-bc23-53b3146f658a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:01.512021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-245176bd-e7c2-4e08-bc23-53b3146f658a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:01.520737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-245176bd-e7c2-4e08-bc23-53b3146f658a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:01.522562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-245176bd-e7c2-4e08-bc23-53b3146f658a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:01.523589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-245176bd-e7c2-4e08-bc23-53b3146f658a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:01.530320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-245176bd-e7c2-4e08-bc23-53b3146f658a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:01.532540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-245176bd-e7c2-4e08-bc23-53b3146f658a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:01.900555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-245176bd-e7c2-4e08-bc23-53b3146f658a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:01.922414 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-245176bd-e7c2-4e08-bc23-53b3146f658a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1477 microversion: 2.1 time: 0.426588 Oct 27 18:51:01.925517 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 724/1489] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:01 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1477 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:02.000210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3a651a53-3f7a-49f3-9551-089d2d67ba73 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:02.001719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3a651a53-3f7a-49f3-9551-089d2d67ba73 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:02.015085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a651a53-3f7a-49f3-9551-089d2d67ba73 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:02.015677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a651a53-3f7a-49f3-9551-089d2d67ba73 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:02.016048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a651a53-3f7a-49f3-9551-089d2d67ba73 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:02.016794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a651a53-3f7a-49f3-9551-089d2d67ba73 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:02.028064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a651a53-3f7a-49f3-9551-089d2d67ba73 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:02.028596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a651a53-3f7a-49f3-9551-089d2d67ba73 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:02.253535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3a651a53-3f7a-49f3-9551-089d2d67ba73 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:02.269165 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3a651a53-3f7a-49f3-9551-089d2d67ba73 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1521 microversion: 2.1 time: 0.271737 Oct 27 18:51:02.270782 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 725/1490] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:01 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:51:02.953066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b798cee5-3e09-4052-8bc2-49af3c3f862a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:02.953700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b798cee5-3e09-4052-8bc2-49af3c3f862a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:02.960300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=18 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:02.984125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b798cee5-3e09-4052-8bc2-49af3c3f862a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:02.984652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b798cee5-3e09-4052-8bc2-49af3c3f862a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:02.985118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b798cee5-3e09-4052-8bc2-49af3c3f862a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:02.989627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b798cee5-3e09-4052-8bc2-49af3c3f862a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:02.990192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b798cee5-3e09-4052-8bc2-49af3c3f862a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:02.990657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b798cee5-3e09-4052-8bc2-49af3c3f862a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:03.309099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b798cee5-3e09-4052-8bc2-49af3c3f862a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:03.322922 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b798cee5-3e09-4052-8bc2-49af3c3f862a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1477 microversion: 2.1 time: 0.373082 Oct 27 18:51:03.326461 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 726/1491] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:02 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1477 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:51:03.335079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-764e5068-c94a-45b3-b18a-2573621f4d5f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:03.336046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-764e5068-c94a-45b3-b18a-2573621f4d5f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:03.356951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-764e5068-c94a-45b3-b18a-2573621f4d5f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:03.360237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-764e5068-c94a-45b3-b18a-2573621f4d5f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:03.360975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-764e5068-c94a-45b3-b18a-2573621f4d5f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:03.363532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-764e5068-c94a-45b3-b18a-2573621f4d5f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:03.364773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-764e5068-c94a-45b3-b18a-2573621f4d5f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:03.366512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-764e5068-c94a-45b3-b18a-2573621f4d5f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:03.617447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-764e5068-c94a-45b3-b18a-2573621f4d5f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:03.629495 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-764e5068-c94a-45b3-b18a-2573621f4d5f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1521 microversion: 2.1 time: 0.300417 Oct 27 18:51:03.630109 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 727/1492] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:03 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:04.353231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-adfabecf-af11-4cfc-a9eb-eda2344265b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:04.354722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-adfabecf-af11-4cfc-a9eb-eda2344265b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:04.365015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adfabecf-af11-4cfc-a9eb-eda2344265b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:04.368712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adfabecf-af11-4cfc-a9eb-eda2344265b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:04.369446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adfabecf-af11-4cfc-a9eb-eda2344265b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:04.372188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adfabecf-af11-4cfc-a9eb-eda2344265b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:04.372876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adfabecf-af11-4cfc-a9eb-eda2344265b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:04.373489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adfabecf-af11-4cfc-a9eb-eda2344265b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:04.659488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-adfabecf-af11-4cfc-a9eb-eda2344265b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:04.671052 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-adfabecf-af11-4cfc-a9eb-eda2344265b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1477 microversion: 2.1 time: 0.322201 Oct 27 18:51:04.683797 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 728/1493] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:04 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1477 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:51:04.842090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a0abccaf-6628-40d9-816a-2bdd4d7736df tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] Action: 'create', calling method: .version_select at 0x7fc86ad283a0>, body: {"pool": null} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:05.449029 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2df66297-416f-4a15-9b5b-7132e0726d52 tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.424713 Oct 27 18:51:05.458555 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 766/1494] 10.222.0.42 () {60 vars in 1170 bytes} [Thu Oct 27 18:51:01 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:05.603880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-607611596", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "48d799d1-472c-411a-b78f-69bbb079830c"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:05.708796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] validate_networks() for [('48d799d1-472c-411a-b78f-69bbb079830c', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:51:06.796413 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a0abccaf-6628-40d9-816a-2bdd4d7736df tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.110844 Oct 27 18:51:06.797021 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 729/1495] 10.222.0.42 () {60 vars in 1170 bytes} [Thu Oct 27 18:51:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:06.812548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5eb94c1e-9c55-4b92-9bbe-269d1ef35dbf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:06.813165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5eb94c1e-9c55-4b92-9bbe-269d1ef35dbf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:06.821229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5eb94c1e-9c55-4b92-9bbe-269d1ef35dbf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:06.822636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5eb94c1e-9c55-4b92-9bbe-269d1ef35dbf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:06.823099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5eb94c1e-9c55-4b92-9bbe-269d1ef35dbf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:06.823796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5eb94c1e-9c55-4b92-9bbe-269d1ef35dbf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:06.824419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5eb94c1e-9c55-4b92-9bbe-269d1ef35dbf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:06.825010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5eb94c1e-9c55-4b92-9bbe-269d1ef35dbf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:07.123603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:51:07.124169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:51:07.124502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:51:07.124918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:51:07.125335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:51:07.129973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=72 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:07.145548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:07.146059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:07.158442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:07.159708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:07.161613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:07.162884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:07.202363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5eb94c1e-9c55-4b92-9bbe-269d1ef35dbf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:07.215015 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5eb94c1e-9c55-4b92-9bbe-269d1ef35dbf tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1521 microversion: 2.1 time: 0.407903 Oct 27 18:51:07.218689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Getting quotas for project d80182bb9450487f93c270d199dac1d1. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:51:07.224128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Getting quotas for user e3973c038bc34eb3b9cc1dfc2e0de5fe and project d80182bb9450487f93c270d199dac1d1. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:51:07.237714 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 730/1496] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:06 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:07.237995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:51:07.240534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:51:07.244749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d3732635-74b4-4e7b-939a-6ce11106388e tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] Action: 'create', calling method: .version_select at 0x7fc86ad558b0>, body: {"pool": null} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:07.316622 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8f6b7daa-6083-462f-a786-035f326d6f65 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.856310 Oct 27 18:51:07.329602 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 767/1497] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:51:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:51:07.342656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f340c837-60e0-4c66-9d1e-04ba60606fc6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:07.350980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f340c837-60e0-4c66-9d1e-04ba60606fc6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:07.372757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f340c837-60e0-4c66-9d1e-04ba60606fc6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:07.373271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f340c837-60e0-4c66-9d1e-04ba60606fc6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:07.373716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f340c837-60e0-4c66-9d1e-04ba60606fc6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:07.378038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f340c837-60e0-4c66-9d1e-04ba60606fc6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:07.384093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f340c837-60e0-4c66-9d1e-04ba60606fc6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:07.385821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f340c837-60e0-4c66-9d1e-04ba60606fc6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:08.406342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f340c837-60e0-4c66-9d1e-04ba60606fc6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:08.421386 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f340c837-60e0-4c66-9d1e-04ba60606fc6 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1477 microversion: 2.1 time: 1.100644 Oct 27 18:51:08.422148 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 768/1498] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:07 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1477 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:08.457245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-57cb6f60-a601-49cc-98af-b64930d7190f tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] Calling method '.version_select at 0x7fc86a9d0f70>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:09.178700 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-57cb6f60-a601-49cc-98af-b64930d7190f tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/27a5eeb9-e4a6-4487-a7b4-5d2d90e6c56d" status: 200 len: 142 microversion: 2.1 time: 0.732599 Oct 27 18:51:09.179924 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 769/1499] 10.222.0.42 () {58 vars in 1260 bytes} [Thu Oct 27 18:51:08 2022] GET /compute/v2.1/os-floating-ips/27a5eeb9-e4a6-4487-a7b4-5d2d90e6c56d => generated 142 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:09.184969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-957d9a9e-8dc5-4eb5-b2d1-3e46331a4237 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:09.186102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-957d9a9e-8dc5-4eb5-b2d1-3e46331a4237 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:09.202417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-957d9a9e-8dc5-4eb5-b2d1-3e46331a4237 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:09.205072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-957d9a9e-8dc5-4eb5-b2d1-3e46331a4237 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:09.207509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-957d9a9e-8dc5-4eb5-b2d1-3e46331a4237 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:09.210682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-957d9a9e-8dc5-4eb5-b2d1-3e46331a4237 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:09.213141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-957d9a9e-8dc5-4eb5-b2d1-3e46331a4237 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:09.213770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-957d9a9e-8dc5-4eb5-b2d1-3e46331a4237 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:09.482581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-957d9a9e-8dc5-4eb5-b2d1-3e46331a4237 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3973c038bc34eb3b9cc1dfc2e0de5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80182bb9450487f93c270d199dac1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:09.499457 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-957d9a9e-8dc5-4eb5-b2d1-3e46331a4237 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 200 len: 1276 microversion: 2.1 time: 0.317003 Oct 27 18:51:09.530043 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 770/1500] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:09 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 1276 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:09.544474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-704d321b-a82c-4a1b-8982-792c01703eeb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:09.546225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-704d321b-a82c-4a1b-8982-792c01703eeb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:09.563567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-704d321b-a82c-4a1b-8982-792c01703eeb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:09.564343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-704d321b-a82c-4a1b-8982-792c01703eeb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:09.565036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-704d321b-a82c-4a1b-8982-792c01703eeb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:09.565946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-704d321b-a82c-4a1b-8982-792c01703eeb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:09.566611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-704d321b-a82c-4a1b-8982-792c01703eeb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:09.567217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-704d321b-a82c-4a1b-8982-792c01703eeb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:09.944140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-704d321b-a82c-4a1b-8982-792c01703eeb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:09.964090 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-704d321b-a82c-4a1b-8982-792c01703eeb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1498 microversion: 2.1 time: 0.426548 Oct 27 18:51:09.965115 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 771/1501] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:09 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1498 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:09.970265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0a0c55aa-e6d7-4af9-b5a4-0fbd2c79b5cd tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] Calling method '.version_select at 0x7fc86aa8d280>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:10.475045 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d3732635-74b4-4e7b-939a-6ce11106388e tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.234972 Oct 27 18:51:10.493539 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 731/1502] 10.222.0.42 () {60 vars in 1170 bytes} [Thu Oct 27 18:51:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:10.513778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cab00dfa-144b-4ec7-93d7-b959b37bccac tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:10.514882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cab00dfa-144b-4ec7-93d7-b959b37bccac tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:10.548893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cab00dfa-144b-4ec7-93d7-b959b37bccac tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:10.549674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cab00dfa-144b-4ec7-93d7-b959b37bccac tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:10.550299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cab00dfa-144b-4ec7-93d7-b959b37bccac tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:10.551096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cab00dfa-144b-4ec7-93d7-b959b37bccac tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:10.551559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cab00dfa-144b-4ec7-93d7-b959b37bccac tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:10.551983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cab00dfa-144b-4ec7-93d7-b959b37bccac tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:10.639482 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0a0c55aa-e6d7-4af9-b5a4-0fbd2c79b5cd tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.673002 Oct 27 18:51:10.639988 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 772/1503] 10.222.0.42 () {58 vars in 1149 bytes} [Thu Oct 27 18:51:09 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:10.644761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5825715b-d1d8-43db-9af0-b85d6d163366 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:10.650164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5825715b-d1d8-43db-9af0-b85d6d163366 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:10.657319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5825715b-d1d8-43db-9af0-b85d6d163366 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:51:10.675699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5825715b-d1d8-43db-9af0-b85d6d163366 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:10.678806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5825715b-d1d8-43db-9af0-b85d6d163366 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:10.679489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5825715b-d1d8-43db-9af0-b85d6d163366 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:10.682462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5825715b-d1d8-43db-9af0-b85d6d163366 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:10.683156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5825715b-d1d8-43db-9af0-b85d6d163366 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:10.683780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5825715b-d1d8-43db-9af0-b85d6d163366 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:10.791056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-5825715b-d1d8-43db-9af0-b85d6d163366 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:51:10.862539 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5825715b-d1d8-43db-9af0-b85d6d163366 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.221329 Oct 27 18:51:10.863662 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 773/1504] 10.222.0.42 () {58 vars in 1154 bytes} [Thu Oct 27 18:51:10 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:10.869359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dc4c6af6-d81a-4a9e-b761-eae2da952ccd tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] Action: 'create', calling method: .version_select at 0x7fc86aa9a820>, body: {"pool": null} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:10.948626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cab00dfa-144b-4ec7-93d7-b959b37bccac tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:10.959543 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cab00dfa-144b-4ec7-93d7-b959b37bccac tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1477 microversion: 2.1 time: 0.462370 Oct 27 18:51:10.963716 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 732/1505] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:10 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1477 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:10.973036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7c1becde-58a6-4013-9122-13499c2922b1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:10.973991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7c1becde-58a6-4013-9122-13499c2922b1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:10.993872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c1becde-58a6-4013-9122-13499c2922b1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:10.995073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c1becde-58a6-4013-9122-13499c2922b1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:10.997199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c1becde-58a6-4013-9122-13499c2922b1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:10.998992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c1becde-58a6-4013-9122-13499c2922b1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:11.002678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c1becde-58a6-4013-9122-13499c2922b1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:11.003163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c1becde-58a6-4013-9122-13499c2922b1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:11.143596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7c1becde-58a6-4013-9122-13499c2922b1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3973c038bc34eb3b9cc1dfc2e0de5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80182bb9450487f93c270d199dac1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:11.159691 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7c1becde-58a6-4013-9122-13499c2922b1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 200 len: 1282 microversion: 2.1 time: 0.194627 Oct 27 18:51:11.174461 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 733/1506] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:10 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 1282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:11.174461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-da56ecc2-ae09-43b2-b3a8-97c603eb506d tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] Calling method '.version_select at 0x7fc86ad28b80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:13.491010 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dc4c6af6-d81a-4a9e-b761-eae2da952ccd tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.626026 Oct 27 18:51:13.496224 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 774/1507] 10.222.0.42 () {60 vars in 1170 bytes} [Thu Oct 27 18:51:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:13.510112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b2b251a-fa09-40f9-bad1-943092d89de4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:13.543464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b2b251a-fa09-40f9-bad1-943092d89de4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:13.544323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b2b251a-fa09-40f9-bad1-943092d89de4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:13.545329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b2b251a-fa09-40f9-bad1-943092d89de4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:13.569510 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-da56ecc2-ae09-43b2-b3a8-97c603eb506d tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/27a5eeb9-e4a6-4487-a7b4-5d2d90e6c56d" status: 202 len: 0 microversion: 2.1 time: 2.407344 Oct 27 18:51:13.570476 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 734/1508] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 18:51:11 2022] DELETE /compute/v2.1/os-floating-ips/27a5eeb9-e4a6-4487-a7b4-5d2d90e6c56d => generated 0 bytes in 2409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:51:13.575833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-38ca9df4-697f-4790-89f6-aedbb687cc4d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:13.576451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-38ca9df4-697f-4790-89f6-aedbb687cc4d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:13.587989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=70 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:13.591668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38ca9df4-697f-4790-89f6-aedbb687cc4d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:13.592204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38ca9df4-697f-4790-89f6-aedbb687cc4d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:13.592650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38ca9df4-697f-4790-89f6-aedbb687cc4d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:13.593405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38ca9df4-697f-4790-89f6-aedbb687cc4d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:13.593899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38ca9df4-697f-4790-89f6-aedbb687cc4d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:13.594446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38ca9df4-697f-4790-89f6-aedbb687cc4d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:13.657211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:13.681747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b2b251a-fa09-40f9-bad1-943092d89de4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Going to try to start instance {{(pid=127029) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 18:51:13.755830 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b2b251a-fa09-40f9-bad1-943092d89de4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "POST /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef/action" status: 202 len: 0 microversion: 2.1 time: 0.257450 Oct 27 18:51:13.757075 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 775/1509] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:51:13 2022] POST /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:51:13.765155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b8d651de-df1e-416e-809f-497dddfa0290 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:13.766277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b8d651de-df1e-416e-809f-497dddfa0290 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:13.775508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8d651de-df1e-416e-809f-497dddfa0290 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:13.776470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8d651de-df1e-416e-809f-497dddfa0290 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:13.778033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8d651de-df1e-416e-809f-497dddfa0290 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:13.779079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8d651de-df1e-416e-809f-497dddfa0290 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:13.779801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8d651de-df1e-416e-809f-497dddfa0290 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:13.780524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8d651de-df1e-416e-809f-497dddfa0290 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:14.044797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-38ca9df4-697f-4790-89f6-aedbb687cc4d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:14.057646 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-38ca9df4-697f-4790-89f6-aedbb687cc4d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1477 microversion: 2.1 time: 0.484219 Oct 27 18:51:14.071881 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 735/1510] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:13 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1477 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:14.082344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b8d651de-df1e-416e-809f-497dddfa0290 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3973c038bc34eb3b9cc1dfc2e0de5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80182bb9450487f93c270d199dac1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:14.084707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d690e8e0-4648-4ed1-a3b3-14a819a749b7 tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] Calling method '.version_select at 0x7fc86b9389d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:14.095495 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b8d651de-df1e-416e-809f-497dddfa0290 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 200 len: 1324 microversion: 2.1 time: 0.335548 Oct 27 18:51:14.096516 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 776/1511] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:13 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 1324 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:14.115670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-66918d35-c8cb-4907-bb19-f53dc381bafa tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] Action: 'create', calling method: .version_select at 0x7fc86aa9a160>, body: {"pool": null} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:14.535639 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d690e8e0-4648-4ed1-a3b3-14a819a749b7 tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/0c9c6c33-f21d-475f-ada3-2c40bffd0385" status: 200 len: 142 microversion: 2.1 time: 0.456027 Oct 27 18:51:14.545677 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 736/1512] 10.222.0.42 () {58 vars in 1260 bytes} [Thu Oct 27 18:51:14 2022] GET /compute/v2.1/os-floating-ips/0c9c6c33-f21d-475f-ada3-2c40bffd0385 => generated 142 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:14.553290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-56c5f56e-d1de-4171-92f3-a32a0ed67987 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:14.554263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-56c5f56e-d1de-4171-92f3-a32a0ed67987 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:14.577012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56c5f56e-d1de-4171-92f3-a32a0ed67987 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:14.577675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56c5f56e-d1de-4171-92f3-a32a0ed67987 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:14.577979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56c5f56e-d1de-4171-92f3-a32a0ed67987 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:14.578930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56c5f56e-d1de-4171-92f3-a32a0ed67987 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:14.579594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56c5f56e-d1de-4171-92f3-a32a0ed67987 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:14.580195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56c5f56e-d1de-4171-92f3-a32a0ed67987 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:15.098901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-56c5f56e-d1de-4171-92f3-a32a0ed67987 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:15.122413 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-56c5f56e-d1de-4171-92f3-a32a0ed67987 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1507 microversion: 2.1 time: 0.574097 Oct 27 18:51:15.139879 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 737/1513] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:14 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1507 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:15.174124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ed535298-fa6a-429a-b6ca-cf7c8b72992d tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] Calling method '.version_select at 0x7fc86ac54280>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:16.730039 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ed535298-fa6a-429a-b6ca-cf7c8b72992d tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/0c9c6c33-f21d-475f-ada3-2c40bffd0385" status: 202 len: 0 microversion: 2.1 time: 1.587705 Oct 27 18:51:16.731018 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 738/1514] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 18:51:15 2022] DELETE /compute/v2.1/os-floating-ips/0c9c6c33-f21d-475f-ada3-2c40bffd0385 => generated 0 bytes in 1590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:51:16.735926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-716125355", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "28da392a-54e3-4ecd-959f-299c4240c639"}, {"uuid": "923e16b7-2513-45fe-a23c-b8f6c65e5241"}, {"uuid": "28da392a-54e3-4ecd-959f-299c4240c639"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:16.838037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] validate_networks() for [('28da392a-54e3-4ecd-959f-299c4240c639', None, None, None, None, None), ('923e16b7-2513-45fe-a23c-b8f6c65e5241', None, None, None, None, None), ('28da392a-54e3-4ecd-959f-299c4240c639', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:51:16.994355 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-66918d35-c8cb-4907-bb19-f53dc381bafa tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.888736 Oct 27 18:51:16.995899 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 777/1515] 10.222.0.42 () {60 vars in 1170 bytes} [Thu Oct 27 18:51:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:17.003047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6759966c-3662-41bf-9ea2-d53148020588 req-624b8521-ed94-4b94-a3c3-c3794065c393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "088955af-fa5c-4217-a66f-fd72d3eed8e8", "tag": "a844e32b-cd78-4d1f-9193-137b08f7908f"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:17.015575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6759966c-3662-41bf-9ea2-d53148020588 req-624b8521-ed94-4b94-a3c3-c3794065c393 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:17.016304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6759966c-3662-41bf-9ea2-d53148020588 req-624b8521-ed94-4b94-a3c3-c3794065c393 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:17.016909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6759966c-3662-41bf-9ea2-d53148020588 req-624b8521-ed94-4b94-a3c3-c3794065c393 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:17.041592 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6759966c-3662-41bf-9ea2-d53148020588 req-624b8521-ed94-4b94-a3c3-c3794065c393 service nova] Creating event network-changed:a844e32b-cd78-4d1f-9193-137b08f7908f for instance 088955af-fa5c-4217-a66f-fd72d3eed8e8 on n-h2-860687-3 Oct 27 18:51:17.054216 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6759966c-3662-41bf-9ea2-d53148020588 req-624b8521-ed94-4b94-a3c3-c3794065c393 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055043 Oct 27 18:51:17.054866 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 778/1516] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:17.061285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6166b8b0-1d48-45b5-8846-3baf30c1f3c1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:17.062908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6166b8b0-1d48-45b5-8846-3baf30c1f3c1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:17.072541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6166b8b0-1d48-45b5-8846-3baf30c1f3c1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:17.073389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6166b8b0-1d48-45b5-8846-3baf30c1f3c1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:17.074051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6166b8b0-1d48-45b5-8846-3baf30c1f3c1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:17.076056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6166b8b0-1d48-45b5-8846-3baf30c1f3c1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:17.076738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6166b8b0-1d48-45b5-8846-3baf30c1f3c1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:17.077373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6166b8b0-1d48-45b5-8846-3baf30c1f3c1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:17.234609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:17.375334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6166b8b0-1d48-45b5-8846-3baf30c1f3c1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:17.384448 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6166b8b0-1d48-45b5-8846-3baf30c1f3c1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1477 microversion: 2.1 time: 0.327864 Oct 27 18:51:17.386590 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 779/1517] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:17 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1477 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:17.391937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-99cf179a-9af4-4905-8bd8-1edc6f0d0368 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:17.392830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-99cf179a-9af4-4905-8bd8-1edc6f0d0368 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:17.400670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99cf179a-9af4-4905-8bd8-1edc6f0d0368 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:17.401745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99cf179a-9af4-4905-8bd8-1edc6f0d0368 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:17.402466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99cf179a-9af4-4905-8bd8-1edc6f0d0368 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:17.403428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99cf179a-9af4-4905-8bd8-1edc6f0d0368 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:17.404107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99cf179a-9af4-4905-8bd8-1edc6f0d0368 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:17.404759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99cf179a-9af4-4905-8bd8-1edc6f0d0368 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:17.435974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:17.634214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-99cf179a-9af4-4905-8bd8-1edc6f0d0368 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3973c038bc34eb3b9cc1dfc2e0de5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80182bb9450487f93c270d199dac1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:17.642786 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-99cf179a-9af4-4905-8bd8-1edc6f0d0368 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 200 len: 1324 microversion: 2.1 time: 0.254759 Oct 27 18:51:17.646724 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 780/1518] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:17 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 1324 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:17.664295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-37cb8393-9267-4ae3-acd7-d029c2c037be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:17.668146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-37cb8393-9267-4ae3-acd7-d029c2c037be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:17.685695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37cb8393-9267-4ae3-acd7-d029c2c037be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:17.688819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37cb8393-9267-4ae3-acd7-d029c2c037be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:17.689282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37cb8393-9267-4ae3-acd7-d029c2c037be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:17.690179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37cb8393-9267-4ae3-acd7-d029c2c037be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:17.690724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37cb8393-9267-4ae3-acd7-d029c2c037be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:17.691275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37cb8393-9267-4ae3-acd7-d029c2c037be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:18.018886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-37cb8393-9267-4ae3-acd7-d029c2c037be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:18.032637 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-37cb8393-9267-4ae3-acd7-d029c2c037be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1511 microversion: 2.1 time: 0.384045 Oct 27 18:51:18.047938 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 781/1519] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:17 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:18.062290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7f9f355d-a867-409a-b8d2-e3664b04a668 tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] Calling method '.version_select at 0x7fc86a9fa8b0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:18.257904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:51:18.258733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:51:18.259238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:51:18.259659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:51:18.260080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:51:18.274962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:18.275774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:18.277058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:18.278019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:18.279585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:18.280647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:18.322245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Getting quotas for project 05e6f4807fd34f6d9422bc06ee20cb10. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:51:18.330286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Getting quotas for user f657dcabf43141b584416d2597efb5cb and project 05e6f4807fd34f6d9422bc06ee20cb10. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:51:18.354216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:51:18.363062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:51:18.444426 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7f9f355d-a867-409a-b8d2-e3664b04a668 tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.395221 Oct 27 18:51:18.445032 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 782/1520] 10.222.0.42 () {58 vars in 1164 bytes} [Thu Oct 27 18:51:18 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:51:18.456472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7555088a-2760-47a9-a7b9-d0c2c6ad4bec tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] Calling method '.version_select at 0x7fc86ab6bd30>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:18.478945 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-69e91390-cbd4-49e9-aed4-ea6a4ace6582 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.746803 Oct 27 18:51:18.480173 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 739/1521] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:51:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:51:18.484911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9f559fe6-a0b0-4927-9969-0c54f08a26be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:18.492401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9f559fe6-a0b0-4927-9969-0c54f08a26be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:18.494790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.compute.servers [None req-9f559fe6-a0b0-4927-9969-0c54f08a26be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Removing options 'limit' from query {{(pid=127028) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 18:51:18.496050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9f559fe6-a0b0-4927-9969-0c54f08a26be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:51:18.497506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f559fe6-a0b0-4927-9969-0c54f08a26be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:18.498187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f559fe6-a0b0-4927-9969-0c54f08a26be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:18.498979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f559fe6-a0b0-4927-9969-0c54f08a26be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:18.500911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f559fe6-a0b0-4927-9969-0c54f08a26be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:18.501567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f559fe6-a0b0-4927-9969-0c54f08a26be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:18.502399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f559fe6-a0b0-4927-9969-0c54f08a26be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:18.504179 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9f559fe6-a0b0-4927-9969-0c54f08a26be tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.022896 Oct 27 18:51:18.505288 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 740/1522] 10.222.0.42 () {58 vars in 1140 bytes} [Thu Oct 27 18:51:18 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:51:18.513648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3d4fdd1e-5072-4de3-bdf0-24e97c3939ca tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:18.514560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3d4fdd1e-5072-4de3-bdf0-24e97c3939ca tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:18.523145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d4fdd1e-5072-4de3-bdf0-24e97c3939ca tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:18.537235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d4fdd1e-5072-4de3-bdf0-24e97c3939ca tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:18.538187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d4fdd1e-5072-4de3-bdf0-24e97c3939ca tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:18.540884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d4fdd1e-5072-4de3-bdf0-24e97c3939ca tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:18.541616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d4fdd1e-5072-4de3-bdf0-24e97c3939ca tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:18.545732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d4fdd1e-5072-4de3-bdf0-24e97c3939ca tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:19.043776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d4fdd1e-5072-4de3-bdf0-24e97c3939ca tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:19.069889 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3d4fdd1e-5072-4de3-bdf0-24e97c3939ca tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1477 microversion: 2.1 time: 0.561790 Oct 27 18:51:19.083009 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 741/1523] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:18 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1477 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:19.092980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf7730cb-01ef-4317-a7d0-6198ef1a6c63 tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] Calling method '.version_select at 0x7fc86b43d160>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:19.750214 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cf7730cb-01ef-4317-a7d0-6198ef1a6c63 tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips" status: 200 len: 395 microversion: 2.1 time: 0.665658 Oct 27 18:51:19.750877 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 742/1524] 10.222.0.42 () {58 vars in 1149 bytes} [Thu Oct 27 18:51:19 2022] GET /compute/v2.1/os-floating-ips => generated 395 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:19.755809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ec9dc3f6-c63a-440e-92a6-b323edf91c49 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:19.756642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ec9dc3f6-c63a-440e-92a6-b323edf91c49 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:19.785233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec9dc3f6-c63a-440e-92a6-b323edf91c49 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:19.786668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec9dc3f6-c63a-440e-92a6-b323edf91c49 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:19.789133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec9dc3f6-c63a-440e-92a6-b323edf91c49 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:19.790733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec9dc3f6-c63a-440e-92a6-b323edf91c49 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:19.792751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec9dc3f6-c63a-440e-92a6-b323edf91c49 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:19.793441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec9dc3f6-c63a-440e-92a6-b323edf91c49 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:19.945464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ec9dc3f6-c63a-440e-92a6-b323edf91c49 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:19.957690 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ec9dc3f6-c63a-440e-92a6-b323edf91c49 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1264 microversion: 2.1 time: 0.205848 Oct 27 18:51:19.960419 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 743/1525] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:19 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:19.966884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2e4c14a7-1d5d-4f02-b509-46e96caa49f1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:19.967990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2e4c14a7-1d5d-4f02-b509-46e96caa49f1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:19.974672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e4c14a7-1d5d-4f02-b509-46e96caa49f1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:19.975571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e4c14a7-1d5d-4f02-b509-46e96caa49f1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:19.981317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e4c14a7-1d5d-4f02-b509-46e96caa49f1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:19.988723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e4c14a7-1d5d-4f02-b509-46e96caa49f1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:19.990683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e4c14a7-1d5d-4f02-b509-46e96caa49f1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:19.991278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e4c14a7-1d5d-4f02-b509-46e96caa49f1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:20.069292 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7555088a-2760-47a9-a7b9-d0c2c6ad4bec tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/f3fa64f2-0993-4356-a6a4-05002b1cd435" status: 202 len: 0 microversion: 2.1 time: 1.616450 Oct 27 18:51:20.078584 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 783/1526] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 18:51:18 2022] DELETE /compute/v2.1/os-floating-ips/f3fa64f2-0993-4356-a6a4-05002b1cd435 => generated 0 bytes in 1633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:51:20.095707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ffc32f0a-62bc-4b13-86b9-6a2205a98909 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:20.096694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ffc32f0a-62bc-4b13-86b9-6a2205a98909 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:20.104580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffc32f0a-62bc-4b13-86b9-6a2205a98909 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:20.105363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffc32f0a-62bc-4b13-86b9-6a2205a98909 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:20.106020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffc32f0a-62bc-4b13-86b9-6a2205a98909 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:20.107285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffc32f0a-62bc-4b13-86b9-6a2205a98909 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:20.107985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffc32f0a-62bc-4b13-86b9-6a2205a98909 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:20.108596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffc32f0a-62bc-4b13-86b9-6a2205a98909 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:20.249413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2e4c14a7-1d5d-4f02-b509-46e96caa49f1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:20.264540 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2e4c14a7-1d5d-4f02-b509-46e96caa49f1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1511 microversion: 2.1 time: 0.302893 Oct 27 18:51:20.265155 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 744/1527] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:19 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1511 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:20.282541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d98e1389-afdd-4977-9b31-9c698f763da2 tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] Calling method '.version_select at 0x7fc86ad55e50>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:20.348435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ffc32f0a-62bc-4b13-86b9-6a2205a98909 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3973c038bc34eb3b9cc1dfc2e0de5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80182bb9450487f93c270d199dac1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:20.358258 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ffc32f0a-62bc-4b13-86b9-6a2205a98909 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 200 len: 1324 microversion: 2.1 time: 0.278221 Oct 27 18:51:20.360885 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 784/1528] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:20 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:20.384943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f76e919e-8125-426b-b928-5e04f72311b9 tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] Calling method '.version_select at 0x7fc86b314670>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:20.436131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-f76e919e-8125-426b-b928-5e04f72311b9 tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f3fa64f2-0993-4356-a6a4-05002b1cd435 could not be found", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:51:20.436949 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-f76e919e-8125-426b-b928-5e04f72311b9 tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] HTTP exception thrown: Floating IP not found for ID f3fa64f2-0993-4356-a6a4-05002b1cd435 Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f76e919e-8125-426b-b928-5e04f72311b9 tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] Request method failure captured: Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-floating-ips/f3fa64f2-0993-4356-a6a4-05002b1cd435 HTTP/1.1 Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtMYZuUqD9djDiYLsk_JiysEOpWYSKmKQWQtdaYlBhKOOcp2JVX2H0HMysnKE0VTiP3Ug-WNgIW0VTkByo6Cn1Us-FpzY3Y4Y8fmLT4k4TrqUFR9jX1WRU1O2WEysl6U7MMrMboQII6EFLWKOZOhplO1vy1R0l_tGaS542D_phgsrLI Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b55dfccba514796bdac0170a17b6d09 Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-FloatingIPsTestJSON-139016277 Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b55dfccba514796bdac0170a17b6d09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b55dfccba514796bdac0170a17b6d09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b55dfccba514796bdac0170a17b6d09", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b55dfccba514796bdac0170a17b6d09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-FloatingIPsTestJSON-139016277 Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b55dfccba514796bdac0170a17b6d09 Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-FloatingIPsTestJSON-139016277 Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-FloatingIPsTestJSON-139016277-project Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 460c9070ee524b3dbc8bb60eb8cbb7ba Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-FloatingIPsTestJSON-139016277-project Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: exception: Floating IP not found for ID f3fa64f2-0993-4356-a6a4-05002b1cd435 Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'f3fa64f2-0993-4356-a6a4-05002b1cd435'} Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f3fa64f2-0993-4356-a6a4-05002b1cd435 could not be found Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c2c8000-506f-4323-9b7d-4909cd433f0f'] Oct 27 18:51:20.439053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f3fa64f2-0993-4356-a6a4-05002b1cd435. Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f3fa64f2-0993-4356-a6a4-05002b1cd435 Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f3fa64f2-0993-4356-a6a4-05002b1cd435 Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:20.444635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f76e919e-8125-426b-b928-5e04f72311b9 tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] Returning 404 to user: Floating IP not found for ID f3fa64f2-0993-4356-a6a4-05002b1cd435 {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:51:20.447481 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f76e919e-8125-426b-b928-5e04f72311b9 tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/f3fa64f2-0993-4356-a6a4-05002b1cd435" status: 404 len: 111 microversion: 2.1 time: 0.066201 Oct 27 18:51:20.448164 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 785/1529] 10.222.0.42 () {58 vars in 1260 bytes} [Thu Oct 27 18:51:20 2022] GET /compute/v2.1/os-floating-ips/f3fa64f2-0993-4356-a6a4-05002b1cd435 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:51:20.468083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-df5cd095-4abf-4b3d-84ad-59e812873d59 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:20.468984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-df5cd095-4abf-4b3d-84ad-59e812873d59 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:20.478469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df5cd095-4abf-4b3d-84ad-59e812873d59 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:20.479113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df5cd095-4abf-4b3d-84ad-59e812873d59 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:20.479662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df5cd095-4abf-4b3d-84ad-59e812873d59 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:20.480493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df5cd095-4abf-4b3d-84ad-59e812873d59 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:20.481074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df5cd095-4abf-4b3d-84ad-59e812873d59 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:20.481766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df5cd095-4abf-4b3d-84ad-59e812873d59 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:20.677032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-df5cd095-4abf-4b3d-84ad-59e812873d59 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:20.686695 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-df5cd095-4abf-4b3d-84ad-59e812873d59 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1477 microversion: 2.1 time: 0.237166 Oct 27 18:51:20.687586 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 786/1530] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:20 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1477 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:20.696640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c57979ce-1ed1-42fd-9242-8090f4ed6ce5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:20.697617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c57979ce-1ed1-42fd-9242-8090f4ed6ce5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: b93639af-67fe-4725-9626-ed881eef60ba] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:20.706459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c57979ce-1ed1-42fd-9242-8090f4ed6ce5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:20.707233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c57979ce-1ed1-42fd-9242-8090f4ed6ce5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:20.707677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c57979ce-1ed1-42fd-9242-8090f4ed6ce5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:20.710756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c57979ce-1ed1-42fd-9242-8090f4ed6ce5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:20.712324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c57979ce-1ed1-42fd-9242-8090f4ed6ce5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:20.712998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c57979ce-1ed1-42fd-9242-8090f4ed6ce5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:20.739475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:21.001711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c57979ce-1ed1-42fd-9242-8090f4ed6ce5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:21.014765 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c57979ce-1ed1-42fd-9242-8090f4ed6ce5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba" status: 200 len: 1512 microversion: 2.1 time: 0.325132 Oct 27 18:51:21.034686 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 787/1531] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:20 2022] GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba => generated 1512 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:21.040487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-823d5a92-6aa8-4c0f-8409-088be7a04391 tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] Calling method '.version_select at 0x7fc86a8a91f0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:21.136190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-823d5a92-6aa8-4c0f-8409-088be7a04391 tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f3fa64f2-0993-4356-a6a4-05002b1cd435 could not be found", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:51:21.137722 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-823d5a92-6aa8-4c0f-8409-088be7a04391 tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] HTTP exception thrown: Floating IP not found for ID f3fa64f2-0993-4356-a6a4-05002b1cd435 Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-823d5a92-6aa8-4c0f-8409-088be7a04391 tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] Request method failure captured: Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-floating-ips/f3fa64f2-0993-4356-a6a4-05002b1cd435 HTTP/1.1 Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtMYZuUqD9djDiYLsk_JiysEOpWYSKmKQWQtdaYlBhKOOcp2JVX2H0HMysnKE0VTiP3Ug-WNgIW0VTkByo6Cn1Us-FpzY3Y4Y8fmLT4k4TrqUFR9jX1WRU1O2WEysl6U7MMrMboQII6EFLWKOZOhplO1vy1R0l_tGaS542D_phgsrLI Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b55dfccba514796bdac0170a17b6d09 Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-FloatingIPsTestJSON-139016277 Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b55dfccba514796bdac0170a17b6d09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b55dfccba514796bdac0170a17b6d09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b55dfccba514796bdac0170a17b6d09", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b55dfccba514796bdac0170a17b6d09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-FloatingIPsTestJSON-139016277 Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b55dfccba514796bdac0170a17b6d09 Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-FloatingIPsTestJSON-139016277 Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-FloatingIPsTestJSON-139016277-project Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 460c9070ee524b3dbc8bb60eb8cbb7ba Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-FloatingIPsTestJSON-139016277-project Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: exception: Floating IP not found for ID f3fa64f2-0993-4356-a6a4-05002b1cd435 Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'f3fa64f2-0993-4356-a6a4-05002b1cd435'} Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f3fa64f2-0993-4356-a6a4-05002b1cd435 could not be found Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3b1c569-a263-430b-b1f0-23f436ecf442'] Oct 27 18:51:21.140687 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f3fa64f2-0993-4356-a6a4-05002b1cd435. Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f3fa64f2-0993-4356-a6a4-05002b1cd435 Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f3fa64f2-0993-4356-a6a4-05002b1cd435 Oct 27 18:51:21.144986 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:21.155435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-823d5a92-6aa8-4c0f-8409-088be7a04391 tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] Returning 404 to user: Floating IP not found for ID f3fa64f2-0993-4356-a6a4-05002b1cd435 {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:51:21.156811 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-823d5a92-6aa8-4c0f-8409-088be7a04391 tempest-FloatingIPsTestJSON-139016277 tempest-FloatingIPsTestJSON-139016277-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/f3fa64f2-0993-4356-a6a4-05002b1cd435" status: 404 len: 111 microversion: 2.1 time: 0.120798 Oct 27 18:51:21.157597 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 788/1532] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 18:51:21 2022] DELETE /compute/v2.1/os-floating-ips/f3fa64f2-0993-4356-a6a4-05002b1cd435 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:51:21.163440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8fc7f6e2-2dfc-4930-a583-8caafbd12959 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:21.164474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8fc7f6e2-2dfc-4930-a583-8caafbd12959 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:21.183439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6e2-2dfc-4930-a583-8caafbd12959 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:21.184534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6e2-2dfc-4930-a583-8caafbd12959 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:21.189369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6e2-2dfc-4930-a583-8caafbd12959 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:21.190927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6e2-2dfc-4930-a583-8caafbd12959 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:21.194316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6e2-2dfc-4930-a583-8caafbd12959 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:21.195026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6e2-2dfc-4930-a583-8caafbd12959 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:21.336969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8fc7f6e2-2dfc-4930-a583-8caafbd12959 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:21.347728 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8fc7f6e2-2dfc-4930-a583-8caafbd12959 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1270 microversion: 2.1 time: 0.188823 Oct 27 18:51:21.349780 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 789/1533] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:21 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1270 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:21.358214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fb589c60-53bb-4e14-8a0e-8d1016667a20 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:21.359236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fb589c60-53bb-4e14-8a0e-8d1016667a20 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:21.372230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb589c60-53bb-4e14-8a0e-8d1016667a20 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:21.376420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb589c60-53bb-4e14-8a0e-8d1016667a20 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:21.377272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb589c60-53bb-4e14-8a0e-8d1016667a20 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:21.378187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb589c60-53bb-4e14-8a0e-8d1016667a20 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:21.378872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb589c60-53bb-4e14-8a0e-8d1016667a20 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:21.382838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb589c60-53bb-4e14-8a0e-8d1016667a20 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:21.428838 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d98e1389-afdd-4977-9b31-9c698f763da2 tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/5c2beb0c-2e77-4d0b-9cf0-fb3ec7c2b0a8" status: 202 len: 0 microversion: 2.1 time: 1.161303 Oct 27 18:51:21.430826 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 745/1534] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 18:51:20 2022] DELETE /compute/v2.1/os-floating-ips/5c2beb0c-2e77-4d0b-9cf0-fb3ec7c2b0a8 => generated 0 bytes in 1165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:51:21.435961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0ca865dd-c000-463b-905a-260cbe41df11 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:21.436931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0ca865dd-c000-463b-905a-260cbe41df11 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:21.459745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ca865dd-c000-463b-905a-260cbe41df11 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:21.460649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ca865dd-c000-463b-905a-260cbe41df11 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:21.461926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ca865dd-c000-463b-905a-260cbe41df11 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:21.463023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ca865dd-c000-463b-905a-260cbe41df11 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:21.463738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ca865dd-c000-463b-905a-260cbe41df11 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:21.464409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ca865dd-c000-463b-905a-260cbe41df11 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:21.648442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0ca865dd-c000-463b-905a-260cbe41df11 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3973c038bc34eb3b9cc1dfc2e0de5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80182bb9450487f93c270d199dac1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:21.653665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fb589c60-53bb-4e14-8a0e-8d1016667a20 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:21.659316 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0ca865dd-c000-463b-905a-260cbe41df11 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 200 len: 1324 microversion: 2.1 time: 0.227243 Oct 27 18:51:21.660385 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 746/1535] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:21 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 1324 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:21.663050 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fb589c60-53bb-4e14-8a0e-8d1016667a20 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1511 microversion: 2.1 time: 0.311929 Oct 27 18:51:21.664280 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 790/1536] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:21 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1511 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:21.667230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-62232c8f-20fb-4ae3-bc7d-1b34b254e314 tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] Calling method '.version_select at 0x7fc86ad55af0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:21.686278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d33c4ab9-0649-4898-8976-4a469fcc26b1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:21.691693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d33c4ab9-0649-4898-8976-4a469fcc26b1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:21.692714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d33c4ab9-0649-4898-8976-4a469fcc26b1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:51:21.859520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d33c4ab9-0649-4898-8976-4a469fcc26b1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:21.860121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d33c4ab9-0649-4898-8976-4a469fcc26b1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:21.860812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d33c4ab9-0649-4898-8976-4a469fcc26b1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:21.861782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d33c4ab9-0649-4898-8976-4a469fcc26b1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:21.862581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d33c4ab9-0649-4898-8976-4a469fcc26b1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:21.863239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d33c4ab9-0649-4898-8976-4a469fcc26b1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:21.981990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-d33c4ab9-0649-4898-8976-4a469fcc26b1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:51:22.061210 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d33c4ab9-0649-4898-8976-4a469fcc26b1 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 345 microversion: 2.1 time: 0.378689 Oct 27 18:51:22.062304 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 791/1537] 10.222.0.42 () {58 vars in 1154 bytes} [Thu Oct 27 18:51:21 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 345 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:22.072460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c7f3dbca-c8b5-46d7-ae5d-014062616113 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:22.073167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c7f3dbca-c8b5-46d7-ae5d-014062616113 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:22.080188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7f3dbca-c8b5-46d7-ae5d-014062616113 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:22.081074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7f3dbca-c8b5-46d7-ae5d-014062616113 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:22.081752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7f3dbca-c8b5-46d7-ae5d-014062616113 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:22.082741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7f3dbca-c8b5-46d7-ae5d-014062616113 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:22.083467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7f3dbca-c8b5-46d7-ae5d-014062616113 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:22.084134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7f3dbca-c8b5-46d7-ae5d-014062616113 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:22.972221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c7f3dbca-c8b5-46d7-ae5d-014062616113 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:22.987272 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c7f3dbca-c8b5-46d7-ae5d-014062616113 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1477 microversion: 2.1 time: 0.923779 Oct 27 18:51:22.988442 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 792/1538] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:22 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1477 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:22.993321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ccbb1a20-7f49-41d6-abbc-f32150449f4d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:22.994088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ccbb1a20-7f49-41d6-abbc-f32150449f4d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:23.011898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ccbb1a20-7f49-41d6-abbc-f32150449f4d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:23.012407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ccbb1a20-7f49-41d6-abbc-f32150449f4d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:23.012852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ccbb1a20-7f49-41d6-abbc-f32150449f4d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:23.013559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ccbb1a20-7f49-41d6-abbc-f32150449f4d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:23.014198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ccbb1a20-7f49-41d6-abbc-f32150449f4d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:23.014813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ccbb1a20-7f49-41d6-abbc-f32150449f4d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:23.215318 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-62232c8f-20fb-4ae3-bc7d-1b34b254e314 tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/efaa4b59-12db-4cc5-b8b7-ee342763e3ca" status: 202 len: 0 microversion: 2.1 time: 1.553074 Oct 27 18:51:23.216359 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 747/1539] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 18:51:21 2022] DELETE /compute/v2.1/os-floating-ips/efaa4b59-12db-4cc5-b8b7-ee342763e3ca => generated 0 bytes in 1555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:51:23.221519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-30f21cd7-8b46-49a2-836d-2af9a26d6817 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:23.222259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-30f21cd7-8b46-49a2-836d-2af9a26d6817 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:23.242128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30f21cd7-8b46-49a2-836d-2af9a26d6817 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:23.243637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30f21cd7-8b46-49a2-836d-2af9a26d6817 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:23.244653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30f21cd7-8b46-49a2-836d-2af9a26d6817 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:23.245881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30f21cd7-8b46-49a2-836d-2af9a26d6817 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:23.246747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30f21cd7-8b46-49a2-836d-2af9a26d6817 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:23.247479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30f21cd7-8b46-49a2-836d-2af9a26d6817 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:23.469120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-30f21cd7-8b46-49a2-836d-2af9a26d6817 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:23.487511 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-30f21cd7-8b46-49a2-836d-2af9a26d6817 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1270 microversion: 2.1 time: 0.269903 Oct 27 18:51:23.490707 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 748/1540] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:23 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1270 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:23.508809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-0eb466b4-6c22-4450-8343-f6fd5808caef req-be9066c0-60f7-4afb-89a1-b81b162c24c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "088955af-fa5c-4217-a66f-fd72d3eed8e8", "name": "network-vif-plugged", "status": "completed", "tag": "a844e32b-cd78-4d1f-9193-137b08f7908f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:23.536298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0eb466b4-6c22-4450-8343-f6fd5808caef req-be9066c0-60f7-4afb-89a1-b81b162c24c6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:23.537421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0eb466b4-6c22-4450-8343-f6fd5808caef req-be9066c0-60f7-4afb-89a1-b81b162c24c6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:23.537963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0eb466b4-6c22-4450-8343-f6fd5808caef req-be9066c0-60f7-4afb-89a1-b81b162c24c6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:23.580497 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-0eb466b4-6c22-4450-8343-f6fd5808caef req-be9066c0-60f7-4afb-89a1-b81b162c24c6 service nova] Creating event network-vif-plugged:a844e32b-cd78-4d1f-9193-137b08f7908f for instance 088955af-fa5c-4217-a66f-fd72d3eed8e8 on n-h2-860687-3 Oct 27 18:51:23.592544 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-0eb466b4-6c22-4450-8343-f6fd5808caef req-be9066c0-60f7-4afb-89a1-b81b162c24c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100144 Oct 27 18:51:23.608064 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 749/1541] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:23.613970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-23d9cbb3-45fb-4237-ae9f-23920a4c0cad tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:23.615102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-23d9cbb3-45fb-4237-ae9f-23920a4c0cad tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:23.635102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23d9cbb3-45fb-4237-ae9f-23920a4c0cad tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:23.643130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23d9cbb3-45fb-4237-ae9f-23920a4c0cad tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:23.643976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23d9cbb3-45fb-4237-ae9f-23920a4c0cad tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:23.645561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23d9cbb3-45fb-4237-ae9f-23920a4c0cad tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:23.650000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23d9cbb3-45fb-4237-ae9f-23920a4c0cad tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:23.654843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23d9cbb3-45fb-4237-ae9f-23920a4c0cad tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:23.765325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ccbb1a20-7f49-41d6-abbc-f32150449f4d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:23.780049 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ccbb1a20-7f49-41d6-abbc-f32150449f4d tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1511 microversion: 2.1 time: 0.790303 Oct 27 18:51:23.781376 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 793/1542] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:22 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1511 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:23.798428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-83e2a67a-6215-4292-b4c6-1fd0af75bf3c tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] Calling method '.version_select at 0x7fc86a984e50>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:24.021346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-23d9cbb3-45fb-4237-ae9f-23920a4c0cad tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3973c038bc34eb3b9cc1dfc2e0de5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80182bb9450487f93c270d199dac1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:24.037548 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-23d9cbb3-45fb-4237-ae9f-23920a4c0cad tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 200 len: 1324 microversion: 2.1 time: 0.427754 Oct 27 18:51:24.043034 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 750/1543] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:23 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 1324 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:24.053937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f3c1cd9f-0bc6-4ef8-83a4-37990c26475b req-002d01f9-707c-4652-943c-ac7b9a992d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8293a368-36ca-4f0c-89b2-8c9f8cd4d83f", "name": "network-vif-unplugged", "status": "completed", "tag": "ef76078a-4991-4a34-a8cf-984da56b97d3"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:24.084057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f3c1cd9f-0bc6-4ef8-83a4-37990c26475b req-002d01f9-707c-4652-943c-ac7b9a992d95 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:24.084599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f3c1cd9f-0bc6-4ef8-83a4-37990c26475b req-002d01f9-707c-4652-943c-ac7b9a992d95 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:24.085026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f3c1cd9f-0bc6-4ef8-83a4-37990c26475b req-002d01f9-707c-4652-943c-ac7b9a992d95 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:24.112475 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f3c1cd9f-0bc6-4ef8-83a4-37990c26475b req-002d01f9-707c-4652-943c-ac7b9a992d95 service nova] Creating event network-vif-unplugged:ef76078a-4991-4a34-a8cf-984da56b97d3 for instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f on n-h2-860687-3 Oct 27 18:51:24.133631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-f3c1cd9f-0bc6-4ef8-83a4-37990c26475b req-002d01f9-707c-4652-943c-ac7b9a992d95 service nova] Instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:51:24.168836 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f3c1cd9f-0bc6-4ef8-83a4-37990c26475b req-002d01f9-707c-4652-943c-ac7b9a992d95 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122617 Oct 27 18:51:24.169957 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 751/1544] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:24.184178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a19029e1-e0ed-427a-bb9c-07df2cefba56 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:24.184901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a19029e1-e0ed-427a-bb9c-07df2cefba56 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: b93639af-67fe-4725-9626-ed881eef60ba] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:24.213615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a19029e1-e0ed-427a-bb9c-07df2cefba56 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:24.214583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a19029e1-e0ed-427a-bb9c-07df2cefba56 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:24.214976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a19029e1-e0ed-427a-bb9c-07df2cefba56 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:24.215870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a19029e1-e0ed-427a-bb9c-07df2cefba56 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:24.217103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a19029e1-e0ed-427a-bb9c-07df2cefba56 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:24.217708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a19029e1-e0ed-427a-bb9c-07df2cefba56 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:24.622725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a19029e1-e0ed-427a-bb9c-07df2cefba56 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:24.634070 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a19029e1-e0ed-427a-bb9c-07df2cefba56 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba" status: 200 len: 1512 microversion: 2.1 time: 0.462317 Oct 27 18:51:24.635445 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 752/1545] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:24 2022] GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba => generated 1512 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:24.640730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-562dca54-4b5f-4e8e-ae89-1accf233eb47 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:24.641521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-562dca54-4b5f-4e8e-ae89-1accf233eb47 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:24.650291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-562dca54-4b5f-4e8e-ae89-1accf233eb47 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:24.651086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-562dca54-4b5f-4e8e-ae89-1accf233eb47 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:24.651716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-562dca54-4b5f-4e8e-ae89-1accf233eb47 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:24.652613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-562dca54-4b5f-4e8e-ae89-1accf233eb47 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:24.654346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-562dca54-4b5f-4e8e-ae89-1accf233eb47 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:24.654975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-562dca54-4b5f-4e8e-ae89-1accf233eb47 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:24.890000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-562dca54-4b5f-4e8e-ae89-1accf233eb47 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:24.902621 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-562dca54-4b5f-4e8e-ae89-1accf233eb47 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1476 microversion: 2.1 time: 0.265717 Oct 27 18:51:24.905268 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 753/1546] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:24 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1476 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:24.919078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e3f65e4f-bb7b-4784-b654-ad80511ab0c0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:24.920043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e3f65e4f-bb7b-4784-b654-ad80511ab0c0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:24.932982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3f65e4f-bb7b-4784-b654-ad80511ab0c0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:24.934806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3f65e4f-bb7b-4784-b654-ad80511ab0c0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:24.938597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3f65e4f-bb7b-4784-b654-ad80511ab0c0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:24.939647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3f65e4f-bb7b-4784-b654-ad80511ab0c0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:24.940348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3f65e4f-bb7b-4784-b654-ad80511ab0c0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:24.941011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3f65e4f-bb7b-4784-b654-ad80511ab0c0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:25.247655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e3f65e4f-bb7b-4784-b654-ad80511ab0c0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:25.256348 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e3f65e4f-bb7b-4784-b654-ad80511ab0c0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1312 microversion: 2.1 time: 0.349742 Oct 27 18:51:25.256940 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 754/1547] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:24 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1312 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:25.296505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8922a706-f801-4682-a822-1ebf5499b000 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:25.307623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8922a706-f801-4682-a822-1ebf5499b000 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:25.323040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8922a706-f801-4682-a822-1ebf5499b000 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:25.324705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8922a706-f801-4682-a822-1ebf5499b000 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:25.325765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8922a706-f801-4682-a822-1ebf5499b000 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:25.326789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8922a706-f801-4682-a822-1ebf5499b000 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:25.327257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8922a706-f801-4682-a822-1ebf5499b000 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:25.327690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8922a706-f801-4682-a822-1ebf5499b000 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:25.589953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8922a706-f801-4682-a822-1ebf5499b000 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:25.598757 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8922a706-f801-4682-a822-1ebf5499b000 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1511 microversion: 2.1 time: 0.305875 Oct 27 18:51:25.603264 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 755/1548] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:25 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:25.608691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-df44cddb-321a-4c74-90c6-37b890873358 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:25.609722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-df44cddb-321a-4c74-90c6-37b890873358 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:25.625617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df44cddb-321a-4c74-90c6-37b890873358 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:25.626587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df44cddb-321a-4c74-90c6-37b890873358 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:25.629937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df44cddb-321a-4c74-90c6-37b890873358 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:25.630939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df44cddb-321a-4c74-90c6-37b890873358 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:25.631702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df44cddb-321a-4c74-90c6-37b890873358 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:25.632271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df44cddb-321a-4c74-90c6-37b890873358 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:25.903006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-df44cddb-321a-4c74-90c6-37b890873358 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3973c038bc34eb3b9cc1dfc2e0de5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80182bb9450487f93c270d199dac1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:25.919062 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-df44cddb-321a-4c74-90c6-37b890873358 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 200 len: 1324 microversion: 2.1 time: 0.314158 Oct 27 18:51:25.937121 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 756/1549] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:25 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 1324 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:25.945232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:25.951559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:25.952451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:51:25.960487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:25.963335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:25.964475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:25.965485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:25.966233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:25.966998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:26.048063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:51:26.152880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:26.172530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:26.173313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:26.173924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:26.263875 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-83e2a67a-6215-4292-b4c6-1fd0af75bf3c tempest-FloatingIPDetailsTestJSON-2106896332 tempest-FloatingIPDetailsTestJSON-2106896332-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/b8e22c3a-952a-4d70-8f55-56b66084508c" status: 202 len: 0 microversion: 2.1 time: 2.481068 Oct 27 18:51:26.269901 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 794/1550] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 18:51:23 2022] DELETE /compute/v2.1/os-floating-ips/b8e22c3a-952a-4d70-8f55-56b66084508c => generated 0 bytes in 2487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:51:26.278234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-69843984-9428-4f18-880e-cad8d96b59b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:26.282216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-69843984-9428-4f18-880e-cad8d96b59b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:26.293342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69843984-9428-4f18-880e-cad8d96b59b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:26.294364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69843984-9428-4f18-880e-cad8d96b59b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:26.295229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69843984-9428-4f18-880e-cad8d96b59b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:26.296434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69843984-9428-4f18-880e-cad8d96b59b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:26.297048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69843984-9428-4f18-880e-cad8d96b59b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:26.297729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69843984-9428-4f18-880e-cad8d96b59b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:26.527852 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ef268d61-c86a-4c46-a668-52250efc4dc7 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.588869 Oct 27 18:51:26.529477 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 757/1551] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:51:25 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:26.575561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-bbc50829-a873-4359-9a0e-d7fc5bcb1f26 req-cb51070b-d114-4f47-aaa5-e3e8b1a83649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8293a368-36ca-4f0c-89b2-8c9f8cd4d83f", "tag": "ef76078a-4991-4a34-a8cf-984da56b97d3"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:26.590730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bbc50829-a873-4359-9a0e-d7fc5bcb1f26 req-cb51070b-d114-4f47-aaa5-e3e8b1a83649 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:26.591267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bbc50829-a873-4359-9a0e-d7fc5bcb1f26 req-cb51070b-d114-4f47-aaa5-e3e8b1a83649 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:26.591734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bbc50829-a873-4359-9a0e-d7fc5bcb1f26 req-cb51070b-d114-4f47-aaa5-e3e8b1a83649 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:26.606794 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-bbc50829-a873-4359-9a0e-d7fc5bcb1f26 req-cb51070b-d114-4f47-aaa5-e3e8b1a83649 service nova] Creating event network-changed:ef76078a-4991-4a34-a8cf-984da56b97d3 for instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f on n-h2-860687-3 Oct 27 18:51:26.613229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-bbc50829-a873-4359-9a0e-d7fc5bcb1f26 req-cb51070b-d114-4f47-aaa5-e3e8b1a83649 service nova] Instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:51:26.629561 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-bbc50829-a873-4359-9a0e-d7fc5bcb1f26 req-cb51070b-d114-4f47-aaa5-e3e8b1a83649 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062438 Oct 27 18:51:26.643275 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 758/1552] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:26.665756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-48d82e3b-790e-45ad-8aa2-edefe4c9370f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:26.666832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-48d82e3b-790e-45ad-8aa2-edefe4c9370f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:26.684886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48d82e3b-790e-45ad-8aa2-edefe4c9370f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:26.688067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48d82e3b-790e-45ad-8aa2-edefe4c9370f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:26.688854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48d82e3b-790e-45ad-8aa2-edefe4c9370f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:26.690666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48d82e3b-790e-45ad-8aa2-edefe4c9370f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:26.694156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48d82e3b-790e-45ad-8aa2-edefe4c9370f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:26.695798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48d82e3b-790e-45ad-8aa2-edefe4c9370f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:26.731736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:27.068986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-48d82e3b-790e-45ad-8aa2-edefe4c9370f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:27.086854 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-48d82e3b-790e-45ad-8aa2-edefe4c9370f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1333 microversion: 2.1 time: 0.439242 Oct 27 18:51:27.090612 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 759/1553] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:26 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1333 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:27.097386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-981659930", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "339d213d-d58f-44f1-aeaf-54d635220475"}], "block_device_mapping_v2": [{"uuid": "ff33940f-d460-458c-abdc-9c466067060d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:27.178962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] validate_networks() for [('339d213d-d58f-44f1-aeaf-54d635220475', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:51:27.386834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-69843984-9428-4f18-880e-cad8d96b59b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:27.396217 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-69843984-9428-4f18-880e-cad8d96b59b0 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1476 microversion: 2.1 time: 1.125118 Oct 27 18:51:27.397103 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 795/1554] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:26 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1476 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:27.403624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fa95648d-44de-4f50-8dc0-81d3795999c6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:27.409878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fa95648d-44de-4f50-8dc0-81d3795999c6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:27.410973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fa95648d-44de-4f50-8dc0-81d3795999c6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:51:27.567846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa95648d-44de-4f50-8dc0-81d3795999c6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:27.568377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa95648d-44de-4f50-8dc0-81d3795999c6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:27.569068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa95648d-44de-4f50-8dc0-81d3795999c6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:27.569959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa95648d-44de-4f50-8dc0-81d3795999c6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:27.570473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa95648d-44de-4f50-8dc0-81d3795999c6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:27.571590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa95648d-44de-4f50-8dc0-81d3795999c6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:27.609510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-fa95648d-44de-4f50-8dc0-81d3795999c6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:51:27.644683 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fa95648d-44de-4f50-8dc0-81d3795999c6 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.245340 Oct 27 18:51:27.645520 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 796/1555] 10.222.0.42 () {58 vars in 1150 bytes} [Thu Oct 27 18:51:27 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:27.651238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e89320fd-b834-423b-a7e9-df68cfe30e5b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:27.652058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e89320fd-b834-423b-a7e9-df68cfe30e5b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:27.658588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e89320fd-b834-423b-a7e9-df68cfe30e5b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:27.659320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e89320fd-b834-423b-a7e9-df68cfe30e5b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:27.659942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e89320fd-b834-423b-a7e9-df68cfe30e5b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:27.661350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e89320fd-b834-423b-a7e9-df68cfe30e5b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:27.661969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e89320fd-b834-423b-a7e9-df68cfe30e5b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:27.662645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e89320fd-b834-423b-a7e9-df68cfe30e5b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:27.747499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:51:27.748053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:51:27.748429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:51:27.748848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:51:27.749363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:51:27.760186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:27.760962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:27.761495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:27.762609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:27.763313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:27.763999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:27.782285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Getting quotas for project a1c89e4b67024f91ae460e3ae3278277. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:51:27.786625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Getting quotas for user c73a9daf485b421c8244f287fee5a942 and project a1c89e4b67024f91ae460e3ae3278277. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:51:27.853030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:51:27.855590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff33940f-d460-458c-abdc-9c466067060d',volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:51:27.991315 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-251b70c5-cdb3-4682-bfd0-332a232b0cd1 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.899311 Oct 27 18:51:27.998467 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 760/1556] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 18:51:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 18:51:27.998467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8280ae22-9eb9-4a0f-8862-6f708f9d80a5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:28.002896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8280ae22-9eb9-4a0f-8862-6f708f9d80a5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:28.004319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8280ae22-9eb9-4a0f-8862-6f708f9d80a5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:51:28.012933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8280ae22-9eb9-4a0f-8862-6f708f9d80a5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.013948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8280ae22-9eb9-4a0f-8862-6f708f9d80a5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.014942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8280ae22-9eb9-4a0f-8862-6f708f9d80a5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.016036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8280ae22-9eb9-4a0f-8862-6f708f9d80a5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.016761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8280ae22-9eb9-4a0f-8862-6f708f9d80a5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.017400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8280ae22-9eb9-4a0f-8862-6f708f9d80a5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.114584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-8280ae22-9eb9-4a0f-8862-6f708f9d80a5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:51:28.120887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e89320fd-b834-423b-a7e9-df68cfe30e5b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3973c038bc34eb3b9cc1dfc2e0de5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80182bb9450487f93c270d199dac1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:28.132662 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e89320fd-b834-423b-a7e9-df68cfe30e5b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 200 len: 1521 microversion: 2.1 time: 0.485760 Oct 27 18:51:28.147082 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 797/1557] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:27 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:28.161150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ee75563f-30c8-417b-ab33-80131ef5d070 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:28.162194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ee75563f-30c8-417b-ab33-80131ef5d070 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:28.186764 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8280ae22-9eb9-4a0f-8862-6f708f9d80a5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.193041 Oct 27 18:51:28.187960 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 761/1558] 10.222.0.42 () {58 vars in 1212 bytes} [Thu Oct 27 18:51:27 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:28.192484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-be0f7755-132b-4593-a53e-a8d75a0c4a72 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:28.194064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-be0f7755-132b-4593-a53e-a8d75a0c4a72 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:28.201490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be0f7755-132b-4593-a53e-a8d75a0c4a72 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.201998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be0f7755-132b-4593-a53e-a8d75a0c4a72 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.202869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be0f7755-132b-4593-a53e-a8d75a0c4a72 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.203568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be0f7755-132b-4593-a53e-a8d75a0c4a72 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.204247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be0f7755-132b-4593-a53e-a8d75a0c4a72 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.204459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be0f7755-132b-4593-a53e-a8d75a0c4a72 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.265849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ee75563f-30c8-417b-ab33-80131ef5d070 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:28.274765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ee75563f-30c8-417b-ab33-80131ef5d070 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:28.276516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ee75563f-30c8-417b-ab33-80131ef5d070 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:28.278013 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ee75563f-30c8-417b-ab33-80131ef5d070 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1103 microversion: 2.25 time: 0.122545 Oct 27 18:51:28.278901 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 798/1559] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:28 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1103 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:28.283801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b5f26e00-c3c9-416e-a26e-de08d7af57f1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:28.284417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b5f26e00-c3c9-416e-a26e-de08d7af57f1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:28.303016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5f26e00-c3c9-416e-a26e-de08d7af57f1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.303660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5f26e00-c3c9-416e-a26e-de08d7af57f1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.304211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5f26e00-c3c9-416e-a26e-de08d7af57f1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.305283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5f26e00-c3c9-416e-a26e-de08d7af57f1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.306034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5f26e00-c3c9-416e-a26e-de08d7af57f1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.306610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5f26e00-c3c9-416e-a26e-de08d7af57f1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.352213 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-b5f26e00-c3c9-416e-a26e-de08d7af57f1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] HTTP exception thrown: Instance is not a member of specified network Oct 27 18:51:28.362301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-be0f7755-132b-4593-a53e-a8d75a0c4a72 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b5f26e00-c3c9-416e-a26e-de08d7af57f1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Request method failure captured: Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8/ips/invalid HTTP/1.1 Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtMYcvLMjwR2HBuyLfxFTp4hCp7k3fDqi7wnxr2-EDbOPOmiw3S6KdU7puUdMlxMX74217vuHbMIhBD09pYVN0xJbVp67tHBEhk1q4HTPrhNLmnehlCHWOR51x95SuLbDWjBtJR54Sc0qFn_7fS1hsL9HYmMwdD0QSrkmQf7hW9TY2s Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: d80182bb9450487f93c270d199dac1d1 Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-269511798 Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d80182bb9450487f93c270d199dac1d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d80182bb9450487f93c270d199dac1d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d80182bb9450487f93c270d199dac1d1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d80182bb9450487f93c270d199dac1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-269511798 Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: d80182bb9450487f93c270d199dac1d1 Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-269511798 Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerAddressesNegativeTestJSON-269511798-project Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e3973c038bc34eb3b9cc1dfc2e0de5fe Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-269511798-project Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance is not a member of specified network Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'server_id': '088955af-fa5c-4217-a66f-fd72d3eed8e8', 'id': 'invalid'} Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 27 18:51:28.371076 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:28.375579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b5f26e00-c3c9-416e-a26e-de08d7af57f1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Returning 404 to user: Instance is not a member of specified network {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:51:28.375579 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b5f26e00-c3c9-416e-a26e-de08d7af57f1 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.094641 Oct 27 18:51:28.375774 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-be0f7755-132b-4593-a53e-a8d75a0c4a72 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1333 microversion: 2.1 time: 0.185416 Oct 27 18:51:28.376507 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 799/1560] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:51:28 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8/ips/invalid => generated 91 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:51:28.376787 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 762/1561] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:28 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1333 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:28.381422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e5d04b54-ed35-41e6-9eab-ea61d77b8f35 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:28.388042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e5d04b54-ed35-41e6-9eab-ea61d77b8f35 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:28.388708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e5d04b54-ed35-41e6-9eab-ea61d77b8f35 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:51:28.395433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5d04b54-ed35-41e6-9eab-ea61d77b8f35 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.396496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5d04b54-ed35-41e6-9eab-ea61d77b8f35 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.397233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5d04b54-ed35-41e6-9eab-ea61d77b8f35 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.398187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5d04b54-ed35-41e6-9eab-ea61d77b8f35 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.400008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5d04b54-ed35-41e6-9eab-ea61d77b8f35 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.400672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5d04b54-ed35-41e6-9eab-ea61d77b8f35 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.406821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cfa76974-2b0b-4e32-95aa-790d77331e36 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:28.407493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cfa76974-2b0b-4e32-95aa-790d77331e36 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Failed to fetch instance by id 999 {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 18:51:28.408112 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-cfa76974-2b0b-4e32-95aa-790d77331e36 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] HTTP exception thrown: Instance 999 could not be found. Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cfa76974-2b0b-4e32-95aa-790d77331e36 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Request method failure captured: Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtMYcvLMjwR2HBuyLfxFTp4hCp7k3fDqi7wnxr2-EDbOPOmiw3S6KdU7puUdMlxMX74217vuHbMIhBD09pYVN0xJbVp67tHBEhk1q4HTPrhNLmnehlCHWOR51x95SuLbDWjBtJR54Sc0qFn_7fS1hsL9HYmMwdD0QSrkmQf7hW9TY2s Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: d80182bb9450487f93c270d199dac1d1 Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-269511798 Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d80182bb9450487f93c270d199dac1d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d80182bb9450487f93c270d199dac1d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d80182bb9450487f93c270d199dac1d1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d80182bb9450487f93c270d199dac1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-269511798 Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: d80182bb9450487f93c270d199dac1d1 Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-269511798 Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerAddressesNegativeTestJSON-269511798-project Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e3973c038bc34eb3b9cc1dfc2e0de5fe Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-269511798-project Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 999 could not be found. Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'server_id': '999'} Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 27 18:51:28.410311 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:28.416777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cfa76974-2b0b-4e32-95aa-790d77331e36 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Returning 404 to user: Instance 999 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:51:28.416777 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cfa76974-2b0b-4e32-95aa-790d77331e36 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.010714 Oct 27 18:51:28.416777 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 763/1562] 10.222.0.42 () {58 vars in 1149 bytes} [Thu Oct 27 18:51:28 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 18:51:28.429245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-46635ec0-8367-4bb5-bb04-23f0321c01a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:28.432194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-46635ec0-8367-4bb5-bb04-23f0321c01a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:28.439885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46635ec0-8367-4bb5-bb04-23f0321c01a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.440502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46635ec0-8367-4bb5-bb04-23f0321c01a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.441146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46635ec0-8367-4bb5-bb04-23f0321c01a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.442196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46635ec0-8367-4bb5-bb04-23f0321c01a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.442894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46635ec0-8367-4bb5-bb04-23f0321c01a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.443531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46635ec0-8367-4bb5-bb04-23f0321c01a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.517227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-e5d04b54-ed35-41e6-9eab-ea61d77b8f35 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:51:28.587125 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e5d04b54-ed35-41e6-9eab-ea61d77b8f35 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.208799 Oct 27 18:51:28.587874 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 800/1563] 10.222.0.42 () {58 vars in 1196 bytes} [Thu Oct 27 18:51:28 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:28.592662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7ed957bf-64ad-4fea-a946-335bda1c334e tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:28.593164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7ed957bf-64ad-4fea-a946-335bda1c334e tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:28.599343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ed957bf-64ad-4fea-a946-335bda1c334e tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.600053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ed957bf-64ad-4fea-a946-335bda1c334e tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.600503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ed957bf-64ad-4fea-a946-335bda1c334e tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.601214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ed957bf-64ad-4fea-a946-335bda1c334e tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.601673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ed957bf-64ad-4fea-a946-335bda1c334e tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.602769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ed957bf-64ad-4fea-a946-335bda1c334e tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.629019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7ed957bf-64ad-4fea-a946-335bda1c334e tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:51:28.633704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-46635ec0-8367-4bb5-bb04-23f0321c01a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:28.643410 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-46635ec0-8367-4bb5-bb04-23f0321c01a5 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1474 microversion: 2.1 time: 0.223049 Oct 27 18:51:28.654968 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 764/1564] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:28 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1474 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:28.655730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:28.667155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-230a5cb9-d956-4e39-ad3f-94d7446b80f4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:28.672580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-230a5cb9-d956-4e39-ad3f-94d7446b80f4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:28.673262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-230a5cb9-d956-4e39-ad3f-94d7446b80f4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'name': '-308936606', 'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:51:28.678803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230a5cb9-d956-4e39-ad3f-94d7446b80f4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.681323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230a5cb9-d956-4e39-ad3f-94d7446b80f4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.681963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230a5cb9-d956-4e39-ad3f-94d7446b80f4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.682780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230a5cb9-d956-4e39-ad3f-94d7446b80f4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.683422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230a5cb9-d956-4e39-ad3f-94d7446b80f4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.683855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230a5cb9-d956-4e39-ad3f-94d7446b80f4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.721227 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7ed957bf-64ad-4fea-a946-335bda1c334e tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "DELETE /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 204 len: 0 microversion: 2.1 time: 0.131854 Oct 27 18:51:28.722212 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 801/1565] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:51:28 2022] DELETE /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:51:28.730805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1d6cde41-8386-4f91-883a-20971e790958 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:28.731615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1d6cde41-8386-4f91-883a-20971e790958 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:28.737941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d6cde41-8386-4f91-883a-20971e790958 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.738466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d6cde41-8386-4f91-883a-20971e790958 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.739207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d6cde41-8386-4f91-883a-20971e790958 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.739911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d6cde41-8386-4f91-883a-20971e790958 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.740369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d6cde41-8386-4f91-883a-20971e790958 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.740797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d6cde41-8386-4f91-883a-20971e790958 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.775102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-230a5cb9-d956-4e39-ad3f-94d7446b80f4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:51:28.837968 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-230a5cb9-d956-4e39-ad3f-94d7446b80f4 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers?name=-308936606" status: 200 len: 345 microversion: 2.1 time: 0.175333 Oct 27 18:51:28.838605 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 765/1566] 10.222.0.42 () {58 vars in 1156 bytes} [Thu Oct 27 18:51:28 2022] GET /compute/v2.1/servers?name=-308936606 => generated 345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:28.850782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-385d0f7b-a297-4398-ae00-89e4f0b49a74 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:28.856347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-385d0f7b-a297-4398-ae00-89e4f0b49a74 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:28.857025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-385d0f7b-a297-4398-ae00-89e4f0b49a74 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:51:28.862170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-385d0f7b-a297-4398-ae00-89e4f0b49a74 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.862699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-385d0f7b-a297-4398-ae00-89e4f0b49a74 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.863143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-385d0f7b-a297-4398-ae00-89e4f0b49a74 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.863877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-385d0f7b-a297-4398-ae00-89e4f0b49a74 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:28.864335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-385d0f7b-a297-4398-ae00-89e4f0b49a74 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:28.864766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-385d0f7b-a297-4398-ae00-89e4f0b49a74 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:28.951976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-385d0f7b-a297-4398-ae00-89e4f0b49a74 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:51:29.012369 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-385d0f7b-a297-4398-ae00-89e4f0b49a74 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.165147 Oct 27 18:51:29.013173 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 766/1567] 10.222.0.42 () {58 vars in 1154 bytes} [Thu Oct 27 18:51:28 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:51:29.025561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bb77b5a3-4e04-4b7a-a5b6-854f90750250 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:29.030704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bb77b5a3-4e04-4b7a-a5b6-854f90750250 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:29.031262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bb77b5a3-4e04-4b7a-a5b6-854f90750250 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-30893660', 'deleted': False, 'project_id': 'f95230f585d04c83885c8cd68f662e7a'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:51:29.036375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb77b5a3-4e04-4b7a-a5b6-854f90750250 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:29.036872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb77b5a3-4e04-4b7a-a5b6-854f90750250 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:29.037284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb77b5a3-4e04-4b7a-a5b6-854f90750250 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:29.038002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb77b5a3-4e04-4b7a-a5b6-854f90750250 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:29.038478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb77b5a3-4e04-4b7a-a5b6-854f90750250 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:29.038901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb77b5a3-4e04-4b7a-a5b6-854f90750250 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:29.129931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-bb77b5a3-4e04-4b7a-a5b6-854f90750250 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:51:29.195026 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bb77b5a3-4e04-4b7a-a5b6-854f90750250 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-30893660" status: 200 len: 345 microversion: 2.1 time: 0.173790 Oct 27 18:51:29.198444 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 767/1568] 10.222.0.42 () {58 vars in 1226 bytes} [Thu Oct 27 18:51:29 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-30893660 => generated 345 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:51:29.209643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cef52984-c63d-4470-9811-2b5baab6635e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:29.210175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cef52984-c63d-4470-9811-2b5baab6635e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:29.236838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cef52984-c63d-4470-9811-2b5baab6635e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:29.237341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cef52984-c63d-4470-9811-2b5baab6635e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:29.237791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cef52984-c63d-4470-9811-2b5baab6635e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:29.238783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cef52984-c63d-4470-9811-2b5baab6635e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:29.239559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cef52984-c63d-4470-9811-2b5baab6635e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:29.240381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cef52984-c63d-4470-9811-2b5baab6635e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:29.272507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1d6cde41-8386-4f91-883a-20971e790958 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3973c038bc34eb3b9cc1dfc2e0de5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80182bb9450487f93c270d199dac1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:29.281229 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1d6cde41-8386-4f91-883a-20971e790958 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 200 len: 1527 microversion: 2.1 time: 0.554943 Oct 27 18:51:29.305197 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 802/1569] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:28 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 1527 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:51:29.306784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cef52984-c63d-4470-9811-2b5baab6635e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:51:29.310144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-18c0d907-eb00-43db-a6b1-dd6ac5f4b8fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:29.313660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-18c0d907-eb00-43db-a6b1-dd6ac5f4b8fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:29.321461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c0d907-eb00-43db-a6b1-dd6ac5f4b8fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:29.322676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c0d907-eb00-43db-a6b1-dd6ac5f4b8fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:29.323349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c0d907-eb00-43db-a6b1-dd6ac5f4b8fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:29.324288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c0d907-eb00-43db-a6b1-dd6ac5f4b8fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:29.324960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c0d907-eb00-43db-a6b1-dd6ac5f4b8fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:29.326029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c0d907-eb00-43db-a6b1-dd6ac5f4b8fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:29.424753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-18c0d907-eb00-43db-a6b1-dd6ac5f4b8fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:29.444277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-18c0d907-eb00-43db-a6b1-dd6ac5f4b8fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:29.446514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-18c0d907-eb00-43db-a6b1-dd6ac5f4b8fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:29.447928 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-18c0d907-eb00-43db-a6b1-dd6ac5f4b8fa tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1184 microversion: 2.25 time: 0.141655 Oct 27 18:51:29.448774 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 803/1570] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:29 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1184 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:29.453537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-11ba6507-e920-43a6-9d99-f923baafc926 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:29.459679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-11ba6507-e920-43a6-9d99-f923baafc926 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:29.475813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11ba6507-e920-43a6-9d99-f923baafc926 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:29.478206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11ba6507-e920-43a6-9d99-f923baafc926 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:29.479037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11ba6507-e920-43a6-9d99-f923baafc926 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:29.480056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11ba6507-e920-43a6-9d99-f923baafc926 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:29.480751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11ba6507-e920-43a6-9d99-f923baafc926 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:29.481435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11ba6507-e920-43a6-9d99-f923baafc926 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:29.535262 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cef52984-c63d-4470-9811-2b5baab6635e tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 204 len: 0 microversion: 2.1 time: 0.328692 Oct 27 18:51:29.540038 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 768/1571] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:51:29 2022] DELETE /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 18:51:29.547361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7c8e0a10-0346-4d5d-9cd4-3999ad98b1d2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:29.548435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7c8e0a10-0346-4d5d-9cd4-3999ad98b1d2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:29.562097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8e0a10-0346-4d5d-9cd4-3999ad98b1d2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:29.562996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8e0a10-0346-4d5d-9cd4-3999ad98b1d2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:29.563654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8e0a10-0346-4d5d-9cd4-3999ad98b1d2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:29.564631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8e0a10-0346-4d5d-9cd4-3999ad98b1d2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:29.565364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8e0a10-0346-4d5d-9cd4-3999ad98b1d2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:29.566098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8e0a10-0346-4d5d-9cd4-3999ad98b1d2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:29.822900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7c8e0a10-0346-4d5d-9cd4-3999ad98b1d2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:29.835528 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7c8e0a10-0346-4d5d-9cd4-3999ad98b1d2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1517 microversion: 2.1 time: 0.293351 Oct 27 18:51:29.836786 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 769/1572] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:29 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1517 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:29.851440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0b9951a3-5292-48d3-9d7a-e46a366457b1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:29.855192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0b9951a3-5292-48d3-9d7a-e46a366457b1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:29.859034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-11ba6507-e920-43a6-9d99-f923baafc926 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:29.863864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b9951a3-5292-48d3-9d7a-e46a366457b1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:29.865302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b9951a3-5292-48d3-9d7a-e46a366457b1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:29.866002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b9951a3-5292-48d3-9d7a-e46a366457b1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:29.866885 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-11ba6507-e920-43a6-9d99-f923baafc926 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 0.416815 Oct 27 18:51:29.867276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b9951a3-5292-48d3-9d7a-e46a366457b1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:29.868222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b9951a3-5292-48d3-9d7a-e46a366457b1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:29.869435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b9951a3-5292-48d3-9d7a-e46a366457b1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:29.870738 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 804/1573] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:29 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:30.184208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0b9951a3-5292-48d3-9d7a-e46a366457b1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:30.199260 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0b9951a3-5292-48d3-9d7a-e46a366457b1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1474 microversion: 2.1 time: 0.359871 Oct 27 18:51:30.213228 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 770/1574] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:29 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:30.322841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-342b86a2-b16a-4cde-a372-8788bd906a9c tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:30.324349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-342b86a2-b16a-4cde-a372-8788bd906a9c tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:30.334561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-342b86a2-b16a-4cde-a372-8788bd906a9c tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:30.337824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-342b86a2-b16a-4cde-a372-8788bd906a9c tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:30.339933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-342b86a2-b16a-4cde-a372-8788bd906a9c tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:30.341375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-342b86a2-b16a-4cde-a372-8788bd906a9c tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:30.342215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-342b86a2-b16a-4cde-a372-8788bd906a9c tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:30.343143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-342b86a2-b16a-4cde-a372-8788bd906a9c tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:30.489268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7926fed-9550-4daa-b807-043ed9779842 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:30.493460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7926fed-9550-4daa-b807-043ed9779842 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:30.524311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7926fed-9550-4daa-b807-043ed9779842 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:30.524960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7926fed-9550-4daa-b807-043ed9779842 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:30.527018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7926fed-9550-4daa-b807-043ed9779842 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:30.527838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7926fed-9550-4daa-b807-043ed9779842 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:30.528520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7926fed-9550-4daa-b807-043ed9779842 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:30.529358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7926fed-9550-4daa-b807-043ed9779842 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:30.698042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7926fed-9550-4daa-b807-043ed9779842 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:30.730136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7926fed-9550-4daa-b807-043ed9779842 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:30.736049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7926fed-9550-4daa-b807-043ed9779842 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:30.737372 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7926fed-9550-4daa-b807-043ed9779842 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1184 microversion: 2.25 time: 0.258770 Oct 27 18:51:30.758801 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 771/1575] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:30 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1184 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:30.793053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-342b86a2-b16a-4cde-a372-8788bd906a9c tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3973c038bc34eb3b9cc1dfc2e0de5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80182bb9450487f93c270d199dac1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:30.803127 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-342b86a2-b16a-4cde-a372-8788bd906a9c tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 200 len: 1527 microversion: 2.1 time: 0.485796 Oct 27 18:51:30.804320 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 805/1576] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:30 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 1527 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:30.860160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf594bb9-a533-43c0-8cd9-1bb2eb786386 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:30.860811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf594bb9-a533-43c0-8cd9-1bb2eb786386 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:30.867056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf594bb9-a533-43c0-8cd9-1bb2eb786386 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:30.867721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf594bb9-a533-43c0-8cd9-1bb2eb786386 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:30.868001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf594bb9-a533-43c0-8cd9-1bb2eb786386 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:30.868803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf594bb9-a533-43c0-8cd9-1bb2eb786386 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:30.869475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf594bb9-a533-43c0-8cd9-1bb2eb786386 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:30.869910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf594bb9-a533-43c0-8cd9-1bb2eb786386 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:30.895277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-38128419-e9dd-410d-a437-751fefa135b3 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:30.895900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-38128419-e9dd-410d-a437-751fefa135b3 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:30.907197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38128419-e9dd-410d-a437-751fefa135b3 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:30.907918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38128419-e9dd-410d-a437-751fefa135b3 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:30.908579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38128419-e9dd-410d-a437-751fefa135b3 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:30.910179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38128419-e9dd-410d-a437-751fefa135b3 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:30.911960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38128419-e9dd-410d-a437-751fefa135b3 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:30.915640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38128419-e9dd-410d-a437-751fefa135b3 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:31.159863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf594bb9-a533-43c0-8cd9-1bb2eb786386 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:31.170768 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf594bb9-a533-43c0-8cd9-1bb2eb786386 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1517 microversion: 2.1 time: 0.314347 Oct 27 18:51:31.173855 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 772/1577] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:30 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1517 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:31.224346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7fc1ad72-7cfa-45ac-a7cb-af06575e6b41 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:31.224974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7fc1ad72-7cfa-45ac-a7cb-af06575e6b41 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:31.233885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc1ad72-7cfa-45ac-a7cb-af06575e6b41 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:31.234467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc1ad72-7cfa-45ac-a7cb-af06575e6b41 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:31.234888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc1ad72-7cfa-45ac-a7cb-af06575e6b41 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:31.235637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc1ad72-7cfa-45ac-a7cb-af06575e6b41 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:31.236155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc1ad72-7cfa-45ac-a7cb-af06575e6b41 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:31.236603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc1ad72-7cfa-45ac-a7cb-af06575e6b41 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:31.690344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7fc1ad72-7cfa-45ac-a7cb-af06575e6b41 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:31.706788 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7fc1ad72-7cfa-45ac-a7cb-af06575e6b41 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1471 microversion: 2.1 time: 0.479021 Oct 27 18:51:31.707793 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 773/1578] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:31 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1471 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:51:31.734234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a4299b69-c4aa-4588-aa08-d233fdbaeed7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:31.735129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a4299b69-c4aa-4588-aa08-d233fdbaeed7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:31.751631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:31.753545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4299b69-c4aa-4588-aa08-d233fdbaeed7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:31.754506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4299b69-c4aa-4588-aa08-d233fdbaeed7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:31.755737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4299b69-c4aa-4588-aa08-d233fdbaeed7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:31.756897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4299b69-c4aa-4588-aa08-d233fdbaeed7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:31.757372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4299b69-c4aa-4588-aa08-d233fdbaeed7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:31.757814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4299b69-c4aa-4588-aa08-d233fdbaeed7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:31.812575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:31.933379 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a4299b69-c4aa-4588-aa08-d233fdbaeed7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "POST /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f/action" status: 202 len: 0 microversion: 2.1 time: 0.202772 Oct 27 18:51:31.934035 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 774/1579] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:51:31 2022] POST /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 18:51:31.942994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-59c84b43-3b42-4f58-8a5d-1acd0b95405d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:31.943769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-59c84b43-3b42-4f58-8a5d-1acd0b95405d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:31.952756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59c84b43-3b42-4f58-8a5d-1acd0b95405d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:31.953821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59c84b43-3b42-4f58-8a5d-1acd0b95405d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:31.954862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59c84b43-3b42-4f58-8a5d-1acd0b95405d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:31.955902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59c84b43-3b42-4f58-8a5d-1acd0b95405d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:31.956877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59c84b43-3b42-4f58-8a5d-1acd0b95405d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:31.957584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59c84b43-3b42-4f58-8a5d-1acd0b95405d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:32.122488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-38128419-e9dd-410d-a437-751fefa135b3 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:32.132302 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-38128419-e9dd-410d-a437-751fefa135b3 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 1.240809 Oct 27 18:51:32.134406 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 806/1580] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:30 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:51:32.141445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-860661b2-b5bb-400c-bd6a-1bdad44ed093 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:32.143491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-860661b2-b5bb-400c-bd6a-1bdad44ed093 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:32.151387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-860661b2-b5bb-400c-bd6a-1bdad44ed093 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:32.152200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-860661b2-b5bb-400c-bd6a-1bdad44ed093 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:32.152646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-860661b2-b5bb-400c-bd6a-1bdad44ed093 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:32.153562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-860661b2-b5bb-400c-bd6a-1bdad44ed093 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:32.153815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-860661b2-b5bb-400c-bd6a-1bdad44ed093 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:32.154250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-860661b2-b5bb-400c-bd6a-1bdad44ed093 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:32.475176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-59c84b43-3b42-4f58-8a5d-1acd0b95405d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:32.481194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-59c84b43-3b42-4f58-8a5d-1acd0b95405d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:32.486692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-59c84b43-3b42-4f58-8a5d-1acd0b95405d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:32.487923 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-59c84b43-3b42-4f58-8a5d-1acd0b95405d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1232 microversion: 2.25 time: 0.549609 Oct 27 18:51:32.491672 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 775/1581] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:31 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1232 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:32.497673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-970392ee-edfc-4beb-8a79-2c778d888035 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:32.515382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-970392ee-edfc-4beb-8a79-2c778d888035 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:32.522606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-970392ee-edfc-4beb-8a79-2c778d888035 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:32.523169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-970392ee-edfc-4beb-8a79-2c778d888035 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:32.524167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-970392ee-edfc-4beb-8a79-2c778d888035 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:32.525447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-970392ee-edfc-4beb-8a79-2c778d888035 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:32.525914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-970392ee-edfc-4beb-8a79-2c778d888035 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:32.526345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-970392ee-edfc-4beb-8a79-2c778d888035 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:32.551738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-860661b2-b5bb-400c-bd6a-1bdad44ed093 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3973c038bc34eb3b9cc1dfc2e0de5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80182bb9450487f93c270d199dac1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:32.575642 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-860661b2-b5bb-400c-bd6a-1bdad44ed093 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 200 len: 1527 microversion: 2.1 time: 0.438914 Oct 27 18:51:32.592680 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 807/1582] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:32 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 1527 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:32.608300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f1634d3e-7d7c-43d0-aa52-976f40dd2340 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:32.608978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f1634d3e-7d7c-43d0-aa52-976f40dd2340 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:32.620953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1634d3e-7d7c-43d0-aa52-976f40dd2340 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:32.621836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1634d3e-7d7c-43d0-aa52-976f40dd2340 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:32.622529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1634d3e-7d7c-43d0-aa52-976f40dd2340 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:32.623470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1634d3e-7d7c-43d0-aa52-976f40dd2340 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:32.624128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1634d3e-7d7c-43d0-aa52-976f40dd2340 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:32.624766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1634d3e-7d7c-43d0-aa52-976f40dd2340 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:33.243095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f1634d3e-7d7c-43d0-aa52-976f40dd2340 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:33.256190 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f1634d3e-7d7c-43d0-aa52-976f40dd2340 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1517 microversion: 2.1 time: 0.662332 Oct 27 18:51:33.257039 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 808/1583] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:32 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1517 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:33.266271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-8331545b-b2dc-4710-93d8-253a23422171 req-7a6e39a6-39c1-4922-854a-11f3af3dc266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "577c18dd-641c-4a06-a686-f98e0900c9ee", "tag": "c4cd9c5f-6c9c-475f-8375-20331b5dfdcf"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:33.292579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8331545b-b2dc-4710-93d8-253a23422171 req-7a6e39a6-39c1-4922-854a-11f3af3dc266 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:33.293660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8331545b-b2dc-4710-93d8-253a23422171 req-7a6e39a6-39c1-4922-854a-11f3af3dc266 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:33.296572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8331545b-b2dc-4710-93d8-253a23422171 req-7a6e39a6-39c1-4922-854a-11f3af3dc266 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:33.329812 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8331545b-b2dc-4710-93d8-253a23422171 req-7a6e39a6-39c1-4922-854a-11f3af3dc266 service nova] Creating event network-changed:c4cd9c5f-6c9c-475f-8375-20331b5dfdcf for instance 577c18dd-641c-4a06-a686-f98e0900c9ee on n-h1-860687-3 Oct 27 18:51:33.345403 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-8331545b-b2dc-4710-93d8-253a23422171 req-7a6e39a6-39c1-4922-854a-11f3af3dc266 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086704 Oct 27 18:51:33.349815 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 809/1584] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:33.384515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a173e9d4-ea1f-4d7b-a7c3-f2a7c55ddbba req-248e9962-6e50-4bb1-8671-590c92ae30e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8293a368-36ca-4f0c-89b2-8c9f8cd4d83f", "name": "network-vif-plugged", "status": "completed", "tag": "ef76078a-4991-4a34-a8cf-984da56b97d3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:33.425081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a173e9d4-ea1f-4d7b-a7c3-f2a7c55ddbba req-248e9962-6e50-4bb1-8671-590c92ae30e8 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:33.433606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a173e9d4-ea1f-4d7b-a7c3-f2a7c55ddbba req-248e9962-6e50-4bb1-8671-590c92ae30e8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:33.434486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a173e9d4-ea1f-4d7b-a7c3-f2a7c55ddbba req-248e9962-6e50-4bb1-8671-590c92ae30e8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:33.460259 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a173e9d4-ea1f-4d7b-a7c3-f2a7c55ddbba req-248e9962-6e50-4bb1-8671-590c92ae30e8 service nova] Creating event network-vif-plugged:ef76078a-4991-4a34-a8cf-984da56b97d3 for instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f on n-h2-860687-3 Oct 27 18:51:33.480849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-a173e9d4-ea1f-4d7b-a7c3-f2a7c55ddbba req-248e9962-6e50-4bb1-8671-590c92ae30e8 service nova] Instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:51:33.522679 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a173e9d4-ea1f-4d7b-a7c3-f2a7c55ddbba req-248e9962-6e50-4bb1-8671-590c92ae30e8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163460 Oct 27 18:51:33.524869 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 810/1585] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:33.534613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-970392ee-edfc-4beb-8a79-2c778d888035 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:33.543080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0f7d5357-e14c-4a22-a46e-964aa6030c7a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:33.543941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0f7d5357-e14c-4a22-a46e-964aa6030c7a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:33.552311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f7d5357-e14c-4a22-a46e-964aa6030c7a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:33.553082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f7d5357-e14c-4a22-a46e-964aa6030c7a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:33.553873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f7d5357-e14c-4a22-a46e-964aa6030c7a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:33.554012 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-970392ee-edfc-4beb-8a79-2c778d888035 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1470 microversion: 2.1 time: 1.059683 Oct 27 18:51:33.566427 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 776/1586] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:32 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1470 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:33.577509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f7d5357-e14c-4a22-a46e-964aa6030c7a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:33.588395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f7d5357-e14c-4a22-a46e-964aa6030c7a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:33.589466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f7d5357-e14c-4a22-a46e-964aa6030c7a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:34.107796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0ce0c5d3-6209-4684-ad4f-6be6e9419465 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:34.108379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0ce0c5d3-6209-4684-ad4f-6be6e9419465 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:34.122869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce0c5d3-6209-4684-ad4f-6be6e9419465 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:34.123684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce0c5d3-6209-4684-ad4f-6be6e9419465 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:34.124955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce0c5d3-6209-4684-ad4f-6be6e9419465 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:34.125905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce0c5d3-6209-4684-ad4f-6be6e9419465 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:34.127880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce0c5d3-6209-4684-ad4f-6be6e9419465 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:34.128797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce0c5d3-6209-4684-ad4f-6be6e9419465 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:34.276471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0ce0c5d3-6209-4684-ad4f-6be6e9419465 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:34.305366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0ce0c5d3-6209-4684-ad4f-6be6e9419465 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:34.308519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0ce0c5d3-6209-4684-ad4f-6be6e9419465 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:34.311763 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0ce0c5d3-6209-4684-ad4f-6be6e9419465 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1250 microversion: 2.25 time: 0.754715 Oct 27 18:51:34.315522 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 777/1587] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:33 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1250 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:34.340028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ffe85032-609c-4e2b-a1f6-d72daab31ed6 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:34.343367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0f7d5357-e14c-4a22-a46e-964aa6030c7a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:34.347621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ffe85032-609c-4e2b-a1f6-d72daab31ed6 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:34.360644 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0f7d5357-e14c-4a22-a46e-964aa6030c7a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 0.833176 Oct 27 18:51:34.361332 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 811/1588] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:33 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:34.365962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-78d41b5a-b544-4a28-bdbb-1d2199c06746 req-7a5b6475-a629-40cb-b59b-f7cf7ede993a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55fa833-3cfc-43e2-add7-7e36b04a7316", "name": "network-vif-deleted", "tag": "e993fcc5-3b19-4eed-a4aa-58d5f76965f7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:34.382244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffe85032-609c-4e2b-a1f6-d72daab31ed6 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:34.383656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffe85032-609c-4e2b-a1f6-d72daab31ed6 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:34.384328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffe85032-609c-4e2b-a1f6-d72daab31ed6 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:34.385981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffe85032-609c-4e2b-a1f6-d72daab31ed6 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:34.387196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffe85032-609c-4e2b-a1f6-d72daab31ed6 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:34.387999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffe85032-609c-4e2b-a1f6-d72daab31ed6 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:34.410790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-78d41b5a-b544-4a28-bdbb-1d2199c06746 req-7a5b6475-a629-40cb-b59b-f7cf7ede993a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:34.411119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-78d41b5a-b544-4a28-bdbb-1d2199c06746 req-7a5b6475-a629-40cb-b59b-f7cf7ede993a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:34.411570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-78d41b5a-b544-4a28-bdbb-1d2199c06746 req-7a5b6475-a629-40cb-b59b-f7cf7ede993a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:34.470658 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-78d41b5a-b544-4a28-bdbb-1d2199c06746 req-7a5b6475-a629-40cb-b59b-f7cf7ede993a service nova] Creating event network-vif-deleted:e993fcc5-3b19-4eed-a4aa-58d5f76965f7 for instance e55fa833-3cfc-43e2-add7-7e36b04a7316 on n-h1-860687-3 Oct 27 18:51:34.485595 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-78d41b5a-b544-4a28-bdbb-1d2199c06746 req-7a5b6475-a629-40cb-b59b-f7cf7ede993a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122902 Oct 27 18:51:34.487800 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 812/1589] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:34.489409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffe85032-609c-4e2b-a1f6-d72daab31ed6 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:34.489913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffe85032-609c-4e2b-a1f6-d72daab31ed6 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:34.492021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffe85032-609c-4e2b-a1f6-d72daab31ed6 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:34.494423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-ffe85032-609c-4e2b-a1f6-d72daab31ed6 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lazy-loading 'fault' on Instance uuid 088955af-fa5c-4217-a66f-fd72d3eed8e8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:51:34.501509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0c31f502-b386-4ae0-a084-58e54a3a4e27 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:34.502473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0c31f502-b386-4ae0-a084-58e54a3a4e27 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:34.513490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c31f502-b386-4ae0-a084-58e54a3a4e27 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:34.524970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c31f502-b386-4ae0-a084-58e54a3a4e27 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:34.525577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c31f502-b386-4ae0-a084-58e54a3a4e27 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:34.526688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c31f502-b386-4ae0-a084-58e54a3a4e27 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:34.527400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c31f502-b386-4ae0-a084-58e54a3a4e27 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:34.528070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c31f502-b386-4ae0-a084-58e54a3a4e27 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:34.595852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c31f502-b386-4ae0-a084-58e54a3a4e27 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:34.596475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c31f502-b386-4ae0-a084-58e54a3a4e27 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:34.597129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c31f502-b386-4ae0-a084-58e54a3a4e27 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:34.597704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-0c31f502-b386-4ae0-a084-58e54a3a4e27 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lazy-loading 'fault' on Instance uuid e55fa833-3cfc-43e2-add7-7e36b04a7316 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:51:34.739968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0c31f502-b386-4ae0-a084-58e54a3a4e27 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:34.749581 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0c31f502-b386-4ae0-a084-58e54a3a4e27 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 200 len: 1311 microversion: 2.1 time: 0.260277 Oct 27 18:51:34.754177 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 813/1590] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:34 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 1311 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:35.111568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ffe85032-609c-4e2b-a1f6-d72daab31ed6 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3973c038bc34eb3b9cc1dfc2e0de5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80182bb9450487f93c270d199dac1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:35.120936 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ffe85032-609c-4e2b-a1f6-d72daab31ed6 tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 200 len: 1314 microversion: 2.1 time: 0.803825 Oct 27 18:51:35.122436 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 778/1591] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:34 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 1314 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:35.247988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b0e7403c-addc-4d94-b558-d471fdfa8c5c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:35.248620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b0e7403c-addc-4d94-b558-d471fdfa8c5c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:35.260688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0e7403c-addc-4d94-b558-d471fdfa8c5c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:35.261296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0e7403c-addc-4d94-b558-d471fdfa8c5c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:35.261735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0e7403c-addc-4d94-b558-d471fdfa8c5c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:35.273226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0e7403c-addc-4d94-b558-d471fdfa8c5c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:35.274405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0e7403c-addc-4d94-b558-d471fdfa8c5c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:35.274884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0e7403c-addc-4d94-b558-d471fdfa8c5c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:35.343774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a950fb46-2860-411c-a7dd-798458d44974 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:35.344778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a950fb46-2860-411c-a7dd-798458d44974 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:35.355060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a950fb46-2860-411c-a7dd-798458d44974 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:35.355889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a950fb46-2860-411c-a7dd-798458d44974 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:35.357238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a950fb46-2860-411c-a7dd-798458d44974 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:35.358311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a950fb46-2860-411c-a7dd-798458d44974 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:35.363150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a950fb46-2860-411c-a7dd-798458d44974 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:35.363847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a950fb46-2860-411c-a7dd-798458d44974 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:35.580358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a950fb46-2860-411c-a7dd-798458d44974 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:35.595090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a950fb46-2860-411c-a7dd-798458d44974 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:35.598004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a950fb46-2860-411c-a7dd-798458d44974 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:35.599207 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a950fb46-2860-411c-a7dd-798458d44974 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1250 microversion: 2.25 time: 0.259573 Oct 27 18:51:35.608568 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 779/1592] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:35 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1250 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:35.615549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3a583868-c2e9-4684-95c1-13ea8e943cad tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:35.617659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3a583868-c2e9-4684-95c1-13ea8e943cad tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:35.627682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a583868-c2e9-4684-95c1-13ea8e943cad tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:35.628482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a583868-c2e9-4684-95c1-13ea8e943cad tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:35.629101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a583868-c2e9-4684-95c1-13ea8e943cad tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:35.631461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a583868-c2e9-4684-95c1-13ea8e943cad tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:35.632155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a583868-c2e9-4684-95c1-13ea8e943cad tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:35.632766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a583868-c2e9-4684-95c1-13ea8e943cad tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:35.674077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b0e7403c-addc-4d94-b558-d471fdfa8c5c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:35.683057 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b0e7403c-addc-4d94-b558-d471fdfa8c5c tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1470 microversion: 2.1 time: 0.927507 Oct 27 18:51:35.694134 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 814/1593] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:34 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1470 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:35.957313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a33948d-665f-4db2-aac3-fe444a341877 tempest-ListImageFiltersNegativeTestJSON-2141008107 tempest-ListImageFiltersNegativeTestJSON-2141008107-project] Calling method '.version_select at 0x7fc86a89a430>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:35.985317 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-8a33948d-665f-4db2-aac3-fe444a341877 tempest-ListImageFiltersNegativeTestJSON-2141008107 tempest-ListImageFiltersNegativeTestJSON-2141008107-project] HTTP exception thrown: Image not found. Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a33948d-665f-4db2-aac3-fe444a341877 tempest-ListImageFiltersNegativeTestJSON-2141008107 tempest-ListImageFiltersNegativeTestJSON-2141008107-project] Request method failure captured: Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/images/2bbd615f-36e7-4874-94a0-0b8766764a23 HTTP/1.1 Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtM3XrbqORGkf-CvLsu1mg6FElqZ3_t1krl_dTpxnEKb6Rvj_E-L-Vd5XXWCYZNqucA9P2NwMHGhrcvSoN4XS0ns3cb-M1zIp3C-afeWrIw6QFqF3-4q3MJpn7KLiqzWwTSeB1NVjaZPC6essjd45CF1x8M78ch7D0pjhzw7xDjJhEc Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 9a4e1ea7d31c466ca154ee521d5d6787 Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-2141008107 Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9a4e1ea7d31c466ca154ee521d5d6787"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9a4e1ea7d31c466ca154ee521d5d6787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9a4e1ea7d31c466ca154ee521d5d6787", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9a4e1ea7d31c466ca154ee521d5d6787"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-2141008107 Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 9a4e1ea7d31c466ca154ee521d5d6787 Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-2141008107 Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ListImageFiltersNegativeTestJSON-2141008107-project Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: d9b465dc3fd64973a9375a3818a9ddbe Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-2141008107-project Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: exception: Image not found. Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '2bbd615f-36e7-4874-94a0-0b8766764a23'} Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2bbd615f-36e7-4874-94a0-0b8766764a23 Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 18:51:35.989018 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2bbd615f-36e7-4874-94a0-0b8766764a23 could not be found. Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 18:51:35.996829 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:36.007343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a33948d-665f-4db2-aac3-fe444a341877 tempest-ListImageFiltersNegativeTestJSON-2141008107 tempest-ListImageFiltersNegativeTestJSON-2141008107-project] Returning 404 to user: Image not found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:51:36.008992 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8a33948d-665f-4db2-aac3-fe444a341877 tempest-ListImageFiltersNegativeTestJSON-2141008107 tempest-ListImageFiltersNegativeTestJSON-2141008107-project] 10.222.0.42 "GET /compute/v2.1/images/2bbd615f-36e7-4874-94a0-0b8766764a23" status: 404 len: 62 microversion: 2.1 time: 0.323745 Oct 27 18:51:36.013282 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 815/1594] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:51:35 2022] GET /compute/v2.1/images/2bbd615f-36e7-4874-94a0-0b8766764a23 => generated 62 bytes in 329 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:51:36.025988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-3bfc7ca5-5ddd-41ae-a063-105c11b1911c req-8eee33f4-9303-40ec-a904-5e6198f94128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "088955af-fa5c-4217-a66f-fd72d3eed8e8", "name": "network-vif-deleted", "tag": "a844e32b-cd78-4d1f-9193-137b08f7908f"}, {"name": "network-changed", "server_uuid": "577c18dd-641c-4a06-a686-f98e0900c9ee", "tag": "60560a38-c725-42df-bc29-3eae66f5de45"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:36.048000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3bfc7ca5-5ddd-41ae-a063-105c11b1911c req-8eee33f4-9303-40ec-a904-5e6198f94128 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:36.048938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3bfc7ca5-5ddd-41ae-a063-105c11b1911c req-8eee33f4-9303-40ec-a904-5e6198f94128 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:36.050007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3bfc7ca5-5ddd-41ae-a063-105c11b1911c req-8eee33f4-9303-40ec-a904-5e6198f94128 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:36.067926 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-3bfc7ca5-5ddd-41ae-a063-105c11b1911c req-8eee33f4-9303-40ec-a904-5e6198f94128 service nova] Creating event network-vif-deleted:a844e32b-cd78-4d1f-9193-137b08f7908f for instance 088955af-fa5c-4217-a66f-fd72d3eed8e8 on n-h2-860687-3 Oct 27 18:51:36.068834 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-3bfc7ca5-5ddd-41ae-a063-105c11b1911c req-8eee33f4-9303-40ec-a904-5e6198f94128 service nova] Creating event network-changed:60560a38-c725-42df-bc29-3eae66f5de45 for instance 577c18dd-641c-4a06-a686-f98e0900c9ee on n-h1-860687-3 Oct 27 18:51:36.079069 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-3bfc7ca5-5ddd-41ae-a063-105c11b1911c req-8eee33f4-9303-40ec-a904-5e6198f94128 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.064252 Oct 27 18:51:36.080349 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 816/1595] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:36.087869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b42daf30-1289-478c-8245-dbdb1ed3b724 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:36.101549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b42daf30-1289-478c-8245-dbdb1ed3b724 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: e55fa833-3cfc-43e2-add7-7e36b04a7316] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:36.110191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42daf30-1289-478c-8245-dbdb1ed3b724 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:36.110978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42daf30-1289-478c-8245-dbdb1ed3b724 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:36.111593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42daf30-1289-478c-8245-dbdb1ed3b724 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:36.112506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42daf30-1289-478c-8245-dbdb1ed3b724 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:36.113140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42daf30-1289-478c-8245-dbdb1ed3b724 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:36.114428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42daf30-1289-478c-8245-dbdb1ed3b724 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:36.122326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3a583868-c2e9-4684-95c1-13ea8e943cad tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:36.130020 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3a583868-c2e9-4684-95c1-13ea8e943cad tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 0.528254 Oct 27 18:51:36.132077 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-b42daf30-1289-478c-8245-dbdb1ed3b724 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] HTTP exception thrown: Instance e55fa833-3cfc-43e2-add7-7e36b04a7316 could not be found. Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b42daf30-1289-478c-8245-dbdb1ed3b724 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Request method failure captured: Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 HTTP/1.1 Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtLqjVSXsPB58N4wNFWqonwq5nwL41pozyloFng3APlb6xSvd0UFMSMH1jqzHElg9XYy8H3zbXaPKJp76QtIuAnKlV0Fb7uTrY9-9rnpXeHcC6SJfRje54Kbupk7vXLpCqGe2yuBsfUBrTOWwraC3eBypCX8SMvlhsjwRewG2Kqfbwo Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f95230f585d04c83885c8cd68f662e7a Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ListServerFiltersTestJSON-1410268660 Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f95230f585d04c83885c8cd68f662e7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f95230f585d04c83885c8cd68f662e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f95230f585d04c83885c8cd68f662e7a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f95230f585d04c83885c8cd68f662e7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ListServerFiltersTestJSON-1410268660 Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f95230f585d04c83885c8cd68f662e7a Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1410268660 Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ListServerFiltersTestJSON-1410268660-project Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ba01db4490774dbfb8196cb459c20dd3 Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ListServerFiltersTestJSON-1410268660-project Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance e55fa833-3cfc-43e2-add7-7e36b04a7316 could not be found. Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'e55fa833-3cfc-43e2-add7-7e36b04a7316'} Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e55fa833-3cfc-43e2-add7-7e36b04a7316 could not be found. Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e55fa833-3cfc-43e2-add7-7e36b04a7316 could not be found. Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:36.133823 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:36.138420 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:36.138420 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:36.138420 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:36.138420 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:51:36.138420 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:51:36.138420 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e55fa833-3cfc-43e2-add7-7e36b04a7316 could not be found. Oct 27 18:51:36.138420 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:36.141030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b42daf30-1289-478c-8245-dbdb1ed3b724 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Returning 404 to user: Instance e55fa833-3cfc-43e2-add7-7e36b04a7316 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:51:36.142123 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b42daf30-1289-478c-8245-dbdb1ed3b724 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316" status: 404 len: 111 microversion: 2.1 time: 0.060455 Oct 27 18:51:36.142913 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 817/1596] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:36 2022] GET /compute/v2.1/servers/e55fa833-3cfc-43e2-add7-7e36b04a7316 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:51:36.149502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b5d470a8-161a-4315-89bc-f0cd67dc287b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:36.149869 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 780/1597] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:35 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:36.150886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b5d470a8-161a-4315-89bc-f0cd67dc287b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] [instance: 088955af-fa5c-4217-a66f-fd72d3eed8e8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:36.154746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-db3bc209-8b13-4004-b5e3-645ddee6cc9b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:36.157914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:36.158715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-db3bc209-8b13-4004-b5e3-645ddee6cc9b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: b93639af-67fe-4725-9626-ed881eef60ba] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:36.159741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5d470a8-161a-4315-89bc-f0cd67dc287b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:36.160716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5d470a8-161a-4315-89bc-f0cd67dc287b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:36.161342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5d470a8-161a-4315-89bc-f0cd67dc287b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:36.162208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5d470a8-161a-4315-89bc-f0cd67dc287b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:36.163564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5d470a8-161a-4315-89bc-f0cd67dc287b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:36.164077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5d470a8-161a-4315-89bc-f0cd67dc287b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:36.174158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db3bc209-8b13-4004-b5e3-645ddee6cc9b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:36.174686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db3bc209-8b13-4004-b5e3-645ddee6cc9b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:36.175124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db3bc209-8b13-4004-b5e3-645ddee6cc9b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:36.175846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db3bc209-8b13-4004-b5e3-645ddee6cc9b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:36.176314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db3bc209-8b13-4004-b5e3-645ddee6cc9b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:36.176741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db3bc209-8b13-4004-b5e3-645ddee6cc9b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:36.183972 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-b5d470a8-161a-4315-89bc-f0cd67dc287b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] HTTP exception thrown: Instance 088955af-fa5c-4217-a66f-fd72d3eed8e8 could not be found. Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b5d470a8-161a-4315-89bc-f0cd67dc287b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Request method failure captured: Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 HTTP/1.1 Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtMYcvLMjwR2HBuyLfxFTp4hCp7k3fDqi7wnxr2-EDbOPOmiw3S6KdU7puUdMlxMX74217vuHbMIhBD09pYVN0xJbVp67tHBEhk1q4HTPrhNLmnehlCHWOR51x95SuLbDWjBtJR54Sc0qFn_7fS1hsL9HYmMwdD0QSrkmQf7hW9TY2s Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: d80182bb9450487f93c270d199dac1d1 Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-269511798 Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d80182bb9450487f93c270d199dac1d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d80182bb9450487f93c270d199dac1d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d80182bb9450487f93c270d199dac1d1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d80182bb9450487f93c270d199dac1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-269511798 Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: d80182bb9450487f93c270d199dac1d1 Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-269511798 Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerAddressesNegativeTestJSON-269511798-project Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e3973c038bc34eb3b9cc1dfc2e0de5fe Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-269511798-project Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 088955af-fa5c-4217-a66f-fd72d3eed8e8 could not be found. Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '088955af-fa5c-4217-a66f-fd72d3eed8e8'} Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 088955af-fa5c-4217-a66f-fd72d3eed8e8 could not be found. Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 088955af-fa5c-4217-a66f-fd72d3eed8e8 could not be found. Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:36.185958 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:36.192015 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:36.192015 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:36.192015 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:36.192015 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:36.192015 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:51:36.192015 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:51:36.192015 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 088955af-fa5c-4217-a66f-fd72d3eed8e8 could not be found. Oct 27 18:51:36.192015 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:36.192015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b5d470a8-161a-4315-89bc-f0cd67dc287b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] Returning 404 to user: Instance 088955af-fa5c-4217-a66f-fd72d3eed8e8 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:51:36.192015 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b5d470a8-161a-4315-89bc-f0cd67dc287b tempest-ServerAddressesNegativeTestJSON-269511798 tempest-ServerAddressesNegativeTestJSON-269511798-project] 10.222.0.42 "GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8" status: 404 len: 111 microversion: 2.1 time: 0.042938 Oct 27 18:51:36.192015 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 818/1598] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:36 2022] GET /compute/v2.1/servers/088955af-fa5c-4217-a66f-fd72d3eed8e8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:51:36.246452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-db3bc209-8b13-4004-b5e3-645ddee6cc9b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: b93639af-67fe-4725-9626-ed881eef60ba] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:51:36.463207 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-db3bc209-8b13-4004-b5e3-645ddee6cc9b tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba" status: 204 len: 0 microversion: 2.1 time: 0.310226 Oct 27 18:51:36.467258 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 781/1599] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:51:36 2022] DELETE /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:51:36.475258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e863a1d8-21af-4887-91a3-de46e461580f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:36.476185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e863a1d8-21af-4887-91a3-de46e461580f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: b93639af-67fe-4725-9626-ed881eef60ba] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:36.490974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e863a1d8-21af-4887-91a3-de46e461580f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:36.492225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e863a1d8-21af-4887-91a3-de46e461580f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:36.493201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e863a1d8-21af-4887-91a3-de46e461580f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:36.494296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e863a1d8-21af-4887-91a3-de46e461580f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:36.495013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e863a1d8-21af-4887-91a3-de46e461580f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:36.496090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e863a1d8-21af-4887-91a3-de46e461580f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:36.626214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-26a857de-0bfd-442c-9747-ac2536bf9587 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:36.628528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-26a857de-0bfd-442c-9747-ac2536bf9587 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:36.641588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26a857de-0bfd-442c-9747-ac2536bf9587 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:36.646626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26a857de-0bfd-442c-9747-ac2536bf9587 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:36.648136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26a857de-0bfd-442c-9747-ac2536bf9587 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:36.649344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26a857de-0bfd-442c-9747-ac2536bf9587 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:36.651179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26a857de-0bfd-442c-9747-ac2536bf9587 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:36.654414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26a857de-0bfd-442c-9747-ac2536bf9587 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:37.105590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e863a1d8-21af-4887-91a3-de46e461580f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:37.132798 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e863a1d8-21af-4887-91a3-de46e461580f tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba" status: 200 len: 1518 microversion: 2.1 time: 0.661391 Oct 27 18:51:37.153519 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 819/1600] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:36 2022] GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba => generated 1518 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:37.162177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2bc9c243-4f4b-46e4-8ab2-52fbf2277d74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:37.171690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2bc9c243-4f4b-46e4-8ab2-52fbf2277d74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:37.188165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc9c243-4f4b-46e4-8ab2-52fbf2277d74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:37.191114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc9c243-4f4b-46e4-8ab2-52fbf2277d74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:37.192479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc9c243-4f4b-46e4-8ab2-52fbf2277d74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:37.195289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc9c243-4f4b-46e4-8ab2-52fbf2277d74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:37.197416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc9c243-4f4b-46e4-8ab2-52fbf2277d74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:37.201339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc9c243-4f4b-46e4-8ab2-52fbf2277d74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:37.303696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-26a857de-0bfd-442c-9747-ac2536bf9587 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:37.319837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-26a857de-0bfd-442c-9747-ac2536bf9587 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:37.325969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-26a857de-0bfd-442c-9747-ac2536bf9587 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:37.329268 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-26a857de-0bfd-442c-9747-ac2536bf9587 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1292 microversion: 2.25 time: 0.707708 Oct 27 18:51:37.329922 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 782/1601] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:36 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1292 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:51:37.348989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ca63c72e-b498-421e-8be1-51a95b278b25 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:37.349954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ca63c72e-b498-421e-8be1-51a95b278b25 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:37.362474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca63c72e-b498-421e-8be1-51a95b278b25 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:37.364999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca63c72e-b498-421e-8be1-51a95b278b25 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:37.365713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca63c72e-b498-421e-8be1-51a95b278b25 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:37.367207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca63c72e-b498-421e-8be1-51a95b278b25 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:37.375162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca63c72e-b498-421e-8be1-51a95b278b25 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:37.375963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca63c72e-b498-421e-8be1-51a95b278b25 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:37.683995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2bc9c243-4f4b-46e4-8ab2-52fbf2277d74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:37.701692 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2bc9c243-4f4b-46e4-8ab2-52fbf2277d74 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1470 microversion: 2.1 time: 0.546920 Oct 27 18:51:37.704467 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 820/1602] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:37 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1470 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:37.727063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ca63c72e-b498-421e-8be1-51a95b278b25 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:37.745243 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ca63c72e-b498-421e-8be1-51a95b278b25 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 0.412351 Oct 27 18:51:37.745852 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 783/1603] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:37 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:38.172674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b3c3fbde-2e4f-4451-85a8-b86235b68fd5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:38.174049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b3c3fbde-2e4f-4451-85a8-b86235b68fd5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: b93639af-67fe-4725-9626-ed881eef60ba] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:38.181724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3c3fbde-2e4f-4451-85a8-b86235b68fd5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:38.182877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3c3fbde-2e4f-4451-85a8-b86235b68fd5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:38.184677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3c3fbde-2e4f-4451-85a8-b86235b68fd5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:38.185648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3c3fbde-2e4f-4451-85a8-b86235b68fd5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:38.186128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3c3fbde-2e4f-4451-85a8-b86235b68fd5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:38.194679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3c3fbde-2e4f-4451-85a8-b86235b68fd5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:38.270202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:38.340676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-623f7ea5-fc80-4951-b439-0112a463630c req-7e45f468-8c26-491c-bc26-e2f3a8b72216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "577c18dd-641c-4a06-a686-f98e0900c9ee", "tag": "8a32fd83-25f1-4404-aa7a-0920aacf1688"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:38.362300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=14 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:38.369013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-623f7ea5-fc80-4951-b439-0112a463630c req-7e45f468-8c26-491c-bc26-e2f3a8b72216 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:38.369980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-623f7ea5-fc80-4951-b439-0112a463630c req-7e45f468-8c26-491c-bc26-e2f3a8b72216 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:38.370818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-623f7ea5-fc80-4951-b439-0112a463630c req-7e45f468-8c26-491c-bc26-e2f3a8b72216 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:38.403198 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-623f7ea5-fc80-4951-b439-0112a463630c req-7e45f468-8c26-491c-bc26-e2f3a8b72216 service nova] Creating event network-changed:8a32fd83-25f1-4404-aa7a-0920aacf1688 for instance 577c18dd-641c-4a06-a686-f98e0900c9ee on n-h1-860687-3 Oct 27 18:51:38.408781 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-623f7ea5-fc80-4951-b439-0112a463630c req-7e45f468-8c26-491c-bc26-e2f3a8b72216 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077999 Oct 27 18:51:38.417951 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 784/1604] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:51:38.430784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bb31112b-45cb-44a2-b8c0-eea216135a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:38.432137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bb31112b-45cb-44a2-b8c0-eea216135a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:38.445542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb31112b-45cb-44a2-b8c0-eea216135a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:38.450697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb31112b-45cb-44a2-b8c0-eea216135a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:38.451623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb31112b-45cb-44a2-b8c0-eea216135a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:38.452518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb31112b-45cb-44a2-b8c0-eea216135a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:38.456451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb31112b-45cb-44a2-b8c0-eea216135a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:38.457101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb31112b-45cb-44a2-b8c0-eea216135a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:38.458548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:38.729367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bb31112b-45cb-44a2-b8c0-eea216135a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:38.746029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bb31112b-45cb-44a2-b8c0-eea216135a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:38.747803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bb31112b-45cb-44a2-b8c0-eea216135a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:38.749093 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bb31112b-45cb-44a2-b8c0-eea216135a09 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1292 microversion: 2.25 time: 0.329589 Oct 27 18:51:38.752304 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 785/1605] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:38 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1292 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:38.778026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6db55147-3eac-4d2f-b86c-943d0cc6a75d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:38.781435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6db55147-3eac-4d2f-b86c-943d0cc6a75d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:38.793466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6db55147-3eac-4d2f-b86c-943d0cc6a75d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:38.801863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6db55147-3eac-4d2f-b86c-943d0cc6a75d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:38.802521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6db55147-3eac-4d2f-b86c-943d0cc6a75d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:38.803394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6db55147-3eac-4d2f-b86c-943d0cc6a75d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:38.804152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6db55147-3eac-4d2f-b86c-943d0cc6a75d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:38.805450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6db55147-3eac-4d2f-b86c-943d0cc6a75d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:38.865906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b3c3fbde-2e4f-4451-85a8-b86235b68fd5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:38.870850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:38.887592 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b3c3fbde-2e4f-4451-85a8-b86235b68fd5 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba" status: 200 len: 1518 microversion: 2.1 time: 0.729174 Oct 27 18:51:38.888217 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 821/1606] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:38 2022] GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba => generated 1518 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:38.904031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-09748353-64eb-4e44-891d-5165e893d785 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:38.904710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-09748353-64eb-4e44-891d-5165e893d785 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:38.929125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09748353-64eb-4e44-891d-5165e893d785 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:38.930437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09748353-64eb-4e44-891d-5165e893d785 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:38.931065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09748353-64eb-4e44-891d-5165e893d785 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:38.933172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09748353-64eb-4e44-891d-5165e893d785 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:38.933787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09748353-64eb-4e44-891d-5165e893d785 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:38.934313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09748353-64eb-4e44-891d-5165e893d785 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:39.259229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=14 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:39.620716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-09748353-64eb-4e44-891d-5165e893d785 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:39.635713 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-09748353-64eb-4e44-891d-5165e893d785 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 0.746317 Oct 27 18:51:39.642563 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 822/1607] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:38 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:40.002293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8900bfd0-90a6-4aa3-b69e-49ec6ee2e395 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] Calling method '.version_select at 0x7fc86aa2a550>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:40.047738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8900bfd0-90a6-4aa3-b69e-49ec6ee2e395 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:40.048253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8900bfd0-90a6-4aa3-b69e-49ec6ee2e395 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:40.051801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8900bfd0-90a6-4aa3-b69e-49ec6ee2e395 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:40.056608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8900bfd0-90a6-4aa3-b69e-49ec6ee2e395 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:40.065504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8900bfd0-90a6-4aa3-b69e-49ec6ee2e395 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:40.067621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8900bfd0-90a6-4aa3-b69e-49ec6ee2e395 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:40.114660 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8900bfd0-90a6-4aa3-b69e-49ec6ee2e395 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] 10.222.0.42 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.375689 Oct 27 18:51:40.119037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6db55147-3eac-4d2f-b86c-943d0cc6a75d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:40.130894 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 823/1608] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Oct 27 18:51:39 2022] GET /compute/v2.1/limits => generated 511 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:51:40.137302 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6db55147-3eac-4d2f-b86c-943d0cc6a75d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1470 microversion: 2.1 time: 1.367127 Oct 27 18:51:40.138485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4ac623ee-0d8e-41d4-9330-90f24dc6f268 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:40.139449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4ac623ee-0d8e-41d4-9330-90f24dc6f268 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:40.140516 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 786/1609] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:38 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1470 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:40.146302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-864c652f-f04a-4595-bdef-42659dae7828 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:40.146903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-864c652f-f04a-4595-bdef-42659dae7828 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: b93639af-67fe-4725-9626-ed881eef60ba] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:40.147905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ac623ee-0d8e-41d4-9330-90f24dc6f268 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:40.149212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ac623ee-0d8e-41d4-9330-90f24dc6f268 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:40.149935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ac623ee-0d8e-41d4-9330-90f24dc6f268 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:40.151262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ac623ee-0d8e-41d4-9330-90f24dc6f268 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:40.151972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ac623ee-0d8e-41d4-9330-90f24dc6f268 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:40.152639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ac623ee-0d8e-41d4-9330-90f24dc6f268 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:40.192133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-864c652f-f04a-4595-bdef-42659dae7828 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:40.193065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-864c652f-f04a-4595-bdef-42659dae7828 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:40.193717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-864c652f-f04a-4595-bdef-42659dae7828 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:40.194662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-864c652f-f04a-4595-bdef-42659dae7828 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:40.195299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-864c652f-f04a-4595-bdef-42659dae7828 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:40.195965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-864c652f-f04a-4595-bdef-42659dae7828 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:40.872000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-864c652f-f04a-4595-bdef-42659dae7828 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:40.885028 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-864c652f-f04a-4595-bdef-42659dae7828 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba" status: 200 len: 1518 microversion: 2.1 time: 0.743410 Oct 27 18:51:40.886355 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 787/1610] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:40 2022] GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba => generated 1518 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:40.891962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f8712ec3-eeaf-4304-b00d-d92be81a77f9 req-08a8e5ca-66e9-4665-b9f5-b01c8cc466c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d948f3-a6a5-46cb-b716-79eaf55ff690", "tag": "6b2d83f0-401a-4e99-a170-d27160cbcd4d"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:40.903531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f8712ec3-eeaf-4304-b00d-d92be81a77f9 req-08a8e5ca-66e9-4665-b9f5-b01c8cc466c1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:40.904377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f8712ec3-eeaf-4304-b00d-d92be81a77f9 req-08a8e5ca-66e9-4665-b9f5-b01c8cc466c1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:40.904511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4ac623ee-0d8e-41d4-9330-90f24dc6f268 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:40.905651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f8712ec3-eeaf-4304-b00d-d92be81a77f9 req-08a8e5ca-66e9-4665-b9f5-b01c8cc466c1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:40.911254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:40.917617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4ac623ee-0d8e-41d4-9330-90f24dc6f268 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:40.926234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4ac623ee-0d8e-41d4-9330-90f24dc6f268 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:40.927378 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f8712ec3-eeaf-4304-b00d-d92be81a77f9 req-08a8e5ca-66e9-4665-b9f5-b01c8cc466c1 service nova] Creating event network-changed:6b2d83f0-401a-4e99-a170-d27160cbcd4d for instance 60d948f3-a6a5-46cb-b716-79eaf55ff690 on n-h2-860687-3 Oct 27 18:51:40.933515 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4ac623ee-0d8e-41d4-9330-90f24dc6f268 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1292 microversion: 2.25 time: 0.800639 Oct 27 18:51:40.934873 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f8712ec3-eeaf-4304-b00d-d92be81a77f9 req-08a8e5ca-66e9-4665-b9f5-b01c8cc466c1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046687 Oct 27 18:51:40.936364 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 788/1611] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:40.939952 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 824/1612] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:40 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1292 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:40.942621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9dd7c375-623f-4964-ac22-77cef85855b5 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1742315687", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:40.963098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9de2e098-cac8-475b-ac95-faa3969a748c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:40.968532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9de2e098-cac8-475b-ac95-faa3969a748c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:40.989261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9de2e098-cac8-475b-ac95-faa3969a748c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:40.990030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9de2e098-cac8-475b-ac95-faa3969a748c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:40.992495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9de2e098-cac8-475b-ac95-faa3969a748c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:40.993630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9de2e098-cac8-475b-ac95-faa3969a748c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:40.998543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9de2e098-cac8-475b-ac95-faa3969a748c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:40.999459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9de2e098-cac8-475b-ac95-faa3969a748c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:41.043745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-9dd7c375-623f-4964-ac22-77cef85855b5 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:51:41.688069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-9dd7c375-623f-4964-ac22-77cef85855b5 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] Getting quotas for project d9663f42c92e4c65b17fe7f585ef654b. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:51:41.697333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-9dd7c375-623f-4964-ac22-77cef85855b5 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] Getting quotas for user 1543cf8b9e8d442ca1875fce47d4f4e4 and project d9663f42c92e4c65b17fe7f585ef654b. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:51:41.732138 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-9dd7c375-623f-4964-ac22-77cef85855b5 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9dd7c375-623f-4964-ac22-77cef85855b5 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] Request method failure captured: Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 1752 Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtM7P1SP4ugRvyDYdA0GEyo6tAV7pSexsZpY3YlVR4qRuWxiMHwIhUiX3Bk4PvpPG9cVS3MGsjwhXBL_vNwsI6Vcd0TSQ1u_wrekbeXWJpoqvMhuPVNu5Clk1PPEuWLQUFJiTtGbmu-4fBxYE2ysBj40B_xYmaH_FfW-Hhuo-a8TdFk Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: d9663f42c92e4c65b17fe7f585ef654b Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1880028184 Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d9663f42c92e4c65b17fe7f585ef654b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d9663f42c92e4c65b17fe7f585ef654b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d9663f42c92e4c65b17fe7f585ef654b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d9663f42c92e4c65b17fe7f585ef654b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1880028184 Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: d9663f42c92e4c65b17fe7f585ef654b Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1880028184 Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 1543cf8b9e8d442ca1875fce47d4f4e4 Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1742315687", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:51:41.749412 n-d-860687-3 devstack@n-api.service[127028]: exception: Maximum number of metadata items exceeds 128 Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1742315687', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:51:41.752625 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 27 18:51:41.756841 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:41.762723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9dd7c375-623f-4964-ac22-77cef85855b5 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:51:41.763437 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9dd7c375-623f-4964-ac22-77cef85855b5 tempest-AbsoluteLimitsNegativeTestJSON-1880028184 tempest-AbsoluteLimitsNegativeTestJSON-1880028184-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.824842 Oct 27 18:51:41.764152 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 789/1613] 10.222.0.42 () {60 vars in 1148 bytes} [Thu Oct 27 18:51:40 2022] POST /compute/v2.1/servers => generated 87 bytes in 827 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:51:41.779070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-33ed403d-006c-458c-add4-9bbeda57ade4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:41.779833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-33ed403d-006c-458c-add4-9bbeda57ade4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:41.808723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33ed403d-006c-458c-add4-9bbeda57ade4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:41.809221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33ed403d-006c-458c-add4-9bbeda57ade4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:41.809664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33ed403d-006c-458c-add4-9bbeda57ade4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:41.810407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33ed403d-006c-458c-add4-9bbeda57ade4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:41.810869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33ed403d-006c-458c-add4-9bbeda57ade4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:41.811302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33ed403d-006c-458c-add4-9bbeda57ade4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:42.059554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-33ed403d-006c-458c-add4-9bbeda57ade4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:42.069939 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-33ed403d-006c-458c-add4-9bbeda57ade4 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1470 microversion: 2.1 time: 0.303193 Oct 27 18:51:42.095257 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 790/1614] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:41 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1470 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:42.108607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b7b009e-ad51-4a06-8840-dfd5d136a106 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:42.110556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6b7b009e-ad51-4a06-8840-dfd5d136a106 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: b93639af-67fe-4725-9626-ed881eef60ba] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:42.119940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b7b009e-ad51-4a06-8840-dfd5d136a106 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:42.121375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b7b009e-ad51-4a06-8840-dfd5d136a106 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:42.122164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b7b009e-ad51-4a06-8840-dfd5d136a106 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:42.123214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b7b009e-ad51-4a06-8840-dfd5d136a106 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:42.123840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b7b009e-ad51-4a06-8840-dfd5d136a106 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:42.124463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b7b009e-ad51-4a06-8840-dfd5d136a106 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:42.137863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9de2e098-cac8-475b-ac95-faa3969a748c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:42.155070 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9de2e098-cac8-475b-ac95-faa3969a748c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 1.213506 Oct 27 18:51:42.155991 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 825/1615] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:40 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:42.165949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9316447f-c6f8-4c9f-8192-1f3bf5ae63ad tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:42.167652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9316447f-c6f8-4c9f-8192-1f3bf5ae63ad tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:42.174954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b7b009e-ad51-4a06-8840-dfd5d136a106 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:42.175703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b7b009e-ad51-4a06-8840-dfd5d136a106 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:42.176308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b7b009e-ad51-4a06-8840-dfd5d136a106 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:42.176925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-6b7b009e-ad51-4a06-8840-dfd5d136a106 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lazy-loading 'fault' on Instance uuid b93639af-67fe-4725-9626-ed881eef60ba {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:51:42.182419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9316447f-c6f8-4c9f-8192-1f3bf5ae63ad tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:42.183185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9316447f-c6f8-4c9f-8192-1f3bf5ae63ad tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:42.183834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9316447f-c6f8-4c9f-8192-1f3bf5ae63ad tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:42.192056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9316447f-c6f8-4c9f-8192-1f3bf5ae63ad tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:42.192552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9316447f-c6f8-4c9f-8192-1f3bf5ae63ad tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:42.193248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9316447f-c6f8-4c9f-8192-1f3bf5ae63ad tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:42.416631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6b7b009e-ad51-4a06-8840-dfd5d136a106 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:42.425750 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b7b009e-ad51-4a06-8840-dfd5d136a106 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba" status: 200 len: 1311 microversion: 2.1 time: 0.329690 Oct 27 18:51:42.434208 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 791/1616] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:42 2022] GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba => generated 1311 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:42.530328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ae4e13a2-f605-4e3e-af27-33409c396613 req-7c785dea-8cf3-404f-8353-ce4b45a1d6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8293a368-36ca-4f0c-89b2-8c9f8cd4d83f", "name": "network-vif-unplugged", "status": "completed", "tag": "ef76078a-4991-4a34-a8cf-984da56b97d3"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:42.554087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ae4e13a2-f605-4e3e-af27-33409c396613 req-7c785dea-8cf3-404f-8353-ce4b45a1d6ac service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:42.554938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ae4e13a2-f605-4e3e-af27-33409c396613 req-7c785dea-8cf3-404f-8353-ce4b45a1d6ac service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:42.557216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ae4e13a2-f605-4e3e-af27-33409c396613 req-7c785dea-8cf3-404f-8353-ce4b45a1d6ac service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:42.565025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9316447f-c6f8-4c9f-8192-1f3bf5ae63ad tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:42.585474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9316447f-c6f8-4c9f-8192-1f3bf5ae63ad tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:42.587748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9316447f-c6f8-4c9f-8192-1f3bf5ae63ad tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:42.588928 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9316447f-c6f8-4c9f-8192-1f3bf5ae63ad tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1280 microversion: 2.25 time: 0.431574 Oct 27 18:51:42.589124 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ae4e13a2-f605-4e3e-af27-33409c396613 req-7c785dea-8cf3-404f-8353-ce4b45a1d6ac service nova] Creating event network-vif-unplugged:ef76078a-4991-4a34-a8cf-984da56b97d3 for instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f on n-h1-860687-3 Oct 27 18:51:42.589803 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 826/1617] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:42 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1280 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:42.609392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-ae4e13a2-f605-4e3e-af27-33409c396613 req-7c785dea-8cf3-404f-8353-ce4b45a1d6ac service nova] Instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:51:42.636758 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ae4e13a2-f605-4e3e-af27-33409c396613 req-7c785dea-8cf3-404f-8353-ce4b45a1d6ac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115900 Oct 27 18:51:42.639216 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 792/1618] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:42.874066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-12643756-62b3-4855-87c6-c077fa51e2a4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a6f03a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:42.926222 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-12643756-62b3-4855-87c6-c077fa51e2a4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/5fca405d-9a5c-47e2-856e-9216e0451328" status: 200 len: 661 microversion: 2.1 time: 0.055696 Oct 27 18:51:42.930779 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 827/1619] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:51:42 2022] GET /compute/v2.1/images/5fca405d-9a5c-47e2-856e-9216e0451328 => generated 661 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:42.942712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c4765430-e26f-4c6a-9bef-92afcb9f56f2 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b485040>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:42.997322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-cc239ca1-9340-43cb-9ff1-48674a3b1991 req-aaef4ba5-385a-4b79-a232-8539e0caacc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93639af-67fe-4725-9626-ed881eef60ba", "name": "network-vif-deleted", "tag": "ba4e40ea-685e-4ca1-932b-b9f6d118d19d"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:42.998984 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c4765430-e26f-4c6a-9bef-92afcb9f56f2 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/5fca405d-9a5c-47e2-856e-9216e0451328" status: 200 len: 661 microversion: 2.1 time: 0.061116 Oct 27 18:51:43.000066 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 793/1620] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:51:42 2022] GET /compute/v2.1/images/5fca405d-9a5c-47e2-856e-9216e0451328 => generated 661 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:43.023155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cc239ca1-9340-43cb-9ff1-48674a3b1991 req-aaef4ba5-385a-4b79-a232-8539e0caacc9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:43.025072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cc239ca1-9340-43cb-9ff1-48674a3b1991 req-aaef4ba5-385a-4b79-a232-8539e0caacc9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:43.027105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cc239ca1-9340-43cb-9ff1-48674a3b1991 req-aaef4ba5-385a-4b79-a232-8539e0caacc9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:43.039840 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-cc239ca1-9340-43cb-9ff1-48674a3b1991 req-aaef4ba5-385a-4b79-a232-8539e0caacc9 service nova] Creating event network-vif-deleted:ba4e40ea-685e-4ca1-932b-b9f6d118d19d for instance b93639af-67fe-4725-9626-ed881eef60ba on n-h2-860687-3 Oct 27 18:51:43.045508 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-cc239ca1-9340-43cb-9ff1-48674a3b1991 req-aaef4ba5-385a-4b79-a232-8539e0caacc9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056333 Oct 27 18:51:43.046931 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 828/1621] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:51:43.101391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0682db1e-56bf-49a2-8a7e-3f818cc98d37 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:43.103584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0682db1e-56bf-49a2-8a7e-3f818cc98d37 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:43.116641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0682db1e-56bf-49a2-8a7e-3f818cc98d37 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:43.117150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0682db1e-56bf-49a2-8a7e-3f818cc98d37 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:43.118019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0682db1e-56bf-49a2-8a7e-3f818cc98d37 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:43.118789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0682db1e-56bf-49a2-8a7e-3f818cc98d37 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:43.119260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0682db1e-56bf-49a2-8a7e-3f818cc98d37 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:43.121916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0682db1e-56bf-49a2-8a7e-3f818cc98d37 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:43.188157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-45e267a6-5433-414e-892e-9b3a4cbea7ef tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:43.189475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-45e267a6-5433-414e-892e-9b3a4cbea7ef tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:43.200565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45e267a6-5433-414e-892e-9b3a4cbea7ef tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:43.201528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45e267a6-5433-414e-892e-9b3a4cbea7ef tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:43.201934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45e267a6-5433-414e-892e-9b3a4cbea7ef tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:43.202857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45e267a6-5433-414e-892e-9b3a4cbea7ef tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:43.203730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45e267a6-5433-414e-892e-9b3a4cbea7ef tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:43.204527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45e267a6-5433-414e-892e-9b3a4cbea7ef tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:43.511034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0682db1e-56bf-49a2-8a7e-3f818cc98d37 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:43.524145 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0682db1e-56bf-49a2-8a7e-3f818cc98d37 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1470 microversion: 2.1 time: 0.426209 Oct 27 18:51:43.535536 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 794/1622] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:43 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1470 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:43.541410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5be0aa2d-8814-49cb-ae42-73019efc2c6a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:43.542437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5be0aa2d-8814-49cb-ae42-73019efc2c6a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: b93639af-67fe-4725-9626-ed881eef60ba] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:43.558727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5be0aa2d-8814-49cb-ae42-73019efc2c6a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:43.561835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5be0aa2d-8814-49cb-ae42-73019efc2c6a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:43.562588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5be0aa2d-8814-49cb-ae42-73019efc2c6a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:43.563612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5be0aa2d-8814-49cb-ae42-73019efc2c6a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:43.566479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5be0aa2d-8814-49cb-ae42-73019efc2c6a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:43.567747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5be0aa2d-8814-49cb-ae42-73019efc2c6a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:43.627083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-45e267a6-5433-414e-892e-9b3a4cbea7ef tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:43.653900 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-45e267a6-5433-414e-892e-9b3a4cbea7ef tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 0.474722 Oct 27 18:51:43.659669 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 829/1623] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:43 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:43.662796 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-5be0aa2d-8814-49cb-ae42-73019efc2c6a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] HTTP exception thrown: Instance b93639af-67fe-4725-9626-ed881eef60ba could not be found. Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5be0aa2d-8814-49cb-ae42-73019efc2c6a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Request method failure captured: Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba HTTP/1.1 Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtLqjVSXsPB58N4wNFWqonwq5nwL41pozyloFng3APlb6xSvd0UFMSMH1jqzHElg9XYy8H3zbXaPKJp76QtIuAnKlV0Fb7uTrY9-9rnpXeHcC6SJfRje54Kbupk7vXLpCqGe2yuBsfUBrTOWwraC3eBypCX8SMvlhsjwRewG2Kqfbwo Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f95230f585d04c83885c8cd68f662e7a Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ListServerFiltersTestJSON-1410268660 Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f95230f585d04c83885c8cd68f662e7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f95230f585d04c83885c8cd68f662e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f95230f585d04c83885c8cd68f662e7a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f95230f585d04c83885c8cd68f662e7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ListServerFiltersTestJSON-1410268660 Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f95230f585d04c83885c8cd68f662e7a Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1410268660 Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ListServerFiltersTestJSON-1410268660-project Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ba01db4490774dbfb8196cb459c20dd3 Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ListServerFiltersTestJSON-1410268660-project Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance b93639af-67fe-4725-9626-ed881eef60ba could not be found. Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'b93639af-67fe-4725-9626-ed881eef60ba'} Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b93639af-67fe-4725-9626-ed881eef60ba could not be found. Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b93639af-67fe-4725-9626-ed881eef60ba could not be found. Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:43.673023 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:43.679491 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:43.679491 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:43.679491 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:43.679491 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:51:43.679491 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:51:43.679491 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b93639af-67fe-4725-9626-ed881eef60ba could not be found. Oct 27 18:51:43.679491 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:43.679491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5be0aa2d-8814-49cb-ae42-73019efc2c6a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Returning 404 to user: Instance b93639af-67fe-4725-9626-ed881eef60ba could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:51:43.679491 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5be0aa2d-8814-49cb-ae42-73019efc2c6a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba" status: 404 len: 111 microversion: 2.1 time: 0.138952 Oct 27 18:51:43.681849 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 795/1624] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:43 2022] GET /compute/v2.1/servers/b93639af-67fe-4725-9626-ed881eef60ba => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:51:43.682607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-76dc12a6-fbbc-4868-a286-14720d5f5410 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:43.687168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-76dc12a6-fbbc-4868-a286-14720d5f5410 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:43.705210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76dc12a6-fbbc-4868-a286-14720d5f5410 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:43.705715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76dc12a6-fbbc-4868-a286-14720d5f5410 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:43.706161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76dc12a6-fbbc-4868-a286-14720d5f5410 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:43.726725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cd551296-83fc-4540-90ce-3fd4338a863a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:43.728071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cd551296-83fc-4540-90ce-3fd4338a863a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:43.732228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76dc12a6-fbbc-4868-a286-14720d5f5410 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:43.733415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76dc12a6-fbbc-4868-a286-14720d5f5410 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:43.736128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76dc12a6-fbbc-4868-a286-14720d5f5410 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:43.745102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd551296-83fc-4540-90ce-3fd4338a863a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:43.747598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd551296-83fc-4540-90ce-3fd4338a863a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:43.748182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd551296-83fc-4540-90ce-3fd4338a863a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:43.750369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd551296-83fc-4540-90ce-3fd4338a863a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:43.751285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd551296-83fc-4540-90ce-3fd4338a863a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:43.753240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd551296-83fc-4540-90ce-3fd4338a863a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:43.821842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cd551296-83fc-4540-90ce-3fd4338a863a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:51:43.962691 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cd551296-83fc-4540-90ce-3fd4338a863a tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 204 len: 0 microversion: 2.1 time: 0.277287 Oct 27 18:51:43.963581 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 796/1625] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:51:43 2022] DELETE /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:51:43.971867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4f99a12f-e2a0-4cc6-90aa-03d63e155980 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:43.972580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4f99a12f-e2a0-4cc6-90aa-03d63e155980 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:43.985565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f99a12f-e2a0-4cc6-90aa-03d63e155980 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:43.987061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f99a12f-e2a0-4cc6-90aa-03d63e155980 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:43.987599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f99a12f-e2a0-4cc6-90aa-03d63e155980 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:43.999401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f99a12f-e2a0-4cc6-90aa-03d63e155980 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:43.999908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f99a12f-e2a0-4cc6-90aa-03d63e155980 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:44.000363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f99a12f-e2a0-4cc6-90aa-03d63e155980 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:44.482154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4f99a12f-e2a0-4cc6-90aa-03d63e155980 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:44.493728 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4f99a12f-e2a0-4cc6-90aa-03d63e155980 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1517 microversion: 2.1 time: 0.526067 Oct 27 18:51:44.497658 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 797/1626] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:43 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1517 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:51:44.562900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9172316e-6749-42f2-98b7-8f7cb1aff13a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:44.563815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9172316e-6749-42f2-98b7-8f7cb1aff13a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:44.580420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9172316e-6749-42f2-98b7-8f7cb1aff13a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:44.581067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9172316e-6749-42f2-98b7-8f7cb1aff13a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:44.581527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9172316e-6749-42f2-98b7-8f7cb1aff13a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:44.584567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9172316e-6749-42f2-98b7-8f7cb1aff13a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:44.588189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9172316e-6749-42f2-98b7-8f7cb1aff13a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:44.590901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9172316e-6749-42f2-98b7-8f7cb1aff13a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:44.871037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-76dc12a6-fbbc-4868-a286-14720d5f5410 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:44.884844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-76dc12a6-fbbc-4868-a286-14720d5f5410 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:44.890075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-76dc12a6-fbbc-4868-a286-14720d5f5410 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:44.894887 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-76dc12a6-fbbc-4868-a286-14720d5f5410 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1280 microversion: 2.25 time: 1.231324 Oct 27 18:51:44.896152 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 830/1627] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:43 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1280 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:44.904923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9172316e-6749-42f2-98b7-8f7cb1aff13a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:44.921705 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9172316e-6749-42f2-98b7-8f7cb1aff13a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1470 microversion: 2.1 time: 0.360645 Oct 27 18:51:44.924288 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 798/1628] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:44 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1470 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:44.929932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7953d3cb-9cae-4404-b755-18826617ff9f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:44.934532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7953d3cb-9cae-4404-b755-18826617ff9f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:44.946993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-74e03fb5-01ea-4eb4-8201-99509c8345c4 req-acb232eb-2f66-4279-a755-40f4e591dfd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8293a368-36ca-4f0c-89b2-8c9f8cd4d83f", "tag": "ef76078a-4991-4a34-a8cf-984da56b97d3"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:44.959878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7953d3cb-9cae-4404-b755-18826617ff9f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:44.963863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7953d3cb-9cae-4404-b755-18826617ff9f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:44.964655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7953d3cb-9cae-4404-b755-18826617ff9f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:44.968193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7953d3cb-9cae-4404-b755-18826617ff9f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:44.970022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7953d3cb-9cae-4404-b755-18826617ff9f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:44.972711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7953d3cb-9cae-4404-b755-18826617ff9f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:44.988998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-74e03fb5-01ea-4eb4-8201-99509c8345c4 req-acb232eb-2f66-4279-a755-40f4e591dfd8 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:44.994260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-74e03fb5-01ea-4eb4-8201-99509c8345c4 req-acb232eb-2f66-4279-a755-40f4e591dfd8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:44.997144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-74e03fb5-01ea-4eb4-8201-99509c8345c4 req-acb232eb-2f66-4279-a755-40f4e591dfd8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:45.047816 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-74e03fb5-01ea-4eb4-8201-99509c8345c4 req-acb232eb-2f66-4279-a755-40f4e591dfd8 service nova] Creating event network-changed:ef76078a-4991-4a34-a8cf-984da56b97d3 for instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f on n-h1-860687-3 Oct 27 18:51:45.072503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-74e03fb5-01ea-4eb4-8201-99509c8345c4 req-acb232eb-2f66-4279-a755-40f4e591dfd8 service nova] Instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 18:51:45.106082 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-74e03fb5-01ea-4eb4-8201-99509c8345c4 req-acb232eb-2f66-4279-a755-40f4e591dfd8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173845 Oct 27 18:51:45.119859 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 799/1629] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:45.157058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a653d82f-50a3-42a9-b82a-725d0e68cf63 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a38f4c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:45.222074 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a653d82f-50a3-42a9-b82a-725d0e68cf63 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/c48522b4-ef08-4fa9-b2b7-497281d973e6" status: 200 len: 662 microversion: 2.1 time: 0.069963 Oct 27 18:51:45.222712 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 800/1630] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:51:45 2022] GET /compute/v2.1/images/c48522b4-ef08-4fa9-b2b7-497281d973e6 => generated 662 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:45.238608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f181dcec-299c-426b-8402-7d9607be7178 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a400670>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:45.302852 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f181dcec-299c-426b-8402-7d9607be7178 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/c48522b4-ef08-4fa9-b2b7-497281d973e6" status: 200 len: 662 microversion: 2.1 time: 0.068740 Oct 27 18:51:45.303621 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 801/1631] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:51:45 2022] GET /compute/v2.1/images/c48522b4-ef08-4fa9-b2b7-497281d973e6 => generated 662 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:45.524403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-177bd84d-a11a-40c4-a2fe-42620cba3ac2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:45.525460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-177bd84d-a11a-40c4-a2fe-42620cba3ac2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:45.543248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-177bd84d-a11a-40c4-a2fe-42620cba3ac2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:45.544442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-177bd84d-a11a-40c4-a2fe-42620cba3ac2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:45.545242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-177bd84d-a11a-40c4-a2fe-42620cba3ac2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:45.546200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-177bd84d-a11a-40c4-a2fe-42620cba3ac2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:45.547122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-177bd84d-a11a-40c4-a2fe-42620cba3ac2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:45.547731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-177bd84d-a11a-40c4-a2fe-42620cba3ac2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:45.743500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7953d3cb-9cae-4404-b755-18826617ff9f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:45.752128 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7953d3cb-9cae-4404-b755-18826617ff9f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 0.853385 Oct 27 18:51:45.759555 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 831/1632] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:44 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:45.925133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-301277f3-d31e-4052-a2ea-9b0f9ccae386 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:45.925830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-301277f3-d31e-4052-a2ea-9b0f9ccae386 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:45.932744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-301277f3-d31e-4052-a2ea-9b0f9ccae386 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:45.933542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-301277f3-d31e-4052-a2ea-9b0f9ccae386 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:45.934185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-301277f3-d31e-4052-a2ea-9b0f9ccae386 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:45.935153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-301277f3-d31e-4052-a2ea-9b0f9ccae386 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:45.935814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-301277f3-d31e-4052-a2ea-9b0f9ccae386 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:45.936458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-301277f3-d31e-4052-a2ea-9b0f9ccae386 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:46.118946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-177bd84d-a11a-40c4-a2fe-42620cba3ac2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:46.128841 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-177bd84d-a11a-40c4-a2fe-42620cba3ac2 tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1517 microversion: 2.1 time: 0.610780 Oct 27 18:51:46.129794 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 802/1633] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:45 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1517 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:46.136952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-43d5dd86-6101-43d6-a526-de41d3249281 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:46.137574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-43d5dd86-6101-43d6-a526-de41d3249281 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:46.145746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43d5dd86-6101-43d6-a526-de41d3249281 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:46.146245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43d5dd86-6101-43d6-a526-de41d3249281 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:46.147422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43d5dd86-6101-43d6-a526-de41d3249281 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:46.148139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43d5dd86-6101-43d6-a526-de41d3249281 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:46.148274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43d5dd86-6101-43d6-a526-de41d3249281 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:46.148791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43d5dd86-6101-43d6-a526-de41d3249281 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:46.407981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-301277f3-d31e-4052-a2ea-9b0f9ccae386 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:46.421893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-301277f3-d31e-4052-a2ea-9b0f9ccae386 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:46.429521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-301277f3-d31e-4052-a2ea-9b0f9ccae386 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:46.437643 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-301277f3-d31e-4052-a2ea-9b0f9ccae386 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1280 microversion: 2.25 time: 0.515460 Oct 27 18:51:46.439227 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 832/1634] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:45 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1280 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:51:46.446149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9c077513-4220-456a-ac97-84c0440571af tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cdaf978-f25e-4661-995b-507b030ff398"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:46.449378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9c077513-4220-456a-ac97-84c0440571af tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:46.457517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c077513-4220-456a-ac97-84c0440571af tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:46.458322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c077513-4220-456a-ac97-84c0440571af tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:46.488924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c077513-4220-456a-ac97-84c0440571af tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:46.489800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c077513-4220-456a-ac97-84c0440571af tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:46.494454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c077513-4220-456a-ac97-84c0440571af tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:46.495009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c077513-4220-456a-ac97-84c0440571af tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:46.732127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-43d5dd86-6101-43d6-a526-de41d3249281 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:46.747436 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-43d5dd86-6101-43d6-a526-de41d3249281 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1470 microversion: 2.1 time: 0.615750 Oct 27 18:51:46.748320 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 803/1635] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:46 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1470 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:46.783893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-90e6df4c-dabb-47dc-8506-a8795c1e7ad5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:46.784664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-90e6df4c-dabb-47dc-8506-a8795c1e7ad5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:46.793797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90e6df4c-dabb-47dc-8506-a8795c1e7ad5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:46.794148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90e6df4c-dabb-47dc-8506-a8795c1e7ad5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:46.794641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90e6df4c-dabb-47dc-8506-a8795c1e7ad5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:46.795363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90e6df4c-dabb-47dc-8506-a8795c1e7ad5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:46.795814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90e6df4c-dabb-47dc-8506-a8795c1e7ad5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:46.805204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90e6df4c-dabb-47dc-8506-a8795c1e7ad5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:47.043420 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9c077513-4220-456a-ac97-84c0440571af tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "POST /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.600637 Oct 27 18:51:47.045822 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 833/1636] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 18:51:46 2022] POST /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments => generated 194 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:47.061098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-32927e45-1d06-4eb9-9d91-e76a181e722a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a7dee50>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:47.139204 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-32927e45-1d06-4eb9-9d91-e76a181e722a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/c69cd01e-4427-4465-907d-dd087e8a1b8c" status: 200 len: 662 microversion: 2.1 time: 0.091403 Oct 27 18:51:47.139820 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 834/1637] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:51:47 2022] GET /compute/v2.1/images/c69cd01e-4427-4465-907d-dd087e8a1b8c => generated 662 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:47.167540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae5e0f47-e04d-4695-9972-6cc6401cd1ea tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:47.168308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ae5e0f47-e04d-4695-9972-6cc6401cd1ea tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:47.212828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae5e0f47-e04d-4695-9972-6cc6401cd1ea tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:47.215591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae5e0f47-e04d-4695-9972-6cc6401cd1ea tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:47.216324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae5e0f47-e04d-4695-9972-6cc6401cd1ea tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:47.217359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae5e0f47-e04d-4695-9972-6cc6401cd1ea tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:47.218065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae5e0f47-e04d-4695-9972-6cc6401cd1ea tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:47.218946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae5e0f47-e04d-4695-9972-6cc6401cd1ea tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:47.237643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-90e6df4c-dabb-47dc-8506-a8795c1e7ad5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:47.251055 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-90e6df4c-dabb-47dc-8506-a8795c1e7ad5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 0.471884 Oct 27 18:51:47.251653 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 804/1638] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:46 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:47.272190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae5145f2-0d48-4a54-9cbc-9f3cdb71b952 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86ae02a60>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:47.329592 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ae5145f2-0d48-4a54-9cbc-9f3cdb71b952 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/c69cd01e-4427-4465-907d-dd087e8a1b8c" status: 200 len: 662 microversion: 2.1 time: 0.064185 Oct 27 18:51:47.340449 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 805/1639] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:51:47 2022] GET /compute/v2.1/images/c69cd01e-4427-4465-907d-dd087e8a1b8c => generated 662 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:47.350880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-bb8cc629-3c8d-4aab-856f-80327f487d02 req-cea3ffbd-2609-4905-99de-6da0d5a57a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b9a4b6f-da4c-442f-9b0c-b1828360eeef", "name": "network-vif-deleted", "tag": "ca705bb3-1c42-4e80-9e45-835a7b457c4f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:47.364169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bb8cc629-3c8d-4aab-856f-80327f487d02 req-cea3ffbd-2609-4905-99de-6da0d5a57a33 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:47.364666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bb8cc629-3c8d-4aab-856f-80327f487d02 req-cea3ffbd-2609-4905-99de-6da0d5a57a33 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:47.365142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bb8cc629-3c8d-4aab-856f-80327f487d02 req-cea3ffbd-2609-4905-99de-6da0d5a57a33 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:47.394692 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-bb8cc629-3c8d-4aab-856f-80327f487d02 req-cea3ffbd-2609-4905-99de-6da0d5a57a33 service nova] Creating event network-vif-deleted:ca705bb3-1c42-4e80-9e45-835a7b457c4f for instance 5b9a4b6f-da4c-442f-9b0c-b1828360eeef on n-h1-860687-3 Oct 27 18:51:47.406941 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-bb8cc629-3c8d-4aab-856f-80327f487d02 req-cea3ffbd-2609-4905-99de-6da0d5a57a33 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062925 Oct 27 18:51:47.407608 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 806/1640] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:47.433321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ae5e0f47-e04d-4695-9972-6cc6401cd1ea tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:47.443017 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ae5e0f47-e04d-4695-9972-6cc6401cd1ea tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1475 microversion: 2.1 time: 0.288802 Oct 27 18:51:47.444429 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 835/1641] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:47 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1475 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:47.469707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-38d4083c-ba9f-41e6-b70f-06f5390ee815 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:47.470710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-38d4083c-ba9f-41e6-b70f-06f5390ee815 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:47.480797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38d4083c-ba9f-41e6-b70f-06f5390ee815 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:47.481348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38d4083c-ba9f-41e6-b70f-06f5390ee815 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:47.482480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38d4083c-ba9f-41e6-b70f-06f5390ee815 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:47.483217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38d4083c-ba9f-41e6-b70f-06f5390ee815 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:47.483832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38d4083c-ba9f-41e6-b70f-06f5390ee815 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:47.484276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38d4083c-ba9f-41e6-b70f-06f5390ee815 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:47.487296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1873929040", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:47.558983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:51:47.663789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-38d4083c-ba9f-41e6-b70f-06f5390ee815 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:47.676378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-38d4083c-ba9f-41e6-b70f-06f5390ee815 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:47.678327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-38d4083c-ba9f-41e6-b70f-06f5390ee815 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:47.680459 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-38d4083c-ba9f-41e6-b70f-06f5390ee815 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1280 microversion: 2.25 time: 0.215093 Oct 27 18:51:47.704816 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 807/1642] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:47 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1280 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:47.795257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-32fc3aaa-ab00-434c-8d70-ca8b7105a692 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:47.797971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-32fc3aaa-ab00-434c-8d70-ca8b7105a692 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:47.825538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32fc3aaa-ab00-434c-8d70-ca8b7105a692 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:47.828087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32fc3aaa-ab00-434c-8d70-ca8b7105a692 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:47.828883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32fc3aaa-ab00-434c-8d70-ca8b7105a692 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:47.829956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32fc3aaa-ab00-434c-8d70-ca8b7105a692 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:47.833995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32fc3aaa-ab00-434c-8d70-ca8b7105a692 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:47.834763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32fc3aaa-ab00-434c-8d70-ca8b7105a692 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:48.255667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:51:48.257040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:51:48.257726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:51:48.258531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:51:48.259123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:51:48.282240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:48.283012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:48.283666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:48.284780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:48.285491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:48.286210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:48.328215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Getting quotas for project 29fb21c8e61d489fa2c8e347f32c7fe9. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:51:48.339544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Getting quotas for user 61a88f72dfe74cbf9134d52d0fcf25ed and project 29fb21c8e61d489fa2c8e347f32c7fe9. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:51:48.369518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:51:48.372385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: 1f02e8ec-759d-48bf-9d99-31fa890241c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:51:48.488847 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a15d34a2-73fe-4d93-b9d9-e00c4c22381e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005514 Oct 27 18:51:48.493040 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 836/1643] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:51:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:51:48.498058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fc981c9e-ea79-4fca-9fd6-f4819d90876e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:48.503232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fc981c9e-ea79-4fca-9fd6-f4819d90876e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:48.520984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc981c9e-ea79-4fca-9fd6-f4819d90876e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:48.521585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc981c9e-ea79-4fca-9fd6-f4819d90876e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:48.522037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc981c9e-ea79-4fca-9fd6-f4819d90876e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:48.526659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc981c9e-ea79-4fca-9fd6-f4819d90876e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:48.527166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc981c9e-ea79-4fca-9fd6-f4819d90876e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:48.527652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc981c9e-ea79-4fca-9fd6-f4819d90876e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:48.588512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-32fc3aaa-ab00-434c-8d70-ca8b7105a692 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:48.602028 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-32fc3aaa-ab00-434c-8d70-ca8b7105a692 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1470 microversion: 2.1 time: 0.818859 Oct 27 18:51:48.602999 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 808/1644] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:47 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1470 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:48.622674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bdcd4334-b036-4cd2-bce6-da6e05d616cb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:48.625634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bdcd4334-b036-4cd2-bce6-da6e05d616cb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:48.641182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdcd4334-b036-4cd2-bce6-da6e05d616cb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:48.649809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdcd4334-b036-4cd2-bce6-da6e05d616cb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:48.650954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdcd4334-b036-4cd2-bce6-da6e05d616cb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:48.651738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdcd4334-b036-4cd2-bce6-da6e05d616cb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:48.658373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdcd4334-b036-4cd2-bce6-da6e05d616cb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:48.661367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdcd4334-b036-4cd2-bce6-da6e05d616cb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:48.803966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdcd4334-b036-4cd2-bce6-da6e05d616cb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:48.813073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdcd4334-b036-4cd2-bce6-da6e05d616cb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:48.815935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdcd4334-b036-4cd2-bce6-da6e05d616cb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:48.816622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-bdcd4334-b036-4cd2-bce6-da6e05d616cb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lazy-loading 'fault' on Instance uuid 5b9a4b6f-da4c-442f-9b0c-b1828360eeef {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:51:48.970556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bdcd4334-b036-4cd2-bce6-da6e05d616cb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba01db4490774dbfb8196cb459c20dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95230f585d04c83885c8cd68f662e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:48.980377 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bdcd4334-b036-4cd2-bce6-da6e05d616cb tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 200 len: 1310 microversion: 2.1 time: 0.374527 Oct 27 18:51:48.981452 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 809/1645] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:48 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 1310 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:48.997513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9f80c7d5-088a-4c15-a121-d71ff892d46f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:48.998153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9f80c7d5-088a-4c15-a121-d71ff892d46f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:49.014643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f80c7d5-088a-4c15-a121-d71ff892d46f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:49.015154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f80c7d5-088a-4c15-a121-d71ff892d46f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:49.017456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f80c7d5-088a-4c15-a121-d71ff892d46f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:49.018414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f80c7d5-088a-4c15-a121-d71ff892d46f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:49.020914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f80c7d5-088a-4c15-a121-d71ff892d46f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:49.021561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f80c7d5-088a-4c15-a121-d71ff892d46f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:49.036550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:49.143803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fc981c9e-ea79-4fca-9fd6-f4819d90876e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:49.164571 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fc981c9e-ea79-4fca-9fd6-f4819d90876e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 0.666332 Oct 27 18:51:49.172341 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 837/1646] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:48 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:49.185621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1210638501", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:49.298867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:51:49.573357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9f80c7d5-088a-4c15-a121-d71ff892d46f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:49.587606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9f80c7d5-088a-4c15-a121-d71ff892d46f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:49.589074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9f80c7d5-088a-4c15-a121-d71ff892d46f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:49.593224 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9f80c7d5-088a-4c15-a121-d71ff892d46f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1280 microversion: 2.25 time: 0.609330 Oct 27 18:51:49.595167 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 810/1647] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:48 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1280 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:49.636344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f1a5d726-b613-4db5-9fb2-30526cbf69ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:49.638914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f1a5d726-b613-4db5-9fb2-30526cbf69ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:49.661265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1a5d726-b613-4db5-9fb2-30526cbf69ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:49.661768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1a5d726-b613-4db5-9fb2-30526cbf69ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:49.662215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1a5d726-b613-4db5-9fb2-30526cbf69ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:49.668427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1a5d726-b613-4db5-9fb2-30526cbf69ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:49.672837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1a5d726-b613-4db5-9fb2-30526cbf69ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:49.674432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1a5d726-b613-4db5-9fb2-30526cbf69ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:49.939960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:51:49.940727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:51:49.941528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:51:49.942508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:51:49.943187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:51:49.943472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f1a5d726-b613-4db5-9fb2-30526cbf69ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:49.958246 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f1a5d726-b613-4db5-9fb2-30526cbf69ae tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1463 microversion: 2.1 time: 0.329617 Oct 27 18:51:49.968270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:49.968905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:49.969589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:49.970823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:49.971962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:49.972647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:49.975191 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 811/1648] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:49 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1463 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:50.006153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Getting quotas for project 29fb21c8e61d489fa2c8e347f32c7fe9. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:51:50.021730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Getting quotas for user 61a88f72dfe74cbf9134d52d0fcf25ed and project 29fb21c8e61d489fa2c8e347f32c7fe9. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:51:50.060629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:51:50.065283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:51:50.191263 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ad33e551-1bc5-4bd3-8d3d-22d1087023bf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.015109 Oct 27 18:51:50.191952 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 838/1649] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:51:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:51:50.200821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-82edc06b-09ba-4f16-87b0-36d3d49630a6 req-7bcabe14-a885-4a4e-907f-2c593927df4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577c18dd-641c-4a06-a686-f98e0900c9ee", "name": "network-vif-plugged", "status": "completed", "tag": "c4cd9c5f-6c9c-475f-8375-20331b5dfdcf"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:50.219332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-82edc06b-09ba-4f16-87b0-36d3d49630a6 req-7bcabe14-a885-4a4e-907f-2c593927df4b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:50.219946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-82edc06b-09ba-4f16-87b0-36d3d49630a6 req-7bcabe14-a885-4a4e-907f-2c593927df4b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:50.220363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-82edc06b-09ba-4f16-87b0-36d3d49630a6 req-7bcabe14-a885-4a4e-907f-2c593927df4b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:50.235156 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-82edc06b-09ba-4f16-87b0-36d3d49630a6 req-7bcabe14-a885-4a4e-907f-2c593927df4b service nova] Creating event network-vif-plugged:c4cd9c5f-6c9c-475f-8375-20331b5dfdcf for instance 577c18dd-641c-4a06-a686-f98e0900c9ee on n-h1-860687-3 Oct 27 18:51:50.250590 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-82edc06b-09ba-4f16-87b0-36d3d49630a6 req-7bcabe14-a885-4a4e-907f-2c593927df4b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046179 Oct 27 18:51:50.252156 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 839/1650] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:50.259463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c46f8db0-e8cb-48f6-b044-089d230f7754 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:50.260635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c46f8db0-e8cb-48f6-b044-089d230f7754 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:50.271013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c46f8db0-e8cb-48f6-b044-089d230f7754 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:50.272957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c46f8db0-e8cb-48f6-b044-089d230f7754 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:50.274133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c46f8db0-e8cb-48f6-b044-089d230f7754 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:50.276181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c46f8db0-e8cb-48f6-b044-089d230f7754 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:50.276877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c46f8db0-e8cb-48f6-b044-089d230f7754 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:50.277476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c46f8db0-e8cb-48f6-b044-089d230f7754 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:50.387826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-533064729", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": "none"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:50.497415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:51:50.498095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:51:50.500473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:51:50.501707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:51:50.503749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:51:50.513527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:50.557425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:50.558237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:50.560261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:50.564457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:50.567885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:50.568532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:50.609781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Getting quotas for project 838e2192e7a74b46829aa6fa134570de. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:51:50.622817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Getting quotas for user 4d69cfaa641e47679ffc57539b6aef0c and project 838e2192e7a74b46829aa6fa134570de. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:51:50.658423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:51:50.662222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: 3772b92e-60a4-464c-8fb4-49060f978351] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:51:50.780328 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4ae0fdba-fdd5-445f-a2e0-2f50107c73f8 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.800972 Oct 27 18:51:50.787400 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 812/1651] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 18:51:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 18:51:50.800173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4f1c35a6-fa89-4e63-9487-5ab6d89b08bc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:50.800811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4f1c35a6-fa89-4e63-9487-5ab6d89b08bc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] [instance: 5b9a4b6f-da4c-442f-9b0c-b1828360eeef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:50.809637 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c46f8db0-e8cb-48f6-b044-089d230f7754 tempest-MigrationsAdminTest-1182023258 tempest-MigrationsAdminTest-1182023258-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1614 microversion: 2.1 time: 0.556047 Oct 27 18:51:50.817157 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 840/1652] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:50 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1614 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:50.822823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f1c35a6-fa89-4e63-9487-5ab6d89b08bc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:50.825073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f1c35a6-fa89-4e63-9487-5ab6d89b08bc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:50.826217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f1c35a6-fa89-4e63-9487-5ab6d89b08bc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:50.827272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f1c35a6-fa89-4e63-9487-5ab6d89b08bc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:50.828791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f1c35a6-fa89-4e63-9487-5ab6d89b08bc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:50.830416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f1c35a6-fa89-4e63-9487-5ab6d89b08bc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:50.861541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8bba51a2-134b-46af-8e55-e551ccede84a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:50.862295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8bba51a2-134b-46af-8e55-e551ccede84a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:50.877280 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-4f1c35a6-fa89-4e63-9487-5ab6d89b08bc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] HTTP exception thrown: Instance 5b9a4b6f-da4c-442f-9b0c-b1828360eeef could not be found. Oct 27 18:51:50.877508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bba51a2-134b-46af-8e55-e551ccede84a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:50.880736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bba51a2-134b-46af-8e55-e551ccede84a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4f1c35a6-fa89-4e63-9487-5ab6d89b08bc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Request method failure captured: Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef HTTP/1.1 Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtLqjVSXsPB58N4wNFWqonwq5nwL41pozyloFng3APlb6xSvd0UFMSMH1jqzHElg9XYy8H3zbXaPKJp76QtIuAnKlV0Fb7uTrY9-9rnpXeHcC6SJfRje54Kbupk7vXLpCqGe2yuBsfUBrTOWwraC3eBypCX8SMvlhsjwRewG2Kqfbwo Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f95230f585d04c83885c8cd68f662e7a Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ListServerFiltersTestJSON-1410268660 Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f95230f585d04c83885c8cd68f662e7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f95230f585d04c83885c8cd68f662e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f95230f585d04c83885c8cd68f662e7a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f95230f585d04c83885c8cd68f662e7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ListServerFiltersTestJSON-1410268660 Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f95230f585d04c83885c8cd68f662e7a Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1410268660 Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ListServerFiltersTestJSON-1410268660-project Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ba01db4490774dbfb8196cb459c20dd3 Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ListServerFiltersTestJSON-1410268660-project Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 5b9a4b6f-da4c-442f-9b0c-b1828360eeef could not be found. Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '5b9a4b6f-da4c-442f-9b0c-b1828360eeef'} Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9a4b6f-da4c-442f-9b0c-b1828360eeef could not be found. Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9a4b6f-da4c-442f-9b0c-b1828360eeef could not be found. Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:50.882275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:50.891831 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:50.891831 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:50.891831 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:50.891831 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:51:50.891831 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:51:50.891831 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9a4b6f-da4c-442f-9b0c-b1828360eeef could not be found. Oct 27 18:51:50.891831 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:51:50.891831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4f1c35a6-fa89-4e63-9487-5ab6d89b08bc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] Returning 404 to user: Instance 5b9a4b6f-da4c-442f-9b0c-b1828360eeef could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:51:50.891831 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4f1c35a6-fa89-4e63-9487-5ab6d89b08bc tempest-ListServerFiltersTestJSON-1410268660 tempest-ListServerFiltersTestJSON-1410268660-project] 10.222.0.42 "GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef" status: 404 len: 111 microversion: 2.1 time: 0.098253 Oct 27 18:51:50.891831 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 813/1653] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:50 2022] GET /compute/v2.1/servers/5b9a4b6f-da4c-442f-9b0c-b1828360eeef => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:51:50.895314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bba51a2-134b-46af-8e55-e551ccede84a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:50.901577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bba51a2-134b-46af-8e55-e551ccede84a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:50.911081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-51105240-566a-4010-a056-4539ce4a7a87 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:50.911729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-51105240-566a-4010-a056-4539ce4a7a87 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:50.913023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bba51a2-134b-46af-8e55-e551ccede84a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:50.913528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bba51a2-134b-46af-8e55-e551ccede84a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:51.138045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-51105240-566a-4010-a056-4539ce4a7a87 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:51.153312 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-51105240-566a-4010-a056-4539ce4a7a87 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1218 microversion: 2.1 time: 0.255221 Oct 27 18:51:51.154201 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 814/1654] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:50 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1218 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:51.172646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c8c6dd5f-0e97-4835-b6da-ec0286e5d742 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:51.173276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c8c6dd5f-0e97-4835-b6da-ec0286e5d742 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:51.184568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8c6dd5f-0e97-4835-b6da-ec0286e5d742 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:51.191115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8c6dd5f-0e97-4835-b6da-ec0286e5d742 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:51.191594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8c6dd5f-0e97-4835-b6da-ec0286e5d742 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:51.192362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8c6dd5f-0e97-4835-b6da-ec0286e5d742 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:51.192948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8c6dd5f-0e97-4835-b6da-ec0286e5d742 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:51.193245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8c6dd5f-0e97-4835-b6da-ec0286e5d742 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:51.539732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8bba51a2-134b-46af-8e55-e551ccede84a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:51.593014 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8bba51a2-134b-46af-8e55-e551ccede84a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 0.773978 Oct 27 18:51:51.597568 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 841/1655] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:50 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:51.615503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-69dedb0f-c2eb-42e3-a438-c024d3fe90ae tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:51.621141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-69dedb0f-c2eb-42e3-a438-c024d3fe90ae tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: 3772b92e-60a4-464c-8fb4-49060f978351] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:51.904839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-69dedb0f-c2eb-42e3-a438-c024d3fe90ae tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:51.929009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-69dedb0f-c2eb-42e3-a438-c024d3fe90ae tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:51.931821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-69dedb0f-c2eb-42e3-a438-c024d3fe90ae tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:51.933355 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-69dedb0f-c2eb-42e3-a438-c024d3fe90ae tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351" status: 200 len: 1277 microversion: 2.47 time: 0.330241 Oct 27 18:51:51.940401 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 842/1656] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:51 2022] GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351 => generated 1277 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:51.944459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c8c6dd5f-0e97-4835-b6da-ec0286e5d742 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:51.948142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4cd67af2-66d3-42ac-94b6-6c15567cc16b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:51.962024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c8c6dd5f-0e97-4835-b6da-ec0286e5d742 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:51.967027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4cd67af2-66d3-42ac-94b6-6c15567cc16b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:51.969863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c8c6dd5f-0e97-4835-b6da-ec0286e5d742 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:51.979697 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c8c6dd5f-0e97-4835-b6da-ec0286e5d742 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1280 microversion: 2.25 time: 0.810411 Oct 27 18:51:51.984878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cd67af2-66d3-42ac-94b6-6c15567cc16b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:51.990527 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 815/1657] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:51 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1280 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:51.991582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cd67af2-66d3-42ac-94b6-6c15567cc16b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:52.001605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cd67af2-66d3-42ac-94b6-6c15567cc16b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:52.002557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cd67af2-66d3-42ac-94b6-6c15567cc16b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:52.003385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cd67af2-66d3-42ac-94b6-6c15567cc16b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:52.004364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cd67af2-66d3-42ac-94b6-6c15567cc16b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:52.051721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:52.098289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1068186211", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": "none"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:52.107263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4cd67af2-66d3-42ac-94b6-6c15567cc16b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:51:52.183404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:51:52.184132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:51:52.184925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:51:52.185497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:51:52.186372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:51:52.201381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:52.201886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:52.202327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:52.204091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:52.204642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:52.205280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:52.241174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Getting quotas for project 838e2192e7a74b46829aa6fa134570de. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:51:52.248914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Getting quotas for user 4d69cfaa641e47679ffc57539b6aef0c and project 838e2192e7a74b46829aa6fa134570de. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:51:52.279533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:51:52.283296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:51:52.334502 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4cd67af2-66d3-42ac-94b6-6c15567cc16b tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 204 len: 0 microversion: 2.1 time: 0.392240 Oct 27 18:51:52.335079 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 843/1658] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:51:51 2022] DELETE /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:51:52.348063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b55704d2-4fb9-4a84-8ed7-86bffef30964 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:52.349003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b55704d2-4fb9-4a84-8ed7-86bffef30964 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:52.364345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b55704d2-4fb9-4a84-8ed7-86bffef30964 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:52.364935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b55704d2-4fb9-4a84-8ed7-86bffef30964 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:52.365424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b55704d2-4fb9-4a84-8ed7-86bffef30964 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:52.366226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b55704d2-4fb9-4a84-8ed7-86bffef30964 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:52.366777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b55704d2-4fb9-4a84-8ed7-86bffef30964 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:52.376203 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d120c0bd-9e9a-41d4-81e5-19817287c7ff tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.284173 Oct 27 18:51:52.381790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b55704d2-4fb9-4a84-8ed7-86bffef30964 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:52.385493 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 816/1659] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 18:51:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 294 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 18:51:52.390338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5a38056d-54f9-4415-a6fa-18a43ab206a1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:52.402184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5a38056d-54f9-4415-a6fa-18a43ab206a1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:52.415228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a38056d-54f9-4415-a6fa-18a43ab206a1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:52.417496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a38056d-54f9-4415-a6fa-18a43ab206a1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:52.418149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a38056d-54f9-4415-a6fa-18a43ab206a1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:52.419106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a38056d-54f9-4415-a6fa-18a43ab206a1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:52.421908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a38056d-54f9-4415-a6fa-18a43ab206a1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:52.422622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a38056d-54f9-4415-a6fa-18a43ab206a1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:53.253021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b55704d2-4fb9-4a84-8ed7-86bffef30964 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:53.262823 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b55704d2-4fb9-4a84-8ed7-86bffef30964 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1270 microversion: 2.1 time: 0.926367 Oct 27 18:51:53.265701 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 844/1660] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:52 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1270 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:53.279883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-180c9222-f9c0-400e-b929-1d84ae64e104 req-d87f1d35-242e-41d3-b240-0fccdf67ae4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577c18dd-641c-4a06-a686-f98e0900c9ee", "name": "network-vif-plugged", "status": "completed", "tag": "8a32fd83-25f1-4404-aa7a-0920aacf1688"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:53.329836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-180c9222-f9c0-400e-b929-1d84ae64e104 req-d87f1d35-242e-41d3-b240-0fccdf67ae4a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:53.330677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-180c9222-f9c0-400e-b929-1d84ae64e104 req-d87f1d35-242e-41d3-b240-0fccdf67ae4a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:53.331386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-180c9222-f9c0-400e-b929-1d84ae64e104 req-d87f1d35-242e-41d3-b240-0fccdf67ae4a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:53.357478 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-180c9222-f9c0-400e-b929-1d84ae64e104 req-d87f1d35-242e-41d3-b240-0fccdf67ae4a service nova] Creating event network-vif-plugged:8a32fd83-25f1-4404-aa7a-0920aacf1688 for instance 577c18dd-641c-4a06-a686-f98e0900c9ee on n-h1-860687-3 Oct 27 18:51:53.368819 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-180c9222-f9c0-400e-b929-1d84ae64e104 req-d87f1d35-242e-41d3-b240-0fccdf67ae4a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097157 Oct 27 18:51:53.373796 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 845/1661] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:53.386358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cc42cf00-2188-4835-baf3-d9695bcc00d0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:53.389386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cc42cf00-2188-4835-baf3-d9695bcc00d0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:53.404195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc42cf00-2188-4835-baf3-d9695bcc00d0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:53.406500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc42cf00-2188-4835-baf3-d9695bcc00d0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:53.407073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc42cf00-2188-4835-baf3-d9695bcc00d0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:53.412410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc42cf00-2188-4835-baf3-d9695bcc00d0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:53.413223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc42cf00-2188-4835-baf3-d9695bcc00d0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:53.413954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc42cf00-2188-4835-baf3-d9695bcc00d0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:54.413506 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cc42cf00-2188-4835-baf3-d9695bcc00d0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "PUT /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 992 microversion: 2.47 time: 1.037680 Oct 27 18:51:54.427736 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 846/1662] 10.222.0.42 () {62 vars in 1297 bytes} [Thu Oct 27 18:51:53 2022] PUT /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 992 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:51:54.433708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5a38056d-54f9-4415-a6fa-18a43ab206a1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:54.443484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fa31c87c-197a-47e6-b1e0-5ecaa8ab81a5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:54.444721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fa31c87c-197a-47e6-b1e0-5ecaa8ab81a5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:54.446011 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5a38056d-54f9-4415-a6fa-18a43ab206a1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1469 microversion: 2.1 time: 2.058749 Oct 27 18:51:54.450574 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 817/1663] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:52 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1469 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:54.470273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-74f0da59-f366-419d-a151-8f4bb533f3da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:54.471495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa31c87c-197a-47e6-b1e0-5ecaa8ab81a5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:54.472002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa31c87c-197a-47e6-b1e0-5ecaa8ab81a5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:54.473040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-74f0da59-f366-419d-a151-8f4bb533f3da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:54.478215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa31c87c-197a-47e6-b1e0-5ecaa8ab81a5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:54.479151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa31c87c-197a-47e6-b1e0-5ecaa8ab81a5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:54.480166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa31c87c-197a-47e6-b1e0-5ecaa8ab81a5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:54.482720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa31c87c-197a-47e6-b1e0-5ecaa8ab81a5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:54.490781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74f0da59-f366-419d-a151-8f4bb533f3da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:54.495858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74f0da59-f366-419d-a151-8f4bb533f3da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:54.496366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74f0da59-f366-419d-a151-8f4bb533f3da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:54.497145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74f0da59-f366-419d-a151-8f4bb533f3da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:54.501550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74f0da59-f366-419d-a151-8f4bb533f3da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:54.502079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74f0da59-f366-419d-a151-8f4bb533f3da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:55.175368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fa31c87c-197a-47e6-b1e0-5ecaa8ab81a5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:55.198256 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fa31c87c-197a-47e6-b1e0-5ecaa8ab81a5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 0.765091 Oct 27 18:51:55.202779 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 847/1664] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:54 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:55.241844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-81bfaf27-490e-4a6a-b437-e71b2321bfc4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:55.247846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-81bfaf27-490e-4a6a-b437-e71b2321bfc4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:55.291862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81bfaf27-490e-4a6a-b437-e71b2321bfc4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:55.295153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81bfaf27-490e-4a6a-b437-e71b2321bfc4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:55.297393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81bfaf27-490e-4a6a-b437-e71b2321bfc4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:55.299134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81bfaf27-490e-4a6a-b437-e71b2321bfc4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:55.301303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81bfaf27-490e-4a6a-b437-e71b2321bfc4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:55.301917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81bfaf27-490e-4a6a-b437-e71b2321bfc4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:55.702802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-81bfaf27-490e-4a6a-b437-e71b2321bfc4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:55.713141 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-81bfaf27-490e-4a6a-b437-e71b2321bfc4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1276 microversion: 2.1 time: 0.508254 Oct 27 18:51:55.728986 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 848/1665] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:55 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1276 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:55.729338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3eca4492-562b-49e2-87c0-f908e6aba6f4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:55.729910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3eca4492-562b-49e2-87c0-f908e6aba6f4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:55.733280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-74f0da59-f366-419d-a151-8f4bb533f3da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:55.743512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-74f0da59-f366-419d-a151-8f4bb533f3da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:55.744460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3eca4492-562b-49e2-87c0-f908e6aba6f4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:55.744973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3eca4492-562b-49e2-87c0-f908e6aba6f4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:55.745431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3eca4492-562b-49e2-87c0-f908e6aba6f4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:55.745803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-74f0da59-f366-419d-a151-8f4bb533f3da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:55.746156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3eca4492-562b-49e2-87c0-f908e6aba6f4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:55.746656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3eca4492-562b-49e2-87c0-f908e6aba6f4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:55.747095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3eca4492-562b-49e2-87c0-f908e6aba6f4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:55.747700 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-74f0da59-f366-419d-a151-8f4bb533f3da tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1280 microversion: 2.25 time: 1.295753 Oct 27 18:51:55.748769 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 818/1666] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:54 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1280 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:55.753841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b8bbc3fd-1227-4773-9081-06fa5482e79b req-5dd0bd1b-619a-4e35-80f6-31d150a39ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577c18dd-641c-4a06-a686-f98e0900c9ee", "name": "network-vif-plugged", "status": "completed", "tag": "60560a38-c725-42df-bc29-3eae66f5de45"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:55.764546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b8bbc3fd-1227-4773-9081-06fa5482e79b req-5dd0bd1b-619a-4e35-80f6-31d150a39ecb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:55.765291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b8bbc3fd-1227-4773-9081-06fa5482e79b req-5dd0bd1b-619a-4e35-80f6-31d150a39ecb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:55.766039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b8bbc3fd-1227-4773-9081-06fa5482e79b req-5dd0bd1b-619a-4e35-80f6-31d150a39ecb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:55.782624 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b8bbc3fd-1227-4773-9081-06fa5482e79b req-5dd0bd1b-619a-4e35-80f6-31d150a39ecb service nova] Creating event network-vif-plugged:60560a38-c725-42df-bc29-3eae66f5de45 for instance 577c18dd-641c-4a06-a686-f98e0900c9ee on n-h1-860687-3 Oct 27 18:51:55.788960 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b8bbc3fd-1227-4773-9081-06fa5482e79b req-5dd0bd1b-619a-4e35-80f6-31d150a39ecb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038495 Oct 27 18:51:55.790205 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 819/1667] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:55.797165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e38405b0-7f30-44c0-94de-9b129eabe7fc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:55.798097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e38405b0-7f30-44c0-94de-9b129eabe7fc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:55.805900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e38405b0-7f30-44c0-94de-9b129eabe7fc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:55.806758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e38405b0-7f30-44c0-94de-9b129eabe7fc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:55.807404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e38405b0-7f30-44c0-94de-9b129eabe7fc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:55.808347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e38405b0-7f30-44c0-94de-9b129eabe7fc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:55.809004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e38405b0-7f30-44c0-94de-9b129eabe7fc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:55.809635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e38405b0-7f30-44c0-94de-9b129eabe7fc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:55.903210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3eca4492-562b-49e2-87c0-f908e6aba6f4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:55.917066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3eca4492-562b-49e2-87c0-f908e6aba6f4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:55.922797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3eca4492-562b-49e2-87c0-f908e6aba6f4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:55.924349 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3eca4492-562b-49e2-87c0-f908e6aba6f4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1330 microversion: 2.47 time: 0.209675 Oct 27 18:51:55.927141 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 849/1668] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:55 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1330 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:56.117362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e38405b0-7f30-44c0-94de-9b129eabe7fc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:56.126695 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e38405b0-7f30-44c0-94de-9b129eabe7fc tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1427 microversion: 2.1 time: 0.335027 Oct 27 18:51:56.137522 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 820/1669] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:55 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1427 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:56.229684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e3e2a2bb-9856-47ae-a8e9-0ab751e033ba tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:56.230602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e3e2a2bb-9856-47ae-a8e9-0ab751e033ba tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:56.231241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-58d8e531-77ec-4037-8951-e88731a00e9e req-d217b75e-04c5-4101-966f-ea6d0a5f6402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8293a368-36ca-4f0c-89b2-8c9f8cd4d83f", "name": "network-vif-deleted", "tag": "ef76078a-4991-4a34-a8cf-984da56b97d3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:56.249534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e2a2bb-9856-47ae-a8e9-0ab751e033ba tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:56.250036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e2a2bb-9856-47ae-a8e9-0ab751e033ba tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:56.256108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:51:56.256393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e2a2bb-9856-47ae-a8e9-0ab751e033ba tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:56.257503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e2a2bb-9856-47ae-a8e9-0ab751e033ba tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:56.259986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-58d8e531-77ec-4037-8951-e88731a00e9e req-d217b75e-04c5-4101-966f-ea6d0a5f6402 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:56.260394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e2a2bb-9856-47ae-a8e9-0ab751e033ba tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:56.260870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e2a2bb-9856-47ae-a8e9-0ab751e033ba tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:56.262147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-58d8e531-77ec-4037-8951-e88731a00e9e req-d217b75e-04c5-4101-966f-ea6d0a5f6402 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:56.262620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-58d8e531-77ec-4037-8951-e88731a00e9e req-d217b75e-04c5-4101-966f-ea6d0a5f6402 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:56.315325 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-58d8e531-77ec-4037-8951-e88731a00e9e req-d217b75e-04c5-4101-966f-ea6d0a5f6402 service nova] Creating event network-vif-deleted:ef76078a-4991-4a34-a8cf-984da56b97d3 for instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f on n-h1-860687-3 Oct 27 18:51:56.332884 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-58d8e531-77ec-4037-8951-e88731a00e9e req-d217b75e-04c5-4101-966f-ea6d0a5f6402 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114906 Oct 27 18:51:56.334207 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 850/1670] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:56.737474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b88c59d1-e374-49d2-aa91-41a8e822bc36 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:56.739058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b88c59d1-e374-49d2-aa91-41a8e822bc36 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:56.763160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b88c59d1-e374-49d2-aa91-41a8e822bc36 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:56.764017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b88c59d1-e374-49d2-aa91-41a8e822bc36 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:56.764686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b88c59d1-e374-49d2-aa91-41a8e822bc36 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:56.765650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b88c59d1-e374-49d2-aa91-41a8e822bc36 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:56.772206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b88c59d1-e374-49d2-aa91-41a8e822bc36 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:56.773401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b88c59d1-e374-49d2-aa91-41a8e822bc36 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:56.962905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b88c59d1-e374-49d2-aa91-41a8e822bc36 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:56.975472 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b88c59d1-e374-49d2-aa91-41a8e822bc36 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1276 microversion: 2.1 time: 0.242350 Oct 27 18:51:56.992619 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 851/1671] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:56 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:57.008766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-08c7d526-d79c-4fdd-b90f-ac855124022d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:57.009658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-08c7d526-d79c-4fdd-b90f-ac855124022d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:57.016973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08c7d526-d79c-4fdd-b90f-ac855124022d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:57.027215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08c7d526-d79c-4fdd-b90f-ac855124022d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:57.028035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08c7d526-d79c-4fdd-b90f-ac855124022d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:57.029087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08c7d526-d79c-4fdd-b90f-ac855124022d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:57.029775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08c7d526-d79c-4fdd-b90f-ac855124022d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:57.030511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08c7d526-d79c-4fdd-b90f-ac855124022d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:57.367432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-08c7d526-d79c-4fdd-b90f-ac855124022d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:57.383669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-08c7d526-d79c-4fdd-b90f-ac855124022d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:57.387118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-08c7d526-d79c-4fdd-b90f-ac855124022d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:57.388320 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-08c7d526-d79c-4fdd-b90f-ac855124022d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1280 microversion: 2.25 time: 0.394491 Oct 27 18:51:57.391341 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 852/1672] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:56 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1280 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:57.405027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-133dfdb2-2c11-472d-926c-21e880f715e6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:57.405789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-133dfdb2-2c11-472d-926c-21e880f715e6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:57.419887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e3e2a2bb-9856-47ae-a8e9-0ab751e033ba tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:57.424920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-133dfdb2-2c11-472d-926c-21e880f715e6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:57.427710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-133dfdb2-2c11-472d-926c-21e880f715e6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:57.428210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-133dfdb2-2c11-472d-926c-21e880f715e6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:57.428972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-133dfdb2-2c11-472d-926c-21e880f715e6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:57.429450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-133dfdb2-2c11-472d-926c-21e880f715e6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:57.430182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-133dfdb2-2c11-472d-926c-21e880f715e6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:57.436159 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e3e2a2bb-9856-47ae-a8e9-0ab751e033ba tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 1.212837 Oct 27 18:51:57.440360 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 821/1673] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:56 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:57.470927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7f7a907-b09e-4440-9d71-4dbd8ac0d184 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:57.472030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7f7a907-b09e-4440-9d71-4dbd8ac0d184 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:57.491203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7f7a907-b09e-4440-9d71-4dbd8ac0d184 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:57.492652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7f7a907-b09e-4440-9d71-4dbd8ac0d184 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:57.495991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7f7a907-b09e-4440-9d71-4dbd8ac0d184 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:57.501961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7f7a907-b09e-4440-9d71-4dbd8ac0d184 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:57.502557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7f7a907-b09e-4440-9d71-4dbd8ac0d184 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:57.504982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7f7a907-b09e-4440-9d71-4dbd8ac0d184 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:57.583911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7f7a907-b09e-4440-9d71-4dbd8ac0d184 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:57.584538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7f7a907-b09e-4440-9d71-4dbd8ac0d184 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:57.585229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7f7a907-b09e-4440-9d71-4dbd8ac0d184 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:57.587739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-d7f7a907-b09e-4440-9d71-4dbd8ac0d184 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lazy-loading 'fault' on Instance uuid 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:51:57.737566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7f7a907-b09e-4440-9d71-4dbd8ac0d184 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:57.750930 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7f7a907-b09e-4440-9d71-4dbd8ac0d184 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1303 microversion: 2.1 time: 0.307570 Oct 27 18:51:57.765231 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 822/1674] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:57 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1303 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:57.811326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-6553c469-22e9-4f5a-bcb7-110509d6f958 req-d14987a4-b664-4d75-8783-17cdbe00ec84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d948f3-a6a5-46cb-b716-79eaf55ff690", "name": "network-vif-plugged", "status": "completed", "tag": "6b2d83f0-401a-4e99-a170-d27160cbcd4d"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:57.837933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6553c469-22e9-4f5a-bcb7-110509d6f958 req-d14987a4-b664-4d75-8783-17cdbe00ec84 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:57.838667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6553c469-22e9-4f5a-bcb7-110509d6f958 req-d14987a4-b664-4d75-8783-17cdbe00ec84 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:57.839635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-133dfdb2-2c11-472d-926c-21e880f715e6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:57.842271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6553c469-22e9-4f5a-bcb7-110509d6f958 req-d14987a4-b664-4d75-8783-17cdbe00ec84 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:57.853227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-133dfdb2-2c11-472d-926c-21e880f715e6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:57.866570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-133dfdb2-2c11-472d-926c-21e880f715e6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:57.869244 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-133dfdb2-2c11-472d-926c-21e880f715e6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1338 microversion: 2.47 time: 0.476717 Oct 27 18:51:57.869825 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 853/1675] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:57 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1338 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:57.874451 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-6553c469-22e9-4f5a-bcb7-110509d6f958 req-d14987a4-b664-4d75-8783-17cdbe00ec84 service nova] Creating event network-vif-plugged:6b2d83f0-401a-4e99-a170-d27160cbcd4d for instance 60d948f3-a6a5-46cb-b716-79eaf55ff690 on n-h2-860687-3 Oct 27 18:51:57.880914 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-6553c469-22e9-4f5a-bcb7-110509d6f958 req-d14987a4-b664-4d75-8783-17cdbe00ec84 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076432 Oct 27 18:51:57.904964 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 823/1676] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:51:58.003886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-82504d1a-10a2-4dd1-9597-5887133bfcf5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:58.004515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-82504d1a-10a2-4dd1-9597-5887133bfcf5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:58.022358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82504d1a-10a2-4dd1-9597-5887133bfcf5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:58.026795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82504d1a-10a2-4dd1-9597-5887133bfcf5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:58.027424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82504d1a-10a2-4dd1-9597-5887133bfcf5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:58.028331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82504d1a-10a2-4dd1-9597-5887133bfcf5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:58.029058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82504d1a-10a2-4dd1-9597-5887133bfcf5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:58.030573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82504d1a-10a2-4dd1-9597-5887133bfcf5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:58.415843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1e4749c7-a03e-40ba-9e96-eb0bb3cc72f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:58.416927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1e4749c7-a03e-40ba-9e96-eb0bb3cc72f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:58.432694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e4749c7-a03e-40ba-9e96-eb0bb3cc72f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:58.441237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e4749c7-a03e-40ba-9e96-eb0bb3cc72f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:58.442897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e4749c7-a03e-40ba-9e96-eb0bb3cc72f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:58.443703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e4749c7-a03e-40ba-9e96-eb0bb3cc72f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:58.448575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e4749c7-a03e-40ba-9e96-eb0bb3cc72f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:58.449041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e4749c7-a03e-40ba-9e96-eb0bb3cc72f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:58.701409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-82504d1a-10a2-4dd1-9597-5887133bfcf5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:58.709245 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-82504d1a-10a2-4dd1-9597-5887133bfcf5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1318 microversion: 2.1 time: 0.709984 Oct 27 18:51:58.728892 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 854/1677] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:57 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1318 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:58.736498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d9b611d-9fef-4a6f-a1ec-210ef9b5f81c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:58.737125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9d9b611d-9fef-4a6f-a1ec-210ef9b5f81c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:58.758351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d9b611d-9fef-4a6f-a1ec-210ef9b5f81c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:58.759069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d9b611d-9fef-4a6f-a1ec-210ef9b5f81c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:58.759513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d9b611d-9fef-4a6f-a1ec-210ef9b5f81c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:58.760233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d9b611d-9fef-4a6f-a1ec-210ef9b5f81c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:58.760814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d9b611d-9fef-4a6f-a1ec-210ef9b5f81c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:58.761111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d9b611d-9fef-4a6f-a1ec-210ef9b5f81c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:59.059029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1e4749c7-a03e-40ba-9e96-eb0bb3cc72f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:59.063889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9d9b611d-9fef-4a6f-a1ec-210ef9b5f81c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:59.077868 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9d9b611d-9fef-4a6f-a1ec-210ef9b5f81c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1354 microversion: 2.1 time: 0.347812 Oct 27 18:51:59.078062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1e4749c7-a03e-40ba-9e96-eb0bb3cc72f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:59.080723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1e4749c7-a03e-40ba-9e96-eb0bb3cc72f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:59.080980 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 855/1678] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:58 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1354 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:59.082337 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1e4749c7-a03e-40ba-9e96-eb0bb3cc72f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1280 microversion: 2.25 time: 0.672686 Oct 27 18:51:59.103051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bfe1fed2-1076-4e03-9e1a-d714816f2ac3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:59.104011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bfe1fed2-1076-4e03-9e1a-d714816f2ac3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:59.113837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe1fed2-1076-4e03-9e1a-d714816f2ac3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:59.116964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe1fed2-1076-4e03-9e1a-d714816f2ac3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:59.117690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe1fed2-1076-4e03-9e1a-d714816f2ac3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:59.122345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe1fed2-1076-4e03-9e1a-d714816f2ac3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:59.122733 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 824/1679] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:58 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1280 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:59.123299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe1fed2-1076-4e03-9e1a-d714816f2ac3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:59.123957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe1fed2-1076-4e03-9e1a-d714816f2ac3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:59.128501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-acba0975-4833-4c01-9c60-325d3352a8d6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:59.137061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-acba0975-4833-4c01-9c60-325d3352a8d6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:59.144089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acba0975-4833-4c01-9c60-325d3352a8d6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:59.144910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acba0975-4833-4c01-9c60-325d3352a8d6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:59.145504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acba0975-4833-4c01-9c60-325d3352a8d6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:59.146416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acba0975-4833-4c01-9c60-325d3352a8d6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:59.146889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acba0975-4833-4c01-9c60-325d3352a8d6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:59.147532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acba0975-4833-4c01-9c60-325d3352a8d6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:59.170170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe1fed2-1076-4e03-9e1a-d714816f2ac3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:59.171025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe1fed2-1076-4e03-9e1a-d714816f2ac3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:59.172043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe1fed2-1076-4e03-9e1a-d714816f2ac3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:59.172840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-bfe1fed2-1076-4e03-9e1a-d714816f2ac3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lazy-loading 'fault' on Instance uuid 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:51:59.224872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bfe1fed2-1076-4e03-9e1a-d714816f2ac3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:59.238134 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bfe1fed2-1076-4e03-9e1a-d714816f2ac3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 200 len: 1303 microversion: 2.1 time: 0.145407 Oct 27 18:51:59.240353 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 856/1680] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:59 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 1303 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:51:59.366296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-acba0975-4833-4c01-9c60-325d3352a8d6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:59.377140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-acba0975-4833-4c01-9c60-325d3352a8d6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:59.378641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-acba0975-4833-4c01-9c60-325d3352a8d6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:51:59.385052 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-acba0975-4833-4c01-9c60-325d3352a8d6 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1336 microversion: 2.47 time: 0.256001 Oct 27 18:51:59.385721 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 825/1681] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:51:59 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1336 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:51:59.391200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-443a977a-1676-481c-a47d-753ce64046a1 req-52359657-ff26-4952-a884-3781c00294c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f02e8ec-759d-48bf-9d99-31fa890241c1", "tag": "e08a66dd-bce1-4f3f-ae67-ea863bda862f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:51:59.410305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-443a977a-1676-481c-a47d-753ce64046a1 req-52359657-ff26-4952-a884-3781c00294c9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:59.411233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-443a977a-1676-481c-a47d-753ce64046a1 req-52359657-ff26-4952-a884-3781c00294c9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:59.412371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-443a977a-1676-481c-a47d-753ce64046a1 req-52359657-ff26-4952-a884-3781c00294c9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:59.426239 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-443a977a-1676-481c-a47d-753ce64046a1 req-52359657-ff26-4952-a884-3781c00294c9 service nova] Creating event network-changed:e08a66dd-bce1-4f3f-ae67-ea863bda862f for instance 1f02e8ec-759d-48bf-9d99-31fa890241c1 on n-h2-860687-3 Oct 27 18:51:59.433440 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-443a977a-1676-481c-a47d-753ce64046a1 req-52359657-ff26-4952-a884-3781c00294c9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046477 Oct 27 18:51:59.435276 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 826/1682] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:51:59.524050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-671b4b53-49b2-40f9-b981-686dd21bacff tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Calling method '.version_select at 0x7fc86a7d1d30>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:59.567078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-671b4b53-49b2-40f9-b981-686dd21bacff tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0da0fde0-6312-4129-a279-d760735adc8c does not exist", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:51:59.568189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.security_group_api [None req-671b4b53-49b2-40f9-b981-686dd21bacff tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Neutron security group 0da0fde0-6312-4129-a279-d760735adc8c not found {{(pid=127029) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:51:59.569164 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-671b4b53-49b2-40f9-b981-686dd21bacff tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] HTTP exception thrown: Security group 0da0fde0-6312-4129-a279-d760735adc8c does not exist Oct 27 18:51:59.569164 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-43692b39-45b4-40c9-9b8f-aef0be7df257'] Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-671b4b53-49b2-40f9-b981-686dd21bacff tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Request method failure captured: Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-security-groups/0da0fde0-6312-4129-a279-d760735adc8c HTTP/1.1 Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtNO9wKqvhXzc8jTVxRCeVGvM78JIWftouBqX_q80VIJTWXw7QCa5nHcoQ8mF0zx8wq1odv9xEl3f5zbX8Ub0w_lyLKInwZZ-Qzw13lEDdf8UY2xuY0pIqeUrrHkgCCWmr2g5FndzP8qcEx5Hk1W03N5EtMNuE80Tjn76QlVLJsl0bs Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c28e16cb72da44dda3b42b3ea33d077c Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-852804806 Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c28e16cb72da44dda3b42b3ea33d077c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c28e16cb72da44dda3b42b3ea33d077c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c28e16cb72da44dda3b42b3ea33d077c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c28e16cb72da44dda3b42b3ea33d077c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-852804806 Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c28e16cb72da44dda3b42b3ea33d077c Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-852804806 Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupsNegativeTestJSON-852804806-project Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ead3f214e4c64deb89656f71784143a0 Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-852804806-project Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: exception: Security group 0da0fde0-6312-4129-a279-d760735adc8c does not exist Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-43692b39-45b4-40c9-9b8f-aef0be7df257'] Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '0da0fde0-6312-4129-a279-d760735adc8c'} Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:51:59.572436 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0da0fde0-6312-4129-a279-d760735adc8c does not exist Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43692b39-45b4-40c9-9b8f-aef0be7df257'] Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0da0fde0-6312-4129-a279-d760735adc8c does not exist Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43692b39-45b4-40c9-9b8f-aef0be7df257'] Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0da0fde0-6312-4129-a279-d760735adc8c does not exist Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43692b39-45b4-40c9-9b8f-aef0be7df257'] Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0da0fde0-6312-4129-a279-d760735adc8c does not exist Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43692b39-45b4-40c9-9b8f-aef0be7df257'] Oct 27 18:51:59.576811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:51:59.582842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-671b4b53-49b2-40f9-b981-686dd21bacff tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Returning 404 to user: Security group 0da0fde0-6312-4129-a279-d760735adc8c does not exist Oct 27 18:51:59.582842 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-43692b39-45b4-40c9-9b8f-aef0be7df257'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:51:59.584096 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-671b4b53-49b2-40f9-b981-686dd21bacff tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/0da0fde0-6312-4129-a279-d760735adc8c" status: 404 len: 194 microversion: 2.1 time: 0.342475 Oct 27 18:51:59.589673 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 857/1683] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:51:59 2022] DELETE /compute/v2.1/os-security-groups/0da0fde0-6312-4129-a279-d760735adc8c => generated 194 bytes in 348 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:51:59.596627 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-737e2a90-4a2d-42c6-b05d-533b30a29508 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005598 Oct 27 18:51:59.597479 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 827/1684] 10.222.0.42 () {58 vars in 1164 bytes} [Thu Oct 27 18:51:59 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 18:51:59.620977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-571620f6-9354-4377-83cb-49563065fe32 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Calling method '.version_select at 0x7fc86a6f0310>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:59.738314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85de00e6-337d-4999-909f-d99c131d5e84 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:51:59.739159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85de00e6-337d-4999-909f-d99c131d5e84 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:51:59.749991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85de00e6-337d-4999-909f-d99c131d5e84 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:59.750640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85de00e6-337d-4999-909f-d99c131d5e84 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:59.751086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85de00e6-337d-4999-909f-d99c131d5e84 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:59.752346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85de00e6-337d-4999-909f-d99c131d5e84 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:51:59.752873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85de00e6-337d-4999-909f-d99c131d5e84 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:51:59.753672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85de00e6-337d-4999-909f-d99c131d5e84 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:51:59.990370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:00.031785 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-571620f6-9354-4377-83cb-49563065fe32 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.417063 Oct 27 18:52:00.033440 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 858/1685] 10.222.0.42 () {58 vars in 1158 bytes} [Thu Oct 27 18:51:59 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:00.053903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-253e07d8-f171-41b5-a938-5d7f8a8180b2 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Calling method '.version_select at 0x7fc86aa2adc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:00.340107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-85de00e6-337d-4999-909f-d99c131d5e84 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:00.379145 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85de00e6-337d-4999-909f-d99c131d5e84 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1318 microversion: 2.1 time: 0.645714 Oct 27 18:52:00.398792 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 828/1686] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:51:59 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1318 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:52:00.404521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-253e07d8-f171-41b5-a938-5d7f8a8180b2 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:52:00.406784 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-253e07d8-f171-41b5-a938-5d7f8a8180b2 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 27 18:52:00.406784 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-07e13869-6fe7-4d98-9faa-aef74fb08a09'] Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-253e07d8-f171-41b5-a938-5d7f8a8180b2 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Request method failure captured: Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-security-groups/9051c421-3539-4da2-a44f-489e3d871de1 HTTP/1.1 Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtNO9wKqvhXzc8jTVxRCeVGvM78JIWftouBqX_q80VIJTWXw7QCa5nHcoQ8mF0zx8wq1odv9xEl3f5zbX8Ub0w_lyLKInwZZ-Qzw13lEDdf8UY2xuY0pIqeUrrHkgCCWmr2g5FndzP8qcEx5Hk1W03N5EtMNuE80Tjn76QlVLJsl0bs Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c28e16cb72da44dda3b42b3ea33d077c Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-852804806 Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c28e16cb72da44dda3b42b3ea33d077c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c28e16cb72da44dda3b42b3ea33d077c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c28e16cb72da44dda3b42b3ea33d077c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c28e16cb72da44dda3b42b3ea33d077c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-852804806 Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c28e16cb72da44dda3b42b3ea33d077c Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-852804806 Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupsNegativeTestJSON-852804806-project Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ead3f214e4c64deb89656f71784143a0 Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-852804806-project Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: exception: Insufficient rights for removing default security group. Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-07e13869-6fe7-4d98-9faa-aef74fb08a09'] Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '9051c421-3539-4da2-a44f-489e3d871de1'} Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:52:00.408671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e13869-6fe7-4d98-9faa-aef74fb08a09'] Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e13869-6fe7-4d98-9faa-aef74fb08a09'] Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e13869-6fe7-4d98-9faa-aef74fb08a09'] Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e13869-6fe7-4d98-9faa-aef74fb08a09'] Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-253e07d8-f171-41b5-a938-5d7f8a8180b2 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-07e13869-6fe7-4d98-9faa-aef74fb08a09'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:52:00.413035 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-253e07d8-f171-41b5-a938-5d7f8a8180b2 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/9051c421-3539-4da2-a44f-489e3d871de1" status: 400 len: 182 microversion: 2.1 time: 0.365872 Oct 27 18:52:00.419552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a6d7bcb6-c733-4efd-a5da-3a06428a1d0f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:00.419727 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 859/1687] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:52:00 2022] DELETE /compute/v2.1/os-security-groups/9051c421-3539-4da2-a44f-489e3d871de1 => generated 182 bytes in 367 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:52:00.419727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8539a4cd-042d-42dd-8370-729c9407970a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:00.419727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8539a4cd-042d-42dd-8370-729c9407970a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:00.426043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a6d7bcb6-c733-4efd-a5da-3a06428a1d0f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:00.434213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8539a4cd-042d-42dd-8370-729c9407970a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:00.435733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8539a4cd-042d-42dd-8370-729c9407970a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:00.436438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8539a4cd-042d-42dd-8370-729c9407970a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:00.437457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8539a4cd-042d-42dd-8370-729c9407970a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:00.437993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8539a4cd-042d-42dd-8370-729c9407970a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:00.438451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8539a4cd-042d-42dd-8370-729c9407970a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:00.455425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6d7bcb6-c733-4efd-a5da-3a06428a1d0f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:00.455979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6d7bcb6-c733-4efd-a5da-3a06428a1d0f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:00.456961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6d7bcb6-c733-4efd-a5da-3a06428a1d0f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:00.458949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6d7bcb6-c733-4efd-a5da-3a06428a1d0f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:00.459429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6d7bcb6-c733-4efd-a5da-3a06428a1d0f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:00.461139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6d7bcb6-c733-4efd-a5da-3a06428a1d0f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:00.659253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8539a4cd-042d-42dd-8370-729c9407970a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:00.672102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8539a4cd-042d-42dd-8370-729c9407970a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:00.675105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8539a4cd-042d-42dd-8370-729c9407970a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:00.677463 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8539a4cd-042d-42dd-8370-729c9407970a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1476 microversion: 2.25 time: 0.265546 Oct 27 18:52:00.680243 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 860/1688] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:00 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1476 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:00.687248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-874005da-41ae-4ccb-a54d-c5c804c05db3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:00.688166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-874005da-41ae-4ccb-a54d-c5c804c05db3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:00.701257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-874005da-41ae-4ccb-a54d-c5c804c05db3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:00.702136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-874005da-41ae-4ccb-a54d-c5c804c05db3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:00.702886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-874005da-41ae-4ccb-a54d-c5c804c05db3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:00.703843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-874005da-41ae-4ccb-a54d-c5c804c05db3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:00.704944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-874005da-41ae-4ccb-a54d-c5c804c05db3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:00.706949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-874005da-41ae-4ccb-a54d-c5c804c05db3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:00.724810 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-874005da-41ae-4ccb-a54d-c5c804c05db3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] HTTP exception thrown: Instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f could not be found. Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-874005da-41ae-4ccb-a54d-c5c804c05db3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Request method failure captured: Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f HTTP/1.1 Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtIHwu7BWzo1fbGogUjJvTOtyqBweBjGX-2Z-jKASMIdKeXUaZCS0MyerPerxF0r-nxaePuWKvgRwsrSErx8kThsLBrgNTu0UtV04gQFFJ1ST8BBpppoT6gHzL6AuPBR7CfIsL0W8jrNg-7Hk-tAI12FBPAHiOKBkdR8834SGz_2KuM Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6 Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-MigrationsAdminTest-289834691 Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e7f6bb6f7db4b52ad01f0ac3d3aa8e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e7f6bb6f7db4b52ad01f0ac3d3aa8e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e7f6bb6f7db4b52ad01f0ac3d3aa8e6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e7f6bb6f7db4b52ad01f0ac3d3aa8e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-MigrationsAdminTest-289834691 Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6 Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-MigrationsAdminTest-289834691 Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-MigrationsAdminTest-289834691-project Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 1917ae65262c40b792c28c2aa4d44b44 Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-MigrationsAdminTest-289834691-project Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f could not be found. Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '8293a368-36ca-4f0c-89b2-8c9f8cd4d83f'} Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f could not be found. Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f could not be found. Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:00.726624 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.733882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:00.733882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:00.733882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:00.733882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:52:00.733882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:52:00.733882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f could not be found. Oct 27 18:52:00.733882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.733882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-874005da-41ae-4ccb-a54d-c5c804c05db3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Returning 404 to user: Instance 8293a368-36ca-4f0c-89b2-8c9f8cd4d83f could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:52:00.733882 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-874005da-41ae-4ccb-a54d-c5c804c05db3 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f" status: 404 len: 111 microversion: 2.1 time: 0.045752 Oct 27 18:52:00.733882 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 861/1689] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:00 2022] GET /compute/v2.1/servers/8293a368-36ca-4f0c-89b2-8c9f8cd4d83f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:52:00.733882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8460be8e-3eed-44ac-ba2e-10830cf106a9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:00.735659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8460be8e-3eed-44ac-ba2e-10830cf106a9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:00.741727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8460be8e-3eed-44ac-ba2e-10830cf106a9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:00.742798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8460be8e-3eed-44ac-ba2e-10830cf106a9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:00.743656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8460be8e-3eed-44ac-ba2e-10830cf106a9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:00.744626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8460be8e-3eed-44ac-ba2e-10830cf106a9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:00.745378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8460be8e-3eed-44ac-ba2e-10830cf106a9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:00.746122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8460be8e-3eed-44ac-ba2e-10830cf106a9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:00.827875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8460be8e-3eed-44ac-ba2e-10830cf106a9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:00.839349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8460be8e-3eed-44ac-ba2e-10830cf106a9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:00.840824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8460be8e-3eed-44ac-ba2e-10830cf106a9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:00.841986 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8460be8e-3eed-44ac-ba2e-10830cf106a9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1336 microversion: 2.47 time: 0.112435 Oct 27 18:52:00.842804 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 862/1690] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:00 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1336 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:00.848752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ca55bcce-0f09-487b-8efa-63f55e650d41 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Calling method '.version_select at 0x7fc86a9d03a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:00.906632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-ca55bcce-0f09-487b-8efa-63f55e650d41 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7ed0ba27-9cfb-4016-a3b7-365050cad1d8 does not exist", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:52:00.907541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.security_group_api [None req-ca55bcce-0f09-487b-8efa-63f55e650d41 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Neutron security group 7ed0ba27-9cfb-4016-a3b7-365050cad1d8 not found {{(pid=127029) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:52:00.908093 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-ca55bcce-0f09-487b-8efa-63f55e650d41 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] HTTP exception thrown: Security group 7ed0ba27-9cfb-4016-a3b7-365050cad1d8 does not exist Oct 27 18:52:00.908093 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-002045d3-d575-4e3d-a8b2-3ea5336e09fb'] Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ca55bcce-0f09-487b-8efa-63f55e650d41 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Request method failure captured: Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-security-groups/7ed0ba27-9cfb-4016-a3b7-365050cad1d8 HTTP/1.1 Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtNO9wKqvhXzc8jTVxRCeVGvM78JIWftouBqX_q80VIJTWXw7QCa5nHcoQ8mF0zx8wq1odv9xEl3f5zbX8Ub0w_lyLKInwZZ-Qzw13lEDdf8UY2xuY0pIqeUrrHkgCCWmr2g5FndzP8qcEx5Hk1W03N5EtMNuE80Tjn76QlVLJsl0bs Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c28e16cb72da44dda3b42b3ea33d077c Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-852804806 Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c28e16cb72da44dda3b42b3ea33d077c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c28e16cb72da44dda3b42b3ea33d077c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c28e16cb72da44dda3b42b3ea33d077c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c28e16cb72da44dda3b42b3ea33d077c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-852804806 Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c28e16cb72da44dda3b42b3ea33d077c Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-852804806 Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupsNegativeTestJSON-852804806-project Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ead3f214e4c64deb89656f71784143a0 Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-852804806-project Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: exception: Security group 7ed0ba27-9cfb-4016-a3b7-365050cad1d8 does not exist Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-002045d3-d575-4e3d-a8b2-3ea5336e09fb'] Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '7ed0ba27-9cfb-4016-a3b7-365050cad1d8'} Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:52:00.910013 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7ed0ba27-9cfb-4016-a3b7-365050cad1d8 does not exist Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-002045d3-d575-4e3d-a8b2-3ea5336e09fb'] Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7ed0ba27-9cfb-4016-a3b7-365050cad1d8 does not exist Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-002045d3-d575-4e3d-a8b2-3ea5336e09fb'] Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7ed0ba27-9cfb-4016-a3b7-365050cad1d8 does not exist Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-002045d3-d575-4e3d-a8b2-3ea5336e09fb'] Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7ed0ba27-9cfb-4016-a3b7-365050cad1d8 does not exist Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-002045d3-d575-4e3d-a8b2-3ea5336e09fb'] Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ca55bcce-0f09-487b-8efa-63f55e650d41 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Returning 404 to user: Security group 7ed0ba27-9cfb-4016-a3b7-365050cad1d8 does not exist Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-002045d3-d575-4e3d-a8b2-3ea5336e09fb'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:52:00.917108 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ca55bcce-0f09-487b-8efa-63f55e650d41 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/7ed0ba27-9cfb-4016-a3b7-365050cad1d8" status: 404 len: 194 microversion: 2.1 time: 0.067364 Oct 27 18:52:00.926022 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 863/1691] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 18:52:00 2022] GET /compute/v2.1/os-security-groups/7ed0ba27-9cfb-4016-a3b7-365050cad1d8 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:52:01.085551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5e3d6d23-9ba7-4797-af19-b85c1eab62f5 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:01.087233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5e3d6d23-9ba7-4797-af19-b85c1eab62f5 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:01.096236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e3d6d23-9ba7-4797-af19-b85c1eab62f5 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:01.096997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e3d6d23-9ba7-4797-af19-b85c1eab62f5 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:01.097657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e3d6d23-9ba7-4797-af19-b85c1eab62f5 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:01.098527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e3d6d23-9ba7-4797-af19-b85c1eab62f5 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:01.099089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e3d6d23-9ba7-4797-af19-b85c1eab62f5 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:01.099583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e3d6d23-9ba7-4797-af19-b85c1eab62f5 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:01.120729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:01.139415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a6d7bcb6-c733-4efd-a5da-3a06428a1d0f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:01.149025 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a6d7bcb6-c733-4efd-a5da-3a06428a1d0f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1805 microversion: 2.1 time: 0.760153 Oct 27 18:52:01.174122 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 829/1692] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:00 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1805 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:01.190296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-070129e8-1aba-4431-858e-3bb7418ae700 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:01.191136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-070129e8-1aba-4431-858e-3bb7418ae700 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:01.201349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-070129e8-1aba-4431-858e-3bb7418ae700 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:01.210040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-070129e8-1aba-4431-858e-3bb7418ae700 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:01.210645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-070129e8-1aba-4431-858e-3bb7418ae700 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:01.211561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-070129e8-1aba-4431-858e-3bb7418ae700 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:01.212276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-070129e8-1aba-4431-858e-3bb7418ae700 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:01.212981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-070129e8-1aba-4431-858e-3bb7418ae700 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:01.268761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-070129e8-1aba-4431-858e-3bb7418ae700 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:52:01.305130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-5e3d6d23-9ba7-4797-af19-b85c1eab62f5 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 60d948f3-a6a5-46cb-b716-79eaf55ff690 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:52:01.325507 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5e3d6d23-9ba7-4797-af19-b85c1eab62f5 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1968 microversion: 2.25 time: 0.404479 Oct 27 18:52:01.328308 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 864/1693] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:00 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1968 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:01.343961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:01.357100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-96b55513-4540-4ab1-8e77-abbf2c5fb762 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Action: 'update', calling method: .version_select at 0x7fc86aaf71f0>, body: {"security_group": {"name": "tempest-sg-2022510990", "description": "tempest-description-1306933686"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:01.388023 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-070129e8-1aba-4431-858e-3bb7418ae700 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "DELETE /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 204 len: 0 microversion: 2.1 time: 0.212055 Oct 27 18:52:01.390732 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 830/1694] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:52:01 2022] DELETE /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:52:01.396754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-89892fb4-ad65-4d69-ab56-70d78782e042 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:01.397591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-89892fb4-ad65-4d69-ab56-70d78782e042 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:01.406301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89892fb4-ad65-4d69-ab56-70d78782e042 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:01.407241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89892fb4-ad65-4d69-ab56-70d78782e042 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:01.407943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89892fb4-ad65-4d69-ab56-70d78782e042 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:01.409225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89892fb4-ad65-4d69-ab56-70d78782e042 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:01.410042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89892fb4-ad65-4d69-ab56-70d78782e042 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:01.410863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89892fb4-ad65-4d69-ab56-70d78782e042 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:01.428890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-96b55513-4540-4ab1-8e77-abbf2c5fb762 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b6f30dfc-4ff8-4479-a0ba-a2f1e2ebaa9b does not exist", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:52:01.430050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.security_group_api [None req-96b55513-4540-4ab1-8e77-abbf2c5fb762 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Neutron security group b6f30dfc-4ff8-4479-a0ba-a2f1e2ebaa9b not found {{(pid=127029) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:52:01.430733 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-96b55513-4540-4ab1-8e77-abbf2c5fb762 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] HTTP exception thrown: Security group b6f30dfc-4ff8-4479-a0ba-a2f1e2ebaa9b does not exist Oct 27 18:52:01.430733 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-584108aa-63f4-4040-9506-7594bc1ca3fc'] Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-96b55513-4540-4ab1-8e77-abbf2c5fb762 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Request method failure captured: Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/os-security-groups/b6f30dfc-4ff8-4479-a0ba-a2f1e2ebaa9b HTTP/1.1 Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 102 Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtNO9wKqvhXzc8jTVxRCeVGvM78JIWftouBqX_q80VIJTWXw7QCa5nHcoQ8mF0zx8wq1odv9xEl3f5zbX8Ub0w_lyLKInwZZ-Qzw13lEDdf8UY2xuY0pIqeUrrHkgCCWmr2g5FndzP8qcEx5Hk1W03N5EtMNuE80Tjn76QlVLJsl0bs Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c28e16cb72da44dda3b42b3ea33d077c Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-852804806 Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c28e16cb72da44dda3b42b3ea33d077c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c28e16cb72da44dda3b42b3ea33d077c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c28e16cb72da44dda3b42b3ea33d077c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c28e16cb72da44dda3b42b3ea33d077c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-852804806 Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c28e16cb72da44dda3b42b3ea33d077c Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-852804806 Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupsNegativeTestJSON-852804806-project Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ead3f214e4c64deb89656f71784143a0 Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-852804806-project Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: {"security_group": {"name": "tempest-sg-2022510990", "description": "tempest-description-1306933686"}} Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: exception: Security group b6f30dfc-4ff8-4479-a0ba-a2f1e2ebaa9b does not exist Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-584108aa-63f4-4040-9506-7594bc1ca3fc'] Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'b6f30dfc-4ff8-4479-a0ba-a2f1e2ebaa9b', 'body': {'security_group': {'name': 'tempest-sg-2022510990', 'description': 'tempest-description-1306933686'}}} Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:52:01.433487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b6f30dfc-4ff8-4479-a0ba-a2f1e2ebaa9b does not exist Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-584108aa-63f4-4040-9506-7594bc1ca3fc'] Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b6f30dfc-4ff8-4479-a0ba-a2f1e2ebaa9b does not exist Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-584108aa-63f4-4040-9506-7594bc1ca3fc'] Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b6f30dfc-4ff8-4479-a0ba-a2f1e2ebaa9b does not exist Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-584108aa-63f4-4040-9506-7594bc1ca3fc'] Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b6f30dfc-4ff8-4479-a0ba-a2f1e2ebaa9b does not exist Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-584108aa-63f4-4040-9506-7594bc1ca3fc'] Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-96b55513-4540-4ab1-8e77-abbf2c5fb762 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] Returning 404 to user: Security group b6f30dfc-4ff8-4479-a0ba-a2f1e2ebaa9b does not exist Oct 27 18:52:01.438629 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-584108aa-63f4-4040-9506-7594bc1ca3fc'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:52:01.443637 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-96b55513-4540-4ab1-8e77-abbf2c5fb762 tempest-SecurityGroupsNegativeTestJSON-852804806 tempest-SecurityGroupsNegativeTestJSON-852804806-project] 10.222.0.42 "PUT /compute/v2.1/os-security-groups/b6f30dfc-4ff8-4479-a0ba-a2f1e2ebaa9b" status: 404 len: 194 microversion: 2.1 time: 0.102503 Oct 27 18:52:01.443637 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 865/1695] 10.222.0.42 () {60 vars in 1290 bytes} [Thu Oct 27 18:52:01 2022] PUT /compute/v2.1/os-security-groups/b6f30dfc-4ff8-4479-a0ba-a2f1e2ebaa9b => generated 194 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:52:01.449895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-96986a8e-b828-4487-88e7-c230bea05ec2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:01.450694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-96986a8e-b828-4487-88e7-c230bea05ec2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:01.460161 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-89892fb4-ad65-4d69-ab56-70d78782e042 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee/ips" status: 200 len: 219 microversion: 2.1 time: 0.067472 Oct 27 18:52:01.469677 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 831/1696] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 18:52:01 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee/ips => generated 219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:01.476201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-025bbf24-5abe-434d-9706-5703886d235d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:01.477254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-025bbf24-5abe-434d-9706-5703886d235d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:01.485263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-025bbf24-5abe-434d-9706-5703886d235d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:01.486094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-025bbf24-5abe-434d-9706-5703886d235d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:01.486771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-025bbf24-5abe-434d-9706-5703886d235d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:01.487667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-025bbf24-5abe-434d-9706-5703886d235d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:01.488337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-025bbf24-5abe-434d-9706-5703886d235d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:01.488929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-025bbf24-5abe-434d-9706-5703886d235d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:01.494115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96986a8e-b828-4487-88e7-c230bea05ec2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:01.494653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96986a8e-b828-4487-88e7-c230bea05ec2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:01.495105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96986a8e-b828-4487-88e7-c230bea05ec2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:01.495840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96986a8e-b828-4487-88e7-c230bea05ec2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:01.496308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96986a8e-b828-4487-88e7-c230bea05ec2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:01.496750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96986a8e-b828-4487-88e7-c230bea05ec2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:01.768041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-96986a8e-b828-4487-88e7-c230bea05ec2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 60d948f3-a6a5-46cb-b716-79eaf55ff690 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:52:01.824072 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-96986a8e-b828-4487-88e7-c230bea05ec2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1968 microversion: 2.25 time: 0.378432 Oct 27 18:52:01.834564 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 866/1697] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:01 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1968 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:01.845001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a57b8e7-39d7-4bc1-82aa-14f773dc7ed1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:01.845001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5a57b8e7-39d7-4bc1-82aa-14f773dc7ed1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:01.845770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a57b8e7-39d7-4bc1-82aa-14f773dc7ed1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:01.846594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a57b8e7-39d7-4bc1-82aa-14f773dc7ed1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:01.847894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a57b8e7-39d7-4bc1-82aa-14f773dc7ed1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:01.849385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a57b8e7-39d7-4bc1-82aa-14f773dc7ed1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:01.858934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a57b8e7-39d7-4bc1-82aa-14f773dc7ed1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:01.859701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a57b8e7-39d7-4bc1-82aa-14f773dc7ed1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:01.911511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=16 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:01.991881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-025bbf24-5abe-434d-9706-5703886d235d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:02.012790 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-025bbf24-5abe-434d-9706-5703886d235d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1534 microversion: 2.1 time: 0.541614 Oct 27 18:52:02.026492 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 832/1698] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:01 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1534 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:02.026492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa27404d-5107-4c0c-83b8-f84a3cc2ac34 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:02.026492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa27404d-5107-4c0c-83b8-f84a3cc2ac34 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:02.033849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa27404d-5107-4c0c-83b8-f84a3cc2ac34 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:02.036134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa27404d-5107-4c0c-83b8-f84a3cc2ac34 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:02.036828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa27404d-5107-4c0c-83b8-f84a3cc2ac34 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:02.037798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa27404d-5107-4c0c-83b8-f84a3cc2ac34 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:02.038517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa27404d-5107-4c0c-83b8-f84a3cc2ac34 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:02.039781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa27404d-5107-4c0c-83b8-f84a3cc2ac34 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:02.079140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa27404d-5107-4c0c-83b8-f84a3cc2ac34 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:52:02.214855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:02.266868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5a57b8e7-39d7-4bc1-82aa-14f773dc7ed1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:02.272098 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fa27404d-5107-4c0c-83b8-f84a3cc2ac34 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "DELETE /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 204 len: 0 microversion: 2.1 time: 0.256015 Oct 27 18:52:02.274647 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 833/1699] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:52:02 2022] DELETE /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:52:02.277429 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5a57b8e7-39d7-4bc1-82aa-14f773dc7ed1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1318 microversion: 2.1 time: 0.446311 Oct 27 18:52:02.281853 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 867/1700] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:01 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:02.287972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-9a955fbc-95d0-47d4-9677-53726d06dd38 req-0764d781-9b08-4a9d-8fb4-d1c851927999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac5e11da-2f25-4433-98d7-8f5b0620095f", "tag": "00a226a6-58cf-4f6d-9bc2-e12c43140523"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:02.290576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c138f774-c13f-4dd4-ae36-edee584a038c tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:02.294608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c138f774-c13f-4dd4-ae36-edee584a038c tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:02.297559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c138f774-c13f-4dd4-ae36-edee584a038c tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:02.299859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=18 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:02.301725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c138f774-c13f-4dd4-ae36-edee584a038c tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:02.302819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c138f774-c13f-4dd4-ae36-edee584a038c tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:02.303216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9a955fbc-95d0-47d4-9677-53726d06dd38 req-0764d781-9b08-4a9d-8fb4-d1c851927999 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:02.303967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9a955fbc-95d0-47d4-9677-53726d06dd38 req-0764d781-9b08-4a9d-8fb4-d1c851927999 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:02.305198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c138f774-c13f-4dd4-ae36-edee584a038c tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:02.307680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c138f774-c13f-4dd4-ae36-edee584a038c tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:02.312739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9a955fbc-95d0-47d4-9677-53726d06dd38 req-0764d781-9b08-4a9d-8fb4-d1c851927999 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:02.333477 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-9a955fbc-95d0-47d4-9677-53726d06dd38 req-0764d781-9b08-4a9d-8fb4-d1c851927999 service nova] Creating event network-changed:00a226a6-58cf-4f6d-9bc2-e12c43140523 for instance ac5e11da-2f25-4433-98d7-8f5b0620095f on n-h1-860687-3 Oct 27 18:52:02.341365 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-9a955fbc-95d0-47d4-9677-53726d06dd38 req-0764d781-9b08-4a9d-8fb4-d1c851927999 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063627 Oct 27 18:52:02.342367 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 834/1701] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:02.361955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-012bc849-cfd6-4411-bf9b-0c190240c6c0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:02.363753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-012bc849-cfd6-4411-bf9b-0c190240c6c0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:02.384392 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c138f774-c13f-4dd4-ae36-edee584a038c tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.101080 Oct 27 18:52:02.385848 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 868/1702] 10.222.0.42 () {60 vars in 1217 bytes} [Thu Oct 27 18:52:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:52:02.391721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-485d2b7b-7390-4348-b5ed-166dd8be8698 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:02.392874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-485d2b7b-7390-4348-b5ed-166dd8be8698 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:02.397623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-012bc849-cfd6-4411-bf9b-0c190240c6c0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:02.399816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-012bc849-cfd6-4411-bf9b-0c190240c6c0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:02.400467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-012bc849-cfd6-4411-bf9b-0c190240c6c0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:02.402203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-012bc849-cfd6-4411-bf9b-0c190240c6c0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:02.404233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-012bc849-cfd6-4411-bf9b-0c190240c6c0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:02.404700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-012bc849-cfd6-4411-bf9b-0c190240c6c0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:02.411678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-485d2b7b-7390-4348-b5ed-166dd8be8698 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:02.413064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-485d2b7b-7390-4348-b5ed-166dd8be8698 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:02.413688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-485d2b7b-7390-4348-b5ed-166dd8be8698 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:02.415020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-485d2b7b-7390-4348-b5ed-166dd8be8698 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:02.415708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-485d2b7b-7390-4348-b5ed-166dd8be8698 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:02.416305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-485d2b7b-7390-4348-b5ed-166dd8be8698 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:02.798818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-012bc849-cfd6-4411-bf9b-0c190240c6c0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:02.816832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-012bc849-cfd6-4411-bf9b-0c190240c6c0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:02.818311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-012bc849-cfd6-4411-bf9b-0c190240c6c0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:02.819566 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-012bc849-cfd6-4411-bf9b-0c190240c6c0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1357 microversion: 2.47 time: 0.469298 Oct 27 18:52:02.820653 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 835/1703] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:02 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1357 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:02.841921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d71f8012-732f-4a46-b2da-29a33d3fe9bb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860687-3", "block_migration": "auto"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:02.845616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d71f8012-732f-4a46-b2da-29a33d3fe9bb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:02.857991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d71f8012-732f-4a46-b2da-29a33d3fe9bb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:02.858538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d71f8012-732f-4a46-b2da-29a33d3fe9bb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:02.858987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d71f8012-732f-4a46-b2da-29a33d3fe9bb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:02.859717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d71f8012-732f-4a46-b2da-29a33d3fe9bb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:02.860178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d71f8012-732f-4a46-b2da-29a33d3fe9bb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:02.860611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d71f8012-732f-4a46-b2da-29a33d3fe9bb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:02.890217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-485d2b7b-7390-4348-b5ed-166dd8be8698 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:02.897683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-d71f8012-732f-4a46-b2da-29a33d3fe9bb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'flavor' on Instance uuid 60d948f3-a6a5-46cb-b716-79eaf55ff690 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:52:02.900272 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-485d2b7b-7390-4348-b5ed-166dd8be8698 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1811 microversion: 2.1 time: 0.513101 Oct 27 18:52:02.900859 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 869/1704] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:02 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1811 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:02.917196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:02.920088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:02.920933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d71f8012-732f-4a46-b2da-29a33d3fe9bb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Going to try to live migrate instance to n-h1-860687-3 {{(pid=127028) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 18:52:02.936367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:02.937426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:02.938184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:02.950949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:02.953762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:02.955606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:03.130736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:52:03.131721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:52:03.132370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:52:03.135925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:52:03.136371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:52:03.304041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:03.317110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:03.322167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:03.324432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:03.326777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:03.327868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:03.328689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:03.405663 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-968dc4e9-b221-416e-9ace-0691dfe78a73 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "POST /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde/action" status: 202 len: 1079 microversion: 2.47 time: 0.498310 Oct 27 18:52:03.429135 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 870/1705] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 18:52:02 2022] POST /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde/action => generated 1079 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 18:52:03.441365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e6209cb1-b2a9-4cc2-b838-b6380ec73277 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:03.443886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e6209cb1-b2a9-4cc2-b838-b6380ec73277 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:03.462151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6209cb1-b2a9-4cc2-b838-b6380ec73277 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:03.466231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6209cb1-b2a9-4cc2-b838-b6380ec73277 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:03.466777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6209cb1-b2a9-4cc2-b838-b6380ec73277 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:03.470017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6209cb1-b2a9-4cc2-b838-b6380ec73277 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:03.471621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6209cb1-b2a9-4cc2-b838-b6380ec73277 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:03.472082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6209cb1-b2a9-4cc2-b838-b6380ec73277 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:03.830084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e6209cb1-b2a9-4cc2-b838-b6380ec73277 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:03.844418 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e6209cb1-b2a9-4cc2-b838-b6380ec73277 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1534 microversion: 2.1 time: 0.413744 Oct 27 18:52:03.856312 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 871/1706] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:03 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1534 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:03.856312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f2bdecd5-1a7e-4359-87d1-fef38e325f73 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:03.856312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f2bdecd5-1a7e-4359-87d1-fef38e325f73 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:03.874699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2bdecd5-1a7e-4359-87d1-fef38e325f73 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:03.875660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2bdecd5-1a7e-4359-87d1-fef38e325f73 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:03.878097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2bdecd5-1a7e-4359-87d1-fef38e325f73 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:03.881350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2bdecd5-1a7e-4359-87d1-fef38e325f73 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:03.882029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2bdecd5-1a7e-4359-87d1-fef38e325f73 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:03.882476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2bdecd5-1a7e-4359-87d1-fef38e325f73 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:04.239273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f2bdecd5-1a7e-4359-87d1-fef38e325f73 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:04.250101 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f2bdecd5-1a7e-4359-87d1-fef38e325f73 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1318 microversion: 2.1 time: 0.403697 Oct 27 18:52:04.250742 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 872/1707] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:03 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:04.280635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4eb3b9df-3c35-4f2b-922a-f66e1ea199da tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:04.284698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4eb3b9df-3c35-4f2b-922a-f66e1ea199da tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:04.292059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4eb3b9df-3c35-4f2b-922a-f66e1ea199da tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:04.292805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4eb3b9df-3c35-4f2b-922a-f66e1ea199da tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:04.293465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4eb3b9df-3c35-4f2b-922a-f66e1ea199da tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:04.294606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4eb3b9df-3c35-4f2b-922a-f66e1ea199da tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:04.305374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4eb3b9df-3c35-4f2b-922a-f66e1ea199da tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:04.310109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4eb3b9df-3c35-4f2b-922a-f66e1ea199da tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:04.430342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4eb3b9df-3c35-4f2b-922a-f66e1ea199da tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:04.444598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4eb3b9df-3c35-4f2b-922a-f66e1ea199da tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:04.446655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4eb3b9df-3c35-4f2b-922a-f66e1ea199da tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:04.448177 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4eb3b9df-3c35-4f2b-922a-f66e1ea199da tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.175640 Oct 27 18:52:04.449282 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 873/1708] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:04 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:04.454230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aa4367dc-1b50-43a0-a5a0-635f66e17321 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:04.454999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-aa4367dc-1b50-43a0-a5a0-635f66e17321 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:04.461655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa4367dc-1b50-43a0-a5a0-635f66e17321 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:04.462239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa4367dc-1b50-43a0-a5a0-635f66e17321 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:04.462780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa4367dc-1b50-43a0-a5a0-635f66e17321 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:04.463646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa4367dc-1b50-43a0-a5a0-635f66e17321 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:04.464325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa4367dc-1b50-43a0-a5a0-635f66e17321 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:04.464828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa4367dc-1b50-43a0-a5a0-635f66e17321 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:04.903354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-aa4367dc-1b50-43a0-a5a0-635f66e17321 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:04.918290 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aa4367dc-1b50-43a0-a5a0-635f66e17321 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1811 microversion: 2.1 time: 0.465511 Oct 27 18:52:04.919363 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 874/1709] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:04 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1811 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:04.927542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-37b3f563-927a-4a27-9df4-8f26808e6c8a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:04.928293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-37b3f563-927a-4a27-9df4-8f26808e6c8a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:04.944047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37b3f563-927a-4a27-9df4-8f26808e6c8a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:04.944567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37b3f563-927a-4a27-9df4-8f26808e6c8a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:04.948259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37b3f563-927a-4a27-9df4-8f26808e6c8a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:04.949050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37b3f563-927a-4a27-9df4-8f26808e6c8a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:04.949724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37b3f563-927a-4a27-9df4-8f26808e6c8a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:04.950363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37b3f563-927a-4a27-9df4-8f26808e6c8a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:05.626850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-37b3f563-927a-4a27-9df4-8f26808e6c8a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:05.636324 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-37b3f563-927a-4a27-9df4-8f26808e6c8a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 200 len: 1534 microversion: 2.1 time: 0.715791 Oct 27 18:52:05.644033 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 875/1710] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:04 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 1534 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:05.649763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-517d23b8-bd21-4a38-9bc3-666450ecee48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:05.650419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-517d23b8-bd21-4a38-9bc3-666450ecee48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:05.670069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-517d23b8-bd21-4a38-9bc3-666450ecee48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:05.670726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-517d23b8-bd21-4a38-9bc3-666450ecee48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:05.671631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-517d23b8-bd21-4a38-9bc3-666450ecee48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:05.672787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-517d23b8-bd21-4a38-9bc3-666450ecee48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:05.673256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-517d23b8-bd21-4a38-9bc3-666450ecee48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:05.673868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-517d23b8-bd21-4a38-9bc3-666450ecee48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:06.313020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-517d23b8-bd21-4a38-9bc3-666450ecee48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:06.323397 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-517d23b8-bd21-4a38-9bc3-666450ecee48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1318 microversion: 2.1 time: 0.678159 Oct 27 18:52:06.335162 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 876/1711] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:05 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:06.340370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-77e09d3b-6bcf-4269-af2f-10288d3ccbd4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:06.341211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-77e09d3b-6bcf-4269-af2f-10288d3ccbd4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:06.350890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77e09d3b-6bcf-4269-af2f-10288d3ccbd4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:06.352086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77e09d3b-6bcf-4269-af2f-10288d3ccbd4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:06.352591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77e09d3b-6bcf-4269-af2f-10288d3ccbd4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:06.353419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77e09d3b-6bcf-4269-af2f-10288d3ccbd4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:06.353890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77e09d3b-6bcf-4269-af2f-10288d3ccbd4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:06.358598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77e09d3b-6bcf-4269-af2f-10288d3ccbd4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:06.552569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-77e09d3b-6bcf-4269-af2f-10288d3ccbd4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:06.572535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-77e09d3b-6bcf-4269-af2f-10288d3ccbd4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:06.587135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-77e09d3b-6bcf-4269-af2f-10288d3ccbd4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:06.598083 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-77e09d3b-6bcf-4269-af2f-10288d3ccbd4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.261487 Oct 27 18:52:06.599235 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 877/1712] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:06 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:06.608088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7a5e11e4-0a52-4660-b656-bd98d1d208cb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:06.609579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7a5e11e4-0a52-4660-b656-bd98d1d208cb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:06.626073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a5e11e4-0a52-4660-b656-bd98d1d208cb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:06.626611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a5e11e4-0a52-4660-b656-bd98d1d208cb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:06.627506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a5e11e4-0a52-4660-b656-bd98d1d208cb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:06.628091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a5e11e4-0a52-4660-b656-bd98d1d208cb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:06.628314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a5e11e4-0a52-4660-b656-bd98d1d208cb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:06.628658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a5e11e4-0a52-4660-b656-bd98d1d208cb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:07.567215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7a5e11e4-0a52-4660-b656-bd98d1d208cb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:07.581521 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7a5e11e4-0a52-4660-b656-bd98d1d208cb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1811 microversion: 2.1 time: 0.981040 Oct 27 18:52:07.582351 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 878/1713] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:06 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1811 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:07.593286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-4a68da89-ca79-4431-b5d6-330bfc971772 req-b15cc75f-c12f-429d-9e63-a27c4523f02b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873ced30-1179-4f52-9356-8e2f6c310959", "name": "network-vif-deleted", "tag": "fc24a5e3-d26b-4205-b920-4db5d5e6467b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:07.618030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4a68da89-ca79-4431-b5d6-330bfc971772 req-b15cc75f-c12f-429d-9e63-a27c4523f02b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:07.625830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4a68da89-ca79-4431-b5d6-330bfc971772 req-b15cc75f-c12f-429d-9e63-a27c4523f02b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:07.629077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4a68da89-ca79-4431-b5d6-330bfc971772 req-b15cc75f-c12f-429d-9e63-a27c4523f02b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:07.660885 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-4a68da89-ca79-4431-b5d6-330bfc971772 req-b15cc75f-c12f-429d-9e63-a27c4523f02b service nova] Creating event network-vif-deleted:fc24a5e3-d26b-4205-b920-4db5d5e6467b for instance 873ced30-1179-4f52-9356-8e2f6c310959 on n-h2-860687-3 Oct 27 18:52:07.687955 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-4a68da89-ca79-4431-b5d6-330bfc971772 req-b15cc75f-c12f-429d-9e63-a27c4523f02b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104099 Oct 27 18:52:07.688905 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 879/1714] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:07.920827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-78a3114c-25dc-4360-94fe-5e8b8b18750b tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "78bb6a99-dae2-4a73-ac06-b4238866e2f2"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:07.923646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-78a3114c-25dc-4360-94fe-5e8b8b18750b tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:07.938324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78a3114c-25dc-4360-94fe-5e8b8b18750b tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:07.938864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78a3114c-25dc-4360-94fe-5e8b8b18750b tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:07.939318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78a3114c-25dc-4360-94fe-5e8b8b18750b tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:07.940266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78a3114c-25dc-4360-94fe-5e8b8b18750b tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:07.940907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78a3114c-25dc-4360-94fe-5e8b8b18750b tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:07.941521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78a3114c-25dc-4360-94fe-5e8b8b18750b tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:08.252204 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d71f8012-732f-4a46-b2da-29a33d3fe9bb tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690/action" status: 202 len: 0 microversion: 2.25 time: 5.429558 Oct 27 18:52:08.253739 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 836/1715] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 18:52:02 2022] POST /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690/action => generated 0 bytes in 5432 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:52:08.260623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fe848467-82c1-415f-8d15-daf4c2680c34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:08.262968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fe848467-82c1-415f-8d15-daf4c2680c34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 873ced30-1179-4f52-9356-8e2f6c310959] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:08.264793 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-78a3114c-25dc-4360-94fe-5e8b8b18750b tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] HTTP exception thrown: Volume 78bb6a99-dae2-4a73-ac06-b4238866e2f2 could not be found. Oct 27 18:52:08.319108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe848467-82c1-415f-8d15-daf4c2680c34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:08.319622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe848467-82c1-415f-8d15-daf4c2680c34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-78a3114c-25dc-4360-94fe-5e8b8b18750b tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Request method failure captured: Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments/1cdaf978-f25e-4661-995b-507b030ff398 HTTP/1.1 Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 74 Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtLNS8yB5Q0hczvkqbY6XYxp3CQxbfEpwutiknjyIZOmqN_92eouxP6Yyh0JAAlZCEnX8KcsdGXGGQ3SmFPyu4fwJ_9v5MakKFE_POE8W58XEwt_JZcYY-fGwP9SQA_-NZTT88beYA4MtyYf1LHnUd3MOfcyiYis-MOAZBi8twm3km8 Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 21a168d06680435ea91c0b4ef0326031 Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-VolumesAdminNegativeTest-1659364617 Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/21a168d06680435ea91c0b4ef0326031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/21a168d06680435ea91c0b4ef0326031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_21a168d06680435ea91c0b4ef0326031", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/21a168d06680435ea91c0b4ef0326031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-VolumesAdminNegativeTest-1659364617 Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 21a168d06680435ea91c0b4ef0326031 Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1659364617 Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-VolumesAdminNegativeTest-1659364617-project-admin Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 572c69bd9c96480995afd58c91f34590 Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-VolumesAdminNegativeTest-1659364617-project-admin Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: {"volumeAttachment": {"volumeId": "78bb6a99-dae2-4a73-ac06-b4238866e2f2"}} Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: exception: Volume 78bb6a99-dae2-4a73-ac06-b4238866e2f2 could not be found. Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'server_id': 'e561b8d1-1362-4ae7-8578-5971e739c9e1', 'id': '1cdaf978-f25e-4661-995b-507b030ff398', 'body': {'volumeAttachment': {'volumeId': '78bb6a99-dae2-4a73-ac06-b4238866e2f2'}}} Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 78bb6a99-dae2-4a73-ac06-b4238866e2f2 could not be found. (HTTP 404) (Request-ID: req-68463ca8-f662-4297-8ee7-44197046ad0f) Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 18:52:08.320681 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 78bb6a99-dae2-4a73-ac06-b4238866e2f2 could not be found. Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 78bb6a99-dae2-4a73-ac06-b4238866e2f2 could not be found. Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 78bb6a99-dae2-4a73-ac06-b4238866e2f2 could not be found. Oct 27 18:52:08.326053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:08.329898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe848467-82c1-415f-8d15-daf4c2680c34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:08.329898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe848467-82c1-415f-8d15-daf4c2680c34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:08.329898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe848467-82c1-415f-8d15-daf4c2680c34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:08.329898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe848467-82c1-415f-8d15-daf4c2680c34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:08.331365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-78a3114c-25dc-4360-94fe-5e8b8b18750b tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Returning 400 to user: Volume 78bb6a99-dae2-4a73-ac06-b4238866e2f2 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:52:08.332709 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-78a3114c-25dc-4360-94fe-5e8b8b18750b tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] 10.222.0.42 "PUT /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments/1cdaf978-f25e-4661-995b-507b030ff398" status: 400 len: 107 microversion: 2.1 time: 0.642532 Oct 27 18:52:08.333911 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 880/1716] 10.222.0.42 () {60 vars in 1433 bytes} [Thu Oct 27 18:52:07 2022] PUT /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments/1cdaf978-f25e-4661-995b-507b030ff398 => generated 107 bytes in 644 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:52:08.343834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-279e83b4-e1b7-4a25-bbed-a5a3f7684166 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:08.344783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-279e83b4-e1b7-4a25-bbed-a5a3f7684166 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:08.360402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-279e83b4-e1b7-4a25-bbed-a5a3f7684166 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:08.366266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-279e83b4-e1b7-4a25-bbed-a5a3f7684166 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:08.367264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-279e83b4-e1b7-4a25-bbed-a5a3f7684166 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:08.368237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-279e83b4-e1b7-4a25-bbed-a5a3f7684166 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:08.368885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-279e83b4-e1b7-4a25-bbed-a5a3f7684166 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:08.369500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-279e83b4-e1b7-4a25-bbed-a5a3f7684166 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:08.379438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:08.436523 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-fe848467-82c1-415f-8d15-daf4c2680c34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] HTTP exception thrown: Instance 873ced30-1179-4f52-9356-8e2f6c310959 could not be found. Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fe848467-82c1-415f-8d15-daf4c2680c34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Request method failure captured: Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 HTTP/1.1 Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtIHwu7BWzo1fbGogUjJvTOtyqBweBjGX-2Z-jKASMIdKeXUaZCS0MyerPerxF0r-nxaePuWKvgRwsrSErx8kThsLBrgNTu0UtV04gQFFJ1ST8BBpppoT6gHzL6AuPBR7CfIsL0W8jrNg-7Hk-tAI12FBPAHiOKBkdR8834SGz_2KuM Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6 Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-MigrationsAdminTest-289834691 Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e7f6bb6f7db4b52ad01f0ac3d3aa8e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e7f6bb6f7db4b52ad01f0ac3d3aa8e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e7f6bb6f7db4b52ad01f0ac3d3aa8e6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e7f6bb6f7db4b52ad01f0ac3d3aa8e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-MigrationsAdminTest-289834691 Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6 Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-MigrationsAdminTest-289834691 Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-MigrationsAdminTest-289834691-project Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 1917ae65262c40b792c28c2aa4d44b44 Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-MigrationsAdminTest-289834691-project Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 873ced30-1179-4f52-9356-8e2f6c310959 could not be found. Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '873ced30-1179-4f52-9356-8e2f6c310959'} Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873ced30-1179-4f52-9356-8e2f6c310959 could not be found. Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873ced30-1179-4f52-9356-8e2f6c310959 could not be found. Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:08.449627 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:08.455420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:08.455420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:08.455420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:08.455420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:52:08.455420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:52:08.455420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873ced30-1179-4f52-9356-8e2f6c310959 could not be found. Oct 27 18:52:08.455420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:08.455420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fe848467-82c1-415f-8d15-daf4c2680c34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Returning 404 to user: Instance 873ced30-1179-4f52-9356-8e2f6c310959 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:52:08.455420 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fe848467-82c1-415f-8d15-daf4c2680c34 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959" status: 404 len: 111 microversion: 2.1 time: 0.198681 Oct 27 18:52:08.455420 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 837/1717] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:08 2022] GET /compute/v2.1/servers/873ced30-1179-4f52-9356-8e2f6c310959 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:52:08.459990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-92743744-b003-4e0c-a231-47467ccd0753 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:08.460944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-92743744-b003-4e0c-a231-47467ccd0753 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:08.470521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92743744-b003-4e0c-a231-47467ccd0753 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:08.471012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92743744-b003-4e0c-a231-47467ccd0753 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:08.471449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92743744-b003-4e0c-a231-47467ccd0753 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:08.472161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92743744-b003-4e0c-a231-47467ccd0753 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:08.472616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92743744-b003-4e0c-a231-47467ccd0753 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:08.473048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92743744-b003-4e0c-a231-47467ccd0753 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:08.597763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-92743744-b003-4e0c-a231-47467ccd0753 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:08.612603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-92743744-b003-4e0c-a231-47467ccd0753 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:08.614486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-92743744-b003-4e0c-a231-47467ccd0753 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:08.616000 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-92743744-b003-4e0c-a231-47467ccd0753 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.160189 Oct 27 18:52:08.618945 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 838/1718] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:08 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:08.625595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-59bbe9bb-71ba-4ee3-9ee4-f22a55c2bc4e req-ea8c96e3-d4ab-427b-97e3-49891caac777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577c18dd-641c-4a06-a686-f98e0900c9ee", "name": "network-vif-deleted", "tag": "c4cd9c5f-6c9c-475f-8375-20331b5dfdcf"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:08.643851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-59bbe9bb-71ba-4ee3-9ee4-f22a55c2bc4e req-ea8c96e3-d4ab-427b-97e3-49891caac777 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:08.644700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-59bbe9bb-71ba-4ee3-9ee4-f22a55c2bc4e req-ea8c96e3-d4ab-427b-97e3-49891caac777 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:08.645300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-59bbe9bb-71ba-4ee3-9ee4-f22a55c2bc4e req-ea8c96e3-d4ab-427b-97e3-49891caac777 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:08.670000 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-59bbe9bb-71ba-4ee3-9ee4-f22a55c2bc4e req-ea8c96e3-d4ab-427b-97e3-49891caac777 service nova] Creating event network-vif-deleted:c4cd9c5f-6c9c-475f-8375-20331b5dfdcf for instance 577c18dd-641c-4a06-a686-f98e0900c9ee on n-h1-860687-3 Oct 27 18:52:08.678038 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-59bbe9bb-71ba-4ee3-9ee4-f22a55c2bc4e req-ea8c96e3-d4ab-427b-97e3-49891caac777 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057608 Oct 27 18:52:08.679184 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 839/1719] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:08.688175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f774540b-8c16-4173-8d6b-71e31a94267e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:08.689214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f774540b-8c16-4173-8d6b-71e31a94267e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:08.699495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f774540b-8c16-4173-8d6b-71e31a94267e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:08.700579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f774540b-8c16-4173-8d6b-71e31a94267e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:08.701361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f774540b-8c16-4173-8d6b-71e31a94267e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:08.702277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f774540b-8c16-4173-8d6b-71e31a94267e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:08.703258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f774540b-8c16-4173-8d6b-71e31a94267e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:08.703860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f774540b-8c16-4173-8d6b-71e31a94267e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:08.939038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-279e83b4-e1b7-4a25-bbed-a5a3f7684166 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:08.947988 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-279e83b4-e1b7-4a25-bbed-a5a3f7684166 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1318 microversion: 2.1 time: 0.612572 Oct 27 18:52:08.949147 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 881/1720] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:08 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1318 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:08.955324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-adb423a3-b903-4332-b2c9-6b6bee118a04 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:08.956039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-adb423a3-b903-4332-b2c9-6b6bee118a04 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:08.976211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adb423a3-b903-4332-b2c9-6b6bee118a04 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:08.986167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adb423a3-b903-4332-b2c9-6b6bee118a04 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:08.991181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adb423a3-b903-4332-b2c9-6b6bee118a04 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:08.992135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adb423a3-b903-4332-b2c9-6b6bee118a04 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:08.992647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adb423a3-b903-4332-b2c9-6b6bee118a04 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:08.993161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adb423a3-b903-4332-b2c9-6b6bee118a04 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:09.187039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-adb423a3-b903-4332-b2c9-6b6bee118a04 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lazy-loading 'services' on Instance uuid e561b8d1-1362-4ae7-8578-5971e739c9e1 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:52:09.411096 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-adb423a3-b903-4332-b2c9-6b6bee118a04 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments/1cdaf978-f25e-4661-995b-507b030ff398" status: 202 len: 0 microversion: 2.1 time: 0.460355 Oct 27 18:52:09.460681 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 882/1721] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 18:52:08 2022] DELETE /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments/1cdaf978-f25e-4661-995b-507b030ff398 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:52:09.470345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f774540b-8c16-4173-8d6b-71e31a94267e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:09.485036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-60153e87-7ab0-4176-abbd-28c04888140f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '.version_select at 0x7fc86b314670>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:09.492524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f774540b-8c16-4173-8d6b-71e31a94267e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:09.519361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f774540b-8c16-4173-8d6b-71e31a94267e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:09.520752 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f774540b-8c16-4173-8d6b-71e31a94267e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.838905 Oct 27 18:52:09.523665 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 840/1722] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:08 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:09.536372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9412db80-1eef-4464-b39f-6a95d7dd936b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:09.539817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9412db80-1eef-4464-b39f-6a95d7dd936b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:09.548370 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-60153e87-7ab0-4176-abbd-28c04888140f tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1867489722" status: 202 len: 0 microversion: 2.1 time: 0.082125 Oct 27 18:52:09.550946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:09.554273 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 883/1723] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 18:52:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1867489722 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:52:09.561237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4dd148c8-8e5b-4bec-b8fe-3d9713cec7a3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:09.564405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4dd148c8-8e5b-4bec-b8fe-3d9713cec7a3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:09.572529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dd148c8-8e5b-4bec-b8fe-3d9713cec7a3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:09.573614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dd148c8-8e5b-4bec-b8fe-3d9713cec7a3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:09.574503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dd148c8-8e5b-4bec-b8fe-3d9713cec7a3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:09.576000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dd148c8-8e5b-4bec-b8fe-3d9713cec7a3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:09.576832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dd148c8-8e5b-4bec-b8fe-3d9713cec7a3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:09.578084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dd148c8-8e5b-4bec-b8fe-3d9713cec7a3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:09.580201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9412db80-1eef-4464-b39f-6a95d7dd936b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:09.581063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9412db80-1eef-4464-b39f-6a95d7dd936b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:09.582556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9412db80-1eef-4464-b39f-6a95d7dd936b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:09.583628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9412db80-1eef-4464-b39f-6a95d7dd936b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:09.585208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9412db80-1eef-4464-b39f-6a95d7dd936b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:09.586913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9412db80-1eef-4464-b39f-6a95d7dd936b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:09.631209 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4dd148c8-8e5b-4bec-b8fe-3d9713cec7a3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074331 Oct 27 18:52:09.633630 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 884/1724] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:52:09 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:09.650685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-55192041-c992-43b9-be9d-99a225eb0a8f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:09.661079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-55192041-c992-43b9-be9d-99a225eb0a8f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:09.692674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55192041-c992-43b9-be9d-99a225eb0a8f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:09.693315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55192041-c992-43b9-be9d-99a225eb0a8f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:09.694168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55192041-c992-43b9-be9d-99a225eb0a8f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:09.695213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55192041-c992-43b9-be9d-99a225eb0a8f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:09.695952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55192041-c992-43b9-be9d-99a225eb0a8f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:09.696957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55192041-c992-43b9-be9d-99a225eb0a8f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:09.842151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-55192041-c992-43b9-be9d-99a225eb0a8f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:09.857321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-55192041-c992-43b9-be9d-99a225eb0a8f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:09.859492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-55192041-c992-43b9-be9d-99a225eb0a8f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:09.860938 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-55192041-c992-43b9-be9d-99a225eb0a8f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.217575 Oct 27 18:52:09.867503 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 885/1725] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:09 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:09.973353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e06119f5-e285-479d-a1bf-5556143ad650 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:09.973973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e06119f5-e285-479d-a1bf-5556143ad650 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:09.989949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e06119f5-e285-479d-a1bf-5556143ad650 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:09.990501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e06119f5-e285-479d-a1bf-5556143ad650 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:09.991184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e06119f5-e285-479d-a1bf-5556143ad650 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:09.992654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e06119f5-e285-479d-a1bf-5556143ad650 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:09.993324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e06119f5-e285-479d-a1bf-5556143ad650 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:09.993965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e06119f5-e285-479d-a1bf-5556143ad650 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:10.295037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e06119f5-e285-479d-a1bf-5556143ad650 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:10.319711 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e06119f5-e285-479d-a1bf-5556143ad650 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1318 microversion: 2.1 time: 0.347842 Oct 27 18:52:10.320885 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 886/1726] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:09 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:52:10.341458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-10ef0a17-ed80-4ba8-b46f-ce317a30e35e req-e705d7d3-9d11-449d-97b3-97be1bb8fc21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577c18dd-641c-4a06-a686-f98e0900c9ee", "name": "network-vif-unplugged", "status": "completed", "tag": "8a32fd83-25f1-4404-aa7a-0920aacf1688"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:10.378535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-10ef0a17-ed80-4ba8-b46f-ce317a30e35e req-e705d7d3-9d11-449d-97b3-97be1bb8fc21 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:10.380078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-10ef0a17-ed80-4ba8-b46f-ce317a30e35e req-e705d7d3-9d11-449d-97b3-97be1bb8fc21 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:10.380726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-10ef0a17-ed80-4ba8-b46f-ce317a30e35e req-e705d7d3-9d11-449d-97b3-97be1bb8fc21 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:10.409358 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-10ef0a17-ed80-4ba8-b46f-ce317a30e35e req-e705d7d3-9d11-449d-97b3-97be1bb8fc21 service nova] Creating event network-vif-unplugged:8a32fd83-25f1-4404-aa7a-0920aacf1688 for instance 577c18dd-641c-4a06-a686-f98e0900c9ee on n-h1-860687-3 Oct 27 18:52:10.420456 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-10ef0a17-ed80-4ba8-b46f-ce317a30e35e req-e705d7d3-9d11-449d-97b3-97be1bb8fc21 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094326 Oct 27 18:52:10.421394 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 887/1727] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:10.425214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9412db80-1eef-4464-b39f-6a95d7dd936b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:10.434511 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9412db80-1eef-4464-b39f-6a95d7dd936b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1654 microversion: 2.1 time: 0.909158 Oct 27 18:52:10.448870 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 841/1728] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:09 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1654 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:10.554315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c0eb197d-70c9-4248-8c93-94b0aff3b9f4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:10.555290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c0eb197d-70c9-4248-8c93-94b0aff3b9f4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:10.571250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0eb197d-70c9-4248-8c93-94b0aff3b9f4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:10.572094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0eb197d-70c9-4248-8c93-94b0aff3b9f4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:10.575980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0eb197d-70c9-4248-8c93-94b0aff3b9f4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:10.577092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0eb197d-70c9-4248-8c93-94b0aff3b9f4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:10.577901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0eb197d-70c9-4248-8c93-94b0aff3b9f4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:10.582306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0eb197d-70c9-4248-8c93-94b0aff3b9f4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:10.650829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0945e8c0-ce23-442c-9ada-3c2d37897f9a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:10.653444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0945e8c0-ce23-442c-9ada-3c2d37897f9a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:10.674138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0945e8c0-ce23-442c-9ada-3c2d37897f9a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:10.674747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0945e8c0-ce23-442c-9ada-3c2d37897f9a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:10.677583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0945e8c0-ce23-442c-9ada-3c2d37897f9a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:10.681069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0945e8c0-ce23-442c-9ada-3c2d37897f9a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:10.682815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0945e8c0-ce23-442c-9ada-3c2d37897f9a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:10.683287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0945e8c0-ce23-442c-9ada-3c2d37897f9a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:10.798264 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0945e8c0-ce23-442c-9ada-3c2d37897f9a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155406 Oct 27 18:52:10.799632 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 842/1729] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:52:10 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:10.807232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-a36627de-bb0f-4b1f-b8dd-392d6fad5873 req-1c93078d-b664-451a-a0f5-baa604c73a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577c18dd-641c-4a06-a686-f98e0900c9ee", "name": "network-vif-deleted", "tag": "60560a38-c725-42df-bc29-3eae66f5de45"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:10.823922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a36627de-bb0f-4b1f-b8dd-392d6fad5873 req-1c93078d-b664-451a-a0f5-baa604c73a3b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:10.826282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a36627de-bb0f-4b1f-b8dd-392d6fad5873 req-1c93078d-b664-451a-a0f5-baa604c73a3b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:10.827493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a36627de-bb0f-4b1f-b8dd-392d6fad5873 req-1c93078d-b664-451a-a0f5-baa604c73a3b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:10.849833 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a36627de-bb0f-4b1f-b8dd-392d6fad5873 req-1c93078d-b664-451a-a0f5-baa604c73a3b service nova] Creating event network-vif-deleted:60560a38-c725-42df-bc29-3eae66f5de45 for instance 577c18dd-641c-4a06-a686-f98e0900c9ee on n-h1-860687-3 Oct 27 18:52:10.859166 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-a36627de-bb0f-4b1f-b8dd-392d6fad5873 req-1c93078d-b664-451a-a0f5-baa604c73a3b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057281 Oct 27 18:52:10.862573 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 843/1730] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:10.901373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bafc4c28-162f-475a-8c90-3f0a306a93cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:10.902793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bafc4c28-162f-475a-8c90-3f0a306a93cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:10.915637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bafc4c28-162f-475a-8c90-3f0a306a93cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:10.916575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bafc4c28-162f-475a-8c90-3f0a306a93cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:10.917319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bafc4c28-162f-475a-8c90-3f0a306a93cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:10.918506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bafc4c28-162f-475a-8c90-3f0a306a93cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:10.920086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bafc4c28-162f-475a-8c90-3f0a306a93cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:10.921223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bafc4c28-162f-475a-8c90-3f0a306a93cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:11.042640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bafc4c28-162f-475a-8c90-3f0a306a93cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:11.056852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bafc4c28-162f-475a-8c90-3f0a306a93cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:11.064358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bafc4c28-162f-475a-8c90-3f0a306a93cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:11.066021 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bafc4c28-162f-475a-8c90-3f0a306a93cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.175305 Oct 27 18:52:11.067194 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 844/1731] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:10 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:11.262192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c0eb197d-70c9-4248-8c93-94b0aff3b9f4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:11.272544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c0eb197d-70c9-4248-8c93-94b0aff3b9f4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:11.277931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c0eb197d-70c9-4248-8c93-94b0aff3b9f4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:11.280050 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c0eb197d-70c9-4248-8c93-94b0aff3b9f4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.734340 Oct 27 18:52:11.281231 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 888/1732] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:10 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:11.344956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-98acf9ee-d33d-4f41-b76a-4c7adb9858e2 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:11.345700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-98acf9ee-d33d-4f41-b76a-4c7adb9858e2 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:11.361886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98acf9ee-d33d-4f41-b76a-4c7adb9858e2 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:11.368736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98acf9ee-d33d-4f41-b76a-4c7adb9858e2 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:11.369380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98acf9ee-d33d-4f41-b76a-4c7adb9858e2 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:11.372020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98acf9ee-d33d-4f41-b76a-4c7adb9858e2 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:11.372640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98acf9ee-d33d-4f41-b76a-4c7adb9858e2 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:11.373184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98acf9ee-d33d-4f41-b76a-4c7adb9858e2 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:11.473707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ee0412f3-7f63-46ea-b001-763f1b1b4524 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:11.474882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ee0412f3-7f63-46ea-b001-763f1b1b4524 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:11.496985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee0412f3-7f63-46ea-b001-763f1b1b4524 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:11.499202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee0412f3-7f63-46ea-b001-763f1b1b4524 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:11.502485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee0412f3-7f63-46ea-b001-763f1b1b4524 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:11.506888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee0412f3-7f63-46ea-b001-763f1b1b4524 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:11.514069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee0412f3-7f63-46ea-b001-763f1b1b4524 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:11.515481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee0412f3-7f63-46ea-b001-763f1b1b4524 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:11.759472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ee0412f3-7f63-46ea-b001-763f1b1b4524 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:11.774868 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ee0412f3-7f63-46ea-b001-763f1b1b4524 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 200 len: 1454 microversion: 2.1 time: 0.304410 Oct 27 18:52:11.779281 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 889/1733] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:11 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 1454 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:11.986048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-98acf9ee-d33d-4f41-b76a-4c7adb9858e2 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:12.019241 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-98acf9ee-d33d-4f41-b76a-4c7adb9858e2 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1318 microversion: 2.1 time: 0.675870 Oct 27 18:52:12.024670 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 845/1734] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:11 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:12.047231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c012bbd3-a7b4-486d-bf79-b52d0644f381 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:12.062880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c012bbd3-a7b4-486d-bf79-b52d0644f381 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:12.090182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c012bbd3-a7b4-486d-bf79-b52d0644f381 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:12.090796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c012bbd3-a7b4-486d-bf79-b52d0644f381 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:12.097655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c012bbd3-a7b4-486d-bf79-b52d0644f381 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:12.098572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c012bbd3-a7b4-486d-bf79-b52d0644f381 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:12.099071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c012bbd3-a7b4-486d-bf79-b52d0644f381 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:12.099584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c012bbd3-a7b4-486d-bf79-b52d0644f381 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:12.170983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-593235741", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "c6f304b1-07d8-4fe2-b95b-79675ce53612"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:12.203232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:12.225270 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c012bbd3-a7b4-486d-bf79-b52d0644f381 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196356 Oct 27 18:52:12.230359 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 846/1735] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:52:12 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:12.254166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c2b786c8-277f-410b-bd24-1e421703c28c tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:12.258730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c2b786c8-277f-410b-bd24-1e421703c28c tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:12.283277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b786c8-277f-410b-bd24-1e421703c28c tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:12.283880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b786c8-277f-410b-bd24-1e421703c28c tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:12.284346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b786c8-277f-410b-bd24-1e421703c28c tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:12.286581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b786c8-277f-410b-bd24-1e421703c28c tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:12.287478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b786c8-277f-410b-bd24-1e421703c28c tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:12.290840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b786c8-277f-410b-bd24-1e421703c28c tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:12.323322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:12.330296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] validate_networks() for [('c6f304b1-07d8-4fe2-b95b-79675ce53612', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:52:12.466763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c2b786c8-277f-410b-bd24-1e421703c28c tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:12.482618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c2b786c8-277f-410b-bd24-1e421703c28c tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:12.484114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c2b786c8-277f-410b-bd24-1e421703c28c tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:12.486804 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c2b786c8-277f-410b-bd24-1e421703c28c tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.255361 Oct 27 18:52:12.503334 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 847/1736] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:12 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:12.515294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-012ab46b-0541-4858-8008-e05952abe754 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:12.521838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-012ab46b-0541-4858-8008-e05952abe754 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:12.535820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-012ab46b-0541-4858-8008-e05952abe754 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:12.536328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-012ab46b-0541-4858-8008-e05952abe754 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:12.542141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-012ab46b-0541-4858-8008-e05952abe754 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:12.543224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-012ab46b-0541-4858-8008-e05952abe754 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:12.543726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-012ab46b-0541-4858-8008-e05952abe754 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:12.544177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-012ab46b-0541-4858-8008-e05952abe754 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:12.926909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-012ab46b-0541-4858-8008-e05952abe754 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:12.937115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-012ab46b-0541-4858-8008-e05952abe754 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:12.938616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-012ab46b-0541-4858-8008-e05952abe754 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:12.944251 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-012ab46b-0541-4858-8008-e05952abe754 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.438467 Oct 27 18:52:12.946935 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 848/1737] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:12 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:12.951843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e1631e8d-defe-4e69-9109-1ee2c02add31 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:12.952356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e1631e8d-defe-4e69-9109-1ee2c02add31 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:12.958413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1631e8d-defe-4e69-9109-1ee2c02add31 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:12.958948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1631e8d-defe-4e69-9109-1ee2c02add31 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:12.959397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1631e8d-defe-4e69-9109-1ee2c02add31 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:12.960165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1631e8d-defe-4e69-9109-1ee2c02add31 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:12.961092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1631e8d-defe-4e69-9109-1ee2c02add31 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:12.961600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1631e8d-defe-4e69-9109-1ee2c02add31 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.006833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e1631e8d-defe-4e69-9109-1ee2c02add31 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:52:13.066959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:52:13.067390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:52:13.067872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:52:13.068289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:52:13.068706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:52:13.085852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.089233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.089696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.090510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.090979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.094902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.121027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Getting quotas for project a01070f71f894787a5a26e00dc2cd3ef. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:52:13.125287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Getting quotas for user 7af58c47c7ff47a1abb83c046335a44e and project a01070f71f894787a5a26e00dc2cd3ef. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:52:13.139332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Going to run 2 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:52:13.142256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: fcfb303a-9cf9-45a7-83cc-87ad12e35bb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:52:13.158789 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e1631e8d-defe-4e69-9109-1ee2c02add31 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 204 len: 0 microversion: 2.1 time: 0.210197 Oct 27 18:52:13.160576 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 849/1738] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:52:12 2022] DELETE /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:52:13.169528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-6770952b-c343-4d93-b693-ed723aed9d48 req-e664b33c-9b0a-4489-981a-9b6ad5c3d887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f02e8ec-759d-48bf-9d99-31fa890241c1", "name": "network-vif-plugged", "status": "completed", "tag": "e08a66dd-bce1-4f3f-ae67-ea863bda862f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:13.189834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=fcfb303a-9cf9-45a7-83cc-87ad12e35bb5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:52:13.194610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6770952b-c343-4d93-b693-ed723aed9d48 req-e664b33c-9b0a-4489-981a-9b6ad5c3d887 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.196063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6770952b-c343-4d93-b693-ed723aed9d48 req-e664b33c-9b0a-4489-981a-9b6ad5c3d887 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.196909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6770952b-c343-4d93-b693-ed723aed9d48 req-e664b33c-9b0a-4489-981a-9b6ad5c3d887 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.214041 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-6770952b-c343-4d93-b693-ed723aed9d48 req-e664b33c-9b0a-4489-981a-9b6ad5c3d887 service nova] Creating event network-vif-plugged:e08a66dd-bce1-4f3f-ae67-ea863bda862f for instance 1f02e8ec-759d-48bf-9d99-31fa890241c1 on n-h2-860687-3 Oct 27 18:52:13.222366 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-6770952b-c343-4d93-b693-ed723aed9d48 req-e664b33c-9b0a-4489-981a-9b6ad5c3d887 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060121 Oct 27 18:52:13.223831 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 850/1739] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:13.233000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aaa7215b-c9e0-457b-bdf0-a50893f5d79f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:13.234544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aaa7215b-c9e0-457b-bdf0-a50893f5d79f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:13.246301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaa7215b-c9e0-457b-bdf0-a50893f5d79f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.247159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaa7215b-c9e0-457b-bdf0-a50893f5d79f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.248696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaa7215b-c9e0-457b-bdf0-a50893f5d79f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.250050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaa7215b-c9e0-457b-bdf0-a50893f5d79f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.250857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaa7215b-c9e0-457b-bdf0-a50893f5d79f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.251603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaa7215b-c9e0-457b-bdf0-a50893f5d79f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.292039 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6cc2d936-8df1-4366-927a-a72f0414ec4a tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.510698 Oct 27 18:52:13.292729 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 890/1740] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:52:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:52:13.305180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ec4718c0-2e36-4b0c-b8b7-b8c1ee9e0b09 req-f597cbec-b74f-4eb0-a995-7436d4916039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577c18dd-641c-4a06-a686-f98e0900c9ee", "name": "network-vif-deleted", "tag": "8a32fd83-25f1-4404-aa7a-0920aacf1688"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:13.309588 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-aaa7215b-c9e0-457b-bdf0-a50893f5d79f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] HTTP exception thrown: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aaa7215b-c9e0-457b-bdf0-a50893f5d79f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Request method failure captured: Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee HTTP/1.1 Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtMeeRths5L55mBhO8XlAumcRl4mkQ1GuA7ZOv_qc2iBuWncYJIGTMjzUnWnV8EbVS9b6dJoJGKKelPDVaXInbDvaoYdebdMZSIOZOInbFaFLtPdYOVwEHh-aQiNviNGYr868yrixAnbm3oP_cdtr7WPDuWGYs3lGWgBt_B8ojRgXNI Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 05e6f4807fd34f6d9422bc06ee20cb10 Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestMultiNic-814031626 Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05e6f4807fd34f6d9422bc06ee20cb10", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestMultiNic-814031626 Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 05e6f4807fd34f6d9422bc06ee20cb10 Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestMultiNic-814031626 Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestMultiNic-814031626-project Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: f657dcabf43141b584416d2597efb5cb Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestMultiNic-814031626-project Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '577c18dd-641c-4a06-a686-f98e0900c9ee'} Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:13.318360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:13.324420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:13.324420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:13.324420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:13.324420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:52:13.324420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:52:13.324420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:52:13.324420 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:13.324420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aaa7215b-c9e0-457b-bdf0-a50893f5d79f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Returning 404 to user: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:52:13.324420 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aaa7215b-c9e0-457b-bdf0-a50893f5d79f tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 404 len: 111 microversion: 2.1 time: 0.094499 Oct 27 18:52:13.325287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:13.325728 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 851/1741] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:13 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:52:13.336855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e1d5620d-b2c1-41bc-a40a-b42303351524 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:13.338719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e1d5620d-b2c1-41bc-a40a-b42303351524 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:13.342614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ec4718c0-2e36-4b0c-b8b7-b8c1ee9e0b09 req-f597cbec-b74f-4eb0-a995-7436d4916039 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.343413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ec4718c0-2e36-4b0c-b8b7-b8c1ee9e0b09 req-f597cbec-b74f-4eb0-a995-7436d4916039 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.344605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ec4718c0-2e36-4b0c-b8b7-b8c1ee9e0b09 req-f597cbec-b74f-4eb0-a995-7436d4916039 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.358587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1d5620d-b2c1-41bc-a40a-b42303351524 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.359176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1d5620d-b2c1-41bc-a40a-b42303351524 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.360452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1d5620d-b2c1-41bc-a40a-b42303351524 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.364738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1d5620d-b2c1-41bc-a40a-b42303351524 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.369257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1d5620d-b2c1-41bc-a40a-b42303351524 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.369901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1d5620d-b2c1-41bc-a40a-b42303351524 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.393264 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ec4718c0-2e36-4b0c-b8b7-b8c1ee9e0b09 req-f597cbec-b74f-4eb0-a995-7436d4916039 service nova] Creating event network-vif-deleted:8a32fd83-25f1-4404-aa7a-0920aacf1688 for instance 577c18dd-641c-4a06-a686-f98e0900c9ee on n-h1-860687-3 Oct 27 18:52:13.410628 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ec4718c0-2e36-4b0c-b8b7-b8c1ee9e0b09 req-f597cbec-b74f-4eb0-a995-7436d4916039 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116519 Oct 27 18:52:13.414781 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 891/1742] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:13.428912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d48dde9-af4d-499f-90b5-1b457ccd1d99 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:13.434792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3d48dde9-af4d-499f-90b5-1b457ccd1d99 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:13.449939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d48dde9-af4d-499f-90b5-1b457ccd1d99 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.454797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d48dde9-af4d-499f-90b5-1b457ccd1d99 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.455477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d48dde9-af4d-499f-90b5-1b457ccd1d99 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.456652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d48dde9-af4d-499f-90b5-1b457ccd1d99 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.457317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d48dde9-af4d-499f-90b5-1b457ccd1d99 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.458337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d48dde9-af4d-499f-90b5-1b457ccd1d99 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.722130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e1d5620d-b2c1-41bc-a40a-b42303351524 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:13.732148 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e1d5620d-b2c1-41bc-a40a-b42303351524 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1318 microversion: 2.1 time: 0.405727 Oct 27 18:52:13.732667 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 852/1743] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:13 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:13.746635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28ef9e1d-aa36-4791-bba8-2807dc62c71a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:13.749228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-28ef9e1d-aa36-4791-bba8-2807dc62c71a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:13.766815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28ef9e1d-aa36-4791-bba8-2807dc62c71a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.768303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28ef9e1d-aa36-4791-bba8-2807dc62c71a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.771087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28ef9e1d-aa36-4791-bba8-2807dc62c71a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.772311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28ef9e1d-aa36-4791-bba8-2807dc62c71a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.773676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28ef9e1d-aa36-4791-bba8-2807dc62c71a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.780158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28ef9e1d-aa36-4791-bba8-2807dc62c71a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.835130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3d48dde9-af4d-499f-90b5-1b457ccd1d99 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:13.848859 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3d48dde9-af4d-499f-90b5-1b457ccd1d99 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1467 microversion: 2.1 time: 0.430713 Oct 27 18:52:13.850207 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 892/1744] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:13 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1467 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:13.854999 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-28ef9e1d-aa36-4791-bba8-2807dc62c71a tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121208 Oct 27 18:52:13.855599 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 853/1745] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:52:13 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:13.868275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3456e5d3-c725-42fb-8572-4aec80b99c4a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:13.869051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7a43cd06-c15f-4dbe-8ccf-cc098e17cfeb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:13.869456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3456e5d3-c725-42fb-8572-4aec80b99c4a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:13.885623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7a43cd06-c15f-4dbe-8ccf-cc098e17cfeb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:13.886555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7a43cd06-c15f-4dbe-8ccf-cc098e17cfeb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Searching by: {'deleted': False, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:52:13.901756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3456e5d3-c725-42fb-8572-4aec80b99c4a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.902672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3456e5d3-c725-42fb-8572-4aec80b99c4a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.903273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3456e5d3-c725-42fb-8572-4aec80b99c4a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.904078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3456e5d3-c725-42fb-8572-4aec80b99c4a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.904680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3456e5d3-c725-42fb-8572-4aec80b99c4a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.905348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3456e5d3-c725-42fb-8572-4aec80b99c4a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.929112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a43cd06-c15f-4dbe-8ccf-cc098e17cfeb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.929706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a43cd06-c15f-4dbe-8ccf-cc098e17cfeb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.931242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a43cd06-c15f-4dbe-8ccf-cc098e17cfeb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.937139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a43cd06-c15f-4dbe-8ccf-cc098e17cfeb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:13.938127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a43cd06-c15f-4dbe-8ccf-cc098e17cfeb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:13.938797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a43cd06-c15f-4dbe-8ccf-cc098e17cfeb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:13.982299 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7a43cd06-c15f-4dbe-8ccf-cc098e17cfeb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.130509 Oct 27 18:52:13.982862 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 893/1746] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 18:52:13 2022] GET /compute/v2.1/servers => generated 675 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:13.994084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3456e5d3-c725-42fb-8572-4aec80b99c4a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:13.998211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b75f2401-581d-4230-8bc2-384338ce431b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:13.998886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b75f2401-581d-4230-8bc2-384338ce431b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:14.003557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3456e5d3-c725-42fb-8572-4aec80b99c4a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:14.005351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3456e5d3-c725-42fb-8572-4aec80b99c4a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:14.006764 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3456e5d3-c725-42fb-8572-4aec80b99c4a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.145883 Oct 27 18:52:14.016480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b75f2401-581d-4230-8bc2-384338ce431b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:14.016985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b75f2401-581d-4230-8bc2-384338ce431b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:14.017437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b75f2401-581d-4230-8bc2-384338ce431b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:14.018260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b75f2401-581d-4230-8bc2-384338ce431b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:14.018670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b75f2401-581d-4230-8bc2-384338ce431b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:14.019115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b75f2401-581d-4230-8bc2-384338ce431b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:14.023409 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 854/1747] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:13 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:14.049183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-82f41912-a2f3-46d0-b513-6c58b8126dc5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:14.049818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-82f41912-a2f3-46d0-b513-6c58b8126dc5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:14.144744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-82f41912-a2f3-46d0-b513-6c58b8126dc5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:14.157368 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-82f41912-a2f3-46d0-b513-6c58b8126dc5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1219 microversion: 2.1 time: 0.131503 Oct 27 18:52:14.163155 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 855/1748] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:14 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:14.424751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b75f2401-581d-4230-8bc2-384338ce431b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:14.439543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b75f2401-581d-4230-8bc2-384338ce431b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:14.443548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b75f2401-581d-4230-8bc2-384338ce431b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:14.447037 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b75f2401-581d-4230-8bc2-384338ce431b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.456666 Oct 27 18:52:14.447644 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 894/1749] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:13 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:14.761234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-23c98935-c2fb-4361-9a70-80784585f48b tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:14.762190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-23c98935-c2fb-4361-9a70-80784585f48b tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:14.785213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23c98935-c2fb-4361-9a70-80784585f48b tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:14.786157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23c98935-c2fb-4361-9a70-80784585f48b tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:14.788338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23c98935-c2fb-4361-9a70-80784585f48b tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:14.791371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23c98935-c2fb-4361-9a70-80784585f48b tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:14.792410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23c98935-c2fb-4361-9a70-80784585f48b tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:14.796747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23c98935-c2fb-4361-9a70-80784585f48b tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:14.867147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-982853b8-8917-4d4f-946f-eba31e90cd03 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:14.869514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-982853b8-8917-4d4f-946f-eba31e90cd03 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:14.896818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-982853b8-8917-4d4f-946f-eba31e90cd03 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:14.902283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-982853b8-8917-4d4f-946f-eba31e90cd03 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:14.902964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-982853b8-8917-4d4f-946f-eba31e90cd03 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:14.903754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-982853b8-8917-4d4f-946f-eba31e90cd03 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:14.905760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-982853b8-8917-4d4f-946f-eba31e90cd03 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:14.906420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-982853b8-8917-4d4f-946f-eba31e90cd03 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:14.993416 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-982853b8-8917-4d4f-946f-eba31e90cd03 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130151 Oct 27 18:52:14.998670 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 895/1750] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:52:14 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:15.005194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f3d520ce-c191-49eb-86e6-707090992ff7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:15.006109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f3d520ce-c191-49eb-86e6-707090992ff7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:15.025351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3d520ce-c191-49eb-86e6-707090992ff7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:15.026196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3d520ce-c191-49eb-86e6-707090992ff7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:15.027689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3d520ce-c191-49eb-86e6-707090992ff7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:15.028887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3d520ce-c191-49eb-86e6-707090992ff7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:15.029776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3d520ce-c191-49eb-86e6-707090992ff7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:15.030552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3d520ce-c191-49eb-86e6-707090992ff7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:15.908842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-23c98935-c2fb-4361-9a70-80784585f48b tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:15.923075 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-23c98935-c2fb-4361-9a70-80784585f48b tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1318 microversion: 2.1 time: 1.168362 Oct 27 18:52:15.927051 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 856/1751] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:14 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1318 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:15.958676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ff6c5364-6bf8-45fd-8df9-a11a8072a594 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:15.958676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ff6c5364-6bf8-45fd-8df9-a11a8072a594 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:15.969884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff6c5364-6bf8-45fd-8df9-a11a8072a594 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:15.970376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff6c5364-6bf8-45fd-8df9-a11a8072a594 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:15.974246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff6c5364-6bf8-45fd-8df9-a11a8072a594 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:15.975082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff6c5364-6bf8-45fd-8df9-a11a8072a594 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:15.976212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff6c5364-6bf8-45fd-8df9-a11a8072a594 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:15.976870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff6c5364-6bf8-45fd-8df9-a11a8072a594 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:16.215445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ff6c5364-6bf8-45fd-8df9-a11a8072a594 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:16.232865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ff6c5364-6bf8-45fd-8df9-a11a8072a594 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:16.234734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ff6c5364-6bf8-45fd-8df9-a11a8072a594 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:16.235979 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ff6c5364-6bf8-45fd-8df9-a11a8072a594 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.303877 Oct 27 18:52:16.254785 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 857/1752] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:15 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:16.269357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f3d520ce-c191-49eb-86e6-707090992ff7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:16.272169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-38d9991e-6645-4b62-bb34-18e65017d9c2 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:16.272905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-38d9991e-6645-4b62-bb34-18e65017d9c2 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:16.289765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38d9991e-6645-4b62-bb34-18e65017d9c2 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:16.291886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38d9991e-6645-4b62-bb34-18e65017d9c2 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:16.292651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38d9991e-6645-4b62-bb34-18e65017d9c2 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:16.293652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38d9991e-6645-4b62-bb34-18e65017d9c2 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:16.296134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38d9991e-6645-4b62-bb34-18e65017d9c2 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:16.296536 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f3d520ce-c191-49eb-86e6-707090992ff7 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1467 microversion: 2.1 time: 1.284561 Oct 27 18:52:16.296827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38d9991e-6645-4b62-bb34-18e65017d9c2 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:16.297480 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 896/1753] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:14 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1467 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:16.332714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cc6bfa4c-ae18-4434-bca5-e7f137397a37 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:16.343205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cc6bfa4c-ae18-4434-bca5-e7f137397a37 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:16.355375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc6bfa4c-ae18-4434-bca5-e7f137397a37 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:16.360315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc6bfa4c-ae18-4434-bca5-e7f137397a37 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:16.360841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc6bfa4c-ae18-4434-bca5-e7f137397a37 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:16.363552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc6bfa4c-ae18-4434-bca5-e7f137397a37 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:16.365858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc6bfa4c-ae18-4434-bca5-e7f137397a37 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:16.371192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc6bfa4c-ae18-4434-bca5-e7f137397a37 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:16.727748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-38d9991e-6645-4b62-bb34-18e65017d9c2 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:16.739695 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-38d9991e-6645-4b62-bb34-18e65017d9c2 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1271 microversion: 2.1 time: 0.483665 Oct 27 18:52:16.740300 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 858/1754] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:16 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1271 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:16.758759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-cdc5f77f-6578-4a3c-a6ab-982c07064d48 req-a3d746b7-e7bd-40cd-9d32-897339d31618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5e11da-2f25-4433-98d7-8f5b0620095f", "name": "network-vif-plugged", "status": "completed", "tag": "00a226a6-58cf-4f6d-9bc2-e12c43140523"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:16.771094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cdc5f77f-6578-4a3c-a6ab-982c07064d48 req-a3d746b7-e7bd-40cd-9d32-897339d31618 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:16.772635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cdc5f77f-6578-4a3c-a6ab-982c07064d48 req-a3d746b7-e7bd-40cd-9d32-897339d31618 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:16.773984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cdc5f77f-6578-4a3c-a6ab-982c07064d48 req-a3d746b7-e7bd-40cd-9d32-897339d31618 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:16.789520 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-cdc5f77f-6578-4a3c-a6ab-982c07064d48 req-a3d746b7-e7bd-40cd-9d32-897339d31618 service nova] Creating event network-vif-plugged:00a226a6-58cf-4f6d-9bc2-e12c43140523 for instance ac5e11da-2f25-4433-98d7-8f5b0620095f on n-h1-860687-3 Oct 27 18:52:16.798002 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-cdc5f77f-6578-4a3c-a6ab-982c07064d48 req-a3d746b7-e7bd-40cd-9d32-897339d31618 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054722 Oct 27 18:52:16.803659 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 859/1755] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:16.836790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a6aaed26-6003-43a8-aeed-b910fa53741b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:16.853512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a6aaed26-6003-43a8-aeed-b910fa53741b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:16.874460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6aaed26-6003-43a8-aeed-b910fa53741b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:16.878550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6aaed26-6003-43a8-aeed-b910fa53741b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:16.880298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6aaed26-6003-43a8-aeed-b910fa53741b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:16.881929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6aaed26-6003-43a8-aeed-b910fa53741b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:16.883273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6aaed26-6003-43a8-aeed-b910fa53741b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:16.883849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6aaed26-6003-43a8-aeed-b910fa53741b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:16.954764 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a6aaed26-6003-43a8-aeed-b910fa53741b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137911 Oct 27 18:52:16.962083 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 860/1756] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:52:16 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:16.967773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8e1c8c0f-009c-4f30-8962-3a76fef78d9d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:16.968662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8e1c8c0f-009c-4f30-8962-3a76fef78d9d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:16.978931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1c8c0f-009c-4f30-8962-3a76fef78d9d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:16.980055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1c8c0f-009c-4f30-8962-3a76fef78d9d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:16.980850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1c8c0f-009c-4f30-8962-3a76fef78d9d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:16.982231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1c8c0f-009c-4f30-8962-3a76fef78d9d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:16.983033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1c8c0f-009c-4f30-8962-3a76fef78d9d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:16.983825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1c8c0f-009c-4f30-8962-3a76fef78d9d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:17.210046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cc6bfa4c-ae18-4434-bca5-e7f137397a37 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:17.244779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cc6bfa4c-ae18-4434-bca5-e7f137397a37 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:17.258416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cc6bfa4c-ae18-4434-bca5-e7f137397a37 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:17.265314 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cc6bfa4c-ae18-4434-bca5-e7f137397a37 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.961970 Oct 27 18:52:17.270866 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 897/1757] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:16 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:17.291512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-b039f76f-ab44-4a87-8619-7c60dffce25d req-0dbba2c6-1383-4513-a049-ff9b412690c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3b19c1-802b-4c1e-9ac3-6f795e307b2d", "name": "network-vif-deleted", "tag": "c2767add-2352-4e4a-b9c7-583a3ba6d7cf"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:17.312118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b039f76f-ab44-4a87-8619-7c60dffce25d req-0dbba2c6-1383-4513-a049-ff9b412690c0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:17.316542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b039f76f-ab44-4a87-8619-7c60dffce25d req-0dbba2c6-1383-4513-a049-ff9b412690c0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:17.317321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b039f76f-ab44-4a87-8619-7c60dffce25d req-0dbba2c6-1383-4513-a049-ff9b412690c0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:17.348265 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-b039f76f-ab44-4a87-8619-7c60dffce25d req-0dbba2c6-1383-4513-a049-ff9b412690c0 service nova] Creating event network-vif-deleted:c2767add-2352-4e4a-b9c7-583a3ba6d7cf for instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d on n-h1-860687-3 Oct 27 18:52:17.361298 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-b039f76f-ab44-4a87-8619-7c60dffce25d req-0dbba2c6-1383-4513-a049-ff9b412690c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084499 Oct 27 18:52:17.362596 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 898/1758] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:17.373403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b8b36b4e-7ee6-431b-8336-c71e4ccc1635 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:17.379554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b8b36b4e-7ee6-431b-8336-c71e4ccc1635 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:17.392557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8b36b4e-7ee6-431b-8336-c71e4ccc1635 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:17.393482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8b36b4e-7ee6-431b-8336-c71e4ccc1635 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:17.394218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8b36b4e-7ee6-431b-8336-c71e4ccc1635 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:17.395220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8b36b4e-7ee6-431b-8336-c71e4ccc1635 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:17.407288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8b36b4e-7ee6-431b-8336-c71e4ccc1635 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:17.408093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8b36b4e-7ee6-431b-8336-c71e4ccc1635 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:17.524559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b8b36b4e-7ee6-431b-8336-c71e4ccc1635 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:17.537271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b8b36b4e-7ee6-431b-8336-c71e4ccc1635 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:17.542217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b8b36b4e-7ee6-431b-8336-c71e4ccc1635 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:17.548626 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b8b36b4e-7ee6-431b-8336-c71e4ccc1635 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.181695 Oct 27 18:52:17.563387 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 899/1759] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:17 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:17.575566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-02c200bd-b9e9-44f1-9783-7f4856ec889e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:17.576488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-02c200bd-b9e9-44f1-9783-7f4856ec889e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:17.596622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02c200bd-b9e9-44f1-9783-7f4856ec889e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:17.599056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02c200bd-b9e9-44f1-9783-7f4856ec889e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:17.602257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02c200bd-b9e9-44f1-9783-7f4856ec889e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:17.603515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02c200bd-b9e9-44f1-9783-7f4856ec889e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:17.605799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02c200bd-b9e9-44f1-9783-7f4856ec889e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:17.606962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02c200bd-b9e9-44f1-9783-7f4856ec889e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:17.694255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02c200bd-b9e9-44f1-9783-7f4856ec889e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:17.695207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02c200bd-b9e9-44f1-9783-7f4856ec889e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:17.696181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02c200bd-b9e9-44f1-9783-7f4856ec889e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:17.696839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-02c200bd-b9e9-44f1-9783-7f4856ec889e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lazy-loading 'fault' on Instance uuid 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:52:17.786797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8e1c8c0f-009c-4f30-8962-3a76fef78d9d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:17.791086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-02c200bd-b9e9-44f1-9783-7f4856ec889e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:17.803499 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8e1c8c0f-009c-4f30-8962-3a76fef78d9d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1318 microversion: 2.1 time: 0.839768 Oct 27 18:52:17.804098 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 861/1760] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:16 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1318 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:17.819302 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-02c200bd-b9e9-44f1-9783-7f4856ec889e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 200 len: 1302 microversion: 2.1 time: 0.238950 Oct 27 18:52:17.820917 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 900/1761] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:17 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 1302 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:17.822094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ffa0c8b8-98df-4778-9232-e6693095c1a5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:17.822757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ffa0c8b8-98df-4778-9232-e6693095c1a5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:17.842362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffa0c8b8-98df-4778-9232-e6693095c1a5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:17.842890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffa0c8b8-98df-4778-9232-e6693095c1a5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:17.843329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffa0c8b8-98df-4778-9232-e6693095c1a5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:17.844044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffa0c8b8-98df-4778-9232-e6693095c1a5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:17.844499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffa0c8b8-98df-4778-9232-e6693095c1a5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:17.844931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffa0c8b8-98df-4778-9232-e6693095c1a5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:17.968693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9b2054db-ba0b-4cbf-82b3-694d4f74c9ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:17.971089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9b2054db-ba0b-4cbf-82b3-694d4f74c9ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:17.981463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2054db-ba0b-4cbf-82b3-694d4f74c9ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:17.982406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2054db-ba0b-4cbf-82b3-694d4f74c9ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:17.983091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2054db-ba0b-4cbf-82b3-694d4f74c9ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:17.984239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2054db-ba0b-4cbf-82b3-694d4f74c9ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:17.984951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2054db-ba0b-4cbf-82b3-694d4f74c9ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:17.985632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2054db-ba0b-4cbf-82b3-694d4f74c9ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:17.990417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:18.002483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ffa0c8b8-98df-4778-9232-e6693095c1a5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:18.012546 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ffa0c8b8-98df-4778-9232-e6693095c1a5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1277 microversion: 2.1 time: 0.206808 Oct 27 18:52:18.013156 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 862/1762] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:17 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:18.024606 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9b2054db-ba0b-4cbf-82b3-694d4f74c9ae tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059686 Oct 27 18:52:18.025921 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 901/1763] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:52:17 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:18.299234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6dec6a1b-5b0a-4154-b2c3-ed7132b5f475 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:18.300704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6dec6a1b-5b0a-4154-b2c3-ed7132b5f475 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:18.317752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dec6a1b-5b0a-4154-b2c3-ed7132b5f475 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:18.319346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dec6a1b-5b0a-4154-b2c3-ed7132b5f475 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:18.320265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dec6a1b-5b0a-4154-b2c3-ed7132b5f475 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:18.321595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dec6a1b-5b0a-4154-b2c3-ed7132b5f475 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:18.322234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dec6a1b-5b0a-4154-b2c3-ed7132b5f475 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:18.323803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dec6a1b-5b0a-4154-b2c3-ed7132b5f475 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:18.578682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-37a2eea8-0f63-4cbb-ad0c-e6c0511dfade tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:18.580982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-37a2eea8-0f63-4cbb-ad0c-e6c0511dfade tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:18.595736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37a2eea8-0f63-4cbb-ad0c-e6c0511dfade tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:18.596623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37a2eea8-0f63-4cbb-ad0c-e6c0511dfade tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:18.598300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37a2eea8-0f63-4cbb-ad0c-e6c0511dfade tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:18.601027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37a2eea8-0f63-4cbb-ad0c-e6c0511dfade tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:18.603023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37a2eea8-0f63-4cbb-ad0c-e6c0511dfade tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:18.603730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37a2eea8-0f63-4cbb-ad0c-e6c0511dfade tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:18.884859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-37a2eea8-0f63-4cbb-ad0c-e6c0511dfade tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:18.904519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-37a2eea8-0f63-4cbb-ad0c-e6c0511dfade tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:18.911338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-37a2eea8-0f63-4cbb-ad0c-e6c0511dfade tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:18.916809 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-37a2eea8-0f63-4cbb-ad0c-e6c0511dfade tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.341908 Oct 27 18:52:18.932039 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 902/1764] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:18 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:18.954416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8033335b-75e3-4821-b1d7-916debbeb914 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:18.959306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8033335b-75e3-4821-b1d7-916debbeb914 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:18.980592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8033335b-75e3-4821-b1d7-916debbeb914 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:18.984051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8033335b-75e3-4821-b1d7-916debbeb914 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:18.984556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8033335b-75e3-4821-b1d7-916debbeb914 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:19.002567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8033335b-75e3-4821-b1d7-916debbeb914 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:19.014570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8033335b-75e3-4821-b1d7-916debbeb914 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:19.015081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8033335b-75e3-4821-b1d7-916debbeb914 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:19.288575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6dec6a1b-5b0a-4154-b2c3-ed7132b5f475 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:19.306425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6dec6a1b-5b0a-4154-b2c3-ed7132b5f475 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:19.316358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6dec6a1b-5b0a-4154-b2c3-ed7132b5f475 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:19.317787 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6dec6a1b-5b0a-4154-b2c3-ed7132b5f475 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 1.023717 Oct 27 18:52:19.318736 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 863/1765] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:18 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:19.329015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b655dcee-0ebd-46ec-9a5c-7b682a100bb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:19.329659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b655dcee-0ebd-46ec-9a5c-7b682a100bb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:19.343351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b655dcee-0ebd-46ec-9a5c-7b682a100bb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:19.343795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b655dcee-0ebd-46ec-9a5c-7b682a100bb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:19.347438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b655dcee-0ebd-46ec-9a5c-7b682a100bb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:19.348129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b655dcee-0ebd-46ec-9a5c-7b682a100bb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:19.348575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b655dcee-0ebd-46ec-9a5c-7b682a100bb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:19.349019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b655dcee-0ebd-46ec-9a5c-7b682a100bb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:19.384017 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-b655dcee-0ebd-46ec-9a5c-7b682a100bb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] HTTP exception thrown: Instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d could not be found. Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b655dcee-0ebd-46ec-9a5c-7b682a100bb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Request method failure captured: Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d HTTP/1.1 Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtIHwu7BWzo1fbGogUjJvTOtyqBweBjGX-2Z-jKASMIdKeXUaZCS0MyerPerxF0r-nxaePuWKvgRwsrSErx8kThsLBrgNTu0UtV04gQFFJ1ST8BBpppoT6gHzL6AuPBR7CfIsL0W8jrNg-7Hk-tAI12FBPAHiOKBkdR8834SGz_2KuM Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6 Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-MigrationsAdminTest-289834691 Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e7f6bb6f7db4b52ad01f0ac3d3aa8e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e7f6bb6f7db4b52ad01f0ac3d3aa8e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e7f6bb6f7db4b52ad01f0ac3d3aa8e6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e7f6bb6f7db4b52ad01f0ac3d3aa8e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-MigrationsAdminTest-289834691 Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6 Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-MigrationsAdminTest-289834691 Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-MigrationsAdminTest-289834691-project Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 1917ae65262c40b792c28c2aa4d44b44 Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-MigrationsAdminTest-289834691-project Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d could not be found. Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '5f3b19c1-802b-4c1e-9ac3-6f795e307b2d'} Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d could not be found. Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d could not be found. Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:19.385850 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:19.396104 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:19.396104 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:19.396104 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:19.396104 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:52:19.396104 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:52:19.396104 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d could not be found. Oct 27 18:52:19.396104 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:19.396104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b655dcee-0ebd-46ec-9a5c-7b682a100bb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Returning 404 to user: Instance 5f3b19c1-802b-4c1e-9ac3-6f795e307b2d could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:52:19.396104 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b655dcee-0ebd-46ec-9a5c-7b682a100bb8 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d" status: 404 len: 111 microversion: 2.1 time: 0.067633 Oct 27 18:52:19.396104 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 864/1766] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:19 2022] GET /compute/v2.1/servers/5f3b19c1-802b-4c1e-9ac3-6f795e307b2d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:52:19.396104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-15f19f89-882d-4643-8646-3061cea50f3e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:19.411315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-15f19f89-882d-4643-8646-3061cea50f3e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:19.425095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15f19f89-882d-4643-8646-3061cea50f3e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:19.425649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15f19f89-882d-4643-8646-3061cea50f3e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:19.426563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15f19f89-882d-4643-8646-3061cea50f3e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:19.427297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15f19f89-882d-4643-8646-3061cea50f3e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:19.427768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15f19f89-882d-4643-8646-3061cea50f3e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:19.428201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15f19f89-882d-4643-8646-3061cea50f3e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:19.472314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:19.502939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8033335b-75e3-4821-b1d7-916debbeb914 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:19.512421 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-15f19f89-882d-4643-8646-3061cea50f3e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.117953 Oct 27 18:52:19.514993 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 865/1767] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:52:19 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:52:19.517717 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8033335b-75e3-4821-b1d7-916debbeb914 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1468 microversion: 2.1 time: 0.584415 Oct 27 18:52:19.520051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-81211271-21d8-450d-a76c-98a39a78a898 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:19.523119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-81211271-21d8-450d-a76c-98a39a78a898 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:19.538686 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 903/1768] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:18 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1468 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:19.540232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81211271-21d8-450d-a76c-98a39a78a898 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:19.540907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81211271-21d8-450d-a76c-98a39a78a898 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:19.541363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81211271-21d8-450d-a76c-98a39a78a898 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:19.542298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81211271-21d8-450d-a76c-98a39a78a898 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:19.544448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81211271-21d8-450d-a76c-98a39a78a898 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:19.545451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81211271-21d8-450d-a76c-98a39a78a898 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:19.565620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4738f3b1-2503-42fa-ad83-287aa3a3973e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:19.566164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4738f3b1-2503-42fa-ad83-287aa3a3973e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:19.591768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4738f3b1-2503-42fa-ad83-287aa3a3973e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:19.592361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4738f3b1-2503-42fa-ad83-287aa3a3973e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:19.601942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4738f3b1-2503-42fa-ad83-287aa3a3973e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:19.607504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4738f3b1-2503-42fa-ad83-287aa3a3973e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:19.609188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4738f3b1-2503-42fa-ad83-287aa3a3973e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:19.611959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4738f3b1-2503-42fa-ad83-287aa3a3973e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:19.686752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-81211271-21d8-450d-a76c-98a39a78a898 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:19.699332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4738f3b1-2503-42fa-ad83-287aa3a3973e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:52:19.701710 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-81211271-21d8-450d-a76c-98a39a78a898 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1277 microversion: 2.1 time: 0.184519 Oct 27 18:52:19.705350 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 866/1769] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:19 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:19.713748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e737b9a8-aff2-4919-a057-49cdd856706c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:19.714366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e737b9a8-aff2-4919-a057-49cdd856706c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: 1f02e8ec-759d-48bf-9d99-31fa890241c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:19.726769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e737b9a8-aff2-4919-a057-49cdd856706c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:19.738148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e737b9a8-aff2-4919-a057-49cdd856706c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:19.738643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e737b9a8-aff2-4919-a057-49cdd856706c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:19.741073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e737b9a8-aff2-4919-a057-49cdd856706c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:19.741562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e737b9a8-aff2-4919-a057-49cdd856706c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:19.747355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e737b9a8-aff2-4919-a057-49cdd856706c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:19.899150 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4738f3b1-2503-42fa-ad83-287aa3a3973e tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "DELETE /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 204 len: 0 microversion: 2.1 time: 0.358242 Oct 27 18:52:19.904139 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 904/1770] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:52:19 2022] DELETE /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:52:19.909801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1543342627", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "0f010104-9a93-40d2-a889-3691cdaf1b69"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:20.005791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] validate_networks() for [('0f010104-9a93-40d2-a889-3691cdaf1b69', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:52:20.621703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e737b9a8-aff2-4919-a057-49cdd856706c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:20.631410 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e737b9a8-aff2-4919-a057-49cdd856706c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1" status: 200 len: 1468 microversion: 2.1 time: 0.923169 Oct 27 18:52:20.641711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:52:20.642217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:52:20.642939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:52:20.643365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:52:20.644323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:52:20.658696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:20.659058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:20.660236 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 867/1771] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:19 2022] GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1 => generated 1468 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:20.662323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:20.665240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:20.666652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:20.669182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:20.678552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5f160751-a58f-4efe-bf2b-8503606f76cf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:20.682708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5f160751-a58f-4efe-bf2b-8503606f76cf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:20.693695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f160751-a58f-4efe-bf2b-8503606f76cf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:20.694197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f160751-a58f-4efe-bf2b-8503606f76cf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:20.694675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f160751-a58f-4efe-bf2b-8503606f76cf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:20.696703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f160751-a58f-4efe-bf2b-8503606f76cf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:20.697183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f160751-a58f-4efe-bf2b-8503606f76cf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:20.697627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f160751-a58f-4efe-bf2b-8503606f76cf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:20.708249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Getting quotas for project 366d94ed2eb14e759c191e32c65b187a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:52:20.717875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Getting quotas for user 878d41625de6498283fde8fb05a4bbf6 and project 366d94ed2eb14e759c191e32c65b187a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:52:20.753281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:52:20.756046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:52:20.881033 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-574d5184-0361-4fef-bd99-3c0c568ee58f tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974518 Oct 27 18:52:20.888765 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 905/1772] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:52:20.900342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f38a54be-ea08-4ec4-85cc-34b77d00e54b tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:20.903718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f38a54be-ea08-4ec4-85cc-34b77d00e54b tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:20.915419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f38a54be-ea08-4ec4-85cc-34b77d00e54b tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:20.916217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f38a54be-ea08-4ec4-85cc-34b77d00e54b tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:20.916936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f38a54be-ea08-4ec4-85cc-34b77d00e54b tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:20.917943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f38a54be-ea08-4ec4-85cc-34b77d00e54b tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:20.918696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f38a54be-ea08-4ec4-85cc-34b77d00e54b tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:20.920606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f38a54be-ea08-4ec4-85cc-34b77d00e54b tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:21.174898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f38a54be-ea08-4ec4-85cc-34b77d00e54b tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:21.196594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f38a54be-ea08-4ec4-85cc-34b77d00e54b tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:21.199192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f38a54be-ea08-4ec4-85cc-34b77d00e54b tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:21.203544 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f38a54be-ea08-4ec4-85cc-34b77d00e54b tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.306843 Oct 27 18:52:21.204921 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 906/1773] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:20 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:21.232775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-05061afd-001f-4e4f-a871-5903720c6175 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:21.233492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-05061afd-001f-4e4f-a871-5903720c6175 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:21.253303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05061afd-001f-4e4f-a871-5903720c6175 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:21.256128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05061afd-001f-4e4f-a871-5903720c6175 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:21.259343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05061afd-001f-4e4f-a871-5903720c6175 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:21.260128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05061afd-001f-4e4f-a871-5903720c6175 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:21.260695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05061afd-001f-4e4f-a871-5903720c6175 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:21.261085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05061afd-001f-4e4f-a871-5903720c6175 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:21.707158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-05061afd-001f-4e4f-a871-5903720c6175 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:21.722158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-05061afd-001f-4e4f-a871-5903720c6175 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:21.725370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-05061afd-001f-4e4f-a871-5903720c6175 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:21.731322 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-05061afd-001f-4e4f-a871-5903720c6175 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.524026 Oct 27 18:52:21.732482 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 907/1774] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:21 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:21.742530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-501cd5ce-2e14-47ea-b3c2-2d93e173eefc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-277047733"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:21.750026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-501cd5ce-2e14-47ea-b3c2-2d93e173eefc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: 1f02e8ec-759d-48bf-9d99-31fa890241c1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:21.765817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-501cd5ce-2e14-47ea-b3c2-2d93e173eefc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:21.767907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-501cd5ce-2e14-47ea-b3c2-2d93e173eefc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:21.768606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-501cd5ce-2e14-47ea-b3c2-2d93e173eefc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:21.769525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-501cd5ce-2e14-47ea-b3c2-2d93e173eefc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:21.771964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-501cd5ce-2e14-47ea-b3c2-2d93e173eefc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:21.772705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-501cd5ce-2e14-47ea-b3c2-2d93e173eefc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:21.996523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5f160751-a58f-4efe-bf2b-8503606f76cf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:22.008142 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5f160751-a58f-4efe-bf2b-8503606f76cf tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1467 microversion: 2.1 time: 1.345110 Oct 27 18:52:22.018498 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 868/1775] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:20 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1467 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:22.018879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-96263b03-e0bc-4833-8840-1aa8f2d2b146 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:22.019512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-96263b03-e0bc-4833-8840-1aa8f2d2b146 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:22.035396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96263b03-e0bc-4833-8840-1aa8f2d2b146 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:22.038203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96263b03-e0bc-4833-8840-1aa8f2d2b146 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:22.038747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96263b03-e0bc-4833-8840-1aa8f2d2b146 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:22.039602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96263b03-e0bc-4833-8840-1aa8f2d2b146 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:22.040095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96263b03-e0bc-4833-8840-1aa8f2d2b146 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:22.040532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96263b03-e0bc-4833-8840-1aa8f2d2b146 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:22.300452 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-501cd5ce-2e14-47ea-b3c2-2d93e173eefc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "POST /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1/action" status: 202 len: 0 microversion: 2.1 time: 0.566309 Oct 27 18:52:22.301138 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 908/1776] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:52:21 2022] POST /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 18:52:22.326963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7b525019-f89e-4b20-9f53-9161fd875f5b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:22.327717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7b525019-f89e-4b20-9f53-9161fd875f5b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:22.347210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b525019-f89e-4b20-9f53-9161fd875f5b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:22.348849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b525019-f89e-4b20-9f53-9161fd875f5b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:22.348849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b525019-f89e-4b20-9f53-9161fd875f5b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:22.349286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b525019-f89e-4b20-9f53-9161fd875f5b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:22.349822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b525019-f89e-4b20-9f53-9161fd875f5b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:22.350267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b525019-f89e-4b20-9f53-9161fd875f5b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:22.573768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-96263b03-e0bc-4833-8840-1aa8f2d2b146 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:22.596423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7b525019-f89e-4b20-9f53-9161fd875f5b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:22.596788 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-96263b03-e0bc-4833-8840-1aa8f2d2b146 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1319 microversion: 2.1 time: 0.583662 Oct 27 18:52:22.598860 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 869/1777] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:22 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1319 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:22.611653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e11d55d-31d8-4472-9292-6110d61bf8f3 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:22.613820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e11d55d-31d8-4472-9292-6110d61bf8f3 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:22.616084 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7b525019-f89e-4b20-9f53-9161fd875f5b tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1270 microversion: 2.1 time: 0.310978 Oct 27 18:52:22.617468 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 909/1778] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:22 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1270 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:22.622515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e11d55d-31d8-4472-9292-6110d61bf8f3 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:22.623393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e11d55d-31d8-4472-9292-6110d61bf8f3 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:22.624139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e11d55d-31d8-4472-9292-6110d61bf8f3 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:22.625142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e11d55d-31d8-4472-9292-6110d61bf8f3 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:22.625872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e11d55d-31d8-4472-9292-6110d61bf8f3 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:22.626549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e11d55d-31d8-4472-9292-6110d61bf8f3 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:22.638994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b0162a80-ea67-4c58-aee5-07fdd673a5c4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86aba2280>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:22.714206 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b0162a80-ea67-4c58-aee5-07fdd673a5c4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2" status: 200 len: 1452 microversion: 2.1 time: 0.093333 Oct 27 18:52:22.716609 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 910/1779] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:52:22 2022] GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:22.765574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-131a880d-0c6e-4237-94f6-3da903cf5b29 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:22.766657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-131a880d-0c6e-4237-94f6-3da903cf5b29 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:22.779132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-131a880d-0c6e-4237-94f6-3da903cf5b29 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:22.780238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-131a880d-0c6e-4237-94f6-3da903cf5b29 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:22.780967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-131a880d-0c6e-4237-94f6-3da903cf5b29 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:22.783076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-131a880d-0c6e-4237-94f6-3da903cf5b29 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:22.784856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-131a880d-0c6e-4237-94f6-3da903cf5b29 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:22.787088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-131a880d-0c6e-4237-94f6-3da903cf5b29 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:23.406595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e11d55d-31d8-4472-9292-6110d61bf8f3 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:23.422614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e11d55d-31d8-4472-9292-6110d61bf8f3 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:23.424819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e11d55d-31d8-4472-9292-6110d61bf8f3 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:23.427884 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e11d55d-31d8-4472-9292-6110d61bf8f3 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.827135 Oct 27 18:52:23.439646 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 870/1780] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:22 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:23.445163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-793c31e0-00fa-4140-9dd8-e4668bdfff3d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:23.446159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-793c31e0-00fa-4140-9dd8-e4668bdfff3d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:23.455002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-793c31e0-00fa-4140-9dd8-e4668bdfff3d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:23.457112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-793c31e0-00fa-4140-9dd8-e4668bdfff3d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:23.465259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-793c31e0-00fa-4140-9dd8-e4668bdfff3d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:23.466318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-793c31e0-00fa-4140-9dd8-e4668bdfff3d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:23.466988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-793c31e0-00fa-4140-9dd8-e4668bdfff3d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:23.467644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-793c31e0-00fa-4140-9dd8-e4668bdfff3d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:23.753447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-793c31e0-00fa-4140-9dd8-e4668bdfff3d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:23.761866 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-793c31e0-00fa-4140-9dd8-e4668bdfff3d tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1425 microversion: 2.1 time: 0.320657 Oct 27 18:52:23.783837 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 871/1781] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:23 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1425 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:23.791978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd8f86b8-6517-40c9-8eef-d75ad576d14b tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:23.794902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bd8f86b8-6517-40c9-8eef-d75ad576d14b tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:23.816144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8f86b8-6517-40c9-8eef-d75ad576d14b tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:23.822309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8f86b8-6517-40c9-8eef-d75ad576d14b tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:23.826190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8f86b8-6517-40c9-8eef-d75ad576d14b tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:23.832259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8f86b8-6517-40c9-8eef-d75ad576d14b tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:23.832911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8f86b8-6517-40c9-8eef-d75ad576d14b tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:23.833447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8f86b8-6517-40c9-8eef-d75ad576d14b tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:23.979555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-131a880d-0c6e-4237-94f6-3da903cf5b29 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:24.000098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-131a880d-0c6e-4237-94f6-3da903cf5b29 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:24.001666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-131a880d-0c6e-4237-94f6-3da903cf5b29 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:24.002942 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-131a880d-0c6e-4237-94f6-3da903cf5b29 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 1.245432 Oct 27 18:52:24.005067 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 911/1782] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:22 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:52:24.011368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fde92c21-a361-46eb-b1f7-a752329ca30c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:24.011999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fde92c21-a361-46eb-b1f7-a752329ca30c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:24.021506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fde92c21-a361-46eb-b1f7-a752329ca30c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:24.025693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fde92c21-a361-46eb-b1f7-a752329ca30c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:24.026817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fde92c21-a361-46eb-b1f7-a752329ca30c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:24.027886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fde92c21-a361-46eb-b1f7-a752329ca30c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:24.029252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fde92c21-a361-46eb-b1f7-a752329ca30c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:24.031552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fde92c21-a361-46eb-b1f7-a752329ca30c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:24.153047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:24.215416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fde92c21-a361-46eb-b1f7-a752329ca30c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:24.229454 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fde92c21-a361-46eb-b1f7-a752329ca30c tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1276 microversion: 2.1 time: 0.222663 Oct 27 18:52:24.246099 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 912/1783] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:24 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1276 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:24.257056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1cf01593-8423-496c-95a4-628a6fd84338 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b29f430>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:24.356138 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1cf01593-8423-496c-95a4-628a6fd84338 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2" status: 200 len: 1452 microversion: 2.1 time: 0.108632 Oct 27 18:52:24.365803 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 913/1784] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:52:24 2022] GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2 => generated 1452 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:24.375104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-3fbade79-8c56-42e3-b5e6-1c91f5957e7c req-22f5e43c-4596-4805-8528-61d856122e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901fd413-2d42-4014-86c1-5fe80598f789", "name": "network-vif-deleted", "tag": "11fc4a40-18f3-4dcf-b5eb-6e544bd414ef"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:24.474108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3fbade79-8c56-42e3-b5e6-1c91f5957e7c req-22f5e43c-4596-4805-8528-61d856122e07 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:24.477997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3fbade79-8c56-42e3-b5e6-1c91f5957e7c req-22f5e43c-4596-4805-8528-61d856122e07 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:24.478847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3fbade79-8c56-42e3-b5e6-1c91f5957e7c req-22f5e43c-4596-4805-8528-61d856122e07 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:24.539430 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-3fbade79-8c56-42e3-b5e6-1c91f5957e7c req-22f5e43c-4596-4805-8528-61d856122e07 service nova] Creating event network-vif-deleted:11fc4a40-18f3-4dcf-b5eb-6e544bd414ef for instance 901fd413-2d42-4014-86c1-5fe80598f789 on n-h1-860687-3 Oct 27 18:52:24.567577 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-3fbade79-8c56-42e3-b5e6-1c91f5957e7c req-22f5e43c-4596-4805-8528-61d856122e07 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200131 Oct 27 18:52:24.573598 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 914/1785] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:24.593745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2e1929fc-f6cd-4095-b6ec-f749d15d748d tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:24.606767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2e1929fc-f6cd-4095-b6ec-f749d15d748d tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:24.629555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e1929fc-f6cd-4095-b6ec-f749d15d748d tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:24.630336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e1929fc-f6cd-4095-b6ec-f749d15d748d tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:24.635610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e1929fc-f6cd-4095-b6ec-f749d15d748d tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:24.636755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e1929fc-f6cd-4095-b6ec-f749d15d748d tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:24.637404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e1929fc-f6cd-4095-b6ec-f749d15d748d tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:24.638144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e1929fc-f6cd-4095-b6ec-f749d15d748d tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:24.891054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bd8f86b8-6517-40c9-8eef-d75ad576d14b tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:24.908822 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bd8f86b8-6517-40c9-8eef-d75ad576d14b tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1319 microversion: 2.1 time: 1.121671 Oct 27 18:52:24.912108 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 872/1786] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:23 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1319 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:24.924696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55e647d7-bad8-4633-a601-411beccc6ef1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:24.926242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-55e647d7-bad8-4633-a601-411beccc6ef1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:24.945761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e647d7-bad8-4633-a601-411beccc6ef1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:24.946457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e647d7-bad8-4633-a601-411beccc6ef1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:24.947901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e647d7-bad8-4633-a601-411beccc6ef1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:24.949312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e647d7-bad8-4633-a601-411beccc6ef1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:24.950895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e647d7-bad8-4633-a601-411beccc6ef1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:24.952173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e647d7-bad8-4633-a601-411beccc6ef1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:25.006918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2e1929fc-f6cd-4095-b6ec-f749d15d748d tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:25.016078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e647d7-bad8-4633-a601-411beccc6ef1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:25.016987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e647d7-bad8-4633-a601-411beccc6ef1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:25.017779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e647d7-bad8-4633-a601-411beccc6ef1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:25.018970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-55e647d7-bad8-4633-a601-411beccc6ef1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lazy-loading 'fault' on Instance uuid 901fd413-2d42-4014-86c1-5fe80598f789 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:52:25.021221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2e1929fc-f6cd-4095-b6ec-f749d15d748d tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:25.026419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2e1929fc-f6cd-4095-b6ec-f749d15d748d tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:25.029190 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2e1929fc-f6cd-4095-b6ec-f749d15d748d tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.439764 Oct 27 18:52:25.034182 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 915/1787] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:24 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:25.045554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-086112fa-137b-4ff9-b0d6-db0b48cf011d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:25.046485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-086112fa-137b-4ff9-b0d6-db0b48cf011d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:25.062160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-086112fa-137b-4ff9-b0d6-db0b48cf011d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:25.062959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-086112fa-137b-4ff9-b0d6-db0b48cf011d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:25.065923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-086112fa-137b-4ff9-b0d6-db0b48cf011d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:25.072170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-086112fa-137b-4ff9-b0d6-db0b48cf011d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:25.074692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-086112fa-137b-4ff9-b0d6-db0b48cf011d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:25.077495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-086112fa-137b-4ff9-b0d6-db0b48cf011d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:25.128553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-55e647d7-bad8-4633-a601-411beccc6ef1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1917ae65262c40b792c28c2aa4d44b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7f6bb6f7db4b52ad01f0ac3d3aa8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:25.143802 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-55e647d7-bad8-4633-a601-411beccc6ef1 tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 200 len: 1302 microversion: 2.1 time: 0.229167 Oct 27 18:52:25.159474 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 873/1788] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:24 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 1302 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:25.255368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ee707ca6-b8ef-4690-9bd4-da8a64941d10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:25.256709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ee707ca6-b8ef-4690-9bd4-da8a64941d10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:25.270629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee707ca6-b8ef-4690-9bd4-da8a64941d10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:25.272397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee707ca6-b8ef-4690-9bd4-da8a64941d10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:25.272943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee707ca6-b8ef-4690-9bd4-da8a64941d10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:25.275853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee707ca6-b8ef-4690-9bd4-da8a64941d10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:25.277414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee707ca6-b8ef-4690-9bd4-da8a64941d10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:25.277884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee707ca6-b8ef-4690-9bd4-da8a64941d10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:26.004831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ee707ca6-b8ef-4690-9bd4-da8a64941d10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:26.024424 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ee707ca6-b8ef-4690-9bd4-da8a64941d10 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1318 microversion: 2.1 time: 0.773365 Oct 27 18:52:26.026115 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 874/1789] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:25 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1318 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:26.042810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-452406a3-0ce6-4465-8eb3-c325dd434487 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86ae0d1f0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:26.160492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-086112fa-137b-4ff9-b0d6-db0b48cf011d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:26.175912 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-452406a3-0ce6-4465-8eb3-c325dd434487 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2" status: 200 len: 1452 microversion: 2.1 time: 0.146478 Oct 27 18:52:26.177214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-086112fa-137b-4ff9-b0d6-db0b48cf011d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:26.178910 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 875/1790] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:52:26 2022] GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:26.186788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-086112fa-137b-4ff9-b0d6-db0b48cf011d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:26.189553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-23aebb9d-74c3-4133-8cff-b5cfe4dc6939 req-7dcc07f7-4967-4599-9432-47cd8308a432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfb303a-9cf9-45a7-83cc-87ad12e35bb5", "tag": "a8c60220-c624-4a9a-9ec9-dbd2ce3ba561"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:26.190335 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-086112fa-137b-4ff9-b0d6-db0b48cf011d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 1.154157 Oct 27 18:52:26.198173 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 916/1791] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:25 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:26.209967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f33e7a45-a48f-4c3c-a388-99d094c61e72 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:26.215654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f33e7a45-a48f-4c3c-a388-99d094c61e72 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:26.222710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-23aebb9d-74c3-4133-8cff-b5cfe4dc6939 req-7dcc07f7-4967-4599-9432-47cd8308a432 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:26.223647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-23aebb9d-74c3-4133-8cff-b5cfe4dc6939 req-7dcc07f7-4967-4599-9432-47cd8308a432 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:26.224451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-23aebb9d-74c3-4133-8cff-b5cfe4dc6939 req-7dcc07f7-4967-4599-9432-47cd8308a432 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:26.235416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f33e7a45-a48f-4c3c-a388-99d094c61e72 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:26.235942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f33e7a45-a48f-4c3c-a388-99d094c61e72 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:26.237687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f33e7a45-a48f-4c3c-a388-99d094c61e72 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:26.243503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f33e7a45-a48f-4c3c-a388-99d094c61e72 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:26.244364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f33e7a45-a48f-4c3c-a388-99d094c61e72 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:26.244949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f33e7a45-a48f-4c3c-a388-99d094c61e72 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:26.255151 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-23aebb9d-74c3-4133-8cff-b5cfe4dc6939 req-7dcc07f7-4967-4599-9432-47cd8308a432 service nova] Creating event network-changed:a8c60220-c624-4a9a-9ec9-dbd2ce3ba561 for instance fcfb303a-9cf9-45a7-83cc-87ad12e35bb5 on n-h1-860687-3 Oct 27 18:52:26.268484 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-23aebb9d-74c3-4133-8cff-b5cfe4dc6939 req-7dcc07f7-4967-4599-9432-47cd8308a432 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085700 Oct 27 18:52:26.270687 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 876/1792] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:26.283603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b38af700-6cbc-4446-b647-d24c97ee329e tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:26.284954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b38af700-6cbc-4446-b647-d24c97ee329e tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:26.295348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38af700-6cbc-4446-b647-d24c97ee329e tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:26.295348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38af700-6cbc-4446-b647-d24c97ee329e tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:26.295348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38af700-6cbc-4446-b647-d24c97ee329e tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:26.295348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38af700-6cbc-4446-b647-d24c97ee329e tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:26.296014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38af700-6cbc-4446-b647-d24c97ee329e tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:26.296748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38af700-6cbc-4446-b647-d24c97ee329e tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:26.482824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b38af700-6cbc-4446-b647-d24c97ee329e tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:26.494823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b38af700-6cbc-4446-b647-d24c97ee329e tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:26.496628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b38af700-6cbc-4446-b647-d24c97ee329e tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:26.498008 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b38af700-6cbc-4446-b647-d24c97ee329e tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.225870 Oct 27 18:52:26.498633 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 877/1793] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:26 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:26.510830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4935d892-e5b5-47e3-85bb-ad67b9e83b3a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:26.511511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4935d892-e5b5-47e3-85bb-ad67b9e83b3a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] [instance: 901fd413-2d42-4014-86c1-5fe80598f789] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:26.529412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4935d892-e5b5-47e3-85bb-ad67b9e83b3a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:26.529882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4935d892-e5b5-47e3-85bb-ad67b9e83b3a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:26.530327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4935d892-e5b5-47e3-85bb-ad67b9e83b3a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:26.535418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4935d892-e5b5-47e3-85bb-ad67b9e83b3a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:26.536238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4935d892-e5b5-47e3-85bb-ad67b9e83b3a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:26.536914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4935d892-e5b5-47e3-85bb-ad67b9e83b3a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:26.556198 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-4935d892-e5b5-47e3-85bb-ad67b9e83b3a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] HTTP exception thrown: Instance 901fd413-2d42-4014-86c1-5fe80598f789 could not be found. Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4935d892-e5b5-47e3-85bb-ad67b9e83b3a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Request method failure captured: Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 HTTP/1.1 Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtIHwu7BWzo1fbGogUjJvTOtyqBweBjGX-2Z-jKASMIdKeXUaZCS0MyerPerxF0r-nxaePuWKvgRwsrSErx8kThsLBrgNTu0UtV04gQFFJ1ST8BBpppoT6gHzL6AuPBR7CfIsL0W8jrNg-7Hk-tAI12FBPAHiOKBkdR8834SGz_2KuM Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6 Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-MigrationsAdminTest-289834691 Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e7f6bb6f7db4b52ad01f0ac3d3aa8e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e7f6bb6f7db4b52ad01f0ac3d3aa8e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e7f6bb6f7db4b52ad01f0ac3d3aa8e6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e7f6bb6f7db4b52ad01f0ac3d3aa8e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-MigrationsAdminTest-289834691 Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4e7f6bb6f7db4b52ad01f0ac3d3aa8e6 Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-MigrationsAdminTest-289834691 Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-MigrationsAdminTest-289834691-project Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 1917ae65262c40b792c28c2aa4d44b44 Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-MigrationsAdminTest-289834691-project Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 901fd413-2d42-4014-86c1-5fe80598f789 could not be found. Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '901fd413-2d42-4014-86c1-5fe80598f789'} Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 901fd413-2d42-4014-86c1-5fe80598f789 could not be found. Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 901fd413-2d42-4014-86c1-5fe80598f789 could not be found. Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:26.559194 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:26.564855 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:26.564855 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:26.564855 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:26.564855 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:52:26.564855 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:52:26.564855 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 901fd413-2d42-4014-86c1-5fe80598f789 could not be found. Oct 27 18:52:26.564855 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:52:26.565353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4935d892-e5b5-47e3-85bb-ad67b9e83b3a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] Returning 404 to user: Instance 901fd413-2d42-4014-86c1-5fe80598f789 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:52:26.565919 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4935d892-e5b5-47e3-85bb-ad67b9e83b3a tempest-MigrationsAdminTest-289834691 tempest-MigrationsAdminTest-289834691-project] 10.222.0.42 "GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789" status: 404 len: 111 microversion: 2.1 time: 0.066332 Oct 27 18:52:26.572293 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 878/1794] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:26 2022] GET /compute/v2.1/servers/901fd413-2d42-4014-86c1-5fe80598f789 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:52:27.052309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a54fa159-1e3c-4758-83ce-d0b8d16601bb tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:27.052969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a54fa159-1e3c-4758-83ce-d0b8d16601bb tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:27.070323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a54fa159-1e3c-4758-83ce-d0b8d16601bb tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:27.071444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a54fa159-1e3c-4758-83ce-d0b8d16601bb tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:27.072491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a54fa159-1e3c-4758-83ce-d0b8d16601bb tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:27.073539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a54fa159-1e3c-4758-83ce-d0b8d16601bb tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:27.074325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a54fa159-1e3c-4758-83ce-d0b8d16601bb tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:27.075128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a54fa159-1e3c-4758-83ce-d0b8d16601bb tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:27.099992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f33e7a45-a48f-4c3c-a388-99d094c61e72 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:27.115984 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f33e7a45-a48f-4c3c-a388-99d094c61e72 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1319 microversion: 2.1 time: 0.915775 Oct 27 18:52:27.118267 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 917/1795] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:26 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1319 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:27.195189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2e0dd6ed-c14d-4cc7-ae17-1637109b3bcd tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86ab92ca0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:27.296822 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2e0dd6ed-c14d-4cc7-ae17-1637109b3bcd tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2" status: 200 len: 1452 microversion: 2.1 time: 0.105611 Oct 27 18:52:27.299505 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 918/1796] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:52:27 2022] GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:27.310472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7dbbb6ad-03cb-49e8-81ed-932229ee457f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:27.311503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7dbbb6ad-03cb-49e8-81ed-932229ee457f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:27.323909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dbbb6ad-03cb-49e8-81ed-932229ee457f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:27.325284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dbbb6ad-03cb-49e8-81ed-932229ee457f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:27.327563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dbbb6ad-03cb-49e8-81ed-932229ee457f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:27.329161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dbbb6ad-03cb-49e8-81ed-932229ee457f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:27.330666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dbbb6ad-03cb-49e8-81ed-932229ee457f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:27.332032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dbbb6ad-03cb-49e8-81ed-932229ee457f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:27.341019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:27.801637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a54fa159-1e3c-4758-83ce-d0b8d16601bb tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:27.808944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7dbbb6ad-03cb-49e8-81ed-932229ee457f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:27.829821 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a54fa159-1e3c-4758-83ce-d0b8d16601bb tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1318 microversion: 2.1 time: 0.784526 Oct 27 18:52:27.830043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7dbbb6ad-03cb-49e8-81ed-932229ee457f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:27.831272 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 879/1797] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:27 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1318 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:52:27.843544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7dbbb6ad-03cb-49e8-81ed-932229ee457f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:27.849050 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7dbbb6ad-03cb-49e8-81ed-932229ee457f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.544491 Oct 27 18:52:27.853398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-24e26952-fe3b-4175-80c9-c031baed1d05 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:27.857877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-24e26952-fe3b-4175-80c9-c031baed1d05 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:27.862909 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 919/1798] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:27 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:27.873566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24e26952-fe3b-4175-80c9-c031baed1d05 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:27.874426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24e26952-fe3b-4175-80c9-c031baed1d05 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:27.875491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24e26952-fe3b-4175-80c9-c031baed1d05 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:27.876584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24e26952-fe3b-4175-80c9-c031baed1d05 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:27.877424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24e26952-fe3b-4175-80c9-c031baed1d05 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:27.878437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24e26952-fe3b-4175-80c9-c031baed1d05 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:28.011850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-24e26952-fe3b-4175-80c9-c031baed1d05 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:28.026806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-24e26952-fe3b-4175-80c9-c031baed1d05 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:28.031348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-24e26952-fe3b-4175-80c9-c031baed1d05 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:28.032886 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-24e26952-fe3b-4175-80c9-c031baed1d05 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.198273 Oct 27 18:52:28.033957 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 880/1799] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:27 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:28.152450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4553f76c-fdcb-4943-b04b-050a2b1d624f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:28.154684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4553f76c-fdcb-4943-b04b-050a2b1d624f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:28.171669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4553f76c-fdcb-4943-b04b-050a2b1d624f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:28.172630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4553f76c-fdcb-4943-b04b-050a2b1d624f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:28.173323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4553f76c-fdcb-4943-b04b-050a2b1d624f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:28.175162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4553f76c-fdcb-4943-b04b-050a2b1d624f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:28.175162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4553f76c-fdcb-4943-b04b-050a2b1d624f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:28.175606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4553f76c-fdcb-4943-b04b-050a2b1d624f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:28.317568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae10df8b-585f-4de0-aa4f-de2a4948f982 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a4004c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:28.393426 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ae10df8b-585f-4de0-aa4f-de2a4948f982 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2" status: 200 len: 1452 microversion: 2.1 time: 0.082950 Oct 27 18:52:28.413243 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 881/1800] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:52:28 2022] GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:28.423179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-cf60b069-c7d5-4c59-a935-465b2df74602 req-e4dcc2d2-ee9d-41d4-9e2e-434555b1cde0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e288e56e-507d-4ebc-a8e8-56b19aaff597", "tag": "6a2790be-4874-41ac-9a89-bccc175b9913"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:28.450726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cf60b069-c7d5-4c59-a935-465b2df74602 req-e4dcc2d2-ee9d-41d4-9e2e-434555b1cde0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:28.451560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cf60b069-c7d5-4c59-a935-465b2df74602 req-e4dcc2d2-ee9d-41d4-9e2e-434555b1cde0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:28.452252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cf60b069-c7d5-4c59-a935-465b2df74602 req-e4dcc2d2-ee9d-41d4-9e2e-434555b1cde0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:28.475388 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-cf60b069-c7d5-4c59-a935-465b2df74602 req-e4dcc2d2-ee9d-41d4-9e2e-434555b1cde0 service nova] Creating event network-changed:6a2790be-4874-41ac-9a89-bccc175b9913 for instance e288e56e-507d-4ebc-a8e8-56b19aaff597 on n-h2-860687-3 Oct 27 18:52:28.486415 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-cf60b069-c7d5-4c59-a935-465b2df74602 req-e4dcc2d2-ee9d-41d4-9e2e-434555b1cde0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070039 Oct 27 18:52:28.493034 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 882/1801] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:28.744615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4553f76c-fdcb-4943-b04b-050a2b1d624f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:28.756071 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4553f76c-fdcb-4943-b04b-050a2b1d624f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1319 microversion: 2.1 time: 0.615745 Oct 27 18:52:28.761540 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 920/1802] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:28 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1319 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:28.793988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-789b4c0d-e287-4f92-82d5-ac170f59af3e tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Action: 'create', calling method: .version_select at 0x7fc86aeb6f70>, body: {"keypair": {"name": "tempest-keypair-2126868959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWs9jbqEbJfvIxMgn+dbi/d1fpBLOT6ZlVN1PhNLNi0h82ZSsO3qz/AD9BC7m5Ttff8dCAplWNAtf6E6dn2VhMnDuL6WYasqsfcakiVmZWRCw5A/hpYC+4AVPj9yhiEgg=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:28.838608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-789b4c0d-e287-4f92-82d5-ac170f59af3e tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Getting quotas for project dfd09ac8cf7a4b809a996cdebb20d76e. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:52:28.844560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-789b4c0d-e287-4f92-82d5-ac170f59af3e tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Getting quotas for user e5d15a9c4f714dd6a6764b5a431c27d6 and project dfd09ac8cf7a4b809a996cdebb20d76e. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:52:28.858111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b78b1e18-da4c-4c73-8bf7-985d82af4dc5 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:28.858809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b78b1e18-da4c-4c73-8bf7-985d82af4dc5 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:28.870961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b78b1e18-da4c-4c73-8bf7-985d82af4dc5 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:28.872596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b78b1e18-da4c-4c73-8bf7-985d82af4dc5 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:28.874300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b78b1e18-da4c-4c73-8bf7-985d82af4dc5 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:28.875258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b78b1e18-da4c-4c73-8bf7-985d82af4dc5 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:28.880244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b78b1e18-da4c-4c73-8bf7-985d82af4dc5 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:28.881140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b78b1e18-da4c-4c73-8bf7-985d82af4dc5 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:28.886510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:28.900931 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-789b4c0d-e287-4f92-82d5-ac170f59af3e tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.391090 Oct 27 18:52:28.902023 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 883/1803] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:52:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:28.907177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5659bae7-ec95-4b22-a66a-01877ba53d5a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:28.914173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5659bae7-ec95-4b22-a66a-01877ba53d5a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:28.935465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5659bae7-ec95-4b22-a66a-01877ba53d5a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:28.936558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5659bae7-ec95-4b22-a66a-01877ba53d5a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:28.937271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5659bae7-ec95-4b22-a66a-01877ba53d5a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:28.942809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5659bae7-ec95-4b22-a66a-01877ba53d5a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:28.943538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5659bae7-ec95-4b22-a66a-01877ba53d5a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:28.944212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5659bae7-ec95-4b22-a66a-01877ba53d5a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:29.336267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b78b1e18-da4c-4c73-8bf7-985d82af4dc5 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:29.355748 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b78b1e18-da4c-4c73-8bf7-985d82af4dc5 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1318 microversion: 2.1 time: 0.501597 Oct 27 18:52:29.357822 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 921/1804] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:28 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:29.364928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1e07a7a2-a637-4391-bbda-10c246427ba9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:29.365943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1e07a7a2-a637-4391-bbda-10c246427ba9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:29.374673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e07a7a2-a637-4391-bbda-10c246427ba9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:29.375410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e07a7a2-a637-4391-bbda-10c246427ba9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:29.376516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e07a7a2-a637-4391-bbda-10c246427ba9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:29.377609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e07a7a2-a637-4391-bbda-10c246427ba9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:29.378270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e07a7a2-a637-4391-bbda-10c246427ba9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:29.378901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e07a7a2-a637-4391-bbda-10c246427ba9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:29.477703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5659bae7-ec95-4b22-a66a-01877ba53d5a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:29.489390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5659bae7-ec95-4b22-a66a-01877ba53d5a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:29.494544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5659bae7-ec95-4b22-a66a-01877ba53d5a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:29.496479 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5659bae7-ec95-4b22-a66a-01877ba53d5a tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.593072 Oct 27 18:52:29.510802 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 884/1805] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:28 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:29.529057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b197ac44-a837-43d5-bfd9-cffa14000f2a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86ae16f70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:29.594266 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b197ac44-a837-43d5-bfd9-cffa14000f2a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2" status: 200 len: 1452 microversion: 2.1 time: 0.082261 Oct 27 18:52:29.610982 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 885/1806] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:52:29 2022] GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:29.615009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1e07a7a2-a637-4391-bbda-10c246427ba9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:29.619692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-9b8ded5f-6c55-4677-aad1-0143369a679d req-de572a07-7301-4601-9179-02d6e0b32018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07939c40-3c51-4886-813a-04aaeeef35b9", "tag": "19f989fd-2163-4e5e-9ea3-a81013562e5b"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:29.628831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1e07a7a2-a637-4391-bbda-10c246427ba9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:29.636653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1e07a7a2-a637-4391-bbda-10c246427ba9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:29.638191 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1e07a7a2-a637-4391-bbda-10c246427ba9 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.279001 Oct 27 18:52:29.641263 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 922/1807] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:29 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:29.654304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9b8ded5f-6c55-4677-aad1-0143369a679d req-de572a07-7301-4601-9179-02d6e0b32018 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:29.654893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9b8ded5f-6c55-4677-aad1-0143369a679d req-de572a07-7301-4601-9179-02d6e0b32018 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:29.655343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9b8ded5f-6c55-4677-aad1-0143369a679d req-de572a07-7301-4601-9179-02d6e0b32018 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:29.677007 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-9b8ded5f-6c55-4677-aad1-0143369a679d req-de572a07-7301-4601-9179-02d6e0b32018 service nova] Creating event network-changed:19f989fd-2163-4e5e-9ea3-a81013562e5b for instance 07939c40-3c51-4886-813a-04aaeeef35b9 on n-h1-860687-3 Oct 27 18:52:29.680465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-663330191", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "987ea250-de94-4f75-8079-507374a22730"}, {"uuid": "136e1f1e-8ef1-48ad-a24a-29457b34645c"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:29.696945 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-9b8ded5f-6c55-4677-aad1-0143369a679d req-de572a07-7301-4601-9179-02d6e0b32018 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084244 Oct 27 18:52:29.697878 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 886/1808] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:29.785749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e52d4d5-8d44-4770-88b5-879fb6ec18ac tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:29.786496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e52d4d5-8d44-4770-88b5-879fb6ec18ac tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:29.792114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] validate_networks() for [('987ea250-de94-4f75-8079-507374a22730', None, None, None, None, None), ('136e1f1e-8ef1-48ad-a24a-29457b34645c', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:52:29.802252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e52d4d5-8d44-4770-88b5-879fb6ec18ac tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:29.802792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e52d4d5-8d44-4770-88b5-879fb6ec18ac tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:29.803237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e52d4d5-8d44-4770-88b5-879fb6ec18ac tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:29.803970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e52d4d5-8d44-4770-88b5-879fb6ec18ac tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:29.804504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e52d4d5-8d44-4770-88b5-879fb6ec18ac tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:29.805306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e52d4d5-8d44-4770-88b5-879fb6ec18ac tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:30.208822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e52d4d5-8d44-4770-88b5-879fb6ec18ac tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:30.221336 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e52d4d5-8d44-4770-88b5-879fb6ec18ac tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1319 microversion: 2.1 time: 0.439906 Oct 27 18:52:30.222258 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 887/1809] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:29 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:30.233117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-8772275f-9596-41f3-8820-a5d336f7aa10 req-bf05a41c-9234-4dab-b8b6-fa9bff42d723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f02e8ec-759d-48bf-9d99-31fa890241c1", "name": "network-vif-plugged", "status": "completed", "tag": "e08a66dd-bce1-4f3f-ae67-ea863bda862f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:30.259286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8772275f-9596-41f3-8820-a5d336f7aa10 req-bf05a41c-9234-4dab-b8b6-fa9bff42d723 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:30.260119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8772275f-9596-41f3-8820-a5d336f7aa10 req-bf05a41c-9234-4dab-b8b6-fa9bff42d723 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:30.268133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8772275f-9596-41f3-8820-a5d336f7aa10 req-bf05a41c-9234-4dab-b8b6-fa9bff42d723 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:30.296641 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-8772275f-9596-41f3-8820-a5d336f7aa10 req-bf05a41c-9234-4dab-b8b6-fa9bff42d723 service nova] Creating event network-vif-plugged:e08a66dd-bce1-4f3f-ae67-ea863bda862f for instance 1f02e8ec-759d-48bf-9d99-31fa890241c1 on n-h2-860687-3 Oct 27 18:52:30.304075 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-8772275f-9596-41f3-8820-a5d336f7aa10 req-bf05a41c-9234-4dab-b8b6-fa9bff42d723 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080136 Oct 27 18:52:30.306150 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 888/1810] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:30.383031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-97d1ade3-2a1f-418b-8135-fe50d3763885 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:30.384122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-97d1ade3-2a1f-418b-8135-fe50d3763885 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:30.401546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97d1ade3-2a1f-418b-8135-fe50d3763885 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:30.404672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97d1ade3-2a1f-418b-8135-fe50d3763885 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:30.407693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97d1ade3-2a1f-418b-8135-fe50d3763885 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:30.408709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97d1ade3-2a1f-418b-8135-fe50d3763885 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:30.410822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97d1ade3-2a1f-418b-8135-fe50d3763885 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:30.420139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97d1ade3-2a1f-418b-8135-fe50d3763885 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:30.426798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:30.679014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:30.740244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=12 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:30.818109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-97d1ade3-2a1f-418b-8135-fe50d3763885 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:30.832409 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-97d1ade3-2a1f-418b-8135-fe50d3763885 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1318 microversion: 2.1 time: 0.455755 Oct 27 18:52:30.833015 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 889/1811] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:30 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:52:30.861775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c2ab9fe3-8757-4df6-997e-011096ae1bb5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:30.862601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c2ab9fe3-8757-4df6-997e-011096ae1bb5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:30.896425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2ab9fe3-8757-4df6-997e-011096ae1bb5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:30.900797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2ab9fe3-8757-4df6-997e-011096ae1bb5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:30.909060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2ab9fe3-8757-4df6-997e-011096ae1bb5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:30.910202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2ab9fe3-8757-4df6-997e-011096ae1bb5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:30.911304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2ab9fe3-8757-4df6-997e-011096ae1bb5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:30.912190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2ab9fe3-8757-4df6-997e-011096ae1bb5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:32.506719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c2ab9fe3-8757-4df6-997e-011096ae1bb5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:32.528934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c2ab9fe3-8757-4df6-997e-011096ae1bb5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:32.539466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c2ab9fe3-8757-4df6-997e-011096ae1bb5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:32.541180 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c2ab9fe3-8757-4df6-997e-011096ae1bb5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 1.686833 Oct 27 18:52:32.541791 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 890/1812] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:30 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:32.553396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-23a05d5d-b70f-46cf-84a3-148a685f855f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b1b9d30>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:32.647335 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-23a05d5d-b70f-46cf-84a3-148a685f855f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2" status: 200 len: 1452 microversion: 2.1 time: 0.102625 Oct 27 18:52:32.651299 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 891/1813] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:52:32 2022] GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:32.664914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b2f5c52a-af97-47d5-852a-c2f71b237f9f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:32.666880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b2f5c52a-af97-47d5-852a-c2f71b237f9f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:32.694128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2f5c52a-af97-47d5-852a-c2f71b237f9f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:32.698668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2f5c52a-af97-47d5-852a-c2f71b237f9f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:32.699516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2f5c52a-af97-47d5-852a-c2f71b237f9f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:32.704335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2f5c52a-af97-47d5-852a-c2f71b237f9f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:32.705115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2f5c52a-af97-47d5-852a-c2f71b237f9f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:32.706481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2f5c52a-af97-47d5-852a-c2f71b237f9f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:33.063413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b2f5c52a-af97-47d5-852a-c2f71b237f9f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:33.076292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b2f5c52a-af97-47d5-852a-c2f71b237f9f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:33.088028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b2f5c52a-af97-47d5-852a-c2f71b237f9f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:33.089835 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b2f5c52a-af97-47d5-852a-c2f71b237f9f tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.436650 Oct 27 18:52:33.092887 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 892/1814] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:32 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:33.101067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-389207bd-040c-4c35-840e-719b27025e57 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:33.109028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-389207bd-040c-4c35-840e-719b27025e57 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:33.119937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-389207bd-040c-4c35-840e-719b27025e57 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:33.120805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-389207bd-040c-4c35-840e-719b27025e57 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:33.125882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-389207bd-040c-4c35-840e-719b27025e57 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:33.127102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-389207bd-040c-4c35-840e-719b27025e57 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:33.127890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-389207bd-040c-4c35-840e-719b27025e57 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:33.129005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-389207bd-040c-4c35-840e-719b27025e57 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:33.169962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:52:33.171486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:52:33.175489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:52:33.176674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:52:33.177788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:52:33.264694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:33.267797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:33.268457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:33.271680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:33.272259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:33.272740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:33.356721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Getting quotas for project 05e6f4807fd34f6d9422bc06ee20cb10. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:52:33.365065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Getting quotas for user f657dcabf43141b584416d2597efb5cb and project 05e6f4807fd34f6d9422bc06ee20cb10. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:52:33.425987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:52:33.442212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:52:33.592147 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cb7ed0e2-4fe4-4dcf-a23d-6bb393dbe786 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.915623 Oct 27 18:52:33.603562 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 923/1815] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:52:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 18:52:33.603562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-47c464c9-0165-4d0e-a5aa-ed99791c609d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:33.608906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-47c464c9-0165-4d0e-a5aa-ed99791c609d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:33.636037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47c464c9-0165-4d0e-a5aa-ed99791c609d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:33.637490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47c464c9-0165-4d0e-a5aa-ed99791c609d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:33.640381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47c464c9-0165-4d0e-a5aa-ed99791c609d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:33.641365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47c464c9-0165-4d0e-a5aa-ed99791c609d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:33.642940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47c464c9-0165-4d0e-a5aa-ed99791c609d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:33.645527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47c464c9-0165-4d0e-a5aa-ed99791c609d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:33.981000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-389207bd-040c-4c35-840e-719b27025e57 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:33.993548 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-389207bd-040c-4c35-840e-719b27025e57 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1319 microversion: 2.1 time: 0.897689 Oct 27 18:52:33.996606 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 893/1816] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:33 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1319 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:34.021610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f283118a-8a54-4d17-a9ac-f657aa7c402e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:34.022250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f283118a-8a54-4d17-a9ac-f657aa7c402e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:34.041576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f283118a-8a54-4d17-a9ac-f657aa7c402e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:34.042416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f283118a-8a54-4d17-a9ac-f657aa7c402e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:34.043095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f283118a-8a54-4d17-a9ac-f657aa7c402e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:34.056054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f283118a-8a54-4d17-a9ac-f657aa7c402e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:34.057185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f283118a-8a54-4d17-a9ac-f657aa7c402e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:34.057841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f283118a-8a54-4d17-a9ac-f657aa7c402e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:34.202084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-47c464c9-0165-4d0e-a5aa-ed99791c609d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:34.214288 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-47c464c9-0165-4d0e-a5aa-ed99791c609d tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1318 microversion: 2.1 time: 0.615010 Oct 27 18:52:34.243584 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 924/1817] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:33 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1318 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:34.264668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a50a68e-e737-4f83-b124-981c219b47a6 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:34.265441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1a50a68e-e737-4f83-b124-981c219b47a6 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:34.302422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:34.670196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f283118a-8a54-4d17-a9ac-f657aa7c402e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:34.681831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f283118a-8a54-4d17-a9ac-f657aa7c402e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:34.683310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f283118a-8a54-4d17-a9ac-f657aa7c402e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:34.684533 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f283118a-8a54-4d17-a9ac-f657aa7c402e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.686917 Oct 27 18:52:34.691724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1a50a68e-e737-4f83-b124-981c219b47a6 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:34.704909 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1a50a68e-e737-4f83-b124-981c219b47a6 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1212 microversion: 2.1 time: 0.458945 Oct 27 18:52:34.711130 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 925/1818] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:34 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1212 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:34.719427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fdcd826b-96ed-42ba-8ac9-907b2a657a2f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b153b80>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:34.730823 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 894/1819] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:33 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:34.872066 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fdcd826b-96ed-42ba-8ac9-907b2a657a2f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2" status: 200 len: 1452 microversion: 2.1 time: 0.151665 Oct 27 18:52:34.878092 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 926/1820] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:52:34 2022] GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:34.903084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fa779a55-0570-4ad9-85f8-e6eec61ac1b7 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:34.906299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fa779a55-0570-4ad9-85f8-e6eec61ac1b7 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:34.931381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa779a55-0570-4ad9-85f8-e6eec61ac1b7 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:34.933880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa779a55-0570-4ad9-85f8-e6eec61ac1b7 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:34.934344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa779a55-0570-4ad9-85f8-e6eec61ac1b7 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:34.937980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa779a55-0570-4ad9-85f8-e6eec61ac1b7 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:34.938504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa779a55-0570-4ad9-85f8-e6eec61ac1b7 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:34.938958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa779a55-0570-4ad9-85f8-e6eec61ac1b7 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:35.018292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4c346931-4682-4f97-8691-909426113cfb tempest-NetworksTest-823993136 tempest-NetworksTest-823993136-project-admin] Calling method '.version_select at 0x7fc86b7dd0d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:35.148235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fa779a55-0570-4ad9-85f8-e6eec61ac1b7 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:35.170682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fa779a55-0570-4ad9-85f8-e6eec61ac1b7 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:35.172644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fa779a55-0570-4ad9-85f8-e6eec61ac1b7 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:35.174111 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fa779a55-0570-4ad9-85f8-e6eec61ac1b7 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.294634 Oct 27 18:52:35.175059 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 927/1821] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:34 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:35.185126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-0941db02-2b13-445b-9336-6bbc30a5e296 req-b9335662-bd48-4901-9be9-ca107a4cf14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d948f3-a6a5-46cb-b716-79eaf55ff690", "name": "network-vif-unplugged", "status": "completed", "tag": "6b2d83f0-401a-4e99-a170-d27160cbcd4d"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:35.213609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0941db02-2b13-445b-9336-6bbc30a5e296 req-b9335662-bd48-4901-9be9-ca107a4cf14e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:35.214311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0941db02-2b13-445b-9336-6bbc30a5e296 req-b9335662-bd48-4901-9be9-ca107a4cf14e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:35.214775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0941db02-2b13-445b-9336-6bbc30a5e296 req-b9335662-bd48-4901-9be9-ca107a4cf14e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:35.240154 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-0941db02-2b13-445b-9336-6bbc30a5e296 req-b9335662-bd48-4901-9be9-ca107a4cf14e service nova] Creating event network-vif-unplugged:6b2d83f0-401a-4e99-a170-d27160cbcd4d for instance 60d948f3-a6a5-46cb-b716-79eaf55ff690 on n-h2-860687-3 Oct 27 18:52:35.254946 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-0941db02-2b13-445b-9336-6bbc30a5e296 req-b9335662-bd48-4901-9be9-ca107a4cf14e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072539 Oct 27 18:52:35.257331 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 928/1822] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:35.273347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-22560ed5-f74e-477a-909e-d796240d941d tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:35.276202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-22560ed5-f74e-477a-909e-d796240d941d tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:35.291954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22560ed5-f74e-477a-909e-d796240d941d tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:35.292365 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4c346931-4682-4f97-8691-909426113cfb tempest-NetworksTest-823993136 tempest-NetworksTest-823993136-project-admin] 10.222.0.42 "GET /compute/v2.1/os-networks" status: 200 len: 8085 microversion: 2.1 time: 0.560327 Oct 27 18:52:35.292869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22560ed5-f74e-477a-909e-d796240d941d tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:35.293349 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 895/1823] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:52:34 2022] GET /compute/v2.1/os-networks => generated 8085 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:35.293748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22560ed5-f74e-477a-909e-d796240d941d tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:35.294806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22560ed5-f74e-477a-909e-d796240d941d tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:35.295449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22560ed5-f74e-477a-909e-d796240d941d tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:35.296082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22560ed5-f74e-477a-909e-d796240d941d tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:35.298435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b4b42d2e-c1d8-4e7f-bd92-993630ec46fe tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:35.299091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b4b42d2e-c1d8-4e7f-bd92-993630ec46fe tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:35.317967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4b42d2e-c1d8-4e7f-bd92-993630ec46fe tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:35.318584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4b42d2e-c1d8-4e7f-bd92-993630ec46fe tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:35.319034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4b42d2e-c1d8-4e7f-bd92-993630ec46fe tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:35.325826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4b42d2e-c1d8-4e7f-bd92-993630ec46fe tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:35.327694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4b42d2e-c1d8-4e7f-bd92-993630ec46fe tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:35.328788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4b42d2e-c1d8-4e7f-bd92-993630ec46fe tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:35.558452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-22560ed5-f74e-477a-909e-d796240d941d tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:35.564094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b4b42d2e-c1d8-4e7f-bd92-993630ec46fe tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:35.567981 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-22560ed5-f74e-477a-909e-d796240d941d tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1319 microversion: 2.1 time: 0.308348 Oct 27 18:52:35.587641 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b4b42d2e-c1d8-4e7f-bd92-993630ec46fe tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1318 microversion: 2.1 time: 0.293040 Oct 27 18:52:35.588203 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 929/1824] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:35 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:35.588941 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 896/1825] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:35 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:35.595614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eb583201-b968-4969-815f-2d5c1b0d5e59 tempest-NetworksTest-823993136 tempest-NetworksTest-823993136-project-admin] Calling method '.version_select at 0x7fc86abbaf70>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:35.716359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-25428827-2307-4b58-91f2-dccda32dcbe4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:35.717281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-25428827-2307-4b58-91f2-dccda32dcbe4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:35.727070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25428827-2307-4b58-91f2-dccda32dcbe4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:35.727969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25428827-2307-4b58-91f2-dccda32dcbe4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:35.728605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25428827-2307-4b58-91f2-dccda32dcbe4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:35.729517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25428827-2307-4b58-91f2-dccda32dcbe4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:35.730415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25428827-2307-4b58-91f2-dccda32dcbe4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:35.731066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25428827-2307-4b58-91f2-dccda32dcbe4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:35.964317 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eb583201-b968-4969-815f-2d5c1b0d5e59 tempest-NetworksTest-823993136 tempest-NetworksTest-823993136-project-admin] 10.222.0.42 "GET /compute/v2.1/os-networks/7df642ec-8467-4952-9b8b-a0179be2d86e" status: 200 len: 652 microversion: 2.1 time: 0.374827 Oct 27 18:52:35.965609 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 930/1826] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 18:52:35 2022] GET /compute/v2.1/os-networks/7df642ec-8467-4952-9b8b-a0179be2d86e => generated 652 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:35.976876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-19da0a93-6da6-4d23-973b-e46d4c5663da tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:35.977879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-19da0a93-6da6-4d23-973b-e46d4c5663da tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:35.984542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19da0a93-6da6-4d23-973b-e46d4c5663da tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:35.985873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19da0a93-6da6-4d23-973b-e46d4c5663da tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:35.986595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19da0a93-6da6-4d23-973b-e46d4c5663da tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:35.987566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19da0a93-6da6-4d23-973b-e46d4c5663da tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:35.988273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19da0a93-6da6-4d23-973b-e46d4c5663da tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:35.988942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19da0a93-6da6-4d23-973b-e46d4c5663da tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:36.078609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-25428827-2307-4b58-91f2-dccda32dcbe4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:36.103763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-25428827-2307-4b58-91f2-dccda32dcbe4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:36.109304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-19da0a93-6da6-4d23-973b-e46d4c5663da tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:36.112037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-25428827-2307-4b58-91f2-dccda32dcbe4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:36.117713 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-25428827-2307-4b58-91f2-dccda32dcbe4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.406535 Oct 27 18:52:36.119079 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-19da0a93-6da6-4d23-973b-e46d4c5663da tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1264 microversion: 2.1 time: 0.147869 Oct 27 18:52:36.120183 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 931/1827] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:35 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:36.121258 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 897/1828] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:35 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:52:36.131295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0b704c8e-0630-492b-80a4-a473cf64d6a4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b1c28b0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:36.134986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8122d44a-3c7f-4b49-a7fc-5c2a5a96608c tempest-NetworksTest-823993136 tempest-NetworksTest-823993136-project-admin] Calling method '.version_select at 0x7fc86ac1fee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:36.275020 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0b704c8e-0630-492b-80a4-a473cf64d6a4 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2" status: 200 len: 1452 microversion: 2.1 time: 0.147100 Oct 27 18:52:36.301142 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 932/1829] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:52:36 2022] GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2 => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:36.307431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-882cd2ad-ac10-4444-8871-717f6f72c5b4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:36.308969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-882cd2ad-ac10-4444-8871-717f6f72c5b4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:36.329712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-882cd2ad-ac10-4444-8871-717f6f72c5b4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:36.331363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-882cd2ad-ac10-4444-8871-717f6f72c5b4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:36.332600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-882cd2ad-ac10-4444-8871-717f6f72c5b4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:36.339455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-882cd2ad-ac10-4444-8871-717f6f72c5b4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:36.339958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-882cd2ad-ac10-4444-8871-717f6f72c5b4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:36.340409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-882cd2ad-ac10-4444-8871-717f6f72c5b4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:36.397388 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8122d44a-3c7f-4b49-a7fc-5c2a5a96608c tempest-NetworksTest-823993136 tempest-NetworksTest-823993136-project-admin] 10.222.0.42 "GET /compute/v2.1/os-networks" status: 200 len: 8085 microversion: 2.1 time: 0.273658 Oct 27 18:52:36.398523 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 898/1830] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:52:36 2022] GET /compute/v2.1/os-networks => generated 8085 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:36.598825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6a3d198-be7b-40f0-a1fd-dff38d6942db tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:36.599830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d6a3d198-be7b-40f0-a1fd-dff38d6942db tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:36.614810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6a3d198-be7b-40f0-a1fd-dff38d6942db tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:36.615782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6a3d198-be7b-40f0-a1fd-dff38d6942db tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:36.616475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6a3d198-be7b-40f0-a1fd-dff38d6942db tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:36.619254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6a3d198-be7b-40f0-a1fd-dff38d6942db tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:36.621521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6a3d198-be7b-40f0-a1fd-dff38d6942db tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:36.622257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6a3d198-be7b-40f0-a1fd-dff38d6942db tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:36.658448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-882cd2ad-ac10-4444-8871-717f6f72c5b4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:36.672112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-882cd2ad-ac10-4444-8871-717f6f72c5b4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:36.678912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-882cd2ad-ac10-4444-8871-717f6f72c5b4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:36.682214 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-882cd2ad-ac10-4444-8871-717f6f72c5b4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1366 microversion: 2.47 time: 0.379708 Oct 27 18:52:36.696358 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 933/1831] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:36 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:36.702889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d3ff82b1-3981-4ab4-9749-5dc0073659e0 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:36.707628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d3ff82b1-3981-4ab4-9749-5dc0073659e0 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:36.723500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ff82b1-3981-4ab4-9749-5dc0073659e0 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:36.724044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ff82b1-3981-4ab4-9749-5dc0073659e0 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:36.724453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ff82b1-3981-4ab4-9749-5dc0073659e0 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:36.729219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ff82b1-3981-4ab4-9749-5dc0073659e0 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:36.730687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ff82b1-3981-4ab4-9749-5dc0073659e0 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:36.732864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ff82b1-3981-4ab4-9749-5dc0073659e0 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:36.926419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d6a3d198-be7b-40f0-a1fd-dff38d6942db tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:36.950495 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d6a3d198-be7b-40f0-a1fd-dff38d6942db tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1319 microversion: 2.1 time: 0.353884 Oct 27 18:52:36.954077 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 899/1832] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:36 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:37.155408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7d48fa74-d12e-408a-9092-c8b0b1f62509 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:37.156176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7d48fa74-d12e-408a-9092-c8b0b1f62509 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:37.180041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d48fa74-d12e-408a-9092-c8b0b1f62509 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:37.180713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d48fa74-d12e-408a-9092-c8b0b1f62509 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:37.181370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d48fa74-d12e-408a-9092-c8b0b1f62509 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:37.182408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d48fa74-d12e-408a-9092-c8b0b1f62509 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:37.188174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d48fa74-d12e-408a-9092-c8b0b1f62509 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:37.189807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d48fa74-d12e-408a-9092-c8b0b1f62509 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:37.192398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d3ff82b1-3981-4ab4-9749-5dc0073659e0 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:37.207883 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d3ff82b1-3981-4ab4-9749-5dc0073659e0 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1318 microversion: 2.1 time: 0.506646 Oct 27 18:52:37.209668 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 934/1833] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:36 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:37.223473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-32f2d57d-e63c-45e4-82c4-b9694e80181b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:37.225166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-32f2d57d-e63c-45e4-82c4-b9694e80181b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:37.247825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32f2d57d-e63c-45e4-82c4-b9694e80181b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:37.249563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32f2d57d-e63c-45e4-82c4-b9694e80181b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:37.250034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32f2d57d-e63c-45e4-82c4-b9694e80181b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:37.250793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32f2d57d-e63c-45e4-82c4-b9694e80181b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:37.251254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32f2d57d-e63c-45e4-82c4-b9694e80181b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:37.251718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32f2d57d-e63c-45e4-82c4-b9694e80181b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:37.395570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-32f2d57d-e63c-45e4-82c4-b9694e80181b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:37.405174 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-32f2d57d-e63c-45e4-82c4-b9694e80181b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1272 microversion: 2.1 time: 0.193177 Oct 27 18:52:37.405763 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 935/1834] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:37 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:37.438579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5abb360a-ba24-47db-b928-b8e4b47d05fc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b153a60>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:37.564522 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5abb360a-ba24-47db-b928-b8e4b47d05fc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2" status: 200 len: 1452 microversion: 2.1 time: 0.157659 Oct 27 18:52:37.581091 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 936/1835] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:52:37 2022] GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2 => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:37.600632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-388d014c-48d0-4478-9648-79663551b4b2 req-2a079870-68e3-47fb-88dc-83c0ece4e69d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d948f3-a6a5-46cb-b716-79eaf55ff690", "tag": "6b2d83f0-401a-4e99-a170-d27160cbcd4d"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:37.619045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-388d014c-48d0-4478-9648-79663551b4b2 req-2a079870-68e3-47fb-88dc-83c0ece4e69d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:37.619758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-388d014c-48d0-4478-9648-79663551b4b2 req-2a079870-68e3-47fb-88dc-83c0ece4e69d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:37.620497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-388d014c-48d0-4478-9648-79663551b4b2 req-2a079870-68e3-47fb-88dc-83c0ece4e69d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:37.636771 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-388d014c-48d0-4478-9648-79663551b4b2 req-2a079870-68e3-47fb-88dc-83c0ece4e69d service nova] Creating event network-changed:6b2d83f0-401a-4e99-a170-d27160cbcd4d for instance 60d948f3-a6a5-46cb-b716-79eaf55ff690 on n-h2-860687-3 Oct 27 18:52:37.642924 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-388d014c-48d0-4478-9648-79663551b4b2 req-2a079870-68e3-47fb-88dc-83c0ece4e69d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060210 Oct 27 18:52:37.644612 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 937/1836] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:37.651370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-487b7dc0-ff35-40f2-92d7-b658b8eddb99 req-b96946a7-dc10-4145-b74d-936b3cdbc356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfb303a-9cf9-45a7-83cc-87ad12e35bb5", "name": "network-vif-plugged", "status": "completed", "tag": "a8c60220-c624-4a9a-9ec9-dbd2ce3ba561"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:37.678750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-487b7dc0-ff35-40f2-92d7-b658b8eddb99 req-b96946a7-dc10-4145-b74d-936b3cdbc356 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:37.680779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-487b7dc0-ff35-40f2-92d7-b658b8eddb99 req-b96946a7-dc10-4145-b74d-936b3cdbc356 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:37.681715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-487b7dc0-ff35-40f2-92d7-b658b8eddb99 req-b96946a7-dc10-4145-b74d-936b3cdbc356 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:37.704055 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-487b7dc0-ff35-40f2-92d7-b658b8eddb99 req-b96946a7-dc10-4145-b74d-936b3cdbc356 service nova] Creating event network-vif-plugged:a8c60220-c624-4a9a-9ec9-dbd2ce3ba561 for instance fcfb303a-9cf9-45a7-83cc-87ad12e35bb5 on n-h1-860687-3 Oct 27 18:52:37.720946 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-487b7dc0-ff35-40f2-92d7-b658b8eddb99 req-b96946a7-dc10-4145-b74d-936b3cdbc356 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074707 Oct 27 18:52:37.722191 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 938/1837] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:37.732185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e839f94a-cdaa-4882-b6ca-a3e51c30a468 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:37.735859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e839f94a-cdaa-4882-b6ca-a3e51c30a468 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:37.746417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e839f94a-cdaa-4882-b6ca-a3e51c30a468 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:37.747200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e839f94a-cdaa-4882-b6ca-a3e51c30a468 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:37.747935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e839f94a-cdaa-4882-b6ca-a3e51c30a468 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:37.749091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e839f94a-cdaa-4882-b6ca-a3e51c30a468 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:37.749825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e839f94a-cdaa-4882-b6ca-a3e51c30a468 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:37.750532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e839f94a-cdaa-4882-b6ca-a3e51c30a468 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:37.870265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e839f94a-cdaa-4882-b6ca-a3e51c30a468 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:37.885736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e839f94a-cdaa-4882-b6ca-a3e51c30a468 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:37.887776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e839f94a-cdaa-4882-b6ca-a3e51c30a468 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:37.891149 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e839f94a-cdaa-4882-b6ca-a3e51c30a468 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1372 microversion: 2.47 time: 0.166749 Oct 27 18:52:37.912327 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 939/1838] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:37 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:37.997025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dc9d8455-d655-4988-9251-d3a69b1d7576 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:37.997655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dc9d8455-d655-4988-9251-d3a69b1d7576 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:38.011131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc9d8455-d655-4988-9251-d3a69b1d7576 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:38.015638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc9d8455-d655-4988-9251-d3a69b1d7576 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:38.016399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc9d8455-d655-4988-9251-d3a69b1d7576 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:38.017403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc9d8455-d655-4988-9251-d3a69b1d7576 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:38.020236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc9d8455-d655-4988-9251-d3a69b1d7576 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:38.021715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc9d8455-d655-4988-9251-d3a69b1d7576 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:38.064364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7d48fa74-d12e-408a-9092-c8b0b1f62509 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:38.079265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7d48fa74-d12e-408a-9092-c8b0b1f62509 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:38.084068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7d48fa74-d12e-408a-9092-c8b0b1f62509 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:38.086156 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7d48fa74-d12e-408a-9092-c8b0b1f62509 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.934519 Oct 27 18:52:38.090708 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 900/1839] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:37 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:38.237590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7728ebb1-bf1c-4c1a-9468-5d9915d3df87 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:38.239066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7728ebb1-bf1c-4c1a-9468-5d9915d3df87 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:38.247062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7728ebb1-bf1c-4c1a-9468-5d9915d3df87 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:38.247854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7728ebb1-bf1c-4c1a-9468-5d9915d3df87 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:38.248467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7728ebb1-bf1c-4c1a-9468-5d9915d3df87 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:38.249366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7728ebb1-bf1c-4c1a-9468-5d9915d3df87 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:38.249995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7728ebb1-bf1c-4c1a-9468-5d9915d3df87 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:38.250867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7728ebb1-bf1c-4c1a-9468-5d9915d3df87 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:38.864142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:38.957261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dc9d8455-d655-4988-9251-d3a69b1d7576 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:38.967571 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dc9d8455-d655-4988-9251-d3a69b1d7576 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1319 microversion: 2.1 time: 0.981071 Oct 27 18:52:38.968167 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 940/1840] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:37 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1319 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:38.987738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de5fa6ae-7bb8-4f5d-b4d7-5fae487d9edd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:38.988284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-de5fa6ae-7bb8-4f5d-b4d7-5fae487d9edd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:39.017588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de5fa6ae-7bb8-4f5d-b4d7-5fae487d9edd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:39.025094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de5fa6ae-7bb8-4f5d-b4d7-5fae487d9edd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:39.027465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de5fa6ae-7bb8-4f5d-b4d7-5fae487d9edd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:39.028597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de5fa6ae-7bb8-4f5d-b4d7-5fae487d9edd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:39.029533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de5fa6ae-7bb8-4f5d-b4d7-5fae487d9edd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:39.031290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de5fa6ae-7bb8-4f5d-b4d7-5fae487d9edd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:39.226964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-de5fa6ae-7bb8-4f5d-b4d7-5fae487d9edd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:39.253142 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-de5fa6ae-7bb8-4f5d-b4d7-5fae487d9edd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1270 microversion: 2.1 time: 0.273579 Oct 27 18:52:39.258670 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 941/1841] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:38 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1270 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:39.279672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b9539e8a-ad6d-48dc-b40b-1ee6a13b6440 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b284160>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:39.417366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7728ebb1-bf1c-4c1a-9468-5d9915d3df87 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:39.437483 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7728ebb1-bf1c-4c1a-9468-5d9915d3df87 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1318 microversion: 2.1 time: 1.205811 Oct 27 18:52:39.439158 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 901/1842] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:38 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1318 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:39.456641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-64b51048-832c-4be9-abbf-172f12d33a78 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:39.457995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-64b51048-832c-4be9-abbf-172f12d33a78 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:39.467462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64b51048-832c-4be9-abbf-172f12d33a78 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:39.468225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64b51048-832c-4be9-abbf-172f12d33a78 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:39.468895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64b51048-832c-4be9-abbf-172f12d33a78 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:39.469627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64b51048-832c-4be9-abbf-172f12d33a78 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:39.470100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64b51048-832c-4be9-abbf-172f12d33a78 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:39.470575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64b51048-832c-4be9-abbf-172f12d33a78 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:39.652397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-64b51048-832c-4be9-abbf-172f12d33a78 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:39.661079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-64b51048-832c-4be9-abbf-172f12d33a78 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:39.667761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-64b51048-832c-4be9-abbf-172f12d33a78 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:39.669006 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-64b51048-832c-4be9-abbf-172f12d33a78 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1372 microversion: 2.47 time: 0.226550 Oct 27 18:52:39.669585 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 902/1843] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:39 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1372 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:39.684788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71d4e716-bb8c-4077-b0de-6d51ce791069 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:39.685963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-71d4e716-bb8c-4077-b0de-6d51ce791069 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:39.697821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d4e716-bb8c-4077-b0de-6d51ce791069 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:39.698557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d4e716-bb8c-4077-b0de-6d51ce791069 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:39.699246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d4e716-bb8c-4077-b0de-6d51ce791069 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:39.700445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d4e716-bb8c-4077-b0de-6d51ce791069 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:39.701159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d4e716-bb8c-4077-b0de-6d51ce791069 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:39.701999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d4e716-bb8c-4077-b0de-6d51ce791069 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:40.047164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-71d4e716-bb8c-4077-b0de-6d51ce791069 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:40.087642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-71d4e716-bb8c-4077-b0de-6d51ce791069 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:40.100146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-71d4e716-bb8c-4077-b0de-6d51ce791069 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:40.104991 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-71d4e716-bb8c-4077-b0de-6d51ce791069 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.425197 Oct 27 18:52:40.110678 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 903/1844] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:39 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:40.125464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-0d56029d-adfd-4767-a03a-9bbc2a60ec97 req-335ec9b3-fce7-4db1-b80d-8def0aeedb7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e288e56e-507d-4ebc-a8e8-56b19aaff597", "name": "network-vif-plugged", "status": "completed", "tag": "6a2790be-4874-41ac-9a89-bccc175b9913"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:40.173515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0d56029d-adfd-4767-a03a-9bbc2a60ec97 req-335ec9b3-fce7-4db1-b80d-8def0aeedb7a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:40.174578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0d56029d-adfd-4767-a03a-9bbc2a60ec97 req-335ec9b3-fce7-4db1-b80d-8def0aeedb7a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:40.175217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0d56029d-adfd-4767-a03a-9bbc2a60ec97 req-335ec9b3-fce7-4db1-b80d-8def0aeedb7a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:40.217945 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-0d56029d-adfd-4767-a03a-9bbc2a60ec97 req-335ec9b3-fce7-4db1-b80d-8def0aeedb7a service nova] Creating event network-vif-plugged:6a2790be-4874-41ac-9a89-bccc175b9913 for instance e288e56e-507d-4ebc-a8e8-56b19aaff597 on n-h2-860687-3 Oct 27 18:52:40.236274 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-0d56029d-adfd-4767-a03a-9bbc2a60ec97 req-335ec9b3-fce7-4db1-b80d-8def0aeedb7a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122428 Oct 27 18:52:40.241179 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 904/1845] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:40.247493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-88c49447-df5b-4fa5-b3e4-9e3e1b9a9a62 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:40.261592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-88c49447-df5b-4fa5-b3e4-9e3e1b9a9a62 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:40.287518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88c49447-df5b-4fa5-b3e4-9e3e1b9a9a62 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:40.290064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88c49447-df5b-4fa5-b3e4-9e3e1b9a9a62 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:40.290792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88c49447-df5b-4fa5-b3e4-9e3e1b9a9a62 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:40.291769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88c49447-df5b-4fa5-b3e4-9e3e1b9a9a62 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:40.292484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88c49447-df5b-4fa5-b3e4-9e3e1b9a9a62 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:40.293145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88c49447-df5b-4fa5-b3e4-9e3e1b9a9a62 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:41.008431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-88c49447-df5b-4fa5-b3e4-9e3e1b9a9a62 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:41.029870 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-88c49447-df5b-4fa5-b3e4-9e3e1b9a9a62 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1319 microversion: 2.1 time: 0.786548 Oct 27 18:52:41.031513 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 905/1846] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:40 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1319 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:41.037835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-97063ab7-fc1b-47da-bf09-0a0f1b8c6463 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:41.056652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-97063ab7-fc1b-47da-bf09-0a0f1b8c6463 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:41.073024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97063ab7-fc1b-47da-bf09-0a0f1b8c6463 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:41.073538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97063ab7-fc1b-47da-bf09-0a0f1b8c6463 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:41.074066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97063ab7-fc1b-47da-bf09-0a0f1b8c6463 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:41.075097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97063ab7-fc1b-47da-bf09-0a0f1b8c6463 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:41.076624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97063ab7-fc1b-47da-bf09-0a0f1b8c6463 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:41.078148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97063ab7-fc1b-47da-bf09-0a0f1b8c6463 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:41.494249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-97063ab7-fc1b-47da-bf09-0a0f1b8c6463 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:41.504856 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-97063ab7-fc1b-47da-bf09-0a0f1b8c6463 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1312 microversion: 2.1 time: 0.471893 Oct 27 18:52:41.512984 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 906/1847] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:41 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1312 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:41.520099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c57ff360-f9ff-43a1-b182-09a54b08079e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:41.521981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c57ff360-f9ff-43a1-b182-09a54b08079e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:41.541049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c57ff360-f9ff-43a1-b182-09a54b08079e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:41.541843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c57ff360-f9ff-43a1-b182-09a54b08079e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:41.546238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c57ff360-f9ff-43a1-b182-09a54b08079e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:41.547618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c57ff360-f9ff-43a1-b182-09a54b08079e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:41.548453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c57ff360-f9ff-43a1-b182-09a54b08079e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:41.549116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c57ff360-f9ff-43a1-b182-09a54b08079e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:41.852979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c57ff360-f9ff-43a1-b182-09a54b08079e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:41.880741 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c57ff360-f9ff-43a1-b182-09a54b08079e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1318 microversion: 2.1 time: 0.362713 Oct 27 18:52:41.885548 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 907/1848] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:41 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:41.892644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aa7cf33f-b013-402d-b747-379eb4008a47 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:41.893539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aa7cf33f-b013-402d-b747-379eb4008a47 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:41.901318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa7cf33f-b013-402d-b747-379eb4008a47 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:41.902341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa7cf33f-b013-402d-b747-379eb4008a47 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:41.903020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa7cf33f-b013-402d-b747-379eb4008a47 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:41.904033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa7cf33f-b013-402d-b747-379eb4008a47 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:41.904932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa7cf33f-b013-402d-b747-379eb4008a47 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:41.905705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa7cf33f-b013-402d-b747-379eb4008a47 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:42.114585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aa7cf33f-b013-402d-b747-379eb4008a47 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:42.131173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aa7cf33f-b013-402d-b747-379eb4008a47 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:42.137907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aa7cf33f-b013-402d-b747-379eb4008a47 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:42.141687 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aa7cf33f-b013-402d-b747-379eb4008a47 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1357 microversion: 2.47 time: 0.252901 Oct 27 18:52:42.161888 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 908/1849] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:41 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1357 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:42.176955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d81e2915-6739-49f8-a802-db23de5c1dc7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:42.177951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d81e2915-6739-49f8-a802-db23de5c1dc7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:42.186901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d81e2915-6739-49f8-a802-db23de5c1dc7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:42.187897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d81e2915-6739-49f8-a802-db23de5c1dc7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:42.188615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d81e2915-6739-49f8-a802-db23de5c1dc7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:42.189566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d81e2915-6739-49f8-a802-db23de5c1dc7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:42.190916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d81e2915-6739-49f8-a802-db23de5c1dc7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:42.191618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d81e2915-6739-49f8-a802-db23de5c1dc7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:42.220911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:42.426052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d81e2915-6739-49f8-a802-db23de5c1dc7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:42.449073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d81e2915-6739-49f8-a802-db23de5c1dc7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:42.453363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d81e2915-6739-49f8-a802-db23de5c1dc7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:42.462788 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d81e2915-6739-49f8-a802-db23de5c1dc7 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.299004 Oct 27 18:52:42.470187 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 909/1850] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:42 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:42.475551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bc1f4a5a-0681-400d-956d-7852faebb5ba tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:42.479072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bc1f4a5a-0681-400d-956d-7852faebb5ba tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:42.497936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc1f4a5a-0681-400d-956d-7852faebb5ba tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:42.498775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc1f4a5a-0681-400d-956d-7852faebb5ba tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:42.499400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc1f4a5a-0681-400d-956d-7852faebb5ba tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:42.500319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc1f4a5a-0681-400d-956d-7852faebb5ba tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:42.500991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc1f4a5a-0681-400d-956d-7852faebb5ba tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:42.501608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc1f4a5a-0681-400d-956d-7852faebb5ba tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:43.113353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bc1f4a5a-0681-400d-956d-7852faebb5ba tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:43.135909 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bc1f4a5a-0681-400d-956d-7852faebb5ba tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 200 len: 1506 microversion: 2.1 time: 0.660361 Oct 27 18:52:43.138235 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 910/1851] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:42 2022] GET /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 1506 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:43.147422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:43.160981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:43.172006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Searching by: {'deleted': False, 'project_id': '838e2192e7a74b46829aa6fa134570de'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:52:43.185551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:43.204975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:43.206197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:43.207342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:43.209113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:43.211416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:43.324413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:43.493661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:52:43.691592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:43.701845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:43.702939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:43.704508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:43.717276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:43.719194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:43.854785 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bd2e82b4-a2a7-46dd-9b12-83f7ff2e7afc tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.715077 Oct 27 18:52:43.871343 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 911/1852] 10.222.0.42 () {60 vars in 1187 bytes} [Thu Oct 27 18:52:43 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:43.889470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-1661a220-84fd-46ba-8c3e-324078c11270 req-e21c6085-3c90-4259-b56c-f429facf24ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07939c40-3c51-4886-813a-04aaeeef35b9", "name": "network-vif-plugged", "status": "completed", "tag": "19f989fd-2163-4e5e-9ea3-a81013562e5b"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:43.920533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1661a220-84fd-46ba-8c3e-324078c11270 req-e21c6085-3c90-4259-b56c-f429facf24ca service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:43.923680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1661a220-84fd-46ba-8c3e-324078c11270 req-e21c6085-3c90-4259-b56c-f429facf24ca service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:43.925282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1661a220-84fd-46ba-8c3e-324078c11270 req-e21c6085-3c90-4259-b56c-f429facf24ca service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:43.965975 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-1661a220-84fd-46ba-8c3e-324078c11270 req-e21c6085-3c90-4259-b56c-f429facf24ca service nova] Creating event network-vif-plugged:19f989fd-2163-4e5e-9ea3-a81013562e5b for instance 07939c40-3c51-4886-813a-04aaeeef35b9 on n-h1-860687-3 Oct 27 18:52:43.981940 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-1661a220-84fd-46ba-8c3e-324078c11270 req-e21c6085-3c90-4259-b56c-f429facf24ca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108578 Oct 27 18:52:43.985263 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 912/1853] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:44.004495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e8cfd36c-f2a8-4182-b5c4-fbe3a3b4aecb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:44.017471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e8cfd36c-f2a8-4182-b5c4-fbe3a3b4aecb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:44.055651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8cfd36c-f2a8-4182-b5c4-fbe3a3b4aecb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:44.056159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8cfd36c-f2a8-4182-b5c4-fbe3a3b4aecb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:44.056603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8cfd36c-f2a8-4182-b5c4-fbe3a3b4aecb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:44.057330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8cfd36c-f2a8-4182-b5c4-fbe3a3b4aecb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:44.057936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8cfd36c-f2a8-4182-b5c4-fbe3a3b4aecb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:44.058205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8cfd36c-f2a8-4182-b5c4-fbe3a3b4aecb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:44.705506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:44.846430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8cfd36c-f2a8-4182-b5c4-fbe3a3b4aecb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:44.861428 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e8cfd36c-f2a8-4182-b5c4-fbe3a3b4aecb tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1333 microversion: 2.1 time: 0.869694 Oct 27 18:52:44.862358 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 913/1854] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:43 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1333 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:44.876444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ce73a17-bb20-4a95-b344-554d296105d3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:44.880494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3ce73a17-bb20-4a95-b344-554d296105d3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:44.895200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce73a17-bb20-4a95-b344-554d296105d3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:44.895813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce73a17-bb20-4a95-b344-554d296105d3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:44.898279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce73a17-bb20-4a95-b344-554d296105d3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:44.899205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce73a17-bb20-4a95-b344-554d296105d3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:44.901021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce73a17-bb20-4a95-b344-554d296105d3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:44.904416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce73a17-bb20-4a95-b344-554d296105d3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:45.327784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ce73a17-bb20-4a95-b344-554d296105d3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:45.338235 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3ce73a17-bb20-4a95-b344-554d296105d3 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1318 microversion: 2.1 time: 0.473825 Oct 27 18:52:45.364185 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 914/1855] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:44 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:45.378289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-425e59cf-c49a-452f-b937-23339c2afd67 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:45.380000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-425e59cf-c49a-452f-b937-23339c2afd67 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: fcfb303a-9cf9-45a7-83cc-87ad12e35bb5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:45.395108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-425e59cf-c49a-452f-b937-23339c2afd67 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:45.401116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-425e59cf-c49a-452f-b937-23339c2afd67 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:45.401714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-425e59cf-c49a-452f-b937-23339c2afd67 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:45.402727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-425e59cf-c49a-452f-b937-23339c2afd67 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:45.403379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-425e59cf-c49a-452f-b937-23339c2afd67 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:45.404107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-425e59cf-c49a-452f-b937-23339c2afd67 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:45.875125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-425e59cf-c49a-452f-b937-23339c2afd67 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:45.885919 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-425e59cf-c49a-452f-b937-23339c2afd67 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/fcfb303a-9cf9-45a7-83cc-87ad12e35bb5" status: 200 len: 1507 microversion: 2.1 time: 0.521143 Oct 27 18:52:45.887823 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 915/1856] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:45 2022] GET /compute/v2.1/servers/fcfb303a-9cf9-45a7-83cc-87ad12e35bb5 => generated 1507 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:45.903609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-45f9b6b6-f265-40e0-92d8-100251e07795 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:45.904273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-45f9b6b6-f265-40e0-92d8-100251e07795 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:45.920412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45f9b6b6-f265-40e0-92d8-100251e07795 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:45.922658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45f9b6b6-f265-40e0-92d8-100251e07795 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:45.922826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45f9b6b6-f265-40e0-92d8-100251e07795 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:45.923689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45f9b6b6-f265-40e0-92d8-100251e07795 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:45.928174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45f9b6b6-f265-40e0-92d8-100251e07795 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:45.931275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45f9b6b6-f265-40e0-92d8-100251e07795 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:46.349417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-45f9b6b6-f265-40e0-92d8-100251e07795 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:46.372731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-45f9b6b6-f265-40e0-92d8-100251e07795 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:46.375096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-45f9b6b6-f265-40e0-92d8-100251e07795 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:46.376342 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-45f9b6b6-f265-40e0-92d8-100251e07795 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.486249 Oct 27 18:52:46.377920 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 916/1857] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:45 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:46.753729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c970f688-3906-45e4-b049-6a8e1cea2ea8 tempest-QuotaClassesAdminTestJSON-64554918 tempest-QuotaClassesAdminTestJSON-64554918-project-admin] Calling method '.version_select at 0x7fc86acb4310>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:46.788234 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c970f688-3906-45e4-b049-6a8e1cea2ea8 tempest-QuotaClassesAdminTestJSON-64554918 tempest-QuotaClassesAdminTestJSON-64554918-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.394871 Oct 27 18:52:46.789042 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 917/1858] 10.222.0.42 () {58 vars in 1185 bytes} [Thu Oct 27 18:52:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:46.794784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-77293d0b-0abb-4099-9f79-92d5b033d269 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:46.795413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-77293d0b-0abb-4099-9f79-92d5b033d269 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:46.809444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77293d0b-0abb-4099-9f79-92d5b033d269 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:46.810042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77293d0b-0abb-4099-9f79-92d5b033d269 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:46.810598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77293d0b-0abb-4099-9f79-92d5b033d269 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:46.811398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77293d0b-0abb-4099-9f79-92d5b033d269 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:46.811920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77293d0b-0abb-4099-9f79-92d5b033d269 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:46.812422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77293d0b-0abb-4099-9f79-92d5b033d269 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:46.846067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-77293d0b-0abb-4099-9f79-92d5b033d269 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:52:46.966843 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-77293d0b-0abb-4099-9f79-92d5b033d269 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 204 len: 0 microversion: 2.47 time: 0.176127 Oct 27 18:52:46.971276 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 918/1859] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:52:46 2022] DELETE /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 18:52:46.986486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-74b7a92a-0d29-41a9-aee4-12750996146b req-143efca5-63d6-406f-a1cb-eb60a2db8147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38cba4e9-98d0-4048-ba3c-362d01b321e6", "tag": "093e7ae1-f1cf-4870-b6e1-49be73664937"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:46.997354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-74b7a92a-0d29-41a9-aee4-12750996146b req-143efca5-63d6-406f-a1cb-eb60a2db8147 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:46.997845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-74b7a92a-0d29-41a9-aee4-12750996146b req-143efca5-63d6-406f-a1cb-eb60a2db8147 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:46.998274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-74b7a92a-0d29-41a9-aee4-12750996146b req-143efca5-63d6-406f-a1cb-eb60a2db8147 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:47.015505 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-74b7a92a-0d29-41a9-aee4-12750996146b req-143efca5-63d6-406f-a1cb-eb60a2db8147 service nova] Creating event network-changed:093e7ae1-f1cf-4870-b6e1-49be73664937 for instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 on n-h1-860687-3 Oct 27 18:52:47.038117 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-74b7a92a-0d29-41a9-aee4-12750996146b req-143efca5-63d6-406f-a1cb-eb60a2db8147 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061481 Oct 27 18:52:47.039151 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 919/1860] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:47.058178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-db73f83a-7fe1-4eb5-8635-9795fa94d980 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:47.059028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-db73f83a-7fe1-4eb5-8635-9795fa94d980 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:47.076960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db73f83a-7fe1-4eb5-8635-9795fa94d980 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:47.077471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db73f83a-7fe1-4eb5-8635-9795fa94d980 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:47.077911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db73f83a-7fe1-4eb5-8635-9795fa94d980 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:47.086540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db73f83a-7fe1-4eb5-8635-9795fa94d980 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:47.087024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db73f83a-7fe1-4eb5-8635-9795fa94d980 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:47.087479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db73f83a-7fe1-4eb5-8635-9795fa94d980 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:47.428552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-db73f83a-7fe1-4eb5-8635-9795fa94d980 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:47.439890 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-db73f83a-7fe1-4eb5-8635-9795fa94d980 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1333 microversion: 2.1 time: 0.399472 Oct 27 18:52:47.440682 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 920/1861] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:47 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1333 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:47.454069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f7fca6e9-8b0a-46f3-8f49-db12f41f4383 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:47.454622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f7fca6e9-8b0a-46f3-8f49-db12f41f4383 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: fcfb303a-9cf9-45a7-83cc-87ad12e35bb5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:47.461886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7fca6e9-8b0a-46f3-8f49-db12f41f4383 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:47.462426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7fca6e9-8b0a-46f3-8f49-db12f41f4383 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:47.462949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7fca6e9-8b0a-46f3-8f49-db12f41f4383 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:47.463677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7fca6e9-8b0a-46f3-8f49-db12f41f4383 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:47.464145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7fca6e9-8b0a-46f3-8f49-db12f41f4383 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:47.464884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7fca6e9-8b0a-46f3-8f49-db12f41f4383 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:47.501882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f7fca6e9-8b0a-46f3-8f49-db12f41f4383 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: fcfb303a-9cf9-45a7-83cc-87ad12e35bb5] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:52:47.604975 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f7fca6e9-8b0a-46f3-8f49-db12f41f4383 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fcfb303a-9cf9-45a7-83cc-87ad12e35bb5" status: 204 len: 0 microversion: 2.1 time: 0.158309 Oct 27 18:52:47.605590 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 921/1862] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:52:47 2022] DELETE /compute/v2.1/servers/fcfb303a-9cf9-45a7-83cc-87ad12e35bb5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:52:47.611469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e16b1a65-aafb-42f1-b3d6-472f668271c6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:47.612197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e16b1a65-aafb-42f1-b3d6-472f668271c6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:47.619973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e16b1a65-aafb-42f1-b3d6-472f668271c6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:47.620979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e16b1a65-aafb-42f1-b3d6-472f668271c6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:47.621435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e16b1a65-aafb-42f1-b3d6-472f668271c6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:47.622516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e16b1a65-aafb-42f1-b3d6-472f668271c6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:47.622987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e16b1a65-aafb-42f1-b3d6-472f668271c6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:47.623422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e16b1a65-aafb-42f1-b3d6-472f668271c6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:47.792583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e16b1a65-aafb-42f1-b3d6-472f668271c6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:47.802710 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e16b1a65-aafb-42f1-b3d6-472f668271c6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1509 microversion: 2.1 time: 0.195602 Oct 27 18:52:47.804036 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 922/1863] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:47 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:47.810524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a1bfff0c-b94a-488b-8e65-4e7ba0bf2e0a tempest-QuotaClassesAdminTestJSON-64554918 tempest-QuotaClassesAdminTestJSON-64554918-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b01a670>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:47.906004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=91,nova_api:UPDATE=5 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:48.324547 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a1bfff0c-b94a-488b-8e65-4e7ba0bf2e0a tempest-QuotaClassesAdminTestJSON-64554918 tempest-QuotaClassesAdminTestJSON-64554918-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.518487 Oct 27 18:52:48.325264 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 923/1864] 10.222.0.42 () {60 vars in 1206 bytes} [Thu Oct 27 18:52:47 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:48.340821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d6c7a9f-4363-4281-b5c3-50d5ee4cb64a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:48.343879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9d6c7a9f-4363-4281-b5c3-50d5ee4cb64a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:48.356058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d6c7a9f-4363-4281-b5c3-50d5ee4cb64a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:48.356970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d6c7a9f-4363-4281-b5c3-50d5ee4cb64a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:48.359177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d6c7a9f-4363-4281-b5c3-50d5ee4cb64a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:48.360043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d6c7a9f-4363-4281-b5c3-50d5ee4cb64a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:48.360954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d6c7a9f-4363-4281-b5c3-50d5ee4cb64a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:48.361674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d6c7a9f-4363-4281-b5c3-50d5ee4cb64a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:48.447545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d6c7a9f-4363-4281-b5c3-50d5ee4cb64a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:48.457059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d6c7a9f-4363-4281-b5c3-50d5ee4cb64a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:48.459268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d6c7a9f-4363-4281-b5c3-50d5ee4cb64a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:48.461495 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9d6c7a9f-4363-4281-b5c3-50d5ee4cb64a tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 200 len: 1363 microversion: 2.47 time: 0.135335 Oct 27 18:52:48.462577 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 924/1865] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:48 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 1363 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:48.488355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-423b196e-85bb-4620-8009-70de390afe02 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:48.489052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-423b196e-85bb-4620-8009-70de390afe02 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:48.510361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-423b196e-85bb-4620-8009-70de390afe02 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:48.512232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-423b196e-85bb-4620-8009-70de390afe02 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:48.512232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-423b196e-85bb-4620-8009-70de390afe02 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:48.516417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-423b196e-85bb-4620-8009-70de390afe02 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:48.516904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-423b196e-85bb-4620-8009-70de390afe02 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:48.517347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-423b196e-85bb-4620-8009-70de390afe02 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:48.547995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:48.718445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-423b196e-85bb-4620-8009-70de390afe02 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:48.728014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-423b196e-85bb-4620-8009-70de390afe02 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:48.730191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-423b196e-85bb-4620-8009-70de390afe02 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:48.731742 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-423b196e-85bb-4620-8009-70de390afe02 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1486 microversion: 2.25 time: 0.268100 Oct 27 18:52:48.732627 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 925/1866] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:48 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1486 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:48.750186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-08b52732-40d9-4b56-b77f-551c78555b50 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:48.750834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-08b52732-40d9-4b56-b77f-551c78555b50 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:48.768941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08b52732-40d9-4b56-b77f-551c78555b50 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:48.771232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08b52732-40d9-4b56-b77f-551c78555b50 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:48.772258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08b52732-40d9-4b56-b77f-551c78555b50 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:48.773773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08b52732-40d9-4b56-b77f-551c78555b50 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:48.774972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08b52732-40d9-4b56-b77f-551c78555b50 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:48.775566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08b52732-40d9-4b56-b77f-551c78555b50 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:48.818520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-08b52732-40d9-4b56-b77f-551c78555b50 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: e288e56e-507d-4ebc-a8e8-56b19aaff597] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:52:48.944580 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-08b52732-40d9-4b56-b77f-551c78555b50 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597" status: 204 len: 0 microversion: 2.1 time: 0.200848 Oct 27 18:52:48.944580 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 926/1867] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:52:48 2022] DELETE /compute/v2.1/servers/e288e56e-507d-4ebc-a8e8-56b19aaff597 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:52:48.951866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b0d60337-599e-49d6-9dc0-063afdcfabd9 tempest-QuotaClassesAdminTestJSON-64554918 tempest-QuotaClassesAdminTestJSON-64554918-project-admin] Calling method '.version_select at 0x7fc86b014d30>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:48.972881 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b0d60337-599e-49d6-9dc0-063afdcfabd9 tempest-QuotaClassesAdminTestJSON-64554918 tempest-QuotaClassesAdminTestJSON-64554918-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.025841 Oct 27 18:52:48.984354 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 927/1868] 10.222.0.42 () {58 vars in 1185 bytes} [Thu Oct 27 18:52:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:48.991732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b96125f5-546c-4193-8ce5-b4d22c6e103e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:48.992779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b96125f5-546c-4193-8ce5-b4d22c6e103e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:49.000444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b96125f5-546c-4193-8ce5-b4d22c6e103e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:49.001483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b96125f5-546c-4193-8ce5-b4d22c6e103e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:49.002168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b96125f5-546c-4193-8ce5-b4d22c6e103e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:49.003126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b96125f5-546c-4193-8ce5-b4d22c6e103e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:49.003778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b96125f5-546c-4193-8ce5-b4d22c6e103e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:49.004849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b96125f5-546c-4193-8ce5-b4d22c6e103e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:49.016467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=25 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:49.242480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=91 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:49.254792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b96125f5-546c-4193-8ce5-b4d22c6e103e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:49.267209 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b96125f5-546c-4193-8ce5-b4d22c6e103e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1333 microversion: 2.1 time: 0.281156 Oct 27 18:52:49.269637 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 928/1869] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:48 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1333 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:49.274360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-935bdcd6-ac0f-465d-9b1f-ade93577b9eb tempest-QuotaClassesAdminTestJSON-64554918 tempest-QuotaClassesAdminTestJSON-64554918-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b014d30>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:49.478936 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-935bdcd6-ac0f-465d-9b1f-ade93577b9eb tempest-QuotaClassesAdminTestJSON-64554918 tempest-QuotaClassesAdminTestJSON-64554918-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.208114 Oct 27 18:52:49.479952 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 929/1870] 10.222.0.42 () {60 vars in 1206 bytes} [Thu Oct 27 18:52:49 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:49.518211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-a90615ff-a1bb-4050-8039-c1b897eb0f22 req-1bb08cdd-fc12-4522-8552-c420f60c6955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38cba4e9-98d0-4048-ba3c-362d01b321e6", "tag": "f92f1772-805d-4542-b5d8-d055d2b9dce5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:49.543238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a90615ff-a1bb-4050-8039-c1b897eb0f22 req-1bb08cdd-fc12-4522-8552-c420f60c6955 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:49.550430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a90615ff-a1bb-4050-8039-c1b897eb0f22 req-1bb08cdd-fc12-4522-8552-c420f60c6955 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:49.551082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a90615ff-a1bb-4050-8039-c1b897eb0f22 req-1bb08cdd-fc12-4522-8552-c420f60c6955 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:49.575716 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a90615ff-a1bb-4050-8039-c1b897eb0f22 req-1bb08cdd-fc12-4522-8552-c420f60c6955 service nova] Creating event network-changed:f92f1772-805d-4542-b5d8-d055d2b9dce5 for instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 on n-h1-860687-3 Oct 27 18:52:49.582832 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-a90615ff-a1bb-4050-8039-c1b897eb0f22 req-1bb08cdd-fc12-4522-8552-c420f60c6955 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101483 Oct 27 18:52:49.590942 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 930/1871] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:49.599106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-192318760", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "c6f304b1-07d8-4fe2-b95b-79675ce53612"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:53.288961 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b9539e8a-ad6d-48dc-b40b-1ee6a13b6440 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2" status: 200 len: 1461 microversion: 2.1 time: 14.027136 Oct 27 18:52:53.289672 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 942/1872] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:52:39 2022] GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2 => generated 1461 bytes in 14030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:53.296248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] validate_networks() for [('c6f304b1-07d8-4fe2-b95b-79675ce53612', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:52:53.299671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c8ba620e-f6cf-4b56-a34b-5d1d55470331 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:53.304973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c8ba620e-f6cf-4b56-a34b-5d1d55470331 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: f1ab3a98-7be5-418e-80fd-9dc73055adde] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:53.314947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8ba620e-f6cf-4b56-a34b-5d1d55470331 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:53.315449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8ba620e-f6cf-4b56-a34b-5d1d55470331 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:53.315902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8ba620e-f6cf-4b56-a34b-5d1d55470331 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:53.316935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8ba620e-f6cf-4b56-a34b-5d1d55470331 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:53.317241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:53.317798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8ba620e-f6cf-4b56-a34b-5d1d55470331 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:53.318248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8ba620e-f6cf-4b56-a34b-5d1d55470331 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:53.339063 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-c8ba620e-f6cf-4b56-a34b-5d1d55470331 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] HTTP exception thrown: Instance f1ab3a98-7be5-418e-80fd-9dc73055adde could not be found. Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c8ba620e-f6cf-4b56-a34b-5d1d55470331 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Request method failure captured: Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde HTTP/1.1 Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtNFCI0EvCl0GHMugFRc2FpAVD5zpLKZpvrleONrQvIKvpyy20yCnRBL2gehJtvdVjvYXfaxnkjbom_v2dufwX91zJ7KuEngu2i3_h9U7pZ29uKwtxG4zPj57C3715SwOQBscbhrIaZeRGnE01EIS-E0TfFk4qAJB2ZL1xfax5T8IO8 Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.47 Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 838e2192e7a74b46829aa6fa134570de Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerShowV247Test-689494243 Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/838e2192e7a74b46829aa6fa134570de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/838e2192e7a74b46829aa6fa134570de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_838e2192e7a74b46829aa6fa134570de", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/838e2192e7a74b46829aa6fa134570de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerShowV247Test-689494243 Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 838e2192e7a74b46829aa6fa134570de Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerShowV247Test-689494243 Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerShowV247Test-689494243-project Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 4d69cfaa641e47679ffc57539b6aef0c Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerShowV247Test-689494243-project Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance f1ab3a98-7be5-418e-80fd-9dc73055adde could not be found. Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'f1ab3a98-7be5-418e-80fd-9dc73055adde'} Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ab3a98-7be5-418e-80fd-9dc73055adde could not be found. Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ab3a98-7be5-418e-80fd-9dc73055adde could not be found. Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:53.340811 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:53.347142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:53.347142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:53.347142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:53.347142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:52:53.347142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:52:53.347142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ab3a98-7be5-418e-80fd-9dc73055adde could not be found. Oct 27 18:52:53.347142 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:53.347142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c8ba620e-f6cf-4b56-a34b-5d1d55470331 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Returning 404 to user: Instance f1ab3a98-7be5-418e-80fd-9dc73055adde could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:52:53.347142 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c8ba620e-f6cf-4b56-a34b-5d1d55470331 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde" status: 404 len: 111 microversion: 2.47 time: 0.050091 Oct 27 18:52:53.347142 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 943/1873] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:53 2022] GET /compute/v2.1/servers/f1ab3a98-7be5-418e-80fd-9dc73055adde => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:52:53.356427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-416766ba-adc1-496a-b7b8-b0c6b9f475ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:53.357477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-416766ba-adc1-496a-b7b8-b0c6b9f475ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:53.368148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-416766ba-adc1-496a-b7b8-b0c6b9f475ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:53.368973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-416766ba-adc1-496a-b7b8-b0c6b9f475ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:53.369639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-416766ba-adc1-496a-b7b8-b0c6b9f475ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:53.370637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-416766ba-adc1-496a-b7b8-b0c6b9f475ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:53.371526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-416766ba-adc1-496a-b7b8-b0c6b9f475ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:53.372141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-416766ba-adc1-496a-b7b8-b0c6b9f475ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:53.559314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-416766ba-adc1-496a-b7b8-b0c6b9f475ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:53.572392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-416766ba-adc1-496a-b7b8-b0c6b9f475ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:53.574478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-416766ba-adc1-496a-b7b8-b0c6b9f475ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:53.576256 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-416766ba-adc1-496a-b7b8-b0c6b9f475ed tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1476 microversion: 2.25 time: 0.227539 Oct 27 18:52:53.587517 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 944/1874] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:53 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1476 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:53.604210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c7a727d9-50d4-424b-9fd6-cbb01f10e96a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:53.604210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c7a727d9-50d4-424b-9fd6-cbb01f10e96a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:53.613608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7a727d9-50d4-424b-9fd6-cbb01f10e96a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:53.614163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7a727d9-50d4-424b-9fd6-cbb01f10e96a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:53.614916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7a727d9-50d4-424b-9fd6-cbb01f10e96a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:53.615631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7a727d9-50d4-424b-9fd6-cbb01f10e96a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:53.616293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7a727d9-50d4-424b-9fd6-cbb01f10e96a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:53.617595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7a727d9-50d4-424b-9fd6-cbb01f10e96a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:53.810151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c7a727d9-50d4-424b-9fd6-cbb01f10e96a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:53.822066 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c7a727d9-50d4-424b-9fd6-cbb01f10e96a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1333 microversion: 2.1 time: 0.233077 Oct 27 18:52:53.823268 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 945/1875] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:53 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1333 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:53.843370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8cbd7a06-d89a-4a03-abf8-7834b55f7923 tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c7c51f97-59e7-4361-bf8e-90b4d198c965"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:53.848260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8cbd7a06-d89a-4a03-abf8-7834b55f7923 tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:53.865917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cbd7a06-d89a-4a03-abf8-7834b55f7923 tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:53.867128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cbd7a06-d89a-4a03-abf8-7834b55f7923 tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:53.868748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cbd7a06-d89a-4a03-abf8-7834b55f7923 tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:53.872924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cbd7a06-d89a-4a03-abf8-7834b55f7923 tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:53.873716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cbd7a06-d89a-4a03-abf8-7834b55f7923 tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:53.874959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cbd7a06-d89a-4a03-abf8-7834b55f7923 tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:53.941232 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-8cbd7a06-d89a-4a03-abf8-7834b55f7923 tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] HTTP exception thrown: Volume 896789fb-6c52-4dd0-9153-2e6d9642cd9b could not be found. Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8cbd7a06-d89a-4a03-abf8-7834b55f7923 tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Request method failure captured: Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9/os-volume_attachments/896789fb-6c52-4dd0-9153-2e6d9642cd9b HTTP/1.1 Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 74 Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtLNS8yB5Q0hczvkqbY6XYxp3CQxbfEpwutiknjyIZOmqN_92eouxP6Yyh0JAAlZCEnX8KcsdGXGGQ3SmFPyu4fwJ_9v5MakKFE_POE8W58XEwt_JZcYY-fGwP9SQA_-NZTT88beYA4MtyYf1LHnUd3MOfcyiYis-MOAZBi8twm3km8 Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 21a168d06680435ea91c0b4ef0326031 Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-VolumesAdminNegativeTest-1659364617 Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/21a168d06680435ea91c0b4ef0326031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/21a168d06680435ea91c0b4ef0326031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_21a168d06680435ea91c0b4ef0326031", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/21a168d06680435ea91c0b4ef0326031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-VolumesAdminNegativeTest-1659364617 Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 21a168d06680435ea91c0b4ef0326031 Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1659364617 Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-VolumesAdminNegativeTest-1659364617-project-admin Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 572c69bd9c96480995afd58c91f34590 Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-VolumesAdminNegativeTest-1659364617-project-admin Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: {"volumeAttachment": {"volumeId": "c7c51f97-59e7-4361-bf8e-90b4d198c965"}} Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: exception: Volume 896789fb-6c52-4dd0-9153-2e6d9642cd9b could not be found. Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'server_id': '07939c40-3c51-4886-813a-04aaeeef35b9', 'id': '896789fb-6c52-4dd0-9153-2e6d9642cd9b', 'body': {'volumeAttachment': {'volumeId': 'c7c51f97-59e7-4361-bf8e-90b4d198c965'}}} Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 896789fb-6c52-4dd0-9153-2e6d9642cd9b could not be found. (HTTP 404) (Request-ID: req-9f52d301-3852-47c6-9b57-3b979c987f10) Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 18:52:53.943545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 896789fb-6c52-4dd0-9153-2e6d9642cd9b could not be found. Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 896789fb-6c52-4dd0-9153-2e6d9642cd9b could not be found. Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 896789fb-6c52-4dd0-9153-2e6d9642cd9b could not be found. Oct 27 18:52:53.951031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:53.960691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8cbd7a06-d89a-4a03-abf8-7834b55f7923 tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] Returning 404 to user: Volume 896789fb-6c52-4dd0-9153-2e6d9642cd9b could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:52:53.960691 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8cbd7a06-d89a-4a03-abf8-7834b55f7923 tempest-VolumesAdminNegativeTest-1659364617 tempest-VolumesAdminNegativeTest-1659364617-project-admin] 10.222.0.42 "PUT /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9/os-volume_attachments/896789fb-6c52-4dd0-9153-2e6d9642cd9b" status: 404 len: 109 microversion: 2.1 time: 0.133079 Oct 27 18:52:53.962555 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 946/1876] 10.222.0.42 () {60 vars in 1433 bytes} [Thu Oct 27 18:52:53 2022] PUT /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9/os-volume_attachments/896789fb-6c52-4dd0-9153-2e6d9642cd9b => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:52:53.977176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-1bb99f40-3e81-4c02-9f46-349bca8c0298 req-22256e4d-869b-454a-9b36-ae4ed4bc1180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfb303a-9cf9-45a7-83cc-87ad12e35bb5", "name": "network-vif-deleted", "tag": "a8c60220-c624-4a9a-9ec9-dbd2ce3ba561"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:54.004339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1bb99f40-3e81-4c02-9f46-349bca8c0298 req-22256e4d-869b-454a-9b36-ae4ed4bc1180 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:54.004976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1bb99f40-3e81-4c02-9f46-349bca8c0298 req-22256e4d-869b-454a-9b36-ae4ed4bc1180 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:54.005435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1bb99f40-3e81-4c02-9f46-349bca8c0298 req-22256e4d-869b-454a-9b36-ae4ed4bc1180 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:54.031969 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-1bb99f40-3e81-4c02-9f46-349bca8c0298 req-22256e4d-869b-454a-9b36-ae4ed4bc1180 service nova] Creating event network-vif-deleted:a8c60220-c624-4a9a-9ec9-dbd2ce3ba561 for instance fcfb303a-9cf9-45a7-83cc-87ad12e35bb5 on n-h1-860687-3 Oct 27 18:52:54.048116 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-1bb99f40-3e81-4c02-9f46-349bca8c0298 req-22256e4d-869b-454a-9b36-ae4ed4bc1180 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083699 Oct 27 18:52:54.049028 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 947/1877] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:54.059361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d5ac0554-6f43-43d4-bbb6-e494fba58093 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b1c2f70>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:54.149029 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d5ac0554-6f43-43d4-bbb6-e494fba58093 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2" status: 200 len: 1461 microversion: 2.1 time: 0.097201 Oct 27 18:52:54.150200 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 948/1878] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:52:54 2022] GET /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2 => generated 1461 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:54.156779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-78d122c6-f33f-4c27-86db-68f91a241792 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:54.157703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-78d122c6-f33f-4c27-86db-68f91a241792 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: 3772b92e-60a4-464c-8fb4-49060f978351] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:54.168666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78d122c6-f33f-4c27-86db-68f91a241792 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:54.170180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78d122c6-f33f-4c27-86db-68f91a241792 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:54.170902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78d122c6-f33f-4c27-86db-68f91a241792 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:54.172837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78d122c6-f33f-4c27-86db-68f91a241792 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:54.172837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78d122c6-f33f-4c27-86db-68f91a241792 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:54.173480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78d122c6-f33f-4c27-86db-68f91a241792 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:54.238761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-78d122c6-f33f-4c27-86db-68f91a241792 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: 3772b92e-60a4-464c-8fb4-49060f978351] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:52:54.386443 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-78d122c6-f33f-4c27-86db-68f91a241792 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351" status: 204 len: 0 microversion: 2.47 time: 0.233486 Oct 27 18:52:54.395376 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 949/1879] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:52:54 2022] DELETE /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 18:52:54.417446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b1c651b7-64f2-4944-a405-02dbc4c220c2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '.version_select at 0x7fc86b896ee0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:54.430621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1c651b7-64f2-4944-a405-02dbc4c220c2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:54.432909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1c651b7-64f2-4944-a405-02dbc4c220c2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:54.433891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1c651b7-64f2-4944-a405-02dbc4c220c2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:54.462670 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b1c651b7-64f2-4944-a405-02dbc4c220c2 tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.064068 Oct 27 18:52:54.473372 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 950/1880] 10.222.0.42 () {60 vars in 1184 bytes} [Thu Oct 27 18:52:54 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:54.478060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9559807c-51e4-4528-8898-0fcc91330670 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:54.482426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9559807c-51e4-4528-8898-0fcc91330670 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: 1f02e8ec-759d-48bf-9d99-31fa890241c1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:54.499825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9559807c-51e4-4528-8898-0fcc91330670 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:54.500621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9559807c-51e4-4528-8898-0fcc91330670 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:54.503284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9559807c-51e4-4528-8898-0fcc91330670 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:54.504045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9559807c-51e4-4528-8898-0fcc91330670 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:54.504528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9559807c-51e4-4528-8898-0fcc91330670 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:54.505023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9559807c-51e4-4528-8898-0fcc91330670 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:54.658945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:52:54.659488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:52:54.659760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:52:54.660175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:52:54.661111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:52:54.687914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:54.688420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:54.688868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:54.689612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:54.690078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:54.690547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:54.761936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Getting quotas for project a01070f71f894787a5a26e00dc2cd3ef. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:52:54.777761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Getting quotas for user 7af58c47c7ff47a1abb83c046335a44e and project a01070f71f894787a5a26e00dc2cd3ef. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:52:54.787447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=22,nova_api:INSERT=9 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:54.801082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9559807c-51e4-4528-8898-0fcc91330670 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:54.813149 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9559807c-51e4-4528-8898-0fcc91330670 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1" status: 200 len: 1468 microversion: 2.1 time: 0.346128 Oct 27 18:52:54.815188 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 951/1881] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:54 2022] GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1 => generated 1468 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:54.817452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Going to run 2 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:52:54.822345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d0f81d4-5a15-4be7-9bf6-6ce8c1666551 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:54.823110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0d0f81d4-5a15-4be7-9bf6-6ce8c1666551 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: 3772b92e-60a4-464c-8fb4-49060f978351] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:54.824915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:52:54.836023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d0f81d4-5a15-4be7-9bf6-6ce8c1666551 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:54.836668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d0f81d4-5a15-4be7-9bf6-6ce8c1666551 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:54.839350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d0f81d4-5a15-4be7-9bf6-6ce8c1666551 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:54.846102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d0f81d4-5a15-4be7-9bf6-6ce8c1666551 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:54.846758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d0f81d4-5a15-4be7-9bf6-6ce8c1666551 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:54.847445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d0f81d4-5a15-4be7-9bf6-6ce8c1666551 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:54.912182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 50aa2e14-0b49-4eb7-af7b-79582409b298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=0556339c-0d41-460d-945e-c3b5a95bccfe,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:52:55.031864 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8295bfab-2629-4c21-ba88-8d099f482748 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 5.439538 Oct 27 18:52:55.035516 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 931/1882] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:52:49 2022] POST /compute/v2.1/servers => generated 32 bytes in 5444 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 27 18:52:55.046139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-877d1a06-16d4-4864-b060-68b171386f2e tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:55.047138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-877d1a06-16d4-4864-b060-68b171386f2e tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:55.057112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-877d1a06-16d4-4864-b060-68b171386f2e tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:55.058171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-877d1a06-16d4-4864-b060-68b171386f2e tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:55.058867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-877d1a06-16d4-4864-b060-68b171386f2e tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:55.060084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-877d1a06-16d4-4864-b060-68b171386f2e tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:55.060808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-877d1a06-16d4-4864-b060-68b171386f2e tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:55.061451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-877d1a06-16d4-4864-b060-68b171386f2e tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:55.690696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0d0f81d4-5a15-4be7-9bf6-6ce8c1666551 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:55.700739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0d0f81d4-5a15-4be7-9bf6-6ce8c1666551 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:55.702200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0d0f81d4-5a15-4be7-9bf6-6ce8c1666551 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:55.703416 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0d0f81d4-5a15-4be7-9bf6-6ce8c1666551 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351" status: 200 len: 1362 microversion: 2.47 time: 0.885759 Oct 27 18:52:55.710839 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 952/1883] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:54 2022] GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351 => generated 1362 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:55.717510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e6e69147-733c-4813-b8ad-289e73309b1a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1662090873"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:55.738082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e6e69147-733c-4813-b8ad-289e73309b1a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:55.758454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6e69147-733c-4813-b8ad-289e73309b1a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:55.760506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6e69147-733c-4813-b8ad-289e73309b1a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:55.761866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6e69147-733c-4813-b8ad-289e73309b1a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:55.765695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6e69147-733c-4813-b8ad-289e73309b1a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:55.767094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6e69147-733c-4813-b8ad-289e73309b1a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:55.769319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6e69147-733c-4813-b8ad-289e73309b1a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:56.195033 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e6e69147-733c-4813-b8ad-289e73309b1a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "POST /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f/action" status: 202 len: 0 microversion: 2.1 time: 0.480744 Oct 27 18:52:56.202354 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 953/1884] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:52:55 2022] POST /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 18:52:56.213219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2e50380f-4a40-4618-b5b6-0dd0cbd118de tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:56.214231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2e50380f-4a40-4618-b5b6-0dd0cbd118de tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:56.229954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e50380f-4a40-4618-b5b6-0dd0cbd118de tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:56.231042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e50380f-4a40-4618-b5b6-0dd0cbd118de tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:56.231717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e50380f-4a40-4618-b5b6-0dd0cbd118de tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:56.232661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e50380f-4a40-4618-b5b6-0dd0cbd118de tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:56.233315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e50380f-4a40-4618-b5b6-0dd0cbd118de tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:56.233968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e50380f-4a40-4618-b5b6-0dd0cbd118de tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:56.517564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-877d1a06-16d4-4864-b060-68b171386f2e tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] Lazy-loading 'services' on Instance uuid 60d948f3-a6a5-46cb-b716-79eaf55ff690 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:52:56.545995 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-877d1a06-16d4-4864-b060-68b171386f2e tempest-LiveAutoBlockMigrationV225Test-1822497957 tempest-LiveAutoBlockMigrationV225Test-1822497957-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1968 microversion: 2.25 time: 1.509335 Oct 27 18:52:56.553607 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 932/1885] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:55 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1968 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:56.560383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3bd79e3d-7788-4005-82c6-67ee25a9a4de tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:56.579527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3bd79e3d-7788-4005-82c6-67ee25a9a4de tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:56.580828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3bd79e3d-7788-4005-82c6-67ee25a9a4de tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Searching by: {'deleted': False, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:52:56.594231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd79e3d-7788-4005-82c6-67ee25a9a4de tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:56.595365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd79e3d-7788-4005-82c6-67ee25a9a4de tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:56.596100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd79e3d-7788-4005-82c6-67ee25a9a4de tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:56.597648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd79e3d-7788-4005-82c6-67ee25a9a4de tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:56.598710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd79e3d-7788-4005-82c6-67ee25a9a4de tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:56.599713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd79e3d-7788-4005-82c6-67ee25a9a4de tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:56.632576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-3bd79e3d-7788-4005-82c6-67ee25a9a4de tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:52:56.649700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2e50380f-4a40-4618-b5b6-0dd0cbd118de tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:56.661922 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2e50380f-4a40-4618-b5b6-0dd0cbd118de tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1333 microversion: 2.1 time: 0.457819 Oct 27 18:52:56.670018 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3bd79e3d-7788-4005-82c6-67ee25a9a4de tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 671 microversion: 2.1 time: 0.114172 Oct 27 18:52:56.670953 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 933/1886] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 18:52:56 2022] GET /compute/v2.1/servers => generated 671 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:56.675956 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 954/1887] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:56 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1333 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:56.682434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-f39dfb7f-15c4-4f22-a0f4-24922ed37836 req-d83e90a4-d83b-4ba1-9b6e-1a4a612f98c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f02e8ec-759d-48bf-9d99-31fa890241c1", "name": "network-vif-unplugged", "status": "completed", "tag": "e08a66dd-bce1-4f3f-ae67-ea863bda862f"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:56.721094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f39dfb7f-15c4-4f22-a0f4-24922ed37836 req-d83e90a4-d83b-4ba1-9b6e-1a4a612f98c9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:56.721769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f39dfb7f-15c4-4f22-a0f4-24922ed37836 req-d83e90a4-d83b-4ba1-9b6e-1a4a612f98c9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:56.722034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f39dfb7f-15c4-4f22-a0f4-24922ed37836 req-d83e90a4-d83b-4ba1-9b6e-1a4a612f98c9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:56.745793 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-f39dfb7f-15c4-4f22-a0f4-24922ed37836 req-d83e90a4-d83b-4ba1-9b6e-1a4a612f98c9 service nova] Creating event network-vif-unplugged:e08a66dd-bce1-4f3f-ae67-ea863bda862f for instance 1f02e8ec-759d-48bf-9d99-31fa890241c1 on n-h2-860687-3 Oct 27 18:52:56.755182 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-f39dfb7f-15c4-4f22-a0f4-24922ed37836 req-d83e90a4-d83b-4ba1-9b6e-1a4a612f98c9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077327 Oct 27 18:52:56.756295 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 955/1888] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:56.765627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fe7b799f-0275-4f1e-9dfe-1bbf577e259c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b12b0d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:56.848980 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fe7b799f-0275-4f1e-9dfe-1bbf577e259c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.090559 Oct 27 18:52:56.857980 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 956/1889] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:52:56 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:56.863495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-9de41d37-1d49-4642-8994-978f29b45656 req-8defd05e-ba1e-4f25-9df0-adfd07177a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e288e56e-507d-4ebc-a8e8-56b19aaff597", "name": "network-vif-deleted", "tag": "6a2790be-4874-41ac-9a89-bccc175b9913"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:56.884061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9de41d37-1d49-4642-8994-978f29b45656 req-8defd05e-ba1e-4f25-9df0-adfd07177a88 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:56.884837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9de41d37-1d49-4642-8994-978f29b45656 req-8defd05e-ba1e-4f25-9df0-adfd07177a88 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:56.885450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9de41d37-1d49-4642-8994-978f29b45656 req-8defd05e-ba1e-4f25-9df0-adfd07177a88 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:56.899859 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-9de41d37-1d49-4642-8994-978f29b45656 req-8defd05e-ba1e-4f25-9df0-adfd07177a88 service nova] Creating event network-vif-deleted:6a2790be-4874-41ac-9a89-bccc175b9913 for instance e288e56e-507d-4ebc-a8e8-56b19aaff597 on n-h2-860687-3 Oct 27 18:52:56.905644 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-9de41d37-1d49-4642-8994-978f29b45656 req-8defd05e-ba1e-4f25-9df0-adfd07177a88 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054401 Oct 27 18:52:56.907090 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 957/1890] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:56.916377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-04863e5c-e9bb-4fae-8515-06fb0923c282 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:56.917211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-04863e5c-e9bb-4fae-8515-06fb0923c282 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:56.925259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04863e5c-e9bb-4fae-8515-06fb0923c282 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:56.926884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04863e5c-e9bb-4fae-8515-06fb0923c282 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:56.927575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04863e5c-e9bb-4fae-8515-06fb0923c282 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:56.928719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04863e5c-e9bb-4fae-8515-06fb0923c282 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:56.929990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04863e5c-e9bb-4fae-8515-06fb0923c282 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:56.930701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04863e5c-e9bb-4fae-8515-06fb0923c282 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:56.971470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-04863e5c-e9bb-4fae-8515-06fb0923c282 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:52:57.011919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1e77f0be-40c0-43bc-89de-db8f4c32a518 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Calling method '.version_select at 0x7fc86b014d30>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:57.122942 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-04863e5c-e9bb-4fae-8515-06fb0923c282 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "DELETE /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 204 len: 0 microversion: 2.25 time: 0.212716 Oct 27 18:52:57.125056 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 958/1891] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:52:56 2022] DELETE /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 18:52:57.137522 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1e77f0be-40c0-43bc-89de-db8f4c32a518 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1" status: 200 len: 371 microversion: 2.1 time: 0.463913 Oct 27 18:52:57.140075 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 934/1892] 10.222.0.42 () {58 vars in 1242 bytes} [Thu Oct 27 18:52:56 2022] GET /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1 => generated 371 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:57.140565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bfdabdb3-9ca3-4ae7-b8af-ebcdbcf16914 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:57.142309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bfdabdb3-9ca3-4ae7-b8af-ebcdbcf16914 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:57.154803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-97a2445e-f0cd-4b66-bf62-5d4a53848418 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:57.155701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-97a2445e-f0cd-4b66-bf62-5d4a53848418 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: 3772b92e-60a4-464c-8fb4-49060f978351] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:57.157769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfdabdb3-9ca3-4ae7-b8af-ebcdbcf16914 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:57.158981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfdabdb3-9ca3-4ae7-b8af-ebcdbcf16914 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:57.161004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfdabdb3-9ca3-4ae7-b8af-ebcdbcf16914 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:57.162026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfdabdb3-9ca3-4ae7-b8af-ebcdbcf16914 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:57.165328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfdabdb3-9ca3-4ae7-b8af-ebcdbcf16914 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:57.165965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfdabdb3-9ca3-4ae7-b8af-ebcdbcf16914 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:57.171146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97a2445e-f0cd-4b66-bf62-5d4a53848418 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:57.171657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97a2445e-f0cd-4b66-bf62-5d4a53848418 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:57.175041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97a2445e-f0cd-4b66-bf62-5d4a53848418 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:57.176792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97a2445e-f0cd-4b66-bf62-5d4a53848418 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:57.178375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97a2445e-f0cd-4b66-bf62-5d4a53848418 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:57.182986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97a2445e-f0cd-4b66-bf62-5d4a53848418 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:57.277369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bfdabdb3-9ca3-4ae7-b8af-ebcdbcf16914 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:57.281917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-97a2445e-f0cd-4b66-bf62-5d4a53848418 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:57.287748 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bfdabdb3-9ca3-4ae7-b8af-ebcdbcf16914 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe" status: 200 len: 1213 microversion: 2.1 time: 0.159382 Oct 27 18:52:57.298199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-97a2445e-f0cd-4b66-bf62-5d4a53848418 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:57.298912 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 959/1893] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:57 2022] GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:57.307242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-97a2445e-f0cd-4b66-bf62-5d4a53848418 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:57.309521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d773e4f5-89a9-480a-b973-487ce993ccd5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:57.311232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d773e4f5-89a9-480a-b973-487ce993ccd5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:57.312559 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-97a2445e-f0cd-4b66-bf62-5d4a53848418 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351" status: 200 len: 1362 microversion: 2.47 time: 0.168931 Oct 27 18:52:57.314022 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 935/1894] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:57 2022] GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:57.344338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f112fdd3-471c-4fe1-a909-35b10bf2f1ba tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Action: 'update', calling method: .version_select at 0x7fc86ac5d0d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:57.352415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d773e4f5-89a9-480a-b973-487ce993ccd5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:57.354711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d773e4f5-89a9-480a-b973-487ce993ccd5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:57.356857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d773e4f5-89a9-480a-b973-487ce993ccd5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:57.358169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d773e4f5-89a9-480a-b973-487ce993ccd5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:57.359707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d773e4f5-89a9-480a-b973-487ce993ccd5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:57.360521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d773e4f5-89a9-480a-b973-487ce993ccd5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:57.392122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:52:57.436841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f112fdd3-471c-4fe1-a909-35b10bf2f1ba tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:57.437421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f112fdd3-471c-4fe1-a909-35b10bf2f1ba tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:57.437934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f112fdd3-471c-4fe1-a909-35b10bf2f1ba tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:57.438775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f112fdd3-471c-4fe1-a909-35b10bf2f1ba tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:57.439301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f112fdd3-471c-4fe1-a909-35b10bf2f1ba tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:57.439794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f112fdd3-471c-4fe1-a909-35b10bf2f1ba tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:57.506908 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f112fdd3-471c-4fe1-a909-35b10bf2f1ba tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1" status: 200 len: 328 microversion: 2.1 time: 0.177014 Oct 27 18:52:57.513532 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 936/1895] 10.222.0.42 () {60 vars in 1262 bytes} [Thu Oct 27 18:52:57 2022] PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1 => generated 328 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:57.565756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d773e4f5-89a9-480a-b973-487ce993ccd5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:57.576319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d773e4f5-89a9-480a-b973-487ce993ccd5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:57.578143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d773e4f5-89a9-480a-b973-487ce993ccd5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:57.580247 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d773e4f5-89a9-480a-b973-487ce993ccd5 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1482 microversion: 2.25 time: 0.280059 Oct 27 18:52:57.596986 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 960/1896] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:57 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1482 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:57.693505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-53f00b2e-e15a-47bc-9a49-2a6df469b023 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:57.694134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-53f00b2e-e15a-47bc-9a49-2a6df469b023 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:57.709242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53f00b2e-e15a-47bc-9a49-2a6df469b023 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:57.709750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53f00b2e-e15a-47bc-9a49-2a6df469b023 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:57.714824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53f00b2e-e15a-47bc-9a49-2a6df469b023 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:57.715805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53f00b2e-e15a-47bc-9a49-2a6df469b023 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:57.716282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53f00b2e-e15a-47bc-9a49-2a6df469b023 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:57.716719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53f00b2e-e15a-47bc-9a49-2a6df469b023 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:57.783614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1671213555", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:57.869421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:52:58.013591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-53f00b2e-e15a-47bc-9a49-2a6df469b023 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:58.023785 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-53f00b2e-e15a-47bc-9a49-2a6df469b023 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1333 microversion: 2.1 time: 0.334559 Oct 27 18:52:58.025086 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 937/1897] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:57 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1333 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:58.038741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d46f9856-40c9-4ef6-96c5-0c4bba04bded tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873374c10>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:58.138606 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d46f9856-40c9-4ef6-96c5-0c4bba04bded tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.112214 Oct 27 18:52:58.147370 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 938/1898] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:52:58 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:58.190260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:52:58.190718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:52:58.191205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:52:58.191625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:52:58.192047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:52:58.201570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:58.202059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:58.202533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:58.203279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:58.203858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:58.204429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:58.222220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Getting quotas for project ff6119a5bbb041dfa73ee1a488ed1bc1. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:52:58.228274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Getting quotas for user b3463494b1344c41883f4efc7dea2eeb and project ff6119a5bbb041dfa73ee1a488ed1bc1. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:52:58.240504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.utils [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] cores quota exceeded for ff6119a5bbb041dfa73ee1a488ed1bc1, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127029) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 27 18:52:58.242090 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Request method failure captured: Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 145 Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOGlrVo17y007gY-HtMDTxeVn4QZeR7OCvt0aCvq0A98FZirxwdhJPUIugXefgyyEstKxnqkGeznkZGG0E6GkgaFz7Jb5KpHWOmsAH-Hw6XTbiyqjZTzKGfNjsT31P7VaJQ2CQerS-CHS4SieUFKZOQb4JeM0LL5Ta-1sgko8A411A Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ff6119a5bbb041dfa73ee1a488ed1bc1 Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-QuotasAdminNegativeTest-1523344438 Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ff6119a5bbb041dfa73ee1a488ed1bc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff6119a5bbb041dfa73ee1a488ed1bc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ff6119a5bbb041dfa73ee1a488ed1bc1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff6119a5bbb041dfa73ee1a488ed1bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-QuotasAdminNegativeTest-1523344438 Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ff6119a5bbb041dfa73ee1a488ed1bc1 Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1523344438 Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-QuotasAdminNegativeTest-1523344438-project Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b3463494b1344c41883f4efc7dea2eeb Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-QuotasAdminNegativeTest-1523344438-project Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1671213555", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1671213555', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452'}}} Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 18:52:58.254009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-311c696d-9710-412f-aaad-f4a4ce1b046b tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.557459 Oct 27 18:52:58.261011 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 961/1899] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:52:57 2022] POST /compute/v2.1/servers => generated 111 bytes in 562 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:52:58.266804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a97818f1-8bf4-46d1-8343-6ace152dbca9 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Action: 'update', calling method: .version_select at 0x7fc86ac5d4c0>, body: {"quota_set": {"cores": 20}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:58.314680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0f4ae474-5134-4e88-9c6b-26bd949b72e4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:58.315418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0f4ae474-5134-4e88-9c6b-26bd949b72e4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:58.326642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4ae474-5134-4e88-9c6b-26bd949b72e4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:58.328894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4ae474-5134-4e88-9c6b-26bd949b72e4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:58.330576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4ae474-5134-4e88-9c6b-26bd949b72e4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:58.331658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4ae474-5134-4e88-9c6b-26bd949b72e4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:58.333770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4ae474-5134-4e88-9c6b-26bd949b72e4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:58.336200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4ae474-5134-4e88-9c6b-26bd949b72e4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:58.397619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a97818f1-8bf4-46d1-8343-6ace152dbca9 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:58.398757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a97818f1-8bf4-46d1-8343-6ace152dbca9 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:58.399420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a97818f1-8bf4-46d1-8343-6ace152dbca9 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:58.400483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a97818f1-8bf4-46d1-8343-6ace152dbca9 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:58.401188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a97818f1-8bf4-46d1-8343-6ace152dbca9 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:58.401813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a97818f1-8bf4-46d1-8343-6ace152dbca9 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:58.444939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0f4ae474-5134-4e88-9c6b-26bd949b72e4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:58.458814 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0f4ae474-5134-4e88-9c6b-26bd949b72e4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe" status: 200 len: 1269 microversion: 2.1 time: 0.145980 Oct 27 18:52:58.461127 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 962/1900] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:58 2022] GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:52:58.472056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9a399ffb-e716-4383-bff8-8fc4450ab3cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:58.472966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9a399ffb-e716-4383-bff8-8fc4450ab3cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: 3772b92e-60a4-464c-8fb4-49060f978351] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:58.487259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a399ffb-e716-4383-bff8-8fc4450ab3cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:58.490530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a399ffb-e716-4383-bff8-8fc4450ab3cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:58.491244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a399ffb-e716-4383-bff8-8fc4450ab3cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:58.492764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a399ffb-e716-4383-bff8-8fc4450ab3cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:58.493534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a399ffb-e716-4383-bff8-8fc4450ab3cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:58.493930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a399ffb-e716-4383-bff8-8fc4450ab3cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:58.561096 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a97818f1-8bf4-46d1-8343-6ace152dbca9 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1" status: 200 len: 329 microversion: 2.1 time: 0.296624 Oct 27 18:52:58.567887 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 939/1901] 10.222.0.42 () {60 vars in 1262 bytes} [Thu Oct 27 18:52:58 2022] PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1 => generated 329 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:58.593697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e9a7316-c643-44c5-8cd0-784a3fcf2a21 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Calling method '.version_select at 0x7fc86a391a60>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:58.639910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9a399ffb-e716-4383-bff8-8fc4450ab3cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:58.660911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9a399ffb-e716-4383-bff8-8fc4450ab3cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:58.681902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9a399ffb-e716-4383-bff8-8fc4450ab3cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:58.688503 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9a399ffb-e716-4383-bff8-8fc4450ab3cf tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351" status: 200 len: 1362 microversion: 2.47 time: 0.220361 Oct 27 18:52:58.707899 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 963/1902] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:58 2022] GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:58.719051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3e8a4e64-4c68-4c43-9312-b8772fe48141 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:58.719737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3e8a4e64-4c68-4c43-9312-b8772fe48141 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:58.728434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e8a4e64-4c68-4c43-9312-b8772fe48141 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:58.729060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e8a4e64-4c68-4c43-9312-b8772fe48141 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:58.729923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e8a4e64-4c68-4c43-9312-b8772fe48141 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:58.730876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e8a4e64-4c68-4c43-9312-b8772fe48141 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:58.731534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e8a4e64-4c68-4c43-9312-b8772fe48141 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:58.732182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e8a4e64-4c68-4c43-9312-b8772fe48141 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:58.812286 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e9a7316-c643-44c5-8cd0-784a3fcf2a21 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1" status: 200 len: 371 microversion: 2.1 time: 0.237404 Oct 27 18:52:58.833252 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 940/1903] 10.222.0.42 () {58 vars in 1242 bytes} [Thu Oct 27 18:52:58 2022] GET /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1 => generated 371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:58.843353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ea9427a9-5c7b-4c54-92b7-d9f23a0f6383 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:58.845804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ea9427a9-5c7b-4c54-92b7-d9f23a0f6383 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:58.877546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea9427a9-5c7b-4c54-92b7-d9f23a0f6383 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:58.880121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea9427a9-5c7b-4c54-92b7-d9f23a0f6383 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:58.883094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea9427a9-5c7b-4c54-92b7-d9f23a0f6383 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:58.886285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea9427a9-5c7b-4c54-92b7-d9f23a0f6383 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:58.888383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea9427a9-5c7b-4c54-92b7-d9f23a0f6383 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:58.888852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea9427a9-5c7b-4c54-92b7-d9f23a0f6383 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:58.957233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ea9427a9-5c7b-4c54-92b7-d9f23a0f6383 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:52:59.134488 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ea9427a9-5c7b-4c54-92b7-d9f23a0f6383 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "DELETE /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 204 len: 0 microversion: 2.1 time: 0.299685 Oct 27 18:52:59.135744 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 941/1904] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:52:58 2022] DELETE /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:52:59.141239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-693403c8-7bff-4d95-b482-59578c35ba97 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Action: 'update', calling method: .version_select at 0x7fc873374b80>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:52:59.202931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3e8a4e64-4c68-4c43-9312-b8772fe48141 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:59.236418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3e8a4e64-4c68-4c43-9312-b8772fe48141 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:59.237905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3e8a4e64-4c68-4c43-9312-b8772fe48141 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:52:59.239192 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3e8a4e64-4c68-4c43-9312-b8772fe48141 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1482 microversion: 2.25 time: 0.530139 Oct 27 18:52:59.239986 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 964/1905] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:52:58 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1482 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:52:59.257720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1ced4ea0-a52e-40fd-9859-126b1c8d6ba8 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:59.264510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1ced4ea0-a52e-40fd-9859-126b1c8d6ba8 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:59.293174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ced4ea0-a52e-40fd-9859-126b1c8d6ba8 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:59.293823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ced4ea0-a52e-40fd-9859-126b1c8d6ba8 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:59.299619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ced4ea0-a52e-40fd-9859-126b1c8d6ba8 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:59.301254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ced4ea0-a52e-40fd-9859-126b1c8d6ba8 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:59.303526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ced4ea0-a52e-40fd-9859-126b1c8d6ba8 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:59.305322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ced4ea0-a52e-40fd-9859-126b1c8d6ba8 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:59.326887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-693403c8-7bff-4d95-b482-59578c35ba97 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:59.336886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-693403c8-7bff-4d95-b482-59578c35ba97 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:59.337708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-693403c8-7bff-4d95-b482-59578c35ba97 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:59.339016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-693403c8-7bff-4d95-b482-59578c35ba97 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:59.344350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-693403c8-7bff-4d95-b482-59578c35ba97 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:59.345693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-693403c8-7bff-4d95-b482-59578c35ba97 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:59.531789 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-693403c8-7bff-4d95-b482-59578c35ba97 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1" status: 200 len: 328 microversion: 2.1 time: 0.390865 Oct 27 18:52:59.534729 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 942/1906] 10.222.0.42 () {60 vars in 1262 bytes} [Thu Oct 27 18:52:59 2022] PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1 => generated 328 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:52:59.546460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-02836df9-fe0b-49c9-8ba5-cdb2aefcc6ba tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:52:59.547166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-02836df9-fe0b-49c9-8ba5-cdb2aefcc6ba tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:52:59.573113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02836df9-fe0b-49c9-8ba5-cdb2aefcc6ba tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:59.587479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02836df9-fe0b-49c9-8ba5-cdb2aefcc6ba tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:59.587986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02836df9-fe0b-49c9-8ba5-cdb2aefcc6ba tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:52:59.588763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02836df9-fe0b-49c9-8ba5-cdb2aefcc6ba tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:52:59.589238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02836df9-fe0b-49c9-8ba5-cdb2aefcc6ba tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:52:59.589678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02836df9-fe0b-49c9-8ba5-cdb2aefcc6ba tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:00.049040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1ced4ea0-a52e-40fd-9859-126b1c8d6ba8 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:00.059135 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1ced4ea0-a52e-40fd-9859-126b1c8d6ba8 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1333 microversion: 2.1 time: 0.805883 Oct 27 18:53:00.061193 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 965/1907] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:59 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1333 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:00.078920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-58025432-0090-4099-ae1a-cee417487edf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b02d8b0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:00.143883 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-58025432-0090-4099-ae1a-cee417487edf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.079740 Oct 27 18:53:00.144649 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 966/1908] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:00 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:00.164317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fbda7aad-53ff-40d3-b5d5-1ddc974a37b4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:00.165432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fbda7aad-53ff-40d3-b5d5-1ddc974a37b4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:00.173505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbda7aad-53ff-40d3-b5d5-1ddc974a37b4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:00.174290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbda7aad-53ff-40d3-b5d5-1ddc974a37b4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:00.174948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbda7aad-53ff-40d3-b5d5-1ddc974a37b4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:00.176221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbda7aad-53ff-40d3-b5d5-1ddc974a37b4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:00.176868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbda7aad-53ff-40d3-b5d5-1ddc974a37b4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:00.177649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbda7aad-53ff-40d3-b5d5-1ddc974a37b4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:00.356768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fbda7aad-53ff-40d3-b5d5-1ddc974a37b4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:00.375229 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fbda7aad-53ff-40d3-b5d5-1ddc974a37b4 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe" status: 200 len: 1317 microversion: 2.1 time: 0.225990 Oct 27 18:53:00.403680 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 967/1909] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:00 2022] GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:00.410180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2127093509", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:00.438765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-02836df9-fe0b-49c9-8ba5-cdb2aefcc6ba tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:00.460639 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-02836df9-fe0b-49c9-8ba5-cdb2aefcc6ba tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1515 microversion: 2.1 time: 0.923960 Oct 27 18:53:00.461402 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 943/1910] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:52:59 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1515 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:00.470677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-63d9af9e-0003-4ba3-8968-388c05fa99ae req-5d4de4a2-391c-4e9c-b4e0-88a1088c576a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cba4e9-98d0-4048-ba3c-362d01b321e6", "name": "network-vif-plugged", "status": "completed", "tag": "f92f1772-805d-4542-b5d8-d055d2b9dce5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:00.479496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-63d9af9e-0003-4ba3-8968-388c05fa99ae req-5d4de4a2-391c-4e9c-b4e0-88a1088c576a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:00.479496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-63d9af9e-0003-4ba3-8968-388c05fa99ae req-5d4de4a2-391c-4e9c-b4e0-88a1088c576a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:00.479884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-63d9af9e-0003-4ba3-8968-388c05fa99ae req-5d4de4a2-391c-4e9c-b4e0-88a1088c576a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:00.498876 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-63d9af9e-0003-4ba3-8968-388c05fa99ae req-5d4de4a2-391c-4e9c-b4e0-88a1088c576a service nova] Creating event network-vif-plugged:f92f1772-805d-4542-b5d8-d055d2b9dce5 for instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 on n-h1-860687-3 Oct 27 18:53:00.504473 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-63d9af9e-0003-4ba3-8968-388c05fa99ae req-5d4de4a2-391c-4e9c-b4e0-88a1088c576a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041903 Oct 27 18:53:00.505078 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 944/1911] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:00.510925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:00.511628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: 3772b92e-60a4-464c-8fb4-49060f978351] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:00.520318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:53:00.529482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:00.529974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:00.531149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:00.532193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:00.532742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:00.533212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:00.628013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:00.629121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:00.630339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:00.631202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lazy-loading 'fault' on Instance uuid 3772b92e-60a4-464c-8fb4-49060f978351 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:53:00.833560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:00.852612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:00.854275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:00.855578 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-04ad7c92-9be2-4060-b853-2616665ca4a0 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351" status: 200 len: 1367 microversion: 2.47 time: 0.349420 Oct 27 18:53:00.858774 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 945/1912] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:00 2022] GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:00.872234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-612edb77-c8dd-41c0-b802-28456b811655 req-5edd31c7-15d4-4aa8-90a9-e1d7c21df873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d948f3-a6a5-46cb-b716-79eaf55ff690", "name": "network-vif-deleted", "tag": "6b2d83f0-401a-4e99-a170-d27160cbcd4d"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:00.890242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-612edb77-c8dd-41c0-b802-28456b811655 req-5edd31c7-15d4-4aa8-90a9-e1d7c21df873 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:00.894424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-612edb77-c8dd-41c0-b802-28456b811655 req-5edd31c7-15d4-4aa8-90a9-e1d7c21df873 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:00.894905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-612edb77-c8dd-41c0-b802-28456b811655 req-5edd31c7-15d4-4aa8-90a9-e1d7c21df873 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:00.923903 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-612edb77-c8dd-41c0-b802-28456b811655 req-5edd31c7-15d4-4aa8-90a9-e1d7c21df873 service nova] Creating event network-vif-deleted:6b2d83f0-401a-4e99-a170-d27160cbcd4d for instance 60d948f3-a6a5-46cb-b716-79eaf55ff690 on n-h1-860687-3 Oct 27 18:53:00.937880 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-612edb77-c8dd-41c0-b802-28456b811655 req-5edd31c7-15d4-4aa8-90a9-e1d7c21df873 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075244 Oct 27 18:53:00.938997 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 946/1913] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:00.953501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-553c99bf-fe41-4634-b6b8-5269d0b9be7d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:00.954540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-553c99bf-fe41-4634-b6b8-5269d0b9be7d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:00.965975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-553c99bf-fe41-4634-b6b8-5269d0b9be7d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:00.969822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-553c99bf-fe41-4634-b6b8-5269d0b9be7d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:00.970526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-553c99bf-fe41-4634-b6b8-5269d0b9be7d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:00.971458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-553c99bf-fe41-4634-b6b8-5269d0b9be7d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:00.972091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-553c99bf-fe41-4634-b6b8-5269d0b9be7d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:00.972706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-553c99bf-fe41-4634-b6b8-5269d0b9be7d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:00.986701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:53:00.987132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:53:00.987615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:53:00.988028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:53:00.988446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:53:01.011163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:01.014551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:01.015144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:01.016012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:01.023996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:01.024665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:01.027576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:01.108927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Getting quotas for project ff6119a5bbb041dfa73ee1a488ed1bc1. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:53:01.123784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Getting quotas for user b3463494b1344c41883f4efc7dea2eeb and project ff6119a5bbb041dfa73ee1a488ed1bc1. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:53:01.156359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.utils [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] instances quota exceeded for ff6119a5bbb041dfa73ee1a488ed1bc1, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127029) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 27 18:53:01.156927 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Request method failure captured: Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 145 Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOGlrVo17y007gY-HtMDTxeVn4QZeR7OCvt0aCvq0A98FZirxwdhJPUIugXefgyyEstKxnqkGeznkZGG0E6GkgaFz7Jb5KpHWOmsAH-Hw6XTbiyqjZTzKGfNjsT31P7VaJQ2CQerS-CHS4SieUFKZOQb4JeM0LL5Ta-1sgko8A411A Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ff6119a5bbb041dfa73ee1a488ed1bc1 Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-QuotasAdminNegativeTest-1523344438 Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ff6119a5bbb041dfa73ee1a488ed1bc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff6119a5bbb041dfa73ee1a488ed1bc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ff6119a5bbb041dfa73ee1a488ed1bc1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff6119a5bbb041dfa73ee1a488ed1bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-QuotasAdminNegativeTest-1523344438 Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ff6119a5bbb041dfa73ee1a488ed1bc1 Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1523344438 Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-QuotasAdminNegativeTest-1523344438-project Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b3463494b1344c41883f4efc7dea2eeb Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-QuotasAdminNegativeTest-1523344438-project Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2127093509", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2127093509', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452'}}} Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 18:53:01.158942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:01.165710 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-06b1e063-5626-4b59-9ceb-56d71bd848ee tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.755322 Oct 27 18:53:01.174116 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 968/1914] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:53:00 2022] POST /compute/v2.1/servers => generated 119 bytes in 763 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:53:01.174116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-370b6148-a03c-4fab-b01b-f7180e985b27 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:01.174116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-370b6148-a03c-4fab-b01b-f7180e985b27 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:01.192038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-553c99bf-fe41-4634-b6b8-5269d0b9be7d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:01.203474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-553c99bf-fe41-4634-b6b8-5269d0b9be7d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:01.204936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-553c99bf-fe41-4634-b6b8-5269d0b9be7d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:01.206109 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-553c99bf-fe41-4634-b6b8-5269d0b9be7d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1265 microversion: 2.25 time: 0.265844 Oct 27 18:53:01.206710 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 947/1915] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:00 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:01.212821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-370b6148-a03c-4fab-b01b-f7180e985b27 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:01.213349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-370b6148-a03c-4fab-b01b-f7180e985b27 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:01.213811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-370b6148-a03c-4fab-b01b-f7180e985b27 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:01.214582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-370b6148-a03c-4fab-b01b-f7180e985b27 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:01.215052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-370b6148-a03c-4fab-b01b-f7180e985b27 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:01.217350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-370b6148-a03c-4fab-b01b-f7180e985b27 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:01.232581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7ece7d9b-41a9-4e1f-83b3-d667975f41d1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873387790>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:01.333362 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7ece7d9b-41a9-4e1f-83b3-d667975f41d1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.124691 Oct 27 18:53:01.334218 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 948/1916] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:01 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:01.353546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-adfda770-c6fe-4fd7-b65f-1db3c05c8756 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Action: 'update', calling method: .version_select at 0x7fc873387d30>, body: {"quota_set": {"instances": 10}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:01.532693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adfda770-c6fe-4fd7-b65f-1db3c05c8756 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:01.534525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adfda770-c6fe-4fd7-b65f-1db3c05c8756 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:01.535170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adfda770-c6fe-4fd7-b65f-1db3c05c8756 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:01.536122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adfda770-c6fe-4fd7-b65f-1db3c05c8756 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:01.541935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adfda770-c6fe-4fd7-b65f-1db3c05c8756 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:01.542612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adfda770-c6fe-4fd7-b65f-1db3c05c8756 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:01.629500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:01.691749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=88,nova_cell0:UPDATE=12 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:01.716092 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-adfda770-c6fe-4fd7-b65f-1db3c05c8756 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1" status: 200 len: 329 microversion: 2.1 time: 0.380470 Oct 27 18:53:01.743867 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 949/1917] 10.222.0.42 () {60 vars in 1262 bytes} [Thu Oct 27 18:53:01 2022] PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1 => generated 329 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:01.751329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-370b6148-a03c-4fab-b01b-f7180e985b27 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:01.776387 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-370b6148-a03c-4fab-b01b-f7180e985b27 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1333 microversion: 2.1 time: 0.608297 Oct 27 18:53:01.788536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cc7fe66a-e557-446c-854b-259c789ba2d1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:01.789964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cc7fe66a-e557-446c-854b-259c789ba2d1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:01.801260 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 969/1918] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:01 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1333 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:01.824676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc7fe66a-e557-446c-854b-259c789ba2d1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:01.826548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc7fe66a-e557-446c-854b-259c789ba2d1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:01.827231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc7fe66a-e557-446c-854b-259c789ba2d1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:01.827806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-820bb331-6d7e-41ef-8573-caf89c6902cd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:01.828653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-820bb331-6d7e-41ef-8573-caf89c6902cd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:01.830142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc7fe66a-e557-446c-854b-259c789ba2d1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:01.832266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc7fe66a-e557-446c-854b-259c789ba2d1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:01.833586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc7fe66a-e557-446c-854b-259c789ba2d1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:01.883661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-820bb331-6d7e-41ef-8573-caf89c6902cd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:01.884188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-820bb331-6d7e-41ef-8573-caf89c6902cd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:01.890593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-820bb331-6d7e-41ef-8573-caf89c6902cd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:01.891582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-820bb331-6d7e-41ef-8573-caf89c6902cd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:01.897111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-820bb331-6d7e-41ef-8573-caf89c6902cd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:01.900808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-820bb331-6d7e-41ef-8573-caf89c6902cd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:02.212351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-820bb331-6d7e-41ef-8573-caf89c6902cd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:02.233296 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-820bb331-6d7e-41ef-8573-caf89c6902cd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1515 microversion: 2.1 time: 0.429926 Oct 27 18:53:02.235601 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 970/1919] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:01 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1515 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:02.243863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2e6d15ed-026b-4525-a926-e4b2c4f38013 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Calling method '.version_select at 0x7fc86b39eee0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:02.448985 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2e6d15ed-026b-4525-a926-e4b2c4f38013 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1" status: 200 len: 371 microversion: 2.1 time: 0.211159 Oct 27 18:53:02.449584 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 971/1920] 10.222.0.42 () {58 vars in 1242 bytes} [Thu Oct 27 18:53:02 2022] GET /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1 => generated 371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:02.483298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:02.495683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: 3772b92e-60a4-464c-8fb4-49060f978351] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:02.517226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:02.518573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:02.523753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:02.524937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:02.525802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:02.526985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:02.616176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:02.618022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:02.618777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:02.619798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lazy-loading 'fault' on Instance uuid 3772b92e-60a4-464c-8fb4-49060f978351 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:53:02.896397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:02.930694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:02.932820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d69cfaa641e47679ffc57539b6aef0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838e2192e7a74b46829aa6fa134570de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:02.938054 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5180f379-3cf3-4ca9-bf95-d840a9a1bf80 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351" status: 200 len: 1367 microversion: 2.47 time: 0.487427 Oct 27 18:53:02.966580 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 972/1921] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:02 2022] GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351 => generated 1367 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:02.986479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e6630716-acbe-441f-8307-a7fbd8b94a3d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:02.988761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e6630716-acbe-441f-8307-a7fbd8b94a3d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:03.015716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6630716-acbe-441f-8307-a7fbd8b94a3d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:03.018765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6630716-acbe-441f-8307-a7fbd8b94a3d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:03.024547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6630716-acbe-441f-8307-a7fbd8b94a3d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:03.029864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6630716-acbe-441f-8307-a7fbd8b94a3d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:03.030501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6630716-acbe-441f-8307-a7fbd8b94a3d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:03.032531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6630716-acbe-441f-8307-a7fbd8b94a3d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:03.215506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cc7fe66a-e557-446c-854b-259c789ba2d1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:03.240500 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cc7fe66a-e557-446c-854b-259c789ba2d1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe" status: 200 len: 1317 microversion: 2.1 time: 1.492685 Oct 27 18:53:03.242619 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 950/1922] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:01 2022] GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe => generated 1317 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:03.301295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-51d04c06-8bea-4509-b121-409f1b0e238f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b0145e0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:03.354190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e6630716-acbe-441f-8307-a7fbd8b94a3d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:03.368367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e6630716-acbe-441f-8307-a7fbd8b94a3d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:03.382503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e6630716-acbe-441f-8307-a7fbd8b94a3d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:03.388504 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e6630716-acbe-441f-8307-a7fbd8b94a3d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1265 microversion: 2.25 time: 0.417486 Oct 27 18:53:03.392892 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 973/1923] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:02 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1265 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:03.401699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bc192e21-b32d-4733-9ef3-c9d032658e7e tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b153940>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:03.471184 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-51d04c06-8bea-4509-b121-409f1b0e238f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.204942 Oct 27 18:53:03.471972 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 951/1924] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:03 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:03.487617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f51dda59-abe8-4f2b-8373-440c04273bd8 req-372f1c35-9fcd-435b-97eb-e8a5459c5ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cba4e9-98d0-4048-ba3c-362d01b321e6", "name": "network-vif-plugged", "status": "completed", "tag": "093e7ae1-f1cf-4870-b6e1-49be73664937"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:03.542800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f51dda59-abe8-4f2b-8373-440c04273bd8 req-372f1c35-9fcd-435b-97eb-e8a5459c5ef2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:03.544361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f51dda59-abe8-4f2b-8373-440c04273bd8 req-372f1c35-9fcd-435b-97eb-e8a5459c5ef2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:03.545609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f51dda59-abe8-4f2b-8373-440c04273bd8 req-372f1c35-9fcd-435b-97eb-e8a5459c5ef2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:03.597276 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f51dda59-abe8-4f2b-8373-440c04273bd8 req-372f1c35-9fcd-435b-97eb-e8a5459c5ef2 service nova] Creating event network-vif-plugged:093e7ae1-f1cf-4870-b6e1-49be73664937 for instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 on n-h1-860687-3 Oct 27 18:53:03.605144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc192e21-b32d-4733-9ef3-c9d032658e7e tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:03.605396 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f51dda59-abe8-4f2b-8373-440c04273bd8 req-372f1c35-9fcd-435b-97eb-e8a5459c5ef2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131371 Oct 27 18:53:03.605639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc192e21-b32d-4733-9ef3-c9d032658e7e tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:03.606084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc192e21-b32d-4733-9ef3-c9d032658e7e tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:03.606880 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 952/1925] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:03.613675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a3990774-51e9-400b-90e9-786eda4cbd5d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:03.614893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a3990774-51e9-400b-90e9-786eda4cbd5d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:03.617179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc192e21-b32d-4733-9ef3-c9d032658e7e tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:03.617814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc192e21-b32d-4733-9ef3-c9d032658e7e tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:03.618277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc192e21-b32d-4733-9ef3-c9d032658e7e tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:03.623916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3990774-51e9-400b-90e9-786eda4cbd5d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:03.625012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3990774-51e9-400b-90e9-786eda4cbd5d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:03.625647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3990774-51e9-400b-90e9-786eda4cbd5d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:03.626575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3990774-51e9-400b-90e9-786eda4cbd5d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:03.627198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3990774-51e9-400b-90e9-786eda4cbd5d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:03.627953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3990774-51e9-400b-90e9-786eda4cbd5d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:03.743307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:03.832070 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bc192e21-b32d-4733-9ef3-c9d032658e7e tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1" status: 200 len: 325 microversion: 2.1 time: 0.437752 Oct 27 18:53:03.833224 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 974/1926] 10.222.0.42 () {60 vars in 1262 bytes} [Thu Oct 27 18:53:03 2022] PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1 => generated 325 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:03.850374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-34f7298e-2ef0-4450-99f1-2fc18a0c8fcf req-baf97330-65b0-4ce1-8d28-edbf2d0b1e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07939c40-3c51-4886-813a-04aaeeef35b9", "name": "network-vif-deleted", "tag": "19f989fd-2163-4e5e-9ea3-a81013562e5b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:03.874212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-34f7298e-2ef0-4450-99f1-2fc18a0c8fcf req-baf97330-65b0-4ce1-8d28-edbf2d0b1e20 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:03.875157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-34f7298e-2ef0-4450-99f1-2fc18a0c8fcf req-baf97330-65b0-4ce1-8d28-edbf2d0b1e20 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:03.875889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-34f7298e-2ef0-4450-99f1-2fc18a0c8fcf req-baf97330-65b0-4ce1-8d28-edbf2d0b1e20 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:03.901310 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-34f7298e-2ef0-4450-99f1-2fc18a0c8fcf req-baf97330-65b0-4ce1-8d28-edbf2d0b1e20 service nova] Creating event network-vif-deleted:19f989fd-2163-4e5e-9ea3-a81013562e5b for instance 07939c40-3c51-4886-813a-04aaeeef35b9 on n-h1-860687-3 Oct 27 18:53:03.918715 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-34f7298e-2ef0-4450-99f1-2fc18a0c8fcf req-baf97330-65b0-4ce1-8d28-edbf2d0b1e20 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083874 Oct 27 18:53:03.924646 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 975/1927] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:03.931426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4006f877-0a6b-44a9-9b06-5a4457d8e1bd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:03.932470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4006f877-0a6b-44a9-9b06-5a4457d8e1bd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:03.939799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4006f877-0a6b-44a9-9b06-5a4457d8e1bd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:03.940660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4006f877-0a6b-44a9-9b06-5a4457d8e1bd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:03.941342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4006f877-0a6b-44a9-9b06-5a4457d8e1bd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:03.942306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4006f877-0a6b-44a9-9b06-5a4457d8e1bd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:03.943042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4006f877-0a6b-44a9-9b06-5a4457d8e1bd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:03.943982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4006f877-0a6b-44a9-9b06-5a4457d8e1bd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:03.996941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4006f877-0a6b-44a9-9b06-5a4457d8e1bd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:03.997974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4006f877-0a6b-44a9-9b06-5a4457d8e1bd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:03.999112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4006f877-0a6b-44a9-9b06-5a4457d8e1bd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:04.002051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-4006f877-0a6b-44a9-9b06-5a4457d8e1bd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lazy-loading 'fault' on Instance uuid 07939c40-3c51-4886-813a-04aaeeef35b9 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:53:04.128626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4006f877-0a6b-44a9-9b06-5a4457d8e1bd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:04.138182 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4006f877-0a6b-44a9-9b06-5a4457d8e1bd tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 200 len: 1308 microversion: 2.1 time: 0.211961 Oct 27 18:53:04.139377 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 976/1928] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:03 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 1308 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:04.145161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1773626361", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:04.256058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:53:04.426462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a3990774-51e9-400b-90e9-786eda4cbd5d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:04.443147 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a3990774-51e9-400b-90e9-786eda4cbd5d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1333 microversion: 2.1 time: 0.834742 Oct 27 18:53:04.454418 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 953/1929] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:03 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1333 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:04.454418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-183a89e6-eecb-462a-a351-f5681028d8e4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:04.454418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-183a89e6-eecb-462a-a351-f5681028d8e4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] [instance: 3772b92e-60a4-464c-8fb4-49060f978351] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:04.467400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-183a89e6-eecb-462a-a351-f5681028d8e4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:04.467904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-183a89e6-eecb-462a-a351-f5681028d8e4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:04.468359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-183a89e6-eecb-462a-a351-f5681028d8e4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:04.469084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-183a89e6-eecb-462a-a351-f5681028d8e4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:04.469549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-183a89e6-eecb-462a-a351-f5681028d8e4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:04.469986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-183a89e6-eecb-462a-a351-f5681028d8e4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:04.508060 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-183a89e6-eecb-462a-a351-f5681028d8e4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] HTTP exception thrown: Instance 3772b92e-60a4-464c-8fb4-49060f978351 could not be found. Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-183a89e6-eecb-462a-a351-f5681028d8e4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Request method failure captured: Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351 HTTP/1.1 Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtNFCI0EvCl0GHMugFRc2FpAVD5zpLKZpvrleONrQvIKvpyy20yCnRBL2gehJtvdVjvYXfaxnkjbom_v2dufwX91zJ7KuEngu2i3_h9U7pZ29uKwtxG4zPj57C3715SwOQBscbhrIaZeRGnE01EIS-E0TfFk4qAJB2ZL1xfax5T8IO8 Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.47 Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 838e2192e7a74b46829aa6fa134570de Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerShowV247Test-689494243 Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/838e2192e7a74b46829aa6fa134570de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/838e2192e7a74b46829aa6fa134570de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_838e2192e7a74b46829aa6fa134570de", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/838e2192e7a74b46829aa6fa134570de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerShowV247Test-689494243 Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 838e2192e7a74b46829aa6fa134570de Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerShowV247Test-689494243 Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerShowV247Test-689494243-project Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 4d69cfaa641e47679ffc57539b6aef0c Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerShowV247Test-689494243-project Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 3772b92e-60a4-464c-8fb4-49060f978351 could not be found. Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '3772b92e-60a4-464c-8fb4-49060f978351'} Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3772b92e-60a4-464c-8fb4-49060f978351 could not be found. Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3772b92e-60a4-464c-8fb4-49060f978351 could not be found. Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:04.509662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:04.515918 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:04.515918 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:04.515918 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:04.515918 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:04.515918 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:04.515918 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3772b92e-60a4-464c-8fb4-49060f978351 could not be found. Oct 27 18:53:04.515918 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:04.515918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-183a89e6-eecb-462a-a351-f5681028d8e4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] Returning 404 to user: Instance 3772b92e-60a4-464c-8fb4-49060f978351 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:04.515918 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-183a89e6-eecb-462a-a351-f5681028d8e4 tempest-ServerShowV247Test-689494243 tempest-ServerShowV247Test-689494243-project] 10.222.0.42 "GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351" status: 404 len: 111 microversion: 2.47 time: 0.065979 Oct 27 18:53:04.515918 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 954/1930] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:04 2022] GET /compute/v2.1/servers/3772b92e-60a4-464c-8fb4-49060f978351 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:53:04.518652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9b1ae68-0275-4be5-8c40-73a88d3efef3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:04.519519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c9b1ae68-0275-4be5-8c40-73a88d3efef3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:04.532398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:53:04.532918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:53:04.533416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:53:04.533841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:53:04.534266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:53:04.538208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9b1ae68-0275-4be5-8c40-73a88d3efef3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:04.539326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9b1ae68-0275-4be5-8c40-73a88d3efef3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:04.539776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9b1ae68-0275-4be5-8c40-73a88d3efef3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:04.540510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9b1ae68-0275-4be5-8c40-73a88d3efef3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:04.540968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9b1ae68-0275-4be5-8c40-73a88d3efef3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:04.541404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9b1ae68-0275-4be5-8c40-73a88d3efef3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:04.555630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:04.561383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:04.561383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:04.561383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:04.561383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:04.561383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:04.607656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Getting quotas for project ff6119a5bbb041dfa73ee1a488ed1bc1. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:53:04.623164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Getting quotas for user b3463494b1344c41883f4efc7dea2eeb and project ff6119a5bbb041dfa73ee1a488ed1bc1. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:53:04.652079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.utils [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] ram quota exceeded for ff6119a5bbb041dfa73ee1a488ed1bc1, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127029) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 27 18:53:04.652647 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Request method failure captured: Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 145 Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOGlrVo17y007gY-HtMDTxeVn4QZeR7OCvt0aCvq0A98FZirxwdhJPUIugXefgyyEstKxnqkGeznkZGG0E6GkgaFz7Jb5KpHWOmsAH-Hw6XTbiyqjZTzKGfNjsT31P7VaJQ2CQerS-CHS4SieUFKZOQb4JeM0LL5Ta-1sgko8A411A Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ff6119a5bbb041dfa73ee1a488ed1bc1 Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-QuotasAdminNegativeTest-1523344438 Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ff6119a5bbb041dfa73ee1a488ed1bc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff6119a5bbb041dfa73ee1a488ed1bc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ff6119a5bbb041dfa73ee1a488ed1bc1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff6119a5bbb041dfa73ee1a488ed1bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-QuotasAdminNegativeTest-1523344438 Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ff6119a5bbb041dfa73ee1a488ed1bc1 Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1523344438 Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-QuotasAdminNegativeTest-1523344438-project Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b3463494b1344c41883f4efc7dea2eeb Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-QuotasAdminNegativeTest-1523344438-project Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1773626361", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1773626361', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452'}}} Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 18:53:04.654819 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dce32e91-9cc4-425e-b6e5-fa126f93c448 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.515102 Oct 27 18:53:04.660722 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 977/1931] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:53:04 2022] POST /compute/v2.1/servers => generated 110 bytes in 516 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:53:04.682896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-59fb1fbb-6c54-4d9a-b3c4-3fa1509381c2 req-1bae7b20-3ce0-41c0-9143-5250f4f2a855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0556339c-0d41-460d-945e-c3b5a95bccfe", "tag": "f9f631d4-05dd-4e90-8742-f18d221abce2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:04.700816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-59fb1fbb-6c54-4d9a-b3c4-3fa1509381c2 req-1bae7b20-3ce0-41c0-9143-5250f4f2a855 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:04.702230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-59fb1fbb-6c54-4d9a-b3c4-3fa1509381c2 req-1bae7b20-3ce0-41c0-9143-5250f4f2a855 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:04.702925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-59fb1fbb-6c54-4d9a-b3c4-3fa1509381c2 req-1bae7b20-3ce0-41c0-9143-5250f4f2a855 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:04.727114 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-59fb1fbb-6c54-4d9a-b3c4-3fa1509381c2 req-1bae7b20-3ce0-41c0-9143-5250f4f2a855 service nova] Creating event network-changed:f9f631d4-05dd-4e90-8742-f18d221abce2 for instance 0556339c-0d41-460d-945e-c3b5a95bccfe on n-h2-860687-3 Oct 27 18:53:04.735136 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-59fb1fbb-6c54-4d9a-b3c4-3fa1509381c2 req-1bae7b20-3ce0-41c0-9143-5250f4f2a855 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076650 Oct 27 18:53:04.737036 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 978/1932] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:04.748105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-648f4494-9fcf-48d6-9492-d8f72e9c1ec4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:04.750006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-648f4494-9fcf-48d6-9492-d8f72e9c1ec4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:04.759152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-648f4494-9fcf-48d6-9492-d8f72e9c1ec4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:04.760002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-648f4494-9fcf-48d6-9492-d8f72e9c1ec4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:04.760639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-648f4494-9fcf-48d6-9492-d8f72e9c1ec4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:04.761627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-648f4494-9fcf-48d6-9492-d8f72e9c1ec4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:04.762352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-648f4494-9fcf-48d6-9492-d8f72e9c1ec4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:04.763053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-648f4494-9fcf-48d6-9492-d8f72e9c1ec4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:04.861015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-648f4494-9fcf-48d6-9492-d8f72e9c1ec4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:04.872543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-648f4494-9fcf-48d6-9492-d8f72e9c1ec4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:04.874279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-648f4494-9fcf-48d6-9492-d8f72e9c1ec4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:04.875696 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-648f4494-9fcf-48d6-9492-d8f72e9c1ec4 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1265 microversion: 2.25 time: 0.137152 Oct 27 18:53:04.876789 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 979/1933] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:04 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:04.885984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84a0fc31-a085-42d1-b083-e201d73ba2af tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86aaf7040>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:04.962722 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-84a0fc31-a085-42d1-b083-e201d73ba2af tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.084517 Oct 27 18:53:04.964247 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 980/1934] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:04 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:04.976866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5dd35ae9-1ca5-4bf3-a7f1-fa7bf47ed841 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Action: 'update', calling method: .version_select at 0x7fc86b007820>, body: {"quota_set": {"ram": 51200}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:05.259276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c9b1ae68-0275-4be5-8c40-73a88d3efef3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:05.273834 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c9b1ae68-0275-4be5-8c40-73a88d3efef3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe" status: 200 len: 1317 microversion: 2.1 time: 0.759417 Oct 27 18:53:05.277047 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 955/1935] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:04 2022] GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe => generated 1317 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:05.290562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1718707c-3f31-44bf-a41c-ebcd626bf1b6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:05.291730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1718707c-3f31-44bf-a41c-ebcd626bf1b6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: 07939c40-3c51-4886-813a-04aaeeef35b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:05.307365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1718707c-3f31-44bf-a41c-ebcd626bf1b6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:05.308286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1718707c-3f31-44bf-a41c-ebcd626bf1b6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:05.310113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1718707c-3f31-44bf-a41c-ebcd626bf1b6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:05.312552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1718707c-3f31-44bf-a41c-ebcd626bf1b6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:05.315522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1718707c-3f31-44bf-a41c-ebcd626bf1b6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:05.316310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1718707c-3f31-44bf-a41c-ebcd626bf1b6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:05.364708 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-1718707c-3f31-44bf-a41c-ebcd626bf1b6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] HTTP exception thrown: Instance 07939c40-3c51-4886-813a-04aaeeef35b9 could not be found. Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1718707c-3f31-44bf-a41c-ebcd626bf1b6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Request method failure captured: Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 HTTP/1.1 Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtLANq_1XCqdXrMgXg1HCP060ziCly0OHtlX72FRXAe3NyMVxo4rqxSS01peLn0gtC97ll4_g2LBb00itEUbB0Kc3rSsCR6zEqCmV3pSiTxQZXRvdN2fjWKBO6Iraa2OUkhYwsLmylslLQq9Uqpo9JFUPs4Pv_1b0jVTSCn6SrLTCUs Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 366d94ed2eb14e759c191e32c65b187a Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesAdminNegativeTest-1240918187 Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/366d94ed2eb14e759c191e32c65b187a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/366d94ed2eb14e759c191e32c65b187a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_366d94ed2eb14e759c191e32c65b187a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/366d94ed2eb14e759c191e32c65b187a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-VolumesAdminNegativeTest-1240918187 Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 366d94ed2eb14e759c191e32c65b187a Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1240918187 Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-VolumesAdminNegativeTest-1240918187-project Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 878d41625de6498283fde8fb05a4bbf6 Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-VolumesAdminNegativeTest-1240918187-project Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 07939c40-3c51-4886-813a-04aaeeef35b9 could not be found. Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '07939c40-3c51-4886-813a-04aaeeef35b9'} Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07939c40-3c51-4886-813a-04aaeeef35b9 could not be found. Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07939c40-3c51-4886-813a-04aaeeef35b9 could not be found. Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:05.370362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:05.375383 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:05.375383 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:05.375383 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:05.375383 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:05.375383 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:05.375383 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07939c40-3c51-4886-813a-04aaeeef35b9 could not be found. Oct 27 18:53:05.375383 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:05.377797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1718707c-3f31-44bf-a41c-ebcd626bf1b6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Returning 404 to user: Instance 07939c40-3c51-4886-813a-04aaeeef35b9 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:05.379109 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1718707c-3f31-44bf-a41c-ebcd626bf1b6 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9" status: 404 len: 111 microversion: 2.1 time: 0.100713 Oct 27 18:53:05.380344 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 956/1936] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:05 2022] GET /compute/v2.1/servers/07939c40-3c51-4886-813a-04aaeeef35b9 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:53:05.460333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5dd35ae9-1ca5-4bf3-a7f1-fa7bf47ed841 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:05.461144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5dd35ae9-1ca5-4bf3-a7f1-fa7bf47ed841 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:05.461899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5dd35ae9-1ca5-4bf3-a7f1-fa7bf47ed841 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:05.462894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5dd35ae9-1ca5-4bf3-a7f1-fa7bf47ed841 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:05.463549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5dd35ae9-1ca5-4bf3-a7f1-fa7bf47ed841 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:05.464311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5dd35ae9-1ca5-4bf3-a7f1-fa7bf47ed841 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:05.471586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c5e4b18c-e8ec-4329-9ed1-9eefcf419f84 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:05.473111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c5e4b18c-e8ec-4329-9ed1-9eefcf419f84 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:05.486325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5e4b18c-e8ec-4329-9ed1-9eefcf419f84 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:05.488184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5e4b18c-e8ec-4329-9ed1-9eefcf419f84 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:05.489990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5e4b18c-e8ec-4329-9ed1-9eefcf419f84 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:05.492983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5e4b18c-e8ec-4329-9ed1-9eefcf419f84 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:05.493737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5e4b18c-e8ec-4329-9ed1-9eefcf419f84 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:05.495413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5e4b18c-e8ec-4329-9ed1-9eefcf419f84 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:05.559009 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5dd35ae9-1ca5-4bf3-a7f1-fa7bf47ed841 tempest-QuotasAdminNegativeTest-351914161 tempest-QuotasAdminNegativeTest-351914161-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1" status: 200 len: 329 microversion: 2.1 time: 0.593603 Oct 27 18:53:05.560434 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 981/1937] 10.222.0.42 () {60 vars in 1262 bytes} [Thu Oct 27 18:53:04 2022] PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1 => generated 329 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:05.577991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f94c1a5c-0d11-483c-b6e7-7798a2fe8510 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Action: 'update', calling method: .version_select at 0x7fc86b7848b0>, body: {"quota_set": {"ram": 0}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:05.585523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f94c1a5c-0d11-483c-b6e7-7798a2fe8510 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'b3463494b1344c41883f4efc7dea2eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff6119a5bbb041dfa73ee1a488ed1bc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f94c1a5c-0d11-483c-b6e7-7798a2fe8510 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Request method failure captured: Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1 HTTP/1.1 Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 25 Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOGlrVo17y007gY-HtMDTxeVn4QZeR7OCvt0aCvq0A98FZirxwdhJPUIugXefgyyEstKxnqkGeznkZGG0E6GkgaFz7Jb5KpHWOmsAH-Hw6XTbiyqjZTzKGfNjsT31P7VaJQ2CQerS-CHS4SieUFKZOQb4JeM0LL5Ta-1sgko8A411A Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ff6119a5bbb041dfa73ee1a488ed1bc1 Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-QuotasAdminNegativeTest-1523344438 Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ff6119a5bbb041dfa73ee1a488ed1bc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff6119a5bbb041dfa73ee1a488ed1bc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ff6119a5bbb041dfa73ee1a488ed1bc1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff6119a5bbb041dfa73ee1a488ed1bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-QuotasAdminNegativeTest-1523344438 Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ff6119a5bbb041dfa73ee1a488ed1bc1 Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1523344438 Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-QuotasAdminNegativeTest-1523344438-project Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b3463494b1344c41883f4efc7dea2eeb Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-QuotasAdminNegativeTest-1523344438-project Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: {"quota_set": {"ram": 0}} Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'ff6119a5bbb041dfa73ee1a488ed1bc1', 'body': {'quota_set': {'ram': 0}}} Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 18:53:05.597732 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f94c1a5c-0d11-483c-b6e7-7798a2fe8510 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:05.603989 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f94c1a5c-0d11-483c-b6e7-7798a2fe8510 tempest-QuotasAdminNegativeTest-1523344438 tempest-QuotasAdminNegativeTest-1523344438-project] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1" status: 403 len: 116 microversion: 2.1 time: 0.025942 Oct 27 18:53:05.607337 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 982/1938] 10.222.0.42 () {60 vars in 1262 bytes} [Thu Oct 27 18:53:05 2022] PUT /compute/v2.1/os-quota-sets/ff6119a5bbb041dfa73ee1a488ed1bc1 => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:53:05.640433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-60272fdc-e30d-4d5d-bd2b-959d9e27dfe6 req-5edfa63e-8eae-4a53-84d3-73b8c17aeb2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5e11da-2f25-4433-98d7-8f5b0620095f", "name": "network-vif-plugged", "status": "completed", "tag": "00a226a6-58cf-4f6d-9bc2-e12c43140523"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:05.653270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-60272fdc-e30d-4d5d-bd2b-959d9e27dfe6 req-5edfa63e-8eae-4a53-84d3-73b8c17aeb2f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:05.654079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-60272fdc-e30d-4d5d-bd2b-959d9e27dfe6 req-5edfa63e-8eae-4a53-84d3-73b8c17aeb2f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:05.654771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-60272fdc-e30d-4d5d-bd2b-959d9e27dfe6 req-5edfa63e-8eae-4a53-84d3-73b8c17aeb2f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:05.669564 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-60272fdc-e30d-4d5d-bd2b-959d9e27dfe6 req-5edfa63e-8eae-4a53-84d3-73b8c17aeb2f service nova] Creating event network-vif-plugged:00a226a6-58cf-4f6d-9bc2-e12c43140523 for instance ac5e11da-2f25-4433-98d7-8f5b0620095f on n-h1-860687-3 Oct 27 18:53:05.677959 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-60272fdc-e30d-4d5d-bd2b-959d9e27dfe6 req-5edfa63e-8eae-4a53-84d3-73b8c17aeb2f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049211 Oct 27 18:53:05.680620 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 983/1939] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:05.915341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1dbd9bea-fef3-4bf8-b768-fd4097ac71bf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:05.920096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1dbd9bea-fef3-4bf8-b768-fd4097ac71bf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:05.939369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dbd9bea-fef3-4bf8-b768-fd4097ac71bf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:05.940266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dbd9bea-fef3-4bf8-b768-fd4097ac71bf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:05.944655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dbd9bea-fef3-4bf8-b768-fd4097ac71bf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:05.945724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dbd9bea-fef3-4bf8-b768-fd4097ac71bf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:05.946480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dbd9bea-fef3-4bf8-b768-fd4097ac71bf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:05.948948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dbd9bea-fef3-4bf8-b768-fd4097ac71bf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:06.151819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1dbd9bea-fef3-4bf8-b768-fd4097ac71bf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:06.161063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1dbd9bea-fef3-4bf8-b768-fd4097ac71bf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:06.167990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1dbd9bea-fef3-4bf8-b768-fd4097ac71bf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:06.180444 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1dbd9bea-fef3-4bf8-b768-fd4097ac71bf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1265 microversion: 2.25 time: 0.272382 Oct 27 18:53:06.184546 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 984/1940] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:05 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:53:06.198898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1fe69ff1-a6b7-4c03-96cb-c2d698f442ee tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b2f5ee0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:06.284396 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1fe69ff1-a6b7-4c03-96cb-c2d698f442ee tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.098476 Oct 27 18:53:06.285162 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 985/1941] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:06 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:06.301199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-04803068-a72e-49e1-b5e8-2c1156c94a14 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:06.301993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-04803068-a72e-49e1-b5e8-2c1156c94a14 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:06.313931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04803068-a72e-49e1-b5e8-2c1156c94a14 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:06.320364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04803068-a72e-49e1-b5e8-2c1156c94a14 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:06.332080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04803068-a72e-49e1-b5e8-2c1156c94a14 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:06.332975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04803068-a72e-49e1-b5e8-2c1156c94a14 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:06.335896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04803068-a72e-49e1-b5e8-2c1156c94a14 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:06.338511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04803068-a72e-49e1-b5e8-2c1156c94a14 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:06.535627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c5e4b18c-e8ec-4329-9ed1-9eefcf419f84 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:06.547757 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c5e4b18c-e8ec-4329-9ed1-9eefcf419f84 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1666 microversion: 2.1 time: 1.082244 Oct 27 18:53:06.552927 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 957/1942] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:05 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1666 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:06.579929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b2708acd-c4a6-4f13-bbae-dd19a788578c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:06.580741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b2708acd-c4a6-4f13-bbae-dd19a788578c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:06.605790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2708acd-c4a6-4f13-bbae-dd19a788578c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:06.606625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2708acd-c4a6-4f13-bbae-dd19a788578c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:06.609667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2708acd-c4a6-4f13-bbae-dd19a788578c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:06.617264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2708acd-c4a6-4f13-bbae-dd19a788578c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:06.618266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2708acd-c4a6-4f13-bbae-dd19a788578c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:06.618926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2708acd-c4a6-4f13-bbae-dd19a788578c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:06.758679 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b2708acd-c4a6-4f13-bbae-dd19a788578c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6/ips" status: 200 len: 177 microversion: 2.1 time: 0.181459 Oct 27 18:53:06.761666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-04803068-a72e-49e1-b5e8-2c1156c94a14 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:06.766251 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 958/1943] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 18:53:06 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6/ips => generated 177 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:53:06.771209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:06.784862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b7706dbf-b904-4e85-bef6-1ae5541ad15d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:06.785379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b7706dbf-b904-4e85-bef6-1ae5541ad15d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:06.791224 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-04803068-a72e-49e1-b5e8-2c1156c94a14 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe" status: 200 len: 1317 microversion: 2.1 time: 0.493406 Oct 27 18:53:06.792739 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 986/1944] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:06 2022] GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:06.796475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7706dbf-b904-4e85-bef6-1ae5541ad15d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:06.799644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7706dbf-b904-4e85-bef6-1ae5541ad15d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:06.802734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7706dbf-b904-4e85-bef6-1ae5541ad15d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:06.803584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7706dbf-b904-4e85-bef6-1ae5541ad15d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:06.804114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7706dbf-b904-4e85-bef6-1ae5541ad15d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:06.804561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7706dbf-b904-4e85-bef6-1ae5541ad15d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:06.866358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b7706dbf-b904-4e85-bef6-1ae5541ad15d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:53:06.887073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-0099b2de-8e4e-4317-afc0-37ca32137de2 req-2f5c264d-8ef4-49a2-a41b-51b6043129bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50aa2e14-0b49-4eb7-af7b-79582409b298", "tag": "eaf4cd8a-cd39-427d-bd80-9e251b91623b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:06.937475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0099b2de-8e4e-4317-afc0-37ca32137de2 req-2f5c264d-8ef4-49a2-a41b-51b6043129bf service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:06.938041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0099b2de-8e4e-4317-afc0-37ca32137de2 req-2f5c264d-8ef4-49a2-a41b-51b6043129bf service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:06.961168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0099b2de-8e4e-4317-afc0-37ca32137de2 req-2f5c264d-8ef4-49a2-a41b-51b6043129bf service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:06.986924 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-0099b2de-8e4e-4317-afc0-37ca32137de2 req-2f5c264d-8ef4-49a2-a41b-51b6043129bf service nova] Creating event network-changed:eaf4cd8a-cd39-427d-bd80-9e251b91623b for instance 50aa2e14-0b49-4eb7-af7b-79582409b298 on n-h2-860687-3 Oct 27 18:53:07.006176 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-0099b2de-8e4e-4317-afc0-37ca32137de2 req-2f5c264d-8ef4-49a2-a41b-51b6043129bf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124338 Oct 27 18:53:07.016258 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 987/1945] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:07.023613 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b7706dbf-b904-4e85-bef6-1ae5541ad15d tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "DELETE /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 204 len: 0 microversion: 2.1 time: 0.255915 Oct 27 18:53:07.024734 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 959/1946] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:53:06 2022] DELETE /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:53:07.033476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5ad2d184-5aeb-4d45-af72-c73d11741f0c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:07.041275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5ad2d184-5aeb-4d45-af72-c73d11741f0c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:07.051518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ad2d184-5aeb-4d45-af72-c73d11741f0c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:07.052023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ad2d184-5aeb-4d45-af72-c73d11741f0c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:07.052476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ad2d184-5aeb-4d45-af72-c73d11741f0c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:07.053200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ad2d184-5aeb-4d45-af72-c73d11741f0c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:07.053664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ad2d184-5aeb-4d45-af72-c73d11741f0c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:07.054692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ad2d184-5aeb-4d45-af72-c73d11741f0c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:07.214671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6bb2915-f5d3-4343-9760-750c42215fbf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:07.215746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d6bb2915-f5d3-4343-9760-750c42215fbf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:07.229226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6bb2915-f5d3-4343-9760-750c42215fbf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:07.233317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6bb2915-f5d3-4343-9760-750c42215fbf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:07.235809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6bb2915-f5d3-4343-9760-750c42215fbf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:07.246027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6bb2915-f5d3-4343-9760-750c42215fbf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:07.247031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6bb2915-f5d3-4343-9760-750c42215fbf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:07.247832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6bb2915-f5d3-4343-9760-750c42215fbf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:07.336622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5ad2d184-5aeb-4d45-af72-c73d11741f0c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:07.360101 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5ad2d184-5aeb-4d45-af72-c73d11741f0c tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1672 microversion: 2.1 time: 0.330865 Oct 27 18:53:07.363426 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 988/1947] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:07 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1672 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:07.382269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-70659019-6f5e-4205-b58e-f71762159943 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86afd6e50>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:07.480746 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-70659019-6f5e-4205-b58e-f71762159943 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.114171 Oct 27 18:53:07.481439 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 989/1948] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:07 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:07.545813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d6bb2915-f5d3-4343-9760-750c42215fbf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:07.558617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d6bb2915-f5d3-4343-9760-750c42215fbf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:07.560457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d6bb2915-f5d3-4343-9760-750c42215fbf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:07.562304 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d6bb2915-f5d3-4343-9760-750c42215fbf tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1265 microversion: 2.25 time: 0.353386 Oct 27 18:53:07.579604 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 960/1949] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:07 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1265 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:53:07.830857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-68a1346d-c7b1-48be-8fce-a3ef6aba1e60 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:07.831480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-68a1346d-c7b1-48be-8fce-a3ef6aba1e60 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:07.853737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68a1346d-c7b1-48be-8fce-a3ef6aba1e60 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:07.860521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68a1346d-c7b1-48be-8fce-a3ef6aba1e60 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:07.866327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68a1346d-c7b1-48be-8fce-a3ef6aba1e60 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:07.868262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68a1346d-c7b1-48be-8fce-a3ef6aba1e60 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:07.868750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68a1346d-c7b1-48be-8fce-a3ef6aba1e60 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:07.869195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68a1346d-c7b1-48be-8fce-a3ef6aba1e60 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:08.168972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-68a1346d-c7b1-48be-8fce-a3ef6aba1e60 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:08.189600 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-68a1346d-c7b1-48be-8fce-a3ef6aba1e60 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe" status: 200 len: 1317 microversion: 2.1 time: 0.362501 Oct 27 18:53:08.190206 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 990/1950] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:07 2022] GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:08.389816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4f22c129-c617-4f17-bc9c-bff9ab8ab64a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:08.393811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4f22c129-c617-4f17-bc9c-bff9ab8ab64a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:08.402614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f22c129-c617-4f17-bc9c-bff9ab8ab64a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:08.403522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f22c129-c617-4f17-bc9c-bff9ab8ab64a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:08.404196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f22c129-c617-4f17-bc9c-bff9ab8ab64a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:08.405168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f22c129-c617-4f17-bc9c-bff9ab8ab64a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:08.405868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f22c129-c617-4f17-bc9c-bff9ab8ab64a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:08.406558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f22c129-c617-4f17-bc9c-bff9ab8ab64a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:08.497152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b3c84dc7-7254-4fb0-8b10-cce163aad43f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a7de040>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:08.619768 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b3c84dc7-7254-4fb0-8b10-cce163aad43f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.126761 Oct 27 18:53:08.622832 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 991/1951] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:08 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:08.638366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5ac747fc-66a1-455b-ac00-0a216bbc2a9d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:08.639768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5ac747fc-66a1-455b-ac00-0a216bbc2a9d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:08.657821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ac747fc-66a1-455b-ac00-0a216bbc2a9d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:08.658894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ac747fc-66a1-455b-ac00-0a216bbc2a9d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:08.660084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ac747fc-66a1-455b-ac00-0a216bbc2a9d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:08.663929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ac747fc-66a1-455b-ac00-0a216bbc2a9d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:08.667107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ac747fc-66a1-455b-ac00-0a216bbc2a9d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:08.668149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ac747fc-66a1-455b-ac00-0a216bbc2a9d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:08.749936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4f22c129-c617-4f17-bc9c-bff9ab8ab64a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:08.760614 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4f22c129-c617-4f17-bc9c-bff9ab8ab64a tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1672 microversion: 2.1 time: 0.374740 Oct 27 18:53:08.763244 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 961/1952] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:08 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1672 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:08.865446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5ac747fc-66a1-455b-ac00-0a216bbc2a9d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:08.879358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5ac747fc-66a1-455b-ac00-0a216bbc2a9d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:08.883798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5ac747fc-66a1-455b-ac00-0a216bbc2a9d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:08.885080 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5ac747fc-66a1-455b-ac00-0a216bbc2a9d tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1265 microversion: 2.25 time: 0.259094 Oct 27 18:53:08.903185 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 992/1953] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:08 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:09.214693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-416e5c91-ecfb-4522-8f8c-8797a39fbcdb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:09.215323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-416e5c91-ecfb-4522-8f8c-8797a39fbcdb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:09.225819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-416e5c91-ecfb-4522-8f8c-8797a39fbcdb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:09.226331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-416e5c91-ecfb-4522-8f8c-8797a39fbcdb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:09.226805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-416e5c91-ecfb-4522-8f8c-8797a39fbcdb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:09.227533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-416e5c91-ecfb-4522-8f8c-8797a39fbcdb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:09.227994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-416e5c91-ecfb-4522-8f8c-8797a39fbcdb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:09.228428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-416e5c91-ecfb-4522-8f8c-8797a39fbcdb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:09.638688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ea43dd9f-5685-431b-943b-90bce0831894 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b073ee0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:09.727231 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ea43dd9f-5685-431b-943b-90bce0831894 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.089609 Oct 27 18:53:09.727933 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 993/1954] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:09 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:09.791890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4dc19d95-68d2-45df-8a3a-6207236c393b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:09.793295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4dc19d95-68d2-45df-8a3a-6207236c393b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:09.824309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dc19d95-68d2-45df-8a3a-6207236c393b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:09.826862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dc19d95-68d2-45df-8a3a-6207236c393b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:09.827345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dc19d95-68d2-45df-8a3a-6207236c393b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:09.828112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dc19d95-68d2-45df-8a3a-6207236c393b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:09.828586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dc19d95-68d2-45df-8a3a-6207236c393b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:09.829027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4dc19d95-68d2-45df-8a3a-6207236c393b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:10.739211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-416e5c91-ecfb-4522-8f8c-8797a39fbcdb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:10.762195 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-416e5c91-ecfb-4522-8f8c-8797a39fbcdb tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe" status: 200 len: 1317 microversion: 2.1 time: 1.547348 Oct 27 18:53:10.763759 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 962/1955] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:09 2022] GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe => generated 1317 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:10.771860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:10.773089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:10.780895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:10.781928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:10.782688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:10.784092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:10.785049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:10.785717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:10.853436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:10.854770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:10.855773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:10.856720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lazy-loading 'fault' on Instance uuid 60d948f3-a6a5-46cb-b716-79eaf55ff690 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:53:10.957922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4dc19d95-68d2-45df-8a3a-6207236c393b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:10.968913 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4dc19d95-68d2-45df-8a3a-6207236c393b tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1651 microversion: 2.1 time: 1.181365 Oct 27 18:53:10.982659 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 994/1956] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:09 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1651 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:10.992833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-23a4dfec-4c5e-47e5-a2c6-49567c67169c req-b701eb65-1ca2-4f61-8ffe-7068c279d180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cba4e9-98d0-4048-ba3c-362d01b321e6", "name": "network-vif-deleted", "tag": "f92f1772-805d-4542-b5d8-d055d2b9dce5"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:11.044265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-23a4dfec-4c5e-47e5-a2c6-49567c67169c req-b701eb65-1ca2-4f61-8ffe-7068c279d180 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:11.044653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-23a4dfec-4c5e-47e5-a2c6-49567c67169c req-b701eb65-1ca2-4f61-8ffe-7068c279d180 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:11.045102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-23a4dfec-4c5e-47e5-a2c6-49567c67169c req-b701eb65-1ca2-4f61-8ffe-7068c279d180 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:11.114608 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-23a4dfec-4c5e-47e5-a2c6-49567c67169c req-b701eb65-1ca2-4f61-8ffe-7068c279d180 service nova] Creating event network-vif-deleted:f92f1772-805d-4542-b5d8-d055d2b9dce5 for instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 on n-h1-860687-3 Oct 27 18:53:11.132513 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-23a4dfec-4c5e-47e5-a2c6-49567c67169c req-b701eb65-1ca2-4f61-8ffe-7068c279d180 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148962 Oct 27 18:53:11.141410 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 995/1957] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:11.147169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-57f91d09-0245-4ac9-90a1-3aa86b857197 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b039ee0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:11.245481 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-57f91d09-0245-4ac9-90a1-3aa86b857197 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.102365 Oct 27 18:53:11.246742 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 996/1958] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:11 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:11.255882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1046795706", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "299482f3-57f8-4286-b4c4-3317687c91c2"}], "security_groups": [{"name": "tempest-securitygroup--1886397967"}], "key_name": "tempest-keypair-2126868959", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "45a7f07f-ee2a-4ef4-b0e8-7c03c3189d11", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:11.331469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:11.346791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:11.354979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:11.358302 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-63f93421-8284-46a9-826e-592bf8fd33f3 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 200 len: 1193 microversion: 2.25 time: 0.592960 Oct 27 18:53:11.371243 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 963/1959] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:10 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 1193 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:11.788505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-12fea4ec-d16b-4843-b7c2-b8cb140ad7a3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:11.789158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-12fea4ec-d16b-4843-b7c2-b8cb140ad7a3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:11.792292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=12 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:11.805617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] validate_networks() for [('299482f3-57f8-4286-b4c4-3317687c91c2', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:53:11.806972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12fea4ec-d16b-4843-b7c2-b8cb140ad7a3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:11.820744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12fea4ec-d16b-4843-b7c2-b8cb140ad7a3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:11.821551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12fea4ec-d16b-4843-b7c2-b8cb140ad7a3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:11.822532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12fea4ec-d16b-4843-b7c2-b8cb140ad7a3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:11.825837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12fea4ec-d16b-4843-b7c2-b8cb140ad7a3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:11.826764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12fea4ec-d16b-4843-b7c2-b8cb140ad7a3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:12.494067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-12fea4ec-d16b-4843-b7c2-b8cb140ad7a3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:12.502427 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-12fea4ec-d16b-4843-b7c2-b8cb140ad7a3 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe" status: 200 len: 1317 microversion: 2.1 time: 0.717910 Oct 27 18:53:12.521606 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 964/1960] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:11 2022] GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe => generated 1317 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:12.534457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-08baa287-b853-456a-b0ae-63e393f98cdd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:12.535350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-08baa287-b853-456a-b0ae-63e393f98cdd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:12.550036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08baa287-b853-456a-b0ae-63e393f98cdd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:12.550878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08baa287-b853-456a-b0ae-63e393f98cdd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:12.553462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08baa287-b853-456a-b0ae-63e393f98cdd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:12.554915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08baa287-b853-456a-b0ae-63e393f98cdd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:12.556438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08baa287-b853-456a-b0ae-63e393f98cdd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:12.558613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08baa287-b853-456a-b0ae-63e393f98cdd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:12.851624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-08baa287-b853-456a-b0ae-63e393f98cdd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f657dcabf43141b584416d2597efb5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6f4807fd34f6d9422bc06ee20cb10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:12.860425 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-08baa287-b853-456a-b0ae-63e393f98cdd tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 200 len: 1452 microversion: 2.1 time: 0.336219 Oct 27 18:53:12.860683 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 965/1961] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:12 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 1452 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:12.874736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ceb79c58-be4c-41f3-8dbe-21b277639791 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873368af0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:12.975021 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ceb79c58-be4c-41f3-8dbe-21b277639791 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.113335 Oct 27 18:53:12.977462 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 966/1962] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:12 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:13.001475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-50f3e516-7699-4b78-b731-6cd2aa8d25d8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:13.006326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-50f3e516-7699-4b78-b731-6cd2aa8d25d8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 60d948f3-a6a5-46cb-b716-79eaf55ff690] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:13.037731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50f3e516-7699-4b78-b731-6cd2aa8d25d8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:13.043345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50f3e516-7699-4b78-b731-6cd2aa8d25d8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:13.048269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50f3e516-7699-4b78-b731-6cd2aa8d25d8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:13.052023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50f3e516-7699-4b78-b731-6cd2aa8d25d8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:13.058311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50f3e516-7699-4b78-b731-6cd2aa8d25d8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:13.062773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50f3e516-7699-4b78-b731-6cd2aa8d25d8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:13.130523 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-50f3e516-7699-4b78-b731-6cd2aa8d25d8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] HTTP exception thrown: Instance 60d948f3-a6a5-46cb-b716-79eaf55ff690 could not be found. Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-50f3e516-7699-4b78-b731-6cd2aa8d25d8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Request method failure captured: Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 HTTP/1.1 Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtH54kKGI2_VMr-tkr1kvsEF2LwSziPkOKzEpMchvtpUGnvXInOLu7oI10jqJbOG0Z6_yC7HUl7R44dz_SsJr75yawC2VOkFPwCkbK3Icj36YL9NljTLx2ekq_5fQ5Kc_yHCRikXXAgYsViebvXAQLUG1gWJOrfpKYSZl1r2dIomPQQ Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: a1c89e4b67024f91ae460e3ae3278277 Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-144322176 Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a1c89e4b67024f91ae460e3ae3278277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1c89e4b67024f91ae460e3ae3278277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a1c89e4b67024f91ae460e3ae3278277", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1c89e4b67024f91ae460e3ae3278277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-144322176 Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: a1c89e4b67024f91ae460e3ae3278277 Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-144322176 Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-LiveAutoBlockMigrationV225Test-144322176-project Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c73a9daf485b421c8244f287fee5a942 Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-144322176-project Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 60d948f3-a6a5-46cb-b716-79eaf55ff690 could not be found. Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '60d948f3-a6a5-46cb-b716-79eaf55ff690'} Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d948f3-a6a5-46cb-b716-79eaf55ff690 could not be found. Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d948f3-a6a5-46cb-b716-79eaf55ff690 could not be found. Oct 27 18:53:13.135558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:13.140247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:13.140247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:13.140247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:13.140247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:13.140247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:13.140247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:13.140247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:13.140247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d948f3-a6a5-46cb-b716-79eaf55ff690 could not be found. Oct 27 18:53:13.140247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:13.140247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-50f3e516-7699-4b78-b731-6cd2aa8d25d8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Returning 404 to user: Instance 60d948f3-a6a5-46cb-b716-79eaf55ff690 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:13.142758 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-50f3e516-7699-4b78-b731-6cd2aa8d25d8 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690" status: 404 len: 111 microversion: 2.25 time: 0.161302 Oct 27 18:53:13.142758 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 967/1963] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:12 2022] GET /compute/v2.1/servers/60d948f3-a6a5-46cb-b716-79eaf55ff690 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:53:13.259530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Getting quotas for project dfd09ac8cf7a4b809a996cdebb20d76e. Resources: dict_keys(['metadata_items']) {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:53:13.296145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Getting quotas for user e5d15a9c4f714dd6a6764b5a431c27d6 and project dfd09ac8cf7a4b809a996cdebb20d76e. Resources: dict_keys(['metadata_items']) {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:53:13.379798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:53:13.384206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:53:13.388853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:53:13.389435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:53:13.392752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:53:13.436841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:13.441170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:13.441771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:13.449318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:13.450981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:13.454106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:13.552376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Getting quotas for project dfd09ac8cf7a4b809a996cdebb20d76e. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:53:13.571307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0e5d0ff5-4f64-4622-9326-9a74ef3a7f19 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:13.576872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e5d0ff5-4f64-4622-9326-9a74ef3a7f19 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:13.578021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e5d0ff5-4f64-4622-9326-9a74ef3a7f19 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:13.578981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e5d0ff5-4f64-4622-9326-9a74ef3a7f19 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:13.579994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e5d0ff5-4f64-4622-9326-9a74ef3a7f19 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:13.580734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e5d0ff5-4f64-4622-9326-9a74ef3a7f19 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:13.581459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e5d0ff5-4f64-4622-9326-9a74ef3a7f19 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:13.588602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Getting quotas for user e5d15a9c4f714dd6a6764b5a431c27d6 and project dfd09ac8cf7a4b809a996cdebb20d76e. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:53:13.618648 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0e5d0ff5-4f64-4622-9326-9a74ef3a7f19 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.475652 Oct 27 18:53:13.619934 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 968/1964] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:53:13 2022] GET /compute/v2.1/os-services => generated 944 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:13.633708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-68af6a16-0215-481f-bd8a-1d6f7a4b8484 req-bd403319-7849-4104-8230-0f123cb4cba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cba4e9-98d0-4048-ba3c-362d01b321e6", "name": "network-vif-deleted", "tag": "093e7ae1-f1cf-4870-b6e1-49be73664937"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:13.649288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-68af6a16-0215-481f-bd8a-1d6f7a4b8484 req-bd403319-7849-4104-8230-0f123cb4cba2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:13.649936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-68af6a16-0215-481f-bd8a-1d6f7a4b8484 req-bd403319-7849-4104-8230-0f123cb4cba2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:13.650416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-68af6a16-0215-481f-bd8a-1d6f7a4b8484 req-bd403319-7849-4104-8230-0f123cb4cba2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:13.664854 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-68af6a16-0215-481f-bd8a-1d6f7a4b8484 req-bd403319-7849-4104-8230-0f123cb4cba2 service nova] Creating event network-vif-deleted:093e7ae1-f1cf-4870-b6e1-49be73664937 for instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 on n-h1-860687-3 Oct 27 18:53:13.670568 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-68af6a16-0215-481f-bd8a-1d6f7a4b8484 req-bd403319-7849-4104-8230-0f123cb4cba2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045821 Oct 27 18:53:13.711075 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 969/1965] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:13.740208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-50a66647-caf6-479d-99b8-d1cc59c50e5e tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:13.742284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-50a66647-caf6-479d-99b8-d1cc59c50e5e tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:13.755167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50a66647-caf6-479d-99b8-d1cc59c50e5e tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:13.755894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50a66647-caf6-479d-99b8-d1cc59c50e5e tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:13.756512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50a66647-caf6-479d-99b8-d1cc59c50e5e tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:13.757752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50a66647-caf6-479d-99b8-d1cc59c50e5e tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:13.758428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50a66647-caf6-479d-99b8-d1cc59c50e5e tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:13.759037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50a66647-caf6-479d-99b8-d1cc59c50e5e tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:13.790616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:13.811655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:53:13.815705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45a7f07f-ee2a-4ef4-b0e8-7c03c3189d11',volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:53:14.165103 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cf1d4ea0-c66a-46d5-a20b-2de1fc77eb89 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.916884 Oct 27 18:53:14.172786 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 997/1966] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:53:11 2022] POST /compute/v2.1/servers => generated 407 bytes in 2924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:53:14.189052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d640a3a2-aaba-48cc-b35b-7b97d13427f2 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:14.228272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d640a3a2-aaba-48cc-b35b-7b97d13427f2 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:14.228764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d640a3a2-aaba-48cc-b35b-7b97d13427f2 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:14.229211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d640a3a2-aaba-48cc-b35b-7b97d13427f2 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:14.229951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d640a3a2-aaba-48cc-b35b-7b97d13427f2 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:14.256577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d640a3a2-aaba-48cc-b35b-7b97d13427f2 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:14.258257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d640a3a2-aaba-48cc-b35b-7b97d13427f2 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:14.384615 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d640a3a2-aaba-48cc-b35b-7b97d13427f2 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=n-d-860687-3" status: 200 len: 578 microversion: 2.1 time: 0.209131 Oct 27 18:53:14.397635 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 998/1967] 10.222.0.42 () {58 vars in 1172 bytes} [Thu Oct 27 18:53:14 2022] GET /compute/v2.1/os-services?host=n-d-860687-3 => generated 578 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:14.427555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-75dff8d9-9161-4c37-8d89-1456290c913e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:14.433715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-75dff8d9-9161-4c37-8d89-1456290c913e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:14.455312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75dff8d9-9161-4c37-8d89-1456290c913e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:14.458066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75dff8d9-9161-4c37-8d89-1456290c913e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:14.461305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75dff8d9-9161-4c37-8d89-1456290c913e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:14.462636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75dff8d9-9161-4c37-8d89-1456290c913e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:14.466541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75dff8d9-9161-4c37-8d89-1456290c913e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:14.469120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75dff8d9-9161-4c37-8d89-1456290c913e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:14.524830 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-75dff8d9-9161-4c37-8d89-1456290c913e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] HTTP exception thrown: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-75dff8d9-9161-4c37-8d89-1456290c913e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Request method failure captured: Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 HTTP/1.1 Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtMeeRths5L55mBhO8XlAumcRl4mkQ1GuA7ZOv_qc2iBuWncYJIGTMjzUnWnV8EbVS9b6dJoJGKKelPDVaXInbDvaoYdebdMZSIOZOInbFaFLtPdYOVwEHh-aQiNviNGYr868yrixAnbm3oP_cdtr7WPDuWGYs3lGWgBt_B8ojRgXNI Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 05e6f4807fd34f6d9422bc06ee20cb10 Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05e6f4807fd34f6d9422bc06ee20cb10", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 05e6f4807fd34f6d9422bc06ee20cb10 Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestMultiNic-814031626-project Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: f657dcabf43141b584416d2597efb5cb Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestMultiNic-814031626-project Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '38cba4e9-98d0-4048-ba3c-362d01b321e6'} Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:14.531530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:14.537926 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:14.537926 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:14.537926 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:14.537926 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:14.537926 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:14.537926 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:14.537926 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:14.537926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-75dff8d9-9161-4c37-8d89-1456290c913e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Returning 404 to user: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:14.537926 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-75dff8d9-9161-4c37-8d89-1456290c913e tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 404 len: 111 microversion: 2.1 time: 0.119800 Oct 27 18:53:14.537926 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 999/1968] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:14 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:53:14.579099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-37236281-3f03-4e98-b361-84856cfef35a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b007430>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:14.723781 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-37236281-3f03-4e98-b361-84856cfef35a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.189126 Oct 27 18:53:14.724382 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1000/1969] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:14 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:14.758092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a4af86b1-5ea3-455a-ba90-3c73b49c0de2 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:14.763306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a4af86b1-5ea3-455a-ba90-3c73b49c0de2 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:15.057175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a4af86b1-5ea3-455a-ba90-3c73b49c0de2 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:15.065526 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a4af86b1-5ea3-455a-ba90-3c73b49c0de2 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1122 microversion: 2.1 time: 0.331129 Oct 27 18:53:15.068324 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1001/1970] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:14 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1122 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:15.088977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-805cae09-c5f6-4871-aa53-4beb6fe8191f tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:15.106441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-805cae09-c5f6-4871-aa53-4beb6fe8191f tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:15.107011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-805cae09-c5f6-4871-aa53-4beb6fe8191f tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:15.107472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-805cae09-c5f6-4871-aa53-4beb6fe8191f tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:15.113780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-805cae09-c5f6-4871-aa53-4beb6fe8191f tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:15.114378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-805cae09-c5f6-4871-aa53-4beb6fe8191f tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:15.114871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-805cae09-c5f6-4871-aa53-4beb6fe8191f tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:15.173918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:15.196590 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-805cae09-c5f6-4871-aa53-4beb6fe8191f tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.121922 Oct 27 18:53:15.199780 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1002/1971] 10.222.0.42 () {58 vars in 1176 bytes} [Thu Oct 27 18:53:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:15.224851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-324000e2-5e29-434e-9b53-db989bc7dd40 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:15.240785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-324000e2-5e29-434e-9b53-db989bc7dd40 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:15.241651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-324000e2-5e29-434e-9b53-db989bc7dd40 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:15.244235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-324000e2-5e29-434e-9b53-db989bc7dd40 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:15.245686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-324000e2-5e29-434e-9b53-db989bc7dd40 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:15.246408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-324000e2-5e29-434e-9b53-db989bc7dd40 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:15.247180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-324000e2-5e29-434e-9b53-db989bc7dd40 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:15.378580 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-324000e2-5e29-434e-9b53-db989bc7dd40 tempest-ServicesAdminTestJSON-1366081082 tempest-ServicesAdminTestJSON-1366081082-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.166563 Oct 27 18:53:15.386592 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1003/1972] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:53:15 2022] GET /compute/v2.1/os-services => generated 944 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:15.436062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-47ef85fe-f3ec-4ab2-9637-2f077b536d9a req-94ad06bb-60e4-4096-a43c-bb08c226b4cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0556339c-0d41-460d-945e-c3b5a95bccfe", "name": "network-vif-plugged", "status": "completed", "tag": "f9f631d4-05dd-4e90-8742-f18d221abce2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:15.490589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-47ef85fe-f3ec-4ab2-9637-2f077b536d9a req-94ad06bb-60e4-4096-a43c-bb08c226b4cb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:15.500357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-47ef85fe-f3ec-4ab2-9637-2f077b536d9a req-94ad06bb-60e4-4096-a43c-bb08c226b4cb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:15.504451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-47ef85fe-f3ec-4ab2-9637-2f077b536d9a req-94ad06bb-60e4-4096-a43c-bb08c226b4cb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:15.562041 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-47ef85fe-f3ec-4ab2-9637-2f077b536d9a req-94ad06bb-60e4-4096-a43c-bb08c226b4cb service nova] Creating event network-vif-plugged:f9f631d4-05dd-4e90-8742-f18d221abce2 for instance 0556339c-0d41-460d-945e-c3b5a95bccfe on n-h2-860687-3 Oct 27 18:53:15.605085 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-47ef85fe-f3ec-4ab2-9637-2f077b536d9a req-94ad06bb-60e4-4096-a43c-bb08c226b4cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213349 Oct 27 18:53:15.605698 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1004/1973] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:15.742993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cfb6622d-ab01-4266-81c6-b0397951df60 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b183b80>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:15.903390 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cfb6622d-ab01-4266-81c6-b0397951df60 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.166538 Oct 27 18:53:15.904064 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1005/1974] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:15 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:16.096508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4143fa8e-0e18-4012-803c-eb5bf1f726d8 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:16.097254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4143fa8e-0e18-4012-803c-eb5bf1f726d8 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:16.127549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4143fa8e-0e18-4012-803c-eb5bf1f726d8 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:16.128962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4143fa8e-0e18-4012-803c-eb5bf1f726d8 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:16.133492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4143fa8e-0e18-4012-803c-eb5bf1f726d8 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:16.134551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4143fa8e-0e18-4012-803c-eb5bf1f726d8 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:16.137133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4143fa8e-0e18-4012-803c-eb5bf1f726d8 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:16.142286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4143fa8e-0e18-4012-803c-eb5bf1f726d8 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:16.167230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-50a66647-caf6-479d-99b8-d1cc59c50e5e tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:16.196387 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-50a66647-caf6-479d-99b8-d1cc59c50e5e tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe" status: 200 len: 1317 microversion: 2.1 time: 2.482872 Oct 27 18:53:16.205569 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 970/1975] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:13 2022] GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe => generated 1317 bytes in 2493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:16.421685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4143fa8e-0e18-4012-803c-eb5bf1f726d8 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:16.436729 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4143fa8e-0e18-4012-803c-eb5bf1f726d8 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1220 microversion: 2.1 time: 0.344744 Oct 27 18:53:16.437336 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1006/1976] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:16 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1220 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:16.923902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a4988fb3-b961-4cf6-804a-1109afaee3f0 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc8733bd790>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:17.050015 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a4988fb3-b961-4cf6-804a-1109afaee3f0 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.131369 Oct 27 18:53:17.051405 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 971/1977] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:16 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:17.226742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a64a003-5324-452c-8f0c-3f33e872ee9c tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:17.232713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1a64a003-5324-452c-8f0c-3f33e872ee9c tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:17.265947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a64a003-5324-452c-8f0c-3f33e872ee9c tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:17.269050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a64a003-5324-452c-8f0c-3f33e872ee9c tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:17.269797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a64a003-5324-452c-8f0c-3f33e872ee9c tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:17.271787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a64a003-5324-452c-8f0c-3f33e872ee9c tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:17.274873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a64a003-5324-452c-8f0c-3f33e872ee9c tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:17.277689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a64a003-5324-452c-8f0c-3f33e872ee9c tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:17.464428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d8e46f0a-52f4-42dc-865c-09cc05f3b890 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:17.465791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d8e46f0a-52f4-42dc-865c-09cc05f3b890 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:17.477105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8e46f0a-52f4-42dc-865c-09cc05f3b890 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:17.483176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8e46f0a-52f4-42dc-865c-09cc05f3b890 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:17.484001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8e46f0a-52f4-42dc-865c-09cc05f3b890 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:17.485005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8e46f0a-52f4-42dc-865c-09cc05f3b890 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:17.485843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8e46f0a-52f4-42dc-865c-09cc05f3b890 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:17.486639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8e46f0a-52f4-42dc-865c-09cc05f3b890 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:17.821883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d8e46f0a-52f4-42dc-865c-09cc05f3b890 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:17.839190 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d8e46f0a-52f4-42dc-865c-09cc05f3b890 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1238 microversion: 2.1 time: 0.379353 Oct 27 18:53:17.844696 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 972/1978] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:17 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1238 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:18.066538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9c0ef85-c793-45ab-b52c-0d5a8b48e6fc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873387940>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:18.165329 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d9c0ef85-c793-45ab-b52c-0d5a8b48e6fc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.102777 Oct 27 18:53:18.172849 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 973/1979] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:18 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:18.188474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-45969988-c3b2-45fe-aac4-da43f44e7efa tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:18.195136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-45969988-c3b2-45fe-aac4-da43f44e7efa tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:18.224453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45969988-c3b2-45fe-aac4-da43f44e7efa tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:18.235346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45969988-c3b2-45fe-aac4-da43f44e7efa tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:18.236091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45969988-c3b2-45fe-aac4-da43f44e7efa tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:18.237074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45969988-c3b2-45fe-aac4-da43f44e7efa tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:18.237721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45969988-c3b2-45fe-aac4-da43f44e7efa tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:18.238354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45969988-c3b2-45fe-aac4-da43f44e7efa tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:18.321640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-45969988-c3b2-45fe-aac4-da43f44e7efa tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:53:18.608685 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-45969988-c3b2-45fe-aac4-da43f44e7efa tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 204 len: 0 microversion: 2.1 time: 0.431983 Oct 27 18:53:18.611703 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 974/1980] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:53:18 2022] DELETE /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:53:18.629989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7edb4108-18df-4db3-b9a2-3b99988f4159 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:18.635378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7edb4108-18df-4db3-b9a2-3b99988f4159 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:18.657640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edb4108-18df-4db3-b9a2-3b99988f4159 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:18.661979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edb4108-18df-4db3-b9a2-3b99988f4159 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:18.664278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edb4108-18df-4db3-b9a2-3b99988f4159 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:18.669629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edb4108-18df-4db3-b9a2-3b99988f4159 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:18.671596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edb4108-18df-4db3-b9a2-3b99988f4159 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:18.672379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edb4108-18df-4db3-b9a2-3b99988f4159 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:19.272078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7edb4108-18df-4db3-b9a2-3b99988f4159 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:19.285400 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7edb4108-18df-4db3-b9a2-3b99988f4159 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1684 microversion: 2.1 time: 0.666446 Oct 27 18:53:19.294881 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 975/1981] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:18 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1684 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:19.307117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b51f5e0e-3669-4c6e-9e15-4e0f4f684bc2 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:19.307751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b51f5e0e-3669-4c6e-9e15-4e0f4f684bc2 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:19.316242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b51f5e0e-3669-4c6e-9e15-4e0f4f684bc2 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:19.319068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b51f5e0e-3669-4c6e-9e15-4e0f4f684bc2 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:19.323348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b51f5e0e-3669-4c6e-9e15-4e0f4f684bc2 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:19.324348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b51f5e0e-3669-4c6e-9e15-4e0f4f684bc2 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:19.325017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b51f5e0e-3669-4c6e-9e15-4e0f4f684bc2 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:19.325768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b51f5e0e-3669-4c6e-9e15-4e0f4f684bc2 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:19.597402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b51f5e0e-3669-4c6e-9e15-4e0f4f684bc2 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:19.638982 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b51f5e0e-3669-4c6e-9e15-4e0f4f684bc2 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1238 microversion: 2.1 time: 0.342786 Oct 27 18:53:19.650600 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 976/1982] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:19 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1238 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:19.667566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d5f4a53-4384-41e8-9d40-8bea2dc28fa3 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc8733975e0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:19.796788 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d5f4a53-4384-41e8-9d40-8bea2dc28fa3 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.156107 Oct 27 18:53:19.797386 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 977/1983] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:19 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:20.313619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d4e65bc-cb8e-4b12-8b84-255acd9a6c96 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:20.314564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0d4e65bc-cb8e-4b12-8b84-255acd9a6c96 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:20.329802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d4e65bc-cb8e-4b12-8b84-255acd9a6c96 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:20.333330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d4e65bc-cb8e-4b12-8b84-255acd9a6c96 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:20.334102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d4e65bc-cb8e-4b12-8b84-255acd9a6c96 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:20.335684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d4e65bc-cb8e-4b12-8b84-255acd9a6c96 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:20.338660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d4e65bc-cb8e-4b12-8b84-255acd9a6c96 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:20.339636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d4e65bc-cb8e-4b12-8b84-255acd9a6c96 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:20.450652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1a64a003-5324-452c-8f0c-3f33e872ee9c tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:20.463205 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1a64a003-5324-452c-8f0c-3f33e872ee9c tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe" status: 200 len: 1317 microversion: 2.1 time: 3.241967 Oct 27 18:53:20.463802 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1007/1984] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:17 2022] GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe => generated 1317 bytes in 3243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:20.665915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9632ad9d-a356-4ae5-a4f2-1738911ee592 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:20.666913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9632ad9d-a356-4ae5-a4f2-1738911ee592 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:20.692096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9632ad9d-a356-4ae5-a4f2-1738911ee592 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:20.694209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9632ad9d-a356-4ae5-a4f2-1738911ee592 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:20.699231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9632ad9d-a356-4ae5-a4f2-1738911ee592 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:20.705869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9632ad9d-a356-4ae5-a4f2-1738911ee592 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:20.709431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9632ad9d-a356-4ae5-a4f2-1738911ee592 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:20.712052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9632ad9d-a356-4ae5-a4f2-1738911ee592 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:20.996739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9632ad9d-a356-4ae5-a4f2-1738911ee592 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:21.007587 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9632ad9d-a356-4ae5-a4f2-1738911ee592 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1238 microversion: 2.1 time: 0.346056 Oct 27 18:53:21.012816 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1008/1985] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:20 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1238 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:21.017985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-2fba3c82-63d0-493d-8e28-bd919375a906 req-52f34f0a-f237-43cb-8a7c-6ef8616e4485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50aa2e14-0b49-4eb7-af7b-79582409b298", "name": "network-vif-plugged", "status": "completed", "tag": "eaf4cd8a-cd39-427d-bd80-9e251b91623b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:21.046558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2fba3c82-63d0-493d-8e28-bd919375a906 req-52f34f0a-f237-43cb-8a7c-6ef8616e4485 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:21.047365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2fba3c82-63d0-493d-8e28-bd919375a906 req-52f34f0a-f237-43cb-8a7c-6ef8616e4485 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:21.047992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2fba3c82-63d0-493d-8e28-bd919375a906 req-52f34f0a-f237-43cb-8a7c-6ef8616e4485 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:21.090813 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-2fba3c82-63d0-493d-8e28-bd919375a906 req-52f34f0a-f237-43cb-8a7c-6ef8616e4485 service nova] Creating event network-vif-plugged:eaf4cd8a-cd39-427d-bd80-9e251b91623b for instance 50aa2e14-0b49-4eb7-af7b-79582409b298 on n-h2-860687-3 Oct 27 18:53:21.118077 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-2fba3c82-63d0-493d-8e28-bd919375a906 req-52f34f0a-f237-43cb-8a7c-6ef8616e4485 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100826 Oct 27 18:53:21.119097 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1009/1986] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:21.136496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0db26bf4-4a41-48b6-8d66-29a1515edaa1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a7d1dc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:21.252247 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0db26bf4-4a41-48b6-8d66-29a1515edaa1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.129480 Oct 27 18:53:21.253204 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1010/1987] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:21 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:21.490034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f2e2079e-3b49-4e50-bd16-0a00832c7603 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:21.491716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f2e2079e-3b49-4e50-bd16-0a00832c7603 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:21.511149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2e2079e-3b49-4e50-bd16-0a00832c7603 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:21.512491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2e2079e-3b49-4e50-bd16-0a00832c7603 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:21.513509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2e2079e-3b49-4e50-bd16-0a00832c7603 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:21.515957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2e2079e-3b49-4e50-bd16-0a00832c7603 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:21.517852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2e2079e-3b49-4e50-bd16-0a00832c7603 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:21.518569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2e2079e-3b49-4e50-bd16-0a00832c7603 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:21.828836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0d4e65bc-cb8e-4b12-8b84-255acd9a6c96 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:21.847567 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d4e65bc-cb8e-4b12-8b84-255acd9a6c96 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1684 microversion: 2.1 time: 1.538786 Oct 27 18:53:21.852185 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 978/1988] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:20 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1684 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:22.041201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b123d944-5591-45d5-8805-3b3a8332a4d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:22.042134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b123d944-5591-45d5-8805-3b3a8332a4d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:22.064944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b123d944-5591-45d5-8805-3b3a8332a4d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:22.067130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b123d944-5591-45d5-8805-3b3a8332a4d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:22.068848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b123d944-5591-45d5-8805-3b3a8332a4d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:22.075014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b123d944-5591-45d5-8805-3b3a8332a4d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:22.080558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b123d944-5591-45d5-8805-3b3a8332a4d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:22.084614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b123d944-5591-45d5-8805-3b3a8332a4d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:22.425325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b123d944-5591-45d5-8805-3b3a8332a4d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:22.445169 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b123d944-5591-45d5-8805-3b3a8332a4d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1238 microversion: 2.1 time: 0.408206 Oct 27 18:53:22.455205 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 979/1989] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:22 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1238 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:22.465454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4e93f602-43d5-496d-ae3f-a0c382dd546e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873368430>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:22.578608 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4e93f602-43d5-496d-ae3f-a0c382dd546e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.120474 Oct 27 18:53:22.587267 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 980/1990] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:22 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:22.618461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f2e2079e-3b49-4e50-bd16-0a00832c7603 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:22.629839 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f2e2079e-3b49-4e50-bd16-0a00832c7603 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe" status: 200 len: 1505 microversion: 2.1 time: 1.146797 Oct 27 18:53:22.639993 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1011/1991] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:21 2022] GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe => generated 1505 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:22.664918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-29259bcb-b116-4b54-9d01-89ba5b4b728f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:22.665553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-29259bcb-b116-4b54-9d01-89ba5b4b728f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 50aa2e14-0b49-4eb7-af7b-79582409b298] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:22.677169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29259bcb-b116-4b54-9d01-89ba5b4b728f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:22.677598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29259bcb-b116-4b54-9d01-89ba5b4b728f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:22.678051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29259bcb-b116-4b54-9d01-89ba5b4b728f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:22.690574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29259bcb-b116-4b54-9d01-89ba5b4b728f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:22.691091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29259bcb-b116-4b54-9d01-89ba5b4b728f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:22.691558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29259bcb-b116-4b54-9d01-89ba5b4b728f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:22.877684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6dfe9ac8-5a21-46ac-8253-280cfb9d5172 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:22.878533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6dfe9ac8-5a21-46ac-8253-280cfb9d5172 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:22.889247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6dfe9ac8-5a21-46ac-8253-280cfb9d5172 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:22.900724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6dfe9ac8-5a21-46ac-8253-280cfb9d5172 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:22.901363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6dfe9ac8-5a21-46ac-8253-280cfb9d5172 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:22.902255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6dfe9ac8-5a21-46ac-8253-280cfb9d5172 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:22.902891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6dfe9ac8-5a21-46ac-8253-280cfb9d5172 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:22.903621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6dfe9ac8-5a21-46ac-8253-280cfb9d5172 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:23.598157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:23.963904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-29259bcb-b116-4b54-9d01-89ba5b4b728f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:23.980492 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-29259bcb-b116-4b54-9d01-89ba5b4b728f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298" status: 200 len: 1317 microversion: 2.1 time: 1.320586 Oct 27 18:53:24.023486 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 981/1992] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:22 2022] GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298 => generated 1317 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:24.030494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e7ce6429-b4de-4ed4-ad53-2ca15608ee2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:24.035216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e7ce6429-b4de-4ed4-ad53-2ca15608ee2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:24.074490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7ce6429-b4de-4ed4-ad53-2ca15608ee2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:24.075030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7ce6429-b4de-4ed4-ad53-2ca15608ee2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:24.075499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7ce6429-b4de-4ed4-ad53-2ca15608ee2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:24.076276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7ce6429-b4de-4ed4-ad53-2ca15608ee2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:24.076751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7ce6429-b4de-4ed4-ad53-2ca15608ee2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:24.077196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7ce6429-b4de-4ed4-ad53-2ca15608ee2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:24.138607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e7ce6429-b4de-4ed4-ad53-2ca15608ee2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:53:24.176953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6dfe9ac8-5a21-46ac-8253-280cfb9d5172 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:24.192733 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6dfe9ac8-5a21-46ac-8253-280cfb9d5172 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1684 microversion: 2.1 time: 1.312611 Oct 27 18:53:24.208939 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1012/1993] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:22 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1684 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:24.208939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-50572100-a5a9-4add-8bd0-bbab0ff818a6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:24.208939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-50572100-a5a9-4add-8bd0-bbab0ff818a6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:24.234430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50572100-a5a9-4add-8bd0-bbab0ff818a6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:24.234936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50572100-a5a9-4add-8bd0-bbab0ff818a6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:24.235387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50572100-a5a9-4add-8bd0-bbab0ff818a6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:24.236113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50572100-a5a9-4add-8bd0-bbab0ff818a6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:24.236575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50572100-a5a9-4add-8bd0-bbab0ff818a6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:24.237009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50572100-a5a9-4add-8bd0-bbab0ff818a6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:24.394712 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e7ce6429-b4de-4ed4-ad53-2ca15608ee2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "DELETE /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 204 len: 0 microversion: 2.25 time: 0.384708 Oct 27 18:53:24.398630 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 982/1994] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:53:24 2022] DELETE /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 18:53:24.424986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1ab56b1c-a84f-43b5-8523-a5e8d6a55837 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc8733668b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:24.512347 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1ab56b1c-a84f-43b5-8523-a5e8d6a55837 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.113839 Oct 27 18:53:24.516682 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 983/1995] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:24 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:24.529811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-58579693-f477-4899-9264-c6ce74b73b2c req-7dba3132-2185-4662-af6d-4ded56c7051b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e561b8d1-1362-4ae7-8578-5971e739c9e1", "name": "network-vif-deleted", "tag": "59ff7efa-692b-4e01-9413-347f3012718e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:24.592248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-58579693-f477-4899-9264-c6ce74b73b2c req-7dba3132-2185-4662-af6d-4ded56c7051b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:24.592985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-58579693-f477-4899-9264-c6ce74b73b2c req-7dba3132-2185-4662-af6d-4ded56c7051b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:24.593590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-58579693-f477-4899-9264-c6ce74b73b2c req-7dba3132-2185-4662-af6d-4ded56c7051b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:24.620661 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-58579693-f477-4899-9264-c6ce74b73b2c req-7dba3132-2185-4662-af6d-4ded56c7051b service nova] Creating event network-vif-deleted:59ff7efa-692b-4e01-9413-347f3012718e for instance e561b8d1-1362-4ae7-8578-5971e739c9e1 on n-h2-860687-3 Oct 27 18:53:24.634467 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-58579693-f477-4899-9264-c6ce74b73b2c req-7dba3132-2185-4662-af6d-4ded56c7051b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111402 Oct 27 18:53:24.635210 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 984/1996] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:24.646863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ab64e73-89a4-4da8-a332-d90c9fc7b69f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:24.649305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3ab64e73-89a4-4da8-a332-d90c9fc7b69f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:24.660085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ab64e73-89a4-4da8-a332-d90c9fc7b69f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:24.660918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ab64e73-89a4-4da8-a332-d90c9fc7b69f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:24.661614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ab64e73-89a4-4da8-a332-d90c9fc7b69f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:24.662741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ab64e73-89a4-4da8-a332-d90c9fc7b69f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:24.663651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ab64e73-89a4-4da8-a332-d90c9fc7b69f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:24.664307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ab64e73-89a4-4da8-a332-d90c9fc7b69f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:25.047307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ab64e73-89a4-4da8-a332-d90c9fc7b69f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:25.056536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ab64e73-89a4-4da8-a332-d90c9fc7b69f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:25.065118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=48 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:25.075641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ab64e73-89a4-4da8-a332-d90c9fc7b69f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:25.077297 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3ab64e73-89a4-4da8-a332-d90c9fc7b69f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1728 microversion: 2.25 time: 0.440684 Oct 27 18:53:25.080314 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 985/1997] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:24 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1728 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:25.102215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-56d0cc4a-f8dc-43ea-8cda-196d1ed41ac9 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:25.106403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-56d0cc4a-f8dc-43ea-8cda-196d1ed41ac9 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 50aa2e14-0b49-4eb7-af7b-79582409b298] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:25.137910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d0cc4a-f8dc-43ea-8cda-196d1ed41ac9 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:25.142013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d0cc4a-f8dc-43ea-8cda-196d1ed41ac9 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:25.144446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d0cc4a-f8dc-43ea-8cda-196d1ed41ac9 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:25.145255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d0cc4a-f8dc-43ea-8cda-196d1ed41ac9 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:25.150118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d0cc4a-f8dc-43ea-8cda-196d1ed41ac9 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:25.156043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d0cc4a-f8dc-43ea-8cda-196d1ed41ac9 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:25.263260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=18 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:25.635836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-50572100-a5a9-4add-8bd0-bbab0ff818a6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:25.654511 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-50572100-a5a9-4add-8bd0-bbab0ff818a6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1306 microversion: 2.1 time: 1.457483 Oct 27 18:53:25.662267 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1013/1998] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:24 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1306 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:25.689373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-30ef8208-67db-412f-a2a9-c04e138e1841 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:25.711549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-30ef8208-67db-412f-a2a9-c04e138e1841 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:25.735462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-56d0cc4a-f8dc-43ea-8cda-196d1ed41ac9 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:25.744729 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-56d0cc4a-f8dc-43ea-8cda-196d1ed41ac9 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298" status: 200 len: 1504 microversion: 2.1 time: 0.663013 Oct 27 18:53:25.752362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef8208-67db-412f-a2a9-c04e138e1841 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:25.752857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef8208-67db-412f-a2a9-c04e138e1841 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:25.753307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef8208-67db-412f-a2a9-c04e138e1841 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:25.754030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef8208-67db-412f-a2a9-c04e138e1841 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:25.758342 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 986/1999] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:25 2022] GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298 => generated 1504 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:25.765454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef8208-67db-412f-a2a9-c04e138e1841 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:25.765931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef8208-67db-412f-a2a9-c04e138e1841 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:25.775930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-69c6bbf3-c75b-4b00-806b-fa5b9df3ca2f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc8733668b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:25.956230 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-69c6bbf3-c75b-4b00-806b-fa5b9df3ca2f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.196554 Oct 27 18:53:25.957140 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 987/2000] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:25 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:25.969436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1bdc200e-d646-460f-85fb-d96e7efeedd8 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:25.969948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1bdc200e-d646-460f-85fb-d96e7efeedd8 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 50aa2e14-0b49-4eb7-af7b-79582409b298] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:25.981186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef8208-67db-412f-a2a9-c04e138e1841 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:25.995674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bdc200e-d646-460f-85fb-d96e7efeedd8 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:26.000352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bdc200e-d646-460f-85fb-d96e7efeedd8 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:26.004060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bdc200e-d646-460f-85fb-d96e7efeedd8 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:26.005021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bdc200e-d646-460f-85fb-d96e7efeedd8 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:26.005519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bdc200e-d646-460f-85fb-d96e7efeedd8 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:26.005929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef8208-67db-412f-a2a9-c04e138e1841 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:26.006033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bdc200e-d646-460f-85fb-d96e7efeedd8 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:26.007498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ef8208-67db-412f-a2a9-c04e138e1841 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:26.012892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-30ef8208-67db-412f-a2a9-c04e138e1841 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lazy-loading 'fault' on Instance uuid e561b8d1-1362-4ae7-8578-5971e739c9e1 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:53:26.110003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1bdc200e-d646-460f-85fb-d96e7efeedd8 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 50aa2e14-0b49-4eb7-af7b-79582409b298] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:53:26.287797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:26.364375 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1bdc200e-d646-460f-85fb-d96e7efeedd8 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "DELETE /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298" status: 204 len: 0 microversion: 2.1 time: 0.405851 Oct 27 18:53:26.368727 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 988/2001] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:53:25 2022] DELETE /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:53:26.382492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5924ed38-85e8-41a1-bbd2-d8b04dc35a5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:26.383254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5924ed38-85e8-41a1-bbd2-d8b04dc35a5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:26.403445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5924ed38-85e8-41a1-bbd2-d8b04dc35a5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:26.403960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5924ed38-85e8-41a1-bbd2-d8b04dc35a5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:26.404416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5924ed38-85e8-41a1-bbd2-d8b04dc35a5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:26.406758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5924ed38-85e8-41a1-bbd2-d8b04dc35a5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:26.407468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5924ed38-85e8-41a1-bbd2-d8b04dc35a5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:26.421553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5924ed38-85e8-41a1-bbd2-d8b04dc35a5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:26.669011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-30ef8208-67db-412f-a2a9-c04e138e1841 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878d41625de6498283fde8fb05a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366d94ed2eb14e759c191e32c65b187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:26.690718 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-30ef8208-67db-412f-a2a9-c04e138e1841 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 200 len: 1332 microversion: 2.1 time: 1.025560 Oct 27 18:53:26.691329 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1014/2002] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:25 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 1332 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:26.744339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-691dcf00-4c00-4327-99bc-249f6af3c523 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:26.750129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-691dcf00-4c00-4327-99bc-249f6af3c523 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:26.770204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-691dcf00-4c00-4327-99bc-249f6af3c523 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:26.770872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-691dcf00-4c00-4327-99bc-249f6af3c523 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:26.787748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-691dcf00-4c00-4327-99bc-249f6af3c523 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:26.788961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-691dcf00-4c00-4327-99bc-249f6af3c523 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:26.802909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-691dcf00-4c00-4327-99bc-249f6af3c523 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:26.803912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-691dcf00-4c00-4327-99bc-249f6af3c523 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:26.892519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-691dcf00-4c00-4327-99bc-249f6af3c523 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:53:26.950373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5924ed38-85e8-41a1-bbd2-d8b04dc35a5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:26.962761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5924ed38-85e8-41a1-bbd2-d8b04dc35a5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:26.968159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5924ed38-85e8-41a1-bbd2-d8b04dc35a5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:26.971438 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5924ed38-85e8-41a1-bbd2-d8b04dc35a5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1728 microversion: 2.25 time: 0.601448 Oct 27 18:53:26.974245 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 989/2003] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:26 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1728 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:27.005616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c146665b-dadd-4008-a11c-e6c4f2fd0c81 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:27.014763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c146665b-dadd-4008-a11c-e6c4f2fd0c81 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:27.039386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=94,nova_api:UPDATE=5 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:27.041421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c146665b-dadd-4008-a11c-e6c4f2fd0c81 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:27.045775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c146665b-dadd-4008-a11c-e6c4f2fd0c81 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:27.046937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:27.049848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c146665b-dadd-4008-a11c-e6c4f2fd0c81 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:27.053159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c146665b-dadd-4008-a11c-e6c4f2fd0c81 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:27.055712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c146665b-dadd-4008-a11c-e6c4f2fd0c81 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:27.063299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c146665b-dadd-4008-a11c-e6c4f2fd0c81 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:27.210160 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-691dcf00-4c00-4327-99bc-249f6af3c523 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe" status: 204 len: 0 microversion: 2.1 time: 0.516978 Oct 27 18:53:27.219419 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1015/2004] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:53:26 2022] DELETE /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:53:27.245479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4c04b021-2f68-423d-9b99-e41493c9834d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b153940>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:27.413848 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4c04b021-2f68-423d-9b99-e41493c9834d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.180959 Oct 27 18:53:27.422642 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1016/2005] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:27 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:27.432617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5fb9c470-6976-4c20-8ee2-ffa13c38531f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:27.432617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5fb9c470-6976-4c20-8ee2-ffa13c38531f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 50aa2e14-0b49-4eb7-af7b-79582409b298] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:27.459539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb9c470-6976-4c20-8ee2-ffa13c38531f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:27.465405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb9c470-6976-4c20-8ee2-ffa13c38531f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:27.466217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb9c470-6976-4c20-8ee2-ffa13c38531f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:27.471784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb9c470-6976-4c20-8ee2-ffa13c38531f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:27.474857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb9c470-6976-4c20-8ee2-ffa13c38531f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:27.477190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb9c470-6976-4c20-8ee2-ffa13c38531f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:28.050792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c146665b-dadd-4008-a11c-e6c4f2fd0c81 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:28.061846 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c146665b-dadd-4008-a11c-e6c4f2fd0c81 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1306 microversion: 2.1 time: 1.073552 Oct 27 18:53:28.071407 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 990/2006] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:26 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1306 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:28.078069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f56089b-ac6d-4249-bcb6-ea87d970255e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:28.078978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0f56089b-ac6d-4249-bcb6-ea87d970255e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] [instance: e561b8d1-1362-4ae7-8578-5971e739c9e1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:28.088887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f56089b-ac6d-4249-bcb6-ea87d970255e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:28.093041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f56089b-ac6d-4249-bcb6-ea87d970255e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:28.093809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f56089b-ac6d-4249-bcb6-ea87d970255e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:28.094889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f56089b-ac6d-4249-bcb6-ea87d970255e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:28.095779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f56089b-ac6d-4249-bcb6-ea87d970255e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:28.101383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f56089b-ac6d-4249-bcb6-ea87d970255e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:28.134535 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-0f56089b-ac6d-4249-bcb6-ea87d970255e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] HTTP exception thrown: Instance e561b8d1-1362-4ae7-8578-5971e739c9e1 could not be found. Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f56089b-ac6d-4249-bcb6-ea87d970255e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Request method failure captured: Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 HTTP/1.1 Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtLANq_1XCqdXrMgXg1HCP060ziCly0OHtlX72FRXAe3NyMVxo4rqxSS01peLn0gtC97ll4_g2LBb00itEUbB0Kc3rSsCR6zEqCmV3pSiTxQZXRvdN2fjWKBO6Iraa2OUkhYwsLmylslLQq9Uqpo9JFUPs4Pv_1b0jVTSCn6SrLTCUs Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 366d94ed2eb14e759c191e32c65b187a Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesAdminNegativeTest-1240918187 Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/366d94ed2eb14e759c191e32c65b187a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/366d94ed2eb14e759c191e32c65b187a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_366d94ed2eb14e759c191e32c65b187a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/366d94ed2eb14e759c191e32c65b187a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-VolumesAdminNegativeTest-1240918187 Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 366d94ed2eb14e759c191e32c65b187a Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1240918187 Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-VolumesAdminNegativeTest-1240918187-project Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 878d41625de6498283fde8fb05a4bbf6 Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-VolumesAdminNegativeTest-1240918187-project Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance e561b8d1-1362-4ae7-8578-5971e739c9e1 could not be found. Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'e561b8d1-1362-4ae7-8578-5971e739c9e1'} Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e561b8d1-1362-4ae7-8578-5971e739c9e1 could not be found. Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e561b8d1-1362-4ae7-8578-5971e739c9e1 could not be found. Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:28.139780 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:28.142674 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:28.142674 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:28.142674 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:28.142674 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:28.142674 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:28.142674 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e561b8d1-1362-4ae7-8578-5971e739c9e1 could not be found. Oct 27 18:53:28.142674 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:28.145139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f56089b-ac6d-4249-bcb6-ea87d970255e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Returning 404 to user: Instance e561b8d1-1362-4ae7-8578-5971e739c9e1 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:28.146217 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0f56089b-ac6d-4249-bcb6-ea87d970255e tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1" status: 404 len: 111 microversion: 2.1 time: 0.073366 Oct 27 18:53:28.150968 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 991/2007] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:28 2022] GET /compute/v2.1/servers/e561b8d1-1362-4ae7-8578-5971e739c9e1 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:53:28.163826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e128a4c5-3fda-4b5e-b945-394965f97627 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:28.164533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e128a4c5-3fda-4b5e-b945-394965f97627 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:28.180734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e128a4c5-3fda-4b5e-b945-394965f97627 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:28.181498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e128a4c5-3fda-4b5e-b945-394965f97627 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:28.182216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e128a4c5-3fda-4b5e-b945-394965f97627 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:28.183169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e128a4c5-3fda-4b5e-b945-394965f97627 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:28.186473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e128a4c5-3fda-4b5e-b945-394965f97627 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:28.187224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e128a4c5-3fda-4b5e-b945-394965f97627 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:28.219797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5fb9c470-6976-4c20-8ee2-ffa13c38531f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:28.234842 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5fb9c470-6976-4c20-8ee2-ffa13c38531f tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298" status: 200 len: 1510 microversion: 2.1 time: 0.818773 Oct 27 18:53:28.245134 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1017/2008] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:27 2022] GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298 => generated 1510 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:28.258290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eda5d8dc-3bb7-4a5e-ba50-c0f00517af71 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] Calling method '.version_select at 0x7fc86b4be940>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:28.338320 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eda5d8dc-3bb7-4a5e-ba50-c0f00517af71 tempest-VolumesAdminNegativeTest-1240918187 tempest-VolumesAdminNegativeTest-1240918187-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357184221" status: 202 len: 0 microversion: 2.1 time: 0.089016 Oct 27 18:53:28.345073 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1018/2009] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 18:53:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357184221 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:53:28.440214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eb3389e2-e854-4bb0-883a-0ce6b417b085 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86adbfaf0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:28.515661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e128a4c5-3fda-4b5e-b945-394965f97627 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:28.528699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e128a4c5-3fda-4b5e-b945-394965f97627 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:28.535650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e128a4c5-3fda-4b5e-b945-394965f97627 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:28.538487 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e128a4c5-3fda-4b5e-b945-394965f97627 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1728 microversion: 2.25 time: 0.385100 Oct 27 18:53:28.540120 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 992/2010] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:28 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1728 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:28.548915 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eb3389e2-e854-4bb0-883a-0ce6b417b085 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.122464 Oct 27 18:53:28.549487 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1019/2011] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:28 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:29.087506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-feec1c0b-03e6-40e8-b262-8fc3d0c15786 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:29.088797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-feec1c0b-03e6-40e8-b262-8fc3d0c15786 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:29.097195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-feec1c0b-03e6-40e8-b262-8fc3d0c15786 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:29.107120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-feec1c0b-03e6-40e8-b262-8fc3d0c15786 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:29.107983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-feec1c0b-03e6-40e8-b262-8fc3d0c15786 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:29.108977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-feec1c0b-03e6-40e8-b262-8fc3d0c15786 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:29.109740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-feec1c0b-03e6-40e8-b262-8fc3d0c15786 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:29.110430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-feec1c0b-03e6-40e8-b262-8fc3d0c15786 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:29.271366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d9a8a62-a959-4731-a973-a7690d661df5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:29.274659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3d9a8a62-a959-4731-a973-a7690d661df5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 50aa2e14-0b49-4eb7-af7b-79582409b298] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:29.289765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d9a8a62-a959-4731-a973-a7690d661df5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:29.290619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d9a8a62-a959-4731-a973-a7690d661df5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:29.291281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d9a8a62-a959-4731-a973-a7690d661df5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:29.296114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d9a8a62-a959-4731-a973-a7690d661df5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:29.297346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d9a8a62-a959-4731-a973-a7690d661df5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:29.298622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d9a8a62-a959-4731-a973-a7690d661df5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:29.595069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-feec1c0b-03e6-40e8-b262-8fc3d0c15786 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:29.613064 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-feec1c0b-03e6-40e8-b262-8fc3d0c15786 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1306 microversion: 2.1 time: 0.529646 Oct 27 18:53:29.614275 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 993/2012] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:29 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1306 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:29.625350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf40309b-c46b-4087-8519-1f5f3cdb7d2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:29.626202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cf40309b-c46b-4087-8519-1f5f3cdb7d2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:29.642596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf40309b-c46b-4087-8519-1f5f3cdb7d2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:29.643617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf40309b-c46b-4087-8519-1f5f3cdb7d2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:29.644317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf40309b-c46b-4087-8519-1f5f3cdb7d2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:29.645313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf40309b-c46b-4087-8519-1f5f3cdb7d2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:29.648113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf40309b-c46b-4087-8519-1f5f3cdb7d2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:29.648843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf40309b-c46b-4087-8519-1f5f3cdb7d2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:30.032990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cf40309b-c46b-4087-8519-1f5f3cdb7d2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:30.056423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cf40309b-c46b-4087-8519-1f5f3cdb7d2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:30.057917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cf40309b-c46b-4087-8519-1f5f3cdb7d2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:30.063252 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cf40309b-c46b-4087-8519-1f5f3cdb7d2b tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1660 microversion: 2.25 time: 0.447626 Oct 27 18:53:30.065259 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 994/2013] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:29 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1660 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:30.073122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e4aae737-3f9a-463b-aa87-8a371cb78f16 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc87337c4c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:30.166640 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e4aae737-3f9a-463b-aa87-8a371cb78f16 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.100217 Oct 27 18:53:30.167632 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 995/2014] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:30 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:30.278815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3d9a8a62-a959-4731-a973-a7690d661df5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:30.279563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f38e560a-77a1-47a2-a554-d88d72027dd5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:30.280521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f38e560a-77a1-47a2-a554-d88d72027dd5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:30.291900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f38e560a-77a1-47a2-a554-d88d72027dd5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:30.292609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f38e560a-77a1-47a2-a554-d88d72027dd5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:30.293217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f38e560a-77a1-47a2-a554-d88d72027dd5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:30.293331 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3d9a8a62-a959-4731-a973-a7690d661df5 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298" status: 200 len: 1510 microversion: 2.1 time: 1.026122 Oct 27 18:53:30.295237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f38e560a-77a1-47a2-a554-d88d72027dd5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:30.299154 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1020/2015] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:29 2022] GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298 => generated 1510 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:30.299703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f38e560a-77a1-47a2-a554-d88d72027dd5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:30.300455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f38e560a-77a1-47a2-a554-d88d72027dd5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:30.340061 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-f38e560a-77a1-47a2-a554-d88d72027dd5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] HTTP exception thrown: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f38e560a-77a1-47a2-a554-d88d72027dd5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Request method failure captured: Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 HTTP/1.1 Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtMeeRths5L55mBhO8XlAumcRl4mkQ1GuA7ZOv_qc2iBuWncYJIGTMjzUnWnV8EbVS9b6dJoJGKKelPDVaXInbDvaoYdebdMZSIOZOInbFaFLtPdYOVwEHh-aQiNviNGYr868yrixAnbm3oP_cdtr7WPDuWGYs3lGWgBt_B8ojRgXNI Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 05e6f4807fd34f6d9422bc06ee20cb10 Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05e6f4807fd34f6d9422bc06ee20cb10", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 05e6f4807fd34f6d9422bc06ee20cb10 Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestMultiNic-814031626-project Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: f657dcabf43141b584416d2597efb5cb Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestMultiNic-814031626-project Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '38cba4e9-98d0-4048-ba3c-362d01b321e6'} Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:53:30.345759 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:30.349256 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:30.349256 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.349256 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:30.349256 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.349256 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:30.349256 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:30.349256 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:30.349256 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:30.349256 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:30.349256 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:30.349256 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.352960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f38e560a-77a1-47a2-a554-d88d72027dd5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Returning 404 to user: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:30.355534 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f38e560a-77a1-47a2-a554-d88d72027dd5 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "DELETE /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 404 len: 111 microversion: 2.1 time: 0.080209 Oct 27 18:53:30.360383 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 996/2016] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:53:30 2022] DELETE /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:53:30.370041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dfc5a96e-fa31-4fff-a20f-f1dc57ba06a0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:30.370982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dfc5a96e-fa31-4fff-a20f-f1dc57ba06a0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 38cba4e9-98d0-4048-ba3c-362d01b321e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:30.392913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dfc5a96e-fa31-4fff-a20f-f1dc57ba06a0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:30.393685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dfc5a96e-fa31-4fff-a20f-f1dc57ba06a0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:30.394347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dfc5a96e-fa31-4fff-a20f-f1dc57ba06a0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:30.395372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dfc5a96e-fa31-4fff-a20f-f1dc57ba06a0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:30.396055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dfc5a96e-fa31-4fff-a20f-f1dc57ba06a0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:30.396745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dfc5a96e-fa31-4fff-a20f-f1dc57ba06a0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:30.435673 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-dfc5a96e-fa31-4fff-a20f-f1dc57ba06a0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] HTTP exception thrown: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dfc5a96e-fa31-4fff-a20f-f1dc57ba06a0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Request method failure captured: Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 HTTP/1.1 Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtMeeRths5L55mBhO8XlAumcRl4mkQ1GuA7ZOv_qc2iBuWncYJIGTMjzUnWnV8EbVS9b6dJoJGKKelPDVaXInbDvaoYdebdMZSIOZOInbFaFLtPdYOVwEHh-aQiNviNGYr868yrixAnbm3oP_cdtr7WPDuWGYs3lGWgBt_B8ojRgXNI Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 05e6f4807fd34f6d9422bc06ee20cb10 Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05e6f4807fd34f6d9422bc06ee20cb10", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 05e6f4807fd34f6d9422bc06ee20cb10 Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestMultiNic-814031626-project Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: f657dcabf43141b584416d2597efb5cb Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestMultiNic-814031626-project Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '38cba4e9-98d0-4048-ba3c-362d01b321e6'} Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:30.437714 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.441509 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:30.441509 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:30.441509 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:30.441509 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:30.441509 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:30.441509 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. Oct 27 18:53:30.441509 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.448396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dfc5a96e-fa31-4fff-a20f-f1dc57ba06a0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Returning 404 to user: Instance 38cba4e9-98d0-4048-ba3c-362d01b321e6 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:30.455512 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dfc5a96e-fa31-4fff-a20f-f1dc57ba06a0 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6" status: 404 len: 111 microversion: 2.1 time: 0.090686 Oct 27 18:53:30.456800 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1021/2017] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:30 2022] GET /compute/v2.1/servers/38cba4e9-98d0-4048-ba3c-362d01b321e6 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:53:30.465872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-679a2926-41ef-4139-81fe-4cf5bf641d46 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:30.466407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-679a2926-41ef-4139-81fe-4cf5bf641d46 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:30.474098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-679a2926-41ef-4139-81fe-4cf5bf641d46 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:30.474615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-679a2926-41ef-4139-81fe-4cf5bf641d46 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:30.475067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-679a2926-41ef-4139-81fe-4cf5bf641d46 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:30.492371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-679a2926-41ef-4139-81fe-4cf5bf641d46 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:30.492886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-679a2926-41ef-4139-81fe-4cf5bf641d46 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:30.493339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-679a2926-41ef-4139-81fe-4cf5bf641d46 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:30.544794 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-679a2926-41ef-4139-81fe-4cf5bf641d46 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] HTTP exception thrown: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-679a2926-41ef-4139-81fe-4cf5bf641d46 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Request method failure captured: Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee HTTP/1.1 Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtMeeRths5L55mBhO8XlAumcRl4mkQ1GuA7ZOv_qc2iBuWncYJIGTMjzUnWnV8EbVS9b6dJoJGKKelPDVaXInbDvaoYdebdMZSIOZOInbFaFLtPdYOVwEHh-aQiNviNGYr868yrixAnbm3oP_cdtr7WPDuWGYs3lGWgBt_B8ojRgXNI Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 05e6f4807fd34f6d9422bc06ee20cb10 Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05e6f4807fd34f6d9422bc06ee20cb10", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 05e6f4807fd34f6d9422bc06ee20cb10 Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestMultiNic-814031626-project Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: f657dcabf43141b584416d2597efb5cb Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestMultiNic-814031626-project Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '577c18dd-641c-4a06-a686-f98e0900c9ee'} Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:53:30.546415 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:30.549742 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:53:30.549742 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.549742 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:30.549742 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.549742 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:30.549742 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:30.549742 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:30.549742 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:30.549742 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:30.549742 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:53:30.549742 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.549742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-679a2926-41ef-4139-81fe-4cf5bf641d46 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Returning 404 to user: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:30.556688 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-679a2926-41ef-4139-81fe-4cf5bf641d46 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "DELETE /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 404 len: 111 microversion: 2.1 time: 0.085885 Oct 27 18:53:30.557986 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 997/2018] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:53:30 2022] DELETE /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:53:30.571039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84be38c2-1eac-427f-a4ad-6d8d01fb0dc2 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:30.571838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-84be38c2-1eac-427f-a4ad-6d8d01fb0dc2 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] [instance: 577c18dd-641c-4a06-a686-f98e0900c9ee] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:30.593652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84be38c2-1eac-427f-a4ad-6d8d01fb0dc2 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:30.595875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84be38c2-1eac-427f-a4ad-6d8d01fb0dc2 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:30.596557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84be38c2-1eac-427f-a4ad-6d8d01fb0dc2 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:30.598578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84be38c2-1eac-427f-a4ad-6d8d01fb0dc2 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:30.600361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84be38c2-1eac-427f-a4ad-6d8d01fb0dc2 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:30.608596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84be38c2-1eac-427f-a4ad-6d8d01fb0dc2 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:30.635476 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-84be38c2-1eac-427f-a4ad-6d8d01fb0dc2 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] HTTP exception thrown: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:53:30.636913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-34be1503-7c46-43aa-9ee0-cd8041830cd9 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:30.637824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-34be1503-7c46-43aa-9ee0-cd8041830cd9 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84be38c2-1eac-427f-a4ad-6d8d01fb0dc2 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Request method failure captured: Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee HTTP/1.1 Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtMeeRths5L55mBhO8XlAumcRl4mkQ1GuA7ZOv_qc2iBuWncYJIGTMjzUnWnV8EbVS9b6dJoJGKKelPDVaXInbDvaoYdebdMZSIOZOInbFaFLtPdYOVwEHh-aQiNviNGYr868yrixAnbm3oP_cdtr7WPDuWGYs3lGWgBt_B8ojRgXNI Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 05e6f4807fd34f6d9422bc06ee20cb10 Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05e6f4807fd34f6d9422bc06ee20cb10", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e6f4807fd34f6d9422bc06ee20cb10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 05e6f4807fd34f6d9422bc06ee20cb10 Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestMultiNic-814031626 Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestMultiNic-814031626-project Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: f657dcabf43141b584416d2597efb5cb Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestMultiNic-814031626-project Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '577c18dd-641c-4a06-a686-f98e0900c9ee'} Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:30.642740 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.645727 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:30.645727 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:30.645727 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:30.645727 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:30.645727 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:30.645727 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. Oct 27 18:53:30.645727 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:30.650167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84be38c2-1eac-427f-a4ad-6d8d01fb0dc2 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] Returning 404 to user: Instance 577c18dd-641c-4a06-a686-f98e0900c9ee could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:30.652446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34be1503-7c46-43aa-9ee0-cd8041830cd9 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:30.654701 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-84be38c2-1eac-427f-a4ad-6d8d01fb0dc2 tempest-ServersTestMultiNic-814031626 tempest-ServersTestMultiNic-814031626-project] 10.222.0.42 "GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee" status: 404 len: 111 microversion: 2.1 time: 0.090484 Oct 27 18:53:30.655549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34be1503-7c46-43aa-9ee0-cd8041830cd9 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:30.658639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34be1503-7c46-43aa-9ee0-cd8041830cd9 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:30.659613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34be1503-7c46-43aa-9ee0-cd8041830cd9 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:30.659823 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1022/2019] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:30 2022] GET /compute/v2.1/servers/577c18dd-641c-4a06-a686-f98e0900c9ee => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:53:30.661434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34be1503-7c46-43aa-9ee0-cd8041830cd9 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:30.665708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34be1503-7c46-43aa-9ee0-cd8041830cd9 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:31.093361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f06d4689-c9d7-4933-b91b-60f11b444fe9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:31.094172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f06d4689-c9d7-4933-b91b-60f11b444fe9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:31.108500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f06d4689-c9d7-4933-b91b-60f11b444fe9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:31.109640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f06d4689-c9d7-4933-b91b-60f11b444fe9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:31.110413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f06d4689-c9d7-4933-b91b-60f11b444fe9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:31.111366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f06d4689-c9d7-4933-b91b-60f11b444fe9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:31.112387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f06d4689-c9d7-4933-b91b-60f11b444fe9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:31.113051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f06d4689-c9d7-4933-b91b-60f11b444fe9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:31.458497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f06d4689-c9d7-4933-b91b-60f11b444fe9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:31.473755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f06d4689-c9d7-4933-b91b-60f11b444fe9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:31.482028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f06d4689-c9d7-4933-b91b-60f11b444fe9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:31.483673 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f06d4689-c9d7-4933-b91b-60f11b444fe9 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1660 microversion: 2.25 time: 0.395124 Oct 27 18:53:31.489204 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1023/2020] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:31 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1660 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:31.502000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dd6a2ef6-de1b-41be-b35f-d61e340889b0 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a68f550>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:31.534641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-34be1503-7c46-43aa-9ee0-cd8041830cd9 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:31.551312 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-34be1503-7c46-43aa-9ee0-cd8041830cd9 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1306 microversion: 2.1 time: 0.919549 Oct 27 18:53:31.566826 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 998/2021] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:30 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1306 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:31.572871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0c459f71-cfe1-466d-9501-36b8f24e6ae1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:31.578214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0c459f71-cfe1-466d-9501-36b8f24e6ae1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 50aa2e14-0b49-4eb7-af7b-79582409b298] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:31.590699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c459f71-cfe1-466d-9501-36b8f24e6ae1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:31.591290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c459f71-cfe1-466d-9501-36b8f24e6ae1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:31.591795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c459f71-cfe1-466d-9501-36b8f24e6ae1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:31.592586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c459f71-cfe1-466d-9501-36b8f24e6ae1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:31.593592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c459f71-cfe1-466d-9501-36b8f24e6ae1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:31.594103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c459f71-cfe1-466d-9501-36b8f24e6ae1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:31.610345 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dd6a2ef6-de1b-41be-b35f-d61e340889b0 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.119820 Oct 27 18:53:31.617221 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1024/2022] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:31 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:31.853323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-1734c9f9-c31c-47d0-9049-460807ef4ee7 req-4e7f57d6-7eaa-4de8-925c-3cb67120821d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d5439d-efc3-4e29-a439-7b8b40177342", "name": "network-vif-deleted", "tag": "cb412b3e-6a21-4028-8662-7d6ffba2fede"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:31.876233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1734c9f9-c31c-47d0-9049-460807ef4ee7 req-4e7f57d6-7eaa-4de8-925c-3cb67120821d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:31.877136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1734c9f9-c31c-47d0-9049-460807ef4ee7 req-4e7f57d6-7eaa-4de8-925c-3cb67120821d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:31.877819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1734c9f9-c31c-47d0-9049-460807ef4ee7 req-4e7f57d6-7eaa-4de8-925c-3cb67120821d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:31.921920 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-1734c9f9-c31c-47d0-9049-460807ef4ee7 req-4e7f57d6-7eaa-4de8-925c-3cb67120821d service nova] Creating event network-vif-deleted:cb412b3e-6a21-4028-8662-7d6ffba2fede for instance 26d5439d-efc3-4e29-a439-7b8b40177342 on n-h2-860687-3 Oct 27 18:53:31.947427 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-1734c9f9-c31c-47d0-9049-460807ef4ee7 req-4e7f57d6-7eaa-4de8-925c-3cb67120821d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099814 Oct 27 18:53:31.952527 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1025/2023] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:53:32.335417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0c459f71-cfe1-466d-9501-36b8f24e6ae1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:32.345000 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0c459f71-cfe1-466d-9501-36b8f24e6ae1 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298" status: 200 len: 1510 microversion: 2.1 time: 0.777139 Oct 27 18:53:32.357267 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 999/2024] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:31 2022] GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298 => generated 1510 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:32.520245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:32.521100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:32.543810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:32.544465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:32.545035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:32.547657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:32.550507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:32.551289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:32.589222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b48aab57-06c8-4f4b-92b0-fd41d2ae7664 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:32.589962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b48aab57-06c8-4f4b-92b0-fd41d2ae7664 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:32.602874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b48aab57-06c8-4f4b-92b0-fd41d2ae7664 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:32.603458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b48aab57-06c8-4f4b-92b0-fd41d2ae7664 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:32.603902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b48aab57-06c8-4f4b-92b0-fd41d2ae7664 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:32.624218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b48aab57-06c8-4f4b-92b0-fd41d2ae7664 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:32.624789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b48aab57-06c8-4f4b-92b0-fd41d2ae7664 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:32.630580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b48aab57-06c8-4f4b-92b0-fd41d2ae7664 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:32.634911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:32.636113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:32.639769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:32.640515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lazy-loading 'fault' on Instance uuid 26d5439d-efc3-4e29-a439-7b8b40177342 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:53:32.969957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b48aab57-06c8-4f4b-92b0-fd41d2ae7664 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:32.981693 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b48aab57-06c8-4f4b-92b0-fd41d2ae7664 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1294 microversion: 2.1 time: 0.406839 Oct 27 18:53:32.982290 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1000/2025] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:32 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1294 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:32.992858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4f38d2ea-8c7a-415b-a282-ebd6dd8f0f3c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc87337c280>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:33.081589 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4f38d2ea-8c7a-415b-a282-ebd6dd8f0f3c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.089643 Oct 27 18:53:33.082711 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1001/2026] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:32 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:33.092806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b0e9a462-e2c8-4d45-bdce-1732ad13ac30 req-f1d131fb-89c6-454a-bcb1-7e571e2bc988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cbe523-eacc-4725-bb27-dd16d1609546", "tag": "1d3a53ad-9130-41c9-89de-5938f71a59bc"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:33.142169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b0e9a462-e2c8-4d45-bdce-1732ad13ac30 req-f1d131fb-89c6-454a-bcb1-7e571e2bc988 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:33.144160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b0e9a462-e2c8-4d45-bdce-1732ad13ac30 req-f1d131fb-89c6-454a-bcb1-7e571e2bc988 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:33.146034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b0e9a462-e2c8-4d45-bdce-1732ad13ac30 req-f1d131fb-89c6-454a-bcb1-7e571e2bc988 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:33.184856 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b0e9a462-e2c8-4d45-bdce-1732ad13ac30 req-f1d131fb-89c6-454a-bcb1-7e571e2bc988 service nova] Creating event network-changed:1d3a53ad-9130-41c9-89de-5938f71a59bc for instance 84cbe523-eacc-4725-bb27-dd16d1609546 on n-h1-860687-3 Oct 27 18:53:33.192014 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b0e9a462-e2c8-4d45-bdce-1732ad13ac30 req-f1d131fb-89c6-454a-bcb1-7e571e2bc988 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107906 Oct 27 18:53:33.193124 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1002/2027] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:33.223384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:33.242893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:33.245797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:33.250591 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aee2b2c8-34b9-44bd-8660-e6561b4b92ee tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 200 len: 1373 microversion: 2.25 time: 0.735714 Oct 27 18:53:33.258013 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1026/2028] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:32 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 1373 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:33.385987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7fbfecb-7abf-47ea-8c0d-9ec9bb661b98 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:33.387068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7fbfecb-7abf-47ea-8c0d-9ec9bb661b98 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 50aa2e14-0b49-4eb7-af7b-79582409b298] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:33.404435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7fbfecb-7abf-47ea-8c0d-9ec9bb661b98 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:33.410838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7fbfecb-7abf-47ea-8c0d-9ec9bb661b98 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:33.413530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7fbfecb-7abf-47ea-8c0d-9ec9bb661b98 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:33.417790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7fbfecb-7abf-47ea-8c0d-9ec9bb661b98 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:33.421601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7fbfecb-7abf-47ea-8c0d-9ec9bb661b98 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:33.422498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7fbfecb-7abf-47ea-8c0d-9ec9bb661b98 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:33.513492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7fbfecb-7abf-47ea-8c0d-9ec9bb661b98 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:33.514032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7fbfecb-7abf-47ea-8c0d-9ec9bb661b98 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:33.515077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7fbfecb-7abf-47ea-8c0d-9ec9bb661b98 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:33.515841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-d7fbfecb-7abf-47ea-8c0d-9ec9bb661b98 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lazy-loading 'fault' on Instance uuid 50aa2e14-0b49-4eb7-af7b-79582409b298 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:53:33.609983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7fbfecb-7abf-47ea-8c0d-9ec9bb661b98 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af58c47c7ff47a1abb83c046335a44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01070f71f894787a5a26e00dc2cd3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:33.635470 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7fbfecb-7abf-47ea-8c0d-9ec9bb661b98 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298" status: 200 len: 1307 microversion: 2.1 time: 0.250361 Oct 27 18:53:33.638467 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1003/2029] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:33 2022] GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298 => generated 1307 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:34.003116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-63bf1800-dad4-40c8-a110-6dd3921d1177 req-48a34432-ea1e-4538-9222-efbe977950d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50aa2e14-0b49-4eb7-af7b-79582409b298", "name": "network-vif-deleted", "tag": "eaf4cd8a-cd39-427d-bd80-9e251b91623b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:34.013775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-df18e827-01f8-48b9-97f5-bc7152c0491b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:34.014680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-df18e827-01f8-48b9-97f5-bc7152c0491b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:34.024332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df18e827-01f8-48b9-97f5-bc7152c0491b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:34.025073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df18e827-01f8-48b9-97f5-bc7152c0491b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:34.027831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df18e827-01f8-48b9-97f5-bc7152c0491b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:34.028764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df18e827-01f8-48b9-97f5-bc7152c0491b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:34.029390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df18e827-01f8-48b9-97f5-bc7152c0491b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:34.030488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df18e827-01f8-48b9-97f5-bc7152c0491b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:34.040248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-63bf1800-dad4-40c8-a110-6dd3921d1177 req-48a34432-ea1e-4538-9222-efbe977950d7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:34.041117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-63bf1800-dad4-40c8-a110-6dd3921d1177 req-48a34432-ea1e-4538-9222-efbe977950d7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:34.041725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-63bf1800-dad4-40c8-a110-6dd3921d1177 req-48a34432-ea1e-4538-9222-efbe977950d7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:34.066378 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-63bf1800-dad4-40c8-a110-6dd3921d1177 req-48a34432-ea1e-4538-9222-efbe977950d7 service nova] Creating event network-vif-deleted:eaf4cd8a-cd39-427d-bd80-9e251b91623b for instance 50aa2e14-0b49-4eb7-af7b-79582409b298 on n-h2-860687-3 Oct 27 18:53:34.085852 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-63bf1800-dad4-40c8-a110-6dd3921d1177 req-48a34432-ea1e-4538-9222-efbe977950d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086721 Oct 27 18:53:34.086559 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1027/2030] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:53:34.097888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-35002a97-0b15-4a86-82e2-162fc34a6a66 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86ad353a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:34.183180 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-35002a97-0b15-4a86-82e2-162fc34a6a66 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.089200 Oct 27 18:53:34.191093 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1028/2031] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:34 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:34.285837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2010fda7-9018-407a-be08-99954526ea5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:34.286875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2010fda7-9018-407a-be08-99954526ea5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 26d5439d-efc3-4e29-a439-7b8b40177342] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:34.304065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2010fda7-9018-407a-be08-99954526ea5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:34.304571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2010fda7-9018-407a-be08-99954526ea5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:34.305023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2010fda7-9018-407a-be08-99954526ea5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:34.305747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2010fda7-9018-407a-be08-99954526ea5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:34.306207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2010fda7-9018-407a-be08-99954526ea5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:34.306744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2010fda7-9018-407a-be08-99954526ea5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:34.341180 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-2010fda7-9018-407a-be08-99954526ea5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] HTTP exception thrown: Instance 26d5439d-efc3-4e29-a439-7b8b40177342 could not be found. Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2010fda7-9018-407a-be08-99954526ea5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Request method failure captured: Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 HTTP/1.1 Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtH54kKGI2_VMr-tkr1kvsEF2LwSziPkOKzEpMchvtpUGnvXInOLu7oI10jqJbOG0Z6_yC7HUl7R44dz_SsJr75yawC2VOkFPwCkbK3Icj36YL9NljTLx2ekq_5fQ5Kc_yHCRikXXAgYsViebvXAQLUG1gWJOrfpKYSZl1r2dIomPQQ Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: a1c89e4b67024f91ae460e3ae3278277 Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-144322176 Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a1c89e4b67024f91ae460e3ae3278277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1c89e4b67024f91ae460e3ae3278277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a1c89e4b67024f91ae460e3ae3278277", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1c89e4b67024f91ae460e3ae3278277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-144322176 Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: a1c89e4b67024f91ae460e3ae3278277 Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-144322176 Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-LiveAutoBlockMigrationV225Test-144322176-project Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c73a9daf485b421c8244f287fee5a942 Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-144322176-project Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 26d5439d-efc3-4e29-a439-7b8b40177342 could not be found. Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '26d5439d-efc3-4e29-a439-7b8b40177342'} Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d5439d-efc3-4e29-a439-7b8b40177342 could not be found. Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d5439d-efc3-4e29-a439-7b8b40177342 could not be found. Oct 27 18:53:34.342792 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.359720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:34.359720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.359720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:34.359720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:34.359720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:34.359720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:34.359720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:34.359720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d5439d-efc3-4e29-a439-7b8b40177342 could not be found. Oct 27 18:53:34.359720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.359720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2010fda7-9018-407a-be08-99954526ea5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Returning 404 to user: Instance 26d5439d-efc3-4e29-a439-7b8b40177342 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:34.359720 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2010fda7-9018-407a-be08-99954526ea5e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342" status: 404 len: 111 microversion: 2.25 time: 0.062963 Oct 27 18:53:34.359720 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1029/2032] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:34 2022] GET /compute/v2.1/servers/26d5439d-efc3-4e29-a439-7b8b40177342 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 18:53:34.362774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7eb8df94-8af0-4e01-99b4-9451aec07179 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '.version_select at 0x7fc86ad35af0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:34.425780 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7eb8df94-8af0-4e01-99b4-9451aec07179 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-15047669" status: 204 len: 0 microversion: 2.25 time: 0.067751 Oct 27 18:53:34.427779 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1030/2033] 10.222.0.42 () {60 vars in 1256 bytes} [Thu Oct 27 18:53:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-15047669 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 18:53:34.663564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7718fbeb-56fa-4e16-85da-336e54371460 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:34.665723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7718fbeb-56fa-4e16-85da-336e54371460 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 50aa2e14-0b49-4eb7-af7b-79582409b298] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:34.674072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7718fbeb-56fa-4e16-85da-336e54371460 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:34.676009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7718fbeb-56fa-4e16-85da-336e54371460 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:34.676752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7718fbeb-56fa-4e16-85da-336e54371460 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:34.684189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7718fbeb-56fa-4e16-85da-336e54371460 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:34.684954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7718fbeb-56fa-4e16-85da-336e54371460 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:34.686256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7718fbeb-56fa-4e16-85da-336e54371460 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:34.687553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-df18e827-01f8-48b9-97f5-bc7152c0491b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:34.696165 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-df18e827-01f8-48b9-97f5-bc7152c0491b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1294 microversion: 2.1 time: 0.686383 Oct 27 18:53:34.696766 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1004/2034] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:34 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1294 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:34.707271 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-7718fbeb-56fa-4e16-85da-336e54371460 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] HTTP exception thrown: Instance 50aa2e14-0b49-4eb7-af7b-79582409b298 could not be found. Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7718fbeb-56fa-4e16-85da-336e54371460 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Request method failure captured: Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298 HTTP/1.1 Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtNbZ1YeaqIfZbf65hIU37Qmljh0_99UqZT6RueXYW_J8lUFd0LByrxL3n57jWSaNS6kOUveoxMrgeLaYwRP0S-wV8GNk7XusntOsqIn1k5dOeSbNaLr3GK9GvvPciSJqrlw0G6oXGj2BGkrY55s7htWzNx__lhWWnAWNd36A0hHC70 Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: a01070f71f894787a5a26e00dc2cd3ef Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-MultipleCreateTestJSON-1581952115 Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a01070f71f894787a5a26e00dc2cd3ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a01070f71f894787a5a26e00dc2cd3ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a01070f71f894787a5a26e00dc2cd3ef", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a01070f71f894787a5a26e00dc2cd3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-MultipleCreateTestJSON-1581952115 Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: a01070f71f894787a5a26e00dc2cd3ef Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1581952115 Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-MultipleCreateTestJSON-1581952115-project Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 7af58c47c7ff47a1abb83c046335a44e Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-MultipleCreateTestJSON-1581952115-project Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 50aa2e14-0b49-4eb7-af7b-79582409b298 could not be found. Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '50aa2e14-0b49-4eb7-af7b-79582409b298'} Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50aa2e14-0b49-4eb7-af7b-79582409b298 could not be found. Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50aa2e14-0b49-4eb7-af7b-79582409b298 could not be found. Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:34.709091 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.712217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:34.712217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:34.712217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:34.712217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:34.712217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:34.712217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50aa2e14-0b49-4eb7-af7b-79582409b298 could not be found. Oct 27 18:53:34.712217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.713888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7718fbeb-56fa-4e16-85da-336e54371460 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Returning 404 to user: Instance 50aa2e14-0b49-4eb7-af7b-79582409b298 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:34.714989 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7718fbeb-56fa-4e16-85da-336e54371460 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298" status: 404 len: 111 microversion: 2.1 time: 0.057220 Oct 27 18:53:34.716837 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1031/2035] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:34 2022] GET /compute/v2.1/servers/50aa2e14-0b49-4eb7-af7b-79582409b298 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:53:34.725691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4523ef44-fd4c-417a-8f68-8273b7518587 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:34.726787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4523ef44-fd4c-417a-8f68-8273b7518587 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] [instance: 0556339c-0d41-460d-945e-c3b5a95bccfe] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:34.733894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4523ef44-fd4c-417a-8f68-8273b7518587 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:34.734590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4523ef44-fd4c-417a-8f68-8273b7518587 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:34.735044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4523ef44-fd4c-417a-8f68-8273b7518587 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:34.735768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4523ef44-fd4c-417a-8f68-8273b7518587 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:34.736231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4523ef44-fd4c-417a-8f68-8273b7518587 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:34.736831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4523ef44-fd4c-417a-8f68-8273b7518587 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:34.753784 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-4523ef44-fd4c-417a-8f68-8273b7518587 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] HTTP exception thrown: Instance 0556339c-0d41-460d-945e-c3b5a95bccfe could not be found. Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4523ef44-fd4c-417a-8f68-8273b7518587 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Request method failure captured: Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe HTTP/1.1 Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtNbZ1YeaqIfZbf65hIU37Qmljh0_99UqZT6RueXYW_J8lUFd0LByrxL3n57jWSaNS6kOUveoxMrgeLaYwRP0S-wV8GNk7XusntOsqIn1k5dOeSbNaLr3GK9GvvPciSJqrlw0G6oXGj2BGkrY55s7htWzNx__lhWWnAWNd36A0hHC70 Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: a01070f71f894787a5a26e00dc2cd3ef Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-MultipleCreateTestJSON-1581952115 Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a01070f71f894787a5a26e00dc2cd3ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a01070f71f894787a5a26e00dc2cd3ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a01070f71f894787a5a26e00dc2cd3ef", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a01070f71f894787a5a26e00dc2cd3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-MultipleCreateTestJSON-1581952115 Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: a01070f71f894787a5a26e00dc2cd3ef Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1581952115 Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-MultipleCreateTestJSON-1581952115-project Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 7af58c47c7ff47a1abb83c046335a44e Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-MultipleCreateTestJSON-1581952115-project Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 0556339c-0d41-460d-945e-c3b5a95bccfe could not be found. Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '0556339c-0d41-460d-945e-c3b5a95bccfe'} Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0556339c-0d41-460d-945e-c3b5a95bccfe could not be found. Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0556339c-0d41-460d-945e-c3b5a95bccfe could not be found. Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:34.755980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.760175 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:34.760175 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:34.760175 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:34.760175 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:34.760175 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:34.760175 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0556339c-0d41-460d-945e-c3b5a95bccfe could not be found. Oct 27 18:53:34.760175 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:34.760175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4523ef44-fd4c-417a-8f68-8273b7518587 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] Returning 404 to user: Instance 0556339c-0d41-460d-945e-c3b5a95bccfe could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:34.760175 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4523ef44-fd4c-417a-8f68-8273b7518587 tempest-MultipleCreateTestJSON-1581952115 tempest-MultipleCreateTestJSON-1581952115-project] 10.222.0.42 "GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe" status: 404 len: 111 microversion: 2.1 time: 0.039255 Oct 27 18:53:34.761409 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1005/2036] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:34 2022] GET /compute/v2.1/servers/0556339c-0d41-460d-945e-c3b5a95bccfe => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:53:35.199704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-751e4bad-e63a-4c17-924b-f669552f8f41 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86ad27820>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:35.270045 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-751e4bad-e63a-4c17-924b-f669552f8f41 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1453 microversion: 2.1 time: 0.074495 Oct 27 18:53:35.272660 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1032/2037] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:35 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:35.396332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-621c1207-98f4-46ab-92cc-605bb9c2917c req-ec3491e1-3a93-4798-9251-82861cea2897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0556339c-0d41-460d-945e-c3b5a95bccfe", "name": "network-vif-deleted", "tag": "f9f631d4-05dd-4e90-8742-f18d221abce2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:35.414065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-621c1207-98f4-46ab-92cc-605bb9c2917c req-ec3491e1-3a93-4798-9251-82861cea2897 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:35.415197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-621c1207-98f4-46ab-92cc-605bb9c2917c req-ec3491e1-3a93-4798-9251-82861cea2897 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:35.415786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-621c1207-98f4-46ab-92cc-605bb9c2917c req-ec3491e1-3a93-4798-9251-82861cea2897 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:35.434364 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-621c1207-98f4-46ab-92cc-605bb9c2917c req-ec3491e1-3a93-4798-9251-82861cea2897 service nova] Creating event network-vif-deleted:f9f631d4-05dd-4e90-8742-f18d221abce2 for instance 0556339c-0d41-460d-945e-c3b5a95bccfe on n-h2-860687-3 Oct 27 18:53:35.447095 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-621c1207-98f4-46ab-92cc-605bb9c2917c req-ec3491e1-3a93-4798-9251-82861cea2897 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058998 Oct 27 18:53:35.447944 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1006/2038] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:35.723966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-003b3ee8-4d7e-4cb9-8030-3ea54a8858cd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:35.724696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-003b3ee8-4d7e-4cb9-8030-3ea54a8858cd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:35.731473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-003b3ee8-4d7e-4cb9-8030-3ea54a8858cd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:35.732056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-003b3ee8-4d7e-4cb9-8030-3ea54a8858cd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:35.732570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-003b3ee8-4d7e-4cb9-8030-3ea54a8858cd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:35.733511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-003b3ee8-4d7e-4cb9-8030-3ea54a8858cd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:35.734052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-003b3ee8-4d7e-4cb9-8030-3ea54a8858cd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:35.734615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-003b3ee8-4d7e-4cb9-8030-3ea54a8858cd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:36.231270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-003b3ee8-4d7e-4cb9-8030-3ea54a8858cd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:36.244301 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-003b3ee8-4d7e-4cb9-8030-3ea54a8858cd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1294 microversion: 2.1 time: 0.526915 Oct 27 18:53:36.273675 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1033/2039] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:35 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1294 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:36.293270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-18f68ac7-aa3c-4025-bd9c-ae0561116f70 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc8733bddc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:36.395529 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-18f68ac7-aa3c-4025-bd9c-ae0561116f70 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1462 microversion: 2.1 time: 0.109045 Oct 27 18:53:36.396724 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1007/2040] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:36 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1462 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:36.415910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-edc2fe33-e542-4677-99bb-c82a3e6eca72 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b284b80>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:36.518157 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-edc2fe33-e542-4677-99bb-c82a3e6eca72 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 200 len: 1462 microversion: 2.1 time: 0.106631 Oct 27 18:53:36.519353 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1034/2041] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:36 2022] GET /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 1462 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:36.541676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-319144b6-011c-4ca2-abad-f968e573df48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:36.542665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-319144b6-011c-4ca2-abad-f968e573df48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:36.561174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-319144b6-011c-4ca2-abad-f968e573df48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:36.562113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-319144b6-011c-4ca2-abad-f968e573df48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:36.562819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-319144b6-011c-4ca2-abad-f968e573df48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:36.563748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-319144b6-011c-4ca2-abad-f968e573df48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:36.564423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-319144b6-011c-4ca2-abad-f968e573df48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:36.565090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-319144b6-011c-4ca2-abad-f968e573df48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:37.053885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-187723170", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:37.140783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] validate_networks() for [('969dfa55-7bd6-4101-b2b3-c0ca6c6378eb', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:53:37.250930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-319144b6-011c-4ca2-abad-f968e573df48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:37.270917 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-319144b6-011c-4ca2-abad-f968e573df48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1468 microversion: 2.1 time: 0.737148 Oct 27 18:53:37.274428 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1008/2042] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:36 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1468 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:37.291878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f374796c-3604-4501-81cf-0b4e0b6d39b0 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:37.292810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f374796c-3604-4501-81cf-0b4e0b6d39b0 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:37.303888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f374796c-3604-4501-81cf-0b4e0b6d39b0 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:37.309682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f374796c-3604-4501-81cf-0b4e0b6d39b0 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:37.310404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f374796c-3604-4501-81cf-0b4e0b6d39b0 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:37.311349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f374796c-3604-4501-81cf-0b4e0b6d39b0 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:37.313344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f374796c-3604-4501-81cf-0b4e0b6d39b0 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:37.315520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f374796c-3604-4501-81cf-0b4e0b6d39b0 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:37.973460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f374796c-3604-4501-81cf-0b4e0b6d39b0 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:37.989480 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f374796c-3604-4501-81cf-0b4e0b6d39b0 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1294 microversion: 2.1 time: 0.713547 Oct 27 18:53:37.998536 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1009/2043] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:37 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1294 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:38.013823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7061e270-192f-4e1e-b8bc-cb417aba439d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-386895840"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:38.020409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7061e270-192f-4e1e-b8bc-cb417aba439d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: 1f02e8ec-759d-48bf-9d99-31fa890241c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:38.036396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7061e270-192f-4e1e-b8bc-cb417aba439d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:38.037029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7061e270-192f-4e1e-b8bc-cb417aba439d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:38.038621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7061e270-192f-4e1e-b8bc-cb417aba439d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:38.039619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7061e270-192f-4e1e-b8bc-cb417aba439d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:38.041912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7061e270-192f-4e1e-b8bc-cb417aba439d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:38.042627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7061e270-192f-4e1e-b8bc-cb417aba439d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:38.454741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:38.510311 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7061e270-192f-4e1e-b8bc-cb417aba439d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "POST /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1/action" status: 202 len: 0 microversion: 2.1 time: 0.510162 Oct 27 18:53:38.517488 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1010/2044] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:53:37 2022] POST /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 18:53:38.531000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-571f6632-e959-4885-abba-6fe313464661 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:38.531892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-571f6632-e959-4885-abba-6fe313464661 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:38.547450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-571f6632-e959-4885-abba-6fe313464661 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:38.549438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-571f6632-e959-4885-abba-6fe313464661 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:38.550792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-571f6632-e959-4885-abba-6fe313464661 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:38.553878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-571f6632-e959-4885-abba-6fe313464661 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:38.556758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-571f6632-e959-4885-abba-6fe313464661 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:38.557499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-571f6632-e959-4885-abba-6fe313464661 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:38.622957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-571f6632-e959-4885-abba-6fe313464661 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:53:38.871760 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-571f6632-e959-4885-abba-6fe313464661 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "DELETE /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 204 len: 0 microversion: 2.25 time: 0.355524 Oct 27 18:53:38.872384 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1011/2045] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:53:38 2022] DELETE /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 18:53:38.886189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-40a69a90-72c9-47d3-9999-6b097032b192 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873366dc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:38.936712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:53:38.937732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:53:38.938511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:53:38.939149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:53:38.939715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:53:38.963503 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-40a69a90-72c9-47d3-9999-6b097032b192 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.089864 Oct 27 18:53:38.964297 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1012/2046] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:38 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:38.965402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:38.965900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:38.966340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:38.967104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:38.970767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:38.971301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:38.979082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-225e0cb3-1c42-4182-8f0f-b63e04e8aa43 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:38.979692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-225e0cb3-1c42-4182-8f0f-b63e04e8aa43 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:39.001928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-225e0cb3-1c42-4182-8f0f-b63e04e8aa43 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:39.002465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-225e0cb3-1c42-4182-8f0f-b63e04e8aa43 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:39.003244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-225e0cb3-1c42-4182-8f0f-b63e04e8aa43 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:39.003993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-225e0cb3-1c42-4182-8f0f-b63e04e8aa43 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:39.004462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-225e0cb3-1c42-4182-8f0f-b63e04e8aa43 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:39.004904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-225e0cb3-1c42-4182-8f0f-b63e04e8aa43 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:39.026802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Getting quotas for project 4b90de1493a5422ba51e27b6241725c8. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:53:39.042413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Getting quotas for user 834fdde034434a19aec0129ef2d744df and project 4b90de1493a5422ba51e27b6241725c8. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:53:39.082501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:53:39.086725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:53:39.202561 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9cc9054f-2047-45a0-b36f-297f8d684128 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.451598 Oct 27 18:53:39.211140 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1035/2047] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:53:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:53:39.222837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eef25274-d030-457c-927f-21b1c8465c04 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:39.226589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-eef25274-d030-457c-927f-21b1c8465c04 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:39.255990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eef25274-d030-457c-927f-21b1c8465c04 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:39.258524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eef25274-d030-457c-927f-21b1c8465c04 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:39.260665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eef25274-d030-457c-927f-21b1c8465c04 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:39.262935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eef25274-d030-457c-927f-21b1c8465c04 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:39.265241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eef25274-d030-457c-927f-21b1c8465c04 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:39.266062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eef25274-d030-457c-927f-21b1c8465c04 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:39.973961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-eef25274-d030-457c-927f-21b1c8465c04 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:39.984394 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eef25274-d030-457c-927f-21b1c8465c04 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1294 microversion: 2.1 time: 0.771860 Oct 27 18:53:39.985004 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1036/2048] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:39 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1294 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:40.014074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af79abd3-3249-47ba-8ab5-172e0bb0b4bb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:40.015216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-af79abd3-3249-47ba-8ab5-172e0bb0b4bb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:40.188728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-af79abd3-3249-47ba-8ab5-172e0bb0b4bb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:40.204354 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-af79abd3-3249-47ba-8ab5-172e0bb0b4bb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1216 microversion: 2.1 time: 0.199150 Oct 27 18:53:40.208132 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1037/2049] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:39 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1216 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:40.214596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-fa1298ed-cab6-42bc-94df-b0ed16e0154f req-35c6f9a7-a674-406e-86b0-07938784ddee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5e11da-2f25-4433-98d7-8f5b0620095f", "name": "network-vif-unplugged", "status": "completed", "tag": "00a226a6-58cf-4f6d-9bc2-e12c43140523"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:40.231756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fa1298ed-cab6-42bc-94df-b0ed16e0154f req-35c6f9a7-a674-406e-86b0-07938784ddee service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:40.232573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fa1298ed-cab6-42bc-94df-b0ed16e0154f req-35c6f9a7-a674-406e-86b0-07938784ddee service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:40.233208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fa1298ed-cab6-42bc-94df-b0ed16e0154f req-35c6f9a7-a674-406e-86b0-07938784ddee service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:40.276462 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-fa1298ed-cab6-42bc-94df-b0ed16e0154f req-35c6f9a7-a674-406e-86b0-07938784ddee service nova] Creating event network-vif-unplugged:00a226a6-58cf-4f6d-9bc2-e12c43140523 for instance ac5e11da-2f25-4433-98d7-8f5b0620095f on n-h1-860687-3 Oct 27 18:53:40.285884 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-fa1298ed-cab6-42bc-94df-b0ed16e0154f req-35c6f9a7-a674-406e-86b0-07938784ddee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075525 Oct 27 18:53:40.287163 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1038/2050] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:40.313445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bd81b26a-17a3-45d2-9cd8-92cd3183ff0e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86afd6940>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:40.379091 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bd81b26a-17a3-45d2-9cd8-92cd3183ff0e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.075917 Oct 27 18:53:40.379811 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1039/2051] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:40 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:40.522874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-225e0cb3-1c42-4182-8f0f-b63e04e8aa43 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:40.533001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-225e0cb3-1c42-4182-8f0f-b63e04e8aa43 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:40.543404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-225e0cb3-1c42-4182-8f0f-b63e04e8aa43 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:40.551198 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-225e0cb3-1c42-4182-8f0f-b63e04e8aa43 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1548 microversion: 2.25 time: 1.574969 Oct 27 18:53:40.556342 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1013/2052] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:38 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1548 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:41.013539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e5362c81-f77f-4c50-8806-33a9524ef96b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:41.014583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e5362c81-f77f-4c50-8806-33a9524ef96b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:41.026223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5362c81-f77f-4c50-8806-33a9524ef96b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:41.029808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-2171d31b-c4e9-4105-a92d-603d7132c525 req-91ccec7c-86a6-46d7-a703-1c29cba16f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293448e8-0911-4074-a5d0-d9ff98094843", "name": "network-vif-deleted", "tag": "e5835307-83a9-4b59-8ccd-63bd95493e8c"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:41.030580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5362c81-f77f-4c50-8806-33a9524ef96b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:41.031171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5362c81-f77f-4c50-8806-33a9524ef96b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:41.032198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5362c81-f77f-4c50-8806-33a9524ef96b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:41.032949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5362c81-f77f-4c50-8806-33a9524ef96b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:41.034807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5362c81-f77f-4c50-8806-33a9524ef96b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:41.066871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2171d31b-c4e9-4105-a92d-603d7132c525 req-91ccec7c-86a6-46d7-a703-1c29cba16f3a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:41.067376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2171d31b-c4e9-4105-a92d-603d7132c525 req-91ccec7c-86a6-46d7-a703-1c29cba16f3a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:41.067817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2171d31b-c4e9-4105-a92d-603d7132c525 req-91ccec7c-86a6-46d7-a703-1c29cba16f3a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:41.097693 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-2171d31b-c4e9-4105-a92d-603d7132c525 req-91ccec7c-86a6-46d7-a703-1c29cba16f3a service nova] Creating event network-vif-deleted:e5835307-83a9-4b59-8ccd-63bd95493e8c for instance 293448e8-0911-4074-a5d0-d9ff98094843 on n-h2-860687-3 Oct 27 18:53:41.111062 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-2171d31b-c4e9-4105-a92d-603d7132c525 req-91ccec7c-86a6-46d7-a703-1c29cba16f3a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086215 Oct 27 18:53:41.113499 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1014/2053] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:41.235679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fccc2dcf-3d85-41e5-a8f8-4a21e8fe0f0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:41.236948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fccc2dcf-3d85-41e5-a8f8-4a21e8fe0f0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:41.250852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fccc2dcf-3d85-41e5-a8f8-4a21e8fe0f0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:41.251640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fccc2dcf-3d85-41e5-a8f8-4a21e8fe0f0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:41.253682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fccc2dcf-3d85-41e5-a8f8-4a21e8fe0f0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:41.256655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fccc2dcf-3d85-41e5-a8f8-4a21e8fe0f0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:41.258912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fccc2dcf-3d85-41e5-a8f8-4a21e8fe0f0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:41.260028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fccc2dcf-3d85-41e5-a8f8-4a21e8fe0f0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:41.647651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fccc2dcf-3d85-41e5-a8f8-4a21e8fe0f0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:41.668590 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fccc2dcf-3d85-41e5-a8f8-4a21e8fe0f0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1268 microversion: 2.1 time: 0.433312 Oct 27 18:53:41.679111 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1015/2054] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:41 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1268 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:41.696144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e16372d-e3bf-44c3-9049-fbd427331a2a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873366a60>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:41.767311 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9e16372d-e3bf-44c3-9049-fbd427331a2a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.086679 Oct 27 18:53:41.768733 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1016/2055] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:41 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:41.803085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:41.809998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:41.819875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e5362c81-f77f-4c50-8806-33a9524ef96b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:41.833721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:41.834570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:41.835560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:41.836543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:41.837286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:41.837956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:41.843001 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e5362c81-f77f-4c50-8806-33a9524ef96b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1294 microversion: 2.1 time: 0.834953 Oct 27 18:53:41.854937 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1040/2056] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:41 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1294 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:41.959888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:41.962372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:41.963070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:41.964022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lazy-loading 'fault' on Instance uuid 293448e8-0911-4074-a5d0-d9ff98094843 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:53:42.226492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:42.236564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:42.251678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:42.259274 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6496da81-6fb0-43fd-9107-1facfb94a19e tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 200 len: 1352 microversion: 2.25 time: 0.487418 Oct 27 18:53:42.259972 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1017/2057] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:41 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 1352 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:42.705073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4964ff46-181c-4091-a346-ad3c291863ae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:42.705861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4964ff46-181c-4091-a346-ad3c291863ae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:42.716769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4964ff46-181c-4091-a346-ad3c291863ae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:42.720807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4964ff46-181c-4091-a346-ad3c291863ae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:42.722688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4964ff46-181c-4091-a346-ad3c291863ae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:42.723555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4964ff46-181c-4091-a346-ad3c291863ae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:42.726588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4964ff46-181c-4091-a346-ad3c291863ae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:42.727160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4964ff46-181c-4091-a346-ad3c291863ae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:42.790819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ba9a1668-ace4-44b1-b1f3-8c049d71618b tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873394700>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:42.855639 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ba9a1668-ace4-44b1-b1f3-8c049d71618b tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.074357 Oct 27 18:53:42.857386 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1018/2058] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:42 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:42.888130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-053a50b5-0ec3-4ee7-9be1-945ed86158a3 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:42.888998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-053a50b5-0ec3-4ee7-9be1-945ed86158a3 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:42.890864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4964ff46-181c-4091-a346-ad3c291863ae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:42.909859 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4964ff46-181c-4091-a346-ad3c291863ae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1274 microversion: 2.1 time: 0.208461 Oct 27 18:53:42.910411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-053a50b5-0ec3-4ee7-9be1-945ed86158a3 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:42.923514 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1041/2059] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:42 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:42.926171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-053a50b5-0ec3-4ee7-9be1-945ed86158a3 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:42.933309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-053a50b5-0ec3-4ee7-9be1-945ed86158a3 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:42.952772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-053a50b5-0ec3-4ee7-9be1-945ed86158a3 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:42.956078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-053a50b5-0ec3-4ee7-9be1-945ed86158a3 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:42.959592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-053a50b5-0ec3-4ee7-9be1-945ed86158a3 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:43.290802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f8f3e2ab-8e22-467f-83a8-0de48b1273d0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:43.291771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f8f3e2ab-8e22-467f-83a8-0de48b1273d0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 293448e8-0911-4074-a5d0-d9ff98094843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:43.309906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8f3e2ab-8e22-467f-83a8-0de48b1273d0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:43.313934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8f3e2ab-8e22-467f-83a8-0de48b1273d0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:43.314793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8f3e2ab-8e22-467f-83a8-0de48b1273d0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:43.315895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8f3e2ab-8e22-467f-83a8-0de48b1273d0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:43.317913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8f3e2ab-8e22-467f-83a8-0de48b1273d0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:43.322924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8f3e2ab-8e22-467f-83a8-0de48b1273d0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:43.353249 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-f8f3e2ab-8e22-467f-83a8-0de48b1273d0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] HTTP exception thrown: Instance 293448e8-0911-4074-a5d0-d9ff98094843 could not be found. Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f8f3e2ab-8e22-467f-83a8-0de48b1273d0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Request method failure captured: Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 HTTP/1.1 Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtH54kKGI2_VMr-tkr1kvsEF2LwSziPkOKzEpMchvtpUGnvXInOLu7oI10jqJbOG0Z6_yC7HUl7R44dz_SsJr75yawC2VOkFPwCkbK3Icj36YL9NljTLx2ekq_5fQ5Kc_yHCRikXXAgYsViebvXAQLUG1gWJOrfpKYSZl1r2dIomPQQ Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: a1c89e4b67024f91ae460e3ae3278277 Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-144322176 Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a1c89e4b67024f91ae460e3ae3278277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1c89e4b67024f91ae460e3ae3278277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a1c89e4b67024f91ae460e3ae3278277", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1c89e4b67024f91ae460e3ae3278277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-144322176 Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: a1c89e4b67024f91ae460e3ae3278277 Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-144322176 Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-LiveAutoBlockMigrationV225Test-144322176-project Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c73a9daf485b421c8244f287fee5a942 Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-144322176-project Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 293448e8-0911-4074-a5d0-d9ff98094843 could not be found. Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '293448e8-0911-4074-a5d0-d9ff98094843'} Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 293448e8-0911-4074-a5d0-d9ff98094843 could not be found. Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 293448e8-0911-4074-a5d0-d9ff98094843 could not be found. Oct 27 18:53:43.356586 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:43.359782 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:43.359782 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:43.359782 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:43.359782 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:43.359782 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:43.359782 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:43.359782 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:43.359782 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 293448e8-0911-4074-a5d0-d9ff98094843 could not be found. Oct 27 18:53:43.359782 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:53:43.362216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f8f3e2ab-8e22-467f-83a8-0de48b1273d0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Returning 404 to user: Instance 293448e8-0911-4074-a5d0-d9ff98094843 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:43.363339 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f8f3e2ab-8e22-467f-83a8-0de48b1273d0 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843" status: 404 len: 111 microversion: 2.25 time: 0.080143 Oct 27 18:53:43.368454 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1042/2060] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:43 2022] GET /compute/v2.1/servers/293448e8-0911-4074-a5d0-d9ff98094843 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:53:43.375203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2d8387c1-abd2-4ca2-a6da-d679c9955b8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:43.376023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2d8387c1-abd2-4ca2-a6da-d679c9955b8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:43.386316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d8387c1-abd2-4ca2-a6da-d679c9955b8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:43.387202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d8387c1-abd2-4ca2-a6da-d679c9955b8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:43.387913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d8387c1-abd2-4ca2-a6da-d679c9955b8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:43.391623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d8387c1-abd2-4ca2-a6da-d679c9955b8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:43.393108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d8387c1-abd2-4ca2-a6da-d679c9955b8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:43.393769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d8387c1-abd2-4ca2-a6da-d679c9955b8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:43.407532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-053a50b5-0ec3-4ee7-9be1-945ed86158a3 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:43.420786 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-053a50b5-0ec3-4ee7-9be1-945ed86158a3 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1294 microversion: 2.1 time: 0.542051 Oct 27 18:53:43.421510 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1019/2061] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:42 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1294 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:43.491078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2d8387c1-abd2-4ca2-a6da-d679c9955b8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:53:43.617566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:43.641785 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2d8387c1-abd2-4ca2-a6da-d679c9955b8f tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 204 len: 0 microversion: 2.25 time: 0.271385 Oct 27 18:53:43.642605 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1043/2062] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:53:43 2022] DELETE /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 18:53:43.651299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cdb9d2cd-0488-46fb-8291-ff34c38c6269 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:43.652196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cdb9d2cd-0488-46fb-8291-ff34c38c6269 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:43.659861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdb9d2cd-0488-46fb-8291-ff34c38c6269 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:43.666941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdb9d2cd-0488-46fb-8291-ff34c38c6269 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:43.668034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdb9d2cd-0488-46fb-8291-ff34c38c6269 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:43.669123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdb9d2cd-0488-46fb-8291-ff34c38c6269 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:43.674975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdb9d2cd-0488-46fb-8291-ff34c38c6269 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:43.675678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdb9d2cd-0488-46fb-8291-ff34c38c6269 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:43.871757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-03c99f85-2bde-48d1-9177-fbb094cdda8a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86ad353a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:43.969110 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-03c99f85-2bde-48d1-9177-fbb094cdda8a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.101265 Oct 27 18:53:43.988658 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1044/2063] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:43 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:44.012727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-77f07367-1fff-40cd-8309-b7978783383c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:44.013719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-77f07367-1fff-40cd-8309-b7978783383c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:44.030279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77f07367-1fff-40cd-8309-b7978783383c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:44.035449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77f07367-1fff-40cd-8309-b7978783383c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:44.035959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77f07367-1fff-40cd-8309-b7978783383c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:44.036734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77f07367-1fff-40cd-8309-b7978783383c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:44.037844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77f07367-1fff-40cd-8309-b7978783383c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:44.038296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77f07367-1fff-40cd-8309-b7978783383c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:44.202983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-77f07367-1fff-40cd-8309-b7978783383c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:44.222071 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-77f07367-1fff-40cd-8309-b7978783383c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1274 microversion: 2.1 time: 0.229086 Oct 27 18:53:44.226555 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1045/2064] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:43 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1274 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:44.444721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c4d9052c-3574-4811-9fc7-a6261bf682d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:44.445505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c4d9052c-3574-4811-9fc7-a6261bf682d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:44.461230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4d9052c-3574-4811-9fc7-a6261bf682d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:44.461758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4d9052c-3574-4811-9fc7-a6261bf682d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:44.465734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4d9052c-3574-4811-9fc7-a6261bf682d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:44.467910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4d9052c-3574-4811-9fc7-a6261bf682d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:44.468421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4d9052c-3574-4811-9fc7-a6261bf682d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:44.470039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4d9052c-3574-4811-9fc7-a6261bf682d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:44.597405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cdb9d2cd-0488-46fb-8291-ff34c38c6269 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:44.614729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cdb9d2cd-0488-46fb-8291-ff34c38c6269 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:44.616579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cdb9d2cd-0488-46fb-8291-ff34c38c6269 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:44.618055 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cdb9d2cd-0488-46fb-8291-ff34c38c6269 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1564 microversion: 2.25 time: 0.971263 Oct 27 18:53:44.619188 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1020/2065] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:43 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1564 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:45.006809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5cd46d24-ca2c-4b87-98d8-66a63cfe1f9f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc87334bf70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:45.095100 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5cd46d24-ca2c-4b87-98d8-66a63cfe1f9f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.094009 Oct 27 18:53:45.096102 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1021/2066] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:44 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:45.163387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c4d9052c-3574-4811-9fc7-a6261bf682d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:45.173721 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c4d9052c-3574-4811-9fc7-a6261bf682d5 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1294 microversion: 2.1 time: 0.733106 Oct 27 18:53:45.175053 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1046/2067] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:44 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1294 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:45.251137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85b123cd-2f88-473d-9950-91acc94c7905 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:45.252137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85b123cd-2f88-473d-9950-91acc94c7905 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:45.260621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85b123cd-2f88-473d-9950-91acc94c7905 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:45.261383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85b123cd-2f88-473d-9950-91acc94c7905 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:45.262047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85b123cd-2f88-473d-9950-91acc94c7905 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:45.263029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85b123cd-2f88-473d-9950-91acc94c7905 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:45.263713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85b123cd-2f88-473d-9950-91acc94c7905 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:45.264380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85b123cd-2f88-473d-9950-91acc94c7905 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:45.648868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0a1d04b9-02b8-4b3b-b526-8cd0dd22dbeb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:45.649960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0a1d04b9-02b8-4b3b-b526-8cd0dd22dbeb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:45.658279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a1d04b9-02b8-4b3b-b526-8cd0dd22dbeb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:45.659121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a1d04b9-02b8-4b3b-b526-8cd0dd22dbeb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:45.659788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a1d04b9-02b8-4b3b-b526-8cd0dd22dbeb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:45.660712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a1d04b9-02b8-4b3b-b526-8cd0dd22dbeb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:45.661996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a1d04b9-02b8-4b3b-b526-8cd0dd22dbeb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:45.681805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a1d04b9-02b8-4b3b-b526-8cd0dd22dbeb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:45.693776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:46.361794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-85b123cd-2f88-473d-9950-91acc94c7905 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:46.374845 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85b123cd-2f88-473d-9950-91acc94c7905 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1316 microversion: 2.1 time: 1.127140 Oct 27 18:53:46.375833 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1022/2068] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:45 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1316 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:46.382919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c82b681f-5be8-41d3-bec6-4cfaa6fe3752 req-2f5dfb29-924e-4ea6-8f6c-5a6357638f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f02e8ec-759d-48bf-9d99-31fa890241c1", "name": "network-vif-plugged", "status": "completed", "tag": "e08a66dd-bce1-4f3f-ae67-ea863bda862f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:46.406172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c82b681f-5be8-41d3-bec6-4cfaa6fe3752 req-2f5dfb29-924e-4ea6-8f6c-5a6357638f26 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:46.408376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c82b681f-5be8-41d3-bec6-4cfaa6fe3752 req-2f5dfb29-924e-4ea6-8f6c-5a6357638f26 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:46.409890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c82b681f-5be8-41d3-bec6-4cfaa6fe3752 req-2f5dfb29-924e-4ea6-8f6c-5a6357638f26 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:46.424942 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c82b681f-5be8-41d3-bec6-4cfaa6fe3752 req-2f5dfb29-924e-4ea6-8f6c-5a6357638f26 service nova] Creating event network-vif-plugged:e08a66dd-bce1-4f3f-ae67-ea863bda862f for instance 1f02e8ec-759d-48bf-9d99-31fa890241c1 on n-h2-860687-3 Oct 27 18:53:46.431496 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c82b681f-5be8-41d3-bec6-4cfaa6fe3752 req-2f5dfb29-924e-4ea6-8f6c-5a6357638f26 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053676 Oct 27 18:53:46.432656 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1023/2069] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:46.441068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1c088fe0-3740-400b-9600-4105fdf23ea1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873394670>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:46.460792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0a1d04b9-02b8-4b3b-b526-8cd0dd22dbeb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:46.475934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0a1d04b9-02b8-4b3b-b526-8cd0dd22dbeb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:46.477435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0a1d04b9-02b8-4b3b-b526-8cd0dd22dbeb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:46.487387 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0a1d04b9-02b8-4b3b-b526-8cd0dd22dbeb tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1564 microversion: 2.25 time: 0.842280 Oct 27 18:53:46.488545 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1047/2070] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:45 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1564 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:53:46.499428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0435df27-0d3d-466b-bca2-5836666469a1 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:46.500252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0435df27-0d3d-466b-bca2-5836666469a1 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:46.500746 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1c088fe0-3740-400b-9600-4105fdf23ea1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.066474 Oct 27 18:53:46.501630 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1024/2071] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:46 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:46.519915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0435df27-0d3d-466b-bca2-5836666469a1 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:46.521229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0435df27-0d3d-466b-bca2-5836666469a1 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:46.522804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0435df27-0d3d-466b-bca2-5836666469a1 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:46.524173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0435df27-0d3d-466b-bca2-5836666469a1 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:46.524884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0435df27-0d3d-466b-bca2-5836666469a1 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:46.525479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0435df27-0d3d-466b-bca2-5836666469a1 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:47.083417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0435df27-0d3d-466b-bca2-5836666469a1 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:47.094024 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0435df27-0d3d-466b-bca2-5836666469a1 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1294 microversion: 2.1 time: 0.604030 Oct 27 18:53:47.095029 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1048/2072] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:46 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1294 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:47.297026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-89aa98c1-acf7-48a8-a19b-64047e83112a req-1dece2a8-01f0-49ce-a4c7-35004a39540d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60", "name": "network-vif-deleted", "tag": "a55bb603-e764-4da2-9e39-dba7565b80df"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:47.316492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-89aa98c1-acf7-48a8-a19b-64047e83112a req-1dece2a8-01f0-49ce-a4c7-35004a39540d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:47.320250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-89aa98c1-acf7-48a8-a19b-64047e83112a req-1dece2a8-01f0-49ce-a4c7-35004a39540d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:47.321156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-89aa98c1-acf7-48a8-a19b-64047e83112a req-1dece2a8-01f0-49ce-a4c7-35004a39540d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:47.344342 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-89aa98c1-acf7-48a8-a19b-64047e83112a req-1dece2a8-01f0-49ce-a4c7-35004a39540d service nova] Creating event network-vif-deleted:a55bb603-e764-4da2-9e39-dba7565b80df for instance 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 on n-h2-860687-3 Oct 27 18:53:47.356464 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-89aa98c1-acf7-48a8-a19b-64047e83112a req-1dece2a8-01f0-49ce-a4c7-35004a39540d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072328 Oct 27 18:53:47.364034 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1025/2073] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:47.408430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e51d1166-af5d-41d1-9316-c009aeb18a42 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:47.409391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e51d1166-af5d-41d1-9316-c009aeb18a42 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:47.422535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e51d1166-af5d-41d1-9316-c009aeb18a42 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:47.423926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e51d1166-af5d-41d1-9316-c009aeb18a42 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:47.424662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e51d1166-af5d-41d1-9316-c009aeb18a42 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:47.426597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e51d1166-af5d-41d1-9316-c009aeb18a42 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:47.427267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e51d1166-af5d-41d1-9316-c009aeb18a42 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:47.428854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e51d1166-af5d-41d1-9316-c009aeb18a42 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:47.518490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00d59a7c-d0d2-4697-8294-93d7c31b8d32 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc8733bddc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:47.608736 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-00d59a7c-d0d2-4697-8294-93d7c31b8d32 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.081341 Oct 27 18:53:47.617087 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1026/2074] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:47 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:47.624260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:47.625033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:47.645087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:47.645797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:47.646660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:47.647759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:47.648375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:47.649147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:47.732773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:47.733776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:47.734575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:47.735084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lazy-loading 'fault' on Instance uuid 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:53:47.858143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:47.877151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:47.883921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73a9daf485b421c8244f287fee5a942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c89e4b67024f91ae460e3ae3278277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:47.885404 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-818c6497-ebce-4173-84d3-4fa1ee856048 tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 200 len: 1352 microversion: 2.25 time: 0.267216 Oct 27 18:53:47.886128 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1027/2075] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:47 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 1352 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:53:48.117713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf904edc-273d-492e-8187-72b1113ef045 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:48.118648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cf904edc-273d-492e-8187-72b1113ef045 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:48.139513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf904edc-273d-492e-8187-72b1113ef045 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:48.140024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf904edc-273d-492e-8187-72b1113ef045 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:48.141130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf904edc-273d-492e-8187-72b1113ef045 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:48.145276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf904edc-273d-492e-8187-72b1113ef045 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:48.158068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf904edc-273d-492e-8187-72b1113ef045 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:48.158644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf904edc-273d-492e-8187-72b1113ef045 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:48.468175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e51d1166-af5d-41d1-9316-c009aeb18a42 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:48.481463 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e51d1166-af5d-41d1-9316-c009aeb18a42 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1316 microversion: 2.1 time: 1.079595 Oct 27 18:53:48.490822 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1049/2076] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:47 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1316 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:48.625487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8495efa8-a172-47f1-9d15-fbb7e094325e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86ab92f70>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:48.726688 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8495efa8-a172-47f1-9d15-fbb7e094325e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.105339 Oct 27 18:53:48.727469 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1050/2077] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:48 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:48.828920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cf904edc-273d-492e-8187-72b1113ef045 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:48.838235 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cf904edc-273d-492e-8187-72b1113ef045 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1294 microversion: 2.1 time: 0.724909 Oct 27 18:53:48.852600 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1028/2078] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:48 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1294 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:48.908716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6192d8f6-bfb4-47fc-9edf-f4b23ca6f324 req-fecffad6-87f8-47e3-b6c9-641207d023d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84cbe523-eacc-4725-bb27-dd16d1609546", "name": "network-vif-plugged", "status": "completed", "tag": "1d3a53ad-9130-41c9-89de-5938f71a59bc"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:48.914918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f34ba82-aa40-4f3d-bad4-602143573fcc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:48.916064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0f34ba82-aa40-4f3d-bad4-602143573fcc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] [instance: 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:48.928905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f34ba82-aa40-4f3d-bad4-602143573fcc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:48.933075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f34ba82-aa40-4f3d-bad4-602143573fcc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:48.935090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f34ba82-aa40-4f3d-bad4-602143573fcc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:48.938427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f34ba82-aa40-4f3d-bad4-602143573fcc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:48.939136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f34ba82-aa40-4f3d-bad4-602143573fcc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:48.940755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f34ba82-aa40-4f3d-bad4-602143573fcc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:48.941541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6192d8f6-bfb4-47fc-9edf-f4b23ca6f324 req-fecffad6-87f8-47e3-b6c9-641207d023d5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:48.942199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6192d8f6-bfb4-47fc-9edf-f4b23ca6f324 req-fecffad6-87f8-47e3-b6c9-641207d023d5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:48.944172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6192d8f6-bfb4-47fc-9edf-f4b23ca6f324 req-fecffad6-87f8-47e3-b6c9-641207d023d5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:48.982295 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-0f34ba82-aa40-4f3d-bad4-602143573fcc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] HTTP exception thrown: Instance 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 could not be found. Oct 27 18:53:48.985345 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6192d8f6-bfb4-47fc-9edf-f4b23ca6f324 req-fecffad6-87f8-47e3-b6c9-641207d023d5 service nova] Creating event network-vif-plugged:1d3a53ad-9130-41c9-89de-5938f71a59bc for instance 84cbe523-eacc-4725-bb27-dd16d1609546 on n-h1-860687-3 Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f34ba82-aa40-4f3d-bad4-602143573fcc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Request method failure captured: Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 HTTP/1.1 Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtH54kKGI2_VMr-tkr1kvsEF2LwSziPkOKzEpMchvtpUGnvXInOLu7oI10jqJbOG0Z6_yC7HUl7R44dz_SsJr75yawC2VOkFPwCkbK3Icj36YL9NljTLx2ekq_5fQ5Kc_yHCRikXXAgYsViebvXAQLUG1gWJOrfpKYSZl1r2dIomPQQ Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: a1c89e4b67024f91ae460e3ae3278277 Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-144322176 Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a1c89e4b67024f91ae460e3ae3278277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1c89e4b67024f91ae460e3ae3278277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a1c89e4b67024f91ae460e3ae3278277", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1c89e4b67024f91ae460e3ae3278277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-144322176 Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: a1c89e4b67024f91ae460e3ae3278277 Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-144322176 Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-LiveAutoBlockMigrationV225Test-144322176-project Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c73a9daf485b421c8244f287fee5a942 Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-144322176-project Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 could not be found. Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60'} Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 could not be found. Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 could not be found. Oct 27 18:53:48.988820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:48.995261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:48.995261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:48.995261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:48.995261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:48.995261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:48.995261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:48.995261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:48.995261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 could not be found. Oct 27 18:53:48.995261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:48.997699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f34ba82-aa40-4f3d-bad4-602143573fcc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] Returning 404 to user: Instance 7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:48.999232 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0f34ba82-aa40-4f3d-bad4-602143573fcc tempest-LiveAutoBlockMigrationV225Test-144322176 tempest-LiveAutoBlockMigrationV225Test-144322176-project] 10.222.0.42 "GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60" status: 404 len: 111 microversion: 2.25 time: 0.089711 Oct 27 18:53:49.002474 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1029/2079] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:53:48 2022] GET /compute/v2.1/servers/7d9b0ea8-6ae8-490a-8ac1-21ad9e29bb60 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 18:53:49.002635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:49.015422 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6192d8f6-bfb4-47fc-9edf-f4b23ca6f324 req-fecffad6-87f8-47e3-b6c9-641207d023d5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112489 Oct 27 18:53:49.027524 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1051/2080] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:49.158744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-2d95083e-a362-414f-b1a3-64288c323f00 req-2f93942a-648e-4ccd-914e-89b3f01b7e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6e311e1-6dd0-4498-897c-c92ce762d9b9", "tag": "5e0a3a4e-0c02-4bfb-b6c9-0aefa83bc658"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:49.186715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2d95083e-a362-414f-b1a3-64288c323f00 req-2f93942a-648e-4ccd-914e-89b3f01b7e5f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:49.189593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2d95083e-a362-414f-b1a3-64288c323f00 req-2f93942a-648e-4ccd-914e-89b3f01b7e5f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:49.190370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2d95083e-a362-414f-b1a3-64288c323f00 req-2f93942a-648e-4ccd-914e-89b3f01b7e5f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:49.229903 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-2d95083e-a362-414f-b1a3-64288c323f00 req-2f93942a-648e-4ccd-914e-89b3f01b7e5f service nova] Creating event network-changed:5e0a3a4e-0c02-4bfb-b6c9-0aefa83bc658 for instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 on n-h2-860687-3 Oct 27 18:53:49.248304 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-2d95083e-a362-414f-b1a3-64288c323f00 req-2f93942a-648e-4ccd-914e-89b3f01b7e5f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091395 Oct 27 18:53:49.248980 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1052/2081] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:49.444458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f003a0f0-ea85-492b-8c0d-1760a753e849 tempest-FloatingIPsNegativeTestJSON-558246425 tempest-FloatingIPsNegativeTestJSON-558246425-project] Calling method '.version_select at 0x7fc8733095e0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:49.525366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c35f5021-309f-4cf8-bd8b-cf8c533ae31f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:49.527100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c35f5021-309f-4cf8-bd8b-cf8c533ae31f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:49.538008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c35f5021-309f-4cf8-bd8b-cf8c533ae31f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:49.538652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c35f5021-309f-4cf8-bd8b-cf8c533ae31f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:49.539098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c35f5021-309f-4cf8-bd8b-cf8c533ae31f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:49.539816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c35f5021-309f-4cf8-bd8b-cf8c533ae31f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:49.545477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c35f5021-309f-4cf8-bd8b-cf8c533ae31f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:49.547045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c35f5021-309f-4cf8-bd8b-cf8c533ae31f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:49.554965 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f003a0f0-ea85-492b-8c0d-1760a753e849 tempest-FloatingIPsNegativeTestJSON-558246425 tempest-FloatingIPsNegativeTestJSON-558246425-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.511440 Oct 27 18:53:49.556249 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1030/2082] 10.222.0.42 () {58 vars in 1149 bytes} [Thu Oct 27 18:53:49 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 18:53:49.578042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-afaf2e84-5da7-4fcc-8801-67bbb42bdd8f tempest-FloatingIPsNegativeTestJSON-558246425 tempest-FloatingIPsNegativeTestJSON-558246425-project] Action: 'create', calling method: .version_select at 0x7fc873309ca0>, body: {"pool": "non_exist_pool"} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:49.647928 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-afaf2e84-5da7-4fcc-8801-67bbb42bdd8f tempest-FloatingIPsNegativeTestJSON-558246425 tempest-FloatingIPsNegativeTestJSON-558246425-project] HTTP exception thrown: Floating IP pool not found. Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-afaf2e84-5da7-4fcc-8801-67bbb42bdd8f tempest-FloatingIPsNegativeTestJSON-558246425 tempest-FloatingIPsNegativeTestJSON-558246425-project] Request method failure captured: Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 26 Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtO8k3zCEBAhgNxLRaitolHmb3FH4ol82tuFLratI7wxHfn-OMzCQpwlloXtCrkWUysUQPoTDcHAEU7TqehytSBqfq3faqoaAFQpzb02D1OUqqASS7dOgL5saTmdwP6FeFnwYcVWiZoyXnfQqhZwhKyihj_HXIj_1NGlJdz7GECYgUE Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4c93bd88e9804aabbf4d0e0efde97493 Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-558246425 Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4c93bd88e9804aabbf4d0e0efde97493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c93bd88e9804aabbf4d0e0efde97493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4c93bd88e9804aabbf4d0e0efde97493", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c93bd88e9804aabbf4d0e0efde97493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-558246425 Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4c93bd88e9804aabbf4d0e0efde97493 Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-558246425 Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FloatingIPsNegativeTestJSON-558246425-project Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b29a725c660f4681ae816d58acc17d2e Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-558246425-project Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: {"pool": "non_exist_pool"} Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: exception: Floating IP pool not found. Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:49.650164 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:49.653797 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 27 18:53:49.653797 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:49.653797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-afaf2e84-5da7-4fcc-8801-67bbb42bdd8f tempest-FloatingIPsNegativeTestJSON-558246425 tempest-FloatingIPsNegativeTestJSON-558246425-project] Returning 404 to user: Floating IP pool not found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:49.653797 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-afaf2e84-5da7-4fcc-8801-67bbb42bdd8f tempest-FloatingIPsNegativeTestJSON-558246425 tempest-FloatingIPsNegativeTestJSON-558246425-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.080133 Oct 27 18:53:49.653797 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1031/2083] 10.222.0.42 () {60 vars in 1170 bytes} [Thu Oct 27 18:53:49 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:53:49.672852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cdee3f87-527d-4927-b8e3-77833674e4fb tempest-FloatingIPsNegativeTestJSON-558246425 tempest-FloatingIPsNegativeTestJSON-558246425-project] Calling method '.version_select at 0x7fc873309c10>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:49.805793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG neutronclient.v2_0.client [None req-cdee3f87-527d-4927-b8e3-77833674e4fb tempest-FloatingIPsNegativeTestJSON-558246425 tempest-FloatingIPsNegativeTestJSON-558246425-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5e96047f-c346-4709-b0b4-f48fc29cca60 could not be found", "detail": ""}} {{(pid=127028) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:53:49.813291 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-cdee3f87-527d-4927-b8e3-77833674e4fb tempest-FloatingIPsNegativeTestJSON-558246425 tempest-FloatingIPsNegativeTestJSON-558246425-project] HTTP exception thrown: Floating IP not found for ID 5e96047f-c346-4709-b0b4-f48fc29cca60 Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cdee3f87-527d-4927-b8e3-77833674e4fb tempest-FloatingIPsNegativeTestJSON-558246425 tempest-FloatingIPsNegativeTestJSON-558246425-project] Request method failure captured: Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/os-floating-ips/5e96047f-c346-4709-b0b4-f48fc29cca60 HTTP/1.1 Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtO8k3zCEBAhgNxLRaitolHmb3FH4ol82tuFLratI7wxHfn-OMzCQpwlloXtCrkWUysUQPoTDcHAEU7TqehytSBqfq3faqoaAFQpzb02D1OUqqASS7dOgL5saTmdwP6FeFnwYcVWiZoyXnfQqhZwhKyihj_HXIj_1NGlJdz7GECYgUE Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4c93bd88e9804aabbf4d0e0efde97493 Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-558246425 Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4c93bd88e9804aabbf4d0e0efde97493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c93bd88e9804aabbf4d0e0efde97493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4c93bd88e9804aabbf4d0e0efde97493", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c93bd88e9804aabbf4d0e0efde97493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-558246425 Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4c93bd88e9804aabbf4d0e0efde97493 Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-558246425 Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-FloatingIPsNegativeTestJSON-558246425-project Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b29a725c660f4681ae816d58acc17d2e Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-558246425-project Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: exception: Floating IP not found for ID 5e96047f-c346-4709-b0b4-f48fc29cca60 Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '5e96047f-c346-4709-b0b4-f48fc29cca60'} Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5e96047f-c346-4709-b0b4-f48fc29cca60 could not be found Oct 27 18:53:49.815621 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcb888dc-7f9c-43d3-995a-306de66e4cf6'] Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5e96047f-c346-4709-b0b4-f48fc29cca60. Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5e96047f-c346-4709-b0b4-f48fc29cca60 Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5e96047f-c346-4709-b0b4-f48fc29cca60 Oct 27 18:53:49.820283 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:53:49.827068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cdee3f87-527d-4927-b8e3-77833674e4fb tempest-FloatingIPsNegativeTestJSON-558246425 tempest-FloatingIPsNegativeTestJSON-558246425-project] Returning 404 to user: Floating IP not found for ID 5e96047f-c346-4709-b0b4-f48fc29cca60 {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:53:49.830857 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cdee3f87-527d-4927-b8e3-77833674e4fb tempest-FloatingIPsNegativeTestJSON-558246425 tempest-FloatingIPsNegativeTestJSON-558246425-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/5e96047f-c346-4709-b0b4-f48fc29cca60" status: 404 len: 111 microversion: 2.1 time: 0.172791 Oct 27 18:53:49.832081 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1032/2084] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 18:53:49 2022] DELETE /compute/v2.1/os-floating-ips/5e96047f-c346-4709-b0b4-f48fc29cca60 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:53:49.853792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5d4f2cee-7cd4-4c78-974a-e00104e2c7c5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b014d30>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:49.964992 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5d4f2cee-7cd4-4c78-974a-e00104e2c7c5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.129422 Oct 27 18:53:49.969284 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1033/2085] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:49 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:49.984064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d185194f-e24c-48c4-b09b-c266ae065494 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:49.990773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d185194f-e24c-48c4-b09b-c266ae065494 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:50.015513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d185194f-e24c-48c4-b09b-c266ae065494 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:50.016043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d185194f-e24c-48c4-b09b-c266ae065494 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:50.020766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d185194f-e24c-48c4-b09b-c266ae065494 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:50.027023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d185194f-e24c-48c4-b09b-c266ae065494 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:50.027785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d185194f-e24c-48c4-b09b-c266ae065494 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:50.029549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d185194f-e24c-48c4-b09b-c266ae065494 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:50.193676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:50.562698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d185194f-e24c-48c4-b09b-c266ae065494 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:50.574215 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d185194f-e24c-48c4-b09b-c266ae065494 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1294 microversion: 2.1 time: 0.602447 Oct 27 18:53:50.579563 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1034/2086] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:49 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1294 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:50.985016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-934c55df-87ab-4ab2-bf9f-505cc884fcbe tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873303ee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:50.993870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c35f5021-309f-4cf8-bd8b-cf8c533ae31f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:51.009123 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c35f5021-309f-4cf8-bd8b-cf8c533ae31f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1316 microversion: 2.1 time: 1.495447 Oct 27 18:53:51.009712 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1053/2087] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:49 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1316 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:51.080215 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-934c55df-87ab-4ab2-bf9f-505cc884fcbe tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.098911 Oct 27 18:53:51.080793 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1035/2088] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:50 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:51.604316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6bc4127e-04f8-4396-aa6a-ffd06aa7932b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:51.605012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6bc4127e-04f8-4396-aa6a-ffd06aa7932b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:51.622002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc4127e-04f8-4396-aa6a-ffd06aa7932b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:51.623518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc4127e-04f8-4396-aa6a-ffd06aa7932b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:51.624151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc4127e-04f8-4396-aa6a-ffd06aa7932b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:51.625084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc4127e-04f8-4396-aa6a-ffd06aa7932b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:51.625773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc4127e-04f8-4396-aa6a-ffd06aa7932b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:51.626409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc4127e-04f8-4396-aa6a-ffd06aa7932b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:52.035927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f801c159-25c1-4f3f-a5d0-7579741e320b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:52.037350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f801c159-25c1-4f3f-a5d0-7579741e320b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:52.050204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f801c159-25c1-4f3f-a5d0-7579741e320b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:52.055349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f801c159-25c1-4f3f-a5d0-7579741e320b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:52.056040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f801c159-25c1-4f3f-a5d0-7579741e320b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:52.057038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f801c159-25c1-4f3f-a5d0-7579741e320b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:52.057654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f801c159-25c1-4f3f-a5d0-7579741e320b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:52.058233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f801c159-25c1-4f3f-a5d0-7579741e320b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:52.184062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6bc4127e-04f8-4396-aa6a-ffd06aa7932b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:52.198053 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6bc4127e-04f8-4396-aa6a-ffd06aa7932b tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1294 microversion: 2.1 time: 0.594509 Oct 27 18:53:52.199766 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1054/2089] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:51 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1294 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:52.219184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d2d05723-fa05-4ea3-b024-329fcaacad5d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a7d1550>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:52.317360 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d2d05723-fa05-4ea3-b024-329fcaacad5d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.114826 Oct 27 18:53:52.320838 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1055/2090] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:52 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:53.223401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e81b8cec-f0bc-4d8f-aa31-51add0ffbed7 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:53.227052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e81b8cec-f0bc-4d8f-aa31-51add0ffbed7 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:53.243855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e81b8cec-f0bc-4d8f-aa31-51add0ffbed7 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:53.244743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e81b8cec-f0bc-4d8f-aa31-51add0ffbed7 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:53.245462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e81b8cec-f0bc-4d8f-aa31-51add0ffbed7 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:53.246421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e81b8cec-f0bc-4d8f-aa31-51add0ffbed7 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:53.247099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e81b8cec-f0bc-4d8f-aa31-51add0ffbed7 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:53.247778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e81b8cec-f0bc-4d8f-aa31-51add0ffbed7 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:53.345891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f801c159-25c1-4f3f-a5d0-7579741e320b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:53.359213 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f801c159-25c1-4f3f-a5d0-7579741e320b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1316 microversion: 2.1 time: 1.326610 Oct 27 18:53:53.360081 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1036/2091] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:52 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1316 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:53.382654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7b1795b-421d-4bd7-9109-293d86ed01eb tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc8733093a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:53.480290 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7b1795b-421d-4bd7-9109-293d86ed01eb tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.118786 Oct 27 18:53:53.480922 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1037/2092] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:53 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:53.764903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e81b8cec-f0bc-4d8f-aa31-51add0ffbed7 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:53.800817 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e81b8cec-f0bc-4d8f-aa31-51add0ffbed7 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1485 microversion: 2.1 time: 0.579969 Oct 27 18:53:53.801814 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1056/2093] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:53 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1485 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:53.829079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eed25048-51d1-4557-a7d8-36ea5d9264ae tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:53.829583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eed25048-51d1-4557-a7d8-36ea5d9264ae tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:53.841788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eed25048-51d1-4557-a7d8-36ea5d9264ae tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:53.844046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eed25048-51d1-4557-a7d8-36ea5d9264ae tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:53.844648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eed25048-51d1-4557-a7d8-36ea5d9264ae tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:53.845558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eed25048-51d1-4557-a7d8-36ea5d9264ae tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:53.849051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eed25048-51d1-4557-a7d8-36ea5d9264ae tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:53.850188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eed25048-51d1-4557-a7d8-36ea5d9264ae tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:54.125722 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eed25048-51d1-4557-a7d8-36ea5d9264ae tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.300719 Oct 27 18:53:54.136560 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1038/2094] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 18:53:53 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546/os-interface => generated 284 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:54.386748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8b9ff12a-2654-42c3-b0a1-b660b0886b8c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:54.387382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8b9ff12a-2654-42c3-b0a1-b660b0886b8c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:54.403816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9ff12a-2654-42c3-b0a1-b660b0886b8c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:54.404585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9ff12a-2654-42c3-b0a1-b660b0886b8c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:54.405204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9ff12a-2654-42c3-b0a1-b660b0886b8c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:54.406076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9ff12a-2654-42c3-b0a1-b660b0886b8c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:54.406715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9ff12a-2654-42c3-b0a1-b660b0886b8c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:54.407612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9ff12a-2654-42c3-b0a1-b660b0886b8c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:54.498588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7136c8c7-6e0d-4c23-8ded-794a31e54b01 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc87335f0d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:54.561174 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7136c8c7-6e0d-4c23-8ded-794a31e54b01 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.067461 Oct 27 18:53:54.564491 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1039/2095] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:54 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:55.579920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a98ffc02-b782-42b9-a4e2-68bc799ba866 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc87334b160>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:55.657294 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a98ffc02-b782-42b9-a4e2-68bc799ba866 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.082186 Oct 27 18:53:55.659812 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1040/2096] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:55 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:55.906911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8b9ff12a-2654-42c3-b0a1-b660b0886b8c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:55.920871 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8b9ff12a-2654-42c3-b0a1-b660b0886b8c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1316 microversion: 2.1 time: 1.537353 Oct 27 18:53:55.924180 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1057/2097] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:54 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1316 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:56.675280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3d26da8e-d400-4e8d-8f59-6d7fc2a12d5e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc8733099d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:56.759451 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3d26da8e-d400-4e8d-8f59-6d7fc2a12d5e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.089070 Oct 27 18:53:56.760700 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1041/2098] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:56 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:56.950507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c745e4a3-c2ae-4586-94d3-6f23026ff415 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:56.951485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c745e4a3-c2ae-4586-94d3-6f23026ff415 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:56.969280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c745e4a3-c2ae-4586-94d3-6f23026ff415 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:56.969787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c745e4a3-c2ae-4586-94d3-6f23026ff415 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:56.970245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c745e4a3-c2ae-4586-94d3-6f23026ff415 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:56.971024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c745e4a3-c2ae-4586-94d3-6f23026ff415 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:56.971498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c745e4a3-c2ae-4586-94d3-6f23026ff415 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:56.972116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c745e4a3-c2ae-4586-94d3-6f23026ff415 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:57.778987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd18a3b9-9562-4292-be1b-3e2d1e714a78 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc87330a0d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:57.874040 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bd18a3b9-9562-4292-be1b-3e2d1e714a78 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.101190 Oct 27 18:53:57.882469 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1042/2099] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:57 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:58.405719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c3479166-6fed-4e49-b971-85693e7c1d19 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:58.406349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c3479166-6fed-4e49-b971-85693e7c1d19 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:58.411055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:58.432548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3479166-6fed-4e49-b971-85693e7c1d19 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:58.433056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3479166-6fed-4e49-b971-85693e7c1d19 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:58.435268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3479166-6fed-4e49-b971-85693e7c1d19 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:58.453869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3479166-6fed-4e49-b971-85693e7c1d19 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:58.454684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3479166-6fed-4e49-b971-85693e7c1d19 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:58.455836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3479166-6fed-4e49-b971-85693e7c1d19 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:58.764318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c745e4a3-c2ae-4586-94d3-6f23026ff415 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:58.773443 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c745e4a3-c2ae-4586-94d3-6f23026ff415 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1316 microversion: 2.1 time: 1.826917 Oct 27 18:53:58.783055 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1058/2100] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:56 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1316 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:58.789182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-cb2eb341-ddd3-4870-8de5-d444fc4f42e2 req-e0c5be51-64dd-4b2b-9f69-6743627bab91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cbe523-eacc-4725-bb27-dd16d1609546", "tag": "1d3a53ad-9130-41c9-89de-5938f71a59bc"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:58.817523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cb2eb341-ddd3-4870-8de5-d444fc4f42e2 req-e0c5be51-64dd-4b2b-9f69-6743627bab91 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:58.818894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cb2eb341-ddd3-4870-8de5-d444fc4f42e2 req-e0c5be51-64dd-4b2b-9f69-6743627bab91 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:58.819509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cb2eb341-ddd3-4870-8de5-d444fc4f42e2 req-e0c5be51-64dd-4b2b-9f69-6743627bab91 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:58.853124 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-cb2eb341-ddd3-4870-8de5-d444fc4f42e2 req-e0c5be51-64dd-4b2b-9f69-6743627bab91 service nova] Creating event network-changed:1d3a53ad-9130-41c9-89de-5938f71a59bc for instance 84cbe523-eacc-4725-bb27-dd16d1609546 on n-h1-860687-3 Oct 27 18:53:58.868948 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-cb2eb341-ddd3-4870-8de5-d444fc4f42e2 req-e0c5be51-64dd-4b2b-9f69-6743627bab91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081870 Oct 27 18:53:58.871657 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1059/2101] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:53:58.890856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4437eb2d-2a85-423d-8d36-a0f5279abd8a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b0390d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:58.969057 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4437eb2d-2a85-423d-8d36-a0f5279abd8a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.082448 Oct 27 18:53:58.975756 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1060/2102] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:58 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:53:59.431119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-198be05e-097b-4468-b673-65f97fad7f3a req-801a8255-7378-4df2-aca8-aea1d2892a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e311e1-6dd0-4498-897c-c92ce762d9b9", "name": "network-vif-plugged", "status": "completed", "tag": "5e0a3a4e-0c02-4bfb-b6c9-0aefa83bc658"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:53:59.472439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-198be05e-097b-4468-b673-65f97fad7f3a req-801a8255-7378-4df2-aca8-aea1d2892a03 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:59.473001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-198be05e-097b-4468-b673-65f97fad7f3a req-801a8255-7378-4df2-aca8-aea1d2892a03 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:59.473457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-198be05e-097b-4468-b673-65f97fad7f3a req-801a8255-7378-4df2-aca8-aea1d2892a03 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:59.532414 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-198be05e-097b-4468-b673-65f97fad7f3a req-801a8255-7378-4df2-aca8-aea1d2892a03 service nova] Creating event network-vif-plugged:5e0a3a4e-0c02-4bfb-b6c9-0aefa83bc658 for instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 on n-h2-860687-3 Oct 27 18:53:59.548429 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-198be05e-097b-4468-b673-65f97fad7f3a req-801a8255-7378-4df2-aca8-aea1d2892a03 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121722 Oct 27 18:53:59.550964 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1061/2103] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:53:59.815832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a5da85cd-8c88-4e77-b522-016503b73ce9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:53:59.816520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a5da85cd-8c88-4e77-b522-016503b73ce9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:53:59.822896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c3479166-6fed-4e49-b971-85693e7c1d19 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:53:59.826308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:53:59.831292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5da85cd-8c88-4e77-b522-016503b73ce9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:59.835559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5da85cd-8c88-4e77-b522-016503b73ce9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:59.836268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5da85cd-8c88-4e77-b522-016503b73ce9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:59.836838 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c3479166-6fed-4e49-b971-85693e7c1d19 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1485 microversion: 2.1 time: 1.441864 Oct 27 18:53:59.837412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5da85cd-8c88-4e77-b522-016503b73ce9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:53:59.837517 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1043/2104] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:58 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1485 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:53:59.851672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5da85cd-8c88-4e77-b522-016503b73ce9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:53:59.852357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5da85cd-8c88-4e77-b522-016503b73ce9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:53:59.986902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8da5a08f-d57a-4a50-b178-8e2420870db9 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc87335eaf0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:00.078254 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8da5a08f-d57a-4a50-b178-8e2420870db9 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.095079 Oct 27 18:54:00.082192 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1044/2105] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:53:59 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:54:00.206702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a5da85cd-8c88-4e77-b522-016503b73ce9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:00.220767 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a5da85cd-8c88-4e77-b522-016503b73ce9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1316 microversion: 2.1 time: 0.412728 Oct 27 18:54:00.221741 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1062/2106] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:53:59 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:54:01.098877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ad2c20f6-1352-461c-acad-4b40b4fb401e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc8733094c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:01.170092 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ad2c20f6-1352-461c-acad-4b40b4fb401e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.076493 Oct 27 18:54:01.170990 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1045/2107] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:01 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:01.248849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5d5baa6e-a614-4685-98ae-76db3cfe3dfa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:01.249491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5d5baa6e-a614-4685-98ae-76db3cfe3dfa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:01.262783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5baa6e-a614-4685-98ae-76db3cfe3dfa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:01.273973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5baa6e-a614-4685-98ae-76db3cfe3dfa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:01.274683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5baa6e-a614-4685-98ae-76db3cfe3dfa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:01.275482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5baa6e-a614-4685-98ae-76db3cfe3dfa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:01.275973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5baa6e-a614-4685-98ae-76db3cfe3dfa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:01.277905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5baa6e-a614-4685-98ae-76db3cfe3dfa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:01.732214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5d5baa6e-a614-4685-98ae-76db3cfe3dfa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:01.748622 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5d5baa6e-a614-4685-98ae-76db3cfe3dfa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1316 microversion: 2.1 time: 0.503885 Oct 27 18:54:01.749523 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1063/2108] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:01 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:02.188444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c43e0508-2850-493e-a79e-c39f795034c6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc87330b1f0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:02.306055 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c43e0508-2850-493e-a79e-c39f795034c6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.121606 Oct 27 18:54:02.310051 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1046/2109] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:02 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:02.774293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f192f9b0-662d-458f-b6a9-851c10bd958e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:02.775973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f192f9b0-662d-458f-b6a9-851c10bd958e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:02.814981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f192f9b0-662d-458f-b6a9-851c10bd958e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:02.820288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f192f9b0-662d-458f-b6a9-851c10bd958e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:02.821118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f192f9b0-662d-458f-b6a9-851c10bd958e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:02.824529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f192f9b0-662d-458f-b6a9-851c10bd958e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:02.825192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f192f9b0-662d-458f-b6a9-851c10bd958e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:02.825825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f192f9b0-662d-458f-b6a9-851c10bd958e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:03.323904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4f22b06f-f9ae-428c-83fa-a5d1617abae8 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc87337caf0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:03.425803 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4f22b06f-f9ae-428c-83fa-a5d1617abae8 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.103133 Oct 27 18:54:03.426612 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1047/2110] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:03 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:03.454566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f192f9b0-662d-458f-b6a9-851c10bd958e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:03.468594 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f192f9b0-662d-458f-b6a9-851c10bd958e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.698663 Oct 27 18:54:03.488868 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1064/2111] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:02 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:03.702062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-730814460", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:03.873842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] validate_networks() for [('969dfa55-7bd6-4101-b2b3-c0ca6c6378eb', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:54:04.465256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-32a01609-995f-4576-9537-c0a7a7202c2c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b0c40d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:04.574671 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-32a01609-995f-4576-9537-c0a7a7202c2c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.137163 Oct 27 18:54:04.576354 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1065/2112] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:04 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:54:05.495556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:54:05.497319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:54:05.498333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:54:05.501661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:54:05.502733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:54:05.515232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:05.515932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:05.516657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:05.517625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:05.518290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:05.518951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:05.543425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Getting quotas for project 4b90de1493a5422ba51e27b6241725c8. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:54:05.555426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Getting quotas for user 834fdde034434a19aec0129ef2d744df and project 4b90de1493a5422ba51e27b6241725c8. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:54:05.570849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:54:05.573883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:54:05.591136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aacd822e-afca-431e-be6a-ea76061f7851 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a8a9550>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:05.645553 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-65858316-2803-47ca-8839-79fc74f1ea72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.948534 Oct 27 18:54:05.646906 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1048/2113] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:54:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:54:05.659033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b5363731-3d08-4eba-8305-fb9b7d411568 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:05.659930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b5363731-3d08-4eba-8305-fb9b7d411568 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:05.684464 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aacd822e-afca-431e-be6a-ea76061f7851 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.090903 Oct 27 18:54:05.685468 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1066/2114] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:05 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:05.929321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b5363731-3d08-4eba-8305-fb9b7d411568 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:05.944823 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b5363731-3d08-4eba-8305-fb9b7d411568 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1216 microversion: 2.1 time: 0.286154 Oct 27 18:54:05.964294 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1049/2115] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:05 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1216 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:54:06.701618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-377d9367-5cd6-48f1-ad99-77279dbd41a7 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86ae85280>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:06.790660 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-377d9367-5cd6-48f1-ad99-77279dbd41a7 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.093663 Oct 27 18:54:06.791383 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1067/2116] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:06 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:06.969176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-de14ac8b-e42b-4d13-bd27-dcac923d7a3c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:06.970612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-de14ac8b-e42b-4d13-bd27-dcac923d7a3c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:06.984812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de14ac8b-e42b-4d13-bd27-dcac923d7a3c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:07.005822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de14ac8b-e42b-4d13-bd27-dcac923d7a3c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:07.013383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de14ac8b-e42b-4d13-bd27-dcac923d7a3c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:07.014910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de14ac8b-e42b-4d13-bd27-dcac923d7a3c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:07.016840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de14ac8b-e42b-4d13-bd27-dcac923d7a3c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:07.018357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de14ac8b-e42b-4d13-bd27-dcac923d7a3c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:07.246735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-de14ac8b-e42b-4d13-bd27-dcac923d7a3c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:07.255994 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-de14ac8b-e42b-4d13-bd27-dcac923d7a3c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1212 microversion: 2.1 time: 0.290105 Oct 27 18:54:07.269104 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1050/2117] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:06 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1212 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:07.812214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-be4ee221-bb86-415d-aacc-d614fb44f66a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86ad9adc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:07.947569 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-be4ee221-bb86-415d-aacc-d614fb44f66a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.145208 Oct 27 18:54:07.956318 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1068/2118] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:07 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:08.297138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-49edfc50-de13-4a19-8db8-555120343e43 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:08.298679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-49edfc50-de13-4a19-8db8-555120343e43 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:08.311978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49edfc50-de13-4a19-8db8-555120343e43 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:08.314255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49edfc50-de13-4a19-8db8-555120343e43 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:08.317701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49edfc50-de13-4a19-8db8-555120343e43 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:08.320292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49edfc50-de13-4a19-8db8-555120343e43 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:08.324059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49edfc50-de13-4a19-8db8-555120343e43 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:08.325472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49edfc50-de13-4a19-8db8-555120343e43 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:08.821879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-49edfc50-de13-4a19-8db8-555120343e43 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:08.838859 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-49edfc50-de13-4a19-8db8-555120343e43 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1274 microversion: 2.1 time: 0.539491 Oct 27 18:54:08.840826 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1051/2119] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:08 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1274 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:08.965841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-946d2150-9c5e-4872-810b-59b7e5bf6e19 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b0075e0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:09.060109 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-946d2150-9c5e-4872-810b-59b7e5bf6e19 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.100296 Oct 27 18:54:09.061136 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1069/2120] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:08 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:09.516127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-05460fc6-b2fe-4794-a705-90fa86c21358 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:09.526525 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-05460fc6-b2fe-4794-a705-90fa86c21358 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.236130 Oct 27 18:54:09.527209 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1052/2121] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:54:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:09.543166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b71ba92-942d-4f81-bb03-888dfaac3ccb tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:09.603315 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1b71ba92-942d-4f81-bb03-888dfaac3ccb tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.065044 Oct 27 18:54:09.607932 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1070/2122] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 18:54:09 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:09.625081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ea43cd79-2e00-4bbb-9c36-58059aaf7864 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:09.635590 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ea43cd79-2e00-4bbb-9c36-58059aaf7864 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015339 Oct 27 18:54:09.640979 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1053/2123] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:54:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:09.654672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a7496306-9d8b-494d-b5d3-d6e66c88acd3 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:09.670148 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a7496306-9d8b-494d-b5d3-d6e66c88acd3 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014827 Oct 27 18:54:09.671626 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1071/2124] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:54:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:09.687054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9fec9175-8968-4101-bf4e-d5baf7ee21a0 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:09.727756 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9fec9175-8968-4101-bf4e-d5baf7ee21a0 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.046188 Oct 27 18:54:09.728966 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1054/2125] 10.222.0.42 () {58 vars in 1165 bytes} [Thu Oct 27 18:54:09 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:09.750061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bffa4bc0-05f2-47c7-a8ca-a04c1ad23e75 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:09.771567 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bffa4bc0-05f2-47c7-a8ca-a04c1ad23e75 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026248 Oct 27 18:54:09.772870 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1072/2126] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:54:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:09.788790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d1a6e8c3-3535-4e2b-8f4f-52b52c7e6a9b tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:09.867474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-39481ae3-b759-4f02-bbcf-6ccbcf1f2d72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:09.868584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-39481ae3-b759-4f02-bbcf-6ccbcf1f2d72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:09.878913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39481ae3-b759-4f02-bbcf-6ccbcf1f2d72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:09.882480 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d1a6e8c3-3535-4e2b-8f4f-52b52c7e6a9b tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.099489 Oct 27 18:54:09.884853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39481ae3-b759-4f02-bbcf-6ccbcf1f2d72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:09.888034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39481ae3-b759-4f02-bbcf-6ccbcf1f2d72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:09.896214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39481ae3-b759-4f02-bbcf-6ccbcf1f2d72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:09.899586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39481ae3-b759-4f02-bbcf-6ccbcf1f2d72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:09.899788 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1055/2127] 10.222.0.42 () {58 vars in 1169 bytes} [Thu Oct 27 18:54:09 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:09.902568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39481ae3-b759-4f02-bbcf-6ccbcf1f2d72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:09.906811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-224fc281-d6a5-44fb-8050-c261c90f34e8 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:09.931916 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-224fc281-d6a5-44fb-8050-c261c90f34e8 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.030632 Oct 27 18:54:09.947746 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1056/2128] 10.222.0.42 () {58 vars in 1161 bytes} [Thu Oct 27 18:54:09 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:09.957328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-83a22e8a-4e96-4aab-9089-b1f722544bff tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:09.970860 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-83a22e8a-4e96-4aab-9089-b1f722544bff tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021412 Oct 27 18:54:09.971819 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1057/2129] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:54:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:09.992074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ec5f2de2-72ea-467e-87be-af6108080f43 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:10.055512 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ec5f2de2-72ea-467e-87be-af6108080f43 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.072668 Oct 27 18:54:10.056728 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1058/2130] 10.222.0.42 () {58 vars in 1167 bytes} [Thu Oct 27 18:54:09 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:10.076140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a6a65749-8170-4b3c-b660-1b8f0be9f9b1 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:10.086373 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a6a65749-8170-4b3c-b660-1b8f0be9f9b1 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014527 Oct 27 18:54:10.087572 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1059/2131] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:54:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:10.134580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae9e40f5-e5a9-4d47-8dbb-b2f5490841c6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc87330a550>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:10.228095 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ae9e40f5-e5a9-4d47-8dbb-b2f5490841c6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.130985 Oct 27 18:54:10.235311 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1060/2132] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:10 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:10.248441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5b1f235d-22a9-4c8f-a921-a65c7bfa003f tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:10.276172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-39481ae3-b759-4f02-bbcf-6ccbcf1f2d72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:10.284316 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-39481ae3-b759-4f02-bbcf-6ccbcf1f2d72 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1274 microversion: 2.1 time: 0.421595 Oct 27 18:54:10.308633 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1073/2133] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:09 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1274 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:54:10.316339 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5b1f235d-22a9-4c8f-a921-a65c7bfa003f tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.071480 Oct 27 18:54:10.323655 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1061/2134] 10.222.0.42 () {58 vars in 1144 bytes} [Thu Oct 27 18:54:10 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:10.335524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-592faa2a-9f8b-451c-b005-569d1c99859e tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:10.345846 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-592faa2a-9f8b-451c-b005-569d1c99859e tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015340 Oct 27 18:54:10.351472 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1074/2135] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:54:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:10.363891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ce7d585-f185-4a0b-9f99-8594d49bf247 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:10.394114 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5ce7d585-f185-4a0b-9f99-8594d49bf247 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.034215 Oct 27 18:54:10.402191 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1062/2136] 10.222.0.42 () {58 vars in 1148 bytes} [Thu Oct 27 18:54:10 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:10.418632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7aec5df9-b20d-4a72-b640-19137ab1fc20 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:10.443173 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7aec5df9-b20d-4a72-b640-19137ab1fc20 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.028791 Oct 27 18:54:10.463213 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1075/2137] 10.222.0.42 () {58 vars in 1140 bytes} [Thu Oct 27 18:54:10 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:10.471245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5423a4c3-e6fe-46de-ae9a-77e26084fa7d tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:10.490089 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5423a4c3-e6fe-46de-ae9a-77e26084fa7d tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023097 Oct 27 18:54:10.498055 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1063/2138] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:54:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:10.503900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-37ef00ff-05e8-4f7c-a139-68aa931c885a tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:10.585745 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-37ef00ff-05e8-4f7c-a139-68aa931c885a tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.086111 Oct 27 18:54:10.593639 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1076/2139] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:54:10 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:10.614367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-99077ba4-221c-42d2-aef2-a335a46184b2 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:10.695594 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-99077ba4-221c-42d2-aef2-a335a46184b2 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089252 Oct 27 18:54:10.699892 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1064/2140] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:54:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:10.720083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-99c96797-6a0f-4b4f-97dc-5d9a08b1c385 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:10.732497 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-99c96797-6a0f-4b4f-97dc-5d9a08b1c385 tempest-FlavorsV2TestJSON-601708515 tempest-FlavorsV2TestJSON-601708515-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016704 Oct 27 18:54:10.735153 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1077/2141] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:54:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:11.251785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-87d9a139-18f8-4717-bce4-986e2e3f7e27 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873303790>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:11.329722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cccd8741-2ed3-4b4b-b229-dc3490f3704e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:11.331153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cccd8741-2ed3-4b4b-b229-dc3490f3704e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:11.365299 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-87d9a139-18f8-4717-bce4-986e2e3f7e27 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.117414 Oct 27 18:54:11.386366 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1065/2142] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:11 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:11.421225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cccd8741-2ed3-4b4b-b229-dc3490f3704e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:11.425942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cccd8741-2ed3-4b4b-b229-dc3490f3704e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:11.426535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cccd8741-2ed3-4b4b-b229-dc3490f3704e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:11.436540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cccd8741-2ed3-4b4b-b229-dc3490f3704e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:11.437044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cccd8741-2ed3-4b4b-b229-dc3490f3704e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:11.440070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cccd8741-2ed3-4b4b-b229-dc3490f3704e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:11.623682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cccd8741-2ed3-4b4b-b229-dc3490f3704e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:11.634523 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cccd8741-2ed3-4b4b-b229-dc3490f3704e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1274 microversion: 2.1 time: 0.315650 Oct 27 18:54:11.637151 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1078/2143] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:11 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1274 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:54:12.395483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-92687d61-7494-454c-9b30-524bf75007b7 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a984940>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:12.464994 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-92687d61-7494-454c-9b30-524bf75007b7 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.074683 Oct 27 18:54:12.465457 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1079/2144] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:12 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:12.497508 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e4681922-fb36-45b8-815b-36259a4164b2 tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] 10.222.0.42 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.290360 Oct 27 18:54:12.498975 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1066/2145] 10.222.0.42 () {58 vars in 1128 bytes} [Thu Oct 27 18:54:12 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 18:54:12.510232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ab5f55bc-28c3-44ad-9bbe-a6066cb10f9c tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Calling method '.version_select at 0x7fc86a8bd9d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:12.566409 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-ab5f55bc-28c3-44ad-9bbe-a6066cb10f9c tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] HTTP exception thrown: Image not found. Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ab5f55bc-28c3-44ad-9bbe-a6066cb10f9c tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Request method failure captured: Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPTj960vPIZZYxLlogkkt6y67FsbMHzdTvIH6Fk4KK4O1f_CDV_h4mFgU0P_jiPRoBtVnJxHya0Ow4PDgdhCqt1Q9eiNw4baxXBJVBz4GgfXIk7jLDU_B_fiOIfQQN-eZeLXz-PaDAYI2xvIk6wtHGJT0kwftiikTmjvo3WfpKkG-g Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: e53d32f32fbd40a98497139afd4bb867 Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e53d32f32fbd40a98497139afd4bb867", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: e53d32f32fbd40a98497139afd4bb867 Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesDeleteNegativeTestJSON-806701622-project Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b10a0474d8d14948a81206499057d73f Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-806701622-project Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: exception: Image not found. Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '-1'} Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.568870 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ab5f55bc-28c3-44ad-9bbe-a6066cb10f9c tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Returning 404 to user: Image not found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:12.572678 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ab5f55bc-28c3-44ad-9bbe-a6066cb10f9c tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] 10.222.0.42 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.065734 Oct 27 18:54:12.576593 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1080/2146] 10.222.0.42 () {58 vars in 1134 bytes} [Thu Oct 27 18:54:12 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:54:12.591718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf5391a2-f9b5-47ad-bfd1-fa93f2d93985 tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Calling method '.version_select at 0x7fc873309ee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:12.633719 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-bf5391a2-f9b5-47ad-bfd1-fa93f2d93985 tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] HTTP exception thrown: Image not found. Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf5391a2-f9b5-47ad-bfd1-fa93f2d93985 tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Request method failure captured: Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/images/cc6d9021-a9c2-4640-a996-e652bb2f7d3j HTTP/1.1 Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPTj960vPIZZYxLlogkkt6y67FsbMHzdTvIH6Fk4KK4O1f_CDV_h4mFgU0P_jiPRoBtVnJxHya0Ow4PDgdhCqt1Q9eiNw4baxXBJVBz4GgfXIk7jLDU_B_fiOIfQQN-eZeLXz-PaDAYI2xvIk6wtHGJT0kwftiikTmjvo3WfpKkG-g Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: e53d32f32fbd40a98497139afd4bb867 Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e53d32f32fbd40a98497139afd4bb867", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: e53d32f32fbd40a98497139afd4bb867 Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesDeleteNegativeTestJSON-806701622-project Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b10a0474d8d14948a81206499057d73f Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-806701622-project Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: exception: Image not found. Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'cc6d9021-a9c2-4640-a996-e652bb2f7d3j'} Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cc6d9021-a9c2-4640-a996-e652bb2f7d3j to delete Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cc6d9021-a9c2-4640-a996-e652bb2f7d3j could not be found. Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.637219 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 18:54:12.644769 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.650896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf5391a2-f9b5-47ad-bfd1-fa93f2d93985 tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Returning 404 to user: Image not found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:12.652289 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf5391a2-f9b5-47ad-bfd1-fa93f2d93985 tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] 10.222.0.42 "DELETE /compute/v2.1/images/cc6d9021-a9c2-4640-a996-e652bb2f7d3j" status: 404 len: 62 microversion: 2.1 time: 0.074793 Oct 27 18:54:12.654496 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1067/2147] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:12 2022] DELETE /compute/v2.1/images/cc6d9021-a9c2-4640-a996-e652bb2f7d3j => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:54:12.664500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4eae58a2-0cd1-444c-b454-83f503a187bd tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Calling method '.version_select at 0x7fc86a8bdaf0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:12.682394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fdb86edd-3315-48eb-9f23-74c683a8cc20 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:12.694774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fdb86edd-3315-48eb-9f23-74c683a8cc20 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:12.704062 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-4eae58a2-0cd1-444c-b454-83f503a187bd tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] HTTP exception thrown: Image not found. Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4eae58a2-0cd1-444c-b454-83f503a187bd tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Request method failure captured: Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/images/fc9e3601-2e8c-4e16-a31b-772c50acba691 HTTP/1.1 Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPTj960vPIZZYxLlogkkt6y67FsbMHzdTvIH6Fk4KK4O1f_CDV_h4mFgU0P_jiPRoBtVnJxHya0Ow4PDgdhCqt1Q9eiNw4baxXBJVBz4GgfXIk7jLDU_B_fiOIfQQN-eZeLXz-PaDAYI2xvIk6wtHGJT0kwftiikTmjvo3WfpKkG-g Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: e53d32f32fbd40a98497139afd4bb867 Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e53d32f32fbd40a98497139afd4bb867", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: e53d32f32fbd40a98497139afd4bb867 Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesDeleteNegativeTestJSON-806701622-project Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b10a0474d8d14948a81206499057d73f Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-806701622-project Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: exception: Image not found. Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'fc9e3601-2e8c-4e16-a31b-772c50acba691'} Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fc9e3601-2e8c-4e16-a31b-772c50acba691 to delete Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fc9e3601-2e8c-4e16-a31b-772c50acba691 could not be found. Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.705858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.710217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4eae58a2-0cd1-444c-b454-83f503a187bd tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Returning 404 to user: Image not found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:12.713517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdb86edd-3315-48eb-9f23-74c683a8cc20 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:12.714233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdb86edd-3315-48eb-9f23-74c683a8cc20 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:12.714859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdb86edd-3315-48eb-9f23-74c683a8cc20 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:12.715790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdb86edd-3315-48eb-9f23-74c683a8cc20 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:12.716994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdb86edd-3315-48eb-9f23-74c683a8cc20 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:12.718956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdb86edd-3315-48eb-9f23-74c683a8cc20 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:12.724814 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4eae58a2-0cd1-444c-b454-83f503a187bd tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] 10.222.0.42 "DELETE /compute/v2.1/images/fc9e3601-2e8c-4e16-a31b-772c50acba691" status: 404 len: 62 microversion: 2.1 time: 0.047084 Oct 27 18:54:12.725443 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1081/2148] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:54:12 2022] DELETE /compute/v2.1/images/fc9e3601-2e8c-4e16-a31b-772c50acba691 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:54:12.747141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7ed9f05f-3c02-4cc1-9b17-178f3ed79e2b tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Calling method '.version_select at 0x7fc86afd0940>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:12.812692 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-7ed9f05f-3c02-4cc1-9b17-178f3ed79e2b tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] HTTP exception thrown: Image not found. Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7ed9f05f-3c02-4cc1-9b17-178f3ed79e2b tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Request method failure captured: Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/images/tempest-invalid-1252560547 HTTP/1.1 Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPTj960vPIZZYxLlogkkt6y67FsbMHzdTvIH6Fk4KK4O1f_CDV_h4mFgU0P_jiPRoBtVnJxHya0Ow4PDgdhCqt1Q9eiNw4baxXBJVBz4GgfXIk7jLDU_B_fiOIfQQN-eZeLXz-PaDAYI2xvIk6wtHGJT0kwftiikTmjvo3WfpKkG-g Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: e53d32f32fbd40a98497139afd4bb867 Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e53d32f32fbd40a98497139afd4bb867", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: e53d32f32fbd40a98497139afd4bb867 Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesDeleteNegativeTestJSON-806701622-project Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b10a0474d8d14948a81206499057d73f Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-806701622-project Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: exception: Image not found. Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'tempest-invalid-1252560547'} Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1252560547 to delete Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1252560547 could not be found. Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.815685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7ed9f05f-3c02-4cc1-9b17-178f3ed79e2b tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Returning 404 to user: Image not found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:12.820202 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7ed9f05f-3c02-4cc1-9b17-178f3ed79e2b tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] 10.222.0.42 "DELETE /compute/v2.1/images/tempest-invalid-1252560547" status: 404 len: 62 microversion: 2.1 time: 0.079641 Oct 27 18:54:12.830906 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1082/2149] 10.222.0.42 () {58 vars in 1206 bytes} [Thu Oct 27 18:54:12 2022] DELETE /compute/v2.1/images/tempest-invalid-1252560547 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:54:12.842184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de45890a-556a-4ea8-9002-6a5748837af0 tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Calling method '.version_select at 0x7fc86b2f5ee0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:12.886823 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-de45890a-556a-4ea8-9002-6a5748837af0 tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] HTTP exception thrown: Image not found. Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de45890a-556a-4ea8-9002-6a5748837af0 tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Request method failure captured: Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/images/57590a9f-5e9c-417e-b325-7644be001a96 HTTP/1.1 Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPTj960vPIZZYxLlogkkt6y67FsbMHzdTvIH6Fk4KK4O1f_CDV_h4mFgU0P_jiPRoBtVnJxHya0Ow4PDgdhCqt1Q9eiNw4baxXBJVBz4GgfXIk7jLDU_B_fiOIfQQN-eZeLXz-PaDAYI2xvIk6wtHGJT0kwftiikTmjvo3WfpKkG-g Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: e53d32f32fbd40a98497139afd4bb867 Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e53d32f32fbd40a98497139afd4bb867", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e53d32f32fbd40a98497139afd4bb867"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: e53d32f32fbd40a98497139afd4bb867 Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-806701622 Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesDeleteNegativeTestJSON-806701622-project Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b10a0474d8d14948a81206499057d73f Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-806701622-project Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: exception: Image not found. Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '57590a9f-5e9c-417e-b325-7644be001a96'} Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 57590a9f-5e9c-417e-b325-7644be001a96 to delete Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 57590a9f-5e9c-417e-b325-7644be001a96 could not be found. Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.888615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de45890a-556a-4ea8-9002-6a5748837af0 tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] Returning 404 to user: Image not found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-de45890a-556a-4ea8-9002-6a5748837af0 tempest-ImagesDeleteNegativeTestJSON-806701622 tempest-ImagesDeleteNegativeTestJSON-806701622-project] 10.222.0.42 "DELETE /compute/v2.1/images/57590a9f-5e9c-417e-b325-7644be001a96" status: 404 len: 62 microversion: 2.1 time: 0.058951 Oct 27 18:54:12.892239 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1083/2150] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:12 2022] DELETE /compute/v2.1/images/57590a9f-5e9c-417e-b325-7644be001a96 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:54:13.481704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e7ea992f-00b0-4e96-ac7e-3e934c1d410c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a8bd280>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:13.590290 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e7ea992f-00b0-4e96-ac7e-3e934c1d410c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.112970 Oct 27 18:54:13.606791 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1084/2151] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:13 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:14.607272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-17c8317e-dfea-454b-b3dc-276be0e6eb21 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a8bde50>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:14.686120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fdb86edd-3315-48eb-9f23-74c683a8cc20 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:14.700433 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fdb86edd-3315-48eb-9f23-74c683a8cc20 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1316 microversion: 2.1 time: 2.029773 Oct 27 18:54:14.710418 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-17c8317e-dfea-454b-b3dc-276be0e6eb21 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.098094 Oct 27 18:54:14.710656 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1068/2152] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:12 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1316 bytes in 2034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:14.717219 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1085/2153] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:14 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:15.768921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-70231d67-f369-4352-8dee-1c8d951e136a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:15.769610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-70231d67-f369-4352-8dee-1c8d951e136a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:15.772530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-df520258-4d01-4058-a4d7-16f076faa9a5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc87334b1f0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:15.798074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=55 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:15.820241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:15.825588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70231d67-f369-4352-8dee-1c8d951e136a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:15.826121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70231d67-f369-4352-8dee-1c8d951e136a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:15.835102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70231d67-f369-4352-8dee-1c8d951e136a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:15.836003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70231d67-f369-4352-8dee-1c8d951e136a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:15.836535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70231d67-f369-4352-8dee-1c8d951e136a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:15.836998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70231d67-f369-4352-8dee-1c8d951e136a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:15.924168 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-df520258-4d01-4058-a4d7-16f076faa9a5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.165468 Oct 27 18:54:15.928438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=85 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:15.930598 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1069/2154] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:15 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:16.371281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-70231d67-f369-4352-8dee-1c8d951e136a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:16.382360 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-70231d67-f369-4352-8dee-1c8d951e136a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1316 microversion: 2.1 time: 0.624891 Oct 27 18:54:16.385350 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1086/2155] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:15 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1316 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:16.941888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:16.948950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8e0d85e0-3214-44b8-8523-86b9fbddf451 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873309310>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:17.027425 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8e0d85e0-3214-44b8-8523-86b9fbddf451 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.085166 Oct 27 18:54:17.028238 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1070/2156] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:16 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:17.410032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-490f61af-2202-4b24-8a22-415a9118861a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:17.410730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-490f61af-2202-4b24-8a22-415a9118861a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:17.431421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-490f61af-2202-4b24-8a22-415a9118861a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:17.432263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-490f61af-2202-4b24-8a22-415a9118861a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:17.432980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-490f61af-2202-4b24-8a22-415a9118861a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:17.433947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-490f61af-2202-4b24-8a22-415a9118861a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:17.434672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-490f61af-2202-4b24-8a22-415a9118861a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:17.435383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-490f61af-2202-4b24-8a22-415a9118861a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:17.896666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-490f61af-2202-4b24-8a22-415a9118861a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:17.907297 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-490f61af-2202-4b24-8a22-415a9118861a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1316 microversion: 2.1 time: 0.504521 Oct 27 18:54:17.914122 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1087/2157] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:17 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1316 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:18.045617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bdc3aeb3-b614-44c7-a718-a2454e94f410 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc87335ea60>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:18.131856 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bdc3aeb3-b614-44c7-a718-a2454e94f410 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1452 microversion: 2.1 time: 0.092192 Oct 27 18:54:18.133235 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1071/2158] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:18 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:18.472594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d959f316-7a59-436b-8499-c5307d03ddaf req-67133027-1ca4-4f2f-bdd6-bafad7c2372f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "263ba238-b675-4ae7-a469-ced7d67f016a", "tag": "60da2023-14ac-4154-8f86-64e5b6e76b40"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:18.485632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d959f316-7a59-436b-8499-c5307d03ddaf req-67133027-1ca4-4f2f-bdd6-bafad7c2372f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:18.486376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d959f316-7a59-436b-8499-c5307d03ddaf req-67133027-1ca4-4f2f-bdd6-bafad7c2372f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:18.486998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d959f316-7a59-436b-8499-c5307d03ddaf req-67133027-1ca4-4f2f-bdd6-bafad7c2372f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:18.509715 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d959f316-7a59-436b-8499-c5307d03ddaf req-67133027-1ca4-4f2f-bdd6-bafad7c2372f service nova] Creating event network-changed:60da2023-14ac-4154-8f86-64e5b6e76b40 for instance 263ba238-b675-4ae7-a469-ced7d67f016a on n-h1-860687-3 Oct 27 18:54:18.515097 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d959f316-7a59-436b-8499-c5307d03ddaf req-67133027-1ca4-4f2f-bdd6-bafad7c2372f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047443 Oct 27 18:54:18.516699 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1088/2159] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:18.940828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-375c83fe-b8f7-4d0a-a862-752896297503 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Calling method '.version_select at 0x7fc86ac541f0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:18.959943 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-375c83fe-b8f7-4d0a-a862-752896297503 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] HTTP exception thrown: Image not found. Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-375c83fe-b8f7-4d0a-a862-752896297503 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Request method failure captured: Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/images/eca46376-f3fc-4a04-8b16-22f4699ae574/metadata/os_distro HTTP/1.1 Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPaCvn9f0SAXGv-6NKCNjpQDRL4nCwydJrccVN_GqjnbmKuFDD4lbR-K4dsboRNAu0TOLpEO9xRZte3BDawvcbpEX0JxpQYbld6jqyZdVQdL1k3xEeMmz_Ogd5WP79pLnMPEGeDUxGkvUtwrPdlNhZY1thLZ4or4-fQzV5h6MjAQTU Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: c0e3148b12964a099fc3dfdc0cfa4427 Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c0e3148b12964a099fc3dfdc0cfa4427", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: c0e3148b12964a099fc3dfdc0cfa4427 Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesMetadataNegativeTestJSON-199027044-project Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2105bedd11014b3b9fb75420b26dcbdb Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-199027044-project Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: exception: Image not found. Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'image_id': 'eca46376-f3fc-4a04-8b16-22f4699ae574', 'id': 'os_distro'} Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID eca46376-f3fc-4a04-8b16-22f4699ae574 Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 18:54:18.969080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eca46376-f3fc-4a04-8b16-22f4699ae574 could not be found. Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:18.973432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-375c83fe-b8f7-4d0a-a862-752896297503 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Returning 404 to user: Image not found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:18.978744 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-375c83fe-b8f7-4d0a-a862-752896297503 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] 10.222.0.42 "DELETE /compute/v2.1/images/eca46376-f3fc-4a04-8b16-22f4699ae574/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.316292 Oct 27 18:54:18.978744 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1072/2160] 10.222.0.42 () {58 vars in 1293 bytes} [Thu Oct 27 18:54:18 2022] DELETE /compute/v2.1/images/eca46376-f3fc-4a04-8b16-22f4699ae574/metadata/os_distro => generated 62 bytes in 320 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:54:18.985473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c988123b-3c16-4d89-9f41-4fadad83256d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:18.987766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c988123b-3c16-4d89-9f41-4fadad83256d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:19.000785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c988123b-3c16-4d89-9f41-4fadad83256d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:19.006046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c988123b-3c16-4d89-9f41-4fadad83256d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:19.006550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c988123b-3c16-4d89-9f41-4fadad83256d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:19.007321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c988123b-3c16-4d89-9f41-4fadad83256d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:19.010757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c988123b-3c16-4d89-9f41-4fadad83256d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:19.011483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c988123b-3c16-4d89-9f41-4fadad83256d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:19.093938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2052369044", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "700f0f16-58c0-4cd3-9a25-b6c938e0a6b1"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:19.183063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] validate_networks() for [('700f0f16-58c0-4cd3-9a25-b6c938e0a6b1', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:54:19.404747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c988123b-3c16-4d89-9f41-4fadad83256d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:19.421314 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c988123b-3c16-4d89-9f41-4fadad83256d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1316 microversion: 2.1 time: 0.441747 Oct 27 18:54:19.422467 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1073/2161] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:18 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:19.435336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5c6f18a5-4d73-42bc-a35b-93592b0b24b2 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Calling method '.version_select at 0x7fc873303ee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:19.492287 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-5c6f18a5-4d73-42bc-a35b-93592b0b24b2 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] HTTP exception thrown: Image not found. Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5c6f18a5-4d73-42bc-a35b-93592b0b24b2 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Request method failure captured: Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/images/ab5e582e-7ba9-4b0b-ad68-238dd8fa4028/metadata/os_version HTTP/1.1 Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPaCvn9f0SAXGv-6NKCNjpQDRL4nCwydJrccVN_GqjnbmKuFDD4lbR-K4dsboRNAu0TOLpEO9xRZte3BDawvcbpEX0JxpQYbld6jqyZdVQdL1k3xEeMmz_Ogd5WP79pLnMPEGeDUxGkvUtwrPdlNhZY1thLZ4or4-fQzV5h6MjAQTU Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: c0e3148b12964a099fc3dfdc0cfa4427 Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c0e3148b12964a099fc3dfdc0cfa4427", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: c0e3148b12964a099fc3dfdc0cfa4427 Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesMetadataNegativeTestJSON-199027044-project Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2105bedd11014b3b9fb75420b26dcbdb Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-199027044-project Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: exception: Image not found. Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'image_id': 'ab5e582e-7ba9-4b0b-ad68-238dd8fa4028', 'id': 'os_version'} Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ab5e582e-7ba9-4b0b-ad68-238dd8fa4028 Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 18:54:19.498293 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ab5e582e-7ba9-4b0b-ad68-238dd8fa4028 could not be found. Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5c6f18a5-4d73-42bc-a35b-93592b0b24b2 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Returning 404 to user: Image not found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5c6f18a5-4d73-42bc-a35b-93592b0b24b2 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] 10.222.0.42 "GET /compute/v2.1/images/ab5e582e-7ba9-4b0b-ad68-238dd8fa4028/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.074207 Oct 27 18:54:19.504251 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1074/2162] 10.222.0.42 () {58 vars in 1293 bytes} [Thu Oct 27 18:54:19 2022] GET /compute/v2.1/images/ab5e582e-7ba9-4b0b-ad68-238dd8fa4028/metadata/os_version => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:54:19.516145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-15798a09-cf57-40fb-9545-5373a6f12450 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873309550>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:19.594146 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-15798a09-cf57-40fb-9545-5373a6f12450 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1461 microversion: 2.1 time: 0.092635 Oct 27 18:54:19.602484 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1075/2163] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:19 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1461 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:19.609864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b5f8601-f1fc-471d-8976-b6fa8f625a6d tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Calling method '.version_select at 0x7fc8733878b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:19.635619 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-6b5f8601-f1fc-471d-8976-b6fa8f625a6d tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] HTTP exception thrown: Image not found. Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b5f8601-f1fc-471d-8976-b6fa8f625a6d tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Request method failure captured: Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/images/1608610d-5727-49dd-9fdd-1afc0c4b167f/metadata HTTP/1.1 Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPaCvn9f0SAXGv-6NKCNjpQDRL4nCwydJrccVN_GqjnbmKuFDD4lbR-K4dsboRNAu0TOLpEO9xRZte3BDawvcbpEX0JxpQYbld6jqyZdVQdL1k3xEeMmz_Ogd5WP79pLnMPEGeDUxGkvUtwrPdlNhZY1thLZ4or4-fQzV5h6MjAQTU Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: c0e3148b12964a099fc3dfdc0cfa4427 Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c0e3148b12964a099fc3dfdc0cfa4427", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: c0e3148b12964a099fc3dfdc0cfa4427 Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesMetadataNegativeTestJSON-199027044-project Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2105bedd11014b3b9fb75420b26dcbdb Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-199027044-project Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: exception: Image not found. Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'image_id': '1608610d-5727-49dd-9fdd-1afc0c4b167f'} Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1608610d-5727-49dd-9fdd-1afc0c4b167f Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 18:54:19.639187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1608610d-5727-49dd-9fdd-1afc0c4b167f could not be found. Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 18:54:19.642660 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.650202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b5f8601-f1fc-471d-8976-b6fa8f625a6d tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Returning 404 to user: Image not found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:19.651101 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b5f8601-f1fc-471d-8976-b6fa8f625a6d tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] 10.222.0.42 "GET /compute/v2.1/images/1608610d-5727-49dd-9fdd-1afc0c4b167f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047351 Oct 27 18:54:19.651711 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1076/2164] 10.222.0.42 () {58 vars in 1260 bytes} [Thu Oct 27 18:54:19 2022] GET /compute/v2.1/images/1608610d-5727-49dd-9fdd-1afc0c4b167f/metadata => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:54:19.675357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9fb783db-3ebc-4540-a100-5174b4129e46 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873309f70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:19.752746 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9fb783db-3ebc-4540-a100-5174b4129e46 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 200 len: 1461 microversion: 2.1 time: 0.099917 Oct 27 18:54:19.755591 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1077/2165] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:19 2022] GET /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 1461 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:19.760487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-57dcac71-09d0-4ea2-8aeb-b573b5dc28ae tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Action: 'update_all', calling method: .version_select at 0x7fc86ac541f0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:19.815634 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-57dcac71-09d0-4ea2-8aeb-b573b5dc28ae tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] HTTP exception thrown: Image not found. Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-57dcac71-09d0-4ea2-8aeb-b573b5dc28ae tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Request method failure captured: Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: request: PUT /compute/v2.1/images/849e6e26-445c-4ecf-8033-45d0e6f80c6f/metadata HTTP/1.1 Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 57 Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPaCvn9f0SAXGv-6NKCNjpQDRL4nCwydJrccVN_GqjnbmKuFDD4lbR-K4dsboRNAu0TOLpEO9xRZte3BDawvcbpEX0JxpQYbld6jqyZdVQdL1k3xEeMmz_Ogd5WP79pLnMPEGeDUxGkvUtwrPdlNhZY1thLZ4or4-fQzV5h6MjAQTU Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: c0e3148b12964a099fc3dfdc0cfa4427 Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c0e3148b12964a099fc3dfdc0cfa4427", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: c0e3148b12964a099fc3dfdc0cfa4427 Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesMetadataNegativeTestJSON-199027044-project Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2105bedd11014b3b9fb75420b26dcbdb Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-199027044-project Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: exception: Image not found. Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'image_id': '849e6e26-445c-4ecf-8033-45d0e6f80c6f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 849e6e26-445c-4ecf-8033-45d0e6f80c6f Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 18:54:19.822124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 849e6e26-445c-4ecf-8033-45d0e6f80c6f could not be found. Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 18:54:19.826473 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:19.830706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-57dcac71-09d0-4ea2-8aeb-b573b5dc28ae tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Returning 404 to user: Image not found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:19.832556 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-57dcac71-09d0-4ea2-8aeb-b573b5dc28ae tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] 10.222.0.42 "PUT /compute/v2.1/images/849e6e26-445c-4ecf-8033-45d0e6f80c6f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.075131 Oct 27 18:54:19.833508 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1078/2166] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:54:19 2022] PUT /compute/v2.1/images/849e6e26-445c-4ecf-8033-45d0e6f80c6f/metadata => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:54:20.042999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:54:20.043522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:54:20.044302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:54:20.045062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:54:20.045663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:54:20.069301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:20.069719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:20.070278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:20.073508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:20.073964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:20.077390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:20.128566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Getting quotas for project bcefa097ed8d4bf8b7f0118786874cc1. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:54:20.144510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Getting quotas for user 77434d4813ca426fbc20f386894c3176 and project bcefa097ed8d4bf8b7f0118786874cc1. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:54:20.196578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:54:20.199128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:54:20.281948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1895906484", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "b79e7be9-b3fa-414d-9c68-072b444eb9bb"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:20.313499 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-482039c6-8614-4e4e-91b2-6d764edc0fd3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.634345 Oct 27 18:54:20.321251 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1089/2167] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:54:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:54:20.327626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-424bfa28-2081-4e3b-b682-8ca27be9c64c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:20.330056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-424bfa28-2081-4e3b-b682-8ca27be9c64c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: 1f02e8ec-759d-48bf-9d99-31fa890241c1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:20.338816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-424bfa28-2081-4e3b-b682-8ca27be9c64c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:20.339346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-424bfa28-2081-4e3b-b682-8ca27be9c64c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:20.339872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-424bfa28-2081-4e3b-b682-8ca27be9c64c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:20.340629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-424bfa28-2081-4e3b-b682-8ca27be9c64c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:20.341107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-424bfa28-2081-4e3b-b682-8ca27be9c64c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:20.341878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-424bfa28-2081-4e3b-b682-8ca27be9c64c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:20.414792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] validate_networks() for [('b79e7be9-b3fa-414d-9c68-072b444eb9bb', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:54:20.606010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-424bfa28-2081-4e3b-b682-8ca27be9c64c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:20.616920 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-424bfa28-2081-4e3b-b682-8ca27be9c64c tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1" status: 200 len: 1468 microversion: 2.1 time: 0.300958 Oct 27 18:54:20.619915 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1090/2168] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:20 2022] GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1 => generated 1468 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:20.633034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-93372e15-b17e-4a6e-8f4d-de6e58026d01 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Action: 'update', calling method: .version_select at 0x7fc86ad35b80>, body: {"meta": {"os_distro": "alt"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:20.694137 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-93372e15-b17e-4a6e-8f4d-de6e58026d01 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] HTTP exception thrown: Image not found. Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-93372e15-b17e-4a6e-8f4d-de6e58026d01 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Request method failure captured: Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/images/abba5342-cae4-4346-9ae8-ddba4d944cc6/metadata/os_distro HTTP/1.1 Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 30 Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPaCvn9f0SAXGv-6NKCNjpQDRL4nCwydJrccVN_GqjnbmKuFDD4lbR-K4dsboRNAu0TOLpEO9xRZte3BDawvcbpEX0JxpQYbld6jqyZdVQdL1k3xEeMmz_Ogd5WP79pLnMPEGeDUxGkvUtwrPdlNhZY1thLZ4or4-fQzV5h6MjAQTU Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c0e3148b12964a099fc3dfdc0cfa4427 Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c0e3148b12964a099fc3dfdc0cfa4427", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c0e3148b12964a099fc3dfdc0cfa4427 Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesMetadataNegativeTestJSON-199027044-project Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2105bedd11014b3b9fb75420b26dcbdb Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-199027044-project Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: {"meta": {"os_distro": "alt"}} Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: exception: Image not found. Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'image_id': 'abba5342-cae4-4346-9ae8-ddba4d944cc6', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID abba5342-cae4-4346-9ae8-ddba4d944cc6 Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 18:54:20.698801 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image abba5342-cae4-4346-9ae8-ddba4d944cc6 could not be found. Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 18:54:20.703265 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:20.707514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-93372e15-b17e-4a6e-8f4d-de6e58026d01 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Returning 404 to user: Image not found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:20.712170 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-93372e15-b17e-4a6e-8f4d-de6e58026d01 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] 10.222.0.42 "PUT /compute/v2.1/images/abba5342-cae4-4346-9ae8-ddba4d944cc6/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.089570 Oct 27 18:54:20.712889 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1091/2169] 10.222.0.42 () {60 vars in 1310 bytes} [Thu Oct 27 18:54:20 2022] PUT /compute/v2.1/images/abba5342-cae4-4346-9ae8-ddba4d944cc6/metadata/os_distro => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:54:20.724219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-667b488f-ccbd-4584-81da-eac6164fe525 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:20.732761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-667b488f-ccbd-4584-81da-eac6164fe525 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:21.005073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-667b488f-ccbd-4584-81da-eac6164fe525 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:21.014846 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-667b488f-ccbd-4584-81da-eac6164fe525 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1218 microversion: 2.1 time: 0.299315 Oct 27 18:54:21.023244 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1092/2170] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:20 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1218 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:21.038192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ecbaf189-c272-4f25-a959-d484625a0440 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:21.039091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ecbaf189-c272-4f25-a959-d484625a0440 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:21.047719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ecbaf189-c272-4f25-a959-d484625a0440 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:21.049495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ecbaf189-c272-4f25-a959-d484625a0440 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:21.050143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ecbaf189-c272-4f25-a959-d484625a0440 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:21.051085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ecbaf189-c272-4f25-a959-d484625a0440 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:21.053142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ecbaf189-c272-4f25-a959-d484625a0440 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:21.055079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ecbaf189-c272-4f25-a959-d484625a0440 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:21.414993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ecbaf189-c272-4f25-a959-d484625a0440 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:21.427968 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ecbaf189-c272-4f25-a959-d484625a0440 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1316 microversion: 2.1 time: 0.403421 Oct 27 18:54:21.430920 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1093/2171] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:21 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:21.436066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-311289a7-e3f2-43ba-84ee-2b5911143b0d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a7933a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:21.627629 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-311289a7-e3f2-43ba-84ee-2b5911143b0d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images?changes-since=2022-10-27T18%3A51%3A45Z" status: 200 len: 2375 microversion: 2.1 time: 0.195235 Oct 27 18:54:21.629058 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1094/2172] 10.222.0.42 () {58 vars in 1199 bytes} [Thu Oct 27 18:54:21 2022] GET /compute/v2.1/images?changes-since=2022-10-27T18%3A51%3A45Z => generated 2375 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:21.635934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-137a8c60-f2f0-4df5-890a-46a9cad7c9a9 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Action: 'create', calling method: .version_select at 0x7fc86b435160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:21.671633 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-137a8c60-f2f0-4df5-890a-46a9cad7c9a9 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] HTTP exception thrown: Image not found. Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-137a8c60-f2f0-4df5-890a-46a9cad7c9a9 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Request method failure captured: Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/images/b4a01605-d1eb-4896-b43c-9c54353c3c53/metadata HTTP/1.1 Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 57 Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPaCvn9f0SAXGv-6NKCNjpQDRL4nCwydJrccVN_GqjnbmKuFDD4lbR-K4dsboRNAu0TOLpEO9xRZte3BDawvcbpEX0JxpQYbld6jqyZdVQdL1k3xEeMmz_Ogd5WP79pLnMPEGeDUxGkvUtwrPdlNhZY1thLZ4or4-fQzV5h6MjAQTU Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c0e3148b12964a099fc3dfdc0cfa4427 Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c0e3148b12964a099fc3dfdc0cfa4427", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0e3148b12964a099fc3dfdc0cfa4427"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c0e3148b12964a099fc3dfdc0cfa4427 Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-199027044 Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesMetadataNegativeTestJSON-199027044-project Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2105bedd11014b3b9fb75420b26dcbdb Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-199027044-project Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: exception: Image not found. Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'image_id': 'b4a01605-d1eb-4896-b43c-9c54353c3c53', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b4a01605-d1eb-4896-b43c-9c54353c3c53 Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 18:54:21.675335 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b4a01605-d1eb-4896-b43c-9c54353c3c53 could not be found. Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-137a8c60-f2f0-4df5-890a-46a9cad7c9a9 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] Returning 404 to user: Image not found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:21.680121 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-137a8c60-f2f0-4df5-890a-46a9cad7c9a9 tempest-ImagesMetadataNegativeTestJSON-199027044 tempest-ImagesMetadataNegativeTestJSON-199027044-project] 10.222.0.42 "POST /compute/v2.1/images/b4a01605-d1eb-4896-b43c-9c54353c3c53/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047526 Oct 27 18:54:21.684289 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1095/2173] 10.222.0.42 () {60 vars in 1281 bytes} [Thu Oct 27 18:54:21 2022] POST /compute/v2.1/images/b4a01605-d1eb-4896-b43c-9c54353c3c53/metadata => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:54:21.698172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0e54e0e-2d9b-4afe-9637-1fba9328146b tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86ad08dc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:21.842003 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f0e54e0e-2d9b-4afe-9637-1fba9328146b tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-675033873" status: 200 len: 484 microversion: 2.1 time: 0.156456 Oct 27 18:54:21.842645 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1096/2174] 10.222.0.42 () {58 vars in 1229 bytes} [Thu Oct 27 18:54:21 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-675033873 => generated 484 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:21.858175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9f0b1f96-3806-4046-bca8-b9cdd536809f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a793820>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:22.006247 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9f0b1f96-3806-4046-bca8-b9cdd536809f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images?server=1f02e8ec-759d-48bf-9d99-31fa890241c1" status: 200 len: 956 microversion: 2.1 time: 0.153044 Oct 27 18:54:22.017606 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1097/2175] 10.222.0.42 () {58 vars in 1209 bytes} [Thu Oct 27 18:54:21 2022] GET /compute/v2.1/images?server=1f02e8ec-759d-48bf-9d99-31fa890241c1 => generated 956 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:22.023771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a834de3e-3817-4c92-84e3-63a205cc84bc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86ad08dc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:22.106245 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a834de3e-3817-4c92-84e3-63a205cc84bc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fv2.1%2Fservers%2Fac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 485 microversion: 2.1 time: 0.087065 Oct 27 18:54:22.110016 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1098/2176] 10.222.0.42 () {58 vars in 1317 bytes} [Thu Oct 27 18:54:22 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fv2.1%2Fservers%2Fac5e11da-2f25-4433-98d7-8f5b0620095f => generated 485 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:22.129465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d8bea9f7-5d51-4ca8-9046-37b60c831096 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:22.131475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d8bea9f7-5d51-4ca8-9046-37b60c831096 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:22.138694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8bea9f7-5d51-4ca8-9046-37b60c831096 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:22.140128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8bea9f7-5d51-4ca8-9046-37b60c831096 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:22.141309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8bea9f7-5d51-4ca8-9046-37b60c831096 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:22.142258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8bea9f7-5d51-4ca8-9046-37b60c831096 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:22.142950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8bea9f7-5d51-4ca8-9046-37b60c831096 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:22.143528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8bea9f7-5d51-4ca8-9046-37b60c831096 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:22.826650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:54:22.827223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:54:22.827706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:54:22.828239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:54:22.828775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:54:22.833505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d8bea9f7-5d51-4ca8-9046-37b60c831096 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:22.842792 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d8bea9f7-5d51-4ca8-9046-37b60c831096 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1270 microversion: 2.1 time: 0.721582 Oct 27 18:54:22.843445 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1099/2177] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:22 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1270 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:22.847773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:22.848114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b630424c-9a9b-46f1-95fa-194ca1f61576 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86b0c4040>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:22.848882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:22.851605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:22.854052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:22.854786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:22.857741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:22.906905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Getting quotas for project 66d8a8780e4b4f9d91388b3bee2d61c2. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:54:22.917939 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b630424c-9a9b-46f1-95fa-194ca1f61576 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fservers%2Fac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 485 microversion: 2.1 time: 0.073340 Oct 27 18:54:22.921364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Getting quotas for user 03f7953b2a894523ac7e38d059ed267b and project 66d8a8780e4b4f9d91388b3bee2d61c2. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:54:22.928409 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1100/2178] 10.222.0.42 () {58 vars in 1303 bytes} [Thu Oct 27 18:54:22 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fservers%2Fac5e11da-2f25-4433-98d7-8f5b0620095f => generated 485 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:22.933642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-16f13593-9e90-4746-ba48-d6274e26b76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:22.934523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-16f13593-9e90-4746-ba48-d6274e26b76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:22.941975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16f13593-9e90-4746-ba48-d6274e26b76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:22.942867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16f13593-9e90-4746-ba48-d6274e26b76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:22.944036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16f13593-9e90-4746-ba48-d6274e26b76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:22.944975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16f13593-9e90-4746-ba48-d6274e26b76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:22.945634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16f13593-9e90-4746-ba48-d6274e26b76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:22.946258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16f13593-9e90-4746-ba48-d6274e26b76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:22.955700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:54:22.961850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:54:23.091017 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9c05e4c6-5b3c-4276-a2e7-2afa433c2b14 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.252824 Oct 27 18:54:23.094026 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1079/2179] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:54:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:54:23.117850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-5576f9b7-e6ce-437d-828b-332c5a3db178 req-7cce066d-5a40-4ca1-a7ba-b86c900bca44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f02e8ec-759d-48bf-9d99-31fa890241c1", "name": "network-vif-unplugged", "status": "completed", "tag": "e08a66dd-bce1-4f3f-ae67-ea863bda862f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:23.152754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5576f9b7-e6ce-437d-828b-332c5a3db178 req-7cce066d-5a40-4ca1-a7ba-b86c900bca44 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:23.154188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5576f9b7-e6ce-437d-828b-332c5a3db178 req-7cce066d-5a40-4ca1-a7ba-b86c900bca44 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:23.157389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5576f9b7-e6ce-437d-828b-332c5a3db178 req-7cce066d-5a40-4ca1-a7ba-b86c900bca44 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:23.191757 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5576f9b7-e6ce-437d-828b-332c5a3db178 req-7cce066d-5a40-4ca1-a7ba-b86c900bca44 service nova] Creating event network-vif-unplugged:e08a66dd-bce1-4f3f-ae67-ea863bda862f for instance 1f02e8ec-759d-48bf-9d99-31fa890241c1 on n-h2-860687-3 Oct 27 18:54:23.211707 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-5576f9b7-e6ce-437d-828b-332c5a3db178 req-7cce066d-5a40-4ca1-a7ba-b86c900bca44 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111251 Oct 27 18:54:23.214794 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1080/2180] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:23.228676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-79366219-e071-4114-a1e9-a9082aeeb0ec tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc8732db8b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:23.443115 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-79366219-e071-4114-a1e9-a9082aeeb0ec tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.226136 Oct 27 18:54:23.454335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-16f13593-9e90-4746-ba48-d6274e26b76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:23.459859 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1081/2181] 10.222.0.42 () {58 vars in 1149 bytes} [Thu Oct 27 18:54:23 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:23.472935 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-16f13593-9e90-4746-ba48-d6274e26b76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1316 microversion: 2.1 time: 0.543050 Oct 27 18:54:23.480924 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1101/2182] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:22 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:23.481904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-120b2a99-9bb4-4391-923f-ad0fd359d551 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:23.483763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-120b2a99-9bb4-4391-923f-ad0fd359d551 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:23.498306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-34930808-5b7e-41d4-a9ac-440dd729f49f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a793af0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:23.636284 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-34930808-5b7e-41d4-a9ac-440dd729f49f tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.153420 Oct 27 18:54:23.636875 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1102/2183] 10.222.0.42 () {58 vars in 1149 bytes} [Thu Oct 27 18:54:23 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:23.651699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-078d3743-23fa-4ec7-9f4c-3cdc020acea1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a8bdb80>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:23.784663 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-078d3743-23fa-4ec7-9f4c-3cdc020acea1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.137707 Oct 27 18:54:23.791548 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1103/2184] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:54:23 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:54:23.814743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-874b2416-0f1b-40f3-a55e-2a0e3688be8d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a793af0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:23.983153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-120b2a99-9bb4-4391-923f-ad0fd359d551 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:23.997799 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-120b2a99-9bb4-4391-923f-ad0fd359d551 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1224 microversion: 2.1 time: 0.536529 Oct 27 18:54:23.998417 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1082/2185] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:23 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1224 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:24.010499 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-874b2416-0f1b-40f3-a55e-2a0e3688be8d tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/detail?changes-since=2022-10-27T18%3A51%3A41Z" status: 200 len: 6327 microversion: 2.1 time: 0.214956 Oct 27 18:54:24.014601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85d50760-f93b-40ff-a683-4f9694b8eb46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:24.017476 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1104/2186] 10.222.0.42 () {58 vars in 1220 bytes} [Thu Oct 27 18:54:23 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-27T18%3A51%3A41Z => generated 6327 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:54:24.023144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85d50760-f93b-40ff-a683-4f9694b8eb46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:24.033672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85d50760-f93b-40ff-a683-4f9694b8eb46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:24.044266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-665365f1-3a66-4258-b61d-bf06d4354a8e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a8bd9d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:24.050177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85d50760-f93b-40ff-a683-4f9694b8eb46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:24.050928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85d50760-f93b-40ff-a683-4f9694b8eb46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:24.051929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85d50760-f93b-40ff-a683-4f9694b8eb46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:24.052697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85d50760-f93b-40ff-a683-4f9694b8eb46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:24.053359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85d50760-f93b-40ff-a683-4f9694b8eb46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:24.213306 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-665365f1-3a66-4258-b61d-bf06d4354a8e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-675033873" status: 200 len: 664 microversion: 2.1 time: 0.174363 Oct 27 18:54:24.231584 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1105/2187] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Oct 27 18:54:24 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-675033873 => generated 664 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:24.247409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b3683f09-50ff-4511-8a01-465a3c1d4de2 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86aa8d940>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:24.314864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-85d50760-f93b-40ff-a683-4f9694b8eb46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:24.327565 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85d50760-f93b-40ff-a683-4f9694b8eb46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1276 microversion: 2.1 time: 0.321497 Oct 27 18:54:24.335036 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1083/2188] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:24 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1276 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:24.490624 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b3683f09-50ff-4511-8a01-465a3c1d4de2 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fv2.1%2Fservers%2Fac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1465 microversion: 2.1 time: 0.238831 Oct 27 18:54:24.492316 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1106/2189] 10.222.0.42 () {58 vars in 1338 bytes} [Thu Oct 27 18:54:24 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fv2.1%2Fservers%2Fac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1465 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:54:24.510082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-422df7da-8048-40a6-a500-8d4437aae963 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86aa8d160>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:24.513401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d962e42d-945a-4a23-b9db-b394f931cd7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:24.514356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d962e42d-945a-4a23-b9db-b394f931cd7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:24.541651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d962e42d-945a-4a23-b9db-b394f931cd7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:24.543670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d962e42d-945a-4a23-b9db-b394f931cd7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:24.544232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d962e42d-945a-4a23-b9db-b394f931cd7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:24.545141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d962e42d-945a-4a23-b9db-b394f931cd7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:24.545778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d962e42d-945a-4a23-b9db-b394f931cd7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:24.546304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d962e42d-945a-4a23-b9db-b394f931cd7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:24.605564 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-422df7da-8048-40a6-a500-8d4437aae963 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fservers%2Fac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1465 microversion: 2.1 time: 0.099290 Oct 27 18:54:24.619579 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1107/2190] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Oct 27 18:54:24 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fservers%2Fac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1465 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:24.625354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6a87c200-2600-470d-a54e-1838198bf862 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a9e3310>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:24.837662 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6a87c200-2600-470d-a54e-1838198bf862 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.210809 Oct 27 18:54:24.838861 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1108/2191] 10.222.0.42 () {58 vars in 1170 bytes} [Thu Oct 27 18:54:24 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:54:24.863426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e9007cd2-0f03-4502-8b51-cdaed224eadc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86aa8d160>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:25.010685 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e9007cd2-0f03-4502-8b51-cdaed224eadc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.154332 Oct 27 18:54:25.014983 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1109/2192] 10.222.0.42 () {58 vars in 1170 bytes} [Thu Oct 27 18:54:24 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:25.047467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-51c93c01-2039-4713-80ec-97b7d8615722 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:25.053565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-51c93c01-2039-4713-80ec-97b7d8615722 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:25.083854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51c93c01-2039-4713-80ec-97b7d8615722 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:25.092798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51c93c01-2039-4713-80ec-97b7d8615722 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:25.093301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51c93c01-2039-4713-80ec-97b7d8615722 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:25.095312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51c93c01-2039-4713-80ec-97b7d8615722 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:25.095834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51c93c01-2039-4713-80ec-97b7d8615722 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:25.096277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51c93c01-2039-4713-80ec-97b7d8615722 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:25.295117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-51c93c01-2039-4713-80ec-97b7d8615722 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:25.362721 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-51c93c01-2039-4713-80ec-97b7d8615722 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1276 microversion: 2.1 time: 0.327589 Oct 27 18:54:25.363936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d962e42d-945a-4a23-b9db-b394f931cd7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:25.376550 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d962e42d-945a-4a23-b9db-b394f931cd7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1316 microversion: 2.1 time: 0.873893 Oct 27 18:54:25.377152 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1084/2193] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:24 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1316 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:25.390811 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1110/2194] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:25 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1276 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:25.407835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f726575a-0470-432a-9dbf-2787d367d469 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:25.416419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c4525db2-e448-471d-9acb-6af25c215bb1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc8733945e0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:25.428568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f726575a-0470-432a-9dbf-2787d367d469 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:25.454437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f726575a-0470-432a-9dbf-2787d367d469 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:25.454958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f726575a-0470-432a-9dbf-2787d367d469 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:25.460533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f726575a-0470-432a-9dbf-2787d367d469 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:25.461384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f726575a-0470-432a-9dbf-2787d367d469 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:25.466133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f726575a-0470-432a-9dbf-2787d367d469 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:25.468214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f726575a-0470-432a-9dbf-2787d367d469 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:25.522086 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c4525db2-e448-471d-9acb-6af25c215bb1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/77589569-9b6a-4afc-8af7-7a43ef9ebc00" status: 200 len: 784 microversion: 2.1 time: 0.122774 Oct 27 18:54:25.522681 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1085/2195] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:54:25 2022] GET /compute/v2.1/images/77589569-9b6a-4afc-8af7-7a43ef9ebc00 => generated 784 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:25.541402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d3ed85b5-b3b9-4475-8f68-e7ab3bf3d26a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc8732db700>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:25.659357 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d3ed85b5-b3b9-4475-8f68-e7ab3bf3d26a tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.123584 Oct 27 18:54:25.663037 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1086/2196] 10.222.0.42 () {58 vars in 1158 bytes} [Thu Oct 27 18:54:25 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:25.681986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-94aa3b0e-f817-4a58-b732-58f6afc0881e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc87335e790>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:26.240149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f726575a-0470-432a-9dbf-2787d367d469 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:26.250039 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f726575a-0470-432a-9dbf-2787d367d469 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1318 microversion: 2.1 time: 0.855901 Oct 27 18:54:26.250984 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1111/2197] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:25 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1318 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:26.399701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-28d958da-2a6a-4614-bc93-18da070f270b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:26.400363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-28d958da-2a6a-4614-bc93-18da070f270b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:26.412602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28d958da-2a6a-4614-bc93-18da070f270b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:26.413233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28d958da-2a6a-4614-bc93-18da070f270b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:26.415691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28d958da-2a6a-4614-bc93-18da070f270b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:26.419394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28d958da-2a6a-4614-bc93-18da070f270b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:26.420065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28d958da-2a6a-4614-bc93-18da070f270b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:26.420637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28d958da-2a6a-4614-bc93-18da070f270b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:26.799128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-28d958da-2a6a-4614-bc93-18da070f270b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:26.814267 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-28d958da-2a6a-4614-bc93-18da070f270b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1282 microversion: 2.1 time: 0.416436 Oct 27 18:54:26.828465 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1112/2198] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:26 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1282 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:54:26.831120 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-94aa3b0e-f817-4a58-b732-58f6afc0881e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "DELETE /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad" status: 204 len: 0 microversion: 2.1 time: 1.154875 Oct 27 18:54:26.837132 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1087/2199] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:25 2022] DELETE /compute/v2.1/images/8c301049-1059-41b8-8b1c-e99463b399ad => generated 0 bytes in 1157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:26.843603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8a20950c-8f98-4f89-b225-e4598e5fdd8e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc8733d8700>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:26.853760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-555b6732-6669-4e46-a38c-f558f7ad52e4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:26.854786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-555b6732-6669-4e46-a38c-f558f7ad52e4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:26.863400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-555b6732-6669-4e46-a38c-f558f7ad52e4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:26.865358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-555b6732-6669-4e46-a38c-f558f7ad52e4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:26.866117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-555b6732-6669-4e46-a38c-f558f7ad52e4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:26.869118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-555b6732-6669-4e46-a38c-f558f7ad52e4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:26.870163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-555b6732-6669-4e46-a38c-f558f7ad52e4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:26.870942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-555b6732-6669-4e46-a38c-f558f7ad52e4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:27.499653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-555b6732-6669-4e46-a38c-f558f7ad52e4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:27.523863 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-555b6732-6669-4e46-a38c-f558f7ad52e4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1316 microversion: 2.1 time: 0.693986 Oct 27 18:54:27.552944 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1113/2200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:26 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1316 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:27.567011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b209ce0e-705e-4690-9bcd-bbd6708aeb56 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:27.568272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b209ce0e-705e-4690-9bcd-bbd6708aeb56 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:27.585922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b209ce0e-705e-4690-9bcd-bbd6708aeb56 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:27.592297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b209ce0e-705e-4690-9bcd-bbd6708aeb56 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:27.593076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b209ce0e-705e-4690-9bcd-bbd6708aeb56 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:27.594062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b209ce0e-705e-4690-9bcd-bbd6708aeb56 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:27.595006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b209ce0e-705e-4690-9bcd-bbd6708aeb56 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:27.595557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b209ce0e-705e-4690-9bcd-bbd6708aeb56 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:27.983418 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8a20950c-8f98-4f89-b225-e4598e5fdd8e tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "DELETE /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2" status: 204 len: 0 microversion: 2.1 time: 1.144652 Oct 27 18:54:27.983827 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1088/2201] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:26 2022] DELETE /compute/v2.1/images/12f635f3-56c6-46f4-8978-41fc1a5f2bc2 => generated 0 bytes in 1146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:27.988526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9ba9290-3cc5-465a-8182-a8a8d076863e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:27.989857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d9ba9290-3cc5-465a-8182-a8a8d076863e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:28.000652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9ba9290-3cc5-465a-8182-a8a8d076863e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:28.002465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9ba9290-3cc5-465a-8182-a8a8d076863e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:28.004117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9ba9290-3cc5-465a-8182-a8a8d076863e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:28.005923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9ba9290-3cc5-465a-8182-a8a8d076863e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:28.006594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9ba9290-3cc5-465a-8182-a8a8d076863e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:28.007216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9ba9290-3cc5-465a-8182-a8a8d076863e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:28.164622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b209ce0e-705e-4690-9bcd-bbd6708aeb56 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:28.178840 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b209ce0e-705e-4690-9bcd-bbd6708aeb56 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1318 microversion: 2.1 time: 0.624432 Oct 27 18:54:28.180159 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1114/2202] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:27 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1318 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:28.198983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-849c9909-f8e4-488a-bfb1-745b3ee0a732 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc86a8a9a60>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:28.384419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d9ba9290-3cc5-465a-8182-a8a8d076863e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:28.395986 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d9ba9290-3cc5-465a-8182-a8a8d076863e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1282 microversion: 2.1 time: 0.410249 Oct 27 18:54:28.397221 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1089/2203] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:27 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1282 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:28.568576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-516e0d1e-9311-4cef-80ef-b426c9332cb4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:28.569902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-516e0d1e-9311-4cef-80ef-b426c9332cb4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:28.589388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:28.590703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-516e0d1e-9311-4cef-80ef-b426c9332cb4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:28.595481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-516e0d1e-9311-4cef-80ef-b426c9332cb4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:28.596093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-516e0d1e-9311-4cef-80ef-b426c9332cb4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:28.597267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-516e0d1e-9311-4cef-80ef-b426c9332cb4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:28.597819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-516e0d1e-9311-4cef-80ef-b426c9332cb4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:28.601663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-516e0d1e-9311-4cef-80ef-b426c9332cb4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:29.053827 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-849c9909-f8e4-488a-bfb1-745b3ee0a732 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "DELETE /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2" status: 204 len: 0 microversion: 2.1 time: 0.872318 Oct 27 18:54:29.057692 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1115/2204] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:28 2022] DELETE /compute/v2.1/images/4de9cd0a-fc66-4c61-bf1a-b63435c675b2 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:29.080249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6fee2856-84bd-4020-a898-8541d837d992 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:29.080773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6fee2856-84bd-4020-a898-8541d837d992 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:29.092084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fee2856-84bd-4020-a898-8541d837d992 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:29.092590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fee2856-84bd-4020-a898-8541d837d992 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:29.093046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fee2856-84bd-4020-a898-8541d837d992 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:29.093786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fee2856-84bd-4020-a898-8541d837d992 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:29.094265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fee2856-84bd-4020-a898-8541d837d992 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:29.102569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fee2856-84bd-4020-a898-8541d837d992 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:29.171756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6fee2856-84bd-4020-a898-8541d837d992 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:54:29.340252 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6fee2856-84bd-4020-a898-8541d837d992 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 204 len: 0 microversion: 2.1 time: 0.276115 Oct 27 18:54:29.345721 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1116/2205] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:54:29 2022] DELETE /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:29.358666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-1ba816df-5693-4249-a1d6-9c3e69ad4eeb req-fab6aa6c-13ea-4d3e-8b61-a5540234fde3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "263ba238-b675-4ae7-a469-ced7d67f016a", "name": "network-vif-plugged", "status": "completed", "tag": "60da2023-14ac-4154-8f86-64e5b6e76b40"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:29.373421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1ba816df-5693-4249-a1d6-9c3e69ad4eeb req-fab6aa6c-13ea-4d3e-8b61-a5540234fde3 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:29.375399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1ba816df-5693-4249-a1d6-9c3e69ad4eeb req-fab6aa6c-13ea-4d3e-8b61-a5540234fde3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:29.376774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1ba816df-5693-4249-a1d6-9c3e69ad4eeb req-fab6aa6c-13ea-4d3e-8b61-a5540234fde3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:29.405090 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-1ba816df-5693-4249-a1d6-9c3e69ad4eeb req-fab6aa6c-13ea-4d3e-8b61-a5540234fde3 service nova] Creating event network-vif-plugged:60da2023-14ac-4154-8f86-64e5b6e76b40 for instance 263ba238-b675-4ae7-a469-ced7d67f016a on n-h1-860687-3 Oct 27 18:54:29.421985 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-1ba816df-5693-4249-a1d6-9c3e69ad4eeb req-fab6aa6c-13ea-4d3e-8b61-a5540234fde3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073914 Oct 27 18:54:29.424519 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1117/2206] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:29.433550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-7bcd5587-3e3d-4655-b3b2-4b1ba4bbd490 req-396b14d5-9a01-4fc3-ad91-e4556e8d2a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b6f25f-ce24-45c5-b633-6a36808a0540", "tag": "1e5c551d-9e29-4371-a23d-08f3b6b96e56"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:29.461547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7bcd5587-3e3d-4655-b3b2-4b1ba4bbd490 req-396b14d5-9a01-4fc3-ad91-e4556e8d2a87 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:29.463408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7bcd5587-3e3d-4655-b3b2-4b1ba4bbd490 req-396b14d5-9a01-4fc3-ad91-e4556e8d2a87 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:29.465010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7bcd5587-3e3d-4655-b3b2-4b1ba4bbd490 req-396b14d5-9a01-4fc3-ad91-e4556e8d2a87 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:29.545634 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-7bcd5587-3e3d-4655-b3b2-4b1ba4bbd490 req-396b14d5-9a01-4fc3-ad91-e4556e8d2a87 service nova] Creating event network-changed:1e5c551d-9e29-4371-a23d-08f3b6b96e56 for instance f3b6f25f-ce24-45c5-b633-6a36808a0540 on n-h2-860687-3 Oct 27 18:54:29.558426 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-7bcd5587-3e3d-4655-b3b2-4b1ba4bbd490 req-396b14d5-9a01-4fc3-ad91-e4556e8d2a87 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132255 Oct 27 18:54:29.568065 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1118/2207] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:29.574864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-446550c4-e5b6-4160-8736-3a6dc6b72d57 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:29.575845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-446550c4-e5b6-4160-8736-3a6dc6b72d57 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:29.593875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-446550c4-e5b6-4160-8736-3a6dc6b72d57 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:29.594607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-446550c4-e5b6-4160-8736-3a6dc6b72d57 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:29.595230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-446550c4-e5b6-4160-8736-3a6dc6b72d57 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:29.596064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-446550c4-e5b6-4160-8736-3a6dc6b72d57 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:29.596632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-446550c4-e5b6-4160-8736-3a6dc6b72d57 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:29.597219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-446550c4-e5b6-4160-8736-3a6dc6b72d57 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:30.102434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:30.182145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-446550c4-e5b6-4160-8736-3a6dc6b72d57 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:30.196997 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-446550c4-e5b6-4160-8736-3a6dc6b72d57 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1318 microversion: 2.1 time: 0.627201 Oct 27 18:54:30.204664 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1119/2208] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:29 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:30.211894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e057e175-f795-4e6f-934b-98d382a3f7ce tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:30.219025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e057e175-f795-4e6f-934b-98d382a3f7ce tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:30.230809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e057e175-f795-4e6f-934b-98d382a3f7ce tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:30.231313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e057e175-f795-4e6f-934b-98d382a3f7ce tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:30.231760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e057e175-f795-4e6f-934b-98d382a3f7ce tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:30.232484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e057e175-f795-4e6f-934b-98d382a3f7ce tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:30.233126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e057e175-f795-4e6f-934b-98d382a3f7ce tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:30.233719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e057e175-f795-4e6f-934b-98d382a3f7ce tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:30.431921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-516e0d1e-9311-4cef-80ef-b426c9332cb4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:30.441088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=53 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:30.445270 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-516e0d1e-9311-4cef-80ef-b426c9332cb4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1316 microversion: 2.1 time: 1.885171 Oct 27 18:54:30.449382 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1090/2209] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:28 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1316 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:30.455688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6f2b37da-4e84-47b5-99ae-cec8c64c38e5 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:30.456966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6f2b37da-4e84-47b5-99ae-cec8c64c38e5 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:30.466577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f2b37da-4e84-47b5-99ae-cec8c64c38e5 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:30.467465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f2b37da-4e84-47b5-99ae-cec8c64c38e5 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:30.468294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f2b37da-4e84-47b5-99ae-cec8c64c38e5 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:30.470038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f2b37da-4e84-47b5-99ae-cec8c64c38e5 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:30.470955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f2b37da-4e84-47b5-99ae-cec8c64c38e5 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:30.471685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f2b37da-4e84-47b5-99ae-cec8c64c38e5 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:30.501957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e057e175-f795-4e6f-934b-98d382a3f7ce tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:30.505064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:30.515974 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e057e175-f795-4e6f-934b-98d382a3f7ce tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1474 microversion: 2.1 time: 0.309974 Oct 27 18:54:30.516996 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1120/2210] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:30 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1474 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:31.041109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6f2b37da-4e84-47b5-99ae-cec8c64c38e5 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:31.054531 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6f2b37da-4e84-47b5-99ae-cec8c64c38e5 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1324 microversion: 2.1 time: 0.603298 Oct 27 18:54:31.055391 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1091/2211] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:30 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1324 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:31.225525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e192d394-eb72-4f5c-9e76-e2a9f4424114 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:31.227004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e192d394-eb72-4f5c-9e76-e2a9f4424114 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:31.238532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:31.242541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e192d394-eb72-4f5c-9e76-e2a9f4424114 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:31.243283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e192d394-eb72-4f5c-9e76-e2a9f4424114 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:31.243887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e192d394-eb72-4f5c-9e76-e2a9f4424114 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:31.245217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e192d394-eb72-4f5c-9e76-e2a9f4424114 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:31.246197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e192d394-eb72-4f5c-9e76-e2a9f4424114 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:31.247557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e192d394-eb72-4f5c-9e76-e2a9f4424114 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:31.483812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-87d93507-c415-4e99-b37e-942f285940d1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:31.485800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-87d93507-c415-4e99-b37e-942f285940d1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:31.521963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87d93507-c415-4e99-b37e-942f285940d1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:31.522534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87d93507-c415-4e99-b37e-942f285940d1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:31.526911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87d93507-c415-4e99-b37e-942f285940d1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:31.527719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87d93507-c415-4e99-b37e-942f285940d1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:31.528208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87d93507-c415-4e99-b37e-942f285940d1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:31.528652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87d93507-c415-4e99-b37e-942f285940d1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:31.772065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e192d394-eb72-4f5c-9e76-e2a9f4424114 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:31.787468 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e192d394-eb72-4f5c-9e76-e2a9f4424114 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1318 microversion: 2.1 time: 0.571326 Oct 27 18:54:31.808861 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1121/2212] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:31 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:31.821274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8ed77a7c-f224-40e8-9950-474706896bee tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:31.825171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8ed77a7c-f224-40e8-9950-474706896bee tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:31.842732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed77a7c-f224-40e8-9950-474706896bee tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:31.843146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed77a7c-f224-40e8-9950-474706896bee tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:31.843930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed77a7c-f224-40e8-9950-474706896bee tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:31.844810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed77a7c-f224-40e8-9950-474706896bee tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:31.845419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed77a7c-f224-40e8-9950-474706896bee tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:31.846165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed77a7c-f224-40e8-9950-474706896bee tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:32.259989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8ed77a7c-f224-40e8-9950-474706896bee tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:32.286150 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8ed77a7c-f224-40e8-9950-474706896bee tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1474 microversion: 2.1 time: 0.468560 Oct 27 18:54:32.288793 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1122/2213] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:31 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1474 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:32.299518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4121d556-6638-4704-a854-a44ef23d6a2e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:32.300498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4121d556-6638-4704-a854-a44ef23d6a2e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:32.317557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4121d556-6638-4704-a854-a44ef23d6a2e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:32.318995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4121d556-6638-4704-a854-a44ef23d6a2e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:32.318995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4121d556-6638-4704-a854-a44ef23d6a2e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:32.321171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4121d556-6638-4704-a854-a44ef23d6a2e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:32.321637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4121d556-6638-4704-a854-a44ef23d6a2e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:32.324663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4121d556-6638-4704-a854-a44ef23d6a2e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:32.382732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-87d93507-c415-4e99-b37e-942f285940d1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:32.398127 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-87d93507-c415-4e99-b37e-942f285940d1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1316 microversion: 2.1 time: 0.927255 Oct 27 18:54:32.398827 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1092/2214] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:31 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1316 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:32.821036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b3e8e62f-37cf-4bc0-a223-d2aa633bd90b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:32.823232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b3e8e62f-37cf-4bc0-a223-d2aa633bd90b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:32.847041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3e8e62f-37cf-4bc0-a223-d2aa633bd90b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:32.847041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3e8e62f-37cf-4bc0-a223-d2aa633bd90b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:32.847715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3e8e62f-37cf-4bc0-a223-d2aa633bd90b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:32.849574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3e8e62f-37cf-4bc0-a223-d2aa633bd90b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:32.849574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3e8e62f-37cf-4bc0-a223-d2aa633bd90b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:32.850018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3e8e62f-37cf-4bc0-a223-d2aa633bd90b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:32.904147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:33.195056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4121d556-6638-4704-a854-a44ef23d6a2e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:33.203802 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4121d556-6638-4704-a854-a44ef23d6a2e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1324 microversion: 2.1 time: 0.910316 Oct 27 18:54:33.224585 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1123/2215] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:32 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1324 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:33.312573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8e8c81b1-b3da-4017-8a3a-fe913c58a0b5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:33.313977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8e8c81b1-b3da-4017-8a3a-fe913c58a0b5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:33.329338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e8c81b1-b3da-4017-8a3a-fe913c58a0b5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:33.331968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e8c81b1-b3da-4017-8a3a-fe913c58a0b5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:33.333582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e8c81b1-b3da-4017-8a3a-fe913c58a0b5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:33.336577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e8c81b1-b3da-4017-8a3a-fe913c58a0b5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:33.337415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e8c81b1-b3da-4017-8a3a-fe913c58a0b5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:33.339531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e8c81b1-b3da-4017-8a3a-fe913c58a0b5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:33.635370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8e8c81b1-b3da-4017-8a3a-fe913c58a0b5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:33.643682 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8e8c81b1-b3da-4017-8a3a-fe913c58a0b5 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1474 microversion: 2.1 time: 0.335336 Oct 27 18:54:33.647032 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1124/2216] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:33 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1474 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:33.655635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2054501e-5cdc-411d-8e04-d10d4ab15ecf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:33.658067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2054501e-5cdc-411d-8e04-d10d4ab15ecf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:33.666355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2054501e-5cdc-411d-8e04-d10d4ab15ecf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:33.667195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2054501e-5cdc-411d-8e04-d10d4ab15ecf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:33.667822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2054501e-5cdc-411d-8e04-d10d4ab15ecf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:33.668737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2054501e-5cdc-411d-8e04-d10d4ab15ecf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:33.669378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2054501e-5cdc-411d-8e04-d10d4ab15ecf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:33.669990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2054501e-5cdc-411d-8e04-d10d4ab15ecf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:33.915503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2054501e-5cdc-411d-8e04-d10d4ab15ecf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:33.937245 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2054501e-5cdc-411d-8e04-d10d4ab15ecf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1505 microversion: 2.1 time: 0.290728 Oct 27 18:54:33.938190 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1125/2217] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:33 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:33.965147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a6c7976c-ba2f-47ff-ba61-d9b780a4b46c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:33.965615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a6c7976c-ba2f-47ff-ba61-d9b780a4b46c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:33.984367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6c7976c-ba2f-47ff-ba61-d9b780a4b46c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:33.984876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6c7976c-ba2f-47ff-ba61-d9b780a4b46c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:33.985325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6c7976c-ba2f-47ff-ba61-d9b780a4b46c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:33.986063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6c7976c-ba2f-47ff-ba61-d9b780a4b46c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:33.986659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6c7976c-ba2f-47ff-ba61-d9b780a4b46c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:33.987096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6c7976c-ba2f-47ff-ba61-d9b780a4b46c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:33.996045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:34.034723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a6c7976c-ba2f-47ff-ba61-d9b780a4b46c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:54:34.198594 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a6c7976c-ba2f-47ff-ba61-d9b780a4b46c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "DELETE /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 204 len: 0 microversion: 2.1 time: 0.236839 Oct 27 18:54:34.202081 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1126/2218] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:54:33 2022] DELETE /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 18:54:34.219188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c04f1337-d89d-4127-b934-bddb0841d254 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:34.220139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c04f1337-d89d-4127-b934-bddb0841d254 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:34.228160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c04f1337-d89d-4127-b934-bddb0841d254 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:34.231662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c04f1337-d89d-4127-b934-bddb0841d254 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:34.232275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c04f1337-d89d-4127-b934-bddb0841d254 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:34.236301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c04f1337-d89d-4127-b934-bddb0841d254 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:34.237167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c04f1337-d89d-4127-b934-bddb0841d254 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:34.238460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b3e8e62f-37cf-4bc0-a223-d2aa633bd90b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:34.239760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c04f1337-d89d-4127-b934-bddb0841d254 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:34.256926 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b3e8e62f-37cf-4bc0-a223-d2aa633bd90b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1318 microversion: 2.1 time: 1.436906 Oct 27 18:54:34.257579 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1093/2219] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:32 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1318 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:34.271551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6bd79350-ce27-497a-8ea4-a72f59942c5b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:34.272203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6bd79350-ce27-497a-8ea4-a72f59942c5b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:34.286849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6bd79350-ce27-497a-8ea4-a72f59942c5b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:34.287584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6bd79350-ce27-497a-8ea4-a72f59942c5b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:34.291563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6bd79350-ce27-497a-8ea4-a72f59942c5b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:34.292557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6bd79350-ce27-497a-8ea4-a72f59942c5b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:34.293264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6bd79350-ce27-497a-8ea4-a72f59942c5b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:34.293878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6bd79350-ce27-497a-8ea4-a72f59942c5b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:34.600469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c04f1337-d89d-4127-b934-bddb0841d254 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:34.613568 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c04f1337-d89d-4127-b934-bddb0841d254 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1511 microversion: 2.1 time: 0.409343 Oct 27 18:54:34.614181 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1127/2220] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:34 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:34.674786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1fafeeeb-3cd7-4e5c-a36e-e7257d559f47 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:34.675413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1fafeeeb-3cd7-4e5c-a36e-e7257d559f47 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:34.688941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fafeeeb-3cd7-4e5c-a36e-e7257d559f47 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:34.689445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fafeeeb-3cd7-4e5c-a36e-e7257d559f47 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:34.689891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fafeeeb-3cd7-4e5c-a36e-e7257d559f47 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:34.690650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fafeeeb-3cd7-4e5c-a36e-e7257d559f47 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:34.691115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fafeeeb-3cd7-4e5c-a36e-e7257d559f47 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:34.691551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fafeeeb-3cd7-4e5c-a36e-e7257d559f47 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:34.810342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1fafeeeb-3cd7-4e5c-a36e-e7257d559f47 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:34.823246 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1fafeeeb-3cd7-4e5c-a36e-e7257d559f47 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1432 microversion: 2.1 time: 0.151232 Oct 27 18:54:34.824617 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1128/2221] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:34 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1432 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:34.985252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6bd79350-ce27-497a-8ea4-a72f59942c5b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:34.997893 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6bd79350-ce27-497a-8ea4-a72f59942c5b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1324 microversion: 2.1 time: 0.738860 Oct 27 18:54:34.998503 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1094/2222] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:34 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1324 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:35.150976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5f7aea15-e5fa-4b00-a567-280af54798c9 req-4706faec-f3a4-4aad-bb73-1711fb2a93e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5e11da-2f25-4433-98d7-8f5b0620095f", "name": "network-vif-deleted", "tag": "00a226a6-58cf-4f6d-9bc2-e12c43140523"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:35.170495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5f7aea15-e5fa-4b00-a567-280af54798c9 req-4706faec-f3a4-4aad-bb73-1711fb2a93e0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:35.170984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5f7aea15-e5fa-4b00-a567-280af54798c9 req-4706faec-f3a4-4aad-bb73-1711fb2a93e0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:35.175146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5f7aea15-e5fa-4b00-a567-280af54798c9 req-4706faec-f3a4-4aad-bb73-1711fb2a93e0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:35.191643 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5f7aea15-e5fa-4b00-a567-280af54798c9 req-4706faec-f3a4-4aad-bb73-1711fb2a93e0 service nova] Creating event network-vif-deleted:00a226a6-58cf-4f6d-9bc2-e12c43140523 for instance ac5e11da-2f25-4433-98d7-8f5b0620095f on n-h1-860687-3 Oct 27 18:54:35.197560 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5f7aea15-e5fa-4b00-a567-280af54798c9 req-4706faec-f3a4-4aad-bb73-1711fb2a93e0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050181 Oct 27 18:54:35.199014 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1129/2223] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:35.284223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3729498e-9417-4577-b189-8f1a0515bbc6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:35.285108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3729498e-9417-4577-b189-8f1a0515bbc6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:35.295463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3729498e-9417-4577-b189-8f1a0515bbc6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:35.296032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3729498e-9417-4577-b189-8f1a0515bbc6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:35.299620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3729498e-9417-4577-b189-8f1a0515bbc6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:35.302594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3729498e-9417-4577-b189-8f1a0515bbc6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:35.306616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3729498e-9417-4577-b189-8f1a0515bbc6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:35.307714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3729498e-9417-4577-b189-8f1a0515bbc6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:35.642682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a2881bc0-e6d3-48b3-8903-0bf6c0ce1a3d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:35.644055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a2881bc0-e6d3-48b3-8903-0bf6c0ce1a3d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:35.659477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2881bc0-e6d3-48b3-8903-0bf6c0ce1a3d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:35.659987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2881bc0-e6d3-48b3-8903-0bf6c0ce1a3d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:35.661089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2881bc0-e6d3-48b3-8903-0bf6c0ce1a3d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:35.662106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2881bc0-e6d3-48b3-8903-0bf6c0ce1a3d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:35.662715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2881bc0-e6d3-48b3-8903-0bf6c0ce1a3d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:35.663163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2881bc0-e6d3-48b3-8903-0bf6c0ce1a3d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:35.903260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a2881bc0-e6d3-48b3-8903-0bf6c0ce1a3d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:35.924998 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a2881bc0-e6d3-48b3-8903-0bf6c0ce1a3d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1511 microversion: 2.1 time: 0.283378 Oct 27 18:54:35.925909 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1130/2224] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:35 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1511 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:35.942958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8d424ef8-c740-4425-ab43-d96d40223abf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:35.946413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8d424ef8-c740-4425-ab43-d96d40223abf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:35.963331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d424ef8-c740-4425-ab43-d96d40223abf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:35.965725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d424ef8-c740-4425-ab43-d96d40223abf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:35.967629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d424ef8-c740-4425-ab43-d96d40223abf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:35.968454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d424ef8-c740-4425-ab43-d96d40223abf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:35.971313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d424ef8-c740-4425-ab43-d96d40223abf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:35.971833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d424ef8-c740-4425-ab43-d96d40223abf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:36.082264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3729498e-9417-4577-b189-8f1a0515bbc6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:36.095694 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3729498e-9417-4577-b189-8f1a0515bbc6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1318 microversion: 2.1 time: 0.813204 Oct 27 18:54:36.098314 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1095/2225] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:35 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1318 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:36.102339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d424ef8-c740-4425-ab43-d96d40223abf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:36.104363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d424ef8-c740-4425-ab43-d96d40223abf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:36.105873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d424ef8-c740-4425-ab43-d96d40223abf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:36.108294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-8d424ef8-c740-4425-ab43-d96d40223abf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lazy-loading 'fault' on Instance uuid ac5e11da-2f25-4433-98d7-8f5b0620095f {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:54:36.111854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-82f35963-8ff2-4675-8fca-d1044e4d2e0b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:36.116081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-82f35963-8ff2-4675-8fca-d1044e4d2e0b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:36.131555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82f35963-8ff2-4675-8fca-d1044e4d2e0b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:36.133941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82f35963-8ff2-4675-8fca-d1044e4d2e0b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:36.136011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82f35963-8ff2-4675-8fca-d1044e4d2e0b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:36.137204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82f35963-8ff2-4675-8fca-d1044e4d2e0b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:36.138030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82f35963-8ff2-4675-8fca-d1044e4d2e0b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:36.138906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82f35963-8ff2-4675-8fca-d1044e4d2e0b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:36.238940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8d424ef8-c740-4425-ab43-d96d40223abf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:36.254108 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8d424ef8-c740-4425-ab43-d96d40223abf tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 200 len: 1308 microversion: 2.1 time: 0.324939 Oct 27 18:54:36.255314 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1131/2226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:35 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 1308 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:37.020173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1202857229", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "bd2a2055-53fd-4e07-8727-b0efd4106712"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:37.086684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] validate_networks() for [('bd2a2055-53fd-4e07-8727-b0efd4106712', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:54:37.351230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-82f35963-8ff2-4675-8fca-d1044e4d2e0b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:37.362714 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-82f35963-8ff2-4675-8fca-d1044e4d2e0b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1324 microversion: 2.1 time: 1.261808 Oct 27 18:54:37.364918 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1096/2227] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:36 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1324 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:37.370890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ccf71888-1551-43d9-9d7b-7eeb037f38d2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:37.371879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ccf71888-1551-43d9-9d7b-7eeb037f38d2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:37.390789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccf71888-1551-43d9-9d7b-7eeb037f38d2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:37.391777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccf71888-1551-43d9-9d7b-7eeb037f38d2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:37.392487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccf71888-1551-43d9-9d7b-7eeb037f38d2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:37.394348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccf71888-1551-43d9-9d7b-7eeb037f38d2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:37.395514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccf71888-1551-43d9-9d7b-7eeb037f38d2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:37.396262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccf71888-1551-43d9-9d7b-7eeb037f38d2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:37.969740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:54:37.970168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:54:37.971033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:54:37.971635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:54:37.972263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:54:38.006989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:38.011081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:38.013593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:38.014152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:38.017091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:38.017554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:38.021248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ccf71888-1551-43d9-9d7b-7eeb037f38d2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:38.030136 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ccf71888-1551-43d9-9d7b-7eeb037f38d2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1511 microversion: 2.1 time: 0.663835 Oct 27 18:54:38.041165 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1097/2228] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:37 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1511 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:38.055330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-35431836-5251-43a5-8f52-4d850f0b494b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:38.055959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-35431836-5251-43a5-8f52-4d850f0b494b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:38.070431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35431836-5251-43a5-8f52-4d850f0b494b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:38.070940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35431836-5251-43a5-8f52-4d850f0b494b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:38.071452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35431836-5251-43a5-8f52-4d850f0b494b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:38.072450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35431836-5251-43a5-8f52-4d850f0b494b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:38.073061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35431836-5251-43a5-8f52-4d850f0b494b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:38.073643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35431836-5251-43a5-8f52-4d850f0b494b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:38.080141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Getting quotas for project 75c41c5833484551b422742abfad598f. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:54:38.088599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Getting quotas for user ac1e2f62e22b4e52badd230ef175817e and project 75c41c5833484551b422742abfad598f. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:54:38.106493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:38.108667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:54:38.112077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:54:38.203537 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3dcd46ae-ad5d-4a6e-bc89-c42d9af8a94a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.350897 Oct 27 18:54:38.205081 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1132/2229] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:54:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:54:38.213609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-76a638d0-32cf-4f02-ace3-b9bdf276cc42 req-32565c3c-e9fc-45fb-b719-eb8b55da7a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47d118d6-37dd-4318-959f-0346e2e7bf67", "tag": "75b873bf-a29c-482c-9601-377724e003a2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:38.229386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-76a638d0-32cf-4f02-ace3-b9bdf276cc42 req-32565c3c-e9fc-45fb-b719-eb8b55da7a38 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:38.231065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-76a638d0-32cf-4f02-ace3-b9bdf276cc42 req-32565c3c-e9fc-45fb-b719-eb8b55da7a38 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:38.231892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-76a638d0-32cf-4f02-ace3-b9bdf276cc42 req-32565c3c-e9fc-45fb-b719-eb8b55da7a38 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:38.287783 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-76a638d0-32cf-4f02-ace3-b9bdf276cc42 req-32565c3c-e9fc-45fb-b719-eb8b55da7a38 service nova] Creating event network-changed:75b873bf-a29c-482c-9601-377724e003a2 for instance 47d118d6-37dd-4318-959f-0346e2e7bf67 on n-h1-860687-3 Oct 27 18:54:38.293587 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-76a638d0-32cf-4f02-ace3-b9bdf276cc42 req-32565c3c-e9fc-45fb-b719-eb8b55da7a38 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086799 Oct 27 18:54:38.307924 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1133/2230] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:38.317470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42123282-7288-449f-a186-f6f12119a6cb tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:38.323151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-42123282-7288-449f-a186-f6f12119a6cb tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: ac5e11da-2f25-4433-98d7-8f5b0620095f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:38.343909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42123282-7288-449f-a186-f6f12119a6cb tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:38.344110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42123282-7288-449f-a186-f6f12119a6cb tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:38.344427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42123282-7288-449f-a186-f6f12119a6cb tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:38.345398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42123282-7288-449f-a186-f6f12119a6cb tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:38.345701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42123282-7288-449f-a186-f6f12119a6cb tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:38.346087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42123282-7288-449f-a186-f6f12119a6cb tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:38.375163 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-42123282-7288-449f-a186-f6f12119a6cb tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] HTTP exception thrown: Instance ac5e11da-2f25-4433-98d7-8f5b0620095f could not be found. Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42123282-7288-449f-a186-f6f12119a6cb tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Request method failure captured: Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f HTTP/1.1 Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtM8K7QvMg8ZcObIu99DJpEaksOFNmcoxeL3-1fjG2eQPYEH7l-n7bj9Scw05ZY_UELKuBQXxJVlELg5H3CXuRdfxGauRz9qSusBOK2uHUMTI-x0lmKf_UoVt6RSZxqLk8jCydbX3X5OGEcwPDtlPnRhDuDWi-w2zX7y6-Rg4oEuPog Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 29fb21c8e61d489fa2c8e347f32c7fe9 Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ListImageFiltersTestJSON-756835261 Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29fb21c8e61d489fa2c8e347f32c7fe9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29fb21c8e61d489fa2c8e347f32c7fe9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29fb21c8e61d489fa2c8e347f32c7fe9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29fb21c8e61d489fa2c8e347f32c7fe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ListImageFiltersTestJSON-756835261 Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 29fb21c8e61d489fa2c8e347f32c7fe9 Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-756835261 Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ListImageFiltersTestJSON-756835261-project Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 61a88f72dfe74cbf9134d52d0fcf25ed Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ListImageFiltersTestJSON-756835261-project Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance ac5e11da-2f25-4433-98d7-8f5b0620095f could not be found. Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'ac5e11da-2f25-4433-98d7-8f5b0620095f'} Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5e11da-2f25-4433-98d7-8f5b0620095f could not be found. Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5e11da-2f25-4433-98d7-8f5b0620095f could not be found. Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:38.376532 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:38.380992 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:38.380992 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:38.380992 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:38.380992 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:38.380992 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:38.380992 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5e11da-2f25-4433-98d7-8f5b0620095f could not be found. Oct 27 18:54:38.380992 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:38.388890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42123282-7288-449f-a186-f6f12119a6cb tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Returning 404 to user: Instance ac5e11da-2f25-4433-98d7-8f5b0620095f could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:38.389938 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-42123282-7288-449f-a186-f6f12119a6cb tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f" status: 404 len: 111 microversion: 2.1 time: 0.080389 Oct 27 18:54:38.401491 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1134/2231] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:38 2022] GET /compute/v2.1/servers/ac5e11da-2f25-4433-98d7-8f5b0620095f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:54:38.406522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-243c3a43-71af-456d-9e8d-83904eff3c5a req-724f088a-3c43-4047-9c9f-bd7dfd6d35d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b6f25f-ce24-45c5-b633-6a36808a0540", "name": "network-vif-plugged", "status": "completed", "tag": "1e5c551d-9e29-4371-a23d-08f3b6b96e56"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:38.424922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-243c3a43-71af-456d-9e8d-83904eff3c5a req-724f088a-3c43-4047-9c9f-bd7dfd6d35d6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:38.425433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-243c3a43-71af-456d-9e8d-83904eff3c5a req-724f088a-3c43-4047-9c9f-bd7dfd6d35d6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:38.425923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-243c3a43-71af-456d-9e8d-83904eff3c5a req-724f088a-3c43-4047-9c9f-bd7dfd6d35d6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:38.453030 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-243c3a43-71af-456d-9e8d-83904eff3c5a req-724f088a-3c43-4047-9c9f-bd7dfd6d35d6 service nova] Creating event network-vif-plugged:1e5c551d-9e29-4371-a23d-08f3b6b96e56 for instance f3b6f25f-ce24-45c5-b633-6a36808a0540 on n-h2-860687-3 Oct 27 18:54:38.462503 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-243c3a43-71af-456d-9e8d-83904eff3c5a req-724f088a-3c43-4047-9c9f-bd7dfd6d35d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058137 Oct 27 18:54:38.465371 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1135/2232] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:38.476553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-443def6e-9441-43ef-ab29-19f6cd529cf6 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:38.477288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-443def6e-9441-43ef-ab29-19f6cd529cf6 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:38.618514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-443def6e-9441-43ef-ab29-19f6cd529cf6 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:38.632673 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-443def6e-9441-43ef-ab29-19f6cd529cf6 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1208 microversion: 2.1 time: 0.165039 Oct 27 18:54:38.637147 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1136/2233] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:38 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1208 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:38.663763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-274819a6-2b58-4d2d-beae-b4c9348adcb4 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:38.664398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-274819a6-2b58-4d2d-beae-b4c9348adcb4 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:38.687044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-274819a6-2b58-4d2d-beae-b4c9348adcb4 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:38.687546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-274819a6-2b58-4d2d-beae-b4c9348adcb4 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:38.687991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-274819a6-2b58-4d2d-beae-b4c9348adcb4 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:38.688704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-274819a6-2b58-4d2d-beae-b4c9348adcb4 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:38.689164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-274819a6-2b58-4d2d-beae-b4c9348adcb4 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:38.689753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-274819a6-2b58-4d2d-beae-b4c9348adcb4 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:38.890800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-35431836-5251-43a5-8f52-4d850f0b494b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:38.902840 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-35431836-5251-43a5-8f52-4d850f0b494b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1318 microversion: 2.1 time: 0.860182 Oct 27 18:54:38.908935 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1098/2234] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:38 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1318 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:38.924594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b1ba0047-d57b-4ef8-b678-1f1091b873bc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:38.925596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b1ba0047-d57b-4ef8-b678-1f1091b873bc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: 1f02e8ec-759d-48bf-9d99-31fa890241c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:38.944188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1ba0047-d57b-4ef8-b678-1f1091b873bc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:38.945932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1ba0047-d57b-4ef8-b678-1f1091b873bc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:38.946485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1ba0047-d57b-4ef8-b678-1f1091b873bc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:38.948653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1ba0047-d57b-4ef8-b678-1f1091b873bc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:38.950659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1ba0047-d57b-4ef8-b678-1f1091b873bc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:38.961158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1ba0047-d57b-4ef8-b678-1f1091b873bc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:39.076887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-274819a6-2b58-4d2d-beae-b4c9348adcb4 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:39.093261 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-274819a6-2b58-4d2d-beae-b4c9348adcb4 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1324 microversion: 2.1 time: 0.451886 Oct 27 18:54:39.095357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b1ba0047-d57b-4ef8-b678-1f1091b873bc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: 1f02e8ec-759d-48bf-9d99-31fa890241c1] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:54:39.099926 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1137/2235] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:38 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1324 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:39.102965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-274819a6-2b58-4d2d-beae-b4c9348adcb4 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:39.106273 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-274819a6-2b58-4d2d-beae-b4c9348adcb4 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001506 Oct 27 18:54:39.107193 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1138/2236] 10.222.0.42 () {56 vars in 886 bytes} [Thu Oct 27 18:54:39 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 18:54:39.130424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7a2eca34-aad1-46a4-a294-0e276cf18d0d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:39.131753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7a2eca34-aad1-46a4-a294-0e276cf18d0d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:39.161012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a2eca34-aad1-46a4-a294-0e276cf18d0d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:39.164330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a2eca34-aad1-46a4-a294-0e276cf18d0d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:39.166001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a2eca34-aad1-46a4-a294-0e276cf18d0d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:39.169402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a2eca34-aad1-46a4-a294-0e276cf18d0d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:39.171030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a2eca34-aad1-46a4-a294-0e276cf18d0d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:39.173898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7a2eca34-aad1-46a4-a294-0e276cf18d0d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:39.327804 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b1ba0047-d57b-4ef8-b678-1f1091b873bc tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1" status: 204 len: 0 microversion: 2.1 time: 0.413880 Oct 27 18:54:39.329874 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1099/2237] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:54:38 2022] DELETE /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:39.346192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-04036fe9-31fd-42f4-ad8f-597cb70bb7aa tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:39.349668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04036fe9-31fd-42f4-ad8f-597cb70bb7aa tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: 1f02e8ec-759d-48bf-9d99-31fa890241c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:39.356896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04036fe9-31fd-42f4-ad8f-597cb70bb7aa tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:39.357665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04036fe9-31fd-42f4-ad8f-597cb70bb7aa tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:39.358299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04036fe9-31fd-42f4-ad8f-597cb70bb7aa tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:39.359499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04036fe9-31fd-42f4-ad8f-597cb70bb7aa tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:39.360143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04036fe9-31fd-42f4-ad8f-597cb70bb7aa tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:39.360751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04036fe9-31fd-42f4-ad8f-597cb70bb7aa tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:39.605461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-04036fe9-31fd-42f4-ad8f-597cb70bb7aa tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:39.617460 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-04036fe9-31fd-42f4-ad8f-597cb70bb7aa tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1" status: 200 len: 1474 microversion: 2.1 time: 0.282592 Oct 27 18:54:39.619468 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1100/2238] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:39 2022] GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1 => generated 1474 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:39.674828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dbf03f09-7584-43b1-8470-dccef5a96a9a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:39.675815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dbf03f09-7584-43b1-8470-dccef5a96a9a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:39.682907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbf03f09-7584-43b1-8470-dccef5a96a9a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:39.683753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbf03f09-7584-43b1-8470-dccef5a96a9a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:39.684401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbf03f09-7584-43b1-8470-dccef5a96a9a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:39.685329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbf03f09-7584-43b1-8470-dccef5a96a9a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:39.686002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbf03f09-7584-43b1-8470-dccef5a96a9a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:39.686690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbf03f09-7584-43b1-8470-dccef5a96a9a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:39.764126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dbf03f09-7584-43b1-8470-dccef5a96a9a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:39.778553 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dbf03f09-7584-43b1-8470-dccef5a96a9a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1212 microversion: 2.1 time: 0.107834 Oct 27 18:54:39.793058 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1101/2239] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:39 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1212 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:39.852207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7a2eca34-aad1-46a4-a294-0e276cf18d0d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:39.866791 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7a2eca34-aad1-46a4-a294-0e276cf18d0d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 200 len: 1469 microversion: 2.1 time: 0.756774 Oct 27 18:54:39.871158 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1139/2240] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:39 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 1469 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:39.936392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-04ad8300-1e05-420c-b4be-90040843d752 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:39.938051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04ad8300-1e05-420c-b4be-90040843d752 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:39.953404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad8300-1e05-420c-b4be-90040843d752 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:39.955512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad8300-1e05-420c-b4be-90040843d752 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:39.956143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad8300-1e05-420c-b4be-90040843d752 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:39.958516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad8300-1e05-420c-b4be-90040843d752 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:39.966320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad8300-1e05-420c-b4be-90040843d752 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:39.970404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ad8300-1e05-420c-b4be-90040843d752 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:40.120752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8c3da095-6fc6-48a9-83c4-936f3378de29 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:40.121368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8c3da095-6fc6-48a9-83c4-936f3378de29 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:40.143098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c3da095-6fc6-48a9-83c4-936f3378de29 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:40.146536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c3da095-6fc6-48a9-83c4-936f3378de29 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:40.150600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c3da095-6fc6-48a9-83c4-936f3378de29 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:40.152649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c3da095-6fc6-48a9-83c4-936f3378de29 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:40.156637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c3da095-6fc6-48a9-83c4-936f3378de29 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:40.157371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c3da095-6fc6-48a9-83c4-936f3378de29 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:40.401974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-04ad8300-1e05-420c-b4be-90040843d752 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:40.416000 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-04ad8300-1e05-420c-b4be-90040843d752 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1318 microversion: 2.1 time: 0.485000 Oct 27 18:54:40.434466 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1102/2241] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:39 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:40.442708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c0b12eea-f9da-4154-8364-d97234717b8c req-0e6350f3-3636-4076-b987-76257b47d21f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "263ba238-b675-4ae7-a469-ced7d67f016a", "name": "network-vif-deleted", "tag": "60da2023-14ac-4154-8f86-64e5b6e76b40"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:40.463968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c0b12eea-f9da-4154-8364-d97234717b8c req-0e6350f3-3636-4076-b987-76257b47d21f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:40.464468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c0b12eea-f9da-4154-8364-d97234717b8c req-0e6350f3-3636-4076-b987-76257b47d21f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:40.465125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c0b12eea-f9da-4154-8364-d97234717b8c req-0e6350f3-3636-4076-b987-76257b47d21f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:40.488990 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c0b12eea-f9da-4154-8364-d97234717b8c req-0e6350f3-3636-4076-b987-76257b47d21f service nova] Creating event network-vif-deleted:60da2023-14ac-4154-8f86-64e5b6e76b40 for instance 263ba238-b675-4ae7-a469-ced7d67f016a on n-h1-860687-3 Oct 27 18:54:40.501286 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c0b12eea-f9da-4154-8364-d97234717b8c req-0e6350f3-3636-4076-b987-76257b47d21f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065192 Oct 27 18:54:40.512526 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1103/2242] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:40.643226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-94bb9f7b-68a1-423a-b438-32ae78a240f1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:40.643907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-94bb9f7b-68a1-423a-b438-32ae78a240f1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: 1f02e8ec-759d-48bf-9d99-31fa890241c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:40.660937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94bb9f7b-68a1-423a-b438-32ae78a240f1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:40.663079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94bb9f7b-68a1-423a-b438-32ae78a240f1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:40.664190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94bb9f7b-68a1-423a-b438-32ae78a240f1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:40.670111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94bb9f7b-68a1-423a-b438-32ae78a240f1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:40.670891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94bb9f7b-68a1-423a-b438-32ae78a240f1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:40.671538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94bb9f7b-68a1-423a-b438-32ae78a240f1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:40.758253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8c3da095-6fc6-48a9-83c4-936f3378de29 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:40.762130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:40.779344 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8c3da095-6fc6-48a9-83c4-936f3378de29 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1324 microversion: 2.1 time: 0.661353 Oct 27 18:54:40.781951 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1140/2243] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:40 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1324 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:40.805367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-df468ba5-140f-46a3-8c73-8f4bb3ebe632 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:40.806593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-df468ba5-140f-46a3-8c73-8f4bb3ebe632 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:40.828682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df468ba5-140f-46a3-8c73-8f4bb3ebe632 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:40.834498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df468ba5-140f-46a3-8c73-8f4bb3ebe632 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:40.836430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df468ba5-140f-46a3-8c73-8f4bb3ebe632 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:40.841626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df468ba5-140f-46a3-8c73-8f4bb3ebe632 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:40.842913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df468ba5-140f-46a3-8c73-8f4bb3ebe632 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:40.845678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df468ba5-140f-46a3-8c73-8f4bb3ebe632 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:41.069197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-df468ba5-140f-46a3-8c73-8f4bb3ebe632 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:41.080292 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-df468ba5-140f-46a3-8c73-8f4bb3ebe632 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1212 microversion: 2.1 time: 0.280061 Oct 27 18:54:41.098651 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1141/2244] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:40 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1212 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:41.110509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a95a4514-86d1-47da-ac7a-130d9f2aa3ab tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:41.111232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a95a4514-86d1-47da-ac7a-130d9f2aa3ab tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:41.125703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a95a4514-86d1-47da-ac7a-130d9f2aa3ab tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:41.126445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a95a4514-86d1-47da-ac7a-130d9f2aa3ab tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:41.127601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a95a4514-86d1-47da-ac7a-130d9f2aa3ab tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:41.128355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a95a4514-86d1-47da-ac7a-130d9f2aa3ab tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:41.128836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a95a4514-86d1-47da-ac7a-130d9f2aa3ab tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:41.129402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a95a4514-86d1-47da-ac7a-130d9f2aa3ab tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:41.168302 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-a95a4514-86d1-47da-ac7a-130d9f2aa3ab tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a95a4514-86d1-47da-ac7a-130d9f2aa3ab tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a HTTP/1.1 Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '263ba238-b675-4ae7-a469-ced7d67f016a'} Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:41.172961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:41.177670 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:41.177670 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:41.177670 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:41.177670 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:41.177670 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:41.177670 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:54:41.177670 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:41.183338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a95a4514-86d1-47da-ac7a-130d9f2aa3ab tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:41.184570 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a95a4514-86d1-47da-ac7a-130d9f2aa3ab tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 404 len: 111 microversion: 2.1 time: 0.084559 Oct 27 18:54:41.185370 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1142/2245] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:41 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:54:41.199909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0648d639-be14-4835-85ac-ae42b4a0c577 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:41.206034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0648d639-be14-4835-85ac-ae42b4a0c577 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:41.218070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0648d639-be14-4835-85ac-ae42b4a0c577 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Searching by: {'deleted': False, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:54:41.226235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0648d639-be14-4835-85ac-ae42b4a0c577 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:41.230662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0648d639-be14-4835-85ac-ae42b4a0c577 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:41.231421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0648d639-be14-4835-85ac-ae42b4a0c577 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:41.239499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0648d639-be14-4835-85ac-ae42b4a0c577 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:41.240790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0648d639-be14-4835-85ac-ae42b4a0c577 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:41.241352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0648d639-be14-4835-85ac-ae42b4a0c577 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:41.278979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-94bb9f7b-68a1-423a-b438-32ae78a240f1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:41.293471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-0648d639-be14-4835-85ac-ae42b4a0c577 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:54:41.294630 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-94bb9f7b-68a1-423a-b438-32ae78a240f1 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1" status: 200 len: 1474 microversion: 2.1 time: 0.655898 Oct 27 18:54:41.319625 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1104/2246] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:40 2022] GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1 => generated 1474 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:41.325860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4d918601-4b74-4e79-b709-8071033a2169 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:41.327300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4d918601-4b74-4e79-b709-8071033a2169 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:41.336287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d918601-4b74-4e79-b709-8071033a2169 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:41.336992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d918601-4b74-4e79-b709-8071033a2169 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:41.338124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d918601-4b74-4e79-b709-8071033a2169 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:41.340831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d918601-4b74-4e79-b709-8071033a2169 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:41.343603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d918601-4b74-4e79-b709-8071033a2169 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:41.349132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d918601-4b74-4e79-b709-8071033a2169 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:41.377779 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0648d639-be14-4835-85ac-ae42b4a0c577 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.191084 Oct 27 18:54:41.380057 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1143/2247] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 18:54:41 2022] GET /compute/v2.1/servers => generated 344 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:41.396221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:41.408855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:41.410056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Searching by: {'deleted': False, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 18:54:41.423614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:41.424313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:41.429098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:41.432869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:41.437077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:41.437652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:41.488159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 18:54:41.548817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4d918601-4b74-4e79-b709-8071033a2169 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:41.560967 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4d918601-4b74-4e79-b709-8071033a2169 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.239684 Oct 27 18:54:41.564031 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1105/2248] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:41 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:41.570605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-828a9186-f3f8-4379-ad06-4b77a9c02f5f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:41.571427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-828a9186-f3f8-4379-ad06-4b77a9c02f5f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:41.585415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-828a9186-f3f8-4379-ad06-4b77a9c02f5f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:41.589817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-828a9186-f3f8-4379-ad06-4b77a9c02f5f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:41.593541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:41.596268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-828a9186-f3f8-4379-ad06-4b77a9c02f5f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:41.597712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-828a9186-f3f8-4379-ad06-4b77a9c02f5f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:41.598762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-828a9186-f3f8-4379-ad06-4b77a9c02f5f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:41.599205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-828a9186-f3f8-4379-ad06-4b77a9c02f5f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:41.602493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:41.603215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:41.604104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:41.641304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:41.967998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-828a9186-f3f8-4379-ad06-4b77a9c02f5f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:41.996278 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-828a9186-f3f8-4379-ad06-4b77a9c02f5f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1318 microversion: 2.1 time: 0.430427 Oct 27 18:54:42.002231 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1106/2249] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:41 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:42.019083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9e1ef08-9ded-4be4-9ddc-0f4452d21895 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9e1ef08-9ded-4be4-9ddc-0f4452d21895 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 163 Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": 12345, "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'networks': [{'uuid': '969dfa55-7bd6-4101-b2b3-c0ca6c6378eb'}]}}} Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 12345 Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:54:42.024450 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:54:42.028022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:54:42.028022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 27 18:54:42.028022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:42.028022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:42.028022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:42.028022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:42.028022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:42.028022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:42.028022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:54:42.028022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:54:42.028022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 27 18:54:42.028022 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:42.036519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9e1ef08-9ded-4be4-9ddc-0f4452d21895 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:42.037707 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c9e1ef08-9ded-4be4-9ddc-0f4452d21895 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.034135 Oct 27 18:54:42.053712 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1107/2250] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:54:42 2022] POST /compute/v2.1/servers => generated 127 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:54:42.059123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e050d8c-7ee3-42a3-ae7a-56b3ae5d4a9b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:42.067844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e050d8c-7ee3-42a3-ae7a-56b3ae5d4a9b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:42.097339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e050d8c-7ee3-42a3-ae7a-56b3ae5d4a9b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:42.098339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e050d8c-7ee3-42a3-ae7a-56b3ae5d4a9b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:42.103045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e050d8c-7ee3-42a3-ae7a-56b3ae5d4a9b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:42.106593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e050d8c-7ee3-42a3-ae7a-56b3ae5d4a9b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:42.114301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e050d8c-7ee3-42a3-ae7a-56b3ae5d4a9b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:42.115243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e050d8c-7ee3-42a3-ae7a-56b3ae5d4a9b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:42.375323 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-830b0be3-aa14-418d-9b93-58ed0a76572f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.984432 Oct 27 18:54:42.377232 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1144/2251] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 18:54:41 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:54:42.384105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a62f4204-9f3d-425b-bf3f-d5eccd340bd2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:42.385301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a62f4204-9f3d-425b-bf3f-d5eccd340bd2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:42.403299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a62f4204-9f3d-425b-bf3f-d5eccd340bd2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:42.406993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a62f4204-9f3d-425b-bf3f-d5eccd340bd2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:42.409875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a62f4204-9f3d-425b-bf3f-d5eccd340bd2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:42.414791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a62f4204-9f3d-425b-bf3f-d5eccd340bd2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:42.417994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a62f4204-9f3d-425b-bf3f-d5eccd340bd2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:42.418643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a62f4204-9f3d-425b-bf3f-d5eccd340bd2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:42.492248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e050d8c-7ee3-42a3-ae7a-56b3ae5d4a9b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:42.500901 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e050d8c-7ee3-42a3-ae7a-56b3ae5d4a9b tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1324 microversion: 2.1 time: 0.445469 Oct 27 18:54:42.516062 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1108/2252] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:42 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1324 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:42.524566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aa9f6ca2-f9e6-4696-9f31-8e2027c878e2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:42.525665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aa9f6ca2-f9e6-4696-9f31-8e2027c878e2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:42.532479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa9f6ca2-f9e6-4696-9f31-8e2027c878e2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:42.533763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa9f6ca2-f9e6-4696-9f31-8e2027c878e2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:42.534464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa9f6ca2-f9e6-4696-9f31-8e2027c878e2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:42.536362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa9f6ca2-f9e6-4696-9f31-8e2027c878e2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:42.537499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa9f6ca2-f9e6-4696-9f31-8e2027c878e2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:42.538146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa9f6ca2-f9e6-4696-9f31-8e2027c878e2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:42.771572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aa9f6ca2-f9e6-4696-9f31-8e2027c878e2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:42.783416 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aa9f6ca2-f9e6-4696-9f31-8e2027c878e2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1260 microversion: 2.1 time: 0.266040 Oct 27 18:54:42.784039 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1109/2253] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:42 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1260 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:42.810546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5d565d89-0dd7-471b-a628-aa9a4f57cbdd tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:42.812168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5d565d89-0dd7-471b-a628-aa9a4f57cbdd tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: 1f02e8ec-759d-48bf-9d99-31fa890241c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:42.829377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d565d89-0dd7-471b-a628-aa9a4f57cbdd tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:42.829881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d565d89-0dd7-471b-a628-aa9a4f57cbdd tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:42.830323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d565d89-0dd7-471b-a628-aa9a4f57cbdd tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:42.835884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d565d89-0dd7-471b-a628-aa9a4f57cbdd tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:42.836400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d565d89-0dd7-471b-a628-aa9a4f57cbdd tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:42.836855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d565d89-0dd7-471b-a628-aa9a4f57cbdd tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:42.974643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5d565d89-0dd7-471b-a628-aa9a4f57cbdd tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a88f72dfe74cbf9134d52d0fcf25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fb21c8e61d489fa2c8e347f32c7fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:42.992007 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5d565d89-0dd7-471b-a628-aa9a4f57cbdd tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1" status: 200 len: 1432 microversion: 2.1 time: 0.200319 Oct 27 18:54:42.993262 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1110/2254] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:42 2022] GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1 => generated 1432 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:42.997997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e8794a32-d38c-4a27-9bd7-1b69ee7666aa tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:43.021172 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e8794a32-d38c-4a27-9bd7-1b69ee7666aa tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026556 Oct 27 18:54:43.029284 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1111/2255] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:54:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:43.036332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f0251f5a-ba38-465a-9cec-381dc1bd93d3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:43.051617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f0251f5a-ba38-465a-9cec-381dc1bd93d3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:43.073244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0251f5a-ba38-465a-9cec-381dc1bd93d3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:43.073779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0251f5a-ba38-465a-9cec-381dc1bd93d3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:43.074292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0251f5a-ba38-465a-9cec-381dc1bd93d3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:43.075160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0251f5a-ba38-465a-9cec-381dc1bd93d3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:43.075670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0251f5a-ba38-465a-9cec-381dc1bd93d3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:43.076131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0251f5a-ba38-465a-9cec-381dc1bd93d3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:43.306502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f0251f5a-ba38-465a-9cec-381dc1bd93d3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:43.318576 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f0251f5a-ba38-465a-9cec-381dc1bd93d3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1509 microversion: 2.1 time: 0.287786 Oct 27 18:54:43.330826 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1112/2256] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:43 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:43.346807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a62f4204-9f3d-425b-bf3f-d5eccd340bd2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:43.355192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-2e8c8927-bc09-4b60-bc97-ede584dd68cf req-f1279622-c28b-4e3d-8bbd-49b3a4d04553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f02e8ec-759d-48bf-9d99-31fa890241c1", "name": "network-vif-deleted", "tag": "e08a66dd-bce1-4f3f-ae67-ea863bda862f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:43.357568 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a62f4204-9f3d-425b-bf3f-d5eccd340bd2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.978530 Oct 27 18:54:43.358330 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1145/2257] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:42 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:43.368267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bb916222-7cda-4ed3-bfb0-95e6fc2e3e89 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:43.370097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bb916222-7cda-4ed3-bfb0-95e6fc2e3e89 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:43.385376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2e8c8927-bc09-4b60-bc97-ede584dd68cf req-f1279622-c28b-4e3d-8bbd-49b3a4d04553 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:43.386153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2e8c8927-bc09-4b60-bc97-ede584dd68cf req-f1279622-c28b-4e3d-8bbd-49b3a4d04553 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:43.386774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2e8c8927-bc09-4b60-bc97-ede584dd68cf req-f1279622-c28b-4e3d-8bbd-49b3a4d04553 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:43.398888 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-2e8c8927-bc09-4b60-bc97-ede584dd68cf req-f1279622-c28b-4e3d-8bbd-49b3a4d04553 service nova] Creating event network-vif-deleted:e08a66dd-bce1-4f3f-ae67-ea863bda862f for instance 1f02e8ec-759d-48bf-9d99-31fa890241c1 on n-h2-860687-3 Oct 27 18:54:43.403447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb916222-7cda-4ed3-bfb0-95e6fc2e3e89 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:43.404018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb916222-7cda-4ed3-bfb0-95e6fc2e3e89 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:43.404389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb916222-7cda-4ed3-bfb0-95e6fc2e3e89 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:43.405336 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-2e8c8927-bc09-4b60-bc97-ede584dd68cf req-f1279622-c28b-4e3d-8bbd-49b3a4d04553 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073177 Oct 27 18:54:43.405520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb916222-7cda-4ed3-bfb0-95e6fc2e3e89 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:43.405987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb916222-7cda-4ed3-bfb0-95e6fc2e3e89 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:43.406866 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1113/2258] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:43.412928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb916222-7cda-4ed3-bfb0-95e6fc2e3e89 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:43.416597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aec5c1b7-c41e-4a95-993a-2c22e6760345 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:43.417552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aec5c1b7-c41e-4a95-993a-2c22e6760345 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:43.439869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aec5c1b7-c41e-4a95-993a-2c22e6760345 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:43.440370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aec5c1b7-c41e-4a95-993a-2c22e6760345 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:43.446549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aec5c1b7-c41e-4a95-993a-2c22e6760345 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:43.447670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aec5c1b7-c41e-4a95-993a-2c22e6760345 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:43.451821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aec5c1b7-c41e-4a95-993a-2c22e6760345 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:43.452619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aec5c1b7-c41e-4a95-993a-2c22e6760345 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:43.501450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aec5c1b7-c41e-4a95-993a-2c22e6760345 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:54:43.633413 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aec5c1b7-c41e-4a95-993a-2c22e6760345 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "DELETE /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 204 len: 0 microversion: 2.1 time: 0.224008 Oct 27 18:54:43.634574 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1114/2259] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:54:43 2022] DELETE /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:43.641796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-32e56bb8-5e06-4367-bc94-78c831e125a4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:43.642851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-32e56bb8-5e06-4367-bc94-78c831e125a4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:43.651004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32e56bb8-5e06-4367-bc94-78c831e125a4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:43.651887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32e56bb8-5e06-4367-bc94-78c831e125a4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:43.652334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32e56bb8-5e06-4367-bc94-78c831e125a4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:43.653355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32e56bb8-5e06-4367-bc94-78c831e125a4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:43.654632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32e56bb8-5e06-4367-bc94-78c831e125a4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:43.655256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32e56bb8-5e06-4367-bc94-78c831e125a4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:43.846231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-32e56bb8-5e06-4367-bc94-78c831e125a4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:43.870529 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-32e56bb8-5e06-4367-bc94-78c831e125a4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.234533 Oct 27 18:54:43.873163 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1115/2260] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:43 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:43.883955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-73b24a96-e96b-4379-86ca-ffc9802e4d45 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:43.885833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-73b24a96-e96b-4379-86ca-ffc9802e4d45 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:43.900032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b24a96-e96b-4379-86ca-ffc9802e4d45 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:43.912847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b24a96-e96b-4379-86ca-ffc9802e4d45 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:43.913634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b24a96-e96b-4379-86ca-ffc9802e4d45 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:43.914442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b24a96-e96b-4379-86ca-ffc9802e4d45 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:43.914934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b24a96-e96b-4379-86ca-ffc9802e4d45 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:43.918020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b24a96-e96b-4379-86ca-ffc9802e4d45 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:44.111180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bb916222-7cda-4ed3-bfb0-95e6fc2e3e89 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:44.128133 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bb916222-7cda-4ed3-bfb0-95e6fc2e3e89 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1509 microversion: 2.1 time: 0.763651 Oct 27 18:54:44.128784 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1146/2261] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:43 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1509 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:44.141275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c36ca77d-d536-443d-b5e6-2d9e7a1b29bc tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:44.148292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c36ca77d-d536-443d-b5e6-2d9e7a1b29bc tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:44.165648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c36ca77d-d536-443d-b5e6-2d9e7a1b29bc tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:44.166988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c36ca77d-d536-443d-b5e6-2d9e7a1b29bc tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:44.167617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c36ca77d-d536-443d-b5e6-2d9e7a1b29bc tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:44.171343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c36ca77d-d536-443d-b5e6-2d9e7a1b29bc tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:44.171905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c36ca77d-d536-443d-b5e6-2d9e7a1b29bc tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:44.173700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c36ca77d-d536-443d-b5e6-2d9e7a1b29bc tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:44.182474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-73b24a96-e96b-4379-86ca-ffc9802e4d45 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:44.203194 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-73b24a96-e96b-4379-86ca-ffc9802e4d45 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1324 microversion: 2.1 time: 0.328645 Oct 27 18:54:44.205558 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1116/2262] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:43 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1324 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:44.215439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-794a495e-74e9-4c1a-813b-eb8dfbc4dbb9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:44.216383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-794a495e-74e9-4c1a-813b-eb8dfbc4dbb9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:44.240630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-794a495e-74e9-4c1a-813b-eb8dfbc4dbb9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:44.241136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-794a495e-74e9-4c1a-813b-eb8dfbc4dbb9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:44.241576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-794a495e-74e9-4c1a-813b-eb8dfbc4dbb9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:44.242299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-794a495e-74e9-4c1a-813b-eb8dfbc4dbb9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:44.247013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-794a495e-74e9-4c1a-813b-eb8dfbc4dbb9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:44.247827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-794a495e-74e9-4c1a-813b-eb8dfbc4dbb9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:44.360041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-794a495e-74e9-4c1a-813b-eb8dfbc4dbb9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:44.372807 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-794a495e-74e9-4c1a-813b-eb8dfbc4dbb9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1266 microversion: 2.1 time: 0.165694 Oct 27 18:54:44.373499 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1117/2263] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:44 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:44.380942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f15d2bfa-fdae-4beb-ba58-ae4b5bf66cc6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:44.383033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f15d2bfa-fdae-4beb-ba58-ae4b5bf66cc6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] [instance: 1f02e8ec-759d-48bf-9d99-31fa890241c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:44.399993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f15d2bfa-fdae-4beb-ba58-ae4b5bf66cc6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:44.401184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f15d2bfa-fdae-4beb-ba58-ae4b5bf66cc6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:44.401773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f15d2bfa-fdae-4beb-ba58-ae4b5bf66cc6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:44.402683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f15d2bfa-fdae-4beb-ba58-ae4b5bf66cc6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:44.403302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f15d2bfa-fdae-4beb-ba58-ae4b5bf66cc6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:44.403833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f15d2bfa-fdae-4beb-ba58-ae4b5bf66cc6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:44.427674 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-f15d2bfa-fdae-4beb-ba58-ae4b5bf66cc6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] HTTP exception thrown: Instance 1f02e8ec-759d-48bf-9d99-31fa890241c1 could not be found. Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f15d2bfa-fdae-4beb-ba58-ae4b5bf66cc6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Request method failure captured: Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1 HTTP/1.1 Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtM8K7QvMg8ZcObIu99DJpEaksOFNmcoxeL3-1fjG2eQPYEH7l-n7bj9Scw05ZY_UELKuBQXxJVlELg5H3CXuRdfxGauRz9qSusBOK2uHUMTI-x0lmKf_UoVt6RSZxqLk8jCydbX3X5OGEcwPDtlPnRhDuDWi-w2zX7y6-Rg4oEuPog Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 29fb21c8e61d489fa2c8e347f32c7fe9 Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ListImageFiltersTestJSON-756835261 Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29fb21c8e61d489fa2c8e347f32c7fe9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29fb21c8e61d489fa2c8e347f32c7fe9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29fb21c8e61d489fa2c8e347f32c7fe9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29fb21c8e61d489fa2c8e347f32c7fe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ListImageFiltersTestJSON-756835261 Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 29fb21c8e61d489fa2c8e347f32c7fe9 Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-756835261 Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ListImageFiltersTestJSON-756835261-project Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 61a88f72dfe74cbf9134d52d0fcf25ed Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ListImageFiltersTestJSON-756835261-project Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 1f02e8ec-759d-48bf-9d99-31fa890241c1 could not be found. Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '1f02e8ec-759d-48bf-9d99-31fa890241c1'} Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f02e8ec-759d-48bf-9d99-31fa890241c1 could not be found. Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f02e8ec-759d-48bf-9d99-31fa890241c1 could not be found. Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:44.430442 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:44.434821 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:44.434821 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:44.434821 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:44.434821 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:44.434821 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:44.434821 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f02e8ec-759d-48bf-9d99-31fa890241c1 could not be found. Oct 27 18:54:44.434821 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:44.435955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f15d2bfa-fdae-4beb-ba58-ae4b5bf66cc6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Returning 404 to user: Instance 1f02e8ec-759d-48bf-9d99-31fa890241c1 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:44.436973 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f15d2bfa-fdae-4beb-ba58-ae4b5bf66cc6 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1" status: 404 len: 111 microversion: 2.1 time: 0.062243 Oct 27 18:54:44.437952 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1118/2264] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:44 2022] GET /compute/v2.1/servers/1f02e8ec-759d-48bf-9d99-31fa890241c1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:54:44.445126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:44.448897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:44.457776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:44.458230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:44.458868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:44.460436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:44.462453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:44.462453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:44.608063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:54:44.609882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:54:44.610369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:54:44.610961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:54:44.611531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:54:44.679347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c36ca77d-d536-443d-b5e6-2d9e7a1b29bc tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:44.689087 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c36ca77d-d536-443d-b5e6-2d9e7a1b29bc tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1609 microversion: 2.1 time: 0.554380 Oct 27 18:54:44.691020 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1147/2265] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:44 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1609 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:44.715701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-11d8f02f-4cde-46fb-ade9-e8f77b291e48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc8733b6040>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:44.775555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:44.792698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:44.796517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:44.797146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:44.798309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:44.798947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:44.800741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:44.884485 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e30708f9-6881-41e9-be46-24bac80bb045 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "POST /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540/action" status: 202 len: 1111 microversion: 2.1 time: 0.444380 Oct 27 18:54:44.885160 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1119/2266] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:54:44 2022] POST /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540/action => generated 1111 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 18:54:44.909547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1efc0668-c861-42ef-b1e2-9ab711fcea07 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:44.913575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1efc0668-c861-42ef-b1e2-9ab711fcea07 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:44.941063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1efc0668-c861-42ef-b1e2-9ab711fcea07 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:44.951534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1efc0668-c861-42ef-b1e2-9ab711fcea07 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:44.952175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1efc0668-c861-42ef-b1e2-9ab711fcea07 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:44.952944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1efc0668-c861-42ef-b1e2-9ab711fcea07 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:44.953423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1efc0668-c861-42ef-b1e2-9ab711fcea07 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:44.953857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1efc0668-c861-42ef-b1e2-9ab711fcea07 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:45.297047 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-11d8f02f-4cde-46fb-ade9-e8f77b291e48 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "DELETE /compute/v2.1/images/c69cd01e-4427-4465-907d-dd087e8a1b8c" status: 204 len: 0 microversion: 2.1 time: 0.598704 Oct 27 18:54:45.298612 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1148/2267] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:44 2022] DELETE /compute/v2.1/images/c69cd01e-4427-4465-907d-dd087e8a1b8c => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:45.305042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e7e8138-9dd5-41f5-af9a-9c6e049f8459 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:45.311461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6e7e8138-9dd5-41f5-af9a-9c6e049f8459 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:45.331553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7e8138-9dd5-41f5-af9a-9c6e049f8459 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:45.332568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7e8138-9dd5-41f5-af9a-9c6e049f8459 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:45.333278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7e8138-9dd5-41f5-af9a-9c6e049f8459 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:45.334250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7e8138-9dd5-41f5-af9a-9c6e049f8459 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:45.334881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7e8138-9dd5-41f5-af9a-9c6e049f8459 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:45.335480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7e8138-9dd5-41f5-af9a-9c6e049f8459 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:45.378092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1efc0668-c861-42ef-b1e2-9ab711fcea07 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:45.399781 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1efc0668-c861-42ef-b1e2-9ab711fcea07 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 0.494077 Oct 27 18:54:45.400967 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1120/2268] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:44 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:54:45.420457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a249cc97-40f1-4d20-b9d7-d1d31dfa9673 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc87335e160>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:46.208682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6e7e8138-9dd5-41f5-af9a-9c6e049f8459 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:46.213804 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a249cc97-40f1-4d20-b9d7-d1d31dfa9673 tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "DELETE /compute/v2.1/images/c48522b4-ef08-4fa9-b2b7-497281d973e6" status: 204 len: 0 microversion: 2.1 time: 0.811162 Oct 27 18:54:46.214450 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1121/2269] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:45 2022] DELETE /compute/v2.1/images/c48522b4-ef08-4fa9-b2b7-497281d973e6 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:46.221217 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6e7e8138-9dd5-41f5-af9a-9c6e049f8459 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1324 microversion: 2.1 time: 0.921090 Oct 27 18:54:46.234424 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1149/2270] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:45 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1324 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:46.235627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d0292d40-b75c-4987-9348-6735162fdea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:46.235627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d0292d40-b75c-4987-9348-6735162fdea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:46.236568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ed518da1-a4bc-4929-89ba-16a42c521bdb tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:46.240074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ed518da1-a4bc-4929-89ba-16a42c521bdb tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:46.249619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0292d40-b75c-4987-9348-6735162fdea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:46.250144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0292d40-b75c-4987-9348-6735162fdea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:46.258452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0292d40-b75c-4987-9348-6735162fdea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:46.259306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0292d40-b75c-4987-9348-6735162fdea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:46.261291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0292d40-b75c-4987-9348-6735162fdea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:46.262707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed518da1-a4bc-4929-89ba-16a42c521bdb tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:46.263213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed518da1-a4bc-4929-89ba-16a42c521bdb tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:46.263871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed518da1-a4bc-4929-89ba-16a42c521bdb tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:46.264413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed518da1-a4bc-4929-89ba-16a42c521bdb tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:46.264883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed518da1-a4bc-4929-89ba-16a42c521bdb tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:46.265316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed518da1-a4bc-4929-89ba-16a42c521bdb tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:46.266538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0292d40-b75c-4987-9348-6735162fdea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:46.420404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ed518da1-a4bc-4929-89ba-16a42c521bdb tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:46.433341 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ed518da1-a4bc-4929-89ba-16a42c521bdb tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1541 microversion: 2.1 time: 0.204058 Oct 27 18:54:46.434738 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1150/2271] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:46 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1541 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:46.450837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d95edcc4-7a2f-472a-9c8b-073cf926c5ae tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] Calling method '.version_select at 0x7fc873391a60>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:46.472546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d0292d40-b75c-4987-9348-6735162fdea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:46.481410 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d0292d40-b75c-4987-9348-6735162fdea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1266 microversion: 2.1 time: 0.261535 Oct 27 18:54:46.482575 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1122/2272] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:46 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:46.498306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f06fe7d5-eaf0-4e59-8965-dae46def1652 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:46.499163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f06fe7d5-eaf0-4e59-8965-dae46def1652 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:46.518274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f06fe7d5-eaf0-4e59-8965-dae46def1652 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:46.520639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f06fe7d5-eaf0-4e59-8965-dae46def1652 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:46.526117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f06fe7d5-eaf0-4e59-8965-dae46def1652 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:46.528112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f06fe7d5-eaf0-4e59-8965-dae46def1652 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:46.536005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f06fe7d5-eaf0-4e59-8965-dae46def1652 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:46.536777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f06fe7d5-eaf0-4e59-8965-dae46def1652 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:46.917965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f06fe7d5-eaf0-4e59-8965-dae46def1652 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:46.920898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:46.931277 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f06fe7d5-eaf0-4e59-8965-dae46def1652 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 0.447445 Oct 27 18:54:46.949559 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1123/2273] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:46 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:47.142475 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d95edcc4-7a2f-472a-9c8b-073cf926c5ae tempest-ListImageFiltersTestJSON-756835261 tempest-ListImageFiltersTestJSON-756835261-project] 10.222.0.42 "DELETE /compute/v2.1/images/5fca405d-9a5c-47e2-856e-9216e0451328" status: 204 len: 0 microversion: 2.1 time: 0.706232 Oct 27 18:54:47.143494 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1151/2274] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:46 2022] DELETE /compute/v2.1/images/5fca405d-9a5c-47e2-856e-9216e0451328 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:47.252272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9a6dad21-3191-4f11-8d0a-4546424bd40d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:47.253673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9a6dad21-3191-4f11-8d0a-4546424bd40d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:47.268565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a6dad21-3191-4f11-8d0a-4546424bd40d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:47.275396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a6dad21-3191-4f11-8d0a-4546424bd40d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:47.277532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a6dad21-3191-4f11-8d0a-4546424bd40d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:47.280134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a6dad21-3191-4f11-8d0a-4546424bd40d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:47.286289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a6dad21-3191-4f11-8d0a-4546424bd40d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:47.291043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a6dad21-3191-4f11-8d0a-4546424bd40d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:47.461961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-189b2df4-d13a-4b55-bd15-82ede4270ad6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:47.462958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-189b2df4-d13a-4b55-bd15-82ede4270ad6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:47.485217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-189b2df4-d13a-4b55-bd15-82ede4270ad6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:47.491976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-189b2df4-d13a-4b55-bd15-82ede4270ad6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:47.493032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-189b2df4-d13a-4b55-bd15-82ede4270ad6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:47.494069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-189b2df4-d13a-4b55-bd15-82ede4270ad6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:47.495422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-189b2df4-d13a-4b55-bd15-82ede4270ad6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:47.497223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-189b2df4-d13a-4b55-bd15-82ede4270ad6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:47.780561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-189b2df4-d13a-4b55-bd15-82ede4270ad6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:47.799791 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-189b2df4-d13a-4b55-bd15-82ede4270ad6 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1541 microversion: 2.1 time: 0.344391 Oct 27 18:54:47.804921 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1152/2275] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:47 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1541 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:47.819038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13bab342-a4a5-449b-b1e9-ca953bc8b93b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:47.822718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-13bab342-a4a5-449b-b1e9-ca953bc8b93b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:47.839448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13bab342-a4a5-449b-b1e9-ca953bc8b93b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:47.844030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13bab342-a4a5-449b-b1e9-ca953bc8b93b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:47.846996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13bab342-a4a5-449b-b1e9-ca953bc8b93b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:47.848484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13bab342-a4a5-449b-b1e9-ca953bc8b93b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:47.850261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13bab342-a4a5-449b-b1e9-ca953bc8b93b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:47.851538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13bab342-a4a5-449b-b1e9-ca953bc8b93b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:48.404757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9a6dad21-3191-4f11-8d0a-4546424bd40d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:48.432925 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9a6dad21-3191-4f11-8d0a-4546424bd40d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1324 microversion: 2.1 time: 1.184565 Oct 27 18:54:48.433562 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1124/2276] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:47 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1324 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:48.454816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-89024fc1-39c3-4726-aa07-5ed944682f4b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:48.455636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-89024fc1-39c3-4726-aa07-5ed944682f4b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:48.475243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89024fc1-39c3-4726-aa07-5ed944682f4b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:48.476046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89024fc1-39c3-4726-aa07-5ed944682f4b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:48.476651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89024fc1-39c3-4726-aa07-5ed944682f4b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:48.477542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89024fc1-39c3-4726-aa07-5ed944682f4b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:48.478169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89024fc1-39c3-4726-aa07-5ed944682f4b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:48.478813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89024fc1-39c3-4726-aa07-5ed944682f4b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:48.819193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-89024fc1-39c3-4726-aa07-5ed944682f4b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:48.820736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-13bab342-a4a5-449b-b1e9-ca953bc8b93b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:48.828742 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-89024fc1-39c3-4726-aa07-5ed944682f4b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 0.393841 Oct 27 18:54:48.829371 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1125/2277] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:48 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:48.850679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-a8d28113-12ba-43a8-ba55-173a3b74bd33 req-522b7e48-57b9-4664-8414-94bccd829d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84cbe523-eacc-4725-bb27-dd16d1609546", "name": "network-vif-deleted", "tag": "1d3a53ad-9130-41c9-89de-5938f71a59bc"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:48.855613 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13bab342-a4a5-449b-b1e9-ca953bc8b93b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1308 microversion: 2.1 time: 1.048911 Oct 27 18:54:48.856388 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1153/2278] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:47 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1308 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:48.867784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e972cc57-60b8-448a-a1be-88dc07a3104b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1783624608", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "63f8ff6f-c9fb-4cd1-b71c-75de758015cb", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:48.878550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a8d28113-12ba-43a8-ba55-173a3b74bd33 req-522b7e48-57b9-4664-8414-94bccd829d14 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:48.879103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a8d28113-12ba-43a8-ba55-173a3b74bd33 req-522b7e48-57b9-4664-8414-94bccd829d14 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:48.879572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a8d28113-12ba-43a8-ba55-173a3b74bd33 req-522b7e48-57b9-4664-8414-94bccd829d14 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:48.901032 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a8d28113-12ba-43a8-ba55-173a3b74bd33 req-522b7e48-57b9-4664-8414-94bccd829d14 service nova] Creating event network-vif-deleted:1d3a53ad-9130-41c9-89de-5938f71a59bc for instance 84cbe523-eacc-4725-bb27-dd16d1609546 on n-h1-860687-3 Oct 27 18:54:48.908221 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-a8d28113-12ba-43a8-ba55-173a3b74bd33 req-522b7e48-57b9-4664-8414-94bccd829d14 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069697 Oct 27 18:54:48.909373 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1126/2279] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:48.917898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-aa16a855-9c90-405f-9452-f2d86b47c230 req-d97ddf3c-0b69-4554-99b5-2762908e5c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d118d6-37dd-4318-959f-0346e2e7bf67", "name": "network-vif-plugged", "status": "completed", "tag": "75b873bf-a29c-482c-9601-377724e003a2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:48.930256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-aa16a855-9c90-405f-9452-f2d86b47c230 req-d97ddf3c-0b69-4554-99b5-2762908e5c35 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:48.931179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-aa16a855-9c90-405f-9452-f2d86b47c230 req-d97ddf3c-0b69-4554-99b5-2762908e5c35 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:48.931834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-aa16a855-9c90-405f-9452-f2d86b47c230 req-d97ddf3c-0b69-4554-99b5-2762908e5c35 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:48.955609 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-aa16a855-9c90-405f-9452-f2d86b47c230 req-d97ddf3c-0b69-4554-99b5-2762908e5c35 service nova] Creating event network-vif-plugged:75b873bf-a29c-482c-9601-377724e003a2 for instance 47d118d6-37dd-4318-959f-0346e2e7bf67 on n-h1-860687-3 Oct 27 18:54:48.970611 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-aa16a855-9c90-405f-9452-f2d86b47c230 req-d97ddf3c-0b69-4554-99b5-2762908e5c35 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056488 Oct 27 18:54:48.972378 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1127/2280] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:48.980210 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-e972cc57-60b8-448a-a1be-88dc07a3104b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Block Device 63f8ff6f-c9fb-4cd1-b71c-75de758015cb is not bootable. Oct 27 18:54:48.983909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3dd19210-3589-4f0d-9a15-d772e88e2e12 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:48.986605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3dd19210-3589-4f0d-9a15-d772e88e2e12 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e972cc57-60b8-448a-a1be-88dc07a3104b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 358 Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1783624608", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "63f8ff6f-c9fb-4cd1-b71c-75de758015cb", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: exception: Block Device 63f8ff6f-c9fb-4cd1-b71c-75de758015cb is not bootable. Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1783624608', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '63f8ff6f-c9fb-4cd1-b71c-75de758015cb'}], 'networks': [{'uuid': '969dfa55-7bd6-4101-b2b3-c0ca6c6378eb'}]}}} Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 63f8ff6f-c9fb-4cd1-b71c-75de758015cb is not bootable. Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:48.993802 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 63f8ff6f-c9fb-4cd1-b71c-75de758015cb is not bootable. Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 63f8ff6f-c9fb-4cd1-b71c-75de758015cb is not bootable. Oct 27 18:54:48.997476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:49.000965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e972cc57-60b8-448a-a1be-88dc07a3104b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Block Device 63f8ff6f-c9fb-4cd1-b71c-75de758015cb is not bootable. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:49.002211 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e972cc57-60b8-448a-a1be-88dc07a3104b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.144675 Oct 27 18:54:49.002980 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1154/2281] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:54:48 2022] POST /compute/v2.1/servers => generated 110 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:54:49.006629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3dd19210-3589-4f0d-9a15-d772e88e2e12 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:49.012469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9776ac7c-a1f0-484b-80b0-2bd95cc337d0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:49.014103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9776ac7c-a1f0-484b-80b0-2bd95cc337d0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:49.017053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3dd19210-3589-4f0d-9a15-d772e88e2e12 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:49.017686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3dd19210-3589-4f0d-9a15-d772e88e2e12 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:49.018891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3dd19210-3589-4f0d-9a15-d772e88e2e12 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:49.021118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3dd19210-3589-4f0d-9a15-d772e88e2e12 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:49.023584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3dd19210-3589-4f0d-9a15-d772e88e2e12 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:49.032731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9776ac7c-a1f0-484b-80b0-2bd95cc337d0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:49.033464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9776ac7c-a1f0-484b-80b0-2bd95cc337d0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:49.034056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9776ac7c-a1f0-484b-80b0-2bd95cc337d0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:49.035254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9776ac7c-a1f0-484b-80b0-2bd95cc337d0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:49.041487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9776ac7c-a1f0-484b-80b0-2bd95cc337d0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:49.042141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9776ac7c-a1f0-484b-80b0-2bd95cc337d0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:49.168344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3dd19210-3589-4f0d-9a15-d772e88e2e12 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:49.178614 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3dd19210-3589-4f0d-9a15-d772e88e2e12 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1253 microversion: 2.1 time: 0.203000 Oct 27 18:54:49.179517 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1128/2282] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:48 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1253 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:49.466712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f8b67084-c898-4d7c-8c38-003c8de5485d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:49.467332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f8b67084-c898-4d7c-8c38-003c8de5485d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:49.478806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8b67084-c898-4d7c-8c38-003c8de5485d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:49.479587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8b67084-c898-4d7c-8c38-003c8de5485d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:49.496920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8b67084-c898-4d7c-8c38-003c8de5485d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:49.498998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8b67084-c898-4d7c-8c38-003c8de5485d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:49.499739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8b67084-c898-4d7c-8c38-003c8de5485d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:49.501026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8b67084-c898-4d7c-8c38-003c8de5485d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:49.645719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9776ac7c-a1f0-484b-80b0-2bd95cc337d0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:49.658854 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9776ac7c-a1f0-484b-80b0-2bd95cc337d0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.650722 Oct 27 18:54:49.673819 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1155/2283] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:49 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:54:49.693049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-38db2639-f205-4aef-9850-afa8a0bc5f9f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:49.693982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-38db2639-f205-4aef-9850-afa8a0bc5f9f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:49.708205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38db2639-f205-4aef-9850-afa8a0bc5f9f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:49.708969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38db2639-f205-4aef-9850-afa8a0bc5f9f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:49.711368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38db2639-f205-4aef-9850-afa8a0bc5f9f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:49.713247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38db2639-f205-4aef-9850-afa8a0bc5f9f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:49.714207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38db2639-f205-4aef-9850-afa8a0bc5f9f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:49.716181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38db2639-f205-4aef-9850-afa8a0bc5f9f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:49.721924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f8b67084-c898-4d7c-8c38-003c8de5485d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:49.735004 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f8b67084-c898-4d7c-8c38-003c8de5485d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1324 microversion: 2.1 time: 0.272616 Oct 27 18:54:49.751634 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1129/2284] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:49 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1324 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:49.859931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-98485646-5df7-420b-9106-287a1869e2b5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:49.860567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-98485646-5df7-420b-9106-287a1869e2b5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:49.873759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98485646-5df7-420b-9106-287a1869e2b5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:49.874267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98485646-5df7-420b-9106-287a1869e2b5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:49.874925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98485646-5df7-420b-9106-287a1869e2b5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:49.875810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98485646-5df7-420b-9106-287a1869e2b5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:49.876432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98485646-5df7-420b-9106-287a1869e2b5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:49.877021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98485646-5df7-420b-9106-287a1869e2b5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:50.184046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-98485646-5df7-420b-9106-287a1869e2b5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:50.197600 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-98485646-5df7-420b-9106-287a1869e2b5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 0.341785 Oct 27 18:54:50.218540 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1130/2285] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:49 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:50.224703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ec81bd2-4f2f-45e5-848a-46db5cd56a36 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:50.225534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ec81bd2-4f2f-45e5-848a-46db5cd56a36 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:50.233794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ec81bd2-4f2f-45e5-848a-46db5cd56a36 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:50.250888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ec81bd2-4f2f-45e5-848a-46db5cd56a36 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:50.252824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ec81bd2-4f2f-45e5-848a-46db5cd56a36 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:50.260743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ec81bd2-4f2f-45e5-848a-46db5cd56a36 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:50.261498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ec81bd2-4f2f-45e5-848a-46db5cd56a36 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:50.261958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ec81bd2-4f2f-45e5-848a-46db5cd56a36 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:50.658508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9ec81bd2-4f2f-45e5-848a-46db5cd56a36 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:50.674468 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ec81bd2-4f2f-45e5-848a-46db5cd56a36 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1308 microversion: 2.1 time: 0.454341 Oct 27 18:54:50.687777 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1131/2286] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:50 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:50.704182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aa0e47cc-0ed6-415b-a3a7-4cdc318630fd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:50.709281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-38db2639-f205-4aef-9850-afa8a0bc5f9f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:50.711569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aa0e47cc-0ed6-415b-a3a7-4cdc318630fd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:50.719851 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-38db2639-f205-4aef-9850-afa8a0bc5f9f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 1.033289 Oct 27 18:54:50.721239 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1156/2287] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:49 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:50.742209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa0e47cc-0ed6-415b-a3a7-4cdc318630fd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:50.742475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa0e47cc-0ed6-415b-a3a7-4cdc318630fd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:50.742928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa0e47cc-0ed6-415b-a3a7-4cdc318630fd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:50.743651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa0e47cc-0ed6-415b-a3a7-4cdc318630fd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:50.744121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa0e47cc-0ed6-415b-a3a7-4cdc318630fd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:50.744556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa0e47cc-0ed6-415b-a3a7-4cdc318630fd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:50.759639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2a6d928e-cd64-41c3-b814-94ca01ca1f21 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:50.766371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2a6d928e-cd64-41c3-b814-94ca01ca1f21 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:50.781357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a6d928e-cd64-41c3-b814-94ca01ca1f21 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:50.788004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a6d928e-cd64-41c3-b814-94ca01ca1f21 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:50.788817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a6d928e-cd64-41c3-b814-94ca01ca1f21 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:50.790237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a6d928e-cd64-41c3-b814-94ca01ca1f21 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:50.791712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a6d928e-cd64-41c3-b814-94ca01ca1f21 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:50.793694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a6d928e-cd64-41c3-b814-94ca01ca1f21 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:51.000140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aa0e47cc-0ed6-415b-a3a7-4cdc318630fd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:51.018112 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aa0e47cc-0ed6-415b-a3a7-4cdc318630fd tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1253 microversion: 2.1 time: 0.328556 Oct 27 18:54:51.018771 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1132/2288] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:50 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1253 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:51.452752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:51.553341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70f8a107-7843-48c3-9357-40e01757fb53 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Action: 'create', calling method: .version_select at 0x7fc873278790>, body: {"keypair": {"name": "tempest-keypair-1177481997", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOV1QLt/dFDhabwrndTnw0wgs6SG8mYQmQni35LwBEIzyhtahKOn3dbAPNgC9g2sYyHzsZmsp4c4lNN2+GtOZkHXbh/oV4DREGkPcbO0MHEWTvvg2yoeScRjx6IZCoyg1Q=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:51.563745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=10 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:51.576398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:51.591624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-70f8a107-7843-48c3-9357-40e01757fb53 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:54:51.607284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-70f8a107-7843-48c3-9357-40e01757fb53 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for user c79319497cc34fbabe1889bd3eb01399 and project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:54:51.645259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2a6d928e-cd64-41c3-b814-94ca01ca1f21 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:51.658289 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2a6d928e-cd64-41c3-b814-94ca01ca1f21 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1520 microversion: 2.1 time: 0.902893 Oct 27 18:54:51.663755 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1157/2289] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:50 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1520 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:54:51.680910 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70f8a107-7843-48c3-9357-40e01757fb53 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.483203 Oct 27 18:54:51.682521 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1133/2290] 10.222.0.42 () {62 vars in 1199 bytes} [Thu Oct 27 18:54:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 486 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 18:54:51.697452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-54e04b56-5500-4bb6-869b-e93350f39257 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Calling method '.version_select at 0x7fc87335e550>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:51.702763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f76769cd-db09-4f1f-8e69-66d41d2cb119 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:51.703429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f76769cd-db09-4f1f-8e69-66d41d2cb119 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:51.724835 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-54e04b56-5500-4bb6-869b-e93350f39257 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-1177481997" status: 200 len: 513 microversion: 2.2 time: 0.033201 Oct 27 18:54:51.725796 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1134/2291] 10.222.0.42 () {60 vars in 1258 bytes} [Thu Oct 27 18:54:51 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1177481997 => generated 513 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:54:51.739662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f76769cd-db09-4f1f-8e69-66d41d2cb119 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:51.740208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f76769cd-db09-4f1f-8e69-66d41d2cb119 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:51.741409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f70dda1c-f7dc-4dd1-b0fa-15096125556a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:51.743748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f70dda1c-f7dc-4dd1-b0fa-15096125556a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:51.748703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f76769cd-db09-4f1f-8e69-66d41d2cb119 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:51.749557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f76769cd-db09-4f1f-8e69-66d41d2cb119 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:51.751088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f76769cd-db09-4f1f-8e69-66d41d2cb119 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:51.752298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f76769cd-db09-4f1f-8e69-66d41d2cb119 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:51.757822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f70dda1c-f7dc-4dd1-b0fa-15096125556a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:51.758573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f70dda1c-f7dc-4dd1-b0fa-15096125556a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:51.761521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f70dda1c-f7dc-4dd1-b0fa-15096125556a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:51.762652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f70dda1c-f7dc-4dd1-b0fa-15096125556a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:51.763278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f70dda1c-f7dc-4dd1-b0fa-15096125556a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:51.763867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f70dda1c-f7dc-4dd1-b0fa-15096125556a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:52.332855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f70dda1c-f7dc-4dd1-b0fa-15096125556a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:52.346223 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f70dda1c-f7dc-4dd1-b0fa-15096125556a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1308 microversion: 2.1 time: 0.618141 Oct 27 18:54:52.349710 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1135/2292] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:51 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1308 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:52.370405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0c0faa61-9fa2-4f03-85f2-7006cee28fc2 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Calling method '.version_select at 0x7fc87330f5e0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:52.441158 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0c0faa61-9fa2-4f03-85f2-7006cee28fc2 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1177481997" status: 204 len: 0 microversion: 2.2 time: 0.088806 Oct 27 18:54:52.442277 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1136/2293] 10.222.0.42 () {60 vars in 1261 bytes} [Thu Oct 27 18:54:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1177481997 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:52.465657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4ba37670-0205-4693-813b-865a660d0b2e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-753892755", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b79e7be9-b3fa-414d-9c68-072b444eb9bb"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4ba37670-0205-4693-813b-865a660d0b2e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Request method failure captured: Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 242 Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPb35qs_2VLjeYropqd-keEcMYSAzIBGnqMOstF1Y9wj0OR4xzKXVMkTp4PBObjU4JKx5WJALq_c0uTgNScd4Lb7Nnr_ndlV93Ts9mLqiY4ah0prLMT5kaAwd7ui_xh2PbWqvlZ0fkuj3GapnU-rvWrhvGaW8J6lrxl-3PxGMJIxBQ Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_66d8a8780e4b4f9d91388b3bee2d61c2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 03f7953b2a894523ac7e38d059ed267b Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-753892755", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b79e7be9-b3fa-414d-9c68-072b444eb9bb"}]}} Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-753892755', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'b79e7be9-b3fa-414d-9c68-072b444eb9bb'}]}}} Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:52.488978 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:52.493425 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:52.502440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4ba37670-0205-4693-813b-865a660d0b2e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:52.508989 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4ba37670-0205-4693-813b-865a660d0b2e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.062380 Oct 27 18:54:52.514716 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1137/2294] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:54:52 2022] POST /compute/v2.1/servers => generated 175 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:54:52.539441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2fa0a5c1-d58e-437c-a22a-aea30685ab58 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:52.541662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2fa0a5c1-d58e-437c-a22a-aea30685ab58 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:52.594828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fa0a5c1-d58e-437c-a22a-aea30685ab58 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:52.601220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fa0a5c1-d58e-437c-a22a-aea30685ab58 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:52.602156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fa0a5c1-d58e-437c-a22a-aea30685ab58 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:52.604258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fa0a5c1-d58e-437c-a22a-aea30685ab58 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:52.604929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fa0a5c1-d58e-437c-a22a-aea30685ab58 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:52.607203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fa0a5c1-d58e-437c-a22a-aea30685ab58 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:52.669489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f76769cd-db09-4f1f-8e69-66d41d2cb119 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:52.714709 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f76769cd-db09-4f1f-8e69-66d41d2cb119 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 1.037516 Oct 27 18:54:52.715664 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1158/2295] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:51 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:52.724860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e092a984-25f7-49d3-bcdf-115c58d59274 req-f251dcbf-c125-40eb-8e56-21cb826d7a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d741a04d-f8e8-4b66-bc30-377d4c8de1dc", "tag": "ac56cb8e-e2ef-419e-be28-4a7a3d4a4c68"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:52.748557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e092a984-25f7-49d3-bcdf-115c58d59274 req-f251dcbf-c125-40eb-8e56-21cb826d7a80 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:52.752145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e092a984-25f7-49d3-bcdf-115c58d59274 req-f251dcbf-c125-40eb-8e56-21cb826d7a80 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:52.752889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e092a984-25f7-49d3-bcdf-115c58d59274 req-f251dcbf-c125-40eb-8e56-21cb826d7a80 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:52.784309 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e092a984-25f7-49d3-bcdf-115c58d59274 req-f251dcbf-c125-40eb-8e56-21cb826d7a80 service nova] Creating event network-changed:ac56cb8e-e2ef-419e-be28-4a7a3d4a4c68 for instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc on n-h2-860687-3 Oct 27 18:54:52.800312 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e092a984-25f7-49d3-bcdf-115c58d59274 req-f251dcbf-c125-40eb-8e56-21cb826d7a80 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082874 Oct 27 18:54:52.802233 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1159/2296] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:52.807889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1073d40d-a743-4840-bb71-1212c051ea15 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Action: 'create', calling method: .version_select at 0x7fc86a9faee0>, body: {"keypair": {"name": "tempest-keypair-719391796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOE9/aoajjbVW2K6i0TIc7zGNZYCE3vaWLtMumPGzLpPPJrGnuYXVTc2F3dsKFR4WkEYy38oiz00RJrW3coKfJyfmPzo3SHMexIEmuTWVjjDaPEMPpHM/p4yyG7Eyh1x9w=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:52.832153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2fa0a5c1-d58e-437c-a22a-aea30685ab58 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:52.842893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-1073d40d-a743-4840-bb71-1212c051ea15 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:54:52.850683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-1073d40d-a743-4840-bb71-1212c051ea15 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for user c79319497cc34fbabe1889bd3eb01399 and project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:54:52.852831 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2fa0a5c1-d58e-437c-a22a-aea30685ab58 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1253 microversion: 2.1 time: 0.334630 Oct 27 18:54:52.853432 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1138/2297] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:52 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1253 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:52.880567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-74b7b300-9a7f-469f-9ad6-cc94514db7cd tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:52.883173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-74b7b300-9a7f-469f-9ad6-cc94514db7cd tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 84e2f73c-979b-4f7e-8267-b77883550270] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:52.897695 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-74b7b300-9a7f-469f-9ad6-cc94514db7cd tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] HTTP exception thrown: Instance 84e2f73c-979b-4f7e-8267-b77883550270 could not be found. Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-74b7b300-9a7f-469f-9ad6-cc94514db7cd tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Request method failure captured: Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/84e2f73c-979b-4f7e-8267-b77883550270/metadata HTTP/1.1 Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPb35qs_2VLjeYropqd-keEcMYSAzIBGnqMOstF1Y9wj0OR4xzKXVMkTp4PBObjU4JKx5WJALq_c0uTgNScd4Lb7Nnr_ndlV93Ts9mLqiY4ah0prLMT5kaAwd7ui_xh2PbWqvlZ0fkuj3GapnU-rvWrhvGaW8J6lrxl-3PxGMJIxBQ Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_66d8a8780e4b4f9d91388b3bee2d61c2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 03f7953b2a894523ac7e38d059ed267b Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 84e2f73c-979b-4f7e-8267-b77883550270 could not be found. Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'server_id': '84e2f73c-979b-4f7e-8267-b77883550270'} Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e2f73c-979b-4f7e-8267-b77883550270 could not be found. Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e2f73c-979b-4f7e-8267-b77883550270 could not be found. Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:52.905210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:52.908694 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:52.908694 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:52.908694 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e2f73c-979b-4f7e-8267-b77883550270 could not be found. Oct 27 18:54:52.908694 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:52.911578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-74b7b300-9a7f-469f-9ad6-cc94514db7cd tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Returning 404 to user: Instance 84e2f73c-979b-4f7e-8267-b77883550270 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:52.912701 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-74b7b300-9a7f-469f-9ad6-cc94514db7cd tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/84e2f73c-979b-4f7e-8267-b77883550270/metadata" status: 404 len: 111 microversion: 2.1 time: 0.046151 Oct 27 18:54:52.914857 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1139/2298] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 18:54:52 2022] GET /compute/v2.1/servers/84e2f73c-979b-4f7e-8267-b77883550270/metadata => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:54:52.918577 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1073d40d-a743-4840-bb71-1212c051ea15 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.112163 Oct 27 18:54:52.924471 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1160/2299] 10.222.0.42 () {62 vars in 1199 bytes} [Thu Oct 27 18:54:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 18:54:52.930459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71135448-eddb-43dc-b2b9-6ab8bfc5ff2a tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Calling method '.version_select at 0x7fc87335e160>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:52.976531 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-71135448-eddb-43dc-b2b9-6ab8bfc5ff2a tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-719391796" status: 204 len: 0 microversion: 2.2 time: 0.052741 Oct 27 18:54:52.991368 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1140/2300] 10.222.0.42 () {60 vars in 1258 bytes} [Thu Oct 27 18:54:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-719391796 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:52.992796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-91cdba48-f501-4e99-a288-e7f415ca16d1 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Action: 'create', calling method: .version_select at 0x7fc86afd08b0>, body: {"keypair": {"name": "tempest-keypair-1768942996", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:53.038749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8d8b7f9f-2f6c-488b-82e8-a0696e6743a6 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1995653752", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b79e7be9-b3fa-414d-9c68-072b444eb9bb"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8d8b7f9f-2f6c-488b-82e8-a0696e6743a6 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Request method failure captured: Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 499 Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPb35qs_2VLjeYropqd-keEcMYSAzIBGnqMOstF1Y9wj0OR4xzKXVMkTp4PBObjU4JKx5WJALq_c0uTgNScd4Lb7Nnr_ndlV93Ts9mLqiY4ah0prLMT5kaAwd7ui_xh2PbWqvlZ0fkuj3GapnU-rvWrhvGaW8J6lrxl-3PxGMJIxBQ Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_66d8a8780e4b4f9d91388b3bee2d61c2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 03f7953b2a894523ac7e38d059ed267b Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1995653752", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b79e7be9-b3fa-414d-9c68-072b444eb9bb"}]}} Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1995653752', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b79e7be9-b3fa-414d-9c68-072b444eb9bb'}]}}} Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 18:54:53.059729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.062715 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.072190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8d8b7f9f-2f6c-488b-82e8-a0696e6743a6 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:53.075607 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8d8b7f9f-2f6c-488b-82e8-a0696e6743a6 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.047001 Oct 27 18:54:53.076238 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1141/2301] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:54:53 2022] POST /compute/v2.1/servers => generated 687 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:54:53.096239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-91cdba48-f501-4e99-a288-e7f415ca16d1 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:54:53.117228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-91cdba48-f501-4e99-a288-e7f415ca16d1 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for user c79319497cc34fbabe1889bd3eb01399 and project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:54:53.176238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e152f197-cff7-42a9-92ab-b2150b843ad3 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1492403267", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b79e7be9-b3fa-414d-9c68-072b444eb9bb"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e152f197-cff7-42a9-92ab-b2150b843ad3 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Request method failure captured: Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 500 Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPb35qs_2VLjeYropqd-keEcMYSAzIBGnqMOstF1Y9wj0OR4xzKXVMkTp4PBObjU4JKx5WJALq_c0uTgNScd4Lb7Nnr_ndlV93Ts9mLqiY4ah0prLMT5kaAwd7ui_xh2PbWqvlZ0fkuj3GapnU-rvWrhvGaW8J6lrxl-3PxGMJIxBQ Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_66d8a8780e4b4f9d91388b3bee2d61c2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 03f7953b2a894523ac7e38d059ed267b Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1492403267", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b79e7be9-b3fa-414d-9c68-072b444eb9bb"}]}} Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1492403267', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b79e7be9-b3fa-414d-9c68-072b444eb9bb'}]}}} Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 18:54:53.180642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e152f197-cff7-42a9-92ab-b2150b843ad3 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:53.183893 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e152f197-cff7-42a9-92ab-b2150b843ad3 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.011156 Oct 27 18:54:53.187066 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-91cdba48-f501-4e99-a288-e7f415ca16d1 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.202664 Oct 27 18:54:53.191747 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1161/2302] 10.222.0.42 () {62 vars in 1199 bytes} [Thu Oct 27 18:54:52 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 208 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 18:54:53.192522 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1142/2303] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:54:53 2022] POST /compute/v2.1/servers => generated 689 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:54:53.219358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bc8dd07b-2734-4e73-8c07-b64239439f63 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Calling method '.version_select at 0x7fc86b3c1040>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:53.275259 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bc8dd07b-2734-4e73-8c07-b64239439f63 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768942996" status: 204 len: 0 microversion: 2.2 time: 0.079633 Oct 27 18:54:53.275954 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1162/2304] 10.222.0.42 () {60 vars in 1261 bytes} [Thu Oct 27 18:54:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768942996 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 18:54:53.293273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f77677d9-ae82-48ef-b05f-d76931fd92a2 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Action: 'create', calling method: .version_select at 0x7fc8731f4700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1176397461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSQjGdq0kQgCJhPFT3lAyB8ltJi6uDnJXz6wRiHXhXhBjoFe0PkA8IfX3B0ER2d5Lk6DnYXTqCCzM2utxuZ0k0CiR/eqamwIR4SHZ9+nPgOBxo71AJXF+5fJFX7rmvEXg=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:53.299989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d178d2cb-3766-43b9-9678-e94c754ecf46 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-811379424", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b79e7be9-b3fa-414d-9c68-072b444eb9bb"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d178d2cb-3766-43b9-9678-e94c754ecf46 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Request method failure captured: Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 753 Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPb35qs_2VLjeYropqd-keEcMYSAzIBGnqMOstF1Y9wj0OR4xzKXVMkTp4PBObjU4JKx5WJALq_c0uTgNScd4Lb7Nnr_ndlV93Ts9mLqiY4ah0prLMT5kaAwd7ui_xh2PbWqvlZ0fkuj3GapnU-rvWrhvGaW8J6lrxl-3PxGMJIxBQ Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_66d8a8780e4b4f9d91388b3bee2d61c2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 03f7953b2a894523ac7e38d059ed267b Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-811379424", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b79e7be9-b3fa-414d-9c68-072b444eb9bb"}]}} Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-811379424', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b79e7be9-b3fa-414d-9c68-072b444eb9bb'}]}}} Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:54:53.322977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:54:53.325248 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:54:53.327405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.327405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.329186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d178d2cb-3766-43b9-9678-e94c754ecf46 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:53.330340 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d178d2cb-3766-43b9-9678-e94c754ecf46 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.041395 Oct 27 18:54:53.333450 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1163/2305] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:54:53 2022] POST /compute/v2.1/servers => generated 1197 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 27 18:54:53.361245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-f77677d9-ae82-48ef-b05f-d76931fd92a2 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:54:53.377366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8bb37db2-1233-4d75-be43-4031686d51e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:53.379036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8bb37db2-1233-4d75-be43-4031686d51e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:53.390919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-f77677d9-ae82-48ef-b05f-d76931fd92a2 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for user c79319497cc34fbabe1889bd3eb01399 and project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:54:53.400922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bb37db2-1233-4d75-be43-4031686d51e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:53.402717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bb37db2-1233-4d75-be43-4031686d51e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:53.404664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bb37db2-1233-4d75-be43-4031686d51e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:53.405667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bb37db2-1233-4d75-be43-4031686d51e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:53.411434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bb37db2-1233-4d75-be43-4031686d51e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:53.416721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bb37db2-1233-4d75-be43-4031686d51e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:53.515488 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f77677d9-ae82-48ef-b05f-d76931fd92a2 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.231752 Oct 27 18:54:53.517237 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1143/2306] 10.222.0.42 () {62 vars in 1199 bytes} [Thu Oct 27 18:54:53 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 234 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 18:54:53.523806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa50d920-d105-4b6a-bf70-89cc1d84be9e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1020602382", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b79e7be9-b3fa-414d-9c68-072b444eb9bb"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa50d920-d105-4b6a-bf70-89cc1d84be9e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Request method failure captured: Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 1266 Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPb35qs_2VLjeYropqd-keEcMYSAzIBGnqMOstF1Y9wj0OR4xzKXVMkTp4PBObjU4JKx5WJALq_c0uTgNScd4Lb7Nnr_ndlV93Ts9mLqiY4ah0prLMT5kaAwd7ui_xh2PbWqvlZ0fkuj3GapnU-rvWrhvGaW8J6lrxl-3PxGMJIxBQ Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_66d8a8780e4b4f9d91388b3bee2d61c2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 03f7953b2a894523ac7e38d059ed267b Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1020602382", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b79e7be9-b3fa-414d-9c68-072b444eb9bb"}]}} Oct 27 18:54:53.543228 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1020602382', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b79e7be9-b3fa-414d-9c68-072b444eb9bb'}]}}} Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.545195 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:54:53.546135 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:54:53.548024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 18:54:53.548024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.550058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa50d920-d105-4b6a-bf70-89cc1d84be9e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:53.552196 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fa50d920-d105-4b6a-bf70-89cc1d84be9e tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.033808 Oct 27 18:54:53.553338 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1144/2307] 10.222.0.42 () {60 vars in 1148 bytes} [Thu Oct 27 18:54:53 2022] POST /compute/v2.1/servers => generated 2221 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 27 18:54:53.574862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-203b7bc9-5544-4a27-a29a-fe305cc45456 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Action: 'create', calling method: .version_select at 0x7fc873205790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-99796266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWB1CTb7/V0ba8pjUVofqfpIum8M0tjdbG1oFUAb7KR1DFMlTv+iV1qHL63XkNfrdbm+IdSal4rDQ6fW3gty7ei0Xb9mfPI6t2Amq/6tbkVFROt6cNayCp6X77cspIo9A=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:53.606571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-203b7bc9-5544-4a27-a29a-fe305cc45456 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:54:53.613103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-203b7bc9-5544-4a27-a29a-fe305cc45456 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for user c79319497cc34fbabe1889bd3eb01399 and project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:54:53.656913 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-203b7bc9-5544-4a27-a29a-fe305cc45456 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.2 time: 0.102229 Oct 27 18:54:53.667610 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1145/2308] 10.222.0.42 () {62 vars in 1199 bytes} [Thu Oct 27 18:54:53 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 18:54:53.673956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb951f56-639a-4c7b-9736-d6dce327893d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:53.675025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fb951f56-639a-4c7b-9736-d6dce327893d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 42470396-8bc1-4202-a4ff-0ea6446d665b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:53.682134 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-fb951f56-639a-4c7b-9736-d6dce327893d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] HTTP exception thrown: Instance 42470396-8bc1-4202-a4ff-0ea6446d665b could not be found. Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb951f56-639a-4c7b-9736-d6dce327893d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Request method failure captured: Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/42470396-8bc1-4202-a4ff-0ea6446d665b/metadata/test2 HTTP/1.1 Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPb35qs_2VLjeYropqd-keEcMYSAzIBGnqMOstF1Y9wj0OR4xzKXVMkTp4PBObjU4JKx5WJALq_c0uTgNScd4Lb7Nnr_ndlV93Ts9mLqiY4ah0prLMT5kaAwd7ui_xh2PbWqvlZ0fkuj3GapnU-rvWrhvGaW8J6lrxl-3PxGMJIxBQ Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_66d8a8780e4b4f9d91388b3bee2d61c2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 03f7953b2a894523ac7e38d059ed267b Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 42470396-8bc1-4202-a4ff-0ea6446d665b could not be found. Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'server_id': '42470396-8bc1-4202-a4ff-0ea6446d665b', 'id': 'test2'} Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42470396-8bc1-4202-a4ff-0ea6446d665b could not be found. Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42470396-8bc1-4202-a4ff-0ea6446d665b could not be found. Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:53.685302 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:53.688790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:53.688790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:53.688790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42470396-8bc1-4202-a4ff-0ea6446d665b could not be found. Oct 27 18:54:53.688790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:53.691959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb951f56-639a-4c7b-9736-d6dce327893d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Returning 404 to user: Instance 42470396-8bc1-4202-a4ff-0ea6446d665b could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:53.693168 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fb951f56-639a-4c7b-9736-d6dce327893d tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/42470396-8bc1-4202-a4ff-0ea6446d665b/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.023987 Oct 27 18:54:53.693990 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1146/2309] 10.222.0.42 () {58 vars in 1281 bytes} [Thu Oct 27 18:54:53 2022] GET /compute/v2.1/servers/42470396-8bc1-4202-a4ff-0ea6446d665b/metadata/test2 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:54:53.725709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e7af00ea-6763-450e-9cdd-b6d625721a93 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Action: 'create', calling method: .version_select at 0x7fc87324cee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1941597618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSB076EK23AIte5/71NkT/swcRmGparu2igUyDJhvk2FGabP9uLY0L6aLG7tHx/vErtH1TmlndqTDMQO5CuhrQ3zkhzTNRuxYQ9O9YYQgdEs+eyIk8a3TKw5eHAVy3PTg=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:53.771690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e7af00ea-6763-450e-9cdd-b6d625721a93 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:54:53.783837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e7af00ea-6763-450e-9cdd-b6d625721a93 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for user c79319497cc34fbabe1889bd3eb01399 and project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:54:53.863435 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e7af00ea-6763-450e-9cdd-b6d625721a93 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.167513 Oct 27 18:54:53.867880 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1147/2310] 10.222.0.42 () {62 vars in 1199 bytes} [Thu Oct 27 18:54:53 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 18:54:53.886269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b46120b5-f947-4a92-9c38-77746a0f9904 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:53.886807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b46120b5-f947-4a92-9c38-77746a0f9904 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:53.906315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b46120b5-f947-4a92-9c38-77746a0f9904 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:53.908053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b46120b5-f947-4a92-9c38-77746a0f9904 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:53.908698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b46120b5-f947-4a92-9c38-77746a0f9904 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:53.912264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b46120b5-f947-4a92-9c38-77746a0f9904 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:53.913697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b46120b5-f947-4a92-9c38-77746a0f9904 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:53.915164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b46120b5-f947-4a92-9c38-77746a0f9904 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:54.002800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b46120b5-f947-4a92-9c38-77746a0f9904 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:54:54.219218 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b46120b5-f947-4a92-9c38-77746a0f9904 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "DELETE /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 204 len: 0 microversion: 2.1 time: 0.345250 Oct 27 18:54:54.220328 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1148/2311] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:54:53 2022] DELETE /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:54.235236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd311ca5-6502-42a4-99fd-a3bb747d668a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:54.235567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dd311ca5-6502-42a4-99fd-a3bb747d668a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:54.254846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd311ca5-6502-42a4-99fd-a3bb747d668a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:54.259035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd311ca5-6502-42a4-99fd-a3bb747d668a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:54.259556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd311ca5-6502-42a4-99fd-a3bb747d668a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:54.260328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd311ca5-6502-42a4-99fd-a3bb747d668a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:54.267750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd311ca5-6502-42a4-99fd-a3bb747d668a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:54.268363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd311ca5-6502-42a4-99fd-a3bb747d668a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:54.788973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dd311ca5-6502-42a4-99fd-a3bb747d668a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:54.813508 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dd311ca5-6502-42a4-99fd-a3bb747d668a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 0.591818 Oct 27 18:54:54.814918 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1149/2312] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:54 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:54.821077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6284a143-abf6-4a7b-a0f6-7e9c703bb19d tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:54.830291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6284a143-abf6-4a7b-a0f6-7e9c703bb19d tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:54.853641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6284a143-abf6-4a7b-a0f6-7e9c703bb19d tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:54.854522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6284a143-abf6-4a7b-a0f6-7e9c703bb19d tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:54.855127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6284a143-abf6-4a7b-a0f6-7e9c703bb19d tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:54.858998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6284a143-abf6-4a7b-a0f6-7e9c703bb19d tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:54.859752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6284a143-abf6-4a7b-a0f6-7e9c703bb19d tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:54.860349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6284a143-abf6-4a7b-a0f6-7e9c703bb19d tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:55.007233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8bb37db2-1233-4d75-be43-4031686d51e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:55.009774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:55.016821 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8bb37db2-1233-4d75-be43-4031686d51e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1308 microversion: 2.1 time: 1.643559 Oct 27 18:54:55.023129 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1164/2313] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:53 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1308 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:55.038914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9c49f1a2-9010-4e1e-aa6b-dc112f8cdd8d tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Calling method '.version_select at 0x7fc86b435160>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:55.043070 n-d-860687-3 devstack@n-api.service[127029]: WARNING oslo_db.sqlalchemy.utils [None req-9c49f1a2-9010-4e1e-aa6b-dc112f8cdd8d tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 18:54:55.063845 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9c49f1a2-9010-4e1e-aa6b-dc112f8cdd8d tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.039533 Oct 27 18:54:55.065910 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1165/2314] 10.222.0.42 () {60 vars in 1177 bytes} [Thu Oct 27 18:54:55 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:55.071125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6284a143-abf6-4a7b-a0f6-7e9c703bb19d tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:55.077370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ac796108-cc6b-4b39-a3e5-d681ce9d50b8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-284132340", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "destination_type": "local"}, {"source_type": "volume", "uuid": "96c72993-e52f-47e3-aee2-064452e19cd2", "destination_type": "invalid"}], "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ac796108-cc6b-4b39-a3e5-d681ce9d50b8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 494 Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-284132340", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "destination_type": "local"}, {"source_type": "volume", "uuid": "96c72993-e52f-47e3-aee2-064452e19cd2", "destination_type": "invalid"}], "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-284132340', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '96c72993-e52f-47e3-aee2-064452e19cd2', 'destination_type': 'invalid'}], 'networks': [{'uuid': '969dfa55-7bd6-4101-b2b3-c0ca6c6378eb'}]}}} Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:55.089334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 27 18:54:55.092545 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:55.094826 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6284a143-abf6-4a7b-a0f6-7e9c703bb19d tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1253 microversion: 2.1 time: 0.276910 Oct 27 18:54:55.095833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ac796108-cc6b-4b39-a3e5-d681ce9d50b8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:55.096599 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1150/2315] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:54 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1253 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:55.099240 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ac796108-cc6b-4b39-a3e5-d681ce9d50b8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.031413 Oct 27 18:54:55.106954 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1166/2316] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:54:55 2022] POST /compute/v2.1/servers => generated 155 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:54:55.119615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3da8e9f2-50a7-4900-aecf-cc6483349998 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Calling method '.version_select at 0x7fc873391700>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:55.129290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4e5bbb8a-5da9-4436-9caa-85c9d9073b1f tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:55.130134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4e5bbb8a-5da9-4436-9caa-85c9d9073b1f tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:55.147559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5bbb8a-5da9-4436-9caa-85c9d9073b1f tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:55.148127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5bbb8a-5da9-4436-9caa-85c9d9073b1f tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:55.148584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5bbb8a-5da9-4436-9caa-85c9d9073b1f tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:55.149329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5bbb8a-5da9-4436-9caa-85c9d9073b1f tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:55.149796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5bbb8a-5da9-4436-9caa-85c9d9073b1f tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:55.154215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5bbb8a-5da9-4436-9caa-85c9d9073b1f tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:55.166675 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3da8e9f2-50a7-4900-aecf-cc6483349998 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1941597618" status: 204 len: 0 microversion: 2.2 time: 0.055278 Oct 27 18:54:55.167937 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1167/2317] 10.222.0.42 () {60 vars in 1321 bytes} [Thu Oct 27 18:54:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1941597618 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:55.173271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-679a4793-676a-4d34-a44c-d43d65da1d89 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:55.174189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-679a4793-676a-4d34-a44c-d43d65da1d89 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:55.188874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-679a4793-676a-4d34-a44c-d43d65da1d89 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:55.189618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-679a4793-676a-4d34-a44c-d43d65da1d89 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:55.190282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-679a4793-676a-4d34-a44c-d43d65da1d89 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:55.193179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-679a4793-676a-4d34-a44c-d43d65da1d89 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:55.193998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-679a4793-676a-4d34-a44c-d43d65da1d89 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:55.196110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-679a4793-676a-4d34-a44c-d43d65da1d89 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:55.485169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-679a4793-676a-4d34-a44c-d43d65da1d89 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:55.499241 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-679a4793-676a-4d34-a44c-d43d65da1d89 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.329846 Oct 27 18:54:55.499747 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1168/2318] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:55 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:55.509922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-386c6d9f-4b44-467d-bf6c-2f21551125ce tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Calling method '.version_select at 0x7fc86b435ee0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:55.561469 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-386c6d9f-4b44-467d-bf6c-2f21551125ce tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-99796266" status: 204 len: 0 microversion: 2.2 time: 0.056085 Oct 27 18:54:55.562601 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1169/2319] 10.222.0.42 () {60 vars in 1315 bytes} [Thu Oct 27 18:54:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-99796266 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:55.571330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f7268c57-699e-48e1-adc2-9c9a20db852a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:55.573381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f7268c57-699e-48e1-adc2-9c9a20db852a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:55.585066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:55.588300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7268c57-699e-48e1-adc2-9c9a20db852a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:55.589345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7268c57-699e-48e1-adc2-9c9a20db852a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:55.594410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7268c57-699e-48e1-adc2-9c9a20db852a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:55.595161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7268c57-699e-48e1-adc2-9c9a20db852a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:55.595635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7268c57-699e-48e1-adc2-9c9a20db852a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:55.596093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7268c57-699e-48e1-adc2-9c9a20db852a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:55.606822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4e5bbb8a-5da9-4436-9caa-85c9d9073b1f tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:55.625078 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4e5bbb8a-5da9-4436-9caa-85c9d9073b1f tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1526 microversion: 2.1 time: 0.513877 Oct 27 18:54:55.626019 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1151/2320] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:55 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1526 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:55.638281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-99e2ae78-b506-49b5-93f6-a5e47bea4f1d tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Calling method '.version_select at 0x7fc87335eb80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:55.682463 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-99e2ae78-b506-49b5-93f6-a5e47bea4f1d tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1176397461" status: 204 len: 0 microversion: 2.2 time: 0.055310 Oct 27 18:54:55.690165 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1152/2321] 10.222.0.42 () {60 vars in 1321 bytes} [Thu Oct 27 18:54:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1176397461 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:55.695808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71612664-677c-48a4-9783-ce50c537730d tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Action: 'create', calling method: .version_select at 0x7fc8733949d0>, body: {"keypair": {"name": "tempest-keypair-1908248031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBrIB3fD7G+FPlN0jjeln/0X0k+762CTVntzXoPtUkyKgqb91dRS83Y82q0QDJYgZAdag24CUrLEocrg67En8GyMxdZb302Ugh+a0/ZfgNi5Bh8bL7WyukhFJwW434+hg=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:55.740505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-71612664-677c-48a4-9783-ce50c537730d tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:54:55.748079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-71612664-677c-48a4-9783-ce50c537730d tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for user c79319497cc34fbabe1889bd3eb01399 and project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:54:55.809881 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-71612664-677c-48a4-9783-ce50c537730d tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.118033 Oct 27 18:54:55.810585 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1153/2322] 10.222.0.42 () {62 vars in 1199 bytes} [Thu Oct 27 18:54:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 18:54:55.822441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-719e1ef1-3317-49cc-9a3a-6bb47e75a39a tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Calling method '.version_select at 0x7fc873297ca0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:55.843744 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-719e1ef1-3317-49cc-9a3a-6bb47e75a39a tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-1908248031" status: 200 len: 513 microversion: 2.2 time: 0.022920 Oct 27 18:54:55.844921 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1154/2323] 10.222.0.42 () {60 vars in 1258 bytes} [Thu Oct 27 18:54:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1908248031 => generated 513 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:55.851653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc3d5ec7-cdc4-4ea4-a71f-67017fb1950e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:55.858060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fc3d5ec7-cdc4-4ea4-a71f-67017fb1950e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:55.874015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc3d5ec7-cdc4-4ea4-a71f-67017fb1950e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:55.874550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc3d5ec7-cdc4-4ea4-a71f-67017fb1950e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:55.874991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc3d5ec7-cdc4-4ea4-a71f-67017fb1950e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:55.880552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc3d5ec7-cdc4-4ea4-a71f-67017fb1950e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:55.883820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc3d5ec7-cdc4-4ea4-a71f-67017fb1950e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:55.884328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc3d5ec7-cdc4-4ea4-a71f-67017fb1950e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:55.907534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f7268c57-699e-48e1-adc2-9c9a20db852a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:55.923477 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f7268c57-699e-48e1-adc2-9c9a20db852a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.355156 Oct 27 18:54:55.924123 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1170/2324] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:55 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:55.949477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d2cbf0b1-f390-4069-b2a0-dd6ea08a2a95 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Calling method '.version_select at 0x7fc86a9fa4c0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:55.978131 n-d-860687-3 devstack@n-api.service[127029]: WARNING oslo_db.sqlalchemy.utils [None req-d2cbf0b1-f390-4069-b2a0-dd6ea08a2a95 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 18:54:55.994285 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d2cbf0b1-f390-4069-b2a0-dd6ea08a2a95 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.058201 Oct 27 18:54:56.000389 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1171/2325] 10.222.0.42 () {60 vars in 1177 bytes} [Thu Oct 27 18:54:55 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:56.009163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f1a9d7f7-c5a7-4c2b-88e6-ed5d308448dd tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Calling method '.version_select at 0x7fc8733b6310>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:56.067586 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f1a9d7f7-c5a7-4c2b-88e6-ed5d308448dd tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908248031" status: 204 len: 0 microversion: 2.2 time: 0.062114 Oct 27 18:54:56.068228 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1172/2326] 10.222.0.42 () {60 vars in 1261 bytes} [Thu Oct 27 18:54:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908248031 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 18:54:56.077445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-baf93f96-1851-494a-bb57-6e4b61f3268b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:56.078223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-baf93f96-1851-494a-bb57-6e4b61f3268b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:56.093405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baf93f96-1851-494a-bb57-6e4b61f3268b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:56.098087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baf93f96-1851-494a-bb57-6e4b61f3268b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:56.098756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baf93f96-1851-494a-bb57-6e4b61f3268b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:56.099678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baf93f96-1851-494a-bb57-6e4b61f3268b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:56.100273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baf93f96-1851-494a-bb57-6e4b61f3268b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:56.100792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baf93f96-1851-494a-bb57-6e4b61f3268b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:56.396788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc3d5ec7-cdc4-4ea4-a71f-67017fb1950e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:56.407199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-baf93f96-1851-494a-bb57-6e4b61f3268b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:56.410052 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc3d5ec7-cdc4-4ea4-a71f-67017fb1950e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 0.561423 Oct 27 18:54:56.421430 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-baf93f96-1851-494a-bb57-6e4b61f3268b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1308 microversion: 2.1 time: 0.352007 Oct 27 18:54:56.422619 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1173/2327] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:56 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1308 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:56.423539 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1155/2328] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:55 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:56.437335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1a0a2900-8d1b-44d2-b520-a150a83a1efc tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Action: 'create', calling method: .version_select at 0x7fc87330af70>, body: {"keypair": {"name": "tempest-keypair-1156179108", "type": "x509"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:56.438824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-026f3390-a9d6-402e-ae12-cdc3205baf06 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-954284941", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-026f3390-a9d6-402e-ae12-cdc3205baf06 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 491 Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-954284941", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-954284941', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '969dfa55-7bd6-4101-b2b3-c0ca6c6378eb'}]}}} Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:56.452322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-026f3390-a9d6-402e-ae12-cdc3205baf06 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:56.455119 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-026f3390-a9d6-402e-ae12-cdc3205baf06 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.029980 Oct 27 18:54:56.462031 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1174/2329] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:54:56 2022] POST /compute/v2.1/servers => generated 624 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:54:56.471104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bf0d4665-5b86-461a-b4d2-7d2d2dedc346 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:56.471763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bf0d4665-5b86-461a-b4d2-7d2d2dedc346 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:56.474350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:56.496021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf0d4665-5b86-461a-b4d2-7d2d2dedc346 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:56.496774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf0d4665-5b86-461a-b4d2-7d2d2dedc346 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:56.497641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf0d4665-5b86-461a-b4d2-7d2d2dedc346 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:56.499076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf0d4665-5b86-461a-b4d2-7d2d2dedc346 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:56.501339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf0d4665-5b86-461a-b4d2-7d2d2dedc346 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:56.502378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf0d4665-5b86-461a-b4d2-7d2d2dedc346 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:56.505939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-1a0a2900-8d1b-44d2-b520-a150a83a1efc tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:54:56.538858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-1a0a2900-8d1b-44d2-b520-a150a83a1efc tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for user c79319497cc34fbabe1889bd3eb01399 and project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:54:56.583231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.processutils [None req-1a0a2900-8d1b-44d2-b520-a150a83a1efc tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmphq3ns4eq/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmphq3ns4eq/temp.key -subj /CN=c79319497cc34fbabe1889bd3eb01399 -extensions v3_req_client {{(pid=127028) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 27 18:54:56.735084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bf0d4665-5b86-461a-b4d2-7d2d2dedc346 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d15a9c4f714dd6a6764b5a431c27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd09ac8cf7a4b809a996cdebb20d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:56.764222 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bf0d4665-5b86-461a-b4d2-7d2d2dedc346 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 200 len: 1253 microversion: 2.1 time: 0.300932 Oct 27 18:54:56.764834 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1175/2330] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:56 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 1253 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:56.788217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5788f093-2fe8-4468-9361-f1e55f3f080e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:56.788836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5788f093-2fe8-4468-9361-f1e55f3f080e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:56.797343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5788f093-2fe8-4468-9361-f1e55f3f080e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:56.798420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5788f093-2fe8-4468-9361-f1e55f3f080e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:56.799496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5788f093-2fe8-4468-9361-f1e55f3f080e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:56.803791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5788f093-2fe8-4468-9361-f1e55f3f080e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:56.804763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5788f093-2fe8-4468-9361-f1e55f3f080e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:56.805712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5788f093-2fe8-4468-9361-f1e55f3f080e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:57.122145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5788f093-2fe8-4468-9361-f1e55f3f080e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:57.132424 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5788f093-2fe8-4468-9361-f1e55f3f080e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.350045 Oct 27 18:54:57.155746 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1176/2331] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:56 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:57.167988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-525de792-8431-40bc-9757-a4cfd8fbf411 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:57.168626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-525de792-8431-40bc-9757-a4cfd8fbf411 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:57.186011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-525de792-8431-40bc-9757-a4cfd8fbf411 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:57.186542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-525de792-8431-40bc-9757-a4cfd8fbf411 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:57.187021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-525de792-8431-40bc-9757-a4cfd8fbf411 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:57.187871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-525de792-8431-40bc-9757-a4cfd8fbf411 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:57.188289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-525de792-8431-40bc-9757-a4cfd8fbf411 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:57.188730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-525de792-8431-40bc-9757-a4cfd8fbf411 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:57.288243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-525de792-8431-40bc-9757-a4cfd8fbf411 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:57.297884 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-525de792-8431-40bc-9757-a4cfd8fbf411 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1484 microversion: 2.1 time: 0.140527 Oct 27 18:54:57.299323 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1177/2332] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:57 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1484 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:57.312192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a35028f1-dcbe-4995-863a-a1176fb8ead0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:57.313837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a35028f1-dcbe-4995-863a-a1176fb8ead0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:57.328443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a35028f1-dcbe-4995-863a-a1176fb8ead0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:57.328907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a35028f1-dcbe-4995-863a-a1176fb8ead0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:57.330963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a35028f1-dcbe-4995-863a-a1176fb8ead0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:57.331689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a35028f1-dcbe-4995-863a-a1176fb8ead0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:57.332317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a35028f1-dcbe-4995-863a-a1176fb8ead0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:57.332818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a35028f1-dcbe-4995-863a-a1176fb8ead0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:57.474002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.processutils [None req-1a0a2900-8d1b-44d2-b520-a150a83a1efc tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmphq3ns4eq/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmphq3ns4eq/temp.key -subj /CN=c79319497cc34fbabe1889bd3eb01399 -extensions v3_req_client" returned: 0 in 0.892s {{(pid=127028) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 27 18:54:57.476311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.processutils [None req-1a0a2900-8d1b-44d2-b520-a150a83a1efc tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmphq3ns4eq/temp.key -password pass: {{(pid=127028) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 27 18:54:57.609881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.processutils [None req-1a0a2900-8d1b-44d2-b520-a150a83a1efc tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] CMD "openssl pkcs12 -export -inkey /tmp/tmphq3ns4eq/temp.key -password pass:" returned: 0 in 0.133s {{(pid=127028) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 27 18:54:57.710076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-1a0a2900-8d1b-44d2-b520-a150a83a1efc tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:54:57.734145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-1a0a2900-8d1b-44d2-b520-a150a83a1efc tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Getting quotas for user c79319497cc34fbabe1889bd3eb01399 and project ecd6d370244946aabca0bd3cc7c477ca. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:54:57.819286 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1a0a2900-8d1b-44d2-b520-a150a83a1efc tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.394189 Oct 27 18:54:57.830147 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1156/2333] 10.222.0.42 () {62 vars in 1198 bytes} [Thu Oct 27 18:54:56 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1405 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:57.851193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a002f1c9-8f7f-4c38-9f5d-6b7f776341f3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:57.860956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a002f1c9-8f7f-4c38-9f5d-6b7f776341f3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:57.880157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a002f1c9-8f7f-4c38-9f5d-6b7f776341f3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:57.881060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a002f1c9-8f7f-4c38-9f5d-6b7f776341f3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:57.883367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a002f1c9-8f7f-4c38-9f5d-6b7f776341f3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:57.887803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a002f1c9-8f7f-4c38-9f5d-6b7f776341f3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:57.888614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a002f1c9-8f7f-4c38-9f5d-6b7f776341f3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:57.889346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a002f1c9-8f7f-4c38-9f5d-6b7f776341f3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:57.903070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:54:58.147402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a35028f1-dcbe-4995-863a-a1176fb8ead0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:58.157491 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a35028f1-dcbe-4995-863a-a1176fb8ead0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.856154 Oct 27 18:54:58.161010 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1178/2334] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:57 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:58.173126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d96450fe-316d-49eb-836f-983eb32bdb91 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:58.174147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d96450fe-316d-49eb-836f-983eb32bdb91 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:58.198140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d96450fe-316d-49eb-836f-983eb32bdb91 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:58.203176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d96450fe-316d-49eb-836f-983eb32bdb91 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:58.203951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a002f1c9-8f7f-4c38-9f5d-6b7f776341f3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:58.207271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d96450fe-316d-49eb-836f-983eb32bdb91 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:58.214008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d96450fe-316d-49eb-836f-983eb32bdb91 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:58.214692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d96450fe-316d-49eb-836f-983eb32bdb91 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:58.218145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d96450fe-316d-49eb-836f-983eb32bdb91 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:58.218683 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a002f1c9-8f7f-4c38-9f5d-6b7f776341f3 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 0.384712 Oct 27 18:54:58.220840 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1157/2335] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:57 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:58.231522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6a191b7-27f0-4c0d-997a-84e86836009f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:58.234235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d6a191b7-27f0-4c0d-997a-84e86836009f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] [instance: 84cbe523-eacc-4725-bb27-dd16d1609546] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:58.248882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6a191b7-27f0-4c0d-997a-84e86836009f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:58.250560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6a191b7-27f0-4c0d-997a-84e86836009f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:58.251495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6a191b7-27f0-4c0d-997a-84e86836009f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:58.261056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6a191b7-27f0-4c0d-997a-84e86836009f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:58.267164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6a191b7-27f0-4c0d-997a-84e86836009f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:58.269175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6a191b7-27f0-4c0d-997a-84e86836009f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:58.324246 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d6a191b7-27f0-4c0d-997a-84e86836009f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] HTTP exception thrown: Instance 84cbe523-eacc-4725-bb27-dd16d1609546 could not be found. Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6a191b7-27f0-4c0d-997a-84e86836009f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Request method failure captured: Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 HTTP/1.1 Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtNsT2lb9INQ966otIXvbi2qzS-X3y0Vj6W3DkA1MlE-JErHl_9IF9qAknpMc9pXN0HIe-od0sy6P0ytFKCfBt5RXrrIX5T1s44tmWi4AsdN5HOjux9UPkYTszbFGVmAXEi-IC8_N_eo1SwTOOA4tTes9ouhh83ohXWhcO1xV46FBdc Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: dfd09ac8cf7a4b809a996cdebb20d76e Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestBootFromVolume-571835465 Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dfd09ac8cf7a4b809a996cdebb20d76e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dfd09ac8cf7a4b809a996cdebb20d76e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dfd09ac8cf7a4b809a996cdebb20d76e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dfd09ac8cf7a4b809a996cdebb20d76e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestBootFromVolume-571835465 Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: dfd09ac8cf7a4b809a996cdebb20d76e Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestBootFromVolume-571835465 Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestBootFromVolume-571835465-project Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e5d15a9c4f714dd6a6764b5a431c27d6 Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestBootFromVolume-571835465-project Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 84cbe523-eacc-4725-bb27-dd16d1609546 could not be found. Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '84cbe523-eacc-4725-bb27-dd16d1609546'} Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84cbe523-eacc-4725-bb27-dd16d1609546 could not be found. Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84cbe523-eacc-4725-bb27-dd16d1609546 could not be found. Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:58.331400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:58.336067 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:58.336067 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:58.336067 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:58.336067 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:54:58.336067 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:54:58.336067 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84cbe523-eacc-4725-bb27-dd16d1609546 could not be found. Oct 27 18:54:58.336067 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:58.336067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6a191b7-27f0-4c0d-997a-84e86836009f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Returning 404 to user: Instance 84cbe523-eacc-4725-bb27-dd16d1609546 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:58.336067 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d6a191b7-27f0-4c0d-997a-84e86836009f tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546" status: 404 len: 111 microversion: 2.1 time: 0.112007 Oct 27 18:54:58.339937 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1158/2336] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:58 2022] GET /compute/v2.1/servers/84cbe523-eacc-4725-bb27-dd16d1609546 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:54:58.355218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-bccefa56-67f7-49bc-956c-117cfffc8345 req-3b09c72d-8e85-40fd-892c-9970241fc0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d118d6-37dd-4318-959f-0346e2e7bf67", "name": "network-vif-deleted", "tag": "75b873bf-a29c-482c-9601-377724e003a2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:58.381230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bccefa56-67f7-49bc-956c-117cfffc8345 req-3b09c72d-8e85-40fd-892c-9970241fc0bc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:58.384395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bccefa56-67f7-49bc-956c-117cfffc8345 req-3b09c72d-8e85-40fd-892c-9970241fc0bc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:58.384882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bccefa56-67f7-49bc-956c-117cfffc8345 req-3b09c72d-8e85-40fd-892c-9970241fc0bc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:58.436169 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-bccefa56-67f7-49bc-956c-117cfffc8345 req-3b09c72d-8e85-40fd-892c-9970241fc0bc service nova] Creating event network-vif-deleted:75b873bf-a29c-482c-9601-377724e003a2 for instance 47d118d6-37dd-4318-959f-0346e2e7bf67 on n-h1-860687-3 Oct 27 18:54:58.446840 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-bccefa56-67f7-49bc-956c-117cfffc8345 req-3b09c72d-8e85-40fd-892c-9970241fc0bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103045 Oct 27 18:54:58.447775 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1159/2337] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:54:58.453115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b54ea34-4a77-42b1-8c9d-61cd2ee758d7 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Calling method '.version_select at 0x7fc873394e50>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:58.485693 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b54ea34-4a77-42b1-8c9d-61cd2ee758d7 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-1156179108" status: 200 len: 1534 microversion: 2.2 time: 0.029517 Oct 27 18:54:58.487318 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1160/2338] 10.222.0.42 () {60 vars in 1258 bytes} [Thu Oct 27 18:54:58 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1156179108 => generated 1534 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:58.499971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8a9f92e8-cd55-4ed2-921e-0801d4a31540 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:58.500940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8a9f92e8-cd55-4ed2-921e-0801d4a31540 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:58.512944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a9f92e8-cd55-4ed2-921e-0801d4a31540 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:58.517174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a9f92e8-cd55-4ed2-921e-0801d4a31540 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:58.517794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a9f92e8-cd55-4ed2-921e-0801d4a31540 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:58.518753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a9f92e8-cd55-4ed2-921e-0801d4a31540 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:58.521899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a9f92e8-cd55-4ed2-921e-0801d4a31540 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:58.522598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a9f92e8-cd55-4ed2-921e-0801d4a31540 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:58.618345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a9f92e8-cd55-4ed2-921e-0801d4a31540 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:58.619125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a9f92e8-cd55-4ed2-921e-0801d4a31540 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:58.619745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a9f92e8-cd55-4ed2-921e-0801d4a31540 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:58.620368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-8a9f92e8-cd55-4ed2-921e-0801d4a31540 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lazy-loading 'fault' on Instance uuid 47d118d6-37dd-4318-959f-0346e2e7bf67 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:54:58.719769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8a9f92e8-cd55-4ed2-921e-0801d4a31540 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f7953b2a894523ac7e38d059ed267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d8a8780e4b4f9d91388b3bee2d61c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:58.733415 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8a9f92e8-cd55-4ed2-921e-0801d4a31540 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 200 len: 1314 microversion: 2.1 time: 0.244224 Oct 27 18:54:58.734356 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1161/2339] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:58 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:58.746743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7520770a-0267-42e2-9751-f1455a67bbe8 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] Calling method '.version_select at 0x7fc873205ca0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:58.800024 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7520770a-0267-42e2-9751-f1455a67bbe8 tempest-ServersTestBootFromVolume-571835465 tempest-ServersTestBootFromVolume-571835465-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2126868959" status: 202 len: 0 microversion: 2.1 time: 0.063090 Oct 27 18:54:58.801391 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1162/2340] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 18:54:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2126868959 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:54:58.806781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e920eb2e-5a6e-4d60-acf8-8580675984ff tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e920eb2e-5a6e-4d60-acf8-8580675984ff tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 416 Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'networks': [{'uuid': '969dfa55-7bd6-4101-b2b3-c0ca6c6378eb'}]}}} Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:58.822011 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 18:54:58.825677 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:58.833942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e920eb2e-5a6e-4d60-acf8-8580675984ff tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:58.835172 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e920eb2e-5a6e-4d60-acf8-8580675984ff tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.032495 Oct 27 18:54:58.838571 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1163/2341] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:54:58 2022] POST /compute/v2.1/servers => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:54:58.845286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-42be5639-383d-4f40-9fc2-6b63a408134c tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Calling method '.version_select at 0x7fc87324c8b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:58.864496 n-d-860687-3 devstack@n-api.service[127028]: WARNING oslo_db.sqlalchemy.utils [None req-42be5639-383d-4f40-9fc2-6b63a408134c tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 18:54:58.877298 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-42be5639-383d-4f40-9fc2-6b63a408134c tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.037228 Oct 27 18:54:58.879820 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1164/2342] 10.222.0.42 () {60 vars in 1177 bytes} [Thu Oct 27 18:54:58 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:58.889938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-adc71efe-c40b-4145-9ef9-43af0be01dde tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:58.904513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-adc71efe-c40b-4145-9ef9-43af0be01dde tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:58.918416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adc71efe-c40b-4145-9ef9-43af0be01dde tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:58.918687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adc71efe-c40b-4145-9ef9-43af0be01dde tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:58.924692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adc71efe-c40b-4145-9ef9-43af0be01dde tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:58.926741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adc71efe-c40b-4145-9ef9-43af0be01dde tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:58.929848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adc71efe-c40b-4145-9ef9-43af0be01dde tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:58.932784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d96450fe-316d-49eb-836f-983eb32bdb91 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:58.936947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adc71efe-c40b-4145-9ef9-43af0be01dde tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:58.945171 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d96450fe-316d-49eb-836f-983eb32bdb91 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1308 microversion: 2.1 time: 0.782830 Oct 27 18:54:58.973658 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1179/2343] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:58 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1308 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:59.241794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e9dd60b4-597a-41dd-ad67-a052a348b323 tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Action: 'create', calling method: .version_select at 0x7fc8733dea60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-261182298", "metadata": {"Type": "work"}}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e9dd60b4-597a-41dd-ad67-a052a348b323 tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Request method failure captured: Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 121 Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtQCVcC7KojwVoRWq2qBfo-Hw_xUMvL3e2YGxbSuAqs3qeaVdWTQkgKqMK9DjL8TwmkgDE8KcRNulAVYSQn8LBMCu53B0bbqGyA1yp94W930cWxH8H8f61Lz1cjzWBTQLmRNr8EPwR1CpyddGTZ1L9MQSPUHZibb6KTBpCtr6-BLPJc Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 969d0ac537ec4296af1117b6950cdc60 Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-VolumesNegativeTest-727710069 Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_969d0ac537ec4296af1117b6950cdc60", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-VolumesNegativeTest-727710069 Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 969d0ac537ec4296af1117b6950cdc60 Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-VolumesNegativeTest-727710069 Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-VolumesNegativeTest-727710069-project Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: d1f0ce7e27fb4c3490f51a908e7586f3 Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-VolumesNegativeTest-727710069-project Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-261182298", "metadata": {"Type": "work"}}} Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-261182298', 'metadata': {'Type': 'work'}}}} Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi '#$%' Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:54:59.251109 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:54:59.257798 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 18:54:59.257798 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:59.257798 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:59.257798 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:59.257798 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:59.257798 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:59.257798 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:59.257798 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:54:59.257798 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:54:59.257798 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 18:54:59.257798 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:54:59.261439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e9dd60b4-597a-41dd-ad67-a052a348b323 tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:59.262588 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e9dd60b4-597a-41dd-ad67-a052a348b323 tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.285320 Oct 27 18:54:59.270034 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1180/2344] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Oct 27 18:54:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 294 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:54:59.276734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-94bdf40c-de7b-4736-946e-f7558b05e195 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] Calling method '.version_select at 0x7fc86a9faf70>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:59.338823 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-94bdf40c-de7b-4736-946e-f7558b05e195 tempest-KeyPairsV22TestJSON-426562683 tempest-KeyPairsV22TestJSON-426562683-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1156179108" status: 204 len: 0 microversion: 2.2 time: 0.065938 Oct 27 18:54:59.339840 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1181/2345] 10.222.0.42 () {60 vars in 1261 bytes} [Thu Oct 27 18:54:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1156179108 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:54:59.348566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-16949f6f-faab-4bcf-8c9a-106de3513187 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:59.349496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-16949f6f-faab-4bcf-8c9a-106de3513187 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:59.374800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16949f6f-faab-4bcf-8c9a-106de3513187 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:59.375324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16949f6f-faab-4bcf-8c9a-106de3513187 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:59.376374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16949f6f-faab-4bcf-8c9a-106de3513187 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:59.377716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16949f6f-faab-4bcf-8c9a-106de3513187 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:59.380650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16949f6f-faab-4bcf-8c9a-106de3513187 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:59.381281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16949f6f-faab-4bcf-8c9a-106de3513187 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:59.597673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-adc71efe-c40b-4145-9ef9-43af0be01dde tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:59.610749 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-adc71efe-c40b-4145-9ef9-43af0be01dde tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.729679 Oct 27 18:54:59.627111 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1165/2346] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:58 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:59.649651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1d42ee2a-d707-47ff-af19-2cd5cad679c1 tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Action: 'create', calling method: .version_select at 0x7fc873205af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1299878882", "metadata": {"Type": "work"}}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1d42ee2a-d707-47ff-af19-2cd5cad679c1 tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Request method failure captured: Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 120 Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtQCVcC7KojwVoRWq2qBfo-Hw_xUMvL3e2YGxbSuAqs3qeaVdWTQkgKqMK9DjL8TwmkgDE8KcRNulAVYSQn8LBMCu53B0bbqGyA1yp94W930cWxH8H8f61Lz1cjzWBTQLmRNr8EPwR1CpyddGTZ1L9MQSPUHZibb6KTBpCtr6-BLPJc Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 969d0ac537ec4296af1117b6950cdc60 Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesNegativeTest-727710069 Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_969d0ac537ec4296af1117b6950cdc60", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-VolumesNegativeTest-727710069 Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 969d0ac537ec4296af1117b6950cdc60 Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesNegativeTest-727710069 Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-VolumesNegativeTest-727710069-project Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: d1f0ce7e27fb4c3490f51a908e7586f3 Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-VolumesNegativeTest-727710069-project Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1299878882", "metadata": {"Type": "work"}}} Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1299878882', 'metadata': {'Type': 'work'}}}} Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi '0' Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:54:59.662263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:54:59.666585 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 18:54:59.666585 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:59.666585 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:54:59.666585 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:59.666585 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:54:59.666585 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:54:59.666585 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:54:59.666585 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:54:59.666585 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:54:59.666585 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 18:54:59.666585 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:54:59.668487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1d42ee2a-d707-47ff-af19-2cd5cad679c1 tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:54:59.669838 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1d42ee2a-d707-47ff-af19-2cd5cad679c1 tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.040076 Oct 27 18:54:59.670624 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1166/2347] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Oct 27 18:54:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:54:59.684682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-83e55b5c-a6f2-4ac6-8f87-4c21e7e2ae6d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:54:59.685506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-83e55b5c-a6f2-4ac6-8f87-4c21e7e2ae6d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:54:59.702615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83e55b5c-a6f2-4ac6-8f87-4c21e7e2ae6d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:59.708627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83e55b5c-a6f2-4ac6-8f87-4c21e7e2ae6d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:59.709060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83e55b5c-a6f2-4ac6-8f87-4c21e7e2ae6d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:59.709795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83e55b5c-a6f2-4ac6-8f87-4c21e7e2ae6d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:54:59.710268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83e55b5c-a6f2-4ac6-8f87-4c21e7e2ae6d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:54:59.710716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83e55b5c-a6f2-4ac6-8f87-4c21e7e2ae6d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:54:59.974584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-16949f6f-faab-4bcf-8c9a-106de3513187 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:54:59.988685 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-16949f6f-faab-4bcf-8c9a-106de3513187 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 0.646813 Oct 27 18:54:59.990613 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1182/2348] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:59 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:54:59.996804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5bca35ad-53a2-4602-b39c-e98b35113533 tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Action: 'create', calling method: .version_select at 0x7fc86a9e3940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-965240695", "metadata": {"Type": "work"}}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5bca35ad-53a2-4602-b39c-e98b35113533 tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Request method failure captured: Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 118 Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtQCVcC7KojwVoRWq2qBfo-Hw_xUMvL3e2YGxbSuAqs3qeaVdWTQkgKqMK9DjL8TwmkgDE8KcRNulAVYSQn8LBMCu53B0bbqGyA1yp94W930cWxH8H8f61Lz1cjzWBTQLmRNr8EPwR1CpyddGTZ1L9MQSPUHZibb6KTBpCtr6-BLPJc Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 969d0ac537ec4296af1117b6950cdc60 Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-VolumesNegativeTest-727710069 Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_969d0ac537ec4296af1117b6950cdc60", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-VolumesNegativeTest-727710069 Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 969d0ac537ec4296af1117b6950cdc60 Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-VolumesNegativeTest-727710069 Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-VolumesNegativeTest-727710069-project Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: d1f0ce7e27fb4c3490f51a908e7586f3 Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-VolumesNegativeTest-727710069-project Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-965240695", "metadata": {"Type": "work"}}} Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-965240695', 'metadata': {'Type': 'work'}}}} Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi '' Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:55:00.002468 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:55:00.007196 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 18:55:00.007196 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.007196 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.007196 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.007196 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.007196 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:00.007196 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:00.007196 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:55:00.007196 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:55:00.007196 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 18:55:00.007196 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.022942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5bca35ad-53a2-4602-b39c-e98b35113533 tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:00.023967 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5bca35ad-53a2-4602-b39c-e98b35113533 tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031934 Oct 27 18:55:00.024566 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1183/2349] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Oct 27 18:54:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:55:00.044507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b842c491-ce3f-48c6-adf1-5b6a34bb0b80 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:00.045609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b842c491-ce3f-48c6-adf1-5b6a34bb0b80 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] [instance: 47d118d6-37dd-4318-959f-0346e2e7bf67] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:00.060431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b842c491-ce3f-48c6-adf1-5b6a34bb0b80 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:00.063209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b842c491-ce3f-48c6-adf1-5b6a34bb0b80 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:00.063918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b842c491-ce3f-48c6-adf1-5b6a34bb0b80 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:00.064990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b842c491-ce3f-48c6-adf1-5b6a34bb0b80 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:00.069704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b842c491-ce3f-48c6-adf1-5b6a34bb0b80 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:00.070462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b842c491-ce3f-48c6-adf1-5b6a34bb0b80 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:00.102919 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-b842c491-ce3f-48c6-adf1-5b6a34bb0b80 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] HTTP exception thrown: Instance 47d118d6-37dd-4318-959f-0346e2e7bf67 could not be found. Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b842c491-ce3f-48c6-adf1-5b6a34bb0b80 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Request method failure captured: Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 HTTP/1.1 Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPb35qs_2VLjeYropqd-keEcMYSAzIBGnqMOstF1Y9wj0OR4xzKXVMkTp4PBObjU4JKx5WJALq_c0uTgNScd4Lb7Nnr_ndlV93Ts9mLqiY4ah0prLMT5kaAwd7ui_xh2PbWqvlZ0fkuj3GapnU-rvWrhvGaW8J6lrxl-3PxGMJIxBQ Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_66d8a8780e4b4f9d91388b3bee2d61c2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66d8a8780e4b4f9d91388b3bee2d61c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 66d8a8780e4b4f9d91388b3bee2d61c2 Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-900673084 Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 03f7953b2a894523ac7e38d059ed267b Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-900673084-project Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 47d118d6-37dd-4318-959f-0346e2e7bf67 could not be found. Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '47d118d6-37dd-4318-959f-0346e2e7bf67'} Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47d118d6-37dd-4318-959f-0346e2e7bf67 could not be found. Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47d118d6-37dd-4318-959f-0346e2e7bf67 could not be found. Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.104903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.108786 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.108786 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.108786 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:00.108786 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:00.108786 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:00.108786 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:00.108786 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47d118d6-37dd-4318-959f-0346e2e7bf67 could not be found. Oct 27 18:55:00.108786 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.112025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b842c491-ce3f-48c6-adf1-5b6a34bb0b80 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] Returning 404 to user: Instance 47d118d6-37dd-4318-959f-0346e2e7bf67 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:00.116986 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b842c491-ce3f-48c6-adf1-5b6a34bb0b80 tempest-ServerMetadataNegativeTestJSON-900673084 tempest-ServerMetadataNegativeTestJSON-900673084-project] 10.222.0.42 "GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67" status: 404 len: 111 microversion: 2.1 time: 0.086929 Oct 27 18:55:00.118208 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1184/2350] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:00 2022] GET /compute/v2.1/servers/47d118d6-37dd-4318-959f-0346e2e7bf67 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:00.127762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a278ce09-4a24-40fc-98dd-14b639e9a124 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:00.131095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a278ce09-4a24-40fc-98dd-14b639e9a124 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:00.148033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a278ce09-4a24-40fc-98dd-14b639e9a124 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:00.148757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a278ce09-4a24-40fc-98dd-14b639e9a124 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:00.149370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a278ce09-4a24-40fc-98dd-14b639e9a124 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:00.150281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a278ce09-4a24-40fc-98dd-14b639e9a124 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:00.157016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a278ce09-4a24-40fc-98dd-14b639e9a124 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:00.158055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a278ce09-4a24-40fc-98dd-14b639e9a124 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:00.399670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-83e55b5c-a6f2-4ac6-8f87-4c21e7e2ae6d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:00.408612 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-83e55b5c-a6f2-4ac6-8f87-4c21e7e2ae6d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.736820 Oct 27 18:55:00.432662 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1167/2351] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:54:59 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:00.452165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d876b97-441a-4821-8ac4-7512e071c71b tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Calling method '.version_select at 0x7fc8731feaf0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:00.512462 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-2d876b97-441a-4821-8ac4-7512e071c71b tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] HTTP exception thrown: Volume tempest-invalid-820895818 could not be found. Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d876b97-441a-4821-8ac4-7512e071c71b tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Request method failure captured: Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-820895818 HTTP/1.1 Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtQCVcC7KojwVoRWq2qBfo-Hw_xUMvL3e2YGxbSuAqs3qeaVdWTQkgKqMK9DjL8TwmkgDE8KcRNulAVYSQn8LBMCu53B0bbqGyA1yp94W930cWxH8H8f61Lz1cjzWBTQLmRNr8EPwR1CpyddGTZ1L9MQSPUHZibb6KTBpCtr6-BLPJc Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 969d0ac537ec4296af1117b6950cdc60 Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesNegativeTest-727710069 Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_969d0ac537ec4296af1117b6950cdc60", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-VolumesNegativeTest-727710069 Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 969d0ac537ec4296af1117b6950cdc60 Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesNegativeTest-727710069 Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-VolumesNegativeTest-727710069-project Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: d1f0ce7e27fb4c3490f51a908e7586f3 Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-VolumesNegativeTest-727710069-project Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: exception: Volume tempest-invalid-820895818 could not be found. Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'tempest-invalid-820895818'} Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-820895818 could not be found. (HTTP 404) (Request-ID: req-0f4cac42-1eff-40a3-8434-5d50a9ba27e6) Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 18:55:00.517077 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-820895818 could not be found. Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-820895818 could not be found. Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-820895818 could not be found. Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d876b97-441a-4821-8ac4-7512e071c71b tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Returning 404 to user: Volume tempest-invalid-820895818 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d876b97-441a-4821-8ac4-7512e071c71b tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-820895818" status: 404 len: 98 microversion: 2.1 time: 0.084553 Oct 27 18:55:00.520772 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1168/2352] 10.222.0.42 () {58 vars in 1215 bytes} [Thu Oct 27 18:55:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-820895818 => generated 98 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:55:00.535157 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ee2acc4c-2aca-4b01-a9ce-e045be855eb2 tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008773 Oct 27 18:55:00.536142 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1169/2353] 10.222.0.42 () {58 vars in 1140 bytes} [Thu Oct 27 18:55:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 27 18:55:00.555673 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-35ab5806-8fe5-4e95-bb0e-7c50a40ef54b tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012749 Oct 27 18:55:00.558036 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1170/2354] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:55:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 18:55:00.572647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e2d9f59-5ad6-4088-afcd-6a4531dc703e tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Calling method '.version_select at 0x7fc87320d940>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:00.639938 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-9e2d9f59-5ad6-4088-afcd-6a4531dc703e tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] HTTP exception thrown: Volume cee0c817-aa14-4d67-9307-61970764dd9e could not be found. Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e2d9f59-5ad6-4088-afcd-6a4531dc703e tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Request method failure captured: Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/os-volumes/cee0c817-aa14-4d67-9307-61970764dd9e HTTP/1.1 Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtQCVcC7KojwVoRWq2qBfo-Hw_xUMvL3e2YGxbSuAqs3qeaVdWTQkgKqMK9DjL8TwmkgDE8KcRNulAVYSQn8LBMCu53B0bbqGyA1yp94W930cWxH8H8f61Lz1cjzWBTQLmRNr8EPwR1CpyddGTZ1L9MQSPUHZibb6KTBpCtr6-BLPJc Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 969d0ac537ec4296af1117b6950cdc60 Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesNegativeTest-727710069 Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_969d0ac537ec4296af1117b6950cdc60", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-VolumesNegativeTest-727710069 Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 969d0ac537ec4296af1117b6950cdc60 Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesNegativeTest-727710069 Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-VolumesNegativeTest-727710069-project Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: d1f0ce7e27fb4c3490f51a908e7586f3 Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-VolumesNegativeTest-727710069-project Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: exception: Volume cee0c817-aa14-4d67-9307-61970764dd9e could not be found. Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'cee0c817-aa14-4d67-9307-61970764dd9e'} Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cee0c817-aa14-4d67-9307-61970764dd9e could not be found. (HTTP 404) (Request-ID: req-fbf6dd4a-0f38-4695-b538-7d34694f4d08) Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 18:55:00.642811 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cee0c817-aa14-4d67-9307-61970764dd9e could not be found. Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cee0c817-aa14-4d67-9307-61970764dd9e could not be found. Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cee0c817-aa14-4d67-9307-61970764dd9e could not be found. Oct 27 18:55:00.647043 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.653139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e2d9f59-5ad6-4088-afcd-6a4531dc703e tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Returning 404 to user: Volume cee0c817-aa14-4d67-9307-61970764dd9e could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:00.654875 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9e2d9f59-5ad6-4088-afcd-6a4531dc703e tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/cee0c817-aa14-4d67-9307-61970764dd9e" status: 404 len: 109 microversion: 2.1 time: 0.091854 Oct 27 18:55:00.655665 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1171/2355] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 18:55:00 2022] DELETE /compute/v2.1/os-volumes/cee0c817-aa14-4d67-9307-61970764dd9e => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:00.669805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-db80eb1a-028c-47c3-895f-0cc5f45cd41c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2054480191", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": -1, "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:00.714658 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-db80eb1a-028c-47c3-895f-0cc5f45cd41c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Flavor -1 could not be found. Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-db80eb1a-028c-47c3-895f-0cc5f45cd41c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 206 Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2054480191", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": -1, "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: exception: Flavor -1 could not be found. Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2054480191', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': -1, 'networks': [{'uuid': '969dfa55-7bd6-4101-b2b3-c0ca6c6378eb'}]}}} Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:00.716986 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 27 18:55:00.721225 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.724422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-db80eb1a-028c-47c3-895f-0cc5f45cd41c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:00.726418 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-db80eb1a-028c-47c3-895f-0cc5f45cd41c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.069012 Oct 27 18:55:00.729354 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1172/2356] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:55:00 2022] POST /compute/v2.1/servers => generated 73 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:55:00.736133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf4cf775-0ecc-4f02-9a10-0ac64ef9360c tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Calling method '.version_select at 0x7fc87320db80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:00.772264 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-cf4cf775-0ecc-4f02-9a10-0ac64ef9360c tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] HTTP exception thrown: Volume 6b2f986b-3f3e-4a71-b5e0-65619e255956 could not be found. Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf4cf775-0ecc-4f02-9a10-0ac64ef9360c tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Request method failure captured: Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-volumes/6b2f986b-3f3e-4a71-b5e0-65619e255956 HTTP/1.1 Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtQCVcC7KojwVoRWq2qBfo-Hw_xUMvL3e2YGxbSuAqs3qeaVdWTQkgKqMK9DjL8TwmkgDE8KcRNulAVYSQn8LBMCu53B0bbqGyA1yp94W930cWxH8H8f61Lz1cjzWBTQLmRNr8EPwR1CpyddGTZ1L9MQSPUHZibb6KTBpCtr6-BLPJc Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 969d0ac537ec4296af1117b6950cdc60 Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesNegativeTest-727710069 Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_969d0ac537ec4296af1117b6950cdc60", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/969d0ac537ec4296af1117b6950cdc60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-VolumesNegativeTest-727710069 Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 969d0ac537ec4296af1117b6950cdc60 Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesNegativeTest-727710069 Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-VolumesNegativeTest-727710069-project Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: d1f0ce7e27fb4c3490f51a908e7586f3 Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-VolumesNegativeTest-727710069-project Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: exception: Volume 6b2f986b-3f3e-4a71-b5e0-65619e255956 could not be found. Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '6b2f986b-3f3e-4a71-b5e0-65619e255956'} Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b2f986b-3f3e-4a71-b5e0-65619e255956 could not be found. (HTTP 404) (Request-ID: req-0b44dc61-aadc-4490-aa8c-9f3f1a375a4e) Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 18:55:00.774820 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b2f986b-3f3e-4a71-b5e0-65619e255956 could not be found. Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b2f986b-3f3e-4a71-b5e0-65619e255956 could not be found. Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b2f986b-3f3e-4a71-b5e0-65619e255956 could not be found. Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf4cf775-0ecc-4f02-9a10-0ac64ef9360c tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] Returning 404 to user: Volume 6b2f986b-3f3e-4a71-b5e0-65619e255956 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cf4cf775-0ecc-4f02-9a10-0ac64ef9360c tempest-VolumesNegativeTest-727710069 tempest-VolumesNegativeTest-727710069-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6b2f986b-3f3e-4a71-b5e0-65619e255956" status: 404 len: 109 microversion: 2.1 time: 0.045674 Oct 27 18:55:00.778333 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1173/2357] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 18:55:00 2022] GET /compute/v2.1/os-volumes/6b2f986b-3f3e-4a71-b5e0-65619e255956 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:00.783526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-01f7ef12-e45d-4fd2-8c55-42c34db3b388 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:00.785447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-01f7ef12-e45d-4fd2-8c55-42c34db3b388 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:00.792623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01f7ef12-e45d-4fd2-8c55-42c34db3b388 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:00.793400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01f7ef12-e45d-4fd2-8c55-42c34db3b388 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:00.794010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01f7ef12-e45d-4fd2-8c55-42c34db3b388 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:00.795435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01f7ef12-e45d-4fd2-8c55-42c34db3b388 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:00.796132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01f7ef12-e45d-4fd2-8c55-42c34db3b388 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:00.797292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01f7ef12-e45d-4fd2-8c55-42c34db3b388 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:00.807643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a278ce09-4a24-40fc-98dd-14b639e9a124 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:00.816907 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a278ce09-4a24-40fc-98dd-14b639e9a124 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1308 microversion: 2.1 time: 0.697400 Oct 27 18:55:00.822639 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1185/2358] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:00 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1308 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:01.016368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b71478f8-b374-4c7b-a5a7-3540d1097a05 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:01.017290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b71478f8-b374-4c7b-a5a7-3540d1097a05 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:01.028827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b71478f8-b374-4c7b-a5a7-3540d1097a05 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:01.029558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b71478f8-b374-4c7b-a5a7-3540d1097a05 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:01.030179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b71478f8-b374-4c7b-a5a7-3540d1097a05 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:01.031086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b71478f8-b374-4c7b-a5a7-3540d1097a05 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:01.033700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b71478f8-b374-4c7b-a5a7-3540d1097a05 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:01.034800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b71478f8-b374-4c7b-a5a7-3540d1097a05 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:01.205481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-01f7ef12-e45d-4fd2-8c55-42c34db3b388 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:01.219767 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-01f7ef12-e45d-4fd2-8c55-42c34db3b388 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.439986 Oct 27 18:55:01.223129 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1174/2359] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:00 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:01.258656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-21d1036b-5f6c-466a-b937-f813e119d7f4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:01.258656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-21d1036b-5f6c-466a-b937-f813e119d7f4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:01.264774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d1036b-5f6c-466a-b937-f813e119d7f4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:01.265423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d1036b-5f6c-466a-b937-f813e119d7f4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:01.266045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d1036b-5f6c-466a-b937-f813e119d7f4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:01.266997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d1036b-5f6c-466a-b937-f813e119d7f4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:01.267588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d1036b-5f6c-466a-b937-f813e119d7f4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:01.268118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d1036b-5f6c-466a-b937-f813e119d7f4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:01.631691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-21d1036b-5f6c-466a-b937-f813e119d7f4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:01.647363 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-21d1036b-5f6c-466a-b937-f813e119d7f4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.397132 Oct 27 18:55:01.652067 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1175/2360] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:01 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:55:01.885180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2009824031", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "db61e2ae-a0b9-4ebe-826d-1c6dfd28832f"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:01.989618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] validate_networks() for [('db61e2ae-a0b9-4ebe-826d-1c6dfd28832f', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:55:02.561471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b71478f8-b374-4c7b-a5a7-3540d1097a05 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:02.573550 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b71478f8-b374-4c7b-a5a7-3540d1097a05 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 1.561107 Oct 27 18:55:02.592080 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1186/2361] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:01 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:55:02.605820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-444fee42-c93b-48b2-8242-8124a59c8847 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:02.606482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-444fee42-c93b-48b2-8242-8124a59c8847 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:02.623771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-444fee42-c93b-48b2-8242-8124a59c8847 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:02.624185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-444fee42-c93b-48b2-8242-8124a59c8847 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:02.624805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-444fee42-c93b-48b2-8242-8124a59c8847 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:02.625717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-444fee42-c93b-48b2-8242-8124a59c8847 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:02.626349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-444fee42-c93b-48b2-8242-8124a59c8847 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:02.633073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-444fee42-c93b-48b2-8242-8124a59c8847 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:03.125642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:55:03.126148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:55:03.126895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:55:03.127775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:55:03.128680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:55:03.137731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:03.153800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:03.154812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:03.155483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:03.160966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:03.161719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:03.162677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:03.215850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Getting quotas for project 47340475d333442da39184d873995e37. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:55:03.229794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Getting quotas for user 59ab6001dda8482a83fbd4dc67eabb68 and project 47340475d333442da39184d873995e37. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:55:03.262905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:55:03.266757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:55:03.395086 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-29655322-3ec9-4da4-9451-1717f199a2ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.741569 Oct 27 18:55:03.397921 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1176/2362] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:55:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:55:03.420022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb1fd8ee-f7a8-4cae-af0a-8b1334822984 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2001426118", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb1fd8ee-f7a8-4cae-af0a-8b1334822984 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 173 Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2001426118", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2001426118', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '969dfa55-7bd6-4101-b2b3-c0ca6c6378eb'}]}}} Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi -1 Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:55:03.433459 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:55:03.437110 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:55:03.437110 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:55:03.437110 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 27 18:55:03.437110 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:03.437110 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:03.437110 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:03.437110 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:03.437110 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:03.437110 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:03.437110 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:55:03.437110 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:55:03.437110 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 27 18:55:03.437110 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:03.441435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb1fd8ee-f7a8-4cae-af0a-8b1334822984 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:03.443659 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cb1fd8ee-f7a8-4cae-af0a-8b1334822984 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.042890 Oct 27 18:55:03.446590 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1177/2363] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:55:03 2022] POST /compute/v2.1/servers => generated 145 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:55:03.464128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-3f5fa692-0fb4-4735-ab3b-8effe8a9abef req-d0787e7f-5443-4d76-842b-4393d83688d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d741a04d-f8e8-4b66-bc30-377d4c8de1dc", "name": "network-vif-plugged", "status": "completed", "tag": "ac56cb8e-e2ef-419e-be28-4a7a3d4a4c68"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:03.489015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3f5fa692-0fb4-4735-ab3b-8effe8a9abef req-d0787e7f-5443-4d76-842b-4393d83688d8 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:03.492498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3f5fa692-0fb4-4735-ab3b-8effe8a9abef req-d0787e7f-5443-4d76-842b-4393d83688d8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:03.493202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3f5fa692-0fb4-4735-ab3b-8effe8a9abef req-d0787e7f-5443-4d76-842b-4393d83688d8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:03.520659 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-3f5fa692-0fb4-4735-ab3b-8effe8a9abef req-d0787e7f-5443-4d76-842b-4393d83688d8 service nova] Creating event network-vif-plugged:ac56cb8e-e2ef-419e-be28-4a7a3d4a4c68 for instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc on n-h2-860687-3 Oct 27 18:55:03.533314 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-3f5fa692-0fb4-4735-ab3b-8effe8a9abef req-d0787e7f-5443-4d76-842b-4393d83688d8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083851 Oct 27 18:55:03.547593 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1178/2364] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:03.564238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb6f7e2a-6744-4453-a599-8820a7cf8ec0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:03.568630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fb6f7e2a-6744-4453-a599-8820a7cf8ec0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:03.734539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fb6f7e2a-6744-4453-a599-8820a7cf8ec0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:03.748276 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fb6f7e2a-6744-4453-a599-8820a7cf8ec0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1211 microversion: 2.1 time: 0.198684 Oct 27 18:55:03.751569 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1179/2365] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:03 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1211 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:03.766123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7f44be26-aced-441f-a37c-7209e8741bda tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:03.768443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7f44be26-aced-441f-a37c-7209e8741bda tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:03.788628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f44be26-aced-441f-a37c-7209e8741bda tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:03.790715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f44be26-aced-441f-a37c-7209e8741bda tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:03.792950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f44be26-aced-441f-a37c-7209e8741bda tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:03.793977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f44be26-aced-441f-a37c-7209e8741bda tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:03.795382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f44be26-aced-441f-a37c-7209e8741bda tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:03.801743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f44be26-aced-441f-a37c-7209e8741bda tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:04.154166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7f44be26-aced-441f-a37c-7209e8741bda tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:04.163622 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7f44be26-aced-441f-a37c-7209e8741bda tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.408033 Oct 27 18:55:04.164221 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1180/2366] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:03 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:04.175178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b6899324-1f91-4cc3-9d80-bdac58741327 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:04.176209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b6899324-1f91-4cc3-9d80-bdac58741327 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:04.191636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6899324-1f91-4cc3-9d80-bdac58741327 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:04.192970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6899324-1f91-4cc3-9d80-bdac58741327 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:04.193707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6899324-1f91-4cc3-9d80-bdac58741327 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:04.207421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6899324-1f91-4cc3-9d80-bdac58741327 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:04.208702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6899324-1f91-4cc3-9d80-bdac58741327 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:04.209459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6899324-1f91-4cc3-9d80-bdac58741327 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:04.328496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-444fee42-c93b-48b2-8242-8124a59c8847 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:04.355302 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-444fee42-c93b-48b2-8242-8124a59c8847 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1308 microversion: 2.1 time: 1.753642 Oct 27 18:55:04.356628 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1187/2367] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:02 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1308 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:04.370610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d50b8e0-e2a2-4f6a-8298-e854817f4a06 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:04.371250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9d50b8e0-e2a2-4f6a-8298-e854817f4a06 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:04.385731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d50b8e0-e2a2-4f6a-8298-e854817f4a06 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:04.386242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d50b8e0-e2a2-4f6a-8298-e854817f4a06 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:04.386726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d50b8e0-e2a2-4f6a-8298-e854817f4a06 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:04.387456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d50b8e0-e2a2-4f6a-8298-e854817f4a06 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:04.392101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d50b8e0-e2a2-4f6a-8298-e854817f4a06 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:04.394748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d50b8e0-e2a2-4f6a-8298-e854817f4a06 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:04.690819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6899324-1f91-4cc3-9d80-bdac58741327 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:04.709333 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b6899324-1f91-4cc3-9d80-bdac58741327 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 0.538202 Oct 27 18:55:04.719881 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1181/2368] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:04 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:04.777410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3bc63d41-e026-4357-a486-53c359012329 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:04.778405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3bc63d41-e026-4357-a486-53c359012329 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:04.790101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bc63d41-e026-4357-a486-53c359012329 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:04.790639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bc63d41-e026-4357-a486-53c359012329 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:04.791807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bc63d41-e026-4357-a486-53c359012329 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:04.793095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bc63d41-e026-4357-a486-53c359012329 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:04.793571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bc63d41-e026-4357-a486-53c359012329 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:04.794011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bc63d41-e026-4357-a486-53c359012329 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:04.948611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3bc63d41-e026-4357-a486-53c359012329 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:04.956584 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3bc63d41-e026-4357-a486-53c359012329 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1207 microversion: 2.1 time: 0.184344 Oct 27 18:55:04.957184 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1182/2369] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:04 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1207 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:55:05.271392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9d50b8e0-e2a2-4f6a-8298-e854817f4a06 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:05.280525 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9d50b8e0-e2a2-4f6a-8298-e854817f4a06 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.922696 Oct 27 18:55:05.290436 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1188/2370] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:04 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:05.381304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b90fa412-27a7-4424-9ac6-306f3ab5b0ec tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:05.383277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b90fa412-27a7-4424-9ac6-306f3ab5b0ec tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:05.392926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b90fa412-27a7-4424-9ac6-306f3ab5b0ec tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:05.398190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b90fa412-27a7-4424-9ac6-306f3ab5b0ec tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:05.399049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b90fa412-27a7-4424-9ac6-306f3ab5b0ec tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:05.406431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b90fa412-27a7-4424-9ac6-306f3ab5b0ec tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:05.407588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b90fa412-27a7-4424-9ac6-306f3ab5b0ec tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:05.409714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b90fa412-27a7-4424-9ac6-306f3ab5b0ec tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:05.742654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-82d72790-53fa-4468-b590-a1573e5c849f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:05.743985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-82d72790-53fa-4468-b590-a1573e5c849f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:05.753839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82d72790-53fa-4468-b590-a1573e5c849f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:05.760422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82d72790-53fa-4468-b590-a1573e5c849f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:05.765586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82d72790-53fa-4468-b590-a1573e5c849f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:05.766744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82d72790-53fa-4468-b590-a1573e5c849f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:05.767389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82d72790-53fa-4468-b590-a1573e5c849f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:05.768109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82d72790-53fa-4468-b590-a1573e5c849f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:06.196942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b90fa412-27a7-4424-9ac6-306f3ab5b0ec tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:06.205702 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b90fa412-27a7-4424-9ac6-306f3ab5b0ec tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1308 microversion: 2.1 time: 0.830066 Oct 27 18:55:06.230415 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1183/2371] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:05 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1308 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:06.230415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cea9b927-1f41-457c-b20e-aabb1df9cf94 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1081220238", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:06.243963 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-cea9b927-1f41-457c-b20e-aabb1df9cf94 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cea9b927-1f41-457c-b20e-aabb1df9cf94 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 216 Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1081220238", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1081220238', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:06.246963 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:06.252643 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:06.252643 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:06.252643 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:06.252643 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:06.252643 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:06.252643 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 18:55:06.252643 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:06.256596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cea9b927-1f41-457c-b20e-aabb1df9cf94 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:06.272816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-82d72790-53fa-4468-b590-a1573e5c849f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:06.279941 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cea9b927-1f41-457c-b20e-aabb1df9cf94 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.041172 Oct 27 18:55:06.287023 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1184/2372] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:55:06 2022] POST /compute/v2.1/servers => generated 123 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:55:06.296237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e386365-4696-431a-8b11-519e6636bcf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:06.297124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9e386365-4696-431a-8b11-519e6636bcf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:06.303188 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-82d72790-53fa-4468-b590-a1573e5c849f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 0.564031 Oct 27 18:55:06.306964 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1189/2373] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:05 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:06.313870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e386365-4696-431a-8b11-519e6636bcf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:06.314623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e386365-4696-431a-8b11-519e6636bcf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:06.315252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e386365-4696-431a-8b11-519e6636bcf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:06.317459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e386365-4696-431a-8b11-519e6636bcf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:06.318088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e386365-4696-431a-8b11-519e6636bcf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:06.320273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dd289d80-1548-48b4-8c43-660123c7d810 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:06.320933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e386365-4696-431a-8b11-519e6636bcf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:06.322179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dd289d80-1548-48b4-8c43-660123c7d810 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:06.336089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd289d80-1548-48b4-8c43-660123c7d810 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:06.337243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd289d80-1548-48b4-8c43-660123c7d810 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:06.337862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd289d80-1548-48b4-8c43-660123c7d810 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:06.339541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd289d80-1548-48b4-8c43-660123c7d810 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:06.340303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd289d80-1548-48b4-8c43-660123c7d810 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:06.341391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd289d80-1548-48b4-8c43-660123c7d810 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:06.490145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9e386365-4696-431a-8b11-519e6636bcf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:06.500118 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9e386365-4696-431a-8b11-519e6636bcf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1269 microversion: 2.1 time: 0.211768 Oct 27 18:55:06.514616 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1185/2374] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:06 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:07.024795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dd289d80-1548-48b4-8c43-660123c7d810 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:07.046774 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dd289d80-1548-48b4-8c43-660123c7d810 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.731367 Oct 27 18:55:07.049433 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1190/2375] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:06 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:07.074299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf0f8554-1862-47d2-aa6a-db995055390b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:07.075285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf0f8554-1862-47d2-aa6a-db995055390b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:07.089219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf0f8554-1862-47d2-aa6a-db995055390b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:07.091521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf0f8554-1862-47d2-aa6a-db995055390b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:07.092155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf0f8554-1862-47d2-aa6a-db995055390b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:07.093148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf0f8554-1862-47d2-aa6a-db995055390b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:07.093769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf0f8554-1862-47d2-aa6a-db995055390b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:07.094350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf0f8554-1862-47d2-aa6a-db995055390b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:07.259006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-95326699-b427-4cd2-bbd7-329ab29d5fee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:07.260337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-95326699-b427-4cd2-bbd7-329ab29d5fee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:07.272776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95326699-b427-4cd2-bbd7-329ab29d5fee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:07.274536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95326699-b427-4cd2-bbd7-329ab29d5fee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:07.289801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95326699-b427-4cd2-bbd7-329ab29d5fee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:07.293476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95326699-b427-4cd2-bbd7-329ab29d5fee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:07.295764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95326699-b427-4cd2-bbd7-329ab29d5fee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:07.296986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95326699-b427-4cd2-bbd7-329ab29d5fee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:07.600838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf0f8554-1862-47d2-aa6a-db995055390b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:07.613720 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf0f8554-1862-47d2-aa6a-db995055390b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.544655 Oct 27 18:55:07.614329 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1186/2376] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:07 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:07.630279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-10bcd93f-065c-4b09-b99a-faf4b1db6f0f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:07.630955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-10bcd93f-065c-4b09-b99a-faf4b1db6f0f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:07.649917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10bcd93f-065c-4b09-b99a-faf4b1db6f0f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:07.650439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10bcd93f-065c-4b09-b99a-faf4b1db6f0f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:07.650887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10bcd93f-065c-4b09-b99a-faf4b1db6f0f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:07.651606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10bcd93f-065c-4b09-b99a-faf4b1db6f0f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:07.652066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10bcd93f-065c-4b09-b99a-faf4b1db6f0f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:07.652496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10bcd93f-065c-4b09-b99a-faf4b1db6f0f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:07.997617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-95326699-b427-4cd2-bbd7-329ab29d5fee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:08.023016 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-95326699-b427-4cd2-bbd7-329ab29d5fee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1488 microversion: 2.1 time: 0.781156 Oct 27 18:55:08.026358 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1191/2377] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:07 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1488 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:08.032045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0e030591-f400-472b-b324-16fa87828ec6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:08.032880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0e030591-f400-472b-b324-16fa87828ec6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:08.041614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e030591-f400-472b-b324-16fa87828ec6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:08.042662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e030591-f400-472b-b324-16fa87828ec6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:08.043313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e030591-f400-472b-b324-16fa87828ec6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:08.044667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e030591-f400-472b-b324-16fa87828ec6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:08.046112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e030591-f400-472b-b324-16fa87828ec6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:08.047171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e030591-f400-472b-b324-16fa87828ec6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:08.054639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:08.230122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-10bcd93f-065c-4b09-b99a-faf4b1db6f0f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:08.241882 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-10bcd93f-065c-4b09-b99a-faf4b1db6f0f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 0.626342 Oct 27 18:55:08.244587 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1187/2378] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:07 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:08.261661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6ea7fe47-e591-4f20-831b-0ffe77215f33 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-257728792", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "key_name": "tempest-key-1386442351", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:08.332838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0e030591-f400-472b-b324-16fa87828ec6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:08.346413 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0e030591-f400-472b-b324-16fa87828ec6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1311 microversion: 2.1 time: 0.318980 Oct 27 18:55:08.347928 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1192/2379] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:08 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1311 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:08.363306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dca411b1-4603-4348-bb25-27a1c9ea27c0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:08.363306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dca411b1-4603-4348-bb25-27a1c9ea27c0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:08.385864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dca411b1-4603-4348-bb25-27a1c9ea27c0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:08.388996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-6ea7fe47-e591-4f20-831b-0ffe77215f33 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] validate_networks() for [('969dfa55-7bd6-4101-b2b3-c0ca6c6378eb', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:55:08.389155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dca411b1-4603-4348-bb25-27a1c9ea27c0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:08.389850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dca411b1-4603-4348-bb25-27a1c9ea27c0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:08.391181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dca411b1-4603-4348-bb25-27a1c9ea27c0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:08.391923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dca411b1-4603-4348-bb25-27a1c9ea27c0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:08.393432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dca411b1-4603-4348-bb25-27a1c9ea27c0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:08.517430 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dca411b1-4603-4348-bb25-27a1c9ea27c0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "POST /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc/action" status: 202 len: 0 microversion: 2.1 time: 0.163644 Oct 27 18:55:08.519406 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1193/2380] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:08 2022] POST /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:55:08.529745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84f3db6f-a282-4d2a-aa40-20fd348f5cfd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:08.531860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-84f3db6f-a282-4d2a-aa40-20fd348f5cfd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:08.552552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84f3db6f-a282-4d2a-aa40-20fd348f5cfd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:08.553064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84f3db6f-a282-4d2a-aa40-20fd348f5cfd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:08.553518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84f3db6f-a282-4d2a-aa40-20fd348f5cfd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:08.554340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84f3db6f-a282-4d2a-aa40-20fd348f5cfd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:08.555350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84f3db6f-a282-4d2a-aa40-20fd348f5cfd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:08.555350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84f3db6f-a282-4d2a-aa40-20fd348f5cfd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:09.123952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-84f3db6f-a282-4d2a-aa40-20fd348f5cfd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:09.133267 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-84f3db6f-a282-4d2a-aa40-20fd348f5cfd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1493 microversion: 2.1 time: 0.607763 Oct 27 18:55:09.150854 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1194/2381] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:08 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1493 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:09.189174 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-6ea7fe47-e591-4f20-831b-0ffe77215f33 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Invalid key_name provided. Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6ea7fe47-e591-4f20-831b-0ffe77215f33 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 246 Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-257728792", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "key_name": "tempest-key-1386442351", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid key_name provided. Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-257728792', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'key_name': 'tempest-key-1386442351', 'networks': [{'uuid': '969dfa55-7bd6-4101-b2b3-c0ca6c6378eb'}]}}} Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1386442351 not found for user 834fdde034434a19aec0129ef2d744df Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:09.191266 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6ea7fe47-e591-4f20-831b-0ffe77215f33 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Invalid key_name provided. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6ea7fe47-e591-4f20-831b-0ffe77215f33 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.945715 Oct 27 18:55:09.195063 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1188/2382] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:55:08 2022] POST /compute/v2.1/servers => generated 70 bytes in 947 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:55:09.204695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8c8439ff-84e1-4a33-b07b-340d67b771b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:09.205329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8c8439ff-84e1-4a33-b07b-340d67b771b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:09.216353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c8439ff-84e1-4a33-b07b-340d67b771b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:09.217312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c8439ff-84e1-4a33-b07b-340d67b771b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:09.217800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c8439ff-84e1-4a33-b07b-340d67b771b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:09.223497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c8439ff-84e1-4a33-b07b-340d67b771b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:09.224139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c8439ff-84e1-4a33-b07b-340d67b771b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:09.224603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c8439ff-84e1-4a33-b07b-340d67b771b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:09.271645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3da63c77-f705-4eec-a128-b48a184c8d46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:09.272425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3da63c77-f705-4eec-a128-b48a184c8d46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:09.287722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3da63c77-f705-4eec-a128-b48a184c8d46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:09.288493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3da63c77-f705-4eec-a128-b48a184c8d46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:09.290922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3da63c77-f705-4eec-a128-b48a184c8d46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:09.292267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3da63c77-f705-4eec-a128-b48a184c8d46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:09.296614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3da63c77-f705-4eec-a128-b48a184c8d46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:09.297257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3da63c77-f705-4eec-a128-b48a184c8d46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:09.880795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8c8439ff-84e1-4a33-b07b-340d67b771b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:09.889463 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8c8439ff-84e1-4a33-b07b-340d67b771b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.688852 Oct 27 18:55:09.895150 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1195/2383] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:09 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:09.904999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a6753911-d4a8-4367-bb3f-4200e183a40a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:09.909856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a6753911-d4a8-4367-bb3f-4200e183a40a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:09.928769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6753911-d4a8-4367-bb3f-4200e183a40a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:09.930410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6753911-d4a8-4367-bb3f-4200e183a40a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:09.933499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6753911-d4a8-4367-bb3f-4200e183a40a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:09.935537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6753911-d4a8-4367-bb3f-4200e183a40a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:09.937264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6753911-d4a8-4367-bb3f-4200e183a40a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:09.939026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6753911-d4a8-4367-bb3f-4200e183a40a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:10.321429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a6753911-d4a8-4367-bb3f-4200e183a40a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:10.337307 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a6753911-d4a8-4367-bb3f-4200e183a40a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1311 microversion: 2.1 time: 0.440680 Oct 27 18:55:10.342516 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1196/2384] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:09 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1311 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:10.351712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e010a4e2-ef95-4a99-b4ef-60c81d3523ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:10.352943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e010a4e2-ef95-4a99-b4ef-60c81d3523ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:10.372570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e010a4e2-ef95-4a99-b4ef-60c81d3523ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:10.373079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e010a4e2-ef95-4a99-b4ef-60c81d3523ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:10.373526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e010a4e2-ef95-4a99-b4ef-60c81d3523ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:10.374255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e010a4e2-ef95-4a99-b4ef-60c81d3523ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:10.374777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e010a4e2-ef95-4a99-b4ef-60c81d3523ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:10.375205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e010a4e2-ef95-4a99-b4ef-60c81d3523ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:10.735528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3da63c77-f705-4eec-a128-b48a184c8d46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:10.746140 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3da63c77-f705-4eec-a128-b48a184c8d46 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 1.480100 Oct 27 18:55:10.746777 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1189/2385] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:09 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:10.748812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e010a4e2-ef95-4a99-b4ef-60c81d3523ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:10.760489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8304cf28-e37e-4f8e-aec0-54b6eb08bb14 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:10.761220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8304cf28-e37e-4f8e-aec0-54b6eb08bb14 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:10.766128 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e010a4e2-ef95-4a99-b4ef-60c81d3523ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.422391 Oct 27 18:55:10.767041 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1197/2386] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:10 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:10.775284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8304cf28-e37e-4f8e-aec0-54b6eb08bb14 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:10.776146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8304cf28-e37e-4f8e-aec0-54b6eb08bb14 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:10.776777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8304cf28-e37e-4f8e-aec0-54b6eb08bb14 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:10.778687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8304cf28-e37e-4f8e-aec0-54b6eb08bb14 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:10.779490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8304cf28-e37e-4f8e-aec0-54b6eb08bb14 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:10.780105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8304cf28-e37e-4f8e-aec0-54b6eb08bb14 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:10.998875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-62187f5b-cf14-4558-9613-e12c6a8370e5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-370793405", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:11.360168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.security_group_api [None req-62187f5b-cf14-4558-9613-e12c6a8370e5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Neutron security group does_not_exist not found {{(pid=127029) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 27 18:55:11.361169 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-62187f5b-cf14-4558-9613-e12c6a8370e5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-62187f5b-cf14-4558-9613-e12c6a8370e5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 257 Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-370793405", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-370793405', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '969dfa55-7bd6-4101-b2b3-c0ca6c6378eb'}]}}} Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 27 18:55:11.376760 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:11.380576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-62187f5b-cf14-4558-9613-e12c6a8370e5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:11.387428 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-62187f5b-cf14-4558-9613-e12c6a8370e5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.391108 Oct 27 18:55:11.387428 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1198/2387] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:55:10 2022] POST /compute/v2.1/servers => generated 106 bytes in 397 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:55:11.388853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-50a67599-63d2-4ed7-a8fe-7eb345644ad6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:11.389749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-50a67599-63d2-4ed7-a8fe-7eb345644ad6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:11.410108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a67599-63d2-4ed7-a8fe-7eb345644ad6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:11.411082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a67599-63d2-4ed7-a8fe-7eb345644ad6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:11.412161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a67599-63d2-4ed7-a8fe-7eb345644ad6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:11.414467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a67599-63d2-4ed7-a8fe-7eb345644ad6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:11.415906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a67599-63d2-4ed7-a8fe-7eb345644ad6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:11.417083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a67599-63d2-4ed7-a8fe-7eb345644ad6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:11.442589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8304cf28-e37e-4f8e-aec0-54b6eb08bb14 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:11.454970 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8304cf28-e37e-4f8e-aec0-54b6eb08bb14 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 200 len: 1473 microversion: 2.1 time: 0.698474 Oct 27 18:55:11.455572 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1190/2388] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:10 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 1473 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:11.467434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6136907e-a3a1-4510-a1d3-02b61e790e05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:11.470182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6136907e-a3a1-4510-a1d3-02b61e790e05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:11.487983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6136907e-a3a1-4510-a1d3-02b61e790e05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:11.488977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6136907e-a3a1-4510-a1d3-02b61e790e05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:11.489437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6136907e-a3a1-4510-a1d3-02b61e790e05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:11.490164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6136907e-a3a1-4510-a1d3-02b61e790e05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:11.490907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6136907e-a3a1-4510-a1d3-02b61e790e05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:11.491660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6136907e-a3a1-4510-a1d3-02b61e790e05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:11.522178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:11.708231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-50a67599-63d2-4ed7-a8fe-7eb345644ad6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:11.717191 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-50a67599-63d2-4ed7-a8fe-7eb345644ad6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1311 microversion: 2.1 time: 0.332152 Oct 27 18:55:11.717854 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1199/2389] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:11 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1311 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:11.734816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2264e503-1ff1-4d3c-adb4-345178629b3d tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2121625440"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:11.734816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2264e503-1ff1-4d3c-adb4-345178629b3d tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:11.735583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2264e503-1ff1-4d3c-adb4-345178629b3d tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:11.736079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2264e503-1ff1-4d3c-adb4-345178629b3d tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:11.736524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2264e503-1ff1-4d3c-adb4-345178629b3d tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:11.737233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2264e503-1ff1-4d3c-adb4-345178629b3d tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:11.738239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2264e503-1ff1-4d3c-adb4-345178629b3d tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:11.738693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2264e503-1ff1-4d3c-adb4-345178629b3d tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:11.984047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6136907e-a3a1-4510-a1d3-02b61e790e05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:11.997087 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6136907e-a3a1-4510-a1d3-02b61e790e05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.539705 Oct 27 18:55:11.997853 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1191/2390] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:11 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:12.016835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-57ac82ca-ea03-4a88-b20b-9796dd6e48e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:12.016835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-57ac82ca-ea03-4a88-b20b-9796dd6e48e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:12.030541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57ac82ca-ea03-4a88-b20b-9796dd6e48e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:12.033069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57ac82ca-ea03-4a88-b20b-9796dd6e48e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:12.033700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57ac82ca-ea03-4a88-b20b-9796dd6e48e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:12.035189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57ac82ca-ea03-4a88-b20b-9796dd6e48e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:12.035888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57ac82ca-ea03-4a88-b20b-9796dd6e48e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:12.036528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57ac82ca-ea03-4a88-b20b-9796dd6e48e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:12.076353 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2264e503-1ff1-4d3c-adb4-345178629b3d tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "POST /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc/action" status: 202 len: 0 microversion: 2.1 time: 0.353882 Oct 27 18:55:12.077867 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1200/2391] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:11 2022] POST /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 18:55:12.085616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-193bf3a5-77a1-448d-a208-8fe36e109fae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:12.086906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-193bf3a5-77a1-448d-a208-8fe36e109fae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:12.098579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-193bf3a5-77a1-448d-a208-8fe36e109fae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:12.099524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-193bf3a5-77a1-448d-a208-8fe36e109fae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:12.100223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-193bf3a5-77a1-448d-a208-8fe36e109fae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:12.101274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-193bf3a5-77a1-448d-a208-8fe36e109fae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:12.101922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-193bf3a5-77a1-448d-a208-8fe36e109fae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:12.103568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-193bf3a5-77a1-448d-a208-8fe36e109fae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:12.283760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-193bf3a5-77a1-448d-a208-8fe36e109fae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:12.294576 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-193bf3a5-77a1-448d-a208-8fe36e109fae tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.215129 Oct 27 18:55:12.307902 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1201/2392] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:12 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:12.324371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9f2ba7d1-941a-4d63-acb3-d3d673fa10ec tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86adb3940>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:12.410941 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9f2ba7d1-941a-4d63-acb3-d3d673fa10ec tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.101761 Oct 27 18:55:12.412642 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1202/2393] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:12 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:12.421698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d6e1e95e-e714-463e-a10d-12e105184225 req-10e6c0c9-829e-42a9-b3d3-0a4f4d8628e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "592bd675-3b12-4ab8-8e8f-be99ea57e702", "tag": "1f047cd7-16bb-416c-8bf4-ce6a1d8f9459"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:12.461868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d6e1e95e-e714-463e-a10d-12e105184225 req-10e6c0c9-829e-42a9-b3d3-0a4f4d8628e5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:12.462667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d6e1e95e-e714-463e-a10d-12e105184225 req-10e6c0c9-829e-42a9-b3d3-0a4f4d8628e5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:12.463971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d6e1e95e-e714-463e-a10d-12e105184225 req-10e6c0c9-829e-42a9-b3d3-0a4f4d8628e5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:12.506476 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d6e1e95e-e714-463e-a10d-12e105184225 req-10e6c0c9-829e-42a9-b3d3-0a4f4d8628e5 service nova] Creating event network-changed:1f047cd7-16bb-416c-8bf4-ce6a1d8f9459 for instance 592bd675-3b12-4ab8-8e8f-be99ea57e702 on n-h1-860687-3 Oct 27 18:55:12.514314 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d6e1e95e-e714-463e-a10d-12e105184225 req-10e6c0c9-829e-42a9-b3d3-0a4f4d8628e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100194 Oct 27 18:55:12.515623 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1203/2394] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:12.523241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8bf6b2c5-b0ef-4bc5-9794-154da27c42a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:12.524016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8bf6b2c5-b0ef-4bc5-9794-154da27c42a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 40bda7f5-f283-44eb-a516-f5ca9c5b40db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:12.538852 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-8bf6b2c5-b0ef-4bc5-9794-154da27c42a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 40bda7f5-f283-44eb-a516-f5ca9c5b40db could not be found. Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8bf6b2c5-b0ef-4bc5-9794-154da27c42a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/40bda7f5-f283-44eb-a516-f5ca9c5b40db HTTP/1.1 Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 40bda7f5-f283-44eb-a516-f5ca9c5b40db could not be found. Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '40bda7f5-f283-44eb-a516-f5ca9c5b40db'} Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40bda7f5-f283-44eb-a516-f5ca9c5b40db could not be found. Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40bda7f5-f283-44eb-a516-f5ca9c5b40db could not be found. Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:12.540840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:12.544791 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:12.544791 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:12.544791 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:12.544791 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:12.544791 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:12.544791 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:12.544791 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40bda7f5-f283-44eb-a516-f5ca9c5b40db could not be found. Oct 27 18:55:12.544791 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:12.548433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8bf6b2c5-b0ef-4bc5-9794-154da27c42a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 40bda7f5-f283-44eb-a516-f5ca9c5b40db could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:12.550812 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8bf6b2c5-b0ef-4bc5-9794-154da27c42a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "DELETE /compute/v2.1/servers/40bda7f5-f283-44eb-a516-f5ca9c5b40db" status: 404 len: 111 microversion: 2.1 time: 0.032645 Oct 27 18:55:12.551652 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1204/2395] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:55:12 2022] DELETE /compute/v2.1/servers/40bda7f5-f283-44eb-a516-f5ca9c5b40db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:12.591240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fd82bfe2-51eb-4b35-b3ca-67230fa28c1c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:12.591875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fd82bfe2-51eb-4b35-b3ca-67230fa28c1c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:12.604269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd82bfe2-51eb-4b35-b3ca-67230fa28c1c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:12.605166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd82bfe2-51eb-4b35-b3ca-67230fa28c1c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:12.605794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd82bfe2-51eb-4b35-b3ca-67230fa28c1c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:12.607000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd82bfe2-51eb-4b35-b3ca-67230fa28c1c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:12.609001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd82bfe2-51eb-4b35-b3ca-67230fa28c1c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:12.609606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd82bfe2-51eb-4b35-b3ca-67230fa28c1c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:12.768141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-57ac82ca-ea03-4a88-b20b-9796dd6e48e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:12.779559 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-57ac82ca-ea03-4a88-b20b-9796dd6e48e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1516 microversion: 2.1 time: 0.772321 Oct 27 18:55:12.780491 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1192/2396] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:12 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1516 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:12.785093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7edbefd2-33cc-499f-b241-8bac7958e746 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:12.785712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7edbefd2-33cc-499f-b241-8bac7958e746 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:12.808167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edbefd2-33cc-499f-b241-8bac7958e746 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:12.808695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edbefd2-33cc-499f-b241-8bac7958e746 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:12.809201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edbefd2-33cc-499f-b241-8bac7958e746 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:12.809936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edbefd2-33cc-499f-b241-8bac7958e746 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:12.810965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edbefd2-33cc-499f-b241-8bac7958e746 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:12.811415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edbefd2-33cc-499f-b241-8bac7958e746 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:12.894344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fd82bfe2-51eb-4b35-b3ca-67230fa28c1c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:12.903884 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fd82bfe2-51eb-4b35-b3ca-67230fa28c1c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.343622 Oct 27 18:55:12.928265 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1205/2397] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:12 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:12.934677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2870d92b-d5ff-445b-9806-bb35883332b6 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:12.936003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2870d92b-d5ff-445b-9806-bb35883332b6 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:12.949066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2870d92b-d5ff-445b-9806-bb35883332b6 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:12.949624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2870d92b-d5ff-445b-9806-bb35883332b6 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:12.950417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2870d92b-d5ff-445b-9806-bb35883332b6 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:12.951500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2870d92b-d5ff-445b-9806-bb35883332b6 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:12.952277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2870d92b-d5ff-445b-9806-bb35883332b6 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:12.952922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2870d92b-d5ff-445b-9806-bb35883332b6 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:13.180216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2870d92b-d5ff-445b-9806-bb35883332b6 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:13.190954 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2870d92b-d5ff-445b-9806-bb35883332b6 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.260587 Oct 27 18:55:13.192855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:13.209429 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1206/2398] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:12 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:13.225099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-328cadc6-fba5-4122-81c4-c14a37d57d36 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:13.225595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-328cadc6-fba5-4122-81c4-c14a37d57d36 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Failed to fetch instance by id 9223372036854775808 {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 18:55:13.226119 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-328cadc6-fba5-4122-81c4-c14a37d57d36 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-328cadc6-fba5-4122-81c4-c14a37d57d36 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 9223372036854775808 could not be found. Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '9223372036854775808'} Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:13.233938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:13.237689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:13.237689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:13.237689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:13.237689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 27 18:55:13.237689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:13.237689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-328cadc6-fba5-4122-81c4-c14a37d57d36 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:13.237689 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-328cadc6-fba5-4122-81c4-c14a37d57d36 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.014594 Oct 27 18:55:13.239006 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1207/2399] 10.222.0.42 () {58 vars in 1188 bytes} [Thu Oct 27 18:55:13 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:55:13.244008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ad9c46a7-a664-4bc7-9628-c0500fb50969 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:13.244553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ad9c46a7-a664-4bc7-9628-c0500fb50969 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:13.261091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad9c46a7-a664-4bc7-9628-c0500fb50969 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:13.261280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad9c46a7-a664-4bc7-9628-c0500fb50969 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:13.261631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad9c46a7-a664-4bc7-9628-c0500fb50969 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:13.262360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad9c46a7-a664-4bc7-9628-c0500fb50969 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:13.262864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad9c46a7-a664-4bc7-9628-c0500fb50969 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:13.263304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad9c46a7-a664-4bc7-9628-c0500fb50969 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:13.557759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ad9c46a7-a664-4bc7-9628-c0500fb50969 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:13.570155 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ad9c46a7-a664-4bc7-9628-c0500fb50969 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.330058 Oct 27 18:55:13.576537 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1208/2400] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:13 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:13.589592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a4cd03ed-754e-41ee-804e-d19704516f87 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc8733465e0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:13.666921 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a4cd03ed-754e-41ee-804e-d19704516f87 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.088517 Oct 27 18:55:13.668021 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1209/2401] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:13 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:13.680991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ec4a6604-c26f-47b1-92df-16930f8baab0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:13.681928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ec4a6604-c26f-47b1-92df-16930f8baab0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:13.696313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec4a6604-c26f-47b1-92df-16930f8baab0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:13.697047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec4a6604-c26f-47b1-92df-16930f8baab0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:13.699476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec4a6604-c26f-47b1-92df-16930f8baab0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:13.700797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec4a6604-c26f-47b1-92df-16930f8baab0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:13.704917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec4a6604-c26f-47b1-92df-16930f8baab0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:13.705611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec4a6604-c26f-47b1-92df-16930f8baab0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:13.744665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=36 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:13.918070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ec4a6604-c26f-47b1-92df-16930f8baab0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:13.928082 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ec4a6604-c26f-47b1-92df-16930f8baab0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.258771 Oct 27 18:55:13.928675 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1210/2402] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:13 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:13.933655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-792b2a9d-3abd-4a81-ba09-6f66a3684615 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:13.934477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-792b2a9d-3abd-4a81-ba09-6f66a3684615 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:13.942431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-792b2a9d-3abd-4a81-ba09-6f66a3684615 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:13.943595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-792b2a9d-3abd-4a81-ba09-6f66a3684615 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:13.944261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-792b2a9d-3abd-4a81-ba09-6f66a3684615 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:13.974970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-792b2a9d-3abd-4a81-ba09-6f66a3684615 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:13.974970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-792b2a9d-3abd-4a81-ba09-6f66a3684615 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:13.974970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-792b2a9d-3abd-4a81-ba09-6f66a3684615 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:14.069433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7edbefd2-33cc-499f-b241-8bac7958e746 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:14.081584 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7edbefd2-33cc-499f-b241-8bac7958e746 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1311 microversion: 2.1 time: 1.299871 Oct 27 18:55:14.082504 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1193/2403] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:12 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1311 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:14.087836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03c3f52a-6cb3-487b-835d-474601234080 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:14.088574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-03c3f52a-6cb3-487b-835d-474601234080 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Failed to fetch instance by id -1 {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 18:55:14.089254 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-03c3f52a-6cb3-487b-835d-474601234080 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance -1 could not be found. Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03c3f52a-6cb3-487b-835d-474601234080 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance -1 could not be found. Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '-1'} Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:14.093417 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:14.098044 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:14.098044 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:14.098044 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 27 18:55:14.098044 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:14.099228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03c3f52a-6cb3-487b-835d-474601234080 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance -1 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:14.100266 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-03c3f52a-6cb3-487b-835d-474601234080 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.016645 Oct 27 18:55:14.101301 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1194/2404] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 18:55:14 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:55:14.117205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-230a36d8-0548-4dba-9eee-fa4e48d43239 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:14.121509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-230a36d8-0548-4dba-9eee-fa4e48d43239 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:14.134412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230a36d8-0548-4dba-9eee-fa4e48d43239 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:14.135527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230a36d8-0548-4dba-9eee-fa4e48d43239 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:14.136381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230a36d8-0548-4dba-9eee-fa4e48d43239 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:14.137289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230a36d8-0548-4dba-9eee-fa4e48d43239 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:14.137946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230a36d8-0548-4dba-9eee-fa4e48d43239 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:14.138586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230a36d8-0548-4dba-9eee-fa4e48d43239 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:14.419779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-792b2a9d-3abd-4a81-ba09-6f66a3684615 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:14.432804 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-792b2a9d-3abd-4a81-ba09-6f66a3684615 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1534 microversion: 2.1 time: 0.502839 Oct 27 18:55:14.433814 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1211/2405] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:13 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1534 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:14.688568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42b639b0-58c8-4ee2-b829-a0c2dced68ef tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b435700>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:14.757245 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-42b639b0-58c8-4ee2-b829-a0c2dced68ef tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.073207 Oct 27 18:55:14.765294 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1212/2406] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:14 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:14.964424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-230a36d8-0548-4dba-9eee-fa4e48d43239 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:14.978967 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-230a36d8-0548-4dba-9eee-fa4e48d43239 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.872095 Oct 27 18:55:14.979574 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1195/2407] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:14 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:15.006074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-55d1025d-cd5e-441a-b4fd-9bb2707dea41 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:15.006739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-55d1025d-cd5e-441a-b4fd-9bb2707dea41 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:15.017211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55d1025d-cd5e-441a-b4fd-9bb2707dea41 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:15.017730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55d1025d-cd5e-441a-b4fd-9bb2707dea41 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:15.018184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55d1025d-cd5e-441a-b4fd-9bb2707dea41 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:15.023839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55d1025d-cd5e-441a-b4fd-9bb2707dea41 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:15.024557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55d1025d-cd5e-441a-b4fd-9bb2707dea41 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:15.025168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55d1025d-cd5e-441a-b4fd-9bb2707dea41 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:15.031065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:15.115096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fccd534d-c01f-43a6-87a8-445fe1ec7394 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:15.116287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fccd534d-c01f-43a6-87a8-445fe1ec7394 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:15.129879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:15.134069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fccd534d-c01f-43a6-87a8-445fe1ec7394 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:15.136936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fccd534d-c01f-43a6-87a8-445fe1ec7394 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:15.137724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fccd534d-c01f-43a6-87a8-445fe1ec7394 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:15.138841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fccd534d-c01f-43a6-87a8-445fe1ec7394 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:15.139728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fccd534d-c01f-43a6-87a8-445fe1ec7394 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:15.140621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fccd534d-c01f-43a6-87a8-445fe1ec7394 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:15.387658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-55d1025d-cd5e-441a-b4fd-9bb2707dea41 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:15.402850 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-55d1025d-cd5e-441a-b4fd-9bb2707dea41 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.398415 Oct 27 18:55:15.405710 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1213/2408] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:15 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:15.432578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4b6f3e72-1284-4b25-a811-338833b9bfad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:15.458352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4b6f3e72-1284-4b25-a811-338833b9bfad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 0a941aec-ce4f-46af-8a16-95dcbd937e66] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:15.488963 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-4b6f3e72-1284-4b25-a811-338833b9bfad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 0a941aec-ce4f-46af-8a16-95dcbd937e66 could not be found. Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4b6f3e72-1284-4b25-a811-338833b9bfad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/0a941aec-ce4f-46af-8a16-95dcbd937e66/action HTTP/1.1 Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 19 Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: {"forceDelete": {}} Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 0a941aec-ce4f-46af-8a16-95dcbd937e66 could not be found. Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '0a941aec-ce4f-46af-8a16-95dcbd937e66', 'body': {'forceDelete': {}}} Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a941aec-ce4f-46af-8a16-95dcbd937e66 could not be found. Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a941aec-ce4f-46af-8a16-95dcbd937e66 could not be found. Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:15.499843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:15.508367 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:15.508367 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:15.508367 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a941aec-ce4f-46af-8a16-95dcbd937e66 could not be found. Oct 27 18:55:15.508367 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:15.508367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4b6f3e72-1284-4b25-a811-338833b9bfad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 0a941aec-ce4f-46af-8a16-95dcbd937e66 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:15.508367 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4b6f3e72-1284-4b25-a811-338833b9bfad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/0a941aec-ce4f-46af-8a16-95dcbd937e66/action" status: 404 len: 111 microversion: 2.1 time: 0.078784 Oct 27 18:55:15.508367 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1214/2409] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:15 2022] POST /compute/v2.1/servers/0a941aec-ce4f-46af-8a16-95dcbd937e66/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:55:15.516584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5bd0f94d-ad8e-4898-b080-a8ea7cc62648 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:15.517546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5bd0f94d-ad8e-4898-b080-a8ea7cc62648 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:15.532665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bd0f94d-ad8e-4898-b080-a8ea7cc62648 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:15.533528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bd0f94d-ad8e-4898-b080-a8ea7cc62648 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:15.534694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bd0f94d-ad8e-4898-b080-a8ea7cc62648 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:15.535961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bd0f94d-ad8e-4898-b080-a8ea7cc62648 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:15.537450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bd0f94d-ad8e-4898-b080-a8ea7cc62648 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:15.539481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bd0f94d-ad8e-4898-b080-a8ea7cc62648 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:15.636925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fccd534d-c01f-43a6-87a8-445fe1ec7394 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:15.650779 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fccd534d-c01f-43a6-87a8-445fe1ec7394 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1311 microversion: 2.1 time: 0.541138 Oct 27 18:55:15.652034 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1196/2410] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:15 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1311 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:55:15.660091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a339ab82-e48f-4adb-b61f-c22f2297d04f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:15.661988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a339ab82-e48f-4adb-b61f-c22f2297d04f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:15.674615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a339ab82-e48f-4adb-b61f-c22f2297d04f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:15.675525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a339ab82-e48f-4adb-b61f-c22f2297d04f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:15.676635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a339ab82-e48f-4adb-b61f-c22f2297d04f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:15.678152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a339ab82-e48f-4adb-b61f-c22f2297d04f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:15.679359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a339ab82-e48f-4adb-b61f-c22f2297d04f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:15.680027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a339ab82-e48f-4adb-b61f-c22f2297d04f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:16.099758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a339ab82-e48f-4adb-b61f-c22f2297d04f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:16.100406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5bd0f94d-ad8e-4898-b080-a8ea7cc62648 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:16.117200 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5bd0f94d-ad8e-4898-b080-a8ea7cc62648 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1522 microversion: 2.1 time: 0.613220 Oct 27 18:55:16.118052 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1215/2411] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:15 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1522 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:16.122740 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a339ab82-e48f-4adb-b61f-c22f2297d04f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.462841 Oct 27 18:55:16.125756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dcad6820-a078-4295-9c17-9a046ac22b6a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc873365a60>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:16.127778 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1197/2412] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:15 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:16.152484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7ac48bd0-32a2-4f80-9fc5-b1e1bca4e91b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:16.153415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7ac48bd0-32a2-4f80-9fc5-b1e1bca4e91b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:16.160841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ac48bd0-32a2-4f80-9fc5-b1e1bca4e91b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:16.161700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ac48bd0-32a2-4f80-9fc5-b1e1bca4e91b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:16.162421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ac48bd0-32a2-4f80-9fc5-b1e1bca4e91b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:16.163499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ac48bd0-32a2-4f80-9fc5-b1e1bca4e91b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:16.164212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ac48bd0-32a2-4f80-9fc5-b1e1bca4e91b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:16.164868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ac48bd0-32a2-4f80-9fc5-b1e1bca4e91b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:16.203573 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dcad6820-a078-4295-9c17-9a046ac22b6a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.084224 Oct 27 18:55:16.212402 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1216/2413] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:16 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:16.479318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7ac48bd0-32a2-4f80-9fc5-b1e1bca4e91b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:16.490755 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7ac48bd0-32a2-4f80-9fc5-b1e1bca4e91b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.342399 Oct 27 18:55:16.491353 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1198/2414] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:16 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:16.518117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-24fd5719-2075-403b-8d68-ce5209b7adc0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:16.521266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-24fd5719-2075-403b-8d68-ce5209b7adc0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 30c45cea-9b98-48d9-ba99-82a03407a236] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:16.541102 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-24fd5719-2075-403b-8d68-ce5209b7adc0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 30c45cea-9b98-48d9-ba99-82a03407a236 could not be found. Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-24fd5719-2075-403b-8d68-ce5209b7adc0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/30c45cea-9b98-48d9-ba99-82a03407a236/action HTTP/1.1 Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 39 Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: {"os-getConsoleOutput": {"length": 10}} Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 30c45cea-9b98-48d9-ba99-82a03407a236 could not be found. Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '30c45cea-9b98-48d9-ba99-82a03407a236', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c45cea-9b98-48d9-ba99-82a03407a236 could not be found. Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c45cea-9b98-48d9-ba99-82a03407a236 could not be found. Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:16.551433 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:16.555223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:16.555223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:16.555223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:16.555223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:16.555223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c45cea-9b98-48d9-ba99-82a03407a236 could not be found. Oct 27 18:55:16.555223 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:16.557715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-24fd5719-2075-403b-8d68-ce5209b7adc0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 30c45cea-9b98-48d9-ba99-82a03407a236 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:16.558832 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-24fd5719-2075-403b-8d68-ce5209b7adc0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/30c45cea-9b98-48d9-ba99-82a03407a236/action" status: 404 len: 111 microversion: 2.1 time: 0.046218 Oct 27 18:55:16.559940 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1217/2415] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:16 2022] POST /compute/v2.1/servers/30c45cea-9b98-48d9-ba99-82a03407a236/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:16.568596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-076ce743-42af-4e00-b909-32fd2007b525 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:16.569613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-076ce743-42af-4e00-b909-32fd2007b525 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:16.576908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-076ce743-42af-4e00-b909-32fd2007b525 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:16.577877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-076ce743-42af-4e00-b909-32fd2007b525 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:16.578718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-076ce743-42af-4e00-b909-32fd2007b525 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:16.579757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-076ce743-42af-4e00-b909-32fd2007b525 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:16.580508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-076ce743-42af-4e00-b909-32fd2007b525 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:16.581224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-076ce743-42af-4e00-b909-32fd2007b525 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:16.676979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d5983cd-4291-4c0e-8df4-2a8f273f9c5f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:16.677694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0d5983cd-4291-4c0e-8df4-2a8f273f9c5f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:16.685957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d5983cd-4291-4c0e-8df4-2a8f273f9c5f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:16.692601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d5983cd-4291-4c0e-8df4-2a8f273f9c5f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:16.693152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d5983cd-4291-4c0e-8df4-2a8f273f9c5f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:16.694005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d5983cd-4291-4c0e-8df4-2a8f273f9c5f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:16.694584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d5983cd-4291-4c0e-8df4-2a8f273f9c5f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:16.695193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d5983cd-4291-4c0e-8df4-2a8f273f9c5f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:17.032733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-076ce743-42af-4e00-b909-32fd2007b525 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:17.047023 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-076ce743-42af-4e00-b909-32fd2007b525 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.482927 Oct 27 18:55:17.048634 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1199/2416] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:16 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:17.093207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-837f611e-9147-427d-8b37-db3ce3b80d11 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:17.095702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-837f611e-9147-427d-8b37-db3ce3b80d11 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:17.110122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-837f611e-9147-427d-8b37-db3ce3b80d11 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:17.111663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-837f611e-9147-427d-8b37-db3ce3b80d11 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:17.112443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-837f611e-9147-427d-8b37-db3ce3b80d11 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:17.113559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-837f611e-9147-427d-8b37-db3ce3b80d11 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:17.114683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-837f611e-9147-427d-8b37-db3ce3b80d11 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:17.115640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-837f611e-9147-427d-8b37-db3ce3b80d11 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:17.144089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0d5983cd-4291-4c0e-8df4-2a8f273f9c5f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:17.155570 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0d5983cd-4291-4c0e-8df4-2a8f273f9c5f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1311 microversion: 2.1 time: 0.483126 Oct 27 18:55:17.179175 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1218/2417] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:16 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1311 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:55:17.197365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-47516cc8-b304-448d-805e-18f86a0bd1b1 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:17.198185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-47516cc8-b304-448d-805e-18f86a0bd1b1 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:17.205087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47516cc8-b304-448d-805e-18f86a0bd1b1 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:17.205579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47516cc8-b304-448d-805e-18f86a0bd1b1 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:17.206598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47516cc8-b304-448d-805e-18f86a0bd1b1 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:17.207455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47516cc8-b304-448d-805e-18f86a0bd1b1 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:17.207918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47516cc8-b304-448d-805e-18f86a0bd1b1 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:17.208345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47516cc8-b304-448d-805e-18f86a0bd1b1 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:17.413072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-47516cc8-b304-448d-805e-18f86a0bd1b1 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:17.423603 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-47516cc8-b304-448d-805e-18f86a0bd1b1 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1522 microversion: 2.1 time: 0.243071 Oct 27 18:55:17.425380 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1219/2418] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:17 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:17.454826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7293b837-40ca-4d79-80a9-6cbb82387337 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86aa8d3a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:17.571872 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7293b837-40ca-4d79-80a9-6cbb82387337 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.145150 Oct 27 18:55:17.572719 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1220/2419] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:17 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:17.644970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-837f611e-9147-427d-8b37-db3ce3b80d11 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:17.657565 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-837f611e-9147-427d-8b37-db3ce3b80d11 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.581705 Oct 27 18:55:17.663337 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1200/2420] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:17 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:17.685475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c851c4ca-4d2f-4053-a839-625949779172 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:17.686092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c851c4ca-4d2f-4053-a839-625949779172 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 1a7bb0ac-f8a2-48b5-ada6-ca9d8db794a9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:17.693650 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-c851c4ca-4d2f-4053-a839-625949779172 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 1a7bb0ac-f8a2-48b5-ada6-ca9d8db794a9 could not be found. Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c851c4ca-4d2f-4053-a839-625949779172 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/1a7bb0ac-f8a2-48b5-ada6-ca9d8db794a9 HTTP/1.1 Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 1a7bb0ac-f8a2-48b5-ada6-ca9d8db794a9 could not be found. Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '1a7bb0ac-f8a2-48b5-ada6-ca9d8db794a9'} Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a7bb0ac-f8a2-48b5-ada6-ca9d8db794a9 could not be found. Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a7bb0ac-f8a2-48b5-ada6-ca9d8db794a9 could not be found. Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:17.695227 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:17.700491 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:17.700491 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:17.700491 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:17.700491 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a7bb0ac-f8a2-48b5-ada6-ca9d8db794a9 could not be found. Oct 27 18:55:17.700491 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:17.700491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c851c4ca-4d2f-4053-a839-625949779172 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 1a7bb0ac-f8a2-48b5-ada6-ca9d8db794a9 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:17.700491 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c851c4ca-4d2f-4053-a839-625949779172 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7bb0ac-f8a2-48b5-ada6-ca9d8db794a9" status: 404 len: 111 microversion: 2.1 time: 0.015945 Oct 27 18:55:17.705775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c6b12bda-fed3-4155-ae9f-2c25c9d1d379 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:17.706742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c6b12bda-fed3-4155-ae9f-2c25c9d1d379 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:17.717136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6b12bda-fed3-4155-ae9f-2c25c9d1d379 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:17.717625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6b12bda-fed3-4155-ae9f-2c25c9d1d379 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:17.718283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6b12bda-fed3-4155-ae9f-2c25c9d1d379 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:17.720652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6b12bda-fed3-4155-ae9f-2c25c9d1d379 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:17.721215 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1221/2421] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:17 2022] GET /compute/v2.1/servers/1a7bb0ac-f8a2-48b5-ada6-ca9d8db794a9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:17.722417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6b12bda-fed3-4155-ae9f-2c25c9d1d379 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:17.727524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6b12bda-fed3-4155-ae9f-2c25c9d1d379 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:18.149099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c6b12bda-fed3-4155-ae9f-2c25c9d1d379 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:18.166744 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c6b12bda-fed3-4155-ae9f-2c25c9d1d379 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.464595 Oct 27 18:55:18.167822 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1201/2422] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:17 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:55:18.205574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ed92674a-191d-42ee-8283-9704a572f50a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:18.206770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6e8cf5a5-711d-4b1a-a711-222986c562dc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:18.208025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ed92674a-191d-42ee-8283-9704a572f50a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:18.211617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6e8cf5a5-711d-4b1a-a711-222986c562dc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:18.223413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed92674a-191d-42ee-8283-9704a572f50a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:18.226613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e8cf5a5-711d-4b1a-a711-222986c562dc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:18.227433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed92674a-191d-42ee-8283-9704a572f50a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:18.227769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed92674a-191d-42ee-8283-9704a572f50a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:18.228424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e8cf5a5-711d-4b1a-a711-222986c562dc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:18.229903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e8cf5a5-711d-4b1a-a711-222986c562dc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:18.230502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed92674a-191d-42ee-8283-9704a572f50a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:18.231776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed92674a-191d-42ee-8283-9704a572f50a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:18.232965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e8cf5a5-711d-4b1a-a711-222986c562dc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:18.233495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed92674a-191d-42ee-8283-9704a572f50a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:18.235316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e8cf5a5-711d-4b1a-a711-222986c562dc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:18.236125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e8cf5a5-711d-4b1a-a711-222986c562dc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:18.470584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ed92674a-191d-42ee-8283-9704a572f50a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:18.481991 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ed92674a-191d-42ee-8283-9704a572f50a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.289559 Oct 27 18:55:18.485465 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1222/2423] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:18 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:18.493853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d5401c06-bbb9-4ae7-bab5-b061d2a2a81e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:18.499064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d5401c06-bbb9-4ae7-bab5-b061d2a2a81e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:18.516490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5401c06-bbb9-4ae7-bab5-b061d2a2a81e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:18.517467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5401c06-bbb9-4ae7-bab5-b061d2a2a81e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:18.517950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5401c06-bbb9-4ae7-bab5-b061d2a2a81e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:18.518933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5401c06-bbb9-4ae7-bab5-b061d2a2a81e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:18.519589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5401c06-bbb9-4ae7-bab5-b061d2a2a81e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:18.520213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5401c06-bbb9-4ae7-bab5-b061d2a2a81e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:18.834211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d5401c06-bbb9-4ae7-bab5-b061d2a2a81e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:18.847301 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d5401c06-bbb9-4ae7-bab5-b061d2a2a81e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1522 microversion: 2.1 time: 0.360086 Oct 27 18:55:18.864372 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1223/2424] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:18 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:18.871029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d01cff63-547d-4b0b-ae71-2508329d2a0b req-24d3070c-281f-42ce-8df0-da66e03a31a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b6f25f-ce24-45c5-b633-6a36808a0540", "name": "network-vif-unplugged", "status": "completed", "tag": "1e5c551d-9e29-4371-a23d-08f3b6b96e56"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:18.884913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d01cff63-547d-4b0b-ae71-2508329d2a0b req-24d3070c-281f-42ce-8df0-da66e03a31a9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:18.886030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d01cff63-547d-4b0b-ae71-2508329d2a0b req-24d3070c-281f-42ce-8df0-da66e03a31a9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:18.887229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d01cff63-547d-4b0b-ae71-2508329d2a0b req-24d3070c-281f-42ce-8df0-da66e03a31a9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:18.911115 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d01cff63-547d-4b0b-ae71-2508329d2a0b req-24d3070c-281f-42ce-8df0-da66e03a31a9 service nova] Creating event network-vif-unplugged:1e5c551d-9e29-4371-a23d-08f3b6b96e56 for instance f3b6f25f-ce24-45c5-b633-6a36808a0540 on n-h2-860687-3 Oct 27 18:55:18.925309 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d01cff63-547d-4b0b-ae71-2508329d2a0b req-24d3070c-281f-42ce-8df0-da66e03a31a9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058369 Oct 27 18:55:18.926539 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1224/2425] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:18.932293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d5c71c62-c75f-40c3-bb0e-78f9165536f9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc87330eee0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:19.036138 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d5c71c62-c75f-40c3-bb0e-78f9165536f9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.107958 Oct 27 18:55:19.039344 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1225/2426] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:18 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:19.070088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b064baeb-424a-4f6d-b2fb-5742041496db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-79108797", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b064baeb-424a-4f6d-b2fb-5742041496db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 236 Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-79108797", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-79108797', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '969dfa55-7bd6-4101-b2b3-c0ca6c6378eb'}]}}} Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:19.090644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 27 18:55:19.095080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:19.099439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b064baeb-424a-4f6d-b2fb-5742041496db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:19.100574 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b064baeb-424a-4f6d-b2fb-5742041496db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.059454 Oct 27 18:55:19.101624 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1226/2427] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:55:19 2022] POST /compute/v2.1/servers => generated 139 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:55:19.110045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0703593-7a0b-4b62-a36d-4b4da01e4899 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:19.111163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f0703593-7a0b-4b62-a36d-4b4da01e4899 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:19.120673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0703593-7a0b-4b62-a36d-4b4da01e4899 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:19.121580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0703593-7a0b-4b62-a36d-4b4da01e4899 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:19.122673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0703593-7a0b-4b62-a36d-4b4da01e4899 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:19.123961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0703593-7a0b-4b62-a36d-4b4da01e4899 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:19.124920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0703593-7a0b-4b62-a36d-4b4da01e4899 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:19.125700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0703593-7a0b-4b62-a36d-4b4da01e4899 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:19.189082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6e8cf5a5-711d-4b1a-a711-222986c562dc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:19.209180 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6e8cf5a5-711d-4b1a-a711-222986c562dc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1311 microversion: 2.1 time: 1.015338 Oct 27 18:55:19.210325 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1202/2428] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:18 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1311 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:19.441804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f0703593-7a0b-4b62-a36d-4b4da01e4899 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:19.472898 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f0703593-7a0b-4b62-a36d-4b4da01e4899 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.367205 Oct 27 18:55:19.473731 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1227/2429] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:19 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:55:19.496348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ec461965-2633-4e44-a680-92e5ab3968a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:19.497257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ec461965-2633-4e44-a680-92e5ab3968a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:19.504804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec461965-2633-4e44-a680-92e5ab3968a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:19.505646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec461965-2633-4e44-a680-92e5ab3968a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:19.506354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec461965-2633-4e44-a680-92e5ab3968a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:19.507312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec461965-2633-4e44-a680-92e5ab3968a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:19.508291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec461965-2633-4e44-a680-92e5ab3968a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:19.508947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec461965-2633-4e44-a680-92e5ab3968a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:19.795434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ec461965-2633-4e44-a680-92e5ab3968a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:19.807534 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ec461965-2633-4e44-a680-92e5ab3968a0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.314986 Oct 27 18:55:19.808128 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1203/2430] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:19 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:19.876162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85fb0c2e-d743-4ff4-be03-e6ab383c9669 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:19.876941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-85fb0c2e-d743-4ff4-be03-e6ab383c9669 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:19.897447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85fb0c2e-d743-4ff4-be03-e6ab383c9669 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:19.898523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85fb0c2e-d743-4ff4-be03-e6ab383c9669 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:19.901989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85fb0c2e-d743-4ff4-be03-e6ab383c9669 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:19.903028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85fb0c2e-d743-4ff4-be03-e6ab383c9669 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:19.907505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85fb0c2e-d743-4ff4-be03-e6ab383c9669 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:19.915261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85fb0c2e-d743-4ff4-be03-e6ab383c9669 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:20.038488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-201b0e49-f4c0-456a-b51d-7dd1fca1f48a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-403674890", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-201b0e49-f4c0-456a-b51d-7dd1fca1f48a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 234 Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-403674890", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-403674890', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '969dfa55-7bd6-4101-b2b3-c0ca6c6378eb'}]}}} Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:20.056682 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 27 18:55:20.061203 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:20.063839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-201b0e49-f4c0-456a-b51d-7dd1fca1f48a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:20.066119 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-201b0e49-f4c0-456a-b51d-7dd1fca1f48a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.039910 Oct 27 18:55:20.074468 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1204/2431] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:55:20 2022] POST /compute/v2.1/servers => generated 133 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 18:55:20.085563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3e812f28-c179-42d0-8af7-853fe73e942f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc869da40d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:20.160910 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3e812f28-c179-42d0-8af7-853fe73e942f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.084766 Oct 27 18:55:20.166097 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1205/2432] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:20 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:20.172121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e8cfbcca-a2b7-4136-945d-080eccd4069e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:20.175795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e8cfbcca-a2b7-4136-945d-080eccd4069e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:20.194416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8cfbcca-a2b7-4136-945d-080eccd4069e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:20.198695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8cfbcca-a2b7-4136-945d-080eccd4069e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:20.199324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8cfbcca-a2b7-4136-945d-080eccd4069e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:20.200203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8cfbcca-a2b7-4136-945d-080eccd4069e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:20.200797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8cfbcca-a2b7-4136-945d-080eccd4069e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:20.201348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8cfbcca-a2b7-4136-945d-080eccd4069e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:20.464630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-85fb0c2e-d743-4ff4-be03-e6ab383c9669 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:20.475471 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-85fb0c2e-d743-4ff4-be03-e6ab383c9669 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1522 microversion: 2.1 time: 0.603416 Oct 27 18:55:20.478698 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1228/2433] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:19 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1522 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:20.490072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-55e0991c-2060-46f7-8227-5f827a8a8e3d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:20.491831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-55e0991c-2060-46f7-8227-5f827a8a8e3d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:20.500806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:20.509281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55e0991c-2060-46f7-8227-5f827a8a8e3d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:20.509787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55e0991c-2060-46f7-8227-5f827a8a8e3d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:20.510227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55e0991c-2060-46f7-8227-5f827a8a8e3d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:20.511022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55e0991c-2060-46f7-8227-5f827a8a8e3d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:20.511477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55e0991c-2060-46f7-8227-5f827a8a8e3d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:20.511968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55e0991c-2060-46f7-8227-5f827a8a8e3d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:21.032926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-55e0991c-2060-46f7-8227-5f827a8a8e3d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:21.054127 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-55e0991c-2060-46f7-8227-5f827a8a8e3d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1311 microversion: 2.1 time: 0.573487 Oct 27 18:55:21.060580 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1229/2434] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:20 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1311 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:21.073881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8cfbcca-a2b7-4136-945d-080eccd4069e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:21.085058 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e8cfbcca-a2b7-4136-945d-080eccd4069e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.917656 Oct 27 18:55:21.087021 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1206/2435] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:20 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:21.114309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42062d65-ba77-42b7-8a3d-7e217323635e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:21.115344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-42062d65-ba77-42b7-8a3d-7e217323635e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:21.122454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42062d65-ba77-42b7-8a3d-7e217323635e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:21.123294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42062d65-ba77-42b7-8a3d-7e217323635e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:21.123956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42062d65-ba77-42b7-8a3d-7e217323635e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:21.124923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42062d65-ba77-42b7-8a3d-7e217323635e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:21.127246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42062d65-ba77-42b7-8a3d-7e217323635e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:21.128091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42062d65-ba77-42b7-8a3d-7e217323635e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:21.182178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b8ccd59-2b8a-4c95-80a9-368c25d9f48e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc8731fedc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:21.282038 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b8ccd59-2b8a-4c95-80a9-368c25d9f48e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.104169 Oct 27 18:55:21.290764 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1207/2436] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:21 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:55:21.515015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-01624579-e26d-49d7-9d1e-67957f163442 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:21.515902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-01624579-e26d-49d7-9d1e-67957f163442 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:21.559210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01624579-e26d-49d7-9d1e-67957f163442 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:21.567352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01624579-e26d-49d7-9d1e-67957f163442 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:21.578827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01624579-e26d-49d7-9d1e-67957f163442 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:21.580137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01624579-e26d-49d7-9d1e-67957f163442 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:21.580824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01624579-e26d-49d7-9d1e-67957f163442 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:21.582231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01624579-e26d-49d7-9d1e-67957f163442 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:21.718372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-42062d65-ba77-42b7-8a3d-7e217323635e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:21.735671 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-42062d65-ba77-42b7-8a3d-7e217323635e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.624512 Oct 27 18:55:21.739613 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1230/2437] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:21 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:21.769212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-71f8003e-b177-4ef9-ac00-7bb6f3e442f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:21.770715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-71f8003e-b177-4ef9-ac00-7bb6f3e442f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 37aa8d80-0b96-4867-aa79-41952e0dcc75] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:21.787447 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-71f8003e-b177-4ef9-ac00-7bb6f3e442f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 37aa8d80-0b96-4867-aa79-41952e0dcc75 could not be found. Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-71f8003e-b177-4ef9-ac00-7bb6f3e442f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/37aa8d80-0b96-4867-aa79-41952e0dcc75/action HTTP/1.1 Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 13 Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: {"pause": {}} Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 37aa8d80-0b96-4867-aa79-41952e0dcc75 could not be found. Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '37aa8d80-0b96-4867-aa79-41952e0dcc75', 'body': {'pause': {}}} Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37aa8d80-0b96-4867-aa79-41952e0dcc75 could not be found. Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37aa8d80-0b96-4867-aa79-41952e0dcc75 could not be found. Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:21.807726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:21.811633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:21.811633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:21.811633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37aa8d80-0b96-4867-aa79-41952e0dcc75 could not be found. Oct 27 18:55:21.811633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:21.811633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-71f8003e-b177-4ef9-ac00-7bb6f3e442f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 37aa8d80-0b96-4867-aa79-41952e0dcc75 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:21.812170 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-71f8003e-b177-4ef9-ac00-7bb6f3e442f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/37aa8d80-0b96-4867-aa79-41952e0dcc75/action" status: 404 len: 111 microversion: 2.1 time: 0.049388 Oct 27 18:55:21.823552 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1231/2438] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:21 2022] POST /compute/v2.1/servers/37aa8d80-0b96-4867-aa79-41952e0dcc75/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:21.836685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-58382582-5380-4138-8258-cb446a0abb31 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:21.837344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-58382582-5380-4138-8258-cb446a0abb31 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:21.856729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58382582-5380-4138-8258-cb446a0abb31 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:21.857512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58382582-5380-4138-8258-cb446a0abb31 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:21.858178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58382582-5380-4138-8258-cb446a0abb31 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:21.862092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58382582-5380-4138-8258-cb446a0abb31 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:21.865872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58382582-5380-4138-8258-cb446a0abb31 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:21.869575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58382582-5380-4138-8258-cb446a0abb31 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:22.145492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-58382582-5380-4138-8258-cb446a0abb31 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:22.155949 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-58382582-5380-4138-8258-cb446a0abb31 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.331199 Oct 27 18:55:22.157290 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1232/2439] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:21 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:22.163828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9b2f11cd-0631-4988-8d80-5b0d11183dcc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:22.164887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9b2f11cd-0631-4988-8d80-5b0d11183dcc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:22.172356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2f11cd-0631-4988-8d80-5b0d11183dcc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:22.173339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2f11cd-0631-4988-8d80-5b0d11183dcc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:22.173949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2f11cd-0631-4988-8d80-5b0d11183dcc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:22.175422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2f11cd-0631-4988-8d80-5b0d11183dcc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:22.176036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2f11cd-0631-4988-8d80-5b0d11183dcc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:22.176616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2f11cd-0631-4988-8d80-5b0d11183dcc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:22.334032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-01624579-e26d-49d7-9d1e-67957f163442 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:22.354755 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-01624579-e26d-49d7-9d1e-67957f163442 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1522 microversion: 2.1 time: 0.849881 Oct 27 18:55:22.370798 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1208/2440] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:21 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1522 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:22.370798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3b961683-057f-40f2-9d5b-ca8c9c812735 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:22.370798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3b961683-057f-40f2-9d5b-ca8c9c812735 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:22.395070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b961683-057f-40f2-9d5b-ca8c9c812735 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:22.395568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b961683-057f-40f2-9d5b-ca8c9c812735 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:22.396010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b961683-057f-40f2-9d5b-ca8c9c812735 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:22.396737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b961683-057f-40f2-9d5b-ca8c9c812735 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:22.397193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b961683-057f-40f2-9d5b-ca8c9c812735 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:22.397621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b961683-057f-40f2-9d5b-ca8c9c812735 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:22.557892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9b2f11cd-0631-4988-8d80-5b0d11183dcc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:22.575011 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9b2f11cd-0631-4988-8d80-5b0d11183dcc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1311 microversion: 2.1 time: 0.409954 Oct 27 18:55:22.586437 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1233/2441] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:22 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1311 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:22.586437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1e3b2556-228d-4603-8e19-33a5e63c4e4b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc87335ba60>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:22.685710 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1e3b2556-228d-4603-8e19-33a5e63c4e4b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.101457 Oct 27 18:55:22.687705 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1234/2442] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:22 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:23.017445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3b961683-057f-40f2-9d5b-ca8c9c812735 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:23.026433 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3b961683-057f-40f2-9d5b-ca8c9c812735 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.669484 Oct 27 18:55:23.046794 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1209/2443] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:22 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:23.058511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ff952dd8-b662-415d-81f0-8a643474ab0f req-6cd11c30-777c-4de5-ad8b-479c67378f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d741a04d-f8e8-4b66-bc30-377d4c8de1dc", "name": "network-vif-plugged", "status": "completed", "tag": "ac56cb8e-e2ef-419e-be28-4a7a3d4a4c68"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:23.081893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ff952dd8-b662-415d-81f0-8a643474ab0f req-6cd11c30-777c-4de5-ad8b-479c67378f8b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:23.086712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ff952dd8-b662-415d-81f0-8a643474ab0f req-6cd11c30-777c-4de5-ad8b-479c67378f8b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:23.087938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ff952dd8-b662-415d-81f0-8a643474ab0f req-6cd11c30-777c-4de5-ad8b-479c67378f8b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:23.090331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8e10f2f6-34df-45f4-a884-79e9637c281d tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Action: 'create', calling method: .version_select at 0x7fc87330d700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1323832253", "description": "tempest-description-2130023826"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:23.118350 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ff952dd8-b662-415d-81f0-8a643474ab0f req-6cd11c30-777c-4de5-ad8b-479c67378f8b service nova] Creating event network-vif-plugged:ac56cb8e-e2ef-419e-be28-4a7a3d4a4c68 for instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc on n-h2-860687-3 Oct 27 18:55:23.134196 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ff952dd8-b662-415d-81f0-8a643474ab0f req-6cd11c30-777c-4de5-ad8b-479c67378f8b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086027 Oct 27 18:55:23.135381 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1210/2444] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:23.141013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f76d0fbf-81b0-4283-8295-88cf1cf34022 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:23.155406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f76d0fbf-81b0-4283-8295-88cf1cf34022 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:23.165163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f76d0fbf-81b0-4283-8295-88cf1cf34022 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:23.171183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f76d0fbf-81b0-4283-8295-88cf1cf34022 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:23.171988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f76d0fbf-81b0-4283-8295-88cf1cf34022 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:23.173238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f76d0fbf-81b0-4283-8295-88cf1cf34022 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:23.173937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f76d0fbf-81b0-4283-8295-88cf1cf34022 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:23.175272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f76d0fbf-81b0-4283-8295-88cf1cf34022 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:23.303510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:23.343600 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f76d0fbf-81b0-4283-8295-88cf1cf34022 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action" status: 202 len: 0 microversion: 2.1 time: 0.206548 Oct 27 18:55:23.349127 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1211/2445] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:23 2022] POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:55:23.372353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-38c234f3-4f6e-4543-bf89-96bfda8498c8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:23.375132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-38c234f3-4f6e-4543-bf89-96bfda8498c8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:23.401119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38c234f3-4f6e-4543-bf89-96bfda8498c8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:23.402099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38c234f3-4f6e-4543-bf89-96bfda8498c8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:23.402844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38c234f3-4f6e-4543-bf89-96bfda8498c8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:23.410034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38c234f3-4f6e-4543-bf89-96bfda8498c8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:23.416957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38c234f3-4f6e-4543-bf89-96bfda8498c8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:23.417746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38c234f3-4f6e-4543-bf89-96bfda8498c8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:23.551363 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8e10f2f6-34df-45f4-a884-79e9637c281d tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.861333 Oct 27 18:55:23.552692 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1235/2446] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:55:22 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:23.559138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-49029b69-3682-4e0b-bd23-7a0b399bdb1b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:23.560136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-49029b69-3682-4e0b-bd23-7a0b399bdb1b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:23.592264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49029b69-3682-4e0b-bd23-7a0b399bdb1b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:23.593140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49029b69-3682-4e0b-bd23-7a0b399bdb1b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:23.593840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49029b69-3682-4e0b-bd23-7a0b399bdb1b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:23.597711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49029b69-3682-4e0b-bd23-7a0b399bdb1b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:23.599034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49029b69-3682-4e0b-bd23-7a0b399bdb1b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:23.599728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49029b69-3682-4e0b-bd23-7a0b399bdb1b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:24.005070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-49029b69-3682-4e0b-bd23-7a0b399bdb1b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:24.018131 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-49029b69-3682-4e0b-bd23-7a0b399bdb1b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1522 microversion: 2.1 time: 0.462733 Oct 27 18:55:24.041169 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1236/2447] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:23 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1522 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:24.058855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-be4ef03c-0524-41b5-9345-7cba7e9da7fe tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Action: 'create', calling method: .version_select at 0x7fc8732ccaf0>, body: {"security_group_rule": {"parent_group_id": "985005e1-a102-49aa-aab0-72eaa75a9970", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:24.420707 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-be4ef03c-0524-41b5-9345-7cba7e9da7fe tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.376234 Oct 27 18:55:24.421419 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1237/2448] 10.222.0.42 () {60 vars in 1195 bytes} [Thu Oct 27 18:55:24 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:24.430220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8613eb1f-bbf7-4689-8171-1c883eeffe09 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:24.431058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8613eb1f-bbf7-4689-8171-1c883eeffe09 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:24.441741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8613eb1f-bbf7-4689-8171-1c883eeffe09 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:24.448146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8613eb1f-bbf7-4689-8171-1c883eeffe09 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:24.448791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8613eb1f-bbf7-4689-8171-1c883eeffe09 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:24.449686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8613eb1f-bbf7-4689-8171-1c883eeffe09 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:24.452325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8613eb1f-bbf7-4689-8171-1c883eeffe09 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:24.452901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8613eb1f-bbf7-4689-8171-1c883eeffe09 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:24.906332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8613eb1f-bbf7-4689-8171-1c883eeffe09 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:24.916533 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8613eb1f-bbf7-4689-8171-1c883eeffe09 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1311 microversion: 2.1 time: 0.493971 Oct 27 18:55:24.931715 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1238/2449] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:24 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1311 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:24.946217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fe14b5d2-ba0d-4248-9cf6-94b47cd480fd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc87330d8b0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:25.055722 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fe14b5d2-ba0d-4248-9cf6-94b47cd480fd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.137558 Oct 27 18:55:25.057112 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1239/2450] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:24 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:25.061739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dbf8bd41-acf3-4cee-bef9-82142cf655e3 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Action: 'create', calling method: .version_select at 0x7fc87335ba60>, body: {"security_group_rule": {"parent_group_id": "985005e1-a102-49aa-aab0-72eaa75a9970", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:25.216688 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-dbf8bd41-acf3-4cee-bef9-82142cf655e3 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] HTTP exception thrown: This rule already exists in group 985005e1-a102-49aa-aab0-72eaa75a9970 Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dbf8bd41-acf3-4cee-bef9-82142cf655e3 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Request method failure captured: Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 138 Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtQaiV2mJREBiE-vDiOeVbGTxhxargBs74hmsOjmM0N2q7gEaTxxTZWgkxf2wU17jxpOiCb1LSAXilvgJqlb8kDdgkLJAoQAJ6PW0yz1WqvVOlSVu4_8bmvR27WxauGkm89rrGjnJvGL8-i8p_gVbm8ge3DiCKPPy_Qj38gPE6nc60U Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e35c6f361a784066896f169831c91e95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e35c6f361a784066896f169831c91e95", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2e5c12033a6e4b2890dabd39fa9b2b98 Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: {"security_group_rule": {"parent_group_id": "985005e1-a102-49aa-aab0-72eaa75a9970", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: exception: This rule already exists in group 985005e1-a102-49aa-aab0-72eaa75a9970 Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'security_group_rule': {'parent_group_id': '985005e1-a102-49aa-aab0-72eaa75a9970', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 985005e1-a102-49aa-aab0-72eaa75a9970 Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 985005e1-a102-49aa-aab0-72eaa75a9970 Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:25.218362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:25.222651 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:25.222651 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:25.222651 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 985005e1-a102-49aa-aab0-72eaa75a9970 Oct 27 18:55:25.222651 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:25.222651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dbf8bd41-acf3-4cee-bef9-82142cf655e3 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Returning 400 to user: This rule already exists in group 985005e1-a102-49aa-aab0-72eaa75a9970 {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:25.222651 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dbf8bd41-acf3-4cee-bef9-82142cf655e3 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.161726 Oct 27 18:55:25.223723 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1240/2451] 10.222.0.42 () {60 vars in 1195 bytes} [Thu Oct 27 18:55:25 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:55:25.228485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3e3387ac-24c4-4811-b6f6-ed600a975d04 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:25.229112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3e3387ac-24c4-4811-b6f6-ed600a975d04 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:25.260344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e3387ac-24c4-4811-b6f6-ed600a975d04 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:25.260860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e3387ac-24c4-4811-b6f6-ed600a975d04 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:25.261310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e3387ac-24c4-4811-b6f6-ed600a975d04 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:25.262044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e3387ac-24c4-4811-b6f6-ed600a975d04 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:25.262534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e3387ac-24c4-4811-b6f6-ed600a975d04 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:25.262972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e3387ac-24c4-4811-b6f6-ed600a975d04 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:25.431594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-38c234f3-4f6e-4543-bf89-96bfda8498c8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:25.439731 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-38c234f3-4f6e-4543-bf89-96bfda8498c8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1511 microversion: 2.1 time: 2.089025 Oct 27 18:55:25.441340 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1212/2452] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:23 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1511 bytes in 2091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:25.469592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2fddd478-d1d0-488a-a3e8-e7d5042aa5b7 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Calling method '.version_select at 0x7fc869dd6550>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:25.631717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3e3387ac-24c4-4811-b6f6-ed600a975d04 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:25.642459 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3e3387ac-24c4-4811-b6f6-ed600a975d04 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1522 microversion: 2.1 time: 0.417595 Oct 27 18:55:25.643340 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1241/2453] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:25 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:25.881074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5beb39b3-fea5-4efe-a521-10eee529a0e3 req-7a6658cc-7e04-4f37-86e4-ef714d3677b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b6f25f-ce24-45c5-b633-6a36808a0540", "name": "network-vif-plugged", "status": "completed", "tag": "1e5c551d-9e29-4371-a23d-08f3b6b96e56"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:25.915384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5beb39b3-fea5-4efe-a521-10eee529a0e3 req-7a6658cc-7e04-4f37-86e4-ef714d3677b7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:25.915886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5beb39b3-fea5-4efe-a521-10eee529a0e3 req-7a6658cc-7e04-4f37-86e4-ef714d3677b7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:25.916337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5beb39b3-fea5-4efe-a521-10eee529a0e3 req-7a6658cc-7e04-4f37-86e4-ef714d3677b7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:25.968476 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5beb39b3-fea5-4efe-a521-10eee529a0e3 req-7a6658cc-7e04-4f37-86e4-ef714d3677b7 service nova] Creating event network-vif-plugged:1e5c551d-9e29-4371-a23d-08f3b6b96e56 for instance f3b6f25f-ce24-45c5-b633-6a36808a0540 on n-h2-860687-3 Oct 27 18:55:25.992131 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5beb39b3-fea5-4efe-a521-10eee529a0e3 req-7a6658cc-7e04-4f37-86e4-ef714d3677b7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117014 Oct 27 18:55:25.996536 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1242/2454] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:55:26.010101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-962487da-c50d-42a6-854c-e11151bfff36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:26.014216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-962487da-c50d-42a6-854c-e11151bfff36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:26.026602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-962487da-c50d-42a6-854c-e11151bfff36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:26.030186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-962487da-c50d-42a6-854c-e11151bfff36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:26.031103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-962487da-c50d-42a6-854c-e11151bfff36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:26.032075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-962487da-c50d-42a6-854c-e11151bfff36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:26.034994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-962487da-c50d-42a6-854c-e11151bfff36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:26.035862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-962487da-c50d-42a6-854c-e11151bfff36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:26.953994 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2fddd478-d1d0-488a-a3e8-e7d5042aa5b7 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-group-rules/c2e1208e-dc84-4836-954f-fa6ff2129416" status: 202 len: 0 microversion: 2.1 time: 1.499478 Oct 27 18:55:26.955880 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1213/2455] 10.222.0.42 () {58 vars in 1287 bytes} [Thu Oct 27 18:55:25 2022] DELETE /compute/v2.1/os-security-group-rules/c2e1208e-dc84-4836-954f-fa6ff2129416 => generated 0 bytes in 1514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:55:26.966187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-54a1a377-afce-4ceb-8144-d9db852c00fa tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc869db9700>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:27.082907 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-54a1a377-afce-4ceb-8144-d9db852c00fa tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.122214 Oct 27 18:55:27.084548 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1214/2456] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:26 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:27.097871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e9acce4e-4d44-4da3-a7d9-5b91dd0e0382 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:27.098743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e9acce4e-4d44-4da3-a7d9-5b91dd0e0382 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:27.118051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9acce4e-4d44-4da3-a7d9-5b91dd0e0382 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:27.118893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9acce4e-4d44-4da3-a7d9-5b91dd0e0382 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:27.119995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9acce4e-4d44-4da3-a7d9-5b91dd0e0382 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:27.123136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9acce4e-4d44-4da3-a7d9-5b91dd0e0382 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:27.123790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9acce4e-4d44-4da3-a7d9-5b91dd0e0382 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:27.127232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9acce4e-4d44-4da3-a7d9-5b91dd0e0382 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:27.338234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-962487da-c50d-42a6-854c-e11151bfff36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:27.350589 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-962487da-c50d-42a6-854c-e11151bfff36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1311 microversion: 2.1 time: 1.352657 Oct 27 18:55:27.351536 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1243/2457] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:25 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1311 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:27.380080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c4835084-edda-477d-9bfc-49e91ff7d614 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:27.381820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c4835084-edda-477d-9bfc-49e91ff7d614 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:27.389448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4835084-edda-477d-9bfc-49e91ff7d614 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:27.390048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4835084-edda-477d-9bfc-49e91ff7d614 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:27.390955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4835084-edda-477d-9bfc-49e91ff7d614 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:27.392411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4835084-edda-477d-9bfc-49e91ff7d614 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:27.392951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4835084-edda-477d-9bfc-49e91ff7d614 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:27.395494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4835084-edda-477d-9bfc-49e91ff7d614 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:27.433712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:27.906722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e9acce4e-4d44-4da3-a7d9-5b91dd0e0382 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:27.923799 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e9acce4e-4d44-4da3-a7d9-5b91dd0e0382 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1491 microversion: 2.1 time: 0.837992 Oct 27 18:55:27.939703 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1215/2458] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:27 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1491 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:27.945120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d8779cd2-2e99-437d-ad9b-cb73a7aa41bc tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Action: 'create', calling method: .version_select at 0x7fc869dd6b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1242518365", "description": "tempest-description-227647075"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:28.233154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c4835084-edda-477d-9bfc-49e91ff7d614 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:28.274571 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c4835084-edda-477d-9bfc-49e91ff7d614 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1522 microversion: 2.1 time: 0.914456 Oct 27 18:55:28.276415 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1244/2459] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:27 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1522 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:28.297530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9aec8c51-95a1-467a-9a16-4413df1a561a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:28.298800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9aec8c51-95a1-467a-9a16-4413df1a561a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:28.308521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aec8c51-95a1-467a-9a16-4413df1a561a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:28.309308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aec8c51-95a1-467a-9a16-4413df1a561a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:28.312393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aec8c51-95a1-467a-9a16-4413df1a561a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:28.313352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aec8c51-95a1-467a-9a16-4413df1a561a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:28.316288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aec8c51-95a1-467a-9a16-4413df1a561a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:28.316957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aec8c51-95a1-467a-9a16-4413df1a561a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:28.471375 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-9aec8c51-95a1-467a-9a16-4413df1a561a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Cannot 'pause' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state paused Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9aec8c51-95a1-467a-9a16-4413df1a561a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action HTTP/1.1 Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 13 Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: {"pause": {}} Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: exception: Cannot 'pause' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state paused Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'a6e311e1-6dd0-4498-897c-c92ce762d9b9', 'body': {'pause': {}}} Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 in vm_state paused. Cannot pause while the instance is in this state. Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state paused Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:28.485070 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:28.489904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:28.489904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:28.489904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:28.489904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state paused Oct 27 18:55:28.489904 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:28.499425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9aec8c51-95a1-467a-9a16-4413df1a561a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 409 to user: Cannot 'pause' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state paused {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:28.505767 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9aec8c51-95a1-467a-9a16-4413df1a561a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action" status: 409 len: 143 microversion: 2.1 time: 0.225220 Oct 27 18:55:28.509916 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1245/2460] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:28 2022] POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action => generated 143 bytes in 232 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:55:28.526086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5874e241-0677-4f8f-976e-b9e19973f9b9 req-317d509f-41b7-4ae3-bbf5-b7fdc1e54ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592bd675-3b12-4ab8-8e8f-be99ea57e702", "name": "network-vif-plugged", "status": "completed", "tag": "1f047cd7-16bb-416c-8bf4-ce6a1d8f9459"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:28.569046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5874e241-0677-4f8f-976e-b9e19973f9b9 req-317d509f-41b7-4ae3-bbf5-b7fdc1e54ba2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:28.570701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5874e241-0677-4f8f-976e-b9e19973f9b9 req-317d509f-41b7-4ae3-bbf5-b7fdc1e54ba2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:28.571151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5874e241-0677-4f8f-976e-b9e19973f9b9 req-317d509f-41b7-4ae3-bbf5-b7fdc1e54ba2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:28.633867 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5874e241-0677-4f8f-976e-b9e19973f9b9 req-317d509f-41b7-4ae3-bbf5-b7fdc1e54ba2 service nova] Creating event network-vif-plugged:1f047cd7-16bb-416c-8bf4-ce6a1d8f9459 for instance 592bd675-3b12-4ab8-8e8f-be99ea57e702 on n-h1-860687-3 Oct 27 18:55:28.679566 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5874e241-0677-4f8f-976e-b9e19973f9b9 req-317d509f-41b7-4ae3-bbf5-b7fdc1e54ba2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163982 Oct 27 18:55:28.696954 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1246/2461] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:28.730625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae18d9cd-3bd6-48c5-96d3-bbf220ed83c8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc8732c3af0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:28.823095 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ae18d9cd-3bd6-48c5-96d3-bbf220ed83c8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.120304 Oct 27 18:55:28.835018 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1247/2462] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:28 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:28.842764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-335d1d30-5fd4-4c57-ba0a-6b999a35baac tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:28.842764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-335d1d30-5fd4-4c57-ba0a-6b999a35baac tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:28.869671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-335d1d30-5fd4-4c57-ba0a-6b999a35baac tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:28.871237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-335d1d30-5fd4-4c57-ba0a-6b999a35baac tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:28.871959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-335d1d30-5fd4-4c57-ba0a-6b999a35baac tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:28.872948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-335d1d30-5fd4-4c57-ba0a-6b999a35baac tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:28.873623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-335d1d30-5fd4-4c57-ba0a-6b999a35baac tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:28.874615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-335d1d30-5fd4-4c57-ba0a-6b999a35baac tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:29.114759 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d8779cd2-2e99-437d-ad9b-cb73a7aa41bc tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.183440 Oct 27 18:55:29.117626 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1216/2463] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:55:27 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:29.132436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-18047f4d-3eba-4123-aef8-9d62836a7b90 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:29.134356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-18047f4d-3eba-4123-aef8-9d62836a7b90 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:29.152084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18047f4d-3eba-4123-aef8-9d62836a7b90 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:29.153005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18047f4d-3eba-4123-aef8-9d62836a7b90 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:29.154917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18047f4d-3eba-4123-aef8-9d62836a7b90 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:29.155869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18047f4d-3eba-4123-aef8-9d62836a7b90 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:29.160884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18047f4d-3eba-4123-aef8-9d62836a7b90 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:29.161742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18047f4d-3eba-4123-aef8-9d62836a7b90 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:29.358755 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-18047f4d-3eba-4123-aef8-9d62836a7b90 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action" status: 202 len: 0 microversion: 2.1 time: 0.235569 Oct 27 18:55:29.361924 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1217/2464] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:29 2022] POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:55:29.371161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-239281de-1732-4e82-800f-a398cbce502d tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Action: 'create', calling method: .version_select at 0x7fc869db9d30>, body: {"security_group_rule": {"parent_group_id": "1c925767-3482-4b17-b452-c013255deb28", "ip_protocol": "tcp", "from_port": 1100233973, "to_port": 22}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:29.599087 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-239281de-1732-4e82-800f-a398cbce502d tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] HTTP exception thrown: Invalid port range 1100233973:22. Former value cannot be greater than the later Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-239281de-1732-4e82-800f-a398cbce502d tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Request method failure captured: Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 146 Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtQaiV2mJREBiE-vDiOeVbGTxhxargBs74hmsOjmM0N2q7gEaTxxTZWgkxf2wU17jxpOiCb1LSAXilvgJqlb8kDdgkLJAoQAJ6PW0yz1WqvVOlSVu4_8bmvR27WxauGkm89rrGjnJvGL8-i8p_gVbm8ge3DiCKPPy_Qj38gPE6nc60U Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e35c6f361a784066896f169831c91e95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e35c6f361a784066896f169831c91e95", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2e5c12033a6e4b2890dabd39fa9b2b98 Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: {"security_group_rule": {"parent_group_id": "1c925767-3482-4b17-b452-c013255deb28", "ip_protocol": "tcp", "from_port": 1100233973, "to_port": 22}} Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid port range 1100233973:22. Former value cannot be greater than the later Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1c925767-3482-4b17-b452-c013255deb28', 'ip_protocol': 'tcp', 'from_port': 1100233973, 'to_port': 22}}} Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1100233973:22. Former value cannot be greater than the later Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1100233973:22. Former value cannot be greater than the later Oct 27 18:55:29.601213 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:29.608969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:29.608969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:29.608969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:29.608969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:29.608969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:29.608969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:29.608969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:29.608969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1100233973:22. Former value cannot be greater than the later Oct 27 18:55:29.608969 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:29.611223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-239281de-1732-4e82-800f-a398cbce502d tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Returning 400 to user: Invalid port range 1100233973:22. Former value cannot be greater than the later {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:29.612980 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-239281de-1732-4e82-800f-a398cbce502d tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.249012 Oct 27 18:55:29.614161 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1218/2465] 10.222.0.42 () {60 vars in 1195 bytes} [Thu Oct 27 18:55:29 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:55:29.624179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ef152c1-ec29-4119-9669-c80444d1932c tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:29.628024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5ef152c1-ec29-4119-9669-c80444d1932c tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:29.669035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ef152c1-ec29-4119-9669-c80444d1932c tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:29.670991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ef152c1-ec29-4119-9669-c80444d1932c tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:29.672971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ef152c1-ec29-4119-9669-c80444d1932c tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:29.673948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ef152c1-ec29-4119-9669-c80444d1932c tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:29.678041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ef152c1-ec29-4119-9669-c80444d1932c tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:29.680846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ef152c1-ec29-4119-9669-c80444d1932c tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:30.191835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5ef152c1-ec29-4119-9669-c80444d1932c tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:30.207919 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5ef152c1-ec29-4119-9669-c80444d1932c tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1507 microversion: 2.1 time: 0.589858 Oct 27 18:55:30.210235 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1219/2466] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:29 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1507 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:30.217335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-42eb4649-8288-4c33-a292-6154543c17b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:30.218241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-42eb4649-8288-4c33-a292-6154543c17b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:30.229302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42eb4649-8288-4c33-a292-6154543c17b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:30.230696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42eb4649-8288-4c33-a292-6154543c17b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:30.231780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42eb4649-8288-4c33-a292-6154543c17b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:30.232994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42eb4649-8288-4c33-a292-6154543c17b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:30.242288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42eb4649-8288-4c33-a292-6154543c17b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:30.253393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42eb4649-8288-4c33-a292-6154543c17b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:30.346004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-335d1d30-5fd4-4c57-ba0a-6b999a35baac tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:30.372191 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-335d1d30-5fd4-4c57-ba0a-6b999a35baac tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1311 microversion: 2.1 time: 1.533495 Oct 27 18:55:30.394603 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1248/2467] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:28 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1311 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:30.411921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-893ba9b5-b467-44dc-8eeb-b54ec0c5d51f tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Action: 'create', calling method: .version_select at 0x7fc8732c30d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1580420391", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:30.416074 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-893ba9b5-b467-44dc-8eeb-b54ec0c5d51f tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] HTTP exception thrown: Security group id should be uuid Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-893ba9b5-b467-44dc-8eeb-b54ec0c5d51f tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Request method failure captured: Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 131 Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtQaiV2mJREBiE-vDiOeVbGTxhxargBs74hmsOjmM0N2q7gEaTxxTZWgkxf2wU17jxpOiCb1LSAXilvgJqlb8kDdgkLJAoQAJ6PW0yz1WqvVOlSVu4_8bmvR27WxauGkm89rrGjnJvGL8-i8p_gVbm8ge3DiCKPPy_Qj38gPE6nc60U Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e35c6f361a784066896f169831c91e95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e35c6f361a784066896f169831c91e95", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2e5c12033a6e4b2890dabd39fa9b2b98 Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1580420391", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: exception: Security group id should be uuid Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1580420391', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:30.417739 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:30.429400 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 27 18:55:30.429400 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:30.429400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-893ba9b5-b467-44dc-8eeb-b54ec0c5d51f tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Returning 400 to user: Security group id should be uuid {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:30.429400 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-893ba9b5-b467-44dc-8eeb-b54ec0c5d51f tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.023396 Oct 27 18:55:30.429400 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1249/2468] 10.222.0.42 () {60 vars in 1195 bytes} [Thu Oct 27 18:55:30 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:55:30.447223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1fd449cf-d4e2-4e83-83d7-510f01365fa0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b3c10d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:30.616372 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1fd449cf-d4e2-4e83-83d7-510f01365fa0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.186266 Oct 27 18:55:30.618213 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1250/2469] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:30 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:30.636866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-30ab7d5e-486b-426e-bc55-630586c7c562 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:30.637950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-30ab7d5e-486b-426e-bc55-630586c7c562 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:30.662722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ab7d5e-486b-426e-bc55-630586c7c562 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:30.671634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ab7d5e-486b-426e-bc55-630586c7c562 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:30.672341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ab7d5e-486b-426e-bc55-630586c7c562 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:30.673733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ab7d5e-486b-426e-bc55-630586c7c562 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:30.677711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ab7d5e-486b-426e-bc55-630586c7c562 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:30.680292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ab7d5e-486b-426e-bc55-630586c7c562 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:30.830902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-42eb4649-8288-4c33-a292-6154543c17b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:30.843993 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-42eb4649-8288-4c33-a292-6154543c17b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.632488 Oct 27 18:55:30.846683 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1220/2470] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:30 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:30.856887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b75d9c98-7dff-4ad0-8acf-f5927114279b tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Action: 'create', calling method: .version_select at 0x7fc869da45e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1323725472", "description": "tempest-description-261336997"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:31.180110 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b75d9c98-7dff-4ad0-8acf-f5927114279b tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.332018 Oct 27 18:55:31.181002 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1221/2471] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:55:30 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:31.193646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7058ac99-26b2-4b1a-b432-01df32942910 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:31.195058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7058ac99-26b2-4b1a-b432-01df32942910 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:31.207902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7058ac99-26b2-4b1a-b432-01df32942910 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:31.208615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7058ac99-26b2-4b1a-b432-01df32942910 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:31.209236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7058ac99-26b2-4b1a-b432-01df32942910 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:31.210179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7058ac99-26b2-4b1a-b432-01df32942910 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:31.210665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7058ac99-26b2-4b1a-b432-01df32942910 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:31.213925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7058ac99-26b2-4b1a-b432-01df32942910 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:31.288803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-30ab7d5e-486b-426e-bc55-630586c7c562 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:31.304332 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-30ab7d5e-486b-426e-bc55-630586c7c562 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 200 len: 1507 microversion: 2.1 time: 0.682979 Oct 27 18:55:31.306453 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1251/2472] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:30 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 1507 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:31.314617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bdc575c2-a831-41af-a1a3-481f33227cb7 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Action: 'create', calling method: .version_select at 0x7fc8732cf8b0>, body: {"security_group_rule": {"parent_group_id": "f9e81b2e-180d-42a2-a827-8574cfec2681", "ip_protocol": "tempest-999-2078070823", "from_port": 22, "to_port": 22}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:31.488274 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-bdc575c2-a831-41af-a1a3-481f33227cb7 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] HTTP exception thrown: Invalid IP protocol tempest-999-2078070823. Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bdc575c2-a831-41af-a1a3-481f33227cb7 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Request method failure captured: Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 157 Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtQaiV2mJREBiE-vDiOeVbGTxhxargBs74hmsOjmM0N2q7gEaTxxTZWgkxf2wU17jxpOiCb1LSAXilvgJqlb8kDdgkLJAoQAJ6PW0yz1WqvVOlSVu4_8bmvR27WxauGkm89rrGjnJvGL8-i8p_gVbm8ge3DiCKPPy_Qj38gPE6nc60U Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e35c6f361a784066896f169831c91e95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e35c6f361a784066896f169831c91e95", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2e5c12033a6e4b2890dabd39fa9b2b98 Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: {"security_group_rule": {"parent_group_id": "f9e81b2e-180d-42a2-a827-8574cfec2681", "ip_protocol": "tempest-999-2078070823", "from_port": 22, "to_port": 22}} Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid IP protocol tempest-999-2078070823. Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f9e81b2e-180d-42a2-a827-8574cfec2681', 'ip_protocol': 'tempest-999-2078070823', 'from_port': 22, 'to_port': 22}}} Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2078070823. Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2078070823. Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:31.491693 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:31.495780 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:31.495780 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:31.495780 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:31.495780 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:31.495780 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:31.495780 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:31.495780 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2078070823. Oct 27 18:55:31.495780 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:31.495780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bdc575c2-a831-41af-a1a3-481f33227cb7 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Returning 400 to user: Invalid IP protocol tempest-999-2078070823. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:31.496407 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bdc575c2-a831-41af-a1a3-481f33227cb7 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.188487 Oct 27 18:55:31.497193 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1252/2473] 10.222.0.42 () {60 vars in 1195 bytes} [Thu Oct 27 18:55:31 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 18:55:31.514961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9437220b-3eaf-44cc-b04e-ef57eea2a5a8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:31.517702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9437220b-3eaf-44cc-b04e-ef57eea2a5a8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:31.535817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9437220b-3eaf-44cc-b04e-ef57eea2a5a8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:31.536811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9437220b-3eaf-44cc-b04e-ef57eea2a5a8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:31.537497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9437220b-3eaf-44cc-b04e-ef57eea2a5a8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:31.538587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9437220b-3eaf-44cc-b04e-ef57eea2a5a8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:31.539313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9437220b-3eaf-44cc-b04e-ef57eea2a5a8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:31.539969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9437220b-3eaf-44cc-b04e-ef57eea2a5a8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:31.619590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9437220b-3eaf-44cc-b04e-ef57eea2a5a8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:55:31.814562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7058ac99-26b2-4b1a-b432-01df32942910 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:31.828811 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7058ac99-26b2-4b1a-b432-01df32942910 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.646587 Oct 27 18:55:31.843707 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1222/2474] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:31 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:31.866359 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9437220b-3eaf-44cc-b04e-ef57eea2a5a8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 204 len: 0 microversion: 2.1 time: 0.362771 Oct 27 18:55:31.867269 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1253/2475] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:55:31 2022] DELETE /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:55:31.874224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6fbfe1fe-8290-42cb-bcbd-e639b5de0a59 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:31.876941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6fbfe1fe-8290-42cb-bcbd-e639b5de0a59 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:31.881854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bc680baa-65de-4d2c-aa1b-9ceee2b91581 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Action: 'create', calling method: .version_select at 0x7fc87332e310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-396902157", "description": "tempest-description-1016688639"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:31.886968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6fbfe1fe-8290-42cb-bcbd-e639b5de0a59 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:31.887663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6fbfe1fe-8290-42cb-bcbd-e639b5de0a59 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:31.888313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6fbfe1fe-8290-42cb-bcbd-e639b5de0a59 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:31.892565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6fbfe1fe-8290-42cb-bcbd-e639b5de0a59 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:31.898925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6fbfe1fe-8290-42cb-bcbd-e639b5de0a59 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:31.905048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6fbfe1fe-8290-42cb-bcbd-e639b5de0a59 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:32.729225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6fbfe1fe-8290-42cb-bcbd-e639b5de0a59 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:32.738135 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6fbfe1fe-8290-42cb-bcbd-e639b5de0a59 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1495 microversion: 2.1 time: 0.893228 Oct 27 18:55:32.743651 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1223/2476] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:31 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1495 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:32.758601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c5d8ad5c-faf5-4f76-97db-ef7df0fe493a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc869db9940>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:32.873903 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c5d8ad5c-faf5-4f76-97db-ef7df0fe493a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.127716 Oct 27 18:55:32.875051 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1224/2477] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:32 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:32.893011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-39e60346-6d48-495f-999e-d086b998a79a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:32.905105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-39e60346-6d48-495f-999e-d086b998a79a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:32.937781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39e60346-6d48-495f-999e-d086b998a79a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:32.942771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39e60346-6d48-495f-999e-d086b998a79a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:32.949574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39e60346-6d48-495f-999e-d086b998a79a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:32.950647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39e60346-6d48-495f-999e-d086b998a79a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:32.952161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39e60346-6d48-495f-999e-d086b998a79a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:32.959119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39e60346-6d48-495f-999e-d086b998a79a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:33.013114 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-39e60346-6d48-495f-999e-d086b998a79a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-39e60346-6d48-495f-999e-d086b998a79a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a/action HTTP/1.1 Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 28 Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: {"reboot": {"type": "SOFT"}} Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '263ba238-b675-4ae7-a469-ced7d67f016a', 'body': {'reboot': {'type': 'SOFT'}}} Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:55:33.017867 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:33.022035 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:55:33.022035 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:33.022035 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:33.022035 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:33.022035 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:33.022035 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:33.022035 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:33.022035 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:33.022035 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:33.022035 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:55:33.022035 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:33.024306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-39e60346-6d48-495f-999e-d086b998a79a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:33.027395 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-39e60346-6d48-495f-999e-d086b998a79a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a/action" status: 404 len: 111 microversion: 2.1 time: 0.151103 Oct 27 18:55:33.031271 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1225/2478] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:32 2022] POST /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a/action => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:33.054925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-962133065", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "700f0f16-58c0-4cd3-9a25-b6c938e0a6b1"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:33.107762 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bc680baa-65de-4d2c-aa1b-9ceee2b91581 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.239087 Oct 27 18:55:33.110298 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1254/2479] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:55:31 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:33.180399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] validate_networks() for [('700f0f16-58c0-4cd3-9a25-b6c938e0a6b1', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:55:33.676102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bfd3176c-9aac-48ef-a66f-acfc4a668fd1 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:33.677074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bfd3176c-9aac-48ef-a66f-acfc4a668fd1 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:33.701382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfd3176c-9aac-48ef-a66f-acfc4a668fd1 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:33.701897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfd3176c-9aac-48ef-a66f-acfc4a668fd1 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:33.702346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfd3176c-9aac-48ef-a66f-acfc4a668fd1 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:33.703148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfd3176c-9aac-48ef-a66f-acfc4a668fd1 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:33.703610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfd3176c-9aac-48ef-a66f-acfc4a668fd1 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:33.704047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfd3176c-9aac-48ef-a66f-acfc4a668fd1 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:34.370636 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bfd3176c-9aac-48ef-a66f-acfc4a668fd1 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1646 microversion: 2.1 time: 1.258975 Oct 27 18:55:34.376455 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1255/2480] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:33 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1646 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:34.392582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c3b9a7fd-41a4-4d64-963b-4b17fec3dca5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:34.394190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c3b9a7fd-41a4-4d64-963b-4b17fec3dca5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:34.425415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3b9a7fd-41a4-4d64-963b-4b17fec3dca5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:34.426094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3b9a7fd-41a4-4d64-963b-4b17fec3dca5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:34.426733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3b9a7fd-41a4-4d64-963b-4b17fec3dca5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:34.438422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3b9a7fd-41a4-4d64-963b-4b17fec3dca5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:34.439053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3b9a7fd-41a4-4d64-963b-4b17fec3dca5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:34.439577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3b9a7fd-41a4-4d64-963b-4b17fec3dca5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:34.923427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:55:34.925605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:55:34.927810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:55:34.928542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:55:34.930685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:55:34.962898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:34.963710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:34.964440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:34.965588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:34.966364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:34.967016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:34.996649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c3b9a7fd-41a4-4d64-963b-4b17fec3dca5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:35.010666 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c3b9a7fd-41a4-4d64-963b-4b17fec3dca5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.631467 Oct 27 18:55:35.025379 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1256/2481] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:34 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:35.025379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ebee2af1-6a9d-4bb4-b6c1-b210303e3138 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Action: 'create', calling method: .version_select at 0x7fc87326c940>, body: {"security_group_rule": {"parent_group_id": "fc1276fb-9570-4419-b0b3-9eba39307374", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:35.089228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Getting quotas for project bcefa097ed8d4bf8b7f0118786874cc1. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:55:35.111570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Getting quotas for user 77434d4813ca426fbc20f386894c3176 and project bcefa097ed8d4bf8b7f0118786874cc1. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:55:35.172163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:55:35.174980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:55:35.293624 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-ebee2af1-6a9d-4bb4-b6c1-b210303e3138 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ebee2af1-6a9d-4bb4-b6c1-b210303e3138 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Request method failure captured: Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 138 Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtQaiV2mJREBiE-vDiOeVbGTxhxargBs74hmsOjmM0N2q7gEaTxxTZWgkxf2wU17jxpOiCb1LSAXilvgJqlb8kDdgkLJAoQAJ6PW0yz1WqvVOlSVu4_8bmvR27WxauGkm89rrGjnJvGL8-i8p_gVbm8ge3DiCKPPy_Qj38gPE6nc60U Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e35c6f361a784066896f169831c91e95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e35c6f361a784066896f169831c91e95", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2e5c12033a6e4b2890dabd39fa9b2b98 Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: {"security_group_rule": {"parent_group_id": "fc1276fb-9570-4419-b0b3-9eba39307374", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fc1276fb-9570-4419-b0b3-9eba39307374', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 18:55:35.295996 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:35.300204 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:35.300204 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:35.300204 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:35.300204 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:35.300204 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:35.300204 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:35.300204 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:35.300204 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 18:55:35.300204 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:35.300204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ebee2af1-6a9d-4bb4-b6c1-b210303e3138 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:35.300204 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ebee2af1-6a9d-4bb4-b6c1-b210303e3138 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.280484 Oct 27 18:55:35.303815 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1257/2482] 10.222.0.42 () {60 vars in 1195 bytes} [Thu Oct 27 18:55:35 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:55:35.309501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1ec65709-1a5a-4a30-b274-6ab68797badf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc873278160>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:35.394943 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-232f3a88-eaa6-4df2-8478-9fbe11cebc2b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.359628 Oct 27 18:55:35.395612 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1226/2483] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:55:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:55:35.469345 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1ec65709-1a5a-4a30-b274-6ab68797badf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.163614 Oct 27 18:55:35.473213 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1258/2484] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:35 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:35.478033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2e768460-62b2-45a1-87a8-c868370998e3 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:35.487897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2e768460-62b2-45a1-87a8-c868370998e3 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:35.497328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e768460-62b2-45a1-87a8-c868370998e3 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:35.500413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e768460-62b2-45a1-87a8-c868370998e3 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:35.507442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e768460-62b2-45a1-87a8-c868370998e3 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:35.508574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e768460-62b2-45a1-87a8-c868370998e3 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:35.509060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e768460-62b2-45a1-87a8-c868370998e3 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:35.509501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e768460-62b2-45a1-87a8-c868370998e3 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:35.835398 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2e768460-62b2-45a1-87a8-c868370998e3 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1646 microversion: 2.1 time: 0.360882 Oct 27 18:55:35.835989 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1259/2485] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:35 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1646 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:36.043136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-128907284", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "ca696adc-fd95-4178-b629-4c41843e63fc"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:36.234429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] validate_networks() for [('ca696adc-fd95-4178-b629-4c41843e63fc', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:55:36.389516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1048239010", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "d9372e57-a1c3-4d9c-a175-c41e9e866931"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:36.539122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] validate_networks() for [('d9372e57-a1c3-4d9c-a175-c41e9e866931', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:55:37.021197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:55:37.025167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:55:37.025730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:55:37.026257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:55:37.026989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:55:37.041951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:37.054915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:37.056363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:37.061334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:37.071227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:37.071698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:37.120500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Getting quotas for project 7b041a3368a34a02ab30267164853ef6. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:55:37.126888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Getting quotas for user 74accb869c48434ab1aa5452d6b0f13e and project 7b041a3368a34a02ab30267164853ef6. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:55:37.141263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:55:37.144238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:55:37.220173 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6a552388-a42a-47b6-b9b3-0e42a54bbc30 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.820045 Oct 27 18:55:37.221610 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1227/2486] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:55:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:55:37.226457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-37b0148c-4e74-4ba6-b8a9-b881eafa0da4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:37.227555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-37b0148c-4e74-4ba6-b8a9-b881eafa0da4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:37.234314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37b0148c-4e74-4ba6-b8a9-b881eafa0da4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:37.235071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37b0148c-4e74-4ba6-b8a9-b881eafa0da4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:37.236100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37b0148c-4e74-4ba6-b8a9-b881eafa0da4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:37.237366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37b0148c-4e74-4ba6-b8a9-b881eafa0da4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:37.238267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37b0148c-4e74-4ba6-b8a9-b881eafa0da4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:37.238944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37b0148c-4e74-4ba6-b8a9-b881eafa0da4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:37.585998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-37b0148c-4e74-4ba6-b8a9-b881eafa0da4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:37.615574 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-37b0148c-4e74-4ba6-b8a9-b881eafa0da4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.387125 Oct 27 18:55:37.619330 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1228/2487] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:37 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:37.648136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:55:37.648678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:55:37.649024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:55:37.649437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:55:37.649850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:55:37.670758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:37.671680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:37.672291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:37.673442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:37.674649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:37.675350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:37.716893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Getting quotas for project ea27d7d92d7d4710910d0c6d168a06ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:55:37.729849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Getting quotas for user 3370465598e14b9191691d6fbd21ff68 and project ea27d7d92d7d4710910d0c6d168a06ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:55:37.769316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:55:37.771710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:55:37.873066 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-64412498-0b47-4565-ba0d-9347c58791b8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.033221 Oct 27 18:55:37.873723 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1260/2488] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 18:55:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2034 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 18:55:37.892108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-151a8d5d-e928-48db-946c-50c57f6a568c tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Action: 'create', calling method: .version_select at 0x7fc873365940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1235573820", "description": "tempest-description-2009993538"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:38.245380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-eb2b38a1-59df-4dd5-abff-b1674a97bea5 req-4f64c8e8-0df8-465c-9873-28641dfa9810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b6f25f-ce24-45c5-b633-6a36808a0540", "name": "network-vif-deleted", "tag": "1e5c551d-9e29-4371-a23d-08f3b6b96e56"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:38.268884 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-151a8d5d-e928-48db-946c-50c57f6a568c tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.380455 Oct 27 18:55:38.269565 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1261/2489] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:55:37 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:38.274198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1f0f12a9-c760-41ec-94f9-e86dd72f9ab0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:38.274835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1f0f12a9-c760-41ec-94f9-e86dd72f9ab0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:38.294095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f0f12a9-c760-41ec-94f9-e86dd72f9ab0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:38.294700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f0f12a9-c760-41ec-94f9-e86dd72f9ab0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:38.295146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f0f12a9-c760-41ec-94f9-e86dd72f9ab0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:38.295848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f0f12a9-c760-41ec-94f9-e86dd72f9ab0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:38.301104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-eb2b38a1-59df-4dd5-abff-b1674a97bea5 req-4f64c8e8-0df8-465c-9873-28641dfa9810 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:38.301876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f0f12a9-c760-41ec-94f9-e86dd72f9ab0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:38.302336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f0f12a9-c760-41ec-94f9-e86dd72f9ab0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:38.305414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-eb2b38a1-59df-4dd5-abff-b1674a97bea5 req-4f64c8e8-0df8-465c-9873-28641dfa9810 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:38.307305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-eb2b38a1-59df-4dd5-abff-b1674a97bea5 req-4f64c8e8-0df8-465c-9873-28641dfa9810 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:38.374220 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-eb2b38a1-59df-4dd5-abff-b1674a97bea5 req-4f64c8e8-0df8-465c-9873-28641dfa9810 service nova] Creating event network-vif-deleted:1e5c551d-9e29-4371-a23d-08f3b6b96e56 for instance f3b6f25f-ce24-45c5-b633-6a36808a0540 on n-h2-860687-3 Oct 27 18:55:38.402225 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-eb2b38a1-59df-4dd5-abff-b1674a97bea5 req-4f64c8e8-0df8-465c-9873-28641dfa9810 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.779637 Oct 27 18:55:38.415104 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1229/2490] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:38.437635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3828ac73-3e77-4879-a827-1c5c2f5289f7 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:38.465550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1f0f12a9-c760-41ec-94f9-e86dd72f9ab0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:38.466096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3828ac73-3e77-4879-a827-1c5c2f5289f7 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:38.471903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3828ac73-3e77-4879-a827-1c5c2f5289f7 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:38.475059 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1f0f12a9-c760-41ec-94f9-e86dd72f9ab0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1269 microversion: 2.1 time: 0.204449 Oct 27 18:55:38.476962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3828ac73-3e77-4879-a827-1c5c2f5289f7 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:38.478091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3828ac73-3e77-4879-a827-1c5c2f5289f7 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:38.479884 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1262/2491] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:38 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1269 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:38.483499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3828ac73-3e77-4879-a827-1c5c2f5289f7 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:38.488440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3828ac73-3e77-4879-a827-1c5c2f5289f7 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:38.489217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-39d116e5-8121-4ad0-a3cd-19d205004670 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc8732c3e50>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:38.556729 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-39d116e5-8121-4ad0-a3cd-19d205004670 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.075274 Oct 27 18:55:38.557596 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1263/2492] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:38 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:38.578596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-98e2e01a-1c9c-4eae-9a23-4f87d88ed54c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:38.581646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-98e2e01a-1c9c-4eae-9a23-4f87d88ed54c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:38.595142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e2e01a-1c9c-4eae-9a23-4f87d88ed54c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:38.596881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e2e01a-1c9c-4eae-9a23-4f87d88ed54c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:38.599132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e2e01a-1c9c-4eae-9a23-4f87d88ed54c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:38.612980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e2e01a-1c9c-4eae-9a23-4f87d88ed54c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:38.613797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e2e01a-1c9c-4eae-9a23-4f87d88ed54c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:38.617280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e2e01a-1c9c-4eae-9a23-4f87d88ed54c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:38.635334 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3828ac73-3e77-4879-a827-1c5c2f5289f7 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.216982 Oct 27 18:55:38.636585 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1230/2493] 10.222.0.42 () {58 vars in 1176 bytes} [Thu Oct 27 18:55:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:38.641672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-16b42bde-6543-4bbd-a9bf-a2fed3119bd5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:38.644463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-16b42bde-6543-4bbd-a9bf-a2fed3119bd5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 087c897c-12a5-45fb-a383-76637e34146f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:38.652733 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-16b42bde-6543-4bbd-a9bf-a2fed3119bd5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 087c897c-12a5-45fb-a383-76637e34146f could not be found. Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-16b42bde-6543-4bbd-a9bf-a2fed3119bd5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/087c897c-12a5-45fb-a383-76637e34146f/action HTTP/1.1 Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 28 Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: {"reboot": {"type": "SOFT"}} Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 087c897c-12a5-45fb-a383-76637e34146f could not be found. Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '087c897c-12a5-45fb-a383-76637e34146f', 'body': {'reboot': {'type': 'SOFT'}}} Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 087c897c-12a5-45fb-a383-76637e34146f could not be found. Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 087c897c-12a5-45fb-a383-76637e34146f could not be found. Oct 27 18:55:38.654758 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:38.659112 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:38.659112 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:38.659112 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:38.659112 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:38.659112 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:38.659112 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:38.659112 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:38.659112 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 087c897c-12a5-45fb-a383-76637e34146f could not be found. Oct 27 18:55:38.659112 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:38.661451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-16b42bde-6543-4bbd-a9bf-a2fed3119bd5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 087c897c-12a5-45fb-a383-76637e34146f could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:38.664671 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-16b42bde-6543-4bbd-a9bf-a2fed3119bd5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/087c897c-12a5-45fb-a383-76637e34146f/action" status: 404 len: 111 microversion: 2.1 time: 0.024881 Oct 27 18:55:38.665752 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1231/2494] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:38 2022] POST /compute/v2.1/servers/087c897c-12a5-45fb-a383-76637e34146f/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:38.671266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5745155f-789a-4867-94cc-fa6ea2b62328 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:38.672145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5745155f-789a-4867-94cc-fa6ea2b62328 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:38.736515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5745155f-789a-4867-94cc-fa6ea2b62328 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:38.749673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5745155f-789a-4867-94cc-fa6ea2b62328 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:38.753429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5745155f-789a-4867-94cc-fa6ea2b62328 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:38.757630 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5745155f-789a-4867-94cc-fa6ea2b62328 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 200 len: 1259 microversion: 2.21 time: 0.090575 Oct 27 18:55:38.758897 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1232/2495] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:55:38 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 1259 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:55:38.764090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8d283aa8-9870-4c13-9f7f-4ad83fce0168 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Action: 'create', calling method: .version_select at 0x7fc869dc6700>, body: {"security_group_rule": {"parent_group_id": "388d4b6a-a527-44f4-bb38-196743883ee2", "ip_protocol": "tcp", "from_port": 22, "to_port": 268503128}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:38.962903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-98e2e01a-1c9c-4eae-9a23-4f87d88ed54c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74accb869c48434ab1aa5452d6b0f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b041a3368a34a02ab30267164853ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:38.983624 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-8d283aa8-9870-4c13-9f7f-4ad83fce0168 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] HTTP exception thrown: Invalid port range 22:268503128. Valid TCP ports should be between 1-65535 Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8d283aa8-9870-4c13-9f7f-4ad83fce0168 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Request method failure captured: Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 145 Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtQaiV2mJREBiE-vDiOeVbGTxhxargBs74hmsOjmM0N2q7gEaTxxTZWgkxf2wU17jxpOiCb1LSAXilvgJqlb8kDdgkLJAoQAJ6PW0yz1WqvVOlSVu4_8bmvR27WxauGkm89rrGjnJvGL8-i8p_gVbm8ge3DiCKPPy_Qj38gPE6nc60U Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e35c6f361a784066896f169831c91e95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e35c6f361a784066896f169831c91e95", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2e5c12033a6e4b2890dabd39fa9b2b98 Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: {"security_group_rule": {"parent_group_id": "388d4b6a-a527-44f4-bb38-196743883ee2", "ip_protocol": "tcp", "from_port": 22, "to_port": 268503128}} Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid port range 22:268503128. Valid TCP ports should be between 1-65535 Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'security_group_rule': {'parent_group_id': '388d4b6a-a527-44f4-bb38-196743883ee2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 268503128}}} Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:268503128. Valid TCP ports should be between 1-65535 Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:268503128. Valid TCP ports should be between 1-65535 Oct 27 18:55:38.985834 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:38.989991 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:38.989991 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:38.989991 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:38.989991 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:38.989991 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:38.989991 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:38.989991 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:38.989991 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:268503128. Valid TCP ports should be between 1-65535 Oct 27 18:55:38.989991 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:38.992159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8d283aa8-9870-4c13-9f7f-4ad83fce0168 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Returning 400 to user: Invalid port range 22:268503128. Valid TCP ports should be between 1-65535 {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:38.993421 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8d283aa8-9870-4c13-9f7f-4ad83fce0168 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.233328 Oct 27 18:55:39.000432 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1233/2496] 10.222.0.42 () {60 vars in 1195 bytes} [Thu Oct 27 18:55:38 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:55:39.003435 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-98e2e01a-1c9c-4eae-9a23-4f87d88ed54c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 200 len: 1219 microversion: 2.1 time: 0.428976 Oct 27 18:55:39.005994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d37a6c71-ee08-46ee-bd8f-99febf4c0757 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860687-3", "block_migration": true, "disk_over_commit": false}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:39.010572 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1264/2497] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:38 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 1219 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:39.011627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d37a6c71-ee08-46ee-bd8f-99febf4c0757 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:39.027789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4e39ded0-c1a7-43fe-95a1-d7437f6a4bd7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:39.028422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4e39ded0-c1a7-43fe-95a1-d7437f6a4bd7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:39.045128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d37a6c71-ee08-46ee-bd8f-99febf4c0757 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:39.046750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d37a6c71-ee08-46ee-bd8f-99febf4c0757 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:39.050396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d37a6c71-ee08-46ee-bd8f-99febf4c0757 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:39.051493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d37a6c71-ee08-46ee-bd8f-99febf4c0757 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:39.053327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d37a6c71-ee08-46ee-bd8f-99febf4c0757 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:39.056424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e39ded0-c1a7-43fe-95a1-d7437f6a4bd7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:39.057001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e39ded0-c1a7-43fe-95a1-d7437f6a4bd7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:39.057483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d37a6c71-ee08-46ee-bd8f-99febf4c0757 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:39.057701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e39ded0-c1a7-43fe-95a1-d7437f6a4bd7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:39.058239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e39ded0-c1a7-43fe-95a1-d7437f6a4bd7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:39.058790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e39ded0-c1a7-43fe-95a1-d7437f6a4bd7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:39.059253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e39ded0-c1a7-43fe-95a1-d7437f6a4bd7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:39.137713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-d37a6c71-ee08-46ee-bd8f-99febf4c0757 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lazy-loading 'flavor' on Instance uuid 592bd675-3b12-4ab8-8e8f-be99ea57e702 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:55:39.178963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d37a6c71-ee08-46ee-bd8f-99febf4c0757 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Going to try to live migrate instance to n-h2-860687-3 {{(pid=127028) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 18:55:39.566480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4e39ded0-c1a7-43fe-95a1-d7437f6a4bd7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:39.576148 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4e39ded0-c1a7-43fe-95a1-d7437f6a4bd7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.564426 Oct 27 18:55:39.580991 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1265/2498] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:39 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:39.591088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7984c83a-65dc-42e5-9abc-3235837e33f1 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Action: 'create', calling method: .version_select at 0x7fc873365a60>, body: {"security_group_rule": {"parent_group_id": "92d73155-f8d1-4b9f-ba85-fa2538a2a868", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:39.633668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-7984c83a-65dc-42e5-9abc-3235837e33f1 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 92d73155-f8d1-4b9f-ba85-fa2538a2a868 does not exist", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:55:39.634582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.security_group_api [None req-7984c83a-65dc-42e5-9abc-3235837e33f1 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Neutron security group 92d73155-f8d1-4b9f-ba85-fa2538a2a868 not found {{(pid=127029) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 18:55:39.635393 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-7984c83a-65dc-42e5-9abc-3235837e33f1 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] HTTP exception thrown: Security group 92d73155-f8d1-4b9f-ba85-fa2538a2a868 does not exist Oct 27 18:55:39.635393 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-1695a625-19c3-457b-9388-5f15a1f4e81a'] Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7984c83a-65dc-42e5-9abc-3235837e33f1 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Request method failure captured: Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 138 Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtQaiV2mJREBiE-vDiOeVbGTxhxargBs74hmsOjmM0N2q7gEaTxxTZWgkxf2wU17jxpOiCb1LSAXilvgJqlb8kDdgkLJAoQAJ6PW0yz1WqvVOlSVu4_8bmvR27WxauGkm89rrGjnJvGL8-i8p_gVbm8ge3DiCKPPy_Qj38gPE6nc60U Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e35c6f361a784066896f169831c91e95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e35c6f361a784066896f169831c91e95", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2e5c12033a6e4b2890dabd39fa9b2b98 Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: {"security_group_rule": {"parent_group_id": "92d73155-f8d1-4b9f-ba85-fa2538a2a868", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: exception: Security group 92d73155-f8d1-4b9f-ba85-fa2538a2a868 does not exist Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-1695a625-19c3-457b-9388-5f15a1f4e81a'] Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'body': {'security_group_rule': {'parent_group_id': '92d73155-f8d1-4b9f-ba85-fa2538a2a868', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:55:39.638689 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 92d73155-f8d1-4b9f-ba85-fa2538a2a868 does not exist Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1695a625-19c3-457b-9388-5f15a1f4e81a'] Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 92d73155-f8d1-4b9f-ba85-fa2538a2a868 does not exist Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1695a625-19c3-457b-9388-5f15a1f4e81a'] Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 92d73155-f8d1-4b9f-ba85-fa2538a2a868 does not exist Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1695a625-19c3-457b-9388-5f15a1f4e81a'] Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 92d73155-f8d1-4b9f-ba85-fa2538a2a868 does not exist Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1695a625-19c3-457b-9388-5f15a1f4e81a'] Oct 27 18:55:39.643668 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:39.648888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7984c83a-65dc-42e5-9abc-3235837e33f1 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Returning 404 to user: Security group 92d73155-f8d1-4b9f-ba85-fa2538a2a868 does not exist Oct 27 18:55:39.648888 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-1695a625-19c3-457b-9388-5f15a1f4e81a'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:39.650190 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7984c83a-65dc-42e5-9abc-3235837e33f1 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.067869 Oct 27 18:55:39.652890 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1266/2499] 10.222.0.42 () {60 vars in 1195 bytes} [Thu Oct 27 18:55:39 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:39.664912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b34ccdcf-5a95-4a0a-bc2a-d783613be452 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:39.672193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b34ccdcf-5a95-4a0a-bc2a-d783613be452 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:39.689172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b34ccdcf-5a95-4a0a-bc2a-d783613be452 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:39.691251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b34ccdcf-5a95-4a0a-bc2a-d783613be452 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:39.691716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b34ccdcf-5a95-4a0a-bc2a-d783613be452 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:39.692456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b34ccdcf-5a95-4a0a-bc2a-d783613be452 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:39.692931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b34ccdcf-5a95-4a0a-bc2a-d783613be452 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:39.693374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b34ccdcf-5a95-4a0a-bc2a-d783613be452 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:39.834356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b34ccdcf-5a95-4a0a-bc2a-d783613be452 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:39.846368 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b34ccdcf-5a95-4a0a-bc2a-d783613be452 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1275 microversion: 2.1 time: 0.187110 Oct 27 18:55:39.847016 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1267/2500] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:39 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1275 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:39.863871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3117fc21-7a49-4ad2-84e5-a10cb59fa7ea tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc8732c34c0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:40.464065 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3117fc21-7a49-4ad2-84e5-a10cb59fa7ea tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.615973 Oct 27 18:55:40.467124 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1268/2501] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:39 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:40.487199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-15e140ed-c0fc-492d-be51-f8456b9b4cdc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:40.488310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-15e140ed-c0fc-492d-be51-f8456b9b4cdc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:40.497965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-15e140ed-c0fc-492d-be51-f8456b9b4cdc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:40.504274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-15e140ed-c0fc-492d-be51-f8456b9b4cdc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:40.505129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-15e140ed-c0fc-492d-be51-f8456b9b4cdc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:40.507718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-15e140ed-c0fc-492d-be51-f8456b9b4cdc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:40.508510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-15e140ed-c0fc-492d-be51-f8456b9b4cdc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:40.515138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-15e140ed-c0fc-492d-be51-f8456b9b4cdc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:40.934725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-15e140ed-c0fc-492d-be51-f8456b9b4cdc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:40.945096 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-15e140ed-c0fc-492d-be51-f8456b9b4cdc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.476523 Oct 27 18:55:40.963264 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1269/2502] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:40 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:40.974331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-271c4479-9ea0-4edf-a9c7-92ad9d8cbc73 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Calling method '.version_select at 0x7fc873278280>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:41.175491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG neutronclient.v2_0.client [None req-271c4479-9ea0-4edf-a9c7-92ad9d8cbc73 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule c290185c-7a02-4848-8c68-9b9f6360c256 does not exist", "detail": ""}} {{(pid=127029) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 18:55:41.176096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.security_group_api [None req-271c4479-9ea0-4edf-a9c7-92ad9d8cbc73 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Neutron security group rule c290185c-7a02-4848-8c68-9b9f6360c256 not found {{(pid=127029) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 27 18:55:41.176628 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-271c4479-9ea0-4edf-a9c7-92ad9d8cbc73 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] HTTP exception thrown: Security group rule c290185c-7a02-4848-8c68-9b9f6360c256 does not exist Oct 27 18:55:41.176628 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-6080902a-e49e-47ca-9ec1-cb1ebd72c0a2'] Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-271c4479-9ea0-4edf-a9c7-92ad9d8cbc73 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Request method failure captured: Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-security-group-rules/c290185c-7a02-4848-8c68-9b9f6360c256 HTTP/1.1 Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtQaiV2mJREBiE-vDiOeVbGTxhxargBs74hmsOjmM0N2q7gEaTxxTZWgkxf2wU17jxpOiCb1LSAXilvgJqlb8kDdgkLJAoQAJ6PW0yz1WqvVOlSVu4_8bmvR27WxauGkm89rrGjnJvGL8-i8p_gVbm8ge3DiCKPPy_Qj38gPE6nc60U Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e35c6f361a784066896f169831c91e95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e35c6f361a784066896f169831c91e95", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e35c6f361a784066896f169831c91e95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: e35c6f361a784066896f169831c91e95 Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768 Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2e5c12033a6e4b2890dabd39fa9b2b98 Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-160398768-project Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: exception: Security group rule c290185c-7a02-4848-8c68-9b9f6360c256 does not exist Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-6080902a-e49e-47ca-9ec1-cb1ebd72c0a2'] Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'c290185c-7a02-4848-8c68-9b9f6360c256'} Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 18:55:41.178506 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule c290185c-7a02-4848-8c68-9b9f6360c256 does not exist Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6080902a-e49e-47ca-9ec1-cb1ebd72c0a2'] Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule c290185c-7a02-4848-8c68-9b9f6360c256 does not exist Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6080902a-e49e-47ca-9ec1-cb1ebd72c0a2'] Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule c290185c-7a02-4848-8c68-9b9f6360c256 does not exist Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6080902a-e49e-47ca-9ec1-cb1ebd72c0a2'] Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule c290185c-7a02-4848-8c68-9b9f6360c256 does not exist Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6080902a-e49e-47ca-9ec1-cb1ebd72c0a2'] Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-271c4479-9ea0-4edf-a9c7-92ad9d8cbc73 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Returning 404 to user: Security group rule c290185c-7a02-4848-8c68-9b9f6360c256 does not exist Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: Neutron server returns request_ids: ['req-6080902a-e49e-47ca-9ec1-cb1ebd72c0a2'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:41.183385 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-271c4479-9ea0-4edf-a9c7-92ad9d8cbc73 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-group-rules/c290185c-7a02-4848-8c68-9b9f6360c256" status: 404 len: 199 microversion: 2.1 time: 0.215313 Oct 27 18:55:41.189216 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1270/2503] 10.222.0.42 () {58 vars in 1287 bytes} [Thu Oct 27 18:55:40 2022] DELETE /compute/v2.1/os-security-group-rules/c290185c-7a02-4848-8c68-9b9f6360c256 => generated 199 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:41.204356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-98ae747e-f786-424f-a7d0-eb1fedc3e463 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:41.204984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-98ae747e-f786-424f-a7d0-eb1fedc3e463 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:41.247048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98ae747e-f786-424f-a7d0-eb1fedc3e463 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:41.247941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98ae747e-f786-424f-a7d0-eb1fedc3e463 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:41.248612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98ae747e-f786-424f-a7d0-eb1fedc3e463 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:41.249440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98ae747e-f786-424f-a7d0-eb1fedc3e463 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:41.249987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98ae747e-f786-424f-a7d0-eb1fedc3e463 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:41.251821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98ae747e-f786-424f-a7d0-eb1fedc3e463 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:41.455765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-98ae747e-f786-424f-a7d0-eb1fedc3e463 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:41.465386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-98ae747e-f786-424f-a7d0-eb1fedc3e463 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:41.466900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-98ae747e-f786-424f-a7d0-eb1fedc3e463 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:41.468446 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-98ae747e-f786-424f-a7d0-eb1fedc3e463 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 200 len: 1317 microversion: 2.21 time: 0.281451 Oct 27 18:55:41.468583 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1271/2504] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:55:41 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:55:41.495210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a3689406-f58c-484a-806f-2a0ab629e33c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:41.495834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a3689406-f58c-484a-806f-2a0ab629e33c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:41.543352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3689406-f58c-484a-806f-2a0ab629e33c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:41.547125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3689406-f58c-484a-806f-2a0ab629e33c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:41.548591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3689406-f58c-484a-806f-2a0ab629e33c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:41.559406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3689406-f58c-484a-806f-2a0ab629e33c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:41.560006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3689406-f58c-484a-806f-2a0ab629e33c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:41.560538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3689406-f58c-484a-806f-2a0ab629e33c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:41.787287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a3689406-f58c-484a-806f-2a0ab629e33c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74accb869c48434ab1aa5452d6b0f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b041a3368a34a02ab30267164853ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:41.794465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:41.796811 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a3689406-f58c-484a-806f-2a0ab629e33c tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 200 len: 1273 microversion: 2.1 time: 0.327208 Oct 27 18:55:41.809142 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1272/2505] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:41 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 1273 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:41.839715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7415f287-c29d-440f-b17f-1216187253e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:41.840626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7415f287-c29d-440f-b17f-1216187253e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:41.850323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7415f287-c29d-440f-b17f-1216187253e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:41.881574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7415f287-c29d-440f-b17f-1216187253e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:41.885247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7415f287-c29d-440f-b17f-1216187253e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:41.887312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7415f287-c29d-440f-b17f-1216187253e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:41.896490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7415f287-c29d-440f-b17f-1216187253e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:41.898989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7415f287-c29d-440f-b17f-1216187253e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:42.113056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7415f287-c29d-440f-b17f-1216187253e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:42.125212 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7415f287-c29d-440f-b17f-1216187253e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1275 microversion: 2.1 time: 0.292442 Oct 27 18:55:42.133749 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1273/2506] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:41 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1275 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:42.151908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-49027d07-ddd2-4a7f-9278-023d6f8f02fd tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:42.161243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-49027d07-ddd2-4a7f-9278-023d6f8f02fd tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:42.190753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49027d07-ddd2-4a7f-9278-023d6f8f02fd tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:42.191832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49027d07-ddd2-4a7f-9278-023d6f8f02fd tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:42.192443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49027d07-ddd2-4a7f-9278-023d6f8f02fd tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:42.193359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49027d07-ddd2-4a7f-9278-023d6f8f02fd tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:42.193995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49027d07-ddd2-4a7f-9278-023d6f8f02fd tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:42.195732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49027d07-ddd2-4a7f-9278-023d6f8f02fd tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:42.241321 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-49027d07-ddd2-4a7f-9278-023d6f8f02fd tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-49027d07-ddd2-4a7f-9278-023d6f8f02fd tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a/action HTTP/1.1 Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 65 Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: {"rebuild": {"imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00"}} Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '263ba238-b675-4ae7-a469-ced7d67f016a', 'body': {'rebuild': {'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00'}}} Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 27 18:55:42.253358 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-49027d07-ddd2-4a7f-9278-023d6f8f02fd tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-49027d07-ddd2-4a7f-9278-023d6f8f02fd tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a/action" status: 404 len: 111 microversion: 2.1 time: 0.120311 Oct 27 18:55:42.258633 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1274/2507] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:42 2022] POST /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a/action => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:42.272439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dc60c3e3-a23e-4593-8d4f-b9b3ec5fc6cf tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Calling method '.version_select at 0x7fc8733455e0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:43.134937 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dc60c3e3-a23e-4593-8d4f-b9b3ec5fc6cf tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/388d4b6a-a527-44f4-bb38-196743883ee2" status: 202 len: 0 microversion: 2.1 time: 0.877711 Oct 27 18:55:43.138430 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1275/2508] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:55:42 2022] DELETE /compute/v2.1/os-security-groups/388d4b6a-a527-44f4-bb38-196743883ee2 => generated 0 bytes in 879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:55:43.140868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eebfa6cb-3ce6-42f2-aa9f-5ac088806814 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a9faf70>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:43.242757 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eebfa6cb-3ce6-42f2-aa9f-5ac088806814 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.106053 Oct 27 18:55:43.244190 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1276/2509] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:43 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:43.257432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-040a9172-dccc-47d6-b684-2aebb2e7b00d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:43.259221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-040a9172-dccc-47d6-b684-2aebb2e7b00d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:43.285734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-040a9172-dccc-47d6-b684-2aebb2e7b00d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:43.287176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-040a9172-dccc-47d6-b684-2aebb2e7b00d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:43.292864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-040a9172-dccc-47d6-b684-2aebb2e7b00d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:43.294914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-040a9172-dccc-47d6-b684-2aebb2e7b00d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:43.299087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-040a9172-dccc-47d6-b684-2aebb2e7b00d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:43.302870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-040a9172-dccc-47d6-b684-2aebb2e7b00d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:44.030722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-040a9172-dccc-47d6-b684-2aebb2e7b00d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:44.042135 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-040a9172-dccc-47d6-b684-2aebb2e7b00d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.795715 Oct 27 18:55:44.042983 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1277/2510] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:43 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:44.056057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ddb9c70e-130a-4c9f-8183-efd7fd864ef4 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:44.056898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ddb9c70e-130a-4c9f-8183-efd7fd864ef4 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:44.072374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ddb9c70e-130a-4c9f-8183-efd7fd864ef4 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:44.076566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ddb9c70e-130a-4c9f-8183-efd7fd864ef4 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:44.077255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ddb9c70e-130a-4c9f-8183-efd7fd864ef4 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:44.078171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ddb9c70e-130a-4c9f-8183-efd7fd864ef4 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:44.078830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ddb9c70e-130a-4c9f-8183-efd7fd864ef4 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:44.081541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ddb9c70e-130a-4c9f-8183-efd7fd864ef4 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:44.473620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ddb9c70e-130a-4c9f-8183-efd7fd864ef4 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:44.488174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ddb9c70e-130a-4c9f-8183-efd7fd864ef4 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:44.489865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ddb9c70e-130a-4c9f-8183-efd7fd864ef4 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:44.491088 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ddb9c70e-130a-4c9f-8183-efd7fd864ef4 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 200 len: 1359 microversion: 2.21 time: 0.445381 Oct 27 18:55:44.491664 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1278/2511] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:55:44 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 1359 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:55:44.511635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e345c9b-27be-46cf-a197-ea1abf6f592b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:44.512382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6e345c9b-27be-46cf-a197-ea1abf6f592b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:44.521860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e345c9b-27be-46cf-a197-ea1abf6f592b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:44.522417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e345c9b-27be-46cf-a197-ea1abf6f592b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:44.523076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e345c9b-27be-46cf-a197-ea1abf6f592b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:44.523812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e345c9b-27be-46cf-a197-ea1abf6f592b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:44.524277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e345c9b-27be-46cf-a197-ea1abf6f592b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:44.524875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e345c9b-27be-46cf-a197-ea1abf6f592b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:45.334926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6e345c9b-27be-46cf-a197-ea1abf6f592b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74accb869c48434ab1aa5452d6b0f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b041a3368a34a02ab30267164853ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:45.344716 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6e345c9b-27be-46cf-a197-ea1abf6f592b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 200 len: 1315 microversion: 2.1 time: 0.849633 Oct 27 18:55:45.351038 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1279/2512] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:44 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 1315 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:45.365512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-90945228-ff4b-45c3-9d61-a7e938332e5d tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Calling method '.version_select at 0x7fc873290700>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:45.640371 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d37a6c71-ee08-46ee-bd8f-99febf4c0757 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702/action" status: 202 len: 0 microversion: 2.1 time: 6.638429 Oct 27 18:55:45.642011 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1234/2513] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:39 2022] POST /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702/action => generated 0 bytes in 6641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:55:45.649237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ed2609b-bc88-4002-8ba3-00c86da9e118 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:45.650140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3ed2609b-bc88-4002-8ba3-00c86da9e118 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:45.683949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:45.691347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ed2609b-bc88-4002-8ba3-00c86da9e118 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:45.694262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ed2609b-bc88-4002-8ba3-00c86da9e118 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:45.694990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ed2609b-bc88-4002-8ba3-00c86da9e118 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:45.698481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ed2609b-bc88-4002-8ba3-00c86da9e118 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:45.699767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ed2609b-bc88-4002-8ba3-00c86da9e118 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:45.701614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ed2609b-bc88-4002-8ba3-00c86da9e118 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:46.130655 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-90945228-ff4b-45c3-9d61-a7e938332e5d tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/fc1276fb-9570-4419-b0b3-9eba39307374" status: 202 len: 0 microversion: 2.1 time: 0.776403 Oct 27 18:55:46.132335 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1280/2514] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:55:45 2022] DELETE /compute/v2.1/os-security-groups/fc1276fb-9570-4419-b0b3-9eba39307374 => generated 0 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:55:46.139095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dd96a14a-d07b-44b5-a161-13abd91a811d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:46.140184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dd96a14a-d07b-44b5-a161-13abd91a811d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:46.161212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd96a14a-d07b-44b5-a161-13abd91a811d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:46.161787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd96a14a-d07b-44b5-a161-13abd91a811d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:46.163281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd96a14a-d07b-44b5-a161-13abd91a811d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:46.165642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd96a14a-d07b-44b5-a161-13abd91a811d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:46.166345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd96a14a-d07b-44b5-a161-13abd91a811d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:46.169471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd96a14a-d07b-44b5-a161-13abd91a811d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:46.327109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ed2609b-bc88-4002-8ba3-00c86da9e118 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:46.340047 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3ed2609b-bc88-4002-8ba3-00c86da9e118 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1317 microversion: 2.1 time: 0.695122 Oct 27 18:55:46.344114 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1235/2515] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:45 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1317 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:46.356667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-569a34ea-2a50-4e95-bb9e-5570f2ee0ddd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc869da4d30>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:46.433225 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-569a34ea-2a50-4e95-bb9e-5570f2ee0ddd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.082265 Oct 27 18:55:46.436349 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1236/2516] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:46 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:46.716268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dd96a14a-d07b-44b5-a161-13abd91a811d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:46.730692 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dd96a14a-d07b-44b5-a161-13abd91a811d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.596718 Oct 27 18:55:46.737961 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1281/2517] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:46 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:46.763412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3f8006c6-6f48-4d2f-aed6-a58b79b38d49 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:46.764110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3f8006c6-6f48-4d2f-aed6-a58b79b38d49 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:46.773706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f8006c6-6f48-4d2f-aed6-a58b79b38d49 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:46.774206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f8006c6-6f48-4d2f-aed6-a58b79b38d49 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:46.774706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f8006c6-6f48-4d2f-aed6-a58b79b38d49 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:46.777403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f8006c6-6f48-4d2f-aed6-a58b79b38d49 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:46.777879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f8006c6-6f48-4d2f-aed6-a58b79b38d49 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:46.778318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f8006c6-6f48-4d2f-aed6-a58b79b38d49 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:46.807812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-5f7e6f13-e07a-46e6-8a12-8a3fc6848c55 req-a655ad8d-830b-4bfe-95de-eecda87a407c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3ab523-37c4-46bc-ab91-975da6d3807f", "tag": "fa3593d4-3151-4370-bc45-3ffbb894137b"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:46.847008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5f7e6f13-e07a-46e6-8a12-8a3fc6848c55 req-a655ad8d-830b-4bfe-95de-eecda87a407c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:46.848999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5f7e6f13-e07a-46e6-8a12-8a3fc6848c55 req-a655ad8d-830b-4bfe-95de-eecda87a407c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:46.850072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5f7e6f13-e07a-46e6-8a12-8a3fc6848c55 req-a655ad8d-830b-4bfe-95de-eecda87a407c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:46.866611 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5f7e6f13-e07a-46e6-8a12-8a3fc6848c55 req-a655ad8d-830b-4bfe-95de-eecda87a407c service nova] Creating event network-changed:fa3593d4-3151-4370-bc45-3ffbb894137b for instance 3b3ab523-37c4-46bc-ab91-975da6d3807f on n-h1-860687-3 Oct 27 18:55:46.874778 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-5f7e6f13-e07a-46e6-8a12-8a3fc6848c55 req-a655ad8d-830b-4bfe-95de-eecda87a407c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436799 Oct 27 18:55:46.875871 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1237/2518] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:46.885374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-419bb56a-4da3-41a1-8b83-b31404219840 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:46.886771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-419bb56a-4da3-41a1-8b83-b31404219840 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:46.899467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-419bb56a-4da3-41a1-8b83-b31404219840 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:46.901538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-419bb56a-4da3-41a1-8b83-b31404219840 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:46.902845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-419bb56a-4da3-41a1-8b83-b31404219840 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:46.903958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-419bb56a-4da3-41a1-8b83-b31404219840 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:46.904660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-419bb56a-4da3-41a1-8b83-b31404219840 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:46.905345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-419bb56a-4da3-41a1-8b83-b31404219840 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:47.068514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3f8006c6-6f48-4d2f-aed6-a58b79b38d49 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:47.082445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3f8006c6-6f48-4d2f-aed6-a58b79b38d49 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:47.085462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3f8006c6-6f48-4d2f-aed6-a58b79b38d49 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:47.086868 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3f8006c6-6f48-4d2f-aed6-a58b79b38d49 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 200 len: 1359 microversion: 2.21 time: 0.347399 Oct 27 18:55:47.088242 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1282/2519] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:55:46 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 1359 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:55:47.094696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4ffa416d-a3f6-4c28-a982-c8443de870a1 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Calling method '.version_select at 0x7fc87330d550>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:47.148367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-419bb56a-4da3-41a1-8b83-b31404219840 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:47.172364 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-419bb56a-4da3-41a1-8b83-b31404219840 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1505 microversion: 2.1 time: 0.293975 Oct 27 18:55:47.186409 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1238/2520] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:46 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:47.191799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-40631c18-6ce5-4abe-8625-99b6fe14970d tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:47.192657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-40631c18-6ce5-4abe-8625-99b6fe14970d tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:47.200325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40631c18-6ce5-4abe-8625-99b6fe14970d tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:47.200840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40631c18-6ce5-4abe-8625-99b6fe14970d tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:47.201934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40631c18-6ce5-4abe-8625-99b6fe14970d tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:47.202813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40631c18-6ce5-4abe-8625-99b6fe14970d tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:47.203394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40631c18-6ce5-4abe-8625-99b6fe14970d tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:47.203984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40631c18-6ce5-4abe-8625-99b6fe14970d tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:47.217036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:47.511096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-40631c18-6ce5-4abe-8625-99b6fe14970d tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74accb869c48434ab1aa5452d6b0f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b041a3368a34a02ab30267164853ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:47.521347 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-40631c18-6ce5-4abe-8625-99b6fe14970d tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 200 len: 1315 microversion: 2.1 time: 0.345529 Oct 27 18:55:47.522107 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1239/2521] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:47 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:47.543274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2cd80532-925d-4eb4-b761-e06c0e697f4b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:47.566236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2cd80532-925d-4eb4-b761-e06c0e697f4b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 312449ea-2fcb-4cf5-aca4-619f78b79273] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:47.587135 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-2cd80532-925d-4eb4-b761-e06c0e697f4b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 312449ea-2fcb-4cf5-aca4-619f78b79273 could not be found. Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2cd80532-925d-4eb4-b761-e06c0e697f4b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/312449ea-2fcb-4cf5-aca4-619f78b79273/action HTTP/1.1 Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 65 Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: {"rebuild": {"imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00"}} Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 312449ea-2fcb-4cf5-aca4-619f78b79273 could not be found. Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '312449ea-2fcb-4cf5-aca4-619f78b79273', 'body': {'rebuild': {'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00'}}} Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 312449ea-2fcb-4cf5-aca4-619f78b79273 could not be found. Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 18:55:47.588928 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 312449ea-2fcb-4cf5-aca4-619f78b79273 could not be found. Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 312449ea-2fcb-4cf5-aca4-619f78b79273 could not be found. Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2cd80532-925d-4eb4-b761-e06c0e697f4b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 312449ea-2fcb-4cf5-aca4-619f78b79273 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:47.597322 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2cd80532-925d-4eb4-b761-e06c0e697f4b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/312449ea-2fcb-4cf5-aca4-619f78b79273/action" status: 404 len: 111 microversion: 2.1 time: 0.067110 Oct 27 18:55:47.598944 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1240/2522] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:47 2022] POST /compute/v2.1/servers/312449ea-2fcb-4cf5-aca4-619f78b79273/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:47.615275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1566e756-a59c-44c2-99e8-16ea3f043b63 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:47.616000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1566e756-a59c-44c2-99e8-16ea3f043b63 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:47.636106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1566e756-a59c-44c2-99e8-16ea3f043b63 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:47.636625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1566e756-a59c-44c2-99e8-16ea3f043b63 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:47.637074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1566e756-a59c-44c2-99e8-16ea3f043b63 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:47.637789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1566e756-a59c-44c2-99e8-16ea3f043b63 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:47.638246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1566e756-a59c-44c2-99e8-16ea3f043b63 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:47.638703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1566e756-a59c-44c2-99e8-16ea3f043b63 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:47.702212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:47.751536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:47.776519 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4ffa416d-a3f6-4c28-a982-c8443de870a1 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/f9e81b2e-180d-42a2-a827-8574cfec2681" status: 202 len: 0 microversion: 2.1 time: 0.686258 Oct 27 18:55:47.778564 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1283/2523] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:55:47 2022] DELETE /compute/v2.1/os-security-groups/f9e81b2e-180d-42a2-a827-8574cfec2681 => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:55:47.789640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-f2b0fe35-0dcc-4f65-b47a-990d9771c36a req-1e8b23b0-3333-40b9-bd44-297e42e7810c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80613ec8-dbf9-454e-9e15-47efdf0726ae", "tag": "dc049456-2863-4275-b3e7-2f12a235c810"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:47.832503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f2b0fe35-0dcc-4f65-b47a-990d9771c36a req-1e8b23b0-3333-40b9-bd44-297e42e7810c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:47.833250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f2b0fe35-0dcc-4f65-b47a-990d9771c36a req-1e8b23b0-3333-40b9-bd44-297e42e7810c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:47.833710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f2b0fe35-0dcc-4f65-b47a-990d9771c36a req-1e8b23b0-3333-40b9-bd44-297e42e7810c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:47.862204 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-f2b0fe35-0dcc-4f65-b47a-990d9771c36a req-1e8b23b0-3333-40b9-bd44-297e42e7810c service nova] Creating event network-changed:dc049456-2863-4275-b3e7-2f12a235c810 for instance 80613ec8-dbf9-454e-9e15-47efdf0726ae on n-h2-860687-3 Oct 27 18:55:47.903181 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-f2b0fe35-0dcc-4f65-b47a-990d9771c36a req-1e8b23b0-3333-40b9-bd44-297e42e7810c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123080 Oct 27 18:55:47.916375 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1284/2524] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:47.929914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af44be90-4d17-478d-8be6-b44850f85545 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc873278dc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:48.025851 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-af44be90-4d17-478d-8be6-b44850f85545 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.107550 Oct 27 18:55:48.026989 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1285/2525] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:47 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:48.037766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-faf9c24f-3516-436e-91f2-726839d2048f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:48.038901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-faf9c24f-3516-436e-91f2-726839d2048f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:48.046904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faf9c24f-3516-436e-91f2-726839d2048f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:48.047944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faf9c24f-3516-436e-91f2-726839d2048f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:48.049239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faf9c24f-3516-436e-91f2-726839d2048f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:48.050414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faf9c24f-3516-436e-91f2-726839d2048f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:48.051037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faf9c24f-3516-436e-91f2-726839d2048f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:48.051624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faf9c24f-3516-436e-91f2-726839d2048f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:48.365952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-faf9c24f-3516-436e-91f2-726839d2048f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:48.374034 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-faf9c24f-3516-436e-91f2-726839d2048f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.345861 Oct 27 18:55:48.382263 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1286/2526] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:48 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:48.387149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9a96faec-56bb-4d02-8a69-3484c91d1df8 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Calling method '.version_select at 0x7fc86a9fa820>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:48.434161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1566e756-a59c-44c2-99e8-16ea3f043b63 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:48.446035 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1566e756-a59c-44c2-99e8-16ea3f043b63 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1317 microversion: 2.1 time: 0.846144 Oct 27 18:55:48.455648 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1241/2527] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:47 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1317 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:48.471115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-778129db-6f7c-44f8-b2d7-37538340f110 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:48.471986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-778129db-6f7c-44f8-b2d7-37538340f110 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:48.494812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-778129db-6f7c-44f8-b2d7-37538340f110 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:48.497615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-778129db-6f7c-44f8-b2d7-37538340f110 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:48.498309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-778129db-6f7c-44f8-b2d7-37538340f110 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:48.499381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-778129db-6f7c-44f8-b2d7-37538340f110 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:48.501637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-778129db-6f7c-44f8-b2d7-37538340f110 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:48.503356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-778129db-6f7c-44f8-b2d7-37538340f110 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:48.537295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:48.746025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=14 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:48.798594 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9a96faec-56bb-4d02-8a69-3484c91d1df8 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/1c925767-3482-4b17-b452-c013255deb28" status: 202 len: 0 microversion: 2.1 time: 0.415007 Oct 27 18:55:48.800576 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1287/2528] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:55:48 2022] DELETE /compute/v2.1/os-security-groups/1c925767-3482-4b17-b452-c013255deb28 => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:55:48.818468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-18c5f0fa-9e64-4093-b549-a31657e81973 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:48.823617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-18c5f0fa-9e64-4093-b549-a31657e81973 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:48.850738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c5f0fa-9e64-4093-b549-a31657e81973 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:48.851907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c5f0fa-9e64-4093-b549-a31657e81973 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:48.852869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c5f0fa-9e64-4093-b549-a31657e81973 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:48.854854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c5f0fa-9e64-4093-b549-a31657e81973 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:48.855624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c5f0fa-9e64-4093-b549-a31657e81973 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:48.856495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c5f0fa-9e64-4093-b549-a31657e81973 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:49.050987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-18c5f0fa-9e64-4093-b549-a31657e81973 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:49.063874 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-18c5f0fa-9e64-4093-b549-a31657e81973 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1505 microversion: 2.1 time: 0.259624 Oct 27 18:55:49.065732 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1288/2529] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:48 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:49.071808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-89f8b22e-3b76-4be6-93f6-9a6e47d0115b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:49.072696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-89f8b22e-3b76-4be6-93f6-9a6e47d0115b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:49.080713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89f8b22e-3b76-4be6-93f6-9a6e47d0115b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:49.082109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89f8b22e-3b76-4be6-93f6-9a6e47d0115b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:49.082797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89f8b22e-3b76-4be6-93f6-9a6e47d0115b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:49.083753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89f8b22e-3b76-4be6-93f6-9a6e47d0115b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:49.084230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89f8b22e-3b76-4be6-93f6-9a6e47d0115b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:49.084685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89f8b22e-3b76-4be6-93f6-9a6e47d0115b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:49.277975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-89f8b22e-3b76-4be6-93f6-9a6e47d0115b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:49.288747 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-89f8b22e-3b76-4be6-93f6-9a6e47d0115b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.221665 Oct 27 18:55:49.304592 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1289/2530] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:49 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:49.310334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6c5e380-f795-4907-a849-b429781ccbe6 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:49.316180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c6c5e380-f795-4907-a849-b429781ccbe6 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:49.329358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6c5e380-f795-4907-a849-b429781ccbe6 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:49.339476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6c5e380-f795-4907-a849-b429781ccbe6 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:49.340419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6c5e380-f795-4907-a849-b429781ccbe6 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:49.341638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6c5e380-f795-4907-a849-b429781ccbe6 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:49.342363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6c5e380-f795-4907-a849-b429781ccbe6 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:49.343186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6c5e380-f795-4907-a849-b429781ccbe6 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:49.607067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c6c5e380-f795-4907-a849-b429781ccbe6 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74accb869c48434ab1aa5452d6b0f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b041a3368a34a02ab30267164853ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:49.620213 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c6c5e380-f795-4907-a849-b429781ccbe6 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 200 len: 1315 microversion: 2.1 time: 0.313846 Oct 27 18:55:49.622810 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1290/2531] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:49 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:49.637665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d5f11d8-9f35-4cd5-968c-c4ecac68c659 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] Calling method '.version_select at 0x7fc86a9faf70>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:49.743927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-778129db-6f7c-44f8-b2d7-37538340f110 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:49.756535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-778129db-6f7c-44f8-b2d7-37538340f110 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:49.759090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-778129db-6f7c-44f8-b2d7-37538340f110 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:49.760461 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-778129db-6f7c-44f8-b2d7-37538340f110 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 200 len: 1359 microversion: 2.21 time: 1.301776 Oct 27 18:55:49.761273 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1242/2532] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:55:48 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 1359 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:55:49.766279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7e097c5-3a2a-4865-b40c-70a7f95e1db0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc8731f4790>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:50.010006 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9d5f11d8-9f35-4cd5-968c-c4ecac68c659 tempest-SecurityGroupRulesNegativeTestJSON-160398768 tempest-SecurityGroupRulesNegativeTestJSON-160398768-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/985005e1-a102-49aa-aab0-72eaa75a9970" status: 202 len: 0 microversion: 2.1 time: 0.383104 Oct 27 18:55:50.010606 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1291/2533] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:55:49 2022] DELETE /compute/v2.1/os-security-groups/985005e1-a102-49aa-aab0-72eaa75a9970 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:55:50.020357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9a97e60-31c5-4593-93c6-58b8318639ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:50.020905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c9a97e60-31c5-4593-93c6-58b8318639ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: af94cc36-ca10-44b6-b550-695c4e3eb9a4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:50.031381 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7e097c5-3a2a-4865-b40c-70a7f95e1db0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1412 microversion: 2.1 time: 0.268752 Oct 27 18:55:50.034617 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1243/2534] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:49 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1412 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:50.039603 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-c9a97e60-31c5-4593-93c6-58b8318639ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance af94cc36-ca10-44b6-b550-695c4e3eb9a4 could not be found. Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9a97e60-31c5-4593-93c6-58b8318639ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/af94cc36-ca10-44b6-b550-695c4e3eb9a4/action HTTP/1.1 Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 15 Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: {"restore": {}} Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance af94cc36-ca10-44b6-b550-695c4e3eb9a4 could not be found. Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'af94cc36-ca10-44b6-b550-695c4e3eb9a4', 'body': {'restore': {}}} Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af94cc36-ca10-44b6-b550-695c4e3eb9a4 could not be found. Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af94cc36-ca10-44b6-b550-695c4e3eb9a4 could not be found. Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:50.043621 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:50.049272 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:50.049272 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:50.049272 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af94cc36-ca10-44b6-b550-695c4e3eb9a4 could not be found. Oct 27 18:55:50.049272 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:50.049272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9a97e60-31c5-4593-93c6-58b8318639ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance af94cc36-ca10-44b6-b550-695c4e3eb9a4 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:50.049272 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c9a97e60-31c5-4593-93c6-58b8318639ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/af94cc36-ca10-44b6-b550-695c4e3eb9a4/action" status: 404 len: 111 microversion: 2.1 time: 0.030087 Oct 27 18:55:50.052765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-537cfa09-a79a-45a2-a962-621cdbc86014 req-61479b1b-3daf-4767-9a81-47211a9c1873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1608b064-7a7d-438e-ae9c-daad010181cf", "tag": "520e44b2-88d2-4fa9-9848-cae4eb6e55bd"}, {"server_uuid": "592bd675-3b12-4ab8-8e8f-be99ea57e702", "name": "network-vif-unplugged", "status": "completed", "tag": "1f047cd7-16bb-416c-8bf4-ce6a1d8f9459"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:50.056146 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1292/2535] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:50 2022] POST /compute/v2.1/servers/af94cc36-ca10-44b6-b550-695c4e3eb9a4/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:50.081198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-537cfa09-a79a-45a2-a962-621cdbc86014 req-61479b1b-3daf-4767-9a81-47211a9c1873 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:50.082017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b42316f5-9aec-4b14-b7e5-a7a3221b42d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:50.082712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b42316f5-9aec-4b14-b7e5-a7a3221b42d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:50.086349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-537cfa09-a79a-45a2-a962-621cdbc86014 req-61479b1b-3daf-4767-9a81-47211a9c1873 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:50.086935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-537cfa09-a79a-45a2-a962-621cdbc86014 req-61479b1b-3daf-4767-9a81-47211a9c1873 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:50.093827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:50.098538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42316f5-9aec-4b14-b7e5-a7a3221b42d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:50.099247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42316f5-9aec-4b14-b7e5-a7a3221b42d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:50.099994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42316f5-9aec-4b14-b7e5-a7a3221b42d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:50.101412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42316f5-9aec-4b14-b7e5-a7a3221b42d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:50.102027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42316f5-9aec-4b14-b7e5-a7a3221b42d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:50.102782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42316f5-9aec-4b14-b7e5-a7a3221b42d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:50.116438 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-537cfa09-a79a-45a2-a962-621cdbc86014 req-61479b1b-3daf-4767-9a81-47211a9c1873 service nova] Creating event network-changed:520e44b2-88d2-4fa9-9848-cae4eb6e55bd for instance 1608b064-7a7d-438e-ae9c-daad010181cf on n-h1-860687-3 Oct 27 18:55:50.118276 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-537cfa09-a79a-45a2-a962-621cdbc86014 req-61479b1b-3daf-4767-9a81-47211a9c1873 service nova] Creating event network-vif-unplugged:1f047cd7-16bb-416c-8bf4-ce6a1d8f9459 for instance 592bd675-3b12-4ab8-8e8f-be99ea57e702 on n-h1-860687-3 Oct 27 18:55:50.141594 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-537cfa09-a79a-45a2-a962-621cdbc86014 req-61479b1b-3daf-4767-9a81-47211a9c1873 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.103771 Oct 27 18:55:50.143405 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1244/2536] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:50.159258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3d881f65-29a4-4ca2-a807-dad64309488f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:50.160657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3d881f65-29a4-4ca2-a807-dad64309488f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:50.176279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d881f65-29a4-4ca2-a807-dad64309488f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:50.177273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d881f65-29a4-4ca2-a807-dad64309488f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:50.177970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d881f65-29a4-4ca2-a807-dad64309488f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:50.178990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d881f65-29a4-4ca2-a807-dad64309488f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:50.182302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d881f65-29a4-4ca2-a807-dad64309488f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:50.184211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d881f65-29a4-4ca2-a807-dad64309488f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:50.489989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b42316f5-9aec-4b14-b7e5-a7a3221b42d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:50.504125 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b42316f5-9aec-4b14-b7e5-a7a3221b42d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1317 microversion: 2.1 time: 0.444313 Oct 27 18:55:50.519690 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1293/2537] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:50 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:50.544885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-60e69f42-e450-4324-a25f-f8fc1f62b4be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:50.545532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-60e69f42-e450-4324-a25f-f8fc1f62b4be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:50.575947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60e69f42-e450-4324-a25f-f8fc1f62b4be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:50.577445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60e69f42-e450-4324-a25f-f8fc1f62b4be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:50.578081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60e69f42-e450-4324-a25f-f8fc1f62b4be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:50.579464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60e69f42-e450-4324-a25f-f8fc1f62b4be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:50.582685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60e69f42-e450-4324-a25f-f8fc1f62b4be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:50.583473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60e69f42-e450-4324-a25f-f8fc1f62b4be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:50.846477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d881f65-29a4-4ca2-a807-dad64309488f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:50.858219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-60e69f42-e450-4324-a25f-f8fc1f62b4be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:50.881316 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-60e69f42-e450-4324-a25f-f8fc1f62b4be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1505 microversion: 2.1 time: 0.368205 Oct 27 18:55:50.882263 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1294/2538] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:50 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:50.882964 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3d881f65-29a4-4ca2-a807-dad64309488f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.733737 Oct 27 18:55:50.885264 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1245/2539] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:50 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:50.905385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-edfdb6bb-f21a-4f81-ab3b-569722142d11 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:50.906609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-edfdb6bb-f21a-4f81-ab3b-569722142d11 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:50.926285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edfdb6bb-f21a-4f81-ab3b-569722142d11 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:50.928692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edfdb6bb-f21a-4f81-ab3b-569722142d11 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:50.929535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edfdb6bb-f21a-4f81-ab3b-569722142d11 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:50.933675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edfdb6bb-f21a-4f81-ab3b-569722142d11 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:50.934174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edfdb6bb-f21a-4f81-ab3b-569722142d11 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:50.935351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edfdb6bb-f21a-4f81-ab3b-569722142d11 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:51.096523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-95dfe785-9eae-4eab-af18-745d99c32449 req-6151f9c0-2f2b-4458-bc56-483912a2fd40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3ab523-37c4-46bc-ab91-975da6d3807f", "name": "network-vif-plugged", "status": "completed", "tag": "fa3593d4-3151-4370-bc45-3ffbb894137b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:51.118507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-95dfe785-9eae-4eab-af18-745d99c32449 req-6151f9c0-2f2b-4458-bc56-483912a2fd40 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:51.119004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-95dfe785-9eae-4eab-af18-745d99c32449 req-6151f9c0-2f2b-4458-bc56-483912a2fd40 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:51.119448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-95dfe785-9eae-4eab-af18-745d99c32449 req-6151f9c0-2f2b-4458-bc56-483912a2fd40 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:51.137424 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-95dfe785-9eae-4eab-af18-745d99c32449 req-6151f9c0-2f2b-4458-bc56-483912a2fd40 service nova] Creating event network-vif-plugged:fa3593d4-3151-4370-bc45-3ffbb894137b for instance 3b3ab523-37c4-46bc-ab91-975da6d3807f on n-h1-860687-3 Oct 27 18:55:51.143683 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-95dfe785-9eae-4eab-af18-745d99c32449 req-6151f9c0-2f2b-4458-bc56-483912a2fd40 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258656 Oct 27 18:55:51.145331 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1295/2540] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:51.152976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13eeadd7-13a7-4861-a38b-88f7c20a8061 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:51.153931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-13eeadd7-13a7-4861-a38b-88f7c20a8061 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:51.161755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13eeadd7-13a7-4861-a38b-88f7c20a8061 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:51.162634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13eeadd7-13a7-4861-a38b-88f7c20a8061 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:51.163252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13eeadd7-13a7-4861-a38b-88f7c20a8061 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:51.164241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13eeadd7-13a7-4861-a38b-88f7c20a8061 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:51.165274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13eeadd7-13a7-4861-a38b-88f7c20a8061 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:51.165876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13eeadd7-13a7-4861-a38b-88f7c20a8061 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:51.484769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-edfdb6bb-f21a-4f81-ab3b-569722142d11 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74accb869c48434ab1aa5452d6b0f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b041a3368a34a02ab30267164853ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:51.494907 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-edfdb6bb-f21a-4f81-ab3b-569722142d11 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 200 len: 1315 microversion: 2.1 time: 0.608140 Oct 27 18:55:51.495672 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1246/2541] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:50 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:51.516885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ca5fad2-728c-4064-8822-343d74468484 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:51.518131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ca5fad2-728c-4064-8822-343d74468484 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:51.524810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ca5fad2-728c-4064-8822-343d74468484 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:51.525627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ca5fad2-728c-4064-8822-343d74468484 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:51.526324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ca5fad2-728c-4064-8822-343d74468484 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:51.527564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ca5fad2-728c-4064-8822-343d74468484 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:51.528258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ca5fad2-728c-4064-8822-343d74468484 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:51.529162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ca5fad2-728c-4064-8822-343d74468484 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:51.536536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-13eeadd7-13a7-4861-a38b-88f7c20a8061 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:51.546882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-13eeadd7-13a7-4861-a38b-88f7c20a8061 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:51.549162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-13eeadd7-13a7-4861-a38b-88f7c20a8061 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:51.550882 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13eeadd7-13a7-4861-a38b-88f7c20a8061 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 200 len: 1359 microversion: 2.21 time: 0.404228 Oct 27 18:55:51.563589 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1296/2542] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:55:51 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 1359 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:55:51.579302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b3a6d949-405a-4378-b4f4-2a36abd02e4f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc8732a18b0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:51.644231 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b3a6d949-405a-4378-b4f4-2a36abd02e4f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1421 microversion: 2.1 time: 0.078787 Oct 27 18:55:51.645002 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1297/2543] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:51 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:51.659203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-45b353bd-dfc7-4f97-9990-6775b67aca59 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:51.659839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-45b353bd-dfc7-4f97-9990-6775b67aca59 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:51.666037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45b353bd-dfc7-4f97-9990-6775b67aca59 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:51.666566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45b353bd-dfc7-4f97-9990-6775b67aca59 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:51.667014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45b353bd-dfc7-4f97-9990-6775b67aca59 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:51.667731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45b353bd-dfc7-4f97-9990-6775b67aca59 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:51.668236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45b353bd-dfc7-4f97-9990-6775b67aca59 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:51.668631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45b353bd-dfc7-4f97-9990-6775b67aca59 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:51.713958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ca5fad2-728c-4064-8822-343d74468484 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:51.722779 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ca5fad2-728c-4064-8822-343d74468484 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.214988 Oct 27 18:55:51.723364 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1247/2544] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:51 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:51.735298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3c5f4695-404e-40e2-a6a5-852abacdc092 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc869dd6e50>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:51.816024 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3c5f4695-404e-40e2-a6a5-852abacdc092 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 200 len: 1421 microversion: 2.1 time: 0.091412 Oct 27 18:55:51.816714 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1248/2545] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:55:51 2022] GET /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 1421 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:51.828545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8c29cfb6-bd8c-429b-bccc-c69fe1e4aff1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:51.829166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8c29cfb6-bd8c-429b-bccc-c69fe1e4aff1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:51.866624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c29cfb6-bd8c-429b-bccc-c69fe1e4aff1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:51.867230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c29cfb6-bd8c-429b-bccc-c69fe1e4aff1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:51.867898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c29cfb6-bd8c-429b-bccc-c69fe1e4aff1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:51.879534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c29cfb6-bd8c-429b-bccc-c69fe1e4aff1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:51.880324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c29cfb6-bd8c-429b-bccc-c69fe1e4aff1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:51.883160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c29cfb6-bd8c-429b-bccc-c69fe1e4aff1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:51.942056 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-8c29cfb6-bd8c-429b-bccc-c69fe1e4aff1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Cannot 'restore' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8c29cfb6-bd8c-429b-bccc-c69fe1e4aff1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action HTTP/1.1 Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 15 Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: {"restore": {}} Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: exception: Cannot 'restore' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a6e311e1-6dd0-4498-897c-c92ce762d9b9', 'body': {'restore': {}}} Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 in vm_state active. Cannot restore while the instance is in this state. Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:51.946558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:51.950378 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:51.950378 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:51.950378 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:51.950378 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:55:51.950378 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:51.950378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8c29cfb6-bd8c-429b-bccc-c69fe1e4aff1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 409 to user: Cannot 'restore' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:51.950378 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8c29cfb6-bd8c-429b-bccc-c69fe1e4aff1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action" status: 409 len: 145 microversion: 2.1 time: 0.130363 Oct 27 18:55:51.960440 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1249/2546] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:51 2022] POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action => generated 145 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:55:51.972652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70927d7d-12a3-4786-9b3f-ecbcfdaf7ab0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc87320dd30>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:52.047151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-45b353bd-dfc7-4f97-9990-6775b67aca59 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:52.055776 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-45b353bd-dfc7-4f97-9990-6775b67aca59 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1317 microversion: 2.1 time: 0.401051 Oct 27 18:55:52.057508 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1298/2547] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:51 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:52.070657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-88624832-5ab6-4fc4-ad22-70f249f5d9a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:52.071635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-88624832-5ab6-4fc4-ad22-70f249f5d9a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:52.083977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88624832-5ab6-4fc4-ad22-70f249f5d9a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:52.084527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88624832-5ab6-4fc4-ad22-70f249f5d9a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:52.084978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88624832-5ab6-4fc4-ad22-70f249f5d9a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:52.085724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88624832-5ab6-4fc4-ad22-70f249f5d9a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:52.086161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88624832-5ab6-4fc4-ad22-70f249f5d9a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:52.086641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88624832-5ab6-4fc4-ad22-70f249f5d9a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:52.384069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-88624832-5ab6-4fc4-ad22-70f249f5d9a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:52.399115 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-88624832-5ab6-4fc4-ad22-70f249f5d9a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1505 microversion: 2.1 time: 0.335034 Oct 27 18:55:52.410801 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1299/2548] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:52 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:52.422075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-40709486-989a-4293-a9fc-f1af22d8d2b5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:52.423175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-40709486-989a-4293-a9fc-f1af22d8d2b5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:52.431340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40709486-989a-4293-a9fc-f1af22d8d2b5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:52.431963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40709486-989a-4293-a9fc-f1af22d8d2b5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:52.432509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40709486-989a-4293-a9fc-f1af22d8d2b5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:52.433586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40709486-989a-4293-a9fc-f1af22d8d2b5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:52.434205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40709486-989a-4293-a9fc-f1af22d8d2b5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:52.435149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40709486-989a-4293-a9fc-f1af22d8d2b5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:52.463312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:52.751485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-40709486-989a-4293-a9fc-f1af22d8d2b5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:52.751876 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70927d7d-12a3-4786-9b3f-ecbcfdaf7ab0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 204 len: 0 microversion: 2.1 time: 0.788058 Oct 27 18:55:52.754087 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1250/2549] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:51 2022] DELETE /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:55:52.765737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-67ae385b-da80-4bd6-b3c9-642f5cd95f03 req-fefb0d22-d0e8-46a1-bce2-91d3679020e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "592bd675-3b12-4ab8-8e8f-be99ea57e702", "tag": "1f047cd7-16bb-416c-8bf4-ce6a1d8f9459"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:52.791044 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-40709486-989a-4293-a9fc-f1af22d8d2b5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.371595 Oct 27 18:55:52.791895 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1300/2550] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:52 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:52.818844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b5e97099-4c2c-4115-91ca-1707708b8cc5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:52.819654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b5e97099-4c2c-4115-91ca-1707708b8cc5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:52.820186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-67ae385b-da80-4bd6-b3c9-642f5cd95f03 req-fefb0d22-d0e8-46a1-bce2-91d3679020e5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:52.820681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-67ae385b-da80-4bd6-b3c9-642f5cd95f03 req-fefb0d22-d0e8-46a1-bce2-91d3679020e5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:52.821747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-67ae385b-da80-4bd6-b3c9-642f5cd95f03 req-fefb0d22-d0e8-46a1-bce2-91d3679020e5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:52.835857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5e97099-4c2c-4115-91ca-1707708b8cc5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:52.836533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5e97099-4c2c-4115-91ca-1707708b8cc5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:52.838377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5e97099-4c2c-4115-91ca-1707708b8cc5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:52.839339 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-67ae385b-da80-4bd6-b3c9-642f5cd95f03 req-fefb0d22-d0e8-46a1-bce2-91d3679020e5 service nova] Creating event network-changed:1f047cd7-16bb-416c-8bf4-ce6a1d8f9459 for instance 592bd675-3b12-4ab8-8e8f-be99ea57e702 on n-h1-860687-3 Oct 27 18:55:52.843395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5e97099-4c2c-4115-91ca-1707708b8cc5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:52.844050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5e97099-4c2c-4115-91ca-1707708b8cc5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:52.844657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5e97099-4c2c-4115-91ca-1707708b8cc5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:52.846663 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-67ae385b-da80-4bd6-b3c9-642f5cd95f03 req-fefb0d22-d0e8-46a1-bce2-91d3679020e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090052 Oct 27 18:55:52.852760 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1251/2551] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:52.862667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-337d0d2d-a35a-49c8-8c37-70a41af93fb1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:52.863940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-337d0d2d-a35a-49c8-8c37-70a41af93fb1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:52.871993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-337d0d2d-a35a-49c8-8c37-70a41af93fb1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:52.873277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-337d0d2d-a35a-49c8-8c37-70a41af93fb1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:52.873921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-337d0d2d-a35a-49c8-8c37-70a41af93fb1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:52.896974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-337d0d2d-a35a-49c8-8c37-70a41af93fb1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:52.897483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-337d0d2d-a35a-49c8-8c37-70a41af93fb1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:52.897934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-337d0d2d-a35a-49c8-8c37-70a41af93fb1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:53.138621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b5e97099-4c2c-4115-91ca-1707708b8cc5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74accb869c48434ab1aa5452d6b0f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b041a3368a34a02ab30267164853ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:53.148494 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b5e97099-4c2c-4115-91ca-1707708b8cc5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 200 len: 1315 microversion: 2.1 time: 0.353764 Oct 27 18:55:53.159513 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1301/2552] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:52 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:53.166215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-04141ae2-067a-45c8-a60d-9229f878a2cd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:53.166760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-04141ae2-067a-45c8-a60d-9229f878a2cd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:53.186844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04141ae2-067a-45c8-a60d-9229f878a2cd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:53.187361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04141ae2-067a-45c8-a60d-9229f878a2cd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:53.187815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04141ae2-067a-45c8-a60d-9229f878a2cd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:53.190185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04141ae2-067a-45c8-a60d-9229f878a2cd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:53.191722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04141ae2-067a-45c8-a60d-9229f878a2cd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:53.192178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04141ae2-067a-45c8-a60d-9229f878a2cd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:53.241797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-04141ae2-067a-45c8-a60d-9229f878a2cd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:55:53.308523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-337d0d2d-a35a-49c8-8c37-70a41af93fb1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:53.325660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-337d0d2d-a35a-49c8-8c37-70a41af93fb1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:53.327512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-337d0d2d-a35a-49c8-8c37-70a41af93fb1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:53.328769 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-337d0d2d-a35a-49c8-8c37-70a41af93fb1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 200 len: 1359 microversion: 2.21 time: 0.474316 Oct 27 18:55:53.331565 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1252/2553] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:55:52 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 1359 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:55:53.367229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3b466c9f-e6f8-4c3b-aeb8-8a199a6ebb2c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:53.368074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3b466c9f-e6f8-4c3b-aeb8-8a199a6ebb2c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:53.375748 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-04141ae2-067a-45c8-a60d-9229f878a2cd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 204 len: 0 microversion: 2.1 time: 0.220886 Oct 27 18:55:53.377949 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1302/2554] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:55:53 2022] DELETE /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:55:53.379556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b466c9f-e6f8-4c3b-aeb8-8a199a6ebb2c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:53.380059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b466c9f-e6f8-4c3b-aeb8-8a199a6ebb2c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:53.382895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b466c9f-e6f8-4c3b-aeb8-8a199a6ebb2c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:53.383849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b466c9f-e6f8-4c3b-aeb8-8a199a6ebb2c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:53.388417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b466c9f-e6f8-4c3b-aeb8-8a199a6ebb2c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:53.389174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b466c9f-e6f8-4c3b-aeb8-8a199a6ebb2c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:53.404196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-87c01926-9efa-4936-83d7-6bdbe0ce1184 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:53.406567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-87c01926-9efa-4936-83d7-6bdbe0ce1184 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:53.414096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87c01926-9efa-4936-83d7-6bdbe0ce1184 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:53.415008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87c01926-9efa-4936-83d7-6bdbe0ce1184 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:53.415760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87c01926-9efa-4936-83d7-6bdbe0ce1184 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:53.416944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87c01926-9efa-4936-83d7-6bdbe0ce1184 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:53.417807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87c01926-9efa-4936-83d7-6bdbe0ce1184 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:53.418619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87c01926-9efa-4936-83d7-6bdbe0ce1184 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:53.669056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-87c01926-9efa-4936-83d7-6bdbe0ce1184 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:53.678794 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-87c01926-9efa-4936-83d7-6bdbe0ce1184 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1508 microversion: 2.1 time: 0.299285 Oct 27 18:55:53.679916 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1303/2555] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:53 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:53.685320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-52ee8614-13cf-4157-9e88-a975406759fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:53.686133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-52ee8614-13cf-4157-9e88-a975406759fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:53.695449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52ee8614-13cf-4157-9e88-a975406759fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:53.695944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52ee8614-13cf-4157-9e88-a975406759fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:53.696588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52ee8614-13cf-4157-9e88-a975406759fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:53.697305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52ee8614-13cf-4157-9e88-a975406759fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:53.697766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52ee8614-13cf-4157-9e88-a975406759fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:53.698262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52ee8614-13cf-4157-9e88-a975406759fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:53.851121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3b466c9f-e6f8-4c3b-aeb8-8a199a6ebb2c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:53.851923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-52ee8614-13cf-4157-9e88-a975406759fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:53.860341 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3b466c9f-e6f8-4c3b-aeb8-8a199a6ebb2c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.509351 Oct 27 18:55:53.861442 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1253/2556] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:53 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:53.868069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1378157087", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "bd2a2055-53fd-4e07-8727-b0efd4106712"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:53.869101 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-52ee8614-13cf-4157-9e88-a975406759fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1505 microversion: 2.1 time: 0.187630 Oct 27 18:55:53.888749 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1304/2557] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:53 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1505 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:53.896593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fce1fcd9-1c18-447a-bf13-b614dbab5c6f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:53.897274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fce1fcd9-1c18-447a-bf13-b614dbab5c6f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:53.905157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fce1fcd9-1c18-447a-bf13-b614dbab5c6f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:53.905848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fce1fcd9-1c18-447a-bf13-b614dbab5c6f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:53.906576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fce1fcd9-1c18-447a-bf13-b614dbab5c6f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:53.907470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fce1fcd9-1c18-447a-bf13-b614dbab5c6f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:53.909759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fce1fcd9-1c18-447a-bf13-b614dbab5c6f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:53.910361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fce1fcd9-1c18-447a-bf13-b614dbab5c6f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:53.933207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] validate_networks() for [('bd2a2055-53fd-4e07-8727-b0efd4106712', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:55:54.082365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fce1fcd9-1c18-447a-bf13-b614dbab5c6f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:54.093182 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fce1fcd9-1c18-447a-bf13-b614dbab5c6f tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1508 microversion: 2.1 time: 0.201458 Oct 27 18:55:54.094273 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1305/2558] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:53 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:54.100401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b34e2094-f95c-421d-80b0-50f38d0f4c97 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:54.101416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b34e2094-f95c-421d-80b0-50f38d0f4c97 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 6a255f75-bcce-4b27-8c03-b63713c6a927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:54.115355 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-b34e2094-f95c-421d-80b0-50f38d0f4c97 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 6a255f75-bcce-4b27-8c03-b63713c6a927 could not be found. Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b34e2094-f95c-421d-80b0-50f38d0f4c97 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/6a255f75-bcce-4b27-8c03-b63713c6a927/action HTTP/1.1 Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 14 Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: {"resume": {}} Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 6a255f75-bcce-4b27-8c03-b63713c6a927 could not be found. Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '6a255f75-bcce-4b27-8c03-b63713c6a927', 'body': {'resume': {}}} Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a255f75-bcce-4b27-8c03-b63713c6a927 could not be found. Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a255f75-bcce-4b27-8c03-b63713c6a927 could not be found. Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:54.124969 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:54.132315 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:54.132315 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:54.132315 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a255f75-bcce-4b27-8c03-b63713c6a927 could not be found. Oct 27 18:55:54.132315 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:54.132315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b34e2094-f95c-421d-80b0-50f38d0f4c97 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 6a255f75-bcce-4b27-8c03-b63713c6a927 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:54.132315 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b34e2094-f95c-421d-80b0-50f38d0f4c97 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/6a255f75-bcce-4b27-8c03-b63713c6a927/action" status: 404 len: 111 microversion: 2.1 time: 0.033873 Oct 27 18:55:54.132315 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1306/2559] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:54 2022] POST /compute/v2.1/servers/6a255f75-bcce-4b27-8c03-b63713c6a927/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:55:54.138619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bf676af7-48e6-48d6-8441-2aac73810969 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:54.141185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bf676af7-48e6-48d6-8441-2aac73810969 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:54.150437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf676af7-48e6-48d6-8441-2aac73810969 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:54.151318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf676af7-48e6-48d6-8441-2aac73810969 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:54.151458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf676af7-48e6-48d6-8441-2aac73810969 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:54.152083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf676af7-48e6-48d6-8441-2aac73810969 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:54.152739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf676af7-48e6-48d6-8441-2aac73810969 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:54.153500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf676af7-48e6-48d6-8441-2aac73810969 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:54.229231 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bf676af7-48e6-48d6-8441-2aac73810969 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "PUT /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1080 microversion: 2.1 time: 0.095386 Oct 27 18:55:54.230208 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1307/2560] 10.222.0.42 () {60 vars in 1256 bytes} [Thu Oct 27 18:55:54 2022] PUT /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1080 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:54.235076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c4562d88-34fc-456a-b74f-891b9aba4697 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:54.236751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c4562d88-34fc-456a-b74f-891b9aba4697 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:54.243677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4562d88-34fc-456a-b74f-891b9aba4697 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:54.244763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4562d88-34fc-456a-b74f-891b9aba4697 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:54.245437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4562d88-34fc-456a-b74f-891b9aba4697 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:54.246498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4562d88-34fc-456a-b74f-891b9aba4697 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:54.247209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4562d88-34fc-456a-b74f-891b9aba4697 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:54.247751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4562d88-34fc-456a-b74f-891b9aba4697 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:54.403933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c4562d88-34fc-456a-b74f-891b9aba4697 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:54.412587 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c4562d88-34fc-456a-b74f-891b9aba4697 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.181096 Oct 27 18:55:54.430258 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1308/2561] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:54 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:54.438789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d731a7b-05c0-46c3-9fc8-74baed8de3b3 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:54.440416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9d731a7b-05c0-46c3-9fc8-74baed8de3b3 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:54.447224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d731a7b-05c0-46c3-9fc8-74baed8de3b3 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:54.447690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d731a7b-05c0-46c3-9fc8-74baed8de3b3 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:54.448433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d731a7b-05c0-46c3-9fc8-74baed8de3b3 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:54.449311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d731a7b-05c0-46c3-9fc8-74baed8de3b3 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:54.449760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d731a7b-05c0-46c3-9fc8-74baed8de3b3 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:54.450413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d731a7b-05c0-46c3-9fc8-74baed8de3b3 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:54.646230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9d731a7b-05c0-46c3-9fc8-74baed8de3b3 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74accb869c48434ab1aa5452d6b0f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b041a3368a34a02ab30267164853ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:54.655870 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9d731a7b-05c0-46c3-9fc8-74baed8de3b3 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 200 len: 1315 microversion: 2.1 time: 0.224094 Oct 27 18:55:54.659510 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1309/2562] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:54 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:54.670546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c23902dc-2dae-4990-8731-0d9a37b9c9a5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:54.670546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c23902dc-2dae-4990-8731-0d9a37b9c9a5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:54.677994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c23902dc-2dae-4990-8731-0d9a37b9c9a5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:54.678586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c23902dc-2dae-4990-8731-0d9a37b9c9a5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:54.679041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c23902dc-2dae-4990-8731-0d9a37b9c9a5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:54.679841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c23902dc-2dae-4990-8731-0d9a37b9c9a5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:54.680416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c23902dc-2dae-4990-8731-0d9a37b9c9a5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:54.680914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c23902dc-2dae-4990-8731-0d9a37b9c9a5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:54.880971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c23902dc-2dae-4990-8731-0d9a37b9c9a5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:54.899459 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c23902dc-2dae-4990-8731-0d9a37b9c9a5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1506 microversion: 2.1 time: 0.241750 Oct 27 18:55:54.903970 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1310/2563] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:54 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:54.912323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0edd1043-4196-4980-9fba-d251862a1f77 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:54.912323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0edd1043-4196-4980-9fba-d251862a1f77 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:54.921496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0edd1043-4196-4980-9fba-d251862a1f77 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:54.923190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0edd1043-4196-4980-9fba-d251862a1f77 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:54.923879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0edd1043-4196-4980-9fba-d251862a1f77 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:54.924645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0edd1043-4196-4980-9fba-d251862a1f77 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:54.925117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0edd1043-4196-4980-9fba-d251862a1f77 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:54.925740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0edd1043-4196-4980-9fba-d251862a1f77 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:55.348553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:55:55.349149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:55:55.349462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:55:55.355376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:55:55.356097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:55:55.386527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:55.386867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:55.387324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:55.388088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:55.388553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:55.388989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:55.467318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Getting quotas for project 75c41c5833484551b422742abfad598f. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:55:55.482793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Getting quotas for user ac1e2f62e22b4e52badd230ef175817e and project 75c41c5833484551b422742abfad598f. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:55:55.511471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:55:55.513820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:55:55.538725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0edd1043-4196-4980-9fba-d251862a1f77 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:55.555916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0edd1043-4196-4980-9fba-d251862a1f77 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:55.557401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0edd1043-4196-4980-9fba-d251862a1f77 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:55.559037 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0edd1043-4196-4980-9fba-d251862a1f77 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 200 len: 1359 microversion: 2.21 time: 0.654283 Oct 27 18:55:55.571328 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1311/2564] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:55:54 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 1359 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:55:55.586308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ed6b7b42-3b8b-4632-9fd4-78b5208a489d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:55.587812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ed6b7b42-3b8b-4632-9fd4-78b5208a489d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:55.594942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed6b7b42-3b8b-4632-9fd4-78b5208a489d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:55.596196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed6b7b42-3b8b-4632-9fd4-78b5208a489d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:55.596812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed6b7b42-3b8b-4632-9fd4-78b5208a489d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:55.597706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed6b7b42-3b8b-4632-9fd4-78b5208a489d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:55.598721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed6b7b42-3b8b-4632-9fd4-78b5208a489d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:55.599258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed6b7b42-3b8b-4632-9fd4-78b5208a489d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:55.655077 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c6c9750e-0e0e-4fea-8d8b-06c71bad7131 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.786169 Oct 27 18:55:55.656063 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1254/2565] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:55:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:55:55.665355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7439eea4-846c-468e-9370-818e9529d34c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:55.672248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7439eea4-846c-468e-9370-818e9529d34c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:55.695115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7439eea4-846c-468e-9370-818e9529d34c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:55.695618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7439eea4-846c-468e-9370-818e9529d34c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:55.696062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7439eea4-846c-468e-9370-818e9529d34c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:55.701551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7439eea4-846c-468e-9370-818e9529d34c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:55.702088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7439eea4-846c-468e-9370-818e9529d34c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:55.702573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7439eea4-846c-468e-9370-818e9529d34c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:55.917959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ed6b7b42-3b8b-4632-9fd4-78b5208a489d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:55.930116 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ed6b7b42-3b8b-4632-9fd4-78b5208a489d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.357025 Oct 27 18:55:55.934078 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1312/2566] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:55 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:55.960725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6111f892-96c1-48ab-a7dc-aad1b31727c6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:55.961938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6111f892-96c1-48ab-a7dc-aad1b31727c6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:55.969557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6111f892-96c1-48ab-a7dc-aad1b31727c6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:55.971373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6111f892-96c1-48ab-a7dc-aad1b31727c6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:55.972184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6111f892-96c1-48ab-a7dc-aad1b31727c6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:55.973434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6111f892-96c1-48ab-a7dc-aad1b31727c6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:55.974201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6111f892-96c1-48ab-a7dc-aad1b31727c6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:55.975598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6111f892-96c1-48ab-a7dc-aad1b31727c6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:56.433002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6111f892-96c1-48ab-a7dc-aad1b31727c6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:56.452681 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6111f892-96c1-48ab-a7dc-aad1b31727c6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1506 microversion: 2.1 time: 0.495307 Oct 27 18:55:56.456763 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1313/2567] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:55 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:56.491309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5cef478d-be89-41c3-acc9-ed94cb3dad07 req-33bc59a7-0673-4e2c-be90-bf6c72802cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80613ec8-dbf9-454e-9e15-47efdf0726ae", "name": "network-vif-plugged", "status": "completed", "tag": "dc049456-2863-4275-b3e7-2f12a235c810"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:56.522516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5cef478d-be89-41c3-acc9-ed94cb3dad07 req-33bc59a7-0673-4e2c-be90-bf6c72802cb4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:56.523395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5cef478d-be89-41c3-acc9-ed94cb3dad07 req-33bc59a7-0673-4e2c-be90-bf6c72802cb4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:56.524326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5cef478d-be89-41c3-acc9-ed94cb3dad07 req-33bc59a7-0673-4e2c-be90-bf6c72802cb4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:56.547886 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5cef478d-be89-41c3-acc9-ed94cb3dad07 req-33bc59a7-0673-4e2c-be90-bf6c72802cb4 service nova] Creating event network-vif-plugged:dc049456-2863-4275-b3e7-2f12a235c810 for instance 80613ec8-dbf9-454e-9e15-47efdf0726ae on n-h2-860687-3 Oct 27 18:55:56.556903 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5cef478d-be89-41c3-acc9-ed94cb3dad07 req-33bc59a7-0673-4e2c-be90-bf6c72802cb4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082954 Oct 27 18:55:56.563974 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1314/2568] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:56.579177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-06d947f5-385d-476a-94f4-94e152b8c3de tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:56.582122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-06d947f5-385d-476a-94f4-94e152b8c3de tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:56.597549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7439eea4-846c-468e-9370-818e9529d34c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:56.604095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06d947f5-385d-476a-94f4-94e152b8c3de tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:56.606289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06d947f5-385d-476a-94f4-94e152b8c3de tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:56.609636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06d947f5-385d-476a-94f4-94e152b8c3de tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:56.610681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06d947f5-385d-476a-94f4-94e152b8c3de tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:56.613452 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7439eea4-846c-468e-9370-818e9529d34c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1505 microversion: 2.1 time: 0.952410 Oct 27 18:55:56.614045 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1255/2569] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:55 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1505 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:56.629337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06d947f5-385d-476a-94f4-94e152b8c3de tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:56.633024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06d947f5-385d-476a-94f4-94e152b8c3de tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:56.647106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d1a87b9-7810-496e-9901-9e6e51272861 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:56.647723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9d1a87b9-7810-496e-9901-9e6e51272861 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:56.661847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d1a87b9-7810-496e-9901-9e6e51272861 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:56.662346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d1a87b9-7810-496e-9901-9e6e51272861 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:56.662867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d1a87b9-7810-496e-9901-9e6e51272861 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:56.663575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d1a87b9-7810-496e-9901-9e6e51272861 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:56.684709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d1a87b9-7810-496e-9901-9e6e51272861 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:56.685286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d1a87b9-7810-496e-9901-9e6e51272861 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:56.855977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-06d947f5-385d-476a-94f4-94e152b8c3de tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:56.866888 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-06d947f5-385d-476a-94f4-94e152b8c3de tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1204 microversion: 2.1 time: 0.300601 Oct 27 18:55:56.870424 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1315/2570] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:56 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1204 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:56.876745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce6291a2-6529-465e-8b5b-0eb1f3cc7d46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:56.877311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ce6291a2-6529-465e-8b5b-0eb1f3cc7d46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:56.886602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce6291a2-6529-465e-8b5b-0eb1f3cc7d46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:56.887280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce6291a2-6529-465e-8b5b-0eb1f3cc7d46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:56.887974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce6291a2-6529-465e-8b5b-0eb1f3cc7d46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:56.888583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce6291a2-6529-465e-8b5b-0eb1f3cc7d46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:56.889358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce6291a2-6529-465e-8b5b-0eb1f3cc7d46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:56.889948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce6291a2-6529-465e-8b5b-0eb1f3cc7d46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:56.906607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:56.927215 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-ce6291a2-6529-465e-8b5b-0eb1f3cc7d46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Cannot 'resume' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce6291a2-6529-465e-8b5b-0eb1f3cc7d46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action HTTP/1.1 Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 14 Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: {"resume": {}} Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: exception: Cannot 'resume' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'a6e311e1-6dd0-4498-897c-c92ce762d9b9', 'body': {'resume': {}}} Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 in vm_state active. Cannot resume while the instance is in this state. Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:56.929777 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:56.934378 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:56.934378 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:56.934378 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:56.934378 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:55:56.934378 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:55:56.934378 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:55:56.934378 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:55:56.935717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce6291a2-6529-465e-8b5b-0eb1f3cc7d46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 409 to user: Cannot 'resume' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:56.936919 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce6291a2-6529-465e-8b5b-0eb1f3cc7d46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action" status: 409 len: 144 microversion: 2.1 time: 0.068027 Oct 27 18:55:56.938228 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1316/2571] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:56 2022] POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action => generated 144 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:55:56.944531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:56.948868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:56.958438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:56.959141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:56.959645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:56.960770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:56.961522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:56.962116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:57.068439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:55:57.068907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:55:57.069353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:55:57.069758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:55:57.070166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:55:57.147530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:57.153846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:57.154595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:57.155046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:57.155763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:57.156308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:57.156745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:57.186647 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-87cf86d4-93e5-41db-8021-c01441fa63bc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "POST /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f/action" status: 202 len: 1112 microversion: 2.1 time: 0.247077 Oct 27 18:55:57.198708 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1317/2572] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:55:56 2022] POST /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f/action => generated 1112 bytes in 249 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 18:55:57.198708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a7fd9209-9fa9-44df-a80a-bbeb7688182e tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:57.198708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a7fd9209-9fa9-44df-a80a-bbeb7688182e tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:57.202615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7fd9209-9fa9-44df-a80a-bbeb7688182e tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:57.203104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7fd9209-9fa9-44df-a80a-bbeb7688182e tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:57.203695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7fd9209-9fa9-44df-a80a-bbeb7688182e tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:57.204404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7fd9209-9fa9-44df-a80a-bbeb7688182e tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:57.206558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7fd9209-9fa9-44df-a80a-bbeb7688182e tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:57.206739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7fd9209-9fa9-44df-a80a-bbeb7688182e tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:57.374035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a7fd9209-9fa9-44df-a80a-bbeb7688182e tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:57.384089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a7fd9209-9fa9-44df-a80a-bbeb7688182e tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:57.385899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a7fd9209-9fa9-44df-a80a-bbeb7688182e tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:57.387064 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a7fd9209-9fa9-44df-a80a-bbeb7688182e tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 200 len: 1359 microversion: 2.21 time: 0.198523 Oct 27 18:55:57.387953 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1318/2573] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:55:57 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:55:57.392477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3f7d5705-9ad8-46bc-bb6b-e8f6d6225968 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:57.393839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3f7d5705-9ad8-46bc-bb6b-e8f6d6225968 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:57.401029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f7d5705-9ad8-46bc-bb6b-e8f6d6225968 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:57.401722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f7d5705-9ad8-46bc-bb6b-e8f6d6225968 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:57.402651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f7d5705-9ad8-46bc-bb6b-e8f6d6225968 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:57.403504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f7d5705-9ad8-46bc-bb6b-e8f6d6225968 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:57.404113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f7d5705-9ad8-46bc-bb6b-e8f6d6225968 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:57.404729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f7d5705-9ad8-46bc-bb6b-e8f6d6225968 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:57.422119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d1a87b9-7810-496e-9901-9e6e51272861 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74accb869c48434ab1aa5452d6b0f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b041a3368a34a02ab30267164853ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:57.437554 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9d1a87b9-7810-496e-9901-9e6e51272861 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 200 len: 1315 microversion: 2.1 time: 0.805579 Oct 27 18:55:57.442201 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1256/2574] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:56 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:57.455797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6aa43620-d4cf-44b6-a40f-9d0a5d6e17bd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:57.458794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6aa43620-d4cf-44b6-a40f-9d0a5d6e17bd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:57.473015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6aa43620-d4cf-44b6-a40f-9d0a5d6e17bd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:57.477177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6aa43620-d4cf-44b6-a40f-9d0a5d6e17bd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:57.477914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6aa43620-d4cf-44b6-a40f-9d0a5d6e17bd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:57.479810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6aa43620-d4cf-44b6-a40f-9d0a5d6e17bd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:57.481639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6aa43620-d4cf-44b6-a40f-9d0a5d6e17bd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:57.484469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6aa43620-d4cf-44b6-a40f-9d0a5d6e17bd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:57.713574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3f7d5705-9ad8-46bc-bb6b-e8f6d6225968 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:57.725436 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3f7d5705-9ad8-46bc-bb6b-e8f6d6225968 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.336396 Oct 27 18:55:57.727033 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1319/2575] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:57 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:57.748143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a1aa233a-9956-4327-93fa-f8912f343b00 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:57.749056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a1aa233a-9956-4327-93fa-f8912f343b00 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:57.755974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1aa233a-9956-4327-93fa-f8912f343b00 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:57.756849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1aa233a-9956-4327-93fa-f8912f343b00 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:57.757513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1aa233a-9956-4327-93fa-f8912f343b00 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:57.758553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1aa233a-9956-4327-93fa-f8912f343b00 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:57.759238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1aa233a-9956-4327-93fa-f8912f343b00 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:57.759893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1aa233a-9956-4327-93fa-f8912f343b00 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:58.024257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6aa43620-d4cf-44b6-a40f-9d0a5d6e17bd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:58.029879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1aa233a-9956-4327-93fa-f8912f343b00 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:58.049580 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6aa43620-d4cf-44b6-a40f-9d0a5d6e17bd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.603736 Oct 27 18:55:58.052920 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a1aa233a-9956-4327-93fa-f8912f343b00 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1505 microversion: 2.1 time: 0.321045 Oct 27 18:55:58.056085 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1320/2576] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:57 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:58.068996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c5143867-0619-4019-994c-0a85dc1e6e07 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:58.069679 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1257/2577] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:57 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:58.074597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c5143867-0619-4019-994c-0a85dc1e6e07 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:58.081462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5143867-0619-4019-994c-0a85dc1e6e07 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:58.082203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5143867-0619-4019-994c-0a85dc1e6e07 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:58.082332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-703e98a1-4a0b-43d0-9a91-01fadc1ed475 req-b2fa5731-95ea-4de2-b0ae-1a117c6274c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d741a04d-f8e8-4b66-bc30-377d4c8de1dc", "name": "network-vif-deleted", "tag": "ac56cb8e-e2ef-419e-be28-4a7a3d4a4c68"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:58.083583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5143867-0619-4019-994c-0a85dc1e6e07 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:58.084522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5143867-0619-4019-994c-0a85dc1e6e07 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:58.085001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5143867-0619-4019-994c-0a85dc1e6e07 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:58.085457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5143867-0619-4019-994c-0a85dc1e6e07 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:58.110581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-703e98a1-4a0b-43d0-9a91-01fadc1ed475 req-b2fa5731-95ea-4de2-b0ae-1a117c6274c0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:58.112655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-703e98a1-4a0b-43d0-9a91-01fadc1ed475 req-b2fa5731-95ea-4de2-b0ae-1a117c6274c0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:58.113296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-703e98a1-4a0b-43d0-9a91-01fadc1ed475 req-b2fa5731-95ea-4de2-b0ae-1a117c6274c0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:58.137607 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-703e98a1-4a0b-43d0-9a91-01fadc1ed475 req-b2fa5731-95ea-4de2-b0ae-1a117c6274c0 service nova] Creating event network-vif-deleted:ac56cb8e-e2ef-419e-be28-4a7a3d4a4c68 for instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc on n-h2-860687-3 Oct 27 18:55:58.152026 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-703e98a1-4a0b-43d0-9a91-01fadc1ed475 req-b2fa5731-95ea-4de2-b0ae-1a117c6274c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080588 Oct 27 18:55:58.152717 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1258/2578] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:58.163098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e16934ba-06ff-4832-82a1-2605720cf4c1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:58.163847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e16934ba-06ff-4832-82a1-2605720cf4c1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:58.181184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e16934ba-06ff-4832-82a1-2605720cf4c1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:58.183651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e16934ba-06ff-4832-82a1-2605720cf4c1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:58.184323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e16934ba-06ff-4832-82a1-2605720cf4c1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:58.185272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e16934ba-06ff-4832-82a1-2605720cf4c1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:58.186155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e16934ba-06ff-4832-82a1-2605720cf4c1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:58.186836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e16934ba-06ff-4832-82a1-2605720cf4c1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:58.353159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e16934ba-06ff-4832-82a1-2605720cf4c1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:58.367044 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e16934ba-06ff-4832-82a1-2605720cf4c1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1278 microversion: 2.1 time: 0.212950 Oct 27 18:55:58.367715 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1259/2579] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:58 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1278 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:58.416446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a0b3a765-44c9-4b70-b5e9-62073fef3cd6 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:58.421392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a0b3a765-44c9-4b70-b5e9-62073fef3cd6 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:58.440990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0b3a765-44c9-4b70-b5e9-62073fef3cd6 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:58.441504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0b3a765-44c9-4b70-b5e9-62073fef3cd6 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:58.441954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0b3a765-44c9-4b70-b5e9-62073fef3cd6 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:58.442717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0b3a765-44c9-4b70-b5e9-62073fef3cd6 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:58.442961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c5143867-0619-4019-994c-0a85dc1e6e07 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:58.443184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0b3a765-44c9-4b70-b5e9-62073fef3cd6 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:58.443646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0b3a765-44c9-4b70-b5e9-62073fef3cd6 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:58.454477 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c5143867-0619-4019-994c-0a85dc1e6e07 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.397055 Oct 27 18:55:58.458022 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1321/2580] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:58 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:58.478223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d4741ed6-cdfd-4d14-a56d-a98eee1d7096 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:58.479468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d4741ed6-cdfd-4d14-a56d-a98eee1d7096 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:58.492220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4741ed6-cdfd-4d14-a56d-a98eee1d7096 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:58.507282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4741ed6-cdfd-4d14-a56d-a98eee1d7096 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:58.507885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4741ed6-cdfd-4d14-a56d-a98eee1d7096 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:58.510544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4741ed6-cdfd-4d14-a56d-a98eee1d7096 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:58.512301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4741ed6-cdfd-4d14-a56d-a98eee1d7096 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:58.512768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4741ed6-cdfd-4d14-a56d-a98eee1d7096 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:58.985300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0b3a765-44c9-4b70-b5e9-62073fef3cd6 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:58.995822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0b3a765-44c9-4b70-b5e9-62073fef3cd6 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:58.998495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0b3a765-44c9-4b70-b5e9-62073fef3cd6 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:59.001249 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a0b3a765-44c9-4b70-b5e9-62073fef3cd6 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 200 len: 1359 microversion: 2.21 time: 0.589164 Oct 27 18:55:59.003390 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1260/2581] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:55:58 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 1359 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:55:59.009258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-354a504c-5e70-4d8f-924a-cf7fa61375d3 req-f6473aa6-18cb-416a-bc1a-7bfaed6f041a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d741a04d-f8e8-4b66-bc30-377d4c8de1dc", "name": "network-vif-unplugged", "status": "completed", "tag": "ac56cb8e-e2ef-419e-be28-4a7a3d4a4c68"}, {"server_uuid": "1608b064-7a7d-438e-ae9c-daad010181cf", "name": "network-vif-plugged", "status": "completed", "tag": "520e44b2-88d2-4fa9-9848-cae4eb6e55bd"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:59.025275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-354a504c-5e70-4d8f-924a-cf7fa61375d3 req-f6473aa6-18cb-416a-bc1a-7bfaed6f041a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:59.026614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-354a504c-5e70-4d8f-924a-cf7fa61375d3 req-f6473aa6-18cb-416a-bc1a-7bfaed6f041a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:59.027288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-354a504c-5e70-4d8f-924a-cf7fa61375d3 req-f6473aa6-18cb-416a-bc1a-7bfaed6f041a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:59.048900 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-354a504c-5e70-4d8f-924a-cf7fa61375d3 req-f6473aa6-18cb-416a-bc1a-7bfaed6f041a service nova] Creating event network-vif-unplugged:ac56cb8e-e2ef-419e-be28-4a7a3d4a4c68 for instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc on n-h2-860687-3 Oct 27 18:55:59.051294 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-354a504c-5e70-4d8f-924a-cf7fa61375d3 req-f6473aa6-18cb-416a-bc1a-7bfaed6f041a service nova] Creating event network-vif-plugged:520e44b2-88d2-4fa9-9848-cae4eb6e55bd for instance 1608b064-7a7d-438e-ae9c-daad010181cf on n-h1-860687-3 Oct 27 18:55:59.067060 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-354a504c-5e70-4d8f-924a-cf7fa61375d3 req-f6473aa6-18cb-416a-bc1a-7bfaed6f041a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.061686 Oct 27 18:55:59.068440 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1261/2582] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:55:59.077115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-540ac5e6-e7e9-4161-99ae-fe42f074e885 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-540ac5e6-e7e9-4161-99ae-fe42f074e885 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 160 Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "969dfa55-7bd6-4101-b2b3-c0ca6c6378eb"}]}} Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'body': {'server': {'name': '', 'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00', 'flavorRef': '452', 'networks': [{'uuid': '969dfa55-7bd6-4101-b2b3-c0ca6c6378eb'}]}}} Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi '' Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:55:59.083345 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:55:59.087440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:55:59.087440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 18:55:59.087440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:59.087440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:55:59.087440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:59.087440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:55:59.087440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:55:59.087440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:55:59.087440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:55:59.087440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:55:59.087440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 18:55:59.087440 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:55:59.090574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-540ac5e6-e7e9-4161-99ae-fe42f074e885 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:55:59.091390 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-540ac5e6-e7e9-4161-99ae-fe42f074e885 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021430 Oct 27 18:55:59.095748 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1262/2583] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:55:59 2022] POST /compute/v2.1/servers => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:55:59.118096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d6df461-f4c1-4fd7-b0b7-c3f8492acefb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:59.118905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0d6df461-f4c1-4fd7-b0b7-c3f8492acefb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:59.137143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d6df461-f4c1-4fd7-b0b7-c3f8492acefb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:59.137647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d6df461-f4c1-4fd7-b0b7-c3f8492acefb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:59.138089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d6df461-f4c1-4fd7-b0b7-c3f8492acefb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:59.139175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d6df461-f4c1-4fd7-b0b7-c3f8492acefb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:59.139828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d6df461-f4c1-4fd7-b0b7-c3f8492acefb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:59.140447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d6df461-f4c1-4fd7-b0b7-c3f8492acefb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:59.184119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d4741ed6-cdfd-4d14-a56d-a98eee1d7096 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74accb869c48434ab1aa5452d6b0f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b041a3368a34a02ab30267164853ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:59.211619 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d4741ed6-cdfd-4d14-a56d-a98eee1d7096 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 200 len: 1315 microversion: 2.1 time: 0.748221 Oct 27 18:55:59.212211 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1322/2584] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:58 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 1315 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:59.231030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-96ce8b22-b5b9-4ded-b3d6-5966cd7c91ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:59.239342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-96ce8b22-b5b9-4ded-b3d6-5966cd7c91ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:59.266508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96ce8b22-b5b9-4ded-b3d6-5966cd7c91ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:59.274285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96ce8b22-b5b9-4ded-b3d6-5966cd7c91ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:59.277915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96ce8b22-b5b9-4ded-b3d6-5966cd7c91ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:59.279630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96ce8b22-b5b9-4ded-b3d6-5966cd7c91ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:59.281520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96ce8b22-b5b9-4ded-b3d6-5966cd7c91ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:59.282059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96ce8b22-b5b9-4ded-b3d6-5966cd7c91ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:59.526321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-96ce8b22-b5b9-4ded-b3d6-5966cd7c91ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:59.544768 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-96ce8b22-b5b9-4ded-b3d6-5966cd7c91ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1505 microversion: 2.1 time: 0.320567 Oct 27 18:55:59.546974 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1323/2585] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:59 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:59.554045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3a16788a-b173-4832-b29a-4bb460502dfe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:59.555322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3a16788a-b173-4832-b29a-4bb460502dfe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:59.568554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a16788a-b173-4832-b29a-4bb460502dfe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:59.569993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a16788a-b173-4832-b29a-4bb460502dfe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:59.570617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a16788a-b173-4832-b29a-4bb460502dfe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:59.571716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a16788a-b173-4832-b29a-4bb460502dfe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:59.572703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a16788a-b173-4832-b29a-4bb460502dfe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:59.573346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a16788a-b173-4832-b29a-4bb460502dfe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:59.652071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0d6df461-f4c1-4fd7-b0b7-c3f8492acefb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:59.661703 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d6df461-f4c1-4fd7-b0b7-c3f8492acefb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.566401 Oct 27 18:55:59.662631 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1263/2586] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:59 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:59.667732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-980bc2ce-11bc-4929-9d72-79b632fd24cf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:59.668582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-980bc2ce-11bc-4929-9d72-79b632fd24cf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:59.688245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980bc2ce-11bc-4929-9d72-79b632fd24cf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:59.689848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980bc2ce-11bc-4929-9d72-79b632fd24cf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:59.691255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980bc2ce-11bc-4929-9d72-79b632fd24cf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:59.692233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980bc2ce-11bc-4929-9d72-79b632fd24cf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:59.692923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980bc2ce-11bc-4929-9d72-79b632fd24cf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:59.693517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980bc2ce-11bc-4929-9d72-79b632fd24cf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:59.712605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:55:59.803878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3a16788a-b173-4832-b29a-4bb460502dfe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:59.815886 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3a16788a-b173-4832-b29a-4bb460502dfe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.265918 Oct 27 18:55:59.827277 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1324/2587] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:59 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:59.839330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-980bc2ce-11bc-4929-9d72-79b632fd24cf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:55:59.844681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-90b7da71-f6c0-4e81-aa87-f2517bf76cf3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:55:59.845997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-90b7da71-f6c0-4e81-aa87-f2517bf76cf3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:55:59.855620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90b7da71-f6c0-4e81-aa87-f2517bf76cf3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:59.856014 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-980bc2ce-11bc-4929-9d72-79b632fd24cf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1266 microversion: 2.1 time: 0.192162 Oct 27 18:55:59.856342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90b7da71-f6c0-4e81-aa87-f2517bf76cf3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:59.856899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90b7da71-f6c0-4e81-aa87-f2517bf76cf3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:55:59.857266 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1264/2588] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:59 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:55:59.874332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90b7da71-f6c0-4e81-aa87-f2517bf76cf3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:55:59.875064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90b7da71-f6c0-4e81-aa87-f2517bf76cf3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:55:59.875597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90b7da71-f6c0-4e81-aa87-f2517bf76cf3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:00.035326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2e5b4637-e66e-481c-89ec-8ae052bb81c8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:00.036032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2e5b4637-e66e-481c-89ec-8ae052bb81c8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:00.061524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e5b4637-e66e-481c-89ec-8ae052bb81c8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:00.065680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e5b4637-e66e-481c-89ec-8ae052bb81c8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:00.066303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e5b4637-e66e-481c-89ec-8ae052bb81c8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:00.067144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e5b4637-e66e-481c-89ec-8ae052bb81c8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:00.067585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e5b4637-e66e-481c-89ec-8ae052bb81c8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:00.068045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e5b4637-e66e-481c-89ec-8ae052bb81c8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:00.129813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-90b7da71-f6c0-4e81-aa87-f2517bf76cf3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:00.140722 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-90b7da71-f6c0-4e81-aa87-f2517bf76cf3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.300515 Oct 27 18:56:00.143094 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1325/2589] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:55:59 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:00.166526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-95d5818f-2e62-4ed9-bd3a-8e84b38a6e0a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:00.168267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-95d5818f-2e62-4ed9-bd3a-8e84b38a6e0a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: e41de53b-9f15-4e63-b764-d3c754a128e3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:00.175933 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-95d5818f-2e62-4ed9-bd3a-8e84b38a6e0a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance e41de53b-9f15-4e63-b764-d3c754a128e3 could not be found. Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-95d5818f-2e62-4ed9-bd3a-8e84b38a6e0a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/e41de53b-9f15-4e63-b764-d3c754a128e3/action HTTP/1.1 Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 14 Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: {"shelve": {}} Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance e41de53b-9f15-4e63-b764-d3c754a128e3 could not be found. Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'e41de53b-9f15-4e63-b764-d3c754a128e3', 'body': {'shelve': {}}} Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e41de53b-9f15-4e63-b764-d3c754a128e3 could not be found. Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e41de53b-9f15-4e63-b764-d3c754a128e3 could not be found. Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:56:00.178754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:56:00.182603 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:56:00.182603 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:56:00.182603 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e41de53b-9f15-4e63-b764-d3c754a128e3 could not be found. Oct 27 18:56:00.182603 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:56:00.184337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-95d5818f-2e62-4ed9-bd3a-8e84b38a6e0a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance e41de53b-9f15-4e63-b764-d3c754a128e3 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:56:00.186216 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-95d5818f-2e62-4ed9-bd3a-8e84b38a6e0a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/e41de53b-9f15-4e63-b764-d3c754a128e3/action" status: 404 len: 111 microversion: 2.1 time: 0.024497 Oct 27 18:56:00.187162 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1326/2590] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:56:00 2022] POST /compute/v2.1/servers/e41de53b-9f15-4e63-b764-d3c754a128e3/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:56:00.195316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f3f0660c-63a3-4d4d-8fe8-48e70229d1f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:00.196787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f3f0660c-63a3-4d4d-8fe8-48e70229d1f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:00.207831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3f0660c-63a3-4d4d-8fe8-48e70229d1f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:00.208366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3f0660c-63a3-4d4d-8fe8-48e70229d1f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:00.209159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3f0660c-63a3-4d4d-8fe8-48e70229d1f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:00.209920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3f0660c-63a3-4d4d-8fe8-48e70229d1f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:00.210425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3f0660c-63a3-4d4d-8fe8-48e70229d1f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:00.210855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3f0660c-63a3-4d4d-8fe8-48e70229d1f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:00.438246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f3f0660c-63a3-4d4d-8fe8-48e70229d1f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:00.459368 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f3f0660c-63a3-4d4d-8fe8-48e70229d1f3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.268041 Oct 27 18:56:00.478938 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1327/2591] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:00 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:56:00.494548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b1314c0b-057b-44be-8b05-aeff587e2aa5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:00.495176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b1314c0b-057b-44be-8b05-aeff587e2aa5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:00.504421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1314c0b-057b-44be-8b05-aeff587e2aa5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:00.505167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1314c0b-057b-44be-8b05-aeff587e2aa5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:00.506002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1314c0b-057b-44be-8b05-aeff587e2aa5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:00.508106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1314c0b-057b-44be-8b05-aeff587e2aa5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:00.508984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1314c0b-057b-44be-8b05-aeff587e2aa5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:00.509611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1314c0b-057b-44be-8b05-aeff587e2aa5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:00.705077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b1314c0b-057b-44be-8b05-aeff587e2aa5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74accb869c48434ab1aa5452d6b0f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b041a3368a34a02ab30267164853ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:00.720806 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b1314c0b-057b-44be-8b05-aeff587e2aa5 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 200 len: 1503 microversion: 2.1 time: 0.240408 Oct 27 18:56:00.721448 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1328/2592] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:00 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:00.729998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6afb10d8-a21f-400e-9849-90fba84585ba tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:00.730850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6afb10d8-a21f-400e-9849-90fba84585ba tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:00.738068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6afb10d8-a21f-400e-9849-90fba84585ba tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:00.738804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6afb10d8-a21f-400e-9849-90fba84585ba tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:00.739728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6afb10d8-a21f-400e-9849-90fba84585ba tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:00.740600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6afb10d8-a21f-400e-9849-90fba84585ba tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:00.741213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6afb10d8-a21f-400e-9849-90fba84585ba tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:00.742094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6afb10d8-a21f-400e-9849-90fba84585ba tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:00.779201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2e5b4637-e66e-481c-89ec-8ae052bb81c8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:00.788669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2e5b4637-e66e-481c-89ec-8ae052bb81c8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:00.795789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2e5b4637-e66e-481c-89ec-8ae052bb81c8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:00.797010 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2e5b4637-e66e-481c-89ec-8ae052bb81c8 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 200 len: 1551 microversion: 2.21 time: 0.768559 Oct 27 18:56:00.797821 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1265/2593] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:56:00 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 1551 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:56:00.817773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fd8ad4cc-2a8a-4d5e-ad94-52e51e407947 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:00.818789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fd8ad4cc-2a8a-4d5e-ad94-52e51e407947 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:00.828150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd8ad4cc-2a8a-4d5e-ad94-52e51e407947 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:00.833065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd8ad4cc-2a8a-4d5e-ad94-52e51e407947 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:00.833777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd8ad4cc-2a8a-4d5e-ad94-52e51e407947 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:00.834834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd8ad4cc-2a8a-4d5e-ad94-52e51e407947 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:00.835489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd8ad4cc-2a8a-4d5e-ad94-52e51e407947 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:00.836103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd8ad4cc-2a8a-4d5e-ad94-52e51e407947 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:00.953559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6afb10d8-a21f-400e-9849-90fba84585ba tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:00.963885 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6afb10d8-a21f-400e-9849-90fba84585ba tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.237786 Oct 27 18:56:00.983368 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1329/2594] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:00 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:00.989414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-769fafc6-ab04-4656-9b43-cbc2b4a456c4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:00.990090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-769fafc6-ab04-4656-9b43-cbc2b4a456c4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:00.996811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-769fafc6-ab04-4656-9b43-cbc2b4a456c4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:00.997289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-769fafc6-ab04-4656-9b43-cbc2b4a456c4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:00.997704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-769fafc6-ab04-4656-9b43-cbc2b4a456c4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:00.998440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-769fafc6-ab04-4656-9b43-cbc2b4a456c4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:00.998905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-769fafc6-ab04-4656-9b43-cbc2b4a456c4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:00.999424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-769fafc6-ab04-4656-9b43-cbc2b4a456c4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.153252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-769fafc6-ab04-4656-9b43-cbc2b4a456c4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:01.162265 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-769fafc6-ab04-4656-9b43-cbc2b4a456c4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.177754 Oct 27 18:56:01.163110 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1330/2595] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:00 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:01.168041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-633a4f82-4b09-42a5-b1c6-f4c10e074b73 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:01.168724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-633a4f82-4b09-42a5-b1c6-f4c10e074b73 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:01.175600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-633a4f82-4b09-42a5-b1c6-f4c10e074b73 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.176345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-633a4f82-4b09-42a5-b1c6-f4c10e074b73 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.176994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-633a4f82-4b09-42a5-b1c6-f4c10e074b73 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.177898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-633a4f82-4b09-42a5-b1c6-f4c10e074b73 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.178602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-633a4f82-4b09-42a5-b1c6-f4c10e074b73 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.179248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-633a4f82-4b09-42a5-b1c6-f4c10e074b73 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.233742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:01.254330 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-633a4f82-4b09-42a5-b1c6-f4c10e074b73 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.089993 Oct 27 18:56:01.255061 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1331/2596] 10.222.0.42 () {58 vars in 1296 bytes} [Thu Oct 27 18:56:01 2022] DELETE /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf/os-server-password => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:56:01.259809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-279dc19d-3e8b-4d99-ae1e-2f0bfe7cd4fe tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:01.260321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-279dc19d-3e8b-4d99-ae1e-2f0bfe7cd4fe tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:01.266769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-279dc19d-3e8b-4d99-ae1e-2f0bfe7cd4fe tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.267266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-279dc19d-3e8b-4d99-ae1e-2f0bfe7cd4fe tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.267714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-279dc19d-3e8b-4d99-ae1e-2f0bfe7cd4fe tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.268513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-279dc19d-3e8b-4d99-ae1e-2f0bfe7cd4fe tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.268983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-279dc19d-3e8b-4d99-ae1e-2f0bfe7cd4fe tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.269416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-279dc19d-3e8b-4d99-ae1e-2f0bfe7cd4fe tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.296814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-279dc19d-3e8b-4d99-ae1e-2f0bfe7cd4fe tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:56:01.347149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd8ad4cc-2a8a-4d5e-ad94-52e51e407947 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:01.355779 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fd8ad4cc-2a8a-4d5e-ad94-52e51e407947 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1505 microversion: 2.1 time: 0.553133 Oct 27 18:56:01.356376 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1266/2597] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:00 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:01.371911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-26b5ee23-0656-4231-b0a5-4328a6fae0a3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:01.372973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-26b5ee23-0656-4231-b0a5-4328a6fae0a3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:01.390566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26b5ee23-0656-4231-b0a5-4328a6fae0a3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.391133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26b5ee23-0656-4231-b0a5-4328a6fae0a3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.391284 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-279dc19d-3e8b-4d99-ae1e-2f0bfe7cd4fe tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "DELETE /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 204 len: 0 microversion: 2.21 time: 0.134903 Oct 27 18:56:01.391503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26b5ee23-0656-4231-b0a5-4328a6fae0a3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.392819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26b5ee23-0656-4231-b0a5-4328a6fae0a3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.393054 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1332/2598] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:56:01 2022] DELETE /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 18:56:01.393743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26b5ee23-0656-4231-b0a5-4328a6fae0a3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.394411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26b5ee23-0656-4231-b0a5-4328a6fae0a3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.401151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-37dab8e7-6050-48ee-9fe7-02600a9f3e98 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:01.401793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-37dab8e7-6050-48ee-9fe7-02600a9f3e98 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:01.409835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37dab8e7-6050-48ee-9fe7-02600a9f3e98 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.410418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37dab8e7-6050-48ee-9fe7-02600a9f3e98 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.410886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37dab8e7-6050-48ee-9fe7-02600a9f3e98 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.412578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37dab8e7-6050-48ee-9fe7-02600a9f3e98 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.413214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37dab8e7-6050-48ee-9fe7-02600a9f3e98 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.414107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37dab8e7-6050-48ee-9fe7-02600a9f3e98 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.444789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-37dab8e7-6050-48ee-9fe7-02600a9f3e98 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lazy-loading 'flavor' on Instance uuid a6e311e1-6dd0-4498-897c-c92ce762d9b9 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:56:01.680093 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-37dab8e7-6050-48ee-9fe7-02600a9f3e98 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action" status: 202 len: 0 microversion: 2.1 time: 0.286210 Oct 27 18:56:01.680713 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1333/2599] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:56:01 2022] POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:56:01.739687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-26b5ee23-0656-4231-b0a5-4328a6fae0a3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:01.748528 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-26b5ee23-0656-4231-b0a5-4328a6fae0a3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1308 microversion: 2.1 time: 0.380464 Oct 27 18:56:01.749238 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1267/2600] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:01 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1308 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:01.754370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b5cfdfdb-e900-469c-961d-bd0cdeea0eb8 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:01.754969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b5cfdfdb-e900-469c-961d-bd0cdeea0eb8 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:01.761054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5cfdfdb-e900-469c-961d-bd0cdeea0eb8 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.761616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5cfdfdb-e900-469c-961d-bd0cdeea0eb8 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.762127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5cfdfdb-e900-469c-961d-bd0cdeea0eb8 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.762918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5cfdfdb-e900-469c-961d-bd0cdeea0eb8 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.763443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5cfdfdb-e900-469c-961d-bd0cdeea0eb8 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.763938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5cfdfdb-e900-469c-961d-bd0cdeea0eb8 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.790674 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b5cfdfdb-e900-469c-961d-bd0cdeea0eb8 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.039652 Oct 27 18:56:01.791280 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1268/2601] 10.222.0.42 () {58 vars in 1293 bytes} [Thu Oct 27 18:56:01 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf/os-server-password => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:56:01.796263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a756ad1e-9739-49a5-aef8-3e0705fd787b tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:01.796878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a756ad1e-9739-49a5-aef8-3e0705fd787b tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:01.804127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a756ad1e-9739-49a5-aef8-3e0705fd787b tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.804833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a756ad1e-9739-49a5-aef8-3e0705fd787b tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.805053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a756ad1e-9739-49a5-aef8-3e0705fd787b tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.805754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a756ad1e-9739-49a5-aef8-3e0705fd787b tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.806210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a756ad1e-9739-49a5-aef8-3e0705fd787b tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.806652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a756ad1e-9739-49a5-aef8-3e0705fd787b tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.825415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-806a7b8f-7086-4c2d-ac82-ca0320b64a1b tempest-AZV2TestJSON-1453529576 tempest-AZV2TestJSON-1453529576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:01.827009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-806a7b8f-7086-4c2d-ac82-ca0320b64a1b tempest-AZV2TestJSON-1453529576 tempest-AZV2TestJSON-1453529576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.827501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-806a7b8f-7086-4c2d-ac82-ca0320b64a1b tempest-AZV2TestJSON-1453529576 tempest-AZV2TestJSON-1453529576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.827947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-806a7b8f-7086-4c2d-ac82-ca0320b64a1b tempest-AZV2TestJSON-1453529576 tempest-AZV2TestJSON-1453529576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.828693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-806a7b8f-7086-4c2d-ac82-ca0320b64a1b tempest-AZV2TestJSON-1453529576 tempest-AZV2TestJSON-1453529576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.829151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-806a7b8f-7086-4c2d-ac82-ca0320b64a1b tempest-AZV2TestJSON-1453529576 tempest-AZV2TestJSON-1453529576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.830195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-806a7b8f-7086-4c2d-ac82-ca0320b64a1b tempest-AZV2TestJSON-1453529576 tempest-AZV2TestJSON-1453529576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.857148 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-806a7b8f-7086-4c2d-ac82-ca0320b64a1b tempest-AZV2TestJSON-1453529576 tempest-AZV2TestJSON-1453529576-project] 10.222.0.42 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.175227 Oct 27 18:56:01.857920 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1334/2602] 10.222.0.42 () {58 vars in 1164 bytes} [Thu Oct 27 18:56:01 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:56:01.862465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-66d8787a-fe46-4c33-ab34-10c8d9b427fe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:01.863207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-66d8787a-fe46-4c33-ab34-10c8d9b427fe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:01.865131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:01.871780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66d8787a-fe46-4c33-ab34-10c8d9b427fe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.871780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66d8787a-fe46-4c33-ab34-10c8d9b427fe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.872240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66d8787a-fe46-4c33-ab34-10c8d9b427fe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:01.872915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66d8787a-fe46-4c33-ab34-10c8d9b427fe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:01.873381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66d8787a-fe46-4c33-ab34-10c8d9b427fe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:01.873814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66d8787a-fe46-4c33-ab34-10c8d9b427fe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:02.042229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-66d8787a-fe46-4c33-ab34-10c8d9b427fe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:02.053037 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-66d8787a-fe46-4c33-ab34-10c8d9b427fe tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1512 microversion: 2.1 time: 0.194267 Oct 27 18:56:02.053690 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1335/2603] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:01 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:02.058722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de0ce638-ab9e-42ee-a417-c4320c22762b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:02.059327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-de0ce638-ab9e-42ee-a417-c4320c22762b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:02.066438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de0ce638-ab9e-42ee-a417-c4320c22762b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:02.067264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de0ce638-ab9e-42ee-a417-c4320c22762b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:02.067917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de0ce638-ab9e-42ee-a417-c4320c22762b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:02.068877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de0ce638-ab9e-42ee-a417-c4320c22762b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:02.069420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de0ce638-ab9e-42ee-a417-c4320c22762b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:02.070123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de0ce638-ab9e-42ee-a417-c4320c22762b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:02.099001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-de0ce638-ab9e-42ee-a417-c4320c22762b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:56:02.153205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a756ad1e-9739-49a5-aef8-3e0705fd787b tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:02.169728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a756ad1e-9739-49a5-aef8-3e0705fd787b tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:02.173928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a756ad1e-9739-49a5-aef8-3e0705fd787b tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:02.176289 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a756ad1e-9739-49a5-aef8-3e0705fd787b tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 200 len: 1557 microversion: 2.21 time: 0.383904 Oct 27 18:56:02.178108 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1269/2604] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:56:01 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 1557 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:56:02.194970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4e68af1d-1365-45a2-8e88-198c9b034938 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:02.195941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4e68af1d-1365-45a2-8e88-198c9b034938 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:02.205782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e68af1d-1365-45a2-8e88-198c9b034938 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:02.206929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e68af1d-1365-45a2-8e88-198c9b034938 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:02.209381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e68af1d-1365-45a2-8e88-198c9b034938 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:02.210729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e68af1d-1365-45a2-8e88-198c9b034938 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:02.211541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e68af1d-1365-45a2-8e88-198c9b034938 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:02.212374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e68af1d-1365-45a2-8e88-198c9b034938 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:02.223269 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-de0ce638-ab9e-42ee-a417-c4320c22762b tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 204 len: 0 microversion: 2.1 time: 0.168005 Oct 27 18:56:02.223868 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1336/2605] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:56:02 2022] DELETE /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:56:02.232728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f7ef562f-2143-461a-8eab-450de3f60bf1 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:02.233575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f7ef562f-2143-461a-8eab-450de3f60bf1 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:02.240945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7ef562f-2143-461a-8eab-450de3f60bf1 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:02.241591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7ef562f-2143-461a-8eab-450de3f60bf1 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:02.242717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7ef562f-2143-461a-8eab-450de3f60bf1 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:02.243760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7ef562f-2143-461a-8eab-450de3f60bf1 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:02.244612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7ef562f-2143-461a-8eab-450de3f60bf1 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:02.245269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7ef562f-2143-461a-8eab-450de3f60bf1 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:02.431408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f7ef562f-2143-461a-8eab-450de3f60bf1 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74accb869c48434ab1aa5452d6b0f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b041a3368a34a02ab30267164853ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:02.439380 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f7ef562f-2143-461a-8eab-450de3f60bf1 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 200 len: 1509 microversion: 2.1 time: 0.211264 Oct 27 18:56:02.455298 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1337/2606] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:02 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:02.460933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-64a4d9c8-6e58-4988-84be-5a4b5023cf61 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:02.461769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-64a4d9c8-6e58-4988-84be-5a4b5023cf61 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:02.468254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64a4d9c8-6e58-4988-84be-5a4b5023cf61 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:02.468744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64a4d9c8-6e58-4988-84be-5a4b5023cf61 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:02.469363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64a4d9c8-6e58-4988-84be-5a4b5023cf61 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:02.470075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64a4d9c8-6e58-4988-84be-5a4b5023cf61 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:02.471501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64a4d9c8-6e58-4988-84be-5a4b5023cf61 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:02.472096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64a4d9c8-6e58-4988-84be-5a4b5023cf61 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:02.615000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4e68af1d-1365-45a2-8e88-198c9b034938 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:02.632129 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4e68af1d-1365-45a2-8e88-198c9b034938 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.449593 Oct 27 18:56:02.633410 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1270/2607] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:02 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:56:02.703709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-64a4d9c8-6e58-4988-84be-5a4b5023cf61 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:02.713241 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-64a4d9c8-6e58-4988-84be-5a4b5023cf61 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1505 microversion: 2.1 time: 0.256494 Oct 27 18:56:02.714060 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1338/2608] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:02 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:02.773138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b85c308a-6b17-4319-8539-44ae651d0ac9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:02.773810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b85c308a-6b17-4319-8539-44ae651d0ac9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:02.780295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b85c308a-6b17-4319-8539-44ae651d0ac9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:02.780999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b85c308a-6b17-4319-8539-44ae651d0ac9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:02.781464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b85c308a-6b17-4319-8539-44ae651d0ac9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:02.783541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b85c308a-6b17-4319-8539-44ae651d0ac9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:02.784026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b85c308a-6b17-4319-8539-44ae651d0ac9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:02.784469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b85c308a-6b17-4319-8539-44ae651d0ac9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:02.879337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-719fe1d5-a244-4c14-b200-a1220d985816 req-349072b5-75e5-448d-b008-103f600b08df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a2f813e-a5e5-4146-a05c-ebf2f66d5c28", "tag": "d055e6c0-257b-49c3-8af8-8b0ef8ef1516"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:02.893204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-719fe1d5-a244-4c14-b200-a1220d985816 req-349072b5-75e5-448d-b008-103f600b08df service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:02.894273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-719fe1d5-a244-4c14-b200-a1220d985816 req-349072b5-75e5-448d-b008-103f600b08df service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:02.895030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-719fe1d5-a244-4c14-b200-a1220d985816 req-349072b5-75e5-448d-b008-103f600b08df service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:02.908984 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-719fe1d5-a244-4c14-b200-a1220d985816 req-349072b5-75e5-448d-b008-103f600b08df service nova] Creating event network-changed:d055e6c0-257b-49c3-8af8-8b0ef8ef1516 for instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 on n-h2-860687-3 Oct 27 18:56:02.915822 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-719fe1d5-a244-4c14-b200-a1220d985816 req-349072b5-75e5-448d-b008-103f600b08df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041420 Oct 27 18:56:02.916748 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1339/2609] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:56:03.078126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2caadf02-1ffc-4065-a423-e021eb311a9c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:03.079238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2caadf02-1ffc-4065-a423-e021eb311a9c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:03.087233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2caadf02-1ffc-4065-a423-e021eb311a9c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:03.088429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2caadf02-1ffc-4065-a423-e021eb311a9c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:03.089076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2caadf02-1ffc-4065-a423-e021eb311a9c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:03.089954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2caadf02-1ffc-4065-a423-e021eb311a9c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:03.090617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2caadf02-1ffc-4065-a423-e021eb311a9c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:03.091254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2caadf02-1ffc-4065-a423-e021eb311a9c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:03.307151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2caadf02-1ffc-4065-a423-e021eb311a9c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:03.328280 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2caadf02-1ffc-4065-a423-e021eb311a9c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1512 microversion: 2.1 time: 0.254274 Oct 27 18:56:03.329600 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1340/2610] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:03 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1512 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:03.342995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b85c308a-6b17-4319-8539-44ae651d0ac9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:03.348280 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b85c308a-6b17-4319-8539-44ae651d0ac9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1308 microversion: 2.1 time: 0.579542 Oct 27 18:56:03.352099 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1271/2611] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:02 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1308 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:03.352562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3f0246e7-c5dc-4a91-b9d8-db88ac63d2e3 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:03.353292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3f0246e7-c5dc-4a91-b9d8-db88ac63d2e3 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:03.370279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f0246e7-c5dc-4a91-b9d8-db88ac63d2e3 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:03.371357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f0246e7-c5dc-4a91-b9d8-db88ac63d2e3 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:03.372153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f0246e7-c5dc-4a91-b9d8-db88ac63d2e3 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:03.373589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f0246e7-c5dc-4a91-b9d8-db88ac63d2e3 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:03.373957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f0246e7-c5dc-4a91-b9d8-db88ac63d2e3 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:03.374568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f0246e7-c5dc-4a91-b9d8-db88ac63d2e3 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:03.471869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-018819fe-fb3b-42a9-a2fb-2950431cb3ee tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:03.472889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-018819fe-fb3b-42a9-a2fb-2950431cb3ee tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:03.483234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-018819fe-fb3b-42a9-a2fb-2950431cb3ee tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:03.484301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-018819fe-fb3b-42a9-a2fb-2950431cb3ee tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:03.485103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-018819fe-fb3b-42a9-a2fb-2950431cb3ee tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:03.486103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-018819fe-fb3b-42a9-a2fb-2950431cb3ee tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:03.486888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-018819fe-fb3b-42a9-a2fb-2950431cb3ee tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:03.487527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-018819fe-fb3b-42a9-a2fb-2950431cb3ee tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:03.668778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3f0246e7-c5dc-4a91-b9d8-db88ac63d2e3 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:03.679790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3f0246e7-c5dc-4a91-b9d8-db88ac63d2e3 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:03.681479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3f0246e7-c5dc-4a91-b9d8-db88ac63d2e3 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3370465598e14b9191691d6fbd21ff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea27d7d92d7d4710910d0c6d168a06ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:03.682732 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3f0246e7-c5dc-4a91-b9d8-db88ac63d2e3 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 200 len: 1557 microversion: 2.21 time: 0.337647 Oct 27 18:56:03.683625 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1341/2612] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:56:03 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 1557 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:56:03.698248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-240d513e-97a7-4909-a820-04d7801f329a req-cba97afd-64e0-4d34-8a35-203da8eed694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80613ec8-dbf9-454e-9e15-47efdf0726ae", "name": "network-vif-deleted", "tag": "dc049456-2863-4275-b3e7-2f12a235c810"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:03.710371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-240d513e-97a7-4909-a820-04d7801f329a req-cba97afd-64e0-4d34-8a35-203da8eed694 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:03.710890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-240d513e-97a7-4909-a820-04d7801f329a req-cba97afd-64e0-4d34-8a35-203da8eed694 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:03.711455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-240d513e-97a7-4909-a820-04d7801f329a req-cba97afd-64e0-4d34-8a35-203da8eed694 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:03.724130 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-240d513e-97a7-4909-a820-04d7801f329a req-cba97afd-64e0-4d34-8a35-203da8eed694 service nova] Creating event network-vif-deleted:dc049456-2863-4275-b3e7-2f12a235c810 for instance 80613ec8-dbf9-454e-9e15-47efdf0726ae on n-h2-860687-3 Oct 27 18:56:03.730518 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-240d513e-97a7-4909-a820-04d7801f329a req-cba97afd-64e0-4d34-8a35-203da8eed694 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044749 Oct 27 18:56:03.732032 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1342/2613] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:03.749813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-31b16321-78e1-4bd6-a0d4-a33bfdd8e062 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:03.751114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-31b16321-78e1-4bd6-a0d4-a33bfdd8e062 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:03.763364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31b16321-78e1-4bd6-a0d4-a33bfdd8e062 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:03.764169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31b16321-78e1-4bd6-a0d4-a33bfdd8e062 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:03.764787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31b16321-78e1-4bd6-a0d4-a33bfdd8e062 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:03.765720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31b16321-78e1-4bd6-a0d4-a33bfdd8e062 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:03.766222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31b16321-78e1-4bd6-a0d4-a33bfdd8e062 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:03.766714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31b16321-78e1-4bd6-a0d4-a33bfdd8e062 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:03.956225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-31b16321-78e1-4bd6-a0d4-a33bfdd8e062 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:03.965560 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-31b16321-78e1-4bd6-a0d4-a33bfdd8e062 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.232032 Oct 27 18:56:03.966682 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1343/2614] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:03 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:03.988104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-affbb97b-f187-4246-8bcb-cb0de4d27fc6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:03.990528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-affbb97b-f187-4246-8bcb-cb0de4d27fc6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:03.997944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-affbb97b-f187-4246-8bcb-cb0de4d27fc6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:03.998679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-affbb97b-f187-4246-8bcb-cb0de4d27fc6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:03.999137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-affbb97b-f187-4246-8bcb-cb0de4d27fc6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:04.000071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-affbb97b-f187-4246-8bcb-cb0de4d27fc6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:04.009141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-affbb97b-f187-4246-8bcb-cb0de4d27fc6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:04.009712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-affbb97b-f187-4246-8bcb-cb0de4d27fc6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:04.029959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=7,nova_cell1:UPDATE=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:04.226304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-affbb97b-f187-4246-8bcb-cb0de4d27fc6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:04.234879 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-affbb97b-f187-4246-8bcb-cb0de4d27fc6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1495 microversion: 2.1 time: 0.266693 Oct 27 18:56:04.235616 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1344/2615] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:03 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1495 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:04.261754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0f4b3ae8-0aec-42ba-97be-2d4d7f2233d5 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '.version_select at 0x7fc87321de50>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:04.267732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4b3ae8-0aec-42ba-97be-2d4d7f2233d5 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:04.268510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4b3ae8-0aec-42ba-97be-2d4d7f2233d5 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:04.269320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f4b3ae8-0aec-42ba-97be-2d4d7f2233d5 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:04.278957 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0f4b3ae8-0aec-42ba-97be-2d4d7f2233d5 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.022133 Oct 27 18:56:04.280733 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1345/2616] 10.222.0.42 () {58 vars in 1143 bytes} [Thu Oct 27 18:56:04 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:04.297426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3de480e6-b3db-4df4-8819-8aa50ef4fd93 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:04.299293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3de480e6-b3db-4df4-8819-8aa50ef4fd93 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:04.307987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3de480e6-b3db-4df4-8819-8aa50ef4fd93 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:04.310429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3de480e6-b3db-4df4-8819-8aa50ef4fd93 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:04.311233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3de480e6-b3db-4df4-8819-8aa50ef4fd93 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:04.317263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3de480e6-b3db-4df4-8819-8aa50ef4fd93 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:04.318078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3de480e6-b3db-4df4-8819-8aa50ef4fd93 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:04.320497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3de480e6-b3db-4df4-8819-8aa50ef4fd93 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:04.387755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-018819fe-fb3b-42a9-a2fb-2950431cb3ee tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74accb869c48434ab1aa5452d6b0f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b041a3368a34a02ab30267164853ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:04.403368 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-018819fe-fb3b-42a9-a2fb-2950431cb3ee tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 200 len: 1509 microversion: 2.1 time: 0.940611 Oct 27 18:56:04.415266 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1272/2617] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:03 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 1509 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:04.421511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b341fbd9-4e99-4f91-84b0-8341f600805a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:04.422493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b341fbd9-4e99-4f91-84b0-8341f600805a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:04.429888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b341fbd9-4e99-4f91-84b0-8341f600805a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:04.430823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b341fbd9-4e99-4f91-84b0-8341f600805a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:04.431528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b341fbd9-4e99-4f91-84b0-8341f600805a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:04.432680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b341fbd9-4e99-4f91-84b0-8341f600805a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:04.433412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b341fbd9-4e99-4f91-84b0-8341f600805a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:04.434738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b341fbd9-4e99-4f91-84b0-8341f600805a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:04.671251 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3de480e6-b3db-4df4-8819-8aa50ef4fd93 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1646 microversion: 2.1 time: 0.378538 Oct 27 18:56:04.672168 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1346/2618] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:04 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1646 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:04.708010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7b5d18e8-d940-475d-bb31-f02cf5e8a5b2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:04.709837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7b5d18e8-d940-475d-bb31-f02cf5e8a5b2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:04.721893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b5d18e8-d940-475d-bb31-f02cf5e8a5b2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:04.722851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b5d18e8-d940-475d-bb31-f02cf5e8a5b2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:04.723370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b5d18e8-d940-475d-bb31-f02cf5e8a5b2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:04.724212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b5d18e8-d940-475d-bb31-f02cf5e8a5b2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:04.725206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b5d18e8-d940-475d-bb31-f02cf5e8a5b2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:04.725711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b5d18e8-d940-475d-bb31-f02cf5e8a5b2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:04.900074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b341fbd9-4e99-4f91-84b0-8341f600805a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:04.910909 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b341fbd9-4e99-4f91-84b0-8341f600805a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1512 microversion: 2.1 time: 0.494017 Oct 27 18:56:04.927474 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1273/2619] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:04 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1512 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:04.934256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc30e502-ddf0-4f3a-8837-5c7daa745e38 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:04.935051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fc30e502-ddf0-4f3a-8837-5c7daa745e38 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:04.942871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc30e502-ddf0-4f3a-8837-5c7daa745e38 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:04.943374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc30e502-ddf0-4f3a-8837-5c7daa745e38 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:04.944342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc30e502-ddf0-4f3a-8837-5c7daa745e38 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:04.945215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc30e502-ddf0-4f3a-8837-5c7daa745e38 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:04.945697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc30e502-ddf0-4f3a-8837-5c7daa745e38 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:04.946317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc30e502-ddf0-4f3a-8837-5c7daa745e38 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:04.969927 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-fc30e502-ddf0-4f3a-8837-5c7daa745e38 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] HTTP exception thrown: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc30e502-ddf0-4f3a-8837-5c7daa745e38 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Request method failure captured: Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae HTTP/1.1 Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtQmccUuw6gd0esrSooyDaN2AtFlha_nE31T9Stmiu6nWgBxtueXgK7jEftJ4x6TpFlyOTSP1CpXiG-Y4XicACJvqFubC9IYWtjsXKPHC3Mn49ObmiWRQCoTgVaTNjuoGN-AyYFRui4gbqQIEcHQRg1y3dBiFTQkVk6XfRzcd6BTXqw Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.21 Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: ea27d7d92d7d4710910d0c6d168a06ca Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-InstanceActionsV221TestJSON-249857318 Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ea27d7d92d7d4710910d0c6d168a06ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea27d7d92d7d4710910d0c6d168a06ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ea27d7d92d7d4710910d0c6d168a06ca", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea27d7d92d7d4710910d0c6d168a06ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-InstanceActionsV221TestJSON-249857318 Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: ea27d7d92d7d4710910d0c6d168a06ca Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-249857318 Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-InstanceActionsV221TestJSON-249857318-project Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 3370465598e14b9191691d6fbd21ff68 Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-InstanceActionsV221TestJSON-249857318-project Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '80613ec8-dbf9-454e-9e15-47efdf0726ae'} Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:04.972444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:56:04.976448 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:04.976448 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:04.976448 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:56:04.976448 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:56:04.976448 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:56:04.976448 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:56:04.976448 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:04.976448 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:04.976448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc30e502-ddf0-4f3a-8837-5c7daa745e38 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Returning 404 to user: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:56:04.976448 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc30e502-ddf0-4f3a-8837-5c7daa745e38 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 404 len: 111 microversion: 2.21 time: 0.044639 Oct 27 18:56:04.978536 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1274/2620] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:56:04 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:56:04.983503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1248220555", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "db61e2ae-a0b9-4ebe-826d-1c6dfd28832f"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:05.022363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7b5d18e8-d940-475d-bb31-f02cf5e8a5b2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:05.037595 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7b5d18e8-d940-475d-bb31-f02cf5e8a5b2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1308 microversion: 2.1 time: 0.363274 Oct 27 18:56:05.038599 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1347/2621] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:04 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:05.041337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] validate_networks() for [('db61e2ae-a0b9-4ebe-826d-1c6dfd28832f', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:56:05.057821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5b7074f9-4e7e-4865-8c23-494b29cd20c9 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '.version_select at 0x7fc87325c0d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:05.058529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5b7074f9-4e7e-4865-8c23-494b29cd20c9 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:05.065709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b7074f9-4e7e-4865-8c23-494b29cd20c9 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:05.066221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b7074f9-4e7e-4865-8c23-494b29cd20c9 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:05.066685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b7074f9-4e7e-4865-8c23-494b29cd20c9 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:05.067388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b7074f9-4e7e-4865-8c23-494b29cd20c9 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:05.067850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b7074f9-4e7e-4865-8c23-494b29cd20c9 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:05.068279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b7074f9-4e7e-4865-8c23-494b29cd20c9 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:05.154879 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5b7074f9-4e7e-4865-8c23-494b29cd20c9 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.100928 Oct 27 18:56:05.159954 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1348/2622] 10.222.0.42 () {60 vars in 1337 bytes} [Thu Oct 27 18:56:05 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae/os-instance-actions => generated 611 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:56:05.171166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-96c24b18-a15e-4794-9fb9-453ad13130f5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:05.174372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-96c24b18-a15e-4794-9fb9-453ad13130f5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:05.204293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96c24b18-a15e-4794-9fb9-453ad13130f5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:05.205333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96c24b18-a15e-4794-9fb9-453ad13130f5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:05.205774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96c24b18-a15e-4794-9fb9-453ad13130f5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:05.206716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96c24b18-a15e-4794-9fb9-453ad13130f5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:05.207178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96c24b18-a15e-4794-9fb9-453ad13130f5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:05.207617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96c24b18-a15e-4794-9fb9-453ad13130f5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:05.427819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:05.507158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:05.725922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:56:05.726730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:56:05.727430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:56:05.728051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:56:05.728705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:56:05.736946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-96c24b18-a15e-4794-9fb9-453ad13130f5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:05.740518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:05.741492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:05.742146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:05.743143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:05.743957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:05.744793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:05.755653 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-96c24b18-a15e-4794-9fb9-453ad13130f5 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.599026 Oct 27 18:56:05.766274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Getting quotas for project 47340475d333442da39184d873995e37. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:56:05.771569 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1349/2623] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:05 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:05.774401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Getting quotas for user 59ab6001dda8482a83fbd4dc67eabb68 and project 47340475d333442da39184d873995e37. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:56:05.777779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae1c4e31-831a-4b15-944b-8845a9e89995 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:05.778505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ae1c4e31-831a-4b15-944b-8845a9e89995 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:05.793960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae1c4e31-831a-4b15-944b-8845a9e89995 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:05.794489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae1c4e31-831a-4b15-944b-8845a9e89995 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:05.795241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae1c4e31-831a-4b15-944b-8845a9e89995 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:05.795964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae1c4e31-831a-4b15-944b-8845a9e89995 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:05.796428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae1c4e31-831a-4b15-944b-8845a9e89995 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:05.796871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae1c4e31-831a-4b15-944b-8845a9e89995 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:05.800424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:56:05.803398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:56:05.828023 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-ae1c4e31-831a-4b15-944b-8845a9e89995 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] HTTP exception thrown: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae1c4e31-831a-4b15-944b-8845a9e89995 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Request method failure captured: Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae HTTP/1.1 Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtQmccUuw6gd0esrSooyDaN2AtFlha_nE31T9Stmiu6nWgBxtueXgK7jEftJ4x6TpFlyOTSP1CpXiG-Y4XicACJvqFubC9IYWtjsXKPHC3Mn49ObmiWRQCoTgVaTNjuoGN-AyYFRui4gbqQIEcHQRg1y3dBiFTQkVk6XfRzcd6BTXqw Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.21 Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ea27d7d92d7d4710910d0c6d168a06ca Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-InstanceActionsV221TestJSON-249857318 Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ea27d7d92d7d4710910d0c6d168a06ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea27d7d92d7d4710910d0c6d168a06ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ea27d7d92d7d4710910d0c6d168a06ca", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea27d7d92d7d4710910d0c6d168a06ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-InstanceActionsV221TestJSON-249857318 Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ea27d7d92d7d4710910d0c6d168a06ca Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-249857318 Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-InstanceActionsV221TestJSON-249857318-project Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 3370465598e14b9191691d6fbd21ff68 Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-InstanceActionsV221TestJSON-249857318-project Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '80613ec8-dbf9-454e-9e15-47efdf0726ae'} Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:56:05.832161 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:56:05.837830 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:05.837830 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:56:05.837830 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:56:05.837830 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:56:05.837830 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:05.837830 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:56:05.837830 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:56:05.837830 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:56:05.837830 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:56:05.837830 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:05.837830 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:56:05.840656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae1c4e31-831a-4b15-944b-8845a9e89995 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Returning 404 to user: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:56:05.842057 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ae1c4e31-831a-4b15-944b-8845a9e89995 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "DELETE /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 404 len: 111 microversion: 2.21 time: 0.069311 Oct 27 18:56:05.843681 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1350/2624] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:56:05 2022] DELETE /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:56:05.852265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ed0ea05d-7e22-4d1a-b641-45c5f6dd5404 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:05.853953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ed0ea05d-7e22-4d1a-b641-45c5f6dd5404 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:05.862337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed0ea05d-7e22-4d1a-b641-45c5f6dd5404 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:05.863073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed0ea05d-7e22-4d1a-b641-45c5f6dd5404 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:05.863679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed0ea05d-7e22-4d1a-b641-45c5f6dd5404 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:05.865204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed0ea05d-7e22-4d1a-b641-45c5f6dd5404 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:05.865834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed0ea05d-7e22-4d1a-b641-45c5f6dd5404 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:05.866568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed0ea05d-7e22-4d1a-b641-45c5f6dd5404 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:05.890004 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-171c9a4b-3bf7-457e-8b7a-932cb2e7cbcb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909708 Oct 27 18:56:05.894033 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1275/2625] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:56:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:56:05.907766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-49784069-1b2e-4391-a9cc-fa3aadd35d1c req-494d79d8-28aa-4804-b4fb-e9a66934ef73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1608b064-7a7d-438e-ae9c-daad010181cf", "name": "network-vif-deleted", "tag": "520e44b2-88d2-4fa9-9848-cae4eb6e55bd"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:05.924129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:05.926227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-49784069-1b2e-4391-a9cc-fa3aadd35d1c req-494d79d8-28aa-4804-b4fb-e9a66934ef73 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:05.927272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-49784069-1b2e-4391-a9cc-fa3aadd35d1c req-494d79d8-28aa-4804-b4fb-e9a66934ef73 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:05.927916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-49784069-1b2e-4391-a9cc-fa3aadd35d1c req-494d79d8-28aa-4804-b4fb-e9a66934ef73 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:05.936753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed0ea05d-7e22-4d1a-b641-45c5f6dd5404 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:05.937433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed0ea05d-7e22-4d1a-b641-45c5f6dd5404 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:05.938036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed0ea05d-7e22-4d1a-b641-45c5f6dd5404 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:05.939692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-ed0ea05d-7e22-4d1a-b641-45c5f6dd5404 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lazy-loading 'fault' on Instance uuid 1608b064-7a7d-438e-ae9c-daad010181cf {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:56:05.943685 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-49784069-1b2e-4391-a9cc-fa3aadd35d1c req-494d79d8-28aa-4804-b4fb-e9a66934ef73 service nova] Creating event network-vif-deleted:520e44b2-88d2-4fa9-9848-cae4eb6e55bd for instance 1608b064-7a7d-438e-ae9c-daad010181cf on n-h1-860687-3 Oct 27 18:56:05.950599 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-49784069-1b2e-4391-a9cc-fa3aadd35d1c req-494d79d8-28aa-4804-b4fb-e9a66934ef73 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053738 Oct 27 18:56:05.956392 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1276/2626] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:05.963209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e47f50a-3807-4093-8f60-c0ec9dd79bd1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:05.964019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e47f50a-3807-4093-8f60-c0ec9dd79bd1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] [instance: 80613ec8-dbf9-454e-9e15-47efdf0726ae] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:05.971794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e47f50a-3807-4093-8f60-c0ec9dd79bd1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:05.972321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e47f50a-3807-4093-8f60-c0ec9dd79bd1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:05.972966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e47f50a-3807-4093-8f60-c0ec9dd79bd1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:05.973770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e47f50a-3807-4093-8f60-c0ec9dd79bd1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:05.974401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e47f50a-3807-4093-8f60-c0ec9dd79bd1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:05.974985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e47f50a-3807-4093-8f60-c0ec9dd79bd1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:05.991558 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-5e47f50a-3807-4093-8f60-c0ec9dd79bd1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] HTTP exception thrown: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e47f50a-3807-4093-8f60-c0ec9dd79bd1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Request method failure captured: Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae HTTP/1.1 Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtQmccUuw6gd0esrSooyDaN2AtFlha_nE31T9Stmiu6nWgBxtueXgK7jEftJ4x6TpFlyOTSP1CpXiG-Y4XicACJvqFubC9IYWtjsXKPHC3Mn49ObmiWRQCoTgVaTNjuoGN-AyYFRui4gbqQIEcHQRg1y3dBiFTQkVk6XfRzcd6BTXqw Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.21 Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: ea27d7d92d7d4710910d0c6d168a06ca Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-InstanceActionsV221TestJSON-249857318 Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ea27d7d92d7d4710910d0c6d168a06ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea27d7d92d7d4710910d0c6d168a06ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ea27d7d92d7d4710910d0c6d168a06ca", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea27d7d92d7d4710910d0c6d168a06ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-InstanceActionsV221TestJSON-249857318 Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: ea27d7d92d7d4710910d0c6d168a06ca Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-249857318 Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-InstanceActionsV221TestJSON-249857318-project Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 3370465598e14b9191691d6fbd21ff68 Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-InstanceActionsV221TestJSON-249857318-project Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '80613ec8-dbf9-454e-9e15-47efdf0726ae'} Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:05.993493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:56:05.999132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:05.999132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:05.999132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:56:05.999132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:56:05.999132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:56:05.999132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:56:05.999132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. Oct 27 18:56:05.999132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:05.999132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e47f50a-3807-4093-8f60-c0ec9dd79bd1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] Returning 404 to user: Instance 80613ec8-dbf9-454e-9e15-47efdf0726ae could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:56:06.000054 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e47f50a-3807-4093-8f60-c0ec9dd79bd1 tempest-InstanceActionsV221TestJSON-249857318 tempest-InstanceActionsV221TestJSON-249857318-project] 10.222.0.42 "GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae" status: 404 len: 111 microversion: 2.21 time: 0.041251 Oct 27 18:56:06.000877 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1277/2627] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:56:05 2022] GET /compute/v2.1/servers/80613ec8-dbf9-454e-9e15-47efdf0726ae => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:56:06.011333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c475afb7-1542-46ec-8913-7f6277e8ae8c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:06.012333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c475afb7-1542-46ec-8913-7f6277e8ae8c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:06.056105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ed0ea05d-7e22-4d1a-b641-45c5f6dd5404 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74accb869c48434ab1aa5452d6b0f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b041a3368a34a02ab30267164853ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:06.089789 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ed0ea05d-7e22-4d1a-b641-45c5f6dd5404 tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 200 len: 1305 microversion: 2.1 time: 0.244655 Oct 27 18:56:06.090439 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1351/2628] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:05 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 1305 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:06.101399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7515a0ed-f5a4-4b8f-9f08-c549fb9150d3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:06.109261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7515a0ed-f5a4-4b8f-9f08-c549fb9150d3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:06.125850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7515a0ed-f5a4-4b8f-9f08-c549fb9150d3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:06.129305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7515a0ed-f5a4-4b8f-9f08-c549fb9150d3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:06.131016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7515a0ed-f5a4-4b8f-9f08-c549fb9150d3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:06.133178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7515a0ed-f5a4-4b8f-9f08-c549fb9150d3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:06.134552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7515a0ed-f5a4-4b8f-9f08-c549fb9150d3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:06.135945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7515a0ed-f5a4-4b8f-9f08-c549fb9150d3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:06.449889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c475afb7-1542-46ec-8913-7f6277e8ae8c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:06.462995 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c475afb7-1542-46ec-8913-7f6277e8ae8c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1211 microversion: 2.1 time: 0.453651 Oct 27 18:56:06.478413 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1278/2629] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:06 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1211 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:06.482695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a1eeae07-b58b-4711-a460-342070d00639 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:06.483309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a1eeae07-b58b-4711-a460-342070d00639 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:06.505771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1eeae07-b58b-4711-a460-342070d00639 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:06.508472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1eeae07-b58b-4711-a460-342070d00639 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:06.508983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1eeae07-b58b-4711-a460-342070d00639 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:06.510884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1eeae07-b58b-4711-a460-342070d00639 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:06.512119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1eeae07-b58b-4711-a460-342070d00639 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:06.512567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1eeae07-b58b-4711-a460-342070d00639 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:06.701254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7515a0ed-f5a4-4b8f-9f08-c549fb9150d3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:06.717654 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7515a0ed-f5a4-4b8f-9f08-c549fb9150d3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1512 microversion: 2.1 time: 0.620265 Oct 27 18:56:06.720954 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1352/2630] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:06 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1512 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:06.792422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-183e8219-3a07-4aac-a15c-a85639fd8e7e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:06.794942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-183e8219-3a07-4aac-a15c-a85639fd8e7e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:06.827270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-183e8219-3a07-4aac-a15c-a85639fd8e7e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:06.830043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-183e8219-3a07-4aac-a15c-a85639fd8e7e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:06.831023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-183e8219-3a07-4aac-a15c-a85639fd8e7e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:06.831764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-183e8219-3a07-4aac-a15c-a85639fd8e7e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:06.832227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-183e8219-3a07-4aac-a15c-a85639fd8e7e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:06.832659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-183e8219-3a07-4aac-a15c-a85639fd8e7e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:07.047961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a1eeae07-b58b-4711-a460-342070d00639 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:07.058561 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a1eeae07-b58b-4711-a460-342070d00639 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1308 microversion: 2.1 time: 0.593580 Oct 27 18:56:07.071814 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1279/2631] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:06 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1308 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:07.117482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cfa31536-e589-4d46-b1df-5729e7bf3f0f tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:07.118105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cfa31536-e589-4d46-b1df-5729e7bf3f0f tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] [instance: 1608b064-7a7d-438e-ae9c-daad010181cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:07.124815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfa31536-e589-4d46-b1df-5729e7bf3f0f tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:07.125714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfa31536-e589-4d46-b1df-5729e7bf3f0f tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:07.127245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfa31536-e589-4d46-b1df-5729e7bf3f0f tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:07.128370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfa31536-e589-4d46-b1df-5729e7bf3f0f tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:07.129077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfa31536-e589-4d46-b1df-5729e7bf3f0f tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:07.129752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfa31536-e589-4d46-b1df-5729e7bf3f0f tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:07.147908 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-cfa31536-e589-4d46-b1df-5729e7bf3f0f tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] HTTP exception thrown: Instance 1608b064-7a7d-438e-ae9c-daad010181cf could not be found. Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cfa31536-e589-4d46-b1df-5729e7bf3f0f tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Request method failure captured: Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf HTTP/1.1 Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtQmm6DxHvunCJ690OtgFFXnLa4d5UEFHVooY1WLBGGaAAmD0ih0TH_do7p2lUZfELCaMNeR0GykL789u8J78CtbZvmpueZdcrxUkYNGO81xuHAlE9onKrfivMC5N-toRNcLAWnFN1lrvYQgekblggzSWZFKL65NFuOvf1c0Y5fvTK8 Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 7b041a3368a34a02ab30267164853ef6 Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerPasswordTestJSON-1299534168 Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7b041a3368a34a02ab30267164853ef6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b041a3368a34a02ab30267164853ef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7b041a3368a34a02ab30267164853ef6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b041a3368a34a02ab30267164853ef6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerPasswordTestJSON-1299534168 Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 7b041a3368a34a02ab30267164853ef6 Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1299534168 Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerPasswordTestJSON-1299534168-project Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 74accb869c48434ab1aa5452d6b0f13e Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerPasswordTestJSON-1299534168-project Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 1608b064-7a7d-438e-ae9c-daad010181cf could not be found. Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '1608b064-7a7d-438e-ae9c-daad010181cf'} Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1608b064-7a7d-438e-ae9c-daad010181cf could not be found. Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1608b064-7a7d-438e-ae9c-daad010181cf could not be found. Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:56:07.150243 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:07.154263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:56:07.154263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:56:07.154263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:56:07.154263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:56:07.154263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:56:07.154263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1608b064-7a7d-438e-ae9c-daad010181cf could not be found. Oct 27 18:56:07.154263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:56:07.158065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cfa31536-e589-4d46-b1df-5729e7bf3f0f tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] Returning 404 to user: Instance 1608b064-7a7d-438e-ae9c-daad010181cf could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:56:07.158904 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cfa31536-e589-4d46-b1df-5729e7bf3f0f tempest-ServerPasswordTestJSON-1299534168 tempest-ServerPasswordTestJSON-1299534168-project] 10.222.0.42 "GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf" status: 404 len: 111 microversion: 2.1 time: 0.045597 Oct 27 18:56:07.159916 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1280/2632] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:07 2022] GET /compute/v2.1/servers/1608b064-7a7d-438e-ae9c-daad010181cf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:56:07.461728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-183e8219-3a07-4aac-a15c-a85639fd8e7e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:07.489016 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-183e8219-3a07-4aac-a15c-a85639fd8e7e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.709296 Oct 27 18:56:07.489894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9edb98e1-4759-4f70-83e4-8d5dc1a3b2d1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:07.503902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9edb98e1-4759-4f70-83e4-8d5dc1a3b2d1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:07.505028 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1353/2633] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:06 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:07.512706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9edb98e1-4759-4f70-83e4-8d5dc1a3b2d1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:07.513620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9edb98e1-4759-4f70-83e4-8d5dc1a3b2d1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:07.514716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9edb98e1-4759-4f70-83e4-8d5dc1a3b2d1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:07.515598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9edb98e1-4759-4f70-83e4-8d5dc1a3b2d1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:07.516279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9edb98e1-4759-4f70-83e4-8d5dc1a3b2d1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:07.517508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9edb98e1-4759-4f70-83e4-8d5dc1a3b2d1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:07.742967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-44d436c8-7256-4d7d-a566-80d4efd3a1f5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:07.743587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-44d436c8-7256-4d7d-a566-80d4efd3a1f5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:07.762548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44d436c8-7256-4d7d-a566-80d4efd3a1f5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:07.763187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44d436c8-7256-4d7d-a566-80d4efd3a1f5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:07.763654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44d436c8-7256-4d7d-a566-80d4efd3a1f5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:07.765150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44d436c8-7256-4d7d-a566-80d4efd3a1f5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:07.765785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44d436c8-7256-4d7d-a566-80d4efd3a1f5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:07.766271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44d436c8-7256-4d7d-a566-80d4efd3a1f5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:07.786530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9edb98e1-4759-4f70-83e4-8d5dc1a3b2d1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:07.806926 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9edb98e1-4759-4f70-83e4-8d5dc1a3b2d1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1263 microversion: 2.1 time: 0.322764 Oct 27 18:56:07.808580 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1281/2634] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:07 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1263 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:56:08.084514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9bc802c-461c-4dfc-a3a8-0c1a593c22d9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:08.085160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d9bc802c-461c-4dfc-a3a8-0c1a593c22d9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:08.094846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9bc802c-461c-4dfc-a3a8-0c1a593c22d9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:08.102771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9bc802c-461c-4dfc-a3a8-0c1a593c22d9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:08.103456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9bc802c-461c-4dfc-a3a8-0c1a593c22d9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:08.104397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9bc802c-461c-4dfc-a3a8-0c1a593c22d9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:08.105029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9bc802c-461c-4dfc-a3a8-0c1a593c22d9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:08.105630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9bc802c-461c-4dfc-a3a8-0c1a593c22d9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:08.130936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-44d436c8-7256-4d7d-a566-80d4efd3a1f5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:08.148008 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-44d436c8-7256-4d7d-a566-80d4efd3a1f5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1512 microversion: 2.1 time: 0.407091 Oct 27 18:56:08.159815 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1354/2635] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:07 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1512 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:08.524376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d072d663-bec5-4b27-bbbd-49d8c4da3206 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:08.525101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d072d663-bec5-4b27-bbbd-49d8c4da3206 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:08.537655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d072d663-bec5-4b27-bbbd-49d8c4da3206 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:08.539352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d072d663-bec5-4b27-bbbd-49d8c4da3206 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:08.541536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d072d663-bec5-4b27-bbbd-49d8c4da3206 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:08.549889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d072d663-bec5-4b27-bbbd-49d8c4da3206 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:08.550685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d072d663-bec5-4b27-bbbd-49d8c4da3206 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:08.551600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d072d663-bec5-4b27-bbbd-49d8c4da3206 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:08.962701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d072d663-bec5-4b27-bbbd-49d8c4da3206 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:08.974349 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d072d663-bec5-4b27-bbbd-49d8c4da3206 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.461616 Oct 27 18:56:08.975553 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1355/2636] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:08 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:56:08.982511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-964ce060-aa67-44e0-8f9e-87f66ef4e0c8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:08.983645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-964ce060-aa67-44e0-8f9e-87f66ef4e0c8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:08.993909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-964ce060-aa67-44e0-8f9e-87f66ef4e0c8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:08.995157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-964ce060-aa67-44e0-8f9e-87f66ef4e0c8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:08.996380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-964ce060-aa67-44e0-8f9e-87f66ef4e0c8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:08.997840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-964ce060-aa67-44e0-8f9e-87f66ef4e0c8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:08.998573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-964ce060-aa67-44e0-8f9e-87f66ef4e0c8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:08.999334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-964ce060-aa67-44e0-8f9e-87f66ef4e0c8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:09.026376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d9bc802c-461c-4dfc-a3a8-0c1a593c22d9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:09.039375 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d9bc802c-461c-4dfc-a3a8-0c1a593c22d9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1308 microversion: 2.1 time: 0.959090 Oct 27 18:56:09.041644 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1282/2637] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:08 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1308 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:09.119233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-964ce060-aa67-44e0-8f9e-87f66ef4e0c8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:09.131588 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-964ce060-aa67-44e0-8f9e-87f66ef4e0c8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1269 microversion: 2.1 time: 0.154646 Oct 27 18:56:09.133795 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1356/2638] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:08 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:09.184136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f4ff6f73-3d12-4ca5-a912-8882df977f6b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:09.184935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f4ff6f73-3d12-4ca5-a912-8882df977f6b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:09.196364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4ff6f73-3d12-4ca5-a912-8882df977f6b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:09.197034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4ff6f73-3d12-4ca5-a912-8882df977f6b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:09.197506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4ff6f73-3d12-4ca5-a912-8882df977f6b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:09.198318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4ff6f73-3d12-4ca5-a912-8882df977f6b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:09.207513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4ff6f73-3d12-4ca5-a912-8882df977f6b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:09.208191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4ff6f73-3d12-4ca5-a912-8882df977f6b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:09.918407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f4ff6f73-3d12-4ca5-a912-8882df977f6b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:09.928454 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f4ff6f73-3d12-4ca5-a912-8882df977f6b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1512 microversion: 2.1 time: 0.748418 Oct 27 18:56:09.933880 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1283/2639] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:09 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1512 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:10.007201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ec895e98-58d3-43db-813e-2b52cbf08b42 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:10.008157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ec895e98-58d3-43db-813e-2b52cbf08b42 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:10.023410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec895e98-58d3-43db-813e-2b52cbf08b42 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:10.024469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec895e98-58d3-43db-813e-2b52cbf08b42 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:10.026202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec895e98-58d3-43db-813e-2b52cbf08b42 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:10.028120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec895e98-58d3-43db-813e-2b52cbf08b42 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:10.029919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec895e98-58d3-43db-813e-2b52cbf08b42 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:10.031258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec895e98-58d3-43db-813e-2b52cbf08b42 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:10.066618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85aa4658-147c-45ec-b0f9-3229f81a65c3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:10.067413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85aa4658-147c-45ec-b0f9-3229f81a65c3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:10.077648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85aa4658-147c-45ec-b0f9-3229f81a65c3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:10.078891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85aa4658-147c-45ec-b0f9-3229f81a65c3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:10.079848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85aa4658-147c-45ec-b0f9-3229f81a65c3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:10.082337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85aa4658-147c-45ec-b0f9-3229f81a65c3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:10.083092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85aa4658-147c-45ec-b0f9-3229f81a65c3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:10.085414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85aa4658-147c-45ec-b0f9-3229f81a65c3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:10.439280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ec895e98-58d3-43db-813e-2b52cbf08b42 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:10.454193 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ec895e98-58d3-43db-813e-2b52cbf08b42 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.455174 Oct 27 18:56:10.460350 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1357/2640] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:09 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:10.481312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-077ce76f-7f24-440a-8636-9257b5d5306f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:10.482189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-077ce76f-7f24-440a-8636-9257b5d5306f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:10.490403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-077ce76f-7f24-440a-8636-9257b5d5306f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:10.491153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-077ce76f-7f24-440a-8636-9257b5d5306f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:10.491872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-077ce76f-7f24-440a-8636-9257b5d5306f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:10.493471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-077ce76f-7f24-440a-8636-9257b5d5306f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:10.494165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-077ce76f-7f24-440a-8636-9257b5d5306f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:10.495811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-077ce76f-7f24-440a-8636-9257b5d5306f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:10.625754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-077ce76f-7f24-440a-8636-9257b5d5306f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:10.645340 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-077ce76f-7f24-440a-8636-9257b5d5306f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1269 microversion: 2.1 time: 0.168955 Oct 27 18:56:10.646192 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1358/2641] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:10 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1269 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:10.739543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-85aa4658-147c-45ec-b0f9-3229f81a65c3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:10.749929 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85aa4658-147c-45ec-b0f9-3229f81a65c3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1308 microversion: 2.1 time: 0.688647 Oct 27 18:56:10.763225 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1284/2642] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:10 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1308 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:56:10.961521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-59fddd20-e6e0-4802-8ea2-743e42d641b8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:10.962280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-59fddd20-e6e0-4802-8ea2-743e42d641b8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:10.988577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59fddd20-e6e0-4802-8ea2-743e42d641b8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:10.993611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59fddd20-e6e0-4802-8ea2-743e42d641b8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:10.994914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59fddd20-e6e0-4802-8ea2-743e42d641b8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:10.995922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59fddd20-e6e0-4802-8ea2-743e42d641b8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:10.997468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59fddd20-e6e0-4802-8ea2-743e42d641b8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:11.004494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59fddd20-e6e0-4802-8ea2-743e42d641b8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:11.314511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-59fddd20-e6e0-4802-8ea2-743e42d641b8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:11.352341 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-59fddd20-e6e0-4802-8ea2-743e42d641b8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1512 microversion: 2.1 time: 0.393224 Oct 27 18:56:11.356928 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1359/2643] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:10 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:11.487090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3a9a220b-f6ef-4b30-90c0-07ce835f47c0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:11.487667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3a9a220b-f6ef-4b30-90c0-07ce835f47c0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:11.496430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a9a220b-f6ef-4b30-90c0-07ce835f47c0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:11.496929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a9a220b-f6ef-4b30-90c0-07ce835f47c0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:11.497375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a9a220b-f6ef-4b30-90c0-07ce835f47c0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:11.498097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a9a220b-f6ef-4b30-90c0-07ce835f47c0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:11.503705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a9a220b-f6ef-4b30-90c0-07ce835f47c0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:11.504226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a9a220b-f6ef-4b30-90c0-07ce835f47c0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:11.608183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-11fc8066-1446-4267-9b54-440583657d92 req-5882796e-e468-46c3-aa6d-81deb9742c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a2f813e-a5e5-4146-a05c-ebf2f66d5c28", "name": "network-vif-plugged", "status": "completed", "tag": "d055e6c0-257b-49c3-8af8-8b0ef8ef1516"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:11.622921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-11fc8066-1446-4267-9b54-440583657d92 req-5882796e-e468-46c3-aa6d-81deb9742c77 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:11.623647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-11fc8066-1446-4267-9b54-440583657d92 req-5882796e-e468-46c3-aa6d-81deb9742c77 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:11.624806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-11fc8066-1446-4267-9b54-440583657d92 req-5882796e-e468-46c3-aa6d-81deb9742c77 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:11.656096 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-11fc8066-1446-4267-9b54-440583657d92 req-5882796e-e468-46c3-aa6d-81deb9742c77 service nova] Creating event network-vif-plugged:d055e6c0-257b-49c3-8af8-8b0ef8ef1516 for instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 on n-h2-860687-3 Oct 27 18:56:11.663517 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-11fc8066-1446-4267-9b54-440583657d92 req-5882796e-e468-46c3-aa6d-81deb9742c77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071317 Oct 27 18:56:11.667560 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1360/2644] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 27 18:56:11.678634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-64facf3a-876c-49e5-8045-c88e3bf658db tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:11.683962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-64facf3a-876c-49e5-8045-c88e3bf658db tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:11.711389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64facf3a-876c-49e5-8045-c88e3bf658db tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:11.712225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64facf3a-876c-49e5-8045-c88e3bf658db tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:11.712847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64facf3a-876c-49e5-8045-c88e3bf658db tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:11.713793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64facf3a-876c-49e5-8045-c88e3bf658db tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:11.714445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64facf3a-876c-49e5-8045-c88e3bf658db tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:11.715048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64facf3a-876c-49e5-8045-c88e3bf658db tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:11.842149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:12.327949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-64facf3a-876c-49e5-8045-c88e3bf658db tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:12.340483 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-64facf3a-876c-49e5-8045-c88e3bf658db tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1311 microversion: 2.1 time: 0.670723 Oct 27 18:56:12.364869 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1361/2645] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:11 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1311 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:12.372760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b4a984e-1099-431e-a0fc-08d171f0bbf0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:12.381297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b4a984e-1099-431e-a0fc-08d171f0bbf0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:12.404762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b4a984e-1099-431e-a0fc-08d171f0bbf0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:12.406658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b4a984e-1099-431e-a0fc-08d171f0bbf0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:12.407297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b4a984e-1099-431e-a0fc-08d171f0bbf0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:12.410570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b4a984e-1099-431e-a0fc-08d171f0bbf0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:12.413691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b4a984e-1099-431e-a0fc-08d171f0bbf0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:12.415998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b4a984e-1099-431e-a0fc-08d171f0bbf0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:12.633477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3a9a220b-f6ef-4b30-90c0-07ce835f47c0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:12.637934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:12.661214 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3a9a220b-f6ef-4b30-90c0-07ce835f47c0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 1.178426 Oct 27 18:56:12.681594 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1285/2646] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:11 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:12.780257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3b4a984e-1099-431e-a0fc-08d171f0bbf0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:12.785036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:12.795595 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b4a984e-1099-431e-a0fc-08d171f0bbf0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1308 microversion: 2.1 time: 0.429450 Oct 27 18:56:12.796755 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1362/2647] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:12 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1308 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:12.802870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-91d0b9e9-5d24-4767-98f6-6a1313272dbb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:12.803983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-91d0b9e9-5d24-4767-98f6-6a1313272dbb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:12.820044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91d0b9e9-5d24-4767-98f6-6a1313272dbb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:12.822783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91d0b9e9-5d24-4767-98f6-6a1313272dbb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:12.824078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91d0b9e9-5d24-4767-98f6-6a1313272dbb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:12.824865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91d0b9e9-5d24-4767-98f6-6a1313272dbb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:12.825337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91d0b9e9-5d24-4767-98f6-6a1313272dbb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:12.825775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91d0b9e9-5d24-4767-98f6-6a1313272dbb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:13.016258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2cfe8e6d-63e5-4744-b3d9-4e2afd7d08fb tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Action: 'create', calling method: .version_select at 0x7fc87320d5e0>, body: {"keypair": {"name": "tempest-keypair-1908941435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqE964w7o/P7FBqtLdtgycVyRNuq5ICbrv/W3EoqTmOgfmIzmQMw/5MFzr4U64kQNF6Pr1y8nwZtwpzoqewmaPiigFr5SsGHfGt0LwAY4ZkLfvWy5yED6DOvazNLCP8Mg=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:13.040005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-2cfe8e6d-63e5-4744-b3d9-4e2afd7d08fb tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Getting quotas for project e030bf61093544d48406bd98ad96b7ef. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:56:13.045752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-2cfe8e6d-63e5-4744-b3d9-4e2afd7d08fb tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Getting quotas for user 504fbbbb4bfa45e88b612301ef7aff3a and project e030bf61093544d48406bd98ad96b7ef. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:56:13.087854 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2cfe8e6d-63e5-4744-b3d9-4e2afd7d08fb tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.404502 Oct 27 18:56:13.096498 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1286/2648] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:56:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:13.135148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-91d0b9e9-5d24-4767-98f6-6a1313272dbb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:13.152575 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-91d0b9e9-5d24-4767-98f6-6a1313272dbb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1512 microversion: 2.1 time: 0.353987 Oct 27 18:56:13.155147 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1363/2649] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:12 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:13.373486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa0c49e1-ffc6-4016-a823-02b4502a1be4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:13.374207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa0c49e1-ffc6-4016-a823-02b4502a1be4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:13.387836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa0c49e1-ffc6-4016-a823-02b4502a1be4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:13.388639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa0c49e1-ffc6-4016-a823-02b4502a1be4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:13.389261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa0c49e1-ffc6-4016-a823-02b4502a1be4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:13.390451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa0c49e1-ffc6-4016-a823-02b4502a1be4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:13.393766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa0c49e1-ffc6-4016-a823-02b4502a1be4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:13.394485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa0c49e1-ffc6-4016-a823-02b4502a1be4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:13.693010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-34d5d129-bc91-45a1-8456-4b6265af578b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:13.694249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-34d5d129-bc91-45a1-8456-4b6265af578b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:13.706997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d5d129-bc91-45a1-8456-4b6265af578b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:13.707532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d5d129-bc91-45a1-8456-4b6265af578b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:13.708013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d5d129-bc91-45a1-8456-4b6265af578b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:13.708725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d5d129-bc91-45a1-8456-4b6265af578b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:13.712439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d5d129-bc91-45a1-8456-4b6265af578b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:13.712745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d5d129-bc91-45a1-8456-4b6265af578b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:13.921336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fa0c49e1-ffc6-4016-a823-02b4502a1be4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:13.935462 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fa0c49e1-ffc6-4016-a823-02b4502a1be4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1311 microversion: 2.1 time: 0.562177 Oct 27 18:56:13.936115 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1287/2650] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:13 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1311 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:13.947176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d245a0b2-0e11-45f7-be2e-ec2789080f5e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:13.948954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d245a0b2-0e11-45f7-be2e-ec2789080f5e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:13.966880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d245a0b2-0e11-45f7-be2e-ec2789080f5e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:13.974766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d245a0b2-0e11-45f7-be2e-ec2789080f5e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:13.975389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d245a0b2-0e11-45f7-be2e-ec2789080f5e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:13.976419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d245a0b2-0e11-45f7-be2e-ec2789080f5e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:13.976894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d245a0b2-0e11-45f7-be2e-ec2789080f5e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:13.977334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d245a0b2-0e11-45f7-be2e-ec2789080f5e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:14.406735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-34d5d129-bc91-45a1-8456-4b6265af578b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:14.444563 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-34d5d129-bc91-45a1-8456-4b6265af578b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.760372 Oct 27 18:56:14.446438 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1364/2651] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:13 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:14.467391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-53e220af-9f70-4c0d-8174-6da7b4cb6c14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:14.468464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-53e220af-9f70-4c0d-8174-6da7b4cb6c14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:14.495873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e220af-9f70-4c0d-8174-6da7b4cb6c14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:14.497234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e220af-9f70-4c0d-8174-6da7b4cb6c14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:14.497699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e220af-9f70-4c0d-8174-6da7b4cb6c14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:14.498586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e220af-9f70-4c0d-8174-6da7b4cb6c14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:14.499506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e220af-9f70-4c0d-8174-6da7b4cb6c14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:14.500168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e220af-9f70-4c0d-8174-6da7b4cb6c14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:14.730088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d245a0b2-0e11-45f7-be2e-ec2789080f5e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:14.741281 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d245a0b2-0e11-45f7-be2e-ec2789080f5e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1308 microversion: 2.1 time: 0.803512 Oct 27 18:56:14.741463 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1288/2652] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:13 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1308 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:14.963949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fe63ee51-4d55-45d2-bd63-64bad223069e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:14.965402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fe63ee51-4d55-45d2-bd63-64bad223069e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:14.973640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe63ee51-4d55-45d2-bd63-64bad223069e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:14.974468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe63ee51-4d55-45d2-bd63-64bad223069e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:14.975177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe63ee51-4d55-45d2-bd63-64bad223069e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:14.976168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe63ee51-4d55-45d2-bd63-64bad223069e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:14.976876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe63ee51-4d55-45d2-bd63-64bad223069e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:14.978171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe63ee51-4d55-45d2-bd63-64bad223069e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:15.086242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-53e220af-9f70-4c0d-8174-6da7b4cb6c14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:15.115731 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-53e220af-9f70-4c0d-8174-6da7b4cb6c14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1512 microversion: 2.1 time: 0.667649 Oct 27 18:56:15.117152 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1365/2653] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:14 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1512 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:15.469684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7f34ee3d-9ff9-4613-a85d-6dddc52f1c41 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:15.471149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7f34ee3d-9ff9-4613-a85d-6dddc52f1c41 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:15.482105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f34ee3d-9ff9-4613-a85d-6dddc52f1c41 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:15.482634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f34ee3d-9ff9-4613-a85d-6dddc52f1c41 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:15.483067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f34ee3d-9ff9-4613-a85d-6dddc52f1c41 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:15.489861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f34ee3d-9ff9-4613-a85d-6dddc52f1c41 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:15.490681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f34ee3d-9ff9-4613-a85d-6dddc52f1c41 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:15.491469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f34ee3d-9ff9-4613-a85d-6dddc52f1c41 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:15.755800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:15.762363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fe63ee51-4d55-45d2-bd63-64bad223069e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:15.792958 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fe63ee51-4d55-45d2-bd63-64bad223069e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1311 microversion: 2.1 time: 0.832713 Oct 27 18:56:15.807494 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1289/2654] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:14 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1311 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:15.818903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-29e894d4-e550-47c4-8f09-3f0cb31b943f req-b2be3ec0-310d-41ce-984c-21b62e14044d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eff0154-2475-4b5b-8c32-0b2ffb3481cf", "tag": "35e4fff4-8327-4345-bb97-8dfe37b06d07"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:15.832357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-29e894d4-e550-47c4-8f09-3f0cb31b943f req-b2be3ec0-310d-41ce-984c-21b62e14044d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:15.833246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-29e894d4-e550-47c4-8f09-3f0cb31b943f req-b2be3ec0-310d-41ce-984c-21b62e14044d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:15.834644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-29e894d4-e550-47c4-8f09-3f0cb31b943f req-b2be3ec0-310d-41ce-984c-21b62e14044d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:15.857542 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-29e894d4-e550-47c4-8f09-3f0cb31b943f req-b2be3ec0-310d-41ce-984c-21b62e14044d service nova] Creating event network-changed:35e4fff4-8327-4345-bb97-8dfe37b06d07 for instance 1eff0154-2475-4b5b-8c32-0b2ffb3481cf on n-h1-860687-3 Oct 27 18:56:15.864290 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-29e894d4-e550-47c4-8f09-3f0cb31b943f req-b2be3ec0-310d-41ce-984c-21b62e14044d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055181 Oct 27 18:56:15.865703 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1290/2655] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:15.871806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-42f9c825-a36c-4783-b23e-95ccd5d5d711 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:15.873740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-42f9c825-a36c-4783-b23e-95ccd5d5d711 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:15.887771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42f9c825-a36c-4783-b23e-95ccd5d5d711 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:15.888868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42f9c825-a36c-4783-b23e-95ccd5d5d711 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:15.889483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42f9c825-a36c-4783-b23e-95ccd5d5d711 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:15.892297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42f9c825-a36c-4783-b23e-95ccd5d5d711 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:15.892970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42f9c825-a36c-4783-b23e-95ccd5d5d711 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:15.893773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42f9c825-a36c-4783-b23e-95ccd5d5d711 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:15.964443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7f34ee3d-9ff9-4613-a85d-6dddc52f1c41 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:15.981692 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7f34ee3d-9ff9-4613-a85d-6dddc52f1c41 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.515896 Oct 27 18:56:15.992052 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1366/2656] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:15 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:16.144905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8013891a-44a3-43b5-a340-2d38efcec338 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:16.146711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8013891a-44a3-43b5-a340-2d38efcec338 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:16.168303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8013891a-44a3-43b5-a340-2d38efcec338 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:16.169592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8013891a-44a3-43b5-a340-2d38efcec338 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:16.171788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8013891a-44a3-43b5-a340-2d38efcec338 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:16.173243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8013891a-44a3-43b5-a340-2d38efcec338 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:16.173946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8013891a-44a3-43b5-a340-2d38efcec338 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:16.174659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8013891a-44a3-43b5-a340-2d38efcec338 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:16.483483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-42f9c825-a36c-4783-b23e-95ccd5d5d711 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:16.510847 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-42f9c825-a36c-4783-b23e-95ccd5d5d711 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1487 microversion: 2.1 time: 0.643337 Oct 27 18:56:16.513960 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1291/2657] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:15 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1487 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:16.543479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2da02399-7a60-47ce-9326-efd34009dc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:16.557517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2da02399-7a60-47ce-9326-efd34009dc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:16.558457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2da02399-7a60-47ce-9326-efd34009dc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:16.559490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2da02399-7a60-47ce-9326-efd34009dc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:16.586831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2da02399-7a60-47ce-9326-efd34009dc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Going to try to stop instance {{(pid=127028) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 18:56:16.666928 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2da02399-7a60-47ce-9326-efd34009dc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "POST /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28/action" status: 202 len: 0 microversion: 2.1 time: 0.127218 Oct 27 18:56:16.668623 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1292/2658] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:56:16 2022] POST /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 18:56:16.682954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ef7222ad-cd22-4845-b897-16cabcc83024 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:16.683694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ef7222ad-cd22-4845-b897-16cabcc83024 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:16.698642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef7222ad-cd22-4845-b897-16cabcc83024 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:16.708285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef7222ad-cd22-4845-b897-16cabcc83024 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:16.708758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef7222ad-cd22-4845-b897-16cabcc83024 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:16.709524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef7222ad-cd22-4845-b897-16cabcc83024 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:16.709997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef7222ad-cd22-4845-b897-16cabcc83024 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:16.710475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef7222ad-cd22-4845-b897-16cabcc83024 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:16.900097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8013891a-44a3-43b5-a340-2d38efcec338 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:16.914363 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8013891a-44a3-43b5-a340-2d38efcec338 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1512 microversion: 2.1 time: 0.775219 Oct 27 18:56:16.937381 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1367/2659] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:16 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1512 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:16.949705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-28a11a9c-9074-4e49-bba6-755a7fc36b79 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:16.950840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-28a11a9c-9074-4e49-bba6-755a7fc36b79 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:16.960262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28a11a9c-9074-4e49-bba6-755a7fc36b79 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:16.961113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28a11a9c-9074-4e49-bba6-755a7fc36b79 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:16.962136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28a11a9c-9074-4e49-bba6-755a7fc36b79 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:16.993192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28a11a9c-9074-4e49-bba6-755a7fc36b79 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:16.995048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28a11a9c-9074-4e49-bba6-755a7fc36b79 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:16.995832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28a11a9c-9074-4e49-bba6-755a7fc36b79 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:17.418043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-28a11a9c-9074-4e49-bba6-755a7fc36b79 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:17.432263 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-28a11a9c-9074-4e49-bba6-755a7fc36b79 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1311 microversion: 2.1 time: 0.489028 Oct 27 18:56:17.445385 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1368/2660] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:16 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1311 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:17.456300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a03a7907-ef33-4e26-be6b-bc19a9e3c1d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:17.459547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a03a7907-ef33-4e26-be6b-bc19a9e3c1d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:17.468154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a03a7907-ef33-4e26-be6b-bc19a9e3c1d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:17.470282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a03a7907-ef33-4e26-be6b-bc19a9e3c1d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:17.470938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a03a7907-ef33-4e26-be6b-bc19a9e3c1d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:17.472828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a03a7907-ef33-4e26-be6b-bc19a9e3c1d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:17.477120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a03a7907-ef33-4e26-be6b-bc19a9e3c1d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:17.477789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a03a7907-ef33-4e26-be6b-bc19a9e3c1d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:17.565674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ef7222ad-cd22-4845-b897-16cabcc83024 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:17.575351 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ef7222ad-cd22-4845-b897-16cabcc83024 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1497 microversion: 2.1 time: 0.896801 Oct 27 18:56:17.587298 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1293/2661] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:16 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1497 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:17.873038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a03a7907-ef33-4e26-be6b-bc19a9e3c1d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:17.887149 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a03a7907-ef33-4e26-be6b-bc19a9e3c1d4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.440327 Oct 27 18:56:17.907153 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1369/2662] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:17 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:17.949035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-007b293a-7fe6-456d-abfb-02b4ff6ea1ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:17.949669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-007b293a-7fe6-456d-abfb-02b4ff6ea1ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:17.956854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-007b293a-7fe6-456d-abfb-02b4ff6ea1ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:17.957365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-007b293a-7fe6-456d-abfb-02b4ff6ea1ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:17.957811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-007b293a-7fe6-456d-abfb-02b4ff6ea1ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:17.958562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-007b293a-7fe6-456d-abfb-02b4ff6ea1ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:17.959024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-007b293a-7fe6-456d-abfb-02b4ff6ea1ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:17.964660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-007b293a-7fe6-456d-abfb-02b4ff6ea1ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:18.469209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5b32a69c-9868-401e-91d9-f52217ef22d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:18.473749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5b32a69c-9868-401e-91d9-f52217ef22d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:18.500416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b32a69c-9868-401e-91d9-f52217ef22d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:18.501904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b32a69c-9868-401e-91d9-f52217ef22d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:18.502286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b32a69c-9868-401e-91d9-f52217ef22d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:18.503288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b32a69c-9868-401e-91d9-f52217ef22d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:18.504113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b32a69c-9868-401e-91d9-f52217ef22d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:18.504829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b32a69c-9868-401e-91d9-f52217ef22d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:18.807276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-007b293a-7fe6-456d-abfb-02b4ff6ea1ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:18.848981 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-007b293a-7fe6-456d-abfb-02b4ff6ea1ac tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1512 microversion: 2.1 time: 0.903617 Oct 27 18:56:18.850210 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1294/2663] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:17 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1512 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:18.860975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-17ad09c1-f88e-4447-b8e6-7cf7d8220a2b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:18.861753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-17ad09c1-f88e-4447-b8e6-7cf7d8220a2b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:18.884334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17ad09c1-f88e-4447-b8e6-7cf7d8220a2b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:18.884843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17ad09c1-f88e-4447-b8e6-7cf7d8220a2b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:18.885287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17ad09c1-f88e-4447-b8e6-7cf7d8220a2b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:18.886001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17ad09c1-f88e-4447-b8e6-7cf7d8220a2b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:18.886478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17ad09c1-f88e-4447-b8e6-7cf7d8220a2b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:18.887073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17ad09c1-f88e-4447-b8e6-7cf7d8220a2b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:18.932567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5b32a69c-9868-401e-91d9-f52217ef22d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:18.947661 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5b32a69c-9868-401e-91d9-f52217ef22d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1311 microversion: 2.1 time: 0.485753 Oct 27 18:56:18.949250 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1370/2664] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:18 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1311 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:18.966949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-76c19e2f-81f7-4de2-963a-77ffef512e24 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:18.971775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-76c19e2f-81f7-4de2-963a-77ffef512e24 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:18.985053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76c19e2f-81f7-4de2-963a-77ffef512e24 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:18.989362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76c19e2f-81f7-4de2-963a-77ffef512e24 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:18.992563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76c19e2f-81f7-4de2-963a-77ffef512e24 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:18.995350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76c19e2f-81f7-4de2-963a-77ffef512e24 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:18.995842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76c19e2f-81f7-4de2-963a-77ffef512e24 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:18.998455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76c19e2f-81f7-4de2-963a-77ffef512e24 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:19.346555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-76c19e2f-81f7-4de2-963a-77ffef512e24 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:19.367107 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-76c19e2f-81f7-4de2-963a-77ffef512e24 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.411272 Oct 27 18:56:19.371049 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1371/2665] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:18 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:19.445494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-17ad09c1-f88e-4447-b8e6-7cf7d8220a2b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:19.456747 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-17ad09c1-f88e-4447-b8e6-7cf7d8220a2b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1497 microversion: 2.1 time: 0.604872 Oct 27 18:56:19.477075 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1295/2666] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:18 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1497 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:19.879034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1aa464bf-8478-46d0-9ede-a39c774c088d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:19.879769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1aa464bf-8478-46d0-9ede-a39c774c088d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:19.896267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1aa464bf-8478-46d0-9ede-a39c774c088d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:19.896784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1aa464bf-8478-46d0-9ede-a39c774c088d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:19.897235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1aa464bf-8478-46d0-9ede-a39c774c088d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:19.899680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1aa464bf-8478-46d0-9ede-a39c774c088d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:19.900168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1aa464bf-8478-46d0-9ede-a39c774c088d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:19.900661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1aa464bf-8478-46d0-9ede-a39c774c088d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:19.928276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "8ea52ef7-177f-4693-be5d-7f1b6e814f38"}], "security_groups": [{"name": "tempest-securitygroup--269753643"}], "key_name": "tempest-keypair-1908941435", "user_data": "}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:20.254087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1aa464bf-8478-46d0-9ede-a39c774c088d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:20.269101 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1aa464bf-8478-46d0-9ede-a39c774c088d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1533 microversion: 2.1 time: 0.394900 Oct 27 18:56:20.292122 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1372/2667] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:19 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1533 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:20.298797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] validate_networks() for [('8ea52ef7-177f-4693-be5d-7f1b6e814f38', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:56:20.300455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e6786350-148c-46ec-a389-474bfede35aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:20.301322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e6786350-148c-46ec-a389-474bfede35aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:20.308594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6786350-148c-46ec-a389-474bfede35aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:20.309350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6786350-148c-46ec-a389-474bfede35aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:20.310071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6786350-148c-46ec-a389-474bfede35aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:20.311065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6786350-148c-46ec-a389-474bfede35aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:20.311999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6786350-148c-46ec-a389-474bfede35aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:20.312803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6786350-148c-46ec-a389-474bfede35aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:20.633763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e6786350-148c-46ec-a389-474bfede35aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:20.648077 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e6786350-148c-46ec-a389-474bfede35aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1311 microversion: 2.1 time: 0.353967 Oct 27 18:56:20.649725 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1373/2668] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:20 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1311 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:20.656630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-312521db-7232-4bb1-bb4d-ca74c0f3e456 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:20.657889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-312521db-7232-4bb1-bb4d-ca74c0f3e456 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:20.673652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-312521db-7232-4bb1-bb4d-ca74c0f3e456 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:20.674509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-312521db-7232-4bb1-bb4d-ca74c0f3e456 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:20.675141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-312521db-7232-4bb1-bb4d-ca74c0f3e456 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:20.676239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-312521db-7232-4bb1-bb4d-ca74c0f3e456 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:20.677094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-312521db-7232-4bb1-bb4d-ca74c0f3e456 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:20.677912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-312521db-7232-4bb1-bb4d-ca74c0f3e456 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:20.968865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-312521db-7232-4bb1-bb4d-ca74c0f3e456 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:20.977711 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-312521db-7232-4bb1-bb4d-ca74c0f3e456 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.326471 Oct 27 18:56:20.991522 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1374/2669] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:20 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:21.002797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bdd13255-bde2-469b-98af-43f984c930f5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:21.004186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bdd13255-bde2-469b-98af-43f984c930f5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:21.011051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdd13255-bde2-469b-98af-43f984c930f5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:21.011883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdd13255-bde2-469b-98af-43f984c930f5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:21.012655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdd13255-bde2-469b-98af-43f984c930f5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:21.013911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdd13255-bde2-469b-98af-43f984c930f5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:21.014728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdd13255-bde2-469b-98af-43f984c930f5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:21.015422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdd13255-bde2-469b-98af-43f984c930f5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:21.286948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bdd13255-bde2-469b-98af-43f984c930f5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:21.299584 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bdd13255-bde2-469b-98af-43f984c930f5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1497 microversion: 2.1 time: 0.306122 Oct 27 18:56:21.319375 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1375/2670] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:20 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1497 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:21.325167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0a6e278d-089f-4e08-9926-8343cc27801b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:21.326164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0a6e278d-089f-4e08-9926-8343cc27801b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:21.327491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:56:21.328041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:56:21.328706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:56:21.330085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:56:21.330767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:56:21.334337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a6e278d-089f-4e08-9926-8343cc27801b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:21.335307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a6e278d-089f-4e08-9926-8343cc27801b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:21.335891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a6e278d-089f-4e08-9926-8343cc27801b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:21.336809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a6e278d-089f-4e08-9926-8343cc27801b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:21.337508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a6e278d-089f-4e08-9926-8343cc27801b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:21.338162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a6e278d-089f-4e08-9926-8343cc27801b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:21.352940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:21.353376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:21.353768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:21.354546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:21.355011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:21.355447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:21.404082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Getting quotas for project e030bf61093544d48406bd98ad96b7ef. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:56:21.412020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Getting quotas for user 504fbbbb4bfa45e88b612301ef7aff3a and project e030bf61093544d48406bd98ad96b7ef. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:56:21.448637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:56:21.453132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:56:21.624453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0a6e278d-089f-4e08-9926-8343cc27801b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:21.635539 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0a6e278d-089f-4e08-9926-8343cc27801b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1533 microversion: 2.1 time: 0.314557 Oct 27 18:56:21.637386 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1376/2671] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:21 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1533 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:21.643708 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c118c207-244b-4b33-a4f8-e46248dd4df7 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.718342 Oct 27 18:56:21.648076 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1296/2672] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:56:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:56:21.659777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-64725d28-096e-4a77-b1be-2df53a184ca9 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:21.662145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-64725d28-096e-4a77-b1be-2df53a184ca9 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:21.678818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c5c7b182-815f-4714-88b0-ac5627ee6fc8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:21.680615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c5c7b182-815f-4714-88b0-ac5627ee6fc8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:21.726374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5c7b182-815f-4714-88b0-ac5627ee6fc8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:21.727239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5c7b182-815f-4714-88b0-ac5627ee6fc8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:21.727711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5c7b182-815f-4714-88b0-ac5627ee6fc8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:21.730689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5c7b182-815f-4714-88b0-ac5627ee6fc8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:21.731363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5c7b182-815f-4714-88b0-ac5627ee6fc8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:21.732005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5c7b182-815f-4714-88b0-ac5627ee6fc8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:21.781565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-64725d28-096e-4a77-b1be-2df53a184ca9 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:21.790418 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-64725d28-096e-4a77-b1be-2df53a184ca9 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1226 microversion: 2.1 time: 0.134787 Oct 27 18:56:21.798788 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1377/2673] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:21 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1226 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:22.007230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-973ee8c2-e0d5-407b-a20e-4af3ba1fcf7d tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:22.008077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-973ee8c2-e0d5-407b-a20e-4af3ba1fcf7d tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:22.046006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973ee8c2-e0d5-407b-a20e-4af3ba1fcf7d tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:22.049616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973ee8c2-e0d5-407b-a20e-4af3ba1fcf7d tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:22.050376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973ee8c2-e0d5-407b-a20e-4af3ba1fcf7d tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:22.052970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973ee8c2-e0d5-407b-a20e-4af3ba1fcf7d tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:22.056799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973ee8c2-e0d5-407b-a20e-4af3ba1fcf7d tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:22.057682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973ee8c2-e0d5-407b-a20e-4af3ba1fcf7d tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:22.163921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c5c7b182-815f-4714-88b0-ac5627ee6fc8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:22.177180 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c5c7b182-815f-4714-88b0-ac5627ee6fc8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1311 microversion: 2.1 time: 0.505049 Oct 27 18:56:22.177782 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1297/2674] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:21 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1311 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:22.326705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f129056d-2696-4b5a-8f0e-6baf315573ad tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:22.327330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f129056d-2696-4b5a-8f0e-6baf315573ad tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:22.339828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f129056d-2696-4b5a-8f0e-6baf315573ad tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:22.340464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f129056d-2696-4b5a-8f0e-6baf315573ad tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:22.340773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f129056d-2696-4b5a-8f0e-6baf315573ad tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:22.341495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f129056d-2696-4b5a-8f0e-6baf315573ad tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:22.342068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f129056d-2696-4b5a-8f0e-6baf315573ad tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:22.358625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f129056d-2696-4b5a-8f0e-6baf315573ad tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:22.478111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-973ee8c2-e0d5-407b-a20e-4af3ba1fcf7d tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:22.495588 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-973ee8c2-e0d5-407b-a20e-4af3ba1fcf7d tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.491929 Oct 27 18:56:22.497467 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1378/2675] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:21 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:56:22.668476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7fd61c6b-e5ed-4eae-9ebb-4895ea3a2b6a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:22.669588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7fd61c6b-e5ed-4eae-9ebb-4895ea3a2b6a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:22.689112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fd61c6b-e5ed-4eae-9ebb-4895ea3a2b6a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:22.689734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fd61c6b-e5ed-4eae-9ebb-4895ea3a2b6a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:22.690193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fd61c6b-e5ed-4eae-9ebb-4895ea3a2b6a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:22.690951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fd61c6b-e5ed-4eae-9ebb-4895ea3a2b6a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:22.691428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fd61c6b-e5ed-4eae-9ebb-4895ea3a2b6a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:22.691870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fd61c6b-e5ed-4eae-9ebb-4895ea3a2b6a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:22.905740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f129056d-2696-4b5a-8f0e-6baf315573ad tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:22.917407 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f129056d-2696-4b5a-8f0e-6baf315573ad tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1497 microversion: 2.1 time: 0.594425 Oct 27 18:56:22.918978 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1298/2676] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:22 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1497 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:56:22.926693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f805277c-6fe1-4ee3-a83a-fc5da9b29e44 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:22.928342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f805277c-6fe1-4ee3-a83a-fc5da9b29e44 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:22.937188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f805277c-6fe1-4ee3-a83a-fc5da9b29e44 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:22.937908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f805277c-6fe1-4ee3-a83a-fc5da9b29e44 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:22.938475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f805277c-6fe1-4ee3-a83a-fc5da9b29e44 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:22.939202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f805277c-6fe1-4ee3-a83a-fc5da9b29e44 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:22.939666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f805277c-6fe1-4ee3-a83a-fc5da9b29e44 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:22.940100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f805277c-6fe1-4ee3-a83a-fc5da9b29e44 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:23.060205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f805277c-6fe1-4ee3-a83a-fc5da9b29e44 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:23.091331 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f805277c-6fe1-4ee3-a83a-fc5da9b29e44 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1222 microversion: 2.1 time: 0.156312 Oct 27 18:56:23.092462 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1299/2677] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:22 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1222 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:23.201917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c3659520-bf2b-4b7d-b9af-dc079e9fb751 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:23.202570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c3659520-bf2b-4b7d-b9af-dc079e9fb751 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:23.212318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3659520-bf2b-4b7d-b9af-dc079e9fb751 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:23.212720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3659520-bf2b-4b7d-b9af-dc079e9fb751 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:23.213165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3659520-bf2b-4b7d-b9af-dc079e9fb751 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:23.213893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3659520-bf2b-4b7d-b9af-dc079e9fb751 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:23.214350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3659520-bf2b-4b7d-b9af-dc079e9fb751 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:23.222362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3659520-bf2b-4b7d-b9af-dc079e9fb751 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:23.259622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7fd61c6b-e5ed-4eae-9ebb-4895ea3a2b6a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:23.274838 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7fd61c6b-e5ed-4eae-9ebb-4895ea3a2b6a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1533 microversion: 2.1 time: 0.617783 Oct 27 18:56:23.279934 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1379/2678] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:22 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1533 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:56:23.525321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e4015970-4dc7-4158-841f-f5c20a949af9 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:23.526182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e4015970-4dc7-4158-841f-f5c20a949af9 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:23.541888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4015970-4dc7-4158-841f-f5c20a949af9 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:23.542427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4015970-4dc7-4158-841f-f5c20a949af9 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:23.545029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4015970-4dc7-4158-841f-f5c20a949af9 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:23.546043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4015970-4dc7-4158-841f-f5c20a949af9 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:23.546572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4015970-4dc7-4158-841f-f5c20a949af9 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:23.549188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4015970-4dc7-4158-841f-f5c20a949af9 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:23.596537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:24.018191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e4015970-4dc7-4158-841f-f5c20a949af9 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:24.028309 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e4015970-4dc7-4158-841f-f5c20a949af9 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1517 microversion: 2.1 time: 0.507769 Oct 27 18:56:24.033097 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1380/2679] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:23 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1517 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:24.067862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2d5f30af-9cb1-4b7d-9ce2-233316cba589 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:24.068910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2d5f30af-9cb1-4b7d-9ce2-233316cba589 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:24.071191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:24.082664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d5f30af-9cb1-4b7d-9ce2-233316cba589 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:24.083674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d5f30af-9cb1-4b7d-9ce2-233316cba589 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:24.084685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d5f30af-9cb1-4b7d-9ce2-233316cba589 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:24.085659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d5f30af-9cb1-4b7d-9ce2-233316cba589 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:24.086593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d5f30af-9cb1-4b7d-9ce2-233316cba589 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:24.087251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d5f30af-9cb1-4b7d-9ce2-233316cba589 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:24.592758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c3659520-bf2b-4b7d-b9af-dc079e9fb751 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:24.611543 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c3659520-bf2b-4b7d-b9af-dc079e9fb751 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1311 microversion: 2.1 time: 1.410190 Oct 27 18:56:24.612330 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1300/2680] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:23 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1311 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:24.623466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-69e166a3-caba-499f-9724-4a5268464cf6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:24.623466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-69e166a3-caba-499f-9724-4a5268464cf6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:24.635781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69e166a3-caba-499f-9724-4a5268464cf6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:24.636483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69e166a3-caba-499f-9724-4a5268464cf6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:24.637010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69e166a3-caba-499f-9724-4a5268464cf6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:24.638128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69e166a3-caba-499f-9724-4a5268464cf6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:24.639995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69e166a3-caba-499f-9724-4a5268464cf6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:24.640516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69e166a3-caba-499f-9724-4a5268464cf6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:24.654591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2d5f30af-9cb1-4b7d-9ce2-233316cba589 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:24.675027 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2d5f30af-9cb1-4b7d-9ce2-233316cba589 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1497 microversion: 2.1 time: 0.609440 Oct 27 18:56:24.676027 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1381/2681] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:24 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1497 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:24.703452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9ef53fee-955b-4d79-b250-0daa33a2a0b9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:24.706270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9ef53fee-955b-4d79-b250-0daa33a2a0b9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:24.718007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ef53fee-955b-4d79-b250-0daa33a2a0b9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:24.723324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ef53fee-955b-4d79-b250-0daa33a2a0b9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:24.724069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ef53fee-955b-4d79-b250-0daa33a2a0b9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:24.725041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ef53fee-955b-4d79-b250-0daa33a2a0b9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:24.725727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ef53fee-955b-4d79-b250-0daa33a2a0b9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:24.726361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ef53fee-955b-4d79-b250-0daa33a2a0b9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:24.919126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-69e166a3-caba-499f-9724-4a5268464cf6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:24.931528 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-69e166a3-caba-499f-9724-4a5268464cf6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1284 microversion: 2.1 time: 0.318084 Oct 27 18:56:24.939548 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1301/2682] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:24 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1284 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:25.060861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b0d2f034-5787-4ca6-8896-f93fe778faa2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:25.061889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0d2f034-5787-4ca6-8896-f93fe778faa2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:25.081633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0d2f034-5787-4ca6-8896-f93fe778faa2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:25.082626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0d2f034-5787-4ca6-8896-f93fe778faa2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:25.087356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0d2f034-5787-4ca6-8896-f93fe778faa2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:25.088790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0d2f034-5787-4ca6-8896-f93fe778faa2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:25.090514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0d2f034-5787-4ca6-8896-f93fe778faa2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:25.091199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0d2f034-5787-4ca6-8896-f93fe778faa2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:25.481096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9ef53fee-955b-4d79-b250-0daa33a2a0b9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:25.491270 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9ef53fee-955b-4d79-b250-0daa33a2a0b9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1528 microversion: 2.1 time: 0.798414 Oct 27 18:56:25.496394 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1382/2683] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:24 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1528 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:25.639381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-96b0c9f9-c54d-4905-96f3-4324e8e7a2b9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:25.640238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-96b0c9f9-c54d-4905-96f3-4324e8e7a2b9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:25.653262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96b0c9f9-c54d-4905-96f3-4324e8e7a2b9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:25.654021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96b0c9f9-c54d-4905-96f3-4324e8e7a2b9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:25.654737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96b0c9f9-c54d-4905-96f3-4324e8e7a2b9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:25.658592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96b0c9f9-c54d-4905-96f3-4324e8e7a2b9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:25.659856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96b0c9f9-c54d-4905-96f3-4324e8e7a2b9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:25.663955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96b0c9f9-c54d-4905-96f3-4324e8e7a2b9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:25.838217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0d2f034-5787-4ca6-8896-f93fe778faa2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:25.848912 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b0d2f034-5787-4ca6-8896-f93fe778faa2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1535 microversion: 2.1 time: 0.791854 Oct 27 18:56:25.853805 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1302/2684] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:25 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1535 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:25.866070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ae9e2b5-2966-44e1-b498-865c4cc80749 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:25.868630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ae9e2b5-2966-44e1-b498-865c4cc80749 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:25.885515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ae9e2b5-2966-44e1-b498-865c4cc80749 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:25.886474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ae9e2b5-2966-44e1-b498-865c4cc80749 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:25.889747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ae9e2b5-2966-44e1-b498-865c4cc80749 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:25.890847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ae9e2b5-2966-44e1-b498-865c4cc80749 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:25.892538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ae9e2b5-2966-44e1-b498-865c4cc80749 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:25.895160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ae9e2b5-2966-44e1-b498-865c4cc80749 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:26.339251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ae9e2b5-2966-44e1-b498-865c4cc80749 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:26.341693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:26.356708 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ae9e2b5-2966-44e1-b498-865c4cc80749 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1497 microversion: 2.1 time: 0.498917 Oct 27 18:56:26.358898 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1303/2685] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:25 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1497 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:26.393296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-862e5fe5-0243-469f-bd23-b344b94b3a4b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:26.397326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-862e5fe5-0243-469f-bd23-b344b94b3a4b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:26.414496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-862e5fe5-0243-469f-bd23-b344b94b3a4b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:26.415279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-862e5fe5-0243-469f-bd23-b344b94b3a4b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:26.416035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-862e5fe5-0243-469f-bd23-b344b94b3a4b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:26.416952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-862e5fe5-0243-469f-bd23-b344b94b3a4b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:26.417631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-862e5fe5-0243-469f-bd23-b344b94b3a4b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:26.418274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-862e5fe5-0243-469f-bd23-b344b94b3a4b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:26.538691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-862e5fe5-0243-469f-bd23-b344b94b3a4b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:26.548814 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-862e5fe5-0243-469f-bd23-b344b94b3a4b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1284 microversion: 2.1 time: 0.174662 Oct 27 18:56:26.555213 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1304/2686] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:26 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:26.570697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f2ac597e-cad0-41d0-b40d-6c802e14672e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:26.576778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f2ac597e-cad0-41d0-b40d-6c802e14672e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:26.596694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2ac597e-cad0-41d0-b40d-6c802e14672e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:26.598122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2ac597e-cad0-41d0-b40d-6c802e14672e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:26.598874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2ac597e-cad0-41d0-b40d-6c802e14672e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:26.600204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2ac597e-cad0-41d0-b40d-6c802e14672e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:26.601181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2ac597e-cad0-41d0-b40d-6c802e14672e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:26.602041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2ac597e-cad0-41d0-b40d-6c802e14672e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:27.008734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-96b0c9f9-c54d-4905-96f3-4324e8e7a2b9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:27.022846 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-96b0c9f9-c54d-4905-96f3-4324e8e7a2b9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1311 microversion: 2.1 time: 1.383248 Oct 27 18:56:27.051794 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1383/2687] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:25 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1311 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:56:27.059054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-c62cf602-0bdf-4d7c-a511-d707b6bf9161 req-25ec9916-4f7c-4cb5-aa64-f5554af56dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e311e1-6dd0-4498-897c-c92ce762d9b9", "name": "network-vif-plugged", "status": "completed", "tag": "5e0a3a4e-0c02-4bfb-b6c9-0aefa83bc658"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:27.081390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c62cf602-0bdf-4d7c-a511-d707b6bf9161 req-25ec9916-4f7c-4cb5-aa64-f5554af56dff service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:27.082134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c62cf602-0bdf-4d7c-a511-d707b6bf9161 req-25ec9916-4f7c-4cb5-aa64-f5554af56dff service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:27.082787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c62cf602-0bdf-4d7c-a511-d707b6bf9161 req-25ec9916-4f7c-4cb5-aa64-f5554af56dff service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:27.108581 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-c62cf602-0bdf-4d7c-a511-d707b6bf9161 req-25ec9916-4f7c-4cb5-aa64-f5554af56dff service nova] Creating event network-vif-plugged:5e0a3a4e-0c02-4bfb-b6c9-0aefa83bc658 for instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 on n-h2-860687-3 Oct 27 18:56:27.114802 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-c62cf602-0bdf-4d7c-a511-d707b6bf9161 req-25ec9916-4f7c-4cb5-aa64-f5554af56dff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061149 Oct 27 18:56:27.116880 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1384/2688] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:27.123929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d7cb3050-1003-429e-a1e1-a84837a24620 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:27.124956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d7cb3050-1003-429e-a1e1-a84837a24620 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:27.133915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d7cb3050-1003-429e-a1e1-a84837a24620 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:27.134786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d7cb3050-1003-429e-a1e1-a84837a24620 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:27.135458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d7cb3050-1003-429e-a1e1-a84837a24620 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:27.136428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d7cb3050-1003-429e-a1e1-a84837a24620 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:27.137126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d7cb3050-1003-429e-a1e1-a84837a24620 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:27.138340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d7cb3050-1003-429e-a1e1-a84837a24620 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:27.158488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f2ac597e-cad0-41d0-b40d-6c802e14672e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:27.171154 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f2ac597e-cad0-41d0-b40d-6c802e14672e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1528 microversion: 2.1 time: 0.602051 Oct 27 18:56:27.184104 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1305/2689] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:26 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1528 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:27.386661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-18c17c06-53b4-497e-8f77-4444d4d893d7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:27.387563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-18c17c06-53b4-497e-8f77-4444d4d893d7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:27.399184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18c17c06-53b4-497e-8f77-4444d4d893d7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:27.404102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18c17c06-53b4-497e-8f77-4444d4d893d7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:27.409704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18c17c06-53b4-497e-8f77-4444d4d893d7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:27.412692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18c17c06-53b4-497e-8f77-4444d4d893d7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:27.413183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18c17c06-53b4-497e-8f77-4444d4d893d7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:27.414764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18c17c06-53b4-497e-8f77-4444d4d893d7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:27.508401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d7cb3050-1003-429e-a1e1-a84837a24620 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:27.525992 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d7cb3050-1003-429e-a1e1-a84837a24620 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1523 microversion: 2.1 time: 0.398883 Oct 27 18:56:27.545089 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1385/2690] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:27 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1523 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:27.578699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0ebe7c35-6219-419d-94c7-f12ac889a702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:27.587448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0ebe7c35-6219-419d-94c7-f12ac889a702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:27.607875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebe7c35-6219-419d-94c7-f12ac889a702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:27.609661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebe7c35-6219-419d-94c7-f12ac889a702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:27.612763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebe7c35-6219-419d-94c7-f12ac889a702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:27.614159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebe7c35-6219-419d-94c7-f12ac889a702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:27.615469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebe7c35-6219-419d-94c7-f12ac889a702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:27.616172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebe7c35-6219-419d-94c7-f12ac889a702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:27.822783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0ebe7c35-6219-419d-94c7-f12ac889a702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:27.837711 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0ebe7c35-6219-419d-94c7-f12ac889a702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1284 microversion: 2.1 time: 0.263701 Oct 27 18:56:27.838307 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1386/2691] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:27 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1284 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:56:28.045222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5043fa80-9d31-49cd-b7e6-0f13f0f908be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:28.046686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5043fa80-9d31-49cd-b7e6-0f13f0f908be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:28.060082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5043fa80-9d31-49cd-b7e6-0f13f0f908be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:28.065942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5043fa80-9d31-49cd-b7e6-0f13f0f908be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:28.067290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5043fa80-9d31-49cd-b7e6-0f13f0f908be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:28.068844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5043fa80-9d31-49cd-b7e6-0f13f0f908be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:28.070769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5043fa80-9d31-49cd-b7e6-0f13f0f908be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:28.086998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5043fa80-9d31-49cd-b7e6-0f13f0f908be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:28.137881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-18c17c06-53b4-497e-8f77-4444d4d893d7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:28.146036 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-18c17c06-53b4-497e-8f77-4444d4d893d7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1497 microversion: 2.1 time: 0.764818 Oct 27 18:56:28.152984 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1306/2692] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:27 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1497 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:56:28.199458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71d58e42-a95c-498e-8092-3cfc30d4a311 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:28.201196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-71d58e42-a95c-498e-8092-3cfc30d4a311 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:28.213859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d58e42-a95c-498e-8092-3cfc30d4a311 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:28.219079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d58e42-a95c-498e-8092-3cfc30d4a311 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:28.221595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d58e42-a95c-498e-8092-3cfc30d4a311 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:28.222504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d58e42-a95c-498e-8092-3cfc30d4a311 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:28.225998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d58e42-a95c-498e-8092-3cfc30d4a311 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:28.226584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d58e42-a95c-498e-8092-3cfc30d4a311 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:28.545747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5043fa80-9d31-49cd-b7e6-0f13f0f908be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:28.573330 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5043fa80-9d31-49cd-b7e6-0f13f0f908be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1311 microversion: 2.1 time: 0.531866 Oct 27 18:56:28.575979 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1387/2693] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:28 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1311 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:56:28.592264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cf91bc7b-d810-4956-8880-993604639da2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:28.592916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cf91bc7b-d810-4956-8880-993604639da2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:28.608861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf91bc7b-d810-4956-8880-993604639da2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:28.609371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf91bc7b-d810-4956-8880-993604639da2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:28.610277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf91bc7b-d810-4956-8880-993604639da2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:28.614684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf91bc7b-d810-4956-8880-993604639da2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:28.615183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf91bc7b-d810-4956-8880-993604639da2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:28.615689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf91bc7b-d810-4956-8880-993604639da2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:28.806559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-71d58e42-a95c-498e-8092-3cfc30d4a311 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:28.815694 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-71d58e42-a95c-498e-8092-3cfc30d4a311 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1528 microversion: 2.1 time: 0.620058 Oct 27 18:56:28.844319 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1307/2694] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:28 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1528 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:28.864912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf09bbc3-d0a9-47ab-90f5-8f6078670315 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:28.865632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf09bbc3-d0a9-47ab-90f5-8f6078670315 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:28.895676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf09bbc3-d0a9-47ab-90f5-8f6078670315 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:28.896342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf09bbc3-d0a9-47ab-90f5-8f6078670315 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:28.897605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf09bbc3-d0a9-47ab-90f5-8f6078670315 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:28.900263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf09bbc3-d0a9-47ab-90f5-8f6078670315 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:28.901039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf09bbc3-d0a9-47ab-90f5-8f6078670315 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:28.903243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cf91bc7b-d810-4956-8880-993604639da2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:28.909848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf09bbc3-d0a9-47ab-90f5-8f6078670315 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:28.927754 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cf91bc7b-d810-4956-8880-993604639da2 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1523 microversion: 2.1 time: 0.350649 Oct 27 18:56:28.933374 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1388/2695] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:28 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:29.175853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a5540fa8-947e-4087-99e5-fd274329c81e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:29.176513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a5540fa8-947e-4087-99e5-fd274329c81e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:29.189367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5540fa8-947e-4087-99e5-fd274329c81e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:29.192757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5540fa8-947e-4087-99e5-fd274329c81e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:29.194153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5540fa8-947e-4087-99e5-fd274329c81e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:29.196864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5540fa8-947e-4087-99e5-fd274329c81e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:29.197510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5540fa8-947e-4087-99e5-fd274329c81e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:29.198824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5540fa8-947e-4087-99e5-fd274329c81e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:29.750490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf09bbc3-d0a9-47ab-90f5-8f6078670315 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:29.754416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a5540fa8-947e-4087-99e5-fd274329c81e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:29.763392 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a5540fa8-947e-4087-99e5-fd274329c81e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1497 microversion: 2.1 time: 0.596098 Oct 27 18:56:29.763804 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf09bbc3-d0a9-47ab-90f5-8f6078670315 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1351 microversion: 2.1 time: 0.903689 Oct 27 18:56:29.765553 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1308/2696] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:28 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1351 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:29.776252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-5c6d249a-7811-431e-9c60-625525c6338d req-f8826f01-8737-48d5-a1ea-9cc80261a710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eff0154-2475-4b5b-8c32-0b2ffb3481cf", "name": "network-vif-plugged", "status": "completed", "tag": "35e4fff4-8327-4345-bb97-8dfe37b06d07"}, {"server_uuid": "3b3ab523-37c4-46bc-ab91-975da6d3807f", "name": "network-vif-unplugged", "status": "completed", "tag": "fa3593d4-3151-4370-bc45-3ffbb894137b"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:29.797088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5c6d249a-7811-431e-9c60-625525c6338d req-f8826f01-8737-48d5-a1ea-9cc80261a710 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:29.799113 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1389/2697] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:29 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1497 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:29.802979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5c6d249a-7811-431e-9c60-625525c6338d req-f8826f01-8737-48d5-a1ea-9cc80261a710 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:29.803638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5c6d249a-7811-431e-9c60-625525c6338d req-f8826f01-8737-48d5-a1ea-9cc80261a710 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:29.803848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8d0c3d32-8fba-439f-9c3a-37035c20f9ae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:29.804487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8d0c3d32-8fba-439f-9c3a-37035c20f9ae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:29.818264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d0c3d32-8fba-439f-9c3a-37035c20f9ae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:29.819293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d0c3d32-8fba-439f-9c3a-37035c20f9ae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:29.819902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d0c3d32-8fba-439f-9c3a-37035c20f9ae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:29.820908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d0c3d32-8fba-439f-9c3a-37035c20f9ae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:29.821651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d0c3d32-8fba-439f-9c3a-37035c20f9ae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:29.822266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d0c3d32-8fba-439f-9c3a-37035c20f9ae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:29.826308 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5c6d249a-7811-431e-9c60-625525c6338d req-f8826f01-8737-48d5-a1ea-9cc80261a710 service nova] Creating event network-vif-plugged:35e4fff4-8327-4345-bb97-8dfe37b06d07 for instance 1eff0154-2475-4b5b-8c32-0b2ffb3481cf on n-h1-860687-3 Oct 27 18:56:29.827234 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5c6d249a-7811-431e-9c60-625525c6338d req-f8826f01-8737-48d5-a1ea-9cc80261a710 service nova] Creating event network-vif-unplugged:fa3593d4-3151-4370-bc45-3ffbb894137b for instance 3b3ab523-37c4-46bc-ab91-975da6d3807f on n-h1-860687-3 Oct 27 18:56:29.840261 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-5c6d249a-7811-431e-9c60-625525c6338d req-f8826f01-8737-48d5-a1ea-9cc80261a710 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.067673 Oct 27 18:56:29.847723 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1309/2698] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:29.853748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-41a2cc5f-1c50-4c02-ada7-a3d6792bbf7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:29.854956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-41a2cc5f-1c50-4c02-ada7-a3d6792bbf7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:29.863059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41a2cc5f-1c50-4c02-ada7-a3d6792bbf7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:29.863950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41a2cc5f-1c50-4c02-ada7-a3d6792bbf7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:29.865284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41a2cc5f-1c50-4c02-ada7-a3d6792bbf7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:29.866167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41a2cc5f-1c50-4c02-ada7-a3d6792bbf7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:29.866839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41a2cc5f-1c50-4c02-ada7-a3d6792bbf7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:29.867631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41a2cc5f-1c50-4c02-ada7-a3d6792bbf7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:30.104685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8d0c3d32-8fba-439f-9c3a-37035c20f9ae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:30.116984 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8d0c3d32-8fba-439f-9c3a-37035c20f9ae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1311 microversion: 2.1 time: 0.316768 Oct 27 18:56:30.117595 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1390/2699] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:29 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1311 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:30.132761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-498b7591-c523-466d-a28e-2bd980cdce94 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:30.132761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-498b7591-c523-466d-a28e-2bd980cdce94 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:30.140728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-498b7591-c523-466d-a28e-2bd980cdce94 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:30.141323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-498b7591-c523-466d-a28e-2bd980cdce94 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:30.141724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-498b7591-c523-466d-a28e-2bd980cdce94 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:30.142494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-498b7591-c523-466d-a28e-2bd980cdce94 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:30.143299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-498b7591-c523-466d-a28e-2bd980cdce94 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:30.143452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-498b7591-c523-466d-a28e-2bd980cdce94 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:30.509734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-498b7591-c523-466d-a28e-2bd980cdce94 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:30.529044 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-498b7591-c523-466d-a28e-2bd980cdce94 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1523 microversion: 2.1 time: 0.410364 Oct 27 18:56:30.530815 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1391/2700] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:30 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:30.683485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-41a2cc5f-1c50-4c02-ada7-a3d6792bbf7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:30.697150 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-41a2cc5f-1c50-4c02-ada7-a3d6792bbf7c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1528 microversion: 2.1 time: 0.847448 Oct 27 18:56:30.710328 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1310/2701] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:29 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1528 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:30.791154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14781f18-7e9d-4cc6-8492-34047cb41918 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:30.792116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-14781f18-7e9d-4cc6-8492-34047cb41918 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:30.801006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14781f18-7e9d-4cc6-8492-34047cb41918 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:30.802535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14781f18-7e9d-4cc6-8492-34047cb41918 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:30.803208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14781f18-7e9d-4cc6-8492-34047cb41918 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:30.804596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14781f18-7e9d-4cc6-8492-34047cb41918 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:30.805174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14781f18-7e9d-4cc6-8492-34047cb41918 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:30.806645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14781f18-7e9d-4cc6-8492-34047cb41918 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:30.815251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-acd10b6d-d7e2-47e9-89b6-ca94f3875e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:30.816037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-acd10b6d-d7e2-47e9-89b6-ca94f3875e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:30.828736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd10b6d-d7e2-47e9-89b6-ca94f3875e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:30.832309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd10b6d-d7e2-47e9-89b6-ca94f3875e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:30.833629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd10b6d-d7e2-47e9-89b6-ca94f3875e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:30.835435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd10b6d-d7e2-47e9-89b6-ca94f3875e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:30.838281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd10b6d-d7e2-47e9-89b6-ca94f3875e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:30.838858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd10b6d-d7e2-47e9-89b6-ca94f3875e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:31.368270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:31.433434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=18 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:31.497090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-14781f18-7e9d-4cc6-8492-34047cb41918 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:31.509956 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-14781f18-7e9d-4cc6-8492-34047cb41918 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1351 microversion: 2.1 time: 0.718440 Oct 27 18:56:31.511603 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1392/2702] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:30 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1351 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:31.520681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0264a713-55c4-4026-963a-106042d21acd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:31.521532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0264a713-55c4-4026-963a-106042d21acd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:31.540264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0264a713-55c4-4026-963a-106042d21acd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:31.541082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0264a713-55c4-4026-963a-106042d21acd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:31.541766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0264a713-55c4-4026-963a-106042d21acd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:31.544294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0264a713-55c4-4026-963a-106042d21acd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:31.545076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0264a713-55c4-4026-963a-106042d21acd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:31.545699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0264a713-55c4-4026-963a-106042d21acd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:31.787591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:31.990328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-acd10b6d-d7e2-47e9-89b6-ca94f3875e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:32.008799 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-acd10b6d-d7e2-47e9-89b6-ca94f3875e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1497 microversion: 2.1 time: 1.197283 Oct 27 18:56:32.012161 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1311/2703] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:30 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1497 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:56:32.028072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb1792f5-8cb6-4802-a4db-983a3d4454ac tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:32.040677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb1792f5-8cb6-4802-a4db-983a3d4454ac tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:32.041586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0264a713-55c4-4026-963a-106042d21acd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:32.046146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:32.056459 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0264a713-55c4-4026-963a-106042d21acd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1311 microversion: 2.1 time: 0.543547 Oct 27 18:56:32.060322 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1393/2704] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:31 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1311 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:32.076908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0e958d6f-4030-4a17-a868-2fcf8f967a85 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:32.077704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0e958d6f-4030-4a17-a868-2fcf8f967a85 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:32.081553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb1792f5-8cb6-4802-a4db-983a3d4454ac tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:32.083250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb1792f5-8cb6-4802-a4db-983a3d4454ac tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:32.084066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb1792f5-8cb6-4802-a4db-983a3d4454ac tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:32.085099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb1792f5-8cb6-4802-a4db-983a3d4454ac tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:32.089431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb1792f5-8cb6-4802-a4db-983a3d4454ac tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:32.092594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb1792f5-8cb6-4802-a4db-983a3d4454ac tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:32.092750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e958d6f-4030-4a17-a868-2fcf8f967a85 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:32.093277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e958d6f-4030-4a17-a868-2fcf8f967a85 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:32.093818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e958d6f-4030-4a17-a868-2fcf8f967a85 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:32.102230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e958d6f-4030-4a17-a868-2fcf8f967a85 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:32.103270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e958d6f-4030-4a17-a868-2fcf8f967a85 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:32.113199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e958d6f-4030-4a17-a868-2fcf8f967a85 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:32.629650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0e958d6f-4030-4a17-a868-2fcf8f967a85 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:32.638616 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0e958d6f-4030-4a17-a868-2fcf8f967a85 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1528 microversion: 2.1 time: 0.576734 Oct 27 18:56:32.639928 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1394/2705] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:32 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1528 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:32.645031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-9c958db7-1ef2-43a3-886e-744157408234 req-b0bb80a7-eb14-480f-b520-49dbebfd2506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3ab523-37c4-46bc-ab91-975da6d3807f", "name": "network-vif-plugged", "status": "completed", "tag": "fa3593d4-3151-4370-bc45-3ffbb894137b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:32.678577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9c958db7-1ef2-43a3-886e-744157408234 req-b0bb80a7-eb14-480f-b520-49dbebfd2506 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:32.679462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9c958db7-1ef2-43a3-886e-744157408234 req-b0bb80a7-eb14-480f-b520-49dbebfd2506 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:32.680153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9c958db7-1ef2-43a3-886e-744157408234 req-b0bb80a7-eb14-480f-b520-49dbebfd2506 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:32.713001 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-9c958db7-1ef2-43a3-886e-744157408234 req-b0bb80a7-eb14-480f-b520-49dbebfd2506 service nova] Creating event network-vif-plugged:fa3593d4-3151-4370-bc45-3ffbb894137b for instance 3b3ab523-37c4-46bc-ab91-975da6d3807f on n-h1-860687-3 Oct 27 18:56:32.721013 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-9c958db7-1ef2-43a3-886e-744157408234 req-b0bb80a7-eb14-480f-b520-49dbebfd2506 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079497 Oct 27 18:56:32.723157 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1395/2706] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:32.728683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d84a29f8-728b-4ff3-9e41-acc265409f01 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:32.741327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d84a29f8-728b-4ff3-9e41-acc265409f01 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:32.748797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d84a29f8-728b-4ff3-9e41-acc265409f01 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:32.749684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d84a29f8-728b-4ff3-9e41-acc265409f01 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:32.750365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d84a29f8-728b-4ff3-9e41-acc265409f01 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:32.751943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d84a29f8-728b-4ff3-9e41-acc265409f01 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:32.753021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d84a29f8-728b-4ff3-9e41-acc265409f01 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:32.753688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d84a29f8-728b-4ff3-9e41-acc265409f01 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:33.191904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d84a29f8-728b-4ff3-9e41-acc265409f01 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:33.201768 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d84a29f8-728b-4ff3-9e41-acc265409f01 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1351 microversion: 2.1 time: 0.477141 Oct 27 18:56:33.208709 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1396/2707] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:32 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1351 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:33.226866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-133e85c7-27c2-40b9-b770-ee47cb610de2 req-9a8fc2b0-963e-4613-b64c-8da4b718ab84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403ad40f-7a7d-4be1-b1c2-16f91dd36e09", "tag": "76e19a54-ac3a-4d4d-b981-0958c1f79d34"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:33.244888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-133e85c7-27c2-40b9-b770-ee47cb610de2 req-9a8fc2b0-963e-4613-b64c-8da4b718ab84 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:33.245730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-133e85c7-27c2-40b9-b770-ee47cb610de2 req-9a8fc2b0-963e-4613-b64c-8da4b718ab84 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:33.246423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-133e85c7-27c2-40b9-b770-ee47cb610de2 req-9a8fc2b0-963e-4613-b64c-8da4b718ab84 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:33.280314 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-133e85c7-27c2-40b9-b770-ee47cb610de2 req-9a8fc2b0-963e-4613-b64c-8da4b718ab84 service nova] Creating event network-changed:76e19a54-ac3a-4d4d-b981-0958c1f79d34 for instance 403ad40f-7a7d-4be1-b1c2-16f91dd36e09 on n-h2-860687-3 Oct 27 18:56:33.288234 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-133e85c7-27c2-40b9-b770-ee47cb610de2 req-9a8fc2b0-963e-4613-b64c-8da4b718ab84 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077919 Oct 27 18:56:33.294131 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1397/2708] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:33.300627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3c16f103-60d4-4869-abe3-d3a76682b9fb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:33.307598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3c16f103-60d4-4869-abe3-d3a76682b9fb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:33.320518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c16f103-60d4-4869-abe3-d3a76682b9fb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:33.323836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c16f103-60d4-4869-abe3-d3a76682b9fb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:33.327638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c16f103-60d4-4869-abe3-d3a76682b9fb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:33.329241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c16f103-60d4-4869-abe3-d3a76682b9fb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:33.329940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c16f103-60d4-4869-abe3-d3a76682b9fb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:33.341471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c16f103-60d4-4869-abe3-d3a76682b9fb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:33.636375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-eb1792f5-8cb6-4802-a4db-983a3d4454ac tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:33.648415 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb1792f5-8cb6-4802-a4db-983a3d4454ac tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1523 microversion: 2.1 time: 1.634852 Oct 27 18:56:33.667214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3c16f103-60d4-4869-abe3-d3a76682b9fb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:33.671979 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1312/2709] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:32 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1523 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:33.682056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8c210d0d-b0d2-48fd-a29b-0032ffbc427c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:33.683034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8c210d0d-b0d2-48fd-a29b-0032ffbc427c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:33.685075 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3c16f103-60d4-4869-abe3-d3a76682b9fb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1497 microversion: 2.1 time: 0.387656 Oct 27 18:56:33.691145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c210d0d-b0d2-48fd-a29b-0032ffbc427c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:33.692346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c210d0d-b0d2-48fd-a29b-0032ffbc427c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:33.693052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c210d0d-b0d2-48fd-a29b-0032ffbc427c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:33.693986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c210d0d-b0d2-48fd-a29b-0032ffbc427c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:33.694662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c210d0d-b0d2-48fd-a29b-0032ffbc427c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:33.695325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c210d0d-b0d2-48fd-a29b-0032ffbc427c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:33.707712 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1398/2710] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:33 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1497 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:33.723480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b08db72-f756-404f-9c21-df701cf63a6e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:33.724167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1b08db72-f756-404f-9c21-df701cf63a6e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:33.743518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b08db72-f756-404f-9c21-df701cf63a6e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:33.744015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b08db72-f756-404f-9c21-df701cf63a6e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:33.744454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b08db72-f756-404f-9c21-df701cf63a6e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:33.745280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b08db72-f756-404f-9c21-df701cf63a6e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:33.745607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b08db72-f756-404f-9c21-df701cf63a6e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:33.746037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b08db72-f756-404f-9c21-df701cf63a6e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:33.759429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:34.085153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1b08db72-f756-404f-9c21-df701cf63a6e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:34.093067 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1b08db72-f756-404f-9c21-df701cf63a6e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1528 microversion: 2.1 time: 0.384155 Oct 27 18:56:34.097732 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1399/2711] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:33 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1528 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:34.239544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9667b740-0c6c-4b08-bdeb-1ae8f4d51c1b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:34.244721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9667b740-0c6c-4b08-bdeb-1ae8f4d51c1b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:34.258946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9667b740-0c6c-4b08-bdeb-1ae8f4d51c1b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:34.259945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9667b740-0c6c-4b08-bdeb-1ae8f4d51c1b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:34.260650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9667b740-0c6c-4b08-bdeb-1ae8f4d51c1b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:34.261649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9667b740-0c6c-4b08-bdeb-1ae8f4d51c1b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:34.262373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9667b740-0c6c-4b08-bdeb-1ae8f4d51c1b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:34.264541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9667b740-0c6c-4b08-bdeb-1ae8f4d51c1b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:34.287709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8c210d0d-b0d2-48fd-a29b-0032ffbc427c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:34.321357 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8c210d0d-b0d2-48fd-a29b-0032ffbc427c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1494 microversion: 2.1 time: 0.644017 Oct 27 18:56:34.330904 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1313/2712] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:33 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1494 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:34.367537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2810e65c-edfb-4e28-a399-28449c8e24cf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:34.368174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2810e65c-edfb-4e28-a399-28449c8e24cf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:34.377335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2810e65c-edfb-4e28-a399-28449c8e24cf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:34.377848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2810e65c-edfb-4e28-a399-28449c8e24cf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:34.378296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2810e65c-edfb-4e28-a399-28449c8e24cf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:34.379054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2810e65c-edfb-4e28-a399-28449c8e24cf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:34.379521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2810e65c-edfb-4e28-a399-28449c8e24cf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:34.379964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2810e65c-edfb-4e28-a399-28449c8e24cf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:34.817130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9667b740-0c6c-4b08-bdeb-1ae8f4d51c1b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:34.830366 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9667b740-0c6c-4b08-bdeb-1ae8f4d51c1b tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1351 microversion: 2.1 time: 0.598587 Oct 27 18:56:34.831583 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1400/2713] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:34 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1351 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:56:34.846760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e6bc74d1-203f-4e5e-a928-be0643a26dcc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:34.847411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e6bc74d1-203f-4e5e-a928-be0643a26dcc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:34.858404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6bc74d1-203f-4e5e-a928-be0643a26dcc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:34.858979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6bc74d1-203f-4e5e-a928-be0643a26dcc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:34.861515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6bc74d1-203f-4e5e-a928-be0643a26dcc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:34.862281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6bc74d1-203f-4e5e-a928-be0643a26dcc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:34.869225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6bc74d1-203f-4e5e-a928-be0643a26dcc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:34.870096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6bc74d1-203f-4e5e-a928-be0643a26dcc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:34.948590 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2810e65c-edfb-4e28-a399-28449c8e24cf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1645 microversion: 2.1 time: 0.595896 Oct 27 18:56:34.964036 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1314/2714] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:34 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1645 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:35.003949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8cf72c7f-0427-4153-929e-7276d29bc853 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:35.004807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8cf72c7f-0427-4153-929e-7276d29bc853 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:35.013381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cf72c7f-0427-4153-929e-7276d29bc853 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:35.014365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cf72c7f-0427-4153-929e-7276d29bc853 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:35.015059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cf72c7f-0427-4153-929e-7276d29bc853 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:35.016103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cf72c7f-0427-4153-929e-7276d29bc853 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:35.016779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cf72c7f-0427-4153-929e-7276d29bc853 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:35.017431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cf72c7f-0427-4153-929e-7276d29bc853 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:35.278654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e6bc74d1-203f-4e5e-a928-be0643a26dcc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:35.300459 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e6bc74d1-203f-4e5e-a928-be0643a26dcc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1508 microversion: 2.1 time: 0.467648 Oct 27 18:56:35.301394 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1401/2715] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:34 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1508 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:35.307565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8092454f-54d5-4250-b945-d0b9b86ffc4f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:35.308520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8092454f-54d5-4250-b945-d0b9b86ffc4f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:35.327189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8092454f-54d5-4250-b945-d0b9b86ffc4f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:35.328606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8092454f-54d5-4250-b945-d0b9b86ffc4f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:35.329366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8092454f-54d5-4250-b945-d0b9b86ffc4f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:35.331075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8092454f-54d5-4250-b945-d0b9b86ffc4f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:35.331861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8092454f-54d5-4250-b945-d0b9b86ffc4f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:35.332581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8092454f-54d5-4250-b945-d0b9b86ffc4f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:35.705548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8cf72c7f-0427-4153-929e-7276d29bc853 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:35.714175 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8cf72c7f-0427-4153-929e-7276d29bc853 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1497 microversion: 2.1 time: 0.746630 Oct 27 18:56:35.733380 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1315/2716] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:34 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1497 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:35.752053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-627a4b35-ab15-4ae2-be07-e01a3460c6bf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:35.756378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-627a4b35-ab15-4ae2-be07-e01a3460c6bf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:35.771962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-627a4b35-ab15-4ae2-be07-e01a3460c6bf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:35.772747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-627a4b35-ab15-4ae2-be07-e01a3460c6bf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:35.777242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-627a4b35-ab15-4ae2-be07-e01a3460c6bf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:35.783635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-627a4b35-ab15-4ae2-be07-e01a3460c6bf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:35.785248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-627a4b35-ab15-4ae2-be07-e01a3460c6bf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:35.786561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-627a4b35-ab15-4ae2-be07-e01a3460c6bf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:35.950356 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8092454f-54d5-4250-b945-d0b9b86ffc4f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1645 microversion: 2.1 time: 0.647422 Oct 27 18:56:35.957644 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1402/2717] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:35 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1645 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:35.975632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2ab6f7d9-43ad-44e0-83dd-15d0a4e36e61 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:35.977588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2ab6f7d9-43ad-44e0-83dd-15d0a4e36e61 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:35.996151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ab6f7d9-43ad-44e0-83dd-15d0a4e36e61 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:35.998235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ab6f7d9-43ad-44e0-83dd-15d0a4e36e61 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:36.000280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ab6f7d9-43ad-44e0-83dd-15d0a4e36e61 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:36.001898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ab6f7d9-43ad-44e0-83dd-15d0a4e36e61 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:36.005044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ab6f7d9-43ad-44e0-83dd-15d0a4e36e61 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:36.005751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ab6f7d9-43ad-44e0-83dd-15d0a4e36e61 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:36.215025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-627a4b35-ab15-4ae2-be07-e01a3460c6bf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:36.227755 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-627a4b35-ab15-4ae2-be07-e01a3460c6bf tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1528 microversion: 2.1 time: 0.492999 Oct 27 18:56:36.231830 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1316/2718] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:35 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1528 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:36.242690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-870ffec5-2238-49d7-9c78-3bca5a12162e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:36.245648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-870ffec5-2238-49d7-9c78-3bca5a12162e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:36.289531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-870ffec5-2238-49d7-9c78-3bca5a12162e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:36.290040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-870ffec5-2238-49d7-9c78-3bca5a12162e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:36.290526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-870ffec5-2238-49d7-9c78-3bca5a12162e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:36.291260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-870ffec5-2238-49d7-9c78-3bca5a12162e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:36.293056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-870ffec5-2238-49d7-9c78-3bca5a12162e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:36.293523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-870ffec5-2238-49d7-9c78-3bca5a12162e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:36.608540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2ab6f7d9-43ad-44e0-83dd-15d0a4e36e61 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:36.621483 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2ab6f7d9-43ad-44e0-83dd-15d0a4e36e61 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 200 len: 1508 microversion: 2.1 time: 0.659204 Oct 27 18:56:36.632053 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1403/2719] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:35 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 1508 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:36.643187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f8f3953f-ddbd-434f-8620-22661c9400bf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:36.662288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8f3953f-ddbd-434f-8620-22661c9400bf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:36.663204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8f3953f-ddbd-434f-8620-22661c9400bf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:36.663946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8f3953f-ddbd-434f-8620-22661c9400bf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:36.664777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8f3953f-ddbd-434f-8620-22661c9400bf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:36.665242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8f3953f-ddbd-434f-8620-22661c9400bf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:36.665682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8f3953f-ddbd-434f-8620-22661c9400bf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:36.724757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-870ffec5-2238-49d7-9c78-3bca5a12162e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:36.737963 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f8f3953f-ddbd-434f-8620-22661c9400bf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.104627 Oct 27 18:56:36.739823 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-870ffec5-2238-49d7-9c78-3bca5a12162e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1351 microversion: 2.1 time: 0.506309 Oct 27 18:56:36.742060 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1317/2720] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:36 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1351 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:36.751675 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1404/2721] 10.222.0.42 () {58 vars in 1176 bytes} [Thu Oct 27 18:56:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:36.760374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ad7d3c32-b8b3-47ff-9bd2-32eaccb0e6b6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:36.765945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ad7d3c32-b8b3-47ff-9bd2-32eaccb0e6b6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:36.767584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0acb36a0-c3fe-4494-9003-7f9baabf1fcf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:36.768385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0acb36a0-c3fe-4494-9003-7f9baabf1fcf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:36.787327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0acb36a0-c3fe-4494-9003-7f9baabf1fcf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:36.788073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0acb36a0-c3fe-4494-9003-7f9baabf1fcf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:36.788312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad7d3c32-b8b3-47ff-9bd2-32eaccb0e6b6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:36.788846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad7d3c32-b8b3-47ff-9bd2-32eaccb0e6b6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:36.792124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad7d3c32-b8b3-47ff-9bd2-32eaccb0e6b6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:36.792427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0acb36a0-c3fe-4494-9003-7f9baabf1fcf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:36.793263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad7d3c32-b8b3-47ff-9bd2-32eaccb0e6b6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:36.793590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0acb36a0-c3fe-4494-9003-7f9baabf1fcf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:36.794295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0acb36a0-c3fe-4494-9003-7f9baabf1fcf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:36.794939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0acb36a0-c3fe-4494-9003-7f9baabf1fcf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:36.796850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad7d3c32-b8b3-47ff-9bd2-32eaccb0e6b6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:36.802057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad7d3c32-b8b3-47ff-9bd2-32eaccb0e6b6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:36.877323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ad7d3c32-b8b3-47ff-9bd2-32eaccb0e6b6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:56:37.103670 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ad7d3c32-b8b3-47ff-9bd2-32eaccb0e6b6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 204 len: 0 microversion: 2.1 time: 0.348602 Oct 27 18:56:37.104661 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1318/2722] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:56:36 2022] DELETE /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:56:37.113493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5fdfe080-0a6e-4340-bb84-6bce913b838e tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:37.115065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5fdfe080-0a6e-4340-bb84-6bce913b838e tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:37.123919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fdfe080-0a6e-4340-bb84-6bce913b838e tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:37.124877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fdfe080-0a6e-4340-bb84-6bce913b838e tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:37.126604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fdfe080-0a6e-4340-bb84-6bce913b838e tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:37.127884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fdfe080-0a6e-4340-bb84-6bce913b838e tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:37.128575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fdfe080-0a6e-4340-bb84-6bce913b838e tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:37.129448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fdfe080-0a6e-4340-bb84-6bce913b838e tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:37.171447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:37.245319 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5fdfe080-0a6e-4340-bb84-6bce913b838e tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf/action" status: 202 len: 0 microversion: 2.1 time: 0.137933 Oct 27 18:56:37.256890 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1319/2723] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:56:37 2022] POST /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:56:37.272145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f3708850-1adc-45b6-9333-ad864f273ecc tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:37.272868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f3708850-1adc-45b6-9333-ad864f273ecc tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:37.306737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3708850-1adc-45b6-9333-ad864f273ecc tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:37.309585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3708850-1adc-45b6-9333-ad864f273ecc tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:37.310054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3708850-1adc-45b6-9333-ad864f273ecc tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:37.311765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3708850-1adc-45b6-9333-ad864f273ecc tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:37.312241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3708850-1adc-45b6-9333-ad864f273ecc tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:37.312684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3708850-1adc-45b6-9333-ad864f273ecc tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:38.012918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0acb36a0-c3fe-4494-9003-7f9baabf1fcf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:38.030490 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0acb36a0-c3fe-4494-9003-7f9baabf1fcf tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1497 microversion: 2.1 time: 1.276633 Oct 27 18:56:38.039931 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1405/2724] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:36 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1497 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:38.052665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9ddf81fb-b4fa-4788-b6b0-d7605ff302b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:38.054774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9ddf81fb-b4fa-4788-b6b0-d7605ff302b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:38.069199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ddf81fb-b4fa-4788-b6b0-d7605ff302b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:38.070027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ddf81fb-b4fa-4788-b6b0-d7605ff302b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:38.070706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ddf81fb-b4fa-4788-b6b0-d7605ff302b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:38.072208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ddf81fb-b4fa-4788-b6b0-d7605ff302b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:38.073558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ddf81fb-b4fa-4788-b6b0-d7605ff302b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:38.074204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ddf81fb-b4fa-4788-b6b0-d7605ff302b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:38.322058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9ddf81fb-b4fa-4788-b6b0-d7605ff302b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:38.332084 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9ddf81fb-b4fa-4788-b6b0-d7605ff302b0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1528 microversion: 2.1 time: 0.290660 Oct 27 18:56:38.336591 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1406/2725] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:38 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1528 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:38.348220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-654441432", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "700f0f16-58c0-4cd3-9a25-b6c938e0a6b1"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:38.460808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] validate_networks() for [('700f0f16-58c0-4cd3-9a25-b6c938e0a6b1', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:56:39.075284 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f3708850-1adc-45b6-9333-ad864f273ecc tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1650 microversion: 2.1 time: 1.813378 Oct 27 18:56:39.098466 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1320/2726] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:37 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1650 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:39.378566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-2054091986", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "ddf7ba4a-5725-4324-8cfc-99345f499249"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:39.473722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:56:39.474520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:56:39.474928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:56:39.475330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:56:39.475810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:56:39.500051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:39.500735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:39.501179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:39.503796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] validate_networks() for [('ddf7ba4a-5725-4324-8cfc-99345f499249', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:56:39.507017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:39.507520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:39.507996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:39.569469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Getting quotas for project bcefa097ed8d4bf8b7f0118786874cc1. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:56:39.588681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Getting quotas for user 77434d4813ca426fbc20f386894c3176 and project bcefa097ed8d4bf8b7f0118786874cc1. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:56:39.624440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:56:39.630926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:56:39.770095 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-375f7e28-ed05-4923-91c7-7e2600d1532b tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.427919 Oct 27 18:56:39.775420 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1407/2727] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:56:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:56:39.812489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-be6f2a08-d39e-4bd3-98f0-e3fffff60bb6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:39.819708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-be6f2a08-d39e-4bd3-98f0-e3fffff60bb6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:39.850531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be6f2a08-d39e-4bd3-98f0-e3fffff60bb6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:39.855343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be6f2a08-d39e-4bd3-98f0-e3fffff60bb6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:39.857801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be6f2a08-d39e-4bd3-98f0-e3fffff60bb6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:39.862095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be6f2a08-d39e-4bd3-98f0-e3fffff60bb6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:39.863366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be6f2a08-d39e-4bd3-98f0-e3fffff60bb6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:39.867476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be6f2a08-d39e-4bd3-98f0-e3fffff60bb6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:40.408297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-be6f2a08-d39e-4bd3-98f0-e3fffff60bb6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:40.422999 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-be6f2a08-d39e-4bd3-98f0-e3fffff60bb6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1351 microversion: 2.1 time: 0.644124 Oct 27 18:56:40.439627 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1408/2728] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:39 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1351 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:40.584590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:56:40.585103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:56:40.585487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:56:40.586071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:56:40.586306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:56:40.608971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:40.613733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:40.614206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:40.618676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:40.619166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:40.619613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:40.631781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-666981365", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:40.683001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Getting quotas for project a03a92ab456f4b21964fd7ac2d277f7f. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:56:40.701095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Getting quotas for user 25aae47b58f94604a6d57bfc222ac6d6 and project a03a92ab456f4b21964fd7ac2d277f7f. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:56:40.764964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:56:40.769694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:56:40.777239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] validate_networks() for [('1dd93382-ebdf-4dbe-b385-4467cbf2351e', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:56:40.870871 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b5d22b18-f0cd-4715-8c64-d8b4fda8050f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.771080 Oct 27 18:56:40.878448 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1321/2729] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:56:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:56:40.878448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8dc7d722-90f6-44cd-bd5b-87b37fdc0535 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:40.884707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8dc7d722-90f6-44cd-bd5b-87b37fdc0535 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:40.893289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dc7d722-90f6-44cd-bd5b-87b37fdc0535 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:40.894071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dc7d722-90f6-44cd-bd5b-87b37fdc0535 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:40.894761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dc7d722-90f6-44cd-bd5b-87b37fdc0535 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:40.895878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dc7d722-90f6-44cd-bd5b-87b37fdc0535 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:40.897024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dc7d722-90f6-44cd-bd5b-87b37fdc0535 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:40.897630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dc7d722-90f6-44cd-bd5b-87b37fdc0535 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:41.332404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8dc7d722-90f6-44cd-bd5b-87b37fdc0535 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:41.346802 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8dc7d722-90f6-44cd-bd5b-87b37fdc0535 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1497 microversion: 2.1 time: 0.470656 Oct 27 18:56:41.348042 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1322/2730] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:40 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1497 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:41.354181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-df073d43-2b08-4113-baa9-c990f782ac05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:41.355109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-df073d43-2b08-4113-baa9-c990f782ac05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:41.365581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df073d43-2b08-4113-baa9-c990f782ac05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:41.366622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df073d43-2b08-4113-baa9-c990f782ac05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:41.367222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df073d43-2b08-4113-baa9-c990f782ac05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:41.368270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df073d43-2b08-4113-baa9-c990f782ac05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:41.369178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df073d43-2b08-4113-baa9-c990f782ac05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:41.369768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df073d43-2b08-4113-baa9-c990f782ac05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:41.907660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-df073d43-2b08-4113-baa9-c990f782ac05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:41.916851 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-df073d43-2b08-4113-baa9-c990f782ac05 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1528 microversion: 2.1 time: 0.567324 Oct 27 18:56:41.943620 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1323/2731] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:41 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1528 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:41.948933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-40bf4672-91aa-4dee-875b-facab3e11ecd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:41.954370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-40bf4672-91aa-4dee-875b-facab3e11ecd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:41.979110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40bf4672-91aa-4dee-875b-facab3e11ecd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:41.979736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40bf4672-91aa-4dee-875b-facab3e11ecd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:41.980203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40bf4672-91aa-4dee-875b-facab3e11ecd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:41.980951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40bf4672-91aa-4dee-875b-facab3e11ecd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:41.981415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40bf4672-91aa-4dee-875b-facab3e11ecd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:41.981844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40bf4672-91aa-4dee-875b-facab3e11ecd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:42.338293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:56:42.338864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:56:42.339295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:56:42.339714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:56:42.340129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:56:42.363655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:42.368428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:42.372957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:42.379817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:42.380646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:42.384393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:42.412412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-40bf4672-91aa-4dee-875b-facab3e11ecd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:42.433085 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-40bf4672-91aa-4dee-875b-facab3e11ecd tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1213 microversion: 2.1 time: 0.477797 Oct 27 18:56:42.433915 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1324/2732] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:41 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1213 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:42.458118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4b838bfd-354a-43fd-9a35-a8a3e2187574 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:42.461355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4b838bfd-354a-43fd-9a35-a8a3e2187574 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:42.499608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Getting quotas for project c6651a933fb1407f95a17ef4a1583933. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:56:42.501373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b838bfd-354a-43fd-9a35-a8a3e2187574 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:42.502671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b838bfd-354a-43fd-9a35-a8a3e2187574 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:42.506028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b838bfd-354a-43fd-9a35-a8a3e2187574 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:42.508269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b838bfd-354a-43fd-9a35-a8a3e2187574 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:42.511216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b838bfd-354a-43fd-9a35-a8a3e2187574 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:42.514492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b838bfd-354a-43fd-9a35-a8a3e2187574 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:42.518934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Getting quotas for user 683571ba22aa4e838e473f111f97ffae and project c6651a933fb1407f95a17ef4a1583933. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:56:42.560570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:56:42.563459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:56:42.724768 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b0115bbb-0121-441b-bc6e-2db4bd5b7f43 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.287791 Oct 27 18:56:42.738415 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1409/2733] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:56:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:56:42.743359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13d22ae4-e01a-45b6-967d-2b6075bf40c9 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:42.750280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-13d22ae4-e01a-45b6-967d-2b6075bf40c9 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:42.770203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13d22ae4-e01a-45b6-967d-2b6075bf40c9 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:42.771624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13d22ae4-e01a-45b6-967d-2b6075bf40c9 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:42.772270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13d22ae4-e01a-45b6-967d-2b6075bf40c9 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:42.773176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13d22ae4-e01a-45b6-967d-2b6075bf40c9 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:42.773800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13d22ae4-e01a-45b6-967d-2b6075bf40c9 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:42.774487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13d22ae4-e01a-45b6-967d-2b6075bf40c9 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:42.917702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-13d22ae4-e01a-45b6-967d-2b6075bf40c9 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aae47b58f94604a6d57bfc222ac6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03a92ab456f4b21964fd7ac2d277f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:42.926437 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13d22ae4-e01a-45b6-967d-2b6075bf40c9 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 200 len: 1213 microversion: 2.1 time: 0.186898 Oct 27 18:56:42.927041 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1410/2734] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:42 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 1213 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:42.947363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-522d6cd5-942d-45af-ad01-0f1bece0243a req-df8c2836-b6c2-467d-aa2f-b16b199fa249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3ab523-37c4-46bc-ab91-975da6d3807f", "name": "network-vif-deleted", "tag": "fa3593d4-3151-4370-bc45-3ffbb894137b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:42.982655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-522d6cd5-942d-45af-ad01-0f1bece0243a req-df8c2836-b6c2-467d-aa2f-b16b199fa249 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:42.983365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-522d6cd5-942d-45af-ad01-0f1bece0243a req-df8c2836-b6c2-467d-aa2f-b16b199fa249 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:42.984085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-522d6cd5-942d-45af-ad01-0f1bece0243a req-df8c2836-b6c2-467d-aa2f-b16b199fa249 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:43.007789 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-522d6cd5-942d-45af-ad01-0f1bece0243a req-df8c2836-b6c2-467d-aa2f-b16b199fa249 service nova] Creating event network-vif-deleted:fa3593d4-3151-4370-bc45-3ffbb894137b for instance 3b3ab523-37c4-46bc-ab91-975da6d3807f on n-h1-860687-3 Oct 27 18:56:43.016949 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-522d6cd5-942d-45af-ad01-0f1bece0243a req-df8c2836-b6c2-467d-aa2f-b16b199fa249 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072332 Oct 27 18:56:43.022691 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1411/2735] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:43.028428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-58ed8596-cf92-47e6-aa70-a2588416e067 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:43.038241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-58ed8596-cf92-47e6-aa70-a2588416e067 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:43.046868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58ed8596-cf92-47e6-aa70-a2588416e067 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:43.048204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58ed8596-cf92-47e6-aa70-a2588416e067 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:43.048656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58ed8596-cf92-47e6-aa70-a2588416e067 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:43.049381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58ed8596-cf92-47e6-aa70-a2588416e067 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:43.049842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58ed8596-cf92-47e6-aa70-a2588416e067 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:43.050276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58ed8596-cf92-47e6-aa70-a2588416e067 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:43.200828 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4b838bfd-354a-43fd-9a35-a8a3e2187574 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1630 microversion: 2.1 time: 0.759800 Oct 27 18:56:43.206425 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1325/2736] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:42 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1630 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:43.248177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e4f5b290-f39a-4564-96e1-ee4e918c0871 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:43.249935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e4f5b290-f39a-4564-96e1-ee4e918c0871 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:43.266249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4f5b290-f39a-4564-96e1-ee4e918c0871 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:43.279251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4f5b290-f39a-4564-96e1-ee4e918c0871 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:43.283070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4f5b290-f39a-4564-96e1-ee4e918c0871 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:43.284564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4f5b290-f39a-4564-96e1-ee4e918c0871 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:43.288906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4f5b290-f39a-4564-96e1-ee4e918c0871 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:43.289569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4f5b290-f39a-4564-96e1-ee4e918c0871 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:43.520577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-58ed8596-cf92-47e6-aa70-a2588416e067 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:43.536186 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-58ed8596-cf92-47e6-aa70-a2588416e067 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1351 microversion: 2.1 time: 0.511833 Oct 27 18:56:43.558741 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1412/2737] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:43 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1351 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:43.577689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5b9795ed-8b74-4fb5-9f7a-874f47f13401 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:43.579909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5b9795ed-8b74-4fb5-9f7a-874f47f13401 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:43.662799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5b9795ed-8b74-4fb5-9f7a-874f47f13401 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:43.673624 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5b9795ed-8b74-4fb5-9f7a-874f47f13401 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1213 microversion: 2.1 time: 0.110988 Oct 27 18:56:43.681979 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1413/2738] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:43 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:43.694599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a83811c7-6712-4bdc-ada0-7e4555477123 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:43.696401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a83811c7-6712-4bdc-ada0-7e4555477123 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:43.737889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a83811c7-6712-4bdc-ada0-7e4555477123 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:43.738414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a83811c7-6712-4bdc-ada0-7e4555477123 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:43.741825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a83811c7-6712-4bdc-ada0-7e4555477123 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:43.744371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a83811c7-6712-4bdc-ada0-7e4555477123 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:43.749678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a83811c7-6712-4bdc-ada0-7e4555477123 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:43.754801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a83811c7-6712-4bdc-ada0-7e4555477123 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:44.096971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e4f5b290-f39a-4564-96e1-ee4e918c0871 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:44.109816 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e4f5b290-f39a-4564-96e1-ee4e918c0871 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 200 len: 1474 microversion: 2.1 time: 0.887773 Oct 27 18:56:44.132676 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1326/2739] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:43 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 1474 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:44.141610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-73216b25-6cd1-49ed-81f6-761fc1ee7ec0 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860687-3", "block_migration": true, "disk_over_commit": false}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:44.145474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-73216b25-6cd1-49ed-81f6-761fc1ee7ec0 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:44.162968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73216b25-6cd1-49ed-81f6-761fc1ee7ec0 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:44.165225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73216b25-6cd1-49ed-81f6-761fc1ee7ec0 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:44.166852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73216b25-6cd1-49ed-81f6-761fc1ee7ec0 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:44.169525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73216b25-6cd1-49ed-81f6-761fc1ee7ec0 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:44.170193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73216b25-6cd1-49ed-81f6-761fc1ee7ec0 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:44.170835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73216b25-6cd1-49ed-81f6-761fc1ee7ec0 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:44.225965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-73216b25-6cd1-49ed-81f6-761fc1ee7ec0 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lazy-loading 'flavor' on Instance uuid 1eff0154-2475-4b5b-8c32-0b2ffb3481cf {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:56:44.260499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-73216b25-6cd1-49ed-81f6-761fc1ee7ec0 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Going to try to live migrate instance to n-h2-860687-3 {{(pid=127028) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 18:56:44.581821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a83811c7-6712-4bdc-ada0-7e4555477123 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:44.603560 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a83811c7-6712-4bdc-ada0-7e4555477123 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1528 microversion: 2.1 time: 0.918555 Oct 27 18:56:44.603560 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1414/2740] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:43 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1528 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:44.608139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5f961b04-478a-42d1-b73e-925764887545 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:44.609261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5f961b04-478a-42d1-b73e-925764887545 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:44.628622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:44.630534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f961b04-478a-42d1-b73e-925764887545 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:44.631093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f961b04-478a-42d1-b73e-925764887545 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:44.631667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f961b04-478a-42d1-b73e-925764887545 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:44.632513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f961b04-478a-42d1-b73e-925764887545 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:44.632956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f961b04-478a-42d1-b73e-925764887545 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:44.635357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f961b04-478a-42d1-b73e-925764887545 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:44.902661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5f961b04-478a-42d1-b73e-925764887545 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:44.934503 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5f961b04-478a-42d1-b73e-925764887545 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1275 microversion: 2.1 time: 0.330478 Oct 27 18:56:44.951309 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1415/2741] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:44 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1275 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:44.957722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5cfc6767-8d70-4e70-a9c1-2712b71a5e84 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:44.958354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5cfc6767-8d70-4e70-a9c1-2712b71a5e84 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:45.005292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cfc6767-8d70-4e70-a9c1-2712b71a5e84 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:45.013870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cfc6767-8d70-4e70-a9c1-2712b71a5e84 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:45.017736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cfc6767-8d70-4e70-a9c1-2712b71a5e84 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:45.019573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cfc6767-8d70-4e70-a9c1-2712b71a5e84 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:45.024195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cfc6767-8d70-4e70-a9c1-2712b71a5e84 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:45.024982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cfc6767-8d70-4e70-a9c1-2712b71a5e84 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:45.289483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5cfc6767-8d70-4e70-a9c1-2712b71a5e84 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aae47b58f94604a6d57bfc222ac6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03a92ab456f4b21964fd7ac2d277f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:45.331024 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5cfc6767-8d70-4e70-a9c1-2712b71a5e84 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 200 len: 1275 microversion: 2.1 time: 0.370737 Oct 27 18:56:45.334096 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1416/2742] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:44 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 1275 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:45.357859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9740e40f-1a6f-47c5-a80d-e60040888929 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1909509197"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:45.371644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9740e40f-1a6f-47c5-a80d-e60040888929 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:45.405497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9740e40f-1a6f-47c5-a80d-e60040888929 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:45.405972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9740e40f-1a6f-47c5-a80d-e60040888929 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:45.406554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9740e40f-1a6f-47c5-a80d-e60040888929 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:45.408963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9740e40f-1a6f-47c5-a80d-e60040888929 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:45.409667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9740e40f-1a6f-47c5-a80d-e60040888929 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:45.417024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9740e40f-1a6f-47c5-a80d-e60040888929 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:46.068310 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9740e40f-1a6f-47c5-a80d-e60040888929 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "POST /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28/action" status: 202 len: 0 microversion: 2.1 time: 0.731111 Oct 27 18:56:46.069685 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1417/2743] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:56:45 2022] POST /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28/action => generated 0 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 18:56:46.082078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fdc834a0-1439-4b24-ac73-1f37b89c97bf tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:46.087590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fdc834a0-1439-4b24-ac73-1f37b89c97bf tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:46.099203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fdc834a0-1439-4b24-ac73-1f37b89c97bf tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:46.111328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fdc834a0-1439-4b24-ac73-1f37b89c97bf tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:46.117517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fdc834a0-1439-4b24-ac73-1f37b89c97bf tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:46.119320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fdc834a0-1439-4b24-ac73-1f37b89c97bf tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:46.122921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fdc834a0-1439-4b24-ac73-1f37b89c97bf tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:46.123615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fdc834a0-1439-4b24-ac73-1f37b89c97bf tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:46.135367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:46.997041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fdc834a0-1439-4b24-ac73-1f37b89c97bf tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:47.008267 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fdc834a0-1439-4b24-ac73-1f37b89c97bf tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1351 microversion: 2.1 time: 0.937155 Oct 27 18:56:47.008861 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1418/2744] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:46 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1351 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:47.034870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9c3c1fb5-f792-4e16-b703-7fbe6f21e6bd tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:47.035496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9c3c1fb5-f792-4e16-b703-7fbe6f21e6bd tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:47.068460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c3c1fb5-f792-4e16-b703-7fbe6f21e6bd tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:47.072190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c3c1fb5-f792-4e16-b703-7fbe6f21e6bd tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:47.073257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c3c1fb5-f792-4e16-b703-7fbe6f21e6bd tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:47.075383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c3c1fb5-f792-4e16-b703-7fbe6f21e6bd tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:47.080773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c3c1fb5-f792-4e16-b703-7fbe6f21e6bd tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:47.084119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c3c1fb5-f792-4e16-b703-7fbe6f21e6bd tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:47.331670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9c3c1fb5-f792-4e16-b703-7fbe6f21e6bd tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:47.343545 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9c3c1fb5-f792-4e16-b703-7fbe6f21e6bd tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1271 microversion: 2.1 time: 0.333610 Oct 27 18:56:47.345184 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1419/2745] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:47 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1271 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:47.356463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e0739527-f549-4529-9b02-2dc9eb5f0648 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:47.357096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e0739527-f549-4529-9b02-2dc9eb5f0648 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:47.381475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0739527-f549-4529-9b02-2dc9eb5f0648 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:47.381990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0739527-f549-4529-9b02-2dc9eb5f0648 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:47.383425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0739527-f549-4529-9b02-2dc9eb5f0648 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:47.384364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0739527-f549-4529-9b02-2dc9eb5f0648 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:47.384997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0739527-f549-4529-9b02-2dc9eb5f0648 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:47.385782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0739527-f549-4529-9b02-2dc9eb5f0648 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:48.573986 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-73216b25-6cd1-49ed-81f6-761fc1ee7ec0 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf/action" status: 202 len: 0 microversion: 2.1 time: 4.439617 Oct 27 18:56:48.580797 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1327/2746] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:56:44 2022] POST /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf/action => generated 0 bytes in 4447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:56:48.591133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d2e8c066-8e29-4793-89cb-2ff2a9c3eb82 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:48.592954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d2e8c066-8e29-4793-89cb-2ff2a9c3eb82 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:48.622125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2e8c066-8e29-4793-89cb-2ff2a9c3eb82 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:48.624190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2e8c066-8e29-4793-89cb-2ff2a9c3eb82 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:48.626208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2e8c066-8e29-4793-89cb-2ff2a9c3eb82 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:48.627729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2e8c066-8e29-4793-89cb-2ff2a9c3eb82 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:48.631844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2e8c066-8e29-4793-89cb-2ff2a9c3eb82 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:48.632335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2e8c066-8e29-4793-89cb-2ff2a9c3eb82 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:48.975726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e0739527-f549-4529-9b02-2dc9eb5f0648 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:48.987623 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e0739527-f549-4529-9b02-2dc9eb5f0648 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1528 microversion: 2.1 time: 1.641284 Oct 27 18:56:48.993240 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1420/2747] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:47 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1528 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:49.005578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e5c72b4d-e74f-46df-8218-def8f4869fb5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a0ce670>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:49.104302 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e5c72b4d-e74f-46df-8218-def8f4869fb5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1412 microversion: 2.1 time: 0.109635 Oct 27 18:56:49.107424 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1421/2748] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:56:48 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:49.114509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-030fa386-337d-44f0-9157-04dfb4f44031 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:49.115441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-030fa386-337d-44f0-9157-04dfb4f44031 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:49.127059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-030fa386-337d-44f0-9157-04dfb4f44031 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:49.129463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-030fa386-337d-44f0-9157-04dfb4f44031 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:49.130165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-030fa386-337d-44f0-9157-04dfb4f44031 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:49.131276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-030fa386-337d-44f0-9157-04dfb4f44031 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:49.132216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-030fa386-337d-44f0-9157-04dfb4f44031 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:49.132919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-030fa386-337d-44f0-9157-04dfb4f44031 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:49.644562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-030fa386-337d-44f0-9157-04dfb4f44031 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aae47b58f94604a6d57bfc222ac6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03a92ab456f4b21964fd7ac2d277f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:49.662250 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-030fa386-337d-44f0-9157-04dfb4f44031 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 200 len: 1317 microversion: 2.1 time: 0.552370 Oct 27 18:56:49.664089 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1422/2749] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:49 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:49.677542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-2a5b1bb5-e9fb-4381-a573-08667aa4b3db req-6428e49a-0fd8-468d-8efa-e268e0cf7c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403ad40f-7a7d-4be1-b1c2-16f91dd36e09", "name": "network-vif-plugged", "status": "completed", "tag": "76e19a54-ac3a-4d4d-b981-0958c1f79d34"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:49.706591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2a5b1bb5-e9fb-4381-a573-08667aa4b3db req-6428e49a-0fd8-468d-8efa-e268e0cf7c19 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:49.710422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2a5b1bb5-e9fb-4381-a573-08667aa4b3db req-6428e49a-0fd8-468d-8efa-e268e0cf7c19 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:49.713347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2a5b1bb5-e9fb-4381-a573-08667aa4b3db req-6428e49a-0fd8-468d-8efa-e268e0cf7c19 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:49.776179 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-2a5b1bb5-e9fb-4381-a573-08667aa4b3db req-6428e49a-0fd8-468d-8efa-e268e0cf7c19 service nova] Creating event network-vif-plugged:76e19a54-ac3a-4d4d-b981-0958c1f79d34 for instance 403ad40f-7a7d-4be1-b1c2-16f91dd36e09 on n-h2-860687-3 Oct 27 18:56:49.796680 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-2a5b1bb5-e9fb-4381-a573-08667aa4b3db req-6428e49a-0fd8-468d-8efa-e268e0cf7c19 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131246 Oct 27 18:56:49.801383 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1423/2750] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:49.819366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1668bbb4-cf93-4d67-92bc-7062ef756929 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:49.820421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1668bbb4-cf93-4d67-92bc-7062ef756929 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:49.841033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1668bbb4-cf93-4d67-92bc-7062ef756929 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:49.841857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1668bbb4-cf93-4d67-92bc-7062ef756929 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:49.845011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1668bbb4-cf93-4d67-92bc-7062ef756929 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:49.847212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1668bbb4-cf93-4d67-92bc-7062ef756929 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:49.849836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1668bbb4-cf93-4d67-92bc-7062ef756929 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:49.853263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1668bbb4-cf93-4d67-92bc-7062ef756929 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:50.076553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d2e8c066-8e29-4793-89cb-2ff2a9c3eb82 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:50.102376 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d2e8c066-8e29-4793-89cb-2ff2a9c3eb82 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1317 microversion: 2.1 time: 1.519842 Oct 27 18:56:50.111417 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1328/2751] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:48 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1317 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:50.133712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7a1aed6-51ca-4ac9-8836-a62070893919 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:50.143421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7a1aed6-51ca-4ac9-8836-a62070893919 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:50.177289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7a1aed6-51ca-4ac9-8836-a62070893919 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:50.180398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7a1aed6-51ca-4ac9-8836-a62070893919 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:50.181048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7a1aed6-51ca-4ac9-8836-a62070893919 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:50.184935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7a1aed6-51ca-4ac9-8836-a62070893919 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:50.186963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7a1aed6-51ca-4ac9-8836-a62070893919 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:50.194186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7a1aed6-51ca-4ac9-8836-a62070893919 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:50.351323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1668bbb4-cf93-4d67-92bc-7062ef756929 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:50.363493 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1668bbb4-cf93-4d67-92bc-7062ef756929 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1351 microversion: 2.1 time: 0.560496 Oct 27 18:56:50.384085 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1424/2752] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:49 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1351 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:50.394077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5ad5256e-4e4b-46f0-a7d1-403e72626d1d req-05ca0a2c-d672-4a86-80b7-89704e59e0ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f3d0be-dedd-4dd1-8b00-9f81d24b957a", "tag": "024b1ff9-2a5f-41df-b730-9c3b28e617ff"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:50.417885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5ad5256e-4e4b-46f0-a7d1-403e72626d1d req-05ca0a2c-d672-4a86-80b7-89704e59e0ce service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:50.418706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5ad5256e-4e4b-46f0-a7d1-403e72626d1d req-05ca0a2c-d672-4a86-80b7-89704e59e0ce service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:50.419996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5ad5256e-4e4b-46f0-a7d1-403e72626d1d req-05ca0a2c-d672-4a86-80b7-89704e59e0ce service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:50.448742 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5ad5256e-4e4b-46f0-a7d1-403e72626d1d req-05ca0a2c-d672-4a86-80b7-89704e59e0ce service nova] Creating event network-changed:024b1ff9-2a5f-41df-b730-9c3b28e617ff for instance e9f3d0be-dedd-4dd1-8b00-9f81d24b957a on n-h1-860687-3 Oct 27 18:56:50.463467 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5ad5256e-4e4b-46f0-a7d1-403e72626d1d req-05ca0a2c-d672-4a86-80b7-89704e59e0ce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076240 Oct 27 18:56:50.466743 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1425/2753] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:50.473978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a3557efd-5bf9-4e1a-ab01-c2a07c590459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:50.479326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a3557efd-5bf9-4e1a-ab01-c2a07c590459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:50.496845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3557efd-5bf9-4e1a-ab01-c2a07c590459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:50.497554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3557efd-5bf9-4e1a-ab01-c2a07c590459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:50.498177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3557efd-5bf9-4e1a-ab01-c2a07c590459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:50.499512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3557efd-5bf9-4e1a-ab01-c2a07c590459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:50.501792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3557efd-5bf9-4e1a-ab01-c2a07c590459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:50.506293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3557efd-5bf9-4e1a-ab01-c2a07c590459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:50.642128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:50.654015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7a1aed6-51ca-4ac9-8836-a62070893919 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:50.672024 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7a1aed6-51ca-4ac9-8836-a62070893919 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1313 microversion: 2.1 time: 0.559124 Oct 27 18:56:50.673450 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1329/2754] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:50 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:50.688766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9dce4667-9171-4302-8b20-37a09d07da4f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:50.689815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9dce4667-9171-4302-8b20-37a09d07da4f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:50.711458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dce4667-9171-4302-8b20-37a09d07da4f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:50.712189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dce4667-9171-4302-8b20-37a09d07da4f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:50.712862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dce4667-9171-4302-8b20-37a09d07da4f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:50.714371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dce4667-9171-4302-8b20-37a09d07da4f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:50.727121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dce4667-9171-4302-8b20-37a09d07da4f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:50.727764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dce4667-9171-4302-8b20-37a09d07da4f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:50.748549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:50.880886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a3557efd-5bf9-4e1a-ab01-c2a07c590459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:50.894120 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a3557efd-5bf9-4e1a-ab01-c2a07c590459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1504 microversion: 2.1 time: 0.425653 Oct 27 18:56:50.911662 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1426/2755] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:50 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:50.917565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5028f1dd-cba7-433a-967f-19b50d1330b8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc87326c3a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:50.974985 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5028f1dd-cba7-433a-967f-19b50d1330b8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1412 microversion: 2.1 time: 0.061648 Oct 27 18:56:50.976446 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1427/2756] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:56:50 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1412 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:50.991101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2a991c2c-83fd-481f-9ebd-7ba08ee74a0a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:50.996120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2a991c2c-83fd-481f-9ebd-7ba08ee74a0a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:51.019730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a991c2c-83fd-481f-9ebd-7ba08ee74a0a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:51.020610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a991c2c-83fd-481f-9ebd-7ba08ee74a0a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:51.022815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a991c2c-83fd-481f-9ebd-7ba08ee74a0a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:51.025313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a991c2c-83fd-481f-9ebd-7ba08ee74a0a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:51.027223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a991c2c-83fd-481f-9ebd-7ba08ee74a0a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:51.029172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a991c2c-83fd-481f-9ebd-7ba08ee74a0a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:51.556471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2a991c2c-83fd-481f-9ebd-7ba08ee74a0a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aae47b58f94604a6d57bfc222ac6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03a92ab456f4b21964fd7ac2d277f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:51.581381 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2a991c2c-83fd-481f-9ebd-7ba08ee74a0a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 200 len: 1317 microversion: 2.1 time: 0.599051 Oct 27 18:56:51.595720 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1428/2757] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:50 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:51.611153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-08b61bf4-fb44-44bb-b11a-0a576d855d15 req-b8ab1e18-b9f5-4acd-a4e0-de8f8954c5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603", "tag": "015c923b-1253-4901-8696-2b913942b5c7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:51.654199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-08b61bf4-fb44-44bb-b11a-0a576d855d15 req-b8ab1e18-b9f5-4acd-a4e0-de8f8954c5d5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:51.659233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-08b61bf4-fb44-44bb-b11a-0a576d855d15 req-b8ab1e18-b9f5-4acd-a4e0-de8f8954c5d5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:51.659693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-08b61bf4-fb44-44bb-b11a-0a576d855d15 req-b8ab1e18-b9f5-4acd-a4e0-de8f8954c5d5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:51.672908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9dce4667-9171-4302-8b20-37a09d07da4f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:51.690208 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-08b61bf4-fb44-44bb-b11a-0a576d855d15 req-b8ab1e18-b9f5-4acd-a4e0-de8f8954c5d5 service nova] Creating event network-changed:015c923b-1253-4901-8696-2b913942b5c7 for instance 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 on n-h1-860687-3 Oct 27 18:56:51.697670 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-08b61bf4-fb44-44bb-b11a-0a576d855d15 req-b8ab1e18-b9f5-4acd-a4e0-de8f8954c5d5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098095 Oct 27 18:56:51.698759 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1429/2758] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:51.699725 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9dce4667-9171-4302-8b20-37a09d07da4f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1528 microversion: 2.1 time: 1.023822 Oct 27 18:56:51.703539 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1330/2759] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:50 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1528 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:51.710338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9843a512-9e4b-477b-8f56-d55467d5fc1f tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:51.711306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9843a512-9e4b-477b-8f56-d55467d5fc1f tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:51.720679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-50e76369-697b-45af-987d-4eb91623d50e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:51.721212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9843a512-9e4b-477b-8f56-d55467d5fc1f tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:51.721396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-50e76369-697b-45af-987d-4eb91623d50e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:51.722041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9843a512-9e4b-477b-8f56-d55467d5fc1f tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:51.722739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9843a512-9e4b-477b-8f56-d55467d5fc1f tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:51.723681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9843a512-9e4b-477b-8f56-d55467d5fc1f tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:51.724529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9843a512-9e4b-477b-8f56-d55467d5fc1f tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:51.725182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9843a512-9e4b-477b-8f56-d55467d5fc1f tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:51.727801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50e76369-697b-45af-987d-4eb91623d50e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:51.728515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50e76369-697b-45af-987d-4eb91623d50e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:51.729739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50e76369-697b-45af-987d-4eb91623d50e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:51.730664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50e76369-697b-45af-987d-4eb91623d50e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:51.731714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50e76369-697b-45af-987d-4eb91623d50e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:51.732336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50e76369-697b-45af-987d-4eb91623d50e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:52.025969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9843a512-9e4b-477b-8f56-d55467d5fc1f tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:52.041484 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9843a512-9e4b-477b-8f56-d55467d5fc1f tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1351 microversion: 2.1 time: 0.336136 Oct 27 18:56:52.042971 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1331/2760] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:51 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1351 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:52.054552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9bd3deee-2d05-42ce-bf58-dc3c2101de76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:52.059376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9bd3deee-2d05-42ce-bf58-dc3c2101de76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:52.073925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9bd3deee-2d05-42ce-bf58-dc3c2101de76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:52.074787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9bd3deee-2d05-42ce-bf58-dc3c2101de76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:52.079592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9bd3deee-2d05-42ce-bf58-dc3c2101de76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:52.080932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9bd3deee-2d05-42ce-bf58-dc3c2101de76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:52.081630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9bd3deee-2d05-42ce-bf58-dc3c2101de76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:52.083073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9bd3deee-2d05-42ce-bf58-dc3c2101de76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:52.155714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-50e76369-697b-45af-987d-4eb91623d50e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:52.167234 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-50e76369-697b-45af-987d-4eb91623d50e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1317 microversion: 2.1 time: 0.467020 Oct 27 18:56:52.170433 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1430/2761] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:51 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:52.183786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e4430c4-d0ed-402d-8112-f50af1fd7cb8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:52.185504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6e4430c4-d0ed-402d-8112-f50af1fd7cb8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:52.203898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e4430c4-d0ed-402d-8112-f50af1fd7cb8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:52.204481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e4430c4-d0ed-402d-8112-f50af1fd7cb8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:52.205006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e4430c4-d0ed-402d-8112-f50af1fd7cb8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:52.205978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e4430c4-d0ed-402d-8112-f50af1fd7cb8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:52.206496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e4430c4-d0ed-402d-8112-f50af1fd7cb8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:52.206943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e4430c4-d0ed-402d-8112-f50af1fd7cb8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:52.440378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:52.613932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6e4430c4-d0ed-402d-8112-f50af1fd7cb8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:52.622410 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6e4430c4-d0ed-402d-8112-f50af1fd7cb8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1504 microversion: 2.1 time: 0.450205 Oct 27 18:56:52.622922 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1431/2762] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:52 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1504 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:52.638177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1d0ece60-6c53-4d86-b570-755026406c82 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a0ce040>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:52.715505 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1d0ece60-6c53-4d86-b570-755026406c82 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1412 microversion: 2.1 time: 0.086267 Oct 27 18:56:52.716470 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1432/2763] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:56:52 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:52.729383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-2cc1c642-c8ef-4edc-b779-0aebaa4787a9 req-983c827f-1c0d-48fb-9548-68af09595dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d40282a5-ba3b-4bef-9ed2-49d45f1585aa", "tag": "86486bd5-2889-47b9-9283-710b1e959993"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:52.751626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2cc1c642-c8ef-4edc-b779-0aebaa4787a9 req-983c827f-1c0d-48fb-9548-68af09595dbe service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:52.755168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2cc1c642-c8ef-4edc-b779-0aebaa4787a9 req-983c827f-1c0d-48fb-9548-68af09595dbe service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:52.758073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2cc1c642-c8ef-4edc-b779-0aebaa4787a9 req-983c827f-1c0d-48fb-9548-68af09595dbe service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:52.782069 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-2cc1c642-c8ef-4edc-b779-0aebaa4787a9 req-983c827f-1c0d-48fb-9548-68af09595dbe service nova] Creating event network-changed:86486bd5-2889-47b9-9283-710b1e959993 for instance d40282a5-ba3b-4bef-9ed2-49d45f1585aa on n-h1-860687-3 Oct 27 18:56:52.819050 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-2cc1c642-c8ef-4edc-b779-0aebaa4787a9 req-983c827f-1c0d-48fb-9548-68af09595dbe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100974 Oct 27 18:56:52.825105 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1433/2764] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:52.834261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-654bff99-e879-4cac-8f07-d33e4ea05842 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:52.854702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-654bff99-e879-4cac-8f07-d33e4ea05842 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:52.876974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-654bff99-e879-4cac-8f07-d33e4ea05842 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:52.884105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-654bff99-e879-4cac-8f07-d33e4ea05842 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:52.885968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-654bff99-e879-4cac-8f07-d33e4ea05842 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:52.891216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-654bff99-e879-4cac-8f07-d33e4ea05842 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:52.895893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-654bff99-e879-4cac-8f07-d33e4ea05842 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:52.896571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-654bff99-e879-4cac-8f07-d33e4ea05842 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:53.005399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9bd3deee-2d05-42ce-bf58-dc3c2101de76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:53.016895 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9bd3deee-2d05-42ce-bf58-dc3c2101de76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1313 microversion: 2.1 time: 0.971175 Oct 27 18:56:53.017759 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1332/2765] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:52 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1313 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:53.035430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b2901711-adf4-4eba-8e2a-9599c21538db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:53.036433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b2901711-adf4-4eba-8e2a-9599c21538db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:53.043616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2901711-adf4-4eba-8e2a-9599c21538db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:53.049512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2901711-adf4-4eba-8e2a-9599c21538db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:53.063733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2901711-adf4-4eba-8e2a-9599c21538db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:53.064974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2901711-adf4-4eba-8e2a-9599c21538db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:53.065986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2901711-adf4-4eba-8e2a-9599c21538db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:53.066858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2901711-adf4-4eba-8e2a-9599c21538db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:53.193031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-654bff99-e879-4cac-8f07-d33e4ea05842 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aae47b58f94604a6d57bfc222ac6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03a92ab456f4b21964fd7ac2d277f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:53.201050 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-654bff99-e879-4cac-8f07-d33e4ea05842 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 200 len: 1317 microversion: 2.1 time: 0.370929 Oct 27 18:56:53.222091 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1434/2766] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:52 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:53.227079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-70dedc7f-c9d8-453e-b59b-02fa651b5c5c req-8763c1c2-c44a-4b01-8adc-3da750ab5b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a2f813e-a5e5-4146-a05c-ebf2f66d5c28", "name": "network-vif-plugged", "status": "completed", "tag": "d055e6c0-257b-49c3-8af8-8b0ef8ef1516"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:53.265878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-70dedc7f-c9d8-453e-b59b-02fa651b5c5c req-8763c1c2-c44a-4b01-8adc-3da750ab5b87 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:53.269362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-70dedc7f-c9d8-453e-b59b-02fa651b5c5c req-8763c1c2-c44a-4b01-8adc-3da750ab5b87 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:53.269867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-70dedc7f-c9d8-453e-b59b-02fa651b5c5c req-8763c1c2-c44a-4b01-8adc-3da750ab5b87 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:53.307995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b2901711-adf4-4eba-8e2a-9599c21538db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:53.310519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:53.313790 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-70dedc7f-c9d8-453e-b59b-02fa651b5c5c req-8763c1c2-c44a-4b01-8adc-3da750ab5b87 service nova] Creating event network-vif-plugged:d055e6c0-257b-49c3-8af8-8b0ef8ef1516 for instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 on n-h2-860687-3 Oct 27 18:56:53.322575 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b2901711-adf4-4eba-8e2a-9599c21538db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1528 microversion: 2.1 time: 0.299699 Oct 27 18:56:53.324925 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1333/2767] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:53 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1528 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:53.333489 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-70dedc7f-c9d8-453e-b59b-02fa651b5c5c req-8763c1c2-c44a-4b01-8adc-3da750ab5b87 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109961 Oct 27 18:56:53.338468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f4f8362b-e822-4d9b-b1b0-03883ee53ea3 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:53.339235 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1435/2768] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:53.344902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f4f8362b-e822-4d9b-b1b0-03883ee53ea3 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:53.354362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d728c50e-b28e-4460-aa88-e518a5c5db30 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:53.356633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4f8362b-e822-4d9b-b1b0-03883ee53ea3 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:53.357140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4f8362b-e822-4d9b-b1b0-03883ee53ea3 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:53.357591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4f8362b-e822-4d9b-b1b0-03883ee53ea3 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:53.358309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4f8362b-e822-4d9b-b1b0-03883ee53ea3 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:53.361180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4f8362b-e822-4d9b-b1b0-03883ee53ea3 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:53.363560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d728c50e-b28e-4460-aa88-e518a5c5db30 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:53.364440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4f8362b-e822-4d9b-b1b0-03883ee53ea3 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:53.385453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d728c50e-b28e-4460-aa88-e518a5c5db30 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:53.385955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d728c50e-b28e-4460-aa88-e518a5c5db30 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:53.386415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d728c50e-b28e-4460-aa88-e518a5c5db30 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:53.387148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d728c50e-b28e-4460-aa88-e518a5c5db30 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:53.387610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d728c50e-b28e-4460-aa88-e518a5c5db30 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:53.388043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d728c50e-b28e-4460-aa88-e518a5c5db30 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:53.658497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f4f8362b-e822-4d9b-b1b0-03883ee53ea3 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:53.674264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=14 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:53.684277 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f4f8362b-e822-4d9b-b1b0-03883ee53ea3 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1541 microversion: 2.1 time: 0.355160 Oct 27 18:56:53.686320 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1334/2769] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:53 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1541 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:53.698813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55d48f94-4eab-4d9b-bed8-5b76cba9edc4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:53.701930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-55d48f94-4eab-4d9b-bed8-5b76cba9edc4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:53.718135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55d48f94-4eab-4d9b-bed8-5b76cba9edc4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:53.719601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55d48f94-4eab-4d9b-bed8-5b76cba9edc4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:53.721656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55d48f94-4eab-4d9b-bed8-5b76cba9edc4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:53.724467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55d48f94-4eab-4d9b-bed8-5b76cba9edc4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:53.725140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55d48f94-4eab-4d9b-bed8-5b76cba9edc4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:53.727001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55d48f94-4eab-4d9b-bed8-5b76cba9edc4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:54.209053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-55d48f94-4eab-4d9b-bed8-5b76cba9edc4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:54.221473 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-55d48f94-4eab-4d9b-bed8-5b76cba9edc4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1504 microversion: 2.1 time: 0.533073 Oct 27 18:56:54.241834 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1335/2770] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:53 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:54.255383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c5b9e828-112f-4fd6-b11c-f182878d1702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:54.255976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c5b9e828-112f-4fd6-b11c-f182878d1702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:54.270168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5b9e828-112f-4fd6-b11c-f182878d1702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:54.270553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5b9e828-112f-4fd6-b11c-f182878d1702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:54.271007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5b9e828-112f-4fd6-b11c-f182878d1702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:54.271805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5b9e828-112f-4fd6-b11c-f182878d1702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:54.272181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5b9e828-112f-4fd6-b11c-f182878d1702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:54.277939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5b9e828-112f-4fd6-b11c-f182878d1702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:54.584814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d728c50e-b28e-4460-aa88-e518a5c5db30 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:54.585938 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c5b9e828-112f-4fd6-b11c-f182878d1702 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.331431 Oct 27 18:56:54.585938 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1336/2771] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 18:56:54 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09/os-interface => generated 284 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:54.588670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-733b7b3e-5848-4a65-ab2f-2cd5709fe376 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc869cce670>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:54.604121 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d728c50e-b28e-4460-aa88-e518a5c5db30 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1317 microversion: 2.1 time: 1.263493 Oct 27 18:56:54.605516 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1436/2772] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:53 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1317 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:54.630886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b8a3b812-03d7-47ea-b150-7746040a8bfb tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:54.632058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b8a3b812-03d7-47ea-b150-7746040a8bfb tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:54.655267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8a3b812-03d7-47ea-b150-7746040a8bfb tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:54.657567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8a3b812-03d7-47ea-b150-7746040a8bfb tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:54.659481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8a3b812-03d7-47ea-b150-7746040a8bfb tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:54.660489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8a3b812-03d7-47ea-b150-7746040a8bfb tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:54.661125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8a3b812-03d7-47ea-b150-7746040a8bfb tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:54.662507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8a3b812-03d7-47ea-b150-7746040a8bfb tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:56.409720 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-733b7b3e-5848-4a65-ab2f-2cd5709fe376 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1412 microversion: 2.1 time: 1.832236 Oct 27 18:56:56.414779 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1337/2773] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:56:54 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1412 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:56.432518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-27699000-0485-4258-9a7a-709503f5648e tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:56.434701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-27699000-0485-4258-9a7a-709503f5648e tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:56.446758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27699000-0485-4258-9a7a-709503f5648e tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:56.449125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27699000-0485-4258-9a7a-709503f5648e tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:56.450834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27699000-0485-4258-9a7a-709503f5648e tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:56.452690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27699000-0485-4258-9a7a-709503f5648e tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:56.454295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27699000-0485-4258-9a7a-709503f5648e tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:56.455077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27699000-0485-4258-9a7a-709503f5648e tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:56.506408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b8a3b812-03d7-47ea-b150-7746040a8bfb tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:56.520253 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b8a3b812-03d7-47ea-b150-7746040a8bfb tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1313 microversion: 2.1 time: 1.913235 Oct 27 18:56:56.524090 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1437/2774] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:54 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1313 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:56.534888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1fc27b09-a75b-45f1-9c38-9ec90582402f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:56.537683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1fc27b09-a75b-45f1-9c38-9ec90582402f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:56.553260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fc27b09-a75b-45f1-9c38-9ec90582402f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:56.554821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fc27b09-a75b-45f1-9c38-9ec90582402f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:56.566378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fc27b09-a75b-45f1-9c38-9ec90582402f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:56.568285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fc27b09-a75b-45f1-9c38-9ec90582402f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:56.569035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fc27b09-a75b-45f1-9c38-9ec90582402f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:56.569723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fc27b09-a75b-45f1-9c38-9ec90582402f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:56.900596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1fc27b09-a75b-45f1-9c38-9ec90582402f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:56.910983 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1fc27b09-a75b-45f1-9c38-9ec90582402f tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1528 microversion: 2.1 time: 0.383684 Oct 27 18:56:56.930478 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1438/2775] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:56 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1528 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:56.940858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6a7ce99c-3337-41dd-944a-9625204f3958 req-64688a5b-34d4-467b-823b-43f73c348541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eff0154-2475-4b5b-8c32-0b2ffb3481cf", "name": "network-vif-unplugged", "status": "completed", "tag": "35e4fff4-8327-4345-bb97-8dfe37b06d07"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:56.961322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6a7ce99c-3337-41dd-944a-9625204f3958 req-64688a5b-34d4-467b-823b-43f73c348541 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:56.962016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6a7ce99c-3337-41dd-944a-9625204f3958 req-64688a5b-34d4-467b-823b-43f73c348541 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:56.963246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6a7ce99c-3337-41dd-944a-9625204f3958 req-64688a5b-34d4-467b-823b-43f73c348541 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:56.979224 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6a7ce99c-3337-41dd-944a-9625204f3958 req-64688a5b-34d4-467b-823b-43f73c348541 service nova] Creating event network-vif-unplugged:35e4fff4-8327-4345-bb97-8dfe37b06d07 for instance 1eff0154-2475-4b5b-8c32-0b2ffb3481cf on n-h1-860687-3 Oct 27 18:56:56.985533 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6a7ce99c-3337-41dd-944a-9625204f3958 req-64688a5b-34d4-467b-823b-43f73c348541 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052895 Oct 27 18:56:56.987086 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1439/2776] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:56.992694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0223b7de-df3e-4872-9cbb-f87c780bc1a9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:56.993707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0223b7de-df3e-4872-9cbb-f87c780bc1a9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:57.001937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0223b7de-df3e-4872-9cbb-f87c780bc1a9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:57.002718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0223b7de-df3e-4872-9cbb-f87c780bc1a9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:57.003386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0223b7de-df3e-4872-9cbb-f87c780bc1a9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:57.004346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0223b7de-df3e-4872-9cbb-f87c780bc1a9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:57.005041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0223b7de-df3e-4872-9cbb-f87c780bc1a9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:57.005687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0223b7de-df3e-4872-9cbb-f87c780bc1a9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:57.516122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-27699000-0485-4258-9a7a-709503f5648e tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aae47b58f94604a6d57bfc222ac6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03a92ab456f4b21964fd7ac2d277f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:57.526249 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-27699000-0485-4258-9a7a-709503f5648e tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 200 len: 1317 microversion: 2.1 time: 1.110388 Oct 27 18:56:57.533755 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1338/2777] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:56 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 1317 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:57.558626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9a619aca-aa4d-4766-b221-8c70d26b24c8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:57.568188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9a619aca-aa4d-4766-b221-8c70d26b24c8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:57.595988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a619aca-aa4d-4766-b221-8c70d26b24c8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:57.605466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a619aca-aa4d-4766-b221-8c70d26b24c8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:57.606277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a619aca-aa4d-4766-b221-8c70d26b24c8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:57.610216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a619aca-aa4d-4766-b221-8c70d26b24c8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:57.613641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a619aca-aa4d-4766-b221-8c70d26b24c8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:57.616769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a619aca-aa4d-4766-b221-8c70d26b24c8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:57.723116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0223b7de-df3e-4872-9cbb-f87c780bc1a9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:57.736822 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0223b7de-df3e-4872-9cbb-f87c780bc1a9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1504 microversion: 2.1 time: 0.745898 Oct 27 18:56:57.740841 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1440/2778] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:56 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1504 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:57.751523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e289df5b-55ad-4100-b266-1d1ca9b56dc4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a0920d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:57.833241 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e289df5b-55ad-4100-b266-1d1ca9b56dc4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1412 microversion: 2.1 time: 0.090989 Oct 27 18:56:57.835348 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1441/2779] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:56:57 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:57.853604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9eab920a-8b63-4a7f-a1f0-0078331aa088 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:57.854696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9eab920a-8b63-4a7f-a1f0-0078331aa088 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:57.871583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9eab920a-8b63-4a7f-a1f0-0078331aa088 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:57.872663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9eab920a-8b63-4a7f-a1f0-0078331aa088 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:57.873109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9eab920a-8b63-4a7f-a1f0-0078331aa088 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:57.875527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9eab920a-8b63-4a7f-a1f0-0078331aa088 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:57.876020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9eab920a-8b63-4a7f-a1f0-0078331aa088 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:57.876462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9eab920a-8b63-4a7f-a1f0-0078331aa088 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:58.214071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9a619aca-aa4d-4766-b221-8c70d26b24c8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:58.227148 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9a619aca-aa4d-4766-b221-8c70d26b24c8 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1317 microversion: 2.1 time: 0.689597 Oct 27 18:56:58.228069 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1339/2780] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:57 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1317 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:58.237529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ca90797-abbf-4122-b6ce-f9a2385703db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:58.240851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ca90797-abbf-4122-b6ce-f9a2385703db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:58.261167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ca90797-abbf-4122-b6ce-f9a2385703db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:58.261961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ca90797-abbf-4122-b6ce-f9a2385703db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:58.262754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ca90797-abbf-4122-b6ce-f9a2385703db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:58.263668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ca90797-abbf-4122-b6ce-f9a2385703db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:58.264309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ca90797-abbf-4122-b6ce-f9a2385703db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:58.267218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ca90797-abbf-4122-b6ce-f9a2385703db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:58.497097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9eab920a-8b63-4a7f-a1f0-0078331aa088 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:58.527609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:56:58.548976 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9eab920a-8b63-4a7f-a1f0-0078331aa088 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1313 microversion: 2.1 time: 0.708384 Oct 27 18:56:58.566536 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1442/2781] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:57 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:58.589938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-362943b3-4082-452d-ac4a-d3161179c28d req-2de8def4-8afc-47f1-98bd-011d1d5e33da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f3d0be-dedd-4dd1-8b00-9f81d24b957a", "name": "network-vif-plugged", "status": "completed", "tag": "024b1ff9-2a5f-41df-b730-9c3b28e617ff"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:58.629704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-362943b3-4082-452d-ac4a-d3161179c28d req-2de8def4-8afc-47f1-98bd-011d1d5e33da service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:58.630551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-362943b3-4082-452d-ac4a-d3161179c28d req-2de8def4-8afc-47f1-98bd-011d1d5e33da service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:58.631999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9ca90797-abbf-4122-b6ce-f9a2385703db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:58.633118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-362943b3-4082-452d-ac4a-d3161179c28d req-2de8def4-8afc-47f1-98bd-011d1d5e33da service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:58.640321 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ca90797-abbf-4122-b6ce-f9a2385703db tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1510 microversion: 2.1 time: 0.411195 Oct 27 18:56:58.641564 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1340/2782] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:58 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1510 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:58.655153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1b8b6f76-7a13-4eb8-a128-3bcbc5874165 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:58.661905 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-362943b3-4082-452d-ac4a-d3161179c28d req-2de8def4-8afc-47f1-98bd-011d1d5e33da service nova] Creating event network-vif-plugged:024b1ff9-2a5f-41df-b730-9c3b28e617ff for instance e9f3d0be-dedd-4dd1-8b00-9f81d24b957a on n-h1-860687-3 Oct 27 18:56:58.666634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1b8b6f76-7a13-4eb8-a128-3bcbc5874165 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:58.677608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b8b6f76-7a13-4eb8-a128-3bcbc5874165 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:58.678439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b8b6f76-7a13-4eb8-a128-3bcbc5874165 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:58.679069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b8b6f76-7a13-4eb8-a128-3bcbc5874165 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:58.681645 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-362943b3-4082-452d-ac4a-d3161179c28d req-2de8def4-8afc-47f1-98bd-011d1d5e33da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112058 Oct 27 18:56:58.682713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b8b6f76-7a13-4eb8-a128-3bcbc5874165 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:58.683403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b8b6f76-7a13-4eb8-a128-3bcbc5874165 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:58.684040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b8b6f76-7a13-4eb8-a128-3bcbc5874165 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:58.685008 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1443/2783] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:58.774816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-05bee476-b9fc-450d-b831-89b3c8b333ea tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:58.775529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-05bee476-b9fc-450d-b831-89b3c8b333ea tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:58.802024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05bee476-b9fc-450d-b831-89b3c8b333ea tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:58.804066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05bee476-b9fc-450d-b831-89b3c8b333ea tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:58.805681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05bee476-b9fc-450d-b831-89b3c8b333ea tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:58.806525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05bee476-b9fc-450d-b831-89b3c8b333ea tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:58.808296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05bee476-b9fc-450d-b831-89b3c8b333ea tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:58.811379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05bee476-b9fc-450d-b831-89b3c8b333ea tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:59.138235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-05bee476-b9fc-450d-b831-89b3c8b333ea tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:59.152132 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-05bee476-b9fc-450d-b831-89b3c8b333ea tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1504 microversion: 2.1 time: 0.389257 Oct 27 18:56:59.156614 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1444/2784] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:58 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:59.167344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-69042775-e8b3-492a-8453-b4dcd5f746a3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a040af0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:59.256609 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-69042775-e8b3-492a-8453-b4dcd5f746a3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1412 microversion: 2.1 time: 0.095947 Oct 27 18:56:59.257932 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1445/2785] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:56:59 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:59.263399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-40e7c60a-0315-4d48-8fc2-85a767f063a5 req-4c03a9be-a1ae-4ea9-9b07-506614d18fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403ad40f-7a7d-4be1-b1c2-16f91dd36e09", "tag": "76e19a54-ac3a-4d4d-b981-0958c1f79d34"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:59.310211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-40e7c60a-0315-4d48-8fc2-85a767f063a5 req-4c03a9be-a1ae-4ea9-9b07-506614d18fd6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:59.311016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-40e7c60a-0315-4d48-8fc2-85a767f063a5 req-4c03a9be-a1ae-4ea9-9b07-506614d18fd6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:59.311623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-40e7c60a-0315-4d48-8fc2-85a767f063a5 req-4c03a9be-a1ae-4ea9-9b07-506614d18fd6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:59.334767 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-40e7c60a-0315-4d48-8fc2-85a767f063a5 req-4c03a9be-a1ae-4ea9-9b07-506614d18fd6 service nova] Creating event network-changed:76e19a54-ac3a-4d4d-b981-0958c1f79d34 for instance 403ad40f-7a7d-4be1-b1c2-16f91dd36e09 on n-h2-860687-3 Oct 27 18:56:59.351629 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-40e7c60a-0315-4d48-8fc2-85a767f063a5 req-4c03a9be-a1ae-4ea9-9b07-506614d18fd6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092166 Oct 27 18:56:59.356677 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1446/2786] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:59.384112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-fe4b8e5c-671b-4985-8039-3adf62ae85c1 req-8c5e9174-0368-483b-8b15-639a9e8a7813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eff0154-2475-4b5b-8c32-0b2ffb3481cf", "tag": "35e4fff4-8327-4345-bb97-8dfe37b06d07"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:56:59.409088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fe4b8e5c-671b-4985-8039-3adf62ae85c1 req-8c5e9174-0368-483b-8b15-639a9e8a7813 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:59.412665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fe4b8e5c-671b-4985-8039-3adf62ae85c1 req-8c5e9174-0368-483b-8b15-639a9e8a7813 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:59.413299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fe4b8e5c-671b-4985-8039-3adf62ae85c1 req-8c5e9174-0368-483b-8b15-639a9e8a7813 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:59.433643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1b8b6f76-7a13-4eb8-a128-3bcbc5874165 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aae47b58f94604a6d57bfc222ac6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03a92ab456f4b21964fd7ac2d277f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:56:59.472956 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1b8b6f76-7a13-4eb8-a128-3bcbc5874165 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 200 len: 1317 microversion: 2.1 time: 0.830322 Oct 27 18:56:59.473392 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-fe4b8e5c-671b-4985-8039-3adf62ae85c1 req-8c5e9174-0368-483b-8b15-639a9e8a7813 service nova] Creating event network-changed:35e4fff4-8327-4345-bb97-8dfe37b06d07 for instance 1eff0154-2475-4b5b-8c32-0b2ffb3481cf on n-h1-860687-3 Oct 27 18:56:59.473910 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1341/2787] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:58 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:56:59.478530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-705a6faa-a038-489f-9d68-70fc67ea683e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:59.479152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-705a6faa-a038-489f-9d68-70fc67ea683e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:59.495010 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-fe4b8e5c-671b-4985-8039-3adf62ae85c1 req-8c5e9174-0368-483b-8b15-639a9e8a7813 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126092 Oct 27 18:56:59.498218 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1447/2788] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:56:59.524134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-705a6faa-a038-489f-9d68-70fc67ea683e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:59.524653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-705a6faa-a038-489f-9d68-70fc67ea683e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:59.525110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-705a6faa-a038-489f-9d68-70fc67ea683e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:59.525835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-705a6faa-a038-489f-9d68-70fc67ea683e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:59.526302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-705a6faa-a038-489f-9d68-70fc67ea683e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:59.535018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-705a6faa-a038-489f-9d68-70fc67ea683e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:59.574444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae2af7c7-bfb5-4cb9-953a-0686dfdacc20 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:56:59.575628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ae2af7c7-bfb5-4cb9-953a-0686dfdacc20 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:56:59.589669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae2af7c7-bfb5-4cb9-953a-0686dfdacc20 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:59.590597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae2af7c7-bfb5-4cb9-953a-0686dfdacc20 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:59.593813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae2af7c7-bfb5-4cb9-953a-0686dfdacc20 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:56:59.597602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae2af7c7-bfb5-4cb9-953a-0686dfdacc20 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:56:59.598476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae2af7c7-bfb5-4cb9-953a-0686dfdacc20 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:56:59.599176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae2af7c7-bfb5-4cb9-953a-0686dfdacc20 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:00.102575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ae2af7c7-bfb5-4cb9-953a-0686dfdacc20 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:00.118530 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ae2af7c7-bfb5-4cb9-953a-0686dfdacc20 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1313 microversion: 2.1 time: 0.544220 Oct 27 18:57:00.120162 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1448/2789] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:59 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1313 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:00.132925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0fbc8186-29e4-4b5d-8796-a3e35c587794 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:00.135321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0fbc8186-29e4-4b5d-8796-a3e35c587794 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:00.151637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fbc8186-29e4-4b5d-8796-a3e35c587794 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:00.154028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fbc8186-29e4-4b5d-8796-a3e35c587794 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:00.167410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fbc8186-29e4-4b5d-8796-a3e35c587794 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:00.168951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fbc8186-29e4-4b5d-8796-a3e35c587794 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:00.170097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fbc8186-29e4-4b5d-8796-a3e35c587794 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:00.170879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fbc8186-29e4-4b5d-8796-a3e35c587794 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:00.473631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-705a6faa-a038-489f-9d68-70fc67ea683e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:00.481760 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-705a6faa-a038-489f-9d68-70fc67ea683e tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1317 microversion: 2.1 time: 1.006719 Oct 27 18:57:00.486242 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1342/2790] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:56:59 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1317 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:00.491353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9a927604-31ae-489f-b95f-a24223edcfc1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:00.494933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9a927604-31ae-489f-b95f-a24223edcfc1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:00.510946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a927604-31ae-489f-b95f-a24223edcfc1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:00.511879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a927604-31ae-489f-b95f-a24223edcfc1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:00.512573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a927604-31ae-489f-b95f-a24223edcfc1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:00.513534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a927604-31ae-489f-b95f-a24223edcfc1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:00.516299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a927604-31ae-489f-b95f-a24223edcfc1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:00.517061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a927604-31ae-489f-b95f-a24223edcfc1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:00.715972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0fbc8186-29e4-4b5d-8796-a3e35c587794 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:00.736589 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0fbc8186-29e4-4b5d-8796-a3e35c587794 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1510 microversion: 2.1 time: 0.613459 Oct 27 18:57:00.751056 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1449/2791] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:00 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1510 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:00.761335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d797db3b-dbdb-4aeb-b7c1-73e94c9c7af3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a0eb5e0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:00.847072 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d797db3b-dbdb-4aeb-b7c1-73e94c9c7af3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1412 microversion: 2.1 time: 0.093814 Oct 27 18:57:00.851232 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1450/2792] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:00 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:00.867147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-940f58c6-7123-4887-a97a-65b56243c803 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:00.867789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-940f58c6-7123-4887-a97a-65b56243c803 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:00.894544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-940f58c6-7123-4887-a97a-65b56243c803 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:00.895110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-940f58c6-7123-4887-a97a-65b56243c803 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:00.895576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-940f58c6-7123-4887-a97a-65b56243c803 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:00.896334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-940f58c6-7123-4887-a97a-65b56243c803 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:00.898828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-940f58c6-7123-4887-a97a-65b56243c803 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:00.899296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-940f58c6-7123-4887-a97a-65b56243c803 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:01.154050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9a927604-31ae-489f-b95f-a24223edcfc1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:01.170512 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9a927604-31ae-489f-b95f-a24223edcfc1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1504 microversion: 2.1 time: 0.675888 Oct 27 18:57:01.172067 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1343/2793] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:00 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1504 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:01.180938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c5c35ce8-f0db-4f77-9f2f-f3f246e57e30 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:01.182028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c5c35ce8-f0db-4f77-9f2f-f3f246e57e30 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:01.195306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5c35ce8-f0db-4f77-9f2f-f3f246e57e30 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:01.200622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5c35ce8-f0db-4f77-9f2f-f3f246e57e30 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:01.201101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5c35ce8-f0db-4f77-9f2f-f3f246e57e30 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:01.202221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5c35ce8-f0db-4f77-9f2f-f3f246e57e30 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:01.206946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5c35ce8-f0db-4f77-9f2f-f3f246e57e30 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:01.207618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5c35ce8-f0db-4f77-9f2f-f3f246e57e30 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:01.363601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-940f58c6-7123-4887-a97a-65b56243c803 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aae47b58f94604a6d57bfc222ac6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03a92ab456f4b21964fd7ac2d277f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:01.380794 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-940f58c6-7123-4887-a97a-65b56243c803 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 200 len: 1317 microversion: 2.1 time: 0.528396 Oct 27 18:57:01.381373 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1451/2794] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:00 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:01.386161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6418fd45-6c3e-4274-ae27-6eb2e1d9b341 req-6bb63ebd-098c-4679-9ae6-c1453e0fdb78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e311e1-6dd0-4498-897c-c92ce762d9b9", "name": "network-vif-unplugged", "status": "completed", "tag": "5e0a3a4e-0c02-4bfb-b6c9-0aefa83bc658"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:01.410080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6418fd45-6c3e-4274-ae27-6eb2e1d9b341 req-6bb63ebd-098c-4679-9ae6-c1453e0fdb78 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:01.410976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6418fd45-6c3e-4274-ae27-6eb2e1d9b341 req-6bb63ebd-098c-4679-9ae6-c1453e0fdb78 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:01.411431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6418fd45-6c3e-4274-ae27-6eb2e1d9b341 req-6bb63ebd-098c-4679-9ae6-c1453e0fdb78 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:01.433508 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6418fd45-6c3e-4274-ae27-6eb2e1d9b341 req-6bb63ebd-098c-4679-9ae6-c1453e0fdb78 service nova] Creating event network-vif-unplugged:5e0a3a4e-0c02-4bfb-b6c9-0aefa83bc658 for instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 on n-h2-860687-3 Oct 27 18:57:01.452359 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6418fd45-6c3e-4274-ae27-6eb2e1d9b341 req-6bb63ebd-098c-4679-9ae6-c1453e0fdb78 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069468 Oct 27 18:57:01.453380 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1452/2795] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:01.510903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0f31bc2f-e7a0-46c0-bff2-6b8cbb307efb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:01.514430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0f31bc2f-e7a0-46c0-bff2-6b8cbb307efb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:01.534601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f31bc2f-e7a0-46c0-bff2-6b8cbb307efb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:01.535455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f31bc2f-e7a0-46c0-bff2-6b8cbb307efb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:01.537489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f31bc2f-e7a0-46c0-bff2-6b8cbb307efb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:01.538472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f31bc2f-e7a0-46c0-bff2-6b8cbb307efb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:01.542264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f31bc2f-e7a0-46c0-bff2-6b8cbb307efb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:01.543421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f31bc2f-e7a0-46c0-bff2-6b8cbb307efb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:01.779189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c5c35ce8-f0db-4f77-9f2f-f3f246e57e30 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:01.792105 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c5c35ce8-f0db-4f77-9f2f-f3f246e57e30 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1313 microversion: 2.1 time: 0.614728 Oct 27 18:57:01.794805 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1344/2796] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:01 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:01.811276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0f31bc2f-e7a0-46c0-bff2-6b8cbb307efb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:01.820999 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0f31bc2f-e7a0-46c0-bff2-6b8cbb307efb tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1507 microversion: 2.1 time: 0.316141 Oct 27 18:57:01.823834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-96ba5903-cda8-4d44-b56d-aa35c795302b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:01.825937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-96ba5903-cda8-4d44-b56d-aa35c795302b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:01.826597 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1453/2797] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:01 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1507 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:01.839845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96ba5903-cda8-4d44-b56d-aa35c795302b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:01.840431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96ba5903-cda8-4d44-b56d-aa35c795302b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:01.840956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96ba5903-cda8-4d44-b56d-aa35c795302b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:01.844100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96ba5903-cda8-4d44-b56d-aa35c795302b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:01.846787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96ba5903-cda8-4d44-b56d-aa35c795302b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:01.847341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96ba5903-cda8-4d44-b56d-aa35c795302b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:01.857832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d30fab4-8327-47f3-80fe-370dd630ea25 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:01.861306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0d30fab4-8327-47f3-80fe-370dd630ea25 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:01.869569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d30fab4-8327-47f3-80fe-370dd630ea25 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:01.872354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d30fab4-8327-47f3-80fe-370dd630ea25 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:01.879475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d30fab4-8327-47f3-80fe-370dd630ea25 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:01.880547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d30fab4-8327-47f3-80fe-370dd630ea25 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:01.881225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d30fab4-8327-47f3-80fe-370dd630ea25 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:01.882014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d30fab4-8327-47f3-80fe-370dd630ea25 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:02.161677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0d30fab4-8327-47f3-80fe-370dd630ea25 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:02.170211 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0d30fab4-8327-47f3-80fe-370dd630ea25 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1507 microversion: 2.1 time: 0.316891 Oct 27 18:57:02.172453 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1454/2798] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:01 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1507 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:02.178044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f49f7bc2-e398-421d-9bcc-52155c08f05e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a092700>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:02.262705 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f49f7bc2-e398-421d-9bcc-52155c08f05e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1412 microversion: 2.1 time: 0.088367 Oct 27 18:57:02.263757 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1455/2799] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:02 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1412 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:02.273785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-df08ae09-9088-40cd-a4a3-c3ef435d6444 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:02.275612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-df08ae09-9088-40cd-a4a3-c3ef435d6444 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:02.300668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df08ae09-9088-40cd-a4a3-c3ef435d6444 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:02.321268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df08ae09-9088-40cd-a4a3-c3ef435d6444 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:02.321820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df08ae09-9088-40cd-a4a3-c3ef435d6444 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:02.333883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df08ae09-9088-40cd-a4a3-c3ef435d6444 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:02.334571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df08ae09-9088-40cd-a4a3-c3ef435d6444 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:02.335062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df08ae09-9088-40cd-a4a3-c3ef435d6444 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:02.499466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-96ba5903-cda8-4d44-b56d-aa35c795302b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:02.510944 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-96ba5903-cda8-4d44-b56d-aa35c795302b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1510 microversion: 2.1 time: 0.693547 Oct 27 18:57:02.514690 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1345/2800] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:01 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1510 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:02.529060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-67d88d8e-6875-4944-bf3d-4301fd3e23da tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:02.543522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-67d88d8e-6875-4944-bf3d-4301fd3e23da tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:02.545641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:02.562187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67d88d8e-6875-4944-bf3d-4301fd3e23da tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:02.563429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67d88d8e-6875-4944-bf3d-4301fd3e23da tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:02.563887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67d88d8e-6875-4944-bf3d-4301fd3e23da tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:02.564613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67d88d8e-6875-4944-bf3d-4301fd3e23da tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:02.565276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67d88d8e-6875-4944-bf3d-4301fd3e23da tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:02.565713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67d88d8e-6875-4944-bf3d-4301fd3e23da tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:02.691211 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-67d88d8e-6875-4944-bf3d-4301fd3e23da tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "PUT /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1079 microversion: 2.1 time: 0.172214 Oct 27 18:57:02.692464 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1346/2801] 10.222.0.42 () {60 vars in 1256 bytes} [Thu Oct 27 18:57:02 2022] PUT /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1079 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:02.697472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c6714a7d-edcd-4a05-9f5b-0252c4f1abc4 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:02.698516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c6714a7d-edcd-4a05-9f5b-0252c4f1abc4 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:02.706000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6714a7d-edcd-4a05-9f5b-0252c4f1abc4 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:02.706798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6714a7d-edcd-4a05-9f5b-0252c4f1abc4 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:02.707415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6714a7d-edcd-4a05-9f5b-0252c4f1abc4 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:02.708294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6714a7d-edcd-4a05-9f5b-0252c4f1abc4 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:02.709248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6714a7d-edcd-4a05-9f5b-0252c4f1abc4 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:02.709847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6714a7d-edcd-4a05-9f5b-0252c4f1abc4 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:02.994825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c6714a7d-edcd-4a05-9f5b-0252c4f1abc4 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aae47b58f94604a6d57bfc222ac6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03a92ab456f4b21964fd7ac2d277f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:03.005667 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c6714a7d-edcd-4a05-9f5b-0252c4f1abc4 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 200 len: 1317 microversion: 2.1 time: 0.311951 Oct 27 18:57:03.010724 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1347/2802] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:02 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:03.019974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-31c860ab-3b73-46f1-90a7-9fa989ad4928 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:03.021588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-31c860ab-3b73-46f1-90a7-9fa989ad4928 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:03.036905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31c860ab-3b73-46f1-90a7-9fa989ad4928 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:03.040606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31c860ab-3b73-46f1-90a7-9fa989ad4928 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:03.041334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31c860ab-3b73-46f1-90a7-9fa989ad4928 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:03.042276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31c860ab-3b73-46f1-90a7-9fa989ad4928 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:03.051157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31c860ab-3b73-46f1-90a7-9fa989ad4928 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:03.051830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31c860ab-3b73-46f1-90a7-9fa989ad4928 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:03.053293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-df08ae09-9088-40cd-a4a3-c3ef435d6444 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:03.065253 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-df08ae09-9088-40cd-a4a3-c3ef435d6444 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1504 microversion: 2.1 time: 0.800242 Oct 27 18:57:03.082766 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1456/2803] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:02 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1504 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:03.089968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dbddfd99-3d97-4bbe-8e86-d830b55b4000 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:03.091042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dbddfd99-3d97-4bbe-8e86-d830b55b4000 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:03.101096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbddfd99-3d97-4bbe-8e86-d830b55b4000 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:03.101963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbddfd99-3d97-4bbe-8e86-d830b55b4000 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:03.103436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbddfd99-3d97-4bbe-8e86-d830b55b4000 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:03.104396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbddfd99-3d97-4bbe-8e86-d830b55b4000 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:03.105105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbddfd99-3d97-4bbe-8e86-d830b55b4000 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:03.105765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbddfd99-3d97-4bbe-8e86-d830b55b4000 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:03.324659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dbddfd99-3d97-4bbe-8e86-d830b55b4000 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:03.334038 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dbddfd99-3d97-4bbe-8e86-d830b55b4000 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1313 microversion: 2.1 time: 0.249219 Oct 27 18:57:03.350705 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1457/2804] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:03 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:03.359837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4fe1fbcd-52de-4068-abd1-c5e11ed4e8a9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a0eb3a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:03.436748 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4fe1fbcd-52de-4068-abd1-c5e11ed4e8a9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1412 microversion: 2.1 time: 0.081761 Oct 27 18:57:03.440406 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1458/2805] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:03 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:03.476851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-55480161-cf22-4c08-9c95-9510086f65b1 req-96d9f411-a704-49e3-8a0f-48ffcb1f3a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603", "name": "network-vif-plugged", "status": "completed", "tag": "015c923b-1253-4901-8696-2b913942b5c7"}, {"server_uuid": "d40282a5-ba3b-4bef-9ed2-49d45f1585aa", "name": "network-vif-plugged", "status": "completed", "tag": "86486bd5-2889-47b9-9283-710b1e959993"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:03.493982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-55480161-cf22-4c08-9c95-9510086f65b1 req-96d9f411-a704-49e3-8a0f-48ffcb1f3a26 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:03.494713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-55480161-cf22-4c08-9c95-9510086f65b1 req-96d9f411-a704-49e3-8a0f-48ffcb1f3a26 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:03.495340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-55480161-cf22-4c08-9c95-9510086f65b1 req-96d9f411-a704-49e3-8a0f-48ffcb1f3a26 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:03.513811 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-55480161-cf22-4c08-9c95-9510086f65b1 req-96d9f411-a704-49e3-8a0f-48ffcb1f3a26 service nova] Creating event network-vif-plugged:015c923b-1253-4901-8696-2b913942b5c7 for instance 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 on n-h1-860687-3 Oct 27 18:57:03.514707 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-55480161-cf22-4c08-9c95-9510086f65b1 req-96d9f411-a704-49e3-8a0f-48ffcb1f3a26 service nova] Creating event network-vif-plugged:86486bd5-2889-47b9-9283-710b1e959993 for instance d40282a5-ba3b-4bef-9ed2-49d45f1585aa on n-h1-860687-3 Oct 27 18:57:03.522548 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-55480161-cf22-4c08-9c95-9510086f65b1 req-96d9f411-a704-49e3-8a0f-48ffcb1f3a26 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049530 Oct 27 18:57:03.524075 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1459/2806] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:03.539385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-baa055ea-0c50-49c9-8331-e4d9e4c8b5c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:03.540339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-baa055ea-0c50-49c9-8331-e4d9e4c8b5c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:03.548165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baa055ea-0c50-49c9-8331-e4d9e4c8b5c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:03.548932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baa055ea-0c50-49c9-8331-e4d9e4c8b5c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:03.549591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baa055ea-0c50-49c9-8331-e4d9e4c8b5c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:03.550535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baa055ea-0c50-49c9-8331-e4d9e4c8b5c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:03.551200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baa055ea-0c50-49c9-8331-e4d9e4c8b5c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:03.551824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baa055ea-0c50-49c9-8331-e4d9e4c8b5c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:03.629917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-31c860ab-3b73-46f1-90a7-9fa989ad4928 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:03.638273 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-31c860ab-3b73-46f1-90a7-9fa989ad4928 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1505 microversion: 2.1 time: 0.626129 Oct 27 18:57:03.638906 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1348/2807] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:03 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1505 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:03.666628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-edfca760-c8d0-42cb-9fa4-2d3b93892341 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:03.667214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-edfca760-c8d0-42cb-9fa4-2d3b93892341 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:03.689236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edfca760-c8d0-42cb-9fa4-2d3b93892341 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:03.692924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edfca760-c8d0-42cb-9fa4-2d3b93892341 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:03.697292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edfca760-c8d0-42cb-9fa4-2d3b93892341 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:03.704893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edfca760-c8d0-42cb-9fa4-2d3b93892341 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:03.707062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edfca760-c8d0-42cb-9fa4-2d3b93892341 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:03.707573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edfca760-c8d0-42cb-9fa4-2d3b93892341 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:03.875476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-baa055ea-0c50-49c9-8331-e4d9e4c8b5c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:03.891060 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-baa055ea-0c50-49c9-8331-e4d9e4c8b5c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1453 microversion: 2.1 time: 0.356501 Oct 27 18:57:03.907037 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1460/2808] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:03 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1453 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:03.918960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-10a8cbaa-1568-4f8d-9ea8-002fe104a453 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:03.923181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-10a8cbaa-1568-4f8d-9ea8-002fe104a453 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:03.939889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10a8cbaa-1568-4f8d-9ea8-002fe104a453 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:03.940800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10a8cbaa-1568-4f8d-9ea8-002fe104a453 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:03.941470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10a8cbaa-1568-4f8d-9ea8-002fe104a453 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:03.942418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10a8cbaa-1568-4f8d-9ea8-002fe104a453 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:03.943095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10a8cbaa-1568-4f8d-9ea8-002fe104a453 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:03.943624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10a8cbaa-1568-4f8d-9ea8-002fe104a453 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:04.189105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-10a8cbaa-1568-4f8d-9ea8-002fe104a453 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:04.199423 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-10a8cbaa-1568-4f8d-9ea8-002fe104a453 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1453 microversion: 2.1 time: 0.284350 Oct 27 18:57:04.200724 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1461/2809] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:03 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1453 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:04.206637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-24e5941d-8437-44b8-ac5e-f4ade4e8e3bc tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:04.207653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-24e5941d-8437-44b8-ac5e-f4ade4e8e3bc tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:04.214201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24e5941d-8437-44b8-ac5e-f4ade4e8e3bc tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:04.214834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24e5941d-8437-44b8-ac5e-f4ade4e8e3bc tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:04.215505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24e5941d-8437-44b8-ac5e-f4ade4e8e3bc tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:04.216496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24e5941d-8437-44b8-ac5e-f4ade4e8e3bc tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:04.217360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24e5941d-8437-44b8-ac5e-f4ade4e8e3bc tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:04.218166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24e5941d-8437-44b8-ac5e-f4ade4e8e3bc tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:04.376954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-edfca760-c8d0-42cb-9fa4-2d3b93892341 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:04.387083 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-edfca760-c8d0-42cb-9fa4-2d3b93892341 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1505 microversion: 2.1 time: 0.727244 Oct 27 18:57:04.390180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-24e5941d-8437-44b8-ac5e-f4ade4e8e3bc tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aae47b58f94604a6d57bfc222ac6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03a92ab456f4b21964fd7ac2d277f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:04.391876 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1349/2810] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:03 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1505 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:04.398439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-839600cb-af81-4738-aa22-5f76c2b40a5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:04.411309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-839600cb-af81-4738-aa22-5f76c2b40a5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:04.416885 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-24e5941d-8437-44b8-ac5e-f4ade4e8e3bc tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 200 len: 1317 microversion: 2.1 time: 0.214566 Oct 27 18:57:04.418286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-839600cb-af81-4738-aa22-5f76c2b40a5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:04.418821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-839600cb-af81-4738-aa22-5f76c2b40a5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:04.418976 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1462/2811] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:04 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:04.419446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-839600cb-af81-4738-aa22-5f76c2b40a5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:04.420178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-839600cb-af81-4738-aa22-5f76c2b40a5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:04.420646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-839600cb-af81-4738-aa22-5f76c2b40a5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:04.421079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-839600cb-af81-4738-aa22-5f76c2b40a5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:04.425164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a614bfa0-2f19-4b7b-8d82-54d74d4b30c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:04.426929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a614bfa0-2f19-4b7b-8d82-54d74d4b30c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:04.434151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a614bfa0-2f19-4b7b-8d82-54d74d4b30c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:04.434923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a614bfa0-2f19-4b7b-8d82-54d74d4b30c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:04.435594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a614bfa0-2f19-4b7b-8d82-54d74d4b30c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:04.438690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a614bfa0-2f19-4b7b-8d82-54d74d4b30c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:04.439433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a614bfa0-2f19-4b7b-8d82-54d74d4b30c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:04.440113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a614bfa0-2f19-4b7b-8d82-54d74d4b30c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:04.473812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-a614bfa0-2f19-4b7b-8d82-54d74d4b30c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lazy-loading 'flavor' on Instance uuid a6e311e1-6dd0-4498-897c-c92ce762d9b9 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:57:04.488125 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-a614bfa0-2f19-4b7b-8d82-54d74d4b30c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Cannot 'shelve' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state shelved_offloaded Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a614bfa0-2f19-4b7b-8d82-54d74d4b30c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action HTTP/1.1 Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 14 Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: {"shelve": {}} Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: exception: Cannot 'shelve' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state shelved_offloaded Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'a6e311e1-6dd0-4498-897c-c92ce762d9b9', 'body': {'shelve': {}}} Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 18:57:04.491282 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 18:57:04.496052 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state shelved_offloaded Oct 27 18:57:04.496052 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:04.496052 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:04.496052 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:04.496052 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:04.496052 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:04.496052 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:04.496052 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:04.496052 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:04.496052 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state shelved_offloaded Oct 27 18:57:04.496052 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:04.499157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a614bfa0-2f19-4b7b-8d82-54d74d4b30c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 409 to user: Cannot 'shelve' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state shelved_offloaded {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:04.500891 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a614bfa0-2f19-4b7b-8d82-54d74d4b30c4 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action" status: 409 len: 155 microversion: 2.1 time: 0.080403 Oct 27 18:57:04.502037 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1463/2812] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:04 2022] POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action => generated 155 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:57:04.507012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e83de3c3-c4dc-4665-9792-04a65161da80 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:04.508519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e83de3c3-c4dc-4665-9792-04a65161da80 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:04.515116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e83de3c3-c4dc-4665-9792-04a65161da80 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:04.516952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e83de3c3-c4dc-4665-9792-04a65161da80 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:04.517603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e83de3c3-c4dc-4665-9792-04a65161da80 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:04.518800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e83de3c3-c4dc-4665-9792-04a65161da80 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:04.519390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e83de3c3-c4dc-4665-9792-04a65161da80 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:04.519928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e83de3c3-c4dc-4665-9792-04a65161da80 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:04.728712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e83de3c3-c4dc-4665-9792-04a65161da80 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:04.740300 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e83de3c3-c4dc-4665-9792-04a65161da80 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1313 microversion: 2.1 time: 0.236977 Oct 27 18:57:04.754705 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1464/2813] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:04 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:04.760380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cf8caae8-aee5-4a2a-8103-eebf4d557aa0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:04.763180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cf8caae8-aee5-4a2a-8103-eebf4d557aa0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:04.771175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf8caae8-aee5-4a2a-8103-eebf4d557aa0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:04.771823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf8caae8-aee5-4a2a-8103-eebf4d557aa0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:04.772374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf8caae8-aee5-4a2a-8103-eebf4d557aa0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:04.774765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf8caae8-aee5-4a2a-8103-eebf4d557aa0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:04.774765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf8caae8-aee5-4a2a-8103-eebf4d557aa0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:04.774765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf8caae8-aee5-4a2a-8103-eebf4d557aa0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:04.869670 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cf8caae8-aee5-4a2a-8103-eebf4d557aa0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "PUT /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1081 microversion: 2.1 time: 0.113651 Oct 27 18:57:04.879523 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1465/2814] 10.222.0.42 () {60 vars in 1256 bytes} [Thu Oct 27 18:57:04 2022] PUT /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1081 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:04.891969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-87ebec36-c8d8-4964-982b-b5e526289173 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a132a60>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:05.026952 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-87ebec36-c8d8-4964-982b-b5e526289173 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1412 microversion: 2.1 time: 0.145286 Oct 27 18:57:05.027952 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1466/2815] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:04 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1412 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:05.034258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7ebafbe0-1e93-4d15-a487-2d4aa772a76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:05.035153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7ebafbe0-1e93-4d15-a487-2d4aa772a76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:05.043330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ebafbe0-1e93-4d15-a487-2d4aa772a76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:05.043978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ebafbe0-1e93-4d15-a487-2d4aa772a76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:05.046339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ebafbe0-1e93-4d15-a487-2d4aa772a76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:05.048204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ebafbe0-1e93-4d15-a487-2d4aa772a76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:05.048802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ebafbe0-1e93-4d15-a487-2d4aa772a76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:05.049494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ebafbe0-1e93-4d15-a487-2d4aa772a76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:05.070485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-839600cb-af81-4738-aa22-5f76c2b40a5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:05.072646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:05.083028 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-839600cb-af81-4738-aa22-5f76c2b40a5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1504 microversion: 2.1 time: 0.689894 Oct 27 18:57:05.087122 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1350/2816] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:04 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1504 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:05.094354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cba4cc02-784b-43c6-8b0f-c428f9172585 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:05.100517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cba4cc02-784b-43c6-8b0f-c428f9172585 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:05.119229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cba4cc02-784b-43c6-8b0f-c428f9172585 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:05.119749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cba4cc02-784b-43c6-8b0f-c428f9172585 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:05.120206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cba4cc02-784b-43c6-8b0f-c428f9172585 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:05.121811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cba4cc02-784b-43c6-8b0f-c428f9172585 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:05.122284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cba4cc02-784b-43c6-8b0f-c428f9172585 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:05.122754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cba4cc02-784b-43c6-8b0f-c428f9172585 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:05.158260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7ebafbe0-1e93-4d15-a487-2d4aa772a76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127029) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 18:57:05.180177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:05.277831 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7ebafbe0-1e93-4d15-a487-2d4aa772a76a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action" status: 202 len: 0 microversion: 2.1 time: 0.248211 Oct 27 18:57:05.282171 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1467/2817] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:05 2022] POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:57:05.287828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-303ff1b3-5856-43ba-9349-6e409360e0cb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:05.288549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-303ff1b3-5856-43ba-9349-6e409360e0cb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:05.296387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-303ff1b3-5856-43ba-9349-6e409360e0cb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:05.297008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-303ff1b3-5856-43ba-9349-6e409360e0cb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:05.297943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-303ff1b3-5856-43ba-9349-6e409360e0cb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:05.298858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-303ff1b3-5856-43ba-9349-6e409360e0cb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:05.299411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-303ff1b3-5856-43ba-9349-6e409360e0cb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:05.299934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-303ff1b3-5856-43ba-9349-6e409360e0cb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:05.643747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-303ff1b3-5856-43ba-9349-6e409360e0cb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:05.660475 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-303ff1b3-5856-43ba-9349-6e409360e0cb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1461 microversion: 2.1 time: 0.376415 Oct 27 18:57:05.661083 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1468/2818] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:05 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1461 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:05.668881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4a4c475c-1629-4a09-82c6-72269549089f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:05.679726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4a4c475c-1629-4a09-82c6-72269549089f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:05.711196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a4c475c-1629-4a09-82c6-72269549089f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:05.712487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a4c475c-1629-4a09-82c6-72269549089f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:05.713091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a4c475c-1629-4a09-82c6-72269549089f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:05.717115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a4c475c-1629-4a09-82c6-72269549089f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:05.717733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a4c475c-1629-4a09-82c6-72269549089f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:05.718255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a4c475c-1629-4a09-82c6-72269549089f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:05.854262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cba4cc02-784b-43c6-8b0f-c428f9172585 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:05.866858 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cba4cc02-784b-43c6-8b0f-c428f9172585 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1507 microversion: 2.1 time: 0.778473 Oct 27 18:57:05.867853 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1351/2819] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:05 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1507 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:05.874170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-538ddd3d-f969-4e0c-9e3b-45cff681480e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:05.875966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-538ddd3d-f969-4e0c-9e3b-45cff681480e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:05.884452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-538ddd3d-f969-4e0c-9e3b-45cff681480e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:05.885178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-538ddd3d-f969-4e0c-9e3b-45cff681480e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:05.886259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-538ddd3d-f969-4e0c-9e3b-45cff681480e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:05.887893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-538ddd3d-f969-4e0c-9e3b-45cff681480e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:05.890345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-538ddd3d-f969-4e0c-9e3b-45cff681480e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:05.891203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-538ddd3d-f969-4e0c-9e3b-45cff681480e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:06.041248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4a4c475c-1629-4a09-82c6-72269549089f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aae47b58f94604a6d57bfc222ac6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03a92ab456f4b21964fd7ac2d277f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:06.050973 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4a4c475c-1629-4a09-82c6-72269549089f tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 200 len: 1507 microversion: 2.1 time: 0.386565 Oct 27 18:57:06.053456 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1469/2820] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:05 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 1507 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:06.060478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4481d599-2cf4-4edc-9175-d218cc89a885 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:06.063474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4481d599-2cf4-4edc-9175-d218cc89a885 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:06.071502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4481d599-2cf4-4edc-9175-d218cc89a885 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:06.072011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4481d599-2cf4-4edc-9175-d218cc89a885 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:06.072448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4481d599-2cf4-4edc-9175-d218cc89a885 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:06.073331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4481d599-2cf4-4edc-9175-d218cc89a885 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:06.073777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4481d599-2cf4-4edc-9175-d218cc89a885 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:06.074210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4481d599-2cf4-4edc-9175-d218cc89a885 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:06.294751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4481d599-2cf4-4edc-9175-d218cc89a885 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:06.325083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-538ddd3d-f969-4e0c-9e3b-45cff681480e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:06.340917 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-538ddd3d-f969-4e0c-9e3b-45cff681480e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1500 microversion: 2.1 time: 0.471828 Oct 27 18:57:06.341521 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1352/2821] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:05 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1500 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:06.345618 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4481d599-2cf4-4edc-9175-d218cc89a885 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1507 microversion: 2.1 time: 0.290453 Oct 27 18:57:06.346202 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1470/2822] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:06 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:06.371295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7c8adac7-cf78-49f1-b825-e8f856d5f937 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:06.371700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5f2ff182-ca39-40cc-b31c-c18618bbe9fd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc869dd60d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:06.377488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7c8adac7-cf78-49f1-b825-e8f856d5f937 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:06.380688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:06.392937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c8adac7-cf78-49f1-b825-e8f856d5f937 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:06.393487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c8adac7-cf78-49f1-b825-e8f856d5f937 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:06.393960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c8adac7-cf78-49f1-b825-e8f856d5f937 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:06.394720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c8adac7-cf78-49f1-b825-e8f856d5f937 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:06.395181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c8adac7-cf78-49f1-b825-e8f856d5f937 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:06.398577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c8adac7-cf78-49f1-b825-e8f856d5f937 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:06.438716 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7c8adac7-cf78-49f1-b825-e8f856d5f937 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603/ips" status: 200 len: 110 microversion: 2.1 time: 0.071143 Oct 27 18:57:06.440331 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1471/2823] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 18:57:06 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603/ips => generated 110 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:06.447085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-77a771ef-2b50-4539-b681-64f7de027411 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:06.448021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-77a771ef-2b50-4539-b681-64f7de027411 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:06.455478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77a771ef-2b50-4539-b681-64f7de027411 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:06.460421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77a771ef-2b50-4539-b681-64f7de027411 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:06.461503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77a771ef-2b50-4539-b681-64f7de027411 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:06.462901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77a771ef-2b50-4539-b681-64f7de027411 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:06.463540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77a771ef-2b50-4539-b681-64f7de027411 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:06.464147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77a771ef-2b50-4539-b681-64f7de027411 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:06.494879 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5f2ff182-ca39-40cc-b31c-c18618bbe9fd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1412 microversion: 2.1 time: 0.152256 Oct 27 18:57:06.495597 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1353/2824] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:06 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1412 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:06.507496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5b5f2635-b599-4949-902d-e6e2f1c7ec17 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:06.511997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5b5f2635-b599-4949-902d-e6e2f1c7ec17 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:06.533064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b5f2635-b599-4949-902d-e6e2f1c7ec17 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:06.534229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b5f2635-b599-4949-902d-e6e2f1c7ec17 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:06.535319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b5f2635-b599-4949-902d-e6e2f1c7ec17 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:06.536265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b5f2635-b599-4949-902d-e6e2f1c7ec17 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:06.539676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b5f2635-b599-4949-902d-e6e2f1c7ec17 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:06.540368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b5f2635-b599-4949-902d-e6e2f1c7ec17 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:06.576014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-5b5f2635-b599-4949-902d-e6e2f1c7ec17 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lazy-loading 'flavor' on Instance uuid d40282a5-ba3b-4bef-9ed2-49d45f1585aa {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:57:06.757408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-77a771ef-2b50-4539-b681-64f7de027411 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:06.770895 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-77a771ef-2b50-4539-b681-64f7de027411 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1479 microversion: 2.1 time: 0.329257 Oct 27 18:57:06.791385 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1472/2825] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:06 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1479 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:06.802655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d71d2772-a047-4ce1-be49-3cae7aa95bf0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:06.804320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d71d2772-a047-4ce1-be49-3cae7aa95bf0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:06.820339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d71d2772-a047-4ce1-be49-3cae7aa95bf0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:06.821133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d71d2772-a047-4ce1-be49-3cae7aa95bf0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:06.823556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d71d2772-a047-4ce1-be49-3cae7aa95bf0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:06.824428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d71d2772-a047-4ce1-be49-3cae7aa95bf0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:06.825800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d71d2772-a047-4ce1-be49-3cae7aa95bf0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:06.828414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d71d2772-a047-4ce1-be49-3cae7aa95bf0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:06.917003 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5b5f2635-b599-4949-902d-e6e2f1c7ec17 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "POST /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa/action" status: 200 len: 32 microversion: 2.1 time: 0.420059 Oct 27 18:57:06.935996 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1354/2826] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:06 2022] POST /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa/action => generated 32 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:57:06.938915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d71d2772-a047-4ce1-be49-3cae7aa95bf0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:57:06.970587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a98879c1-3450-4626-b742-b0f068ab9799 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:06.971526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a98879c1-3450-4626-b742-b0f068ab9799 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:06.986936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a98879c1-3450-4626-b742-b0f068ab9799 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:06.987670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a98879c1-3450-4626-b742-b0f068ab9799 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:06.988288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a98879c1-3450-4626-b742-b0f068ab9799 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:06.989209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a98879c1-3450-4626-b742-b0f068ab9799 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:06.989855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a98879c1-3450-4626-b742-b0f068ab9799 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:06.990504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a98879c1-3450-4626-b742-b0f068ab9799 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.042843 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a98879c1-3450-4626-b742-b0f068ab9799 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603/ips" status: 200 len: 110 microversion: 2.1 time: 0.094792 Oct 27 18:57:07.051918 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1355/2827] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 18:57:06 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603/ips => generated 110 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:07.056786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4bd92c77-0d77-4123-a41e-42b8b9073441 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:07.057448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4bd92c77-0d77-4123-a41e-42b8b9073441 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:07.079070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bd92c77-0d77-4123-a41e-42b8b9073441 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.079459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bd92c77-0d77-4123-a41e-42b8b9073441 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.081421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bd92c77-0d77-4123-a41e-42b8b9073441 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.084233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bd92c77-0d77-4123-a41e-42b8b9073441 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.087359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bd92c77-0d77-4123-a41e-42b8b9073441 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.087838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bd92c77-0d77-4123-a41e-42b8b9073441 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.245570 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d71d2772-a047-4ce1-be49-3cae7aa95bf0 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 204 len: 0 microversion: 2.1 time: 0.448384 Oct 27 18:57:07.249242 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1473/2828] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:57:06 2022] DELETE /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:57:07.269254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cec5be45-4535-4440-81cc-3fe1e175f6d9 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '.version_select at 0x7fc87325c310>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:07.278902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cec5be45-4535-4440-81cc-3fe1e175f6d9 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.284322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cec5be45-4535-4440-81cc-3fe1e175f6d9 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.285054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cec5be45-4535-4440-81cc-3fe1e175f6d9 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.301740 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cec5be45-4535-4440-81cc-3fe1e175f6d9 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 783 microversion: 2.1 time: 0.048186 Oct 27 18:57:07.306674 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1474/2829] 10.222.0.42 () {58 vars in 1143 bytes} [Thu Oct 27 18:57:07 2022] GET /compute/v2.1/os-migrations => generated 783 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:07.318428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f7c435f7-362b-45a7-a42b-aff898d1cc91 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:07.320541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f7c435f7-362b-45a7-a42b-aff898d1cc91 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:07.331594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7c435f7-362b-45a7-a42b-aff898d1cc91 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.332381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7c435f7-362b-45a7-a42b-aff898d1cc91 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.332991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7c435f7-362b-45a7-a42b-aff898d1cc91 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.334372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7c435f7-362b-45a7-a42b-aff898d1cc91 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.335021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7c435f7-362b-45a7-a42b-aff898d1cc91 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.335624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7c435f7-362b-45a7-a42b-aff898d1cc91 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.490977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4bd92c77-0d77-4123-a41e-42b8b9073441 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:07.501422 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4bd92c77-0d77-4123-a41e-42b8b9073441 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1461 microversion: 2.1 time: 0.448326 Oct 27 18:57:07.502331 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1356/2830] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:07 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1461 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:07.507091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-307ed738-5c9b-42a7-8071-eda831963d63 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:07.507795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-307ed738-5c9b-42a7-8071-eda831963d63 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:07.513969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-307ed738-5c9b-42a7-8071-eda831963d63 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.514719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-307ed738-5c9b-42a7-8071-eda831963d63 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.515420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-307ed738-5c9b-42a7-8071-eda831963d63 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.516980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-307ed738-5c9b-42a7-8071-eda831963d63 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.517862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-307ed738-5c9b-42a7-8071-eda831963d63 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.518610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-307ed738-5c9b-42a7-8071-eda831963d63 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.547402 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-307ed738-5c9b-42a7-8071-eda831963d63 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603/ips/tempest-ServerAddressesTestJSON-1533845514-network" status: 200 len: 95 microversion: 2.1 time: 0.043125 Oct 27 18:57:07.548903 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1357/2831] 10.222.0.42 () {58 vars in 1401 bytes} [Thu Oct 27 18:57:07 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603/ips/tempest-ServerAddressesTestJSON-1533845514-network => generated 95 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:57:07.565017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf67abad-aea1-45fd-8525-66cf8bd839a4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:07.565446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cf67abad-aea1-45fd-8525-66cf8bd839a4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:07.574536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf67abad-aea1-45fd-8525-66cf8bd839a4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.575306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf67abad-aea1-45fd-8525-66cf8bd839a4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.575943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf67abad-aea1-45fd-8525-66cf8bd839a4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.577875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf67abad-aea1-45fd-8525-66cf8bd839a4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.579099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf67abad-aea1-45fd-8525-66cf8bd839a4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.579716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf67abad-aea1-45fd-8525-66cf8bd839a4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.638848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cf67abad-aea1-45fd-8525-66cf8bd839a4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:57:07.642428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f7c435f7-362b-45a7-a42b-aff898d1cc91 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:07.652305 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f7c435f7-362b-45a7-a42b-aff898d1cc91 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.344275 Oct 27 18:57:07.654529 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1475/2832] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:07 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:07.660486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-533a37c2-eac9-4481-a3f1-91c25c4da15a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:07.661214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-533a37c2-eac9-4481-a3f1-91c25c4da15a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:07.668276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-533a37c2-eac9-4481-a3f1-91c25c4da15a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.668677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-533a37c2-eac9-4481-a3f1-91c25c4da15a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.669196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-533a37c2-eac9-4481-a3f1-91c25c4da15a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.669969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-533a37c2-eac9-4481-a3f1-91c25c4da15a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.670488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-533a37c2-eac9-4481-a3f1-91c25c4da15a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.671023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-533a37c2-eac9-4481-a3f1-91c25c4da15a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.795708 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.compute.api [None req-cf67abad-aea1-45fd-8525-66cf8bd839a4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Instance is already in deleting state, ignoring this request Oct 27 18:57:07.798722 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cf67abad-aea1-45fd-8525-66cf8bd839a4 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 204 len: 0 microversion: 2.1 time: 0.248631 Oct 27 18:57:07.799965 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1358/2833] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:57:07 2022] DELETE /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:57:07.807423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c993464c-535f-437d-9b4d-b0a4d3460765 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc869ce81f0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:07.884462 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c993464c-535f-437d-9b4d-b0a4d3460765 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1412 microversion: 2.1 time: 0.083126 Oct 27 18:57:07.885442 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1359/2834] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:07 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:07.891556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-40e26588-4aff-43a4-b380-691a48a11e3a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:07.892397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-40e26588-4aff-43a4-b380-691a48a11e3a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:07.900217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40e26588-4aff-43a4-b380-691a48a11e3a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.901180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40e26588-4aff-43a4-b380-691a48a11e3a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.901845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40e26588-4aff-43a4-b380-691a48a11e3a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.902846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40e26588-4aff-43a4-b380-691a48a11e3a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.904107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40e26588-4aff-43a4-b380-691a48a11e3a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.904794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40e26588-4aff-43a4-b380-691a48a11e3a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.948270 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-533a37c2-eac9-4481-a3f1-91c25c4da15a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1630 microversion: 2.1 time: 0.292657 Oct 27 18:57:07.948841 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1476/2835] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:07 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1630 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:07.970325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-40e26588-4aff-43a4-b380-691a48a11e3a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:57:07.982203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b13c0939-6539-4a70-92c4-80a8cc503258 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:07.983125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b13c0939-6539-4a70-92c4-80a8cc503258 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:07.989732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b13c0939-6539-4a70-92c4-80a8cc503258 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.990231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b13c0939-6539-4a70-92c4-80a8cc503258 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.990698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b13c0939-6539-4a70-92c4-80a8cc503258 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:07.991404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b13c0939-6539-4a70-92c4-80a8cc503258 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:07.991861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b13c0939-6539-4a70-92c4-80a8cc503258 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:07.992288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b13c0939-6539-4a70-92c4-80a8cc503258 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:08.129857 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-40e26588-4aff-43a4-b380-691a48a11e3a tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "DELETE /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 204 len: 0 microversion: 2.1 time: 0.242646 Oct 27 18:57:08.131098 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1360/2836] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:57:07 2022] DELETE /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:57:08.137656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a29b9478-ab93-4963-ab8d-567e7cf7edb5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Action: 'create', calling method: .version_select at 0x7fc8731f4790>, body: {"keypair": {"name": "tempest-keypair-1225849210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMHqus8Rw0ANbwJ3PbjZPM/FKe972tYdhOKN1y1JHXTd6UmZNocgUP9pjx0xCT4yjF6u2eze/7ptynprVThcgyDgcCDeH9E7levgA6nh2alORBRMV4N/2jKs1iRbG21Pg=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:08.165170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-a29b9478-ab93-4963-ab8d-567e7cf7edb5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Getting quotas for project 47340475d333442da39184d873995e37. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:57:08.171063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-a29b9478-ab93-4963-ab8d-567e7cf7edb5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Getting quotas for user 59ab6001dda8482a83fbd4dc67eabb68 and project 47340475d333442da39184d873995e37. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:57:08.185806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b13c0939-6539-4a70-92c4-80a8cc503258 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:08.196448 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b13c0939-6539-4a70-92c4-80a8cc503258 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1513 microversion: 2.1 time: 0.230251 Oct 27 18:57:08.212767 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1477/2837] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:07 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:08.220855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-20290bb4-9d59-46c3-8ac5-f5776acb4d16 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:08.221911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-20290bb4-9d59-46c3-8ac5-f5776acb4d16 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:08.228955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20290bb4-9d59-46c3-8ac5-f5776acb4d16 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:08.229649 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a29b9478-ab93-4963-ab8d-567e7cf7edb5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096831 Oct 27 18:57:08.229890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20290bb4-9d59-46c3-8ac5-f5776acb4d16 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:08.230284 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1361/2838] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:57:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:08.231160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20290bb4-9d59-46c3-8ac5-f5776acb4d16 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:08.231293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20290bb4-9d59-46c3-8ac5-f5776acb4d16 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:08.231664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20290bb4-9d59-46c3-8ac5-f5776acb4d16 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:08.232875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20290bb4-9d59-46c3-8ac5-f5776acb4d16 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:08.429322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-20290bb4-9d59-46c3-8ac5-f5776acb4d16 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aae47b58f94604a6d57bfc222ac6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03a92ab456f4b21964fd7ac2d277f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:08.440347 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-20290bb4-9d59-46c3-8ac5-f5776acb4d16 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 200 len: 1513 microversion: 2.1 time: 0.226033 Oct 27 18:57:08.441743 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1478/2839] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:08 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:08.527162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cdd8f68e-3cc1-495d-b3da-08319feadd18 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:08.527907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cdd8f68e-3cc1-495d-b3da-08319feadd18 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:08.540756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdd8f68e-3cc1-495d-b3da-08319feadd18 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:08.541401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdd8f68e-3cc1-495d-b3da-08319feadd18 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:08.542172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdd8f68e-3cc1-495d-b3da-08319feadd18 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:08.543706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdd8f68e-3cc1-495d-b3da-08319feadd18 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:08.544349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdd8f68e-3cc1-495d-b3da-08319feadd18 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:08.544836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdd8f68e-3cc1-495d-b3da-08319feadd18 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:08.681728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-29bc2558-6e4c-49e7-abc2-1bebad6e3cd9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:08.682261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-29bc2558-6e4c-49e7-abc2-1bebad6e3cd9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:08.689808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29bc2558-6e4c-49e7-abc2-1bebad6e3cd9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:08.690327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29bc2558-6e4c-49e7-abc2-1bebad6e3cd9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:08.690804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29bc2558-6e4c-49e7-abc2-1bebad6e3cd9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:08.691714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29bc2558-6e4c-49e7-abc2-1bebad6e3cd9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:08.692187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29bc2558-6e4c-49e7-abc2-1bebad6e3cd9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:08.692625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29bc2558-6e4c-49e7-abc2-1bebad6e3cd9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:09.006162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cdd8f68e-3cc1-495d-b3da-08319feadd18 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:09.019407 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cdd8f68e-3cc1-495d-b3da-08319feadd18 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.495841 Oct 27 18:57:09.039903 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1362/2840] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:08 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:09.050502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6aac582a-9265-46e9-b106-8c8cf020081e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc869d284c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:09.118009 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6aac582a-9265-46e9-b106-8c8cf020081e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1412 microversion: 2.1 time: 0.074999 Oct 27 18:57:09.118859 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1363/2841] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:09 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:09.170088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-29bc2558-6e4c-49e7-abc2-1bebad6e3cd9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:09.182171 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-29bc2558-6e4c-49e7-abc2-1bebad6e3cd9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.504369 Oct 27 18:57:09.183025 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1479/2842] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:08 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:09.228225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e410b14-8a80-4bfc-bb2a-b947e44d06c7 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:09.228850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e410b14-8a80-4bfc-bb2a-b947e44d06c7 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:09.238870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e410b14-8a80-4bfc-bb2a-b947e44d06c7 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:09.239370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e410b14-8a80-4bfc-bb2a-b947e44d06c7 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:09.239821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e410b14-8a80-4bfc-bb2a-b947e44d06c7 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:09.240545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e410b14-8a80-4bfc-bb2a-b947e44d06c7 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:09.242968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e410b14-8a80-4bfc-bb2a-b947e44d06c7 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:09.243362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e410b14-8a80-4bfc-bb2a-b947e44d06c7 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:09.467403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-27bdfeaa-b02a-4fdc-a146-5d9612641602 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:09.469482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-27bdfeaa-b02a-4fdc-a146-5d9612641602 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:09.484697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27bdfeaa-b02a-4fdc-a146-5d9612641602 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:09.485628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27bdfeaa-b02a-4fdc-a146-5d9612641602 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:09.487479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27bdfeaa-b02a-4fdc-a146-5d9612641602 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:09.490697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27bdfeaa-b02a-4fdc-a146-5d9612641602 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:09.492005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27bdfeaa-b02a-4fdc-a146-5d9612641602 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:09.493316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27bdfeaa-b02a-4fdc-a146-5d9612641602 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:09.738001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e410b14-8a80-4bfc-bb2a-b947e44d06c7 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:09.754491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-27bdfeaa-b02a-4fdc-a146-5d9612641602 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aae47b58f94604a6d57bfc222ac6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03a92ab456f4b21964fd7ac2d277f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:09.755069 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e410b14-8a80-4bfc-bb2a-b947e44d06c7 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1513 microversion: 2.1 time: 0.530679 Oct 27 18:57:09.755783 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1364/2843] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:09 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1513 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:09.786030 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-27bdfeaa-b02a-4fdc-a146-5d9612641602 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 200 len: 1513 microversion: 2.1 time: 0.323017 Oct 27 18:57:09.787906 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1480/2844] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:09 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 1513 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:10.048783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e19ac9d1-c7fc-4440-a441-7cb33e37d0e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:10.054612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e19ac9d1-c7fc-4440-a441-7cb33e37d0e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:10.073218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e19ac9d1-c7fc-4440-a441-7cb33e37d0e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:10.073740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e19ac9d1-c7fc-4440-a441-7cb33e37d0e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:10.074318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e19ac9d1-c7fc-4440-a441-7cb33e37d0e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:10.075093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e19ac9d1-c7fc-4440-a441-7cb33e37d0e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:10.075584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e19ac9d1-c7fc-4440-a441-7cb33e37d0e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:10.076029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e19ac9d1-c7fc-4440-a441-7cb33e37d0e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:10.142344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b364609a-3a3b-4591-8c65-e92b6028a9a7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a0fd040>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:11.034853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e19ac9d1-c7fc-4440-a441-7cb33e37d0e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:11.043935 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e19ac9d1-c7fc-4440-a441-7cb33e37d0e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 1.001130 Oct 27 18:57:11.055603 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1365/2845] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:10 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:11.062849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0c1907f7-49e8-4fc9-922c-c648a3bc0656 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:11.072716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0c1907f7-49e8-4fc9-922c-c648a3bc0656 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:11.080566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c1907f7-49e8-4fc9-922c-c648a3bc0656 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:11.087160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c1907f7-49e8-4fc9-922c-c648a3bc0656 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:11.087917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c1907f7-49e8-4fc9-922c-c648a3bc0656 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:11.088849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c1907f7-49e8-4fc9-922c-c648a3bc0656 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:11.089835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c1907f7-49e8-4fc9-922c-c648a3bc0656 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:11.090483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c1907f7-49e8-4fc9-922c-c648a3bc0656 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:11.914873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0c1907f7-49e8-4fc9-922c-c648a3bc0656 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:11.925478 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0c1907f7-49e8-4fc9-922c-c648a3bc0656 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.867567 Oct 27 18:57:11.939034 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1366/2846] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:11 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:11.958142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b5558281-bdec-4eae-b3a9-53556032f8e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:11.959161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b5558281-bdec-4eae-b3a9-53556032f8e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:11.967389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5558281-bdec-4eae-b3a9-53556032f8e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:11.969090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5558281-bdec-4eae-b3a9-53556032f8e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:11.978351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5558281-bdec-4eae-b3a9-53556032f8e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:11.979695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5558281-bdec-4eae-b3a9-53556032f8e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:11.980466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5558281-bdec-4eae-b3a9-53556032f8e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:11.981167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5558281-bdec-4eae-b3a9-53556032f8e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:12.017852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:12.077740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5558281-bdec-4eae-b3a9-53556032f8e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:12.077740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5558281-bdec-4eae-b3a9-53556032f8e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:12.077740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5558281-bdec-4eae-b3a9-53556032f8e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:12.077740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-b5558281-bdec-4eae-b3a9-53556032f8e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lazy-loading 'fault' on Instance uuid e9f3d0be-dedd-4dd1-8b00-9f81d24b957a {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:57:12.154635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b5558281-bdec-4eae-b3a9-53556032f8e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77434d4813ca426fbc20f386894c3176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcefa097ed8d4bf8b7f0118786874cc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:12.175336 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b5558281-bdec-4eae-b3a9-53556032f8e6 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 200 len: 1307 microversion: 2.1 time: 0.234726 Oct 27 18:57:12.191402 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1367/2847] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:11 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 1307 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:12.198703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-989ebe1c-d95f-45ef-bc16-04334280d291 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:12.201526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-989ebe1c-d95f-45ef-bc16-04334280d291 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:12.216264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-989ebe1c-d95f-45ef-bc16-04334280d291 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:12.217195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-989ebe1c-d95f-45ef-bc16-04334280d291 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:12.218730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-989ebe1c-d95f-45ef-bc16-04334280d291 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:12.222056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-989ebe1c-d95f-45ef-bc16-04334280d291 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:12.222867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-989ebe1c-d95f-45ef-bc16-04334280d291 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:12.228392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-989ebe1c-d95f-45ef-bc16-04334280d291 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:12.655338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-989ebe1c-d95f-45ef-bc16-04334280d291 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aae47b58f94604a6d57bfc222ac6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03a92ab456f4b21964fd7ac2d277f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:12.673745 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-989ebe1c-d95f-45ef-bc16-04334280d291 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 200 len: 1513 microversion: 2.1 time: 0.481135 Oct 27 18:57:12.679558 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1368/2848] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:12 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 1513 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:12.697124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ec83c84d-a104-41d8-b0b7-6713fe28039a req-0c39eb5c-b23d-4370-9a30-0b74f6073bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f3d0be-dedd-4dd1-8b00-9f81d24b957a", "name": "network-vif-deleted", "tag": "024b1ff9-2a5f-41df-b730-9c3b28e617ff"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:12.720933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ec83c84d-a104-41d8-b0b7-6713fe28039a req-0c39eb5c-b23d-4370-9a30-0b74f6073bda service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:12.725541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ec83c84d-a104-41d8-b0b7-6713fe28039a req-0c39eb5c-b23d-4370-9a30-0b74f6073bda service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:12.727525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ec83c84d-a104-41d8-b0b7-6713fe28039a req-0c39eb5c-b23d-4370-9a30-0b74f6073bda service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:13.503484 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ec83c84d-a104-41d8-b0b7-6713fe28039a req-0c39eb5c-b23d-4370-9a30-0b74f6073bda service nova] Creating event network-vif-deleted:024b1ff9-2a5f-41df-b730-9c3b28e617ff for instance e9f3d0be-dedd-4dd1-8b00-9f81d24b957a on n-h1-860687-3 Oct 27 18:57:13.523135 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ec83c84d-a104-41d8-b0b7-6713fe28039a req-0c39eb5c-b23d-4370-9a30-0b74f6073bda service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.841005 Oct 27 18:57:13.526948 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1369/2849] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:13.540461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-60772542-b0db-4a90-ac27-23d391ea568c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:13.543068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-60772542-b0db-4a90-ac27-23d391ea568c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:13.566920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60772542-b0db-4a90-ac27-23d391ea568c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:13.567458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60772542-b0db-4a90-ac27-23d391ea568c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:13.567919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60772542-b0db-4a90-ac27-23d391ea568c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:13.568658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60772542-b0db-4a90-ac27-23d391ea568c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:13.569125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60772542-b0db-4a90-ac27-23d391ea568c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:13.569561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60772542-b0db-4a90-ac27-23d391ea568c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:14.049251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-60772542-b0db-4a90-ac27-23d391ea568c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:14.062848 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-60772542-b0db-4a90-ac27-23d391ea568c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.533711 Oct 27 18:57:14.070483 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1370/2850] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:13 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:14.096078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-516be0b4-735b-4e89-8b67-a244319714ef tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:14.102662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-516be0b4-735b-4e89-8b67-a244319714ef tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:14.138403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-516be0b4-735b-4e89-8b67-a244319714ef tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:14.138916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-516be0b4-735b-4e89-8b67-a244319714ef tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:14.139369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-516be0b4-735b-4e89-8b67-a244319714ef tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:14.140629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-516be0b4-735b-4e89-8b67-a244319714ef tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:14.141102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-516be0b4-735b-4e89-8b67-a244319714ef tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:14.141543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-516be0b4-735b-4e89-8b67-a244319714ef tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:14.442308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-516be0b4-735b-4e89-8b67-a244319714ef tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:14.450440 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-516be0b4-735b-4e89-8b67-a244319714ef tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.378510 Oct 27 18:57:14.468560 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1371/2851] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:14 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:14.473895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-e2a6aeeb-2927-4ed4-aaa9-2b52dcbea256 req-15c25369-e658-4d17-ae9e-4dbc853abdca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603", "name": "network-vif-deleted", "tag": "015c923b-1253-4901-8696-2b913942b5c7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:14.485389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e2a6aeeb-2927-4ed4-aaa9-2b52dcbea256 req-15c25369-e658-4d17-ae9e-4dbc853abdca service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:14.486263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e2a6aeeb-2927-4ed4-aaa9-2b52dcbea256 req-15c25369-e658-4d17-ae9e-4dbc853abdca service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:14.486996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e2a6aeeb-2927-4ed4-aaa9-2b52dcbea256 req-15c25369-e658-4d17-ae9e-4dbc853abdca service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:14.500521 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-e2a6aeeb-2927-4ed4-aaa9-2b52dcbea256 req-15c25369-e658-4d17-ae9e-4dbc853abdca service nova] Creating event network-vif-deleted:015c923b-1253-4901-8696-2b913942b5c7 for instance 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 on n-h1-860687-3 Oct 27 18:57:14.514307 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-e2a6aeeb-2927-4ed4-aaa9-2b52dcbea256 req-15c25369-e658-4d17-ae9e-4dbc853abdca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043944 Oct 27 18:57:14.516385 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1372/2852] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:14.523761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-904b030e-16ea-4643-b397-f5558a193972 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:14.533708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-904b030e-16ea-4643-b397-f5558a193972 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: e9f3d0be-dedd-4dd1-8b00-9f81d24b957a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:14.540756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-904b030e-16ea-4643-b397-f5558a193972 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:14.541529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-904b030e-16ea-4643-b397-f5558a193972 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:14.541979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-904b030e-16ea-4643-b397-f5558a193972 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:14.542959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-904b030e-16ea-4643-b397-f5558a193972 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:14.543913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-904b030e-16ea-4643-b397-f5558a193972 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:14.544521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-904b030e-16ea-4643-b397-f5558a193972 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:14.585760 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-904b030e-16ea-4643-b397-f5558a193972 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] HTTP exception thrown: Instance e9f3d0be-dedd-4dd1-8b00-9f81d24b957a could not be found. Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-904b030e-16ea-4643-b397-f5558a193972 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Request method failure captured: Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a HTTP/1.1 Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPan3lZb8-6p71z-Eph1Fbackr4hzcP5VsGdfYLBmqnnCDQU_UdLDF9xRovTl3VxG9LHYQvDNdh5O9JgNzULqhfg7lNIiUFV-OlDodgyVNhoKwpRoJrKk6wV358uIBRl-E3DKlH5pYBThf2sVTIWNX4xk4ruEUIWv34picrVXjAdqo Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: bcefa097ed8d4bf8b7f0118786874cc1 Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bcefa097ed8d4bf8b7f0118786874cc1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: bcefa097ed8d4bf8b7f0118786874cc1 Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerDiskConfigTestJSON-2030697217-project Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 77434d4813ca426fbc20f386894c3176 Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerDiskConfigTestJSON-2030697217-project Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance e9f3d0be-dedd-4dd1-8b00-9f81d24b957a could not be found. Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'e9f3d0be-dedd-4dd1-8b00-9f81d24b957a'} Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f3d0be-dedd-4dd1-8b00-9f81d24b957a could not be found. Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f3d0be-dedd-4dd1-8b00-9f81d24b957a could not be found. Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:14.587265 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:14.593347 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:14.593347 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:14.593347 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:14.593347 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:14.593347 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:14.593347 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f3d0be-dedd-4dd1-8b00-9f81d24b957a could not be found. Oct 27 18:57:14.593347 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:14.593347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-904b030e-16ea-4643-b397-f5558a193972 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Returning 404 to user: Instance e9f3d0be-dedd-4dd1-8b00-9f81d24b957a could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:14.593961 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-904b030e-16ea-4643-b397-f5558a193972 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a" status: 404 len: 111 microversion: 2.1 time: 0.076208 Oct 27 18:57:14.598130 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1373/2853] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:14 2022] GET /compute/v2.1/servers/e9f3d0be-dedd-4dd1-8b00-9f81d24b957a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:57:14.608339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d9e3014-85bf-4f30-aacf-e97e4ed9b300 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:14.609751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0d9e3014-85bf-4f30-aacf-e97e4ed9b300 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] [instance: 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:14.621922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d9e3014-85bf-4f30-aacf-e97e4ed9b300 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:14.622700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d9e3014-85bf-4f30-aacf-e97e4ed9b300 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:14.626711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d9e3014-85bf-4f30-aacf-e97e4ed9b300 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:14.627671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d9e3014-85bf-4f30-aacf-e97e4ed9b300 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:14.628629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d9e3014-85bf-4f30-aacf-e97e4ed9b300 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:14.629229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d9e3014-85bf-4f30-aacf-e97e4ed9b300 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:14.653002 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-0d9e3014-85bf-4f30-aacf-e97e4ed9b300 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] HTTP exception thrown: Instance 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 could not be found. Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d9e3014-85bf-4f30-aacf-e97e4ed9b300 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Request method failure captured: Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 HTTP/1.1 Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtRl3pk5tMXBpqyNcQHX4Cth-75-QLskqDJ6JO1NLiidzP1IkF_DOVL_RBQFsvKG9A-LUjEsDmUtktvsx8oEF1lAwXXFXFYSf7LM9GC7FWd1v9tC9KtyAlh_2CbHhlrN6WRHFPZ0ygkx-QOmuSFbeRpFcyweHXD74OqkU2juNh-OWRg Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: a03a92ab456f4b21964fd7ac2d277f7f Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerAddressesTestJSON-1216584672 Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a03a92ab456f4b21964fd7ac2d277f7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a03a92ab456f4b21964fd7ac2d277f7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a03a92ab456f4b21964fd7ac2d277f7f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a03a92ab456f4b21964fd7ac2d277f7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerAddressesTestJSON-1216584672 Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: a03a92ab456f4b21964fd7ac2d277f7f Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1216584672 Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerAddressesTestJSON-1216584672-project Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 25aae47b58f94604a6d57bfc222ac6d6 Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerAddressesTestJSON-1216584672-project Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 could not be found. Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603'} Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 could not be found. Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 could not be found. Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:14.660589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:14.665434 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:14.665434 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:14.665434 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:14.665434 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:14.665434 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:14.665434 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 could not be found. Oct 27 18:57:14.665434 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:14.667697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d9e3014-85bf-4f30-aacf-e97e4ed9b300 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] Returning 404 to user: Instance 99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:14.669199 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d9e3014-85bf-4f30-aacf-e97e4ed9b300 tempest-ServerAddressesTestJSON-1216584672 tempest-ServerAddressesTestJSON-1216584672-project] 10.222.0.42 "GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603" status: 404 len: 111 microversion: 2.1 time: 0.069623 Oct 27 18:57:14.686821 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1374/2854] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:14 2022] GET /compute/v2.1/servers/99c8d6b4-2191-45e9-b5f1-f4ad5f9eb603 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:57:14.706496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1789674569", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "db61e2ae-a0b9-4ebe-826d-1c6dfd28832f"}], "security_groups": [{"name": "tempest-securitygroup--2128477676"}], "key_name": "tempest-keypair-1225849210", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:15.857228 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b364609a-3a3b-4591-8c65-e92b6028a9a7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1421 microversion: 2.1 time: 5.726918 Oct 27 18:57:15.858081 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1481/2855] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:10 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1421 bytes in 5728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:15.891200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b663fae4-3d40-45bb-8a53-e44410023cfc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:15.892356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b663fae4-3d40-45bb-8a53-e44410023cfc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:15.899605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b663fae4-3d40-45bb-8a53-e44410023cfc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:15.901039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b663fae4-3d40-45bb-8a53-e44410023cfc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:15.901814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b663fae4-3d40-45bb-8a53-e44410023cfc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:15.902796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b663fae4-3d40-45bb-8a53-e44410023cfc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:15.903487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b663fae4-3d40-45bb-8a53-e44410023cfc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:15.904162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b663fae4-3d40-45bb-8a53-e44410023cfc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:15.922317 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-b663fae4-3d40-45bb-8a53-e44410023cfc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] HTTP exception thrown: Instance 3b3ab523-37c4-46bc-ab91-975da6d3807f could not be found. Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b663fae4-3d40-45bb-8a53-e44410023cfc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Request method failure captured: Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f HTTP/1.1 Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPan3lZb8-6p71z-Eph1Fbackr4hzcP5VsGdfYLBmqnnCDQU_UdLDF9xRovTl3VxG9LHYQvDNdh5O9JgNzULqhfg7lNIiUFV-OlDodgyVNhoKwpRoJrKk6wV358uIBRl-E3DKlH5pYBThf2sVTIWNX4xk4ruEUIWv34picrVXjAdqo Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: bcefa097ed8d4bf8b7f0118786874cc1 Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bcefa097ed8d4bf8b7f0118786874cc1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: bcefa097ed8d4bf8b7f0118786874cc1 Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerDiskConfigTestJSON-2030697217-project Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 77434d4813ca426fbc20f386894c3176 Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerDiskConfigTestJSON-2030697217-project Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 3b3ab523-37c4-46bc-ab91-975da6d3807f could not be found. Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '3b3ab523-37c4-46bc-ab91-975da6d3807f'} Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b3ab523-37c4-46bc-ab91-975da6d3807f could not be found. Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:57:15.926082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:57:15.929916 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b3ab523-37c4-46bc-ab91-975da6d3807f could not be found. Oct 27 18:57:15.929916 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:15.929916 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:15.929916 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:15.929916 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:15.929916 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:15.929916 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:15.929916 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:15.929916 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:15.929916 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b3ab523-37c4-46bc-ab91-975da6d3807f could not be found. Oct 27 18:57:15.929916 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:15.933968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b663fae4-3d40-45bb-8a53-e44410023cfc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Returning 404 to user: Instance 3b3ab523-37c4-46bc-ab91-975da6d3807f could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:15.935351 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b663fae4-3d40-45bb-8a53-e44410023cfc tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 404 len: 111 microversion: 2.1 time: 0.076184 Oct 27 18:57:15.936408 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1482/2856] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:57:15 2022] DELETE /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:57:15.944681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0c3c94dc-452b-44c3-a170-facc1ebc44b1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:15.947812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0c3c94dc-452b-44c3-a170-facc1ebc44b1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:15.952717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] validate_networks() for [('db61e2ae-a0b9-4ebe-826d-1c6dfd28832f', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:57:15.956488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c3c94dc-452b-44c3-a170-facc1ebc44b1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:15.957344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c3c94dc-452b-44c3-a170-facc1ebc44b1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:15.958323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c3c94dc-452b-44c3-a170-facc1ebc44b1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:15.960250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c3c94dc-452b-44c3-a170-facc1ebc44b1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:15.960903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c3c94dc-452b-44c3-a170-facc1ebc44b1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:15.961612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c3c94dc-452b-44c3-a170-facc1ebc44b1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:16.213911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0c3c94dc-452b-44c3-a170-facc1ebc44b1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:16.217409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:16.229945 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0c3c94dc-452b-44c3-a170-facc1ebc44b1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.290379 Oct 27 18:57:16.246667 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1483/2857] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:15 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:16.262899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42e79eb7-a330-47a9-a668-341a0e92e819 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:16.263725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-42e79eb7-a330-47a9-a668-341a0e92e819 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:16.282734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42e79eb7-a330-47a9-a668-341a0e92e819 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:16.283303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42e79eb7-a330-47a9-a668-341a0e92e819 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:16.283769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42e79eb7-a330-47a9-a668-341a0e92e819 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:16.284502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42e79eb7-a330-47a9-a668-341a0e92e819 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:16.284973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42e79eb7-a330-47a9-a668-341a0e92e819 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:16.291740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42e79eb7-a330-47a9-a668-341a0e92e819 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:16.711153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:57:16.711605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:57:16.712074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:57:16.712499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:57:16.712919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:57:16.732680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:16.735055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:16.738319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:16.739266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:16.743539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:16.744122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:16.787744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Getting quotas for project 47340475d333442da39184d873995e37. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:57:16.797140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Getting quotas for user 59ab6001dda8482a83fbd4dc67eabb68 and project 47340475d333442da39184d873995e37. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:57:16.805479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-42e79eb7-a330-47a9-a668-341a0e92e819 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:16.815211 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-42e79eb7-a330-47a9-a668-341a0e92e819 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.562908 Oct 27 18:57:16.815379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:57:16.818448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:57:16.836812 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1484/2858] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:16 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:16.841648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cd15ea23-425e-4fc0-b52a-7eef4a6a7f9b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a1321f0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:16.894264 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-04ddaebd-d705-452d-b8db-8981131164e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.201950 Oct 27 18:57:16.897335 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1375/2859] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:57:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 2209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:57:16.907680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55e02807-2e91-4728-8362-05a99c74088a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:16.908973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-55e02807-2e91-4728-8362-05a99c74088a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: 3b3ab523-37c4-46bc-ab91-975da6d3807f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:16.916334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e02807-2e91-4728-8362-05a99c74088a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:16.917289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e02807-2e91-4728-8362-05a99c74088a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:16.918501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e02807-2e91-4728-8362-05a99c74088a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:16.919715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e02807-2e91-4728-8362-05a99c74088a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:16.920599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e02807-2e91-4728-8362-05a99c74088a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:16.923433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55e02807-2e91-4728-8362-05a99c74088a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:16.944323 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-55e02807-2e91-4728-8362-05a99c74088a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] HTTP exception thrown: Instance 3b3ab523-37c4-46bc-ab91-975da6d3807f could not be found. Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55e02807-2e91-4728-8362-05a99c74088a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Request method failure captured: Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f HTTP/1.1 Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPan3lZb8-6p71z-Eph1Fbackr4hzcP5VsGdfYLBmqnnCDQU_UdLDF9xRovTl3VxG9LHYQvDNdh5O9JgNzULqhfg7lNIiUFV-OlDodgyVNhoKwpRoJrKk6wV358uIBRl-E3DKlH5pYBThf2sVTIWNX4xk4ruEUIWv34picrVXjAdqo Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: bcefa097ed8d4bf8b7f0118786874cc1 Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bcefa097ed8d4bf8b7f0118786874cc1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: bcefa097ed8d4bf8b7f0118786874cc1 Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerDiskConfigTestJSON-2030697217-project Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 77434d4813ca426fbc20f386894c3176 Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerDiskConfigTestJSON-2030697217-project Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 3b3ab523-37c4-46bc-ab91-975da6d3807f could not be found. Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '3b3ab523-37c4-46bc-ab91-975da6d3807f'} Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b3ab523-37c4-46bc-ab91-975da6d3807f could not be found. Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b3ab523-37c4-46bc-ab91-975da6d3807f could not be found. Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:16.945916 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:16.951675 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:16.951675 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:16.951675 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:16.951675 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:16.951675 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:16.951675 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b3ab523-37c4-46bc-ab91-975da6d3807f could not be found. Oct 27 18:57:16.951675 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:16.951675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55e02807-2e91-4728-8362-05a99c74088a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Returning 404 to user: Instance 3b3ab523-37c4-46bc-ab91-975da6d3807f could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:16.951675 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-55e02807-2e91-4728-8362-05a99c74088a tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f" status: 404 len: 111 microversion: 2.1 time: 0.048733 Oct 27 18:57:16.951675 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1376/2860] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:16 2022] GET /compute/v2.1/servers/3b3ab523-37c4-46bc-ab91-975da6d3807f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:57:16.956684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a9563a14-67dd-48f8-9540-272cfd3dc4f0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:16.957397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a9563a14-67dd-48f8-9540-272cfd3dc4f0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:16.987812 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cd15ea23-425e-4fc0-b52a-7eef4a6a7f9b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 200 len: 1421 microversion: 2.1 time: 0.149850 Oct 27 18:57:16.990840 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1485/2861] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:16 2022] GET /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 1421 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:17.006510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-95cfa3e7-25d8-430d-aac2-b6f47adf3c23 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:17.007125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-95cfa3e7-25d8-430d-aac2-b6f47adf3c23 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:17.030205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95cfa3e7-25d8-430d-aac2-b6f47adf3c23 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:17.032756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95cfa3e7-25d8-430d-aac2-b6f47adf3c23 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:17.033635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95cfa3e7-25d8-430d-aac2-b6f47adf3c23 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:17.036796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95cfa3e7-25d8-430d-aac2-b6f47adf3c23 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:17.038923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95cfa3e7-25d8-430d-aac2-b6f47adf3c23 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:17.039748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95cfa3e7-25d8-430d-aac2-b6f47adf3c23 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:17.068798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a9563a14-67dd-48f8-9540-272cfd3dc4f0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:17.074316 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-95cfa3e7-25d8-430d-aac2-b6f47adf3c23 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] HTTP exception thrown: Instance f3b6f25f-ce24-45c5-b633-6a36808a0540 could not be found. Oct 27 18:57:17.076296 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a9563a14-67dd-48f8-9540-272cfd3dc4f0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1235 microversion: 2.1 time: 0.123793 Oct 27 18:57:17.090575 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1377/2862] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:16 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1235 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:17.091752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a6066cf9-0444-4517-8d4c-d50002a23948 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc87320db80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-95cfa3e7-25d8-430d-aac2-b6f47adf3c23 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Request method failure captured: Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 HTTP/1.1 Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPan3lZb8-6p71z-Eph1Fbackr4hzcP5VsGdfYLBmqnnCDQU_UdLDF9xRovTl3VxG9LHYQvDNdh5O9JgNzULqhfg7lNIiUFV-OlDodgyVNhoKwpRoJrKk6wV358uIBRl-E3DKlH5pYBThf2sVTIWNX4xk4ruEUIWv34picrVXjAdqo Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: bcefa097ed8d4bf8b7f0118786874cc1 Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bcefa097ed8d4bf8b7f0118786874cc1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: bcefa097ed8d4bf8b7f0118786874cc1 Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerDiskConfigTestJSON-2030697217-project Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 77434d4813ca426fbc20f386894c3176 Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerDiskConfigTestJSON-2030697217-project Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance f3b6f25f-ce24-45c5-b633-6a36808a0540 could not be found. Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'f3b6f25f-ce24-45c5-b633-6a36808a0540'} Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b6f25f-ce24-45c5-b633-6a36808a0540 could not be found. Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:57:17.097626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:57:17.103895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b6f25f-ce24-45c5-b633-6a36808a0540 could not be found. Oct 27 18:57:17.103895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:17.103895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:17.103895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:17.103895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:17.103895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:17.103895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:17.103895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:17.103895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:17.103895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b6f25f-ce24-45c5-b633-6a36808a0540 could not be found. Oct 27 18:57:17.103895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:17.103895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-95cfa3e7-25d8-430d-aac2-b6f47adf3c23 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Returning 404 to user: Instance f3b6f25f-ce24-45c5-b633-6a36808a0540 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:17.103895 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-95cfa3e7-25d8-430d-aac2-b6f47adf3c23 tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 404 len: 111 microversion: 2.1 time: 0.107193 Oct 27 18:57:17.103895 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1486/2863] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:57:16 2022] DELETE /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:57:17.109220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bc8250ff-ac57-4586-9b1b-8c7f8f831fea tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:17.109857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bc8250ff-ac57-4586-9b1b-8c7f8f831fea tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] [instance: f3b6f25f-ce24-45c5-b633-6a36808a0540] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:17.165744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc8250ff-ac57-4586-9b1b-8c7f8f831fea tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:17.182672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc8250ff-ac57-4586-9b1b-8c7f8f831fea tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:17.183403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc8250ff-ac57-4586-9b1b-8c7f8f831fea tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:17.185352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc8250ff-ac57-4586-9b1b-8c7f8f831fea tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:17.185849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc8250ff-ac57-4586-9b1b-8c7f8f831fea tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:17.186292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc8250ff-ac57-4586-9b1b-8c7f8f831fea tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:17.211005 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-bc8250ff-ac57-4586-9b1b-8c7f8f831fea tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] HTTP exception thrown: Instance f3b6f25f-ce24-45c5-b633-6a36808a0540 could not be found. Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bc8250ff-ac57-4586-9b1b-8c7f8f831fea tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Request method failure captured: Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 HTTP/1.1 Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPan3lZb8-6p71z-Eph1Fbackr4hzcP5VsGdfYLBmqnnCDQU_UdLDF9xRovTl3VxG9LHYQvDNdh5O9JgNzULqhfg7lNIiUFV-OlDodgyVNhoKwpRoJrKk6wV358uIBRl-E3DKlH5pYBThf2sVTIWNX4xk4ruEUIWv34picrVXjAdqo Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: bcefa097ed8d4bf8b7f0118786874cc1 Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bcefa097ed8d4bf8b7f0118786874cc1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bcefa097ed8d4bf8b7f0118786874cc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: bcefa097ed8d4bf8b7f0118786874cc1 Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2030697217 Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerDiskConfigTestJSON-2030697217-project Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 77434d4813ca426fbc20f386894c3176 Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerDiskConfigTestJSON-2030697217-project Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance f3b6f25f-ce24-45c5-b633-6a36808a0540 could not be found. Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'f3b6f25f-ce24-45c5-b633-6a36808a0540'} Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b6f25f-ce24-45c5-b633-6a36808a0540 could not be found. Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b6f25f-ce24-45c5-b633-6a36808a0540 could not be found. Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:17.212578 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:17.216818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:17.216818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:17.216818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:17.216818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:17.216818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:17.216818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b6f25f-ce24-45c5-b633-6a36808a0540 could not be found. Oct 27 18:57:17.216818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:17.216818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bc8250ff-ac57-4586-9b1b-8c7f8f831fea tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] Returning 404 to user: Instance f3b6f25f-ce24-45c5-b633-6a36808a0540 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:17.216818 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bc8250ff-ac57-4586-9b1b-8c7f8f831fea tempest-ServerDiskConfigTestJSON-2030697217 tempest-ServerDiskConfigTestJSON-2030697217-project] 10.222.0.42 "GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540" status: 404 len: 111 microversion: 2.1 time: 0.108605 Oct 27 18:57:17.259314 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1487/2864] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:17 2022] GET /compute/v2.1/servers/f3b6f25f-ce24-45c5-b633-6a36808a0540 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:57:17.265158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8b0c2fd6-1044-4f96-9011-c8b7e5d23114 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:17.266271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8b0c2fd6-1044-4f96-9011-c8b7e5d23114 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:17.274056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b0c2fd6-1044-4f96-9011-c8b7e5d23114 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:17.275142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b0c2fd6-1044-4f96-9011-c8b7e5d23114 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:17.275913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b0c2fd6-1044-4f96-9011-c8b7e5d23114 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:17.276882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b0c2fd6-1044-4f96-9011-c8b7e5d23114 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:17.278007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b0c2fd6-1044-4f96-9011-c8b7e5d23114 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:17.278728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b0c2fd6-1044-4f96-9011-c8b7e5d23114 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:18.518301 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a6066cf9-0444-4517-8d4c-d50002a23948 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 204 len: 0 microversion: 2.1 time: 1.437980 Oct 27 18:57:18.523351 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1378/2865] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:17 2022] DELETE /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 0 bytes in 1440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:57:18.529707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-73b2c517-d963-4364-b4b2-ced1493fd1ca tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:18.531153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-73b2c517-d963-4364-b4b2-ced1493fd1ca tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:18.582996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b2c517-d963-4364-b4b2-ced1493fd1ca tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:18.583710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b2c517-d963-4364-b4b2-ced1493fd1ca tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:18.584336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b2c517-d963-4364-b4b2-ced1493fd1ca tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:18.585238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b2c517-d963-4364-b4b2-ced1493fd1ca tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:18.587850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b2c517-d963-4364-b4b2-ced1493fd1ca tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:18.588900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b2c517-d963-4364-b4b2-ced1493fd1ca tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:18.664784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8b0c2fd6-1044-4f96-9011-c8b7e5d23114 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:18.675633 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8b0c2fd6-1044-4f96-9011-c8b7e5d23114 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 1.414753 Oct 27 18:57:18.701373 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1488/2866] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:17 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:18.715974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0cd7536f-8164-4bfa-a1b2-4e7f0966b7a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:18.719095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0cd7536f-8164-4bfa-a1b2-4e7f0966b7a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:18.750692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cd7536f-8164-4bfa-a1b2-4e7f0966b7a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:18.755368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cd7536f-8164-4bfa-a1b2-4e7f0966b7a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:18.755871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cd7536f-8164-4bfa-a1b2-4e7f0966b7a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:18.762544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cd7536f-8164-4bfa-a1b2-4e7f0966b7a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:18.764499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cd7536f-8164-4bfa-a1b2-4e7f0966b7a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:18.766578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cd7536f-8164-4bfa-a1b2-4e7f0966b7a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:19.045811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0cd7536f-8164-4bfa-a1b2-4e7f0966b7a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:19.055679 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0cd7536f-8164-4bfa-a1b2-4e7f0966b7a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1287 microversion: 2.1 time: 0.350353 Oct 27 18:57:19.065786 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1489/2867] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:18 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1287 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:19.070912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ab36f306-db9f-45aa-b107-b68c1ddb2d86 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:19.071651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ab36f306-db9f-45aa-b107-b68c1ddb2d86 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:19.093696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab36f306-db9f-45aa-b107-b68c1ddb2d86 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:19.111348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab36f306-db9f-45aa-b107-b68c1ddb2d86 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:19.112191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab36f306-db9f-45aa-b107-b68c1ddb2d86 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:19.113223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab36f306-db9f-45aa-b107-b68c1ddb2d86 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:19.113943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab36f306-db9f-45aa-b107-b68c1ddb2d86 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:19.114655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab36f306-db9f-45aa-b107-b68c1ddb2d86 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:19.194435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ab36f306-db9f-45aa-b107-b68c1ddb2d86 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:57:19.391834 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ab36f306-db9f-45aa-b107-b68c1ddb2d86 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 204 len: 0 microversion: 2.1 time: 0.324314 Oct 27 18:57:19.393778 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1490/2868] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:57:19 2022] DELETE /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:57:19.444773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-73b2c517-d963-4364-b4b2-ced1493fd1ca tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:19.460872 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-73b2c517-d963-4364-b4b2-ced1493fd1ca tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.934517 Oct 27 18:57:19.478080 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1379/2869] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:18 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:19.670412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-879400947", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "bd2a2055-53fd-4e07-8727-b0efd4106712"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:19.711812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2fa33724-83da-4784-9a94-a79eb6d70760 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:19.712742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2fa33724-83da-4784-9a94-a79eb6d70760 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:19.739160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fa33724-83da-4784-9a94-a79eb6d70760 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:19.745498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fa33724-83da-4784-9a94-a79eb6d70760 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:19.747119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fa33724-83da-4784-9a94-a79eb6d70760 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:19.751181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fa33724-83da-4784-9a94-a79eb6d70760 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:19.769156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fa33724-83da-4784-9a94-a79eb6d70760 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:19.771202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fa33724-83da-4784-9a94-a79eb6d70760 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:19.821993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] validate_networks() for [('bd2a2055-53fd-4e07-8727-b0efd4106712', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:57:20.069343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2fa33724-83da-4784-9a94-a79eb6d70760 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:20.086715 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2fa33724-83da-4784-9a94-a79eb6d70760 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.375885 Oct 27 18:57:20.105302 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1380/2870] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:19 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:20.117524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fd0a66f6-e965-4d3f-8984-0feb68b981be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:20.118493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fd0a66f6-e965-4d3f-8984-0feb68b981be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:20.137736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd0a66f6-e965-4d3f-8984-0feb68b981be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:20.138769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd0a66f6-e965-4d3f-8984-0feb68b981be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:20.139401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd0a66f6-e965-4d3f-8984-0feb68b981be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:20.140940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd0a66f6-e965-4d3f-8984-0feb68b981be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:20.141762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd0a66f6-e965-4d3f-8984-0feb68b981be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:20.142369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd0a66f6-e965-4d3f-8984-0feb68b981be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:20.262691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd0a66f6-e965-4d3f-8984-0feb68b981be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:20.279789 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fd0a66f6-e965-4d3f-8984-0feb68b981be tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1293 microversion: 2.1 time: 0.173264 Oct 27 18:57:20.291875 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1381/2871] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:20 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1293 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:20.490812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5afb189b-ccc0-47ba-94be-c04bef87b961 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:20.491864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5afb189b-ccc0-47ba-94be-c04bef87b961 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:20.497893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:20.500522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5afb189b-ccc0-47ba-94be-c04bef87b961 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:20.501360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5afb189b-ccc0-47ba-94be-c04bef87b961 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:20.502102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5afb189b-ccc0-47ba-94be-c04bef87b961 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:20.503105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5afb189b-ccc0-47ba-94be-c04bef87b961 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:20.503791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5afb189b-ccc0-47ba-94be-c04bef87b961 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:20.504462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5afb189b-ccc0-47ba-94be-c04bef87b961 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:20.786060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5afb189b-ccc0-47ba-94be-c04bef87b961 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:20.802591 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5afb189b-ccc0-47ba-94be-c04bef87b961 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.315642 Oct 27 18:57:20.806893 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1382/2872] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:20 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:21.121423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fbc80b85-894f-4d5c-a30e-bb7e8d2b03c5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:21.122280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fbc80b85-894f-4d5c-a30e-bb7e8d2b03c5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:21.148644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbc80b85-894f-4d5c-a30e-bb7e8d2b03c5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:21.149069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbc80b85-894f-4d5c-a30e-bb7e8d2b03c5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:21.153817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbc80b85-894f-4d5c-a30e-bb7e8d2b03c5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:21.158657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbc80b85-894f-4d5c-a30e-bb7e8d2b03c5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:21.160039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbc80b85-894f-4d5c-a30e-bb7e8d2b03c5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:21.160502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbc80b85-894f-4d5c-a30e-bb7e8d2b03c5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:21.822929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fbc80b85-894f-4d5c-a30e-bb7e8d2b03c5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:21.849622 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fbc80b85-894f-4d5c-a30e-bb7e8d2b03c5 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.733953 Oct 27 18:57:21.865655 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1383/2873] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:21 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:21.876616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c4ff4313-39f1-462c-923f-3d9bb4e7851d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:21.878190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c4ff4313-39f1-462c-923f-3d9bb4e7851d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:21.894290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ff4313-39f1-462c-923f-3d9bb4e7851d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:21.895748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ff4313-39f1-462c-923f-3d9bb4e7851d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:21.896394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ff4313-39f1-462c-923f-3d9bb4e7851d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:21.897500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ff4313-39f1-462c-923f-3d9bb4e7851d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:21.898178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ff4313-39f1-462c-923f-3d9bb4e7851d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:21.899026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ff4313-39f1-462c-923f-3d9bb4e7851d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:22.057295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:57:22.057780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:57:22.058200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:57:22.058661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:57:22.059073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:57:22.088822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:22.090520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:22.091252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:22.092243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:22.092919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:22.093672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:22.119415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Getting quotas for project 75c41c5833484551b422742abfad598f. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:57:22.128229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Getting quotas for user ac1e2f62e22b4e52badd230ef175817e and project 75c41c5833484551b422742abfad598f. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:57:22.144688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:57:22.147519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:57:22.207460 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-216c70b5-1cb9-4e79-810b-b0c3cf27df52 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.541314 Oct 27 18:57:22.209278 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1491/2874] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:57:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:57:22.214758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-740db134-be7c-4970-acf9-cdf193ebd796 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:22.215919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-740db134-be7c-4970-acf9-cdf193ebd796 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:22.225355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-740db134-be7c-4970-acf9-cdf193ebd796 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:22.226280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-740db134-be7c-4970-acf9-cdf193ebd796 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:22.227150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-740db134-be7c-4970-acf9-cdf193ebd796 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:22.228599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-740db134-be7c-4970-acf9-cdf193ebd796 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:22.229670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-740db134-be7c-4970-acf9-cdf193ebd796 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:22.230348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-740db134-be7c-4970-acf9-cdf193ebd796 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:22.602512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c4ff4313-39f1-462c-923f-3d9bb4e7851d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:22.618986 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c4ff4313-39f1-462c-923f-3d9bb4e7851d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1361 microversion: 2.1 time: 0.751704 Oct 27 18:57:22.619581 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1384/2875] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:21 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1361 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:22.639646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-2d318a05-dddc-4c39-8083-ca0469fce896 req-710f62d7-a266-4e1f-9a63-a12f85ddc7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a2f813e-a5e5-4146-a05c-ebf2f66d5c28", "name": "network-vif-unplugged", "status": "completed", "tag": "d055e6c0-257b-49c3-8af8-8b0ef8ef1516"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:22.692371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2d318a05-dddc-4c39-8083-ca0469fce896 req-710f62d7-a266-4e1f-9a63-a12f85ddc7a7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:22.694065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2d318a05-dddc-4c39-8083-ca0469fce896 req-710f62d7-a266-4e1f-9a63-a12f85ddc7a7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:22.696744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2d318a05-dddc-4c39-8083-ca0469fce896 req-710f62d7-a266-4e1f-9a63-a12f85ddc7a7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:22.728833 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-2d318a05-dddc-4c39-8083-ca0469fce896 req-710f62d7-a266-4e1f-9a63-a12f85ddc7a7 service nova] Creating event network-vif-unplugged:d055e6c0-257b-49c3-8af8-8b0ef8ef1516 for instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 on n-h2-860687-3 Oct 27 18:57:22.739789 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-2d318a05-dddc-4c39-8083-ca0469fce896 req-710f62d7-a266-4e1f-9a63-a12f85ddc7a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115399 Oct 27 18:57:22.746562 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1385/2876] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:22.758345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ead25594-5597-4198-b184-fbf731dc36e5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:22.763965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ead25594-5597-4198-b184-fbf731dc36e5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:22.914364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ead25594-5597-4198-b184-fbf731dc36e5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:22.922861 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ead25594-5597-4198-b184-fbf731dc36e5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1207 microversion: 2.1 time: 0.174446 Oct 27 18:57:22.926966 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1386/2877] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:22 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1207 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:22.941876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b40c9752-e07e-401b-99de-16de2c8f32ff tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:22.942584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b40c9752-e07e-401b-99de-16de2c8f32ff tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:22.975574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b40c9752-e07e-401b-99de-16de2c8f32ff tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:22.976181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b40c9752-e07e-401b-99de-16de2c8f32ff tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:22.978693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b40c9752-e07e-401b-99de-16de2c8f32ff tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:22.985874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b40c9752-e07e-401b-99de-16de2c8f32ff tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:22.987542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b40c9752-e07e-401b-99de-16de2c8f32ff tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:22.992909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b40c9752-e07e-401b-99de-16de2c8f32ff tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:23.069581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-740db134-be7c-4970-acf9-cdf193ebd796 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:23.080053 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-740db134-be7c-4970-acf9-cdf193ebd796 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.869218 Oct 27 18:57:23.086335 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1492/2878] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:22 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:23.460369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-4cb08007-2cd6-418b-a611-94c9e7ccab8b req-6ed1a037-a174-4650-826c-537402629fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a2f813e-a5e5-4146-a05c-ebf2f66d5c28", "name": "network-vif-deleted", "tag": "d055e6c0-257b-49c3-8af8-8b0ef8ef1516"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:23.491359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4cb08007-2cd6-418b-a611-94c9e7ccab8b req-6ed1a037-a174-4650-826c-537402629fa6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:23.492147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4cb08007-2cd6-418b-a611-94c9e7ccab8b req-6ed1a037-a174-4650-826c-537402629fa6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:23.492921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4cb08007-2cd6-418b-a611-94c9e7ccab8b req-6ed1a037-a174-4650-826c-537402629fa6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:23.508367 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-4cb08007-2cd6-418b-a611-94c9e7ccab8b req-6ed1a037-a174-4650-826c-537402629fa6 service nova] Creating event network-vif-deleted:d055e6c0-257b-49c3-8af8-8b0ef8ef1516 for instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 on n-h2-860687-3 Oct 27 18:57:23.515793 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-4cb08007-2cd6-418b-a611-94c9e7ccab8b req-6ed1a037-a174-4650-826c-537402629fa6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059873 Oct 27 18:57:23.517360 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1493/2879] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:57:23.548796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b40c9752-e07e-401b-99de-16de2c8f32ff tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:23.568681 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b40c9752-e07e-401b-99de-16de2c8f32ff tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.634967 Oct 27 18:57:23.582441 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1387/2880] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:22 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:23.651158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e129dac3-9268-467f-b264-e97844c197fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:23.652183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e129dac3-9268-467f-b264-e97844c197fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:23.675816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e129dac3-9268-467f-b264-e97844c197fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:23.679744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e129dac3-9268-467f-b264-e97844c197fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:23.682347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e129dac3-9268-467f-b264-e97844c197fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:23.686293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e129dac3-9268-467f-b264-e97844c197fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:23.687862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e129dac3-9268-467f-b264-e97844c197fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:23.689665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e129dac3-9268-467f-b264-e97844c197fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:23.957409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-63d6f502-ced2-4338-ad3c-732b7ca7af0e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:23.958311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-63d6f502-ced2-4338-ad3c-732b7ca7af0e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:23.973257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d6f502-ced2-4338-ad3c-732b7ca7af0e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:23.976027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d6f502-ced2-4338-ad3c-732b7ca7af0e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:23.978988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d6f502-ced2-4338-ad3c-732b7ca7af0e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:23.981749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d6f502-ced2-4338-ad3c-732b7ca7af0e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:23.984423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d6f502-ced2-4338-ad3c-732b7ca7af0e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:23.985170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d6f502-ced2-4338-ad3c-732b7ca7af0e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:24.182329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-63d6f502-ced2-4338-ad3c-732b7ca7af0e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:24.193591 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-63d6f502-ced2-4338-ad3c-732b7ca7af0e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1259 microversion: 2.1 time: 0.242942 Oct 27 18:57:24.197868 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1388/2881] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:23 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:24.211273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a094deab-b5d4-4aad-a0cc-ee31382a330b tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:24.213755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a094deab-b5d4-4aad-a0cc-ee31382a330b tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:24.229705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a094deab-b5d4-4aad-a0cc-ee31382a330b tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:24.230284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a094deab-b5d4-4aad-a0cc-ee31382a330b tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:24.232429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a094deab-b5d4-4aad-a0cc-ee31382a330b tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:24.233296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a094deab-b5d4-4aad-a0cc-ee31382a330b tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:24.236557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a094deab-b5d4-4aad-a0cc-ee31382a330b tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:24.237152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a094deab-b5d4-4aad-a0cc-ee31382a330b tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:24.739333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a094deab-b5d4-4aad-a0cc-ee31382a330b tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:24.750783 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a094deab-b5d4-4aad-a0cc-ee31382a330b tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.548530 Oct 27 18:57:24.773247 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1389/2882] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:24 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:24.779687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2524f15a-5cd8-44f3-9308-5f87afd59784 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:24.783373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e129dac3-9268-467f-b264-e97844c197fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:24.795398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2524f15a-5cd8-44f3-9308-5f87afd59784 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:24.795706 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e129dac3-9268-467f-b264-e97844c197fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1361 microversion: 2.1 time: 1.149643 Oct 27 18:57:24.797410 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1494/2883] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:23 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1361 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:24.804901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2524f15a-5cd8-44f3-9308-5f87afd59784 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:24.805451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2524f15a-5cd8-44f3-9308-5f87afd59784 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:24.805909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2524f15a-5cd8-44f3-9308-5f87afd59784 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:24.806780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2524f15a-5cd8-44f3-9308-5f87afd59784 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:24.807765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2524f15a-5cd8-44f3-9308-5f87afd59784 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:24.807873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2524f15a-5cd8-44f3-9308-5f87afd59784 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:25.225021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-716a19cc-705c-48c2-800b-901209b64cb0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:25.226012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-716a19cc-705c-48c2-800b-901209b64cb0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:25.250838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-716a19cc-705c-48c2-800b-901209b64cb0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:25.256057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-716a19cc-705c-48c2-800b-901209b64cb0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:25.260647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-716a19cc-705c-48c2-800b-901209b64cb0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:25.268269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-716a19cc-705c-48c2-800b-901209b64cb0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:25.269245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-716a19cc-705c-48c2-800b-901209b64cb0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:25.273433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-716a19cc-705c-48c2-800b-901209b64cb0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:25.481277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-716a19cc-705c-48c2-800b-901209b64cb0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:25.508638 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-716a19cc-705c-48c2-800b-901209b64cb0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1277 microversion: 2.1 time: 0.274196 Oct 27 18:57:25.514281 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1495/2884] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:25 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1277 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:25.607567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-34466637-6068-4fe8-b1fa-4d0d40f804e8 req-8e6f7e3c-5d2c-4fd7-a32d-4a9530d32cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69afa571-c5fa-4091-9ce1-5dd147316161", "tag": "a647c899-2362-49df-acbd-1cd3b9f8ec32"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:25.628719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-34466637-6068-4fe8-b1fa-4d0d40f804e8 req-8e6f7e3c-5d2c-4fd7-a32d-4a9530d32cc3 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:25.629232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-34466637-6068-4fe8-b1fa-4d0d40f804e8 req-8e6f7e3c-5d2c-4fd7-a32d-4a9530d32cc3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:25.632042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-34466637-6068-4fe8-b1fa-4d0d40f804e8 req-8e6f7e3c-5d2c-4fd7-a32d-4a9530d32cc3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:25.654620 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-34466637-6068-4fe8-b1fa-4d0d40f804e8 req-8e6f7e3c-5d2c-4fd7-a32d-4a9530d32cc3 service nova] Creating event network-changed:a647c899-2362-49df-acbd-1cd3b9f8ec32 for instance 69afa571-c5fa-4091-9ce1-5dd147316161 on n-h1-860687-3 Oct 27 18:57:25.673752 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-34466637-6068-4fe8-b1fa-4d0d40f804e8 req-8e6f7e3c-5d2c-4fd7-a32d-4a9530d32cc3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070840 Oct 27 18:57:25.680641 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1496/2885] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:25.781254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-48921153-f41c-4a64-b3ec-340475663ee1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:25.781883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-48921153-f41c-4a64-b3ec-340475663ee1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:25.827974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48921153-f41c-4a64-b3ec-340475663ee1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:25.828846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48921153-f41c-4a64-b3ec-340475663ee1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:25.835990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48921153-f41c-4a64-b3ec-340475663ee1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:25.836928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48921153-f41c-4a64-b3ec-340475663ee1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:25.841306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48921153-f41c-4a64-b3ec-340475663ee1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:25.843967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48921153-f41c-4a64-b3ec-340475663ee1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:25.865556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2524f15a-5cd8-44f3-9308-5f87afd59784 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:25.877729 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2524f15a-5cd8-44f3-9308-5f87afd59784 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 1.102504 Oct 27 18:57:25.889952 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1390/2886] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:24 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:25.907365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-477e0344-c8aa-4520-babb-241b4cff4eb9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:25.925910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-477e0344-c8aa-4520-babb-241b4cff4eb9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:25.942169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-477e0344-c8aa-4520-babb-241b4cff4eb9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:25.957239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-477e0344-c8aa-4520-babb-241b4cff4eb9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:25.961024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-477e0344-c8aa-4520-babb-241b4cff4eb9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:25.962086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-477e0344-c8aa-4520-babb-241b4cff4eb9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:25.963153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-477e0344-c8aa-4520-babb-241b4cff4eb9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:25.969209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-477e0344-c8aa-4520-babb-241b4cff4eb9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:26.012613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:26.657535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-477e0344-c8aa-4520-babb-241b4cff4eb9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:26.669027 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-477e0344-c8aa-4520-babb-241b4cff4eb9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1361 microversion: 2.1 time: 0.776867 Oct 27 18:57:26.683562 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1391/2887] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:25 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1361 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:26.695313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-492ee03f-44f6-446a-a706-bb6ba82d6961 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:26.696234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-492ee03f-44f6-446a-a706-bb6ba82d6961 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:26.703350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-492ee03f-44f6-446a-a706-bb6ba82d6961 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:26.704812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-492ee03f-44f6-446a-a706-bb6ba82d6961 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:26.705527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-492ee03f-44f6-446a-a706-bb6ba82d6961 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:26.707194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-492ee03f-44f6-446a-a706-bb6ba82d6961 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:26.707987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-492ee03f-44f6-446a-a706-bb6ba82d6961 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:26.708696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-492ee03f-44f6-446a-a706-bb6ba82d6961 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:26.767027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:26.814902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-48921153-f41c-4a64-b3ec-340475663ee1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:26.826731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-492ee03f-44f6-446a-a706-bb6ba82d6961 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:26.836453 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-492ee03f-44f6-446a-a706-bb6ba82d6961 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1265 microversion: 2.1 time: 0.151580 Oct 27 18:57:26.836858 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-48921153-f41c-4a64-b3ec-340475663ee1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 1.060638 Oct 27 18:57:26.837485 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1497/2888] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:25 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:26.840575 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1392/2889] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:26 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:26.918159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d43c29ae-7626-4b0c-ba68-789e90da0b77 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:26.918159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d43c29ae-7626-4b0c-ba68-789e90da0b77 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:26.929440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d43c29ae-7626-4b0c-ba68-789e90da0b77 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:26.929985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d43c29ae-7626-4b0c-ba68-789e90da0b77 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:26.936660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d43c29ae-7626-4b0c-ba68-789e90da0b77 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:26.937817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d43c29ae-7626-4b0c-ba68-789e90da0b77 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:26.938530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d43c29ae-7626-4b0c-ba68-789e90da0b77 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:26.939245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d43c29ae-7626-4b0c-ba68-789e90da0b77 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:27.302708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d43c29ae-7626-4b0c-ba68-789e90da0b77 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:27.334248 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d43c29ae-7626-4b0c-ba68-789e90da0b77 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.420552 Oct 27 18:57:27.336838 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1498/2890] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:26 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:27.700935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e13efed-a3a4-49b4-a089-fa3e40b08ddb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:27.701551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e13efed-a3a4-49b4-a089-fa3e40b08ddb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:27.724295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e13efed-a3a4-49b4-a089-fa3e40b08ddb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:27.724805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e13efed-a3a4-49b4-a089-fa3e40b08ddb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:27.725258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e13efed-a3a4-49b4-a089-fa3e40b08ddb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:27.725985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e13efed-a3a4-49b4-a089-fa3e40b08ddb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:27.726477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e13efed-a3a4-49b4-a089-fa3e40b08ddb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:27.726919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e13efed-a3a4-49b4-a089-fa3e40b08ddb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:27.863743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a75dc00e-796f-4fea-b839-f9c229c849c3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:27.865413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a75dc00e-796f-4fea-b839-f9c229c849c3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:27.885412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a75dc00e-796f-4fea-b839-f9c229c849c3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:27.886204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a75dc00e-796f-4fea-b839-f9c229c849c3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:27.887120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a75dc00e-796f-4fea-b839-f9c229c849c3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:27.888163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a75dc00e-796f-4fea-b839-f9c229c849c3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:27.888703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a75dc00e-796f-4fea-b839-f9c229c849c3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:27.889464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a75dc00e-796f-4fea-b839-f9c229c849c3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:27.993155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e13efed-a3a4-49b4-a089-fa3e40b08ddb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:28.038899 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e13efed-a3a4-49b4-a089-fa3e40b08ddb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1361 microversion: 2.1 time: 0.341607 Oct 27 18:57:28.039827 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1393/2891] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:27 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1361 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:28.044863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e3c159d1-0f0b-4053-82e8-239be07e3c53 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:28.046304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e3c159d1-0f0b-4053-82e8-239be07e3c53 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:28.054763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3c159d1-0f0b-4053-82e8-239be07e3c53 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:28.055895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3c159d1-0f0b-4053-82e8-239be07e3c53 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:28.056665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3c159d1-0f0b-4053-82e8-239be07e3c53 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:28.057438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3c159d1-0f0b-4053-82e8-239be07e3c53 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:28.057969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3c159d1-0f0b-4053-82e8-239be07e3c53 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:28.058529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3c159d1-0f0b-4053-82e8-239be07e3c53 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:28.318343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a75dc00e-796f-4fea-b839-f9c229c849c3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:28.332065 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a75dc00e-796f-4fea-b839-f9c229c849c3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.474658 Oct 27 18:57:28.352805 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1499/2892] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:27 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:28.362950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-70260b3d-b109-472a-9d63-e826575e5fe2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:28.364274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-70260b3d-b109-472a-9d63-e826575e5fe2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:28.372634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70260b3d-b109-472a-9d63-e826575e5fe2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:28.373175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70260b3d-b109-472a-9d63-e826575e5fe2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:28.373927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70260b3d-b109-472a-9d63-e826575e5fe2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:28.375677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70260b3d-b109-472a-9d63-e826575e5fe2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:28.376723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70260b3d-b109-472a-9d63-e826575e5fe2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:28.377369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70260b3d-b109-472a-9d63-e826575e5fe2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:28.541632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e3c159d1-0f0b-4053-82e8-239be07e3c53 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:28.555767 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e3c159d1-0f0b-4053-82e8-239be07e3c53 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1307 microversion: 2.1 time: 0.513548 Oct 27 18:57:28.557376 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1394/2893] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:28 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1307 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:28.606525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-70260b3d-b109-472a-9d63-e826575e5fe2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:28.622876 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-70260b3d-b109-472a-9d63-e826575e5fe2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.264635 Oct 27 18:57:28.626118 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1500/2894] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:28 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:29.068258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-10eab585-6453-4cd4-bea5-7070a127aad1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:29.070109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-10eab585-6453-4cd4-bea5-7070a127aad1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:29.096227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10eab585-6453-4cd4-bea5-7070a127aad1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:29.101621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10eab585-6453-4cd4-bea5-7070a127aad1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:29.102925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10eab585-6453-4cd4-bea5-7070a127aad1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:29.110426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10eab585-6453-4cd4-bea5-7070a127aad1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:29.111589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10eab585-6453-4cd4-bea5-7070a127aad1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:29.120648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10eab585-6453-4cd4-bea5-7070a127aad1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:29.364250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fc98c225-4026-4e70-8361-13cbba432150 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:29.365028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fc98c225-4026-4e70-8361-13cbba432150 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:29.375399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc98c225-4026-4e70-8361-13cbba432150 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:29.378866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc98c225-4026-4e70-8361-13cbba432150 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:29.379483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc98c225-4026-4e70-8361-13cbba432150 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:29.380447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc98c225-4026-4e70-8361-13cbba432150 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:29.382957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc98c225-4026-4e70-8361-13cbba432150 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:29.383511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc98c225-4026-4e70-8361-13cbba432150 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:29.521915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-10eab585-6453-4cd4-bea5-7070a127aad1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:29.572572 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-10eab585-6453-4cd4-bea5-7070a127aad1 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1361 microversion: 2.1 time: 0.511446 Oct 27 18:57:29.593899 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1395/2895] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:29 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1361 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:29.599325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-25c4a612-c6b7-4e90-971b-59276d9a5d9b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:29.600257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-25c4a612-c6b7-4e90-971b-59276d9a5d9b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:29.616338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25c4a612-c6b7-4e90-971b-59276d9a5d9b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:29.617067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25c4a612-c6b7-4e90-971b-59276d9a5d9b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:29.617747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25c4a612-c6b7-4e90-971b-59276d9a5d9b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:29.618722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25c4a612-c6b7-4e90-971b-59276d9a5d9b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:29.620454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25c4a612-c6b7-4e90-971b-59276d9a5d9b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:29.621110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25c4a612-c6b7-4e90-971b-59276d9a5d9b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:30.119984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fc98c225-4026-4e70-8361-13cbba432150 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:30.133676 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fc98c225-4026-4e70-8361-13cbba432150 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.772979 Oct 27 18:57:30.134959 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1501/2896] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:29 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:30.140089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-25c4a612-c6b7-4e90-971b-59276d9a5d9b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:30.145374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e916c28e-3a3e-419a-8cc9-f414dfcdf274 req-d5d568de-a771-44f5-af61-a76ce918e28b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69afa571-c5fa-4091-9ce1-5dd147316161", "name": "network-vif-plugged", "status": "completed", "tag": "a647c899-2362-49df-acbd-1cd3b9f8ec32"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:30.152216 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-25c4a612-c6b7-4e90-971b-59276d9a5d9b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1307 microversion: 2.1 time: 0.556814 Oct 27 18:57:30.166960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e916c28e-3a3e-419a-8cc9-f414dfcdf274 req-d5d568de-a771-44f5-af61-a76ce918e28b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:30.167991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e916c28e-3a3e-419a-8cc9-f414dfcdf274 req-d5d568de-a771-44f5-af61-a76ce918e28b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:30.168745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e916c28e-3a3e-419a-8cc9-f414dfcdf274 req-d5d568de-a771-44f5-af61-a76ce918e28b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:30.172421 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1396/2897] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:29 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1307 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:30.179661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70d567fe-14b1-4b2b-b6df-a998e466a6a1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:30.180499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-70d567fe-14b1-4b2b-b6df-a998e466a6a1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:30.192463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70d567fe-14b1-4b2b-b6df-a998e466a6a1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:30.193181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70d567fe-14b1-4b2b-b6df-a998e466a6a1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:30.194091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70d567fe-14b1-4b2b-b6df-a998e466a6a1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:30.195001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70d567fe-14b1-4b2b-b6df-a998e466a6a1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:30.195677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70d567fe-14b1-4b2b-b6df-a998e466a6a1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:30.196378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70d567fe-14b1-4b2b-b6df-a998e466a6a1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:30.205335 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e916c28e-3a3e-419a-8cc9-f414dfcdf274 req-d5d568de-a771-44f5-af61-a76ce918e28b service nova] Creating event network-vif-plugged:a647c899-2362-49df-acbd-1cd3b9f8ec32 for instance 69afa571-c5fa-4091-9ce1-5dd147316161 on n-h1-860687-3 Oct 27 18:57:30.211904 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e916c28e-3a3e-419a-8cc9-f414dfcdf274 req-d5d568de-a771-44f5-af61-a76ce918e28b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075519 Oct 27 18:57:30.212529 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1502/2898] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:30.608044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c0b9c2e7-9a67-4b82-a74b-3c01a2259c06 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:30.615073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c0b9c2e7-9a67-4b82-a74b-3c01a2259c06 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:30.627597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-70d567fe-14b1-4b2b-b6df-a998e466a6a1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:30.640367 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70d567fe-14b1-4b2b-b6df-a998e466a6a1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.464866 Oct 27 18:57:30.644867 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1397/2899] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:30 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:30.652843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0b9c2e7-9a67-4b82-a74b-3c01a2259c06 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:30.656800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0b9c2e7-9a67-4b82-a74b-3c01a2259c06 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:30.657263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0b9c2e7-9a67-4b82-a74b-3c01a2259c06 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:30.659695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0b9c2e7-9a67-4b82-a74b-3c01a2259c06 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:30.660183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0b9c2e7-9a67-4b82-a74b-3c01a2259c06 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:30.662873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0b9c2e7-9a67-4b82-a74b-3c01a2259c06 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:31.058605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c0b9c2e7-9a67-4b82-a74b-3c01a2259c06 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:31.061867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:31.074200 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c0b9c2e7-9a67-4b82-a74b-3c01a2259c06 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1361 microversion: 2.1 time: 0.476121 Oct 27 18:57:31.074830 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1503/2900] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:30 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1361 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:31.161161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5c22446e-878f-465f-9062-786400601880 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:31.161788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5c22446e-878f-465f-9062-786400601880 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:31.175500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c22446e-878f-465f-9062-786400601880 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:31.176391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c22446e-878f-465f-9062-786400601880 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:31.177338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c22446e-878f-465f-9062-786400601880 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:31.178638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c22446e-878f-465f-9062-786400601880 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:31.179355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c22446e-878f-465f-9062-786400601880 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:31.179985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c22446e-878f-465f-9062-786400601880 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:31.183205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f0e92f1-5502-43cf-8bfe-443b5a014015 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:31.184769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6f0e92f1-5502-43cf-8bfe-443b5a014015 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:31.224808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f0e92f1-5502-43cf-8bfe-443b5a014015 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:31.226526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f0e92f1-5502-43cf-8bfe-443b5a014015 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:31.228135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f0e92f1-5502-43cf-8bfe-443b5a014015 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:31.229061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f0e92f1-5502-43cf-8bfe-443b5a014015 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:31.231545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f0e92f1-5502-43cf-8bfe-443b5a014015 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:31.234170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f0e92f1-5502-43cf-8bfe-443b5a014015 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:31.513060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6f0e92f1-5502-43cf-8bfe-443b5a014015 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:31.530312 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6f0e92f1-5502-43cf-8bfe-443b5a014015 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1307 microversion: 2.1 time: 0.351953 Oct 27 18:57:31.531241 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1504/2901] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:31 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1307 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:31.538356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-323ee885-b591-4f76-b278-29d75e091f6c req-6c9f1a8d-5952-4015-85a4-b7c86656d118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c280a00e-288a-4927-95e6-1f2b3880f240", "tag": "e3f7c665-6965-4529-a1e9-cf0c7c389160"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:31.582326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-323ee885-b591-4f76-b278-29d75e091f6c req-6c9f1a8d-5952-4015-85a4-b7c86656d118 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:31.583138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-323ee885-b591-4f76-b278-29d75e091f6c req-6c9f1a8d-5952-4015-85a4-b7c86656d118 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:31.583815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-323ee885-b591-4f76-b278-29d75e091f6c req-6c9f1a8d-5952-4015-85a4-b7c86656d118 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:31.622374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5c22446e-878f-465f-9062-786400601880 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:31.623573 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-323ee885-b591-4f76-b278-29d75e091f6c req-6c9f1a8d-5952-4015-85a4-b7c86656d118 service nova] Creating event network-changed:e3f7c665-6965-4529-a1e9-cf0c7c389160 for instance c280a00e-288a-4927-95e6-1f2b3880f240 on n-h2-860687-3 Oct 27 18:57:31.633325 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-323ee885-b591-4f76-b278-29d75e091f6c req-6c9f1a8d-5952-4015-85a4-b7c86656d118 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100401 Oct 27 18:57:31.640518 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1505/2902] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:31.666312 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5c22446e-878f-465f-9062-786400601880 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.504222 Oct 27 18:57:31.668913 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1398/2903] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:31 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:31.684551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9353defd-2aa9-4bb6-adeb-d08898504cb0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:31.685271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9353defd-2aa9-4bb6-adeb-d08898504cb0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:31.696369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9353defd-2aa9-4bb6-adeb-d08898504cb0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:31.697437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9353defd-2aa9-4bb6-adeb-d08898504cb0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:31.698138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9353defd-2aa9-4bb6-adeb-d08898504cb0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:31.699191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9353defd-2aa9-4bb6-adeb-d08898504cb0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:31.700054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9353defd-2aa9-4bb6-adeb-d08898504cb0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:31.700648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9353defd-2aa9-4bb6-adeb-d08898504cb0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:31.987163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9353defd-2aa9-4bb6-adeb-d08898504cb0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:32.000070 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9353defd-2aa9-4bb6-adeb-d08898504cb0 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.320531 Oct 27 18:57:32.000703 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1506/2904] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:31 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:32.107459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1fac6168-2d6f-4849-9aa5-1cae123296c0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:32.109809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1fac6168-2d6f-4849-9aa5-1cae123296c0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:32.128550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fac6168-2d6f-4849-9aa5-1cae123296c0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:32.129468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fac6168-2d6f-4849-9aa5-1cae123296c0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:32.131865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fac6168-2d6f-4849-9aa5-1cae123296c0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:32.133599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fac6168-2d6f-4849-9aa5-1cae123296c0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:32.135015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fac6168-2d6f-4849-9aa5-1cae123296c0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:32.135666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fac6168-2d6f-4849-9aa5-1cae123296c0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:32.559284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-950eb260-db71-4b28-a47c-8044e842cd0c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:32.560643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-950eb260-db71-4b28-a47c-8044e842cd0c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:32.567565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:32.568787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:32.571282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-950eb260-db71-4b28-a47c-8044e842cd0c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:32.572183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-950eb260-db71-4b28-a47c-8044e842cd0c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:32.572816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-950eb260-db71-4b28-a47c-8044e842cd0c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:32.573704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-950eb260-db71-4b28-a47c-8044e842cd0c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:32.574753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-950eb260-db71-4b28-a47c-8044e842cd0c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:32.575470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-950eb260-db71-4b28-a47c-8044e842cd0c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:32.781632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-950eb260-db71-4b28-a47c-8044e842cd0c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:32.795146 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-950eb260-db71-4b28-a47c-8044e842cd0c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1307 microversion: 2.1 time: 0.238863 Oct 27 18:57:32.796550 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1507/2905] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:32 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1307 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:32.812359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-38280578-784e-4837-8eaa-2ac9b7333ad1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:32.814205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-38280578-784e-4837-8eaa-2ac9b7333ad1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:32.833913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38280578-784e-4837-8eaa-2ac9b7333ad1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:32.834732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38280578-784e-4837-8eaa-2ac9b7333ad1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:32.835198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38280578-784e-4837-8eaa-2ac9b7333ad1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:32.836034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38280578-784e-4837-8eaa-2ac9b7333ad1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:32.836574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38280578-784e-4837-8eaa-2ac9b7333ad1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:32.837090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38280578-784e-4837-8eaa-2ac9b7333ad1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:32.838476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1fac6168-2d6f-4849-9aa5-1cae123296c0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:32.848974 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1fac6168-2d6f-4849-9aa5-1cae123296c0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1544 microversion: 2.1 time: 0.750038 Oct 27 18:57:32.849573 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1399/2906] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:32 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1544 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:32.876405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f9daf1cf-7d16-4d4e-bad1-2124dcc2568d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:32.877278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f9daf1cf-7d16-4d4e-bad1-2124dcc2568d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:32.893715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9daf1cf-7d16-4d4e-bad1-2124dcc2568d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:32.894535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9daf1cf-7d16-4d4e-bad1-2124dcc2568d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:32.895173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9daf1cf-7d16-4d4e-bad1-2124dcc2568d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:32.896055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9daf1cf-7d16-4d4e-bad1-2124dcc2568d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:32.896715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9daf1cf-7d16-4d4e-bad1-2124dcc2568d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:32.897348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9daf1cf-7d16-4d4e-bad1-2124dcc2568d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:32.925793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=14 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:33.041925 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f9daf1cf-7d16-4d4e-bad1-2124dcc2568d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170403 Oct 27 18:57:33.042378 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1400/2907] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 18:57:32 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:33.048073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-da90e369-0457-42d1-b2ad-73f6afc69caa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:33.048792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-da90e369-0457-42d1-b2ad-73f6afc69caa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:33.076725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da90e369-0457-42d1-b2ad-73f6afc69caa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:33.078244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da90e369-0457-42d1-b2ad-73f6afc69caa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:33.078973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da90e369-0457-42d1-b2ad-73f6afc69caa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:33.080568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da90e369-0457-42d1-b2ad-73f6afc69caa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:33.080736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da90e369-0457-42d1-b2ad-73f6afc69caa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:33.081279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da90e369-0457-42d1-b2ad-73f6afc69caa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:33.164935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-38280578-784e-4837-8eaa-2ac9b7333ad1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:33.185522 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-38280578-784e-4837-8eaa-2ac9b7333ad1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.387405 Oct 27 18:57:33.186835 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1508/2908] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:32 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:33.362965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1687283935", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": "none"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:33.432808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:57:33.433512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:57:33.434272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:57:33.434965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:57:33.435630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:57:33.449094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:33.449736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:33.450296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:33.451273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:33.451803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:33.452827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:33.467370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:33.477347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Getting quotas for project e6b49c85b2e84aff956d226684a2809b. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:57:33.485046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Getting quotas for user 0921dee96fbe40dcb0ecafd07b62f11e and project e6b49c85b2e84aff956d226684a2809b. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:57:33.502584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:57:33.505279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] [instance: cfe3f058-9949-42f3-b9b8-a51da1ba14f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:57:33.550049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-da90e369-0457-42d1-b2ad-73f6afc69caa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:33.559738 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8b7b19b8-1a36-40f3-bccb-99faec23eb68 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.371018 Oct 27 18:57:33.560778 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1509/2909] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 18:57:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 374 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 18:57:33.570748 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-da90e369-0457-42d1-b2ad-73f6afc69caa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.526768 Oct 27 18:57:33.582956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-604f2032-e878-43e2-991e-43635e172b54 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:33.583957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-604f2032-e878-43e2-991e-43635e172b54 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] [instance: cfe3f058-9949-42f3-b9b8-a51da1ba14f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:33.588017 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1401/2910] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:33 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:33.819677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9db32749-8d36-4fd7-a486-ce5f88225f05 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:33.820308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9db32749-8d36-4fd7-a486-ce5f88225f05 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:33.829175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9db32749-8d36-4fd7-a486-ce5f88225f05 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:33.829681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9db32749-8d36-4fd7-a486-ce5f88225f05 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:33.830137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9db32749-8d36-4fd7-a486-ce5f88225f05 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:33.837407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9db32749-8d36-4fd7-a486-ce5f88225f05 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:33.837917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9db32749-8d36-4fd7-a486-ce5f88225f05 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:33.838134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-604f2032-e878-43e2-991e-43635e172b54 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:33.838659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9db32749-8d36-4fd7-a486-ce5f88225f05 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:33.848584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-604f2032-e878-43e2-991e-43635e172b54 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:33.853929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-604f2032-e878-43e2-991e-43635e172b54 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:33.855173 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-604f2032-e878-43e2-991e-43635e172b54 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2" status: 200 len: 1281 microversion: 2.47 time: 0.285257 Oct 27 18:57:33.857924 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1510/2911] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:57:33 2022] GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2 => generated 1281 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:57:34.182819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9db32749-8d36-4fd7-a486-ce5f88225f05 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:34.212173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b4f80044-8d60-41af-b60a-d47602a3f8f6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:34.213447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b4f80044-8d60-41af-b60a-d47602a3f8f6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:34.214838 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9db32749-8d36-4fd7-a486-ce5f88225f05 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1307 microversion: 2.1 time: 0.398383 Oct 27 18:57:34.219417 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1402/2912] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:33 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1307 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:34.223614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4f80044-8d60-41af-b60a-d47602a3f8f6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:34.224634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4f80044-8d60-41af-b60a-d47602a3f8f6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:34.225653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4f80044-8d60-41af-b60a-d47602a3f8f6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:34.226887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4f80044-8d60-41af-b60a-d47602a3f8f6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:34.227582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4f80044-8d60-41af-b60a-d47602a3f8f6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:34.228287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4f80044-8d60-41af-b60a-d47602a3f8f6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:34.600304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6ab7eb49-28ac-4611-92e1-e8e8aa430a38 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:34.601668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6ab7eb49-28ac-4611-92e1-e8e8aa430a38 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:34.615301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ab7eb49-28ac-4611-92e1-e8e8aa430a38 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:34.618053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ab7eb49-28ac-4611-92e1-e8e8aa430a38 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:34.618843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ab7eb49-28ac-4611-92e1-e8e8aa430a38 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:34.620078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4f80044-8d60-41af-b60a-d47602a3f8f6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:34.620992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ab7eb49-28ac-4611-92e1-e8e8aa430a38 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:34.621945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ab7eb49-28ac-4611-92e1-e8e8aa430a38 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:34.622542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ab7eb49-28ac-4611-92e1-e8e8aa430a38 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:34.631673 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b4f80044-8d60-41af-b60a-d47602a3f8f6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.426125 Oct 27 18:57:34.634918 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1511/2913] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:34 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:34.887924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b4a6f6ba-35d8-41de-8f37-71bf57fad936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:34.889189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b4a6f6ba-35d8-41de-8f37-71bf57fad936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] [instance: cfe3f058-9949-42f3-b9b8-a51da1ba14f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:34.904584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4a6f6ba-35d8-41de-8f37-71bf57fad936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:34.908336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4a6f6ba-35d8-41de-8f37-71bf57fad936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:34.909471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4a6f6ba-35d8-41de-8f37-71bf57fad936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:34.910625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4a6f6ba-35d8-41de-8f37-71bf57fad936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:34.911287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4a6f6ba-35d8-41de-8f37-71bf57fad936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:34.912597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4a6f6ba-35d8-41de-8f37-71bf57fad936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:35.010507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4a6f6ba-35d8-41de-8f37-71bf57fad936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:35.022357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4a6f6ba-35d8-41de-8f37-71bf57fad936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:35.024289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4a6f6ba-35d8-41de-8f37-71bf57fad936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:35.025770 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b4a6f6ba-35d8-41de-8f37-71bf57fad936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2" status: 200 len: 1333 microversion: 2.47 time: 0.144612 Oct 27 18:57:35.026987 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1512/2914] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:57:34 2022] GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2 => generated 1333 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:57:35.049872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6ab7eb49-28ac-4611-92e1-e8e8aa430a38 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:35.060496 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6ab7eb49-28ac-4611-92e1-e8e8aa430a38 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.465279 Oct 27 18:57:35.062600 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1403/2915] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:34 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:35.244832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f36e4133-bd6d-4166-88cd-36cff3b4779b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:35.245722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f36e4133-bd6d-4166-88cd-36cff3b4779b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:35.256539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f36e4133-bd6d-4166-88cd-36cff3b4779b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:35.258191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f36e4133-bd6d-4166-88cd-36cff3b4779b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:35.258861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f36e4133-bd6d-4166-88cd-36cff3b4779b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:35.261233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f36e4133-bd6d-4166-88cd-36cff3b4779b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:35.262255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f36e4133-bd6d-4166-88cd-36cff3b4779b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:35.266819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f36e4133-bd6d-4166-88cd-36cff3b4779b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:35.611342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f36e4133-bd6d-4166-88cd-36cff3b4779b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:35.623606 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f36e4133-bd6d-4166-88cd-36cff3b4779b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1307 microversion: 2.1 time: 0.383749 Oct 27 18:57:35.638860 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1513/2916] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:35 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1307 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:35.657980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-47ff8103-36d8-41c3-8376-e1ae229212a9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:35.658667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-47ff8103-36d8-41c3-8376-e1ae229212a9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:35.665401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47ff8103-36d8-41c3-8376-e1ae229212a9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:35.665895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47ff8103-36d8-41c3-8376-e1ae229212a9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:35.666342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47ff8103-36d8-41c3-8376-e1ae229212a9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:35.667071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47ff8103-36d8-41c3-8376-e1ae229212a9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:35.667537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47ff8103-36d8-41c3-8376-e1ae229212a9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:35.667970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47ff8103-36d8-41c3-8376-e1ae229212a9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:35.962621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-76ef4aa0-f6b3-4ce6-ab12-1c9ae82efd85 req-fbae0216-199a-45ea-8f6c-bd4ef60d6880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69afa571-c5fa-4091-9ce1-5dd147316161", "tag": "a647c899-2362-49df-acbd-1cd3b9f8ec32"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:35.981541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-76ef4aa0-f6b3-4ce6-ab12-1c9ae82efd85 req-fbae0216-199a-45ea-8f6c-bd4ef60d6880 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:35.985507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-76ef4aa0-f6b3-4ce6-ab12-1c9ae82efd85 req-fbae0216-199a-45ea-8f6c-bd4ef60d6880 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:35.986139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-76ef4aa0-f6b3-4ce6-ab12-1c9ae82efd85 req-fbae0216-199a-45ea-8f6c-bd4ef60d6880 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:36.014942 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-76ef4aa0-f6b3-4ce6-ab12-1c9ae82efd85 req-fbae0216-199a-45ea-8f6c-bd4ef60d6880 service nova] Creating event network-changed:a647c899-2362-49df-acbd-1cd3b9f8ec32 for instance 69afa571-c5fa-4091-9ce1-5dd147316161 on n-h1-860687-3 Oct 27 18:57:36.032103 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-76ef4aa0-f6b3-4ce6-ab12-1c9ae82efd85 req-fbae0216-199a-45ea-8f6c-bd4ef60d6880 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074549 Oct 27 18:57:36.034375 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1514/2917] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:57:36.034501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-47ff8103-36d8-41c3-8376-e1ae229212a9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:36.048298 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-47ff8103-36d8-41c3-8376-e1ae229212a9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.394693 Oct 27 18:57:36.049180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-8c29f075-bfa5-48f0-9fcf-0abbdef96408 req-0e7172c4-82d3-4a21-9e21-f25f426674f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e311e1-6dd0-4498-897c-c92ce762d9b9", "name": "network-vif-plugged", "status": "completed", "tag": "5e0a3a4e-0c02-4bfb-b6c9-0aefa83bc658"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:36.051610 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1404/2918] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:35 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:36.065532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2eca43d4-93a9-4244-a6c1-4ab0fb8dc936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:36.066893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2eca43d4-93a9-4244-a6c1-4ab0fb8dc936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] [instance: cfe3f058-9949-42f3-b9b8-a51da1ba14f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:36.078475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8c29f075-bfa5-48f0-9fcf-0abbdef96408 req-0e7172c4-82d3-4a21-9e21-f25f426674f0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:36.079386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8c29f075-bfa5-48f0-9fcf-0abbdef96408 req-0e7172c4-82d3-4a21-9e21-f25f426674f0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:36.080359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8c29f075-bfa5-48f0-9fcf-0abbdef96408 req-0e7172c4-82d3-4a21-9e21-f25f426674f0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:36.084413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eca43d4-93a9-4244-a6c1-4ab0fb8dc936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:36.086807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eca43d4-93a9-4244-a6c1-4ab0fb8dc936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:36.087352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eca43d4-93a9-4244-a6c1-4ab0fb8dc936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:36.088111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eca43d4-93a9-4244-a6c1-4ab0fb8dc936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:36.088581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eca43d4-93a9-4244-a6c1-4ab0fb8dc936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:36.089015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eca43d4-93a9-4244-a6c1-4ab0fb8dc936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:36.095075 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8c29f075-bfa5-48f0-9fcf-0abbdef96408 req-0e7172c4-82d3-4a21-9e21-f25f426674f0 service nova] Creating event network-vif-plugged:5e0a3a4e-0c02-4bfb-b6c9-0aefa83bc658 for instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 on n-h2-860687-3 Oct 27 18:57:36.101981 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-8c29f075-bfa5-48f0-9fcf-0abbdef96408 req-0e7172c4-82d3-4a21-9e21-f25f426674f0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061641 Oct 27 18:57:36.103423 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1515/2919] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:36.110561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae964fd4-7d15-4240-915e-f74e2d074c27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:36.118541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ae964fd4-7d15-4240-915e-f74e2d074c27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:36.131840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae964fd4-7d15-4240-915e-f74e2d074c27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:36.132732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae964fd4-7d15-4240-915e-f74e2d074c27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:36.133570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae964fd4-7d15-4240-915e-f74e2d074c27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:36.135262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae964fd4-7d15-4240-915e-f74e2d074c27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:36.136296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae964fd4-7d15-4240-915e-f74e2d074c27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:36.136949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae964fd4-7d15-4240-915e-f74e2d074c27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:36.286920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2eca43d4-93a9-4244-a6c1-4ab0fb8dc936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:36.303561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2eca43d4-93a9-4244-a6c1-4ab0fb8dc936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:36.305914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2eca43d4-93a9-4244-a6c1-4ab0fb8dc936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:36.307778 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2eca43d4-93a9-4244-a6c1-4ab0fb8dc936 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2" status: 200 len: 1339 microversion: 2.47 time: 0.252529 Oct 27 18:57:36.308954 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1405/2920] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:57:36 2022] GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2 => generated 1339 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:57:36.550704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ae964fd4-7d15-4240-915e-f74e2d074c27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:36.564317 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ae964fd4-7d15-4240-915e-f74e2d074c27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.459240 Oct 27 18:57:36.584016 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1516/2921] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:36 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:36.647877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c49396e9-14f9-47e9-aa2e-569b41431e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:36.648444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c49396e9-14f9-47e9-aa2e-569b41431e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:36.658687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c49396e9-14f9-47e9-aa2e-569b41431e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:36.659200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c49396e9-14f9-47e9-aa2e-569b41431e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:36.659658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c49396e9-14f9-47e9-aa2e-569b41431e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:36.660387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c49396e9-14f9-47e9-aa2e-569b41431e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:36.660855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c49396e9-14f9-47e9-aa2e-569b41431e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:36.661340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c49396e9-14f9-47e9-aa2e-569b41431e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:36.915964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c49396e9-14f9-47e9-aa2e-569b41431e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:36.927754 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c49396e9-14f9-47e9-aa2e-569b41431e73 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1307 microversion: 2.1 time: 0.283910 Oct 27 18:57:36.928739 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1406/2922] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:36 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1307 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:37.079302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b3163b86-7a97-4803-9d83-d864f591c1a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:37.079747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b3163b86-7a97-4803-9d83-d864f591c1a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:37.091323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3163b86-7a97-4803-9d83-d864f591c1a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:37.097072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3163b86-7a97-4803-9d83-d864f591c1a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:37.098053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3163b86-7a97-4803-9d83-d864f591c1a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:37.099275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3163b86-7a97-4803-9d83-d864f591c1a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:37.099993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3163b86-7a97-4803-9d83-d864f591c1a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:37.100603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3163b86-7a97-4803-9d83-d864f591c1a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:37.339701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-af92d94e-0a88-4c0c-81f5-bf0690e0f378 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:37.340942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-af92d94e-0a88-4c0c-81f5-bf0690e0f378 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] [instance: cfe3f058-9949-42f3-b9b8-a51da1ba14f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:37.363128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af92d94e-0a88-4c0c-81f5-bf0690e0f378 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:37.372218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af92d94e-0a88-4c0c-81f5-bf0690e0f378 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:37.372899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af92d94e-0a88-4c0c-81f5-bf0690e0f378 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:37.373891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af92d94e-0a88-4c0c-81f5-bf0690e0f378 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:37.374562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af92d94e-0a88-4c0c-81f5-bf0690e0f378 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:37.375210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af92d94e-0a88-4c0c-81f5-bf0690e0f378 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:37.390086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b3163b86-7a97-4803-9d83-d864f591c1a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:37.403703 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b3163b86-7a97-4803-9d83-d864f591c1a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.329609 Oct 27 18:57:37.404989 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1517/2923] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:37 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:37.521654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-af92d94e-0a88-4c0c-81f5-bf0690e0f378 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:37.534360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-af92d94e-0a88-4c0c-81f5-bf0690e0f378 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:37.540902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-af92d94e-0a88-4c0c-81f5-bf0690e0f378 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:37.542586 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-af92d94e-0a88-4c0c-81f5-bf0690e0f378 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2" status: 200 len: 1339 microversion: 2.47 time: 0.206823 Oct 27 18:57:37.544041 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1407/2924] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:57:37 2022] GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2 => generated 1339 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:57:37.592922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2d996fbd-39c6-4cbf-9e80-558db2f80a24 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:37.593748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2d996fbd-39c6-4cbf-9e80-558db2f80a24 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:37.603306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d996fbd-39c6-4cbf-9e80-558db2f80a24 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:37.608928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d996fbd-39c6-4cbf-9e80-558db2f80a24 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:37.612336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d996fbd-39c6-4cbf-9e80-558db2f80a24 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:37.616036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d996fbd-39c6-4cbf-9e80-558db2f80a24 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:37.616779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d996fbd-39c6-4cbf-9e80-558db2f80a24 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:37.618082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d996fbd-39c6-4cbf-9e80-558db2f80a24 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:37.947659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2d996fbd-39c6-4cbf-9e80-558db2f80a24 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:37.956941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d5bce2fe-5459-4ef5-9aab-41cc44ddcc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:37.957883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d5bce2fe-5459-4ef5-9aab-41cc44ddcc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:37.972736 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2d996fbd-39c6-4cbf-9e80-558db2f80a24 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.376225 Oct 27 18:57:37.991827 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1518/2925] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:37 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:37.996153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5bce2fe-5459-4ef5-9aab-41cc44ddcc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:38.001706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5bce2fe-5459-4ef5-9aab-41cc44ddcc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:38.002325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5bce2fe-5459-4ef5-9aab-41cc44ddcc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:38.006862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5bce2fe-5459-4ef5-9aab-41cc44ddcc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:38.008336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5bce2fe-5459-4ef5-9aab-41cc44ddcc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:38.011876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5bce2fe-5459-4ef5-9aab-41cc44ddcc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:38.056043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:38.345576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d5bce2fe-5459-4ef5-9aab-41cc44ddcc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:38.362352 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d5bce2fe-5459-4ef5-9aab-41cc44ddcc55 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1307 microversion: 2.1 time: 0.403955 Oct 27 18:57:38.363334 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1408/2926] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:37 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1307 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:38.435433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9df93a0a-eb04-4604-a464-be959fa8d949 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:38.438355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9df93a0a-eb04-4604-a464-be959fa8d949 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:38.456673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9df93a0a-eb04-4604-a464-be959fa8d949 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:38.457341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9df93a0a-eb04-4604-a464-be959fa8d949 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:38.457924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9df93a0a-eb04-4604-a464-be959fa8d949 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:38.458793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9df93a0a-eb04-4604-a464-be959fa8d949 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:38.459332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9df93a0a-eb04-4604-a464-be959fa8d949 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:38.459863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9df93a0a-eb04-4604-a464-be959fa8d949 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:38.574289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7ededd3-6acc-4c64-b4c1-930165bf6371 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:38.590885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7ededd3-6acc-4c64-b4c1-930165bf6371 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] [instance: cfe3f058-9949-42f3-b9b8-a51da1ba14f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:38.606976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7ededd3-6acc-4c64-b4c1-930165bf6371 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:38.607714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7ededd3-6acc-4c64-b4c1-930165bf6371 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:38.608979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7ededd3-6acc-4c64-b4c1-930165bf6371 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:38.610010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7ededd3-6acc-4c64-b4c1-930165bf6371 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:38.610799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7ededd3-6acc-4c64-b4c1-930165bf6371 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:38.611410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7ededd3-6acc-4c64-b4c1-930165bf6371 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:38.779601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7ededd3-6acc-4c64-b4c1-930165bf6371 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:38.797173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7ededd3-6acc-4c64-b4c1-930165bf6371 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:38.799676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7ededd3-6acc-4c64-b4c1-930165bf6371 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:38.801293 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7ededd3-6acc-4c64-b4c1-930165bf6371 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2" status: 200 len: 1360 microversion: 2.47 time: 0.231175 Oct 27 18:57:38.802831 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1409/2927] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:57:38 2022] GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2 => generated 1360 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:57:38.836088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6259b7ab-740e-4b16-a15e-ed424441d8ca tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-923878137"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:38.841760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6259b7ab-740e-4b16-a15e-ed424441d8ca tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] [instance: cfe3f058-9949-42f3-b9b8-a51da1ba14f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:38.862808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6259b7ab-740e-4b16-a15e-ed424441d8ca tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:38.864547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6259b7ab-740e-4b16-a15e-ed424441d8ca tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:38.865161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6259b7ab-740e-4b16-a15e-ed424441d8ca tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:38.866218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6259b7ab-740e-4b16-a15e-ed424441d8ca tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:38.866969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6259b7ab-740e-4b16-a15e-ed424441d8ca tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:38.867691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6259b7ab-740e-4b16-a15e-ed424441d8ca tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:38.943578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9df93a0a-eb04-4604-a464-be959fa8d949 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:38.960782 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9df93a0a-eb04-4604-a464-be959fa8d949 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1506 microversion: 2.1 time: 0.531474 Oct 27 18:57:38.978659 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1519/2928] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:38 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:39.016678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-10bbff59-7fc8-4921-a7ab-9cb92b9e6be7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:39.019178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-10bbff59-7fc8-4921-a7ab-9cb92b9e6be7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:39.027166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10bbff59-7fc8-4921-a7ab-9cb92b9e6be7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:39.028671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10bbff59-7fc8-4921-a7ab-9cb92b9e6be7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:39.036093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10bbff59-7fc8-4921-a7ab-9cb92b9e6be7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:39.038818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10bbff59-7fc8-4921-a7ab-9cb92b9e6be7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:39.039355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10bbff59-7fc8-4921-a7ab-9cb92b9e6be7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:39.040846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10bbff59-7fc8-4921-a7ab-9cb92b9e6be7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:39.214171 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6259b7ab-740e-4b16-a15e-ed424441d8ca tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] 10.222.0.42 "POST /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2/action" status: 202 len: 52 microversion: 2.47 time: 0.388639 Oct 27 18:57:39.215677 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1410/2929] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 18:57:38 2022] POST /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2/action => generated 52 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 27 18:57:39.246072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cadb133f-5969-4645-9d18-da55939be736 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:39.246719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cadb133f-5969-4645-9d18-da55939be736 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] [instance: cfe3f058-9949-42f3-b9b8-a51da1ba14f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:39.253925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cadb133f-5969-4645-9d18-da55939be736 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:39.254449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cadb133f-5969-4645-9d18-da55939be736 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:39.254903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cadb133f-5969-4645-9d18-da55939be736 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:39.255628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cadb133f-5969-4645-9d18-da55939be736 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:39.256085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cadb133f-5969-4645-9d18-da55939be736 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:39.256514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cadb133f-5969-4645-9d18-da55939be736 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:39.312452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cadb133f-5969-4645-9d18-da55939be736 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] [instance: cfe3f058-9949-42f3-b9b8-a51da1ba14f2] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:57:39.481435 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cadb133f-5969-4645-9d18-da55939be736 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2" status: 204 len: 0 microversion: 2.47 time: 0.241046 Oct 27 18:57:39.482344 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1411/2930] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 18:57:39 2022] DELETE /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 18:57:39.492443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-84517c60-cd4c-4073-9f45-5b1b09a7a438 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:39.496618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-84517c60-cd4c-4073-9f45-5b1b09a7a438 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:39.507133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84517c60-cd4c-4073-9f45-5b1b09a7a438 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:39.510051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84517c60-cd4c-4073-9f45-5b1b09a7a438 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:39.510810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84517c60-cd4c-4073-9f45-5b1b09a7a438 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:39.511853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84517c60-cd4c-4073-9f45-5b1b09a7a438 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:39.513405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84517c60-cd4c-4073-9f45-5b1b09a7a438 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:39.514103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84517c60-cd4c-4073-9f45-5b1b09a7a438 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:39.612489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-10bbff59-7fc8-4921-a7ab-9cb92b9e6be7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:39.623003 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-10bbff59-7fc8-4921-a7ab-9cb92b9e6be7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1519 microversion: 2.1 time: 0.617508 Oct 27 18:57:39.626636 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1520/2931] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:39 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1519 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:39.641813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4a2e4987-1b8b-483b-8b4b-c962ab56a395 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:39.642494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4a2e4987-1b8b-483b-8b4b-c962ab56a395 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] [instance: cfe3f058-9949-42f3-b9b8-a51da1ba14f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:39.684517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a2e4987-1b8b-483b-8b4b-c962ab56a395 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:39.686003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a2e4987-1b8b-483b-8b4b-c962ab56a395 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:39.689077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a2e4987-1b8b-483b-8b4b-c962ab56a395 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:39.690113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a2e4987-1b8b-483b-8b4b-c962ab56a395 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:39.690951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a2e4987-1b8b-483b-8b4b-c962ab56a395 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:39.692540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a2e4987-1b8b-483b-8b4b-c962ab56a395 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:39.805532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4a2e4987-1b8b-483b-8b4b-c962ab56a395 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:39.817744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4a2e4987-1b8b-483b-8b4b-c962ab56a395 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:39.819252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4a2e4987-1b8b-483b-8b4b-c962ab56a395 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:39.820948 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4a2e4987-1b8b-483b-8b4b-c962ab56a395 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2" status: 200 len: 1366 microversion: 2.47 time: 0.191514 Oct 27 18:57:39.822077 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1521/2932] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:57:39 2022] GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:57:39.908973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1762775996", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:39.991551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] validate_networks() for [('94c62c0b-e354-47fc-826b-1e4eff72400d', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:57:40.050308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-84517c60-cd4c-4073-9f45-5b1b09a7a438 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:40.068856 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-84517c60-cd4c-4073-9f45-5b1b09a7a438 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1307 microversion: 2.1 time: 0.585129 Oct 27 18:57:40.069814 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1412/2933] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:39 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1307 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:40.087517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f34d8517-b83f-469e-b798-2dcf1fe85f76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:40.088378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f34d8517-b83f-469e-b798-2dcf1fe85f76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:40.095972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f34d8517-b83f-469e-b798-2dcf1fe85f76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:40.096718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f34d8517-b83f-469e-b798-2dcf1fe85f76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:40.097328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f34d8517-b83f-469e-b798-2dcf1fe85f76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:40.098243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f34d8517-b83f-469e-b798-2dcf1fe85f76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:40.099190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f34d8517-b83f-469e-b798-2dcf1fe85f76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:40.099795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f34d8517-b83f-469e-b798-2dcf1fe85f76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:40.411825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f34d8517-b83f-469e-b798-2dcf1fe85f76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:40.423988 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f34d8517-b83f-469e-b798-2dcf1fe85f76 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1486 microversion: 2.1 time: 0.352870 Oct 27 18:57:40.424587 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1413/2934] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:40 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1486 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:40.554741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:57:40.555521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:57:40.564074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:57:40.566008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:57:40.567904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:57:40.608116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:40.610844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:40.613421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:40.616647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:40.617431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:40.618123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:40.649946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-514843a5-cecc-47c0-a45a-feb979ffad19 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:40.651211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-514843a5-cecc-47c0-a45a-feb979ffad19 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:40.657784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-514843a5-cecc-47c0-a45a-feb979ffad19 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:40.659496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-514843a5-cecc-47c0-a45a-feb979ffad19 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:40.660062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-514843a5-cecc-47c0-a45a-feb979ffad19 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:40.660720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-514843a5-cecc-47c0-a45a-feb979ffad19 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:40.661510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-514843a5-cecc-47c0-a45a-feb979ffad19 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:40.661960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-514843a5-cecc-47c0-a45a-feb979ffad19 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:40.712413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Getting quotas for project f356a8b83ed843079eca7a548b68da1a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:57:40.718738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Getting quotas for user f82ef1f08fe443bba07e83198686660c and project f356a8b83ed843079eca7a548b68da1a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:57:40.732252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:57:40.734665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:57:40.806216 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6bc8d57a-8ab1-4f56-95a4-a2372a46d827 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.982612 Oct 27 18:57:40.807023 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1522/2935] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:57:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:57:40.813040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-939373723", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:40.863060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-514843a5-cecc-47c0-a45a-feb979ffad19 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:40.887585 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-514843a5-cecc-47c0-a45a-feb979ffad19 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.237161 Oct 27 18:57:40.902859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] validate_networks() for [('1dd93382-ebdf-4dbe-b385-4467cbf2351e', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:57:40.905391 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1414/2936] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:40 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:40.914614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-659a372f-da0a-4075-b133-9c70b864a53f tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:40.915721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-659a372f-da0a-4075-b133-9c70b864a53f tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:40.977766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-659a372f-da0a-4075-b133-9c70b864a53f tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:40.986136 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-659a372f-da0a-4075-b133-9c70b864a53f tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1223 microversion: 2.1 time: 0.078495 Oct 27 18:57:40.986774 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1415/2937] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:40 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:41.010956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-246ddf6d-921f-4da6-852c-9cc4bcf9d8b0 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:41.011607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-246ddf6d-921f-4da6-852c-9cc4bcf9d8b0 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] [instance: cfe3f058-9949-42f3-b9b8-a51da1ba14f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:41.019701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-246ddf6d-921f-4da6-852c-9cc4bcf9d8b0 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:41.020625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-246ddf6d-921f-4da6-852c-9cc4bcf9d8b0 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:41.021430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-246ddf6d-921f-4da6-852c-9cc4bcf9d8b0 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:41.022464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-246ddf6d-921f-4da6-852c-9cc4bcf9d8b0 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:41.023093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-246ddf6d-921f-4da6-852c-9cc4bcf9d8b0 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:41.023861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-246ddf6d-921f-4da6-852c-9cc4bcf9d8b0 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:41.164895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-246ddf6d-921f-4da6-852c-9cc4bcf9d8b0 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:41.184360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-246ddf6d-921f-4da6-852c-9cc4bcf9d8b0 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:41.187490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-246ddf6d-921f-4da6-852c-9cc4bcf9d8b0 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:41.198194 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-246ddf6d-921f-4da6-852c-9cc4bcf9d8b0 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2" status: 200 len: 1366 microversion: 2.47 time: 0.188646 Oct 27 18:57:41.198892 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1416/2938] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:57:40 2022] GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:57:41.206948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3bce5ffd-f408-494d-b64b-b28356dc9d3b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:41.208753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3bce5ffd-f408-494d-b64b-b28356dc9d3b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:41.221851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bce5ffd-f408-494d-b64b-b28356dc9d3b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:41.226111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bce5ffd-f408-494d-b64b-b28356dc9d3b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:41.226805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bce5ffd-f408-494d-b64b-b28356dc9d3b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:41.227916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bce5ffd-f408-494d-b64b-b28356dc9d3b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:41.228939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bce5ffd-f408-494d-b64b-b28356dc9d3b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:41.234921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bce5ffd-f408-494d-b64b-b28356dc9d3b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:41.600380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:57:41.600807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:57:41.603759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:57:41.604874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:57:41.605460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:57:41.614750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3bce5ffd-f408-494d-b64b-b28356dc9d3b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:41.618705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:41.619874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:41.620475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:41.622729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:41.623369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:41.626072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:41.632565 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3bce5ffd-f408-494d-b64b-b28356dc9d3b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.432341 Oct 27 18:57:41.656878 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1417/2939] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:41 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:41.669234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-93213f0f-e112-48f3-b77e-7d2ac054c020 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:41.670177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-93213f0f-e112-48f3-b77e-7d2ac054c020 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:41.678209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Getting quotas for project c6651a933fb1407f95a17ef4a1583933. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:57:41.678445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93213f0f-e112-48f3-b77e-7d2ac054c020 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:41.679147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93213f0f-e112-48f3-b77e-7d2ac054c020 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:41.679795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93213f0f-e112-48f3-b77e-7d2ac054c020 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:41.680680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93213f0f-e112-48f3-b77e-7d2ac054c020 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:41.681333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93213f0f-e112-48f3-b77e-7d2ac054c020 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:41.681936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93213f0f-e112-48f3-b77e-7d2ac054c020 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:41.685099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Getting quotas for user 683571ba22aa4e838e473f111f97ffae and project c6651a933fb1407f95a17ef4a1583933. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:57:41.700498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:57:41.703107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:57:41.763077 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8ad65b8c-15a9-4125-b4be-7ac30e4e8296 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.954797 Oct 27 18:57:41.764119 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1523/2940] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:57:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:57:41.769889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1cb7d589-986a-40fc-825e-ec41dfa9ee0c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:41.771083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1cb7d589-986a-40fc-825e-ec41dfa9ee0c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:41.777679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cb7d589-986a-40fc-825e-ec41dfa9ee0c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:41.778610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cb7d589-986a-40fc-825e-ec41dfa9ee0c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:41.779280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cb7d589-986a-40fc-825e-ec41dfa9ee0c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:41.780852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cb7d589-986a-40fc-825e-ec41dfa9ee0c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:41.781537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cb7d589-986a-40fc-825e-ec41dfa9ee0c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:41.782185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cb7d589-986a-40fc-825e-ec41dfa9ee0c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:42.002257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-93213f0f-e112-48f3-b77e-7d2ac054c020 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:42.012047 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-93213f0f-e112-48f3-b77e-7d2ac054c020 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1307 microversion: 2.1 time: 0.354939 Oct 27 18:57:42.012647 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1418/2941] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:41 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1307 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:42.020808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2e0aa41b-5d34-426c-bb7a-8769e593fe22 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:42.021995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2e0aa41b-5d34-426c-bb7a-8769e593fe22 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:42.143258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1cb7d589-986a-40fc-825e-ec41dfa9ee0c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:42.153690 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1cb7d589-986a-40fc-825e-ec41dfa9ee0c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.387795 Oct 27 18:57:42.154271 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1524/2942] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:41 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:42.168944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-10e3da81-ca50-482b-a6e7-fe7597dadfac tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:42.169663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-10e3da81-ca50-482b-a6e7-fe7597dadfac tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:42.183672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10e3da81-ca50-482b-a6e7-fe7597dadfac tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:42.188747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10e3da81-ca50-482b-a6e7-fe7597dadfac tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:42.190250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10e3da81-ca50-482b-a6e7-fe7597dadfac tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:42.192456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10e3da81-ca50-482b-a6e7-fe7597dadfac tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:42.192935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10e3da81-ca50-482b-a6e7-fe7597dadfac tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:42.193374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10e3da81-ca50-482b-a6e7-fe7597dadfac tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:42.236135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:42.259529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2e0aa41b-5d34-426c-bb7a-8769e593fe22 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:42.269337 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2e0aa41b-5d34-426c-bb7a-8769e593fe22 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1213 microversion: 2.1 time: 0.252099 Oct 27 18:57:42.274835 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1419/2943] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:42 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1213 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:42.286989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-447744ee-62d3-4fdc-9573-70e8ec3bba14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:42.301147 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-447744ee-62d3-4fdc-9573-70e8ec3bba14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 4c76f3b5-a318-4870-9031-3b14db27513c has no mapping to a cell. Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-447744ee-62d3-4fdc-9573-70e8ec3bba14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/4c76f3b5-a318-4870-9031-3b14db27513c/action HTTP/1.1 Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 15 Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: {"os-stop": {}} Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 4c76f3b5-a318-4870-9031-3b14db27513c has no mapping to a cell. Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '4c76f3b5-a318-4870-9031-3b14db27513c', 'body': {'os-stop': {}}} Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 4c76f3b5-a318-4870-9031-3b14db27513c has no mapping to a cell. Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:57:42.312336 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c76f3b5-a318-4870-9031-3b14db27513c has no mapping to a cell. Oct 27 18:57:42.317339 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:42.317339 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:42.317339 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:42.317339 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:42.317339 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:42.317339 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:42.317339 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:42.317339 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:42.317339 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c76f3b5-a318-4870-9031-3b14db27513c has no mapping to a cell. Oct 27 18:57:42.317339 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:42.317339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-447744ee-62d3-4fdc-9573-70e8ec3bba14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 4c76f3b5-a318-4870-9031-3b14db27513c has no mapping to a cell. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:42.317339 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-447744ee-62d3-4fdc-9573-70e8ec3bba14 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/4c76f3b5-a318-4870-9031-3b14db27513c/action" status: 404 len: 117 microversion: 2.1 time: 0.035504 Oct 27 18:57:42.317339 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1420/2944] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:42 2022] POST /compute/v2.1/servers/4c76f3b5-a318-4870-9031-3b14db27513c/action => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:57:42.319553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:42.321242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] [instance: cfe3f058-9949-42f3-b9b8-a51da1ba14f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:42.340744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:42.341248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:42.347517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:42.348308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:42.348882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:42.349326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:42.356918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-10e3da81-ca50-482b-a6e7-fe7597dadfac tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:42.367731 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-10e3da81-ca50-482b-a6e7-fe7597dadfac tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1275 microversion: 2.1 time: 0.203586 Oct 27 18:57:42.368716 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1525/2945] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:42 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1275 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:42.383593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6913ba19-31e2-4c7b-b50f-da5a0db34af8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:42.384237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6913ba19-31e2-4c7b-b50f-da5a0db34af8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:42.392335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:42.392863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6913ba19-31e2-4c7b-b50f-da5a0db34af8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:42.393367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6913ba19-31e2-4c7b-b50f-da5a0db34af8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:42.393719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:42.393835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6913ba19-31e2-4c7b-b50f-da5a0db34af8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:42.394534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6913ba19-31e2-4c7b-b50f-da5a0db34af8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:42.394773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:42.394982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6913ba19-31e2-4c7b-b50f-da5a0db34af8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:42.395743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6913ba19-31e2-4c7b-b50f-da5a0db34af8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:42.396170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lazy-loading 'fault' on Instance uuid cfe3f058-9949-42f3-b9b8-a51da1ba14f2 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:57:42.569174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:42.592839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:42.598847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0921dee96fbe40dcb0ecafd07b62f11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b49c85b2e84aff956d226684a2809b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:42.602740 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8983dc2b-6ef2-4e18-a377-772ac656996d tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2" status: 200 len: 1371 microversion: 2.47 time: 0.286626 Oct 27 18:57:42.621760 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1421/2946] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:57:42 2022] GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2 => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:57:42.635033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-635393c4-db35-4e0a-bce7-6e6c579a2112 req-77f079c7-322b-4c27-843b-af2328845325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c280a00e-288a-4927-95e6-1f2b3880f240", "name": "network-vif-plugged", "status": "completed", "tag": "e3f7c665-6965-4529-a1e9-cf0c7c389160"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:42.651984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-635393c4-db35-4e0a-bce7-6e6c579a2112 req-77f079c7-322b-4c27-843b-af2328845325 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:42.652620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-635393c4-db35-4e0a-bce7-6e6c579a2112 req-77f079c7-322b-4c27-843b-af2328845325 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:42.653161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-635393c4-db35-4e0a-bce7-6e6c579a2112 req-77f079c7-322b-4c27-843b-af2328845325 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:42.682355 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-635393c4-db35-4e0a-bce7-6e6c579a2112 req-77f079c7-322b-4c27-843b-af2328845325 service nova] Creating event network-vif-plugged:e3f7c665-6965-4529-a1e9-cf0c7c389160 for instance c280a00e-288a-4927-95e6-1f2b3880f240 on n-h2-860687-3 Oct 27 18:57:42.694451 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-635393c4-db35-4e0a-bce7-6e6c579a2112 req-77f079c7-322b-4c27-843b-af2328845325 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070634 Oct 27 18:57:42.695600 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1422/2947] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:42.771778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6913ba19-31e2-4c7b-b50f-da5a0db34af8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:42.797598 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6913ba19-31e2-4c7b-b50f-da5a0db34af8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.427506 Oct 27 18:57:42.799117 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1526/2948] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:42 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:42.831091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8cbc151b-76e7-4492-b06e-423c72811523 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:42.832996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8cbc151b-76e7-4492-b06e-423c72811523 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:42.858976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cbc151b-76e7-4492-b06e-423c72811523 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:42.859836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cbc151b-76e7-4492-b06e-423c72811523 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:42.861071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cbc151b-76e7-4492-b06e-423c72811523 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:42.862793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cbc151b-76e7-4492-b06e-423c72811523 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:42.864470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cbc151b-76e7-4492-b06e-423c72811523 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:42.865816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cbc151b-76e7-4492-b06e-423c72811523 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:43.039768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c74b0274-a99b-4599-9f73-261eda5b3414 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:43.040720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c74b0274-a99b-4599-9f73-261eda5b3414 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:43.052843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c74b0274-a99b-4599-9f73-261eda5b3414 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:43.053509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c74b0274-a99b-4599-9f73-261eda5b3414 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:43.055437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c74b0274-a99b-4599-9f73-261eda5b3414 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:43.057410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c74b0274-a99b-4599-9f73-261eda5b3414 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:43.059148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c74b0274-a99b-4599-9f73-261eda5b3414 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:43.059647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c74b0274-a99b-4599-9f73-261eda5b3414 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:43.252498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c74b0274-a99b-4599-9f73-261eda5b3414 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:43.265335 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c74b0274-a99b-4599-9f73-261eda5b3414 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1307 microversion: 2.1 time: 0.228979 Oct 27 18:57:43.266757 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1527/2949] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:43 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:43.302275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a6a20d87-a979-49ac-9658-0ffb990682d6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:43.303030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a6a20d87-a979-49ac-9658-0ffb990682d6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:43.311642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6a20d87-a979-49ac-9658-0ffb990682d6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:43.312444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6a20d87-a979-49ac-9658-0ffb990682d6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:43.313114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6a20d87-a979-49ac-9658-0ffb990682d6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:43.314152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6a20d87-a979-49ac-9658-0ffb990682d6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:43.315827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6a20d87-a979-49ac-9658-0ffb990682d6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:43.316500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6a20d87-a979-49ac-9658-0ffb990682d6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:43.395907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a6a20d87-a979-49ac-9658-0ffb990682d6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:43.404556 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a6a20d87-a979-49ac-9658-0ffb990682d6 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1265 microversion: 2.1 time: 0.107319 Oct 27 18:57:43.413432 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1528/2950] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:43 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:43.413432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a4a1b464-7556-4931-91dc-4a4688683826 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:43.413432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a4a1b464-7556-4931-91dc-4a4688683826 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:43.419815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4a1b464-7556-4931-91dc-4a4688683826 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:43.421429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4a1b464-7556-4931-91dc-4a4688683826 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:43.421899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4a1b464-7556-4931-91dc-4a4688683826 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:43.422930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4a1b464-7556-4931-91dc-4a4688683826 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:43.423466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4a1b464-7556-4931-91dc-4a4688683826 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:43.423907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4a1b464-7556-4931-91dc-4a4688683826 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:43.496476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a4a1b464-7556-4931-91dc-4a4688683826 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:43.505983 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a4a1b464-7556-4931-91dc-4a4688683826 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1281 microversion: 2.1 time: 0.098626 Oct 27 18:57:43.506599 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1529/2951] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:43 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1281 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:43.635698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d779ef5-f83b-40b3-bfa7-dcca777c6732 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:43.636245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0d779ef5-f83b-40b3-bfa7-dcca777c6732 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] [instance: cfe3f058-9949-42f3-b9b8-a51da1ba14f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:43.648524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d779ef5-f83b-40b3-bfa7-dcca777c6732 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:43.649036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d779ef5-f83b-40b3-bfa7-dcca777c6732 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:43.649482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d779ef5-f83b-40b3-bfa7-dcca777c6732 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:43.650211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d779ef5-f83b-40b3-bfa7-dcca777c6732 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:43.650709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d779ef5-f83b-40b3-bfa7-dcca777c6732 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:43.651170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d779ef5-f83b-40b3-bfa7-dcca777c6732 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:43.666776 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-0d779ef5-f83b-40b3-bfa7-dcca777c6732 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] HTTP exception thrown: Instance cfe3f058-9949-42f3-b9b8-a51da1ba14f2 could not be found. Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d779ef5-f83b-40b3-bfa7-dcca777c6732 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Request method failure captured: Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2 HTTP/1.1 Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtSc441R_pHZUsn1duz0wmgj5YN1QgfPRz0BH3BPWB7GoUDQfvqWJJzzwcLqwSo4Gn3YgXnEbi0my7itIDGDfSpEPAl8ttBY3blvmiPlXdRTcr3HgEIQABVjNtrgAIvalXnjGMsFED1tPN2AFTTUC7aMs6qtPKYb8tNppE6Usq_QXOk Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.47 Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: e6b49c85b2e84aff956d226684a2809b Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersAaction247Test-1547132084 Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6b49c85b2e84aff956d226684a2809b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6b49c85b2e84aff956d226684a2809b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6b49c85b2e84aff956d226684a2809b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6b49c85b2e84aff956d226684a2809b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersAaction247Test-1547132084 Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: e6b49c85b2e84aff956d226684a2809b Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersAaction247Test-1547132084 Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersAaction247Test-1547132084-project Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 0921dee96fbe40dcb0ecafd07b62f11e Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersAaction247Test-1547132084-project Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance cfe3f058-9949-42f3-b9b8-a51da1ba14f2 could not be found. Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'cfe3f058-9949-42f3-b9b8-a51da1ba14f2'} Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfe3f058-9949-42f3-b9b8-a51da1ba14f2 could not be found. Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfe3f058-9949-42f3-b9b8-a51da1ba14f2 could not be found. Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:43.669016 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:43.673961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:43.673961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:43.673961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:43.673961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:43.673961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:43.673961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:43.673961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfe3f058-9949-42f3-b9b8-a51da1ba14f2 could not be found. Oct 27 18:57:43.673961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:43.676218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d779ef5-f83b-40b3-bfa7-dcca777c6732 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] Returning 404 to user: Instance cfe3f058-9949-42f3-b9b8-a51da1ba14f2 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:43.677321 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0d779ef5-f83b-40b3-bfa7-dcca777c6732 tempest-ServersAaction247Test-1547132084 tempest-ServersAaction247Test-1547132084-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2" status: 404 len: 111 microversion: 2.47 time: 0.045721 Oct 27 18:57:43.678136 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1530/2952] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:57:43 2022] GET /compute/v2.1/servers/cfe3f058-9949-42f3-b9b8-a51da1ba14f2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 18:57:43.688468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8cbc151b-76e7-4492-b06e-423c72811523 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:43.704965 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8cbc151b-76e7-4492-b06e-423c72811523 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.881632 Oct 27 18:57:43.712141 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1423/2953] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:42 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:43.748431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-22759bb9-5709-4838-a923-1387a311a2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:43.749884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-22759bb9-5709-4838-a923-1387a311a2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 3890afdf-e154-47e3-89c2-fb7e1e830881] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:43.760560 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-22759bb9-5709-4838-a923-1387a311a2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 3890afdf-e154-47e3-89c2-fb7e1e830881 could not be found. Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-22759bb9-5709-4838-a923-1387a311a2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/3890afdf-e154-47e3-89c2-fb7e1e830881/action HTTP/1.1 Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 15 Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: {"suspend": {}} Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 3890afdf-e154-47e3-89c2-fb7e1e830881 could not be found. Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '3890afdf-e154-47e3-89c2-fb7e1e830881', 'body': {'suspend': {}}} Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3890afdf-e154-47e3-89c2-fb7e1e830881 could not be found. Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3890afdf-e154-47e3-89c2-fb7e1e830881 could not be found. Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:43.763688 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:43.768381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:43.768381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:43.768381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3890afdf-e154-47e3-89c2-fb7e1e830881 could not be found. Oct 27 18:57:43.768381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:43.768907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-22759bb9-5709-4838-a923-1387a311a2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 3890afdf-e154-47e3-89c2-fb7e1e830881 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:43.769934 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-22759bb9-5709-4838-a923-1387a311a2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/3890afdf-e154-47e3-89c2-fb7e1e830881/action" status: 404 len: 111 microversion: 2.1 time: 0.033988 Oct 27 18:57:43.771160 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1531/2954] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:43 2022] POST /compute/v2.1/servers/3890afdf-e154-47e3-89c2-fb7e1e830881/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:57:43.784503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71d71fd3-45c9-49a3-942a-867f24be0366 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:43.785937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-71d71fd3-45c9-49a3-942a-867f24be0366 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:43.794776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d71fd3-45c9-49a3-942a-867f24be0366 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:43.795672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d71fd3-45c9-49a3-942a-867f24be0366 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:43.796722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d71fd3-45c9-49a3-942a-867f24be0366 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:43.798307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d71fd3-45c9-49a3-942a-867f24be0366 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:43.799030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d71fd3-45c9-49a3-942a-867f24be0366 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:43.799698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71d71fd3-45c9-49a3-942a-867f24be0366 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:44.216172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-71d71fd3-45c9-49a3-942a-867f24be0366 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:44.227682 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-71d71fd3-45c9-49a3-942a-867f24be0366 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.452473 Oct 27 18:57:44.228840 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1424/2955] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:43 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:44.255348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-74ccb03a-1972-4cdd-acaf-80cd9c78719b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:44.256875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-74ccb03a-1972-4cdd-acaf-80cd9c78719b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:44.266498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74ccb03a-1972-4cdd-acaf-80cd9c78719b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:44.271131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74ccb03a-1972-4cdd-acaf-80cd9c78719b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:44.272193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74ccb03a-1972-4cdd-acaf-80cd9c78719b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:44.287940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74ccb03a-1972-4cdd-acaf-80cd9c78719b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:44.289013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55d04633-9bc6-4afe-80eb-764d21f47f0b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:44.289812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-55d04633-9bc6-4afe-80eb-764d21f47f0b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:44.291739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74ccb03a-1972-4cdd-acaf-80cd9c78719b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:44.293001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74ccb03a-1972-4cdd-acaf-80cd9c78719b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:44.300992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:44.305970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55d04633-9bc6-4afe-80eb-764d21f47f0b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:44.306619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55d04633-9bc6-4afe-80eb-764d21f47f0b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:44.307096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55d04633-9bc6-4afe-80eb-764d21f47f0b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:44.308078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55d04633-9bc6-4afe-80eb-764d21f47f0b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:44.312215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55d04633-9bc6-4afe-80eb-764d21f47f0b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:44.312754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55d04633-9bc6-4afe-80eb-764d21f47f0b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:44.347043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:44.638784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-74ccb03a-1972-4cdd-acaf-80cd9c78719b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:44.653176 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-74ccb03a-1972-4cdd-acaf-80cd9c78719b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.402063 Oct 27 18:57:44.667670 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1532/2956] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:44 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:44.684615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e1bd8e2-581b-4503-9c2c-5c308abf9401 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:44.691620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6e1bd8e2-581b-4503-9c2c-5c308abf9401 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:44.701006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e1bd8e2-581b-4503-9c2c-5c308abf9401 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:44.702080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e1bd8e2-581b-4503-9c2c-5c308abf9401 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:44.702773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e1bd8e2-581b-4503-9c2c-5c308abf9401 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:44.703834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e1bd8e2-581b-4503-9c2c-5c308abf9401 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:44.704638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e1bd8e2-581b-4503-9c2c-5c308abf9401 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:44.705237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e1bd8e2-581b-4503-9c2c-5c308abf9401 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:44.810570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-55d04633-9bc6-4afe-80eb-764d21f47f0b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:44.826553 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-55d04633-9bc6-4afe-80eb-764d21f47f0b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1307 microversion: 2.1 time: 0.541259 Oct 27 18:57:44.830904 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1425/2957] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:44 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1307 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:44.835783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6e1bd8e2-581b-4503-9c2c-5c308abf9401 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:44.847466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ff65fe38-db36-41c2-981c-870e229a8722 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:44.848604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ff65fe38-db36-41c2-981c-870e229a8722 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:44.851543 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6e1bd8e2-581b-4503-9c2c-5c308abf9401 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1271 microversion: 2.1 time: 0.179950 Oct 27 18:57:44.852358 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1533/2958] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:44 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:44.861431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff65fe38-db36-41c2-981c-870e229a8722 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:44.861598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-17bff978-f35c-4f55-9599-fe997b1c9a46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:44.861981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-17bff978-f35c-4f55-9599-fe997b1c9a46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:44.862674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff65fe38-db36-41c2-981c-870e229a8722 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:44.863389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff65fe38-db36-41c2-981c-870e229a8722 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:44.864378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff65fe38-db36-41c2-981c-870e229a8722 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:44.865058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff65fe38-db36-41c2-981c-870e229a8722 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:44.865711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff65fe38-db36-41c2-981c-870e229a8722 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:44.873762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17bff978-f35c-4f55-9599-fe997b1c9a46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:44.880572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17bff978-f35c-4f55-9599-fe997b1c9a46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:44.881959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17bff978-f35c-4f55-9599-fe997b1c9a46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:44.886178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17bff978-f35c-4f55-9599-fe997b1c9a46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:44.887390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17bff978-f35c-4f55-9599-fe997b1c9a46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:44.888841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17bff978-f35c-4f55-9599-fe997b1c9a46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:44.980613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-17bff978-f35c-4f55-9599-fe997b1c9a46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lazy-loading 'flavor' on Instance uuid a6e311e1-6dd0-4498-897c-c92ce762d9b9 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:57:45.040688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ff65fe38-db36-41c2-981c-870e229a8722 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:45.050890 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ff65fe38-db36-41c2-981c-870e229a8722 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1281 microversion: 2.1 time: 0.217437 Oct 27 18:57:45.056555 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1426/2959] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:44 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1281 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:45.110642 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-17bff978-f35c-4f55-9599-fe997b1c9a46 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action" status: 202 len: 0 microversion: 2.1 time: 0.256559 Oct 27 18:57:45.112227 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1534/2960] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:44 2022] POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:57:45.120396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-360d33ba-e96f-41a4-b91f-d99e9d8eeac1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:45.122127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-360d33ba-e96f-41a4-b91f-d99e9d8eeac1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:45.130764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-360d33ba-e96f-41a4-b91f-d99e9d8eeac1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:45.131859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-360d33ba-e96f-41a4-b91f-d99e9d8eeac1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:45.132645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-360d33ba-e96f-41a4-b91f-d99e9d8eeac1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:45.133663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-360d33ba-e96f-41a4-b91f-d99e9d8eeac1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:45.134989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-360d33ba-e96f-41a4-b91f-d99e9d8eeac1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:45.135739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-360d33ba-e96f-41a4-b91f-d99e9d8eeac1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:45.464273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-360d33ba-e96f-41a4-b91f-d99e9d8eeac1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:45.473912 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-360d33ba-e96f-41a4-b91f-d99e9d8eeac1 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1514 microversion: 2.1 time: 0.357846 Oct 27 18:57:45.484676 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1427/2961] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:45 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1514 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:45.862369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6aee53bb-59fb-429c-98cf-789ff183a0b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:45.863786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6aee53bb-59fb-429c-98cf-789ff183a0b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:45.884339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b7df81f0-4684-4a7a-8d23-2e64161a3116 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:45.885118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b7df81f0-4684-4a7a-8d23-2e64161a3116 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:45.893478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6aee53bb-59fb-429c-98cf-789ff183a0b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:45.896467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6aee53bb-59fb-429c-98cf-789ff183a0b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:45.899313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6aee53bb-59fb-429c-98cf-789ff183a0b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:45.900591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6aee53bb-59fb-429c-98cf-789ff183a0b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:45.901958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6aee53bb-59fb-429c-98cf-789ff183a0b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:45.902636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6aee53bb-59fb-429c-98cf-789ff183a0b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:45.913334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7df81f0-4684-4a7a-8d23-2e64161a3116 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:45.917525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7df81f0-4684-4a7a-8d23-2e64161a3116 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:45.918157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7df81f0-4684-4a7a-8d23-2e64161a3116 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:45.919043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7df81f0-4684-4a7a-8d23-2e64161a3116 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:45.919792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7df81f0-4684-4a7a-8d23-2e64161a3116 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:45.923389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7df81f0-4684-4a7a-8d23-2e64161a3116 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:46.365333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6aee53bb-59fb-429c-98cf-789ff183a0b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:46.380801 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6aee53bb-59fb-429c-98cf-789ff183a0b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1486 microversion: 2.1 time: 0.527796 Oct 27 18:57:46.382217 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1535/2962] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:45 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1486 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:46.395252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1230e375-7f2e-4268-81d6-3f3bcb64ed2c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:46.396953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1230e375-7f2e-4268-81d6-3f3bcb64ed2c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:46.411309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1230e375-7f2e-4268-81d6-3f3bcb64ed2c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:46.416165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1230e375-7f2e-4268-81d6-3f3bcb64ed2c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:46.416989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1230e375-7f2e-4268-81d6-3f3bcb64ed2c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:46.417816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1230e375-7f2e-4268-81d6-3f3bcb64ed2c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:46.418441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1230e375-7f2e-4268-81d6-3f3bcb64ed2c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:46.418886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1230e375-7f2e-4268-81d6-3f3bcb64ed2c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:46.715012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1230e375-7f2e-4268-81d6-3f3bcb64ed2c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:46.719217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b7df81f0-4684-4a7a-8d23-2e64161a3116 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:46.723526 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1230e375-7f2e-4268-81d6-3f3bcb64ed2c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1323 microversion: 2.1 time: 0.339879 Oct 27 18:57:46.727082 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b7df81f0-4684-4a7a-8d23-2e64161a3116 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1313 microversion: 2.1 time: 0.847906 Oct 27 18:57:46.734183 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1536/2963] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:46 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1323 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:46.735180 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1428/2964] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:45 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1313 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:46.742148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-364cfe79-5d83-4b4b-85d2-8cae37bed2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:46.742884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-364cfe79-5d83-4b4b-85d2-8cae37bed2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:46.749484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2562d666-9b5a-4d78-87e2-892aa5e036a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:46.752228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2562d666-9b5a-4d78-87e2-892aa5e036a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:46.759545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-364cfe79-5d83-4b4b-85d2-8cae37bed2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:46.760047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-364cfe79-5d83-4b4b-85d2-8cae37bed2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:46.760490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-364cfe79-5d83-4b4b-85d2-8cae37bed2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:46.761162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2562d666-9b5a-4d78-87e2-892aa5e036a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:46.761405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-364cfe79-5d83-4b4b-85d2-8cae37bed2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:46.761637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-364cfe79-5d83-4b4b-85d2-8cae37bed2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:46.762242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-364cfe79-5d83-4b4b-85d2-8cae37bed2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:46.762502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2562d666-9b5a-4d78-87e2-892aa5e036a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:46.763708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2562d666-9b5a-4d78-87e2-892aa5e036a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:46.765473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2562d666-9b5a-4d78-87e2-892aa5e036a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:46.766111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2562d666-9b5a-4d78-87e2-892aa5e036a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:46.766765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2562d666-9b5a-4d78-87e2-892aa5e036a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:46.840104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-2562d666-9b5a-4d78-87e2-892aa5e036a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lazy-loading 'flavor' on Instance uuid c280a00e-288a-4927-95e6-1f2b3880f240 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:57:46.970489 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2562d666-9b5a-4d78-87e2-892aa5e036a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "POST /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240/action" status: 202 len: 0 microversion: 2.1 time: 0.234690 Oct 27 18:57:46.971485 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1537/2965] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:46 2022] POST /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:57:46.984549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5d5575a2-bbbc-4644-87a9-8e4a0157dc01 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:46.985568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5d5575a2-bbbc-4644-87a9-8e4a0157dc01 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:46.998327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5575a2-bbbc-4644-87a9-8e4a0157dc01 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:46.999365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5575a2-bbbc-4644-87a9-8e4a0157dc01 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:46.999944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5575a2-bbbc-4644-87a9-8e4a0157dc01 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:47.002666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5575a2-bbbc-4644-87a9-8e4a0157dc01 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:47.003136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5575a2-bbbc-4644-87a9-8e4a0157dc01 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:47.003879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d5575a2-bbbc-4644-87a9-8e4a0157dc01 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:47.287330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-364cfe79-5d83-4b4b-85d2-8cae37bed2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:47.305561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5d5575a2-bbbc-4644-87a9-8e4a0157dc01 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:47.317471 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-364cfe79-5d83-4b4b-85d2-8cae37bed2fa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1497 microversion: 2.1 time: 0.580762 Oct 27 18:57:47.319114 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5d5575a2-bbbc-4644-87a9-8e4a0157dc01 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1494 microversion: 2.1 time: 0.342283 Oct 27 18:57:47.320053 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1429/2966] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:46 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1497 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:47.338506 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1538/2967] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:46 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1494 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:47.348673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bfd2d4ee-2ad3-478f-b0cb-341fc959b92a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:47.355045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bfd2d4ee-2ad3-478f-b0cb-341fc959b92a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:47.361864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfd2d4ee-2ad3-478f-b0cb-341fc959b92a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:47.362365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfd2d4ee-2ad3-478f-b0cb-341fc959b92a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:47.362833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfd2d4ee-2ad3-478f-b0cb-341fc959b92a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:47.363553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfd2d4ee-2ad3-478f-b0cb-341fc959b92a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:47.364013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfd2d4ee-2ad3-478f-b0cb-341fc959b92a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:47.364446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfd2d4ee-2ad3-478f-b0cb-341fc959b92a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:47.402689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-bfd2d4ee-2ad3-478f-b0cb-341fc959b92a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lazy-loading 'flavor' on Instance uuid a6e311e1-6dd0-4498-897c-c92ce762d9b9 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:57:47.423769 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-bfd2d4ee-2ad3-478f-b0cb-341fc959b92a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Cannot 'suspend' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state suspended Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bfd2d4ee-2ad3-478f-b0cb-341fc959b92a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action HTTP/1.1 Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 15 Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: {"suspend": {}} Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: exception: Cannot 'suspend' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state suspended Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a6e311e1-6dd0-4498-897c-c92ce762d9b9', 'body': {'suspend': {}}} Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 27 18:57:47.426609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 18:57:47.430722 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 18:57:47.430722 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 18:57:47.430722 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state suspended Oct 27 18:57:47.430722 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:47.430722 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:47.430722 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:47.430722 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:47.430722 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:47.430722 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:47.430722 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:47.430722 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:47.430722 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state suspended Oct 27 18:57:47.430722 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:47.433418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bfd2d4ee-2ad3-478f-b0cb-341fc959b92a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 409 to user: Cannot 'suspend' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state suspended {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:47.434535 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bfd2d4ee-2ad3-478f-b0cb-341fc959b92a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action" status: 409 len: 148 microversion: 2.1 time: 0.096821 Oct 27 18:57:47.435688 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1430/2968] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:47 2022] POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action => generated 148 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:57:47.445651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4134ca45-dd7d-41f2-b8be-4c904c7b03f7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:47.446804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4134ca45-dd7d-41f2-b8be-4c904c7b03f7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:47.455201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:47.459210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4134ca45-dd7d-41f2-b8be-4c904c7b03f7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:47.459809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4134ca45-dd7d-41f2-b8be-4c904c7b03f7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:47.460911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4134ca45-dd7d-41f2-b8be-4c904c7b03f7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:47.461875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4134ca45-dd7d-41f2-b8be-4c904c7b03f7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:47.463091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4134ca45-dd7d-41f2-b8be-4c904c7b03f7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:47.463926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4134ca45-dd7d-41f2-b8be-4c904c7b03f7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:47.535472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:47.582898 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4134ca45-dd7d-41f2-b8be-4c904c7b03f7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action" status: 202 len: 0 microversion: 2.1 time: 0.141407 Oct 27 18:57:47.584276 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1539/2969] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:47 2022] POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:57:47.594445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e2a3107d-181f-43b4-9568-fa78996d89ec tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:47.595455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e2a3107d-181f-43b4-9568-fa78996d89ec tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:47.604055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a3107d-181f-43b4-9568-fa78996d89ec tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:47.604899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a3107d-181f-43b4-9568-fa78996d89ec tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:47.605579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a3107d-181f-43b4-9568-fa78996d89ec tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:47.606626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a3107d-181f-43b4-9568-fa78996d89ec tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:47.608589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a3107d-181f-43b4-9568-fa78996d89ec tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:47.609713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a3107d-181f-43b4-9568-fa78996d89ec tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:47.649880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-834c96e8-8dd7-46a8-889f-5a3051452c28 req-686e1ba4-0956-44ad-980f-d676fb2d0c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1eb1b0-efaa-435d-8778-9bfbd72c5699", "tag": "bb0bee56-cdb7-4296-bd24-5e8a5ead4a0b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:47.680125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-834c96e8-8dd7-46a8-889f-5a3051452c28 req-686e1ba4-0956-44ad-980f-d676fb2d0c15 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:47.680643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-834c96e8-8dd7-46a8-889f-5a3051452c28 req-686e1ba4-0956-44ad-980f-d676fb2d0c15 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:47.681089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-834c96e8-8dd7-46a8-889f-5a3051452c28 req-686e1ba4-0956-44ad-980f-d676fb2d0c15 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:47.708836 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-834c96e8-8dd7-46a8-889f-5a3051452c28 req-686e1ba4-0956-44ad-980f-d676fb2d0c15 service nova] Creating event network-changed:bb0bee56-cdb7-4296-bd24-5e8a5ead4a0b for instance ac1eb1b0-efaa-435d-8778-9bfbd72c5699 on n-h1-860687-3 Oct 27 18:57:47.716473 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-834c96e8-8dd7-46a8-889f-5a3051452c28 req-686e1ba4-0956-44ad-980f-d676fb2d0c15 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072053 Oct 27 18:57:47.717831 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1540/2970] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:47.750821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4d7fba1a-9d16-493f-95b0-dee5113b7f12 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:47.752579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4d7fba1a-9d16-493f-95b0-dee5113b7f12 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:47.765732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d7fba1a-9d16-493f-95b0-dee5113b7f12 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:47.766694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d7fba1a-9d16-493f-95b0-dee5113b7f12 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:47.767311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d7fba1a-9d16-493f-95b0-dee5113b7f12 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:47.768847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d7fba1a-9d16-493f-95b0-dee5113b7f12 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:47.769321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d7fba1a-9d16-493f-95b0-dee5113b7f12 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:47.769760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d7fba1a-9d16-493f-95b0-dee5113b7f12 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:48.187772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4d7fba1a-9d16-493f-95b0-dee5113b7f12 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:48.197651 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4d7fba1a-9d16-493f-95b0-dee5113b7f12 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1323 microversion: 2.1 time: 0.452522 Oct 27 18:57:48.205970 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1541/2971] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:47 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1323 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:48.221778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e2a3107d-181f-43b4-9568-fa78996d89ec tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:48.228201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-809655d8-5ad3-4914-ac49-7f61167303ba tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:48.229514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-809655d8-5ad3-4914-ac49-7f61167303ba tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:48.249123 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e2a3107d-181f-43b4-9568-fa78996d89ec tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1503 microversion: 2.1 time: 0.659072 Oct 27 18:57:48.250482 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1431/2972] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:47 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1503 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:48.275189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-809655d8-5ad3-4914-ac49-7f61167303ba tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:48.276007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-809655d8-5ad3-4914-ac49-7f61167303ba tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:48.276487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-809655d8-5ad3-4914-ac49-7f61167303ba tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:48.278182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-809655d8-5ad3-4914-ac49-7f61167303ba tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:48.278706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-809655d8-5ad3-4914-ac49-7f61167303ba tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:48.279157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-809655d8-5ad3-4914-ac49-7f61167303ba tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:48.344350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-45c560e7-a5e3-484c-8a21-c3814fd8241e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:48.345087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-45c560e7-a5e3-484c-8a21-c3814fd8241e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:48.359784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45c560e7-a5e3-484c-8a21-c3814fd8241e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:48.360304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45c560e7-a5e3-484c-8a21-c3814fd8241e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:48.360817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45c560e7-a5e3-484c-8a21-c3814fd8241e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:48.361539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45c560e7-a5e3-484c-8a21-c3814fd8241e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:48.362011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45c560e7-a5e3-484c-8a21-c3814fd8241e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:48.362479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45c560e7-a5e3-484c-8a21-c3814fd8241e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:48.620201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-809655d8-5ad3-4914-ac49-7f61167303ba tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:48.629810 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-809655d8-5ad3-4914-ac49-7f61167303ba tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1313 microversion: 2.1 time: 0.421405 Oct 27 18:57:48.630429 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1542/2973] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:48 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:49.094541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-45c560e7-a5e3-484c-8a21-c3814fd8241e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:49.120834 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-45c560e7-a5e3-484c-8a21-c3814fd8241e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 200 len: 1477 microversion: 2.1 time: 0.773668 Oct 27 18:57:49.134675 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1432/2974] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:48 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 1477 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:49.149178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b1e16321-9699-4853-9fae-f52ef9b7f841 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-219648787"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:49.151738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b1e16321-9699-4853-9fae-f52ef9b7f841 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:49.165112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1e16321-9699-4853-9fae-f52ef9b7f841 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:49.165719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1e16321-9699-4853-9fae-f52ef9b7f841 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:49.166235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1e16321-9699-4853-9fae-f52ef9b7f841 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:49.167592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1e16321-9699-4853-9fae-f52ef9b7f841 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:49.168130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1e16321-9699-4853-9fae-f52ef9b7f841 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:49.168749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1e16321-9699-4853-9fae-f52ef9b7f841 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:49.221670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85196bdb-652c-414b-9f3e-f38e647f8786 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:49.222302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85196bdb-652c-414b-9f3e-f38e647f8786 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:49.243279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85196bdb-652c-414b-9f3e-f38e647f8786 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:49.244275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85196bdb-652c-414b-9f3e-f38e647f8786 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:49.244970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85196bdb-652c-414b-9f3e-f38e647f8786 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:49.245937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85196bdb-652c-414b-9f3e-f38e647f8786 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:49.246646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85196bdb-652c-414b-9f3e-f38e647f8786 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:49.247310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85196bdb-652c-414b-9f3e-f38e647f8786 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:49.525934 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b1e16321-9699-4853-9fae-f52ef9b7f841 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "POST /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240/action" status: 202 len: 0 microversion: 2.1 time: 0.382646 Oct 27 18:57:49.534437 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1543/2975] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:49 2022] POST /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 18:57:49.542661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42d8fd36-17af-42e2-9e04-4d82013eaf1e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:49.543791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-42d8fd36-17af-42e2-9e04-4d82013eaf1e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:49.558304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42d8fd36-17af-42e2-9e04-4d82013eaf1e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:49.559389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42d8fd36-17af-42e2-9e04-4d82013eaf1e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:49.560139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42d8fd36-17af-42e2-9e04-4d82013eaf1e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:49.562151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42d8fd36-17af-42e2-9e04-4d82013eaf1e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:49.563037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42d8fd36-17af-42e2-9e04-4d82013eaf1e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:49.564184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42d8fd36-17af-42e2-9e04-4d82013eaf1e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:49.802252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-85196bdb-652c-414b-9f3e-f38e647f8786 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:49.816687 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85196bdb-652c-414b-9f3e-f38e647f8786 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1323 microversion: 2.1 time: 0.599320 Oct 27 18:57:49.817286 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1433/2976] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:49 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1323 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:49.827541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7876b5a0-b9c5-4474-90dc-afdf3b011055 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc87334b280>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:49.887933 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7876b5a0-b9c5-4474-90dc-afdf3b011055 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.064296 Oct 27 18:57:49.888821 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1434/2977] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:49 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:49.911429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-87327204-fa29-4bc1-a001-e88173f67717 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:49.912078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-87327204-fa29-4bc1-a001-e88173f67717 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:49.919143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87327204-fa29-4bc1-a001-e88173f67717 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:49.919969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87327204-fa29-4bc1-a001-e88173f67717 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:49.921704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87327204-fa29-4bc1-a001-e88173f67717 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:49.924592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87327204-fa29-4bc1-a001-e88173f67717 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:49.925406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87327204-fa29-4bc1-a001-e88173f67717 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:49.925931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87327204-fa29-4bc1-a001-e88173f67717 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:50.095186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-87327204-fa29-4bc1-a001-e88173f67717 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:50.103472 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-87327204-fa29-4bc1-a001-e88173f67717 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1313 microversion: 2.1 time: 0.212080 Oct 27 18:57:50.119056 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1435/2978] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:49 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:50.125859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-296d424b-879b-44ce-b429-7c34f3f994fa req-4bb2576d-d98b-4b20-ab78-ad2d57d7a5dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6ce120-4829-4180-9293-592f8e20e233", "tag": "b92235b2-2236-4871-b34f-af9a42350bb5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:50.133773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-42d8fd36-17af-42e2-9e04-4d82013eaf1e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:50.137350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-296d424b-879b-44ce-b429-7c34f3f994fa req-4bb2576d-d98b-4b20-ab78-ad2d57d7a5dd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:50.138040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-296d424b-879b-44ce-b429-7c34f3f994fa req-4bb2576d-d98b-4b20-ab78-ad2d57d7a5dd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:50.138687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-296d424b-879b-44ce-b429-7c34f3f994fa req-4bb2576d-d98b-4b20-ab78-ad2d57d7a5dd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:50.155425 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-296d424b-879b-44ce-b429-7c34f3f994fa req-4bb2576d-d98b-4b20-ab78-ad2d57d7a5dd service nova] Creating event network-changed:b92235b2-2236-4871-b34f-af9a42350bb5 for instance ca6ce120-4829-4180-9293-592f8e20e233 on n-h2-860687-3 Oct 27 18:57:50.159885 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-42d8fd36-17af-42e2-9e04-4d82013eaf1e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1503 microversion: 2.1 time: 0.623345 Oct 27 18:57:50.161736 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1544/2979] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:49 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1503 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:50.166216 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-296d424b-879b-44ce-b429-7c34f3f994fa req-4bb2576d-d98b-4b20-ab78-ad2d57d7a5dd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045499 Oct 27 18:57:50.168090 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1436/2980] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:50.847352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-267c18cb-ef0a-42c1-b365-ebef7e253eeb tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:50.851282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-267c18cb-ef0a-42c1-b365-ebef7e253eeb tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:50.861688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-267c18cb-ef0a-42c1-b365-ebef7e253eeb tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:50.863241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-267c18cb-ef0a-42c1-b365-ebef7e253eeb tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:50.864124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-267c18cb-ef0a-42c1-b365-ebef7e253eeb tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:50.866780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-267c18cb-ef0a-42c1-b365-ebef7e253eeb tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:50.867378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-267c18cb-ef0a-42c1-b365-ebef7e253eeb tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:50.867894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-267c18cb-ef0a-42c1-b365-ebef7e253eeb tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:50.906815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6ac4bd8d-7986-47dd-a80c-f3a6bf627f99 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc87334baf0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:50.997711 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6ac4bd8d-7986-47dd-a80c-f3a6bf627f99 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.097292 Oct 27 18:57:51.023438 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1437/2981] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:50 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:51.131958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd2d708e-859f-4bd0-ac7b-2e28dbec5cc8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:51.132808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dd2d708e-859f-4bd0-ac7b-2e28dbec5cc8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:51.145314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd2d708e-859f-4bd0-ac7b-2e28dbec5cc8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:51.148228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd2d708e-859f-4bd0-ac7b-2e28dbec5cc8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:51.148816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd2d708e-859f-4bd0-ac7b-2e28dbec5cc8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:51.149763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd2d708e-859f-4bd0-ac7b-2e28dbec5cc8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:51.151619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd2d708e-859f-4bd0-ac7b-2e28dbec5cc8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:51.152168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd2d708e-859f-4bd0-ac7b-2e28dbec5cc8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:51.157949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-267c18cb-ef0a-42c1-b365-ebef7e253eeb tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:51.168744 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-267c18cb-ef0a-42c1-b365-ebef7e253eeb tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1323 microversion: 2.1 time: 0.329556 Oct 27 18:57:51.173339 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1545/2982] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:50 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1323 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:51.188195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-35aae0bc-1491-44c6-bdab-d6a9e4d5d3bb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:51.191247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-35aae0bc-1491-44c6-bdab-d6a9e4d5d3bb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:51.210909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35aae0bc-1491-44c6-bdab-d6a9e4d5d3bb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:51.211419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35aae0bc-1491-44c6-bdab-d6a9e4d5d3bb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:51.211877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35aae0bc-1491-44c6-bdab-d6a9e4d5d3bb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:51.212591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35aae0bc-1491-44c6-bdab-d6a9e4d5d3bb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:51.213061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35aae0bc-1491-44c6-bdab-d6a9e4d5d3bb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:51.213500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35aae0bc-1491-44c6-bdab-d6a9e4d5d3bb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:51.454683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-35aae0bc-1491-44c6-bdab-d6a9e4d5d3bb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:51.467390 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-35aae0bc-1491-44c6-bdab-d6a9e4d5d3bb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1503 microversion: 2.1 time: 0.282795 Oct 27 18:57:51.483493 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1546/2983] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:51 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1503 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:51.565583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dd2d708e-859f-4bd0-ac7b-2e28dbec5cc8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:51.575843 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dd2d708e-859f-4bd0-ac7b-2e28dbec5cc8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1313 microversion: 2.1 time: 0.448499 Oct 27 18:57:51.586770 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1438/2984] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:51 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:52.029307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a8a0bbb-7c9d-4ba1-bf46-ab5bb1113720 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc87325c790>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:52.049109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:52.053038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=20 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:52.109339 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8a8a0bbb-7c9d-4ba1-bf46-ab5bb1113720 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.083752 Oct 27 18:57:52.117876 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1547/2985] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:52 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:52.197679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-980c7444-1716-4943-b7cf-fb3d9e195828 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:52.198859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-980c7444-1716-4943-b7cf-fb3d9e195828 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:52.221135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980c7444-1716-4943-b7cf-fb3d9e195828 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:52.222009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980c7444-1716-4943-b7cf-fb3d9e195828 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:52.222910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980c7444-1716-4943-b7cf-fb3d9e195828 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:52.223854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980c7444-1716-4943-b7cf-fb3d9e195828 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:52.224705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980c7444-1716-4943-b7cf-fb3d9e195828 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:52.225321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980c7444-1716-4943-b7cf-fb3d9e195828 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:52.273957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:52.464471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-980c7444-1716-4943-b7cf-fb3d9e195828 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:52.478499 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-980c7444-1716-4943-b7cf-fb3d9e195828 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1323 microversion: 2.1 time: 0.284528 Oct 27 18:57:52.497770 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1439/2986] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:52 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:52.497893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-92cd2b46-6ed6-4cc6-8d4d-948741edbaad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:52.497893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-92cd2b46-6ed6-4cc6-8d4d-948741edbaad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:52.519173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92cd2b46-6ed6-4cc6-8d4d-948741edbaad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:52.521458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92cd2b46-6ed6-4cc6-8d4d-948741edbaad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:52.522926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92cd2b46-6ed6-4cc6-8d4d-948741edbaad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:52.526628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92cd2b46-6ed6-4cc6-8d4d-948741edbaad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:52.528727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92cd2b46-6ed6-4cc6-8d4d-948741edbaad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:52.531088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92cd2b46-6ed6-4cc6-8d4d-948741edbaad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:52.601089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-741368cc-9987-4da0-a5e6-9f752ff001d4 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:52.601959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-741368cc-9987-4da0-a5e6-9f752ff001d4 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:52.629811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-741368cc-9987-4da0-a5e6-9f752ff001d4 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:52.632200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-741368cc-9987-4da0-a5e6-9f752ff001d4 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:52.633371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-741368cc-9987-4da0-a5e6-9f752ff001d4 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:52.640726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-741368cc-9987-4da0-a5e6-9f752ff001d4 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:52.646077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-741368cc-9987-4da0-a5e6-9f752ff001d4 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:52.646077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-741368cc-9987-4da0-a5e6-9f752ff001d4 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:53.117278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-92cd2b46-6ed6-4cc6-8d4d-948741edbaad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:53.131251 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-92cd2b46-6ed6-4cc6-8d4d-948741edbaad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1503 microversion: 2.1 time: 0.641635 Oct 27 18:57:53.132217 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1548/2987] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:52 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1503 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:53.145226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0000d3d0-5776-4ea8-a9e2-632c6aeb6147 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a0ce3a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:53.166819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-741368cc-9987-4da0-a5e6-9f752ff001d4 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:53.180904 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-741368cc-9987-4da0-a5e6-9f752ff001d4 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1313 microversion: 2.1 time: 0.585152 Oct 27 18:57:53.197264 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1440/2988] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:52 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1313 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:53.225181 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0000d3d0-5776-4ea8-a9e2-632c6aeb6147 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.091485 Oct 27 18:57:53.235253 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1549/2989] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:53 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:53.515242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c027e1cd-3b91-461b-b342-2a03fa236308 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:53.516512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c027e1cd-3b91-461b-b342-2a03fa236308 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:53.532721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c027e1cd-3b91-461b-b342-2a03fa236308 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:53.533498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c027e1cd-3b91-461b-b342-2a03fa236308 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:53.534937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c027e1cd-3b91-461b-b342-2a03fa236308 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:53.537791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c027e1cd-3b91-461b-b342-2a03fa236308 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:53.538420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c027e1cd-3b91-461b-b342-2a03fa236308 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:53.540266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c027e1cd-3b91-461b-b342-2a03fa236308 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:53.632489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5b7947f6-f477-438c-bf11-014870fe1cd4 req-61aa66b9-03f1-486f-810a-d536b1171bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1eb1b0-efaa-435d-8778-9bfbd72c5699", "name": "network-vif-plugged", "status": "completed", "tag": "bb0bee56-cdb7-4296-bd24-5e8a5ead4a0b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:53.674957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5b7947f6-f477-438c-bf11-014870fe1cd4 req-61aa66b9-03f1-486f-810a-d536b1171bb1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:53.681755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5b7947f6-f477-438c-bf11-014870fe1cd4 req-61aa66b9-03f1-486f-810a-d536b1171bb1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:53.682308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5b7947f6-f477-438c-bf11-014870fe1cd4 req-61aa66b9-03f1-486f-810a-d536b1171bb1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:53.702144 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5b7947f6-f477-438c-bf11-014870fe1cd4 req-61aa66b9-03f1-486f-810a-d536b1171bb1 service nova] Creating event network-vif-plugged:bb0bee56-cdb7-4296-bd24-5e8a5ead4a0b for instance ac1eb1b0-efaa-435d-8778-9bfbd72c5699 on n-h1-860687-3 Oct 27 18:57:53.721373 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5b7947f6-f477-438c-bf11-014870fe1cd4 req-61aa66b9-03f1-486f-810a-d536b1171bb1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090988 Oct 27 18:57:53.722336 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1550/2990] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:57:54.173444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f960605-484d-48f6-8394-d6960e8b9f27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:54.179477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6f960605-484d-48f6-8394-d6960e8b9f27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:54.195152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f960605-484d-48f6-8394-d6960e8b9f27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:54.195942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f960605-484d-48f6-8394-d6960e8b9f27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:54.196549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f960605-484d-48f6-8394-d6960e8b9f27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:54.197492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f960605-484d-48f6-8394-d6960e8b9f27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:54.198131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f960605-484d-48f6-8394-d6960e8b9f27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:54.198971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f960605-484d-48f6-8394-d6960e8b9f27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:54.474815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c027e1cd-3b91-461b-b342-2a03fa236308 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:54.485904 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c027e1cd-3b91-461b-b342-2a03fa236308 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1323 microversion: 2.1 time: 0.980298 Oct 27 18:57:54.498913 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1441/2991] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:53 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1323 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:54.512145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ad2a4eaa-8bf1-4c6c-a2e5-6e5f722cf687 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:54.517454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ad2a4eaa-8bf1-4c6c-a2e5-6e5f722cf687 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:54.531096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad2a4eaa-8bf1-4c6c-a2e5-6e5f722cf687 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:54.532669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad2a4eaa-8bf1-4c6c-a2e5-6e5f722cf687 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:54.536681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad2a4eaa-8bf1-4c6c-a2e5-6e5f722cf687 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:54.538583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad2a4eaa-8bf1-4c6c-a2e5-6e5f722cf687 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:54.539282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad2a4eaa-8bf1-4c6c-a2e5-6e5f722cf687 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:54.539898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad2a4eaa-8bf1-4c6c-a2e5-6e5f722cf687 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:54.918334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ad2a4eaa-8bf1-4c6c-a2e5-6e5f722cf687 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:54.928511 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ad2a4eaa-8bf1-4c6c-a2e5-6e5f722cf687 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1313 microversion: 2.1 time: 0.428308 Oct 27 18:57:54.929313 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1442/2992] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:54 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:54.934309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7118f9a2-9e47-4863-ab63-52334273c47e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc8733669d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:55.009634 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7118f9a2-9e47-4863-ab63-52334273c47e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.079073 Oct 27 18:57:55.010222 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1443/2993] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:54 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:55.048323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6f960605-484d-48f6-8394-d6960e8b9f27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:55.048323 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6f960605-484d-48f6-8394-d6960e8b9f27 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.884383 Oct 27 18:57:55.048323 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1551/2994] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:54 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:55.078114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c6f58dbe-c081-4d05-8fdb-a56d8a201ea2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:55.079072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c6f58dbe-c081-4d05-8fdb-a56d8a201ea2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:55.085610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6f58dbe-c081-4d05-8fdb-a56d8a201ea2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:55.086132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6f58dbe-c081-4d05-8fdb-a56d8a201ea2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:55.086580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6f58dbe-c081-4d05-8fdb-a56d8a201ea2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:55.087491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6f58dbe-c081-4d05-8fdb-a56d8a201ea2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:55.088183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6f58dbe-c081-4d05-8fdb-a56d8a201ea2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:55.088798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6f58dbe-c081-4d05-8fdb-a56d8a201ea2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:55.250917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c6f58dbe-c081-4d05-8fdb-a56d8a201ea2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:55.260812 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c6f58dbe-c081-4d05-8fdb-a56d8a201ea2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.187504 Oct 27 18:57:55.262068 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1444/2995] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:55 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:55.286420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d116640-77d2-4eb3-992b-e51cf836e25e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:55.287046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9d116640-77d2-4eb3-992b-e51cf836e25e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 2a76a3aa-9191-4870-9e82-b90a793a3758] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:55.300252 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-9d116640-77d2-4eb3-992b-e51cf836e25e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 2a76a3aa-9191-4870-9e82-b90a793a3758 could not be found. Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d116640-77d2-4eb3-992b-e51cf836e25e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/2a76a3aa-9191-4870-9e82-b90a793a3758/action HTTP/1.1 Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 15 Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: {"unpause": {}} Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 2a76a3aa-9191-4870-9e82-b90a793a3758 could not be found. Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '2a76a3aa-9191-4870-9e82-b90a793a3758', 'body': {'unpause': {}}} Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a76a3aa-9191-4870-9e82-b90a793a3758 could not be found. Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a76a3aa-9191-4870-9e82-b90a793a3758 could not be found. Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:55.302103 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:55.308084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:55.308084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:55.308084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a76a3aa-9191-4870-9e82-b90a793a3758 could not be found. Oct 27 18:57:55.308084 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:55.308084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d116640-77d2-4eb3-992b-e51cf836e25e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 2a76a3aa-9191-4870-9e82-b90a793a3758 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:55.308084 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9d116640-77d2-4eb3-992b-e51cf836e25e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/2a76a3aa-9191-4870-9e82-b90a793a3758/action" status: 404 len: 111 microversion: 2.1 time: 0.023250 Oct 27 18:57:55.309902 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1552/2996] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:55 2022] POST /compute/v2.1/servers/2a76a3aa-9191-4870-9e82-b90a793a3758/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:57:55.316844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8185623e-e6f1-4624-bc88-7b713567e58e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:55.317481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8185623e-e6f1-4624-bc88-7b713567e58e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:55.324187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8185623e-e6f1-4624-bc88-7b713567e58e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:55.324685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8185623e-e6f1-4624-bc88-7b713567e58e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:55.325404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8185623e-e6f1-4624-bc88-7b713567e58e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:55.326199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8185623e-e6f1-4624-bc88-7b713567e58e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:55.327500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8185623e-e6f1-4624-bc88-7b713567e58e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:55.328070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8185623e-e6f1-4624-bc88-7b713567e58e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:55.494541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8185623e-e6f1-4624-bc88-7b713567e58e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:55.497158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:55.507190 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8185623e-e6f1-4624-bc88-7b713567e58e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.194298 Oct 27 18:57:55.507190 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1445/2997] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:55 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:55.512169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-149bf37e-2b0a-45dd-ae15-b8259770f197 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:55.513153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-149bf37e-2b0a-45dd-ae15-b8259770f197 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:55.534998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-149bf37e-2b0a-45dd-ae15-b8259770f197 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:55.535573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-149bf37e-2b0a-45dd-ae15-b8259770f197 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:55.536344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-149bf37e-2b0a-45dd-ae15-b8259770f197 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:55.537305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-149bf37e-2b0a-45dd-ae15-b8259770f197 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:55.537785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-149bf37e-2b0a-45dd-ae15-b8259770f197 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:55.538290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-149bf37e-2b0a-45dd-ae15-b8259770f197 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:55.539750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bec35d0b-eac7-47d7-a142-42f93bd44957 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:55.541664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bec35d0b-eac7-47d7-a142-42f93bd44957 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:55.551379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bec35d0b-eac7-47d7-a142-42f93bd44957 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:55.552349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bec35d0b-eac7-47d7-a142-42f93bd44957 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:55.553049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bec35d0b-eac7-47d7-a142-42f93bd44957 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:55.554003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bec35d0b-eac7-47d7-a142-42f93bd44957 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:55.554792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bec35d0b-eac7-47d7-a142-42f93bd44957 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:55.555451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bec35d0b-eac7-47d7-a142-42f93bd44957 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:55.743899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bec35d0b-eac7-47d7-a142-42f93bd44957 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:55.755829 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bec35d0b-eac7-47d7-a142-42f93bd44957 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.223155 Oct 27 18:57:55.756498 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1446/2998] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:55 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:55.779817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-690ae764-2b1d-46b4-a368-d07e4b137a80 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:55.780865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-690ae764-2b1d-46b4-a368-d07e4b137a80 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:55.788892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-690ae764-2b1d-46b4-a368-d07e4b137a80 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:55.790724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-690ae764-2b1d-46b4-a368-d07e4b137a80 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:55.791487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-690ae764-2b1d-46b4-a368-d07e4b137a80 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:55.792400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-690ae764-2b1d-46b4-a368-d07e4b137a80 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:55.793083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-690ae764-2b1d-46b4-a368-d07e4b137a80 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:55.793610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-690ae764-2b1d-46b4-a368-d07e4b137a80 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:55.834020 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-690ae764-2b1d-46b4-a368-d07e4b137a80 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Cannot 'unpause' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-690ae764-2b1d-46b4-a368-d07e4b137a80 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action HTTP/1.1 Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 15 Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: {"unpause": {}} Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: exception: Cannot 'unpause' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a6e311e1-6dd0-4498-897c-c92ce762d9b9', 'body': {'unpause': {}}} Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 in vm_state active. Cannot unpause while the instance is in this state. Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:55.837255 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:55.843009 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:55.843009 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:55.843009 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:55.843009 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:57:55.843009 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:55.845137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-690ae764-2b1d-46b4-a368-d07e4b137a80 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 409 to user: Cannot 'unpause' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:55.846097 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-690ae764-2b1d-46b4-a368-d07e4b137a80 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action" status: 409 len: 145 microversion: 2.1 time: 0.070329 Oct 27 18:57:55.846745 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1447/2999] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:55 2022] POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action => generated 145 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 18:57:55.855636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4d008964-1c5c-4b81-90cb-647d5f0f34b7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:55.856611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4d008964-1c5c-4b81-90cb-647d5f0f34b7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:55.864732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d008964-1c5c-4b81-90cb-647d5f0f34b7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:55.865397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d008964-1c5c-4b81-90cb-647d5f0f34b7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:55.865940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d008964-1c5c-4b81-90cb-647d5f0f34b7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:55.867532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d008964-1c5c-4b81-90cb-647d5f0f34b7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:55.868215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d008964-1c5c-4b81-90cb-647d5f0f34b7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:55.868659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d008964-1c5c-4b81-90cb-647d5f0f34b7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:56.042499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4d008964-1c5c-4b81-90cb-647d5f0f34b7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:56.052895 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4d008964-1c5c-4b81-90cb-647d5f0f34b7 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.201442 Oct 27 18:57:56.053480 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1448/3000] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:55 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:56.058434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-37aa0505-0f88-4dae-b127-13e0cf449ec5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:56.059579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-37aa0505-0f88-4dae-b127-13e0cf449ec5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:56.067491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37aa0505-0f88-4dae-b127-13e0cf449ec5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:56.067989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37aa0505-0f88-4dae-b127-13e0cf449ec5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:56.068436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37aa0505-0f88-4dae-b127-13e0cf449ec5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:56.069182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37aa0505-0f88-4dae-b127-13e0cf449ec5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:56.069647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37aa0505-0f88-4dae-b127-13e0cf449ec5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:56.070084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37aa0505-0f88-4dae-b127-13e0cf449ec5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:56.190846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-149bf37e-2b0a-45dd-ae15-b8259770f197 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:56.199643 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-149bf37e-2b0a-45dd-ae15-b8259770f197 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1323 microversion: 2.1 time: 0.691808 Oct 27 18:57:56.215194 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1553/3001] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:55 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1323 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:56.215194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5946b23c-876c-498c-8ca9-fa01b1681501 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc87326c940>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:56.252661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-37aa0505-0f88-4dae-b127-13e0cf449ec5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:56.282055 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-37aa0505-0f88-4dae-b127-13e0cf449ec5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1500 microversion: 2.1 time: 0.227265 Oct 27 18:57:56.304498 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1449/3002] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:56 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1500 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:56.314315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5bfa686c-031a-428a-a991-f17351993c7a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:56.318178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5bfa686c-031a-428a-a991-f17351993c7a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:56.335261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bfa686c-031a-428a-a991-f17351993c7a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:56.336702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bfa686c-031a-428a-a991-f17351993c7a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:56.337342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bfa686c-031a-428a-a991-f17351993c7a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:56.338288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bfa686c-031a-428a-a991-f17351993c7a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:56.339230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bfa686c-031a-428a-a991-f17351993c7a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:56.339681 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5946b23c-876c-498c-8ca9-fa01b1681501 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.130439 Oct 27 18:57:56.340347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bfa686c-031a-428a-a991-f17351993c7a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:56.340928 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1554/3003] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:56 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:56.361406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-07b66020-03a2-460f-9ab6-cf20e7dffb55 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:56.368590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-07b66020-03a2-460f-9ab6-cf20e7dffb55 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:56.389208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07b66020-03a2-460f-9ab6-cf20e7dffb55 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:56.390673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07b66020-03a2-460f-9ab6-cf20e7dffb55 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:56.391130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07b66020-03a2-460f-9ab6-cf20e7dffb55 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:56.391868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07b66020-03a2-460f-9ab6-cf20e7dffb55 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:56.394910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07b66020-03a2-460f-9ab6-cf20e7dffb55 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:56.395499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07b66020-03a2-460f-9ab6-cf20e7dffb55 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:56.437587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-07b66020-03a2-460f-9ab6-cf20e7dffb55 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lazy-loading 'flavor' on Instance uuid ac1eb1b0-efaa-435d-8778-9bfbd72c5699 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:57:56.538444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5bfa686c-031a-428a-a991-f17351993c7a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:56.550920 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5bfa686c-031a-428a-a991-f17351993c7a tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.245064 Oct 27 18:57:56.552509 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1450/3004] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:56 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:56.593092 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-07b66020-03a2-460f-9ab6-cf20e7dffb55 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "POST /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699/action" status: 200 len: 32 microversion: 2.1 time: 0.246788 Oct 27 18:57:56.599982 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1555/3005] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:56 2022] POST /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699/action => generated 32 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:57:56.606853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3e8d2e4e-a3f5-42ad-af72-0cb0b0bde4aa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:56.608439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3e8d2e4e-a3f5-42ad-af72-0cb0b0bde4aa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 1fe19201-86fa-4f34-843e-769f15918f65] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:56.616436 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-3e8d2e4e-a3f5-42ad-af72-0cb0b0bde4aa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 1fe19201-86fa-4f34-843e-769f15918f65 could not be found. Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3e8d2e4e-a3f5-42ad-af72-0cb0b0bde4aa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/1fe19201-86fa-4f34-843e-769f15918f65/action HTTP/1.1 Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 18 Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: {"unshelve": null} Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 1fe19201-86fa-4f34-843e-769f15918f65 could not be found. Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '1fe19201-86fa-4f34-843e-769f15918f65', 'body': {'unshelve': None}} Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe19201-86fa-4f34-843e-769f15918f65 could not be found. Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe19201-86fa-4f34-843e-769f15918f65 could not be found. Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:56.620116 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:56.628494 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:56.628494 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:56.628494 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:56.628494 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:56.628494 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:56.628494 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:56.628494 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe19201-86fa-4f34-843e-769f15918f65 could not be found. Oct 27 18:57:56.628494 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:56.628494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3e8d2e4e-a3f5-42ad-af72-0cb0b0bde4aa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 1fe19201-86fa-4f34-843e-769f15918f65 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:56.628494 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3e8d2e4e-a3f5-42ad-af72-0cb0b0bde4aa tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/1fe19201-86fa-4f34-843e-769f15918f65/action" status: 404 len: 111 microversion: 2.1 time: 0.023521 Oct 27 18:57:56.632848 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1556/3006] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:56 2022] POST /compute/v2.1/servers/1fe19201-86fa-4f34-843e-769f15918f65/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:57:56.647113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de4efa6e-9442-4aad-b5ec-8db20c778f9e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:56.649245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-de4efa6e-9442-4aad-b5ec-8db20c778f9e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:56.675328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de4efa6e-9442-4aad-b5ec-8db20c778f9e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:56.675834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de4efa6e-9442-4aad-b5ec-8db20c778f9e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:56.676603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de4efa6e-9442-4aad-b5ec-8db20c778f9e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:56.689853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de4efa6e-9442-4aad-b5ec-8db20c778f9e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:56.692912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de4efa6e-9442-4aad-b5ec-8db20c778f9e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:56.694914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de4efa6e-9442-4aad-b5ec-8db20c778f9e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:56.906517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e929aad8-8471-4a08-8930-066ab902bd08 tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] Action: 'create', calling method: .version_select at 0x7fc869c78940>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:56.930906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e929aad8-8471-4a08-8930-066ab902bd08 tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] Getting quotas for project ed2b5fb58f124e2f8fc4ec03ff28cb0a. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:57:56.936603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e929aad8-8471-4a08-8930-066ab902bd08 tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] Getting quotas for user 74e529c084384d6ea9607ed559154d48 and project ed2b5fb58f124e2f8fc4ec03ff28cb0a. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:57:57.003491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e929aad8-8471-4a08-8930-066ab902bd08 tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] Getting quotas for project ed2b5fb58f124e2f8fc4ec03ff28cb0a. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:57:57.009295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e929aad8-8471-4a08-8930-066ab902bd08 tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] Getting quotas for user 74e529c084384d6ea9607ed559154d48 and project ed2b5fb58f124e2f8fc4ec03ff28cb0a. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:57:57.022233 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e929aad8-8471-4a08-8930-066ab902bd08 tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.468457 Oct 27 18:57:57.023205 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1451/3007] 10.222.0.42 () {62 vars in 1214 bytes} [Thu Oct 27 18:57:56 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:57:57.027859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0652f704-1233-4b2a-855c-1f91d5b2dc7b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:57.028679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0652f704-1233-4b2a-855c-1f91d5b2dc7b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:57.035789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0652f704-1233-4b2a-855c-1f91d5b2dc7b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:57.036508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0652f704-1233-4b2a-855c-1f91d5b2dc7b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:57.037118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0652f704-1233-4b2a-855c-1f91d5b2dc7b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:57.037993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0652f704-1233-4b2a-855c-1f91d5b2dc7b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:57.038648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0652f704-1233-4b2a-855c-1f91d5b2dc7b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:57.039262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0652f704-1233-4b2a-855c-1f91d5b2dc7b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:57.078443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-de4efa6e-9442-4aad-b5ec-8db20c778f9e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:57.098753 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-de4efa6e-9442-4aad-b5ec-8db20c778f9e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.464799 Oct 27 18:57:57.103950 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1557/3008] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:56 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:57.117997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ecbc0803-197d-4687-b4bb-abd696596aed tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:57.146792 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ecbc0803-197d-4687-b4bb-abd696596aed tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.041512 Oct 27 18:57:57.155269 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1558/3009] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Oct 27 18:57:57 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:57:57.161874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ec08453f-f372-4b70-a0a7-4c177298f86f tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:57.198202 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ec08453f-f372-4b70-a0a7-4c177298f86f tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/07b5211b-2f75-4405-8031-47a3adb3a587" status: 200 len: 235 microversion: 2.64 time: 0.040448 Oct 27 18:57:57.205916 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1559/3010] 10.222.0.42 () {60 vars in 1304 bytes} [Thu Oct 27 18:57:57 2022] GET /compute/v2.1/os-server-groups/07b5211b-2f75-4405-8031-47a3adb3a587 => generated 235 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:57:57.212365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8c18ef4e-3d95-4d06-9ca0-32b0c6a2842b tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:57.281569 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8c18ef4e-3d95-4d06-9ca0-32b0c6a2842b tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/07b5211b-2f75-4405-8031-47a3adb3a587" status: 204 len: 0 microversion: 2.64 time: 0.073776 Oct 27 18:57:57.288609 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1560/3011] 10.222.0.42 () {60 vars in 1307 bytes} [Thu Oct 27 18:57:57 2022] DELETE /compute/v2.1/os-server-groups/07b5211b-2f75-4405-8031-47a3adb3a587 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 18:57:57.301766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-43deb3e4-1a28-4596-b86b-1db0ed3460a7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:57.303242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-43deb3e4-1a28-4596-b86b-1db0ed3460a7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:57.308388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0652f704-1233-4b2a-855c-1f91d5b2dc7b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:57.320293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43deb3e4-1a28-4596-b86b-1db0ed3460a7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:57.320920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43deb3e4-1a28-4596-b86b-1db0ed3460a7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:57.321385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43deb3e4-1a28-4596-b86b-1db0ed3460a7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:57.322320 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0652f704-1233-4b2a-855c-1f91d5b2dc7b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.297580 Oct 27 18:57:57.324420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43deb3e4-1a28-4596-b86b-1db0ed3460a7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:57.325536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43deb3e4-1a28-4596-b86b-1db0ed3460a7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:57.327158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43deb3e4-1a28-4596-b86b-1db0ed3460a7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:57.344900 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1452/3012] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:57 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:57.344900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb598ef7-6149-4f95-a12d-9efb2f86260f tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:57.356906 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-cb598ef7-6149-4f95-a12d-9efb2f86260f tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] HTTP exception thrown: Instance group 07b5211b-2f75-4405-8031-47a3adb3a587 could not be found. Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb598ef7-6149-4f95-a12d-9efb2f86260f tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] Request method failure captured: Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/os-server-groups/07b5211b-2f75-4405-8031-47a3adb3a587 HTTP/1.1 Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtS0U5gR5LUw4shpoELrcjuyTVajfHKQibyzfU1xvZ9Jgp773zIt0ZA4eb-3w4BFrsuKa8mlkbQvRWhFjZvQOD7SeEizwQBmvj0CifigLcybxLZ6_-WNNrDfIvr7wkf6__hbOHJ1XtVQ_A5PlzdOVoZgrn6iOkyeAaD_wUQir3pnq5g Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.64 Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: ed2b5fb58f124e2f8fc4ec03ff28cb0a Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerGroup264TestJSON-1976208757 Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ed2b5fb58f124e2f8fc4ec03ff28cb0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed2b5fb58f124e2f8fc4ec03ff28cb0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ed2b5fb58f124e2f8fc4ec03ff28cb0a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed2b5fb58f124e2f8fc4ec03ff28cb0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerGroup264TestJSON-1976208757 Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: ed2b5fb58f124e2f8fc4ec03ff28cb0a Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1976208757 Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerGroup264TestJSON-1976208757-project Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 74e529c084384d6ea9607ed559154d48 Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerGroup264TestJSON-1976208757-project Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance group 07b5211b-2f75-4405-8031-47a3adb3a587 could not be found. Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '07b5211b-2f75-4405-8031-47a3adb3a587'} Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 07b5211b-2f75-4405-8031-47a3adb3a587 could not be found. Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 07b5211b-2f75-4405-8031-47a3adb3a587 could not be found. Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:57.367288 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:57.376044 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:57.376044 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:57.376044 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:57.376044 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:57.376044 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 07b5211b-2f75-4405-8031-47a3adb3a587 could not be found. Oct 27 18:57:57.376044 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:57.376044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb598ef7-6149-4f95-a12d-9efb2f86260f tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] Returning 404 to user: Instance group 07b5211b-2f75-4405-8031-47a3adb3a587 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:57.376044 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cb598ef7-6149-4f95-a12d-9efb2f86260f tempest-ServerGroup264TestJSON-1976208757 tempest-ServerGroup264TestJSON-1976208757-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/07b5211b-2f75-4405-8031-47a3adb3a587" status: 404 len: 117 microversion: 2.64 time: 0.040629 Oct 27 18:57:57.376044 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1453/3013] 10.222.0.42 () {60 vars in 1307 bytes} [Thu Oct 27 18:57:57 2022] DELETE /compute/v2.1/os-server-groups/07b5211b-2f75-4405-8031-47a3adb3a587 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:57:57.380943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4d582456-34ab-4f97-915f-192599e040e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:57.384593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4d582456-34ab-4f97-915f-192599e040e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:57.393073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d582456-34ab-4f97-915f-192599e040e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:57.394057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d582456-34ab-4f97-915f-192599e040e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:57.394805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d582456-34ab-4f97-915f-192599e040e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:57.395852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d582456-34ab-4f97-915f-192599e040e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:57.396576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d582456-34ab-4f97-915f-192599e040e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:57.397296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d582456-34ab-4f97-915f-192599e040e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:57.669823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-43deb3e4-1a28-4596-b86b-1db0ed3460a7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:57.682584 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-43deb3e4-1a28-4596-b86b-1db0ed3460a7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1323 microversion: 2.1 time: 0.392255 Oct 27 18:57:57.702124 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1561/3014] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:57 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1323 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:57.707714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5243b3a4-2099-4709-babf-7414ae74e352 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc87335b430>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:57.754954 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5243b3a4-2099-4709-babf-7414ae74e352 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.050812 Oct 27 18:57:57.755660 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1562/3015] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:57 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:57.865904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4d582456-34ab-4f97-915f-192599e040e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:57.883118 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4d582456-34ab-4f97-915f-192599e040e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.510895 Oct 27 18:57:57.883907 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1454/3016] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:57 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:57.906709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84a5229d-9f13-4329-8819-39a0908fbfd3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:57.907584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-84a5229d-9f13-4329-8819-39a0908fbfd3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:57.914492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84a5229d-9f13-4329-8819-39a0908fbfd3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:57.915306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84a5229d-9f13-4329-8819-39a0908fbfd3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:57.915966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84a5229d-9f13-4329-8819-39a0908fbfd3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:57.916933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84a5229d-9f13-4329-8819-39a0908fbfd3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:57.917858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84a5229d-9f13-4329-8819-39a0908fbfd3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:57.918754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84a5229d-9f13-4329-8819-39a0908fbfd3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:57.924793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:57:57.960184 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-84a5229d-9f13-4329-8819-39a0908fbfd3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Cannot 'unshelve' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84a5229d-9f13-4329-8819-39a0908fbfd3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action HTTP/1.1 Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 18 Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: {"unshelve": null} Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: exception: Cannot 'unshelve' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'a6e311e1-6dd0-4498-897c-c92ce762d9b9', 'body': {'unshelve': None}} Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 in vm_state active. Cannot unshelve while the instance is in this state. Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 18:57:57.962137 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 18:57:57.966083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:57:57.966083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:57.966083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:57.966083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:57.966083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:57.966083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:57.966083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:57.966083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:57.966083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:57.966083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active Oct 27 18:57:57.966083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:57.969454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84a5229d-9f13-4329-8819-39a0908fbfd3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 409 to user: Cannot 'unshelve' instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 while it is in vm_state active {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:57.970797 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-84a5229d-9f13-4329-8819-39a0908fbfd3 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action" status: 409 len: 146 microversion: 2.1 time: 0.068535 Oct 27 18:57:57.984379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7f1aef47-1ca7-4bab-a10e-266b556124bc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:57.985340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7f1aef47-1ca7-4bab-a10e-266b556124bc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:57.988796 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1563/3017] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:57:57 2022] POST /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9/action => generated 146 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:57:57.992696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f1aef47-1ca7-4bab-a10e-266b556124bc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:57.993479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f1aef47-1ca7-4bab-a10e-266b556124bc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:57.994146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f1aef47-1ca7-4bab-a10e-266b556124bc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:57.995723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f1aef47-1ca7-4bab-a10e-266b556124bc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:57.996527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f1aef47-1ca7-4bab-a10e-266b556124bc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:57.997274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f1aef47-1ca7-4bab-a10e-266b556124bc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:58.131185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ac9643d5-eb44-4863-9b28-26c4b7ff3c36 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:58.131935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ac9643d5-eb44-4863-9b28-26c4b7ff3c36 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:58.140582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac9643d5-eb44-4863-9b28-26c4b7ff3c36 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:58.141305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac9643d5-eb44-4863-9b28-26c4b7ff3c36 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:58.141825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac9643d5-eb44-4863-9b28-26c4b7ff3c36 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:58.142716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac9643d5-eb44-4863-9b28-26c4b7ff3c36 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:58.143306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac9643d5-eb44-4863-9b28-26c4b7ff3c36 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:58.143816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac9643d5-eb44-4863-9b28-26c4b7ff3c36 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:58.335107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ac9643d5-eb44-4863-9b28-26c4b7ff3c36 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:58.344704 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ac9643d5-eb44-4863-9b28-26c4b7ff3c36 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.222025 Oct 27 18:57:58.359436 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1564/3018] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:58 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:58.368961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-751ab4dd-c050-4736-9469-79f367dbaa1d req-614254ef-47df-4e1e-8d02-776fefe9e3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c280a00e-288a-4927-95e6-1f2b3880f240", "name": "network-vif-plugged", "status": "completed", "tag": "e3f7c665-6965-4529-a1e9-cf0c7c389160"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:58.380637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-751ab4dd-c050-4736-9469-79f367dbaa1d req-614254ef-47df-4e1e-8d02-776fefe9e3e3 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:58.381530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-751ab4dd-c050-4736-9469-79f367dbaa1d req-614254ef-47df-4e1e-8d02-776fefe9e3e3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:58.382221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-751ab4dd-c050-4736-9469-79f367dbaa1d req-614254ef-47df-4e1e-8d02-776fefe9e3e3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:58.397169 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-751ab4dd-c050-4736-9469-79f367dbaa1d req-614254ef-47df-4e1e-8d02-776fefe9e3e3 service nova] Creating event network-vif-plugged:e3f7c665-6965-4529-a1e9-cf0c7c389160 for instance c280a00e-288a-4927-95e6-1f2b3880f240 on n-h2-860687-3 Oct 27 18:57:58.404530 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-751ab4dd-c050-4736-9469-79f367dbaa1d req-614254ef-47df-4e1e-8d02-776fefe9e3e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043489 Oct 27 18:57:58.405824 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1565/3019] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:57:58.553571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7f1aef47-1ca7-4bab-a10e-266b556124bc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:58.604512 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7f1aef47-1ca7-4bab-a10e-266b556124bc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.627481 Oct 27 18:57:58.620154 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1455/3020] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:57 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:58.642695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dae0aafa-ce43-46f6-8a48-0ee68c6de322 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:58.643419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dae0aafa-ce43-46f6-8a48-0ee68c6de322 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:58.650111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dae0aafa-ce43-46f6-8a48-0ee68c6de322 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:58.651003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dae0aafa-ce43-46f6-8a48-0ee68c6de322 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:58.651670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dae0aafa-ce43-46f6-8a48-0ee68c6de322 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:58.652609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dae0aafa-ce43-46f6-8a48-0ee68c6de322 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:58.653294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dae0aafa-ce43-46f6-8a48-0ee68c6de322 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:58.653965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dae0aafa-ce43-46f6-8a48-0ee68c6de322 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:58.706431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f80f24a5-8f13-49e9-a902-dd3eaedf7d67 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:58.707323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f80f24a5-8f13-49e9-a902-dd3eaedf7d67 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:58.720454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f80f24a5-8f13-49e9-a902-dd3eaedf7d67 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:58.721224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f80f24a5-8f13-49e9-a902-dd3eaedf7d67 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:58.721881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f80f24a5-8f13-49e9-a902-dd3eaedf7d67 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:58.722798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f80f24a5-8f13-49e9-a902-dd3eaedf7d67 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:58.723426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f80f24a5-8f13-49e9-a902-dd3eaedf7d67 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:58.724024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f80f24a5-8f13-49e9-a902-dd3eaedf7d67 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:58.937065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dae0aafa-ce43-46f6-8a48-0ee68c6de322 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:58.945356 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dae0aafa-ce43-46f6-8a48-0ee68c6de322 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.309033 Oct 27 18:57:58.947141 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1566/3021] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:58 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:58.952694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1f037e44-f4a7-4ef3-9dfd-bddcdaf65965 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc87335b700>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:59.008226 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1f037e44-f4a7-4ef3-9dfd-bddcdaf65965 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.059757 Oct 27 18:57:59.009202 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1567/3022] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:57:58 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:59.014554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3649688c-d751-49cd-b270-4c2e9766ddc8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-85782465_updated"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:59.018741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3649688c-d751-49cd-b270-4c2e9766ddc8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a96b4fdc-fd86-4b38-930c-7fca12373dbd] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:59.025324 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-3649688c-d751-49cd-b270-4c2e9766ddc8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance a96b4fdc-fd86-4b38-930c-7fca12373dbd could not be found. Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3649688c-d751-49cd-b270-4c2e9766ddc8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/servers/a96b4fdc-fd86-4b38-930c-7fca12373dbd HTTP/1.1 Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 79 Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-85782465_updated"}} Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance a96b4fdc-fd86-4b38-930c-7fca12373dbd could not be found. Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'a96b4fdc-fd86-4b38-930c-7fca12373dbd', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-85782465_updated'}}} Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96b4fdc-fd86-4b38-930c-7fca12373dbd could not be found. Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 27 18:57:59.028881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:57:59.033354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:57:59.033354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:57:59.033354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:57:59.033354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96b4fdc-fd86-4b38-930c-7fca12373dbd could not be found. Oct 27 18:57:59.033354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:59.033354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:59.033354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:59.033354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:59.033354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:59.033354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:59.033354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:57:59.033354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:57:59.033354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96b4fdc-fd86-4b38-930c-7fca12373dbd could not be found. Oct 27 18:57:59.033354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:57:59.035435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3649688c-d751-49cd-b270-4c2e9766ddc8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance a96b4fdc-fd86-4b38-930c-7fca12373dbd could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:59.036804 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3649688c-d751-49cd-b270-4c2e9766ddc8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "PUT /compute/v2.1/servers/a96b4fdc-fd86-4b38-930c-7fca12373dbd" status: 404 len: 111 microversion: 2.1 time: 0.026451 Oct 27 18:57:59.038098 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1568/3023] 10.222.0.42 () {60 vars in 1256 bytes} [Thu Oct 27 18:57:59 2022] PUT /compute/v2.1/servers/a96b4fdc-fd86-4b38-930c-7fca12373dbd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:57:59.047977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-04310eac-13ee-49b9-b892-e4197d46cc35 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:59.048621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-04310eac-13ee-49b9-b892-e4197d46cc35 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:59.055537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04310eac-13ee-49b9-b892-e4197d46cc35 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:59.056488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04310eac-13ee-49b9-b892-e4197d46cc35 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:59.057133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04310eac-13ee-49b9-b892-e4197d46cc35 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:59.058053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04310eac-13ee-49b9-b892-e4197d46cc35 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:59.058742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04310eac-13ee-49b9-b892-e4197d46cc35 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:59.059359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04310eac-13ee-49b9-b892-e4197d46cc35 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:59.259207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-04310eac-13ee-49b9-b892-e4197d46cc35 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:59.268173 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-04310eac-13ee-49b9-b892-e4197d46cc35 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.225689 Oct 27 18:57:59.269477 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1569/3024] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:59 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:59.304868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8c1a3299-304e-4bfa-9c4c-45c7b7478adc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:59.315645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8c1a3299-304e-4bfa-9c4c-45c7b7478adc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:59.323731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c1a3299-304e-4bfa-9c4c-45c7b7478adc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:59.324680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c1a3299-304e-4bfa-9c4c-45c7b7478adc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:59.325456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c1a3299-304e-4bfa-9c4c-45c7b7478adc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:59.326674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c1a3299-304e-4bfa-9c4c-45c7b7478adc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:59.327577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c1a3299-304e-4bfa-9c4c-45c7b7478adc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:59.328476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c1a3299-304e-4bfa-9c4c-45c7b7478adc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:59.594970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8c1a3299-304e-4bfa-9c4c-45c7b7478adc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:59.615410 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8c1a3299-304e-4bfa-9c4c-45c7b7478adc tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.320815 Oct 27 18:57:59.616321 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1570/3025] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:59 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:57:59.630990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a74f418b-877c-4707-8b86-ae0a3a07c5ce tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:59.631621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a74f418b-877c-4707-8b86-ae0a3a07c5ce tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:59.643051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a74f418b-877c-4707-8b86-ae0a3a07c5ce tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:59.643862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a74f418b-877c-4707-8b86-ae0a3a07c5ce tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:59.644478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a74f418b-877c-4707-8b86-ae0a3a07c5ce tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:59.645576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a74f418b-877c-4707-8b86-ae0a3a07c5ce tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:59.646207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a74f418b-877c-4707-8b86-ae0a3a07c5ce tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:59.650884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a74f418b-877c-4707-8b86-ae0a3a07c5ce tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:59.818104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f80f24a5-8f13-49e9-a902-dd3eaedf7d67 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:59.830464 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f80f24a5-8f13-49e9-a902-dd3eaedf7d67 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1323 microversion: 2.1 time: 1.127832 Oct 27 18:57:59.831067 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1456/3026] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:58 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1323 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:57:59.835796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-275b19a8-2936-4bea-aa71-5df005ae4765 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-275b19a8-2936-4bea-aa71-5df005ae4765 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: request: PUT /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 HTTP/1.1 Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 280 Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a6e311e1-6dd0-4498-897c-c92ce762d9b9', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:59.859838 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-275b19a8-2936-4bea-aa71-5df005ae4765 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:57:59.863278 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-275b19a8-2936-4bea-aa71-5df005ae4765 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "PUT /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 400 len: 619 microversion: 2.1 time: 0.029406 Oct 27 18:57:59.866073 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1457/3027] 10.222.0.42 () {60 vars in 1257 bytes} [Thu Oct 27 18:57:59 2022] PUT /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:57:59.876849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ba4e5637-772b-479f-a890-b1ee802da064 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:57:59.877485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ba4e5637-772b-479f-a890-b1ee802da064 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:57:59.885558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba4e5637-772b-479f-a890-b1ee802da064 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:59.886074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba4e5637-772b-479f-a890-b1ee802da064 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:59.886862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba4e5637-772b-479f-a890-b1ee802da064 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:59.887603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba4e5637-772b-479f-a890-b1ee802da064 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:57:59.888080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba4e5637-772b-479f-a890-b1ee802da064 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:57:59.888526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba4e5637-772b-479f-a890-b1ee802da064 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:57:59.898545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a74f418b-877c-4707-8b86-ae0a3a07c5ce tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:57:59.910051 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a74f418b-877c-4707-8b86-ae0a3a07c5ce tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.292447 Oct 27 18:57:59.910673 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1571/3028] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:59 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:00.025289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-80c02bff-66f5-4a0d-a8ee-fb9ba9687288 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc8732a1ca0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:00.103372 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-80c02bff-66f5-4a0d-a8ee-fb9ba9687288 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.082611 Oct 27 18:58:00.105146 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1572/3029] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:00 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:58:00.467296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-23c796e0-0609-4179-bb59-0015bb274e6a req-093ed1b5-c5a1-419e-9d9b-1ba9662af1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6ce120-4829-4180-9293-592f8e20e233", "name": "network-vif-plugged", "status": "completed", "tag": "b92235b2-2236-4871-b34f-af9a42350bb5"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:00.509507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-23c796e0-0609-4179-bb59-0015bb274e6a req-093ed1b5-c5a1-419e-9d9b-1ba9662af1d6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:00.510101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-23c796e0-0609-4179-bb59-0015bb274e6a req-093ed1b5-c5a1-419e-9d9b-1ba9662af1d6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:00.510715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-23c796e0-0609-4179-bb59-0015bb274e6a req-093ed1b5-c5a1-419e-9d9b-1ba9662af1d6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:00.527553 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-23c796e0-0609-4179-bb59-0015bb274e6a req-093ed1b5-c5a1-419e-9d9b-1ba9662af1d6 service nova] Creating event network-vif-plugged:b92235b2-2236-4871-b34f-af9a42350bb5 for instance ca6ce120-4829-4180-9293-592f8e20e233 on n-h2-860687-3 Oct 27 18:58:00.543486 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-23c796e0-0609-4179-bb59-0015bb274e6a req-093ed1b5-c5a1-419e-9d9b-1ba9662af1d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083547 Oct 27 18:58:00.544204 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1573/3030] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:58:00.664920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ba4e5637-772b-479f-a890-b1ee802da064 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:00.676946 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ba4e5637-772b-479f-a890-b1ee802da064 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.809388 Oct 27 18:58:00.691219 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1458/3031] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:57:59 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:00.738255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a167f902-02de-4714-835e-669961e1d6e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:00.739145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a167f902-02de-4714-835e-669961e1d6e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:00.759197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a167f902-02de-4714-835e-669961e1d6e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:00.760907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a167f902-02de-4714-835e-669961e1d6e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:00.763045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a167f902-02de-4714-835e-669961e1d6e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:00.765139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a167f902-02de-4714-835e-669961e1d6e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:00.765917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a167f902-02de-4714-835e-669961e1d6e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:00.766612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a167f902-02de-4714-835e-669961e1d6e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:00.856485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-02216ed4-aad3-49ff-8e4f-985f10524d75 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:00.863260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-02216ed4-aad3-49ff-8e4f-985f10524d75 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:00.875882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02216ed4-aad3-49ff-8e4f-985f10524d75 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:00.878635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02216ed4-aad3-49ff-8e4f-985f10524d75 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:00.879674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02216ed4-aad3-49ff-8e4f-985f10524d75 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:00.880648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02216ed4-aad3-49ff-8e4f-985f10524d75 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:00.881328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02216ed4-aad3-49ff-8e4f-985f10524d75 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:00.882055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02216ed4-aad3-49ff-8e4f-985f10524d75 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:01.158872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a167f902-02de-4714-835e-669961e1d6e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:01.179000 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a167f902-02de-4714-835e-669961e1d6e2 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.462381 Oct 27 18:58:01.179934 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1574/3032] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:00 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:01.203218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d4faedc7-2e1e-412a-b6b0-d3ed3e61c238 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:01.204689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d4faedc7-2e1e-412a-b6b0-d3ed3e61c238 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:01.226376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4faedc7-2e1e-412a-b6b0-d3ed3e61c238 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:01.227146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4faedc7-2e1e-412a-b6b0-d3ed3e61c238 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:01.227813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4faedc7-2e1e-412a-b6b0-d3ed3e61c238 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:01.228701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4faedc7-2e1e-412a-b6b0-d3ed3e61c238 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:01.229913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4faedc7-2e1e-412a-b6b0-d3ed3e61c238 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:01.231065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4faedc7-2e1e-412a-b6b0-d3ed3e61c238 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:01.554108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-02216ed4-aad3-49ff-8e4f-985f10524d75 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:01.571056 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-02216ed4-aad3-49ff-8e4f-985f10524d75 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1323 microversion: 2.1 time: 0.718951 Oct 27 18:58:01.572758 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1459/3033] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:00 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1323 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:58:01.586010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b35b5f04-69a4-4a45-b518-de48bf7a05ce tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b3acca0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:01.626943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d4faedc7-2e1e-412a-b6b0-d3ed3e61c238 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:01.646838 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d4faedc7-2e1e-412a-b6b0-d3ed3e61c238 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.461906 Oct 27 18:58:01.662885 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b35b5f04-69a4-4a45-b518-de48bf7a05ce tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.088379 Oct 27 18:58:01.667146 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1575/3034] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:01 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:01.675176 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1460/3035] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:01 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:01.686722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a45c995-4c8a-42b5-b5db-0c580620ab9b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a45c995-4c8a-42b5-b5db-0c580620ab9b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 HTTP/1.1 Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 24 Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": ""}} Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'a6e311e1-6dd0-4498-897c-c92ce762d9b9', 'body': {'server': {'name': ''}}} Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi '' Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 18:58:01.702860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 18:58:01.707880 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:01.707880 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:58:01.707880 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:01.707880 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:01.707880 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:58:01.707880 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:58:01.707880 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 18:58:01.707880 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 18:58:01.707880 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 18:58:01.707880 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:01.709609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a45c995-4c8a-42b5-b5db-0c580620ab9b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:58:01.710698 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5a45c995-4c8a-42b5-b5db-0c580620ab9b tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "PUT /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 400 len: 108 microversion: 2.1 time: 0.034088 Oct 27 18:58:01.715225 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1576/3036] 10.222.0.42 () {60 vars in 1256 bytes} [Thu Oct 27 18:58:01 2022] PUT /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 108 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 18:58:01.723303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c758c30f-6741-4efd-bce4-20b0401209da tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:01.724679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c758c30f-6741-4efd-bce4-20b0401209da tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:01.736287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c758c30f-6741-4efd-bce4-20b0401209da tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:01.737369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c758c30f-6741-4efd-bce4-20b0401209da tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:01.739106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c758c30f-6741-4efd-bce4-20b0401209da tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:01.743175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c758c30f-6741-4efd-bce4-20b0401209da tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:01.743827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c758c30f-6741-4efd-bce4-20b0401209da tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:01.745042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c758c30f-6741-4efd-bce4-20b0401209da tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:02.115480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c758c30f-6741-4efd-bce4-20b0401209da tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:02.130657 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c758c30f-6741-4efd-bce4-20b0401209da tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1506 microversion: 2.1 time: 0.411205 Oct 27 18:58:02.133589 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1461/3037] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:01 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:02.611781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9dd3b6b9-c76e-46ee-98b3-b4fa90fde8cc tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:02.613794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9dd3b6b9-c76e-46ee-98b3-b4fa90fde8cc tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:02.635756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd3b6b9-c76e-46ee-98b3-b4fa90fde8cc tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:02.636281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd3b6b9-c76e-46ee-98b3-b4fa90fde8cc tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:02.636745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd3b6b9-c76e-46ee-98b3-b4fa90fde8cc tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:02.637489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd3b6b9-c76e-46ee-98b3-b4fa90fde8cc tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:02.637995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd3b6b9-c76e-46ee-98b3-b4fa90fde8cc tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:02.641818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd3b6b9-c76e-46ee-98b3-b4fa90fde8cc tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:02.680893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae80dfcc-5310-4ccf-b59c-d5b456321f3c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:02.681564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ae80dfcc-5310-4ccf-b59c-d5b456321f3c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:02.700275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae80dfcc-5310-4ccf-b59c-d5b456321f3c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:02.702891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae80dfcc-5310-4ccf-b59c-d5b456321f3c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:02.705093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae80dfcc-5310-4ccf-b59c-d5b456321f3c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:02.707319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae80dfcc-5310-4ccf-b59c-d5b456321f3c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:02.710563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae80dfcc-5310-4ccf-b59c-d5b456321f3c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:02.711430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae80dfcc-5310-4ccf-b59c-d5b456321f3c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:03.137132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae80dfcc-5310-4ccf-b59c-d5b456321f3c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:03.151203 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ae80dfcc-5310-4ccf-b59c-d5b456321f3c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.476670 Oct 27 18:58:03.164187 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1462/3038] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:02 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:03.188255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-80fadcfb-3842-4ba4-a058-8b86a3f081c9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b78bf70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:03.253155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9dd3b6b9-c76e-46ee-98b3-b4fa90fde8cc tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:03.269027 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9dd3b6b9-c76e-46ee-98b3-b4fa90fde8cc tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1517 microversion: 2.1 time: 0.672328 Oct 27 18:58:03.288420 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1577/3039] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:02 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1517 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:03.294415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-868a7f96-66d3-43d0-b3d1-e53bfb97be63 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:03.308709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-868a7f96-66d3-43d0-b3d1-e53bfb97be63 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:03.317261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-868a7f96-66d3-43d0-b3d1-e53bfb97be63 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:03.318997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-868a7f96-66d3-43d0-b3d1-e53bfb97be63 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:03.329313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-868a7f96-66d3-43d0-b3d1-e53bfb97be63 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:03.330352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-868a7f96-66d3-43d0-b3d1-e53bfb97be63 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:03.330986 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-80fadcfb-3842-4ba4-a058-8b86a3f081c9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.163459 Oct 27 18:58:03.331195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-868a7f96-66d3-43d0-b3d1-e53bfb97be63 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:03.331792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-868a7f96-66d3-43d0-b3d1-e53bfb97be63 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:03.339811 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1463/3040] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:03 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:03.376708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-868a7f96-66d3-43d0-b3d1-e53bfb97be63 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lazy-loading 'flavor' on Instance uuid ca6ce120-4829-4180-9293-592f8e20e233 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:58:03.561315 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-868a7f96-66d3-43d0-b3d1-e53bfb97be63 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "POST /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233/action" status: 200 len: 32 microversion: 2.1 time: 0.270508 Oct 27 18:58:03.567550 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1578/3041] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:58:03 2022] POST /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233/action => generated 32 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:58:03.573850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd968640-ec4c-4057-b48b-d9b519c36bb6 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:03.575043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bd968640-ec4c-4057-b48b-d9b519c36bb6 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:03.594588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd968640-ec4c-4057-b48b-d9b519c36bb6 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:03.596596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd968640-ec4c-4057-b48b-d9b519c36bb6 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:03.599619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd968640-ec4c-4057-b48b-d9b519c36bb6 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:03.602190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd968640-ec4c-4057-b48b-d9b519c36bb6 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:03.604056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd968640-ec4c-4057-b48b-d9b519c36bb6 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:03.607162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd968640-ec4c-4057-b48b-d9b519c36bb6 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:04.194242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8bd01235-b19f-4d79-b8ba-278a4751d2e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:04.195148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8bd01235-b19f-4d79-b8ba-278a4751d2e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:04.206488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bd01235-b19f-4d79-b8ba-278a4751d2e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:04.207004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bd01235-b19f-4d79-b8ba-278a4751d2e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:04.207464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bd01235-b19f-4d79-b8ba-278a4751d2e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:04.208199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bd01235-b19f-4d79-b8ba-278a4751d2e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:04.208706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bd01235-b19f-4d79-b8ba-278a4751d2e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:04.209117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8bd01235-b19f-4d79-b8ba-278a4751d2e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:04.715094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bd968640-ec4c-4057-b48b-d9b519c36bb6 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:04.724901 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bd968640-ec4c-4057-b48b-d9b519c36bb6 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 1.156182 Oct 27 18:58:04.725493 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1464/3042] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:03 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:04.733558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9eabcde6-b886-4c54-9a8e-cffa586ef579 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86ae60820>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:04.852375 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9eabcde6-b886-4c54-9a8e-cffa586ef579 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.122592 Oct 27 18:58:04.853488 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1465/3043] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:04 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:04.912065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8bd01235-b19f-4d79-b8ba-278a4751d2e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:04.922305 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8bd01235-b19f-4d79-b8ba-278a4751d2e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.733150 Oct 27 18:58:04.945192 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1579/3044] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:04 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:58:05.757736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-52142618-b2eb-428b-85d0-5a43f3aa27a4 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:05.760515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-52142618-b2eb-428b-85d0-5a43f3aa27a4 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:05.824861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52142618-b2eb-428b-85d0-5a43f3aa27a4 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:05.825972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52142618-b2eb-428b-85d0-5a43f3aa27a4 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:05.828001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52142618-b2eb-428b-85d0-5a43f3aa27a4 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:05.829505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52142618-b2eb-428b-85d0-5a43f3aa27a4 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:05.840748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52142618-b2eb-428b-85d0-5a43f3aa27a4 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:05.842469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52142618-b2eb-428b-85d0-5a43f3aa27a4 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:05.877008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-38771d90-cf55-45cc-941b-2b77af495b99 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a10d820>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:05.960938 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-38771d90-cf55-45cc-941b-2b77af495b99 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.091181 Oct 27 18:58:05.971562 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1580/3045] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:05 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:05.990649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d60e704c-515d-41c6-9315-6c04f7d8c8c8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:05.991639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d60e704c-515d-41c6-9315-6c04f7d8c8c8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:06.009163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d60e704c-515d-41c6-9315-6c04f7d8c8c8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:06.009923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d60e704c-515d-41c6-9315-6c04f7d8c8c8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:06.010586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d60e704c-515d-41c6-9315-6c04f7d8c8c8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:06.012620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d60e704c-515d-41c6-9315-6c04f7d8c8c8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:06.015207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d60e704c-515d-41c6-9315-6c04f7d8c8c8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:06.017785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d60e704c-515d-41c6-9315-6c04f7d8c8c8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:06.251390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d60e704c-515d-41c6-9315-6c04f7d8c8c8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:06.271474 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d60e704c-515d-41c6-9315-6c04f7d8c8c8 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.298406 Oct 27 18:58:06.272687 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1581/3046] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:05 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:06.567713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-52142618-b2eb-428b-85d0-5a43f3aa27a4 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:06.603473 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-52142618-b2eb-428b-85d0-5a43f3aa27a4 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.852426 Oct 27 18:58:06.620811 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1466/3047] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:05 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:06.979993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-40739359-21c8-4eb3-9483-f1c99b3e3056 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc8732cc820>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:07.052351 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-40739359-21c8-4eb3-9483-f1c99b3e3056 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.079150 Oct 27 18:58:07.052948 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1582/3048] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:06 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:07.293382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:07.301762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-358fa89e-e1a9-4446-8c53-9b98abe647c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:07.302973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-358fa89e-e1a9-4446-8c53-9b98abe647c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:07.324678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-358fa89e-e1a9-4446-8c53-9b98abe647c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:07.332755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-358fa89e-e1a9-4446-8c53-9b98abe647c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:07.332755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-358fa89e-e1a9-4446-8c53-9b98abe647c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:07.346974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-358fa89e-e1a9-4446-8c53-9b98abe647c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:07.347583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-358fa89e-e1a9-4446-8c53-9b98abe647c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:07.348053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-358fa89e-e1a9-4446-8c53-9b98abe647c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:07.639848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5b31f483-c5ac-4f83-bf14-350400c134aa tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:07.640569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5b31f483-c5ac-4f83-bf14-350400c134aa tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:07.667176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b31f483-c5ac-4f83-bf14-350400c134aa tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:07.667816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b31f483-c5ac-4f83-bf14-350400c134aa tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:07.668308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b31f483-c5ac-4f83-bf14-350400c134aa tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:07.669037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b31f483-c5ac-4f83-bf14-350400c134aa tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:07.669511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b31f483-c5ac-4f83-bf14-350400c134aa tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:07.675940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b31f483-c5ac-4f83-bf14-350400c134aa tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:07.909916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-358fa89e-e1a9-4446-8c53-9b98abe647c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:07.922120 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-358fa89e-e1a9-4446-8c53-9b98abe647c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.631597 Oct 27 18:58:07.925108 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1467/3049] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:07 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:07.939831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5b31f483-c5ac-4f83-bf14-350400c134aa tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:07.949739 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5b31f483-c5ac-4f83-bf14-350400c134aa tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.322441 Oct 27 18:58:07.970245 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1583/3050] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:07 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:08.072012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1d7dc579-f2e2-4ecb-a523-ead5139a6fe7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b18a040>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:08.151855 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1d7dc579-f2e2-4ecb-a523-ead5139a6fe7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.086147 Oct 27 18:58:08.153153 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1468/3051] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:08 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:08.950516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0cfb50d1-1943-4e06-83a6-11385d17c214 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:08.952814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0cfb50d1-1943-4e06-83a6-11385d17c214 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:08.970161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cfb50d1-1943-4e06-83a6-11385d17c214 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:08.975992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cfb50d1-1943-4e06-83a6-11385d17c214 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:08.977108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-46dc2e8b-c1c1-401a-a0ea-9378108bf244 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:08.977854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-46dc2e8b-c1c1-401a-a0ea-9378108bf244 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:08.978701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cfb50d1-1943-4e06-83a6-11385d17c214 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:08.983522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cfb50d1-1943-4e06-83a6-11385d17c214 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:08.986351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cfb50d1-1943-4e06-83a6-11385d17c214 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:08.987286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cfb50d1-1943-4e06-83a6-11385d17c214 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:08.989832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46dc2e8b-c1c1-401a-a0ea-9378108bf244 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:08.990343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46dc2e8b-c1c1-401a-a0ea-9378108bf244 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:08.990818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46dc2e8b-c1c1-401a-a0ea-9378108bf244 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:08.991547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46dc2e8b-c1c1-401a-a0ea-9378108bf244 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:08.992013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46dc2e8b-c1c1-401a-a0ea-9378108bf244 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:09.012443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46dc2e8b-c1c1-401a-a0ea-9378108bf244 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:09.457820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-46dc2e8b-c1c1-401a-a0ea-9378108bf244 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:09.462074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:09.478200 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-46dc2e8b-c1c1-401a-a0ea-9378108bf244 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.503199 Oct 27 18:58:09.480317 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1469/3052] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:08 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:09.495689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-212c5694-9565-4970-9d56-d8d0fd6303b8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b18aee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:09.507134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0cfb50d1-1943-4e06-83a6-11385d17c214 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:09.534268 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0cfb50d1-1943-4e06-83a6-11385d17c214 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.589647 Oct 27 18:58:09.536780 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1584/3053] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:08 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:09.595739 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-212c5694-9565-4970-9d56-d8d0fd6303b8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.103440 Oct 27 18:58:09.604478 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1470/3054] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:09 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:10.415021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a82a329b-8e6f-4c40-8bf2-173335089e8b tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:10.415822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a82a329b-8e6f-4c40-8bf2-173335089e8b tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:10.429754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a82a329b-8e6f-4c40-8bf2-173335089e8b tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:10.430269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a82a329b-8e6f-4c40-8bf2-173335089e8b tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:10.430753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a82a329b-8e6f-4c40-8bf2-173335089e8b tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:10.431727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a82a329b-8e6f-4c40-8bf2-173335089e8b tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:10.436757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a82a329b-8e6f-4c40-8bf2-173335089e8b tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:10.438006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a82a329b-8e6f-4c40-8bf2-173335089e8b tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:10.476517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:10.510159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-44ccf42e-fb4b-4688-bab1-70f4a01c8baf tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:10.512025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-44ccf42e-fb4b-4688-bab1-70f4a01c8baf tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:10.519022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:10.537656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44ccf42e-fb4b-4688-bab1-70f4a01c8baf tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:10.548287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44ccf42e-fb4b-4688-bab1-70f4a01c8baf tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:10.553712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44ccf42e-fb4b-4688-bab1-70f4a01c8baf tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:10.555426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44ccf42e-fb4b-4688-bab1-70f4a01c8baf tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:10.558080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44ccf42e-fb4b-4688-bab1-70f4a01c8baf tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:10.558897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44ccf42e-fb4b-4688-bab1-70f4a01c8baf tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:10.798755 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a82a329b-8e6f-4c40-8bf2-173335089e8b tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1814 microversion: 2.1 time: 0.382559 Oct 27 18:58:10.825577 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1585/3055] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:10 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1814 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:10.839573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-016162ba-3ca4-441c-9006-a33a11c53c63 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:10.840507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-016162ba-3ca4-441c-9006-a33a11c53c63 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:10.860758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-016162ba-3ca4-441c-9006-a33a11c53c63 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:10.863464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-016162ba-3ca4-441c-9006-a33a11c53c63 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:10.864201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-016162ba-3ca4-441c-9006-a33a11c53c63 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:10.865492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-016162ba-3ca4-441c-9006-a33a11c53c63 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:10.866944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-016162ba-3ca4-441c-9006-a33a11c53c63 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:10.869593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-016162ba-3ca4-441c-9006-a33a11c53c63 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:10.902229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-44ccf42e-fb4b-4688-bab1-70f4a01c8baf tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:10.919307 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-44ccf42e-fb4b-4688-bab1-70f4a01c8baf tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.415095 Oct 27 18:58:10.921695 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1471/3056] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:10 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:10.932194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c705124f-8db0-44df-a70d-c931040185c3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b18a280>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:11.013100 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c705124f-8db0-44df-a70d-c931040185c3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.089904 Oct 27 18:58:11.018647 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1472/3057] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:10 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:11.026958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-230cb513-458e-479d-9f45-a1054ab61b4a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:11.064677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230cb513-458e-479d-9f45-a1054ab61b4a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:11.065192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230cb513-458e-479d-9f45-a1054ab61b4a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:11.065647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230cb513-458e-479d-9f45-a1054ab61b4a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:11.074286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230cb513-458e-479d-9f45-a1054ab61b4a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:11.074937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230cb513-458e-479d-9f45-a1054ab61b4a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:11.075405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-230cb513-458e-479d-9f45-a1054ab61b4a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:11.189381 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-230cb513-458e-479d-9f45-a1054ab61b4a tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.169120 Oct 27 18:58:11.198775 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1473/3058] 10.222.0.42 () {58 vars in 1176 bytes} [Thu Oct 27 18:58:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:11.598775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7cc6982b-849a-4062-a009-c75a0eeef5eb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:11.600295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7cc6982b-849a-4062-a009-c75a0eeef5eb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:11.616528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cc6982b-849a-4062-a009-c75a0eeef5eb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:11.617305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cc6982b-849a-4062-a009-c75a0eeef5eb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:11.620641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cc6982b-849a-4062-a009-c75a0eeef5eb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:11.621569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cc6982b-849a-4062-a009-c75a0eeef5eb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:11.626890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cc6982b-849a-4062-a009-c75a0eeef5eb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:11.628579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cc6982b-849a-4062-a009-c75a0eeef5eb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:11.673642 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-7cc6982b-849a-4062-a009-c75a0eeef5eb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7cc6982b-849a-4062-a009-c75a0eeef5eb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a HTTP/1.1 Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '263ba238-b675-4ae7-a469-ced7d67f016a'} Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:58:11.675767 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:58:11.679924 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:58:11.679924 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:11.679924 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:58:11.679924 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:11.679924 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:11.679924 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:58:11.679924 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:58:11.679924 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:58:11.679924 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:58:11.679924 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:58:11.679924 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:11.682428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7cc6982b-849a-4062-a009-c75a0eeef5eb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:58:11.684137 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7cc6982b-849a-4062-a009-c75a0eeef5eb tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "DELETE /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 404 len: 111 microversion: 2.1 time: 0.089338 Oct 27 18:58:11.695439 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1474/3059] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:58:11 2022] DELETE /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:58:11.708329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae83dd10-e5a0-4072-b0d7-c4d3515a22ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:11.711669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ae83dd10-e5a0-4072-b0d7-c4d3515a22ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: 263ba238-b675-4ae7-a469-ced7d67f016a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:11.728010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae83dd10-e5a0-4072-b0d7-c4d3515a22ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:11.730305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae83dd10-e5a0-4072-b0d7-c4d3515a22ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:11.731493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae83dd10-e5a0-4072-b0d7-c4d3515a22ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:11.733927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae83dd10-e5a0-4072-b0d7-c4d3515a22ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:11.734704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae83dd10-e5a0-4072-b0d7-c4d3515a22ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:11.735564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae83dd10-e5a0-4072-b0d7-c4d3515a22ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:11.773480 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-ae83dd10-e5a0-4072-b0d7-c4d3515a22ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae83dd10-e5a0-4072-b0d7-c4d3515a22ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a HTTP/1.1 Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '263ba238-b675-4ae7-a469-ced7d67f016a'} Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:58:11.775700 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:11.780609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:11.780609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:58:11.780609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:58:11.780609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:58:11.780609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:58:11.780609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. Oct 27 18:58:11.780609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:11.781823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-016162ba-3ca4-441c-9006-a33a11c53c63 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:11.789180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae83dd10-e5a0-4072-b0d7-c4d3515a22ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance 263ba238-b675-4ae7-a469-ced7d67f016a could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:58:11.790798 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ae83dd10-e5a0-4072-b0d7-c4d3515a22ad tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a" status: 404 len: 111 microversion: 2.1 time: 0.091117 Oct 27 18:58:11.791749 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1475/3060] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:11 2022] GET /compute/v2.1/servers/263ba238-b675-4ae7-a469-ced7d67f016a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:58:11.803461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-46cb0c7a-020c-406e-8b3f-615ba0acff00 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:11.804621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-46cb0c7a-020c-406e-8b3f-615ba0acff00 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:11.818290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46cb0c7a-020c-406e-8b3f-615ba0acff00 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:11.820065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46cb0c7a-020c-406e-8b3f-615ba0acff00 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:11.821671 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-016162ba-3ca4-441c-9006-a33a11c53c63 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.991509 Oct 27 18:58:11.835607 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1586/3061] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:10 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:11.835762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46cb0c7a-020c-406e-8b3f-615ba0acff00 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:11.837447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46cb0c7a-020c-406e-8b3f-615ba0acff00 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:11.842282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46cb0c7a-020c-406e-8b3f-615ba0acff00 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:11.843994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46cb0c7a-020c-406e-8b3f-615ba0acff00 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:11.891011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-46cb0c7a-020c-406e-8b3f-615ba0acff00 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:58:11.949024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5b22ac44-4c6b-47d8-8d0e-586f4f572b19 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:11.950282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5b22ac44-4c6b-47d8-8d0e-586f4f572b19 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:11.977803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b22ac44-4c6b-47d8-8d0e-586f4f572b19 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:11.978356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b22ac44-4c6b-47d8-8d0e-586f4f572b19 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:11.978890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b22ac44-4c6b-47d8-8d0e-586f4f572b19 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:11.979707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b22ac44-4c6b-47d8-8d0e-586f4f572b19 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:11.980182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b22ac44-4c6b-47d8-8d0e-586f4f572b19 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:11.980623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b22ac44-4c6b-47d8-8d0e-586f4f572b19 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:12.132963 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-46cb0c7a-020c-406e-8b3f-615ba0acff00 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 204 len: 0 microversion: 2.1 time: 0.334800 Oct 27 18:58:12.135715 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1476/3062] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:58:11 2022] DELETE /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 18:58:12.152743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c8b864df-deae-4891-8eae-d1add6f7426a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc869ccc9d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:12.229923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5b22ac44-4c6b-47d8-8d0e-586f4f572b19 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:12.245177 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5b22ac44-4c6b-47d8-8d0e-586f4f572b19 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.299470 Oct 27 18:58:12.248420 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1587/3063] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:11 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:58:12.259122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c8c87d3b-f3e5-48ae-b18c-635e77b0ed2d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:12.260184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c8c87d3b-f3e5-48ae-b18c-635e77b0ed2d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:12.268948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8c87d3b-f3e5-48ae-b18c-635e77b0ed2d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:12.269865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8c87d3b-f3e5-48ae-b18c-635e77b0ed2d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:12.270607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8c87d3b-f3e5-48ae-b18c-635e77b0ed2d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:12.271670 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c8b864df-deae-4891-8eae-d1add6f7426a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.132091 Oct 27 18:58:12.272085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8c87d3b-f3e5-48ae-b18c-635e77b0ed2d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:12.272651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8c87d3b-f3e5-48ae-b18c-635e77b0ed2d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:12.273383 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1477/3064] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:12 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:12.279783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8c87d3b-f3e5-48ae-b18c-635e77b0ed2d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:12.545062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c8c87d3b-f3e5-48ae-b18c-635e77b0ed2d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:12.565515 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c8c87d3b-f3e5-48ae-b18c-635e77b0ed2d tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1512 microversion: 2.1 time: 0.315357 Oct 27 18:58:12.568418 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1588/3065] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:12 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:12.849004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-26129add-c878-4cbb-b643-edac06a523e3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:12.850478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-26129add-c878-4cbb-b643-edac06a523e3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:12.868894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26129add-c878-4cbb-b643-edac06a523e3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:12.882054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26129add-c878-4cbb-b643-edac06a523e3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:12.882911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26129add-c878-4cbb-b643-edac06a523e3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:12.887178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26129add-c878-4cbb-b643-edac06a523e3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:12.890141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26129add-c878-4cbb-b643-edac06a523e3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:12.894159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26129add-c878-4cbb-b643-edac06a523e3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:13.272038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-423b5dff-4b17-4be1-b278-be0c24a333e5 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:13.272677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-423b5dff-4b17-4be1-b278-be0c24a333e5 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:13.286762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-423b5dff-4b17-4be1-b278-be0c24a333e5 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:13.287276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-423b5dff-4b17-4be1-b278-be0c24a333e5 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:13.287945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-423b5dff-4b17-4be1-b278-be0c24a333e5 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:13.288867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-423b5dff-4b17-4be1-b278-be0c24a333e5 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:13.289512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-423b5dff-4b17-4be1-b278-be0c24a333e5 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:13.290138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-423b5dff-4b17-4be1-b278-be0c24a333e5 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:13.408951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-26129add-c878-4cbb-b643-edac06a523e3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:13.424661 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-26129add-c878-4cbb-b643-edac06a523e3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.579409 Oct 27 18:58:13.425649 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1478/3066] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:12 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:13.434179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb46bd1b-a08d-4783-b59a-1b283cc5cb33 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b840e50>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:13.542963 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fb46bd1b-a08d-4783-b59a-1b283cc5cb33 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.115750 Oct 27 18:58:13.546879 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1479/3067] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:13 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:13.599250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5aeafb65-af8f-401f-8f9b-04cc7691f2a8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:13.600214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5aeafb65-af8f-401f-8f9b-04cc7691f2a8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:13.611716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeafb65-af8f-401f-8f9b-04cc7691f2a8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:13.613345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeafb65-af8f-401f-8f9b-04cc7691f2a8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:13.614083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeafb65-af8f-401f-8f9b-04cc7691f2a8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:13.615163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeafb65-af8f-401f-8f9b-04cc7691f2a8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:13.615890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeafb65-af8f-401f-8f9b-04cc7691f2a8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:13.616543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aeafb65-af8f-401f-8f9b-04cc7691f2a8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:13.903874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5aeafb65-af8f-401f-8f9b-04cc7691f2a8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:13.913298 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5aeafb65-af8f-401f-8f9b-04cc7691f2a8 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1512 microversion: 2.1 time: 0.322557 Oct 27 18:58:13.926763 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1480/3068] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:13 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1512 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:14.083097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-423b5dff-4b17-4be1-b278-be0c24a333e5 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:14.094747 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-423b5dff-4b17-4be1-b278-be0c24a333e5 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.825073 Oct 27 18:58:14.098596 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1589/3069] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:13 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:14.290577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-24ffbe9c-f062-4dec-881d-ee295e7968a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37fdfccb-50e5-4586-9682-c7726e6ff5a7", "device": "/dev/xvdb"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:14.293690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-24ffbe9c-f062-4dec-881d-ee295e7968a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:14.302696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24ffbe9c-f062-4dec-881d-ee295e7968a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:14.303468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24ffbe9c-f062-4dec-881d-ee295e7968a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:14.304085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24ffbe9c-f062-4dec-881d-ee295e7968a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:14.305477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24ffbe9c-f062-4dec-881d-ee295e7968a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:14.306145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24ffbe9c-f062-4dec-881d-ee295e7968a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:14.306769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24ffbe9c-f062-4dec-881d-ee295e7968a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:14.453924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-268f75ad-8b5b-4ab2-b1a9-e252b2a6d42f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:14.455712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-268f75ad-8b5b-4ab2-b1a9-e252b2a6d42f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:14.468135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-268f75ad-8b5b-4ab2-b1a9-e252b2a6d42f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:14.470107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-268f75ad-8b5b-4ab2-b1a9-e252b2a6d42f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:14.483624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-268f75ad-8b5b-4ab2-b1a9-e252b2a6d42f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:14.484982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-268f75ad-8b5b-4ab2-b1a9-e252b2a6d42f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:14.486097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-268f75ad-8b5b-4ab2-b1a9-e252b2a6d42f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:14.487295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-268f75ad-8b5b-4ab2-b1a9-e252b2a6d42f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:14.750140 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-24ffbe9c-f062-4dec-881d-ee295e7968a6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "POST /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.464100 Oct 27 18:58:14.756666 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1481/3070] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 18:58:14 2022] POST /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments => generated 194 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:58:14.773012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5d2dbe06-cbe0-4e98-93ca-4e44c67b1359 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86ae384c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:14.854698 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5d2dbe06-cbe0-4e98-93ca-4e44c67b1359 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.096467 Oct 27 18:58:14.855881 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1482/3071] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:14 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:14.942355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-33f77280-1b3e-4108-9245-c8c0f4c5403c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:14.944281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-33f77280-1b3e-4108-9245-c8c0f4c5403c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:14.959944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33f77280-1b3e-4108-9245-c8c0f4c5403c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:14.960870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33f77280-1b3e-4108-9245-c8c0f4c5403c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:14.962729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33f77280-1b3e-4108-9245-c8c0f4c5403c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:14.963766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33f77280-1b3e-4108-9245-c8c0f4c5403c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:14.967353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33f77280-1b3e-4108-9245-c8c0f4c5403c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:14.968329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33f77280-1b3e-4108-9245-c8c0f4c5403c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:15.209035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-33f77280-1b3e-4108-9245-c8c0f4c5403c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:15.238103 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-33f77280-1b3e-4108-9245-c8c0f4c5403c tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1470 microversion: 2.1 time: 0.304402 Oct 27 18:58:15.239208 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1483/3072] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:14 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1470 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:58:15.255979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0b17efcd-baad-4953-94d0-910491928d45 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:15.257138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0b17efcd-baad-4953-94d0-910491928d45 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:15.267251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b17efcd-baad-4953-94d0-910491928d45 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:15.268515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b17efcd-baad-4953-94d0-910491928d45 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:15.269299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b17efcd-baad-4953-94d0-910491928d45 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:15.270271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b17efcd-baad-4953-94d0-910491928d45 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:15.273003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b17efcd-baad-4953-94d0-910491928d45 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:15.273767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b17efcd-baad-4953-94d0-910491928d45 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:15.885596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-268f75ad-8b5b-4ab2-b1a9-e252b2a6d42f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:15.896958 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-268f75ad-8b5b-4ab2-b1a9-e252b2a6d42f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 1.447722 Oct 27 18:58:15.900426 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1590/3073] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:14 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:58:15.918003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0b17efcd-baad-4953-94d0-910491928d45 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:15.936266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7ddd7224-e3bd-4ccc-987e-2f6b43463ea6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:15.936945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7ddd7224-e3bd-4ccc-987e-2f6b43463ea6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:15.945925 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0b17efcd-baad-4953-94d0-910491928d45 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.705960 Oct 27 18:58:15.951983 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1484/3074] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:15 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:15.980838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ddd7224-e3bd-4ccc-987e-2f6b43463ea6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:15.981260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ddd7224-e3bd-4ccc-987e-2f6b43463ea6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:15.983508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ddd7224-e3bd-4ccc-987e-2f6b43463ea6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:15.985027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d673832b-54cb-4a47-8990-ad1c7a604b9a req-994c145d-b22f-4333-bb5d-0646bf3d668b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e311e1-6dd0-4498-897c-c92ce762d9b9", "name": "network-vif-deleted", "tag": "5e0a3a4e-0c02-4bfb-b6c9-0aefa83bc658"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:15.986025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ddd7224-e3bd-4ccc-987e-2f6b43463ea6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:15.986824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ddd7224-e3bd-4ccc-987e-2f6b43463ea6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:15.991034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ddd7224-e3bd-4ccc-987e-2f6b43463ea6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:16.023280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d673832b-54cb-4a47-8990-ad1c7a604b9a req-994c145d-b22f-4333-bb5d-0646bf3d668b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:16.026544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d673832b-54cb-4a47-8990-ad1c7a604b9a req-994c145d-b22f-4333-bb5d-0646bf3d668b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:16.027430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d673832b-54cb-4a47-8990-ad1c7a604b9a req-994c145d-b22f-4333-bb5d-0646bf3d668b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:16.050156 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d673832b-54cb-4a47-8990-ad1c7a604b9a req-994c145d-b22f-4333-bb5d-0646bf3d668b service nova] Creating event network-vif-deleted:5e0a3a4e-0c02-4bfb-b6c9-0aefa83bc658 for instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 on n-h2-860687-3 Oct 27 18:58:16.056297 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d673832b-54cb-4a47-8990-ad1c7a604b9a req-994c145d-b22f-4333-bb5d-0646bf3d668b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083776 Oct 27 18:58:16.057881 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1485/3075] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:16.069679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7ddd7224-e3bd-4ccc-987e-2f6b43463ea6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:58:16.080019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ec0b04ee-22ec-40e7-ba71-cca15d0bb475 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc873211dc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:16.210292 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ec0b04ee-22ec-40e7-ba71-cca15d0bb475 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.150230 Oct 27 18:58:16.220270 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1486/3076] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:16 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:16.249290 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7ddd7224-e3bd-4ccc-987e-2f6b43463ea6 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "DELETE /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 204 len: 0 microversion: 2.1 time: 0.342198 Oct 27 18:58:16.250613 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1591/3077] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:58:15 2022] DELETE /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:58:16.259584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6df86a21-7905-47aa-accc-d9a3ca110097 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:16.260582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6df86a21-7905-47aa-accc-d9a3ca110097 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:16.269624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df86a21-7905-47aa-accc-d9a3ca110097 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:16.270538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df86a21-7905-47aa-accc-d9a3ca110097 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:16.271179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df86a21-7905-47aa-accc-d9a3ca110097 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:16.271582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4be9ec5f-2d63-4dc1-8bdc-77fc7adc3b0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:16.272353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df86a21-7905-47aa-accc-d9a3ca110097 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:16.272650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4be9ec5f-2d63-4dc1-8bdc-77fc7adc3b0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:16.273170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df86a21-7905-47aa-accc-d9a3ca110097 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:16.273772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df86a21-7905-47aa-accc-d9a3ca110097 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:16.286557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:16.289423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4be9ec5f-2d63-4dc1-8bdc-77fc7adc3b0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:16.289986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4be9ec5f-2d63-4dc1-8bdc-77fc7adc3b0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:16.290792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4be9ec5f-2d63-4dc1-8bdc-77fc7adc3b0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:16.291756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4be9ec5f-2d63-4dc1-8bdc-77fc7adc3b0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:16.292383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4be9ec5f-2d63-4dc1-8bdc-77fc7adc3b0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:16.293059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4be9ec5f-2d63-4dc1-8bdc-77fc7adc3b0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:16.334657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4be9ec5f-2d63-4dc1-8bdc-77fc7adc3b0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:16.335472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4be9ec5f-2d63-4dc1-8bdc-77fc7adc3b0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:16.336112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4be9ec5f-2d63-4dc1-8bdc-77fc7adc3b0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:16.336737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-4be9ec5f-2d63-4dc1-8bdc-77fc7adc3b0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lazy-loading 'fault' on Instance uuid a6e311e1-6dd0-4498-897c-c92ce762d9b9 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:58:16.490875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4be9ec5f-2d63-4dc1-8bdc-77fc7adc3b0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:16.502364 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4be9ec5f-2d63-4dc1-8bdc-77fc7adc3b0e tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1306 microversion: 2.1 time: 0.244776 Oct 27 18:58:16.502988 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1592/3078] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:16 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1306 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:16.566425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6df86a21-7905-47aa-accc-d9a3ca110097 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:16.575988 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6df86a21-7905-47aa-accc-d9a3ca110097 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1666 microversion: 2.1 time: 0.320993 Oct 27 18:58:16.593529 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1487/3079] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:16 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1666 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:16.930026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bd386640-448d-43f6-b7b5-ea029878c7b1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:16.930710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bd386640-448d-43f6-b7b5-ea029878c7b1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:16.940831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd386640-448d-43f6-b7b5-ea029878c7b1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:16.941115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd386640-448d-43f6-b7b5-ea029878c7b1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:16.941512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd386640-448d-43f6-b7b5-ea029878c7b1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:16.942241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd386640-448d-43f6-b7b5-ea029878c7b1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:16.942737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd386640-448d-43f6-b7b5-ea029878c7b1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:16.943177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd386640-448d-43f6-b7b5-ea029878c7b1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:16.978963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bee43260-f6e3-4a95-b832-783046438330 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:16.980181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bee43260-f6e3-4a95-b832-783046438330 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:16.992217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bee43260-f6e3-4a95-b832-783046438330 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:16.999757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bee43260-f6e3-4a95-b832-783046438330 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:17.000482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bee43260-f6e3-4a95-b832-783046438330 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:17.001398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bee43260-f6e3-4a95-b832-783046438330 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:17.002018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bee43260-f6e3-4a95-b832-783046438330 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:17.002637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bee43260-f6e3-4a95-b832-783046438330 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:17.272871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bee43260-f6e3-4a95-b832-783046438330 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:17.286448 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bee43260-f6e3-4a95-b832-783046438330 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.311451 Oct 27 18:58:17.287690 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1488/3080] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:16 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:17.293002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6f78fbc7-5be3-40b0-9660-31f97cb0db98 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86ae060d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:17.354743 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6f78fbc7-5be3-40b0-9660-31f97cb0db98 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.065476 Oct 27 18:58:17.355339 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1489/3081] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:17 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:17.530306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-21e9fa3d-37f9-417c-822b-588457a75289 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:17.531215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-21e9fa3d-37f9-417c-822b-588457a75289 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:17.550843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21e9fa3d-37f9-417c-822b-588457a75289 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:17.562750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21e9fa3d-37f9-417c-822b-588457a75289 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:17.568319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21e9fa3d-37f9-417c-822b-588457a75289 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:17.569333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21e9fa3d-37f9-417c-822b-588457a75289 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:17.569987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21e9fa3d-37f9-417c-822b-588457a75289 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:17.570624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21e9fa3d-37f9-417c-822b-588457a75289 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:17.672421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21e9fa3d-37f9-417c-822b-588457a75289 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:17.673103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21e9fa3d-37f9-417c-822b-588457a75289 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:17.676218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21e9fa3d-37f9-417c-822b-588457a75289 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:17.677959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-21e9fa3d-37f9-417c-822b-588457a75289 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lazy-loading 'fault' on Instance uuid a6e311e1-6dd0-4498-897c-c92ce762d9b9 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:58:17.765842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-21e9fa3d-37f9-417c-822b-588457a75289 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834fdde034434a19aec0129ef2d744df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90de1493a5422ba51e27b6241725c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:17.786196 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-21e9fa3d-37f9-417c-822b-588457a75289 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 200 len: 1306 microversion: 2.1 time: 0.258990 Oct 27 18:58:17.788434 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1490/3082] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:17 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 1306 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:17.802420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-41fbb95c-a44f-4c9e-b54e-01c2d21a781a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:17.804274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-41fbb95c-a44f-4c9e-b54e-01c2d21a781a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:17.827638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41fbb95c-a44f-4c9e-b54e-01c2d21a781a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:17.828171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41fbb95c-a44f-4c9e-b54e-01c2d21a781a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:17.828624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41fbb95c-a44f-4c9e-b54e-01c2d21a781a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:17.830609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41fbb95c-a44f-4c9e-b54e-01c2d21a781a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:17.831104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41fbb95c-a44f-4c9e-b54e-01c2d21a781a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:17.832783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41fbb95c-a44f-4c9e-b54e-01c2d21a781a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:18.043528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bd386640-448d-43f6-b7b5-ea029878c7b1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:18.054085 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bd386640-448d-43f6-b7b5-ea029878c7b1 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 1.128020 Oct 27 18:58:18.078421 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1593/3083] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:16 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:18.312507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eb9999cb-3a82-45a6-96f8-60ee2058444b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:18.313139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-eb9999cb-3a82-45a6-96f8-60ee2058444b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:18.325549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb9999cb-3a82-45a6-96f8-60ee2058444b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:18.327939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb9999cb-3a82-45a6-96f8-60ee2058444b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:18.328406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb9999cb-3a82-45a6-96f8-60ee2058444b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:18.329162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb9999cb-3a82-45a6-96f8-60ee2058444b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:18.335369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb9999cb-3a82-45a6-96f8-60ee2058444b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:18.335834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb9999cb-3a82-45a6-96f8-60ee2058444b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:18.471336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-41fbb95c-a44f-4c9e-b54e-01c2d21a781a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:18.484920 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-41fbb95c-a44f-4c9e-b54e-01c2d21a781a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1666 microversion: 2.1 time: 0.693593 Oct 27 18:58:18.491587 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1491/3084] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:17 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1666 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:18.523319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b03d248e-9739-4cca-aa20-2f7a9579319f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b18a430>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:18.614031 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b03d248e-9739-4cca-aa20-2f7a9579319f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.107657 Oct 27 18:58:18.615235 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1492/3085] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:18 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:18.815401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7cd6c5e9-1a6c-468a-bf3a-d7290a142cc9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:18.816774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7cd6c5e9-1a6c-468a-bf3a-d7290a142cc9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] [instance: a6e311e1-6dd0-4498-897c-c92ce762d9b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:18.829642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cd6c5e9-1a6c-468a-bf3a-d7290a142cc9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:18.830150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cd6c5e9-1a6c-468a-bf3a-d7290a142cc9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:18.830647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cd6c5e9-1a6c-468a-bf3a-d7290a142cc9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:18.834283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cd6c5e9-1a6c-468a-bf3a-d7290a142cc9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:18.834790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cd6c5e9-1a6c-468a-bf3a-d7290a142cc9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:18.835247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cd6c5e9-1a6c-468a-bf3a-d7290a142cc9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:18.875583 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-7cd6c5e9-1a6c-468a-bf3a-d7290a142cc9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] HTTP exception thrown: Instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 could not be found. Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7cd6c5e9-1a6c-468a-bf3a-d7290a142cc9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Request method failure captured: Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 HTTP/1.1 Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtOwfd1SJHkYjbPvjcLhjAb8veUbmst4a8iyH3mqw_fNAi5G_pR1ywKm0i0hUtn6O1fLK_-x43Ofs_ovTS-4CGZaxc6oRP6L1JODe5IONTS1ODKEzKtzAV313O_BrnXShxYObwqfAfFkGkk-MBRw2g1R_grsdsErTRLKR8Nd9_yMOq0 Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b90de1493a5422ba51e27b6241725c8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b90de1493a5422ba51e27b6241725c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 4b90de1493a5422ba51e27b6241725c8 Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-247989349 Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 834fdde034434a19aec0129ef2d744df Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-247989349-project Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 could not be found. Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a6e311e1-6dd0-4498-897c-c92ce762d9b9'} Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 could not be found. Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 could not be found. Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:58:18.877423 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:18.889462 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:18.889462 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:58:18.889462 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:58:18.889462 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:58:18.889462 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:58:18.889462 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 could not be found. Oct 27 18:58:18.889462 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:18.889462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7cd6c5e9-1a6c-468a-bf3a-d7290a142cc9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] Returning 404 to user: Instance a6e311e1-6dd0-4498-897c-c92ce762d9b9 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:58:18.889462 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7cd6c5e9-1a6c-468a-bf3a-d7290a142cc9 tempest-ServersNegativeTestJSON-247989349 tempest-ServersNegativeTestJSON-247989349-project] 10.222.0.42 "GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9" status: 404 len: 111 microversion: 2.1 time: 0.071352 Oct 27 18:58:18.889462 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1493/3086] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:18 2022] GET /compute/v2.1/servers/a6e311e1-6dd0-4498-897c-c92ce762d9b9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 18:58:19.071362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-eb9999cb-3a82-45a6-96f8-60ee2058444b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:19.089226 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eb9999cb-3a82-45a6-96f8-60ee2058444b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.780937 Oct 27 18:58:19.094312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7e5a0e4-ce54-40cb-ae43-2b0dd9bd7b83 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:19.095243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a7e5a0e4-ce54-40cb-ae43-2b0dd9bd7b83 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:19.103032 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1594/3087] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:18 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:58:19.110021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7e5a0e4-ce54-40cb-ae43-2b0dd9bd7b83 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:19.114456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7e5a0e4-ce54-40cb-ae43-2b0dd9bd7b83 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:19.114942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7e5a0e4-ce54-40cb-ae43-2b0dd9bd7b83 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:19.115705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7e5a0e4-ce54-40cb-ae43-2b0dd9bd7b83 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:19.116177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7e5a0e4-ce54-40cb-ae43-2b0dd9bd7b83 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:19.116615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7e5a0e4-ce54-40cb-ae43-2b0dd9bd7b83 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:19.171944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:19.519953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-18294836-6e6f-43c7-a93c-c49ad3e8ef2c tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:19.520854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-18294836-6e6f-43c7-a93c-c49ad3e8ef2c tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:19.533507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18294836-6e6f-43c7-a93c-c49ad3e8ef2c tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:19.534981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18294836-6e6f-43c7-a93c-c49ad3e8ef2c tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:19.535694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18294836-6e6f-43c7-a93c-c49ad3e8ef2c tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:19.539614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18294836-6e6f-43c7-a93c-c49ad3e8ef2c tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:19.540393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18294836-6e6f-43c7-a93c-c49ad3e8ef2c tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:19.543740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18294836-6e6f-43c7-a93c-c49ad3e8ef2c tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:19.697041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a7e5a0e4-ce54-40cb-ae43-2b0dd9bd7b83 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:19.705100 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7e5a0e4-ce54-40cb-ae43-2b0dd9bd7b83 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.616920 Oct 27 18:58:19.720887 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1494/3088] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:19 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:19.725977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4b672db6-9c9e-4264-832e-9b07236a7273 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b7a08b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:19.800141 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4b672db6-9c9e-4264-832e-9b07236a7273 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.080177 Oct 27 18:58:19.811758 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1495/3089] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:19 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:20.117454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-231f1151-db57-4513-a960-24e0ca5dd91e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:20.118089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-231f1151-db57-4513-a960-24e0ca5dd91e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:20.141147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231f1151-db57-4513-a960-24e0ca5dd91e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:20.141654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231f1151-db57-4513-a960-24e0ca5dd91e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:20.142691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231f1151-db57-4513-a960-24e0ca5dd91e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:20.143618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231f1151-db57-4513-a960-24e0ca5dd91e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:20.144249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231f1151-db57-4513-a960-24e0ca5dd91e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:20.151080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-231f1151-db57-4513-a960-24e0ca5dd91e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:20.537220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-18294836-6e6f-43c7-a93c-c49ad3e8ef2c tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:20.548990 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-18294836-6e6f-43c7-a93c-c49ad3e8ef2c tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1666 microversion: 2.1 time: 1.032857 Oct 27 18:58:20.573735 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1595/3090] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:19 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1666 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:58:20.728786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-50644b2e-ceaf-4d89-9ec8-8f7a57b28c64 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:20.730240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-50644b2e-ceaf-4d89-9ec8-8f7a57b28c64 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:20.752999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50644b2e-ceaf-4d89-9ec8-8f7a57b28c64 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:20.754765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50644b2e-ceaf-4d89-9ec8-8f7a57b28c64 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:20.757511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50644b2e-ceaf-4d89-9ec8-8f7a57b28c64 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:20.760060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50644b2e-ceaf-4d89-9ec8-8f7a57b28c64 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:20.764409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50644b2e-ceaf-4d89-9ec8-8f7a57b28c64 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:20.766419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50644b2e-ceaf-4d89-9ec8-8f7a57b28c64 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:21.112208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:21.150532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-50644b2e-ceaf-4d89-9ec8-8f7a57b28c64 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:21.182043 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-50644b2e-ceaf-4d89-9ec8-8f7a57b28c64 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.455194 Oct 27 18:58:21.182715 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1596/3091] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:20 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:58:21.207008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a8519ca4-3e6f-4f54-a299-f71db4680f9d tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc87335b1f0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:21.305934 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a8519ca4-3e6f-4f54-a299-f71db4680f9d tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.122117 Oct 27 18:58:21.307855 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1597/3092] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:21 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:21.584542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-04e2dc88-66f0-401b-9deb-6b23c736819e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:21.586091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-04e2dc88-66f0-401b-9deb-6b23c736819e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:21.612014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04e2dc88-66f0-401b-9deb-6b23c736819e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:21.613654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04e2dc88-66f0-401b-9deb-6b23c736819e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:21.617047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04e2dc88-66f0-401b-9deb-6b23c736819e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:21.618055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04e2dc88-66f0-401b-9deb-6b23c736819e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:21.620224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04e2dc88-66f0-401b-9deb-6b23c736819e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:21.620886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04e2dc88-66f0-401b-9deb-6b23c736819e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:21.782324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-04e2dc88-66f0-401b-9deb-6b23c736819e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:21.805937 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-04e2dc88-66f0-401b-9deb-6b23c736819e tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1599 microversion: 2.1 time: 0.232633 Oct 27 18:58:21.809291 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1598/3093] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:21 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1599 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:58:21.823809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-231f1151-db57-4513-a960-24e0ca5dd91e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:21.886408 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-231f1151-db57-4513-a960-24e0ca5dd91e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 1.770085 Oct 27 18:58:21.897529 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1496/3094] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:20 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:22.205657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f7dcce0d-2e03-4459-be8f-a80bd0e80f37 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:22.206928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f7dcce0d-2e03-4459-be8f-a80bd0e80f37 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:22.213566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7dcce0d-2e03-4459-be8f-a80bd0e80f37 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:22.226025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7dcce0d-2e03-4459-be8f-a80bd0e80f37 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:22.235139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7dcce0d-2e03-4459-be8f-a80bd0e80f37 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:22.236339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7dcce0d-2e03-4459-be8f-a80bd0e80f37 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:22.237358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7dcce0d-2e03-4459-be8f-a80bd0e80f37 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:22.237981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7dcce0d-2e03-4459-be8f-a80bd0e80f37 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:22.323537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e4670de7-f36a-47b6-ab6a-140e3f7e030a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc869d7ce50>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:22.417999 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e4670de7-f36a-47b6-ab6a-140e3f7e030a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.099468 Oct 27 18:58:22.432001 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1497/3095] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:22 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:22.762358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f7dcce0d-2e03-4459-be8f-a80bd0e80f37 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:22.778161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1838243046", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:22.791388 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f7dcce0d-2e03-4459-be8f-a80bd0e80f37 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.589792 Oct 27 18:58:22.799517 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1599/3096] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:22 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:22.814283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a41788c7-35a3-4e10-a941-4a6b76e337cf req-c5cc49f5-2821-44ff-b4a9-fe6264f81cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403ad40f-7a7d-4be1-b1c2-16f91dd36e09", "name": "network-vif-deleted", "tag": "76e19a54-ac3a-4d4d-b981-0958c1f79d34"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:22.901866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a41788c7-35a3-4e10-a941-4a6b76e337cf req-c5cc49f5-2821-44ff-b4a9-fe6264f81cb8 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:22.902413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a41788c7-35a3-4e10-a941-4a6b76e337cf req-c5cc49f5-2821-44ff-b4a9-fe6264f81cb8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:22.902871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a41788c7-35a3-4e10-a941-4a6b76e337cf req-c5cc49f5-2821-44ff-b4a9-fe6264f81cb8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:22.949052 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a41788c7-35a3-4e10-a941-4a6b76e337cf req-c5cc49f5-2821-44ff-b4a9-fe6264f81cb8 service nova] Creating event network-vif-deleted:76e19a54-ac3a-4d4d-b981-0958c1f79d34 for instance 403ad40f-7a7d-4be1-b1c2-16f91dd36e09 on n-h2-860687-3 Oct 27 18:58:22.960041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] validate_networks() for [('0e9bb60c-1994-4870-a5cf-565c3ad2a0f8', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:58:22.974261 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a41788c7-35a3-4e10-a941-4a6b76e337cf req-c5cc49f5-2821-44ff-b4a9-fe6264f81cb8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167678 Oct 27 18:58:22.975067 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1600/3097] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:23.000005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7d6c3d9a-9d9a-4b1f-99c1-02bbb310eb6d tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:23.002565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7d6c3d9a-9d9a-4b1f-99c1-02bbb310eb6d tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:23.024632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d6c3d9a-9d9a-4b1f-99c1-02bbb310eb6d tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:23.025459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d6c3d9a-9d9a-4b1f-99c1-02bbb310eb6d tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:23.026100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d6c3d9a-9d9a-4b1f-99c1-02bbb310eb6d tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:23.027027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d6c3d9a-9d9a-4b1f-99c1-02bbb310eb6d tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:23.027639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d6c3d9a-9d9a-4b1f-99c1-02bbb310eb6d tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:23.030461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d6c3d9a-9d9a-4b1f-99c1-02bbb310eb6d tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:23.116870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d6c3d9a-9d9a-4b1f-99c1-02bbb310eb6d tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:23.118598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d6c3d9a-9d9a-4b1f-99c1-02bbb310eb6d tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:23.119056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d6c3d9a-9d9a-4b1f-99c1-02bbb310eb6d tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:23.119531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-7d6c3d9a-9d9a-4b1f-99c1-02bbb310eb6d tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lazy-loading 'fault' on Instance uuid 403ad40f-7a7d-4be1-b1c2-16f91dd36e09 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:58:23.136475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:23.207336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7d6c3d9a-9d9a-4b1f-99c1-02bbb310eb6d tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504fbbbb4bfa45e88b612301ef7aff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e030bf61093544d48406bd98ad96b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:23.216010 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7d6c3d9a-9d9a-4b1f-99c1-02bbb310eb6d tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 200 len: 1316 microversion: 2.1 time: 0.239877 Oct 27 18:58:23.230637 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1601/3098] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:22 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:23.230637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-93908963-fcd2-4268-814a-69c6368df321 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:23.230637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-93908963-fcd2-4268-814a-69c6368df321 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:23.243814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93908963-fcd2-4268-814a-69c6368df321 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:23.244483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93908963-fcd2-4268-814a-69c6368df321 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:23.244952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93908963-fcd2-4268-814a-69c6368df321 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:23.248705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93908963-fcd2-4268-814a-69c6368df321 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:23.251047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93908963-fcd2-4268-814a-69c6368df321 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:23.251506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93908963-fcd2-4268-814a-69c6368df321 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:23.537193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-93908963-fcd2-4268-814a-69c6368df321 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:23.546520 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-93908963-fcd2-4268-814a-69c6368df321 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.326604 Oct 27 18:58:23.552340 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1602/3099] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:23 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:23.566508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a92b017-f319-4dd8-b677-997b6426704a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86aa8d8b0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:23.653522 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5a92b017-f319-4dd8-b677-997b6426704a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1437 microversion: 2.1 time: 0.099895 Oct 27 18:58:23.655316 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1603/3100] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:23 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1437 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:23.823032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-76565822-a6d3-464e-9108-99b194e601ae tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:23.823678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-76565822-a6d3-464e-9108-99b194e601ae tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:23.848581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76565822-a6d3-464e-9108-99b194e601ae tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:23.849128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76565822-a6d3-464e-9108-99b194e601ae tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:23.849588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76565822-a6d3-464e-9108-99b194e601ae tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:23.850358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76565822-a6d3-464e-9108-99b194e601ae tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:23.850860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76565822-a6d3-464e-9108-99b194e601ae tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:23.851298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76565822-a6d3-464e-9108-99b194e601ae tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:24.410178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-76565822-a6d3-464e-9108-99b194e601ae tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:24.423391 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-76565822-a6d3-464e-9108-99b194e601ae tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.604116 Oct 27 18:58:24.425136 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1604/3101] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:23 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:24.455035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0b96a74-2220-41af-9e6a-189efe82d70a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:24.457640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f0b96a74-2220-41af-9e6a-189efe82d70a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] [instance: 403ad40f-7a7d-4be1-b1c2-16f91dd36e09] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:24.479001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0b96a74-2220-41af-9e6a-189efe82d70a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:24.479528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0b96a74-2220-41af-9e6a-189efe82d70a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:24.479989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0b96a74-2220-41af-9e6a-189efe82d70a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:24.484565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0b96a74-2220-41af-9e6a-189efe82d70a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:24.486933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0b96a74-2220-41af-9e6a-189efe82d70a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:24.490957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0b96a74-2220-41af-9e6a-189efe82d70a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:24.533012 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-f0b96a74-2220-41af-9e6a-189efe82d70a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] HTTP exception thrown: Instance 403ad40f-7a7d-4be1-b1c2-16f91dd36e09 could not be found. Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0b96a74-2220-41af-9e6a-189efe82d70a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Request method failure captured: Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 HTTP/1.1 Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtRLu5sxICAs5HL9Km69YxKsd4wGWGQQV2eZdCLRDvGto8fWQUsoRQKNjQGX2EvQbS2iHoO8Mh4IFyuyocYXQcUCW6LECtiaDaxjnP7awVsU-h1b2uDpmguTHa5NUPYhwLt1qaP0sHN5m-u-9xqeTDPdTsxbxdwYekzTPl3EORXhrqI Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: e030bf61093544d48406bd98ad96b7ef Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestFqdnHostnames-1717322310 Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e030bf61093544d48406bd98ad96b7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e030bf61093544d48406bd98ad96b7ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e030bf61093544d48406bd98ad96b7ef", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e030bf61093544d48406bd98ad96b7ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestFqdnHostnames-1717322310 Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: e030bf61093544d48406bd98ad96b7ef Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1717322310 Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestFqdnHostnames-1717322310-project Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 504fbbbb4bfa45e88b612301ef7aff3a Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestFqdnHostnames-1717322310-project Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 403ad40f-7a7d-4be1-b1c2-16f91dd36e09 could not be found. Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '403ad40f-7a7d-4be1-b1c2-16f91dd36e09'} Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403ad40f-7a7d-4be1-b1c2-16f91dd36e09 could not be found. Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403ad40f-7a7d-4be1-b1c2-16f91dd36e09 could not be found. Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:58:24.535145 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:24.539539 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:24.539539 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:58:24.539539 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:58:24.539539 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:58:24.539539 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:58:24.539539 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403ad40f-7a7d-4be1-b1c2-16f91dd36e09 could not be found. Oct 27 18:58:24.539539 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:24.542165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0b96a74-2220-41af-9e6a-189efe82d70a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Returning 404 to user: Instance 403ad40f-7a7d-4be1-b1c2-16f91dd36e09 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:58:24.543350 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f0b96a74-2220-41af-9e6a-189efe82d70a tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09" status: 404 len: 111 microversion: 2.1 time: 0.116899 Oct 27 18:58:24.545736 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1605/3102] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:24 2022] GET /compute/v2.1/servers/403ad40f-7a7d-4be1-b1c2-16f91dd36e09 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:58:24.574860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-45e85aef-b6a5-4301-b483-a3b7c00dc7d5 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] Calling method '.version_select at 0x7fc86aa8d0d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:24.624714 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-45e85aef-b6a5-4301-b483-a3b7c00dc7d5 tempest-ServersTestFqdnHostnames-1717322310 tempest-ServersTestFqdnHostnames-1717322310-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908941435" status: 202 len: 0 microversion: 2.1 time: 0.072392 Oct 27 18:58:24.625676 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1606/3103] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 18:58:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908941435 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:58:24.633097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-415a5820-dc35-4a36-b598-7d143d9bbe1c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:24.636248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-415a5820-dc35-4a36-b598-7d143d9bbe1c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:24.686503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-415a5820-dc35-4a36-b598-7d143d9bbe1c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:24.689327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-415a5820-dc35-4a36-b598-7d143d9bbe1c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:24.689802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-415a5820-dc35-4a36-b598-7d143d9bbe1c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:24.690601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-415a5820-dc35-4a36-b598-7d143d9bbe1c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:24.694880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-415a5820-dc35-4a36-b598-7d143d9bbe1c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:24.695445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-415a5820-dc35-4a36-b598-7d143d9bbe1c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:25.628246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-415a5820-dc35-4a36-b598-7d143d9bbe1c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:25.642425 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-415a5820-dc35-4a36-b598-7d143d9bbe1c tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 1.014054 Oct 27 18:58:25.643059 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1607/3104] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:24 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:25.655898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-76be75d0-7cbd-40a5-928e-931b2e0ba1a6 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b153940>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:25.729767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:58:25.730854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:58:25.731520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:58:25.732641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:58:25.733367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:58:25.744334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:25.745074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:25.745706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:25.746000 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-76be75d0-7cbd-40a5-928e-931b2e0ba1a6 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1446 microversion: 2.1 time: 0.100852 Oct 27 18:58:25.746659 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1608/3105] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:25 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1446 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:25.755433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bab27e1b-7d6b-4ee6-b4ca-1c4f93a68242 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:25.757863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:25.758406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:25.761080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bab27e1b-7d6b-4ee6-b4ca-1c4f93a68242 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:25.765937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:25.768270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bab27e1b-7d6b-4ee6-b4ca-1c4f93a68242 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:25.770416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bab27e1b-7d6b-4ee6-b4ca-1c4f93a68242 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:25.771064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bab27e1b-7d6b-4ee6-b4ca-1c4f93a68242 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:25.771971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bab27e1b-7d6b-4ee6-b4ca-1c4f93a68242 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:25.772919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bab27e1b-7d6b-4ee6-b4ca-1c4f93a68242 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:25.773703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bab27e1b-7d6b-4ee6-b4ca-1c4f93a68242 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:25.833783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Getting quotas for project adeacece438645c4a0c5844d1ef83793. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:58:25.846361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Getting quotas for user 2b706e9394a642cda315809db15ecbb3 and project adeacece438645c4a0c5844d1ef83793. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:58:25.876250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:58:25.902375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:58:26.062200 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-561ec0c2-329d-4c7b-b50f-f0242992f88b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.625502 Oct 27 18:58:26.063799 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1498/3106] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:58:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 3631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:58:26.072107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-78670567-dea9-4940-814d-cd952a0ef674 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86ac5d3a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:26.131809 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-78670567-dea9-4940-814d-cd952a0ef674 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 200 len: 1446 microversion: 2.1 time: 0.066481 Oct 27 18:58:26.143085 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1499/3107] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:58:26 2022] GET /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 1446 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:26.154471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ca71bd0-fd76-470f-87cc-efd014a5be47 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:26.155643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5ca71bd0-fd76-470f-87cc-efd014a5be47 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:26.389697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5ca71bd0-fd76-470f-87cc-efd014a5be47 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:26.402905 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5ca71bd0-fd76-470f-87cc-efd014a5be47 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1222 microversion: 2.1 time: 0.256940 Oct 27 18:58:26.406288 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1500/3108] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:26 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1222 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:26.412668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6de1d013-112d-454f-b861-fc69cd46274c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86ac1fb80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:26.583220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bab27e1b-7d6b-4ee6-b4ca-1c4f93a68242 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:26.602746 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bab27e1b-7d6b-4ee6-b4ca-1c4f93a68242 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.854759 Oct 27 18:58:26.603745 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1609/3109] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:25 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:26.615595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-723756535", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:26.725950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] validate_networks() for [('0e9bb60c-1994-4870-a5cf-565c3ad2a0f8', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:58:27.604383 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6de1d013-112d-454f-b861-fc69cd46274c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 204 len: 0 microversion: 2.1 time: 1.196741 Oct 27 18:58:27.605251 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1501/3110] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:26 2022] DELETE /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 0 bytes in 1198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:58:27.610122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8e3fb7a6-97cc-47bd-9c70-02d42a1a5c73 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:27.610760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8e3fb7a6-97cc-47bd-9c70-02d42a1a5c73 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:27.630901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e3fb7a6-97cc-47bd-9c70-02d42a1a5c73 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:27.631419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e3fb7a6-97cc-47bd-9c70-02d42a1a5c73 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:27.634431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e3fb7a6-97cc-47bd-9c70-02d42a1a5c73 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:27.635260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e3fb7a6-97cc-47bd-9c70-02d42a1a5c73 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:27.635752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e3fb7a6-97cc-47bd-9c70-02d42a1a5c73 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:27.636208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e3fb7a6-97cc-47bd-9c70-02d42a1a5c73 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:28.029992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:58:28.030981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:58:28.031219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:58:28.031771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:58:28.032180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:58:28.052660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:28.053428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:28.054449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:28.056344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:28.057288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:28.057910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:28.108207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Getting quotas for project adeacece438645c4a0c5844d1ef83793. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:58:28.124774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Getting quotas for user 2b706e9394a642cda315809db15ecbb3 and project adeacece438645c4a0c5844d1ef83793. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:58:28.130453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8e3fb7a6-97cc-47bd-9c70-02d42a1a5c73 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:28.141138 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8e3fb7a6-97cc-47bd-9c70-02d42a1a5c73 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.534795 Oct 27 18:58:28.145834 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1502/3111] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:27 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:28.178640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:58:28.185273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:58:28.186236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f9525224-d7b3-4d19-83ed-2c5dea0828d3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:28.193862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f9525224-d7b3-4d19-83ed-2c5dea0828d3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:28.216245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9525224-d7b3-4d19-83ed-2c5dea0828d3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:28.222329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9525224-d7b3-4d19-83ed-2c5dea0828d3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:28.226646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9525224-d7b3-4d19-83ed-2c5dea0828d3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:28.232693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9525224-d7b3-4d19-83ed-2c5dea0828d3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:28.233459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9525224-d7b3-4d19-83ed-2c5dea0828d3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:28.235796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9525224-d7b3-4d19-83ed-2c5dea0828d3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:28.308568 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f279832e-29c7-40e7-adef-b4e695f64257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.700120 Oct 27 18:58:28.310958 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1610/3112] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:58:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:58:28.341995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2822e6b4-d9c0-43a5-9fd9-1659369f7210 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:28.345612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2822e6b4-d9c0-43a5-9fd9-1659369f7210 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:28.361840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f9525224-d7b3-4d19-83ed-2c5dea0828d3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:58:28.382292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2822e6b4-d9c0-43a5-9fd9-1659369f7210 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:28.385982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2822e6b4-d9c0-43a5-9fd9-1659369f7210 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:28.386710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2822e6b4-d9c0-43a5-9fd9-1659369f7210 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:28.388993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2822e6b4-d9c0-43a5-9fd9-1659369f7210 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:28.390411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2822e6b4-d9c0-43a5-9fd9-1659369f7210 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:28.391696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2822e6b4-d9c0-43a5-9fd9-1659369f7210 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:28.642416 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f9525224-d7b3-4d19-83ed-2c5dea0828d3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 204 len: 0 microversion: 2.1 time: 0.470577 Oct 27 18:58:28.644231 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1503/3113] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:58:28 2022] DELETE /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:58:28.655843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-78fb8e9a-233a-4f2a-a325-63a5507bbc4f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:28.677554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-78fb8e9a-233a-4f2a-a325-63a5507bbc4f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:29.068041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2822e6b4-d9c0-43a5-9fd9-1659369f7210 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:29.070035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-78fb8e9a-233a-4f2a-a325-63a5507bbc4f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:29.081827 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2822e6b4-d9c0-43a5-9fd9-1659369f7210 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1486 microversion: 2.1 time: 0.767064 Oct 27 18:58:29.083144 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1611/3114] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:28 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1486 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:29.086786 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-78fb8e9a-233a-4f2a-a325-63a5507bbc4f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1221 microversion: 2.1 time: 0.438523 Oct 27 18:58:29.086786 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1504/3115] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:28 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1221 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:29.098259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-487245174", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "bd2a2055-53fd-4e07-8727-b0efd4106712"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:29.106395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-1beb1c59-80c6-47d0-a9ac-a089c5bf9a96 req-d1e8a758-aa04-45fd-b3de-bc75b6a733d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c280a00e-288a-4927-95e6-1f2b3880f240", "name": "network-vif-unplugged", "status": "completed", "tag": "e3f7c665-6965-4529-a1e9-cf0c7c389160"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:29.119025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1beb1c59-80c6-47d0-a9ac-a089c5bf9a96 req-d1e8a758-aa04-45fd-b3de-bc75b6a733d6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:29.119612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1beb1c59-80c6-47d0-a9ac-a089c5bf9a96 req-d1e8a758-aa04-45fd-b3de-bc75b6a733d6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:29.120763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1beb1c59-80c6-47d0-a9ac-a089c5bf9a96 req-d1e8a758-aa04-45fd-b3de-bc75b6a733d6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:29.155643 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-1beb1c59-80c6-47d0-a9ac-a089c5bf9a96 req-d1e8a758-aa04-45fd-b3de-bc75b6a733d6 service nova] Creating event network-vif-unplugged:e3f7c665-6965-4529-a1e9-cf0c7c389160 for instance c280a00e-288a-4927-95e6-1f2b3880f240 on n-h2-860687-3 Oct 27 18:58:29.168247 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-1beb1c59-80c6-47d0-a9ac-a089c5bf9a96 req-d1e8a758-aa04-45fd-b3de-bc75b6a733d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083665 Oct 27 18:58:29.173817 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1612/3116] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:29.184716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a502ffa9-b0e5-4c50-b0a4-c45b29e0b2f3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:29.187442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a502ffa9-b0e5-4c50-b0a4-c45b29e0b2f3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:29.200957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a502ffa9-b0e5-4c50-b0a4-c45b29e0b2f3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:29.204058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a502ffa9-b0e5-4c50-b0a4-c45b29e0b2f3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:29.205251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a502ffa9-b0e5-4c50-b0a4-c45b29e0b2f3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:29.207735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] validate_networks() for [('bd2a2055-53fd-4e07-8727-b0efd4106712', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:58:29.209112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a502ffa9-b0e5-4c50-b0a4-c45b29e0b2f3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:29.211057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a502ffa9-b0e5-4c50-b0a4-c45b29e0b2f3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:29.211604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a502ffa9-b0e5-4c50-b0a4-c45b29e0b2f3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:29.364990 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a502ffa9-b0e5-4c50-b0a4-c45b29e0b2f3 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "POST /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699/action" status: 202 len: 0 microversion: 2.1 time: 0.189238 Oct 27 18:58:29.366136 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1613/3117] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:58:29 2022] POST /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:58:29.373206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-25da6bc3-9cfe-478a-80c2-f94d3e14c864 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:29.374542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-25da6bc3-9cfe-478a-80c2-f94d3e14c864 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:29.391112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25da6bc3-9cfe-478a-80c2-f94d3e14c864 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:29.391611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25da6bc3-9cfe-478a-80c2-f94d3e14c864 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:29.392392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25da6bc3-9cfe-478a-80c2-f94d3e14c864 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:29.394082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25da6bc3-9cfe-478a-80c2-f94d3e14c864 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:29.395728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25da6bc3-9cfe-478a-80c2-f94d3e14c864 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:29.396601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25da6bc3-9cfe-478a-80c2-f94d3e14c864 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:29.684543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-25da6bc3-9cfe-478a-80c2-f94d3e14c864 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:29.703705 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-25da6bc3-9cfe-478a-80c2-f94d3e14c864 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.327977 Oct 27 18:58:29.703705 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1614/3118] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:29 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:29.709035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bbdfc672-4a47-4fa0-8dae-09d9fdbf9c08 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:29.715545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bbdfc672-4a47-4fa0-8dae-09d9fdbf9c08 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:29.735495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbdfc672-4a47-4fa0-8dae-09d9fdbf9c08 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:29.736097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbdfc672-4a47-4fa0-8dae-09d9fdbf9c08 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:29.736548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbdfc672-4a47-4fa0-8dae-09d9fdbf9c08 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:29.737516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbdfc672-4a47-4fa0-8dae-09d9fdbf9c08 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:29.740704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbdfc672-4a47-4fa0-8dae-09d9fdbf9c08 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:29.741431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbdfc672-4a47-4fa0-8dae-09d9fdbf9c08 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:30.101551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bbdfc672-4a47-4fa0-8dae-09d9fdbf9c08 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:30.117733 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bbdfc672-4a47-4fa0-8dae-09d9fdbf9c08 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1494 microversion: 2.1 time: 0.418015 Oct 27 18:58:30.120205 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1615/3119] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:29 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1494 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:30.139040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-20130f89-0b01-4187-8d25-0dd593140f94 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:30.140194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-20130f89-0b01-4187-8d25-0dd593140f94 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:30.155993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20130f89-0b01-4187-8d25-0dd593140f94 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:30.158169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20130f89-0b01-4187-8d25-0dd593140f94 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:30.160458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20130f89-0b01-4187-8d25-0dd593140f94 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:30.161518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20130f89-0b01-4187-8d25-0dd593140f94 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:30.167100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20130f89-0b01-4187-8d25-0dd593140f94 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:30.167938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20130f89-0b01-4187-8d25-0dd593140f94 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:30.287390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-20130f89-0b01-4187-8d25-0dd593140f94 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:30.303850 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-20130f89-0b01-4187-8d25-0dd593140f94 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1273 microversion: 2.1 time: 0.173701 Oct 27 18:58:30.307104 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1616/3120] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:30 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1273 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:30.721975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-974343a9-4213-42d9-b10f-48bc0805208e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:30.722606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-974343a9-4213-42d9-b10f-48bc0805208e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:30.732357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-974343a9-4213-42d9-b10f-48bc0805208e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:30.739179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-974343a9-4213-42d9-b10f-48bc0805208e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:30.739635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-974343a9-4213-42d9-b10f-48bc0805208e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:30.740601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-974343a9-4213-42d9-b10f-48bc0805208e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:30.741070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-974343a9-4213-42d9-b10f-48bc0805208e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:30.741506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-974343a9-4213-42d9-b10f-48bc0805208e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:31.413801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-974343a9-4213-42d9-b10f-48bc0805208e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:31.480255 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-974343a9-4213-42d9-b10f-48bc0805208e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.762078 Oct 27 18:58:31.493916 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1617/3121] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:30 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:31.511985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f2bb89c0-c366-423e-a6e6-49cc6be00b8c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:31.515973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f2bb89c0-c366-423e-a6e6-49cc6be00b8c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:31.525524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2bb89c0-c366-423e-a6e6-49cc6be00b8c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:31.526260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2bb89c0-c366-423e-a6e6-49cc6be00b8c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:31.526943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2bb89c0-c366-423e-a6e6-49cc6be00b8c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:31.527878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2bb89c0-c366-423e-a6e6-49cc6be00b8c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:31.529049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2bb89c0-c366-423e-a6e6-49cc6be00b8c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:31.529850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2bb89c0-c366-423e-a6e6-49cc6be00b8c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:31.675297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:58:31.676360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:58:31.677276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:58:31.677900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:58:31.678606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:58:31.690214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:31.691150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:31.691818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:31.692922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:31.693610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:31.694281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:31.718870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Getting quotas for project 75c41c5833484551b422742abfad598f. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:58:31.729623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Getting quotas for user ac1e2f62e22b4e52badd230ef175817e and project 75c41c5833484551b422742abfad598f. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:58:31.749460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:58:31.751948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:58:31.830941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f2bb89c0-c366-423e-a6e6-49cc6be00b8c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:31.841055 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f2bb89c0-c366-423e-a6e6-49cc6be00b8c tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1494 microversion: 2.1 time: 0.344269 Oct 27 18:58:31.859810 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-47279340-ec4a-4743-98bd-918b7368e638 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.773680 Oct 27 18:58:31.862117 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1505/3122] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:58:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:58:31.868007 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1618/3123] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:31 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1494 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:31.874309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-09180cf6-6bc7-474f-a810-2a7ce07e6232 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:31.875095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-09180cf6-6bc7-474f-a810-2a7ce07e6232 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:31.879254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f4544431-afa4-4946-8d1c-54337ef68c14 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:31.879904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f4544431-afa4-4946-8d1c-54337ef68c14 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:31.894478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09180cf6-6bc7-474f-a810-2a7ce07e6232 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:31.901048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09180cf6-6bc7-474f-a810-2a7ce07e6232 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:31.902281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09180cf6-6bc7-474f-a810-2a7ce07e6232 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:31.905558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09180cf6-6bc7-474f-a810-2a7ce07e6232 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:31.906282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09180cf6-6bc7-474f-a810-2a7ce07e6232 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:31.911226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09180cf6-6bc7-474f-a810-2a7ce07e6232 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:32.025126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f4544431-afa4-4946-8d1c-54337ef68c14 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:32.034069 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f4544431-afa4-4946-8d1c-54337ef68c14 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 200 len: 1207 microversion: 2.1 time: 0.164658 Oct 27 18:58:32.035210 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1619/3124] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:31 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 1207 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:32.122319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-19d1ba6d-149b-47e6-8c45-512d2e2c52ad tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:32.123461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-19d1ba6d-149b-47e6-8c45-512d2e2c52ad tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:32.141664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19d1ba6d-149b-47e6-8c45-512d2e2c52ad tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:32.142666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19d1ba6d-149b-47e6-8c45-512d2e2c52ad tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:32.147208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19d1ba6d-149b-47e6-8c45-512d2e2c52ad tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:32.153595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19d1ba6d-149b-47e6-8c45-512d2e2c52ad tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:32.155329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19d1ba6d-149b-47e6-8c45-512d2e2c52ad tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:32.155890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19d1ba6d-149b-47e6-8c45-512d2e2c52ad tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:32.539106 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-19d1ba6d-149b-47e6-8c45-512d2e2c52ad tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1860 microversion: 2.1 time: 0.421020 Oct 27 18:58:32.541928 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1620/3125] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:32 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1860 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:58:32.555219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-222e6f03-d93e-4347-b6e2-66692096f100 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:32.556573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-222e6f03-d93e-4347-b6e2-66692096f100 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:32.574031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-222e6f03-d93e-4347-b6e2-66692096f100 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:32.576326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-222e6f03-d93e-4347-b6e2-66692096f100 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:32.576938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-222e6f03-d93e-4347-b6e2-66692096f100 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:32.578102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-222e6f03-d93e-4347-b6e2-66692096f100 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:32.579900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-222e6f03-d93e-4347-b6e2-66692096f100 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:32.582125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-222e6f03-d93e-4347-b6e2-66692096f100 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:32.650958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-09180cf6-6bc7-474f-a810-2a7ce07e6232 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:32.661117 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-09180cf6-6bc7-474f-a810-2a7ce07e6232 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1279 microversion: 2.1 time: 0.797689 Oct 27 18:58:32.679738 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1506/3126] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:31 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1279 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:32.687799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-81ec975b-8d06-475f-8bda-682658723399 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860687-3", "block_migration": true, "disk_over_commit": false}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:32.695149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-81ec975b-8d06-475f-8bda-682658723399 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:32.707048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81ec975b-8d06-475f-8bda-682658723399 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:32.707609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81ec975b-8d06-475f-8bda-682658723399 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:32.708068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81ec975b-8d06-475f-8bda-682658723399 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:32.708812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81ec975b-8d06-475f-8bda-682658723399 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:32.709273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81ec975b-8d06-475f-8bda-682658723399 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:32.722908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81ec975b-8d06-475f-8bda-682658723399 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:32.850458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-81ec975b-8d06-475f-8bda-682658723399 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lazy-loading 'flavor' on Instance uuid 69afa571-c5fa-4091-9ce1-5dd147316161 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:58:32.878858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-81ec975b-8d06-475f-8bda-682658723399 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Going to try to live migrate instance to n-h2-860687-3 {{(pid=127028) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 18:58:32.900645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:32.988908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-222e6f03-d93e-4347-b6e2-66692096f100 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:33.017091 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-222e6f03-d93e-4347-b6e2-66692096f100 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.469434 Oct 27 18:58:33.018286 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1621/3127] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:32 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:33.040338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4ee2964f-3112-485c-98c7-4ccaae82d4f9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:33.040338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4ee2964f-3112-485c-98c7-4ccaae82d4f9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:33.066930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee2964f-3112-485c-98c7-4ccaae82d4f9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:33.067571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee2964f-3112-485c-98c7-4ccaae82d4f9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:33.072637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee2964f-3112-485c-98c7-4ccaae82d4f9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:33.073407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee2964f-3112-485c-98c7-4ccaae82d4f9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:33.073891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee2964f-3112-485c-98c7-4ccaae82d4f9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:33.076174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee2964f-3112-485c-98c7-4ccaae82d4f9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:33.787970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4ee2964f-3112-485c-98c7-4ccaae82d4f9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:33.798203 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4ee2964f-3112-485c-98c7-4ccaae82d4f9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1494 microversion: 2.1 time: 0.776444 Oct 27 18:58:33.810940 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1622/3128] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:33 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1494 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:33.828416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3570e750-770e-4190-8090-86073161f6e1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:33.829391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3570e750-770e-4190-8090-86073161f6e1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:33.868514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3570e750-770e-4190-8090-86073161f6e1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:33.874318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3570e750-770e-4190-8090-86073161f6e1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:33.876743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3570e750-770e-4190-8090-86073161f6e1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:33.880995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3570e750-770e-4190-8090-86073161f6e1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:33.883460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3570e750-770e-4190-8090-86073161f6e1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:33.885350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3570e750-770e-4190-8090-86073161f6e1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:33.982788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:34.225833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3570e750-770e-4190-8090-86073161f6e1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:34.241463 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3570e750-770e-4190-8090-86073161f6e1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 200 len: 1211 microversion: 2.1 time: 0.427265 Oct 27 18:58:34.241861 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1623/3129] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:33 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 1211 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:34.262594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7d369c47-d1da-487b-afe5-b624839b9e89 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:34.262594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7d369c47-d1da-487b-afe5-b624839b9e89 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:34.271316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d369c47-d1da-487b-afe5-b624839b9e89 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:34.271622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d369c47-d1da-487b-afe5-b624839b9e89 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:34.272114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d369c47-d1da-487b-afe5-b624839b9e89 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:34.272803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d369c47-d1da-487b-afe5-b624839b9e89 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:34.273279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d369c47-d1da-487b-afe5-b624839b9e89 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:34.273731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d369c47-d1da-487b-afe5-b624839b9e89 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:34.654803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7d369c47-d1da-487b-afe5-b624839b9e89 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:34.664468 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7d369c47-d1da-487b-afe5-b624839b9e89 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1279 microversion: 2.1 time: 0.421465 Oct 27 18:58:34.665365 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1624/3130] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:34 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1279 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:34.704770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9de807e-aad4-4314-9022-ac13560d007e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:34.706099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c9de807e-aad4-4314-9022-ac13560d007e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:34.717741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9de807e-aad4-4314-9022-ac13560d007e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:34.725715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9de807e-aad4-4314-9022-ac13560d007e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:34.726732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9de807e-aad4-4314-9022-ac13560d007e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:34.727790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9de807e-aad4-4314-9022-ac13560d007e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:34.728485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9de807e-aad4-4314-9022-ac13560d007e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:34.729739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9de807e-aad4-4314-9022-ac13560d007e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:35.257846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c9de807e-aad4-4314-9022-ac13560d007e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:35.268849 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c9de807e-aad4-4314-9022-ac13560d007e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1523 microversion: 2.1 time: 0.602022 Oct 27 18:58:35.272416 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1625/3131] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:34 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1523 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:35.285945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-29e52ad5-b309-421c-a0c5-eca8071b991f req-7290129f-dbdc-4cd6-bef4-2474f6921096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c280a00e-288a-4927-95e6-1f2b3880f240", "name": "network-vif-deleted", "tag": "e3f7c665-6965-4529-a1e9-cf0c7c389160"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:35.301644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-29e52ad5-b309-421c-a0c5-eca8071b991f req-7290129f-dbdc-4cd6-bef4-2474f6921096 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:35.302966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-29e52ad5-b309-421c-a0c5-eca8071b991f req-7290129f-dbdc-4cd6-bef4-2474f6921096 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:35.303574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-29e52ad5-b309-421c-a0c5-eca8071b991f req-7290129f-dbdc-4cd6-bef4-2474f6921096 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:35.326364 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-29e52ad5-b309-421c-a0c5-eca8071b991f req-7290129f-dbdc-4cd6-bef4-2474f6921096 service nova] Creating event network-vif-deleted:e3f7c665-6965-4529-a1e9-cf0c7c389160 for instance c280a00e-288a-4927-95e6-1f2b3880f240 on n-h2-860687-3 Oct 27 18:58:35.334185 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-29e52ad5-b309-421c-a0c5-eca8071b991f req-7290129f-dbdc-4cd6-bef4-2474f6921096 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058745 Oct 27 18:58:35.335360 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1626/3132] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:35.343832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ff82b392-906e-454d-b074-79467024e9e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:35.345193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ff82b392-906e-454d-b074-79467024e9e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:35.353187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff82b392-906e-454d-b074-79467024e9e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:35.354498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff82b392-906e-454d-b074-79467024e9e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:35.355360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff82b392-906e-454d-b074-79467024e9e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:35.356426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff82b392-906e-454d-b074-79467024e9e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:35.357711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff82b392-906e-454d-b074-79467024e9e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:35.358441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff82b392-906e-454d-b074-79467024e9e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:35.862359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ff82b392-906e-454d-b074-79467024e9e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:35.872462 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ff82b392-906e-454d-b074-79467024e9e9 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1500 microversion: 2.1 time: 0.535542 Oct 27 18:58:35.877021 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1627/3133] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:35 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1500 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:35.881897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c8046049-ac1e-4616-a965-b1b703ca634c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:35.892108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c8046049-ac1e-4616-a965-b1b703ca634c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:35.913067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8046049-ac1e-4616-a965-b1b703ca634c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:35.927199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8046049-ac1e-4616-a965-b1b703ca634c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:35.927930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8046049-ac1e-4616-a965-b1b703ca634c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:35.928855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8046049-ac1e-4616-a965-b1b703ca634c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:35.935126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8046049-ac1e-4616-a965-b1b703ca634c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:35.935832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8046049-ac1e-4616-a965-b1b703ca634c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:36.072781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c8046049-ac1e-4616-a965-b1b703ca634c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:36.110866 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c8046049-ac1e-4616-a965-b1b703ca634c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 200 len: 1267 microversion: 2.1 time: 0.227823 Oct 27 18:58:36.114168 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1628/3134] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:35 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:36.129447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3a5eddc3-0442-4505-a4cd-9da280201aeb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:36.132556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3a5eddc3-0442-4505-a4cd-9da280201aeb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:36.157522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a5eddc3-0442-4505-a4cd-9da280201aeb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:36.158293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a5eddc3-0442-4505-a4cd-9da280201aeb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:36.174458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a5eddc3-0442-4505-a4cd-9da280201aeb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:36.175739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a5eddc3-0442-4505-a4cd-9da280201aeb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:36.176446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a5eddc3-0442-4505-a4cd-9da280201aeb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:36.177128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a5eddc3-0442-4505-a4cd-9da280201aeb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:36.752704 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-81ec975b-8d06-475f-8bda-682658723399 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/action" status: 202 len: 0 microversion: 2.1 time: 4.076942 Oct 27 18:58:36.753395 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1507/3135] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:58:32 2022] POST /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/action => generated 0 bytes in 4078 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:58:36.761437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-97cbdffb-9a55-4713-bb96-27ee9ac2705d tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:36.762488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-97cbdffb-9a55-4713-bb96-27ee9ac2705d tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:36.778199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3a5eddc3-0442-4505-a4cd-9da280201aeb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:36.784284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97cbdffb-9a55-4713-bb96-27ee9ac2705d tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:36.784781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97cbdffb-9a55-4713-bb96-27ee9ac2705d tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:36.789528 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3a5eddc3-0442-4505-a4cd-9da280201aeb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1321 microversion: 2.1 time: 0.673496 Oct 27 18:58:36.791033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97cbdffb-9a55-4713-bb96-27ee9ac2705d tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:36.792530 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1629/3136] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:36 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1321 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:36.793496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97cbdffb-9a55-4713-bb96-27ee9ac2705d tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:36.794620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97cbdffb-9a55-4713-bb96-27ee9ac2705d tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:36.795124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97cbdffb-9a55-4713-bb96-27ee9ac2705d tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:36.809852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2b0097c7-639b-4c23-b524-6d246bd6ad0a tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:36.810708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2b0097c7-639b-4c23-b524-6d246bd6ad0a tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:36.827460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b0097c7-639b-4c23-b524-6d246bd6ad0a tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:36.828246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b0097c7-639b-4c23-b524-6d246bd6ad0a tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:36.828880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b0097c7-639b-4c23-b524-6d246bd6ad0a tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:36.829763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b0097c7-639b-4c23-b524-6d246bd6ad0a tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:36.830408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b0097c7-639b-4c23-b524-6d246bd6ad0a tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:36.831271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b0097c7-639b-4c23-b524-6d246bd6ad0a tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:36.863441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-97cbdffb-9a55-4713-bb96-27ee9ac2705d tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:58:36.998984 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-97cbdffb-9a55-4713-bb96-27ee9ac2705d tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 204 len: 0 microversion: 2.1 time: 0.243920 Oct 27 18:58:37.002776 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1508/3137] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:58:36 2022] DELETE /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:58:37.008476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8da81cb3-23f0-413c-8cac-0c4831414796 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:37.009254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8da81cb3-23f0-413c-8cac-0c4831414796 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:37.017814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8da81cb3-23f0-413c-8cac-0c4831414796 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:37.018829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8da81cb3-23f0-413c-8cac-0c4831414796 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:37.019476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8da81cb3-23f0-413c-8cac-0c4831414796 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:37.020953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8da81cb3-23f0-413c-8cac-0c4831414796 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:37.022040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8da81cb3-23f0-413c-8cac-0c4831414796 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:37.023440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8da81cb3-23f0-413c-8cac-0c4831414796 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:37.612533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2b0097c7-639b-4c23-b524-6d246bd6ad0a tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:37.639107 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2b0097c7-639b-4c23-b524-6d246bd6ad0a tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1503 microversion: 2.1 time: 0.834179 Oct 27 18:58:37.640187 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1630/3138] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:36 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1503 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:37.647922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-81a71fae-1dc5-4ad5-af01-7e888e9dfb09 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:37.649196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-81a71fae-1dc5-4ad5-af01-7e888e9dfb09 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:37.661667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81a71fae-1dc5-4ad5-af01-7e888e9dfb09 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:37.662898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81a71fae-1dc5-4ad5-af01-7e888e9dfb09 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:37.663763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81a71fae-1dc5-4ad5-af01-7e888e9dfb09 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:37.664765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81a71fae-1dc5-4ad5-af01-7e888e9dfb09 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:37.665307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81a71fae-1dc5-4ad5-af01-7e888e9dfb09 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:37.665997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81a71fae-1dc5-4ad5-af01-7e888e9dfb09 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:37.688216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8da81cb3-23f0-413c-8cac-0c4831414796 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:37.699413 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8da81cb3-23f0-413c-8cac-0c4831414796 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.697541 Oct 27 18:58:37.707156 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1509/3139] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:37 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:37.712364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d6ccdcc-9022-40af-8817-a24a03f8c0d1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:37.712980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9d6ccdcc-9022-40af-8817-a24a03f8c0d1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:37.728060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d6ccdcc-9022-40af-8817-a24a03f8c0d1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:37.729066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d6ccdcc-9022-40af-8817-a24a03f8c0d1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:37.729775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d6ccdcc-9022-40af-8817-a24a03f8c0d1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:37.730568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d6ccdcc-9022-40af-8817-a24a03f8c0d1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:37.731322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d6ccdcc-9022-40af-8817-a24a03f8c0d1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:37.733110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d6ccdcc-9022-40af-8817-a24a03f8c0d1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:37.892138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d6ccdcc-9022-40af-8817-a24a03f8c0d1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:37.900995 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9d6ccdcc-9022-40af-8817-a24a03f8c0d1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 200 len: 1265 microversion: 2.1 time: 0.192556 Oct 27 18:58:37.906518 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1510/3140] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:37 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:37.925052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d24f39ca-7234-42d2-b795-75a50a61bc07 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Action: 'create', calling method: .version_select at 0x7fc869d7c700>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-915861682", "description": "tempest-description-335536473"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:38.081182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-81a71fae-1dc5-4ad5-af01-7e888e9dfb09 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:38.087320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:38.099242 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-81a71fae-1dc5-4ad5-af01-7e888e9dfb09 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.457210 Oct 27 18:58:38.100206 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1631/3141] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:37 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:38.105157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4f410521-fce1-4e37-b599-d81dbf44c597 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:38.106057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4f410521-fce1-4e37-b599-d81dbf44c597 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:38.113302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f410521-fce1-4e37-b599-d81dbf44c597 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:38.114103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f410521-fce1-4e37-b599-d81dbf44c597 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:38.114834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f410521-fce1-4e37-b599-d81dbf44c597 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:38.115574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f410521-fce1-4e37-b599-d81dbf44c597 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:38.116037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f410521-fce1-4e37-b599-d81dbf44c597 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:38.116470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f410521-fce1-4e37-b599-d81dbf44c597 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:38.536292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4f410521-fce1-4e37-b599-d81dbf44c597 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:38.546612 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4f410521-fce1-4e37-b599-d81dbf44c597 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1321 microversion: 2.1 time: 0.444432 Oct 27 18:58:38.563308 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1632/3142] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:38 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1321 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:38.569216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-30b16265-14dd-4fd9-bdea-c666fe5e49ff req-89f688de-3634-49ce-9975-08d6ea8cc57b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd8ee1a0-1df0-4488-bffd-1406e9762843", "tag": "c6498581-54ac-4f2f-90e8-789b7cd18a29"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:38.587560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-30b16265-14dd-4fd9-bdea-c666fe5e49ff req-89f688de-3634-49ce-9975-08d6ea8cc57b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:38.588295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-30b16265-14dd-4fd9-bdea-c666fe5e49ff req-89f688de-3634-49ce-9975-08d6ea8cc57b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:38.589981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-30b16265-14dd-4fd9-bdea-c666fe5e49ff req-89f688de-3634-49ce-9975-08d6ea8cc57b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:38.605922 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-30b16265-14dd-4fd9-bdea-c666fe5e49ff req-89f688de-3634-49ce-9975-08d6ea8cc57b service nova] Creating event network-changed:c6498581-54ac-4f2f-90e8-789b7cd18a29 for instance fd8ee1a0-1df0-4488-bffd-1406e9762843 on n-h1-860687-3 Oct 27 18:58:38.612957 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-30b16265-14dd-4fd9-bdea-c666fe5e49ff req-89f688de-3634-49ce-9975-08d6ea8cc57b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048251 Oct 27 18:58:38.614177 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1633/3143] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:38.677793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-f7fb92bf-a2a0-482a-aeeb-db8ec88612c7 req-b9c203ce-3b3e-44c8-8531-e8b2e0e1ad88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8", "tag": "2435268e-6b80-4862-89cd-cdd63a9b63a6"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:38.687279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:38.689639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f7fb92bf-a2a0-482a-aeeb-db8ec88612c7 req-b9c203ce-3b3e-44c8-8531-e8b2e0e1ad88 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:38.690410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f7fb92bf-a2a0-482a-aeeb-db8ec88612c7 req-b9c203ce-3b3e-44c8-8531-e8b2e0e1ad88 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:38.691085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f7fb92bf-a2a0-482a-aeeb-db8ec88612c7 req-b9c203ce-3b3e-44c8-8531-e8b2e0e1ad88 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:38.706713 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-f7fb92bf-a2a0-482a-aeeb-db8ec88612c7 req-b9c203ce-3b3e-44c8-8531-e8b2e0e1ad88 service nova] Creating event network-changed:2435268e-6b80-4862-89cd-cdd63a9b63a6 for instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 on n-h1-860687-3 Oct 27 18:58:38.712435 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-f7fb92bf-a2a0-482a-aeeb-db8ec88612c7 req-b9c203ce-3b3e-44c8-8531-e8b2e0e1ad88 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039265 Oct 27 18:58:38.713659 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1634/3144] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:58:38.735010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d1b32735-503a-4950-8cb8-a7f6017d557a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:38.736318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d1b32735-503a-4950-8cb8-a7f6017d557a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:38.753574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1b32735-503a-4950-8cb8-a7f6017d557a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:38.754418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1b32735-503a-4950-8cb8-a7f6017d557a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:38.755395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1b32735-503a-4950-8cb8-a7f6017d557a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:38.756698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1b32735-503a-4950-8cb8-a7f6017d557a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:38.757769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1b32735-503a-4950-8cb8-a7f6017d557a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:38.758916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1b32735-503a-4950-8cb8-a7f6017d557a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:39.027747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d1b32735-503a-4950-8cb8-a7f6017d557a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:39.038302 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d1b32735-503a-4950-8cb8-a7f6017d557a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.309535 Oct 27 18:58:39.046138 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1635/3145] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:38 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:39.057592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fe2184fc-36b2-4cb4-9a58-e156d30bf93a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:39.058232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fe2184fc-36b2-4cb4-9a58-e156d30bf93a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:39.069751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe2184fc-36b2-4cb4-9a58-e156d30bf93a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:39.070254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe2184fc-36b2-4cb4-9a58-e156d30bf93a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:39.070985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe2184fc-36b2-4cb4-9a58-e156d30bf93a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:39.072175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe2184fc-36b2-4cb4-9a58-e156d30bf93a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:39.073476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe2184fc-36b2-4cb4-9a58-e156d30bf93a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:39.074020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe2184fc-36b2-4cb4-9a58-e156d30bf93a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:39.097150 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d24f39ca-7234-42d2-b795-75a50a61bc07 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 1.189325 Oct 27 18:58:39.099680 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1511/3146] 10.222.0.42 () {60 vars in 1180 bytes} [Thu Oct 27 18:58:37 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:39.113582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f18bebb8-0dc3-4173-bf43-56a764edc3cd tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-915861682"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:39.123014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f18bebb8-0dc3-4173-bf43-56a764edc3cd tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:39.147777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f18bebb8-0dc3-4173-bf43-56a764edc3cd tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:39.148298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f18bebb8-0dc3-4173-bf43-56a764edc3cd tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:39.148761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f18bebb8-0dc3-4173-bf43-56a764edc3cd tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:39.149908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f18bebb8-0dc3-4173-bf43-56a764edc3cd tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:39.150453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f18bebb8-0dc3-4173-bf43-56a764edc3cd tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:39.151386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f18bebb8-0dc3-4173-bf43-56a764edc3cd tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:39.232397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fe2184fc-36b2-4cb4-9a58-e156d30bf93a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:39.246949 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fe2184fc-36b2-4cb4-9a58-e156d30bf93a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 200 len: 1265 microversion: 2.1 time: 0.197040 Oct 27 18:58:39.248784 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1636/3147] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:39 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:39.261747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-24263ac8-7d10-4b56-86df-ee82a0f00dd0 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:39.264155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-24263ac8-7d10-4b56-86df-ee82a0f00dd0 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:39.273022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24263ac8-7d10-4b56-86df-ee82a0f00dd0 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:39.273910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24263ac8-7d10-4b56-86df-ee82a0f00dd0 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:39.274694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24263ac8-7d10-4b56-86df-ee82a0f00dd0 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:39.275771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24263ac8-7d10-4b56-86df-ee82a0f00dd0 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:39.276633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24263ac8-7d10-4b56-86df-ee82a0f00dd0 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:39.277264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24263ac8-7d10-4b56-86df-ee82a0f00dd0 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:39.537873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-24263ac8-7d10-4b56-86df-ee82a0f00dd0 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:39.550970 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-24263ac8-7d10-4b56-86df-ee82a0f00dd0 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.294081 Oct 27 18:58:39.554693 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1637/3148] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:39 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:39.576055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c3716969-18b2-438a-a352-245536a6032f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:39.576713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c3716969-18b2-438a-a352-245536a6032f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:39.590185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3716969-18b2-438a-a352-245536a6032f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:39.590770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3716969-18b2-438a-a352-245536a6032f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:39.593860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3716969-18b2-438a-a352-245536a6032f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:39.594676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3716969-18b2-438a-a352-245536a6032f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:39.597560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3716969-18b2-438a-a352-245536a6032f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:39.598025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3716969-18b2-438a-a352-245536a6032f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:39.795747 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.network.security_group_api [None req-f18bebb8-0dc3-4173-bf43-56a764edc3cd tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Adding security group f4e9334d-05d0-416c-86ec-e0893e3ce555 to port b92235b2-2236-4871-b34f-af9a42350bb5 Oct 27 18:58:40.311570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c3716969-18b2-438a-a352-245536a6032f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:40.335074 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c3716969-18b2-438a-a352-245536a6032f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1321 microversion: 2.1 time: 0.764220 Oct 27 18:58:40.336159 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1638/3149] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:39 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1321 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:40.337415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c3716969-18b2-438a-a352-245536a6032f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:40.338873 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c3716969-18b2-438a-a352-245536a6032f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001456 Oct 27 18:58:40.339637 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1639/3150] 10.222.0.42 () {56 vars in 886 bytes} [Thu Oct 27 18:58:40 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 18:58:40.351208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0bfcc877-08b2-47f1-8c20-74ab247bb3f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:40.351968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0bfcc877-08b2-47f1-8c20-74ab247bb3f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:40.361030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bfcc877-08b2-47f1-8c20-74ab247bb3f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:40.361944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bfcc877-08b2-47f1-8c20-74ab247bb3f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:40.362606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bfcc877-08b2-47f1-8c20-74ab247bb3f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:40.363486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bfcc877-08b2-47f1-8c20-74ab247bb3f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:40.364107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bfcc877-08b2-47f1-8c20-74ab247bb3f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:40.364697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bfcc877-08b2-47f1-8c20-74ab247bb3f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:41.291062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0bfcc877-08b2-47f1-8c20-74ab247bb3f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:41.307789 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0bfcc877-08b2-47f1-8c20-74ab247bb3f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.966878 Oct 27 18:58:41.308637 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1640/3151] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:40 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:41.313469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5c363af6-68b3-461e-b741-cd57e2fdad17 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:41.327360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5c363af6-68b3-461e-b741-cd57e2fdad17 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:41.334307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c363af6-68b3-461e-b741-cd57e2fdad17 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:41.335088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c363af6-68b3-461e-b741-cd57e2fdad17 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:41.335798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c363af6-68b3-461e-b741-cd57e2fdad17 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:41.336743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c363af6-68b3-461e-b741-cd57e2fdad17 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:41.337382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c363af6-68b3-461e-b741-cd57e2fdad17 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:41.337974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c363af6-68b3-461e-b741-cd57e2fdad17 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:41.708100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:41.742894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=16 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:41.811293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5c363af6-68b3-461e-b741-cd57e2fdad17 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:41.824548 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5c363af6-68b3-461e-b741-cd57e2fdad17 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 200 len: 1307 microversion: 2.1 time: 0.514413 Oct 27 18:58:41.826752 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1641/3152] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:41 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 1307 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:41.831653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d4866ec6-e71b-49c7-9283-22e556f02d8a tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:41.844501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d4866ec6-e71b-49c7-9283-22e556f02d8a tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:41.852093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4866ec6-e71b-49c7-9283-22e556f02d8a tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:41.857234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4866ec6-e71b-49c7-9283-22e556f02d8a tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:41.858226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4866ec6-e71b-49c7-9283-22e556f02d8a tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:41.859508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4866ec6-e71b-49c7-9283-22e556f02d8a tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:41.860968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4866ec6-e71b-49c7-9283-22e556f02d8a tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:41.871226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4866ec6-e71b-49c7-9283-22e556f02d8a tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:41.908378 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f18bebb8-0dc3-4173-bf43-56a764edc3cd tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "POST /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233/action" status: 202 len: 0 microversion: 2.1 time: 2.799121 Oct 27 18:58:41.909006 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1512/3153] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:58:39 2022] POST /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233/action => generated 0 bytes in 2801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 18:58:41.917133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f5c9aacf-f362-42fa-9f3b-376ec2d48e21 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:41.917777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f5c9aacf-f362-42fa-9f3b-376ec2d48e21 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:41.939105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5c9aacf-f362-42fa-9f3b-376ec2d48e21 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:41.940170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5c9aacf-f362-42fa-9f3b-376ec2d48e21 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:41.940776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5c9aacf-f362-42fa-9f3b-376ec2d48e21 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:41.942438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5c9aacf-f362-42fa-9f3b-376ec2d48e21 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:41.942925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5c9aacf-f362-42fa-9f3b-376ec2d48e21 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:41.943743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5c9aacf-f362-42fa-9f3b-376ec2d48e21 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:42.029857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:42.278855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d4866ec6-e71b-49c7-9283-22e556f02d8a tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:42.281055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:42.302834 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d4866ec6-e71b-49c7-9283-22e556f02d8a tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1506 microversion: 2.1 time: 0.463368 Oct 27 18:58:42.303521 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1642/3154] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:41 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1506 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:42.314843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-91620357-dc2a-4c96-8f01-13390dc45b8e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-915861682"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:42.314843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-91620357-dc2a-4c96-8f01-13390dc45b8e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:42.319968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91620357-dc2a-4c96-8f01-13390dc45b8e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:42.320707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91620357-dc2a-4c96-8f01-13390dc45b8e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:42.321319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91620357-dc2a-4c96-8f01-13390dc45b8e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:42.322213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91620357-dc2a-4c96-8f01-13390dc45b8e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:42.322708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91620357-dc2a-4c96-8f01-13390dc45b8e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:42.323141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91620357-dc2a-4c96-8f01-13390dc45b8e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:42.635388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f5c9aacf-f362-42fa-9f3b-376ec2d48e21 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:42.651536 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f5c9aacf-f362-42fa-9f3b-376ec2d48e21 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1321 microversion: 2.1 time: 0.740773 Oct 27 18:58:42.653672 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1513/3155] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:41 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1321 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:42.671292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ec7b34c4-8bc0-4322-8897-fdfdc748b101 req-c60e2d89-1f18-4b19-89d2-e97ebd3ed84a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6ce120-4829-4180-9293-592f8e20e233", "tag": "b92235b2-2236-4871-b34f-af9a42350bb5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:42.688667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ec7b34c4-8bc0-4322-8897-fdfdc748b101 req-c60e2d89-1f18-4b19-89d2-e97ebd3ed84a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:42.689754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ec7b34c4-8bc0-4322-8897-fdfdc748b101 req-c60e2d89-1f18-4b19-89d2-e97ebd3ed84a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:42.691461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ec7b34c4-8bc0-4322-8897-fdfdc748b101 req-c60e2d89-1f18-4b19-89d2-e97ebd3ed84a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:42.712001 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ec7b34c4-8bc0-4322-8897-fdfdc748b101 req-c60e2d89-1f18-4b19-89d2-e97ebd3ed84a service nova] Creating event network-changed:b92235b2-2236-4871-b34f-af9a42350bb5 for instance ca6ce120-4829-4180-9293-592f8e20e233 on n-h2-860687-3 Oct 27 18:58:42.716802 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.network.security_group_api [None req-91620357-dc2a-4c96-8f01-13390dc45b8e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Removing security group f4e9334d-05d0-416c-86ec-e0893e3ce555 from port b92235b2-2236-4871-b34f-af9a42350bb5 Oct 27 18:58:42.732148 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ec7b34c4-8bc0-4322-8897-fdfdc748b101 req-c60e2d89-1f18-4b19-89d2-e97ebd3ed84a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075832 Oct 27 18:58:42.734992 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1514/3156] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:42.751257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13574a35-b72c-40bd-847a-11861dc39c51 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:42.753655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-13574a35-b72c-40bd-847a-11861dc39c51 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:42.776937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13574a35-b72c-40bd-847a-11861dc39c51 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:42.780255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13574a35-b72c-40bd-847a-11861dc39c51 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:42.781342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13574a35-b72c-40bd-847a-11861dc39c51 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:42.783276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13574a35-b72c-40bd-847a-11861dc39c51 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:42.786987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13574a35-b72c-40bd-847a-11861dc39c51 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:42.788838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13574a35-b72c-40bd-847a-11861dc39c51 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:42.805747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:43.621727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-13574a35-b72c-40bd-847a-11861dc39c51 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:43.641165 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-13574a35-b72c-40bd-847a-11861dc39c51 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.902404 Oct 27 18:58:43.642281 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1515/3157] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:42 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:43.647238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7d9bbc83-2b39-4ce2-9123-76ac4b74f7df tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:43.650415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7d9bbc83-2b39-4ce2-9123-76ac4b74f7df tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:43.663957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d9bbc83-2b39-4ce2-9123-76ac4b74f7df tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:43.664615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d9bbc83-2b39-4ce2-9123-76ac4b74f7df tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:43.665262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d9bbc83-2b39-4ce2-9123-76ac4b74f7df tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:43.666112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d9bbc83-2b39-4ce2-9123-76ac4b74f7df tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:43.667595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d9bbc83-2b39-4ce2-9123-76ac4b74f7df tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:43.671613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d9bbc83-2b39-4ce2-9123-76ac4b74f7df tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:43.839763 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-91620357-dc2a-4c96-8f01-13390dc45b8e tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "POST /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233/action" status: 202 len: 0 microversion: 2.1 time: 1.534970 Oct 27 18:58:43.840671 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1643/3158] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:58:42 2022] POST /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233/action => generated 0 bytes in 1537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:58:43.846742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-90de91ec-c905-4aa1-bf2a-23374b10880f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:43.847648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-90de91ec-c905-4aa1-bf2a-23374b10880f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:43.869946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90de91ec-c905-4aa1-bf2a-23374b10880f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:43.873686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90de91ec-c905-4aa1-bf2a-23374b10880f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:43.875451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90de91ec-c905-4aa1-bf2a-23374b10880f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:43.878950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90de91ec-c905-4aa1-bf2a-23374b10880f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:43.881505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90de91ec-c905-4aa1-bf2a-23374b10880f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:43.881706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90de91ec-c905-4aa1-bf2a-23374b10880f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:44.100529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-90de91ec-c905-4aa1-bf2a-23374b10880f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:44.115134 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-90de91ec-c905-4aa1-bf2a-23374b10880f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1298 microversion: 2.1 time: 0.273005 Oct 27 18:58:44.120864 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1644/3159] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:43 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1298 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:44.125928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-34c16925-5ca4-4b6e-b8e7-8cd2501598e1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:44.135371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-34c16925-5ca4-4b6e-b8e7-8cd2501598e1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:44.160834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34c16925-5ca4-4b6e-b8e7-8cd2501598e1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:44.161598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34c16925-5ca4-4b6e-b8e7-8cd2501598e1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:44.162321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34c16925-5ca4-4b6e-b8e7-8cd2501598e1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:44.163358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34c16925-5ca4-4b6e-b8e7-8cd2501598e1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:44.164071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34c16925-5ca4-4b6e-b8e7-8cd2501598e1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:44.175701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34c16925-5ca4-4b6e-b8e7-8cd2501598e1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:44.449829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-34c16925-5ca4-4b6e-b8e7-8cd2501598e1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:44.462766 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-34c16925-5ca4-4b6e-b8e7-8cd2501598e1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1321 microversion: 2.1 time: 0.340654 Oct 27 18:58:44.479393 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1645/3160] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:44 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:44.494536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-68a0ac61-3ad4-45ce-b076-cb575e89a6fc tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Action: 'create', calling method: .version_select at 0x7fc8733b61f0>, body: {"pool": null} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:44.541429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7d9bbc83-2b39-4ce2-9123-76ac4b74f7df tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:44.550045 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7d9bbc83-2b39-4ce2-9123-76ac4b74f7df tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 200 len: 1307 microversion: 2.1 time: 0.906446 Oct 27 18:58:44.562876 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1516/3161] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:43 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 1307 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:44.568106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-76840ed9-f205-418e-8e33-c92a4b2761c5 req-7abee36a-546d-4d30-aa32-f5d3ca3a91af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6ce120-4829-4180-9293-592f8e20e233", "tag": "b92235b2-2236-4871-b34f-af9a42350bb5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:44.602448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-76840ed9-f205-418e-8e33-c92a4b2761c5 req-7abee36a-546d-4d30-aa32-f5d3ca3a91af service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:44.603219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-76840ed9-f205-418e-8e33-c92a4b2761c5 req-7abee36a-546d-4d30-aa32-f5d3ca3a91af service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:44.603828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-76840ed9-f205-418e-8e33-c92a4b2761c5 req-7abee36a-546d-4d30-aa32-f5d3ca3a91af service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:44.629066 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-76840ed9-f205-418e-8e33-c92a4b2761c5 req-7abee36a-546d-4d30-aa32-f5d3ca3a91af service nova] Creating event network-changed:b92235b2-2236-4871-b34f-af9a42350bb5 for instance ca6ce120-4829-4180-9293-592f8e20e233 on n-h2-860687-3 Oct 27 18:58:44.634907 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-76840ed9-f205-418e-8e33-c92a4b2761c5 req-7abee36a-546d-4d30-aa32-f5d3ca3a91af service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070155 Oct 27 18:58:44.635994 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1517/3162] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:44.670641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3cd88624-d309-4304-b720-6d02b2b63dae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:44.671558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3cd88624-d309-4304-b720-6d02b2b63dae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:44.689992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cd88624-d309-4304-b720-6d02b2b63dae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:44.690711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cd88624-d309-4304-b720-6d02b2b63dae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:44.691463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cd88624-d309-4304-b720-6d02b2b63dae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:44.692381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cd88624-d309-4304-b720-6d02b2b63dae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:44.693015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cd88624-d309-4304-b720-6d02b2b63dae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:44.693614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cd88624-d309-4304-b720-6d02b2b63dae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:45.341336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3cd88624-d309-4304-b720-6d02b2b63dae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:45.350153 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3cd88624-d309-4304-b720-6d02b2b63dae tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.684759 Oct 27 18:58:45.366794 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1518/3163] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:44 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:45.373286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f450226d-754e-4716-88b5-5c9f80149fc1 req-5ad5ce6e-dd05-423c-aff9-784f276de566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1eb1b0-efaa-435d-8778-9bfbd72c5699", "name": "network-vif-deleted", "tag": "bb0bee56-cdb7-4296-bd24-5e8a5ead4a0b"}, {"name": "network-changed", "server_uuid": "8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f", "tag": "d04a7167-51a8-4ece-aedc-77994439aa42"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:45.385355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f450226d-754e-4716-88b5-5c9f80149fc1 req-5ad5ce6e-dd05-423c-aff9-784f276de566 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:45.386192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f450226d-754e-4716-88b5-5c9f80149fc1 req-5ad5ce6e-dd05-423c-aff9-784f276de566 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:45.386884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f450226d-754e-4716-88b5-5c9f80149fc1 req-5ad5ce6e-dd05-423c-aff9-784f276de566 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:45.400706 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f450226d-754e-4716-88b5-5c9f80149fc1 req-5ad5ce6e-dd05-423c-aff9-784f276de566 service nova] Creating event network-vif-deleted:bb0bee56-cdb7-4296-bd24-5e8a5ead4a0b for instance ac1eb1b0-efaa-435d-8778-9bfbd72c5699 on n-h1-860687-3 Oct 27 18:58:45.401601 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f450226d-754e-4716-88b5-5c9f80149fc1 req-5ad5ce6e-dd05-423c-aff9-784f276de566 service nova] Creating event network-changed:d04a7167-51a8-4ece-aedc-77994439aa42 for instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f on n-h2-860687-3 Oct 27 18:58:45.410692 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f450226d-754e-4716-88b5-5c9f80149fc1 req-5ad5ce6e-dd05-423c-aff9-784f276de566 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042145 Oct 27 18:58:45.411998 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1519/3164] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:45.417333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-79f2504c-655a-4721-a3ce-880b7971341e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:45.418334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-79f2504c-655a-4721-a3ce-880b7971341e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:45.425819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79f2504c-655a-4721-a3ce-880b7971341e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:45.426754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79f2504c-655a-4721-a3ce-880b7971341e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:45.427462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79f2504c-655a-4721-a3ce-880b7971341e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:45.428412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79f2504c-655a-4721-a3ce-880b7971341e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:45.429101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79f2504c-655a-4721-a3ce-880b7971341e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:45.429821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79f2504c-655a-4721-a3ce-880b7971341e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:45.466762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79f2504c-655a-4721-a3ce-880b7971341e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:45.467596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79f2504c-655a-4721-a3ce-880b7971341e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:45.468282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79f2504c-655a-4721-a3ce-880b7971341e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:45.468994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-79f2504c-655a-4721-a3ce-880b7971341e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lazy-loading 'fault' on Instance uuid ac1eb1b0-efaa-435d-8778-9bfbd72c5699 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:58:45.866972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-79f2504c-655a-4721-a3ce-880b7971341e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:45.879213 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-79f2504c-655a-4721-a3ce-880b7971341e tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 200 len: 1303 microversion: 2.1 time: 0.465751 Oct 27 18:58:45.882438 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1520/3165] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:45 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 1303 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:45.896578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70e1c3b5-a4bc-4a9b-8b4c-336ab87b8913 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:45.897377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-70e1c3b5-a4bc-4a9b-8b4c-336ab87b8913 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:45.907566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70e1c3b5-a4bc-4a9b-8b4c-336ab87b8913 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:45.908097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70e1c3b5-a4bc-4a9b-8b4c-336ab87b8913 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:45.908808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70e1c3b5-a4bc-4a9b-8b4c-336ab87b8913 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:45.909855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70e1c3b5-a4bc-4a9b-8b4c-336ab87b8913 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:45.910601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70e1c3b5-a4bc-4a9b-8b4c-336ab87b8913 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:45.911274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70e1c3b5-a4bc-4a9b-8b4c-336ab87b8913 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:46.335262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-70e1c3b5-a4bc-4a9b-8b4c-336ab87b8913 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:46.345107 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70e1c3b5-a4bc-4a9b-8b4c-336ab87b8913 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1321 microversion: 2.1 time: 0.461124 Oct 27 18:58:46.358064 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1521/3166] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:45 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1321 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:46.363200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ddf1754b-affb-4c4f-b9ae-86d5e823610b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:46.363820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ddf1754b-affb-4c4f-b9ae-86d5e823610b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:46.375871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ddf1754b-affb-4c4f-b9ae-86d5e823610b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:46.376571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ddf1754b-affb-4c4f-b9ae-86d5e823610b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:46.377180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ddf1754b-affb-4c4f-b9ae-86d5e823610b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:46.378091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ddf1754b-affb-4c4f-b9ae-86d5e823610b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:46.383172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ddf1754b-affb-4c4f-b9ae-86d5e823610b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:46.383886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ddf1754b-affb-4c4f-b9ae-86d5e823610b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:46.775241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ddf1754b-affb-4c4f-b9ae-86d5e823610b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:46.800147 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ddf1754b-affb-4c4f-b9ae-86d5e823610b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 200 len: 1307 microversion: 2.1 time: 0.440778 Oct 27 18:58:46.803754 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1522/3167] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:46 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 1307 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:46.810569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ecbd2a69-99a5-4a90-99ac-600976c18714 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:46.814441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ecbd2a69-99a5-4a90-99ac-600976c18714 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:46.832674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecbd2a69-99a5-4a90-99ac-600976c18714 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:46.833499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecbd2a69-99a5-4a90-99ac-600976c18714 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:46.835279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecbd2a69-99a5-4a90-99ac-600976c18714 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:46.838587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecbd2a69-99a5-4a90-99ac-600976c18714 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:46.841506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecbd2a69-99a5-4a90-99ac-600976c18714 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:46.842632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecbd2a69-99a5-4a90-99ac-600976c18714 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:47.214543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ecbd2a69-99a5-4a90-99ac-600976c18714 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:47.223784 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ecbd2a69-99a5-4a90-99ac-600976c18714 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.418413 Oct 27 18:58:47.228150 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1523/3168] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:46 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:47.234039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-127dba9a-580e-400d-8640-fe644fb84b9f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:47.234771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-127dba9a-580e-400d-8640-fe644fb84b9f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: ac1eb1b0-efaa-435d-8778-9bfbd72c5699] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:47.240765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-127dba9a-580e-400d-8640-fe644fb84b9f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:47.241689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-127dba9a-580e-400d-8640-fe644fb84b9f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:47.242302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-127dba9a-580e-400d-8640-fe644fb84b9f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:47.243233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-127dba9a-580e-400d-8640-fe644fb84b9f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:47.243864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-127dba9a-580e-400d-8640-fe644fb84b9f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:47.244484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-127dba9a-580e-400d-8640-fe644fb84b9f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:47.263872 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-127dba9a-580e-400d-8640-fe644fb84b9f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] HTTP exception thrown: Instance ac1eb1b0-efaa-435d-8778-9bfbd72c5699 could not be found. Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-127dba9a-580e-400d-8640-fe644fb84b9f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Request method failure captured: Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 HTTP/1.1 Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtRmVjkmWYNTF-L9CCGctRK0gppcLEVQc37XdKIsO7g33Pjkc15hxpJT54m3Hrjb8HQqe6jXwCHnW7lLae7YWfff1rQqDhaUB5rZivfSB8CHNrKXxTnZd4XIXNncNgHJ2lwEJLzkkEpgNPJJANRiFCXKiyeHzG41hugTFLw9kx97Ft8 Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: c6651a933fb1407f95a17ef4a1583933 Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerRescueTestJSON-2078146132 Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c6651a933fb1407f95a17ef4a1583933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c6651a933fb1407f95a17ef4a1583933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c6651a933fb1407f95a17ef4a1583933", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c6651a933fb1407f95a17ef4a1583933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerRescueTestJSON-2078146132 Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: c6651a933fb1407f95a17ef4a1583933 Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerRescueTestJSON-2078146132 Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerRescueTestJSON-2078146132-project Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 683571ba22aa4e838e473f111f97ffae Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerRescueTestJSON-2078146132-project Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance ac1eb1b0-efaa-435d-8778-9bfbd72c5699 could not be found. Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'ac1eb1b0-efaa-435d-8778-9bfbd72c5699'} Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1eb1b0-efaa-435d-8778-9bfbd72c5699 could not be found. Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1eb1b0-efaa-435d-8778-9bfbd72c5699 could not be found. Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:58:47.265913 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:47.270493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:47.270493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:58:47.270493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:58:47.270493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:58:47.270493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:58:47.270493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1eb1b0-efaa-435d-8778-9bfbd72c5699 could not be found. Oct 27 18:58:47.270493 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:58:47.272956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-127dba9a-580e-400d-8640-fe644fb84b9f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Returning 404 to user: Instance ac1eb1b0-efaa-435d-8778-9bfbd72c5699 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:58:47.274190 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-127dba9a-580e-400d-8640-fe644fb84b9f tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699" status: 404 len: 111 microversion: 2.1 time: 0.045159 Oct 27 18:58:47.275291 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1524/3169] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:47 2022] GET /compute/v2.1/servers/ac1eb1b0-efaa-435d-8778-9bfbd72c5699 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:58:47.284352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8b3b86ad-dbce-4827-9fe3-69e3ffe453a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:47.285668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8b3b86ad-dbce-4827-9fe3-69e3ffe453a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:47.298090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b3b86ad-dbce-4827-9fe3-69e3ffe453a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:47.299113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b3b86ad-dbce-4827-9fe3-69e3ffe453a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:47.299779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b3b86ad-dbce-4827-9fe3-69e3ffe453a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:47.300723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b3b86ad-dbce-4827-9fe3-69e3ffe453a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:47.301446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b3b86ad-dbce-4827-9fe3-69e3ffe453a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:47.302078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b3b86ad-dbce-4827-9fe3-69e3ffe453a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:47.336930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8b3b86ad-dbce-4827-9fe3-69e3ffe453a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:58:47.489155 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8b3b86ad-dbce-4827-9fe3-69e3ffe453a2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 204 len: 0 microversion: 2.1 time: 0.208819 Oct 27 18:58:47.490301 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1525/3170] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:58:47 2022] DELETE /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:58:47.509860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa2f2b6a-2b1e-493c-8b33-ccab011a0c8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:47.510936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa2f2b6a-2b1e-493c-8b33-ccab011a0c8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:47.538838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa2f2b6a-2b1e-493c-8b33-ccab011a0c8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:47.539346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa2f2b6a-2b1e-493c-8b33-ccab011a0c8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:47.539796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa2f2b6a-2b1e-493c-8b33-ccab011a0c8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:47.540519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa2f2b6a-2b1e-493c-8b33-ccab011a0c8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:47.543452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa2f2b6a-2b1e-493c-8b33-ccab011a0c8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:47.545177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa2f2b6a-2b1e-493c-8b33-ccab011a0c8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:47.783250 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-68a0ac61-3ad4-45ce-b076-cb575e89a6fc tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.301533 Oct 27 18:58:47.786165 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1646/3171] 10.222.0.42 () {60 vars in 1170 bytes} [Thu Oct 27 18:58:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:47.801337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ef848efb-145e-471a-b431-db51f96ecf12 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:47.802012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ef848efb-145e-471a-b431-db51f96ecf12 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:47.867798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef848efb-145e-471a-b431-db51f96ecf12 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:47.869090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef848efb-145e-471a-b431-db51f96ecf12 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:47.875033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef848efb-145e-471a-b431-db51f96ecf12 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:47.876988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef848efb-145e-471a-b431-db51f96ecf12 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:47.877720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef848efb-145e-471a-b431-db51f96ecf12 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:47.878307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef848efb-145e-471a-b431-db51f96ecf12 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:47.920610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fa2f2b6a-2b1e-493c-8b33-ccab011a0c8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:47.932274 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fa2f2b6a-2b1e-493c-8b33-ccab011a0c8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1321 microversion: 2.1 time: 0.438664 Oct 27 18:58:47.932877 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1526/3172] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:47 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:47.954907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a4276108-5480-49e7-bbd3-078798e27909 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.100"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:47.957885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a4276108-5480-49e7-bbd3-078798e27909 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:47.965391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4276108-5480-49e7-bbd3-078798e27909 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:47.966990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4276108-5480-49e7-bbd3-078798e27909 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:47.967645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4276108-5480-49e7-bbd3-078798e27909 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:47.968572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4276108-5480-49e7-bbd3-078798e27909 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:47.969256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4276108-5480-49e7-bbd3-078798e27909 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:47.969876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4276108-5480-49e7-bbd3-078798e27909 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:48.000172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4276108-5480-49e7-bbd3-078798e27909 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "refresh_cache-ca6ce120-4829-4180-9293-592f8e20e233" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 18:58:48.000865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4276108-5480-49e7-bbd3-078798e27909 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquired lock "refresh_cache-ca6ce120-4829-4180-9293-592f8e20e233" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 18:58:48.222985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ef848efb-145e-471a-b431-db51f96ecf12 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:48.238704 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ef848efb-145e-471a-b431-db51f96ecf12 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1492 microversion: 2.1 time: 0.450384 Oct 27 18:58:48.240275 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1647/3173] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:47 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1492 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:48.250785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8d3b64e8-2cd0-4df0-a6f6-f7f6ae864677 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:48.251972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8d3b64e8-2cd0-4df0-a6f6-f7f6ae864677 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:48.266478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d3b64e8-2cd0-4df0-a6f6-f7f6ae864677 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:48.266968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d3b64e8-2cd0-4df0-a6f6-f7f6ae864677 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:48.267418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d3b64e8-2cd0-4df0-a6f6-f7f6ae864677 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:48.268152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d3b64e8-2cd0-4df0-a6f6-f7f6ae864677 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:48.268622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d3b64e8-2cd0-4df0-a6f6-f7f6ae864677 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:48.269063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d3b64e8-2cd0-4df0-a6f6-f7f6ae864677 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:48.666881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8d3b64e8-2cd0-4df0-a6f6-f7f6ae864677 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:48.695972 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8d3b64e8-2cd0-4df0-a6f6-f7f6ae864677 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 200 len: 1307 microversion: 2.1 time: 0.453000 Oct 27 18:58:48.696919 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1648/3174] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:48 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 1307 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:48.702630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-95e6ec80-66bb-4587-a59e-24fdf4a92168 req-6990de31-6363-4ee7-bc3c-83f95b163875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8", "name": "network-vif-plugged", "status": "completed", "tag": "2435268e-6b80-4862-89cd-cdd63a9b63a6"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:48.717170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-95e6ec80-66bb-4587-a59e-24fdf4a92168 req-6990de31-6363-4ee7-bc3c-83f95b163875 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:48.717906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-95e6ec80-66bb-4587-a59e-24fdf4a92168 req-6990de31-6363-4ee7-bc3c-83f95b163875 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:48.718544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-95e6ec80-66bb-4587-a59e-24fdf4a92168 req-6990de31-6363-4ee7-bc3c-83f95b163875 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:48.742038 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-95e6ec80-66bb-4587-a59e-24fdf4a92168 req-6990de31-6363-4ee7-bc3c-83f95b163875 service nova] Creating event network-vif-plugged:2435268e-6b80-4862-89cd-cdd63a9b63a6 for instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 on n-h1-860687-3 Oct 27 18:58:48.749525 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-95e6ec80-66bb-4587-a59e-24fdf4a92168 req-6990de31-6363-4ee7-bc3c-83f95b163875 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050254 Oct 27 18:58:48.750490 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1649/3175] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:48.759599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1ca6087e-d640-46f4-8cb2-4f20f7d85805 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:48.760618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1ca6087e-d640-46f4-8cb2-4f20f7d85805 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:48.770945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ca6087e-d640-46f4-8cb2-4f20f7d85805 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:48.771444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ca6087e-d640-46f4-8cb2-4f20f7d85805 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:48.771884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ca6087e-d640-46f4-8cb2-4f20f7d85805 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:48.772654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ca6087e-d640-46f4-8cb2-4f20f7d85805 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:48.773119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ca6087e-d640-46f4-8cb2-4f20f7d85805 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:48.773550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ca6087e-d640-46f4-8cb2-4f20f7d85805 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:49.048869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1ca6087e-d640-46f4-8cb2-4f20f7d85805 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:49.062216 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1ca6087e-d640-46f4-8cb2-4f20f7d85805 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.309801 Oct 27 18:58:49.063520 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1650/3176] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:48 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:49.069077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f747b8ad-b8f6-43d4-b1f6-c0c50b455f31 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:49.069882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f747b8ad-b8f6-43d4-b1f6-c0c50b455f31 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:49.083737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f747b8ad-b8f6-43d4-b1f6-c0c50b455f31 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:49.084530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f747b8ad-b8f6-43d4-b1f6-c0c50b455f31 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:49.085283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f747b8ad-b8f6-43d4-b1f6-c0c50b455f31 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:49.086548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f747b8ad-b8f6-43d4-b1f6-c0c50b455f31 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:49.087177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f747b8ad-b8f6-43d4-b1f6-c0c50b455f31 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:49.087781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f747b8ad-b8f6-43d4-b1f6-c0c50b455f31 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:49.267783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f747b8ad-b8f6-43d4-b1f6-c0c50b455f31 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:49.276536 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f747b8ad-b8f6-43d4-b1f6-c0c50b455f31 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1321 microversion: 2.1 time: 0.211557 Oct 27 18:58:49.277500 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1651/3177] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:49 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:49.284820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-40c392fd-3dd4-4473-8727-3288596185c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:49.285833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-40c392fd-3dd4-4473-8727-3288596185c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:49.293499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40c392fd-3dd4-4473-8727-3288596185c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:49.295575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40c392fd-3dd4-4473-8727-3288596185c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:49.296263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40c392fd-3dd4-4473-8727-3288596185c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:49.297214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40c392fd-3dd4-4473-8727-3288596185c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:49.298142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40c392fd-3dd4-4473-8727-3288596185c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:49.298834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40c392fd-3dd4-4473-8727-3288596185c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:49.609394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-40c392fd-3dd4-4473-8727-3288596185c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:49.623673 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-40c392fd-3dd4-4473-8727-3288596185c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1492 microversion: 2.1 time: 0.342510 Oct 27 18:58:49.630996 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1652/3178] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:49 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1492 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:49.722764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-adb3060e-c89d-4c2e-b0ab-266cbefdd530 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:49.723413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-adb3060e-c89d-4c2e-b0ab-266cbefdd530 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:49.733795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adb3060e-c89d-4c2e-b0ab-266cbefdd530 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:49.734330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adb3060e-c89d-4c2e-b0ab-266cbefdd530 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:49.734802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adb3060e-c89d-4c2e-b0ab-266cbefdd530 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:49.735519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adb3060e-c89d-4c2e-b0ab-266cbefdd530 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:49.735978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adb3060e-c89d-4c2e-b0ab-266cbefdd530 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:49.738895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adb3060e-c89d-4c2e-b0ab-266cbefdd530 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:49.946106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-adb3060e-c89d-4c2e-b0ab-266cbefdd530 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:49.960053 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-adb3060e-c89d-4c2e-b0ab-266cbefdd530 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 200 len: 1307 microversion: 2.1 time: 0.242508 Oct 27 18:58:49.960953 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1653/3179] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:49 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 1307 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:58:50.088228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1dfcf0a5-1c53-471f-90cf-839c0ee094b7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:50.088990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1dfcf0a5-1c53-471f-90cf-839c0ee094b7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:50.098840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dfcf0a5-1c53-471f-90cf-839c0ee094b7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:50.102673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dfcf0a5-1c53-471f-90cf-839c0ee094b7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:50.103414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dfcf0a5-1c53-471f-90cf-839c0ee094b7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:50.104290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dfcf0a5-1c53-471f-90cf-839c0ee094b7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:50.104858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dfcf0a5-1c53-471f-90cf-839c0ee094b7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:50.105599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dfcf0a5-1c53-471f-90cf-839c0ee094b7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:50.350779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1dfcf0a5-1c53-471f-90cf-839c0ee094b7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:50.364617 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1dfcf0a5-1c53-471f-90cf-839c0ee094b7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.280018 Oct 27 18:58:50.366758 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1654/3180] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:50 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:50.378779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c8ce0e31-342c-4fe9-a912-a117b4c1c5c5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:50.379427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c8ce0e31-342c-4fe9-a912-a117b4c1c5c5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:50.390312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8ce0e31-342c-4fe9-a912-a117b4c1c5c5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:50.390842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8ce0e31-342c-4fe9-a912-a117b4c1c5c5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:50.391494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8ce0e31-342c-4fe9-a912-a117b4c1c5c5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:50.392488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8ce0e31-342c-4fe9-a912-a117b4c1c5c5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:50.393116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8ce0e31-342c-4fe9-a912-a117b4c1c5c5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:50.393722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8ce0e31-342c-4fe9-a912-a117b4c1c5c5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:50.615560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c8ce0e31-342c-4fe9-a912-a117b4c1c5c5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:50.625944 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c8ce0e31-342c-4fe9-a912-a117b4c1c5c5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1321 microversion: 2.1 time: 0.257792 Oct 27 18:58:50.627095 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1655/3181] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:50 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:50.653463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c2897fca-c4db-4960-b5cf-af68a90638e2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:50.654305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c2897fca-c4db-4960-b5cf-af68a90638e2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:50.663098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2897fca-c4db-4960-b5cf-af68a90638e2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:50.663632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2897fca-c4db-4960-b5cf-af68a90638e2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:50.664115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2897fca-c4db-4960-b5cf-af68a90638e2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:50.670275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2897fca-c4db-4960-b5cf-af68a90638e2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:50.671375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2897fca-c4db-4960-b5cf-af68a90638e2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:50.671502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2897fca-c4db-4960-b5cf-af68a90638e2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:50.842967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c2897fca-c4db-4960-b5cf-af68a90638e2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:50.854813 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c2897fca-c4db-4960-b5cf-af68a90638e2 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1492 microversion: 2.1 time: 0.205105 Oct 27 18:58:50.857108 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1656/3182] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:50 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1492 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:58:50.863063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ac836670-68d8-490f-bcad-259e94bcebdb req-67914697-e811-40e0-aea6-5a5c63553dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8ee1a0-1df0-4488-bffd-1406e9762843", "name": "network-vif-plugged", "status": "completed", "tag": "c6498581-54ac-4f2f-90e8-789b7cd18a29"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:50.878014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ac836670-68d8-490f-bcad-259e94bcebdb req-67914697-e811-40e0-aea6-5a5c63553dff service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:50.878554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ac836670-68d8-490f-bcad-259e94bcebdb req-67914697-e811-40e0-aea6-5a5c63553dff service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:50.879002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ac836670-68d8-490f-bcad-259e94bcebdb req-67914697-e811-40e0-aea6-5a5c63553dff service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:50.892647 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ac836670-68d8-490f-bcad-259e94bcebdb req-67914697-e811-40e0-aea6-5a5c63553dff service nova] Creating event network-vif-plugged:c6498581-54ac-4f2f-90e8-789b7cd18a29 for instance fd8ee1a0-1df0-4488-bffd-1406e9762843 on n-h1-860687-3 Oct 27 18:58:50.898373 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ac836670-68d8-490f-bcad-259e94bcebdb req-67914697-e811-40e0-aea6-5a5c63553dff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039288 Oct 27 18:58:50.899035 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1657/3183] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:50.989542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-515da384-993d-4db9-a792-5a276ad5b9fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:50.990416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-515da384-993d-4db9-a792-5a276ad5b9fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:51.005218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-515da384-993d-4db9-a792-5a276ad5b9fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:51.005727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-515da384-993d-4db9-a792-5a276ad5b9fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:51.006172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-515da384-993d-4db9-a792-5a276ad5b9fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:51.014330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-515da384-993d-4db9-a792-5a276ad5b9fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:51.026943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-515da384-993d-4db9-a792-5a276ad5b9fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:51.050139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-515da384-993d-4db9-a792-5a276ad5b9fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:51.294999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-515da384-993d-4db9-a792-5a276ad5b9fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:51.311238 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-515da384-993d-4db9-a792-5a276ad5b9fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 200 len: 1307 microversion: 2.1 time: 0.329703 Oct 27 18:58:51.312367 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1658/3184] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:50 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 1307 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:51.392627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5207f874-cb79-4031-b153-b49a3c55c906 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:51.393456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5207f874-cb79-4031-b153-b49a3c55c906 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:51.401234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5207f874-cb79-4031-b153-b49a3c55c906 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:51.402172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5207f874-cb79-4031-b153-b49a3c55c906 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:51.402834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5207f874-cb79-4031-b153-b49a3c55c906 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:51.404271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5207f874-cb79-4031-b153-b49a3c55c906 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:51.404958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5207f874-cb79-4031-b153-b49a3c55c906 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:51.405561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5207f874-cb79-4031-b153-b49a3c55c906 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:51.845121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5207f874-cb79-4031-b153-b49a3c55c906 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:51.854032 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5207f874-cb79-4031-b153-b49a3c55c906 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.466177 Oct 27 18:58:51.875652 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1659/3185] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:51 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:51.881730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bd41643d-07ff-46a7-b3f9-854588054bdb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:51.882787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bd41643d-07ff-46a7-b3f9-854588054bdb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:51.894702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd41643d-07ff-46a7-b3f9-854588054bdb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:51.896888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd41643d-07ff-46a7-b3f9-854588054bdb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:51.898914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd41643d-07ff-46a7-b3f9-854588054bdb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:51.900685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd41643d-07ff-46a7-b3f9-854588054bdb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:51.902012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd41643d-07ff-46a7-b3f9-854588054bdb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:51.902854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd41643d-07ff-46a7-b3f9-854588054bdb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:52.259095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bd41643d-07ff-46a7-b3f9-854588054bdb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:52.280287 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bd41643d-07ff-46a7-b3f9-854588054bdb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1321 microversion: 2.1 time: 0.399328 Oct 27 18:58:52.282541 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1660/3186] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:51 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:52.321128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-390653ad-3c7f-4f0b-acb7-8741b658f4c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:52.322457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-390653ad-3c7f-4f0b-acb7-8741b658f4c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:52.339229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-390653ad-3c7f-4f0b-acb7-8741b658f4c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:52.340961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-390653ad-3c7f-4f0b-acb7-8741b658f4c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:52.341680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-390653ad-3c7f-4f0b-acb7-8741b658f4c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:52.345531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-390653ad-3c7f-4f0b-acb7-8741b658f4c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:52.347971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-390653ad-3c7f-4f0b-acb7-8741b658f4c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:52.348442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-390653ad-3c7f-4f0b-acb7-8741b658f4c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:52.484373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-390653ad-3c7f-4f0b-acb7-8741b658f4c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683571ba22aa4e838e473f111f97ffae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6651a933fb1407f95a17ef4a1583933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:52.493027 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-390653ad-3c7f-4f0b-acb7-8741b658f4c5 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 200 len: 1450 microversion: 2.1 time: 0.187613 Oct 27 18:58:52.498175 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1661/3187] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:52 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 1450 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:52.515980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e8a1bb9f-62c5-4f3f-82ea-7951858f9c64 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:52.516972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e8a1bb9f-62c5-4f3f-82ea-7951858f9c64 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:52.524370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e8a1bb9f-62c5-4f3f-82ea-7951858f9c64 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:52.525137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e8a1bb9f-62c5-4f3f-82ea-7951858f9c64 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:52.525774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e8a1bb9f-62c5-4f3f-82ea-7951858f9c64 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:52.526747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e8a1bb9f-62c5-4f3f-82ea-7951858f9c64 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:52.527416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e8a1bb9f-62c5-4f3f-82ea-7951858f9c64 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:52.528063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e8a1bb9f-62c5-4f3f-82ea-7951858f9c64 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:52.553615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:52.798435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e8a1bb9f-62c5-4f3f-82ea-7951858f9c64 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:52.815625 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e8a1bb9f-62c5-4f3f-82ea-7951858f9c64 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 200 len: 1307 microversion: 2.1 time: 0.316076 Oct 27 18:58:52.830411 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1662/3188] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:52 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 1307 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:52.830411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-3e1b0e1e-63fc-42c2-a83e-d4e82a183036 req-4bef7ea6-d022-4aa0-8e9a-242fcca309ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40282a5-ba3b-4bef-9ed2-49d45f1585aa", "name": "network-vif-deleted", "tag": "86486bd5-2889-47b9-9283-710b1e959993"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:52.843030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3e1b0e1e-63fc-42c2-a83e-d4e82a183036 req-4bef7ea6-d022-4aa0-8e9a-242fcca309ef service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:52.843528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3e1b0e1e-63fc-42c2-a83e-d4e82a183036 req-4bef7ea6-d022-4aa0-8e9a-242fcca309ef service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:52.843975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3e1b0e1e-63fc-42c2-a83e-d4e82a183036 req-4bef7ea6-d022-4aa0-8e9a-242fcca309ef service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:52.866332 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-3e1b0e1e-63fc-42c2-a83e-d4e82a183036 req-4bef7ea6-d022-4aa0-8e9a-242fcca309ef service nova] Creating event network-vif-deleted:86486bd5-2889-47b9-9283-710b1e959993 for instance d40282a5-ba3b-4bef-9ed2-49d45f1585aa on n-h1-860687-3 Oct 27 18:58:52.871763 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-3e1b0e1e-63fc-42c2-a83e-d4e82a183036 req-4bef7ea6-d022-4aa0-8e9a-242fcca309ef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053882 Oct 27 18:58:52.873035 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1663/3189] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:52.904491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9f08f89-3c44-4f8c-9291-8556c4014392 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:52.907398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c9f08f89-3c44-4f8c-9291-8556c4014392 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:52.924179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9f08f89-3c44-4f8c-9291-8556c4014392 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:52.926148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9f08f89-3c44-4f8c-9291-8556c4014392 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:52.927078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9f08f89-3c44-4f8c-9291-8556c4014392 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:52.928829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9f08f89-3c44-4f8c-9291-8556c4014392 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:52.930768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9f08f89-3c44-4f8c-9291-8556c4014392 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:52.931470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9f08f89-3c44-4f8c-9291-8556c4014392 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:53.234500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-a4276108-5480-49e7-bbd3-078798e27909 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Building network info cache for instance {{(pid=127028) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 18:58:53.751545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c9f08f89-3c44-4f8c-9291-8556c4014392 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:53.781990 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c9f08f89-3c44-4f8c-9291-8556c4014392 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.892779 Oct 27 18:58:53.783325 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1664/3190] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:52 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:58:53.788149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-8be0bbb8-e275-4682-8868-4b9ce4d58c9b req-e5e1306d-8214-432d-8722-dedc905bb78a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f", "name": "network-vif-plugged", "status": "completed", "tag": "d04a7167-51a8-4ece-aedc-77994439aa42"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:53.804040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8be0bbb8-e275-4682-8868-4b9ce4d58c9b req-e5e1306d-8214-432d-8722-dedc905bb78a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:53.805370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8be0bbb8-e275-4682-8868-4b9ce4d58c9b req-e5e1306d-8214-432d-8722-dedc905bb78a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:53.805883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8be0bbb8-e275-4682-8868-4b9ce4d58c9b req-e5e1306d-8214-432d-8722-dedc905bb78a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:53.876897 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8be0bbb8-e275-4682-8868-4b9ce4d58c9b req-e5e1306d-8214-432d-8722-dedc905bb78a service nova] Creating event network-vif-plugged:d04a7167-51a8-4ece-aedc-77994439aa42 for instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f on n-h2-860687-3 Oct 27 18:58:53.887788 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-8be0bbb8-e275-4682-8868-4b9ce4d58c9b req-e5e1306d-8214-432d-8722-dedc905bb78a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102995 Oct 27 18:58:53.892808 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1665/3191] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:53.906168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d1f63c5c-4f80-405a-9d41-34ab58b05eee tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:53.908062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d1f63c5c-4f80-405a-9d41-34ab58b05eee tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:53.938010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1f63c5c-4f80-405a-9d41-34ab58b05eee tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:53.943362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1f63c5c-4f80-405a-9d41-34ab58b05eee tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:53.944284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1f63c5c-4f80-405a-9d41-34ab58b05eee tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:53.945334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1f63c5c-4f80-405a-9d41-34ab58b05eee tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:53.946252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1f63c5c-4f80-405a-9d41-34ab58b05eee tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:53.946966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1f63c5c-4f80-405a-9d41-34ab58b05eee tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:54.580515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d1f63c5c-4f80-405a-9d41-34ab58b05eee tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:54.594820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-a4276108-5480-49e7-bbd3-078798e27909 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Updating instance_info_cache with network_info: [{"id": "b92235b2-2236-4871-b34f-af9a42350bb5", "address": "fa:16:3e:1f:d1:64", "network": {"id": "94c62c0b-e354-47fc-826b-1e4eff72400d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-273799478-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f356a8b83ed843079eca7a548b68da1a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb92235b2-22", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127028) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 18:58:54.605147 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d1f63c5c-4f80-405a-9d41-34ab58b05eee tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1516 microversion: 2.1 time: 0.710393 Oct 27 18:58:54.609363 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1666/3192] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:53 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1516 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:54.624455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4276108-5480-49e7-bbd3-078798e27909 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Releasing lock "refresh_cache-ca6ce120-4829-4180-9293-592f8e20e233" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 18:58:54.625917 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a4276108-5480-49e7-bbd3-078798e27909 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "POST /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233/action" status: 202 len: 0 microversion: 2.1 time: 6.675888 Oct 27 18:58:54.629704 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1527/3193] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:58:47 2022] POST /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233/action => generated 0 bytes in 6678 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 18:58:54.638680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-021b8d19-838f-4bfa-a222-076814c85261 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:54.639330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-021b8d19-838f-4bfa-a222-076814c85261 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] [instance: d40282a5-ba3b-4bef-9ed2-49d45f1585aa] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:54.642129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-40bbcc6e-c77d-44a6-bb3f-5ff82cb267e4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:54.643003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-40bbcc6e-c77d-44a6-bb3f-5ff82cb267e4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:54.652069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-021b8d19-838f-4bfa-a222-076814c85261 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:54.656634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-021b8d19-838f-4bfa-a222-076814c85261 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:54.657561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-021b8d19-838f-4bfa-a222-076814c85261 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:54.658691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-021b8d19-838f-4bfa-a222-076814c85261 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:54.660381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40bbcc6e-c77d-44a6-bb3f-5ff82cb267e4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:54.661401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-021b8d19-838f-4bfa-a222-076814c85261 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:54.661991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-021b8d19-838f-4bfa-a222-076814c85261 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:54.662736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40bbcc6e-c77d-44a6-bb3f-5ff82cb267e4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:54.666453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40bbcc6e-c77d-44a6-bb3f-5ff82cb267e4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:54.667522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40bbcc6e-c77d-44a6-bb3f-5ff82cb267e4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:54.668222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40bbcc6e-c77d-44a6-bb3f-5ff82cb267e4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:54.670680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40bbcc6e-c77d-44a6-bb3f-5ff82cb267e4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:54.685970 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-021b8d19-838f-4bfa-a222-076814c85261 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] HTTP exception thrown: Instance d40282a5-ba3b-4bef-9ed2-49d45f1585aa could not be found. Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-021b8d19-838f-4bfa-a222-076814c85261 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Request method failure captured: Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa HTTP/1.1 Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtRmVjkmWYNTF-L9CCGctRK0gppcLEVQc37XdKIsO7g33Pjkc15hxpJT54m3Hrjb8HQqe6jXwCHnW7lLae7YWfff1rQqDhaUB5rZivfSB8CHNrKXxTnZd4XIXNncNgHJ2lwEJLzkkEpgNPJJANRiFCXKiyeHzG41hugTFLw9kx97Ft8 Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: c6651a933fb1407f95a17ef4a1583933 Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerRescueTestJSON-2078146132 Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c6651a933fb1407f95a17ef4a1583933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c6651a933fb1407f95a17ef4a1583933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c6651a933fb1407f95a17ef4a1583933", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c6651a933fb1407f95a17ef4a1583933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerRescueTestJSON-2078146132 Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: c6651a933fb1407f95a17ef4a1583933 Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerRescueTestJSON-2078146132 Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerRescueTestJSON-2078146132-project Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 683571ba22aa4e838e473f111f97ffae Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerRescueTestJSON-2078146132-project Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance d40282a5-ba3b-4bef-9ed2-49d45f1585aa could not be found. Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'd40282a5-ba3b-4bef-9ed2-49d45f1585aa'} Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d40282a5-ba3b-4bef-9ed2-49d45f1585aa could not be found. Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d40282a5-ba3b-4bef-9ed2-49d45f1585aa could not be found. Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:58:54.687956 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:54.695535 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:58:54.695535 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:58:54.695535 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:58:54.695535 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:58:54.695535 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:58:54.695535 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d40282a5-ba3b-4bef-9ed2-49d45f1585aa could not be found. Oct 27 18:58:54.695535 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:58:54.699690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-021b8d19-838f-4bfa-a222-076814c85261 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] Returning 404 to user: Instance d40282a5-ba3b-4bef-9ed2-49d45f1585aa could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:58:54.701240 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-021b8d19-838f-4bfa-a222-076814c85261 tempest-ServerRescueTestJSON-2078146132 tempest-ServerRescueTestJSON-2078146132-project] 10.222.0.42 "GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa" status: 404 len: 111 microversion: 2.1 time: 0.090534 Oct 27 18:58:54.706635 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1667/3194] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:54 2022] GET /compute/v2.1/servers/d40282a5-ba3b-4bef-9ed2-49d45f1585aa => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:58:54.713286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4122175a-2045-42fa-af75-dfc1ea6ce54c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:54.716455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4122175a-2045-42fa-af75-dfc1ea6ce54c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:54.725555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4122175a-2045-42fa-af75-dfc1ea6ce54c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:54.726810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4122175a-2045-42fa-af75-dfc1ea6ce54c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:54.727503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4122175a-2045-42fa-af75-dfc1ea6ce54c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:54.729109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4122175a-2045-42fa-af75-dfc1ea6ce54c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:54.730102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4122175a-2045-42fa-af75-dfc1ea6ce54c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:54.731290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4122175a-2045-42fa-af75-dfc1ea6ce54c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:54.792908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-4122175a-2045-42fa-af75-dfc1ea6ce54c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lazy-loading 'flavor' on Instance uuid db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:58:54.978208 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4122175a-2045-42fa-af75-dfc1ea6ce54c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8/action" status: 200 len: 32 microversion: 2.1 time: 0.269890 Oct 27 18:58:54.982876 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1668/3195] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:58:54 2022] POST /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8/action => generated 32 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:58:55.003364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9c0e21bd-3e8f-44a7-a279-ade7cc2eb80b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.100"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:55.217752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9c0e21bd-3e8f-44a7-a279-ade7cc2eb80b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:55.226816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c0e21bd-3e8f-44a7-a279-ade7cc2eb80b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:55.227607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c0e21bd-3e8f-44a7-a279-ade7cc2eb80b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:55.229445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c0e21bd-3e8f-44a7-a279-ade7cc2eb80b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:55.233817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c0e21bd-3e8f-44a7-a279-ade7cc2eb80b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:55.234589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c0e21bd-3e8f-44a7-a279-ade7cc2eb80b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:55.236480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c0e21bd-3e8f-44a7-a279-ade7cc2eb80b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:55.912292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-40bbcc6e-c77d-44a6-bb3f-5ff82cb267e4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:55.925053 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-40bbcc6e-c77d-44a6-bb3f-5ff82cb267e4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 200 len: 1307 microversion: 2.1 time: 1.294273 Oct 27 18:58:55.928925 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1528/3196] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:54 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 1307 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:55.943528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-be31c37e-22d3-4448-9a8a-d76b89c3b571 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:55.944451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-be31c37e-22d3-4448-9a8a-d76b89c3b571 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:55.950787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c0e21bd-3e8f-44a7-a279-ade7cc2eb80b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "refresh_cache-ca6ce120-4829-4180-9293-592f8e20e233" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 18:58:55.951359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c0e21bd-3e8f-44a7-a279-ade7cc2eb80b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquired lock "refresh_cache-ca6ce120-4829-4180-9293-592f8e20e233" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 18:58:55.956618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be31c37e-22d3-4448-9a8a-d76b89c3b571 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:55.958013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be31c37e-22d3-4448-9a8a-d76b89c3b571 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:55.958813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be31c37e-22d3-4448-9a8a-d76b89c3b571 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:55.961576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be31c37e-22d3-4448-9a8a-d76b89c3b571 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:55.965112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be31c37e-22d3-4448-9a8a-d76b89c3b571 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:55.966445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be31c37e-22d3-4448-9a8a-d76b89c3b571 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:56.737524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-be31c37e-22d3-4448-9a8a-d76b89c3b571 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:56.747109 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-be31c37e-22d3-4448-9a8a-d76b89c3b571 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.816599 Oct 27 18:58:56.749006 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1529/3197] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:55 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:56.754375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e563911-f0bf-4399-9cb6-1424823e7649 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:56.755357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9e563911-f0bf-4399-9cb6-1424823e7649 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:56.766534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e563911-f0bf-4399-9cb6-1424823e7649 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:56.767446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e563911-f0bf-4399-9cb6-1424823e7649 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:56.768951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e563911-f0bf-4399-9cb6-1424823e7649 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:56.770003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e563911-f0bf-4399-9cb6-1424823e7649 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:56.771126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e563911-f0bf-4399-9cb6-1424823e7649 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:56.771989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e563911-f0bf-4399-9cb6-1424823e7649 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:57.464922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9e563911-f0bf-4399-9cb6-1424823e7649 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:57.477032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:58:57.497952 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9e563911-f0bf-4399-9cb6-1424823e7649 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1522 microversion: 2.1 time: 0.747043 Oct 27 18:58:57.500065 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1530/3198] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:56 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1522 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:57.507916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-2cdc776e-5664-4540-a1a3-be5c043cfe0b req-c4e94036-03d8-4d4b-9138-3b88a26bce0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6ce120-4829-4180-9293-592f8e20e233", "tag": "b92235b2-2236-4871-b34f-af9a42350bb5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:57.523513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2cdc776e-5664-4540-a1a3-be5c043cfe0b req-c4e94036-03d8-4d4b-9138-3b88a26bce0b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:57.524579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2cdc776e-5664-4540-a1a3-be5c043cfe0b req-c4e94036-03d8-4d4b-9138-3b88a26bce0b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:57.526642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2cdc776e-5664-4540-a1a3-be5c043cfe0b req-c4e94036-03d8-4d4b-9138-3b88a26bce0b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:57.582751 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-2cdc776e-5664-4540-a1a3-be5c043cfe0b req-c4e94036-03d8-4d4b-9138-3b88a26bce0b service nova] Creating event network-changed:b92235b2-2236-4871-b34f-af9a42350bb5 for instance ca6ce120-4829-4180-9293-592f8e20e233 on n-h2-860687-3 Oct 27 18:58:57.613936 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-2cdc776e-5664-4540-a1a3-be5c043cfe0b req-c4e94036-03d8-4d4b-9138-3b88a26bce0b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112135 Oct 27 18:58:57.615888 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1531/3199] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:57.630207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c221e93e-73ff-41a5-9d97-f1c315eec214 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:57.638462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c221e93e-73ff-41a5-9d97-f1c315eec214 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:57.660078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c221e93e-73ff-41a5-9d97-f1c315eec214 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:57.665502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c221e93e-73ff-41a5-9d97-f1c315eec214 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:57.669087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c221e93e-73ff-41a5-9d97-f1c315eec214 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:57.684543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-9c0e21bd-3e8f-44a7-a279-ade7cc2eb80b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Building network info cache for instance {{(pid=127029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 18:58:57.688975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c221e93e-73ff-41a5-9d97-f1c315eec214 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:57.690046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c221e93e-73ff-41a5-9d97-f1c315eec214 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:57.691928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c221e93e-73ff-41a5-9d97-f1c315eec214 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:59.334271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-9c0e21bd-3e8f-44a7-a279-ade7cc2eb80b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Updating instance_info_cache with network_info: [{"id": "b92235b2-2236-4871-b34f-af9a42350bb5", "address": "fa:16:3e:1f:d1:64", "network": {"id": "94c62c0b-e354-47fc-826b-1e4eff72400d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-273799478-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f356a8b83ed843079eca7a548b68da1a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb92235b2-22", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 18:58:59.384548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c0e21bd-3e8f-44a7-a279-ade7cc2eb80b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Releasing lock "refresh_cache-ca6ce120-4829-4180-9293-592f8e20e233" {{(pid=127029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 18:58:59.387744 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9c0e21bd-3e8f-44a7-a279-ade7cc2eb80b tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "POST /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233/action" status: 202 len: 0 microversion: 2.1 time: 4.402581 Oct 27 18:58:59.389083 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1669/3200] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:58:54 2022] POST /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233/action => generated 0 bytes in 4405 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 18:58:59.398033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9b4f389-97dd-48f9-b498-b49b68abe4ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:59.399805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c9b4f389-97dd-48f9-b498-b49b68abe4ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:59.409916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9b4f389-97dd-48f9-b498-b49b68abe4ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:59.410933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9b4f389-97dd-48f9-b498-b49b68abe4ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:59.411560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9b4f389-97dd-48f9-b498-b49b68abe4ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:59.412446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9b4f389-97dd-48f9-b498-b49b68abe4ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:59.413073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9b4f389-97dd-48f9-b498-b49b68abe4ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:59.413667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9b4f389-97dd-48f9-b498-b49b68abe4ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:59.422831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c221e93e-73ff-41a5-9d97-f1c315eec214 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:59.446011 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c221e93e-73ff-41a5-9d97-f1c315eec214 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 200 len: 1486 microversion: 2.1 time: 1.825262 Oct 27 18:58:59.447990 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1532/3201] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:57 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 1486 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:59.460889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b0c047cd-33d4-4281-afd4-4a0466c0ca6d req-a83cb1ef-ee8a-4b7e-99eb-b4d3e405d76d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6ce120-4829-4180-9293-592f8e20e233", "tag": "b92235b2-2236-4871-b34f-af9a42350bb5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:58:59.502975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b0c047cd-33d4-4281-afd4-4a0466c0ca6d req-a83cb1ef-ee8a-4b7e-99eb-b4d3e405d76d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:59.503528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b0c047cd-33d4-4281-afd4-4a0466c0ca6d req-a83cb1ef-ee8a-4b7e-99eb-b4d3e405d76d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:59.504066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b0c047cd-33d4-4281-afd4-4a0466c0ca6d req-a83cb1ef-ee8a-4b7e-99eb-b4d3e405d76d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:59.551223 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b0c047cd-33d4-4281-afd4-4a0466c0ca6d req-a83cb1ef-ee8a-4b7e-99eb-b4d3e405d76d service nova] Creating event network-changed:b92235b2-2236-4871-b34f-af9a42350bb5 for instance ca6ce120-4829-4180-9293-592f8e20e233 on n-h2-860687-3 Oct 27 18:58:59.565346 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b0c047cd-33d4-4281-afd4-4a0466c0ca6d req-a83cb1ef-ee8a-4b7e-99eb-b4d3e405d76d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116055 Oct 27 18:58:59.569702 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1533/3202] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:58:59.590865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-39445964-cdd6-4ca7-bfe4-7b403fe1b969 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:58:59.593857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-39445964-cdd6-4ca7-bfe4-7b403fe1b969 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:58:59.608985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39445964-cdd6-4ca7-bfe4-7b403fe1b969 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:59.611814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39445964-cdd6-4ca7-bfe4-7b403fe1b969 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:59.613992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39445964-cdd6-4ca7-bfe4-7b403fe1b969 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:59.615042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39445964-cdd6-4ca7-bfe4-7b403fe1b969 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:58:59.615877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39445964-cdd6-4ca7-bfe4-7b403fe1b969 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:58:59.618045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39445964-cdd6-4ca7-bfe4-7b403fe1b969 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:58:59.895683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c9b4f389-97dd-48f9-b498-b49b68abe4ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:58:59.918141 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c9b4f389-97dd-48f9-b498-b49b68abe4ff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.527618 Oct 27 18:58:59.939211 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1670/3203] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:59 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:58:59.943149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3905a0d7-428e-457a-a3b9-352fd4de5754 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '.version_select at 0x7fc87332edc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:00.922480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-39445964-cdd6-4ca7-bfe4-7b403fe1b969 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:00.932928 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-39445964-cdd6-4ca7-bfe4-7b403fe1b969 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1522 microversion: 2.1 time: 1.360147 Oct 27 18:59:00.935100 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1534/3204] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:58:59 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1522 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:00.951533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1bfb8a60-1320-4d40-9ca2-bcdb5f8f5aa5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-732017992"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:00.954378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1bfb8a60-1320-4d40-9ca2-bcdb5f8f5aa5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:00.965620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bfb8a60-1320-4d40-9ca2-bcdb5f8f5aa5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:00.966284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bfb8a60-1320-4d40-9ca2-bcdb5f8f5aa5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:00.971699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bfb8a60-1320-4d40-9ca2-bcdb5f8f5aa5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:00.972805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bfb8a60-1320-4d40-9ca2-bcdb5f8f5aa5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:00.973472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bfb8a60-1320-4d40-9ca2-bcdb5f8f5aa5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:00.974211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bfb8a60-1320-4d40-9ca2-bcdb5f8f5aa5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:01.383832 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1bfb8a60-1320-4d40-9ca2-bcdb5f8f5aa5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "POST /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f/action" status: 202 len: 0 microversion: 2.1 time: 0.443294 Oct 27 18:59:01.388144 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1535/3205] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:59:00 2022] POST /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 18:59:01.393409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ee8324c7-4428-4ca9-b969-be42ee2fdbb2 req-ab0ee83d-7eb0-4247-814a-a67a299495bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69afa571-c5fa-4091-9ce1-5dd147316161", "name": "network-vif-unplugged", "status": "completed", "tag": "a647c899-2362-49df-acbd-1cd3b9f8ec32"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:01.423457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ee8324c7-4428-4ca9-b969-be42ee2fdbb2 req-ab0ee83d-7eb0-4247-814a-a67a299495bc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:01.423949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ee8324c7-4428-4ca9-b969-be42ee2fdbb2 req-ab0ee83d-7eb0-4247-814a-a67a299495bc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:01.424386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ee8324c7-4428-4ca9-b969-be42ee2fdbb2 req-ab0ee83d-7eb0-4247-814a-a67a299495bc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:01.450230 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ee8324c7-4428-4ca9-b969-be42ee2fdbb2 req-ab0ee83d-7eb0-4247-814a-a67a299495bc service nova] Creating event network-vif-unplugged:a647c899-2362-49df-acbd-1cd3b9f8ec32 for instance 69afa571-c5fa-4091-9ce1-5dd147316161 on n-h1-860687-3 Oct 27 18:59:01.460666 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ee8324c7-4428-4ca9-b969-be42ee2fdbb2 req-ab0ee83d-7eb0-4247-814a-a67a299495bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071043 Oct 27 18:59:01.467171 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1536/3206] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:01.474112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-db0de221-2264-4da0-84b9-d4260915ff39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:01.479585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-db0de221-2264-4da0-84b9-d4260915ff39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:01.499255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db0de221-2264-4da0-84b9-d4260915ff39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:01.500009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db0de221-2264-4da0-84b9-d4260915ff39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:01.500632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db0de221-2264-4da0-84b9-d4260915ff39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:01.501543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db0de221-2264-4da0-84b9-d4260915ff39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:01.502001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db0de221-2264-4da0-84b9-d4260915ff39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:01.502616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db0de221-2264-4da0-84b9-d4260915ff39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:01.791150 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3905a0d7-428e-457a-a3b9-352fd4de5754 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/f9e1962e-9efa-4767-9cbd-5810e6fe78e7" status: 202 len: 0 microversion: 2.1 time: 1.863422 Oct 27 18:59:01.796362 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1671/3207] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 18:58:59 2022] DELETE /compute/v2.1/os-floating-ips/f9e1962e-9efa-4767-9cbd-5810e6fe78e7 => generated 0 bytes in 1871 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:59:01.807095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85fe91d3-70aa-4bf9-bdb6-c7c68d594459 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86afd03a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:01.898092 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-85fe91d3-70aa-4bf9-bdb6-c7c68d594459 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1411 microversion: 2.1 time: 0.100551 Oct 27 18:59:01.902581 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1672/3208] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:01 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1411 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:01.910363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d261cee0-7c20-4b90-a586-63cce7527390 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '.version_select at 0x7fc87330d310>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:02.249867 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d261cee0-7c20-4b90-a586-63cce7527390 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/f4e9334d-05d0-416c-86ec-e0893e3ce555" status: 202 len: 0 microversion: 2.1 time: 0.344532 Oct 27 18:59:02.250807 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1673/3209] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 18:59:01 2022] DELETE /compute/v2.1/os-security-groups/f4e9334d-05d0-416c-86ec-e0893e3ce555 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:59:02.256706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5df74493-74af-41bb-b120-a83df168d24d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:02.257254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5df74493-74af-41bb-b120-a83df168d24d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:02.273795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5df74493-74af-41bb-b120-a83df168d24d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:02.274298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5df74493-74af-41bb-b120-a83df168d24d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:02.275405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5df74493-74af-41bb-b120-a83df168d24d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:02.276275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5df74493-74af-41bb-b120-a83df168d24d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:02.279843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5df74493-74af-41bb-b120-a83df168d24d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:02.279843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5df74493-74af-41bb-b120-a83df168d24d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:02.569602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5df74493-74af-41bb-b120-a83df168d24d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:02.581988 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5df74493-74af-41bb-b120-a83df168d24d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1522 microversion: 2.1 time: 0.329672 Oct 27 18:59:02.583252 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1674/3210] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:02 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:02.592290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7e0ab3c5-0419-46d8-8137-71aeec041031 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:02.597913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7e0ab3c5-0419-46d8-8137-71aeec041031 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:02.608788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e0ab3c5-0419-46d8-8137-71aeec041031 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:02.609300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e0ab3c5-0419-46d8-8137-71aeec041031 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:02.609759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e0ab3c5-0419-46d8-8137-71aeec041031 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:02.610518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e0ab3c5-0419-46d8-8137-71aeec041031 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:02.619178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e0ab3c5-0419-46d8-8137-71aeec041031 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:02.619723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e0ab3c5-0419-46d8-8137-71aeec041031 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:02.627778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-db0de221-2264-4da0-84b9-d4260915ff39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:02.643978 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-db0de221-2264-4da0-84b9-d4260915ff39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 1.171844 Oct 27 18:59:02.645457 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1537/3211] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:01 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:02.680426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7e0ab3c5-0419-46d8-8137-71aeec041031 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 18:59:02.801833 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7e0ab3c5-0419-46d8-8137-71aeec041031 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 204 len: 0 microversion: 2.1 time: 0.217078 Oct 27 18:59:02.802626 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1675/3212] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 18:59:02 2022] DELETE /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 18:59:02.813302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3d25dfc8-09dd-4992-aca8-69f50d0fe996 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:02.814845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3d25dfc8-09dd-4992-aca8-69f50d0fe996 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:02.826918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d25dfc8-09dd-4992-aca8-69f50d0fe996 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:02.827790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d25dfc8-09dd-4992-aca8-69f50d0fe996 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:02.828964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d25dfc8-09dd-4992-aca8-69f50d0fe996 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:02.830158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d25dfc8-09dd-4992-aca8-69f50d0fe996 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:02.830942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d25dfc8-09dd-4992-aca8-69f50d0fe996 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:02.831793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d25dfc8-09dd-4992-aca8-69f50d0fe996 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:02.916855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-49d09bee-a973-437a-98a5-fb124faf1238 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86adfbaf0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:02.995545 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-49d09bee-a973-437a-98a5-fb124faf1238 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1411 microversion: 2.1 time: 0.085388 Oct 27 18:59:03.002535 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1676/3213] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:02 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:03.557132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-bfff27f6-3700-4128-a57e-c2778b40c33c req-fe53b7f9-d050-4531-8a35-a689227813df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69afa571-c5fa-4091-9ce1-5dd147316161", "tag": "a647c899-2362-49df-acbd-1cd3b9f8ec32"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:03.602874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-bfff27f6-3700-4128-a57e-c2778b40c33c req-fe53b7f9-d050-4531-8a35-a689227813df service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:03.608734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-bfff27f6-3700-4128-a57e-c2778b40c33c req-fe53b7f9-d050-4531-8a35-a689227813df service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:03.610932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-bfff27f6-3700-4128-a57e-c2778b40c33c req-fe53b7f9-d050-4531-8a35-a689227813df service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:03.632717 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-bfff27f6-3700-4128-a57e-c2778b40c33c req-fe53b7f9-d050-4531-8a35-a689227813df service nova] Creating event network-changed:a647c899-2362-49df-acbd-1cd3b9f8ec32 for instance 69afa571-c5fa-4091-9ce1-5dd147316161 on n-h1-860687-3 Oct 27 18:59:03.639070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d25dfc8-09dd-4992-aca8-69f50d0fe996 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:03.673434 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3d25dfc8-09dd-4992-aca8-69f50d0fe996 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1509 microversion: 2.1 time: 0.860403 Oct 27 18:59:03.675331 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1538/3214] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:02 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1509 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:03.680638 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-bfff27f6-3700-4128-a57e-c2778b40c33c req-fe53b7f9-d050-4531-8a35-a689227813df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125046 Oct 27 18:59:03.683778 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1677/3215] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:03.692109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-90b1fb22-bfce-4cba-a5d4-34eb611995b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:03.696222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-90b1fb22-bfce-4cba-a5d4-34eb611995b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:03.698565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5913b679-67a7-4fcd-aa37-6060f56cc9c4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:03.703625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5913b679-67a7-4fcd-aa37-6060f56cc9c4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:03.707977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:03.720624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5913b679-67a7-4fcd-aa37-6060f56cc9c4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:03.721013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90b1fb22-bfce-4cba-a5d4-34eb611995b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:03.722049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90b1fb22-bfce-4cba-a5d4-34eb611995b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:03.722712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90b1fb22-bfce-4cba-a5d4-34eb611995b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:03.723489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5913b679-67a7-4fcd-aa37-6060f56cc9c4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:03.724242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5913b679-67a7-4fcd-aa37-6060f56cc9c4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:03.725218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90b1fb22-bfce-4cba-a5d4-34eb611995b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:03.726268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90b1fb22-bfce-4cba-a5d4-34eb611995b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:03.726980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5913b679-67a7-4fcd-aa37-6060f56cc9c4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:03.730455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90b1fb22-bfce-4cba-a5d4-34eb611995b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:03.731523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5913b679-67a7-4fcd-aa37-6060f56cc9c4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:03.733708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5913b679-67a7-4fcd-aa37-6060f56cc9c4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:04.517837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5913b679-67a7-4fcd-aa37-6060f56cc9c4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:04.526691 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5913b679-67a7-4fcd-aa37-6060f56cc9c4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.839863 Oct 27 18:59:04.547099 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1678/3216] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:03 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:04.555034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-919efb40-7f3a-4fbe-a065-12de96feaea6 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86aa8d3a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:04.594606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-90b1fb22-bfce-4cba-a5d4-34eb611995b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:04.616204 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-90b1fb22-bfce-4cba-a5d4-34eb611995b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1522 microversion: 2.1 time: 0.937572 Oct 27 18:59:04.617253 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1539/3217] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:03 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1522 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:04.680275 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-919efb40-7f3a-4fbe-a065-12de96feaea6 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1411 microversion: 2.1 time: 0.131071 Oct 27 18:59:04.681185 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1679/3218] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:04 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1411 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:04.705324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-950c7181-6380-418d-b0b8-43b135e9839f tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:04.707278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-950c7181-6380-418d-b0b8-43b135e9839f tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:04.724258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-950c7181-6380-418d-b0b8-43b135e9839f tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:04.725481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-950c7181-6380-418d-b0b8-43b135e9839f tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:04.726121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-950c7181-6380-418d-b0b8-43b135e9839f tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:04.728244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-950c7181-6380-418d-b0b8-43b135e9839f tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:04.732066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-950c7181-6380-418d-b0b8-43b135e9839f tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:04.735262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-950c7181-6380-418d-b0b8-43b135e9839f tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:05.572483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3e317271-d554-4a82-94ea-1cea8d249cc9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:05.573125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3e317271-d554-4a82-94ea-1cea8d249cc9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:05.598048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e317271-d554-4a82-94ea-1cea8d249cc9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:05.599126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e317271-d554-4a82-94ea-1cea8d249cc9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:05.603016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e317271-d554-4a82-94ea-1cea8d249cc9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:05.605441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e317271-d554-4a82-94ea-1cea8d249cc9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:05.608534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e317271-d554-4a82-94ea-1cea8d249cc9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:05.609220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e317271-d554-4a82-94ea-1cea8d249cc9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:05.947017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3e317271-d554-4a82-94ea-1cea8d249cc9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:05.972391 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3e317271-d554-4a82-94ea-1cea8d249cc9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.421353 Oct 27 18:59:05.992483 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1680/3219] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:05 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:06.004906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-74d5e904-8d1f-4a14-8939-ac41a694c180 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:06.005909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-74d5e904-8d1f-4a14-8939-ac41a694c180 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:06.013572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74d5e904-8d1f-4a14-8939-ac41a694c180 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:06.014484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74d5e904-8d1f-4a14-8939-ac41a694c180 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:06.015171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74d5e904-8d1f-4a14-8939-ac41a694c180 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:06.016181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74d5e904-8d1f-4a14-8939-ac41a694c180 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:06.017833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74d5e904-8d1f-4a14-8939-ac41a694c180 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:06.018632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74d5e904-8d1f-4a14-8939-ac41a694c180 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:06.481814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-74d5e904-8d1f-4a14-8939-ac41a694c180 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:06.486268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:06.504175 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-74d5e904-8d1f-4a14-8939-ac41a694c180 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1522 microversion: 2.1 time: 0.508793 Oct 27 18:59:06.527119 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1681/3220] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:05 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:06.539891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c5529243-1321-4606-9b59-9917538feb2d tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc873365ee0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:06.630101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-950c7181-6380-418d-b0b8-43b135e9839f tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:06.677672 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-950c7181-6380-418d-b0b8-43b135e9839f tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1509 microversion: 2.1 time: 1.979563 Oct 27 18:59:06.707209 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1540/3221] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:04 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1509 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:06.754426 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c5529243-1321-4606-9b59-9917538feb2d tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1411 microversion: 2.1 time: 0.225204 Oct 27 18:59:06.760202 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1682/3222] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:06 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1411 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:06.981063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb6cd341-6c44-473a-b684-52caff6cfe34 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Action: 'create', calling method: .version_select at 0x7fc86ac543a0>, body: {"keypair": {"name": "tempest-keypair-2045009007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0CYzwsYH+s0kkU8Ic/yPSoKs7cG9hikUocx2rTi0Dtb6M8AJV8qGFewWjogsXI/k2VoFbcX8Rz74Q7RfJz+RrAWQKbr+MUb3Sc+Mof+nY7U7SaolJaDi9JH43RWYU7sA=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:07.001022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0cf823d0-210e-4149-b243-e77584c0c1d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:07.001938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0cf823d0-210e-4149-b243-e77584c0c1d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:07.041510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cf823d0-210e-4149-b243-e77584c0c1d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:07.042041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cf823d0-210e-4149-b243-e77584c0c1d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:07.042546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cf823d0-210e-4149-b243-e77584c0c1d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:07.044114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cf823d0-210e-4149-b243-e77584c0c1d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:07.044429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cf823d0-210e-4149-b243-e77584c0c1d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:07.053320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0cf823d0-210e-4149-b243-e77584c0c1d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:07.061945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-eb6cd341-6c44-473a-b684-52caff6cfe34 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:59:07.094939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-eb6cd341-6c44-473a-b684-52caff6cfe34 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for user 2be49f7bea7a4c8fbf289594e635fd69 and project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:59:07.155337 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb6cd341-6c44-473a-b684-52caff6cfe34 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.442923 Oct 27 18:59:07.163099 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1541/3223] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 18:59:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:07.446791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-db57faaf-e512-4f7b-98b0-9be41573c95a req-bde6bf40-a5fc-4429-89e6-cbd8a9b8acc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6ce120-4829-4180-9293-592f8e20e233", "name": "network-vif-unplugged", "status": "completed", "tag": "b92235b2-2236-4871-b34f-af9a42350bb5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:07.468696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-db57faaf-e512-4f7b-98b0-9be41573c95a req-bde6bf40-a5fc-4429-89e6-cbd8a9b8acc6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:07.469530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-db57faaf-e512-4f7b-98b0-9be41573c95a req-bde6bf40-a5fc-4429-89e6-cbd8a9b8acc6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:07.470192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-db57faaf-e512-4f7b-98b0-9be41573c95a req-bde6bf40-a5fc-4429-89e6-cbd8a9b8acc6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:07.509988 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-db57faaf-e512-4f7b-98b0-9be41573c95a req-bde6bf40-a5fc-4429-89e6-cbd8a9b8acc6 service nova] Creating event network-vif-unplugged:b92235b2-2236-4871-b34f-af9a42350bb5 for instance ca6ce120-4829-4180-9293-592f8e20e233 on n-h2-860687-3 Oct 27 18:59:07.525971 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-db57faaf-e512-4f7b-98b0-9be41573c95a req-bde6bf40-a5fc-4429-89e6-cbd8a9b8acc6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083816 Oct 27 18:59:07.530850 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1542/3224] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:07.540926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d333f1f-75a7-408c-86bb-0578b420fd0b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:07.541678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d333f1f-75a7-408c-86bb-0578b420fd0b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:07.557958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d333f1f-75a7-408c-86bb-0578b420fd0b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:07.558506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d333f1f-75a7-408c-86bb-0578b420fd0b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:07.559504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d333f1f-75a7-408c-86bb-0578b420fd0b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:07.560247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d333f1f-75a7-408c-86bb-0578b420fd0b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:07.570368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d333f1f-75a7-408c-86bb-0578b420fd0b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:07.571444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d333f1f-75a7-408c-86bb-0578b420fd0b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:07.617092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0cf823d0-210e-4149-b243-e77584c0c1d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:07.631031 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0cf823d0-210e-4149-b243-e77584c0c1d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.635491 Oct 27 18:59:07.634459 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1683/3225] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:06 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:07.718087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce5b70b5-a1ad-4de5-8f34-5891cc29e7f7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:07.719010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ce5b70b5-a1ad-4de5-8f34-5891cc29e7f7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:07.735920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce5b70b5-a1ad-4de5-8f34-5891cc29e7f7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:07.736441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce5b70b5-a1ad-4de5-8f34-5891cc29e7f7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:07.741692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce5b70b5-a1ad-4de5-8f34-5891cc29e7f7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:07.742522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce5b70b5-a1ad-4de5-8f34-5891cc29e7f7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:07.743067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce5b70b5-a1ad-4de5-8f34-5891cc29e7f7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:07.743602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce5b70b5-a1ad-4de5-8f34-5891cc29e7f7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:08.411015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ce5b70b5-a1ad-4de5-8f34-5891cc29e7f7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:08.426205 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce5b70b5-a1ad-4de5-8f34-5891cc29e7f7 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1509 microversion: 2.1 time: 0.720723 Oct 27 18:59:08.430163 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1684/3226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:07 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1509 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:08.442688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5892a59f-1331-47c6-9e2f-5774f0d5453c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b238ca0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:08.523856 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5892a59f-1331-47c6-9e2f-5774f0d5453c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1411 microversion: 2.1 time: 0.092460 Oct 27 18:59:08.533674 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1685/3227] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:08 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:08.544859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d333f1f-75a7-408c-86bb-0578b420fd0b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:08.561461 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d333f1f-75a7-408c-86bb-0578b420fd0b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1522 microversion: 2.1 time: 1.028823 Oct 27 18:59:08.563719 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1543/3228] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:07 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1522 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:08.661542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-65518563-4bab-482e-8836-83f4051d786d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:08.662254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-65518563-4bab-482e-8836-83f4051d786d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:08.689616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65518563-4bab-482e-8836-83f4051d786d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:08.692455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65518563-4bab-482e-8836-83f4051d786d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:08.693181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65518563-4bab-482e-8836-83f4051d786d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:08.697585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65518563-4bab-482e-8836-83f4051d786d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:08.699994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65518563-4bab-482e-8836-83f4051d786d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:08.708679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65518563-4bab-482e-8836-83f4051d786d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:09.079809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-65518563-4bab-482e-8836-83f4051d786d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:09.089289 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-65518563-4bab-482e-8836-83f4051d786d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.433772 Oct 27 18:59:09.089877 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1686/3229] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:08 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:09.452012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a94fbbdf-e4e4-4d5f-bf3e-e2cf4d45f757 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:09.453061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a94fbbdf-e4e4-4d5f-bf3e-e2cf4d45f757 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:09.468859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a94fbbdf-e4e4-4d5f-bf3e-e2cf4d45f757 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:09.472119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a94fbbdf-e4e4-4d5f-bf3e-e2cf4d45f757 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:09.473028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a94fbbdf-e4e4-4d5f-bf3e-e2cf4d45f757 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:09.475052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a94fbbdf-e4e4-4d5f-bf3e-e2cf4d45f757 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:09.477901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a94fbbdf-e4e4-4d5f-bf3e-e2cf4d45f757 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:09.478638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a94fbbdf-e4e4-4d5f-bf3e-e2cf4d45f757 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:09.541225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8b266c4d-7f13-4502-b385-bd89abbad099 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b292ee0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:09.637488 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8b266c4d-7f13-4502-b385-bd89abbad099 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1411 microversion: 2.1 time: 0.099868 Oct 27 18:59:09.652125 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1687/3230] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:09 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:09.663620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9075dd31-6608-4d3f-a4dc-081405b81fe0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:09.664945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9075dd31-6608-4d3f-a4dc-081405b81fe0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:09.681461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:09.693081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9075dd31-6608-4d3f-a4dc-081405b81fe0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:09.694822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9075dd31-6608-4d3f-a4dc-081405b81fe0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:09.695439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9075dd31-6608-4d3f-a4dc-081405b81fe0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:09.697651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9075dd31-6608-4d3f-a4dc-081405b81fe0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:09.698488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9075dd31-6608-4d3f-a4dc-081405b81fe0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:09.699777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9075dd31-6608-4d3f-a4dc-081405b81fe0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:10.039438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9075dd31-6608-4d3f-a4dc-081405b81fe0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:10.060959 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9075dd31-6608-4d3f-a4dc-081405b81fe0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1522 microversion: 2.1 time: 0.406249 Oct 27 18:59:10.061932 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1688/3231] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:09 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:10.073522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-67ee6ed7-bcf4-49a8-8ed4-2846d985286c req-82f50e54-1b94-4ba4-bfe8-49ade4dce150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f", "name": "network-vif-plugged", "status": "completed", "tag": "d04a7167-51a8-4ece-aedc-77994439aa42"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:10.099733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-67ee6ed7-bcf4-49a8-8ed4-2846d985286c req-82f50e54-1b94-4ba4-bfe8-49ade4dce150 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:10.103237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-67ee6ed7-bcf4-49a8-8ed4-2846d985286c req-82f50e54-1b94-4ba4-bfe8-49ade4dce150 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:10.103813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-67ee6ed7-bcf4-49a8-8ed4-2846d985286c req-82f50e54-1b94-4ba4-bfe8-49ade4dce150 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:10.142567 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-67ee6ed7-bcf4-49a8-8ed4-2846d985286c req-82f50e54-1b94-4ba4-bfe8-49ade4dce150 service nova] Creating event network-vif-plugged:d04a7167-51a8-4ece-aedc-77994439aa42 for instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f on n-h2-860687-3 Oct 27 18:59:10.163957 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-67ee6ed7-bcf4-49a8-8ed4-2846d985286c req-82f50e54-1b94-4ba4-bfe8-49ade4dce150 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100260 Oct 27 18:59:10.167166 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1689/3232] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:10.181714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ac8fc0b4-d544-4eef-86a5-476380bd1e39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:10.183354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ac8fc0b4-d544-4eef-86a5-476380bd1e39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:10.198781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac8fc0b4-d544-4eef-86a5-476380bd1e39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:10.201269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac8fc0b4-d544-4eef-86a5-476380bd1e39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:10.204146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac8fc0b4-d544-4eef-86a5-476380bd1e39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:10.205321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac8fc0b4-d544-4eef-86a5-476380bd1e39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:10.206046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac8fc0b4-d544-4eef-86a5-476380bd1e39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:10.206779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac8fc0b4-d544-4eef-86a5-476380bd1e39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:10.381020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a94fbbdf-e4e4-4d5f-bf3e-e2cf4d45f757 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:10.394499 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a94fbbdf-e4e4-4d5f-bf3e-e2cf4d45f757 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1509 microversion: 2.1 time: 0.948466 Oct 27 18:59:10.414149 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1544/3233] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:09 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1509 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:10.653485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a5c88014-cdd9-4ae1-9ae5-3a18fc51d6a0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b192040>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:10.696448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ac8fc0b4-d544-4eef-86a5-476380bd1e39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:10.718795 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ac8fc0b4-d544-4eef-86a5-476380bd1e39 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.544714 Oct 27 18:59:10.754130 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1690/3234] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:10 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:10.811548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-69d8ffce-accf-4fd5-a491-8ef6c4cee36a req-d91ef18b-4f3a-4e0f-9804-b31ae339e8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6ce120-4829-4180-9293-592f8e20e233", "name": "network-vif-deleted", "tag": "b92235b2-2236-4871-b34f-af9a42350bb5"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:10.829646 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a5c88014-cdd9-4ae1-9ae5-3a18fc51d6a0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1411 microversion: 2.1 time: 0.180189 Oct 27 18:59:10.831982 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1545/3235] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:10 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1411 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:10.848671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-69d8ffce-accf-4fd5-a491-8ef6c4cee36a req-d91ef18b-4f3a-4e0f-9804-b31ae339e8f9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:10.851625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-69d8ffce-accf-4fd5-a491-8ef6c4cee36a req-d91ef18b-4f3a-4e0f-9804-b31ae339e8f9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:10.852249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-69d8ffce-accf-4fd5-a491-8ef6c4cee36a req-d91ef18b-4f3a-4e0f-9804-b31ae339e8f9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:10.909056 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-69d8ffce-accf-4fd5-a491-8ef6c4cee36a req-d91ef18b-4f3a-4e0f-9804-b31ae339e8f9 service nova] Creating event network-vif-deleted:b92235b2-2236-4871-b34f-af9a42350bb5 for instance ca6ce120-4829-4180-9293-592f8e20e233 on n-h2-860687-3 Oct 27 18:59:10.924882 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-69d8ffce-accf-4fd5-a491-8ef6c4cee36a req-d91ef18b-4f3a-4e0f-9804-b31ae339e8f9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118273 Oct 27 18:59:10.936275 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1691/3236] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:59:11.087167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd19805d-44e0-4cad-95b1-4884377f5b6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:11.087936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dd19805d-44e0-4cad-95b1-4884377f5b6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:11.140910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd19805d-44e0-4cad-95b1-4884377f5b6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:11.145729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd19805d-44e0-4cad-95b1-4884377f5b6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:11.146198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd19805d-44e0-4cad-95b1-4884377f5b6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:11.147686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd19805d-44e0-4cad-95b1-4884377f5b6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:11.148705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd19805d-44e0-4cad-95b1-4884377f5b6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:11.149344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd19805d-44e0-4cad-95b1-4884377f5b6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:11.442888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9aab4b79-3db8-4e56-9eb4-d25c3bb9d631 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:11.443916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9aab4b79-3db8-4e56-9eb4-d25c3bb9d631 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:11.467366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aab4b79-3db8-4e56-9eb4-d25c3bb9d631 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:11.470888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aab4b79-3db8-4e56-9eb4-d25c3bb9d631 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:11.471623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aab4b79-3db8-4e56-9eb4-d25c3bb9d631 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:11.472498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aab4b79-3db8-4e56-9eb4-d25c3bb9d631 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:11.479563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aab4b79-3db8-4e56-9eb4-d25c3bb9d631 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:11.480152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aab4b79-3db8-4e56-9eb4-d25c3bb9d631 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:11.612150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aab4b79-3db8-4e56-9eb4-d25c3bb9d631 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:11.613082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aab4b79-3db8-4e56-9eb4-d25c3bb9d631 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:11.613851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aab4b79-3db8-4e56-9eb4-d25c3bb9d631 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:11.614576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-9aab4b79-3db8-4e56-9eb4-d25c3bb9d631 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lazy-loading 'fault' on Instance uuid ca6ce120-4829-4180-9293-592f8e20e233 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:59:11.971394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9aab4b79-3db8-4e56-9eb4-d25c3bb9d631 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82ef1f08fe443bba07e83198686660c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356a8b83ed843079eca7a548b68da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:11.983622 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9aab4b79-3db8-4e56-9eb4-d25c3bb9d631 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 200 len: 1313 microversion: 2.1 time: 0.553936 Oct 27 18:59:11.984255 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1692/3237] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:11 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:12.016792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fb340edb-f0d8-4698-a9de-b182b2c5ada5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:12.017439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fb340edb-f0d8-4698-a9de-b182b2c5ada5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:12.046991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb340edb-f0d8-4698-a9de-b182b2c5ada5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:12.047866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb340edb-f0d8-4698-a9de-b182b2c5ada5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:12.048264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb340edb-f0d8-4698-a9de-b182b2c5ada5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:12.048936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb340edb-f0d8-4698-a9de-b182b2c5ada5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:12.049411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb340edb-f0d8-4698-a9de-b182b2c5ada5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:12.049854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb340edb-f0d8-4698-a9de-b182b2c5ada5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:12.525470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fb340edb-f0d8-4698-a9de-b182b2c5ada5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:12.536843 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fb340edb-f0d8-4698-a9de-b182b2c5ada5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.551477 Oct 27 18:59:12.541098 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1693/3238] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:11 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:12.555055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-27219502-bbf5-4897-a14a-d5f45506ae36 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86aae08b0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:12.650169 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-27219502-bbf5-4897-a14a-d5f45506ae36 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1411 microversion: 2.1 time: 0.107675 Oct 27 18:59:12.651013 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1694/3239] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:12 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1411 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:12.700747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dd19805d-44e0-4cad-95b1-4884377f5b6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:12.717980 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dd19805d-44e0-4cad-95b1-4884377f5b6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1522 microversion: 2.1 time: 1.635060 Oct 27 18:59:12.733828 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1546/3240] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:11 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1522 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:13.010616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-182cb4d5-1b26-44e6-aa1d-d7e7df4395a8 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:13.011451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-182cb4d5-1b26-44e6-aa1d-d7e7df4395a8 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] [instance: ca6ce120-4829-4180-9293-592f8e20e233] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:13.027686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-182cb4d5-1b26-44e6-aa1d-d7e7df4395a8 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:13.028626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-182cb4d5-1b26-44e6-aa1d-d7e7df4395a8 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:13.030004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-182cb4d5-1b26-44e6-aa1d-d7e7df4395a8 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:13.031110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-182cb4d5-1b26-44e6-aa1d-d7e7df4395a8 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:13.034781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-182cb4d5-1b26-44e6-aa1d-d7e7df4395a8 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:13.035610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-182cb4d5-1b26-44e6-aa1d-d7e7df4395a8 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:13.073149 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-182cb4d5-1b26-44e6-aa1d-d7e7df4395a8 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] HTTP exception thrown: Instance ca6ce120-4829-4180-9293-592f8e20e233 could not be found. Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-182cb4d5-1b26-44e6-aa1d-d7e7df4395a8 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Request method failure captured: Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 HTTP/1.1 Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtSjm6owufohorX8TdxuKBt2vA-46HCrkTApKHmrxIF8gp-p-6aK27A38sRmiEdnQoHRFgOTQc-L7icJUE2UrUUFi0xyBkQjoYgrsvFGRjXRVLgRXAivsdUdx2Omy7qbjBysm4CAyqqMi-hVMGblJBsll3Y3R0THG3UXHJPFw91Lg2g Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f356a8b83ed843079eca7a548b68da1a Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1454157587 Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f356a8b83ed843079eca7a548b68da1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f356a8b83ed843079eca7a548b68da1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f356a8b83ed843079eca7a548b68da1a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f356a8b83ed843079eca7a548b68da1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1454157587 Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f356a8b83ed843079eca7a548b68da1a Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1454157587 Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerRescueTestJSONUnderV235-1454157587-project Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: f82ef1f08fe443bba07e83198686660c Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1454157587-project Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance ca6ce120-4829-4180-9293-592f8e20e233 could not be found. Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'ca6ce120-4829-4180-9293-592f8e20e233'} Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca6ce120-4829-4180-9293-592f8e20e233 could not be found. Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca6ce120-4829-4180-9293-592f8e20e233 could not be found. Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:59:13.079075 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:59:13.085200 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:59:13.085200 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:59:13.085200 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:59:13.085200 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:59:13.085200 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:59:13.085200 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:59:13.085200 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca6ce120-4829-4180-9293-592f8e20e233 could not be found. Oct 27 18:59:13.085200 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:59:13.085200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-182cb4d5-1b26-44e6-aa1d-d7e7df4395a8 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] Returning 404 to user: Instance ca6ce120-4829-4180-9293-592f8e20e233 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:59:13.085200 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-182cb4d5-1b26-44e6-aa1d-d7e7df4395a8 tempest-ServerRescueTestJSONUnderV235-1454157587 tempest-ServerRescueTestJSONUnderV235-1454157587-project] 10.222.0.42 "GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233" status: 404 len: 111 microversion: 2.1 time: 0.078422 Oct 27 18:59:13.089831 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1695/3241] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:13 2022] GET /compute/v2.1/servers/ca6ce120-4829-4180-9293-592f8e20e233 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:59:13.569442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-59f7b5b1-d740-4659-9a8b-d244ed4db2fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:13.570402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-59f7b5b1-d740-4659-9a8b-d244ed4db2fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:13.594852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59f7b5b1-d740-4659-9a8b-d244ed4db2fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:13.595633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59f7b5b1-d740-4659-9a8b-d244ed4db2fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:13.596301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59f7b5b1-d740-4659-9a8b-d244ed4db2fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:13.597375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59f7b5b1-d740-4659-9a8b-d244ed4db2fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:13.598096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59f7b5b1-d740-4659-9a8b-d244ed4db2fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:13.598778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59f7b5b1-d740-4659-9a8b-d244ed4db2fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:13.668117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-df3ecac0-5594-4452-9c84-2c5aa882e53e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86aae0dc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:13.751747 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-df3ecac0-5594-4452-9c84-2c5aa882e53e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1411 microversion: 2.1 time: 0.080502 Oct 27 18:59:13.752404 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1696/3242] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:13 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:59:13.780411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e92491d-4639-4902-acdb-b9e022b75aea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:13.795702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6e92491d-4639-4902-acdb-b9e022b75aea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:13.838754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e92491d-4639-4902-acdb-b9e022b75aea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:13.842092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e92491d-4639-4902-acdb-b9e022b75aea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:13.843207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e92491d-4639-4902-acdb-b9e022b75aea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:13.845453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e92491d-4639-4902-acdb-b9e022b75aea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:13.847453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e92491d-4639-4902-acdb-b9e022b75aea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:13.848916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e92491d-4639-4902-acdb-b9e022b75aea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:14.388029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-59f7b5b1-d740-4659-9a8b-d244ed4db2fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:14.421048 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-59f7b5b1-d740-4659-9a8b-d244ed4db2fd tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.849936 Oct 27 18:59:14.432889 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1547/3243] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:13 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:14.502530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-834195774", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2cfbe0bf-f6fb-46ad-9a6c-606f41f6cc6f"}], "security_groups": [{"name": "tempest-securitygroup--1619846570"}], "key_name": "tempest-keypair-2045009007", "user_data": "}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:14.632619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6e92491d-4639-4902-acdb-b9e022b75aea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:14.646104 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6e92491d-4639-4902-acdb-b9e022b75aea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1522 microversion: 2.1 time: 0.886039 Oct 27 18:59:14.650888 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1697/3244] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:13 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1522 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:14.768410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] validate_networks() for [('2cfbe0bf-f6fb-46ad-9a6c-606f41f6cc6f', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:59:14.768631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-20eefbc6-4e60-4725-b098-c512e55087e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86adbf0d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:14.917225 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-20eefbc6-4e60-4725-b098-c512e55087e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1411 microversion: 2.1 time: 0.152991 Oct 27 18:59:14.917922 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1698/3245] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:14 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1411 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:59:15.446281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6cfd1aa3-a90f-43b2-879b-91221d5da55d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:15.446954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6cfd1aa3-a90f-43b2-879b-91221d5da55d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:15.485774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cfd1aa3-a90f-43b2-879b-91221d5da55d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:15.486715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cfd1aa3-a90f-43b2-879b-91221d5da55d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:15.488065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cfd1aa3-a90f-43b2-879b-91221d5da55d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:15.488873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cfd1aa3-a90f-43b2-879b-91221d5da55d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:15.489356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cfd1aa3-a90f-43b2-879b-91221d5da55d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:15.489807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6cfd1aa3-a90f-43b2-879b-91221d5da55d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:16.153304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:59:16.154637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:59:16.155315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:59:16.155897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:59:16.156652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:59:16.178347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:16.179145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:16.187129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:16.188256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:16.188898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:16.189496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:16.243866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:59:16.265335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for user 2be49f7bea7a4c8fbf289594e635fd69 and project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:59:16.301883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:59:16.304512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:59:16.435860 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3e919485-8fea-4f16-bb47-683f8fd14ba3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.938853 Oct 27 18:59:16.438102 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1548/3246] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:59:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:59:16.459017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bde358e5-e2cb-4a22-824b-74adef8ac34f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:16.463680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bde358e5-e2cb-4a22-824b-74adef8ac34f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:16.481037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde358e5-e2cb-4a22-824b-74adef8ac34f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:16.483583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde358e5-e2cb-4a22-824b-74adef8ac34f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:16.484493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde358e5-e2cb-4a22-824b-74adef8ac34f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:16.485524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde358e5-e2cb-4a22-824b-74adef8ac34f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:16.486218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde358e5-e2cb-4a22-824b-74adef8ac34f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:16.487041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde358e5-e2cb-4a22-824b-74adef8ac34f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:16.665895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6cfd1aa3-a90f-43b2-879b-91221d5da55d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:16.690453 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6cfd1aa3-a90f-43b2-879b-91221d5da55d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 1.243594 Oct 27 18:59:16.694163 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1699/3247] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:15 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:59:16.721112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6a586af-1f1f-4a4d-8585-d8581bfc02ea tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b971ca0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:16.984918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bde358e5-e2cb-4a22-824b-74adef8ac34f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:17.000602 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bde358e5-e2cb-4a22-824b-74adef8ac34f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1522 microversion: 2.1 time: 0.560855 Oct 27 18:59:17.016432 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1549/3248] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:16 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:17.028304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-787dd76e-a0c0-4f37-9aee-9aa21766f90d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:17.029258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-787dd76e-a0c0-4f37-9aee-9aa21766f90d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:17.173864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-787dd76e-a0c0-4f37-9aee-9aa21766f90d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:17.193818 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-787dd76e-a0c0-4f37-9aee-9aa21766f90d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1241 microversion: 2.1 time: 0.172367 Oct 27 18:59:17.196997 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1550/3249] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:17 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1241 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:17.727162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8727038c-38bb-40d7-ac17-63ca9071c665 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:17.732089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8727038c-38bb-40d7-ac17-63ca9071c665 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:17.819041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8727038c-38bb-40d7-ac17-63ca9071c665 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:17.820657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8727038c-38bb-40d7-ac17-63ca9071c665 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:17.821128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8727038c-38bb-40d7-ac17-63ca9071c665 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:17.823202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8727038c-38bb-40d7-ac17-63ca9071c665 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:17.842671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8727038c-38bb-40d7-ac17-63ca9071c665 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:17.846050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8727038c-38bb-40d7-ac17-63ca9071c665 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:18.212207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8727038c-38bb-40d7-ac17-63ca9071c665 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:18.223712 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8727038c-38bb-40d7-ac17-63ca9071c665 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.504454 Oct 27 18:59:18.237596 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1551/3250] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:17 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:18.243399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f356041a-7b75-428a-af1d-5db500054114 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:18.244808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f356041a-7b75-428a-af1d-5db500054114 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:18.263007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f356041a-7b75-428a-af1d-5db500054114 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:18.280818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f356041a-7b75-428a-af1d-5db500054114 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:18.284403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f356041a-7b75-428a-af1d-5db500054114 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:18.285426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f356041a-7b75-428a-af1d-5db500054114 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:18.286074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f356041a-7b75-428a-af1d-5db500054114 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:18.286731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f356041a-7b75-428a-af1d-5db500054114 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:18.368069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:19.027252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f356041a-7b75-428a-af1d-5db500054114 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:19.061818 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f356041a-7b75-428a-af1d-5db500054114 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1522 microversion: 2.1 time: 0.816310 Oct 27 18:59:19.082871 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1552/3251] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:18 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1522 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:19.095583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b4591d37-c3da-4957-9c5e-1968c74f0cb9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:19.099476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b4591d37-c3da-4957-9c5e-1968c74f0cb9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:19.125046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4591d37-c3da-4957-9c5e-1968c74f0cb9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:19.128465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4591d37-c3da-4957-9c5e-1968c74f0cb9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:19.133164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4591d37-c3da-4957-9c5e-1968c74f0cb9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:19.134294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4591d37-c3da-4957-9c5e-1968c74f0cb9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:19.137096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4591d37-c3da-4957-9c5e-1968c74f0cb9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:19.141123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4591d37-c3da-4957-9c5e-1968c74f0cb9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:19.710921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b4591d37-c3da-4957-9c5e-1968c74f0cb9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:19.724936 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b4591d37-c3da-4957-9c5e-1968c74f0cb9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1301 microversion: 2.1 time: 0.637705 Oct 27 18:59:19.725903 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1553/3252] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:19 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1301 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:19.743630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ef96dd3-8cb1-4acf-981b-ad31deba8aa6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:19.751589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ef96dd3-8cb1-4acf-981b-ad31deba8aa6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:19.792742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ef96dd3-8cb1-4acf-981b-ad31deba8aa6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:19.802071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ef96dd3-8cb1-4acf-981b-ad31deba8aa6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:19.805944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ef96dd3-8cb1-4acf-981b-ad31deba8aa6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:19.807012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ef96dd3-8cb1-4acf-981b-ad31deba8aa6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:19.816559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ef96dd3-8cb1-4acf-981b-ad31deba8aa6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:19.817381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ef96dd3-8cb1-4acf-981b-ad31deba8aa6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:20.726440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ef96dd3-8cb1-4acf-981b-ad31deba8aa6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:20.749417 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ef96dd3-8cb1-4acf-981b-ad31deba8aa6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 1.018684 Oct 27 18:59:20.750115 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1554/3253] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:19 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:20.762320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-67527bf8-68af-412b-a07d-28ee73384701 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:20.767273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-67527bf8-68af-412b-a07d-28ee73384701 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:20.785120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67527bf8-68af-412b-a07d-28ee73384701 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:20.785697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67527bf8-68af-412b-a07d-28ee73384701 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:20.786071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67527bf8-68af-412b-a07d-28ee73384701 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:20.786823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67527bf8-68af-412b-a07d-28ee73384701 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:20.787297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67527bf8-68af-412b-a07d-28ee73384701 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:20.787735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67527bf8-68af-412b-a07d-28ee73384701 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:21.305746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-67527bf8-68af-412b-a07d-28ee73384701 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:21.322949 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-67527bf8-68af-412b-a07d-28ee73384701 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1522 microversion: 2.1 time: 0.571621 Oct 27 18:59:21.325205 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1555/3254] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:20 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1522 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:21.353009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0be42792-fd13-4828-b139-a37322b7233b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:21.358133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0be42792-fd13-4828-b139-a37322b7233b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:21.385359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0be42792-fd13-4828-b139-a37322b7233b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:21.388572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0be42792-fd13-4828-b139-a37322b7233b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:21.392161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0be42792-fd13-4828-b139-a37322b7233b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:21.393133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0be42792-fd13-4828-b139-a37322b7233b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:21.396887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0be42792-fd13-4828-b139-a37322b7233b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:21.397889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0be42792-fd13-4828-b139-a37322b7233b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:21.660918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0be42792-fd13-4828-b139-a37322b7233b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:21.670892 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0be42792-fd13-4828-b139-a37322b7233b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1299 microversion: 2.1 time: 0.341284 Oct 27 18:59:21.683501 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1556/3255] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:21 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1299 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:21.778084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-47e22ad7-be64-4a31-acf4-c044b4ca6e05 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:21.778989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-47e22ad7-be64-4a31-acf4-c044b4ca6e05 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:21.791261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47e22ad7-be64-4a31-acf4-c044b4ca6e05 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:21.803202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47e22ad7-be64-4a31-acf4-c044b4ca6e05 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:21.809613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47e22ad7-be64-4a31-acf4-c044b4ca6e05 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:21.810424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47e22ad7-be64-4a31-acf4-c044b4ca6e05 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:21.810917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47e22ad7-be64-4a31-acf4-c044b4ca6e05 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:21.811364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47e22ad7-be64-4a31-acf4-c044b4ca6e05 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:22.927254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-47e22ad7-be64-4a31-acf4-c044b4ca6e05 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:22.950686 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-47e22ad7-be64-4a31-acf4-c044b4ca6e05 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 1.174075 Oct 27 18:59:22.953310 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1557/3256] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:21 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:59:22.970187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2deb51e5-996c-4dd1-bc82-688cd5b795b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:22.971167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2deb51e5-996c-4dd1-bc82-688cd5b795b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:23.021853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2deb51e5-996c-4dd1-bc82-688cd5b795b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:23.022882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2deb51e5-996c-4dd1-bc82-688cd5b795b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:23.024252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2deb51e5-996c-4dd1-bc82-688cd5b795b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:23.026748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2deb51e5-996c-4dd1-bc82-688cd5b795b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:23.028428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2deb51e5-996c-4dd1-bc82-688cd5b795b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:23.029090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2deb51e5-996c-4dd1-bc82-688cd5b795b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:24.513469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2deb51e5-996c-4dd1-bc82-688cd5b795b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:24.523770 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2deb51e5-996c-4dd1-bc82-688cd5b795b8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1522 microversion: 2.1 time: 1.566051 Oct 27 18:59:24.535487 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1558/3257] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:22 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1522 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:24.552473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d4519b3-b48e-41cd-b7c8-16c9bdc0463d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:24.553455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d4519b3-b48e-41cd-b7c8-16c9bdc0463d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:24.592351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d4519b3-b48e-41cd-b7c8-16c9bdc0463d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:24.594149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d4519b3-b48e-41cd-b7c8-16c9bdc0463d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:24.594887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d4519b3-b48e-41cd-b7c8-16c9bdc0463d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:24.595884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d4519b3-b48e-41cd-b7c8-16c9bdc0463d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:24.596578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d4519b3-b48e-41cd-b7c8-16c9bdc0463d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:24.597255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d4519b3-b48e-41cd-b7c8-16c9bdc0463d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:25.483253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=19 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:26.203475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:26.219332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d4519b3-b48e-41cd-b7c8-16c9bdc0463d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:26.237539 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d4519b3-b48e-41cd-b7c8-16c9bdc0463d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1367 microversion: 2.1 time: 1.699794 Oct 27 18:59:26.254705 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1559/3258] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:24 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1367 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:26.260386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-111588e7-f5fe-4410-98ba-aee83a2ab7d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:26.261556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-111588e7-f5fe-4410-98ba-aee83a2ab7d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:26.270339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-111588e7-f5fe-4410-98ba-aee83a2ab7d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:26.271515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-111588e7-f5fe-4410-98ba-aee83a2ab7d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:26.272484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-111588e7-f5fe-4410-98ba-aee83a2ab7d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:26.273446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-111588e7-f5fe-4410-98ba-aee83a2ab7d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:26.274097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-111588e7-f5fe-4410-98ba-aee83a2ab7d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:26.274889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-111588e7-f5fe-4410-98ba-aee83a2ab7d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:26.679138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=62 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:27.042412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-111588e7-f5fe-4410-98ba-aee83a2ab7d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:27.070935 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-111588e7-f5fe-4410-98ba-aee83a2ab7d5 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.814967 Oct 27 18:59:27.084643 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1560/3259] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:26 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:27.141727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-09f5938f-662c-4aa0-b085-a82290e829eb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:27.143899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-09f5938f-662c-4aa0-b085-a82290e829eb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:27.179169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09f5938f-662c-4aa0-b085-a82290e829eb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:27.180870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09f5938f-662c-4aa0-b085-a82290e829eb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:27.183965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09f5938f-662c-4aa0-b085-a82290e829eb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:27.185942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09f5938f-662c-4aa0-b085-a82290e829eb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:27.187875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09f5938f-662c-4aa0-b085-a82290e829eb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:27.196690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09f5938f-662c-4aa0-b085-a82290e829eb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:27.197516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=12 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:28.071793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-09f5938f-662c-4aa0-b085-a82290e829eb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:28.093011 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-09f5938f-662c-4aa0-b085-a82290e829eb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1502 microversion: 2.1 time: 0.985002 Oct 27 18:59:28.117270 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1561/3260] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:27 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1502 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:28.152645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6edb74a2-9a09-4a50-a74b-c7c6069eb7cb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:28.159477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6edb74a2-9a09-4a50-a74b-c7c6069eb7cb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:28.211612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6edb74a2-9a09-4a50-a74b-c7c6069eb7cb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:28.212116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6edb74a2-9a09-4a50-a74b-c7c6069eb7cb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:28.212566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6edb74a2-9a09-4a50-a74b-c7c6069eb7cb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:28.213289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6edb74a2-9a09-4a50-a74b-c7c6069eb7cb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:28.225750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6edb74a2-9a09-4a50-a74b-c7c6069eb7cb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:28.229898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6edb74a2-9a09-4a50-a74b-c7c6069eb7cb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:28.885259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6edb74a2-9a09-4a50-a74b-c7c6069eb7cb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:28.909194 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6edb74a2-9a09-4a50-a74b-c7c6069eb7cb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1367 microversion: 2.1 time: 0.781223 Oct 27 18:59:28.909817 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1562/3261] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:28 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1367 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:28.939054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d97a73d8-60d5-4959-8839-6ac067edebff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:28.940373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d97a73d8-60d5-4959-8839-6ac067edebff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:28.970745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d97a73d8-60d5-4959-8839-6ac067edebff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:28.974891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d97a73d8-60d5-4959-8839-6ac067edebff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:28.975426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d97a73d8-60d5-4959-8839-6ac067edebff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:28.982808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d97a73d8-60d5-4959-8839-6ac067edebff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:28.983346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d97a73d8-60d5-4959-8839-6ac067edebff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:28.987310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d97a73d8-60d5-4959-8839-6ac067edebff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:29.716158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d97a73d8-60d5-4959-8839-6ac067edebff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:29.724960 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d97a73d8-60d5-4959-8839-6ac067edebff tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1719 microversion: 2.1 time: 0.807183 Oct 27 18:59:29.752144 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1563/3262] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:28 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1719 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:29.758647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-abfb9105-8b2a-41f4-bd5a-90c4e0e87e65 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:29.759507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-abfb9105-8b2a-41f4-bd5a-90c4e0e87e65 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:29.766891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abfb9105-8b2a-41f4-bd5a-90c4e0e87e65 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:29.767668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abfb9105-8b2a-41f4-bd5a-90c4e0e87e65 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:29.768310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abfb9105-8b2a-41f4-bd5a-90c4e0e87e65 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:29.769213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abfb9105-8b2a-41f4-bd5a-90c4e0e87e65 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:29.769846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abfb9105-8b2a-41f4-bd5a-90c4e0e87e65 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:29.770660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abfb9105-8b2a-41f4-bd5a-90c4e0e87e65 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:30.449857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-abfb9105-8b2a-41f4-bd5a-90c4e0e87e65 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:30.470439 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-abfb9105-8b2a-41f4-bd5a-90c4e0e87e65 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1517 microversion: 2.1 time: 0.714861 Oct 27 18:59:30.476560 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1564/3263] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:29 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1517 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:30.838659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1c97adc9-7346-4c12-8b00-e1412e5a9b6e tempest-ExtensionsTest-1086971354 tempest-ExtensionsTest-1086971354-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:30.842845 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1c97adc9-7346-4c12-8b00-e1412e5a9b6e tempest-ExtensionsTest-1086971354 tempest-ExtensionsTest-1086971354-project] 10.222.0.42 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.363364 Oct 27 18:59:30.854865 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1565/3264] 10.222.0.42 () {58 vars in 1170 bytes} [Thu Oct 27 18:59:30 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:30.877772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-de5f3273-7b3d-4865-bdbe-bdc929e1875f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:30.878263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-de5f3273-7b3d-4865-bdbe-bdc929e1875f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:30.909614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de5f3273-7b3d-4865-bdbe-bdc929e1875f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:30.913485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de5f3273-7b3d-4865-bdbe-bdc929e1875f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:30.916655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de5f3273-7b3d-4865-bdbe-bdc929e1875f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:30.924053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de5f3273-7b3d-4865-bdbe-bdc929e1875f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:30.925005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de5f3273-7b3d-4865-bdbe-bdc929e1875f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:30.925640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de5f3273-7b3d-4865-bdbe-bdc929e1875f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:31.744023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-de5f3273-7b3d-4865-bdbe-bdc929e1875f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:31.753105 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-de5f3273-7b3d-4865-bdbe-bdc929e1875f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1367 microversion: 2.1 time: 0.896383 Oct 27 18:59:31.753710 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1566/3265] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:30 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1367 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:31.785135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3c671bae-6fb1-46a2-a3d4-e90753a9175a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:31.789707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3c671bae-6fb1-46a2-a3d4-e90753a9175a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: f233696d-af23-46ef-8780-d7300120f68b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:31.812915 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-3c671bae-6fb1-46a2-a3d4-e90753a9175a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] HTTP exception thrown: Instance f233696d-af23-46ef-8780-d7300120f68b could not be found. Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3c671bae-6fb1-46a2-a3d4-e90753a9175a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Request method failure captured: Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/f233696d-af23-46ef-8780-d7300120f68b/action HTTP/1.1 Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 14 Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtTOhZ4eSrUIbh7FOH8abPh8o6s1SrCC6rl-rUyuXuq1ygfePdb0jYAcyGuJrVudmd8OxoZzpYzhODw3ejjYW0-ti5IZ9xJMsPzlMbC7OoicnuCUnW_JwGkg6OKXbZMBkqYeQENn4eoxSAgVgRaELA_KPYJgZbVCfoUL02eTSzGcONI Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_adeacece438645c4a0c5844d1ef83793", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2b706e9394a642cda315809db15ecbb3 Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: {"rescue": {}} Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance f233696d-af23-46ef-8780-d7300120f68b could not be found. Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'f233696d-af23-46ef-8780-d7300120f68b', 'body': {'rescue': {}}} Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f233696d-af23-46ef-8780-d7300120f68b could not be found. Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f233696d-af23-46ef-8780-d7300120f68b could not be found. Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:59:31.829444 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:59:31.835091 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:59:31.835091 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:59:31.835091 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:59:31.835091 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:59:31.835091 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f233696d-af23-46ef-8780-d7300120f68b could not be found. Oct 27 18:59:31.835091 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:59:31.837163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3c671bae-6fb1-46a2-a3d4-e90753a9175a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Returning 404 to user: Instance f233696d-af23-46ef-8780-d7300120f68b could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:59:31.838936 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3c671bae-6fb1-46a2-a3d4-e90753a9175a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers/f233696d-af23-46ef-8780-d7300120f68b/action" status: 404 len: 111 microversion: 2.1 time: 0.078705 Oct 27 18:59:31.846581 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1567/3266] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:59:31 2022] POST /compute/v2.1/servers/f233696d-af23-46ef-8780-d7300120f68b/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:59:31.853106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-34c53281-ecbb-4674-857e-43e2f29c0a24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:31.853731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-34c53281-ecbb-4674-857e-43e2f29c0a24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:31.893038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34c53281-ecbb-4674-857e-43e2f29c0a24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:31.894620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34c53281-ecbb-4674-857e-43e2f29c0a24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:31.895936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34c53281-ecbb-4674-857e-43e2f29c0a24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:31.897550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34c53281-ecbb-4674-857e-43e2f29c0a24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:31.898888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34c53281-ecbb-4674-857e-43e2f29c0a24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:31.900170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34c53281-ecbb-4674-857e-43e2f29c0a24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:32.592823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-34c53281-ecbb-4674-857e-43e2f29c0a24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:32.610700 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-34c53281-ecbb-4674-857e-43e2f29c0a24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1709 microversion: 2.1 time: 0.760482 Oct 27 18:59:32.628298 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1568/3267] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:31 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1709 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:32.644166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-486e5997-4f9b-4aba-8569-035f04fccdcc tempest-ExtensionsTest-1086971354 tempest-ExtensionsTest-1086971354-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:32.651089 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-486e5997-4f9b-4aba-8569-035f04fccdcc tempest-ExtensionsTest-1086971354 tempest-ExtensionsTest-1086971354-project] 10.222.0.42 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.021610 Oct 27 18:59:32.652373 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1569/3268] 10.222.0.42 () {58 vars in 1134 bytes} [Thu Oct 27 18:59:32 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 18:59:32.663234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f6584a80-a7dc-4d5d-89e2-35b14f3fb846 req-833eb70b-cac0-4a5d-bb27-ab149f49cde6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "673d7d02-3b01-418e-825a-8c7ccaffa820", "tag": "dc9bfd96-0979-420c-a567-d63bd7ef7915"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:32.684383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f6584a80-a7dc-4d5d-89e2-35b14f3fb846 req-833eb70b-cac0-4a5d-bb27-ab149f49cde6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:32.687601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f6584a80-a7dc-4d5d-89e2-35b14f3fb846 req-833eb70b-cac0-4a5d-bb27-ab149f49cde6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:32.688351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f6584a80-a7dc-4d5d-89e2-35b14f3fb846 req-833eb70b-cac0-4a5d-bb27-ab149f49cde6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:32.799555 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f6584a80-a7dc-4d5d-89e2-35b14f3fb846 req-833eb70b-cac0-4a5d-bb27-ab149f49cde6 service nova] Creating event network-changed:dc9bfd96-0979-420c-a567-d63bd7ef7915 for instance 673d7d02-3b01-418e-825a-8c7ccaffa820 on n-h2-860687-3 Oct 27 18:59:32.829525 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f6584a80-a7dc-4d5d-89e2-35b14f3fb846 req-833eb70b-cac0-4a5d-bb27-ab149f49cde6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175157 Oct 27 18:59:32.836304 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1570/3269] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:32.886147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-32f04ac3-6266-4ebe-b94a-e533295f8420 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:32.897480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-32f04ac3-6266-4ebe-b94a-e533295f8420 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:32.957797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32f04ac3-6266-4ebe-b94a-e533295f8420 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:32.961938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32f04ac3-6266-4ebe-b94a-e533295f8420 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:32.962694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32f04ac3-6266-4ebe-b94a-e533295f8420 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:32.969026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32f04ac3-6266-4ebe-b94a-e533295f8420 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:32.969568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32f04ac3-6266-4ebe-b94a-e533295f8420 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:32.970846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32f04ac3-6266-4ebe-b94a-e533295f8420 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:33.256131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:33.281281 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-32f04ac3-6266-4ebe-b94a-e533295f8420 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843/action" status: 202 len: 0 microversion: 2.1 time: 0.442155 Oct 27 18:59:33.285334 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1571/3270] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:59:32 2022] POST /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:59:33.602205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0db9926f-ba8e-41ba-82db-9857a0d4ccbb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Action: 'create', calling method: .version_select at 0x7fc86b273430>, body: {"keypair": {"name": "tempest-keypair-390191596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIB9KugD7luVztFp0yYwAF06qYHv1G7nRsaxVYZUE7RVhS9fooevLrWM39v3GwkdDMvha4dELfWF73vy46lo5GsycB4N55OXs5jqvVXG7PFojj0sp1jVx+lYHwwnG6o1A=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:33.653853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-0db9926f-ba8e-41ba-82db-9857a0d4ccbb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Getting quotas for project ab4798756472413683fb46917781e89f. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:59:33.671833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-0db9926f-ba8e-41ba-82db-9857a0d4ccbb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Getting quotas for user 434e7a9a50b340928126550ed66c5590 and project ab4798756472413683fb46917781e89f. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:59:33.781154 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0db9926f-ba8e-41ba-82db-9857a0d4ccbb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.492812 Oct 27 18:59:33.782409 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1572/3271] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Oct 27 18:59:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 496 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 18:59:33.814684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3a82ea9f-f04f-4c38-9956-c10dbc61a9ff tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '.version_select at 0x7fc86ae160d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:33.821602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a82ea9f-f04f-4c38-9956-c10dbc61a9ff tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:33.822546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a82ea9f-f04f-4c38-9956-c10dbc61a9ff tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:33.823411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a82ea9f-f04f-4c38-9956-c10dbc61a9ff tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:33.836926 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3a82ea9f-f04f-4c38-9956-c10dbc61a9ff tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 1170 microversion: 2.1 time: 0.052384 Oct 27 18:59:33.838264 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1573/3272] 10.222.0.42 () {58 vars in 1143 bytes} [Thu Oct 27 18:59:33 2022] GET /compute/v2.1/os-migrations => generated 1170 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:33.845464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb30490d-f1a4-4bf2-9292-e89fec1d87b4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:33.846819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb30490d-f1a4-4bf2-9292-e89fec1d87b4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:33.854206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:33.857625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb30490d-f1a4-4bf2-9292-e89fec1d87b4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:33.858648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb30490d-f1a4-4bf2-9292-e89fec1d87b4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:33.859418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb30490d-f1a4-4bf2-9292-e89fec1d87b4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:33.860568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb30490d-f1a4-4bf2-9292-e89fec1d87b4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:33.861486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb30490d-f1a4-4bf2-9292-e89fec1d87b4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:33.862204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb30490d-f1a4-4bf2-9292-e89fec1d87b4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:34.424556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-eb30490d-f1a4-4bf2-9292-e89fec1d87b4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:34.434519 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb30490d-f1a4-4bf2-9292-e89fec1d87b4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1367 microversion: 2.1 time: 0.594855 Oct 27 18:59:34.440379 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1574/3273] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:33 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1367 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:34.455891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c633b381-5725-421e-8b11-259426a9d45c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:34.456962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c633b381-5725-421e-8b11-259426a9d45c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:34.468562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c633b381-5725-421e-8b11-259426a9d45c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:34.469190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c633b381-5725-421e-8b11-259426a9d45c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:34.469673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c633b381-5725-421e-8b11-259426a9d45c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:34.477321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c633b381-5725-421e-8b11-259426a9d45c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:34.477943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c633b381-5725-421e-8b11-259426a9d45c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:34.478440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c633b381-5725-421e-8b11-259426a9d45c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:34.896861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c633b381-5725-421e-8b11-259426a9d45c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:34.993472 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c633b381-5725-421e-8b11-259426a9d45c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1502 microversion: 2.1 time: 0.550786 Oct 27 18:59:34.995162 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1575/3274] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:34 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1502 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:35.009406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9f5f6bbf-255c-4198-b39c-331e025fbadf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:35.010241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9f5f6bbf-255c-4198-b39c-331e025fbadf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:35.024697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f5f6bbf-255c-4198-b39c-331e025fbadf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:35.025625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f5f6bbf-255c-4198-b39c-331e025fbadf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:35.027962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f5f6bbf-255c-4198-b39c-331e025fbadf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:35.039209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f5f6bbf-255c-4198-b39c-331e025fbadf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:35.040104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f5f6bbf-255c-4198-b39c-331e025fbadf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:35.040584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f5f6bbf-255c-4198-b39c-331e025fbadf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:36.744565 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9f5f6bbf-255c-4198-b39c-331e025fbadf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1860 microversion: 2.1 time: 1.743705 Oct 27 18:59:36.745152 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1576/3275] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:34 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1860 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:36.763999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f4eea55c-211b-4fc2-83a3-8f748753e408 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:36.767038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f4eea55c-211b-4fc2-83a3-8f748753e408 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:36.780076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4eea55c-211b-4fc2-83a3-8f748753e408 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:36.783022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4eea55c-211b-4fc2-83a3-8f748753e408 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:36.783899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4eea55c-211b-4fc2-83a3-8f748753e408 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:36.784910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4eea55c-211b-4fc2-83a3-8f748753e408 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:36.787022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4eea55c-211b-4fc2-83a3-8f748753e408 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:36.787747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4eea55c-211b-4fc2-83a3-8f748753e408 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:36.940778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-f4eea55c-211b-4fc2-83a3-8f748753e408 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lazy-loading 'flavor' on Instance uuid fd8ee1a0-1df0-4488-bffd-1406e9762843 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:59:37.007181 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-f4eea55c-211b-4fc2-83a3-8f748753e408 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] HTTP exception thrown: Cannot 'rescue' instance fd8ee1a0-1df0-4488-bffd-1406e9762843 while it is in vm_state paused Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f4eea55c-211b-4fc2-83a3-8f748753e408 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Request method failure captured: Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843/action HTTP/1.1 Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 14 Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtTOhZ4eSrUIbh7FOH8abPh8o6s1SrCC6rl-rUyuXuq1ygfePdb0jYAcyGuJrVudmd8OxoZzpYzhODw3ejjYW0-ti5IZ9xJMsPzlMbC7OoicnuCUnW_JwGkg6OKXbZMBkqYeQENn4eoxSAgVgRaELA_KPYJgZbVCfoUL02eTSzGcONI Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_adeacece438645c4a0c5844d1ef83793", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2b706e9394a642cda315809db15ecbb3 Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: {"rescue": {}} Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: exception: Cannot 'rescue' instance fd8ee1a0-1df0-4488-bffd-1406e9762843 while it is in vm_state paused Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'fd8ee1a0-1df0-4488-bffd-1406e9762843', 'body': {'rescue': {}}} Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fd8ee1a0-1df0-4488-bffd-1406e9762843 in vm_state paused. Cannot rescue while the instance is in this state. Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance fd8ee1a0-1df0-4488-bffd-1406e9762843 while it is in vm_state paused Oct 27 18:59:37.026300 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:59:37.032261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:59:37.032261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:59:37.032261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:59:37.032261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:59:37.032261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:59:37.032261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:59:37.032261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:59:37.032261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance fd8ee1a0-1df0-4488-bffd-1406e9762843 while it is in vm_state paused Oct 27 18:59:37.032261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 18:59:37.039065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f4eea55c-211b-4fc2-83a3-8f748753e408 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Returning 409 to user: Cannot 'rescue' instance fd8ee1a0-1df0-4488-bffd-1406e9762843 while it is in vm_state paused {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:59:37.041866 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f4eea55c-211b-4fc2-83a3-8f748753e408 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843/action" status: 409 len: 144 microversion: 2.1 time: 0.291410 Oct 27 18:59:37.044379 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1577/3276] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:59:36 2022] POST /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843/action => generated 144 bytes in 299 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 18:59:37.076328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-560dff54-9847-4cb5-9a0c-d9c870090387 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:37.076983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-560dff54-9847-4cb5-9a0c-d9c870090387 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:37.098678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-560dff54-9847-4cb5-9a0c-d9c870090387 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:37.099176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-560dff54-9847-4cb5-9a0c-d9c870090387 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:37.099632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-560dff54-9847-4cb5-9a0c-d9c870090387 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:37.100377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-560dff54-9847-4cb5-9a0c-d9c870090387 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:37.106119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-560dff54-9847-4cb5-9a0c-d9c870090387 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:37.109088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-560dff54-9847-4cb5-9a0c-d9c870090387 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:37.740295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-560dff54-9847-4cb5-9a0c-d9c870090387 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:37.758524 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-560dff54-9847-4cb5-9a0c-d9c870090387 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1367 microversion: 2.1 time: 0.702659 Oct 27 18:59:37.768021 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1578/3277] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:37 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1367 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:37.987768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ad39d9a9-3ad7-4971-9cc0-383e196a6efe tempest-QuotasTestJSON-644676961 tempest-QuotasTestJSON-644676961-project] Calling method '.version_select at 0x7fc86b01adc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:38.090109 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ad39d9a9-3ad7-4971-9cc0-383e196a6efe tempest-QuotasTestJSON-644676961 tempest-QuotasTestJSON-644676961-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/d0eaff6dc99746be8c24e830301559e6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.317709 Oct 27 18:59:38.091341 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1579/3278] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 18:59:37 2022] GET /compute/v2.1/os-quota-sets/d0eaff6dc99746be8c24e830301559e6/defaults => generated 371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:38.101887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b9b6347e-3a09-4a78-ba8a-3798788c85ef tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:38.106000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b9b6347e-3a09-4a78-ba8a-3798788c85ef tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:38.141993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9b6347e-3a09-4a78-ba8a-3798788c85ef tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:38.153676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9b6347e-3a09-4a78-ba8a-3798788c85ef tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:38.154680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9b6347e-3a09-4a78-ba8a-3798788c85ef tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:38.156249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9b6347e-3a09-4a78-ba8a-3798788c85ef tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:38.157534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9b6347e-3a09-4a78-ba8a-3798788c85ef tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:38.159702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9b6347e-3a09-4a78-ba8a-3798788c85ef tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:38.623890 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b9b6347e-3a09-4a78-ba8a-3798788c85ef tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1860 microversion: 2.1 time: 0.531279 Oct 27 18:59:38.625309 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1580/3279] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:38 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1860 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:38.668644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e739662-5b72-4713-b4d0-c13bc376a5c1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:38.682823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9e739662-5b72-4713-b4d0-c13bc376a5c1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:38.711227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e739662-5b72-4713-b4d0-c13bc376a5c1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:38.712077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e739662-5b72-4713-b4d0-c13bc376a5c1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:38.713419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e739662-5b72-4713-b4d0-c13bc376a5c1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:38.714292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e739662-5b72-4713-b4d0-c13bc376a5c1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:38.715531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e739662-5b72-4713-b4d0-c13bc376a5c1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:38.716079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e739662-5b72-4713-b4d0-c13bc376a5c1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:38.929425 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9e739662-5b72-4713-b4d0-c13bc376a5c1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843/action" status: 202 len: 0 microversion: 2.1 time: 0.286811 Oct 27 18:59:38.930883 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1581/3280] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:59:38 2022] POST /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:59:38.978715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-de78f26a-5a45-4d43-b060-ed78f88902b0 tempest-QuotasTestJSON-644676961 tempest-QuotasTestJSON-644676961-project] Calling method '.version_select at 0x7fc86ae0d3a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:39.169428 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-de78f26a-5a45-4d43-b060-ed78f88902b0 tempest-QuotasTestJSON-644676961 tempest-QuotasTestJSON-644676961-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/d0eaff6dc99746be8c24e830301559e6" status: 200 len: 371 microversion: 2.1 time: 0.235647 Oct 27 18:59:39.173714 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1582/3281] 10.222.0.42 () {58 vars in 1242 bytes} [Thu Oct 27 18:59:38 2022] GET /compute/v2.1/os-quota-sets/d0eaff6dc99746be8c24e830301559e6 => generated 371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:39.189972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-409642960", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0be16ab7-102f-4dbe-a96c-e35358c95fd1"}], "security_groups": [{"name": "tempest-securitygroup--869659821"}], "key_name": "tempest-keypair-390191596", "user_data": "}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:40.567775 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c6a586af-1f1f-4a4d-8585-d8581bfc02ea tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1411 microversion: 2.1 time: 23.869827 Oct 27 18:59:40.568697 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1700/3282] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:16 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1411 bytes in 23873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:40.589638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2b766137-2a31-4163-a07a-c5dd279ad656 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:40.590516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2b766137-2a31-4163-a07a-c5dd279ad656 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:40.600342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b766137-2a31-4163-a07a-c5dd279ad656 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:40.601192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b766137-2a31-4163-a07a-c5dd279ad656 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:40.601822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b766137-2a31-4163-a07a-c5dd279ad656 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:40.603007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b766137-2a31-4163-a07a-c5dd279ad656 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:40.605736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b766137-2a31-4163-a07a-c5dd279ad656 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:40.606368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b766137-2a31-4163-a07a-c5dd279ad656 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:40.637267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] validate_networks() for [('0be16ab7-102f-4dbe-a96c-e35358c95fd1', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:59:40.778796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-2b766137-2a31-4163-a07a-c5dd279ad656 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lazy-loading 'services' on Instance uuid 69afa571-c5fa-4091-9ce1-5dd147316161 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:59:40.920493 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2b766137-2a31-4163-a07a-c5dd279ad656 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "DELETE /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments/37fdfccb-50e5-4586-9682-c7726e6ff5a7" status: 202 len: 0 microversion: 2.1 time: 0.347371 Oct 27 18:59:40.921415 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1701/3283] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 18:59:40 2022] DELETE /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments/37fdfccb-50e5-4586-9682-c7726e6ff5a7 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:59:40.954478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c35a58ab-df11-4a4d-ad6f-c79c0ad66543 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:40.956986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c35a58ab-df11-4a4d-ad6f-c79c0ad66543 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:40.978672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c35a58ab-df11-4a4d-ad6f-c79c0ad66543 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:40.979526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c35a58ab-df11-4a4d-ad6f-c79c0ad66543 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:40.980697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c35a58ab-df11-4a4d-ad6f-c79c0ad66543 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:40.981803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c35a58ab-df11-4a4d-ad6f-c79c0ad66543 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:40.986483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c35a58ab-df11-4a4d-ad6f-c79c0ad66543 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:40.987194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c35a58ab-df11-4a4d-ad6f-c79c0ad66543 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:41.240337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c35a58ab-df11-4a4d-ad6f-c79c0ad66543 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:41.263613 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c35a58ab-df11-4a4d-ad6f-c79c0ad66543 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1367 microversion: 2.1 time: 0.327153 Oct 27 18:59:41.264513 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1702/3284] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:40 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:41.276100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c72ba632-9e1b-4fb5-b0e6-bc78a5e0849c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:41.281259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c72ba632-9e1b-4fb5-b0e6-bc78a5e0849c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:41.295029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c72ba632-9e1b-4fb5-b0e6-bc78a5e0849c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:41.296779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c72ba632-9e1b-4fb5-b0e6-bc78a5e0849c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:41.300899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c72ba632-9e1b-4fb5-b0e6-bc78a5e0849c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:41.301913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c72ba632-9e1b-4fb5-b0e6-bc78a5e0849c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:41.302593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c72ba632-9e1b-4fb5-b0e6-bc78a5e0849c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:41.303234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c72ba632-9e1b-4fb5-b0e6-bc78a5e0849c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:41.426836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:59:41.427553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:59:41.428353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:59:41.428730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:59:41.429248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:59:41.469622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:41.470482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:41.475154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:41.477402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:41.478106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:41.478784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:41.545651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Getting quotas for project ab4798756472413683fb46917781e89f. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:59:41.581218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Getting quotas for user 434e7a9a50b340928126550ed66c5590 and project ab4798756472413683fb46917781e89f. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:59:41.664367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:59:41.667069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:59:41.809186 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d1db6b8-2476-467b-a6cd-5223d67af9a2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.633517 Oct 27 18:59:41.809998 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1583/3285] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 18:59:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 2635 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 18:59:41.814954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f2809c8f-334a-4333-bb44-50dc0b641533 tempest-QuotasTestJSON-644676961 tempest-QuotasTestJSON-644676961-project] Calling method '.version_select at 0x7fc86a6870d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:41.820174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c72ba632-9e1b-4fb5-b0e6-bc78a5e0849c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:41.832173 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c72ba632-9e1b-4fb5-b0e6-bc78a5e0849c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1517 microversion: 2.1 time: 0.564221 Oct 27 18:59:41.843049 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1703/3286] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:41 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1517 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:41.858625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-3d3e6bbb-217e-47e4-9be3-673bf755f9a8 req-5421050b-043b-4c11-bc79-323eaccb9e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "673d7d02-3b01-418e-825a-8c7ccaffa820", "name": "network-vif-plugged", "status": "completed", "tag": "dc9bfd96-0979-420c-a567-d63bd7ef7915"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:41.871060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3d3e6bbb-217e-47e4-9be3-673bf755f9a8 req-5421050b-043b-4c11-bc79-323eaccb9e67 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:41.871896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3d3e6bbb-217e-47e4-9be3-673bf755f9a8 req-5421050b-043b-4c11-bc79-323eaccb9e67 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:41.872577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3d3e6bbb-217e-47e4-9be3-673bf755f9a8 req-5421050b-043b-4c11-bc79-323eaccb9e67 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:41.893716 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-3d3e6bbb-217e-47e4-9be3-673bf755f9a8 req-5421050b-043b-4c11-bc79-323eaccb9e67 service nova] Creating event network-vif-plugged:dc9bfd96-0979-420c-a567-d63bd7ef7915 for instance 673d7d02-3b01-418e-825a-8c7ccaffa820 on n-h2-860687-3 Oct 27 18:59:41.900899 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-3d3e6bbb-217e-47e4-9be3-673bf755f9a8 req-5421050b-043b-4c11-bc79-323eaccb9e67 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056219 Oct 27 18:59:41.902731 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1704/3287] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:41.910811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e2a95af8-4ba1-4dd3-b40d-0f449255f82e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:41.913438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e2a95af8-4ba1-4dd3-b40d-0f449255f82e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:41.922089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2a95af8-4ba1-4dd3-b40d-0f449255f82e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:41.925388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2a95af8-4ba1-4dd3-b40d-0f449255f82e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:41.926127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2a95af8-4ba1-4dd3-b40d-0f449255f82e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:41.927473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2a95af8-4ba1-4dd3-b40d-0f449255f82e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:41.928178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2a95af8-4ba1-4dd3-b40d-0f449255f82e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:41.928849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2a95af8-4ba1-4dd3-b40d-0f449255f82e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:41.995113 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f2809c8f-334a-4333-bb44-50dc0b641533 tempest-QuotasTestJSON-644676961 tempest-QuotasTestJSON-644676961-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/d0eaff6dc99746be8c24e830301559e6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.178915 Oct 27 18:59:41.997282 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1584/3288] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 18:59:41 2022] GET /compute/v2.1/os-quota-sets/d0eaff6dc99746be8c24e830301559e6/defaults => generated 371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:42.036026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-98ce3891-d720-48e2-95ee-803c803b47d1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc87334b4c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:42.070262 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e2a95af8-4ba1-4dd3-b40d-0f449255f82e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165629 Oct 27 18:59:42.071936 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1705/3289] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:59:41 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:42.085592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-020ae3d2-61ca-4542-9f69-2cf1ca0b2cd4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:42.089809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-020ae3d2-61ca-4542-9f69-2cf1ca0b2cd4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:42.168784 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-98ce3891-d720-48e2-95ee-803c803b47d1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1411 microversion: 2.1 time: 0.169553 Oct 27 18:59:42.172897 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1585/3290] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:41 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1411 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:42.185475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9a79d84-f3cd-4ea4-9f9b-3a0bc761d087 tempest-QuotasTestJSON-644676961 tempest-QuotasTestJSON-644676961-project] Calling method '.version_select at 0x7fc86a687a60>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:42.246077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-020ae3d2-61ca-4542-9f69-2cf1ca0b2cd4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:42.256006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-020ae3d2-61ca-4542-9f69-2cf1ca0b2cd4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:42.263546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-020ae3d2-61ca-4542-9f69-2cf1ca0b2cd4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:42.266834 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-020ae3d2-61ca-4542-9f69-2cf1ca0b2cd4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1280 microversion: 2.20 time: 0.188257 Oct 27 18:59:42.269337 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1706/3291] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:59:42 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1280 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:59:42.297504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3915490c-a910-4a62-a52a-89c3da87e6da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:42.298502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3915490c-a910-4a62-a52a-89c3da87e6da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:42.321006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3915490c-a910-4a62-a52a-89c3da87e6da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:42.321680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3915490c-a910-4a62-a52a-89c3da87e6da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:42.323430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3915490c-a910-4a62-a52a-89c3da87e6da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:42.325967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3915490c-a910-4a62-a52a-89c3da87e6da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:42.327850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3915490c-a910-4a62-a52a-89c3da87e6da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:42.328319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3915490c-a910-4a62-a52a-89c3da87e6da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:42.369103 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c9a79d84-f3cd-4ea4-9f9b-3a0bc761d087 tempest-QuotasTestJSON-644676961 tempest-QuotasTestJSON-644676961-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/d0eaff6dc99746be8c24e830301559e6" status: 200 len: 371 microversion: 2.1 time: 0.194379 Oct 27 18:59:42.379051 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1586/3292] 10.222.0.42 () {58 vars in 1242 bytes} [Thu Oct 27 18:59:42 2022] GET /compute/v2.1/os-quota-sets/d0eaff6dc99746be8c24e830301559e6 => generated 371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:42.400158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-591087cb-e4dc-4c01-b4a6-29e9f99a96b4 tempest-QuotasTestJSON-644676961 tempest-QuotasTestJSON-644676961-project] Calling method '.version_select at 0x7fc86a6f3670>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:42.538113 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-591087cb-e4dc-4c01-b4a6-29e9f99a96b4 tempest-QuotasTestJSON-644676961 tempest-QuotasTestJSON-644676961-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/d0eaff6dc99746be8c24e830301559e6?user_id=c3747f2a3bf34a70b389333efa821c2a" status: 200 len: 371 microversion: 2.1 time: 0.150051 Oct 27 18:59:42.539581 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1587/3293] 10.222.0.42 () {58 vars in 1323 bytes} [Thu Oct 27 18:59:42 2022] GET /compute/v2.1/os-quota-sets/d0eaff6dc99746be8c24e830301559e6?user_id=c3747f2a3bf34a70b389333efa821c2a => generated 371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:42.776630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3915490c-a910-4a62-a52a-89c3da87e6da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:42.791238 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3915490c-a910-4a62-a52a-89c3da87e6da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1367 microversion: 2.1 time: 0.497848 Oct 27 18:59:42.812082 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1707/3294] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:42 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1367 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:43.085922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f8d0ed0-a810-4078-9bb9-defafdd07314 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:43.088762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0f8d0ed0-a810-4078-9bb9-defafdd07314 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:43.111004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f8d0ed0-a810-4078-9bb9-defafdd07314 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:43.111659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f8d0ed0-a810-4078-9bb9-defafdd07314 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:43.111988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f8d0ed0-a810-4078-9bb9-defafdd07314 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:43.120809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f8d0ed0-a810-4078-9bb9-defafdd07314 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:43.121788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f8d0ed0-a810-4078-9bb9-defafdd07314 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:43.122468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f8d0ed0-a810-4078-9bb9-defafdd07314 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:43.176056 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0f8d0ed0-a810-4078-9bb9-defafdd07314 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095002 Oct 27 18:59:43.181842 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1588/3295] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:59:43 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:43.188262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f697496-d27f-450e-a2e8-0a962030c51a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86aa8d820>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:43.276451 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6f697496-d27f-450e-a2e8-0a962030c51a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1411 microversion: 2.1 time: 0.092568 Oct 27 18:59:43.285163 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1708/3296] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:43 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:43.301637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b77dc62-653d-4354-843e-e69dd3689353 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:43.302298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6b77dc62-653d-4354-843e-e69dd3689353 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:43.318807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b77dc62-653d-4354-843e-e69dd3689353 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:43.319340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b77dc62-653d-4354-843e-e69dd3689353 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:43.321159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b77dc62-653d-4354-843e-e69dd3689353 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:43.324472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b77dc62-653d-4354-843e-e69dd3689353 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:43.324987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b77dc62-653d-4354-843e-e69dd3689353 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:43.326766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b77dc62-653d-4354-843e-e69dd3689353 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:43.487868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6b77dc62-653d-4354-843e-e69dd3689353 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:43.501449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6b77dc62-653d-4354-843e-e69dd3689353 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:43.504961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6b77dc62-653d-4354-843e-e69dd3689353 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:43.509249 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b77dc62-653d-4354-843e-e69dd3689353 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1332 microversion: 2.20 time: 0.215223 Oct 27 18:59:43.523302 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1589/3297] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:59:43 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1332 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:59:43.831919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4abdf05b-5ea5-4f34-bbee-6171283f9c72 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:43.836524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4abdf05b-5ea5-4f34-bbee-6171283f9c72 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:43.867652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4abdf05b-5ea5-4f34-bbee-6171283f9c72 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:43.868171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4abdf05b-5ea5-4f34-bbee-6171283f9c72 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:43.872541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4abdf05b-5ea5-4f34-bbee-6171283f9c72 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:43.873331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4abdf05b-5ea5-4f34-bbee-6171283f9c72 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:43.873819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4abdf05b-5ea5-4f34-bbee-6171283f9c72 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:43.874263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4abdf05b-5ea5-4f34-bbee-6171283f9c72 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:44.188905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb5fe7e6-3a12-4b8b-b2f6-aa96dcebca36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:44.191659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb5fe7e6-3a12-4b8b-b2f6-aa96dcebca36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:44.209165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5fe7e6-3a12-4b8b-b2f6-aa96dcebca36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:44.209797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4abdf05b-5ea5-4f34-bbee-6171283f9c72 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:44.210845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5fe7e6-3a12-4b8b-b2f6-aa96dcebca36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:44.211308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5fe7e6-3a12-4b8b-b2f6-aa96dcebca36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:44.212052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5fe7e6-3a12-4b8b-b2f6-aa96dcebca36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:44.212515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5fe7e6-3a12-4b8b-b2f6-aa96dcebca36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:44.212952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5fe7e6-3a12-4b8b-b2f6-aa96dcebca36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:44.223002 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4abdf05b-5ea5-4f34-bbee-6171283f9c72 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1558 microversion: 2.1 time: 0.404872 Oct 27 18:59:44.224192 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1709/3298] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:43 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1558 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:44.256014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-681b7b02-151f-4cf4-894c-36e29ef1d6d1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:44.257178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-681b7b02-151f-4cf4-894c-36e29ef1d6d1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:44.275026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-681b7b02-151f-4cf4-894c-36e29ef1d6d1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:44.278420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-681b7b02-151f-4cf4-894c-36e29ef1d6d1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:44.279191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-681b7b02-151f-4cf4-894c-36e29ef1d6d1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:44.295957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-681b7b02-151f-4cf4-894c-36e29ef1d6d1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:44.296946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-681b7b02-151f-4cf4-894c-36e29ef1d6d1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:44.300108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-681b7b02-151f-4cf4-894c-36e29ef1d6d1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:44.324821 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb5fe7e6-3a12-4b8b-b2f6-aa96dcebca36 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139641 Oct 27 18:59:44.331081 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1590/3299] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:59:44 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:59:44.359712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-686fd9df-0122-4bf2-8a25-3435b75b7911 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b840f70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:44.437156 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-686fd9df-0122-4bf2-8a25-3435b75b7911 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1420 microversion: 2.1 time: 0.104677 Oct 27 18:59:44.438647 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1591/3300] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:44 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:44.456259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70b67390-28db-4635-8845-0e204bc4285a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86ad7cee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:44.540129 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-681b7b02-151f-4cf4-894c-36e29ef1d6d1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.291414 Oct 27 18:59:44.541835 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1710/3301] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 18:59:44 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-interface => generated 285 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:59:44.552838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0897199d-ab79-41dc-93db-9649e7ee8971 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:44.554292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0897199d-ab79-41dc-93db-9649e7ee8971 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:44.580268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0897199d-ab79-41dc-93db-9649e7ee8971 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:44.581301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0897199d-ab79-41dc-93db-9649e7ee8971 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:44.581931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0897199d-ab79-41dc-93db-9649e7ee8971 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:44.582982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0897199d-ab79-41dc-93db-9649e7ee8971 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:44.583378 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70b67390-28db-4635-8845-0e204bc4285a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 200 len: 1420 microversion: 2.1 time: 0.131208 Oct 27 18:59:44.584345 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1592/3302] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 18:59:44 2022] GET /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:59:44.590495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0897199d-ab79-41dc-93db-9649e7ee8971 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:44.591256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0897199d-ab79-41dc-93db-9649e7ee8971 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:44.767062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0897199d-ab79-41dc-93db-9649e7ee8971 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:44.778186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0897199d-ab79-41dc-93db-9649e7ee8971 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:44.787554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0897199d-ab79-41dc-93db-9649e7ee8971 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:44.789123 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0897199d-ab79-41dc-93db-9649e7ee8971 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1338 microversion: 2.20 time: 0.243802 Oct 27 18:59:44.791094 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1711/3303] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:59:44 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1338 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:59:44.836939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-927642535", "imageRef": "a8ea47ba-b4c5-4625-9c5c-8fccc23595a5", "flavorRef": "452", "networks": [{"uuid": "bd2a2055-53fd-4e07-8727-b0efd4106712"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:44.963224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] validate_networks() for [('bd2a2055-53fd-4e07-8727-b0efd4106712', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 18:59:45.071493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f4d4a73c-b3cc-475b-a4b1-892742c89b55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:45.074251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f4d4a73c-b3cc-475b-a4b1-892742c89b55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:45.091168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4d4a73c-b3cc-475b-a4b1-892742c89b55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:45.091901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4d4a73c-b3cc-475b-a4b1-892742c89b55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:45.092349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4d4a73c-b3cc-475b-a4b1-892742c89b55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:45.093078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4d4a73c-b3cc-475b-a4b1-892742c89b55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:45.093545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4d4a73c-b3cc-475b-a4b1-892742c89b55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:45.093986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4d4a73c-b3cc-475b-a4b1-892742c89b55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:45.156922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-f4d4a73c-b3cc-475b-a4b1-892742c89b55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lazy-loading 'flavor' on Instance uuid fd8ee1a0-1df0-4488-bffd-1406e9762843 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 18:59:45.345044 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f4d4a73c-b3cc-475b-a4b1-892742c89b55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843/action" status: 200 len: 32 microversion: 2.1 time: 0.277233 Oct 27 18:59:45.353320 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1712/3304] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 18:59:45 2022] POST /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843/action => generated 32 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:59:45.363342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-89cdebe1-031b-4be6-b76c-40a55bf9783c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:45.368512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-89cdebe1-031b-4be6-b76c-40a55bf9783c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:45.380151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89cdebe1-031b-4be6-b76c-40a55bf9783c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:45.380981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89cdebe1-031b-4be6-b76c-40a55bf9783c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:45.381628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89cdebe1-031b-4be6-b76c-40a55bf9783c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:45.383405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89cdebe1-031b-4be6-b76c-40a55bf9783c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:45.387073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89cdebe1-031b-4be6-b76c-40a55bf9783c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:45.387733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89cdebe1-031b-4be6-b76c-40a55bf9783c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:45.444227 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-89cdebe1-031b-4be6-b76c-40a55bf9783c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088552 Oct 27 18:59:45.445316 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1713/3305] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:59:45 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:45.451376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a9ad7cda-fa36-441d-9af3-0ade5ad2501c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:45.452217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a9ad7cda-fa36-441d-9af3-0ade5ad2501c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:45.459755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9ad7cda-fa36-441d-9af3-0ade5ad2501c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:45.460526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9ad7cda-fa36-441d-9af3-0ade5ad2501c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:45.461159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9ad7cda-fa36-441d-9af3-0ade5ad2501c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:45.462108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9ad7cda-fa36-441d-9af3-0ade5ad2501c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:45.463373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9ad7cda-fa36-441d-9af3-0ade5ad2501c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:45.466113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9ad7cda-fa36-441d-9af3-0ade5ad2501c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:45.694229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a9ad7cda-fa36-441d-9af3-0ade5ad2501c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:45.706703 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a9ad7cda-fa36-441d-9af3-0ade5ad2501c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 0.259913 Oct 27 18:59:45.707718 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1714/3306] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:45 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:45.823122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-83d1d83f-e41c-4c5a-ab91-edd7210a7c73 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:45.824949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-83d1d83f-e41c-4c5a-ab91-edd7210a7c73 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:45.846807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d1d83f-e41c-4c5a-ab91-edd7210a7c73 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:45.848053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d1d83f-e41c-4c5a-ab91-edd7210a7c73 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:45.860052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d1d83f-e41c-4c5a-ab91-edd7210a7c73 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:45.862248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d1d83f-e41c-4c5a-ab91-edd7210a7c73 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:45.863771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d1d83f-e41c-4c5a-ab91-edd7210a7c73 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:45.866540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d1d83f-e41c-4c5a-ab91-edd7210a7c73 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:45.986188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-83d1d83f-e41c-4c5a-ab91-edd7210a7c73 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:46.001335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-83d1d83f-e41c-4c5a-ab91-edd7210a7c73 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:46.003665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-83d1d83f-e41c-4c5a-ab91-edd7210a7c73 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:46.005225 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-83d1d83f-e41c-4c5a-ab91-edd7210a7c73 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1338 microversion: 2.20 time: 0.187835 Oct 27 18:59:46.006558 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1715/3307] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:59:45 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1338 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:59:46.191667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1f0db78a-fa8a-435b-a8d1-92605cc3e1c1 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Action: 'create', calling method: .version_select at 0x7fc86b91e820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-326849701"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:46.294016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 18:59:46.294676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 18:59:46.296222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 18:59:46.296222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 18:59:46.296222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 18:59:46.316073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:46.316847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:46.317456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:46.318453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:46.319086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:46.319706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:46.350009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Getting quotas for project 75c41c5833484551b422742abfad598f. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 18:59:46.356052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Getting quotas for user ac1e2f62e22b4e52badd230ef175817e and project 75c41c5833484551b422742abfad598f. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 18:59:46.379831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 18:59:46.385467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8ea47ba-b4c5-4625-9c5c-8fccc23595a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 18:59:46.483499 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-61ea69e8-256c-4a7e-9ea3-e75a3b5cc0fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.650316 Oct 27 18:59:46.492932 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1593/3308] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 18:59:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 18:59:46.498928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-06986a62-6221-49f3-8368-eabed6e8a8c7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:46.501960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-06986a62-6221-49f3-8368-eabed6e8a8c7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:46.513708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06986a62-6221-49f3-8368-eabed6e8a8c7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:46.517081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06986a62-6221-49f3-8368-eabed6e8a8c7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:46.517807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06986a62-6221-49f3-8368-eabed6e8a8c7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:46.518692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06986a62-6221-49f3-8368-eabed6e8a8c7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:46.519171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06986a62-6221-49f3-8368-eabed6e8a8c7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:46.519606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06986a62-6221-49f3-8368-eabed6e8a8c7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:46.603489 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-06986a62-6221-49f3-8368-eabed6e8a8c7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107654 Oct 27 18:59:46.605967 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1594/3309] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:59:46 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:46.619429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-62d01b6f-9a54-4a45-a6a9-4eefa80d995a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:46.620864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-62d01b6f-9a54-4a45-a6a9-4eefa80d995a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:46.935133 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1f0db78a-fa8a-435b-a8d1-92605cc3e1c1 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.890335 Oct 27 18:59:46.936771 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1716/3310] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Oct 27 18:59:46 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 893 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 27 18:59:46.941992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3fc1684f-b3b9-4205-aea8-fc9e8d2d235b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:46.942829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3fc1684f-b3b9-4205-aea8-fc9e8d2d235b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:46.960592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3fc1684f-b3b9-4205-aea8-fc9e8d2d235b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:46.961344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3fc1684f-b3b9-4205-aea8-fc9e8d2d235b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:46.961993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3fc1684f-b3b9-4205-aea8-fc9e8d2d235b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:46.962915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3fc1684f-b3b9-4205-aea8-fc9e8d2d235b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:46.971106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3fc1684f-b3b9-4205-aea8-fc9e8d2d235b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:46.971813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3fc1684f-b3b9-4205-aea8-fc9e8d2d235b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:47.221271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-62d01b6f-9a54-4a45-a6a9-4eefa80d995a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:47.234266 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-62d01b6f-9a54-4a45-a6a9-4eefa80d995a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1207 microversion: 2.1 time: 0.624989 Oct 27 18:59:47.235224 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1595/3311] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:46 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1207 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:47.275161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8edc11e3-0402-4da4-b738-25b9ab4415c3 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86b1b9310>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:47.296862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3fc1684f-b3b9-4205-aea8-fc9e8d2d235b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:47.317262 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3fc1684f-b3b9-4205-aea8-fc9e8d2d235b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 0.376880 Oct 27 18:59:47.332676 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1717/3312] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:46 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:47.351485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-299edc10-ae81-4051-99ac-b015eef3332a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:47.352171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-299edc10-ae81-4051-99ac-b015eef3332a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:47.367720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-299edc10-ae81-4051-99ac-b015eef3332a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:47.376675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-299edc10-ae81-4051-99ac-b015eef3332a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:47.377401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-299edc10-ae81-4051-99ac-b015eef3332a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:47.378331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-299edc10-ae81-4051-99ac-b015eef3332a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:47.381309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-299edc10-ae81-4051-99ac-b015eef3332a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:47.382562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-299edc10-ae81-4051-99ac-b015eef3332a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:47.412092 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8edc11e3-0402-4da4-b738-25b9ab4415c3 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609" status: 200 len: 344 microversion: 2.1 time: 0.152308 Oct 27 18:59:47.412813 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1596/3313] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 18:59:47 2022] GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:47.546673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-299edc10-ae81-4051-99ac-b015eef3332a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:47.551331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:47.564838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-299edc10-ae81-4051-99ac-b015eef3332a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:47.578753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-299edc10-ae81-4051-99ac-b015eef3332a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:47.580264 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-299edc10-ae81-4051-99ac-b015eef3332a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1338 microversion: 2.20 time: 0.246502 Oct 27 18:59:47.583915 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1718/3314] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:59:47 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1338 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:59:47.619029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5b596366-0e20-49f4-90a0-4a65d1bd0a69 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:47.622791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5b596366-0e20-49f4-90a0-4a65d1bd0a69 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:47.645388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b596366-0e20-49f4-90a0-4a65d1bd0a69 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:47.647960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b596366-0e20-49f4-90a0-4a65d1bd0a69 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:47.649651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b596366-0e20-49f4-90a0-4a65d1bd0a69 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:47.654277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b596366-0e20-49f4-90a0-4a65d1bd0a69 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:47.655750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b596366-0e20-49f4-90a0-4a65d1bd0a69 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:47.657241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b596366-0e20-49f4-90a0-4a65d1bd0a69 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:47.754505 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5b596366-0e20-49f4-90a0-4a65d1bd0a69 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139008 Oct 27 18:59:47.760505 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1597/3315] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:59:47 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:48.261207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1ebef675-4ed5-4282-b7d9-0a0e152df970 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:48.261934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1ebef675-4ed5-4282-b7d9-0a0e152df970 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:48.277938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ebef675-4ed5-4282-b7d9-0a0e152df970 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:48.278365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ebef675-4ed5-4282-b7d9-0a0e152df970 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:48.278843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ebef675-4ed5-4282-b7d9-0a0e152df970 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:48.279578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ebef675-4ed5-4282-b7d9-0a0e152df970 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:48.280057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ebef675-4ed5-4282-b7d9-0a0e152df970 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:48.280500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ebef675-4ed5-4282-b7d9-0a0e152df970 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:48.354474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-977c63f9-8bc2-4103-acb6-edec69f8dd36 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:48.359111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-977c63f9-8bc2-4103-acb6-edec69f8dd36 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:48.374476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-977c63f9-8bc2-4103-acb6-edec69f8dd36 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:48.379126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-977c63f9-8bc2-4103-acb6-edec69f8dd36 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:48.379891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-977c63f9-8bc2-4103-acb6-edec69f8dd36 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:48.383518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-977c63f9-8bc2-4103-acb6-edec69f8dd36 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:48.384423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-977c63f9-8bc2-4103-acb6-edec69f8dd36 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:48.385285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-977c63f9-8bc2-4103-acb6-edec69f8dd36 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:48.438553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1ebef675-4ed5-4282-b7d9-0a0e152df970 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:48.472261 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1ebef675-4ed5-4282-b7d9-0a0e152df970 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1259 microversion: 2.1 time: 0.215792 Oct 27 18:59:48.473119 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1719/3316] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:48 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:48.488897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3896354c-fc07-4dba-ab6d-ee1b263baf2f tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86b039790>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:48.588020 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3896354c-fc07-4dba-ab6d-ee1b263baf2f tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609" status: 200 len: 344 microversion: 2.1 time: 0.112159 Oct 27 18:59:48.588603 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1720/3317] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 18:59:48 2022] GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 => generated 344 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:48.613323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e1667b3c-b06f-4f2c-90b8-5a287c50a881 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:48.613941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e1667b3c-b06f-4f2c-90b8-5a287c50a881 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:48.624733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1667b3c-b06f-4f2c-90b8-5a287c50a881 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:48.625533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1667b3c-b06f-4f2c-90b8-5a287c50a881 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:48.627224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1667b3c-b06f-4f2c-90b8-5a287c50a881 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:48.629065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1667b3c-b06f-4f2c-90b8-5a287c50a881 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:48.630552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1667b3c-b06f-4f2c-90b8-5a287c50a881 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:48.632995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1667b3c-b06f-4f2c-90b8-5a287c50a881 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:48.955617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1667b3c-b06f-4f2c-90b8-5a287c50a881 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:48.981057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1667b3c-b06f-4f2c-90b8-5a287c50a881 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:48.983423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1667b3c-b06f-4f2c-90b8-5a287c50a881 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:48.984848 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e1667b3c-b06f-4f2c-90b8-5a287c50a881 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1405 microversion: 2.20 time: 0.375606 Oct 27 18:59:48.985636 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1721/3318] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:59:48 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1405 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 18:59:48.990786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a8c2c959-052e-4e44-815b-6967081aa926 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:48.993841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a8c2c959-052e-4e44-815b-6967081aa926 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:49.001759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8c2c959-052e-4e44-815b-6967081aa926 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:49.002868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8c2c959-052e-4e44-815b-6967081aa926 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:49.003689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8c2c959-052e-4e44-815b-6967081aa926 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:49.004652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8c2c959-052e-4e44-815b-6967081aa926 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:49.005519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8c2c959-052e-4e44-815b-6967081aa926 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:49.009282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8c2c959-052e-4e44-815b-6967081aa926 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:49.075861 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a8c2c959-052e-4e44-815b-6967081aa926 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087380 Oct 27 18:59:49.076658 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1722/3319] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:59:48 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:49.274931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-2b4cd287-c71f-41ce-9834-63b7e9a8ed69 req-fc08af3e-5d80-430b-87f7-7b57a758fb80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f", "name": "network-vif-unplugged", "status": "completed", "tag": "d04a7167-51a8-4ece-aedc-77994439aa42"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:49.328940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2b4cd287-c71f-41ce-9834-63b7e9a8ed69 req-fc08af3e-5d80-430b-87f7-7b57a758fb80 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:49.331128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2b4cd287-c71f-41ce-9834-63b7e9a8ed69 req-fc08af3e-5d80-430b-87f7-7b57a758fb80 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:49.333081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2b4cd287-c71f-41ce-9834-63b7e9a8ed69 req-fc08af3e-5d80-430b-87f7-7b57a758fb80 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:49.358506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-977c63f9-8bc2-4103-acb6-edec69f8dd36 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:49.367136 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-2b4cd287-c71f-41ce-9834-63b7e9a8ed69 req-fc08af3e-5d80-430b-87f7-7b57a758fb80 service nova] Creating event network-vif-unplugged:d04a7167-51a8-4ece-aedc-77994439aa42 for instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f on n-h2-860687-3 Oct 27 18:59:49.378290 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-2b4cd287-c71f-41ce-9834-63b7e9a8ed69 req-fc08af3e-5d80-430b-87f7-7b57a758fb80 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107466 Oct 27 18:59:49.386874 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1723/3320] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:59:49.388445 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-977c63f9-8bc2-4103-acb6-edec69f8dd36 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 1.043095 Oct 27 18:59:49.397326 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1598/3321] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:48 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:49.501639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-68acff18-85e9-4f10-ae16-004e2ab2f444 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:49.502784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-68acff18-85e9-4f10-ae16-004e2ab2f444 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:49.530867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68acff18-85e9-4f10-ae16-004e2ab2f444 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:49.542042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68acff18-85e9-4f10-ae16-004e2ab2f444 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:49.544216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68acff18-85e9-4f10-ae16-004e2ab2f444 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:49.545895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68acff18-85e9-4f10-ae16-004e2ab2f444 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:49.548782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68acff18-85e9-4f10-ae16-004e2ab2f444 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:49.549855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68acff18-85e9-4f10-ae16-004e2ab2f444 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:49.602988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-818ecd27-f7e2-437e-8779-265945bff60f tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86ae0d3a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:49.705573 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-818ecd27-f7e2-437e-8779-265945bff60f tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609" status: 200 len: 345 microversion: 2.1 time: 0.106373 Oct 27 18:59:49.706548 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1599/3322] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 18:59:49 2022] GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:59:49.722577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-341f9f73-4b88-4f57-bd27-55db7473e279 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Action: 'create', calling method: .version_select at 0x7fc869c97c10>, body: {"snapshot": {"volume_id": "f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1920109437"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:49.741581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-68acff18-85e9-4f10-ae16-004e2ab2f444 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:49.752287 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-68acff18-85e9-4f10-ae16-004e2ab2f444 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1265 microversion: 2.1 time: 0.255073 Oct 27 18:59:49.766477 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1724/3323] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:49 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:50.016417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-05f0966e-3fd7-44c1-80d0-0dc3748c757a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:50.017193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-05f0966e-3fd7-44c1-80d0-0dc3748c757a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:50.038891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05f0966e-3fd7-44c1-80d0-0dc3748c757a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:50.043620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05f0966e-3fd7-44c1-80d0-0dc3748c757a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:50.045979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05f0966e-3fd7-44c1-80d0-0dc3748c757a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:50.048856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05f0966e-3fd7-44c1-80d0-0dc3748c757a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:50.056317 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-341f9f73-4b88-4f57-bd27-55db7473e279 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.336091 Oct 27 18:59:50.057406 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1600/3324] 10.222.0.42 () {60 vars in 1162 bytes} [Thu Oct 27 18:59:49 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:50.072725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6bd7f0d-6c58-4d11-9227-ea98287ae8f9 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc869c97430>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:50.083692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05f0966e-3fd7-44c1-80d0-0dc3748c757a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:50.083692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05f0966e-3fd7-44c1-80d0-0dc3748c757a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:50.313946 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d6bd7f0d-6c58-4d11-9227-ea98287ae8f9 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d" status: 200 len: 287 microversion: 2.1 time: 0.248037 Oct 27 18:59:50.318783 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1601/3325] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 18:59:50 2022] GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d => generated 287 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:50.324354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8df45d18-962c-45c0-88ea-48ee211661ee tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:50.326911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8df45d18-962c-45c0-88ea-48ee211661ee tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:50.356444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8df45d18-962c-45c0-88ea-48ee211661ee tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:50.367141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8df45d18-962c-45c0-88ea-48ee211661ee tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:50.367802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8df45d18-962c-45c0-88ea-48ee211661ee tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:50.370810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8df45d18-962c-45c0-88ea-48ee211661ee tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:50.373676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8df45d18-962c-45c0-88ea-48ee211661ee tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:50.374429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8df45d18-962c-45c0-88ea-48ee211661ee tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:50.485258 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8df45d18-962c-45c0-88ea-48ee211661ee tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165002 Oct 27 18:59:50.493029 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1602/3326] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:59:50 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:50.531518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-49beea53-69ea-4435-859f-ebe988ca0c69 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86b01e1f0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:50.687792 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-49beea53-69ea-4435-859f-ebe988ca0c69 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.188201 Oct 27 18:59:50.689053 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1603/3327] 10.222.0.42 () {58 vars in 1140 bytes} [Thu Oct 27 18:59:50 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:50.694142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e1c426c5-14bc-444f-be4b-7284f0897a98 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:50.695039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e1c426c5-14bc-444f-be4b-7284f0897a98 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:50.718517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-05f0966e-3fd7-44c1-80d0-0dc3748c757a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:50.738104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1c426c5-14bc-444f-be4b-7284f0897a98 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:50.738545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-05f0966e-3fd7-44c1-80d0-0dc3748c757a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:50.739489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1c426c5-14bc-444f-be4b-7284f0897a98 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:50.740494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-05f0966e-3fd7-44c1-80d0-0dc3748c757a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:50.740710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1c426c5-14bc-444f-be4b-7284f0897a98 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:50.741706 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-05f0966e-3fd7-44c1-80d0-0dc3748c757a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1405 microversion: 2.20 time: 0.732488 Oct 27 18:59:50.742286 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1725/3328] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:59:50 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1405 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:59:50.751264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1c426c5-14bc-444f-be4b-7284f0897a98 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:50.754255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1c426c5-14bc-444f-be4b-7284f0897a98 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:50.760385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1c426c5-14bc-444f-be4b-7284f0897a98 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:50.786309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d715dc47-563c-436f-8dd9-80423794978f req-83d209bc-faec-48fe-94d9-07e0439450d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "673d7d02-3b01-418e-825a-8c7ccaffa820", "tag": "dc9bfd96-0979-420c-a567-d63bd7ef7915"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:50.821051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d715dc47-563c-436f-8dd9-80423794978f req-83d209bc-faec-48fe-94d9-07e0439450d2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:50.821548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d715dc47-563c-436f-8dd9-80423794978f req-83d209bc-faec-48fe-94d9-07e0439450d2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:50.821997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d715dc47-563c-436f-8dd9-80423794978f req-83d209bc-faec-48fe-94d9-07e0439450d2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:50.830012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:50.864325 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d715dc47-563c-436f-8dd9-80423794978f req-83d209bc-faec-48fe-94d9-07e0439450d2 service nova] Creating event network-changed:dc9bfd96-0979-420c-a567-d63bd7ef7915 for instance 673d7d02-3b01-418e-825a-8c7ccaffa820 on n-h2-860687-3 Oct 27 18:59:50.888207 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d715dc47-563c-436f-8dd9-80423794978f req-83d209bc-faec-48fe-94d9-07e0439450d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121105 Oct 27 18:59:50.888863 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1726/3329] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:50.905858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9f300337-3396-4d9e-a4f3-cdbe9b6d3cda tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86adfbaf0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:50.998458 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9f300337-3396-4d9e-a4f3-cdbe9b6d3cda tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d" status: 200 len: 287 microversion: 2.1 time: 0.102405 Oct 27 18:59:50.999848 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1727/3330] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 18:59:50 2022] GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:51.008462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f69c7529-813a-4a1e-8991-c13fd7d73aa3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:51.009679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f69c7529-813a-4a1e-8991-c13fd7d73aa3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:51.028855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f69c7529-813a-4a1e-8991-c13fd7d73aa3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:51.039632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f69c7529-813a-4a1e-8991-c13fd7d73aa3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:51.040429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f69c7529-813a-4a1e-8991-c13fd7d73aa3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:51.041793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f69c7529-813a-4a1e-8991-c13fd7d73aa3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:51.043395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f69c7529-813a-4a1e-8991-c13fd7d73aa3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:51.044157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f69c7529-813a-4a1e-8991-c13fd7d73aa3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:51.194673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f69c7529-813a-4a1e-8991-c13fd7d73aa3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:51.206145 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f69c7529-813a-4a1e-8991-c13fd7d73aa3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1265 microversion: 2.1 time: 0.204914 Oct 27 18:59:51.210134 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1728/3331] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:51 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:51.507547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f88c742d-0e04-4af5-9474-20baaa41cdb6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:51.513573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f88c742d-0e04-4af5-9474-20baaa41cdb6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:51.559560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f88c742d-0e04-4af5-9474-20baaa41cdb6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:51.563807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f88c742d-0e04-4af5-9474-20baaa41cdb6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:51.570749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f88c742d-0e04-4af5-9474-20baaa41cdb6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:51.573145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f88c742d-0e04-4af5-9474-20baaa41cdb6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:51.577184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f88c742d-0e04-4af5-9474-20baaa41cdb6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:51.585867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f88c742d-0e04-4af5-9474-20baaa41cdb6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:51.736553 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f88c742d-0e04-4af5-9474-20baaa41cdb6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.234737 Oct 27 18:59:51.748082 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1729/3332] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 18:59:51 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161/os-volume_attachments => generated 25 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 18:59:51.769952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2fc730ef-162f-497d-8216-53ebaa370102 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:51.770992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2fc730ef-162f-497d-8216-53ebaa370102 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:51.791417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fc730ef-162f-497d-8216-53ebaa370102 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:51.794107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fc730ef-162f-497d-8216-53ebaa370102 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:51.795067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fc730ef-162f-497d-8216-53ebaa370102 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:51.797844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fc730ef-162f-497d-8216-53ebaa370102 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:51.800407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fc730ef-162f-497d-8216-53ebaa370102 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:51.801143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fc730ef-162f-497d-8216-53ebaa370102 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:52.249446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2fc730ef-162f-497d-8216-53ebaa370102 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:52.260503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:52.270258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2fc730ef-162f-497d-8216-53ebaa370102 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:52.279411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2fc730ef-162f-497d-8216-53ebaa370102 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:52.285008 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2fc730ef-162f-497d-8216-53ebaa370102 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1405 microversion: 2.20 time: 0.521146 Oct 27 18:59:52.298410 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1730/3333] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:59:51 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1405 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:59:52.307617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dd62d25b-03cf-494c-9fa7-a5bffab7446c tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86b284310>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:52.380896 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dd62d25b-03cf-494c-9fa7-a5bffab7446c tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d" status: 200 len: 287 microversion: 2.1 time: 0.089252 Oct 27 18:59:52.381870 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1731/3334] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 18:59:52 2022] GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:52.395549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e218af2c-72a9-427b-aff8-c23fc15de3e8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:52.396488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e218af2c-72a9-427b-aff8-c23fc15de3e8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:52.430905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e218af2c-72a9-427b-aff8-c23fc15de3e8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:52.432549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e218af2c-72a9-427b-aff8-c23fc15de3e8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:52.434214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e218af2c-72a9-427b-aff8-c23fc15de3e8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:52.436306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e218af2c-72a9-427b-aff8-c23fc15de3e8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:52.437235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e218af2c-72a9-427b-aff8-c23fc15de3e8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:52.437921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e218af2c-72a9-427b-aff8-c23fc15de3e8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:52.805430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e1c426c5-14bc-444f-be4b-7284f0897a98 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:52.811264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e218af2c-72a9-427b-aff8-c23fc15de3e8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:52.816863 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e1c426c5-14bc-444f-be4b-7284f0897a98 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 2.126580 Oct 27 18:59:52.821575 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e218af2c-72a9-427b-aff8-c23fc15de3e8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1307 microversion: 2.1 time: 0.433142 Oct 27 18:59:52.839541 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1604/3335] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:50 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 2149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:52.843302 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1732/3336] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:52 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1307 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:53.315188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c279eae3-a5fd-4089-b593-1055cb025fdb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:53.319339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c279eae3-a5fd-4089-b593-1055cb025fdb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:53.337426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c279eae3-a5fd-4089-b593-1055cb025fdb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:53.340456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c279eae3-a5fd-4089-b593-1055cb025fdb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:53.341757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c279eae3-a5fd-4089-b593-1055cb025fdb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:53.343370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c279eae3-a5fd-4089-b593-1055cb025fdb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:53.345396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c279eae3-a5fd-4089-b593-1055cb025fdb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:53.346727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c279eae3-a5fd-4089-b593-1055cb025fdb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:53.394638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6edf80f7-e759-4d11-8151-0a370e755ad4 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86b292940>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:53.517238 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6edf80f7-e759-4d11-8151-0a370e755ad4 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d" status: 200 len: 287 microversion: 2.1 time: 0.126664 Oct 27 18:59:53.517825 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1733/3337] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 18:59:53 2022] GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d => generated 287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:59:53.853144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13dd10a3-8519-4fbc-9b2a-7b98619b5416 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:53.855259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-13dd10a3-8519-4fbc-9b2a-7b98619b5416 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:53.885607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dd10a3-8519-4fbc-9b2a-7b98619b5416 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:53.889007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dd10a3-8519-4fbc-9b2a-7b98619b5416 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:53.892276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dd10a3-8519-4fbc-9b2a-7b98619b5416 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:53.893409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dd10a3-8519-4fbc-9b2a-7b98619b5416 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:53.895784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dd10a3-8519-4fbc-9b2a-7b98619b5416 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:53.899147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13dd10a3-8519-4fbc-9b2a-7b98619b5416 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:54.452206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-13dd10a3-8519-4fbc-9b2a-7b98619b5416 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:54.468800 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13dd10a3-8519-4fbc-9b2a-7b98619b5416 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 0.622218 Oct 27 18:59:54.469686 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1734/3338] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:53 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:54.500495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7b7ec8e7-fbcb-4048-b1c3-75281b490188 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:54.501815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7b7ec8e7-fbcb-4048-b1c3-75281b490188 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:54.513206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b7ec8e7-fbcb-4048-b1c3-75281b490188 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:54.514105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b7ec8e7-fbcb-4048-b1c3-75281b490188 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:54.514841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b7ec8e7-fbcb-4048-b1c3-75281b490188 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:54.515857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b7ec8e7-fbcb-4048-b1c3-75281b490188 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:54.516548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b7ec8e7-fbcb-4048-b1c3-75281b490188 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:54.517206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b7ec8e7-fbcb-4048-b1c3-75281b490188 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:54.863276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7b7ec8e7-fbcb-4048-b1c3-75281b490188 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:54.880257 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7b7ec8e7-fbcb-4048-b1c3-75281b490188 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1307 microversion: 2.1 time: 0.401762 Oct 27 18:59:54.883109 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1735/3339] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:54 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1307 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:54.896273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-919132c9-79b1-466d-bac5-c111064bb651 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86b022d30>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:54.965678 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-919132c9-79b1-466d-bac5-c111064bb651 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d" status: 200 len: 288 microversion: 2.1 time: 0.079126 Oct 27 18:59:54.966594 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1736/3340] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 18:59:54 2022] GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d => generated 288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:54.980689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5b4842c0-607f-4d19-8536-b18507a57354 req-b10a44dc-35fe-44ad-9bf8-726a581b35dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a7713a-b78d-425e-a6e8-0e4f5bc8904b", "tag": "9f402fdb-d277-4b7a-b6cc-275f32214caf"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:55.001575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5b4842c0-607f-4d19-8536-b18507a57354 req-b10a44dc-35fe-44ad-9bf8-726a581b35dd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:55.002602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5b4842c0-607f-4d19-8536-b18507a57354 req-b10a44dc-35fe-44ad-9bf8-726a581b35dd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:55.003439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5b4842c0-607f-4d19-8536-b18507a57354 req-b10a44dc-35fe-44ad-9bf8-726a581b35dd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:55.020197 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5b4842c0-607f-4d19-8536-b18507a57354 req-b10a44dc-35fe-44ad-9bf8-726a581b35dd service nova] Creating event network-changed:9f402fdb-d277-4b7a-b6cc-275f32214caf for instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b on n-h1-860687-3 Oct 27 18:59:55.028193 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5b4842c0-607f-4d19-8536-b18507a57354 req-b10a44dc-35fe-44ad-9bf8-726a581b35dd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050844 Oct 27 18:59:55.029394 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1737/3341] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:55.036437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8ad36412-05c7-4821-bced-c8ea3989a5a1 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86bac2670>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:55.125060 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8ad36412-05c7-4821-bced-c8ea3989a5a1 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d" status: 202 len: 0 microversion: 2.1 time: 0.093580 Oct 27 18:59:55.125992 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1738/3342] 10.222.0.42 () {58 vars in 1254 bytes} [Thu Oct 27 18:59:55 2022] DELETE /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:59:55.134618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cc0d734c-e214-4a29-b519-e2092ef6e2a8 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86b409160>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:55.178162 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cc0d734c-e214-4a29-b519-e2092ef6e2a8 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d" status: 200 len: 287 microversion: 2.1 time: 0.047733 Oct 27 18:59:55.180104 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1739/3343] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 18:59:55 2022] GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:59:55.268689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c279eae3-a5fd-4089-b593-1055cb025fdb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:55.279808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c279eae3-a5fd-4089-b593-1055cb025fdb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:55.281343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c279eae3-a5fd-4089-b593-1055cb025fdb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:55.289655 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c279eae3-a5fd-4089-b593-1055cb025fdb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1405 microversion: 2.20 time: 1.978464 Oct 27 18:59:55.295119 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1605/3344] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:59:53 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1405 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:59:55.500704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b416fc7-4e69-4e0c-8df8-10ae855bb218 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:55.501753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1b416fc7-4e69-4e0c-8df8-10ae855bb218 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:55.521809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b416fc7-4e69-4e0c-8df8-10ae855bb218 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:55.527174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b416fc7-4e69-4e0c-8df8-10ae855bb218 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:55.530209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b416fc7-4e69-4e0c-8df8-10ae855bb218 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:55.531561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b416fc7-4e69-4e0c-8df8-10ae855bb218 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:55.537384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b416fc7-4e69-4e0c-8df8-10ae855bb218 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:55.538118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b416fc7-4e69-4e0c-8df8-10ae855bb218 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:55.909916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-60ac3774-4e79-4e18-ac12-c39eafbba2e0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:55.910974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-60ac3774-4e79-4e18-ac12-c39eafbba2e0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:55.927565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60ac3774-4e79-4e18-ac12-c39eafbba2e0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:55.934562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60ac3774-4e79-4e18-ac12-c39eafbba2e0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:55.935397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60ac3774-4e79-4e18-ac12-c39eafbba2e0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:55.936532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60ac3774-4e79-4e18-ac12-c39eafbba2e0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:55.937247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60ac3774-4e79-4e18-ac12-c39eafbba2e0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:55.943495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60ac3774-4e79-4e18-ac12-c39eafbba2e0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:56.055925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1b416fc7-4e69-4e0c-8df8-10ae855bb218 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:56.072484 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1b416fc7-4e69-4e0c-8df8-10ae855bb218 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 0.575309 Oct 27 18:59:56.076317 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1740/3345] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:55 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:56.193047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-318b40d1-bd36-408b-b72d-a960c1f56cc8 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86bac2ca0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:56.286113 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-318b40d1-bd36-408b-b72d-a960c1f56cc8 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d" status: 200 len: 287 microversion: 2.1 time: 0.096804 Oct 27 18:59:56.294364 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1741/3346] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 18:59:56 2022] GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:59:56.324049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e0aa33e8-26a7-4ad4-a998-ead0ae70b77e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:56.324845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e0aa33e8-26a7-4ad4-a998-ead0ae70b77e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:56.337421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:56.346794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0aa33e8-26a7-4ad4-a998-ead0ae70b77e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:56.347469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0aa33e8-26a7-4ad4-a998-ead0ae70b77e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:56.348110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0aa33e8-26a7-4ad4-a998-ead0ae70b77e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:56.348939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0aa33e8-26a7-4ad4-a998-ead0ae70b77e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:56.352371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0aa33e8-26a7-4ad4-a998-ead0ae70b77e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:56.353177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0aa33e8-26a7-4ad4-a998-ead0ae70b77e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:56.649217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-60ac3774-4e79-4e18-ac12-c39eafbba2e0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:56.650377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e0aa33e8-26a7-4ad4-a998-ead0ae70b77e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:56.664311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e0aa33e8-26a7-4ad4-a998-ead0ae70b77e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:56.669651 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-60ac3774-4e79-4e18-ac12-c39eafbba2e0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1307 microversion: 2.1 time: 0.763685 Oct 27 18:59:56.680361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e0aa33e8-26a7-4ad4-a998-ead0ae70b77e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:56.680904 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1606/3347] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:55 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1307 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 18:59:56.691741 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e0aa33e8-26a7-4ad4-a998-ead0ae70b77e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1405 microversion: 2.20 time: 0.372066 Oct 27 18:59:56.706727 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1742/3348] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:59:56 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:59:57.107871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-29142b60-1f49-42da-9c1e-34ea23fbfc92 req-b53de8c8-5d52-4d5c-8947-c22f4aefe181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef", "tag": "75847fa3-d16c-41e6-8a2a-ca6006e81c90"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 18:59:57.109832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-db50cca8-c80e-4b47-8b45-ee9574940693 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:57.110593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-db50cca8-c80e-4b47-8b45-ee9574940693 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:57.128771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db50cca8-c80e-4b47-8b45-ee9574940693 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:57.129985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db50cca8-c80e-4b47-8b45-ee9574940693 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:57.132452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db50cca8-c80e-4b47-8b45-ee9574940693 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:57.134654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db50cca8-c80e-4b47-8b45-ee9574940693 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:57.135486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db50cca8-c80e-4b47-8b45-ee9574940693 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:57.137723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-29142b60-1f49-42da-9c1e-34ea23fbfc92 req-b53de8c8-5d52-4d5c-8947-c22f4aefe181 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:57.139164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db50cca8-c80e-4b47-8b45-ee9574940693 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:57.140057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-29142b60-1f49-42da-9c1e-34ea23fbfc92 req-b53de8c8-5d52-4d5c-8947-c22f4aefe181 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:57.140801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-29142b60-1f49-42da-9c1e-34ea23fbfc92 req-b53de8c8-5d52-4d5c-8947-c22f4aefe181 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:57.169738 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-29142b60-1f49-42da-9c1e-34ea23fbfc92 req-b53de8c8-5d52-4d5c-8947-c22f4aefe181 service nova] Creating event network-changed:75847fa3-d16c-41e6-8a2a-ca6006e81c90 for instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef on n-h1-860687-3 Oct 27 18:59:57.179883 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-29142b60-1f49-42da-9c1e-34ea23fbfc92 req-b53de8c8-5d52-4d5c-8947-c22f4aefe181 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079695 Oct 27 18:59:57.180632 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1743/3349] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 18:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:57.226688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=26 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 18:59:57.300994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a4e1b6b-a85b-4811-9a5a-7107d3b9c008 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86b409550>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:57.341107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-db50cca8-c80e-4b47-8b45-ee9574940693 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:57.344902 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5a4e1b6b-a85b-4811-9a5a-7107d3b9c008 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d" status: 200 len: 287 microversion: 2.1 time: 0.048949 Oct 27 18:59:57.345653 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1744/3350] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 18:59:57 2022] GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 18:59:57.359100 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-db50cca8-c80e-4b47-8b45-ee9574940693 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 0.261450 Oct 27 18:59:57.360593 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1607/3351] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:57 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:57.742654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f33c28ad-107b-4b42-87a4-bf8c2f4d3199 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:57.748970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-43399fa4-509d-4d33-9dad-20e2d8e761e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:57.751030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f33c28ad-107b-4b42-87a4-bf8c2f4d3199 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:57.760552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-43399fa4-509d-4d33-9dad-20e2d8e761e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:57.772857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f33c28ad-107b-4b42-87a4-bf8c2f4d3199 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:57.779386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f33c28ad-107b-4b42-87a4-bf8c2f4d3199 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:57.780204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f33c28ad-107b-4b42-87a4-bf8c2f4d3199 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:57.793400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43399fa4-509d-4d33-9dad-20e2d8e761e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:57.794682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f33c28ad-107b-4b42-87a4-bf8c2f4d3199 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:57.795661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43399fa4-509d-4d33-9dad-20e2d8e761e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:57.796998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43399fa4-509d-4d33-9dad-20e2d8e761e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:57.797886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f33c28ad-107b-4b42-87a4-bf8c2f4d3199 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:57.799163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f33c28ad-107b-4b42-87a4-bf8c2f4d3199 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:57.800413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43399fa4-509d-4d33-9dad-20e2d8e761e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:57.800900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43399fa4-509d-4d33-9dad-20e2d8e761e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:57.801348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43399fa4-509d-4d33-9dad-20e2d8e761e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:58.181045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-43399fa4-509d-4d33-9dad-20e2d8e761e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:58.191979 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-43399fa4-509d-4d33-9dad-20e2d8e761e3 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1307 microversion: 2.1 time: 0.490390 Oct 27 18:59:58.201094 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1745/3352] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:57 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1307 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:58.360900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-49f9c96f-5b56-4ab5-ab1f-e10ff87c914f tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86b039820>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:58.406924 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-49f9c96f-5b56-4ab5-ab1f-e10ff87c914f tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] HTTP exception thrown: Snapshot eefed80f-b4c6-4252-bff8-5f531e3c161d could not be found. Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-49f9c96f-5b56-4ab5-ab1f-e10ff87c914f tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Request method failure captured: Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d HTTP/1.1 Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtUhn0qc4Nha14gQ2sRdvB6lymFqhJIvYgeIRm3w1B-j2qMH-FIkqUAwAOa60f5Vymx31xB26L-FC_RmHOL0Z8gyA0knN7NIxR3LcLZnqpIch3Rn5FispFmjlYr4DroPJE8OtYpwarPWpYZZOACIX1BBbdgECoeiYWmNwxVGv7drDig Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 14e8aad34ec140919f9ad9c2b8368b52 Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-222105307 Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14e8aad34ec140919f9ad9c2b8368b52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14e8aad34ec140919f9ad9c2b8368b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14e8aad34ec140919f9ad9c2b8368b52", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14e8aad34ec140919f9ad9c2b8368b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-VolumesSnapshotsTestJSON-222105307 Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 14e8aad34ec140919f9ad9c2b8368b52 Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-222105307 Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-VolumesSnapshotsTestJSON-222105307-project Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 20c303366b394595bc1d8d495f41e2c7 Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-VolumesSnapshotsTestJSON-222105307-project Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: exception: Snapshot eefed80f-b4c6-4252-bff8-5f531e3c161d could not be found. Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'eefed80f-b4c6-4252-bff8-5f531e3c161d'} Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot eefed80f-b4c6-4252-bff8-5f531e3c161d could not be found. (HTTP 404) (Request-ID: req-92a790fe-60f6-4ec3-a1b0-035380bd40d5) Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 18:59:58.415027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot eefed80f-b4c6-4252-bff8-5f531e3c161d could not be found. Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot eefed80f-b4c6-4252-bff8-5f531e3c161d could not be found. Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot eefed80f-b4c6-4252-bff8-5f531e3c161d could not be found. Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-49f9c96f-5b56-4ab5-ab1f-e10ff87c914f tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Returning 404 to user: Snapshot eefed80f-b4c6-4252-bff8-5f531e3c161d could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-49f9c96f-5b56-4ab5-ab1f-e10ff87c914f tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d" status: 404 len: 111 microversion: 2.1 time: 0.063228 Oct 27 18:59:58.420615 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1746/3353] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 18:59:58 2022] GET /compute/v2.1/os-snapshots/eefed80f-b4c6-4252-bff8-5f531e3c161d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 18:59:58.426505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cc109080-4a9f-4898-8b98-133a41eef875 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:58.428416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cc109080-4a9f-4898-8b98-133a41eef875 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:58.449974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc109080-4a9f-4898-8b98-133a41eef875 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:58.450784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc109080-4a9f-4898-8b98-133a41eef875 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:58.452405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc109080-4a9f-4898-8b98-133a41eef875 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:58.454460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc109080-4a9f-4898-8b98-133a41eef875 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:58.454946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc109080-4a9f-4898-8b98-133a41eef875 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:58.456583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc109080-4a9f-4898-8b98-133a41eef875 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:58.694097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f33c28ad-107b-4b42-87a4-bf8c2f4d3199 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:58.709003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f33c28ad-107b-4b42-87a4-bf8c2f4d3199 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:58.712736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f33c28ad-107b-4b42-87a4-bf8c2f4d3199 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:58.716511 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f33c28ad-107b-4b42-87a4-bf8c2f4d3199 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1405 microversion: 2.20 time: 0.996444 Oct 27 18:59:58.717933 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1608/3354] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:59:57 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1405 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 18:59:58.733590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aa3f3411-15fc-48fa-85b5-7bf4b48ecd24 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86b05e430>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:58.764544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cc109080-4a9f-4898-8b98-133a41eef875 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 18:59:58.779372 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cc109080-4a9f-4898-8b98-133a41eef875 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 0.359786 Oct 27 18:59:58.780542 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1747/3355] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:58 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 18:59:58.900481 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aa3f3411-15fc-48fa-85b5-7bf4b48ecd24 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609" status: 202 len: 0 microversion: 2.1 time: 0.176037 Oct 27 18:59:58.901412 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1609/3356] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 18:59:58 2022] DELETE /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 18:59:58.909725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-181876b3-0407-4016-80a6-2f1457eb0ad9 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86b292ee0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:59.076215 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-181876b3-0407-4016-80a6-2f1457eb0ad9 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609" status: 200 len: 344 microversion: 2.1 time: 0.169966 Oct 27 18:59:59.077636 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1748/3357] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 18:59:58 2022] GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 18:59:59.222597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-475d8b3b-7f06-4cdc-9fbe-09d2b13d25a5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:59.223841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-475d8b3b-7f06-4cdc-9fbe-09d2b13d25a5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:59.237835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-475d8b3b-7f06-4cdc-9fbe-09d2b13d25a5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:59.239279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-475d8b3b-7f06-4cdc-9fbe-09d2b13d25a5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:59.244003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-475d8b3b-7f06-4cdc-9fbe-09d2b13d25a5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:59.246910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-475d8b3b-7f06-4cdc-9fbe-09d2b13d25a5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:59.247699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-475d8b3b-7f06-4cdc-9fbe-09d2b13d25a5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:59.248863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-475d8b3b-7f06-4cdc-9fbe-09d2b13d25a5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:59.746214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7e119bd7-e5b7-46fb-b852-1c9076a37676 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 18:59:59.747711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7e119bd7-e5b7-46fb-b852-1c9076a37676 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 18:59:59.762828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e119bd7-e5b7-46fb-b852-1c9076a37676 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:59.763797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e119bd7-e5b7-46fb-b852-1c9076a37676 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:59.764426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e119bd7-e5b7-46fb-b852-1c9076a37676 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:59.765325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e119bd7-e5b7-46fb-b852-1c9076a37676 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 18:59:59.765958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e119bd7-e5b7-46fb-b852-1c9076a37676 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 18:59:59.769813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e119bd7-e5b7-46fb-b852-1c9076a37676 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 18:59:59.783594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:00.092690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7e119bd7-e5b7-46fb-b852-1c9076a37676 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:00.105045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7e119bd7-e5b7-46fb-b852-1c9076a37676 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:00.114332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7e119bd7-e5b7-46fb-b852-1c9076a37676 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:00.116842 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7e119bd7-e5b7-46fb-b852-1c9076a37676 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1405 microversion: 2.20 time: 0.375293 Oct 27 19:00:00.118079 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1749/3358] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 18:59:59 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1405 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:00.132431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9ab4ce28-1125-4a39-b3cb-73a8c8fcd2cc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:00.133365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9ab4ce28-1125-4a39-b3cb-73a8c8fcd2cc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:00.147427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ab4ce28-1125-4a39-b3cb-73a8c8fcd2cc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:00.160792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ab4ce28-1125-4a39-b3cb-73a8c8fcd2cc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:00.161539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ab4ce28-1125-4a39-b3cb-73a8c8fcd2cc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:00.162535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ab4ce28-1125-4a39-b3cb-73a8c8fcd2cc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:00.163504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ab4ce28-1125-4a39-b3cb-73a8c8fcd2cc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:00.164485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ab4ce28-1125-4a39-b3cb-73a8c8fcd2cc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:00.421616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9ab4ce28-1125-4a39-b3cb-73a8c8fcd2cc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:00.437605 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9ab4ce28-1125-4a39-b3cb-73a8c8fcd2cc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 0.314788 Oct 27 19:00:00.451934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-475d8b3b-7f06-4cdc-9fbe-09d2b13d25a5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:00.463930 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1750/3359] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:00 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:00.472259 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-475d8b3b-7f06-4cdc-9fbe-09d2b13d25a5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1307 microversion: 2.1 time: 1.249614 Oct 27 19:00:00.483627 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1610/3360] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 18:59:59 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1307 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:00.489457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e326f7ed-0d6e-4c9d-9e6a-07a0c848cfde tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86bac2e50>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:00.500948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ee555ed3-7def-4b2a-9941-c928305eb7ab req-ff12929e-bd41-4bba-a884-cae7e8a70187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a7713a-b78d-425e-a6e8-0e4f5bc8904b", "name": "network-vif-plugged", "status": "completed", "tag": "9f402fdb-d277-4b7a-b6cc-275f32214caf"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:00.514775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ee555ed3-7def-4b2a-9941-c928305eb7ab req-ff12929e-bd41-4bba-a884-cae7e8a70187 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:00.516024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ee555ed3-7def-4b2a-9941-c928305eb7ab req-ff12929e-bd41-4bba-a884-cae7e8a70187 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:00.516716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ee555ed3-7def-4b2a-9941-c928305eb7ab req-ff12929e-bd41-4bba-a884-cae7e8a70187 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:00.533183 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ee555ed3-7def-4b2a-9941-c928305eb7ab req-ff12929e-bd41-4bba-a884-cae7e8a70187 service nova] Creating event network-vif-plugged:9f402fdb-d277-4b7a-b6cc-275f32214caf for instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b on n-h1-860687-3 Oct 27 19:00:00.540651 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ee555ed3-7def-4b2a-9941-c928305eb7ab req-ff12929e-bd41-4bba-a884-cae7e8a70187 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047220 Oct 27 19:00:00.542403 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1611/3361] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:00.625411 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e326f7ed-0d6e-4c9d-9e6a-07a0c848cfde tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609" status: 200 len: 344 microversion: 2.1 time: 0.159157 Oct 27 19:00:00.633129 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1751/3362] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:00:00 2022] GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 => generated 344 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:01.146202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-95b4dd3f-ac1c-4e1b-90de-2d5de522495d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:01.147066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-95b4dd3f-ac1c-4e1b-90de-2d5de522495d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:01.159809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b4dd3f-ac1c-4e1b-90de-2d5de522495d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:01.166057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b4dd3f-ac1c-4e1b-90de-2d5de522495d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:01.166684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b4dd3f-ac1c-4e1b-90de-2d5de522495d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:01.173985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b4dd3f-ac1c-4e1b-90de-2d5de522495d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:01.177932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b4dd3f-ac1c-4e1b-90de-2d5de522495d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:01.178532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b4dd3f-ac1c-4e1b-90de-2d5de522495d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:01.469520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a317feb2-7551-40e5-980f-b64047303068 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:01.471222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a317feb2-7551-40e5-980f-b64047303068 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:01.489495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a317feb2-7551-40e5-980f-b64047303068 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:01.501926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a317feb2-7551-40e5-980f-b64047303068 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:01.512069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a317feb2-7551-40e5-980f-b64047303068 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:01.512412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a317feb2-7551-40e5-980f-b64047303068 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:01.513215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a317feb2-7551-40e5-980f-b64047303068 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:01.513834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a317feb2-7551-40e5-980f-b64047303068 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:01.907539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-95b4dd3f-ac1c-4e1b-90de-2d5de522495d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:01.913811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-95b4dd3f-ac1c-4e1b-90de-2d5de522495d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:01.918877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-95b4dd3f-ac1c-4e1b-90de-2d5de522495d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:01.923661 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-95b4dd3f-ac1c-4e1b-90de-2d5de522495d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1405 microversion: 2.20 time: 0.781977 Oct 27 19:00:01.925118 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1612/3363] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:01 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1405 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:01.947120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dfd36618-82d2-4530-b5f3-f44b18119d54 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:01.948847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dfd36618-82d2-4530-b5f3-f44b18119d54 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:01.951274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:01.962707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfd36618-82d2-4530-b5f3-f44b18119d54 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:01.963551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfd36618-82d2-4530-b5f3-f44b18119d54 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:01.964517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfd36618-82d2-4530-b5f3-f44b18119d54 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:01.965730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfd36618-82d2-4530-b5f3-f44b18119d54 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:01.966424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfd36618-82d2-4530-b5f3-f44b18119d54 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:01.967077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfd36618-82d2-4530-b5f3-f44b18119d54 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:02.616381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a317feb2-7551-40e5-980f-b64047303068 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:02.631254 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a317feb2-7551-40e5-980f-b64047303068 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 1.165508 Oct 27 19:00:02.633103 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1752/3364] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:01 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:02.643237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-29473be1-86dc-4294-887b-9755fe0c739e tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86ad35280>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:02.851643 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-29473be1-86dc-4294-887b-9755fe0c739e tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609" status: 200 len: 344 microversion: 2.1 time: 0.212254 Oct 27 19:00:02.853298 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1753/3365] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:00:02 2022] GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:02.953063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4b3045fd-c833-4c1d-b46b-f8a4fbb2c727 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:02.953689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4b3045fd-c833-4c1d-b46b-f8a4fbb2c727 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:02.963799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4b3045fd-c833-4c1d-b46b-f8a4fbb2c727 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:02.964309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4b3045fd-c833-4c1d-b46b-f8a4fbb2c727 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:02.964762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4b3045fd-c833-4c1d-b46b-f8a4fbb2c727 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:02.965490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4b3045fd-c833-4c1d-b46b-f8a4fbb2c727 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:02.971176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4b3045fd-c833-4c1d-b46b-f8a4fbb2c727 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:02.971644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4b3045fd-c833-4c1d-b46b-f8a4fbb2c727 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:03.207700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dfd36618-82d2-4530-b5f3-f44b18119d54 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:03.218634 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dfd36618-82d2-4530-b5f3-f44b18119d54 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1307 microversion: 2.1 time: 1.290632 Oct 27 19:00:03.239620 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1613/3366] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:01 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1307 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:03.367887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4b3045fd-c833-4c1d-b46b-f8a4fbb2c727 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:03.385476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4b3045fd-c833-4c1d-b46b-f8a4fbb2c727 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:03.390164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4b3045fd-c833-4c1d-b46b-f8a4fbb2c727 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:03.394207 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4b3045fd-c833-4c1d-b46b-f8a4fbb2c727 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1597 microversion: 2.20 time: 0.446891 Oct 27 19:00:03.396793 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1754/3367] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:02 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1597 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:03.426581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-beb47239-bbaf-4a20-8f57-5a620ae3793d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:03.427258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-beb47239-bbaf-4a20-8f57-5a620ae3793d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:03.450512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beb47239-bbaf-4a20-8f57-5a620ae3793d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:03.451427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beb47239-bbaf-4a20-8f57-5a620ae3793d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:03.452075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beb47239-bbaf-4a20-8f57-5a620ae3793d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:03.453432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beb47239-bbaf-4a20-8f57-5a620ae3793d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:03.455071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beb47239-bbaf-4a20-8f57-5a620ae3793d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:03.456741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beb47239-bbaf-4a20-8f57-5a620ae3793d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:03.662734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-344bc6d3-4f3e-4cfa-9f71-f44dd4277c13 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:03.664236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-344bc6d3-4f3e-4cfa-9f71-f44dd4277c13 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:03.692195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-344bc6d3-4f3e-4cfa-9f71-f44dd4277c13 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:03.697192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-344bc6d3-4f3e-4cfa-9f71-f44dd4277c13 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:03.699619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-344bc6d3-4f3e-4cfa-9f71-f44dd4277c13 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:03.703415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-344bc6d3-4f3e-4cfa-9f71-f44dd4277c13 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:03.704178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-344bc6d3-4f3e-4cfa-9f71-f44dd4277c13 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:03.707526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-344bc6d3-4f3e-4cfa-9f71-f44dd4277c13 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:03.880344 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-beb47239-bbaf-4a20-8f57-5a620ae3793d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.455323 Oct 27 19:00:03.881847 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1614/3368] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Oct 27 19:00:03 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-interface => generated 284 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:00:03.899304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-da05f2e9-7d05-4d73-9eb4-0f7fc81bfdea tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86a391790>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:04.117700 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-da05f2e9-7d05-4d73-9eb4-0f7fc81bfdea tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609" status: 200 len: 344 microversion: 2.1 time: 0.234180 Oct 27 19:00:04.118518 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1615/3369] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:00:03 2022] GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 => generated 344 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:04.239467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-344bc6d3-4f3e-4cfa-9f71-f44dd4277c13 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:04.247032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-052fecd0-409b-42d1-9abc-80e49aff2f72 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:04.248347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-052fecd0-409b-42d1-9abc-80e49aff2f72 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:04.256768 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-344bc6d3-4f3e-4cfa-9f71-f44dd4277c13 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 0.600869 Oct 27 19:00:04.275206 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1755/3370] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:03 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:04.283739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-052fecd0-409b-42d1-9abc-80e49aff2f72 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:04.284261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-052fecd0-409b-42d1-9abc-80e49aff2f72 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:04.284920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-052fecd0-409b-42d1-9abc-80e49aff2f72 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:04.285838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-052fecd0-409b-42d1-9abc-80e49aff2f72 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:04.286512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-052fecd0-409b-42d1-9abc-80e49aff2f72 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:04.287115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-052fecd0-409b-42d1-9abc-80e49aff2f72 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:05.055284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-052fecd0-409b-42d1-9abc-80e49aff2f72 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:05.065513 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-052fecd0-409b-42d1-9abc-80e49aff2f72 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1307 microversion: 2.1 time: 0.825191 Oct 27 19:00:05.095451 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1616/3371] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:04 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1307 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:05.134795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7c5f03c6-601a-4dab-972f-352233dd4616 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86bac2280>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:05.209821 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-7c5f03c6-601a-4dab-972f-352233dd4616 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] HTTP exception thrown: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7c5f03c6-601a-4dab-972f-352233dd4616 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Request method failure captured: Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 HTTP/1.1 Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtUhn0qc4Nha14gQ2sRdvB6lymFqhJIvYgeIRm3w1B-j2qMH-FIkqUAwAOa60f5Vymx31xB26L-FC_RmHOL0Z8gyA0knN7NIxR3LcLZnqpIch3Rn5FispFmjlYr4DroPJE8OtYpwarPWpYZZOACIX1BBbdgECoeiYWmNwxVGv7drDig Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 14e8aad34ec140919f9ad9c2b8368b52 Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-222105307 Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14e8aad34ec140919f9ad9c2b8368b52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14e8aad34ec140919f9ad9c2b8368b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14e8aad34ec140919f9ad9c2b8368b52", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14e8aad34ec140919f9ad9c2b8368b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-VolumesSnapshotsTestJSON-222105307 Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 14e8aad34ec140919f9ad9c2b8368b52 Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-222105307 Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-VolumesSnapshotsTestJSON-222105307-project Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 20c303366b394595bc1d8d495f41e2c7 Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-VolumesSnapshotsTestJSON-222105307-project Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: exception: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609'} Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. (HTTP 404) (Request-ID: req-982e8d4b-20ac-4ea8-9bf6-a2e2b8724b1b) Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 19:00:05.212525 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7c5f03c6-601a-4dab-972f-352233dd4616 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Returning 404 to user: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7c5f03c6-601a-4dab-972f-352233dd4616 tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609" status: 404 len: 109 microversion: 2.1 time: 0.085541 Oct 27 19:00:05.220882 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1756/3372] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:00:05 2022] GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:00:05.233258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9851ef7-0283-4a46-8c0e-4532040e037e tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc86a38f8b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:05.290195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c0a41ac9-6e3b-4f52-bc68-0f21aeec1767 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:05.290857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c0a41ac9-6e3b-4f52-bc68-0f21aeec1767 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:05.306565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0a41ac9-6e3b-4f52-bc68-0f21aeec1767 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:05.307078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0a41ac9-6e3b-4f52-bc68-0f21aeec1767 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:05.308073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0a41ac9-6e3b-4f52-bc68-0f21aeec1767 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:05.308806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0a41ac9-6e3b-4f52-bc68-0f21aeec1767 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:05.309273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0a41ac9-6e3b-4f52-bc68-0f21aeec1767 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:05.309716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0a41ac9-6e3b-4f52-bc68-0f21aeec1767 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:05.316550 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-c9851ef7-0283-4a46-8c0e-4532040e037e tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] HTTP exception thrown: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9851ef7-0283-4a46-8c0e-4532040e037e tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Request method failure captured: Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 HTTP/1.1 Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtUhn0qc4Nha14gQ2sRdvB6lymFqhJIvYgeIRm3w1B-j2qMH-FIkqUAwAOa60f5Vymx31xB26L-FC_RmHOL0Z8gyA0knN7NIxR3LcLZnqpIch3Rn5FispFmjlYr4DroPJE8OtYpwarPWpYZZOACIX1BBbdgECoeiYWmNwxVGv7drDig Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 14e8aad34ec140919f9ad9c2b8368b52 Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-222105307 Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14e8aad34ec140919f9ad9c2b8368b52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14e8aad34ec140919f9ad9c2b8368b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14e8aad34ec140919f9ad9c2b8368b52", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14e8aad34ec140919f9ad9c2b8368b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-VolumesSnapshotsTestJSON-222105307 Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 14e8aad34ec140919f9ad9c2b8368b52 Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-222105307 Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-VolumesSnapshotsTestJSON-222105307-project Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 20c303366b394595bc1d8d495f41e2c7 Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-VolumesSnapshotsTestJSON-222105307-project Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: exception: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609'} Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. (HTTP 404) (Request-ID: req-b383aa65-3df0-4da3-aede-1e4653626636) Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 19:00:05.318835 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9851ef7-0283-4a46-8c0e-4532040e037e tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Returning 404 to user: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c9851ef7-0283-4a46-8c0e-4532040e037e tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609" status: 404 len: 109 microversion: 2.1 time: 0.095075 Oct 27 19:00:05.324351 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1617/3373] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 19:00:05 2022] DELETE /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:00:05.333056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-06772873-1c8c-452b-b9c9-302ad657dbdc tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Calling method '.version_select at 0x7fc8733949d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:05.406473 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-06772873-1c8c-452b-b9c9-302ad657dbdc tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] HTTP exception thrown: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-06772873-1c8c-452b-b9c9-302ad657dbdc tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Request method failure captured: Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 HTTP/1.1 Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtUhn0qc4Nha14gQ2sRdvB6lymFqhJIvYgeIRm3w1B-j2qMH-FIkqUAwAOa60f5Vymx31xB26L-FC_RmHOL0Z8gyA0knN7NIxR3LcLZnqpIch3Rn5FispFmjlYr4DroPJE8OtYpwarPWpYZZOACIX1BBbdgECoeiYWmNwxVGv7drDig Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 14e8aad34ec140919f9ad9c2b8368b52 Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-222105307 Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14e8aad34ec140919f9ad9c2b8368b52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14e8aad34ec140919f9ad9c2b8368b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14e8aad34ec140919f9ad9c2b8368b52", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14e8aad34ec140919f9ad9c2b8368b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-VolumesSnapshotsTestJSON-222105307 Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 14e8aad34ec140919f9ad9c2b8368b52 Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-222105307 Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-VolumesSnapshotsTestJSON-222105307-project Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 20c303366b394595bc1d8d495f41e2c7 Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-VolumesSnapshotsTestJSON-222105307-project Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: exception: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609'} Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. (HTTP 404) (Request-ID: req-453fc4c7-e5db-4c75-a3c5-e936d5f9764c) Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 19:00:05.408902 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. Oct 27 19:00:05.414107 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:05.420624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-06772873-1c8c-452b-b9c9-302ad657dbdc tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] Returning 404 to user: Volume f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:05.420624 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-06772873-1c8c-452b-b9c9-302ad657dbdc tempest-VolumesSnapshotsTestJSON-222105307 tempest-VolumesSnapshotsTestJSON-222105307-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609" status: 404 len: 109 microversion: 2.1 time: 0.091618 Oct 27 19:00:05.420624 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1618/3374] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:00:05 2022] GET /compute/v2.1/os-volumes/f17eb6a4-0c5c-42a7-b6b0-c7d20cd32609 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:00:05.974229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c0a41ac9-6e3b-4f52-bc68-0f21aeec1767 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:05.987612 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c0a41ac9-6e3b-4f52-bc68-0f21aeec1767 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 0.699902 Oct 27 19:00:05.991374 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1757/3375] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:05 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:06.095769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-391a9303-e488-4a29-ad57-5dc1fd0893ee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:06.096540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-391a9303-e488-4a29-ad57-5dc1fd0893ee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:06.117961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-391a9303-e488-4a29-ad57-5dc1fd0893ee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:06.126640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-391a9303-e488-4a29-ad57-5dc1fd0893ee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:06.127244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-391a9303-e488-4a29-ad57-5dc1fd0893ee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:06.131509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-391a9303-e488-4a29-ad57-5dc1fd0893ee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:06.132434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-391a9303-e488-4a29-ad57-5dc1fd0893ee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:06.133118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-391a9303-e488-4a29-ad57-5dc1fd0893ee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:07.010829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-551a0af2-86da-4122-a800-c85c38b2a0d7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:07.011772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-551a0af2-86da-4122-a800-c85c38b2a0d7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:07.020851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=85 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:07.025750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-551a0af2-86da-4122-a800-c85c38b2a0d7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:07.027334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-551a0af2-86da-4122-a800-c85c38b2a0d7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:07.027963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-551a0af2-86da-4122-a800-c85c38b2a0d7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:07.046713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-551a0af2-86da-4122-a800-c85c38b2a0d7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:07.047843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-551a0af2-86da-4122-a800-c85c38b2a0d7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:07.049085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-551a0af2-86da-4122-a800-c85c38b2a0d7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:07.716059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-391a9303-e488-4a29-ad57-5dc1fd0893ee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:07.732713 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-391a9303-e488-4a29-ad57-5dc1fd0893ee tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1307 microversion: 2.1 time: 1.634966 Oct 27 19:00:07.733863 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1619/3376] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:06 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1307 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:07.941642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-72a7c5ff-c6d0-4666-8124-81a626ea6ec9 req-a02b1d8b-78f4-4067-aee2-402f5662ea86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a7713a-b78d-425e-a6e8-0e4f5bc8904b", "tag": "9f402fdb-d277-4b7a-b6cc-275f32214caf"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:07.962224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-72a7c5ff-c6d0-4666-8124-81a626ea6ec9 req-a02b1d8b-78f4-4067-aee2-402f5662ea86 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:07.964925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-72a7c5ff-c6d0-4666-8124-81a626ea6ec9 req-a02b1d8b-78f4-4067-aee2-402f5662ea86 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:07.965887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-72a7c5ff-c6d0-4666-8124-81a626ea6ec9 req-a02b1d8b-78f4-4067-aee2-402f5662ea86 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:07.978849 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-72a7c5ff-c6d0-4666-8124-81a626ea6ec9 req-a02b1d8b-78f4-4067-aee2-402f5662ea86 service nova] Creating event network-changed:9f402fdb-d277-4b7a-b6cc-275f32214caf for instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b on n-h1-860687-3 Oct 27 19:00:07.985699 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-72a7c5ff-c6d0-4666-8124-81a626ea6ec9 req-a02b1d8b-78f4-4067-aee2-402f5662ea86 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047742 Oct 27 19:00:07.986916 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1620/3377] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:00:08.196210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-551a0af2-86da-4122-a800-c85c38b2a0d7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:08.220795 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-551a0af2-86da-4122-a800-c85c38b2a0d7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 1.213306 Oct 27 19:00:08.237226 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1758/3378] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:07 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:08.764256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cda24e07-9987-41ac-8c7a-3e0b7b38b251 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:08.765530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cda24e07-9987-41ac-8c7a-3e0b7b38b251 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:08.783012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cda24e07-9987-41ac-8c7a-3e0b7b38b251 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:08.783435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cda24e07-9987-41ac-8c7a-3e0b7b38b251 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:08.783895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cda24e07-9987-41ac-8c7a-3e0b7b38b251 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:08.800381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cda24e07-9987-41ac-8c7a-3e0b7b38b251 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:08.801417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cda24e07-9987-41ac-8c7a-3e0b7b38b251 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:08.805367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cda24e07-9987-41ac-8c7a-3e0b7b38b251 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:09.247104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-92a1ba17-4d0c-4371-8943-2fd73e516a73 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:09.248428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-92a1ba17-4d0c-4371-8943-2fd73e516a73 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:09.284538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92a1ba17-4d0c-4371-8943-2fd73e516a73 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:09.286252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92a1ba17-4d0c-4371-8943-2fd73e516a73 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:09.290446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92a1ba17-4d0c-4371-8943-2fd73e516a73 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:09.294595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92a1ba17-4d0c-4371-8943-2fd73e516a73 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:09.295496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92a1ba17-4d0c-4371-8943-2fd73e516a73 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:09.296372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92a1ba17-4d0c-4371-8943-2fd73e516a73 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:09.431564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cda24e07-9987-41ac-8c7a-3e0b7b38b251 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:09.443875 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cda24e07-9987-41ac-8c7a-3e0b7b38b251 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1307 microversion: 2.1 time: 0.682708 Oct 27 19:00:09.445420 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1621/3379] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:08 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1307 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:09.577248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-92a1ba17-4d0c-4371-8943-2fd73e516a73 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:09.595315 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-92a1ba17-4d0c-4371-8943-2fd73e516a73 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 0.354203 Oct 27 19:00:09.599365 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1759/3380] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:09 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:10.474309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7ea3568-92a5-44bf-8020-85f39fc29e26 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:10.475478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a7ea3568-92a5-44bf-8020-85f39fc29e26 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:10.502908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7ea3568-92a5-44bf-8020-85f39fc29e26 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:10.504096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7ea3568-92a5-44bf-8020-85f39fc29e26 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:10.509642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7ea3568-92a5-44bf-8020-85f39fc29e26 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:10.515428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7ea3568-92a5-44bf-8020-85f39fc29e26 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:10.516374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7ea3568-92a5-44bf-8020-85f39fc29e26 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:10.517299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7ea3568-92a5-44bf-8020-85f39fc29e26 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:10.632034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2cb4f714-eea5-4b6d-86e0-885adf6aeca5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:10.633281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2cb4f714-eea5-4b6d-86e0-885adf6aeca5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:10.652960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2cb4f714-eea5-4b6d-86e0-885adf6aeca5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:10.653783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2cb4f714-eea5-4b6d-86e0-885adf6aeca5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:10.654598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2cb4f714-eea5-4b6d-86e0-885adf6aeca5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:10.655555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2cb4f714-eea5-4b6d-86e0-885adf6aeca5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:10.656272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2cb4f714-eea5-4b6d-86e0-885adf6aeca5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:10.656891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2cb4f714-eea5-4b6d-86e0-885adf6aeca5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:11.094148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2cb4f714-eea5-4b6d-86e0-885adf6aeca5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:11.103844 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2cb4f714-eea5-4b6d-86e0-885adf6aeca5 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1503 microversion: 2.1 time: 0.477363 Oct 27 19:00:11.122955 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1760/3381] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:10 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1503 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:11.124410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f699470a-4967-4213-abee-c3b807444e20 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Action: 'create', calling method: .version_select at 0x7fc86ab6bee0>, body: {"keypair": {"name": "tempest-keypair-1412603031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEFxKC8YiEVjYnsSGT/7N4BGRojlzTLrfubK6k908u9mMSHhZug9pzM6NoEiuZ3S2VA5nXnOzTPEXHq76l9D3jZ9G2ExIcS7GjGErL4Nn0hnw+5Vg6q01Z9yWEkT/68EQ=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:11.180787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a7ea3568-92a5-44bf-8020-85f39fc29e26 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:11.187837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-f699470a-4967-4213-abee-c3b807444e20 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Getting quotas for project 530ba49ebcd34fdf954a813de6fdc501. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:00:11.192708 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7ea3568-92a5-44bf-8020-85f39fc29e26 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1307 microversion: 2.1 time: 0.723852 Oct 27 19:00:11.206477 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1622/3382] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:10 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1307 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:11.206477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d3576fe9-60b6-4432-a660-ef52f9e87e6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66a51c75-5d41-47c1-8f4e-5b0d08c09d8e"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:11.207843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d3576fe9-60b6-4432-a660-ef52f9e87e6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:11.216868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-f699470a-4967-4213-abee-c3b807444e20 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Getting quotas for user 7ee8aa94e9b046babadd8dc67177a487 and project 530ba49ebcd34fdf954a813de6fdc501. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:00:11.231023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3576fe9-60b6-4432-a660-ef52f9e87e6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:11.232300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3576fe9-60b6-4432-a660-ef52f9e87e6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:11.232756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3576fe9-60b6-4432-a660-ef52f9e87e6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:11.233496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3576fe9-60b6-4432-a660-ef52f9e87e6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:11.233965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3576fe9-60b6-4432-a660-ef52f9e87e6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:11.234434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3576fe9-60b6-4432-a660-ef52f9e87e6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:11.270069 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f699470a-4967-4213-abee-c3b807444e20 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.157416 Oct 27 19:00:11.277830 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1761/3383] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Oct 27 19:00:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 19:00:11.304402 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d3576fe9-60b6-4432-a660-ef52f9e87e6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] HTTP exception thrown: Cannot 'attach_volume' instance fd8ee1a0-1df0-4488-bffd-1406e9762843 while it is in vm_state rescued Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d3576fe9-60b6-4432-a660-ef52f9e87e6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Request method failure captured: Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843/os-volume_attachments HTTP/1.1 Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 74 Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtTOhZ4eSrUIbh7FOH8abPh8o6s1SrCC6rl-rUyuXuq1ygfePdb0jYAcyGuJrVudmd8OxoZzpYzhODw3ejjYW0-ti5IZ9xJMsPzlMbC7OoicnuCUnW_JwGkg6OKXbZMBkqYeQENn4eoxSAgVgRaELA_KPYJgZbVCfoUL02eTSzGcONI Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_adeacece438645c4a0c5844d1ef83793", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2b706e9394a642cda315809db15ecbb3 Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: {"volumeAttachment": {"volumeId": "66a51c75-5d41-47c1-8f4e-5b0d08c09d8e"}} Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: exception: Cannot 'attach_volume' instance fd8ee1a0-1df0-4488-bffd-1406e9762843 while it is in vm_state rescued Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'server_id': 'fd8ee1a0-1df0-4488-bffd-1406e9762843', 'body': {'volumeAttachment': {'volumeId': '66a51c75-5d41-47c1-8f4e-5b0d08c09d8e'}}} Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fd8ee1a0-1df0-4488-bffd-1406e9762843 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 27 19:00:11.311786 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 19:00:11.316187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 19:00:11.316187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 19:00:11.316187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fd8ee1a0-1df0-4488-bffd-1406e9762843 while it is in vm_state rescued Oct 27 19:00:11.316187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:11.316187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:11.316187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:11.316187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:11.316187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:11.316187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:11.316187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:11.316187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:11.316187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fd8ee1a0-1df0-4488-bffd-1406e9762843 while it is in vm_state rescued Oct 27 19:00:11.316187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:11.323326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d3576fe9-60b6-4432-a660-ef52f9e87e6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Returning 409 to user: Cannot 'attach_volume' instance fd8ee1a0-1df0-4488-bffd-1406e9762843 while it is in vm_state rescued {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:11.327209 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d3576fe9-60b6-4432-a660-ef52f9e87e6e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.127941 Oct 27 19:00:11.329954 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1623/3384] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:00:11 2022] POST /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843/os-volume_attachments => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:00:11.348492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7d15e73e-d5df-470c-85d8-6a731590fdff tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:11.350193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7d15e73e-d5df-470c-85d8-6a731590fdff tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:11.359498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d15e73e-d5df-470c-85d8-6a731590fdff tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:11.363891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d15e73e-d5df-470c-85d8-6a731590fdff tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:11.364986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d15e73e-d5df-470c-85d8-6a731590fdff tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:11.367292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d15e73e-d5df-470c-85d8-6a731590fdff tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:11.368718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d15e73e-d5df-470c-85d8-6a731590fdff tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:11.369412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d15e73e-d5df-470c-85d8-6a731590fdff tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:11.529972 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7d15e73e-d5df-470c-85d8-6a731590fdff tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843/action" status: 202 len: 0 microversion: 2.1 time: 0.190521 Oct 27 19:00:11.532535 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1762/3385] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:00:11 2022] POST /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:00:11.541097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ab48936f-fa1e-4315-ab61-09b380e3d85b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:11.542838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ab48936f-fa1e-4315-ab61-09b380e3d85b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:11.575644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab48936f-fa1e-4315-ab61-09b380e3d85b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:11.576222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab48936f-fa1e-4315-ab61-09b380e3d85b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:11.576781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab48936f-fa1e-4315-ab61-09b380e3d85b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:11.580806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab48936f-fa1e-4315-ab61-09b380e3d85b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:11.583423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab48936f-fa1e-4315-ab61-09b380e3d85b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:11.586142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab48936f-fa1e-4315-ab61-09b380e3d85b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:12.075999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ab48936f-fa1e-4315-ab61-09b380e3d85b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:12.090624 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ab48936f-fa1e-4315-ab61-09b380e3d85b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1511 microversion: 2.1 time: 0.554872 Oct 27 19:00:12.091527 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1624/3386] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:11 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1511 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:12.225669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6d4ca03d-8748-4bb5-ac32-dc75dff2b696 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:12.226413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6d4ca03d-8748-4bb5-ac32-dc75dff2b696 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:12.245686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d4ca03d-8748-4bb5-ac32-dc75dff2b696 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:12.246233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d4ca03d-8748-4bb5-ac32-dc75dff2b696 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:12.246867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d4ca03d-8748-4bb5-ac32-dc75dff2b696 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:12.248543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d4ca03d-8748-4bb5-ac32-dc75dff2b696 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:12.252275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d4ca03d-8748-4bb5-ac32-dc75dff2b696 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:12.253048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d4ca03d-8748-4bb5-ac32-dc75dff2b696 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:12.680419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6d4ca03d-8748-4bb5-ac32-dc75dff2b696 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:12.697051 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6d4ca03d-8748-4bb5-ac32-dc75dff2b696 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1307 microversion: 2.1 time: 0.477593 Oct 27 19:00:12.698463 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1763/3387] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:12 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1307 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:13.116254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d334ef97-a7e3-40db-b4e7-bd2baf48be53 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:13.116891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d334ef97-a7e3-40db-b4e7-bd2baf48be53 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:13.127883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d334ef97-a7e3-40db-b4e7-bd2baf48be53 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:13.137356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d334ef97-a7e3-40db-b4e7-bd2baf48be53 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:13.138041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d334ef97-a7e3-40db-b4e7-bd2baf48be53 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:13.139051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d334ef97-a7e3-40db-b4e7-bd2baf48be53 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:13.139720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d334ef97-a7e3-40db-b4e7-bd2baf48be53 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:13.140373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d334ef97-a7e3-40db-b4e7-bd2baf48be53 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:13.501330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d334ef97-a7e3-40db-b4e7-bd2baf48be53 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:13.513363 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d334ef97-a7e3-40db-b4e7-bd2baf48be53 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1511 microversion: 2.1 time: 0.400647 Oct 27 19:00:13.527942 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1625/3388] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:13 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1511 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:13.720549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5be24f58-a99b-4c8f-9b13-a21ad7dd64ef tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:13.722877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5be24f58-a99b-4c8f-9b13-a21ad7dd64ef tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:13.740376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5be24f58-a99b-4c8f-9b13-a21ad7dd64ef tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:13.740893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5be24f58-a99b-4c8f-9b13-a21ad7dd64ef tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:13.741384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5be24f58-a99b-4c8f-9b13-a21ad7dd64ef tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:13.746064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5be24f58-a99b-4c8f-9b13-a21ad7dd64ef tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:13.746850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5be24f58-a99b-4c8f-9b13-a21ad7dd64ef tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:13.747316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5be24f58-a99b-4c8f-9b13-a21ad7dd64ef tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:14.094718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5be24f58-a99b-4c8f-9b13-a21ad7dd64ef tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:14.103408 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5be24f58-a99b-4c8f-9b13-a21ad7dd64ef tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1307 microversion: 2.1 time: 0.387629 Oct 27 19:00:14.105546 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1764/3389] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:13 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1307 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:14.543038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c23b1ea6-a0df-4c9a-9171-cea64783ba3f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:14.544490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c23b1ea6-a0df-4c9a-9171-cea64783ba3f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:14.571299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c23b1ea6-a0df-4c9a-9171-cea64783ba3f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:14.574322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c23b1ea6-a0df-4c9a-9171-cea64783ba3f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:14.575323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c23b1ea6-a0df-4c9a-9171-cea64783ba3f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:14.576085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c23b1ea6-a0df-4c9a-9171-cea64783ba3f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:14.585549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c23b1ea6-a0df-4c9a-9171-cea64783ba3f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:14.587658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c23b1ea6-a0df-4c9a-9171-cea64783ba3f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:14.792523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-2e448dcc-d68e-4385-8c3e-9cd7e2fd2546 req-795bfc38-f676-4750-abc6-fe82a338d343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef", "name": "network-vif-plugged", "status": "completed", "tag": "75847fa3-d16c-41e6-8a2a-ca6006e81c90"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:14.837749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2e448dcc-d68e-4385-8c3e-9cd7e2fd2546 req-795bfc38-f676-4750-abc6-fe82a338d343 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:14.838249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2e448dcc-d68e-4385-8c3e-9cd7e2fd2546 req-795bfc38-f676-4750-abc6-fe82a338d343 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:14.838826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2e448dcc-d68e-4385-8c3e-9cd7e2fd2546 req-795bfc38-f676-4750-abc6-fe82a338d343 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:14.865528 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-2e448dcc-d68e-4385-8c3e-9cd7e2fd2546 req-795bfc38-f676-4750-abc6-fe82a338d343 service nova] Creating event network-vif-plugged:75847fa3-d16c-41e6-8a2a-ca6006e81c90 for instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef on n-h1-860687-3 Oct 27 19:00:14.882319 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-2e448dcc-d68e-4385-8c3e-9cd7e2fd2546 req-795bfc38-f676-4750-abc6-fe82a338d343 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100148 Oct 27 19:00:14.887443 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1765/3390] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:14.903217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c23b1ea6-a0df-4c9a-9171-cea64783ba3f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:14.930032 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c23b1ea6-a0df-4c9a-9171-cea64783ba3f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1511 microversion: 2.1 time: 0.386716 Oct 27 19:00:14.936906 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1626/3391] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:14 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1511 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:15.077716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2083037171", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f9cbb913-194f-40e1-a976-5bb8fb5ed17c"}, {"port": "41d0cb52-ad80-4f03-87b2-5cf3ba5d9aa8", "tag": "port-1"}, {"port": "2a34a33b-11c6-4dcd-a52b-4a26af50fc18", "tag": "port-2"}, {"uuid": "3b67e9b3-1fdf-436c-b45e-ff393076eb5f", "tag": "net-1"}, {"uuid": "3b67e9b3-1fdf-436c-b45e-ff393076eb5f"}, {"uuid": "43093778-6085-4970-ae66-4ac37ad9afd2", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "43093778-6085-4970-ae66-4ac37ad9afd2", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "64da08d9-05da-46f0-a5a8-622da5db8981", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "fa0ea08e-360b-4850-a636-a6649cad92fb", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "41c09346-d651-47b0-a3c1-5809ce6ee419", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--123979178"}], "key_name": "tempest-keypair-1412603031", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:15.127172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a8b53508-87ff-429d-a59d-60db42e5df8c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:15.127803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a8b53508-87ff-429d-a59d-60db42e5df8c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:15.136526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8b53508-87ff-429d-a59d-60db42e5df8c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:15.137361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8b53508-87ff-429d-a59d-60db42e5df8c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:15.142811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8b53508-87ff-429d-a59d-60db42e5df8c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:15.147378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8b53508-87ff-429d-a59d-60db42e5df8c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:15.147858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8b53508-87ff-429d-a59d-60db42e5df8c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:15.148305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8b53508-87ff-429d-a59d-60db42e5df8c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:15.168486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:15.234119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] validate_networks() for [('f9cbb913-194f-40e1-a976-5bb8fb5ed17c', None, None, None, None, None), (None, None, '41d0cb52-ad80-4f03-87b2-5cf3ba5d9aa8', None, None, None), (None, None, '2a34a33b-11c6-4dcd-a52b-4a26af50fc18', None, None, None), ('3b67e9b3-1fdf-436c-b45e-ff393076eb5f', None, None, None, None, None), ('3b67e9b3-1fdf-436c-b45e-ff393076eb5f', None, None, None, None, None), ('43093778-6085-4970-ae66-4ac37ad9afd2', '10.2.2.100', None, None, None, None), ('43093778-6085-4970-ae66-4ac37ad9afd2', '10.2.2.200', None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:00:15.442473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a8b53508-87ff-429d-a59d-60db42e5df8c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:15.456649 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a8b53508-87ff-429d-a59d-60db42e5df8c tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1307 microversion: 2.1 time: 0.333229 Oct 27 19:00:15.458479 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1627/3392] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:15 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1307 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:15.957968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6ca22a86-46f8-4bf9-8809-08b5d7708814 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:15.958652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6ca22a86-46f8-4bf9-8809-08b5d7708814 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:15.967597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ca22a86-46f8-4bf9-8809-08b5d7708814 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:15.968345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ca22a86-46f8-4bf9-8809-08b5d7708814 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:15.969121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ca22a86-46f8-4bf9-8809-08b5d7708814 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:15.970031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ca22a86-46f8-4bf9-8809-08b5d7708814 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:15.970695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ca22a86-46f8-4bf9-8809-08b5d7708814 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:15.975413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ca22a86-46f8-4bf9-8809-08b5d7708814 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:16.167879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6ca22a86-46f8-4bf9-8809-08b5d7708814 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:16.192549 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6ca22a86-46f8-4bf9-8809-08b5d7708814 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1517 microversion: 2.1 time: 0.241200 Oct 27 19:00:16.194464 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1628/3393] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:15 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1517 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:16.485340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b2d386c7-7dc0-493b-8469-3f6e6692b813 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:16.486119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b2d386c7-7dc0-493b-8469-3f6e6692b813 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:16.504516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2d386c7-7dc0-493b-8469-3f6e6692b813 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:16.512406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2d386c7-7dc0-493b-8469-3f6e6692b813 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:16.512867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2d386c7-7dc0-493b-8469-3f6e6692b813 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:16.513892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2d386c7-7dc0-493b-8469-3f6e6692b813 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:16.514475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2d386c7-7dc0-493b-8469-3f6e6692b813 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:16.515170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2d386c7-7dc0-493b-8469-3f6e6692b813 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:16.894745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b2d386c7-7dc0-493b-8469-3f6e6692b813 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:16.914541 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b2d386c7-7dc0-493b-8469-3f6e6692b813 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1307 microversion: 2.1 time: 0.432250 Oct 27 19:00:16.920114 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1629/3394] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:16 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1307 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:17.945515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-654b1907-3884-44fb-a191-4a167d589a62 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:17.946956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-654b1907-3884-44fb-a191-4a167d589a62 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:17.981834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-654b1907-3884-44fb-a191-4a167d589a62 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:17.983302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-654b1907-3884-44fb-a191-4a167d589a62 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:17.984367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-654b1907-3884-44fb-a191-4a167d589a62 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:17.985964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-654b1907-3884-44fb-a191-4a167d589a62 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:17.986756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-654b1907-3884-44fb-a191-4a167d589a62 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:17.987966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-654b1907-3884-44fb-a191-4a167d589a62 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:18.212014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-654b1907-3884-44fb-a191-4a167d589a62 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:18.223323 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-654b1907-3884-44fb-a191-4a167d589a62 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1487 microversion: 2.1 time: 0.281684 Oct 27 19:00:18.224801 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1630/3395] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:17 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1487 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:18.251105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9f9063b-aa39-4378-af2a-a184d0f42db7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:18.251878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d9f9063b-aa39-4378-af2a-a184d0f42db7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:18.261581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9f9063b-aa39-4378-af2a-a184d0f42db7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:18.262646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9f9063b-aa39-4378-af2a-a184d0f42db7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:18.263790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9f9063b-aa39-4378-af2a-a184d0f42db7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:18.265249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9f9063b-aa39-4378-af2a-a184d0f42db7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:18.266098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9f9063b-aa39-4378-af2a-a184d0f42db7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:18.266919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9f9063b-aa39-4378-af2a-a184d0f42db7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:18.304349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d9f9063b-aa39-4378-af2a-a184d0f42db7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:00:18.424457 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d9f9063b-aa39-4378-af2a-a184d0f42db7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 204 len: 0 microversion: 2.1 time: 0.178948 Oct 27 19:00:18.425502 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1631/3396] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:00:18 2022] DELETE /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:00:18.435365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1d990251-4181-46bc-ad9a-3686af82f266 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:18.436410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1d990251-4181-46bc-ad9a-3686af82f266 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:18.445541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d990251-4181-46bc-ad9a-3686af82f266 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:18.446296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d990251-4181-46bc-ad9a-3686af82f266 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:18.447448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d990251-4181-46bc-ad9a-3686af82f266 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:18.449301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d990251-4181-46bc-ad9a-3686af82f266 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:18.450538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d990251-4181-46bc-ad9a-3686af82f266 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:18.451161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d990251-4181-46bc-ad9a-3686af82f266 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:18.716656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:00:18.718841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:00:18.720323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:00:18.721255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:00:18.721978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:00:18.729825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1d990251-4181-46bc-ad9a-3686af82f266 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:18.748454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:18.749347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:18.750016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:18.751655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:18.752775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:18.753468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:18.784276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Getting quotas for project 530ba49ebcd34fdf954a813de6fdc501. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:00:18.784758 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1d990251-4181-46bc-ad9a-3686af82f266 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1493 microversion: 2.1 time: 0.355031 Oct 27 19:00:18.786097 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1632/3397] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:18 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1493 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:18.789988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Getting quotas for user 7ee8aa94e9b046babadd8dc67177a487 and project 530ba49ebcd34fdf954a813de6fdc501. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:00:18.981272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:00:18.985554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='64da08d9-05da-46f0-a5a8-622da5db8981',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='fa0ea08e-360b-4850-a636-a6649cad92fb',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41c09346-d651-47b0-a3c1-5809ce6ee419',volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:00:19.121956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-25762517-f0c9-4a32-9e09-63307a67aaf9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'create', calling method: .version_select at 0x7fc869c97310>, body: {"keypair": {"name": "tempest-keypair-1883309253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdQ4LD+DbHpYC1tCQKwDy34i1SxKhGxkY7b+I3KcrhXBp9LEdlMNbvbzuHfRhm+rk0v7jjNgKAFcQ7E6I1C5+nQAOMm+yDY2Qr6iF9WI55JrpvrWrnUwhV+8jRGerAsWw=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:19.171267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-25762517-f0c9-4a32-9e09-63307a67aaf9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Getting quotas for project adeacece438645c4a0c5844d1ef83793. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:00:19.183286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-25762517-f0c9-4a32-9e09-63307a67aaf9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Getting quotas for user 2b706e9394a642cda315809db15ecbb3 and project adeacece438645c4a0c5844d1ef83793. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:00:19.236437 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-25762517-f0c9-4a32-9e09-63307a67aaf9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119838 Oct 27 19:00:19.238796 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1633/3398] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:00:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:00:19.542842 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ffe8f71f-20e3-48bd-9009-eac4c20c05f6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 4.470186 Oct 27 19:00:19.543503 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1766/3399] 10.222.0.42 () {62 vars in 1189 bytes} [Thu Oct 27 19:00:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 4472 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 19:00:19.556041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d3cf8ef6-00e3-44d8-b3aa-0e2c2b5ec54e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:19.557552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d3cf8ef6-00e3-44d8-b3aa-0e2c2b5ec54e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:19.810153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-04e175d4-e74c-43c7-8f8f-750ffdba7ebd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:19.810879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-04e175d4-e74c-43c7-8f8f-750ffdba7ebd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:19.827431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04e175d4-e74c-43c7-8f8f-750ffdba7ebd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:19.828073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04e175d4-e74c-43c7-8f8f-750ffdba7ebd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:19.828532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04e175d4-e74c-43c7-8f8f-750ffdba7ebd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:19.829270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04e175d4-e74c-43c7-8f8f-750ffdba7ebd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:19.829730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04e175d4-e74c-43c7-8f8f-750ffdba7ebd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:19.830170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04e175d4-e74c-43c7-8f8f-750ffdba7ebd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:19.878011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d3cf8ef6-00e3-44d8-b3aa-0e2c2b5ec54e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:19.890592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d3cf8ef6-00e3-44d8-b3aa-0e2c2b5ec54e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:19.901234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d3cf8ef6-00e3-44d8-b3aa-0e2c2b5ec54e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:19.902983 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d3cf8ef6-00e3-44d8-b3aa-0e2c2b5ec54e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1286 microversion: 2.42 time: 0.351350 Oct 27 19:00:19.903829 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1634/3400] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:19 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1286 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:20.560701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-04e175d4-e74c-43c7-8f8f-750ffdba7ebd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:20.577540 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-04e175d4-e74c-43c7-8f8f-750ffdba7ebd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1493 microversion: 2.1 time: 0.771284 Oct 27 19:00:20.580802 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1767/3401] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:19 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1493 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:20.733915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-644508ef-e45c-4f0c-a62b-7250a3a4b9a6 req-9d7e8a2a-716d-454d-8942-28f73045ea24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef", "name": "network-vif-deleted", "tag": "75847fa3-d16c-41e6-8a2a-ca6006e81c90"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:20.751100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-644508ef-e45c-4f0c-a62b-7250a3a4b9a6 req-9d7e8a2a-716d-454d-8942-28f73045ea24 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:20.752328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-644508ef-e45c-4f0c-a62b-7250a3a4b9a6 req-9d7e8a2a-716d-454d-8942-28f73045ea24 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:20.754262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-644508ef-e45c-4f0c-a62b-7250a3a4b9a6 req-9d7e8a2a-716d-454d-8942-28f73045ea24 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:20.792778 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-644508ef-e45c-4f0c-a62b-7250a3a4b9a6 req-9d7e8a2a-716d-454d-8942-28f73045ea24 service nova] Creating event network-vif-deleted:75847fa3-d16c-41e6-8a2a-ca6006e81c90 for instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef on n-h1-860687-3 Oct 27 19:00:20.808441 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-644508ef-e45c-4f0c-a62b-7250a3a4b9a6 req-9d7e8a2a-716d-454d-8942-28f73045ea24 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080302 Oct 27 19:00:20.810986 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1635/3402] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:20.933950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b61c65d-4dd5-45fe-8972-0c9665d4a2cb tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:20.934710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1b61c65d-4dd5-45fe-8972-0c9665d4a2cb tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:20.952568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b61c65d-4dd5-45fe-8972-0c9665d4a2cb tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:20.953539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b61c65d-4dd5-45fe-8972-0c9665d4a2cb tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:20.961070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b61c65d-4dd5-45fe-8972-0c9665d4a2cb tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:20.962197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b61c65d-4dd5-45fe-8972-0c9665d4a2cb tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:20.964474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b61c65d-4dd5-45fe-8972-0c9665d4a2cb tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:20.965758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b61c65d-4dd5-45fe-8972-0c9665d4a2cb tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:21.143068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1b61c65d-4dd5-45fe-8972-0c9665d4a2cb tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:21.163501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1b61c65d-4dd5-45fe-8972-0c9665d4a2cb tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:21.170824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1b61c65d-4dd5-45fe-8972-0c9665d4a2cb tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:21.174216 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1b61c65d-4dd5-45fe-8972-0c9665d4a2cb tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1528 microversion: 2.42 time: 0.242614 Oct 27 19:00:21.174216 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1768/3403] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:20 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1528 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:21.615617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7038c19e-3970-4962-8c6f-ebe0f6d0fd12 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:21.616649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7038c19e-3970-4962-8c6f-ebe0f6d0fd12 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:21.628321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7038c19e-3970-4962-8c6f-ebe0f6d0fd12 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:21.631277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7038c19e-3970-4962-8c6f-ebe0f6d0fd12 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:21.632270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7038c19e-3970-4962-8c6f-ebe0f6d0fd12 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:21.633224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7038c19e-3970-4962-8c6f-ebe0f6d0fd12 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:21.633754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7038c19e-3970-4962-8c6f-ebe0f6d0fd12 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:21.634215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7038c19e-3970-4962-8c6f-ebe0f6d0fd12 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:21.748285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7038c19e-3970-4962-8c6f-ebe0f6d0fd12 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:21.748942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7038c19e-3970-4962-8c6f-ebe0f6d0fd12 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:21.751431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7038c19e-3970-4962-8c6f-ebe0f6d0fd12 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:21.753933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-7038c19e-3970-4962-8c6f-ebe0f6d0fd12 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lazy-loading 'fault' on Instance uuid edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:00:21.809827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7038c19e-3970-4962-8c6f-ebe0f6d0fd12 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:21.820375 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7038c19e-3970-4962-8c6f-ebe0f6d0fd12 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 200 len: 1297 microversion: 2.1 time: 0.215287 Oct 27 19:00:21.821658 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1636/3404] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:21 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 1297 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:22.206676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f68463d0-6043-4618-9be6-cf737e5d2778 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:22.207841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f68463d0-6043-4618-9be6-cf737e5d2778 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:22.223757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f68463d0-6043-4618-9be6-cf737e5d2778 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:22.225906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f68463d0-6043-4618-9be6-cf737e5d2778 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:22.226680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f68463d0-6043-4618-9be6-cf737e5d2778 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:22.230241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f68463d0-6043-4618-9be6-cf737e5d2778 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:22.232596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f68463d0-6043-4618-9be6-cf737e5d2778 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:22.233618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f68463d0-6043-4618-9be6-cf737e5d2778 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:22.277548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-185302165", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e9bb60c-1994-4870-a5cf-565c3ad2a0f8"}], "security_groups": [{"name": "tempest-securitygroup--238265073"}], "key_name": "tempest-keypair-1883309253", "user_data": "}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:22.377553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f68463d0-6043-4618-9be6-cf737e5d2778 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:22.401386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f68463d0-6043-4618-9be6-cf737e5d2778 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:22.403191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f68463d0-6043-4618-9be6-cf737e5d2778 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:22.405767 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f68463d0-6043-4618-9be6-cf737e5d2778 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1584 microversion: 2.42 time: 0.210253 Oct 27 19:00:22.408882 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1769/3405] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:22 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1584 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:22.638710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] validate_networks() for [('0e9bb60c-1994-4870-a5cf-565c3ad2a0f8', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:00:22.847971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-74c0c4b5-a932-4c43-9426-c37974b50532 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:22.849033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-74c0c4b5-a932-4c43-9426-c37974b50532 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:22.872220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74c0c4b5-a932-4c43-9426-c37974b50532 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:22.874601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74c0c4b5-a932-4c43-9426-c37974b50532 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:22.875060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74c0c4b5-a932-4c43-9426-c37974b50532 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:22.875819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74c0c4b5-a932-4c43-9426-c37974b50532 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:22.876283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74c0c4b5-a932-4c43-9426-c37974b50532 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:22.876718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74c0c4b5-a932-4c43-9426-c37974b50532 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:22.890737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:22.914556 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-74c0c4b5-a932-4c43-9426-c37974b50532 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-74c0c4b5-a932-4c43-9426-c37974b50532 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef HTTP/1.1 Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef'} Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:22.924840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:22.931094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:22.931094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:22.931094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:22.931094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:22.931094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:22.931094 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:22.931094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-74c0c4b5-a932-4c43-9426-c37974b50532 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:22.931094 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-74c0c4b5-a932-4c43-9426-c37974b50532 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 404 len: 111 microversion: 2.1 time: 0.082839 Oct 27 19:00:22.931094 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1770/3406] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:22 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:00:22.938876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-772e6964-a110-42cf-9383-277b8d25ed1b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b12b550>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:24.339272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:00:24.339825 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-772e6964-a110-42cf-9383-277b8d25ed1b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 204 len: 0 microversion: 2.1 time: 1.405228 Oct 27 19:00:24.340246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:00:24.340355 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1771/3407] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:22 2022] DELETE /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 0 bytes in 1409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:00:24.340675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:00:24.341202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:00:24.341751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:00:24.345498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e38b5ba0-490b-4200-9a6c-aead07d5c921 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:24.346001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e38b5ba0-490b-4200-9a6c-aead07d5c921 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:24.363322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:24.363974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:24.364545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:24.366155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e38b5ba0-490b-4200-9a6c-aead07d5c921 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:24.366678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e38b5ba0-490b-4200-9a6c-aead07d5c921 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:24.366941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:24.367124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e38b5ba0-490b-4200-9a6c-aead07d5c921 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:24.369491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:24.370190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:24.373167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e38b5ba0-490b-4200-9a6c-aead07d5c921 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:24.373736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e38b5ba0-490b-4200-9a6c-aead07d5c921 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:24.374209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e38b5ba0-490b-4200-9a6c-aead07d5c921 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:24.471166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Getting quotas for project adeacece438645c4a0c5844d1ef83793. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:00:24.493663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Getting quotas for user 2b706e9394a642cda315809db15ecbb3 and project adeacece438645c4a0c5844d1ef83793. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:00:24.548912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:00:24.554291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:00:24.746422 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aaadeef3-d3d7-440a-9fac-38329d678b83 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.474344 Oct 27 19:00:24.761021 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1637/3408] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:00:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 2488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:00:24.774096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0b21caf3-5c1e-4ca8-9dd0-defe06f6e85a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:24.778974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0b21caf3-5c1e-4ca8-9dd0-defe06f6e85a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:24.803661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b21caf3-5c1e-4ca8-9dd0-defe06f6e85a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:24.805940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b21caf3-5c1e-4ca8-9dd0-defe06f6e85a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:24.806453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b21caf3-5c1e-4ca8-9dd0-defe06f6e85a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:24.810330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b21caf3-5c1e-4ca8-9dd0-defe06f6e85a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:24.812444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b21caf3-5c1e-4ca8-9dd0-defe06f6e85a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:24.815048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b21caf3-5c1e-4ca8-9dd0-defe06f6e85a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:24.916328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0b21caf3-5c1e-4ca8-9dd0-defe06f6e85a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:00:25.189426 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0b21caf3-5c1e-4ca8-9dd0-defe06f6e85a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 204 len: 0 microversion: 2.1 time: 0.426244 Oct 27 19:00:25.190184 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1638/3409] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:00:24 2022] DELETE /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:00:25.202794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7031ab0-028a-4f29-be0b-97f10d8c4c80 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:25.203662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a7031ab0-028a-4f29-be0b-97f10d8c4c80 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:25.494169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a7031ab0-028a-4f29-be0b-97f10d8c4c80 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:25.509184 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7031ab0-028a-4f29-be0b-97f10d8c4c80 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1245 microversion: 2.1 time: 0.314828 Oct 27 19:00:25.516978 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1639/3410] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:25 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1245 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:25.523891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1725312505", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "bd2a2055-53fd-4e07-8727-b0efd4106712"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:25.665852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] validate_networks() for [('bd2a2055-53fd-4e07-8727-b0efd4106712', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:00:25.782296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e38b5ba0-490b-4200-9a6c-aead07d5c921 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:25.792975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e38b5ba0-490b-4200-9a6c-aead07d5c921 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:25.801284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e38b5ba0-490b-4200-9a6c-aead07d5c921 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:25.807457 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e38b5ba0-490b-4200-9a6c-aead07d5c921 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1661 microversion: 2.42 time: 1.461139 Oct 27 19:00:25.808865 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1772/3411] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:24 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1661 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:26.538589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-268b3abf-c101-48d3-b7d1-e3d2d1886ffb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:26.539454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-268b3abf-c101-48d3-b7d1-e3d2d1886ffb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:26.555537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-268b3abf-c101-48d3-b7d1-e3d2d1886ffb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:26.556602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-268b3abf-c101-48d3-b7d1-e3d2d1886ffb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:26.557818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-268b3abf-c101-48d3-b7d1-e3d2d1886ffb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:26.558864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-268b3abf-c101-48d3-b7d1-e3d2d1886ffb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:26.559865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-268b3abf-c101-48d3-b7d1-e3d2d1886ffb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:26.561759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-268b3abf-c101-48d3-b7d1-e3d2d1886ffb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:26.765014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-268b3abf-c101-48d3-b7d1-e3d2d1886ffb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:26.780913 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-268b3abf-c101-48d3-b7d1-e3d2d1886ffb tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1249 microversion: 2.1 time: 0.244388 Oct 27 19:00:26.782290 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1773/3412] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:26 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1249 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:26.842255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-275a8209-d3f5-45e6-9d26-3f1ae8f31c16 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:26.843246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-275a8209-d3f5-45e6-9d26-3f1ae8f31c16 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:26.854762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-275a8209-d3f5-45e6-9d26-3f1ae8f31c16 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:26.856020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-275a8209-d3f5-45e6-9d26-3f1ae8f31c16 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:26.856815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-275a8209-d3f5-45e6-9d26-3f1ae8f31c16 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:26.857760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-275a8209-d3f5-45e6-9d26-3f1ae8f31c16 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:26.858421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-275a8209-d3f5-45e6-9d26-3f1ae8f31c16 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:26.859049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-275a8209-d3f5-45e6-9d26-3f1ae8f31c16 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:27.166305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-275a8209-d3f5-45e6-9d26-3f1ae8f31c16 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:27.178306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-275a8209-d3f5-45e6-9d26-3f1ae8f31c16 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:27.179822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-275a8209-d3f5-45e6-9d26-3f1ae8f31c16 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:27.194279 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-275a8209-d3f5-45e6-9d26-3f1ae8f31c16 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1661 microversion: 2.42 time: 0.357068 Oct 27 19:00:27.194919 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1774/3413] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:26 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1661 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:27.298993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:00:27.300669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:00:27.303233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:00:27.304153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:00:27.305112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:00:27.324911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:27.325899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:27.327441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:27.329920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:27.331256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:27.332290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:27.368574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Getting quotas for project 75c41c5833484551b422742abfad598f. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:00:27.380952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Getting quotas for user ac1e2f62e22b4e52badd230ef175817e and project 75c41c5833484551b422742abfad598f. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:00:27.386694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:27.410709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:00:27.414065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:00:27.522915 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf5f0cac-2cfc-455f-a74b-dcc4221c4d5b tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.002666 Oct 27 19:00:27.524669 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1640/3414] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:00:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:00:27.556066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6ce7dd2a-d9b1-4ed3-b4c8-941d2ab7206a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:27.556992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6ce7dd2a-d9b1-4ed3-b4c8-941d2ab7206a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:27.770129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6ce7dd2a-d9b1-4ed3-b4c8-941d2ab7206a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:27.781334 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6ce7dd2a-d9b1-4ed3-b4c8-941d2ab7206a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1208 microversion: 2.1 time: 0.243380 Oct 27 19:00:27.798207 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1775/3415] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:27 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1208 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:27.821169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b4f7bd4c-ac01-4605-b121-bfadcc8921d1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:27.823159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b4f7bd4c-ac01-4605-b121-bfadcc8921d1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:27.858355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4f7bd4c-ac01-4605-b121-bfadcc8921d1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:27.859704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4f7bd4c-ac01-4605-b121-bfadcc8921d1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:27.861065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4f7bd4c-ac01-4605-b121-bfadcc8921d1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:27.864873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4f7bd4c-ac01-4605-b121-bfadcc8921d1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:27.865989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4f7bd4c-ac01-4605-b121-bfadcc8921d1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:27.868821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4f7bd4c-ac01-4605-b121-bfadcc8921d1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:28.228407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-952e813b-8b15-432b-9798-4b7047646e64 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:28.230375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-952e813b-8b15-432b-9798-4b7047646e64 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:28.255760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-952e813b-8b15-432b-9798-4b7047646e64 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:28.260767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-952e813b-8b15-432b-9798-4b7047646e64 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:28.261322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-952e813b-8b15-432b-9798-4b7047646e64 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:28.262553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b4f7bd4c-ac01-4605-b121-bfadcc8921d1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:28.267099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-952e813b-8b15-432b-9798-4b7047646e64 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:28.268797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-952e813b-8b15-432b-9798-4b7047646e64 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:28.271395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-952e813b-8b15-432b-9798-4b7047646e64 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:28.276945 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b4f7bd4c-ac01-4605-b121-bfadcc8921d1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1305 microversion: 2.1 time: 0.474060 Oct 27 19:00:28.277542 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1641/3416] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:27 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1305 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:28.766247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:28.805694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-952e813b-8b15-432b-9798-4b7047646e64 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:28.820108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b8d6ca53-6bd0-494b-858e-0966c46707bb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:28.821357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b8d6ca53-6bd0-494b-858e-0966c46707bb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:28.838456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-952e813b-8b15-432b-9798-4b7047646e64 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:28.845358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-952e813b-8b15-432b-9798-4b7047646e64 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:28.847791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8d6ca53-6bd0-494b-858e-0966c46707bb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:28.850641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8d6ca53-6bd0-494b-858e-0966c46707bb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:28.850944 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-952e813b-8b15-432b-9798-4b7047646e64 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1707 microversion: 2.42 time: 0.627677 Oct 27 19:00:28.851080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8d6ca53-6bd0-494b-858e-0966c46707bb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:28.851767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8d6ca53-6bd0-494b-858e-0966c46707bb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:28.852798 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1776/3417] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:28 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1707 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:28.882422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a3c09d11-7569-4d7b-b057-d30eb1f5f5e1 req-b39499b2-be4e-4c83-a7e6-e1b620341024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f", "name": "network-vif-deleted", "tag": "d04a7167-51a8-4ece-aedc-77994439aa42"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:28.887640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8d6ca53-6bd0-494b-858e-0966c46707bb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:28.888129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8d6ca53-6bd0-494b-858e-0966c46707bb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:28.932782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a3c09d11-7569-4d7b-b057-d30eb1f5f5e1 req-b39499b2-be4e-4c83-a7e6-e1b620341024 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:28.938444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a3c09d11-7569-4d7b-b057-d30eb1f5f5e1 req-b39499b2-be4e-4c83-a7e6-e1b620341024 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:28.944230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a3c09d11-7569-4d7b-b057-d30eb1f5f5e1 req-b39499b2-be4e-4c83-a7e6-e1b620341024 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:29.004297 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a3c09d11-7569-4d7b-b057-d30eb1f5f5e1 req-b39499b2-be4e-4c83-a7e6-e1b620341024 service nova] Creating event network-vif-deleted:d04a7167-51a8-4ece-aedc-77994439aa42 for instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f on n-h2-860687-3 Oct 27 19:00:29.032623 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a3c09d11-7569-4d7b-b057-d30eb1f5f5e1 req-b39499b2-be4e-4c83-a7e6-e1b620341024 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159827 Oct 27 19:00:29.033326 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1777/3418] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:00:29.305013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-74926aef-791d-49b3-baae-31030c65c050 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:29.305797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-74926aef-791d-49b3-baae-31030c65c050 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:29.341051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74926aef-791d-49b3-baae-31030c65c050 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:29.343595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74926aef-791d-49b3-baae-31030c65c050 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:29.345739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74926aef-791d-49b3-baae-31030c65c050 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:29.349098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74926aef-791d-49b3-baae-31030c65c050 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:29.354011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74926aef-791d-49b3-baae-31030c65c050 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:29.356832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74926aef-791d-49b3-baae-31030c65c050 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:29.487470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b8d6ca53-6bd0-494b-858e-0966c46707bb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:29.500821 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b8d6ca53-6bd0-494b-858e-0966c46707bb tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1212 microversion: 2.1 time: 0.685393 Oct 27 19:00:29.520537 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1642/3419] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:28 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1212 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:29.692372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-74926aef-791d-49b3-baae-31030c65c050 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:29.727527 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-74926aef-791d-49b3-baae-31030c65c050 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1303 microversion: 2.1 time: 0.421219 Oct 27 19:00:29.734045 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1778/3420] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:29 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1303 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:29.883956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-652420d2-bcf9-4a8d-9032-85e2b246f21c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:29.886275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-652420d2-bcf9-4a8d-9032-85e2b246f21c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:29.897262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-652420d2-bcf9-4a8d-9032-85e2b246f21c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:29.898266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-652420d2-bcf9-4a8d-9032-85e2b246f21c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:29.899446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-652420d2-bcf9-4a8d-9032-85e2b246f21c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:29.901143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-652420d2-bcf9-4a8d-9032-85e2b246f21c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:29.912978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-652420d2-bcf9-4a8d-9032-85e2b246f21c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:29.914891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-652420d2-bcf9-4a8d-9032-85e2b246f21c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:30.527603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-29101a01-aa68-47dc-892e-d8a2d4755a71 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:30.529106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-29101a01-aa68-47dc-892e-d8a2d4755a71 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:30.549064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29101a01-aa68-47dc-892e-d8a2d4755a71 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:30.550181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29101a01-aa68-47dc-892e-d8a2d4755a71 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:30.552870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29101a01-aa68-47dc-892e-d8a2d4755a71 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:30.563020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29101a01-aa68-47dc-892e-d8a2d4755a71 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:30.563020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29101a01-aa68-47dc-892e-d8a2d4755a71 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:30.563020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29101a01-aa68-47dc-892e-d8a2d4755a71 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:30.753965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-29101a01-aa68-47dc-892e-d8a2d4755a71 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:30.769698 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-29101a01-aa68-47dc-892e-d8a2d4755a71 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1268 microversion: 2.1 time: 0.246903 Oct 27 19:00:30.777666 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1779/3421] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:30 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1268 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:30.796443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-53f0c8eb-ba61-4d38-8475-5824848756be tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:30.798032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-53f0c8eb-ba61-4d38-8475-5824848756be tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:30.835554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53f0c8eb-ba61-4d38-8475-5824848756be tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:30.837604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53f0c8eb-ba61-4d38-8475-5824848756be tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:30.839079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53f0c8eb-ba61-4d38-8475-5824848756be tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:30.839948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53f0c8eb-ba61-4d38-8475-5824848756be tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:30.842539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53f0c8eb-ba61-4d38-8475-5824848756be tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:30.843057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-652420d2-bcf9-4a8d-9032-85e2b246f21c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:30.843202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53f0c8eb-ba61-4d38-8475-5824848756be tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:30.858347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-652420d2-bcf9-4a8d-9032-85e2b246f21c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:30.860210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-652420d2-bcf9-4a8d-9032-85e2b246f21c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:30.866827 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-652420d2-bcf9-4a8d-9032-85e2b246f21c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1753 microversion: 2.42 time: 0.988149 Oct 27 19:00:30.867887 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1643/3422] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:29 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1753 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:31.149576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-53f0c8eb-ba61-4d38-8475-5824848756be tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:31.178166 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-53f0c8eb-ba61-4d38-8475-5824848756be tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1370 microversion: 2.1 time: 0.398693 Oct 27 19:00:31.182885 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1780/3423] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:30 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1370 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:31.732353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-859534820", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "db61e2ae-a0b9-4ebe-826d-1c6dfd28832f"}], "block_device_mapping_v2": [{"uuid": "0382157a-ca37-486b-82f0-78a3e3326866", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:31.801623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8ebf7b5d-68b7-4b12-948d-1bc0440703fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:31.802867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8ebf7b5d-68b7-4b12-948d-1bc0440703fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:31.818431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ebf7b5d-68b7-4b12-948d-1bc0440703fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:31.819455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ebf7b5d-68b7-4b12-948d-1bc0440703fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:31.820062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ebf7b5d-68b7-4b12-948d-1bc0440703fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:31.823337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ebf7b5d-68b7-4b12-948d-1bc0440703fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:31.823963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ebf7b5d-68b7-4b12-948d-1bc0440703fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:31.827440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ebf7b5d-68b7-4b12-948d-1bc0440703fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:31.847166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] validate_networks() for [('db61e2ae-a0b9-4ebe-826d-1c6dfd28832f', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:00:31.976208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8ebf7b5d-68b7-4b12-948d-1bc0440703fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:31.987960 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8ebf7b5d-68b7-4b12-948d-1bc0440703fc tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1266 microversion: 2.1 time: 0.191219 Oct 27 19:00:31.990137 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1781/3424] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:31 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:32.000600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2895b739-e9b8-428f-a5fa-98102ae8312a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:32.001549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2895b739-e9b8-428f-a5fa-98102ae8312a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:32.021714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2895b739-e9b8-428f-a5fa-98102ae8312a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:32.022733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2895b739-e9b8-428f-a5fa-98102ae8312a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:32.024051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2895b739-e9b8-428f-a5fa-98102ae8312a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:32.025051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2895b739-e9b8-428f-a5fa-98102ae8312a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:32.025900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2895b739-e9b8-428f-a5fa-98102ae8312a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:32.026702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2895b739-e9b8-428f-a5fa-98102ae8312a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:32.328783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2895b739-e9b8-428f-a5fa-98102ae8312a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:32.354456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2895b739-e9b8-428f-a5fa-98102ae8312a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:32.356557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2895b739-e9b8-428f-a5fa-98102ae8312a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:32.358274 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2895b739-e9b8-428f-a5fa-98102ae8312a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1753 microversion: 2.42 time: 0.366859 Oct 27 19:00:32.361217 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1782/3425] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:31 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1753 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:32.387025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ec671c1c-38ce-421c-bb33-3fd74b940533 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:32.388005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ec671c1c-38ce-421c-bb33-3fd74b940533 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:32.398903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec671c1c-38ce-421c-bb33-3fd74b940533 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:32.399713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec671c1c-38ce-421c-bb33-3fd74b940533 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:32.400242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec671c1c-38ce-421c-bb33-3fd74b940533 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:32.401111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec671c1c-38ce-421c-bb33-3fd74b940533 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:32.401662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec671c1c-38ce-421c-bb33-3fd74b940533 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:32.402171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec671c1c-38ce-421c-bb33-3fd74b940533 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:32.752880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ec671c1c-38ce-421c-bb33-3fd74b940533 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:32.768164 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ec671c1c-38ce-421c-bb33-3fd74b940533 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1370 microversion: 2.1 time: 0.404061 Oct 27 19:00:32.769174 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1783/3426] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:32 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1370 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:32.781764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-3e1ff579-7e80-40ad-92ad-4a0cd994f719 req-d9b7ffe9-71e8-48ea-a198-9642aa720d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c958b48-5e00-49c6-95ab-a36acdbdf6e2", "tag": "f5c0b623-9e29-4d46-9459-e03cfbf0d547"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:32.807919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3e1ff579-7e80-40ad-92ad-4a0cd994f719 req-d9b7ffe9-71e8-48ea-a198-9642aa720d2f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:32.808636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3e1ff579-7e80-40ad-92ad-4a0cd994f719 req-d9b7ffe9-71e8-48ea-a198-9642aa720d2f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:32.808854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3e1ff579-7e80-40ad-92ad-4a0cd994f719 req-d9b7ffe9-71e8-48ea-a198-9642aa720d2f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:32.837172 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-3e1ff579-7e80-40ad-92ad-4a0cd994f719 req-d9b7ffe9-71e8-48ea-a198-9642aa720d2f service nova] Creating event network-changed:f5c0b623-9e29-4d46-9459-e03cfbf0d547 for instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 on n-h2-860687-3 Oct 27 19:00:32.849708 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-3e1ff579-7e80-40ad-92ad-4a0cd994f719 req-d9b7ffe9-71e8-48ea-a198-9642aa720d2f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078866 Oct 27 19:00:32.850627 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1784/3427] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:33.013785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8786737c-f990-4c78-9966-c76bcdf9c18f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:33.014559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8786737c-f990-4c78-9966-c76bcdf9c18f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:33.022115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8786737c-f990-4c78-9966-c76bcdf9c18f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:33.022635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8786737c-f990-4c78-9966-c76bcdf9c18f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:33.023077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8786737c-f990-4c78-9966-c76bcdf9c18f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:33.023790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8786737c-f990-4c78-9966-c76bcdf9c18f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:33.024255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8786737c-f990-4c78-9966-c76bcdf9c18f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:33.024683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8786737c-f990-4c78-9966-c76bcdf9c18f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:33.223561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:00:33.224817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:00:33.225534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:00:33.226874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:00:33.227532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:00:33.244054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:33.245475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:33.246113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:33.247555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:33.248218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:33.249821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:33.282582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Getting quotas for project 47340475d333442da39184d873995e37. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:00:33.291767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Getting quotas for user 59ab6001dda8482a83fbd4dc67eabb68 and project 47340475d333442da39184d873995e37. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:00:33.411021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8786737c-f990-4c78-9966-c76bcdf9c18f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:33.426984 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8786737c-f990-4c78-9966-c76bcdf9c18f tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1308 microversion: 2.1 time: 0.414932 Oct 27 19:00:33.430193 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1785/3428] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:33 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1308 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:33.456546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-70daf073-a942-41d0-b687-272a12aa2745 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:33.457281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-70daf073-a942-41d0-b687-272a12aa2745 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:33.460030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:00:33.462729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0382157a-ca37-486b-82f0-78a3e3326866',volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:00:33.465680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70daf073-a942-41d0-b687-272a12aa2745 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:33.466130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70daf073-a942-41d0-b687-272a12aa2745 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:33.468900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70daf073-a942-41d0-b687-272a12aa2745 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:33.469992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70daf073-a942-41d0-b687-272a12aa2745 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:33.475445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70daf073-a942-41d0-b687-272a12aa2745 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:33.476043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70daf073-a942-41d0-b687-272a12aa2745 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:33.756940 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8e1796ea-1386-4275-b9fa-9d16fdb51956 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.030001 Oct 27 19:00:33.758028 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1644/3429] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:00:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:00:33.771908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-70daf073-a942-41d0-b687-272a12aa2745 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:33.779362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2be73ec3-870c-42f9-ab44-d1024bc74d40 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:33.780761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2be73ec3-870c-42f9-ab44-d1024bc74d40 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:33.783042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-70daf073-a942-41d0-b687-272a12aa2745 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:33.784552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-70daf073-a942-41d0-b687-272a12aa2745 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:33.785776 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-70daf073-a942-41d0-b687-272a12aa2745 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1799 microversion: 2.42 time: 0.352773 Oct 27 19:00:33.790755 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1786/3430] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:33 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1799 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:33.798094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-491c53bc-c156-415c-a1a8-f6912e304fea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:33.800110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-491c53bc-c156-415c-a1a8-f6912e304fea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:33.807639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-491c53bc-c156-415c-a1a8-f6912e304fea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:33.808493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-491c53bc-c156-415c-a1a8-f6912e304fea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:33.810109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-491c53bc-c156-415c-a1a8-f6912e304fea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:33.811816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-491c53bc-c156-415c-a1a8-f6912e304fea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:33.812544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-491c53bc-c156-415c-a1a8-f6912e304fea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:33.813241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-491c53bc-c156-415c-a1a8-f6912e304fea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:33.987799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2be73ec3-870c-42f9-ab44-d1024bc74d40 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:34.000548 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2be73ec3-870c-42f9-ab44-d1024bc74d40 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1052 microversion: 2.1 time: 0.229663 Oct 27 19:00:34.002266 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1645/3431] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:33 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1052 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:34.089064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-491c53bc-c156-415c-a1a8-f6912e304fea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:34.101073 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-491c53bc-c156-415c-a1a8-f6912e304fea tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1370 microversion: 2.1 time: 0.307144 Oct 27 19:00:34.114412 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1787/3432] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:33 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:34.457921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e553abcd-a4f1-4165-99cb-09ec42f32de1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:34.458589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e553abcd-a4f1-4165-99cb-09ec42f32de1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:34.468354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e553abcd-a4f1-4165-99cb-09ec42f32de1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:34.468857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e553abcd-a4f1-4165-99cb-09ec42f32de1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:34.469308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e553abcd-a4f1-4165-99cb-09ec42f32de1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:34.470029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e553abcd-a4f1-4165-99cb-09ec42f32de1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:34.470827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e553abcd-a4f1-4165-99cb-09ec42f32de1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:34.471535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e553abcd-a4f1-4165-99cb-09ec42f32de1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:34.823511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d0f6f31-4494-4c60-a2fa-17e71d877e75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:34.824780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3d0f6f31-4494-4c60-a2fa-17e71d877e75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:34.831360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d0f6f31-4494-4c60-a2fa-17e71d877e75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:34.832361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d0f6f31-4494-4c60-a2fa-17e71d877e75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:34.832999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d0f6f31-4494-4c60-a2fa-17e71d877e75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:34.834167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d0f6f31-4494-4c60-a2fa-17e71d877e75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:34.835006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d0f6f31-4494-4c60-a2fa-17e71d877e75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:34.835678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d0f6f31-4494-4c60-a2fa-17e71d877e75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:34.855559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e553abcd-a4f1-4165-99cb-09ec42f32de1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:34.874900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:34.879235 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e553abcd-a4f1-4165-99cb-09ec42f32de1 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1308 microversion: 2.1 time: 0.426032 Oct 27 19:00:34.898901 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1646/3433] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:34 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1308 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:35.025684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5f3b7c84-80e0-447c-ab27-f0471dab14e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:35.026897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5f3b7c84-80e0-447c-ab27-f0471dab14e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:35.038998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f3b7c84-80e0-447c-ab27-f0471dab14e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:35.040644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f3b7c84-80e0-447c-ab27-f0471dab14e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:35.043358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f3b7c84-80e0-447c-ab27-f0471dab14e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:35.045104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f3b7c84-80e0-447c-ab27-f0471dab14e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:35.045593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f3b7c84-80e0-447c-ab27-f0471dab14e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:35.046933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f3b7c84-80e0-447c-ab27-f0471dab14e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:35.101056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3d0f6f31-4494-4c60-a2fa-17e71d877e75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:35.125772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3d0f6f31-4494-4c60-a2fa-17e71d877e75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:35.129015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3d0f6f31-4494-4c60-a2fa-17e71d877e75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:35.130940 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3d0f6f31-4494-4c60-a2fa-17e71d877e75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1799 microversion: 2.42 time: 0.311633 Oct 27 19:00:35.147443 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1788/3434] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:34 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1799 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:35.161688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-434b0218-0ca2-466e-86e2-50dbcd58b370 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:35.162362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-434b0218-0ca2-466e-86e2-50dbcd58b370 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:35.181472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-434b0218-0ca2-466e-86e2-50dbcd58b370 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:35.182607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-434b0218-0ca2-466e-86e2-50dbcd58b370 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:35.183074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-434b0218-0ca2-466e-86e2-50dbcd58b370 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:35.183815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-434b0218-0ca2-466e-86e2-50dbcd58b370 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:35.184287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-434b0218-0ca2-466e-86e2-50dbcd58b370 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:35.184729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-434b0218-0ca2-466e-86e2-50dbcd58b370 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:35.228263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5f3b7c84-80e0-447c-ab27-f0471dab14e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:35.241399 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5f3b7c84-80e0-447c-ab27-f0471dab14e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1102 microversion: 2.1 time: 0.220307 Oct 27 19:00:35.242553 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1647/3435] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:35 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1102 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:35.467511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-434b0218-0ca2-466e-86e2-50dbcd58b370 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:35.481692 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-434b0218-0ca2-466e-86e2-50dbcd58b370 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1370 microversion: 2.1 time: 0.333982 Oct 27 19:00:35.487135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b6f64504-b0f6-4bc3-ab27-c09e8c9eacd0 req-e03978de-ca1b-49f2-8647-bc15cc630718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a", "tag": "fc9fe7e8-b47d-4417-b21e-720480b5d605"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:35.496461 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1789/3436] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:35 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1370 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:35.533391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b6f64504-b0f6-4bc3-ab27-c09e8c9eacd0 req-e03978de-ca1b-49f2-8647-bc15cc630718 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:35.533900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b6f64504-b0f6-4bc3-ab27-c09e8c9eacd0 req-e03978de-ca1b-49f2-8647-bc15cc630718 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:35.534364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b6f64504-b0f6-4bc3-ab27-c09e8c9eacd0 req-e03978de-ca1b-49f2-8647-bc15cc630718 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:35.580523 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b6f64504-b0f6-4bc3-ab27-c09e8c9eacd0 req-e03978de-ca1b-49f2-8647-bc15cc630718 service nova] Creating event network-changed:fc9fe7e8-b47d-4417-b21e-720480b5d605 for instance a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a on n-h1-860687-3 Oct 27 19:00:35.595678 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b6f64504-b0f6-4bc3-ab27-c09e8c9eacd0 req-e03978de-ca1b-49f2-8647-bc15cc630718 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114811 Oct 27 19:00:35.599520 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1648/3437] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:35.910210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-82a082fb-53d3-44a1-ac46-b452ea4b4e89 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:35.911426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-82a082fb-53d3-44a1-ac46-b452ea4b4e89 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:35.932568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82a082fb-53d3-44a1-ac46-b452ea4b4e89 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:35.936046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82a082fb-53d3-44a1-ac46-b452ea4b4e89 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:35.936585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82a082fb-53d3-44a1-ac46-b452ea4b4e89 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:35.942516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82a082fb-53d3-44a1-ac46-b452ea4b4e89 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:35.943426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82a082fb-53d3-44a1-ac46-b452ea4b4e89 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:35.944098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82a082fb-53d3-44a1-ac46-b452ea4b4e89 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:36.174425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6a354679-f53c-48c6-a041-f24c965d13c1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:36.175197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6a354679-f53c-48c6-a041-f24c965d13c1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:36.206190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a354679-f53c-48c6-a041-f24c965d13c1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:36.206734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a354679-f53c-48c6-a041-f24c965d13c1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:36.217737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a354679-f53c-48c6-a041-f24c965d13c1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:36.217737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a354679-f53c-48c6-a041-f24c965d13c1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:36.217737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a354679-f53c-48c6-a041-f24c965d13c1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:36.217737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a354679-f53c-48c6-a041-f24c965d13c1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:36.329621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-82a082fb-53d3-44a1-ac46-b452ea4b4e89 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:36.334097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:36.350884 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-82a082fb-53d3-44a1-ac46-b452ea4b4e89 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1308 microversion: 2.1 time: 0.450045 Oct 27 19:00:36.352227 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1790/3438] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:35 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1308 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:36.357387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1eceba59-0bfd-4406-a2f0-6036053c7297 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:36.367386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1eceba59-0bfd-4406-a2f0-6036053c7297 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:36.374304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1eceba59-0bfd-4406-a2f0-6036053c7297 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:36.375132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1eceba59-0bfd-4406-a2f0-6036053c7297 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:36.375760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1eceba59-0bfd-4406-a2f0-6036053c7297 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:36.378452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1eceba59-0bfd-4406-a2f0-6036053c7297 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:36.381875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1eceba59-0bfd-4406-a2f0-6036053c7297 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:36.382561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1eceba59-0bfd-4406-a2f0-6036053c7297 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:36.568464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1eceba59-0bfd-4406-a2f0-6036053c7297 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:36.592589 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1eceba59-0bfd-4406-a2f0-6036053c7297 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1150 microversion: 2.1 time: 0.239059 Oct 27 19:00:36.593602 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1791/3439] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:36 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1150 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:36.599019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-230784e0-542e-4f1d-b827-94bf155478d3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:36.599966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-230784e0-542e-4f1d-b827-94bf155478d3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:36.606854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-230784e0-542e-4f1d-b827-94bf155478d3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:36.607731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-230784e0-542e-4f1d-b827-94bf155478d3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:36.608418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-230784e0-542e-4f1d-b827-94bf155478d3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:36.609398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-230784e0-542e-4f1d-b827-94bf155478d3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:36.610094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-230784e0-542e-4f1d-b827-94bf155478d3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:36.610802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-230784e0-542e-4f1d-b827-94bf155478d3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:36.715252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6a354679-f53c-48c6-a041-f24c965d13c1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:36.784071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6a354679-f53c-48c6-a041-f24c965d13c1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:36.785672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6a354679-f53c-48c6-a041-f24c965d13c1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:36.786948 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6a354679-f53c-48c6-a041-f24c965d13c1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1845 microversion: 2.42 time: 0.632934 Oct 27 19:00:36.798940 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1649/3440] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:36 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1845 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:36.909861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-230784e0-542e-4f1d-b827-94bf155478d3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:36.921979 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-230784e0-542e-4f1d-b827-94bf155478d3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1370 microversion: 2.1 time: 0.323879 Oct 27 19:00:36.926717 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1792/3441] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:36 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:37.380643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-75c79540-e70b-45a9-943f-58421489240e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:37.381287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-75c79540-e70b-45a9-943f-58421489240e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:37.390755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75c79540-e70b-45a9-943f-58421489240e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:37.391261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75c79540-e70b-45a9-943f-58421489240e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:37.391712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75c79540-e70b-45a9-943f-58421489240e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:37.392435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75c79540-e70b-45a9-943f-58421489240e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:37.392897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75c79540-e70b-45a9-943f-58421489240e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:37.393335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75c79540-e70b-45a9-943f-58421489240e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:37.623948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-31e1d317-cf29-43c3-a17d-f556d4d4575d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:37.624871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-31e1d317-cf29-43c3-a17d-f556d4d4575d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:37.634247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:37.638332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31e1d317-cf29-43c3-a17d-f556d4d4575d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:37.640069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31e1d317-cf29-43c3-a17d-f556d4d4575d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:37.641962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31e1d317-cf29-43c3-a17d-f556d4d4575d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:37.643351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31e1d317-cf29-43c3-a17d-f556d4d4575d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:37.643843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31e1d317-cf29-43c3-a17d-f556d4d4575d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:37.645437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-31e1d317-cf29-43c3-a17d-f556d4d4575d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:37.775275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=12 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:37.814521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-31e1d317-cf29-43c3-a17d-f556d4d4575d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:37.832752 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-31e1d317-cf29-43c3-a17d-f556d4d4575d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1168 microversion: 2.1 time: 0.211823 Oct 27 19:00:37.846572 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1793/3442] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:37 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1168 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:37.860190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9817e1cb-6cf1-46ce-a5de-70c4378d1a84 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:37.863301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9817e1cb-6cf1-46ce-a5de-70c4378d1a84 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:37.879975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9817e1cb-6cf1-46ce-a5de-70c4378d1a84 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:37.882282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9817e1cb-6cf1-46ce-a5de-70c4378d1a84 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:37.882928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9817e1cb-6cf1-46ce-a5de-70c4378d1a84 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:37.884642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9817e1cb-6cf1-46ce-a5de-70c4378d1a84 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:37.886791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9817e1cb-6cf1-46ce-a5de-70c4378d1a84 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:37.887631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9817e1cb-6cf1-46ce-a5de-70c4378d1a84 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:38.080380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-75c79540-e70b-45a9-943f-58421489240e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:38.097547 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-75c79540-e70b-45a9-943f-58421489240e tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1308 microversion: 2.1 time: 0.720779 Oct 27 19:00:38.111726 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1650/3443] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:37 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1308 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:38.114526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9a7c3529-559f-4055-8c11-c15d408ad38c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:38.115373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9a7c3529-559f-4055-8c11-c15d408ad38c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:38.123472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a7c3529-559f-4055-8c11-c15d408ad38c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:38.131991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a7c3529-559f-4055-8c11-c15d408ad38c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:38.132821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a7c3529-559f-4055-8c11-c15d408ad38c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:38.133749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a7c3529-559f-4055-8c11-c15d408ad38c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:38.134406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a7c3529-559f-4055-8c11-c15d408ad38c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:38.135102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a7c3529-559f-4055-8c11-c15d408ad38c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:38.410630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9817e1cb-6cf1-46ce-a5de-70c4378d1a84 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:38.427978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9817e1cb-6cf1-46ce-a5de-70c4378d1a84 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:38.431219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9817e1cb-6cf1-46ce-a5de-70c4378d1a84 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:38.448526 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9817e1cb-6cf1-46ce-a5de-70c4378d1a84 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1845 microversion: 2.42 time: 0.591991 Oct 27 19:00:38.451740 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1794/3444] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:37 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1845 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:38.865232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-02ff787c-492a-4db1-8439-bf524a56b31c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:38.866424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-02ff787c-492a-4db1-8439-bf524a56b31c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:38.883859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02ff787c-492a-4db1-8439-bf524a56b31c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:38.887825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02ff787c-492a-4db1-8439-bf524a56b31c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:38.889030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02ff787c-492a-4db1-8439-bf524a56b31c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:38.891476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02ff787c-492a-4db1-8439-bf524a56b31c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:38.893237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02ff787c-492a-4db1-8439-bf524a56b31c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:38.894403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02ff787c-492a-4db1-8439-bf524a56b31c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:39.021586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-02ff787c-492a-4db1-8439-bf524a56b31c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:39.040965 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-02ff787c-492a-4db1-8439-bf524a56b31c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1168 microversion: 2.1 time: 0.182473 Oct 27 19:00:39.042985 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1795/3445] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:38 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1168 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:39.056313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-0e432496-597a-4e1c-b20c-71aad4917b11 req-d4d7af1a-fd0f-489d-b32c-3e2b1247456e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "tag": "09a712fe-98b4-4234-9815-ee2620c789f9"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:39.058601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9a7c3529-559f-4055-8c11-c15d408ad38c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:39.071487 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9a7c3529-559f-4055-8c11-c15d408ad38c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1370 microversion: 2.1 time: 0.972257 Oct 27 19:00:39.073899 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1651/3446] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:38 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1370 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:39.076174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0e432496-597a-4e1c-b20c-71aad4917b11 req-d4d7af1a-fd0f-489d-b32c-3e2b1247456e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:39.076663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0e432496-597a-4e1c-b20c-71aad4917b11 req-d4d7af1a-fd0f-489d-b32c-3e2b1247456e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:39.078857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0e432496-597a-4e1c-b20c-71aad4917b11 req-d4d7af1a-fd0f-489d-b32c-3e2b1247456e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:39.094316 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-0e432496-597a-4e1c-b20c-71aad4917b11 req-d4d7af1a-fd0f-489d-b32c-3e2b1247456e service nova] Creating event network-changed:09a712fe-98b4-4234-9815-ee2620c789f9 for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:00:39.101147 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-0e432496-597a-4e1c-b20c-71aad4917b11 req-d4d7af1a-fd0f-489d-b32c-3e2b1247456e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055862 Oct 27 19:00:39.102195 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1796/3447] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:39.132298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6da41ed1-364f-41fd-ab8c-f3d12eadd3f7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:39.134481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6da41ed1-364f-41fd-ab8c-f3d12eadd3f7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:39.158685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6da41ed1-364f-41fd-ab8c-f3d12eadd3f7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:39.159284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6da41ed1-364f-41fd-ab8c-f3d12eadd3f7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:39.162861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6da41ed1-364f-41fd-ab8c-f3d12eadd3f7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:39.164289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6da41ed1-364f-41fd-ab8c-f3d12eadd3f7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:39.166218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6da41ed1-364f-41fd-ab8c-f3d12eadd3f7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:39.168764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6da41ed1-364f-41fd-ab8c-f3d12eadd3f7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:39.481992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8dbb91f6-86d4-4dd7-9d56-0a6fde8c81f3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:39.483984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8dbb91f6-86d4-4dd7-9d56-0a6fde8c81f3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:39.502229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8dbb91f6-86d4-4dd7-9d56-0a6fde8c81f3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:39.503288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8dbb91f6-86d4-4dd7-9d56-0a6fde8c81f3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:39.503746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8dbb91f6-86d4-4dd7-9d56-0a6fde8c81f3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:39.504485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8dbb91f6-86d4-4dd7-9d56-0a6fde8c81f3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:39.504957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8dbb91f6-86d4-4dd7-9d56-0a6fde8c81f3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:39.505402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8dbb91f6-86d4-4dd7-9d56-0a6fde8c81f3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:39.865008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8dbb91f6-86d4-4dd7-9d56-0a6fde8c81f3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:39.886936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8dbb91f6-86d4-4dd7-9d56-0a6fde8c81f3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:39.915313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8dbb91f6-86d4-4dd7-9d56-0a6fde8c81f3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:39.919135 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8dbb91f6-86d4-4dd7-9d56-0a6fde8c81f3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1845 microversion: 2.42 time: 0.443144 Oct 27 19:00:39.919744 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1797/3448] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:39 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1845 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:00:39.941925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a706eeaa-d859-453b-90fb-cb9ea5f1468f req-944e994d-a698-40ca-8798-71ee0d831cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c958b48-5e00-49c6-95ab-a36acdbdf6e2", "name": "network-vif-plugged", "status": "completed", "tag": "f5c0b623-9e29-4d46-9459-e03cfbf0d547"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:39.957158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a706eeaa-d859-453b-90fb-cb9ea5f1468f req-944e994d-a698-40ca-8798-71ee0d831cfd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:39.957915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a706eeaa-d859-453b-90fb-cb9ea5f1468f req-944e994d-a698-40ca-8798-71ee0d831cfd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:39.958719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a706eeaa-d859-453b-90fb-cb9ea5f1468f req-944e994d-a698-40ca-8798-71ee0d831cfd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:40.004091 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a706eeaa-d859-453b-90fb-cb9ea5f1468f req-944e994d-a698-40ca-8798-71ee0d831cfd service nova] Creating event network-vif-plugged:f5c0b623-9e29-4d46-9459-e03cfbf0d547 for instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 on n-h2-860687-3 Oct 27 19:00:40.012153 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a706eeaa-d859-453b-90fb-cb9ea5f1468f req-944e994d-a698-40ca-8798-71ee0d831cfd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080734 Oct 27 19:00:40.016808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6da41ed1-364f-41fd-ab8c-f3d12eadd3f7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:40.019185 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1798/3449] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:40.028354 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6da41ed1-364f-41fd-ab8c-f3d12eadd3f7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1308 microversion: 2.1 time: 0.909528 Oct 27 19:00:40.035712 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1652/3450] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:39 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1308 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:40.068277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c1c14145-186e-41d5-a52b-37345d806a46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:40.069117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c1c14145-186e-41d5-a52b-37345d806a46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:40.078296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1c14145-186e-41d5-a52b-37345d806a46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:40.079291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1c14145-186e-41d5-a52b-37345d806a46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:40.080017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1c14145-186e-41d5-a52b-37345d806a46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:40.080972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1c14145-186e-41d5-a52b-37345d806a46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:40.081605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1c14145-186e-41d5-a52b-37345d806a46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:40.082213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1c14145-186e-41d5-a52b-37345d806a46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:40.099623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-edefed59-a4df-490c-b829-1f79a9621a90 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:40.100610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-edefed59-a4df-490c-b829-1f79a9621a90 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:40.114279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edefed59-a4df-490c-b829-1f79a9621a90 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:40.116733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edefed59-a4df-490c-b829-1f79a9621a90 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:40.117634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edefed59-a4df-490c-b829-1f79a9621a90 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:40.121441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edefed59-a4df-490c-b829-1f79a9621a90 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:40.122161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edefed59-a4df-490c-b829-1f79a9621a90 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:40.123065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edefed59-a4df-490c-b829-1f79a9621a90 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:40.433414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c1c14145-186e-41d5-a52b-37345d806a46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:40.441617 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c1c14145-186e-41d5-a52b-37345d806a46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1210 microversion: 2.1 time: 0.379108 Oct 27 19:00:40.458371 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1799/3451] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:40 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1210 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:40.464926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-344d2ea7-075c-4c1f-8e49-6d50b6676aee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:40.465439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-344d2ea7-075c-4c1f-8e49-6d50b6676aee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:40.489649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-344d2ea7-075c-4c1f-8e49-6d50b6676aee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:40.490344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-344d2ea7-075c-4c1f-8e49-6d50b6676aee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:40.490728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-344d2ea7-075c-4c1f-8e49-6d50b6676aee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:40.491427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-344d2ea7-075c-4c1f-8e49-6d50b6676aee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:40.493953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-344d2ea7-075c-4c1f-8e49-6d50b6676aee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:40.496622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-344d2ea7-075c-4c1f-8e49-6d50b6676aee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:40.542742 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-344d2ea7-075c-4c1f-8e49-6d50b6676aee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/ips" status: 200 len: 151 microversion: 2.20 time: 0.080839 Oct 27 19:00:40.550889 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1800/3452] 10.222.0.42 () {60 vars in 1289 bytes} [Thu Oct 27 19:00:40 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/ips => generated 151 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:00:40.869790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-edefed59-a4df-490c-b829-1f79a9621a90 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:40.885926 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-edefed59-a4df-490c-b829-1f79a9621a90 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1370 microversion: 2.1 time: 0.793024 Oct 27 19:00:40.898919 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1653/3453] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:40 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1370 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:40.947126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ee7ca17f-228b-4f25-aab0-378eb457487e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:40.948788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ee7ca17f-228b-4f25-aab0-378eb457487e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:40.970893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee7ca17f-228b-4f25-aab0-378eb457487e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:40.971755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee7ca17f-228b-4f25-aab0-378eb457487e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:40.972437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee7ca17f-228b-4f25-aab0-378eb457487e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:40.973427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee7ca17f-228b-4f25-aab0-378eb457487e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:40.974247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee7ca17f-228b-4f25-aab0-378eb457487e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:40.975034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee7ca17f-228b-4f25-aab0-378eb457487e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:41.055259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c483b11b-477a-4a75-a36a-9d6450a687f8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:41.055968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c483b11b-477a-4a75-a36a-9d6450a687f8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:41.070003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c483b11b-477a-4a75-a36a-9d6450a687f8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:41.070549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c483b11b-477a-4a75-a36a-9d6450a687f8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:41.071000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c483b11b-477a-4a75-a36a-9d6450a687f8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:41.071724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c483b11b-477a-4a75-a36a-9d6450a687f8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:41.072699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c483b11b-477a-4a75-a36a-9d6450a687f8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:41.073231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c483b11b-477a-4a75-a36a-9d6450a687f8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:41.272767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ee7ca17f-228b-4f25-aab0-378eb457487e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:41.288373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ee7ca17f-228b-4f25-aab0-378eb457487e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:41.290132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ee7ca17f-228b-4f25-aab0-378eb457487e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:41.293461 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ee7ca17f-228b-4f25-aab0-378eb457487e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1866 microversion: 2.42 time: 0.348583 Oct 27 19:00:41.295553 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1801/3454] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:40 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1866 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:41.470755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-27c2f249-a691-4304-89a9-526112df57e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:41.471850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-27c2f249-a691-4304-89a9-526112df57e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:41.491856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27c2f249-a691-4304-89a9-526112df57e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:41.493464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27c2f249-a691-4304-89a9-526112df57e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:41.495597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27c2f249-a691-4304-89a9-526112df57e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:41.497876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27c2f249-a691-4304-89a9-526112df57e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:41.499307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27c2f249-a691-4304-89a9-526112df57e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:41.500071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27c2f249-a691-4304-89a9-526112df57e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:41.613533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c483b11b-477a-4a75-a36a-9d6450a687f8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:41.629504 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c483b11b-477a-4a75-a36a-9d6450a687f8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1308 microversion: 2.1 time: 0.577945 Oct 27 19:00:41.634330 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1654/3455] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:41 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1308 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:41.833299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-27c2f249-a691-4304-89a9-526112df57e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:41.844393 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-27c2f249-a691-4304-89a9-526112df57e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1210 microversion: 2.1 time: 0.382352 Oct 27 19:00:41.845815 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1802/3456] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:41 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1210 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:41.898553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-82d5eb01-6e23-4653-be2f-b2a6f59e8147 req-b78dcb65-e2e1-4378-9b78-0034a3a5d90f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "tag": "41d0cb52-ad80-4f03-87b2-5cf3ba5d9aa8"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:41.911998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-73262821-9609-4465-be02-735bd6259113 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:41.913205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-73262821-9609-4465-be02-735bd6259113 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:41.917819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-82d5eb01-6e23-4653-be2f-b2a6f59e8147 req-b78dcb65-e2e1-4378-9b78-0034a3a5d90f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:41.920387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-82d5eb01-6e23-4653-be2f-b2a6f59e8147 req-b78dcb65-e2e1-4378-9b78-0034a3a5d90f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:41.920741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-82d5eb01-6e23-4653-be2f-b2a6f59e8147 req-b78dcb65-e2e1-4378-9b78-0034a3a5d90f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:41.932195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73262821-9609-4465-be02-735bd6259113 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:41.932992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73262821-9609-4465-be02-735bd6259113 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:41.933588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73262821-9609-4465-be02-735bd6259113 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:41.934679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73262821-9609-4465-be02-735bd6259113 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:41.935258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73262821-9609-4465-be02-735bd6259113 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:41.935904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73262821-9609-4465-be02-735bd6259113 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:41.944901 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-82d5eb01-6e23-4653-be2f-b2a6f59e8147 req-b78dcb65-e2e1-4378-9b78-0034a3a5d90f service nova] Creating event network-changed:41d0cb52-ad80-4f03-87b2-5cf3ba5d9aa8 for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:00:41.952221 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-82d5eb01-6e23-4653-be2f-b2a6f59e8147 req-b78dcb65-e2e1-4378-9b78-0034a3a5d90f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061009 Oct 27 19:00:41.954036 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1655/3457] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:42.040780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-abe9fdaf-5448-4f59-8243-9587fd4db088 req-bbe5cf1a-59c1-4a31-ab71-b78762f4d3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a", "name": "network-vif-plugged", "status": "completed", "tag": "fc9fe7e8-b47d-4417-b21e-720480b5d605"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:42.066951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-abe9fdaf-5448-4f59-8243-9587fd4db088 req-bbe5cf1a-59c1-4a31-ab71-b78762f4d3ab service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:42.068896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-abe9fdaf-5448-4f59-8243-9587fd4db088 req-bbe5cf1a-59c1-4a31-ab71-b78762f4d3ab service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:42.069544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-abe9fdaf-5448-4f59-8243-9587fd4db088 req-bbe5cf1a-59c1-4a31-ab71-b78762f4d3ab service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:42.094790 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-abe9fdaf-5448-4f59-8243-9587fd4db088 req-bbe5cf1a-59c1-4a31-ab71-b78762f4d3ab service nova] Creating event network-vif-plugged:fc9fe7e8-b47d-4417-b21e-720480b5d605 for instance a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a on n-h1-860687-3 Oct 27 19:00:42.112406 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-abe9fdaf-5448-4f59-8243-9587fd4db088 req-bbe5cf1a-59c1-4a31-ab71-b78762f4d3ab service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080555 Oct 27 19:00:42.113525 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1656/3458] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:00:42.325020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-93acde4d-1ccc-4f88-85e6-e773bfa8db3e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:42.326141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-93acde4d-1ccc-4f88-85e6-e773bfa8db3e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:42.339052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93acde4d-1ccc-4f88-85e6-e773bfa8db3e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:42.340808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93acde4d-1ccc-4f88-85e6-e773bfa8db3e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:42.346063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93acde4d-1ccc-4f88-85e6-e773bfa8db3e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:42.347050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93acde4d-1ccc-4f88-85e6-e773bfa8db3e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:42.347641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93acde4d-1ccc-4f88-85e6-e773bfa8db3e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:42.348341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93acde4d-1ccc-4f88-85e6-e773bfa8db3e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:42.513226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-73262821-9609-4465-be02-735bd6259113 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:42.526122 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-73262821-9609-4465-be02-735bd6259113 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1565 microversion: 2.1 time: 0.617466 Oct 27 19:00:42.528273 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1803/3459] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:41 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1565 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:42.551797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e258a65a-083b-4b65-91a7-b3992c4f9189 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:42.552614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e258a65a-083b-4b65-91a7-b3992c4f9189 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:42.566571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e258a65a-083b-4b65-91a7-b3992c4f9189 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:42.567543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e258a65a-083b-4b65-91a7-b3992c4f9189 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:42.568210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e258a65a-083b-4b65-91a7-b3992c4f9189 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:42.568988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e258a65a-083b-4b65-91a7-b3992c4f9189 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:42.569561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e258a65a-083b-4b65-91a7-b3992c4f9189 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:42.574273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e258a65a-083b-4b65-91a7-b3992c4f9189 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:42.913299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-93acde4d-1ccc-4f88-85e6-e773bfa8db3e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:42.937633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-93acde4d-1ccc-4f88-85e6-e773bfa8db3e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:42.937633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-93acde4d-1ccc-4f88-85e6-e773bfa8db3e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:42.938630 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-93acde4d-1ccc-4f88-85e6-e773bfa8db3e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1866 microversion: 2.42 time: 0.620010 Oct 27 19:00:42.954817 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1657/3460] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:42 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1866 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:00:42.972164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6df785f1-d853-4b7b-83f8-94020c111a6a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:42.972811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6df785f1-d853-4b7b-83f8-94020c111a6a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:42.979796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df785f1-d853-4b7b-83f8-94020c111a6a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:42.980305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df785f1-d853-4b7b-83f8-94020c111a6a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:42.980760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df785f1-d853-4b7b-83f8-94020c111a6a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:42.981507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df785f1-d853-4b7b-83f8-94020c111a6a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:42.981980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df785f1-d853-4b7b-83f8-94020c111a6a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:42.982449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df785f1-d853-4b7b-83f8-94020c111a6a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:43.096652 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e258a65a-083b-4b65-91a7-b3992c4f9189 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.549258 Oct 27 19:00:43.097448 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1804/3461] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:00:42 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-interface => generated 285 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:00:43.105104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8456b6f0-7143-4257-8da5-eaf98049d65b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:43.106239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8456b6f0-7143-4257-8da5-eaf98049d65b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:43.121806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8456b6f0-7143-4257-8da5-eaf98049d65b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:43.122412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8456b6f0-7143-4257-8da5-eaf98049d65b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:43.122888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8456b6f0-7143-4257-8da5-eaf98049d65b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:43.126931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8456b6f0-7143-4257-8da5-eaf98049d65b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:43.127441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8456b6f0-7143-4257-8da5-eaf98049d65b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:43.127899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8456b6f0-7143-4257-8da5-eaf98049d65b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:43.269027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:43.476791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8456b6f0-7143-4257-8da5-eaf98049d65b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:43.486730 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8456b6f0-7143-4257-8da5-eaf98049d65b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1210 microversion: 2.1 time: 0.386755 Oct 27 19:00:43.492740 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1805/3462] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:43 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1210 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:43.615599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6df785f1-d853-4b7b-83f8-94020c111a6a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:43.631954 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6df785f1-d853-4b7b-83f8-94020c111a6a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1308 microversion: 2.1 time: 0.675931 Oct 27 19:00:43.640602 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1658/3463] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:42 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1308 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:43.970169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-75d1ac85-3109-4877-aca7-82f2d11ce241 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:43.970965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-75d1ac85-3109-4877-aca7-82f2d11ce241 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:43.987827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75d1ac85-3109-4877-aca7-82f2d11ce241 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:43.989931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75d1ac85-3109-4877-aca7-82f2d11ce241 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:43.993425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75d1ac85-3109-4877-aca7-82f2d11ce241 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:43.995790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-741e8e03-5a9b-47df-9db7-aae1aa3df82f req-dc668edc-1555-42b4-8227-46f6c058fb33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a0b276-1f26-4c66-9c0f-8ada81266162", "tag": "2b54e61c-2e06-4b78-9fd7-f1f2dde7fd49"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:43.996506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75d1ac85-3109-4877-aca7-82f2d11ce241 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:43.997092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75d1ac85-3109-4877-aca7-82f2d11ce241 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:44.000035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75d1ac85-3109-4877-aca7-82f2d11ce241 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:44.009142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=28 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:44.020738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-741e8e03-5a9b-47df-9db7-aae1aa3df82f req-dc668edc-1555-42b4-8227-46f6c058fb33 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:44.022416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-741e8e03-5a9b-47df-9db7-aae1aa3df82f req-dc668edc-1555-42b4-8227-46f6c058fb33 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:44.024364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-741e8e03-5a9b-47df-9db7-aae1aa3df82f req-dc668edc-1555-42b4-8227-46f6c058fb33 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:44.051292 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-741e8e03-5a9b-47df-9db7-aae1aa3df82f req-dc668edc-1555-42b4-8227-46f6c058fb33 service nova] Creating event network-changed:2b54e61c-2e06-4b78-9fd7-f1f2dde7fd49 for instance 06a0b276-1f26-4c66-9c0f-8ada81266162 on n-h2-860687-3 Oct 27 19:00:44.068702 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-741e8e03-5a9b-47df-9db7-aae1aa3df82f req-dc668edc-1555-42b4-8227-46f6c058fb33 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078517 Oct 27 19:00:44.070230 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1659/3464] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:44.501829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-75d1ac85-3109-4877-aca7-82f2d11ce241 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:44.514814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1ed0ff7d-2d3a-478c-8873-a0b3351c226a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:44.515450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1ed0ff7d-2d3a-478c-8873-a0b3351c226a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:44.516806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-75d1ac85-3109-4877-aca7-82f2d11ce241 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:44.519810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-75d1ac85-3109-4877-aca7-82f2d11ce241 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:44.523017 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-75d1ac85-3109-4877-aca7-82f2d11ce241 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1887 microversion: 2.42 time: 0.558259 Oct 27 19:00:44.530828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ed0ff7d-2d3a-478c-8873-a0b3351c226a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:44.531601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ed0ff7d-2d3a-478c-8873-a0b3351c226a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:44.532217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ed0ff7d-2d3a-478c-8873-a0b3351c226a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:44.533102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ed0ff7d-2d3a-478c-8873-a0b3351c226a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:44.533732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ed0ff7d-2d3a-478c-8873-a0b3351c226a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:44.534333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ed0ff7d-2d3a-478c-8873-a0b3351c226a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:44.552342 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1806/3465] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:43 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1887 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:44.664687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-00e40351-5847-43c2-98df-300c00a40e85 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:44.665606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-00e40351-5847-43c2-98df-300c00a40e85 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:44.672353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00e40351-5847-43c2-98df-300c00a40e85 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:44.673124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00e40351-5847-43c2-98df-300c00a40e85 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:44.674022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00e40351-5847-43c2-98df-300c00a40e85 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:44.675001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00e40351-5847-43c2-98df-300c00a40e85 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:44.675631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00e40351-5847-43c2-98df-300c00a40e85 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:44.676228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00e40351-5847-43c2-98df-300c00a40e85 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:44.909415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-00e40351-5847-43c2-98df-300c00a40e85 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:44.919862 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-00e40351-5847-43c2-98df-300c00a40e85 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1488 microversion: 2.1 time: 0.259021 Oct 27 19:00:44.920892 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1807/3466] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:44 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1488 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:44.933352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1ed0ff7d-2d3a-478c-8873-a0b3351c226a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:44.951351 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1ed0ff7d-2d3a-478c-8873-a0b3351c226a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1210 microversion: 2.1 time: 0.441743 Oct 27 19:00:44.952269 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1660/3467] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:44 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1210 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:44.957000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8d2cfb11-525c-4833-b097-1250a8ae14da tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-382763522"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:44.959646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8d2cfb11-525c-4833-b097-1250a8ae14da tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:44.986570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d2cfb11-525c-4833-b097-1250a8ae14da tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:44.987269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d2cfb11-525c-4833-b097-1250a8ae14da tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:44.987889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d2cfb11-525c-4833-b097-1250a8ae14da tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:44.990326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d2cfb11-525c-4833-b097-1250a8ae14da tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:44.990998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d2cfb11-525c-4833-b097-1250a8ae14da tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:44.992490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d2cfb11-525c-4833-b097-1250a8ae14da tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:45.175166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d4adeb66-ddec-4df6-b29a-15ddf4332e44 req-cac0aea0-0668-4f67-83f4-a670105696ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c958b48-5e00-49c6-95ab-a36acdbdf6e2", "tag": "f5c0b623-9e29-4d46-9459-e03cfbf0d547"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:45.188924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d4adeb66-ddec-4df6-b29a-15ddf4332e44 req-cac0aea0-0668-4f67-83f4-a670105696ea service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:45.189915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d4adeb66-ddec-4df6-b29a-15ddf4332e44 req-cac0aea0-0668-4f67-83f4-a670105696ea service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:45.190896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d4adeb66-ddec-4df6-b29a-15ddf4332e44 req-cac0aea0-0668-4f67-83f4-a670105696ea service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:45.209584 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d4adeb66-ddec-4df6-b29a-15ddf4332e44 req-cac0aea0-0668-4f67-83f4-a670105696ea service nova] Creating event network-changed:f5c0b623-9e29-4d46-9459-e03cfbf0d547 for instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 on n-h2-860687-3 Oct 27 19:00:45.218056 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d4adeb66-ddec-4df6-b29a-15ddf4332e44 req-cac0aea0-0668-4f67-83f4-a670105696ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295838 Oct 27 19:00:45.223336 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1808/3468] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:45.327662 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8d2cfb11-525c-4833-b097-1250a8ae14da tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "POST /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a/action" status: 202 len: 0 microversion: 2.1 time: 0.374074 Oct 27 19:00:45.332762 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1661/3469] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:00:44 2022] POST /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 19:00:45.345415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e9e76e4b-8a94-40d7-8987-3a75f2ecd3e0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a9d03a0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:45.430811 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e9e76e4b-8a94-40d7-8987-3a75f2ecd3e0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/4b77d55b-e5e9-4ca6-8484-4192c3fa6f88" status: 200 len: 1411 microversion: 2.1 time: 0.090260 Oct 27 19:00:45.433161 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1809/3470] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 19:00:45 2022] GET /compute/v2.1/images/4b77d55b-e5e9-4ca6-8484-4192c3fa6f88 => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:45.448316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf3bf0e9-559b-475d-9be5-68d476f9efb5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc869c0c430>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:45.505240 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cf3bf0e9-559b-475d-9be5-68d476f9efb5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/4b77d55b-e5e9-4ca6-8484-4192c3fa6f88" status: 200 len: 1411 microversion: 2.1 time: 0.061770 Oct 27 19:00:45.506537 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1662/3471] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 19:00:45 2022] GET /compute/v2.1/images/4b77d55b-e5e9-4ca6-8484-4192c3fa6f88 => generated 1411 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:45.531250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2370a1eb-0031-464c-8f7f-241b4e7e4dc7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a7deb80>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:45.576972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-29e47ab4-886b-4762-b2f3-0799059b83b1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:45.584967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-29e47ab4-886b-4762-b2f3-0799059b83b1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:45.604940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29e47ab4-886b-4762-b2f3-0799059b83b1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:45.605733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29e47ab4-886b-4762-b2f3-0799059b83b1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:45.607439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29e47ab4-886b-4762-b2f3-0799059b83b1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:45.608437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29e47ab4-886b-4762-b2f3-0799059b83b1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:45.609911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29e47ab4-886b-4762-b2f3-0799059b83b1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:45.610646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29e47ab4-886b-4762-b2f3-0799059b83b1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:45.776083 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2370a1eb-0031-464c-8f7f-241b4e7e4dc7 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/images/4b77d55b-e5e9-4ca6-8484-4192c3fa6f88" status: 204 len: 0 microversion: 2.1 time: 0.257586 Oct 27 19:00:45.776992 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1810/3472] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:45 2022] DELETE /compute/v2.1/images/4b77d55b-e5e9-4ca6-8484-4192c3fa6f88 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:00:45.786793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0507ca96-7dca-45d0-8dea-1a78e3ca3d5a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86aa2a1f0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:45.812754 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-0507ca96-7dca-45d0-8dea-1a78e3ca3d5a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Image not found. Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0507ca96-7dca-45d0-8dea-1a78e3ca3d5a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/images/4b77d55b-e5e9-4ca6-8484-4192c3fa6f88 HTTP/1.1 Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: exception: Image not found. Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '4b77d55b-e5e9-4ca6-8484-4192c3fa6f88'} Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4b77d55b-e5e9-4ca6-8484-4192c3fa6f88 Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 19:00:45.815807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4b77d55b-e5e9-4ca6-8484-4192c3fa6f88 could not be found. Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 19:00:45.821326 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:45.832673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0507ca96-7dca-45d0-8dea-1a78e3ca3d5a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Image not found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:45.834207 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0507ca96-7dca-45d0-8dea-1a78e3ca3d5a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/images/4b77d55b-e5e9-4ca6-8484-4192c3fa6f88" status: 404 len: 62 microversion: 2.1 time: 0.051586 Oct 27 19:00:45.841228 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1811/3473] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 19:00:45 2022] GET /compute/v2.1/images/4b77d55b-e5e9-4ca6-8484-4192c3fa6f88 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:00:45.848485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6b530876-e360-4950-8282-2a35baf75abd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:45.849422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6b530876-e360-4950-8282-2a35baf75abd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:45.858432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b530876-e360-4950-8282-2a35baf75abd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:45.859320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b530876-e360-4950-8282-2a35baf75abd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:45.859949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b530876-e360-4950-8282-2a35baf75abd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:45.860847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b530876-e360-4950-8282-2a35baf75abd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:45.861880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b530876-e360-4950-8282-2a35baf75abd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:45.862937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b530876-e360-4950-8282-2a35baf75abd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:46.039538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-29e47ab4-886b-4762-b2f3-0799059b83b1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:46.052664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-29e47ab4-886b-4762-b2f3-0799059b83b1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:46.058359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-29e47ab4-886b-4762-b2f3-0799059b83b1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:46.061383 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-29e47ab4-886b-4762-b2f3-0799059b83b1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1887 microversion: 2.42 time: 0.508106 Oct 27 19:00:46.064500 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1663/3474] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:45 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1887 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:00:46.075587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-41d6f551-8f3b-4835-b110-0218abd36d96 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:46.076366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-41d6f551-8f3b-4835-b110-0218abd36d96 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:46.107772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41d6f551-8f3b-4835-b110-0218abd36d96 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:46.108525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41d6f551-8f3b-4835-b110-0218abd36d96 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:46.109035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41d6f551-8f3b-4835-b110-0218abd36d96 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:46.110074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41d6f551-8f3b-4835-b110-0218abd36d96 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:46.112187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41d6f551-8f3b-4835-b110-0218abd36d96 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:46.113036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41d6f551-8f3b-4835-b110-0218abd36d96 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:46.140901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6b530876-e360-4950-8282-2a35baf75abd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:46.154213 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6b530876-e360-4950-8282-2a35baf75abd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1500 microversion: 2.1 time: 0.309134 Oct 27 19:00:46.156848 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1812/3475] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:45 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1500 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:46.209634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d7288719-014e-4a45-843e-8482d2c0f27b req-dad02f17-89ea-413b-b110-5f51dba9293c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "tag": "2a34a33b-11c6-4dcd-a52b-4a26af50fc18"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:46.230402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d7288719-014e-4a45-843e-8482d2c0f27b req-dad02f17-89ea-413b-b110-5f51dba9293c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:46.231082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d7288719-014e-4a45-843e-8482d2c0f27b req-dad02f17-89ea-413b-b110-5f51dba9293c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:46.231695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d7288719-014e-4a45-843e-8482d2c0f27b req-dad02f17-89ea-413b-b110-5f51dba9293c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:46.239076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:46.250908 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d7288719-014e-4a45-843e-8482d2c0f27b req-dad02f17-89ea-413b-b110-5f51dba9293c service nova] Creating event network-changed:2a34a33b-11c6-4dcd-a52b-4a26af50fc18 for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:00:46.257938 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d7288719-014e-4a45-843e-8482d2c0f27b req-dad02f17-89ea-413b-b110-5f51dba9293c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051072 Oct 27 19:00:46.258948 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1813/3476] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:00:46.734927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-41d6f551-8f3b-4835-b110-0218abd36d96 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:46.745634 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-41d6f551-8f3b-4835-b110-0218abd36d96 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1210 microversion: 2.1 time: 0.679907 Oct 27 19:00:46.746515 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1664/3477] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:46 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1210 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:47.101785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6c28432c-d838-4bc6-8ae4-3a05e4f4dbb5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:47.102976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6c28432c-d838-4bc6-8ae4-3a05e4f4dbb5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:47.123656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c28432c-d838-4bc6-8ae4-3a05e4f4dbb5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:47.126014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c28432c-d838-4bc6-8ae4-3a05e4f4dbb5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:47.133178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c28432c-d838-4bc6-8ae4-3a05e4f4dbb5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:47.134288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c28432c-d838-4bc6-8ae4-3a05e4f4dbb5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:47.135755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c28432c-d838-4bc6-8ae4-3a05e4f4dbb5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:47.142961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c28432c-d838-4bc6-8ae4-3a05e4f4dbb5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:47.182706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a030ee06-b10e-4b6c-a102-b25a6ce22ea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:47.183702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a030ee06-b10e-4b6c-a102-b25a6ce22ea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:47.195256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a030ee06-b10e-4b6c-a102-b25a6ce22ea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:47.197126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a030ee06-b10e-4b6c-a102-b25a6ce22ea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:47.198056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a030ee06-b10e-4b6c-a102-b25a6ce22ea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:47.200702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a030ee06-b10e-4b6c-a102-b25a6ce22ea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:47.201576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a030ee06-b10e-4b6c-a102-b25a6ce22ea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:47.202622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a030ee06-b10e-4b6c-a102-b25a6ce22ea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:47.575591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6c28432c-d838-4bc6-8ae4-3a05e4f4dbb5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:47.607812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6c28432c-d838-4bc6-8ae4-3a05e4f4dbb5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:47.609933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6c28432c-d838-4bc6-8ae4-3a05e4f4dbb5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:47.612778 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6c28432c-d838-4bc6-8ae4-3a05e4f4dbb5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1887 microversion: 2.42 time: 0.517358 Oct 27 19:00:47.613987 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1814/3478] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:47 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1887 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:47.773718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6b0336ac-d05d-4c6e-bd43-7cb7ea99b3f8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:47.774980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6b0336ac-d05d-4c6e-bd43-7cb7ea99b3f8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:47.782583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b0336ac-d05d-4c6e-bd43-7cb7ea99b3f8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:47.783269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b0336ac-d05d-4c6e-bd43-7cb7ea99b3f8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:47.783912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b0336ac-d05d-4c6e-bd43-7cb7ea99b3f8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:47.786698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b0336ac-d05d-4c6e-bd43-7cb7ea99b3f8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:47.787353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b0336ac-d05d-4c6e-bd43-7cb7ea99b3f8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:47.787983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b0336ac-d05d-4c6e-bd43-7cb7ea99b3f8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:47.951937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a030ee06-b10e-4b6c-a102-b25a6ce22ea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:47.957833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:47.969363 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a030ee06-b10e-4b6c-a102-b25a6ce22ea5 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1506 microversion: 2.1 time: 0.789459 Oct 27 19:00:47.971209 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1665/3479] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:47 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1506 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:48.065377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6b0336ac-d05d-4c6e-bd43-7cb7ea99b3f8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:48.083571 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6b0336ac-d05d-4c6e-bd43-7cb7ea99b3f8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1210 microversion: 2.1 time: 0.314822 Oct 27 19:00:48.120575 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1815/3480] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:47 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1210 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:48.643901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f3961b4a-bef7-4c6a-9758-1c33492302bc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:48.645245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f3961b4a-bef7-4c6a-9758-1c33492302bc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:48.653867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3961b4a-bef7-4c6a-9758-1c33492302bc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:48.654726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3961b4a-bef7-4c6a-9758-1c33492302bc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:48.655457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3961b4a-bef7-4c6a-9758-1c33492302bc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:48.656518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3961b4a-bef7-4c6a-9758-1c33492302bc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:48.658598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3961b4a-bef7-4c6a-9758-1c33492302bc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:48.659315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3961b4a-bef7-4c6a-9758-1c33492302bc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:48.867216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-5a4eb4b5-d982-4306-bd76-55116400c168 req-bb84c5dd-119c-4dd7-9eaa-843bcf7837fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "tag": "84b5f126-b4b7-4b2f-9238-d2b20b3ec67d"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:48.889377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5a4eb4b5-d982-4306-bd76-55116400c168 req-bb84c5dd-119c-4dd7-9eaa-843bcf7837fb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:48.889965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5a4eb4b5-d982-4306-bd76-55116400c168 req-bb84c5dd-119c-4dd7-9eaa-843bcf7837fb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:48.896388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5a4eb4b5-d982-4306-bd76-55116400c168 req-bb84c5dd-119c-4dd7-9eaa-843bcf7837fb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:48.935504 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5a4eb4b5-d982-4306-bd76-55116400c168 req-bb84c5dd-119c-4dd7-9eaa-843bcf7837fb service nova] Creating event network-changed:84b5f126-b4b7-4b2f-9238-d2b20b3ec67d for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:00:48.951017 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-5a4eb4b5-d982-4306-bd76-55116400c168 req-bb84c5dd-119c-4dd7-9eaa-843bcf7837fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.566403 Oct 27 19:00:48.951642 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1666/3481] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:48.998215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-35b21631-9cc5-4f26-ad1b-2e94791f6b04 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:48.999141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-35b21631-9cc5-4f26-ad1b-2e94791f6b04 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:49.022642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35b21631-9cc5-4f26-ad1b-2e94791f6b04 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:49.023912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35b21631-9cc5-4f26-ad1b-2e94791f6b04 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:49.028708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35b21631-9cc5-4f26-ad1b-2e94791f6b04 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:49.030958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35b21631-9cc5-4f26-ad1b-2e94791f6b04 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:49.031451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35b21631-9cc5-4f26-ad1b-2e94791f6b04 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:49.034686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35b21631-9cc5-4f26-ad1b-2e94791f6b04 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:49.089067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f3961b4a-bef7-4c6a-9758-1c33492302bc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:49.102139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f3961b4a-bef7-4c6a-9758-1c33492302bc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:49.105016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f3961b4a-bef7-4c6a-9758-1c33492302bc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:49.107288 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f3961b4a-bef7-4c6a-9758-1c33492302bc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1887 microversion: 2.42 time: 0.467547 Oct 27 19:00:49.108535 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1816/3482] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:48 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1887 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:00:49.142008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4111f101-b94c-408e-bf48-2a3f6fcebb74 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:49.143028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4111f101-b94c-408e-bf48-2a3f6fcebb74 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:49.167456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4111f101-b94c-408e-bf48-2a3f6fcebb74 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:49.168172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4111f101-b94c-408e-bf48-2a3f6fcebb74 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:49.168774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4111f101-b94c-408e-bf48-2a3f6fcebb74 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:49.170296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4111f101-b94c-408e-bf48-2a3f6fcebb74 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:49.172527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4111f101-b94c-408e-bf48-2a3f6fcebb74 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:49.173144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4111f101-b94c-408e-bf48-2a3f6fcebb74 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:49.535704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4111f101-b94c-408e-bf48-2a3f6fcebb74 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:49.554414 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4111f101-b94c-408e-bf48-2a3f6fcebb74 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1210 microversion: 2.1 time: 0.420861 Oct 27 19:00:49.555297 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1817/3483] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:49 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1210 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:49.812058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-35b21631-9cc5-4f26-ad1b-2e94791f6b04 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:49.821907 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-35b21631-9cc5-4f26-ad1b-2e94791f6b04 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1488 microversion: 2.1 time: 0.829475 Oct 27 19:00:49.827042 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1667/3484] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:48 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1488 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:49.848731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85a25657-6444-4fa9-8090-69e1921a74a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:49.850153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-85a25657-6444-4fa9-8090-69e1921a74a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:49.859138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85a25657-6444-4fa9-8090-69e1921a74a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:49.860347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85a25657-6444-4fa9-8090-69e1921a74a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:49.861006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85a25657-6444-4fa9-8090-69e1921a74a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:49.862266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85a25657-6444-4fa9-8090-69e1921a74a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:49.863079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85a25657-6444-4fa9-8090-69e1921a74a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:49.863797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85a25657-6444-4fa9-8090-69e1921a74a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:49.923066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-85a25657-6444-4fa9-8090-69e1921a74a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:00:50.079698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fbebab97-aec7-4bce-a230-9672452a3430 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:50.082625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fbebab97-aec7-4bce-a230-9672452a3430 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:50.091079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbebab97-aec7-4bce-a230-9672452a3430 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:50.092102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbebab97-aec7-4bce-a230-9672452a3430 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:50.092772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbebab97-aec7-4bce-a230-9672452a3430 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:50.093881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbebab97-aec7-4bce-a230-9672452a3430 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:50.094536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbebab97-aec7-4bce-a230-9672452a3430 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:50.095169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fbebab97-aec7-4bce-a230-9672452a3430 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:50.118719 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-85a25657-6444-4fa9-8090-69e1921a74a4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 204 len: 0 microversion: 2.1 time: 0.273705 Oct 27 19:00:50.125243 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1818/3485] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:00:49 2022] DELETE /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:00:50.131244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-92a0747c-ede7-454c-a22e-fe02ada368ab tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86a0b2820>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:50.154359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-fbebab97-aec7-4bce-a230-9672452a3430 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lazy-loading 'flavor' on Instance uuid f4a7713a-b78d-425e-a6e8-0e4f5bc8904b {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:00:50.193904 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-92a0747c-ede7-454c-a22e-fe02ada368ab tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Image not found. Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-92a0747c-ede7-454c-a22e-fe02ada368ab tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/images/4b77d55b-e5e9-4ca6-8484-4192c3fa6f88 HTTP/1.1 Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: exception: Image not found. Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '4b77d55b-e5e9-4ca6-8484-4192c3fa6f88'} Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4b77d55b-e5e9-4ca6-8484-4192c3fa6f88 to delete Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4b77d55b-e5e9-4ca6-8484-4192c3fa6f88 could not be found. Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:50.195846 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-92a0747c-ede7-454c-a22e-fe02ada368ab tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Image not found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-92a0747c-ede7-454c-a22e-fe02ada368ab tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/images/4b77d55b-e5e9-4ca6-8484-4192c3fa6f88" status: 404 len: 62 microversion: 2.1 time: 0.070711 Oct 27 19:00:50.203073 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1819/3486] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:50 2022] DELETE /compute/v2.1/images/4b77d55b-e5e9-4ca6-8484-4192c3fa6f88 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:00:50.206228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-906c23a6-49d5-431f-821d-5eee3a8dcc66 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:50.207554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-906c23a6-49d5-431f-821d-5eee3a8dcc66 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:50.236147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-906c23a6-49d5-431f-821d-5eee3a8dcc66 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:50.236751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-906c23a6-49d5-431f-821d-5eee3a8dcc66 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:50.237281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-906c23a6-49d5-431f-821d-5eee3a8dcc66 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:50.246333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-906c23a6-49d5-431f-821d-5eee3a8dcc66 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:50.246895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-906c23a6-49d5-431f-821d-5eee3a8dcc66 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:50.247322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-906c23a6-49d5-431f-821d-5eee3a8dcc66 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:50.551335 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fbebab97-aec7-4bce-a230-9672452a3430 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "POST /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/action" status: 202 len: 0 microversion: 2.20 time: 0.475615 Oct 27 19:00:50.552200 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1668/3487] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 19:00:50 2022] POST /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:00:50.562917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7e690a6f-64c7-465f-b911-01860bffbbc8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:50.563755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7e690a6f-64c7-465f-b911-01860bffbbc8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:50.571044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e690a6f-64c7-465f-b911-01860bffbbc8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:50.571812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e690a6f-64c7-465f-b911-01860bffbbc8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:50.572916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e690a6f-64c7-465f-b911-01860bffbbc8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:50.573848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e690a6f-64c7-465f-b911-01860bffbbc8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:50.574595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e690a6f-64c7-465f-b911-01860bffbbc8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:50.575241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e690a6f-64c7-465f-b911-01860bffbbc8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:50.622034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7e690a6f-64c7-465f-b911-01860bffbbc8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:00:50.635177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-906c23a6-49d5-431f-821d-5eee3a8dcc66 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:50.646747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-906c23a6-49d5-431f-821d-5eee3a8dcc66 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:50.648664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-906c23a6-49d5-431f-821d-5eee3a8dcc66 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:50.650500 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-906c23a6-49d5-431f-821d-5eee3a8dcc66 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1887 microversion: 2.42 time: 0.451300 Oct 27 19:00:50.651470 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1820/3488] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:50 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1887 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:50.663296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-854612be-87f2-454a-a304-907662350784 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:50.664376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-854612be-87f2-454a-a304-907662350784 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:50.689882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-854612be-87f2-454a-a304-907662350784 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:50.691908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-854612be-87f2-454a-a304-907662350784 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:50.692585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-854612be-87f2-454a-a304-907662350784 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:50.693323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-854612be-87f2-454a-a304-907662350784 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:50.695527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-854612be-87f2-454a-a304-907662350784 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:50.696728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-854612be-87f2-454a-a304-907662350784 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:50.717440 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.compute.api [None req-7e690a6f-64c7-465f-b911-01860bffbbc8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Instance is already in deleting state, ignoring this request Oct 27 19:00:50.722582 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7e690a6f-64c7-465f-b911-01860bffbbc8 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 204 len: 0 microversion: 2.1 time: 0.164680 Oct 27 19:00:50.726296 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1669/3489] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:00:50 2022] DELETE /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:00:50.731840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-597cbcde-96b1-4338-b0e5-264698717c22 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:50.736395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-597cbcde-96b1-4338-b0e5-264698717c22 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:50.754570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597cbcde-96b1-4338-b0e5-264698717c22 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:50.755181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597cbcde-96b1-4338-b0e5-264698717c22 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:50.755953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597cbcde-96b1-4338-b0e5-264698717c22 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:50.756767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597cbcde-96b1-4338-b0e5-264698717c22 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:50.767930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597cbcde-96b1-4338-b0e5-264698717c22 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:50.774116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597cbcde-96b1-4338-b0e5-264698717c22 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:50.934859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-854612be-87f2-454a-a304-907662350784 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:50.946531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-854612be-87f2-454a-a304-907662350784 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:50.952449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-854612be-87f2-454a-a304-907662350784 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:50.956517 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-854612be-87f2-454a-a304-907662350784 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1721 microversion: 2.20 time: 0.303764 Oct 27 19:00:50.958601 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1821/3490] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:50 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1721 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:50.971506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-05752fe5-5821-45f7-b9c9-7f59de1a09f9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:50.972622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-05752fe5-5821-45f7-b9c9-7f59de1a09f9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:50.989277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05752fe5-5821-45f7-b9c9-7f59de1a09f9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:50.991030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05752fe5-5821-45f7-b9c9-7f59de1a09f9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:50.992195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05752fe5-5821-45f7-b9c9-7f59de1a09f9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:50.998477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05752fe5-5821-45f7-b9c9-7f59de1a09f9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:51.001486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05752fe5-5821-45f7-b9c9-7f59de1a09f9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:51.004082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05752fe5-5821-45f7-b9c9-7f59de1a09f9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:51.148287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-597cbcde-96b1-4338-b0e5-264698717c22 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:51.159115 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-597cbcde-96b1-4338-b0e5-264698717c22 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1198 microversion: 2.1 time: 0.430786 Oct 27 19:00:51.175149 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1670/3491] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:50 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1198 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:51.192715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-566c8d16-7135-4815-848c-ef9fa02b54e7 req-b898aa7a-53f3-4746-b26e-216eae3037d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "tag": "932a9230-1751-47ce-9693-0eddb2a30ee1"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:51.203812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-566c8d16-7135-4815-848c-ef9fa02b54e7 req-b898aa7a-53f3-4746-b26e-216eae3037d1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:51.204444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-566c8d16-7135-4815-848c-ef9fa02b54e7 req-b898aa7a-53f3-4746-b26e-216eae3037d1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:51.205358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-566c8d16-7135-4815-848c-ef9fa02b54e7 req-b898aa7a-53f3-4746-b26e-216eae3037d1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:51.218428 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-566c8d16-7135-4815-848c-ef9fa02b54e7 req-b898aa7a-53f3-4746-b26e-216eae3037d1 service nova] Creating event network-changed:932a9230-1751-47ce-9693-0eddb2a30ee1 for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:00:51.223393 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-566c8d16-7135-4815-848c-ef9fa02b54e7 req-b898aa7a-53f3-4746-b26e-216eae3037d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046879 Oct 27 19:00:51.223998 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1671/3492] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:51.353001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-05752fe5-5821-45f7-b9c9-7f59de1a09f9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:51.362802 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-05752fe5-5821-45f7-b9c9-7f59de1a09f9 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1494 microversion: 2.1 time: 0.402879 Oct 27 19:00:51.363639 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1822/3493] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:50 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1494 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:51.379522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-43daca5f-2e64-4d56-93dd-d8bb93ff0035 req-0d180b61-341d-4c6d-9201-1ae6650393a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a", "name": "network-vif-plugged", "status": "completed", "tag": "fc9fe7e8-b47d-4417-b21e-720480b5d605"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:51.390765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-43daca5f-2e64-4d56-93dd-d8bb93ff0035 req-0d180b61-341d-4c6d-9201-1ae6650393a2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:51.391259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-43daca5f-2e64-4d56-93dd-d8bb93ff0035 req-0d180b61-341d-4c6d-9201-1ae6650393a2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:51.391701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-43daca5f-2e64-4d56-93dd-d8bb93ff0035 req-0d180b61-341d-4c6d-9201-1ae6650393a2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:51.403200 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-43daca5f-2e64-4d56-93dd-d8bb93ff0035 req-0d180b61-341d-4c6d-9201-1ae6650393a2 service nova] Creating event network-vif-plugged:fc9fe7e8-b47d-4417-b21e-720480b5d605 for instance a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a on n-h1-860687-3 Oct 27 19:00:51.409005 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-43daca5f-2e64-4d56-93dd-d8bb93ff0035 req-0d180b61-341d-4c6d-9201-1ae6650393a2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183326 Oct 27 19:00:51.409615 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1672/3494] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:51.679612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6b32348b-9ee4-47a2-a2e8-76a23d5ca933 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:51.680368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6b32348b-9ee4-47a2-a2e8-76a23d5ca933 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:51.687186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b32348b-9ee4-47a2-a2e8-76a23d5ca933 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:51.687768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b32348b-9ee4-47a2-a2e8-76a23d5ca933 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:51.688283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b32348b-9ee4-47a2-a2e8-76a23d5ca933 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:51.689063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b32348b-9ee4-47a2-a2e8-76a23d5ca933 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:51.689630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b32348b-9ee4-47a2-a2e8-76a23d5ca933 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:51.690136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b32348b-9ee4-47a2-a2e8-76a23d5ca933 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:51.896910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6b32348b-9ee4-47a2-a2e8-76a23d5ca933 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:51.910431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6b32348b-9ee4-47a2-a2e8-76a23d5ca933 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:51.912528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6b32348b-9ee4-47a2-a2e8-76a23d5ca933 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:51.915050 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6b32348b-9ee4-47a2-a2e8-76a23d5ca933 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1887 microversion: 2.42 time: 0.238658 Oct 27 19:00:51.916294 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1823/3495] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:51 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1887 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:51.987318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3748387f-79e8-451c-b026-4d78f464b3b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:51.988059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3748387f-79e8-451c-b026-4d78f464b3b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:51.996322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3748387f-79e8-451c-b026-4d78f464b3b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:51.997137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3748387f-79e8-451c-b026-4d78f464b3b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:51.997761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3748387f-79e8-451c-b026-4d78f464b3b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:51.998732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3748387f-79e8-451c-b026-4d78f464b3b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:51.999371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3748387f-79e8-451c-b026-4d78f464b3b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:51.999992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3748387f-79e8-451c-b026-4d78f464b3b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:52.188310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e9135e7e-8f19-440b-b1eb-1ab76d9f35d2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:52.188924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e9135e7e-8f19-440b-b1eb-1ab76d9f35d2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:52.205931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9135e7e-8f19-440b-b1eb-1ab76d9f35d2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:52.206755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9135e7e-8f19-440b-b1eb-1ab76d9f35d2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:52.206971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9135e7e-8f19-440b-b1eb-1ab76d9f35d2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:52.207639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9135e7e-8f19-440b-b1eb-1ab76d9f35d2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:52.208106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9135e7e-8f19-440b-b1eb-1ab76d9f35d2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:52.208544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9135e7e-8f19-440b-b1eb-1ab76d9f35d2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:52.362397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e9135e7e-8f19-440b-b1eb-1ab76d9f35d2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:52.371114 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e9135e7e-8f19-440b-b1eb-1ab76d9f35d2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1198 microversion: 2.1 time: 0.186581 Oct 27 19:00:52.387106 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1824/3496] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:52 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1198 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:52.393398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f4975152-e726-4c48-ad96-53c66e361405 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:52.394302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f4975152-e726-4c48-ad96-53c66e361405 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:52.401030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4975152-e726-4c48-ad96-53c66e361405 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:52.401827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4975152-e726-4c48-ad96-53c66e361405 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:52.402519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4975152-e726-4c48-ad96-53c66e361405 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:52.403460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4975152-e726-4c48-ad96-53c66e361405 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:52.404123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4975152-e726-4c48-ad96-53c66e361405 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:52.404758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4975152-e726-4c48-ad96-53c66e361405 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:53.143050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f4975152-e726-4c48-ad96-53c66e361405 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:53.156825 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f4975152-e726-4c48-ad96-53c66e361405 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1494 microversion: 2.1 time: 0.768051 Oct 27 19:00:53.157685 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1825/3497] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:52 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1494 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:53.177734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7c2082db-eef3-4761-ab80-9b993674137a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:53.178509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7c2082db-eef3-4761-ab80-9b993674137a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:53.189496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c2082db-eef3-4761-ab80-9b993674137a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:53.190140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c2082db-eef3-4761-ab80-9b993674137a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:53.190473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c2082db-eef3-4761-ab80-9b993674137a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:53.191196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c2082db-eef3-4761-ab80-9b993674137a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:53.199364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c2082db-eef3-4761-ab80-9b993674137a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:53.200097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c2082db-eef3-4761-ab80-9b993674137a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:53.497789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3748387f-79e8-451c-b026-4d78f464b3b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:53.517083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3748387f-79e8-451c-b026-4d78f464b3b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:53.518693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3748387f-79e8-451c-b026-4d78f464b3b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:53.520115 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3748387f-79e8-451c-b026-4d78f464b3b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1721 microversion: 2.20 time: 1.539755 Oct 27 19:00:53.520879 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1673/3498] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:51 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1721 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:53.526848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-84602e80-7029-400e-9adb-113542490f96 req-e90b6166-fa28-4cbb-a488-89028c4e5683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "tag": "5caa00b6-63fd-476a-9d5a-0faa8aa4baad"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:53.554763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-84602e80-7029-400e-9adb-113542490f96 req-e90b6166-fa28-4cbb-a488-89028c4e5683 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:53.555507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-84602e80-7029-400e-9adb-113542490f96 req-e90b6166-fa28-4cbb-a488-89028c4e5683 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:53.556207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-84602e80-7029-400e-9adb-113542490f96 req-e90b6166-fa28-4cbb-a488-89028c4e5683 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:53.602368 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-84602e80-7029-400e-9adb-113542490f96 req-e90b6166-fa28-4cbb-a488-89028c4e5683 service nova] Creating event network-changed:5caa00b6-63fd-476a-9d5a-0faa8aa4baad for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:00:53.616885 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-84602e80-7029-400e-9adb-113542490f96 req-e90b6166-fa28-4cbb-a488-89028c4e5683 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094251 Oct 27 19:00:53.619835 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1674/3499] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:53.628394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7c2082db-eef3-4761-ab80-9b993674137a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:53.630852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7d44f52e-5bb8-4716-8c2d-3c8a0bfe55c9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:53.640177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7d44f52e-5bb8-4716-8c2d-3c8a0bfe55c9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:53.647085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d44f52e-5bb8-4716-8c2d-3c8a0bfe55c9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:53.649873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d44f52e-5bb8-4716-8c2d-3c8a0bfe55c9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:53.650332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7c2082db-eef3-4761-ab80-9b993674137a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:53.651136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d44f52e-5bb8-4716-8c2d-3c8a0bfe55c9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:53.651844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7c2082db-eef3-4761-ab80-9b993674137a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:53.653035 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7c2082db-eef3-4761-ab80-9b993674137a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1887 microversion: 2.42 time: 0.494006 Oct 27 19:00:53.655181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d44f52e-5bb8-4716-8c2d-3c8a0bfe55c9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:53.659177 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1826/3500] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:53 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1887 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:53.660009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d44f52e-5bb8-4716-8c2d-3c8a0bfe55c9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:53.660606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d44f52e-5bb8-4716-8c2d-3c8a0bfe55c9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:53.670355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-f5554d58-dca4-4564-9dd2-06b0c23611e0 req-a1ae105f-411d-4a40-9b91-f8e37937ff5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a", "name": "network-vif-unplugged", "status": "completed", "tag": "fc9fe7e8-b47d-4417-b21e-720480b5d605"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:53.699684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f5554d58-dca4-4564-9dd2-06b0c23611e0 req-a1ae105f-411d-4a40-9b91-f8e37937ff5c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:53.700449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f5554d58-dca4-4564-9dd2-06b0c23611e0 req-a1ae105f-411d-4a40-9b91-f8e37937ff5c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:53.701087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f5554d58-dca4-4564-9dd2-06b0c23611e0 req-a1ae105f-411d-4a40-9b91-f8e37937ff5c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:53.718039 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-f5554d58-dca4-4564-9dd2-06b0c23611e0 req-a1ae105f-411d-4a40-9b91-f8e37937ff5c service nova] Creating event network-vif-unplugged:fc9fe7e8-b47d-4417-b21e-720480b5d605 for instance a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a on n-h1-860687-3 Oct 27 19:00:53.740302 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-f5554d58-dca4-4564-9dd2-06b0c23611e0 req-a1ae105f-411d-4a40-9b91-f8e37937ff5c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079541 Oct 27 19:00:53.741501 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1827/3501] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:00:54.184719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a9ba56e-6683-4a76-93cb-2acc67dd1b23 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:54.185436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5a9ba56e-6683-4a76-93cb-2acc67dd1b23 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:54.204546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a9ba56e-6683-4a76-93cb-2acc67dd1b23 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:54.205136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a9ba56e-6683-4a76-93cb-2acc67dd1b23 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:54.205485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a9ba56e-6683-4a76-93cb-2acc67dd1b23 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:54.206206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a9ba56e-6683-4a76-93cb-2acc67dd1b23 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:54.206699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a9ba56e-6683-4a76-93cb-2acc67dd1b23 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:54.207138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a9ba56e-6683-4a76-93cb-2acc67dd1b23 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:54.260971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7d44f52e-5bb8-4716-8c2d-3c8a0bfe55c9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:54.271806 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7d44f52e-5bb8-4716-8c2d-3c8a0bfe55c9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1198 microversion: 2.1 time: 0.650378 Oct 27 19:00:54.286539 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1675/3502] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:53 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1198 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:54.309277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5a9ba56e-6683-4a76-93cb-2acc67dd1b23 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:54.318082 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5a9ba56e-6683-4a76-93cb-2acc67dd1b23 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1452 microversion: 2.1 time: 0.138784 Oct 27 19:00:54.319557 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1828/3503] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:54 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:54.568774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-04235939-9284-443b-be19-3a248cdce9f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:54.570192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04235939-9284-443b-be19-3a248cdce9f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:54.598669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04235939-9284-443b-be19-3a248cdce9f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:54.600184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04235939-9284-443b-be19-3a248cdce9f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:54.600860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04235939-9284-443b-be19-3a248cdce9f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:54.601825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04235939-9284-443b-be19-3a248cdce9f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:54.602486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04235939-9284-443b-be19-3a248cdce9f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:54.604749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04235939-9284-443b-be19-3a248cdce9f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:54.689108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-77a771d3-ceff-49a2-86a2-9dfd7ff4bbf6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:54.690036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-77a771d3-ceff-49a2-86a2-9dfd7ff4bbf6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:54.711960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77a771d3-ceff-49a2-86a2-9dfd7ff4bbf6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:54.714436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77a771d3-ceff-49a2-86a2-9dfd7ff4bbf6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:54.715138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77a771d3-ceff-49a2-86a2-9dfd7ff4bbf6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:54.717711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77a771d3-ceff-49a2-86a2-9dfd7ff4bbf6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:54.720425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77a771d3-ceff-49a2-86a2-9dfd7ff4bbf6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:54.725016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77a771d3-ceff-49a2-86a2-9dfd7ff4bbf6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:54.934632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-04235939-9284-443b-be19-3a248cdce9f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:54.944363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-04235939-9284-443b-be19-3a248cdce9f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:54.951458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-04235939-9284-443b-be19-3a248cdce9f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:54.955086 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-04235939-9284-443b-be19-3a248cdce9f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1721 microversion: 2.20 time: 0.401857 Oct 27 19:00:54.958416 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1676/3504] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:54 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1721 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:55.202396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-77a771d3-ceff-49a2-86a2-9dfd7ff4bbf6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:55.218755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-77a771d3-ceff-49a2-86a2-9dfd7ff4bbf6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:55.221347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-77a771d3-ceff-49a2-86a2-9dfd7ff4bbf6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:55.222608 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-77a771d3-ceff-49a2-86a2-9dfd7ff4bbf6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1887 microversion: 2.42 time: 0.538771 Oct 27 19:00:55.223381 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1829/3505] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:54 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1887 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:55.300473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-10106c0f-8b66-4f7c-8ee2-9c35cd8ed61c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:55.301111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-10106c0f-8b66-4f7c-8ee2-9c35cd8ed61c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:55.308133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10106c0f-8b66-4f7c-8ee2-9c35cd8ed61c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:55.308634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10106c0f-8b66-4f7c-8ee2-9c35cd8ed61c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:55.309123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10106c0f-8b66-4f7c-8ee2-9c35cd8ed61c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:55.321121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10106c0f-8b66-4f7c-8ee2-9c35cd8ed61c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:55.323160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10106c0f-8b66-4f7c-8ee2-9c35cd8ed61c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:55.331690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10106c0f-8b66-4f7c-8ee2-9c35cd8ed61c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:55.347492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-336dce7e-1c38-46b1-88bc-0f411d424b37 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:55.348130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-336dce7e-1c38-46b1-88bc-0f411d424b37 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:55.356111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-336dce7e-1c38-46b1-88bc-0f411d424b37 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:55.356942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-336dce7e-1c38-46b1-88bc-0f411d424b37 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:55.357648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-336dce7e-1c38-46b1-88bc-0f411d424b37 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:55.358667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-336dce7e-1c38-46b1-88bc-0f411d424b37 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:55.359411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-336dce7e-1c38-46b1-88bc-0f411d424b37 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:55.360093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-336dce7e-1c38-46b1-88bc-0f411d424b37 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:55.430239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:55.463598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-336dce7e-1c38-46b1-88bc-0f411d424b37 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:55.464500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-336dce7e-1c38-46b1-88bc-0f411d424b37 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:55.465188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-336dce7e-1c38-46b1-88bc-0f411d424b37 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:55.465974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-336dce7e-1c38-46b1-88bc-0f411d424b37 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lazy-loading 'fault' on Instance uuid a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:00:55.542687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-336dce7e-1c38-46b1-88bc-0f411d424b37 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1e2f62e22b4e52badd230ef175817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c41c5833484551b422742abfad598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:55.554085 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-336dce7e-1c38-46b1-88bc-0f411d424b37 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 200 len: 1298 microversion: 2.1 time: 0.212830 Oct 27 19:00:55.554967 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1830/3506] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:55 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 1298 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:00:55.686276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-00cb1f80-ae98-4840-94e2-911755804bac req-825fd183-9b2a-4605-9b5b-c01738387418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a", "name": "network-vif-deleted", "tag": "fc9fe7e8-b47d-4417-b21e-720480b5d605"}, {"name": "network-changed", "server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "tag": "2ab12411-7d95-4e74-8e80-f62b068f58be"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:00:55.713715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-00cb1f80-ae98-4840-94e2-911755804bac req-825fd183-9b2a-4605-9b5b-c01738387418 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:55.715551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-00cb1f80-ae98-4840-94e2-911755804bac req-825fd183-9b2a-4605-9b5b-c01738387418 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:55.716019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-00cb1f80-ae98-4840-94e2-911755804bac req-825fd183-9b2a-4605-9b5b-c01738387418 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:55.745862 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-00cb1f80-ae98-4840-94e2-911755804bac req-825fd183-9b2a-4605-9b5b-c01738387418 service nova] Creating event network-vif-deleted:fc9fe7e8-b47d-4417-b21e-720480b5d605 for instance a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a on n-h1-860687-3 Oct 27 19:00:55.752957 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-00cb1f80-ae98-4840-94e2-911755804bac req-825fd183-9b2a-4605-9b5b-c01738387418 service nova] Creating event network-changed:2ab12411-7d95-4e74-8e80-f62b068f58be for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:00:55.764544 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-00cb1f80-ae98-4840-94e2-911755804bac req-825fd183-9b2a-4605-9b5b-c01738387418 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.083935 Oct 27 19:00:55.765685 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1831/3507] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:00:55.825859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-10106c0f-8b66-4f7c-8ee2-9c35cd8ed61c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:55.838741 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-10106c0f-8b66-4f7c-8ee2-9c35cd8ed61c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1198 microversion: 2.1 time: 0.542440 Oct 27 19:00:55.839669 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1677/3508] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:55 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1198 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:55.989855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9c44a715-0b76-4a41-b1d3-35ad0bf61b49 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:55.991667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9c44a715-0b76-4a41-b1d3-35ad0bf61b49 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:56.007609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c44a715-0b76-4a41-b1d3-35ad0bf61b49 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.010555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c44a715-0b76-4a41-b1d3-35ad0bf61b49 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.011850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c44a715-0b76-4a41-b1d3-35ad0bf61b49 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.018301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c44a715-0b76-4a41-b1d3-35ad0bf61b49 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.020407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c44a715-0b76-4a41-b1d3-35ad0bf61b49 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.021924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c44a715-0b76-4a41-b1d3-35ad0bf61b49 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.229100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9c44a715-0b76-4a41-b1d3-35ad0bf61b49 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:56.241503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9c44a715-0b76-4a41-b1d3-35ad0bf61b49 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:56.251730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bcb9baa8-a2b1-4fd2-b97d-892b34112084 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:56.252819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bcb9baa8-a2b1-4fd2-b97d-892b34112084 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:56.259000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9c44a715-0b76-4a41-b1d3-35ad0bf61b49 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:56.260707 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9c44a715-0b76-4a41-b1d3-35ad0bf61b49 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1721 microversion: 2.20 time: 0.279256 Oct 27 19:00:56.268990 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1832/3509] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:55 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:56.269668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcb9baa8-a2b1-4fd2-b97d-892b34112084 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.270197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcb9baa8-a2b1-4fd2-b97d-892b34112084 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.270748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcb9baa8-a2b1-4fd2-b97d-892b34112084 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.271479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcb9baa8-a2b1-4fd2-b97d-892b34112084 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.271941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcb9baa8-a2b1-4fd2-b97d-892b34112084 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.272379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcb9baa8-a2b1-4fd2-b97d-892b34112084 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.584944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ef7ca459-a99f-4c5c-aaad-b1493fb92036 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:56.589901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ef7ca459-a99f-4c5c-aaad-b1493fb92036 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:56.601043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bcb9baa8-a2b1-4fd2-b97d-892b34112084 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:56.617361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef7ca459-a99f-4c5c-aaad-b1493fb92036 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.620511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bcb9baa8-a2b1-4fd2-b97d-892b34112084 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:56.622098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bcb9baa8-a2b1-4fd2-b97d-892b34112084 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:56.622726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef7ca459-a99f-4c5c-aaad-b1493fb92036 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.623903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef7ca459-a99f-4c5c-aaad-b1493fb92036 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.626962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef7ca459-a99f-4c5c-aaad-b1493fb92036 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.628495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef7ca459-a99f-4c5c-aaad-b1493fb92036 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.632973 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bcb9baa8-a2b1-4fd2-b97d-892b34112084 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1887 microversion: 2.42 time: 0.385283 Oct 27 19:00:56.633949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef7ca459-a99f-4c5c-aaad-b1493fb92036 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.650410 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1678/3510] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:56 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1887 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:56.657212 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-ef7ca459-a99f-4c5c-aaad-b1493fb92036 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Instance a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a could not be found. Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ef7ca459-a99f-4c5c-aaad-b1493fb92036 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a HTTP/1.1 Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a could not be found. Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a'} Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a could not be found. Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a could not be found. Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.659224 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.663971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:56.663971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:56.663971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:56.663971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:56.663971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a could not be found. Oct 27 19:00:56.663971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.663971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ef7ca459-a99f-4c5c-aaad-b1493fb92036 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Instance a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:56.663971 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ef7ca459-a99f-4c5c-aaad-b1493fb92036 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a" status: 404 len: 111 microversion: 2.1 time: 0.081794 Oct 27 19:00:56.663971 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1833/3511] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:56 2022] GET /compute/v2.1/servers/a95a0ccc-bf84-45cc-b4d9-9d67e3970e5a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:00:56.671762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7a5caaee-b482-4f74-9e29-0327c4b00c60 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:56.671962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7a5caaee-b482-4f74-9e29-0327c4b00c60 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:56.678402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a5caaee-b482-4f74-9e29-0327c4b00c60 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.679181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a5caaee-b482-4f74-9e29-0327c4b00c60 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.679878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a5caaee-b482-4f74-9e29-0327c4b00c60 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.680934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a5caaee-b482-4f74-9e29-0327c4b00c60 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.681697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a5caaee-b482-4f74-9e29-0327c4b00c60 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.682364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a5caaee-b482-4f74-9e29-0327c4b00c60 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.699643 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-7a5caaee-b482-4f74-9e29-0327c4b00c60 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7a5caaee-b482-4f74-9e29-0327c4b00c60 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef HTTP/1.1 Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef'} Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:56.701729 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:56.706187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.706187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:56.706187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.706187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.706187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:56.706187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:56.706187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:56.706187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:56.706187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:56.706187 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.708288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7a5caaee-b482-4f74-9e29-0327c4b00c60 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:56.709353 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7a5caaee-b482-4f74-9e29-0327c4b00c60 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 404 len: 111 microversion: 2.1 time: 0.042118 Oct 27 19:00:56.710310 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1679/3512] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:00:56 2022] DELETE /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:00:56.718587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e35a12a2-82cd-4d41-befd-e98e5f5cd755 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:56.719209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e35a12a2-82cd-4d41-befd-e98e5f5cd755 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:56.726650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e35a12a2-82cd-4d41-befd-e98e5f5cd755 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.726847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e35a12a2-82cd-4d41-befd-e98e5f5cd755 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.728760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e35a12a2-82cd-4d41-befd-e98e5f5cd755 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.730089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e35a12a2-82cd-4d41-befd-e98e5f5cd755 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.731088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e35a12a2-82cd-4d41-befd-e98e5f5cd755 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.731709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e35a12a2-82cd-4d41-befd-e98e5f5cd755 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.758538 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-e35a12a2-82cd-4d41-befd-e98e5f5cd755 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e35a12a2-82cd-4d41-befd-e98e5f5cd755 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef HTTP/1.1 Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef'} Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.761632 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.767603 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:56.767603 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:56.767603 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:56.767603 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:56.767603 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. Oct 27 19:00:56.767603 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.767603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e35a12a2-82cd-4d41-befd-e98e5f5cd755 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Instance edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:56.767603 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e35a12a2-82cd-4d41-befd-e98e5f5cd755 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef" status: 404 len: 111 microversion: 2.1 time: 0.048659 Oct 27 19:00:56.774570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd4c1342-29df-4e71-bf68-725a9b4b76ed tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc869d32c10>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:56.780999 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1834/3513] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:56 2022] GET /compute/v2.1/servers/edc8aca6-ffd2-4b97-aa2b-1f4363fe61ef => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:00:56.814108 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-dd4c1342-29df-4e71-bf68-725a9b4b76ed tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Image not found. Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd4c1342-29df-4e71-bf68-725a9b4b76ed tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 HTTP/1.1 Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: exception: Image not found. Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a8ea47ba-b4c5-4625-9c5c-8fccc23595a5'} Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 to delete Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 could not be found. Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.816247 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 19:00:56.824228 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.830138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd4c1342-29df-4e71-bf68-725a9b4b76ed tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Image not found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:56.831299 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dd4c1342-29df-4e71-bf68-725a9b4b76ed tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5" status: 404 len: 62 microversion: 2.1 time: 0.061865 Oct 27 19:00:56.844287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-102dea8e-51de-491e-84ec-2b8e5721aacd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:56.845142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-102dea8e-51de-491e-84ec-2b8e5721aacd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:56.846561 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1680/3514] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:56 2022] DELETE /compute/v2.1/images/a8ea47ba-b4c5-4625-9c5c-8fccc23595a5 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:00:56.852502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-102dea8e-51de-491e-84ec-2b8e5721aacd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.852990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-102dea8e-51de-491e-84ec-2b8e5721aacd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.856054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-102dea8e-51de-491e-84ec-2b8e5721aacd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.857102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-102dea8e-51de-491e-84ec-2b8e5721aacd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.857739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-102dea8e-51de-491e-84ec-2b8e5721aacd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.858483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-102dea8e-51de-491e-84ec-2b8e5721aacd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.863563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e5044ed1-99d6-4c26-9a30-21d45b2c831a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:56.867746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e5044ed1-99d6-4c26-9a30-21d45b2c831a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:56.881973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:56.883583 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-102dea8e-51de-491e-84ec-2b8e5721aacd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f could not be found. Oct 27 19:00:56.887161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5044ed1-99d6-4c26-9a30-21d45b2c831a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.887789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5044ed1-99d6-4c26-9a30-21d45b2c831a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.888626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5044ed1-99d6-4c26-9a30-21d45b2c831a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.890334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5044ed1-99d6-4c26-9a30-21d45b2c831a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.891395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5044ed1-99d6-4c26-9a30-21d45b2c831a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.892058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5044ed1-99d6-4c26-9a30-21d45b2c831a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-102dea8e-51de-491e-84ec-2b8e5721aacd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f HTTP/1.1 Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f could not be found. Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f'} Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f could not be found. Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:56.906564 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f could not be found. Oct 27 19:00:56.911082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.911082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:56.911082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.911082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.911082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:56.911082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:56.911082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:56.911082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:56.911082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f could not be found. Oct 27 19:00:56.911082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.918954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-102dea8e-51de-491e-84ec-2b8e5721aacd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:56.920851 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-102dea8e-51de-491e-84ec-2b8e5721aacd tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 404 len: 111 microversion: 2.1 time: 0.083371 Oct 27 19:00:56.922733 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1835/3515] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:00:56 2022] DELETE /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:00:56.938696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a2170df3-b385-47d9-8a14-fe5c2b637d66 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:56.940790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a2170df3-b385-47d9-8a14-fe5c2b637d66 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:56.958428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2170df3-b385-47d9-8a14-fe5c2b637d66 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.959055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2170df3-b385-47d9-8a14-fe5c2b637d66 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.959527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2170df3-b385-47d9-8a14-fe5c2b637d66 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.960283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2170df3-b385-47d9-8a14-fe5c2b637d66 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:56.960759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2170df3-b385-47d9-8a14-fe5c2b637d66 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:56.961203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2170df3-b385-47d9-8a14-fe5c2b637d66 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:56.990815 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-a2170df3-b385-47d9-8a14-fe5c2b637d66 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f could not be found. Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a2170df3-b385-47d9-8a14-fe5c2b637d66 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f HTTP/1.1 Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f could not be found. Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f'} Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f could not be found. Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f could not be found. Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:56.993053 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:56.999269 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:56.999269 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:56.999269 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:56.999269 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:56.999269 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f could not be found. Oct 27 19:00:56.999269 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.000935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a2170df3-b385-47d9-8a14-fe5c2b637d66 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Instance 8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:57.002070 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a2170df3-b385-47d9-8a14-fe5c2b637d66 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f" status: 404 len: 111 microversion: 2.1 time: 0.075093 Oct 27 19:00:57.003380 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1836/3516] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:56 2022] GET /compute/v2.1/servers/8e63d2fa-3bb0-49c4-bf63-346f0d94bf4f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:00:57.011600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e8aa123-0b38-46f2-8cca-777dc785d555 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86aaf7af0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:57.048808 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-6e8aa123-0b38-46f2-8cca-777dc785d555 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Image not found. Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e8aa123-0b38-46f2-8cca-777dc785d555 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 HTTP/1.1 Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: exception: Image not found. Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '178952e6-bb7d-4fcc-bc73-b262fc6fb797'} Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 178952e6-bb7d-4fcc-bc73-b262fc6fb797 to delete Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 178952e6-bb7d-4fcc-bc73-b262fc6fb797 could not be found. Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.058766 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e8aa123-0b38-46f2-8cca-777dc785d555 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Image not found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:57.064244 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6e8aa123-0b38-46f2-8cca-777dc785d555 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797" status: 404 len: 62 microversion: 2.1 time: 0.054697 Oct 27 19:00:57.066058 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1837/3517] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:57 2022] DELETE /compute/v2.1/images/178952e6-bb7d-4fcc-bc73-b262fc6fb797 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 19:00:57.079237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dada486f-59c4-4708-bb6d-afaf990bbd1a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:57.082363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dada486f-59c4-4708-bb6d-afaf990bbd1a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:57.105870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dada486f-59c4-4708-bb6d-afaf990bbd1a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.108544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dada486f-59c4-4708-bb6d-afaf990bbd1a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.110468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dada486f-59c4-4708-bb6d-afaf990bbd1a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.113761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dada486f-59c4-4708-bb6d-afaf990bbd1a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.114872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dada486f-59c4-4708-bb6d-afaf990bbd1a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.116065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dada486f-59c4-4708-bb6d-afaf990bbd1a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.145271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e5044ed1-99d6-4c26-9a30-21d45b2c831a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:57.150747 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-dada486f-59c4-4708-bb6d-afaf990bbd1a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Instance c280a00e-288a-4927-95e6-1f2b3880f240 could not be found. Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dada486f-59c4-4708-bb6d-afaf990bbd1a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 HTTP/1.1 Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance c280a00e-288a-4927-95e6-1f2b3880f240 could not be found. Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'c280a00e-288a-4927-95e6-1f2b3880f240'} Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c280a00e-288a-4927-95e6-1f2b3880f240 could not be found. Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:57.153009 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c280a00e-288a-4927-95e6-1f2b3880f240 could not be found. Oct 27 19:00:57.158334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.158334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.158334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.158334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.158334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.158334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.158334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:57.158334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:57.158334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c280a00e-288a-4927-95e6-1f2b3880f240 could not be found. Oct 27 19:00:57.158334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.161342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dada486f-59c4-4708-bb6d-afaf990bbd1a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Instance c280a00e-288a-4927-95e6-1f2b3880f240 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:57.161558 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e5044ed1-99d6-4c26-9a30-21d45b2c831a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1198 microversion: 2.1 time: 0.301960 Oct 27 19:00:57.161991 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1681/3518] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:56 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1198 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:57.163492 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dada486f-59c4-4708-bb6d-afaf990bbd1a tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 404 len: 111 microversion: 2.1 time: 0.094197 Oct 27 19:00:57.164299 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1838/3519] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:00:57 2022] DELETE /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:00:57.186779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1074d6bc-005a-4690-8145-d1d094376667 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:57.187410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1074d6bc-005a-4690-8145-d1d094376667 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: c280a00e-288a-4927-95e6-1f2b3880f240] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:57.206779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1074d6bc-005a-4690-8145-d1d094376667 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.207308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1074d6bc-005a-4690-8145-d1d094376667 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.207773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1074d6bc-005a-4690-8145-d1d094376667 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.208663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1074d6bc-005a-4690-8145-d1d094376667 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.209198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1074d6bc-005a-4690-8145-d1d094376667 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.209992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1074d6bc-005a-4690-8145-d1d094376667 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.226344 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-1074d6bc-005a-4690-8145-d1d094376667 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Instance c280a00e-288a-4927-95e6-1f2b3880f240 could not be found. Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1074d6bc-005a-4690-8145-d1d094376667 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 HTTP/1.1 Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance c280a00e-288a-4927-95e6-1f2b3880f240 could not be found. Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'c280a00e-288a-4927-95e6-1f2b3880f240'} Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c280a00e-288a-4927-95e6-1f2b3880f240 could not be found. Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c280a00e-288a-4927-95e6-1f2b3880f240 could not be found. Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.227974 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.234539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.234539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.234539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:57.234539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:57.234539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c280a00e-288a-4927-95e6-1f2b3880f240 could not be found. Oct 27 19:00:57.234539 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.234539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1074d6bc-005a-4690-8145-d1d094376667 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Instance c280a00e-288a-4927-95e6-1f2b3880f240 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:57.234539 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1074d6bc-005a-4690-8145-d1d094376667 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240" status: 404 len: 111 microversion: 2.1 time: 0.046664 Oct 27 19:00:57.234539 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1682/3520] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:57 2022] GET /compute/v2.1/servers/c280a00e-288a-4927-95e6-1f2b3880f240 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:00:57.239233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85558cf5-8576-4f93-ad1c-b028b299a2a2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc86b284e50>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:57.274941 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-85558cf5-8576-4f93-ad1c-b028b299a2a2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Image not found. Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85558cf5-8576-4f93-ad1c-b028b299a2a2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 HTTP/1.1 Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: exception: Image not found. Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'ddf8f38a-44cc-4510-a21d-a08dd7012064'} Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ddf8f38a-44cc-4510-a21d-a08dd7012064 to delete Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ddf8f38a-44cc-4510-a21d-a08dd7012064 could not be found. Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.276917 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85558cf5-8576-4f93-ad1c-b028b299a2a2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Image not found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-85558cf5-8576-4f93-ad1c-b028b299a2a2 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064" status: 404 len: 62 microversion: 2.1 time: 0.043845 Oct 27 19:00:57.283472 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1839/3521] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:57 2022] DELETE /compute/v2.1/images/ddf8f38a-44cc-4510-a21d-a08dd7012064 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:00:57.293732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-583509e3-b2b8-493e-95a7-06f9ddd837b4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:57.294641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-583509e3-b2b8-493e-95a7-06f9ddd837b4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:57.302132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-583509e3-b2b8-493e-95a7-06f9ddd837b4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.303260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-583509e3-b2b8-493e-95a7-06f9ddd837b4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.304013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6495eaf4-1a5b-4bdf-9917-969cf496ae1d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:57.307286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6495eaf4-1a5b-4bdf-9917-969cf496ae1d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:57.307532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-583509e3-b2b8-493e-95a7-06f9ddd837b4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.311121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-583509e3-b2b8-493e-95a7-06f9ddd837b4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.311679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-583509e3-b2b8-493e-95a7-06f9ddd837b4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.312231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-583509e3-b2b8-493e-95a7-06f9ddd837b4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.315028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6495eaf4-1a5b-4bdf-9917-969cf496ae1d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.316503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6495eaf4-1a5b-4bdf-9917-969cf496ae1d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.317550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6495eaf4-1a5b-4bdf-9917-969cf496ae1d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.318503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6495eaf4-1a5b-4bdf-9917-969cf496ae1d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.319136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6495eaf4-1a5b-4bdf-9917-969cf496ae1d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.319733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6495eaf4-1a5b-4bdf-9917-969cf496ae1d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.342904 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-583509e3-b2b8-493e-95a7-06f9ddd837b4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 could not be found. Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-583509e3-b2b8-493e-95a7-06f9ddd837b4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 HTTP/1.1 Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 could not be found. Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '8a2f813e-a5e5-4146-a05c-ebf2f66d5c28'} Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 could not be found. Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:57.344622 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 could not be found. Oct 27 19:00:57.349845 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.349845 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.349845 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.349845 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.349845 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.349845 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.349845 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:57.349845 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:57.349845 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 could not be found. Oct 27 19:00:57.349845 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.351809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-583509e3-b2b8-493e-95a7-06f9ddd837b4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:57.352734 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-583509e3-b2b8-493e-95a7-06f9ddd837b4 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 404 len: 111 microversion: 2.1 time: 0.067027 Oct 27 19:00:57.354109 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1683/3522] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:00:57 2022] DELETE /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:00:57.365366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a476b0e0-71df-4d21-8566-d765226b3411 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:57.368302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a476b0e0-71df-4d21-8566-d765226b3411 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:57.382760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a476b0e0-71df-4d21-8566-d765226b3411 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.383917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a476b0e0-71df-4d21-8566-d765226b3411 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.384904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a476b0e0-71df-4d21-8566-d765226b3411 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.385635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a476b0e0-71df-4d21-8566-d765226b3411 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.386104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a476b0e0-71df-4d21-8566-d765226b3411 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.386574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a476b0e0-71df-4d21-8566-d765226b3411 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.403209 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-a476b0e0-71df-4d21-8566-d765226b3411 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 could not be found. Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a476b0e0-71df-4d21-8566-d765226b3411 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 HTTP/1.1 Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 could not be found. Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '8a2f813e-a5e5-4146-a05c-ebf2f66d5c28'} Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 could not be found. Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 could not be found. Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.404825 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.410774 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.410774 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.410774 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:57.410774 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:57.410774 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 could not be found. Oct 27 19:00:57.410774 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.410774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a476b0e0-71df-4d21-8566-d765226b3411 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Instance 8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:57.410774 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a476b0e0-71df-4d21-8566-d765226b3411 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28" status: 404 len: 111 microversion: 2.1 time: 0.046705 Oct 27 19:00:57.410774 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1684/3523] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:57 2022] GET /compute/v2.1/servers/8a2f813e-a5e5-4146-a05c-ebf2f66d5c28 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:00:57.415605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-662446ff-19d4-428c-950b-313480278ace tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '.version_select at 0x7fc8733689d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:57.442885 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-662446ff-19d4-428c-950b-313480278ace tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Image not found. Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-662446ff-19d4-428c-950b-313480278ace tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 HTTP/1.1 Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: exception: Image not found. Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '463d2c3a-e7a1-4124-82a2-85008539c303'} Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 463d2c3a-e7a1-4124-82a2-85008539c303 to delete Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 463d2c3a-e7a1-4124-82a2-85008539c303 could not be found. Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.444865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-662446ff-19d4-428c-950b-313480278ace tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Image not found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-662446ff-19d4-428c-950b-313480278ace tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303" status: 404 len: 62 microversion: 2.1 time: 0.035532 Oct 27 19:00:57.453232 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1685/3524] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:57 2022] DELETE /compute/v2.1/images/463d2c3a-e7a1-4124-82a2-85008539c303 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:00:57.457737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-30c02a00-076b-421f-9bd1-21301b64f950 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:57.457737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-30c02a00-076b-421f-9bd1-21301b64f950 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:57.468546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30c02a00-076b-421f-9bd1-21301b64f950 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.469052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30c02a00-076b-421f-9bd1-21301b64f950 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.469501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30c02a00-076b-421f-9bd1-21301b64f950 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.470223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30c02a00-076b-421f-9bd1-21301b64f950 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.470720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30c02a00-076b-421f-9bd1-21301b64f950 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.471158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30c02a00-076b-421f-9bd1-21301b64f950 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.487097 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-30c02a00-076b-421f-9bd1-21301b64f950 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc could not be found. Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-30c02a00-076b-421f-9bd1-21301b64f950 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc HTTP/1.1 Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc could not be found. Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'd741a04d-f8e8-4b66-bc30-377d4c8de1dc'} Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc could not be found. Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:57.488876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc could not be found. Oct 27 19:00:57.494316 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.494316 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.494316 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.494316 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.494316 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.494316 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.494316 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:57.494316 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:57.494316 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc could not be found. Oct 27 19:00:57.494316 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.494316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-30c02a00-076b-421f-9bd1-21301b64f950 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:57.494316 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-30c02a00-076b-421f-9bd1-21301b64f950 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 404 len: 111 microversion: 2.1 time: 0.037811 Oct 27 19:00:57.496342 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1686/3525] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:00:57 2022] DELETE /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:00:57.501133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6cd6aa7f-c7b2-4650-af84-8115525dd7b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:57.502049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6cd6aa7f-c7b2-4650-af84-8115525dd7b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] [instance: d741a04d-f8e8-4b66-bc30-377d4c8de1dc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:57.509770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cd6aa7f-c7b2-4650-af84-8115525dd7b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.510276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cd6aa7f-c7b2-4650-af84-8115525dd7b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.510783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cd6aa7f-c7b2-4650-af84-8115525dd7b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.513990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cd6aa7f-c7b2-4650-af84-8115525dd7b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.513990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cd6aa7f-c7b2-4650-af84-8115525dd7b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.513990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cd6aa7f-c7b2-4650-af84-8115525dd7b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.517287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:00:57.531581 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-6cd6aa7f-c7b2-4650-af84-8115525dd7b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] HTTP exception thrown: Instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc could not be found. Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6cd6aa7f-c7b2-4650-af84-8115525dd7b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Request method failure captured: Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc HTTP/1.1 Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtPsZIsvJ3Z9aPE-e9kQ3OsdohuK-eHN8K2hIS_mjLNIX8_vVMeG9uYpbxc9VfGMeScXLrEOffM02TEg3aSfl7WVGIQU-W6v2PmKf7es5rgwfLPxrbsfbphpgQquNN28Yg5NOTn-Lllv9yl4QauSLqZJfnbld-P4i_RvcJVEwhic-6Q Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/75c41c5833484551b422742abfad598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_75c41c5833484551b422742abfad598f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/75c41c5833484551b422742abfad598f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 75c41c5833484551b422742abfad598f Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesTestJSON-802863033 Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ac1e2f62e22b4e52badd230ef175817e Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesTestJSON-802863033-project Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc could not be found. Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'd741a04d-f8e8-4b66-bc30-377d4c8de1dc'} Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc could not be found. Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc could not be found. Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.533564 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:00:57.539504 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:00:57.539504 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:00:57.539504 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:00:57.539504 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:00:57.539504 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc could not be found. Oct 27 19:00:57.539504 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:00:57.539504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6cd6aa7f-c7b2-4650-af84-8115525dd7b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] Returning 404 to user: Instance d741a04d-f8e8-4b66-bc30-377d4c8de1dc could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:00:57.541109 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6cd6aa7f-c7b2-4650-af84-8115525dd7b0 tempest-ImagesTestJSON-802863033 tempest-ImagesTestJSON-802863033-project] 10.222.0.42 "GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc" status: 404 len: 111 microversion: 2.1 time: 0.043248 Oct 27 19:00:57.542456 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1687/3526] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:57 2022] GET /compute/v2.1/servers/d741a04d-f8e8-4b66-bc30-377d4c8de1dc => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:00:57.591825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6495eaf4-1a5b-4bdf-9917-969cf496ae1d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:57.603416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6495eaf4-1a5b-4bdf-9917-969cf496ae1d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:57.608674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6495eaf4-1a5b-4bdf-9917-969cf496ae1d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:57.614319 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6495eaf4-1a5b-4bdf-9917-969cf496ae1d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1721 microversion: 2.20 time: 0.318852 Oct 27 19:00:57.616802 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1840/3527] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:57 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:57.664479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13241877-f1e3-46ab-a4f1-fa61819328ac tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:57.665134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-13241877-f1e3-46ab-a4f1-fa61819328ac tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:57.678266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13241877-f1e3-46ab-a4f1-fa61819328ac tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.678832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13241877-f1e3-46ab-a4f1-fa61819328ac tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.679304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13241877-f1e3-46ab-a4f1-fa61819328ac tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:57.680008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13241877-f1e3-46ab-a4f1-fa61819328ac tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:57.680472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13241877-f1e3-46ab-a4f1-fa61819328ac tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:57.680910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13241877-f1e3-46ab-a4f1-fa61819328ac tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:58.185381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b92b107e-d548-41e5-8c65-93db3ac0c29d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:58.186248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b92b107e-d548-41e5-8c65-93db3ac0c29d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:58.192594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-13241877-f1e3-46ab-a4f1-fa61819328ac tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:58.197531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b92b107e-d548-41e5-8c65-93db3ac0c29d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:58.199905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b92b107e-d548-41e5-8c65-93db3ac0c29d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:58.200768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b92b107e-d548-41e5-8c65-93db3ac0c29d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:58.203215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b92b107e-d548-41e5-8c65-93db3ac0c29d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:58.203771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b92b107e-d548-41e5-8c65-93db3ac0c29d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:58.205729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b92b107e-d548-41e5-8c65-93db3ac0c29d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:58.209124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-13241877-f1e3-46ab-a4f1-fa61819328ac tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:58.214200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-13241877-f1e3-46ab-a4f1-fa61819328ac tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:58.215851 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-13241877-f1e3-46ab-a4f1-fa61819328ac tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1887 microversion: 2.42 time: 0.556446 Oct 27 19:00:58.238010 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1688/3528] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:57 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1887 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:58.620679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b92b107e-d548-41e5-8c65-93db3ac0c29d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:58.631930 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b92b107e-d548-41e5-8c65-93db3ac0c29d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1198 microversion: 2.1 time: 0.450466 Oct 27 19:00:58.633212 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1841/3529] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:58 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1198 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:00:58.651444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c3f74438-b873-471e-91bb-45a7cc7f30c4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:58.652152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c3f74438-b873-471e-91bb-45a7cc7f30c4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:58.660935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3f74438-b873-471e-91bb-45a7cc7f30c4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:58.661911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3f74438-b873-471e-91bb-45a7cc7f30c4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:58.662624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3f74438-b873-471e-91bb-45a7cc7f30c4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:58.663632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3f74438-b873-471e-91bb-45a7cc7f30c4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:58.664472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3f74438-b873-471e-91bb-45a7cc7f30c4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:58.665220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3f74438-b873-471e-91bb-45a7cc7f30c4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:59.250710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dacca87b-140e-45c6-92b7-bc3387d32f10 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:59.251625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dacca87b-140e-45c6-92b7-bc3387d32f10 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:59.268601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dacca87b-140e-45c6-92b7-bc3387d32f10 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:59.269471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dacca87b-140e-45c6-92b7-bc3387d32f10 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:59.270185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dacca87b-140e-45c6-92b7-bc3387d32f10 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:59.271200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dacca87b-140e-45c6-92b7-bc3387d32f10 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:59.271855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dacca87b-140e-45c6-92b7-bc3387d32f10 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:59.272533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dacca87b-140e-45c6-92b7-bc3387d32f10 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:59.397258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c3f74438-b873-471e-91bb-45a7cc7f30c4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:59.410492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c3f74438-b873-471e-91bb-45a7cc7f30c4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:59.417868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c3f74438-b873-471e-91bb-45a7cc7f30c4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:59.419810 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c3f74438-b873-471e-91bb-45a7cc7f30c4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1721 microversion: 2.20 time: 0.778691 Oct 27 19:00:59.420627 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1689/3530] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:58 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1721 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:00:59.658162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-32e76018-258a-43d2-9a7c-f0318a472f64 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:00:59.659193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-32e76018-258a-43d2-9a7c-f0318a472f64 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:00:59.668650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32e76018-258a-43d2-9a7c-f0318a472f64 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:59.669492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32e76018-258a-43d2-9a7c-f0318a472f64 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:59.670224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32e76018-258a-43d2-9a7c-f0318a472f64 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:59.671219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32e76018-258a-43d2-9a7c-f0318a472f64 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:00:59.672059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32e76018-258a-43d2-9a7c-f0318a472f64 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:00:59.672733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32e76018-258a-43d2-9a7c-f0318a472f64 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:00:59.728724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dacca87b-140e-45c6-92b7-bc3387d32f10 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:59.747444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dacca87b-140e-45c6-92b7-bc3387d32f10 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:59.760076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dacca87b-140e-45c6-92b7-bc3387d32f10 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:00:59.762661 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dacca87b-140e-45c6-92b7-bc3387d32f10 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.514104 Oct 27 19:00:59.762661 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1842/3531] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:00:59 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:00.078996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-32e76018-258a-43d2-9a7c-f0318a472f64 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:00.089503 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-32e76018-258a-43d2-9a7c-f0318a472f64 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1198 microversion: 2.1 time: 0.435248 Oct 27 19:01:00.095707 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1690/3532] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:00:59 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1198 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:00.447929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-709d4777-759b-4712-b822-962984f8c817 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:00.448971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-709d4777-759b-4712-b822-962984f8c817 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:00.459863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-709d4777-759b-4712-b822-962984f8c817 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:00.475009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-709d4777-759b-4712-b822-962984f8c817 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:00.475554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-709d4777-759b-4712-b822-962984f8c817 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:00.476327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-709d4777-759b-4712-b822-962984f8c817 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:00.476826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-709d4777-759b-4712-b822-962984f8c817 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:00.477277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-709d4777-759b-4712-b822-962984f8c817 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:00.734035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-709d4777-759b-4712-b822-962984f8c817 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:00.743290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-709d4777-759b-4712-b822-962984f8c817 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:00.745167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-709d4777-759b-4712-b822-962984f8c817 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:00.746892 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-709d4777-759b-4712-b822-962984f8c817 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1721 microversion: 2.20 time: 0.303684 Oct 27 19:01:00.756784 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1843/3533] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:00 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1721 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:00.790247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-76cbb57a-15c8-4a12-b78a-2b4d217baf06 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:00.791163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-76cbb57a-15c8-4a12-b78a-2b4d217baf06 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:00.808263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76cbb57a-15c8-4a12-b78a-2b4d217baf06 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:00.810159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76cbb57a-15c8-4a12-b78a-2b4d217baf06 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:00.810990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76cbb57a-15c8-4a12-b78a-2b4d217baf06 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:00.812807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76cbb57a-15c8-4a12-b78a-2b4d217baf06 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:00.813537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76cbb57a-15c8-4a12-b78a-2b4d217baf06 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:00.814255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76cbb57a-15c8-4a12-b78a-2b4d217baf06 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:01.116422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-09aa4ac7-8909-4457-b5e1-fc5d25fed56d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:01.117213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-09aa4ac7-8909-4457-b5e1-fc5d25fed56d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:01.130645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09aa4ac7-8909-4457-b5e1-fc5d25fed56d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:01.134015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09aa4ac7-8909-4457-b5e1-fc5d25fed56d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:01.135062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09aa4ac7-8909-4457-b5e1-fc5d25fed56d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:01.142604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09aa4ac7-8909-4457-b5e1-fc5d25fed56d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:01.147531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09aa4ac7-8909-4457-b5e1-fc5d25fed56d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:01.148088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09aa4ac7-8909-4457-b5e1-fc5d25fed56d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:01.400525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-76cbb57a-15c8-4a12-b78a-2b4d217baf06 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:01.421000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-09aa4ac7-8909-4457-b5e1-fc5d25fed56d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:01.421378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-76cbb57a-15c8-4a12-b78a-2b4d217baf06 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:01.423117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-76cbb57a-15c8-4a12-b78a-2b4d217baf06 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:01.424810 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-76cbb57a-15c8-4a12-b78a-2b4d217baf06 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.639643 Oct 27 19:01:01.430045 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-09aa4ac7-8909-4457-b5e1-fc5d25fed56d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1198 microversion: 2.1 time: 0.320401 Oct 27 19:01:01.435300 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1844/3534] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:01 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1198 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:01:01.438720 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1691/3535] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:00 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:01.784073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-745c31b2-404f-4ed4-b6d9-9feb8899f155 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:01.784766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-745c31b2-404f-4ed4-b6d9-9feb8899f155 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:01.789488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:01.813997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-745c31b2-404f-4ed4-b6d9-9feb8899f155 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:01.814551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-745c31b2-404f-4ed4-b6d9-9feb8899f155 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:01.815011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-745c31b2-404f-4ed4-b6d9-9feb8899f155 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:01.815753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-745c31b2-404f-4ed4-b6d9-9feb8899f155 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:01.816217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-745c31b2-404f-4ed4-b6d9-9feb8899f155 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:01.831552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-745c31b2-404f-4ed4-b6d9-9feb8899f155 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:01.920722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-4b208d37-e57a-4eef-a26e-e0a2da03742a req-ac44c640-3910-40e7-8133-7af9224101b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a0b276-1f26-4c66-9c0f-8ada81266162", "name": "network-vif-plugged", "status": "completed", "tag": "2b54e61c-2e06-4b78-9fd7-f1f2dde7fd49"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:01.932996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4b208d37-e57a-4eef-a26e-e0a2da03742a req-ac44c640-3910-40e7-8133-7af9224101b9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:01.938322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4b208d37-e57a-4eef-a26e-e0a2da03742a req-ac44c640-3910-40e7-8133-7af9224101b9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:01.944165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4b208d37-e57a-4eef-a26e-e0a2da03742a req-ac44c640-3910-40e7-8133-7af9224101b9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:01.972023 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-4b208d37-e57a-4eef-a26e-e0a2da03742a req-ac44c640-3910-40e7-8133-7af9224101b9 service nova] Creating event network-vif-plugged:2b54e61c-2e06-4b78-9fd7-f1f2dde7fd49 for instance 06a0b276-1f26-4c66-9c0f-8ada81266162 on n-h2-860687-3 Oct 27 19:01:01.983273 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-4b208d37-e57a-4eef-a26e-e0a2da03742a req-ac44c640-3910-40e7-8133-7af9224101b9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067231 Oct 27 19:01:01.989103 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1692/3536] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:02.202210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-745c31b2-404f-4ed4-b6d9-9feb8899f155 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:02.217515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-745c31b2-404f-4ed4-b6d9-9feb8899f155 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:02.219019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-745c31b2-404f-4ed4-b6d9-9feb8899f155 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:02.220220 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-745c31b2-404f-4ed4-b6d9-9feb8899f155 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1721 microversion: 2.20 time: 0.443377 Oct 27 19:01:02.221787 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1845/3537] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:01 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1721 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:02.460407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-106fac42-1b94-4a13-bbd1-cc2043586f99 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:02.461130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-106fac42-1b94-4a13-bbd1-cc2043586f99 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:02.461268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-30d2c226-3fc8-4a07-aa87-e4e0621e8afc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:02.462182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-30d2c226-3fc8-4a07-aa87-e4e0621e8afc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:02.471081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-106fac42-1b94-4a13-bbd1-cc2043586f99 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:02.474860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-106fac42-1b94-4a13-bbd1-cc2043586f99 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:02.475418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-106fac42-1b94-4a13-bbd1-cc2043586f99 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:02.476730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-106fac42-1b94-4a13-bbd1-cc2043586f99 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:02.478140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-106fac42-1b94-4a13-bbd1-cc2043586f99 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:02.479523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-106fac42-1b94-4a13-bbd1-cc2043586f99 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:02.496627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30d2c226-3fc8-4a07-aa87-e4e0621e8afc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:02.499075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30d2c226-3fc8-4a07-aa87-e4e0621e8afc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:02.500022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30d2c226-3fc8-4a07-aa87-e4e0621e8afc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:02.502074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30d2c226-3fc8-4a07-aa87-e4e0621e8afc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:02.504920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30d2c226-3fc8-4a07-aa87-e4e0621e8afc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:02.506469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30d2c226-3fc8-4a07-aa87-e4e0621e8afc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:02.766678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-106fac42-1b94-4a13-bbd1-cc2043586f99 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:02.782799 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-106fac42-1b94-4a13-bbd1-cc2043586f99 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1198 microversion: 2.1 time: 0.326522 Oct 27 19:01:02.783969 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1846/3538] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:02 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1198 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:02.875233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce1a7a6e-507c-4768-a721-e32a9afab4e5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:02.876881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ce1a7a6e-507c-4768-a721-e32a9afab4e5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:02.888967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce1a7a6e-507c-4768-a721-e32a9afab4e5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:02.889878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce1a7a6e-507c-4768-a721-e32a9afab4e5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:02.890659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce1a7a6e-507c-4768-a721-e32a9afab4e5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:02.892303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce1a7a6e-507c-4768-a721-e32a9afab4e5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:02.893067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce1a7a6e-507c-4768-a721-e32a9afab4e5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:02.893875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce1a7a6e-507c-4768-a721-e32a9afab4e5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:02.949218 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce1a7a6e-507c-4768-a721-e32a9afab4e5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/ips" status: 200 len: 151 microversion: 2.1 time: 0.080789 Oct 27 19:01:02.952841 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1847/3539] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 19:01:02 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/ips => generated 151 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:03.248057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-04bc21ab-8c74-4b4a-ab9b-d39d17d45398 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:03.248991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-04bc21ab-8c74-4b4a-ab9b-d39d17d45398 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:03.262868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04bc21ab-8c74-4b4a-ab9b-d39d17d45398 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:03.263841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04bc21ab-8c74-4b4a-ab9b-d39d17d45398 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:03.266156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04bc21ab-8c74-4b4a-ab9b-d39d17d45398 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:03.267491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04bc21ab-8c74-4b4a-ab9b-d39d17d45398 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:03.270291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04bc21ab-8c74-4b4a-ab9b-d39d17d45398 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:03.271125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04bc21ab-8c74-4b4a-ab9b-d39d17d45398 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:03.716591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-30d2c226-3fc8-4a07-aa87-e4e0621e8afc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:03.719910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-04bc21ab-8c74-4b4a-ab9b-d39d17d45398 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:03.730599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-04bc21ab-8c74-4b4a-ab9b-d39d17d45398 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:03.736587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-04bc21ab-8c74-4b4a-ab9b-d39d17d45398 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:03.741985 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-04bc21ab-8c74-4b4a-ab9b-d39d17d45398 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1721 microversion: 2.20 time: 0.498439 Oct 27 19:01:03.758434 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1848/3540] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:03 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1721 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:01:03.761917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-30d2c226-3fc8-4a07-aa87-e4e0621e8afc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:03.765039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-30d2c226-3fc8-4a07-aa87-e4e0621e8afc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:03.771624 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-30d2c226-3fc8-4a07-aa87-e4e0621e8afc tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 1.314025 Oct 27 19:01:03.773483 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1693/3541] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:02 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:03.819181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a420a4b-2236-4e4b-9426-2a02ca20e1a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:03.820882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8a420a4b-2236-4e4b-9426-2a02ca20e1a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:03.829114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a420a4b-2236-4e4b-9426-2a02ca20e1a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:03.830174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a420a4b-2236-4e4b-9426-2a02ca20e1a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:03.830783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a420a4b-2236-4e4b-9426-2a02ca20e1a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:03.831570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a420a4b-2236-4e4b-9426-2a02ca20e1a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:03.832342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a420a4b-2236-4e4b-9426-2a02ca20e1a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:03.832975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a420a4b-2236-4e4b-9426-2a02ca20e1a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:04.382037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8a420a4b-2236-4e4b-9426-2a02ca20e1a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:04.395139 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8a420a4b-2236-4e4b-9426-2a02ca20e1a3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1198 microversion: 2.1 time: 0.582749 Oct 27 19:01:04.396317 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1849/3542] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:03 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1198 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:04.770893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6a610661-9ed1-493d-b3a9-3565c00d26b6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:04.772053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6a610661-9ed1-493d-b3a9-3565c00d26b6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:04.788759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a610661-9ed1-493d-b3a9-3565c00d26b6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:04.789261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a610661-9ed1-493d-b3a9-3565c00d26b6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:04.789707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a610661-9ed1-493d-b3a9-3565c00d26b6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:04.790540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a610661-9ed1-493d-b3a9-3565c00d26b6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:04.791099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a610661-9ed1-493d-b3a9-3565c00d26b6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:04.791536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a610661-9ed1-493d-b3a9-3565c00d26b6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:04.808079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-824ae364-0b01-48e8-8a0b-611d24ad2339 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:04.808713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-824ae364-0b01-48e8-8a0b-611d24ad2339 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:04.818061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-824ae364-0b01-48e8-8a0b-611d24ad2339 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:04.818600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-824ae364-0b01-48e8-8a0b-611d24ad2339 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:04.819044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-824ae364-0b01-48e8-8a0b-611d24ad2339 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:04.829904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-824ae364-0b01-48e8-8a0b-611d24ad2339 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:04.831167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-824ae364-0b01-48e8-8a0b-611d24ad2339 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:04.831845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-824ae364-0b01-48e8-8a0b-611d24ad2339 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:05.813633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6a610661-9ed1-493d-b3a9-3565c00d26b6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:05.830602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6a610661-9ed1-493d-b3a9-3565c00d26b6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:05.833290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6a610661-9ed1-493d-b3a9-3565c00d26b6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:05.834790 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6a610661-9ed1-493d-b3a9-3565c00d26b6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1721 microversion: 2.20 time: 1.068343 Oct 27 19:01:05.836951 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1694/3543] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:04 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1721 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:05.851288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f062ac48-2afa-4152-a0de-f1b98a80275f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:05.852181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f062ac48-2afa-4152-a0de-f1b98a80275f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:05.866907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f062ac48-2afa-4152-a0de-f1b98a80275f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:05.867695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f062ac48-2afa-4152-a0de-f1b98a80275f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:05.868349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f062ac48-2afa-4152-a0de-f1b98a80275f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:05.869357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f062ac48-2afa-4152-a0de-f1b98a80275f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:05.870655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f062ac48-2afa-4152-a0de-f1b98a80275f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:05.872947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f062ac48-2afa-4152-a0de-f1b98a80275f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:06.086500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-824ae364-0b01-48e8-8a0b-611d24ad2339 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:06.104578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-824ae364-0b01-48e8-8a0b-611d24ad2339 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:06.106468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-824ae364-0b01-48e8-8a0b-611d24ad2339 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:06.108044 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-824ae364-0b01-48e8-8a0b-611d24ad2339 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 1.305000 Oct 27 19:01:06.108843 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1850/3544] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:04 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:01:06.113915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-99b77156-85be-47a2-8589-444acfe31762 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4db88c3-83c5-403c-a197-7044b7c96f82"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:06.117092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-99b77156-85be-47a2-8589-444acfe31762 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:06.124901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99b77156-85be-47a2-8589-444acfe31762 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:06.125712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99b77156-85be-47a2-8589-444acfe31762 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:06.126373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99b77156-85be-47a2-8589-444acfe31762 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:06.127322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99b77156-85be-47a2-8589-444acfe31762 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:06.127992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99b77156-85be-47a2-8589-444acfe31762 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:06.128616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99b77156-85be-47a2-8589-444acfe31762 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:06.292947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f062ac48-2afa-4152-a0de-f1b98a80275f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:06.311571 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f062ac48-2afa-4152-a0de-f1b98a80275f tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1382 microversion: 2.1 time: 0.472081 Oct 27 19:01:06.312170 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1695/3545] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:05 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1382 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:06.705190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5465d2b7-6b49-4e95-a543-c575145a503c tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:06.706184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5465d2b7-6b49-4e95-a543-c575145a503c tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:06.715564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5465d2b7-6b49-4e95-a543-c575145a503c tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:06.739289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5465d2b7-6b49-4e95-a543-c575145a503c tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:06.739625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5465d2b7-6b49-4e95-a543-c575145a503c tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:06.740385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5465d2b7-6b49-4e95-a543-c575145a503c tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:06.743245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:06.745758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5465d2b7-6b49-4e95-a543-c575145a503c tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:06.746714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5465d2b7-6b49-4e95-a543-c575145a503c tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:06.776378 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-99b77156-85be-47a2-8589-444acfe31762 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "POST /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.662416 Oct 27 19:01:06.783156 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1851/3546] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:01:06 2022] POST /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments => generated 194 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:06.877277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f4dc6447-c94c-49f9-9e74-a9b75a7f32cc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:06.879421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f4dc6447-c94c-49f9-9e74-a9b75a7f32cc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:06.917266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4dc6447-c94c-49f9-9e74-a9b75a7f32cc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:06.918268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4dc6447-c94c-49f9-9e74-a9b75a7f32cc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:06.921505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4dc6447-c94c-49f9-9e74-a9b75a7f32cc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:06.922675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4dc6447-c94c-49f9-9e74-a9b75a7f32cc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:06.923428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4dc6447-c94c-49f9-9e74-a9b75a7f32cc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:06.924357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4dc6447-c94c-49f9-9e74-a9b75a7f32cc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:07.106141 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5465d2b7-6b49-4e95-a543-c575145a503c tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1533 microversion: 2.1 time: 0.774607 Oct 27 19:01:07.108456 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1696/3547] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:06 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1533 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:01:07.140879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf5524f6-38b9-411f-9f93-bbcca4599bd1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:07.141829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf5524f6-38b9-411f-9f93-bbcca4599bd1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:07.149598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf5524f6-38b9-411f-9f93-bbcca4599bd1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:07.150715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf5524f6-38b9-411f-9f93-bbcca4599bd1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:07.151331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf5524f6-38b9-411f-9f93-bbcca4599bd1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:07.153121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf5524f6-38b9-411f-9f93-bbcca4599bd1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:07.153618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf5524f6-38b9-411f-9f93-bbcca4599bd1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:07.154056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf5524f6-38b9-411f-9f93-bbcca4599bd1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:07.311483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f4dc6447-c94c-49f9-9e74-a9b75a7f32cc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:07.325523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f4dc6447-c94c-49f9-9e74-a9b75a7f32cc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:07.327428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f4dc6447-c94c-49f9-9e74-a9b75a7f32cc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:07.328996 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f4dc6447-c94c-49f9-9e74-a9b75a7f32cc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1721 microversion: 2.20 time: 0.464916 Oct 27 19:01:07.342938 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1852/3548] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:06 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1721 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:07.356652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a260261-f57f-4abe-bd27-c56780639702 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:07.357670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1a260261-f57f-4abe-bd27-c56780639702 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:07.366763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a260261-f57f-4abe-bd27-c56780639702 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:07.367645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a260261-f57f-4abe-bd27-c56780639702 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:07.368895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a260261-f57f-4abe-bd27-c56780639702 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:07.369913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a260261-f57f-4abe-bd27-c56780639702 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:07.371146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a260261-f57f-4abe-bd27-c56780639702 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:07.371819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a260261-f57f-4abe-bd27-c56780639702 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:07.397229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf5524f6-38b9-411f-9f93-bbcca4599bd1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:07.409277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf5524f6-38b9-411f-9f93-bbcca4599bd1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:07.410996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf5524f6-38b9-411f-9f93-bbcca4599bd1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:07.414588 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf5524f6-38b9-411f-9f93-bbcca4599bd1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.276372 Oct 27 19:01:07.419223 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1697/3549] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:07 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:01:07.782915 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1a260261-f57f-4abe-bd27-c56780639702 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1533 microversion: 2.1 time: 0.437750 Oct 27 19:01:07.791108 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1853/3550] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:07 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1533 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:07.818320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7916683-ace5-4a45-9ff9-da25811ee768 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:07.836547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7916683-ace5-4a45-9ff9-da25811ee768 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:07.836547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7916683-ace5-4a45-9ff9-da25811ee768 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:07.836547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7916683-ace5-4a45-9ff9-da25811ee768 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:07.836547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7916683-ace5-4a45-9ff9-da25811ee768 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:07.836547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7916683-ace5-4a45-9ff9-da25811ee768 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:07.836547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7916683-ace5-4a45-9ff9-da25811ee768 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:07.873834 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7916683-ace5-4a45-9ff9-da25811ee768 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.065014 Oct 27 19:01:07.874662 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1698/3551] 10.222.0.42 () {58 vars in 1176 bytes} [Thu Oct 27 19:01:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:07.887700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-545923f9-1da4-4cd6-b111-8cbfd5ee412f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860687-3", "block_migration": false, "disk_over_commit": false}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:07.891438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-545923f9-1da4-4cd6-b111-8cbfd5ee412f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:07.898181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-545923f9-1da4-4cd6-b111-8cbfd5ee412f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:07.898971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-545923f9-1da4-4cd6-b111-8cbfd5ee412f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:07.899526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-545923f9-1da4-4cd6-b111-8cbfd5ee412f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:07.900652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-545923f9-1da4-4cd6-b111-8cbfd5ee412f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:07.901230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-545923f9-1da4-4cd6-b111-8cbfd5ee412f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:07.901799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-545923f9-1da4-4cd6-b111-8cbfd5ee412f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:07.956298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-545923f9-1da4-4cd6-b111-8cbfd5ee412f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lazy-loading 'flavor' on Instance uuid 06a0b276-1f26-4c66-9c0f-8ada81266162 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:01:07.973075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-545923f9-1da4-4cd6-b111-8cbfd5ee412f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Going to try to live migrate instance to n-h1-860687-3 {{(pid=127029) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 19:01:08.365258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-850d0c55-f474-4c09-99f0-e336d92e3b42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:08.366684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-850d0c55-f474-4c09-99f0-e336d92e3b42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:08.378553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-850d0c55-f474-4c09-99f0-e336d92e3b42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:08.381660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-850d0c55-f474-4c09-99f0-e336d92e3b42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:08.383613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-850d0c55-f474-4c09-99f0-e336d92e3b42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:08.386090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-850d0c55-f474-4c09-99f0-e336d92e3b42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:08.407386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-850d0c55-f474-4c09-99f0-e336d92e3b42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:08.408319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-850d0c55-f474-4c09-99f0-e336d92e3b42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:08.769164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-850d0c55-f474-4c09-99f0-e336d92e3b42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:08.790041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-850d0c55-f474-4c09-99f0-e336d92e3b42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:08.796717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-850d0c55-f474-4c09-99f0-e336d92e3b42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:08.801317 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-850d0c55-f474-4c09-99f0-e336d92e3b42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1742 microversion: 2.20 time: 0.443646 Oct 27 19:01:08.814460 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1699/3552] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:08 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1742 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:08.838308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ed89b141-4fa8-4a00-b3d1-45326d614670 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:08.839156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ed89b141-4fa8-4a00-b3d1-45326d614670 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:08.865382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed89b141-4fa8-4a00-b3d1-45326d614670 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:08.866273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed89b141-4fa8-4a00-b3d1-45326d614670 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:08.866971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed89b141-4fa8-4a00-b3d1-45326d614670 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:08.870241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed89b141-4fa8-4a00-b3d1-45326d614670 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:08.872676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed89b141-4fa8-4a00-b3d1-45326d614670 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:08.873406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed89b141-4fa8-4a00-b3d1-45326d614670 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:09.742469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ed89b141-4fa8-4a00-b3d1-45326d614670 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:09.758227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ed89b141-4fa8-4a00-b3d1-45326d614670 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:09.759843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ed89b141-4fa8-4a00-b3d1-45326d614670 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:09.761034 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ed89b141-4fa8-4a00-b3d1-45326d614670 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.955075 Oct 27 19:01:09.761602 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1700/3553] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:08 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:09.836132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dfa90cd3-4133-4dc4-8a38-102aa6d121d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:09.836807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dfa90cd3-4133-4dc4-8a38-102aa6d121d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:09.854038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa90cd3-4133-4dc4-8a38-102aa6d121d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:09.854659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa90cd3-4133-4dc4-8a38-102aa6d121d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:09.855125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa90cd3-4133-4dc4-8a38-102aa6d121d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:09.855881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa90cd3-4133-4dc4-8a38-102aa6d121d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:09.856345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa90cd3-4133-4dc4-8a38-102aa6d121d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:09.856845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa90cd3-4133-4dc4-8a38-102aa6d121d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:10.183806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dfa90cd3-4133-4dc4-8a38-102aa6d121d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:10.194120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dfa90cd3-4133-4dc4-8a38-102aa6d121d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:10.201780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dfa90cd3-4133-4dc4-8a38-102aa6d121d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:10.209961 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dfa90cd3-4133-4dc4-8a38-102aa6d121d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.377878 Oct 27 19:01:10.234469 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1701/3554] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:09 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:10.787568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d2743191-2e8f-4a92-abc8-55d7d72c5868 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:10.788307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d2743191-2e8f-4a92-abc8-55d7d72c5868 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:10.801436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2743191-2e8f-4a92-abc8-55d7d72c5868 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:10.803240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2743191-2e8f-4a92-abc8-55d7d72c5868 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:10.803719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2743191-2e8f-4a92-abc8-55d7d72c5868 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:10.805348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2743191-2e8f-4a92-abc8-55d7d72c5868 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:10.805765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2743191-2e8f-4a92-abc8-55d7d72c5868 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:10.807061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2743191-2e8f-4a92-abc8-55d7d72c5868 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:11.160487 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-545923f9-1da4-4cd6-b111-8cbfd5ee412f tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162/action" status: 202 len: 0 microversion: 2.1 time: 3.277105 Oct 27 19:01:11.161954 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1854/3555] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:01:07 2022] POST /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162/action => generated 0 bytes in 3279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:01:11.170872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-b3dcb9a8-a6f4-4da4-b95b-7e4903295488 req-33e5ed5d-0ba0-459d-bb31-61d0971245b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a7713a-b78d-425e-a6e8-0e4f5bc8904b", "name": "network-vif-plugged", "status": "completed", "tag": "9f402fdb-d277-4b7a-b6cc-275f32214caf"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:11.207357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b3dcb9a8-a6f4-4da4-b95b-7e4903295488 req-33e5ed5d-0ba0-459d-bb31-61d0971245b4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:11.215453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b3dcb9a8-a6f4-4da4-b95b-7e4903295488 req-33e5ed5d-0ba0-459d-bb31-61d0971245b4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:11.216253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b3dcb9a8-a6f4-4da4-b95b-7e4903295488 req-33e5ed5d-0ba0-459d-bb31-61d0971245b4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:11.257368 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-b3dcb9a8-a6f4-4da4-b95b-7e4903295488 req-33e5ed5d-0ba0-459d-bb31-61d0971245b4 service nova] Creating event network-vif-plugged:9f402fdb-d277-4b7a-b6cc-275f32214caf for instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b on n-h1-860687-3 Oct 27 19:01:11.269794 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-b3dcb9a8-a6f4-4da4-b95b-7e4903295488 req-33e5ed5d-0ba0-459d-bb31-61d0971245b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103498 Oct 27 19:01:11.278016 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1855/3556] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:11.288356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4698c38c-fd8a-4ed2-932a-f1d5a9d995b8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:11.289851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4698c38c-fd8a-4ed2-932a-f1d5a9d995b8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:11.305521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4698c38c-fd8a-4ed2-932a-f1d5a9d995b8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:11.311004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4698c38c-fd8a-4ed2-932a-f1d5a9d995b8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:11.311941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4698c38c-fd8a-4ed2-932a-f1d5a9d995b8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:11.314623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4698c38c-fd8a-4ed2-932a-f1d5a9d995b8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:11.315401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4698c38c-fd8a-4ed2-932a-f1d5a9d995b8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:11.319194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4698c38c-fd8a-4ed2-932a-f1d5a9d995b8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:11.765409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4698c38c-fd8a-4ed2-932a-f1d5a9d995b8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:11.779523 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4698c38c-fd8a-4ed2-932a-f1d5a9d995b8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.499845 Oct 27 19:01:11.782498 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1856/3557] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:11 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:11.799074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-98e303a0-eef8-4074-85e5-58df81543214 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:11.800122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-98e303a0-eef8-4074-85e5-58df81543214 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:11.817437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e303a0-eef8-4074-85e5-58df81543214 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:11.818507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e303a0-eef8-4074-85e5-58df81543214 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:11.820481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e303a0-eef8-4074-85e5-58df81543214 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:11.827278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d2743191-2e8f-4a92-abc8-55d7d72c5868 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:11.836443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e303a0-eef8-4074-85e5-58df81543214 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:11.841413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e303a0-eef8-4074-85e5-58df81543214 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:11.855422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e303a0-eef8-4074-85e5-58df81543214 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:11.871217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d2743191-2e8f-4a92-abc8-55d7d72c5868 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:11.879788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d2743191-2e8f-4a92-abc8-55d7d72c5868 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:11.883202 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d2743191-2e8f-4a92-abc8-55d7d72c5868 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 1.099426 Oct 27 19:01:11.886317 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1702/3558] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:10 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:01:12.415766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-98e303a0-eef8-4074-85e5-58df81543214 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:12.433145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-98e303a0-eef8-4074-85e5-58df81543214 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:12.435199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-98e303a0-eef8-4074-85e5-58df81543214 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:12.436650 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-98e303a0-eef8-4074-85e5-58df81543214 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.652950 Oct 27 19:01:12.457426 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1857/3559] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:11 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:12.809969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa33880e-22a5-41e5-8ad8-5084416cac0c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:12.811012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa33880e-22a5-41e5-8ad8-5084416cac0c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:12.825737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa33880e-22a5-41e5-8ad8-5084416cac0c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:12.826631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa33880e-22a5-41e5-8ad8-5084416cac0c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:12.827285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa33880e-22a5-41e5-8ad8-5084416cac0c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:12.828253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa33880e-22a5-41e5-8ad8-5084416cac0c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:12.829371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa33880e-22a5-41e5-8ad8-5084416cac0c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:12.830015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa33880e-22a5-41e5-8ad8-5084416cac0c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:12.916734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0fb52b98-9b9d-43d7-ab68-fc4c49f0a1d8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:12.917737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0fb52b98-9b9d-43d7-ab68-fc4c49f0a1d8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:12.935263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fb52b98-9b9d-43d7-ab68-fc4c49f0a1d8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:12.936160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fb52b98-9b9d-43d7-ab68-fc4c49f0a1d8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:12.936833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fb52b98-9b9d-43d7-ab68-fc4c49f0a1d8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:12.937795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fb52b98-9b9d-43d7-ab68-fc4c49f0a1d8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:12.938518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fb52b98-9b9d-43d7-ab68-fc4c49f0a1d8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:12.939180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fb52b98-9b9d-43d7-ab68-fc4c49f0a1d8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:13.224829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0fb52b98-9b9d-43d7-ab68-fc4c49f0a1d8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:13.235231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0fb52b98-9b9d-43d7-ab68-fc4c49f0a1d8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:13.237341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0fb52b98-9b9d-43d7-ab68-fc4c49f0a1d8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:13.238820 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0fb52b98-9b9d-43d7-ab68-fc4c49f0a1d8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.327076 Oct 27 19:01:13.239640 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1858/3560] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:12 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:01:13.320951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fa33880e-22a5-41e5-8ad8-5084416cac0c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:13.335281 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fa33880e-22a5-41e5-8ad8-5084416cac0c tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.529897 Oct 27 19:01:13.340253 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1703/3561] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:12 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:13.466340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3852a682-199a-4ea8-8f04-a3b297d7b171 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:13.467771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3852a682-199a-4ea8-8f04-a3b297d7b171 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:13.490649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3852a682-199a-4ea8-8f04-a3b297d7b171 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:13.494340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3852a682-199a-4ea8-8f04-a3b297d7b171 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:13.497398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3852a682-199a-4ea8-8f04-a3b297d7b171 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:13.499224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3852a682-199a-4ea8-8f04-a3b297d7b171 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:13.501731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3852a682-199a-4ea8-8f04-a3b297d7b171 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:13.505905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3852a682-199a-4ea8-8f04-a3b297d7b171 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:13.949908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3852a682-199a-4ea8-8f04-a3b297d7b171 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:13.959169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3852a682-199a-4ea8-8f04-a3b297d7b171 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:13.964173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3852a682-199a-4ea8-8f04-a3b297d7b171 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:13.967738 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3852a682-199a-4ea8-8f04-a3b297d7b171 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.507436 Oct 27 19:01:13.972437 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1859/3562] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:13 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:14.269146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3d8b3b74-2f9d-4faa-aa14-b2eaea2c8511 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:14.270694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3d8b3b74-2f9d-4faa-aa14-b2eaea2c8511 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:14.297605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d8b3b74-2f9d-4faa-aa14-b2eaea2c8511 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:14.300788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d8b3b74-2f9d-4faa-aa14-b2eaea2c8511 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:14.304722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d8b3b74-2f9d-4faa-aa14-b2eaea2c8511 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:14.309010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d8b3b74-2f9d-4faa-aa14-b2eaea2c8511 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:14.312258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d8b3b74-2f9d-4faa-aa14-b2eaea2c8511 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:14.315269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d8b3b74-2f9d-4faa-aa14-b2eaea2c8511 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:14.366419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-91a4f8a3-f0b4-496f-aaed-d52dafd30217 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:14.367095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-91a4f8a3-f0b4-496f-aaed-d52dafd30217 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:14.377839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a4f8a3-f0b4-496f-aaed-d52dafd30217 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:14.378345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a4f8a3-f0b4-496f-aaed-d52dafd30217 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:14.378828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a4f8a3-f0b4-496f-aaed-d52dafd30217 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:14.393508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a4f8a3-f0b4-496f-aaed-d52dafd30217 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:14.398456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a4f8a3-f0b4-496f-aaed-d52dafd30217 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:14.400237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a4f8a3-f0b4-496f-aaed-d52dafd30217 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:14.785377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-91a4f8a3-f0b4-496f-aaed-d52dafd30217 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:14.796117 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-91a4f8a3-f0b4-496f-aaed-d52dafd30217 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.433797 Oct 27 19:01:14.811092 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1860/3563] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:14 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:15.013573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-56a36343-1d3d-4e59-97bb-30dfa3325993 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:15.016517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-56a36343-1d3d-4e59-97bb-30dfa3325993 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:15.034778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56a36343-1d3d-4e59-97bb-30dfa3325993 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:15.035958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56a36343-1d3d-4e59-97bb-30dfa3325993 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:15.036702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56a36343-1d3d-4e59-97bb-30dfa3325993 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:15.038052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56a36343-1d3d-4e59-97bb-30dfa3325993 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:15.038894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56a36343-1d3d-4e59-97bb-30dfa3325993 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:15.039868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56a36343-1d3d-4e59-97bb-30dfa3325993 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:15.375320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-56a36343-1d3d-4e59-97bb-30dfa3325993 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:15.386595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-56a36343-1d3d-4e59-97bb-30dfa3325993 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:15.396858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-56a36343-1d3d-4e59-97bb-30dfa3325993 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:15.401839 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-56a36343-1d3d-4e59-97bb-30dfa3325993 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.398088 Oct 27 19:01:15.419158 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1861/3564] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:15 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:15.461037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d8b3b74-2f9d-4faa-aa14-b2eaea2c8511 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:15.472925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d8b3b74-2f9d-4faa-aa14-b2eaea2c8511 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:15.485354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d8b3b74-2f9d-4faa-aa14-b2eaea2c8511 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:15.492606 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3d8b3b74-2f9d-4faa-aa14-b2eaea2c8511 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 1.227246 Oct 27 19:01:15.500162 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1704/3565] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:14 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:15.829493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cf3c02f1-6616-4483-9d8b-9f695de8a4c2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:15.831199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cf3c02f1-6616-4483-9d8b-9f695de8a4c2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:15.850599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf3c02f1-6616-4483-9d8b-9f695de8a4c2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:15.851631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf3c02f1-6616-4483-9d8b-9f695de8a4c2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:15.852259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf3c02f1-6616-4483-9d8b-9f695de8a4c2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:15.853368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf3c02f1-6616-4483-9d8b-9f695de8a4c2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:15.853850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf3c02f1-6616-4483-9d8b-9f695de8a4c2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:15.854527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf3c02f1-6616-4483-9d8b-9f695de8a4c2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:16.288121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cf3c02f1-6616-4483-9d8b-9f695de8a4c2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:16.299112 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cf3c02f1-6616-4483-9d8b-9f695de8a4c2 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.474428 Oct 27 19:01:16.308263 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1862/3566] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:15 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:16.437705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ced99015-c6e2-4a77-a0aa-32db0943017f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:16.438683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ced99015-c6e2-4a77-a0aa-32db0943017f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:16.455351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ced99015-c6e2-4a77-a0aa-32db0943017f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:16.456159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ced99015-c6e2-4a77-a0aa-32db0943017f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:16.456806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ced99015-c6e2-4a77-a0aa-32db0943017f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:16.457740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ced99015-c6e2-4a77-a0aa-32db0943017f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:16.458556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ced99015-c6e2-4a77-a0aa-32db0943017f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:16.459334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ced99015-c6e2-4a77-a0aa-32db0943017f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:16.530083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-43e03000-0627-40b6-b0c4-8add8e5f2d39 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:16.531130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-43e03000-0627-40b6-b0c4-8add8e5f2d39 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:16.547439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e03000-0627-40b6-b0c4-8add8e5f2d39 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:16.555085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e03000-0627-40b6-b0c4-8add8e5f2d39 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:16.564700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e03000-0627-40b6-b0c4-8add8e5f2d39 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:16.565738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e03000-0627-40b6-b0c4-8add8e5f2d39 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:16.576480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e03000-0627-40b6-b0c4-8add8e5f2d39 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:16.577238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e03000-0627-40b6-b0c4-8add8e5f2d39 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:16.985537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-43e03000-0627-40b6-b0c4-8add8e5f2d39 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:16.996841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-43e03000-0627-40b6-b0c4-8add8e5f2d39 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:16.998376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-43e03000-0627-40b6-b0c4-8add8e5f2d39 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:17.034490 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-43e03000-0627-40b6-b0c4-8add8e5f2d39 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.507828 Oct 27 19:01:17.037564 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1863/3567] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:16 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:01:17.324555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ced99015-c6e2-4a77-a0aa-32db0943017f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:17.332202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-422f7aaa-97ed-4586-8374-da82e512f35d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:17.333877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-422f7aaa-97ed-4586-8374-da82e512f35d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:17.355403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:17.360866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-422f7aaa-97ed-4586-8374-da82e512f35d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:17.361427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-422f7aaa-97ed-4586-8374-da82e512f35d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:17.364510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-422f7aaa-97ed-4586-8374-da82e512f35d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:17.367814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-422f7aaa-97ed-4586-8374-da82e512f35d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:17.371016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-422f7aaa-97ed-4586-8374-da82e512f35d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:17.371474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-422f7aaa-97ed-4586-8374-da82e512f35d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:17.372404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ced99015-c6e2-4a77-a0aa-32db0943017f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:17.376342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ced99015-c6e2-4a77-a0aa-32db0943017f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:17.380201 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ced99015-c6e2-4a77-a0aa-32db0943017f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.946556 Oct 27 19:01:17.384524 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1705/3568] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:16 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:17.824663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-422f7aaa-97ed-4586-8374-da82e512f35d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:17.833897 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-422f7aaa-97ed-4586-8374-da82e512f35d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.506805 Oct 27 19:01:17.841088 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1864/3569] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:17 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:18.065285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5a9519dc-78d7-4a90-8c97-9dba08faed74 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:18.066372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5a9519dc-78d7-4a90-8c97-9dba08faed74 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:18.080134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:18.084517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a9519dc-78d7-4a90-8c97-9dba08faed74 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:18.093377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a9519dc-78d7-4a90-8c97-9dba08faed74 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:18.094032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a9519dc-78d7-4a90-8c97-9dba08faed74 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:18.096657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a9519dc-78d7-4a90-8c97-9dba08faed74 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:18.097347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a9519dc-78d7-4a90-8c97-9dba08faed74 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:18.097895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a9519dc-78d7-4a90-8c97-9dba08faed74 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:18.414177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7199a1b9-eb9a-4e65-b122-ecf74b44e295 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:18.416023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7199a1b9-eb9a-4e65-b122-ecf74b44e295 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:18.426594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7199a1b9-eb9a-4e65-b122-ecf74b44e295 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:18.434803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7199a1b9-eb9a-4e65-b122-ecf74b44e295 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:18.435518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7199a1b9-eb9a-4e65-b122-ecf74b44e295 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:18.436452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7199a1b9-eb9a-4e65-b122-ecf74b44e295 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:18.437095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7199a1b9-eb9a-4e65-b122-ecf74b44e295 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:18.437929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7199a1b9-eb9a-4e65-b122-ecf74b44e295 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:18.807514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7199a1b9-eb9a-4e65-b122-ecf74b44e295 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:18.818070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7199a1b9-eb9a-4e65-b122-ecf74b44e295 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:18.826338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7199a1b9-eb9a-4e65-b122-ecf74b44e295 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:18.830182 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7199a1b9-eb9a-4e65-b122-ecf74b44e295 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.421544 Oct 27 19:01:18.842947 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1865/3570] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:18 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:18.869783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-406578ee-0d21-43b1-9e08-78e70f5a73e8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:18.870910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-406578ee-0d21-43b1-9e08-78e70f5a73e8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:18.880236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-406578ee-0d21-43b1-9e08-78e70f5a73e8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:18.881259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-406578ee-0d21-43b1-9e08-78e70f5a73e8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:18.881963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-406578ee-0d21-43b1-9e08-78e70f5a73e8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:18.882995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-406578ee-0d21-43b1-9e08-78e70f5a73e8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:18.883710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-406578ee-0d21-43b1-9e08-78e70f5a73e8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:18.884510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-406578ee-0d21-43b1-9e08-78e70f5a73e8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:19.036167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5a9519dc-78d7-4a90-8c97-9dba08faed74 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:19.050167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5a9519dc-78d7-4a90-8c97-9dba08faed74 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:19.057032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5a9519dc-78d7-4a90-8c97-9dba08faed74 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:19.066261 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5a9519dc-78d7-4a90-8c97-9dba08faed74 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 1.003922 Oct 27 19:01:19.070411 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1706/3571] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:18 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:19.135990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-406578ee-0d21-43b1-9e08-78e70f5a73e8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:19.148605 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-406578ee-0d21-43b1-9e08-78e70f5a73e8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.282782 Oct 27 19:01:19.150852 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1866/3572] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:18 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:19.866351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-613da1c8-fd6e-4aff-a0c4-02632f64e6ac tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:19.868098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-613da1c8-fd6e-4aff-a0c4-02632f64e6ac tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:19.890019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-613da1c8-fd6e-4aff-a0c4-02632f64e6ac tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:19.890876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-613da1c8-fd6e-4aff-a0c4-02632f64e6ac tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:19.892664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-613da1c8-fd6e-4aff-a0c4-02632f64e6ac tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:19.896102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-613da1c8-fd6e-4aff-a0c4-02632f64e6ac tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:19.900896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-613da1c8-fd6e-4aff-a0c4-02632f64e6ac tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:19.902154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-613da1c8-fd6e-4aff-a0c4-02632f64e6ac tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:20.098337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f540b5bd-9490-44eb-90bd-0c9573386da7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:20.099640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f540b5bd-9490-44eb-90bd-0c9573386da7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:20.117319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f540b5bd-9490-44eb-90bd-0c9573386da7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:20.118284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f540b5bd-9490-44eb-90bd-0c9573386da7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:20.119438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f540b5bd-9490-44eb-90bd-0c9573386da7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:20.123080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f540b5bd-9490-44eb-90bd-0c9573386da7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:20.124161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f540b5bd-9490-44eb-90bd-0c9573386da7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:20.125717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f540b5bd-9490-44eb-90bd-0c9573386da7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:20.137749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:20.479439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f540b5bd-9490-44eb-90bd-0c9573386da7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:20.489562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f540b5bd-9490-44eb-90bd-0c9573386da7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:20.491860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f540b5bd-9490-44eb-90bd-0c9573386da7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:20.493775 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f540b5bd-9490-44eb-90bd-0c9573386da7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.398991 Oct 27 19:01:20.495882 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1867/3573] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:20 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:01:20.500986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8ef2ed8b-6655-4b67-86ec-fe75315b6f4d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:20.501924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8ef2ed8b-6655-4b67-86ec-fe75315b6f4d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:20.510237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ef2ed8b-6655-4b67-86ec-fe75315b6f4d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:20.511126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ef2ed8b-6655-4b67-86ec-fe75315b6f4d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:20.511872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ef2ed8b-6655-4b67-86ec-fe75315b6f4d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:20.512775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ef2ed8b-6655-4b67-86ec-fe75315b6f4d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:20.513494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ef2ed8b-6655-4b67-86ec-fe75315b6f4d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:20.514138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ef2ed8b-6655-4b67-86ec-fe75315b6f4d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:20.646481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-613da1c8-fd6e-4aff-a0c4-02632f64e6ac tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:20.656995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-613da1c8-fd6e-4aff-a0c4-02632f64e6ac tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:20.660028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-613da1c8-fd6e-4aff-a0c4-02632f64e6ac tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:20.661593 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-613da1c8-fd6e-4aff-a0c4-02632f64e6ac tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.804818 Oct 27 19:01:20.668343 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1707/3574] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:19 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:20.839604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8ef2ed8b-6655-4b67-86ec-fe75315b6f4d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:20.855095 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8ef2ed8b-6655-4b67-86ec-fe75315b6f4d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.355607 Oct 27 19:01:20.857755 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1868/3575] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:20 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:21.524442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b996b95-36d6-439d-9068-9f6c7b458d0d tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:21.526078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6b996b95-36d6-439d-9068-9f6c7b458d0d tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:21.539834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b996b95-36d6-439d-9068-9f6c7b458d0d tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:21.544281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b996b95-36d6-439d-9068-9f6c7b458d0d tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:21.545032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b996b95-36d6-439d-9068-9f6c7b458d0d tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:21.548017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b996b95-36d6-439d-9068-9f6c7b458d0d tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:21.550136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b996b95-36d6-439d-9068-9f6c7b458d0d tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:21.550806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b996b95-36d6-439d-9068-9f6c7b458d0d tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:21.699915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-baa4bd63-0d02-4aba-b0cf-a91ac2399258 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:21.700580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-baa4bd63-0d02-4aba-b0cf-a91ac2399258 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:21.712802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baa4bd63-0d02-4aba-b0cf-a91ac2399258 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:21.718770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baa4bd63-0d02-4aba-b0cf-a91ac2399258 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:21.722014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baa4bd63-0d02-4aba-b0cf-a91ac2399258 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:21.724599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baa4bd63-0d02-4aba-b0cf-a91ac2399258 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:21.727525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baa4bd63-0d02-4aba-b0cf-a91ac2399258 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:21.729898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-baa4bd63-0d02-4aba-b0cf-a91ac2399258 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:22.313549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6b996b95-36d6-439d-9068-9f6c7b458d0d tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:22.327368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6b996b95-36d6-439d-9068-9f6c7b458d0d tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:22.328842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6b996b95-36d6-439d-9068-9f6c7b458d0d tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:22.330052 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b996b95-36d6-439d-9068-9f6c7b458d0d tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.810341 Oct 27 19:01:22.330658 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1708/3576] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:21 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:22.347635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b9ad97a7-74f9-4339-b156-22e26e918c5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:22.348558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b9ad97a7-74f9-4339-b156-22e26e918c5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:22.363373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9ad97a7-74f9-4339-b156-22e26e918c5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:22.369643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9ad97a7-74f9-4339-b156-22e26e918c5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:22.373686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9ad97a7-74f9-4339-b156-22e26e918c5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:22.375901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9ad97a7-74f9-4339-b156-22e26e918c5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:22.376755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9ad97a7-74f9-4339-b156-22e26e918c5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:22.385905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9ad97a7-74f9-4339-b156-22e26e918c5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:22.536759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-baa4bd63-0d02-4aba-b0cf-a91ac2399258 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:22.552978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-baa4bd63-0d02-4aba-b0cf-a91ac2399258 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:22.554484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-baa4bd63-0d02-4aba-b0cf-a91ac2399258 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:22.578984 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-baa4bd63-0d02-4aba-b0cf-a91ac2399258 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.860926 Oct 27 19:01:22.602565 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1869/3577] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:21 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:22.803784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b9ad97a7-74f9-4339-b156-22e26e918c5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:22.814433 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b9ad97a7-74f9-4339-b156-22e26e918c5d tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.470676 Oct 27 19:01:22.820090 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1709/3578] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:22 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:23.358652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-919aa5a7-4d32-47b9-be3c-430181eb4f2a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:23.360027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-919aa5a7-4d32-47b9-be3c-430181eb4f2a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:23.373208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-919aa5a7-4d32-47b9-be3c-430181eb4f2a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:23.380213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-919aa5a7-4d32-47b9-be3c-430181eb4f2a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:23.382098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-919aa5a7-4d32-47b9-be3c-430181eb4f2a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:23.385225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-919aa5a7-4d32-47b9-be3c-430181eb4f2a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:23.385991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-919aa5a7-4d32-47b9-be3c-430181eb4f2a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:23.391103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-919aa5a7-4d32-47b9-be3c-430181eb4f2a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:23.491029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e53fbf44-31a0-41c1-89ed-145dc5247cec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Action: 'create', calling method: .version_select at 0x7fc873374790>, body: {"keypair": {"name": "tempest-keypair-496167742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPwAiqvcfhuQlfTv2D1XiJRpxplXutBmfTE/psYaJGS9YxgGEXPVNWxr/MJhLfbAXoyNMyZUNcFiKt2fUFo1jCuRtWuzAoflPz4vS9PG8tMkXxR2trTiwUAXr/EAgH6tQ=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:23.555162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e53fbf44-31a0-41c1-89ed-145dc5247cec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:01:23.568987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e53fbf44-31a0-41c1-89ed-145dc5247cec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for user 2be49f7bea7a4c8fbf289594e635fd69 and project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:01:23.623431 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e53fbf44-31a0-41c1-89ed-145dc5247cec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.136252 Oct 27 19:01:23.623891 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1710/3579] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:01:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:01:23.651381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d378fc9e-cce3-48bc-8a67-5998b9fd676f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:23.652018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d378fc9e-cce3-48bc-8a67-5998b9fd676f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:23.672803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d378fc9e-cce3-48bc-8a67-5998b9fd676f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:23.674128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d378fc9e-cce3-48bc-8a67-5998b9fd676f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:23.674307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d378fc9e-cce3-48bc-8a67-5998b9fd676f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:23.674996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d378fc9e-cce3-48bc-8a67-5998b9fd676f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:23.688634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d378fc9e-cce3-48bc-8a67-5998b9fd676f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:23.689248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d378fc9e-cce3-48bc-8a67-5998b9fd676f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:23.999816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d378fc9e-cce3-48bc-8a67-5998b9fd676f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:24.013141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d378fc9e-cce3-48bc-8a67-5998b9fd676f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:24.022163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d378fc9e-cce3-48bc-8a67-5998b9fd676f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:24.023987 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d378fc9e-cce3-48bc-8a67-5998b9fd676f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.384328 Oct 27 19:01:24.042424 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1711/3580] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:23 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:24.073501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6db00b98-6005-4669-8299-3ca406792a47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:24.074637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6db00b98-6005-4669-8299-3ca406792a47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:24.092980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6db00b98-6005-4669-8299-3ca406792a47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:24.095565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6db00b98-6005-4669-8299-3ca406792a47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:24.096201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6db00b98-6005-4669-8299-3ca406792a47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:24.098259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6db00b98-6005-4669-8299-3ca406792a47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:24.098788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6db00b98-6005-4669-8299-3ca406792a47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:24.099241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6db00b98-6005-4669-8299-3ca406792a47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:24.928900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6db00b98-6005-4669-8299-3ca406792a47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:24.945569 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6db00b98-6005-4669-8299-3ca406792a47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.899424 Oct 27 19:01:24.968423 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1712/3581] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:24 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:25.083881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-38b74d99-eb10-478f-ae95-75dbe431bef2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:25.085238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-38b74d99-eb10-478f-ae95-75dbe431bef2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:25.111054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38b74d99-eb10-478f-ae95-75dbe431bef2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:25.115301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38b74d99-eb10-478f-ae95-75dbe431bef2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:25.117419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38b74d99-eb10-478f-ae95-75dbe431bef2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:25.122969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38b74d99-eb10-478f-ae95-75dbe431bef2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:25.126085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38b74d99-eb10-478f-ae95-75dbe431bef2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:25.129589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38b74d99-eb10-478f-ae95-75dbe431bef2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:26.017536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-38b74d99-eb10-478f-ae95-75dbe431bef2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:26.031793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-38b74d99-eb10-478f-ae95-75dbe431bef2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:26.033116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-38b74d99-eb10-478f-ae95-75dbe431bef2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:26.034360 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-38b74d99-eb10-478f-ae95-75dbe431bef2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.958965 Oct 27 19:01:26.050562 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1713/3582] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:25 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:01:26.060157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f66dbb9d-7f47-4e5d-b1fb-5c2596f9be47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:26.083332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f66dbb9d-7f47-4e5d-b1fb-5c2596f9be47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:26.104815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f66dbb9d-7f47-4e5d-b1fb-5c2596f9be47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:26.112168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f66dbb9d-7f47-4e5d-b1fb-5c2596f9be47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:26.112640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f66dbb9d-7f47-4e5d-b1fb-5c2596f9be47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:26.113395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f66dbb9d-7f47-4e5d-b1fb-5c2596f9be47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:26.117484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f66dbb9d-7f47-4e5d-b1fb-5c2596f9be47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:26.118109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f66dbb9d-7f47-4e5d-b1fb-5c2596f9be47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:26.418838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-919aa5a7-4d32-47b9-be3c-430181eb4f2a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:26.499732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-919aa5a7-4d32-47b9-be3c-430181eb4f2a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:26.508775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-919aa5a7-4d32-47b9-be3c-430181eb4f2a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:26.514088 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-919aa5a7-4d32-47b9-be3c-430181eb4f2a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 3.158943 Oct 27 19:01:26.517881 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1870/3583] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:23 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 3165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:26.955405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f66dbb9d-7f47-4e5d-b1fb-5c2596f9be47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:26.969163 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f66dbb9d-7f47-4e5d-b1fb-5c2596f9be47 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.917194 Oct 27 19:01:26.979361 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1714/3584] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:26 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:27.097057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ca5beff2-5ac6-4117-939e-afe2909a78eb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:27.098150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ca5beff2-5ac6-4117-939e-afe2909a78eb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:27.147499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca5beff2-5ac6-4117-939e-afe2909a78eb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:27.150779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca5beff2-5ac6-4117-939e-afe2909a78eb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:27.151640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca5beff2-5ac6-4117-939e-afe2909a78eb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:27.158645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca5beff2-5ac6-4117-939e-afe2909a78eb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:27.159679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca5beff2-5ac6-4117-939e-afe2909a78eb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:27.177325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca5beff2-5ac6-4117-939e-afe2909a78eb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:27.552167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a36de5c5-7747-4bd0-b345-5658c9101756 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:27.553110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a36de5c5-7747-4bd0-b345-5658c9101756 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:27.573906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:27.597262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a36de5c5-7747-4bd0-b345-5658c9101756 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:27.600234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a36de5c5-7747-4bd0-b345-5658c9101756 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:27.601927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a36de5c5-7747-4bd0-b345-5658c9101756 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:27.605242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a36de5c5-7747-4bd0-b345-5658c9101756 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:27.607089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a36de5c5-7747-4bd0-b345-5658c9101756 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:27.610411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a36de5c5-7747-4bd0-b345-5658c9101756 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:28.091107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ca5beff2-5ac6-4117-939e-afe2909a78eb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:28.101390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ca5beff2-5ac6-4117-939e-afe2909a78eb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:28.109618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ca5beff2-5ac6-4117-939e-afe2909a78eb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:28.121535 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ca5beff2-5ac6-4117-939e-afe2909a78eb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 1.027009 Oct 27 19:01:28.125383 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1871/3585] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:27 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:28.130612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-01bf02b1-e613-44bc-937b-8e1923f9e9e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:28.138485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-01bf02b1-e613-44bc-937b-8e1923f9e9e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:28.161029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01bf02b1-e613-44bc-937b-8e1923f9e9e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:28.161515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01bf02b1-e613-44bc-937b-8e1923f9e9e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:28.161949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01bf02b1-e613-44bc-937b-8e1923f9e9e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:28.162674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01bf02b1-e613-44bc-937b-8e1923f9e9e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:28.176482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01bf02b1-e613-44bc-937b-8e1923f9e9e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:28.178974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01bf02b1-e613-44bc-937b-8e1923f9e9e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:28.358343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a36de5c5-7747-4bd0-b345-5658c9101756 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:28.369583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a36de5c5-7747-4bd0-b345-5658c9101756 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:28.382742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a36de5c5-7747-4bd0-b345-5658c9101756 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:28.392461 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a36de5c5-7747-4bd0-b345-5658c9101756 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.845208 Oct 27 19:01:28.393301 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1715/3586] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:27 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:01:28.979874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-01bf02b1-e613-44bc-937b-8e1923f9e9e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:28.997276 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-01bf02b1-e613-44bc-937b-8e1923f9e9e4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.870153 Oct 27 19:01:28.997844 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1872/3587] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:28 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:29.154465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5b42ad94-2c4f-43e8-ba1a-2993ac95390b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:29.155725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5b42ad94-2c4f-43e8-ba1a-2993ac95390b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:29.164292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b42ad94-2c4f-43e8-ba1a-2993ac95390b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:29.165650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b42ad94-2c4f-43e8-ba1a-2993ac95390b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:29.166266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b42ad94-2c4f-43e8-ba1a-2993ac95390b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:29.167247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b42ad94-2c4f-43e8-ba1a-2993ac95390b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:29.167887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b42ad94-2c4f-43e8-ba1a-2993ac95390b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:29.168542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b42ad94-2c4f-43e8-ba1a-2993ac95390b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:29.350896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5b42ad94-2c4f-43e8-ba1a-2993ac95390b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:29.438728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5b42ad94-2c4f-43e8-ba1a-2993ac95390b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:29.438728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5b42ad94-2c4f-43e8-ba1a-2993ac95390b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:29.438728 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5b42ad94-2c4f-43e8-ba1a-2993ac95390b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.213004 Oct 27 19:01:29.438728 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1716/3588] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:29 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:29.441261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c4a4e092-611d-42c4-8951-b032a2b58b05 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:29.441261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c4a4e092-611d-42c4-8951-b032a2b58b05 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:29.451062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4a4e092-611d-42c4-8951-b032a2b58b05 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:29.451233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4a4e092-611d-42c4-8951-b032a2b58b05 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:29.451686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4a4e092-611d-42c4-8951-b032a2b58b05 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:29.452578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4a4e092-611d-42c4-8951-b032a2b58b05 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:29.453187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4a4e092-611d-42c4-8951-b032a2b58b05 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:29.453719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4a4e092-611d-42c4-8951-b032a2b58b05 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:29.731147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-305892568", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2cfbe0bf-f6fb-46ad-9a6c-606f41f6cc6f"}], "security_groups": [{"name": "tempest-securitygroup--1897519040"}], "key_name": "tempest-keypair-496167742", "user_data": "}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:29.924498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] validate_networks() for [('2cfbe0bf-f6fb-46ad-9a6c-606f41f6cc6f', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:01:30.144226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c4a4e092-611d-42c4-8951-b032a2b58b05 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:30.166168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c4a4e092-611d-42c4-8951-b032a2b58b05 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:30.176937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c4a4e092-611d-42c4-8951-b032a2b58b05 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:30.182019 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c4a4e092-611d-42c4-8951-b032a2b58b05 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.758901 Oct 27 19:01:30.183525 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1873/3589] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:29 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:30.212746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d136ea5-8b5a-4233-a5bb-db95385bc1d0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:30.214484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0d136ea5-8b5a-4233-a5bb-db95385bc1d0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:30.246350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d136ea5-8b5a-4233-a5bb-db95385bc1d0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:30.248542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d136ea5-8b5a-4233-a5bb-db95385bc1d0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:30.249568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d136ea5-8b5a-4233-a5bb-db95385bc1d0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:30.249798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d136ea5-8b5a-4233-a5bb-db95385bc1d0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:30.253759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d136ea5-8b5a-4233-a5bb-db95385bc1d0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:30.256794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d136ea5-8b5a-4233-a5bb-db95385bc1d0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:30.779827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:01:30.781214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:01:30.781880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:01:30.783380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:01:30.784015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:01:30.808708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:30.813297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:30.813905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:30.815578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:30.816305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:30.816993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:30.857188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:01:30.864729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for user 2be49f7bea7a4c8fbf289594e635fd69 and project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:01:30.866682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0d136ea5-8b5a-4233-a5bb-db95385bc1d0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:30.881307 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0d136ea5-8b5a-4233-a5bb-db95385bc1d0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.696012 Oct 27 19:01:30.882222 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1874/3590] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:30 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:30.895492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:01:30.897930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:01:30.900080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b98d0abe-71df-414b-b3a0-f8d794fba17d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:30.915525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b98d0abe-71df-414b-b3a0-f8d794fba17d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:30.935943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b98d0abe-71df-414b-b3a0-f8d794fba17d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:30.936551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b98d0abe-71df-414b-b3a0-f8d794fba17d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:30.938248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b98d0abe-71df-414b-b3a0-f8d794fba17d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:30.940408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b98d0abe-71df-414b-b3a0-f8d794fba17d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:30.942353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b98d0abe-71df-414b-b3a0-f8d794fba17d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:30.943373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b98d0abe-71df-414b-b3a0-f8d794fba17d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:30.990590 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fb6a74c6-0bf7-4706-9efe-55ae786ce50c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.265175 Oct 27 19:01:30.999353 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1717/3591] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:01:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:01:31.009500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f67b87af-9b75-479f-89d2-f027c5234104 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:31.010234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f67b87af-9b75-479f-89d2-f027c5234104 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:31.409590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f67b87af-9b75-479f-89d2-f027c5234104 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:31.419082 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f67b87af-9b75-479f-89d2-f027c5234104 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1240 microversion: 2.1 time: 0.418543 Oct 27 19:01:31.422096 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1718/3592] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:30 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1240 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:31.432517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-651074aa-9867-4307-be39-c725b0a4c8a7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:31.434446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-651074aa-9867-4307-be39-c725b0a4c8a7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:31.451534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-651074aa-9867-4307-be39-c725b0a4c8a7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:31.452927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-651074aa-9867-4307-be39-c725b0a4c8a7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:31.454499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-651074aa-9867-4307-be39-c725b0a4c8a7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:31.455525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-651074aa-9867-4307-be39-c725b0a4c8a7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:31.459752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-651074aa-9867-4307-be39-c725b0a4c8a7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:31.460450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-651074aa-9867-4307-be39-c725b0a4c8a7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:32.182926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b98d0abe-71df-414b-b3a0-f8d794fba17d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:32.196498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b98d0abe-71df-414b-b3a0-f8d794fba17d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:32.198289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b98d0abe-71df-414b-b3a0-f8d794fba17d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:32.217579 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b98d0abe-71df-414b-b3a0-f8d794fba17d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 1.331907 Oct 27 19:01:32.218211 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1875/3593] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:30 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:32.293255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-afd40374-f531-4031-8418-4087543d7a03 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:32.294180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-afd40374-f531-4031-8418-4087543d7a03 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:32.301735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=64 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:32.377874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-afd40374-f531-4031-8418-4087543d7a03 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:32.378978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-afd40374-f531-4031-8418-4087543d7a03 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:32.380734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-afd40374-f531-4031-8418-4087543d7a03 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:32.382567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-afd40374-f531-4031-8418-4087543d7a03 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:32.385268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-afd40374-f531-4031-8418-4087543d7a03 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:32.385934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-afd40374-f531-4031-8418-4087543d7a03 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:32.433396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-651074aa-9867-4307-be39-c725b0a4c8a7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:32.492096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-651074aa-9867-4307-be39-c725b0a4c8a7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:32.501544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-651074aa-9867-4307-be39-c725b0a4c8a7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:32.506793 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-651074aa-9867-4307-be39-c725b0a4c8a7 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 1.079179 Oct 27 19:01:32.507463 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1719/3594] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:31 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:32.531607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0ce3d004-8af9-4f98-8070-896c8aa6b46d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:32.533633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0ce3d004-8af9-4f98-8070-896c8aa6b46d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:32.550323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce3d004-8af9-4f98-8070-896c8aa6b46d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:32.563453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce3d004-8af9-4f98-8070-896c8aa6b46d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:32.564428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce3d004-8af9-4f98-8070-896c8aa6b46d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:32.568186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce3d004-8af9-4f98-8070-896c8aa6b46d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:32.568941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce3d004-8af9-4f98-8070-896c8aa6b46d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:32.573165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce3d004-8af9-4f98-8070-896c8aa6b46d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:32.614318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-afd40374-f531-4031-8418-4087543d7a03 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:32.628028 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-afd40374-f531-4031-8418-4087543d7a03 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.367709 Oct 27 19:01:32.629351 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1876/3595] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:32 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:33.093523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1293982513", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "6abf8c87-585a-45f7-af8a-77bf8d1d9400"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:33.168894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0ce3d004-8af9-4f98-8070-896c8aa6b46d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:33.185037 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0ce3d004-8af9-4f98-8070-896c8aa6b46d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1236 microversion: 2.1 time: 0.671580 Oct 27 19:01:33.193795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] validate_networks() for [('6abf8c87-585a-45f7-af8a-77bf8d1d9400', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:01:33.201972 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1720/3596] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:32 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1236 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:33.245173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e505132c-5ab7-4358-bc10-1634c83b8feb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:33.245850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e505132c-5ab7-4358-bc10-1634c83b8feb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:33.255540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e505132c-5ab7-4358-bc10-1634c83b8feb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:33.258408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e505132c-5ab7-4358-bc10-1634c83b8feb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:33.260620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e505132c-5ab7-4358-bc10-1634c83b8feb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:33.261610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e505132c-5ab7-4358-bc10-1634c83b8feb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:33.262283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e505132c-5ab7-4358-bc10-1634c83b8feb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:33.263185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e505132c-5ab7-4358-bc10-1634c83b8feb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:34.038144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e505132c-5ab7-4358-bc10-1634c83b8feb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:34.059827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e505132c-5ab7-4358-bc10-1634c83b8feb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:34.071684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e505132c-5ab7-4358-bc10-1634c83b8feb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:34.075647 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e505132c-5ab7-4358-bc10-1634c83b8feb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.835577 Oct 27 19:01:34.078300 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1721/3597] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:33 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:01:34.088962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf2a7b04-df18-49ac-b085-c33b5f236af9 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:34.091431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cf2a7b04-df18-49ac-b085-c33b5f236af9 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:34.106031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf2a7b04-df18-49ac-b085-c33b5f236af9 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:34.108808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf2a7b04-df18-49ac-b085-c33b5f236af9 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:34.109536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf2a7b04-df18-49ac-b085-c33b5f236af9 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:34.112782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf2a7b04-df18-49ac-b085-c33b5f236af9 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:34.114723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf2a7b04-df18-49ac-b085-c33b5f236af9 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:34.117255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf2a7b04-df18-49ac-b085-c33b5f236af9 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:34.889099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:01:34.890619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:01:34.891357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:01:34.891996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:01:34.892596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:01:34.907506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:34.908489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:34.908937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:34.909900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:34.911031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:34.911852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:34.947940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Getting quotas for project 32f3252ed23b44c9b3608b1e954e7094. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:01:34.981203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Getting quotas for user 6dc869326800402785fc9a7804ae9a03 and project 32f3252ed23b44c9b3608b1e954e7094. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:01:35.010248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:01:35.020658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:01:35.080790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cf2a7b04-df18-49ac-b085-c33b5f236af9 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:35.096118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cf2a7b04-df18-49ac-b085-c33b5f236af9 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:35.103026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cf2a7b04-df18-49ac-b085-c33b5f236af9 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:35.106182 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cf2a7b04-df18-49ac-b085-c33b5f236af9 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 1.024146 Oct 27 19:01:35.119372 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1722/3598] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:34 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:35.131622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0c7381a3-59d4-43ff-b304-83b5595e92ba tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:35.132575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0c7381a3-59d4-43ff-b304-83b5595e92ba tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:35.140287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c7381a3-59d4-43ff-b304-83b5595e92ba tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:35.140659 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f63b8afe-b286-4b0d-ab25-6a90faf8addb tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.336539 Oct 27 19:01:35.141296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c7381a3-59d4-43ff-b304-83b5595e92ba tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:35.141934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c7381a3-59d4-43ff-b304-83b5595e92ba tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:35.142877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c7381a3-59d4-43ff-b304-83b5595e92ba tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:35.143509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c7381a3-59d4-43ff-b304-83b5595e92ba tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:35.144120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c7381a3-59d4-43ff-b304-83b5595e92ba tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:35.145965 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1877/3599] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:01:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:01:35.159393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-fe8df857-9095-4431-9765-3987c8060aa9 req-95b73dd9-61cd-4d46-adec-f8819aaa308f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a0b276-1f26-4c66-9c0f-8ada81266162", "name": "network-vif-unplugged", "status": "completed", "tag": "2b54e61c-2e06-4b78-9fd7-f1f2dde7fd49"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:35.186238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fe8df857-9095-4431-9765-3987c8060aa9 req-95b73dd9-61cd-4d46-adec-f8819aaa308f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:35.186765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fe8df857-9095-4431-9765-3987c8060aa9 req-95b73dd9-61cd-4d46-adec-f8819aaa308f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:35.187211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fe8df857-9095-4431-9765-3987c8060aa9 req-95b73dd9-61cd-4d46-adec-f8819aaa308f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:35.224925 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-fe8df857-9095-4431-9765-3987c8060aa9 req-95b73dd9-61cd-4d46-adec-f8819aaa308f service nova] Creating event network-vif-unplugged:2b54e61c-2e06-4b78-9fd7-f1f2dde7fd49 for instance 06a0b276-1f26-4c66-9c0f-8ada81266162 on n-h2-860687-3 Oct 27 19:01:35.241560 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-fe8df857-9095-4431-9765-3987c8060aa9 req-95b73dd9-61cd-4d46-adec-f8819aaa308f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094158 Oct 27 19:01:35.242253 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1878/3600] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:35.259664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-25182985-2dcb-4119-98aa-77cf6baca89a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:35.260786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-25182985-2dcb-4119-98aa-77cf6baca89a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:35.276337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25182985-2dcb-4119-98aa-77cf6baca89a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:35.276699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25182985-2dcb-4119-98aa-77cf6baca89a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:35.277614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25182985-2dcb-4119-98aa-77cf6baca89a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:35.283546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25182985-2dcb-4119-98aa-77cf6baca89a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:35.284246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25182985-2dcb-4119-98aa-77cf6baca89a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:35.284719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25182985-2dcb-4119-98aa-77cf6baca89a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:35.364542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-25182985-2dcb-4119-98aa-77cf6baca89a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:35.378446 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-25182985-2dcb-4119-98aa-77cf6baca89a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1298 microversion: 2.1 time: 0.129844 Oct 27 19:01:35.399933 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1879/3601] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:35 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1298 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:35.417038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bce17b3a-8f2c-4fab-8eeb-20265e9ef592 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:35.418259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bce17b3a-8f2c-4fab-8eeb-20265e9ef592 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:35.440255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bce17b3a-8f2c-4fab-8eeb-20265e9ef592 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:35.441148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bce17b3a-8f2c-4fab-8eeb-20265e9ef592 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:35.441808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bce17b3a-8f2c-4fab-8eeb-20265e9ef592 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:35.443098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bce17b3a-8f2c-4fab-8eeb-20265e9ef592 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:35.448772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bce17b3a-8f2c-4fab-8eeb-20265e9ef592 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:35.449773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bce17b3a-8f2c-4fab-8eeb-20265e9ef592 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:35.919678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0c7381a3-59d4-43ff-b304-83b5595e92ba tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:35.934781 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0c7381a3-59d4-43ff-b304-83b5595e92ba tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.814003 Oct 27 19:01:35.944726 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1723/3602] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:35 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:35.951727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d54e1c3-b91f-47a9-9ff9-1344da8255b5 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:35.952702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d54e1c3-b91f-47a9-9ff9-1344da8255b5 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:35.984724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bce17b3a-8f2c-4fab-8eeb-20265e9ef592 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:36.003139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bce17b3a-8f2c-4fab-8eeb-20265e9ef592 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:36.017287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bce17b3a-8f2c-4fab-8eeb-20265e9ef592 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:36.025955 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bce17b3a-8f2c-4fab-8eeb-20265e9ef592 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.621240 Oct 27 19:01:36.026890 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1880/3603] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:35 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:36.138808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b896d26d-37db-46ee-b8e9-6d79d2ae55c5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:36.139353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b896d26d-37db-46ee-b8e9-6d79d2ae55c5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:36.158912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b896d26d-37db-46ee-b8e9-6d79d2ae55c5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:36.159439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b896d26d-37db-46ee-b8e9-6d79d2ae55c5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:36.159901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b896d26d-37db-46ee-b8e9-6d79d2ae55c5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:36.176295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b896d26d-37db-46ee-b8e9-6d79d2ae55c5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:36.177007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b896d26d-37db-46ee-b8e9-6d79d2ae55c5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:36.177473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b896d26d-37db-46ee-b8e9-6d79d2ae55c5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:36.773944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b896d26d-37db-46ee-b8e9-6d79d2ae55c5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:36.804703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6d54e1c3-b91f-47a9-9ff9-1344da8255b5 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:36.824364 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d54e1c3-b91f-47a9-9ff9-1344da8255b5 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1216 microversion: 2.1 time: 0.877228 Oct 27 19:01:36.827273 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1724/3604] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:35 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1216 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:36.830759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b896d26d-37db-46ee-b8e9-6d79d2ae55c5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:36.835767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b896d26d-37db-46ee-b8e9-6d79d2ae55c5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:36.840391 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b896d26d-37db-46ee-b8e9-6d79d2ae55c5 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.706732 Oct 27 19:01:36.841670 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1881/3605] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:36 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:01:36.849043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4f0ffe32-0128-460f-ae10-38ef52d36058 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:36.850547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4f0ffe32-0128-460f-ae10-38ef52d36058 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:36.871769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-cb29da28-9abd-443a-a3b5-637f4dd4bc49 req-3c6dca86-ac1d-4aaa-a931-a6915c9d99db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-plugged", "status": "completed", "tag": "2a34a33b-11c6-4dcd-a52b-4a26af50fc18"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:36.888407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f0ffe32-0128-460f-ae10-38ef52d36058 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:36.890098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f0ffe32-0128-460f-ae10-38ef52d36058 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:36.894499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f0ffe32-0128-460f-ae10-38ef52d36058 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:36.897080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f0ffe32-0128-460f-ae10-38ef52d36058 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:36.901360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f0ffe32-0128-460f-ae10-38ef52d36058 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:36.902358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f0ffe32-0128-460f-ae10-38ef52d36058 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:36.918142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cb29da28-9abd-443a-a3b5-637f4dd4bc49 req-3c6dca86-ac1d-4aaa-a931-a6915c9d99db service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:36.919168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cb29da28-9abd-443a-a3b5-637f4dd4bc49 req-3c6dca86-ac1d-4aaa-a931-a6915c9d99db service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:36.920109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cb29da28-9abd-443a-a3b5-637f4dd4bc49 req-3c6dca86-ac1d-4aaa-a931-a6915c9d99db service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:36.941000 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-cb29da28-9abd-443a-a3b5-637f4dd4bc49 req-3c6dca86-ac1d-4aaa-a931-a6915c9d99db service nova] Creating event network-vif-plugged:2a34a33b-11c6-4dcd-a52b-4a26af50fc18 for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:01:36.952401 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-cb29da28-9abd-443a-a3b5-637f4dd4bc49 req-3c6dca86-ac1d-4aaa-a931-a6915c9d99db service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122890 Oct 27 19:01:36.962662 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1725/3606] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:36.980744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-540c3f51-1698-419b-bbcd-f59c10c6e44b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:36.988032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-540c3f51-1698-419b-bbcd-f59c10c6e44b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:37.002437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-540c3f51-1698-419b-bbcd-f59c10c6e44b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:37.003733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-540c3f51-1698-419b-bbcd-f59c10c6e44b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:37.007572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-540c3f51-1698-419b-bbcd-f59c10c6e44b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:37.008785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-540c3f51-1698-419b-bbcd-f59c10c6e44b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:37.010786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-540c3f51-1698-419b-bbcd-f59c10c6e44b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:37.012512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-540c3f51-1698-419b-bbcd-f59c10c6e44b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:37.126615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4f0ffe32-0128-460f-ae10-38ef52d36058 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:37.163958 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4f0ffe32-0128-460f-ae10-38ef52d36058 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1298 microversion: 2.1 time: 0.315271 Oct 27 19:01:37.166178 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1882/3607] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:36 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1298 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:37.213792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-83200026-bc85-424e-8aee-22d075df1df0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:37.215963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-83200026-bc85-424e-8aee-22d075df1df0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:37.236150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83200026-bc85-424e-8aee-22d075df1df0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:37.236805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83200026-bc85-424e-8aee-22d075df1df0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:37.238845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83200026-bc85-424e-8aee-22d075df1df0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:37.240173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83200026-bc85-424e-8aee-22d075df1df0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:37.244281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83200026-bc85-424e-8aee-22d075df1df0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:37.244805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83200026-bc85-424e-8aee-22d075df1df0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:37.657656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-83200026-bc85-424e-8aee-22d075df1df0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:37.689975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-83200026-bc85-424e-8aee-22d075df1df0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:37.691501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-83200026-bc85-424e-8aee-22d075df1df0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:37.706176 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-83200026-bc85-424e-8aee-22d075df1df0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.517991 Oct 27 19:01:37.707428 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1883/3608] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:37 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:37.729434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-68018554-69e4-417d-8108-8347bd6296cd req-3c313b2e-3994-43c1-9212-8dc460e62808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a0b276-1f26-4c66-9c0f-8ada81266162", "tag": "2b54e61c-2e06-4b78-9fd7-f1f2dde7fd49"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:37.758123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-68018554-69e4-417d-8108-8347bd6296cd req-3c313b2e-3994-43c1-9212-8dc460e62808 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:37.759960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-68018554-69e4-417d-8108-8347bd6296cd req-3c313b2e-3994-43c1-9212-8dc460e62808 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:37.760627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-68018554-69e4-417d-8108-8347bd6296cd req-3c313b2e-3994-43c1-9212-8dc460e62808 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:37.795801 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-68018554-69e4-417d-8108-8347bd6296cd req-3c313b2e-3994-43c1-9212-8dc460e62808 service nova] Creating event network-changed:2b54e61c-2e06-4b78-9fd7-f1f2dde7fd49 for instance 06a0b276-1f26-4c66-9c0f-8ada81266162 on n-h2-860687-3 Oct 27 19:01:37.801998 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-68018554-69e4-417d-8108-8347bd6296cd req-3c313b2e-3994-43c1-9212-8dc460e62808 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093152 Oct 27 19:01:37.803444 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1884/3609] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:37.856516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e5ea1142-037b-4342-a2f0-3af1c5348637 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:37.857246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e5ea1142-037b-4342-a2f0-3af1c5348637 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:37.870922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5ea1142-037b-4342-a2f0-3af1c5348637 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:37.882465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5ea1142-037b-4342-a2f0-3af1c5348637 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:37.882980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5ea1142-037b-4342-a2f0-3af1c5348637 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:37.886134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5ea1142-037b-4342-a2f0-3af1c5348637 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:37.892963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5ea1142-037b-4342-a2f0-3af1c5348637 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:37.893507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5ea1142-037b-4342-a2f0-3af1c5348637 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:38.236239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-540c3f51-1698-419b-bbcd-f59c10c6e44b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:38.248517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:38.282115 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-540c3f51-1698-419b-bbcd-f59c10c6e44b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 1.297223 Oct 27 19:01:38.299123 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1726/3610] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:36 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:38.319484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8093e591-0bc1-475c-895e-2033b3c46160 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:38.326320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8093e591-0bc1-475c-895e-2033b3c46160 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:38.371570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8093e591-0bc1-475c-895e-2033b3c46160 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:38.383096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8093e591-0bc1-475c-895e-2033b3c46160 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:38.387214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8093e591-0bc1-475c-895e-2033b3c46160 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:38.388685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8093e591-0bc1-475c-895e-2033b3c46160 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:38.392384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8093e591-0bc1-475c-895e-2033b3c46160 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:38.395815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8093e591-0bc1-475c-895e-2033b3c46160 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:38.552109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e5ea1142-037b-4342-a2f0-3af1c5348637 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:38.558726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:38.579781 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e5ea1142-037b-4342-a2f0-3af1c5348637 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1268 microversion: 2.1 time: 0.730960 Oct 27 19:01:38.599462 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1885/3611] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:37 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1268 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:01:38.617178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-02b7d8e3-c16e-4e24-8669-227a736bce52 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:38.617772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-02b7d8e3-c16e-4e24-8669-227a736bce52 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:38.638503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02b7d8e3-c16e-4e24-8669-227a736bce52 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:38.641668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02b7d8e3-c16e-4e24-8669-227a736bce52 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:38.642356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02b7d8e3-c16e-4e24-8669-227a736bce52 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:38.646604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02b7d8e3-c16e-4e24-8669-227a736bce52 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:38.647397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02b7d8e3-c16e-4e24-8669-227a736bce52 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:38.648398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02b7d8e3-c16e-4e24-8669-227a736bce52 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:39.115745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-02b7d8e3-c16e-4e24-8669-227a736bce52 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:39.134187 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-02b7d8e3-c16e-4e24-8669-227a736bce52 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1366 microversion: 2.1 time: 0.526026 Oct 27 19:01:39.139017 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1886/3612] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:38 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1366 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:39.155570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fcf5378e-0366-4f35-80a7-af6d2a88169d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:39.156701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fcf5378e-0366-4f35-80a7-af6d2a88169d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:39.173104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf5378e-0366-4f35-80a7-af6d2a88169d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:39.175020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf5378e-0366-4f35-80a7-af6d2a88169d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:39.176969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf5378e-0366-4f35-80a7-af6d2a88169d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:39.178693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf5378e-0366-4f35-80a7-af6d2a88169d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:39.180953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf5378e-0366-4f35-80a7-af6d2a88169d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:39.182065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf5378e-0366-4f35-80a7-af6d2a88169d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:39.214700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8093e591-0bc1-475c-895e-2033b3c46160 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:39.235764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8093e591-0bc1-475c-895e-2033b3c46160 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:39.240796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8093e591-0bc1-475c-895e-2033b3c46160 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:39.246539 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8093e591-0bc1-475c-895e-2033b3c46160 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.951012 Oct 27 19:01:39.248440 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1727/3613] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:38 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:39.324200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0184370d-6b88-4b53-9028-78a49f9a32a7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:39.325625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0184370d-6b88-4b53-9028-78a49f9a32a7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:39.344711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0184370d-6b88-4b53-9028-78a49f9a32a7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:39.346951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0184370d-6b88-4b53-9028-78a49f9a32a7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:39.348732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0184370d-6b88-4b53-9028-78a49f9a32a7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:39.349698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0184370d-6b88-4b53-9028-78a49f9a32a7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:39.353463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0184370d-6b88-4b53-9028-78a49f9a32a7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:39.356249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0184370d-6b88-4b53-9028-78a49f9a32a7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:39.531012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fcf5378e-0366-4f35-80a7-af6d2a88169d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:39.541702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fcf5378e-0366-4f35-80a7-af6d2a88169d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:39.548626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fcf5378e-0366-4f35-80a7-af6d2a88169d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:39.550778 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fcf5378e-0366-4f35-80a7-af6d2a88169d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.410289 Oct 27 19:01:39.576239 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1887/3614] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:39 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:39.590834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6e9c1e2a-2e7e-43d5-8847-5332ea87fd80 req-23a597f9-563d-4261-b5f1-57e5b5b23104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-plugged", "status": "completed", "tag": "09a712fe-98b4-4234-9815-ee2620c789f9"}, {"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-plugged", "status": "completed", "tag": "41d0cb52-ad80-4f03-87b2-5cf3ba5d9aa8"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:39.616958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6e9c1e2a-2e7e-43d5-8847-5332ea87fd80 req-23a597f9-563d-4261-b5f1-57e5b5b23104 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:39.618772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6e9c1e2a-2e7e-43d5-8847-5332ea87fd80 req-23a597f9-563d-4261-b5f1-57e5b5b23104 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:39.619486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6e9c1e2a-2e7e-43d5-8847-5332ea87fd80 req-23a597f9-563d-4261-b5f1-57e5b5b23104 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:39.666633 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6e9c1e2a-2e7e-43d5-8847-5332ea87fd80 req-23a597f9-563d-4261-b5f1-57e5b5b23104 service nova] Creating event network-vif-plugged:09a712fe-98b4-4234-9815-ee2620c789f9 for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:01:39.670971 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6e9c1e2a-2e7e-43d5-8847-5332ea87fd80 req-23a597f9-563d-4261-b5f1-57e5b5b23104 service nova] Creating event network-vif-plugged:41d0cb52-ad80-4f03-87b2-5cf3ba5d9aa8 for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:01:39.701181 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6e9c1e2a-2e7e-43d5-8847-5332ea87fd80 req-23a597f9-563d-4261-b5f1-57e5b5b23104 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.122581 Oct 27 19:01:39.705271 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1888/3615] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:39.745809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2bc91f88-5fb2-430d-8f80-4f12dc72c2d4 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:39.750211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2bc91f88-5fb2-430d-8f80-4f12dc72c2d4 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:39.780123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc91f88-5fb2-430d-8f80-4f12dc72c2d4 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:39.783544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc91f88-5fb2-430d-8f80-4f12dc72c2d4 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:39.784993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc91f88-5fb2-430d-8f80-4f12dc72c2d4 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:39.792130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc91f88-5fb2-430d-8f80-4f12dc72c2d4 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:39.792912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc91f88-5fb2-430d-8f80-4f12dc72c2d4 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:39.797191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc91f88-5fb2-430d-8f80-4f12dc72c2d4 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:39.996079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2bc91f88-5fb2-430d-8f80-4f12dc72c2d4 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:40.014451 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2bc91f88-5fb2-430d-8f80-4f12dc72c2d4 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1274 microversion: 2.1 time: 0.296790 Oct 27 19:01:40.017493 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1889/3616] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:39 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1274 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:40.161387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dea8783e-aaa9-41cf-b1cf-1e00ccd1421a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:40.162274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dea8783e-aaa9-41cf-b1cf-1e00ccd1421a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:40.183334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dea8783e-aaa9-41cf-b1cf-1e00ccd1421a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:40.189477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dea8783e-aaa9-41cf-b1cf-1e00ccd1421a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:40.193300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dea8783e-aaa9-41cf-b1cf-1e00ccd1421a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:40.207090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dea8783e-aaa9-41cf-b1cf-1e00ccd1421a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:40.207590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dea8783e-aaa9-41cf-b1cf-1e00ccd1421a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:40.208043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dea8783e-aaa9-41cf-b1cf-1e00ccd1421a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:40.545822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dea8783e-aaa9-41cf-b1cf-1e00ccd1421a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:40.555027 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dea8783e-aaa9-41cf-b1cf-1e00ccd1421a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1366 microversion: 2.1 time: 0.397593 Oct 27 19:01:40.556087 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1890/3617] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:40 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1366 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:01:40.574892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-be2b1ff0-765b-46fa-91fb-7e39b5108704 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:40.575810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-be2b1ff0-765b-46fa-91fb-7e39b5108704 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:40.585841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be2b1ff0-765b-46fa-91fb-7e39b5108704 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:40.593236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be2b1ff0-765b-46fa-91fb-7e39b5108704 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:40.593972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be2b1ff0-765b-46fa-91fb-7e39b5108704 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:40.594975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be2b1ff0-765b-46fa-91fb-7e39b5108704 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:40.595679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be2b1ff0-765b-46fa-91fb-7e39b5108704 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:40.596287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be2b1ff0-765b-46fa-91fb-7e39b5108704 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:40.784456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0184370d-6b88-4b53-9028-78a49f9a32a7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:40.799957 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0184370d-6b88-4b53-9028-78a49f9a32a7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 1.483286 Oct 27 19:01:40.802058 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1728/3618] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:39 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:01:40.816728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0403c192-64e3-4217-99d5-3133fb99e8e5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:40.819984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0403c192-64e3-4217-99d5-3133fb99e8e5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:40.838106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:40.843123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0403c192-64e3-4217-99d5-3133fb99e8e5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:40.845432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0403c192-64e3-4217-99d5-3133fb99e8e5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:40.847038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0403c192-64e3-4217-99d5-3133fb99e8e5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:40.849972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0403c192-64e3-4217-99d5-3133fb99e8e5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:40.850712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0403c192-64e3-4217-99d5-3133fb99e8e5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:40.855801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0403c192-64e3-4217-99d5-3133fb99e8e5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:41.212258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-be2b1ff0-765b-46fa-91fb-7e39b5108704 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:41.235162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-be2b1ff0-765b-46fa-91fb-7e39b5108704 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:41.239891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-be2b1ff0-765b-46fa-91fb-7e39b5108704 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:41.253477 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-be2b1ff0-765b-46fa-91fb-7e39b5108704 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.695903 Oct 27 19:01:41.254369 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1891/3619] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:40 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:41.283839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a642bd00-6acd-41d4-acf2-7c403d691a1b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:41.284840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a642bd00-6acd-41d4-acf2-7c403d691a1b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:41.291965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a642bd00-6acd-41d4-acf2-7c403d691a1b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:41.292724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a642bd00-6acd-41d4-acf2-7c403d691a1b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:41.293650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a642bd00-6acd-41d4-acf2-7c403d691a1b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:41.294838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a642bd00-6acd-41d4-acf2-7c403d691a1b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:41.295882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a642bd00-6acd-41d4-acf2-7c403d691a1b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:41.296498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a642bd00-6acd-41d4-acf2-7c403d691a1b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:41.591070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a642bd00-6acd-41d4-acf2-7c403d691a1b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:41.604110 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a642bd00-6acd-41d4-acf2-7c403d691a1b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1316 microversion: 2.1 time: 0.347324 Oct 27 19:01:41.605101 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1892/3620] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:41 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:41.624677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9f8a854f-78be-4da9-a36e-5441030273ab tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:41.625705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9f8a854f-78be-4da9-a36e-5441030273ab tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:41.644747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f8a854f-78be-4da9-a36e-5441030273ab tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:41.645429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f8a854f-78be-4da9-a36e-5441030273ab tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:41.646044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f8a854f-78be-4da9-a36e-5441030273ab tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:41.647008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f8a854f-78be-4da9-a36e-5441030273ab tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:41.647636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f8a854f-78be-4da9-a36e-5441030273ab tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:41.648256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f8a854f-78be-4da9-a36e-5441030273ab tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:41.776533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0403c192-64e3-4217-99d5-3133fb99e8e5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:41.788875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0403c192-64e3-4217-99d5-3133fb99e8e5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:41.795350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0403c192-64e3-4217-99d5-3133fb99e8e5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:41.796616 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0403c192-64e3-4217-99d5-3133fb99e8e5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1737 microversion: 2.20 time: 0.992495 Oct 27 19:01:41.797198 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1729/3621] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:40 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1737 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:41.803032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-5a3495ef-6d6a-4440-9353-7f7ae7483dfc req-595f08f8-ff6f-4f37-9a2d-92b320c6e0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-plugged", "status": "completed", "tag": "5caa00b6-63fd-476a-9d5a-0faa8aa4baad"}, {"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-plugged", "status": "completed", "tag": "932a9230-1751-47ce-9693-0eddb2a30ee1"}, {"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-plugged", "status": "completed", "tag": "2ab12411-7d95-4e74-8e80-f62b068f58be"}, {"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-plugged", "status": "completed", "tag": "84b5f126-b4b7-4b2f-9238-d2b20b3ec67d"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:41.825253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5a3495ef-6d6a-4440-9353-7f7ae7483dfc req-595f08f8-ff6f-4f37-9a2d-92b320c6e0c1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:41.826059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5a3495ef-6d6a-4440-9353-7f7ae7483dfc req-595f08f8-ff6f-4f37-9a2d-92b320c6e0c1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:41.826995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5a3495ef-6d6a-4440-9353-7f7ae7483dfc req-595f08f8-ff6f-4f37-9a2d-92b320c6e0c1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:41.874745 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5a3495ef-6d6a-4440-9353-7f7ae7483dfc req-595f08f8-ff6f-4f37-9a2d-92b320c6e0c1 service nova] Creating event network-vif-plugged:5caa00b6-63fd-476a-9d5a-0faa8aa4baad for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:01:41.880380 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5a3495ef-6d6a-4440-9353-7f7ae7483dfc req-595f08f8-ff6f-4f37-9a2d-92b320c6e0c1 service nova] Creating event network-vif-plugged:932a9230-1751-47ce-9693-0eddb2a30ee1 for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:01:41.884173 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5a3495ef-6d6a-4440-9353-7f7ae7483dfc req-595f08f8-ff6f-4f37-9a2d-92b320c6e0c1 service nova] Creating event network-vif-plugged:2ab12411-7d95-4e74-8e80-f62b068f58be for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:01:41.885516 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5a3495ef-6d6a-4440-9353-7f7ae7483dfc req-595f08f8-ff6f-4f37-9a2d-92b320c6e0c1 service nova] Creating event network-vif-plugged:84b5f126-b4b7-4b2f-9238-d2b20b3ec67d for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:01:41.901217 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-5a3495ef-6d6a-4440-9353-7f7ae7483dfc req-595f08f8-ff6f-4f37-9a2d-92b320c6e0c1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.101717 Oct 27 19:01:41.902882 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1730/3622] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:41.912980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-be6646cd-2583-4bb0-84d9-3a769e825208 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:41.918610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-be6646cd-2583-4bb0-84d9-3a769e825208 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:41.955177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be6646cd-2583-4bb0-84d9-3a769e825208 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:41.956309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be6646cd-2583-4bb0-84d9-3a769e825208 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:41.956977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be6646cd-2583-4bb0-84d9-3a769e825208 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:41.958326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be6646cd-2583-4bb0-84d9-3a769e825208 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:41.964405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be6646cd-2583-4bb0-84d9-3a769e825208 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:41.964853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9f8a854f-78be-4da9-a36e-5441030273ab tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:41.967300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be6646cd-2583-4bb0-84d9-3a769e825208 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:42.000381 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9f8a854f-78be-4da9-a36e-5441030273ab tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1366 microversion: 2.1 time: 0.393753 Oct 27 19:01:42.013060 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1893/3623] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:41 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1366 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:42.307783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fad5cb10-9311-4c49-93a4-1cc66c7292ef tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:42.308769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fad5cb10-9311-4c49-93a4-1cc66c7292ef tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:42.317716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fad5cb10-9311-4c49-93a4-1cc66c7292ef tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:42.318591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fad5cb10-9311-4c49-93a4-1cc66c7292ef tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:42.319235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fad5cb10-9311-4c49-93a4-1cc66c7292ef tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:42.320231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fad5cb10-9311-4c49-93a4-1cc66c7292ef tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:42.321491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fad5cb10-9311-4c49-93a4-1cc66c7292ef tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:42.322140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fad5cb10-9311-4c49-93a4-1cc66c7292ef tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:42.486095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-be6646cd-2583-4bb0-84d9-3a769e825208 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:42.503119 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-be6646cd-2583-4bb0-84d9-3a769e825208 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.598289 Oct 27 19:01:42.504456 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1731/3624] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:41 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:42.562339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c036d36c-842d-4aaf-956a-81054306a0ea req-043e56e4-653d-4939-8041-f4e10df72d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b227794-9896-4ec9-b8a1-3b1f3cce38c3", "tag": "3d9a6379-167d-4e6c-ac72-73f1bd8e4a6b"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:42.583093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c036d36c-842d-4aaf-956a-81054306a0ea req-043e56e4-653d-4939-8041-f4e10df72d04 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:42.583905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c036d36c-842d-4aaf-956a-81054306a0ea req-043e56e4-653d-4939-8041-f4e10df72d04 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:42.584455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c036d36c-842d-4aaf-956a-81054306a0ea req-043e56e4-653d-4939-8041-f4e10df72d04 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:42.613746 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c036d36c-842d-4aaf-956a-81054306a0ea req-043e56e4-653d-4939-8041-f4e10df72d04 service nova] Creating event network-changed:3d9a6379-167d-4e6c-ac72-73f1bd8e4a6b for instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 on n-h1-860687-3 Oct 27 19:01:42.625121 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c036d36c-842d-4aaf-956a-81054306a0ea req-043e56e4-653d-4939-8041-f4e10df72d04 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068642 Oct 27 19:01:42.626819 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1732/3625] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:01:42.636586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-73b4f482-2447-4ce1-9517-58d4d1c9b2b2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:42.637527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-73b4f482-2447-4ce1-9517-58d4d1c9b2b2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:42.646250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b4f482-2447-4ce1-9517-58d4d1c9b2b2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:42.647011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b4f482-2447-4ce1-9517-58d4d1c9b2b2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:42.647565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b4f482-2447-4ce1-9517-58d4d1c9b2b2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:42.648834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b4f482-2447-4ce1-9517-58d4d1c9b2b2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:42.650634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b4f482-2447-4ce1-9517-58d4d1c9b2b2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:42.651229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73b4f482-2447-4ce1-9517-58d4d1c9b2b2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:42.810735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fad5cb10-9311-4c49-93a4-1cc66c7292ef tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:42.822348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fad5cb10-9311-4c49-93a4-1cc66c7292ef tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:42.824175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fad5cb10-9311-4c49-93a4-1cc66c7292ef tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:42.825583 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fad5cb10-9311-4c49-93a4-1cc66c7292ef tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.539833 Oct 27 19:01:42.842872 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1894/3626] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:42 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:42.851545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-adfc3e4f-4888-422d-b34c-f96b5bf30801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:42.852850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-adfc3e4f-4888-422d-b34c-f96b5bf30801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:42.859619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adfc3e4f-4888-422d-b34c-f96b5bf30801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:42.860345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adfc3e4f-4888-422d-b34c-f96b5bf30801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:42.861037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adfc3e4f-4888-422d-b34c-f96b5bf30801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:42.861933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adfc3e4f-4888-422d-b34c-f96b5bf30801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:42.862604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adfc3e4f-4888-422d-b34c-f96b5bf30801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:42.863236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adfc3e4f-4888-422d-b34c-f96b5bf30801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:43.081860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-73b4f482-2447-4ce1-9517-58d4d1c9b2b2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:43.096735 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-73b4f482-2447-4ce1-9517-58d4d1c9b2b2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1316 microversion: 2.1 time: 0.468294 Oct 27 19:01:43.097606 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1733/3627] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:42 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1316 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:43.110900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-53d3b588-a340-4ba5-a603-11594983edac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:43.111796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-53d3b588-a340-4ba5-a603-11594983edac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:43.125156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53d3b588-a340-4ba5-a603-11594983edac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:43.125933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53d3b588-a340-4ba5-a603-11594983edac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:43.126599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53d3b588-a340-4ba5-a603-11594983edac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:43.127493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53d3b588-a340-4ba5-a603-11594983edac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:43.128181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53d3b588-a340-4ba5-a603-11594983edac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:43.128795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53d3b588-a340-4ba5-a603-11594983edac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:43.535031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-adfc3e4f-4888-422d-b34c-f96b5bf30801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:43.544491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-adfc3e4f-4888-422d-b34c-f96b5bf30801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:43.553761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-adfc3e4f-4888-422d-b34c-f96b5bf30801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:43.557619 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-adfc3e4f-4888-422d-b34c-f96b5bf30801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1719 microversion: 2.20 time: 0.713273 Oct 27 19:01:43.573264 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1895/3628] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:42 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1719 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:43.586077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b5447321-bd4e-49ba-9342-2ed7117ae9f4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:43.586998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b5447321-bd4e-49ba-9342-2ed7117ae9f4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:43.594454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5447321-bd4e-49ba-9342-2ed7117ae9f4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:43.594971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5447321-bd4e-49ba-9342-2ed7117ae9f4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:43.595421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5447321-bd4e-49ba-9342-2ed7117ae9f4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:43.596149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5447321-bd4e-49ba-9342-2ed7117ae9f4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:43.596613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5447321-bd4e-49ba-9342-2ed7117ae9f4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:43.597050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5447321-bd4e-49ba-9342-2ed7117ae9f4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:43.879024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-53d3b588-a340-4ba5-a603-11594983edac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:43.889206 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-53d3b588-a340-4ba5-a603-11594983edac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1366 microversion: 2.1 time: 0.790240 Oct 27 19:01:43.890287 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1734/3629] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:43 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1366 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:43.900991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b6d594ac-3d95-4db9-b521-a236b8b6c651 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:43.901968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b6d594ac-3d95-4db9-b521-a236b8b6c651 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:43.908943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6d594ac-3d95-4db9-b521-a236b8b6c651 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:43.909797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6d594ac-3d95-4db9-b521-a236b8b6c651 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:43.910817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6d594ac-3d95-4db9-b521-a236b8b6c651 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:43.911720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6d594ac-3d95-4db9-b521-a236b8b6c651 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:43.912357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6d594ac-3d95-4db9-b521-a236b8b6c651 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:43.912962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6d594ac-3d95-4db9-b521-a236b8b6c651 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:44.115579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b5447321-bd4e-49ba-9342-2ed7117ae9f4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:44.129713 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b5447321-bd4e-49ba-9342-2ed7117ae9f4 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.552761 Oct 27 19:01:44.130325 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1896/3630] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:43 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:44.136526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-59107892-175e-46bf-b3e4-39de097972c2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:44.137142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-59107892-175e-46bf-b3e4-39de097972c2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:44.159912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59107892-175e-46bf-b3e4-39de097972c2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:44.160415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59107892-175e-46bf-b3e4-39de097972c2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:44.160863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59107892-175e-46bf-b3e4-39de097972c2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:44.161578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59107892-175e-46bf-b3e4-39de097972c2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:44.162039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59107892-175e-46bf-b3e4-39de097972c2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:44.162501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-59107892-175e-46bf-b3e4-39de097972c2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:44.214617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6d594ac-3d95-4db9-b521-a236b8b6c651 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:44.233064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6d594ac-3d95-4db9-b521-a236b8b6c651 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:44.234991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6d594ac-3d95-4db9-b521-a236b8b6c651 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:44.236671 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b6d594ac-3d95-4db9-b521-a236b8b6c651 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1875 microversion: 2.42 time: 0.345397 Oct 27 19:01:44.238042 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1735/3631] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:43 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1875 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:44.529175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-59107892-175e-46bf-b3e4-39de097972c2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:44.546298 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-59107892-175e-46bf-b3e4-39de097972c2 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1316 microversion: 2.1 time: 0.413959 Oct 27 19:01:44.547547 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1897/3632] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:44 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1316 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:44.588342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-98aaec69-3214-4aa8-aa38-82cc668c8913 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:44.589561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-98aaec69-3214-4aa8-aa38-82cc668c8913 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:44.596782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98aaec69-3214-4aa8-aa38-82cc668c8913 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:44.597836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98aaec69-3214-4aa8-aa38-82cc668c8913 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:44.598299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98aaec69-3214-4aa8-aa38-82cc668c8913 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:44.599049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98aaec69-3214-4aa8-aa38-82cc668c8913 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:44.599519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98aaec69-3214-4aa8-aa38-82cc668c8913 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:44.599961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98aaec69-3214-4aa8-aa38-82cc668c8913 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:44.672720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e712e268-de2f-4241-9f03-d0a313bf205d req-a68bd562-8e24-4001-8043-e954de2bd00f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce1ae62-f242-46bb-a382-24da7cd449ab", "tag": "9a97ad41-b667-46fe-9eff-7cf3a35d64d1"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:44.691524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e712e268-de2f-4241-9f03-d0a313bf205d req-a68bd562-8e24-4001-8043-e954de2bd00f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:44.693055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e712e268-de2f-4241-9f03-d0a313bf205d req-a68bd562-8e24-4001-8043-e954de2bd00f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:44.693578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e712e268-de2f-4241-9f03-d0a313bf205d req-a68bd562-8e24-4001-8043-e954de2bd00f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:44.718559 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e712e268-de2f-4241-9f03-d0a313bf205d req-a68bd562-8e24-4001-8043-e954de2bd00f service nova] Creating event network-changed:9a97ad41-b667-46fe-9eff-7cf3a35d64d1 for instance 0ce1ae62-f242-46bb-a382-24da7cd449ab on n-h1-860687-3 Oct 27 19:01:44.724435 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e712e268-de2f-4241-9f03-d0a313bf205d req-a68bd562-8e24-4001-8043-e954de2bd00f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063223 Oct 27 19:01:44.725275 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1898/3633] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:01:44.846262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-98aaec69-3214-4aa8-aa38-82cc668c8913 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:44.877610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-98aaec69-3214-4aa8-aa38-82cc668c8913 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:44.887962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-98aaec69-3214-4aa8-aa38-82cc668c8913 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:44.889846 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-98aaec69-3214-4aa8-aa38-82cc668c8913 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1719 microversion: 2.20 time: 0.305546 Oct 27 19:01:44.905736 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1736/3634] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:44 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1719 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:44.917237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a117bc24-f743-47e0-81c4-08add2c6106d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:44.917382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a117bc24-f743-47e0-81c4-08add2c6106d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:44.927535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:44.932087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a117bc24-f743-47e0-81c4-08add2c6106d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:44.935888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a117bc24-f743-47e0-81c4-08add2c6106d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:44.936542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a117bc24-f743-47e0-81c4-08add2c6106d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:44.937481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a117bc24-f743-47e0-81c4-08add2c6106d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:44.943352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a117bc24-f743-47e0-81c4-08add2c6106d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:44.944072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a117bc24-f743-47e0-81c4-08add2c6106d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:45.004137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:45.153503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1ac75f2b-4636-4a8c-a7af-7af7034f9cf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:45.154235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1ac75f2b-4636-4a8c-a7af-7af7034f9cf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:45.163675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ac75f2b-4636-4a8c-a7af-7af7034f9cf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:45.164184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ac75f2b-4636-4a8c-a7af-7af7034f9cf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:45.164672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ac75f2b-4636-4a8c-a7af-7af7034f9cf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:45.165394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ac75f2b-4636-4a8c-a7af-7af7034f9cf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:45.174128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ac75f2b-4636-4a8c-a7af-7af7034f9cf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:45.174811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ac75f2b-4636-4a8c-a7af-7af7034f9cf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:45.453100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a117bc24-f743-47e0-81c4-08add2c6106d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:45.462029 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a117bc24-f743-47e0-81c4-08add2c6106d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1366 microversion: 2.1 time: 0.550814 Oct 27 19:01:45.467654 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1899/3635] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:44 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1366 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:45.472633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-06d2114e-64e8-4444-a880-ca1dc3b3ef87 req-08ecc244-5a72-4a62-b409-202b5a514ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a7713a-b78d-425e-a6e8-0e4f5bc8904b", "name": "network-vif-unplugged", "status": "completed", "tag": "9f402fdb-d277-4b7a-b6cc-275f32214caf"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:45.498341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-06d2114e-64e8-4444-a880-ca1dc3b3ef87 req-08ecc244-5a72-4a62-b409-202b5a514ab6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:45.499186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-06d2114e-64e8-4444-a880-ca1dc3b3ef87 req-08ecc244-5a72-4a62-b409-202b5a514ab6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:45.499856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-06d2114e-64e8-4444-a880-ca1dc3b3ef87 req-08ecc244-5a72-4a62-b409-202b5a514ab6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:45.514034 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-06d2114e-64e8-4444-a880-ca1dc3b3ef87 req-08ecc244-5a72-4a62-b409-202b5a514ab6 service nova] Creating event network-vif-unplugged:9f402fdb-d277-4b7a-b6cc-275f32214caf for instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b on n-h1-860687-3 Oct 27 19:01:45.519741 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-06d2114e-64e8-4444-a880-ca1dc3b3ef87 req-08ecc244-5a72-4a62-b409-202b5a514ab6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050616 Oct 27 19:01:45.520536 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1900/3636] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:45.526763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d2567a3b-7152-4e32-ae9b-cffec61137fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:45.527473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d2567a3b-7152-4e32-ae9b-cffec61137fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:45.534182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2567a3b-7152-4e32-ae9b-cffec61137fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:45.534707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2567a3b-7152-4e32-ae9b-cffec61137fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:45.535337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2567a3b-7152-4e32-ae9b-cffec61137fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:45.536222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2567a3b-7152-4e32-ae9b-cffec61137fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:45.536852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2567a3b-7152-4e32-ae9b-cffec61137fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:45.537449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2567a3b-7152-4e32-ae9b-cffec61137fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:45.647317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1ac75f2b-4636-4a8c-a7af-7af7034f9cf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:45.660553 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1ac75f2b-4636-4a8c-a7af-7af7034f9cf7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.510911 Oct 27 19:01:45.665630 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1737/3637] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:45 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:01:45.691454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd6b26ec-7746-429d-8b04-c5c01136e44e tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:45.692487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bd6b26ec-7746-429d-8b04-c5c01136e44e tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:45.707649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd6b26ec-7746-429d-8b04-c5c01136e44e tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:45.711032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd6b26ec-7746-429d-8b04-c5c01136e44e tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:45.712883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd6b26ec-7746-429d-8b04-c5c01136e44e tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:45.714116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd6b26ec-7746-429d-8b04-c5c01136e44e tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:45.716210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd6b26ec-7746-429d-8b04-c5c01136e44e tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:45.717781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd6b26ec-7746-429d-8b04-c5c01136e44e tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:46.116208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bd6b26ec-7746-429d-8b04-c5c01136e44e tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:46.132043 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bd6b26ec-7746-429d-8b04-c5c01136e44e tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1316 microversion: 2.1 time: 0.464634 Oct 27 19:01:46.140370 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1738/3638] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:45 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:46.152961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f9697c46-1cc1-44b5-9e30-5bc6f71a71df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:46.155196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f9697c46-1cc1-44b5-9e30-5bc6f71a71df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:46.168273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9697c46-1cc1-44b5-9e30-5bc6f71a71df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:46.169531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9697c46-1cc1-44b5-9e30-5bc6f71a71df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:46.170306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9697c46-1cc1-44b5-9e30-5bc6f71a71df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:46.171260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9697c46-1cc1-44b5-9e30-5bc6f71a71df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:46.171724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9697c46-1cc1-44b5-9e30-5bc6f71a71df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:46.172155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9697c46-1cc1-44b5-9e30-5bc6f71a71df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:46.202037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d2567a3b-7152-4e32-ae9b-cffec61137fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:46.228376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d2567a3b-7152-4e32-ae9b-cffec61137fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:46.242451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d2567a3b-7152-4e32-ae9b-cffec61137fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:46.246954 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d2567a3b-7152-4e32-ae9b-cffec61137fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2832 microversion: 2.42 time: 0.725256 Oct 27 19:01:46.250684 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1901/3639] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:45 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2832 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:46.283349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-502621f0-e877-4a69-a235-66513c23b88e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:46.283868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-502621f0-e877-4a69-a235-66513c23b88e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:46.298052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-502621f0-e877-4a69-a235-66513c23b88e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:46.299367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-502621f0-e877-4a69-a235-66513c23b88e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:46.300011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-502621f0-e877-4a69-a235-66513c23b88e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:46.301483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-502621f0-e877-4a69-a235-66513c23b88e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:46.302614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-502621f0-e877-4a69-a235-66513c23b88e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:46.303505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-502621f0-e877-4a69-a235-66513c23b88e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:46.324400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f9697c46-1cc1-44b5-9e30-5bc6f71a71df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:46.335077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f9697c46-1cc1-44b5-9e30-5bc6f71a71df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:46.336979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f9697c46-1cc1-44b5-9e30-5bc6f71a71df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:46.338334 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f9697c46-1cc1-44b5-9e30-5bc6f71a71df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1719 microversion: 2.20 time: 0.196456 Oct 27 19:01:46.343340 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1739/3640] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:46 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1719 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:46.493690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-64a5b202-3990-41ec-9ad1-22cd082349a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:46.494556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-64a5b202-3990-41ec-9ad1-22cd082349a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:46.501338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64a5b202-3990-41ec-9ad1-22cd082349a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:46.502202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64a5b202-3990-41ec-9ad1-22cd082349a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:46.502857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64a5b202-3990-41ec-9ad1-22cd082349a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:46.505765 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-502621f0-e877-4a69-a235-66513c23b88e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.230754 Oct 27 19:01:46.507236 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1902/3641] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Oct 27 19:01:46 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b/os-interface => generated 1831 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:01:46.509194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64a5b202-3990-41ec-9ad1-22cd082349a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:46.509872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64a5b202-3990-41ec-9ad1-22cd082349a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:46.510525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64a5b202-3990-41ec-9ad1-22cd082349a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:46.686234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-24ee8e21-e33a-45ab-ab4e-80eb72c309aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:46.687130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-24ee8e21-e33a-45ab-ab4e-80eb72c309aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:46.696726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ee8e21-e33a-45ab-ab4e-80eb72c309aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:46.697238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ee8e21-e33a-45ab-ab4e-80eb72c309aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:46.697681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ee8e21-e33a-45ab-ab4e-80eb72c309aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:46.698410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ee8e21-e33a-45ab-ab4e-80eb72c309aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:46.698870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ee8e21-e33a-45ab-ab4e-80eb72c309aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:46.707366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ee8e21-e33a-45ab-ab4e-80eb72c309aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:46.796318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-64a5b202-3990-41ec-9ad1-22cd082349a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:46.809014 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-64a5b202-3990-41ec-9ad1-22cd082349a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1366 microversion: 2.1 time: 0.320992 Oct 27 19:01:46.810998 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1740/3642] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:46 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:01:46.976142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-24ee8e21-e33a-45ab-ab4e-80eb72c309aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:46.990268 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-24ee8e21-e33a-45ab-ab4e-80eb72c309aa tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.307808 Oct 27 19:01:46.994651 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1903/3643] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:46 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:01:47.160157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b8e0f38b-c7bd-43f3-9845-5aab7229409a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:47.161207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b8e0f38b-c7bd-43f3-9845-5aab7229409a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:47.170200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=14 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:47.174670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8e0f38b-c7bd-43f3-9845-5aab7229409a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:47.176208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8e0f38b-c7bd-43f3-9845-5aab7229409a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:47.176878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8e0f38b-c7bd-43f3-9845-5aab7229409a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:47.178768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8e0f38b-c7bd-43f3-9845-5aab7229409a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:47.179500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8e0f38b-c7bd-43f3-9845-5aab7229409a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:47.181389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8e0f38b-c7bd-43f3-9845-5aab7229409a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:47.376167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-abc50819-9ffd-4807-8af7-12ff021c18d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:47.377378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-abc50819-9ffd-4807-8af7-12ff021c18d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:47.388331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abc50819-9ffd-4807-8af7-12ff021c18d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:47.389189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abc50819-9ffd-4807-8af7-12ff021c18d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:47.391110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abc50819-9ffd-4807-8af7-12ff021c18d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:47.392634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abc50819-9ffd-4807-8af7-12ff021c18d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:47.393976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abc50819-9ffd-4807-8af7-12ff021c18d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:47.400863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abc50819-9ffd-4807-8af7-12ff021c18d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:47.649929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b8e0f38b-c7bd-43f3-9845-5aab7229409a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:47.658031 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b8e0f38b-c7bd-43f3-9845-5aab7229409a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1316 microversion: 2.1 time: 0.503339 Oct 27 19:01:47.658966 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1741/3644] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:47 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:47.699803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-abc50819-9ffd-4807-8af7-12ff021c18d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:47.706325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:47.710203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-abc50819-9ffd-4807-8af7-12ff021c18d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:47.712225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-abc50819-9ffd-4807-8af7-12ff021c18d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:47.713641 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-abc50819-9ffd-4807-8af7-12ff021c18d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1722 microversion: 2.20 time: 0.343359 Oct 27 19:01:47.722792 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1904/3645] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:47 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:01:47.740546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f9cc350a-533c-47b1-9133-73836ab543a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1f8ee7a-0ff3-45c8-9c0c-61cb6fc84d5e"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:47.743973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f9cc350a-533c-47b1-9133-73836ab543a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:47.755923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9cc350a-533c-47b1-9133-73836ab543a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:47.756490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-7c00593e-8cde-4d72-8fee-c9809e8d0a23 req-e1f549db-9833-4f84-ad40-5c3890f19916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b227794-9896-4ec9-b8a1-3b1f3cce38c3", "name": "network-vif-plugged", "status": "completed", "tag": "3d9a6379-167d-4e6c-ac72-73f1bd8e4a6b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:47.760554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9cc350a-533c-47b1-9133-73836ab543a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:47.761689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9cc350a-533c-47b1-9133-73836ab543a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:47.762692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9cc350a-533c-47b1-9133-73836ab543a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:47.763450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9cc350a-533c-47b1-9133-73836ab543a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:47.764078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9cc350a-533c-47b1-9133-73836ab543a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:47.779820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7c00593e-8cde-4d72-8fee-c9809e8d0a23 req-e1f549db-9833-4f84-ad40-5c3890f19916 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:47.787654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7c00593e-8cde-4d72-8fee-c9809e8d0a23 req-e1f549db-9833-4f84-ad40-5c3890f19916 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:47.788370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7c00593e-8cde-4d72-8fee-c9809e8d0a23 req-e1f549db-9833-4f84-ad40-5c3890f19916 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:47.817440 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-7c00593e-8cde-4d72-8fee-c9809e8d0a23 req-e1f549db-9833-4f84-ad40-5c3890f19916 service nova] Creating event network-vif-plugged:3d9a6379-167d-4e6c-ac72-73f1bd8e4a6b for instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 on n-h1-860687-3 Oct 27 19:01:47.826362 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-7c00593e-8cde-4d72-8fee-c9809e8d0a23 req-e1f549db-9833-4f84-ad40-5c3890f19916 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079149 Oct 27 19:01:47.831585 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1905/3646] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:47.837751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f2028b28-dd2c-470a-98fe-6ef145c305a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:47.868653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f2028b28-dd2c-470a-98fe-6ef145c305a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:47.881405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2028b28-dd2c-470a-98fe-6ef145c305a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:47.882172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2028b28-dd2c-470a-98fe-6ef145c305a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:47.884594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2028b28-dd2c-470a-98fe-6ef145c305a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:47.889045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2028b28-dd2c-470a-98fe-6ef145c305a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:47.891145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2028b28-dd2c-470a-98fe-6ef145c305a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:47.891858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2028b28-dd2c-470a-98fe-6ef145c305a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:48.318257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f2028b28-dd2c-470a-98fe-6ef145c305a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:48.330848 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f2028b28-dd2c-470a-98fe-6ef145c305a4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1366 microversion: 2.1 time: 0.497128 Oct 27 19:01:48.334180 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1906/3647] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:47 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:48.345777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-968d3c3d-97c8-4dc9-8f0b-9f4846e9fa3b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:48.346542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-968d3c3d-97c8-4dc9-8f0b-9f4846e9fa3b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:48.358619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:48.364889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968d3c3d-97c8-4dc9-8f0b-9f4846e9fa3b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:48.366688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968d3c3d-97c8-4dc9-8f0b-9f4846e9fa3b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:48.368548 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f9cc350a-533c-47b1-9133-73836ab543a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "POST /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.628585 Oct 27 19:01:48.369463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968d3c3d-97c8-4dc9-8f0b-9f4846e9fa3b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:48.371041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968d3c3d-97c8-4dc9-8f0b-9f4846e9fa3b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:48.372064 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1742/3648] 10.222.0.42 () {62 vars in 1364 bytes} [Thu Oct 27 19:01:47 2022] POST /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments => generated 188 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:01:48.377051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968d3c3d-97c8-4dc9-8f0b-9f4846e9fa3b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:48.378921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-968d3c3d-97c8-4dc9-8f0b-9f4846e9fa3b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:48.574693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4909bb4d-5599-4bca-921a-35c2123c441c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:48.575175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4909bb4d-5599-4bca-921a-35c2123c441c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:48.592324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4909bb4d-5599-4bca-921a-35c2123c441c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:48.593222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4909bb4d-5599-4bca-921a-35c2123c441c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:48.594484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4909bb4d-5599-4bca-921a-35c2123c441c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:48.595495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4909bb4d-5599-4bca-921a-35c2123c441c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:48.596208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4909bb4d-5599-4bca-921a-35c2123c441c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:48.597336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4909bb4d-5599-4bca-921a-35c2123c441c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:48.674920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4909bb4d-5599-4bca-921a-35c2123c441c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127028) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 19:01:48.809334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-968d3c3d-97c8-4dc9-8f0b-9f4846e9fa3b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:48.820735 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-968d3c3d-97c8-4dc9-8f0b-9f4846e9fa3b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1392 microversion: 2.1 time: 0.484919 Oct 27 19:01:48.831174 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1907/3649] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:48 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1392 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:48.844940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3ea89e3c-4a62-4a9c-8797-ee2f85d2e5c9 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:48.845938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3ea89e3c-4a62-4a9c-8797-ee2f85d2e5c9 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:48.853312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ea89e3c-4a62-4a9c-8797-ee2f85d2e5c9 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:48.854334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ea89e3c-4a62-4a9c-8797-ee2f85d2e5c9 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:48.855157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ea89e3c-4a62-4a9c-8797-ee2f85d2e5c9 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:48.856173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ea89e3c-4a62-4a9c-8797-ee2f85d2e5c9 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:48.857099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ea89e3c-4a62-4a9c-8797-ee2f85d2e5c9 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:48.857852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ea89e3c-4a62-4a9c-8797-ee2f85d2e5c9 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:48.914992 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4909bb4d-5599-4bca-921a-35c2123c441c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "POST /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/action" status: 202 len: 0 microversion: 2.20 time: 0.352255 Oct 27 19:01:48.916507 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1743/3650] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 19:01:48 2022] POST /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:01:48.942929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9cf63157-b266-498e-858a-769496bd16d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:48.944012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9cf63157-b266-498e-858a-769496bd16d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:48.952454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cf63157-b266-498e-858a-769496bd16d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:48.957128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cf63157-b266-498e-858a-769496bd16d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:48.957937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cf63157-b266-498e-858a-769496bd16d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:48.958985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cf63157-b266-498e-858a-769496bd16d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:48.959694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cf63157-b266-498e-858a-769496bd16d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:48.960640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cf63157-b266-498e-858a-769496bd16d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:49.210511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9cf63157-b266-498e-858a-769496bd16d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:49.228360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9cf63157-b266-498e-858a-769496bd16d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:49.232844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9cf63157-b266-498e-858a-769496bd16d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:49.235373 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9cf63157-b266-498e-858a-769496bd16d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1748 microversion: 2.20 time: 0.303962 Oct 27 19:01:49.236538 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1744/3651] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:48 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1748 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:49.367449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ef653bb0-f686-4056-84af-cf06240c037c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:49.369407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ef653bb0-f686-4056-84af-cf06240c037c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:49.383045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef653bb0-f686-4056-84af-cf06240c037c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:49.384701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef653bb0-f686-4056-84af-cf06240c037c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:49.385399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef653bb0-f686-4056-84af-cf06240c037c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:49.386853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef653bb0-f686-4056-84af-cf06240c037c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:49.389049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef653bb0-f686-4056-84af-cf06240c037c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:49.389719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef653bb0-f686-4056-84af-cf06240c037c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:49.547637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3ea89e3c-4a62-4a9c-8797-ee2f85d2e5c9 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:49.580050 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3ea89e3c-4a62-4a9c-8797-ee2f85d2e5c9 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1316 microversion: 2.1 time: 0.745116 Oct 27 19:01:49.581816 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1908/3652] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:48 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1316 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:49.604625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-134d49db-a03a-497b-a339-5c82735b3e90 req-c2ef2b8d-8537-4f07-9d1f-38f6ece43a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "tag": "09a712fe-98b4-4234-9815-ee2620c789f9"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:49.613083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ef653bb0-f686-4056-84af-cf06240c037c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:49.624561 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ef653bb0-f686-4056-84af-cf06240c037c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1366 microversion: 2.1 time: 0.268123 Oct 27 19:01:49.629385 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1745/3653] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:49 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:49.635372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-134d49db-a03a-497b-a339-5c82735b3e90 req-c2ef2b8d-8537-4f07-9d1f-38f6ece43a5e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:49.635946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-134d49db-a03a-497b-a339-5c82735b3e90 req-c2ef2b8d-8537-4f07-9d1f-38f6ece43a5e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:49.636477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-134d49db-a03a-497b-a339-5c82735b3e90 req-c2ef2b8d-8537-4f07-9d1f-38f6ece43a5e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:49.667874 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-134d49db-a03a-497b-a339-5c82735b3e90 req-c2ef2b8d-8537-4f07-9d1f-38f6ece43a5e service nova] Creating event network-changed:09a712fe-98b4-4234-9815-ee2620c789f9 for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:01:49.674710 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-134d49db-a03a-497b-a339-5c82735b3e90 req-c2ef2b8d-8537-4f07-9d1f-38f6ece43a5e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090081 Oct 27 19:01:49.675971 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1909/3654] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:49.850898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-27676c8b-e2e5-4aa8-8c43-095f9f5330fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:49.851593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-27676c8b-e2e5-4aa8-8c43-095f9f5330fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:49.873547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27676c8b-e2e5-4aa8-8c43-095f9f5330fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:49.874065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27676c8b-e2e5-4aa8-8c43-095f9f5330fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:49.877667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27676c8b-e2e5-4aa8-8c43-095f9f5330fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:49.878654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27676c8b-e2e5-4aa8-8c43-095f9f5330fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:49.879303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27676c8b-e2e5-4aa8-8c43-095f9f5330fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:49.880438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27676c8b-e2e5-4aa8-8c43-095f9f5330fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:50.163897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-27676c8b-e2e5-4aa8-8c43-095f9f5330fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:50.177324 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-27676c8b-e2e5-4aa8-8c43-095f9f5330fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1382 microversion: 2.1 time: 0.331324 Oct 27 19:01:50.178465 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1746/3655] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:49 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1382 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:50.203004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aa65a42d-5609-4520-a809-544c865b7180 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '.version_select at 0x7fc86a092a60>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:50.207383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa65a42d-5609-4520-a809-544c865b7180 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:50.215215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa65a42d-5609-4520-a809-544c865b7180 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:50.216562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa65a42d-5609-4520-a809-544c865b7180 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:50.241469 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aa65a42d-5609-4520-a809-544c865b7180 tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.042505 Oct 27 19:01:50.243377 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1910/3656] 10.222.0.42 () {58 vars in 1143 bytes} [Thu Oct 27 19:01:50 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:50.258950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7e6b044f-51f7-4281-a9cd-68c7e34d3fcf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:50.259675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7e6b044f-51f7-4281-a9cd-68c7e34d3fcf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:50.268456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e6b044f-51f7-4281-a9cd-68c7e34d3fcf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:50.268647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0083e9a3-8c6b-4df8-b44f-96897fb885b1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:50.268972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e6b044f-51f7-4281-a9cd-68c7e34d3fcf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:50.269380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0083e9a3-8c6b-4df8-b44f-96897fb885b1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:50.269595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e6b044f-51f7-4281-a9cd-68c7e34d3fcf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:50.275085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e6b044f-51f7-4281-a9cd-68c7e34d3fcf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:50.275660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e6b044f-51f7-4281-a9cd-68c7e34d3fcf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:50.276116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e6b044f-51f7-4281-a9cd-68c7e34d3fcf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:50.277619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0083e9a3-8c6b-4df8-b44f-96897fb885b1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:50.278184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0083e9a3-8c6b-4df8-b44f-96897fb885b1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:50.279322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0083e9a3-8c6b-4df8-b44f-96897fb885b1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:50.282416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0083e9a3-8c6b-4df8-b44f-96897fb885b1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:50.283156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0083e9a3-8c6b-4df8-b44f-96897fb885b1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:50.283771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0083e9a3-8c6b-4df8-b44f-96897fb885b1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:50.641891 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7e6b044f-51f7-4281-a9cd-68c7e34d3fcf tempest-LiveMigrationTest-724670286 tempest-LiveMigrationTest-724670286-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1533 microversion: 2.1 time: 0.387066 Oct 27 19:01:50.654900 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1747/3657] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:50 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1533 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:50.654900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d4667e56-ca85-48f1-818a-a7ce02a2cecc tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:50.654900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d4667e56-ca85-48f1-818a-a7ce02a2cecc tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:50.679084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d4667e56-ca85-48f1-818a-a7ce02a2cecc tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:50.679743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d4667e56-ca85-48f1-818a-a7ce02a2cecc tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:50.680883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d4667e56-ca85-48f1-818a-a7ce02a2cecc tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:50.682109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d4667e56-ca85-48f1-818a-a7ce02a2cecc tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:50.683160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d4667e56-ca85-48f1-818a-a7ce02a2cecc tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:50.684099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d4667e56-ca85-48f1-818a-a7ce02a2cecc tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:51.003778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0083e9a3-8c6b-4df8-b44f-96897fb885b1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:51.033044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0083e9a3-8c6b-4df8-b44f-96897fb885b1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:51.042817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0083e9a3-8c6b-4df8-b44f-96897fb885b1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:51.044538 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0083e9a3-8c6b-4df8-b44f-96897fb885b1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1748 microversion: 2.20 time: 0.780067 Oct 27 19:01:51.050797 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1911/3658] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:50 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1748 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:51.068176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0f91d5e6-f3fa-4ac6-a08f-3a37de7ef004 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:51.076341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0f91d5e6-f3fa-4ac6-a08f-3a37de7ef004 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:51.106614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f91d5e6-f3fa-4ac6-a08f-3a37de7ef004 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:51.108192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f91d5e6-f3fa-4ac6-a08f-3a37de7ef004 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:51.109581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f91d5e6-f3fa-4ac6-a08f-3a37de7ef004 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:51.112750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f91d5e6-f3fa-4ac6-a08f-3a37de7ef004 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:51.114275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f91d5e6-f3fa-4ac6-a08f-3a37de7ef004 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:51.115586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f91d5e6-f3fa-4ac6-a08f-3a37de7ef004 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:51.302615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d4667e56-ca85-48f1-818a-a7ce02a2cecc tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:51.317656 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d4667e56-ca85-48f1-818a-a7ce02a2cecc tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1316 microversion: 2.1 time: 0.669343 Oct 27 19:01:51.334651 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1748/3659] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:50 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1316 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:51.344268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-538481d3-27d1-4c04-a165-a0d7076de8fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:51.345298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-538481d3-27d1-4c04-a165-a0d7076de8fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:51.378134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-538481d3-27d1-4c04-a165-a0d7076de8fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:51.378707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-538481d3-27d1-4c04-a165-a0d7076de8fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:51.380968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-538481d3-27d1-4c04-a165-a0d7076de8fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:51.382505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-538481d3-27d1-4c04-a165-a0d7076de8fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:51.386378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-538481d3-27d1-4c04-a165-a0d7076de8fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:51.387794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-538481d3-27d1-4c04-a165-a0d7076de8fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:51.433008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-538481d3-27d1-4c04-a165-a0d7076de8fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:01:51.575263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0f91d5e6-f3fa-4ac6-a08f-3a37de7ef004 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:51.599052 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0f91d5e6-f3fa-4ac6-a08f-3a37de7ef004 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1556 microversion: 2.1 time: 0.542693 Oct 27 19:01:51.604354 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1912/3660] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:51 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1556 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:51.630725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-00a5183d-69e0-4475-b1db-c17841eaf662 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:51.646970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-00a5183d-69e0-4475-b1db-c17841eaf662 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:51.698010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00a5183d-69e0-4475-b1db-c17841eaf662 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:51.698575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00a5183d-69e0-4475-b1db-c17841eaf662 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:51.699033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00a5183d-69e0-4475-b1db-c17841eaf662 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:51.709714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00a5183d-69e0-4475-b1db-c17841eaf662 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:51.710305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00a5183d-69e0-4475-b1db-c17841eaf662 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:51.715590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00a5183d-69e0-4475-b1db-c17841eaf662 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:51.748121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:51.759348 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-538481d3-27d1-4c04-a165-a0d7076de8fc tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "DELETE /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 204 len: 0 microversion: 2.1 time: 0.418911 Oct 27 19:01:51.765829 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1749/3661] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:01:51 2022] DELETE /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:01:51.795983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a118c105-cda0-4487-b9a4-11a138d8c560 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:51.797932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a118c105-cda0-4487-b9a4-11a138d8c560 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:51.817393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a118c105-cda0-4487-b9a4-11a138d8c560 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:51.818207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a118c105-cda0-4487-b9a4-11a138d8c560 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:51.819525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a118c105-cda0-4487-b9a4-11a138d8c560 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:51.823644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a118c105-cda0-4487-b9a4-11a138d8c560 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:51.825047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a118c105-cda0-4487-b9a4-11a138d8c560 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:51.826973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a118c105-cda0-4487-b9a4-11a138d8c560 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:51.936561 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-00a5183d-69e0-4475-b1db-c17841eaf662 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.309778 Oct 27 19:01:51.938198 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1913/3662] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:01:51 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3/os-interface => generated 284 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:52.088569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2fab205a-0600-4660-8c33-fb02514c1d04 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:52.089729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2fab205a-0600-4660-8c33-fb02514c1d04 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:52.099893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fab205a-0600-4660-8c33-fb02514c1d04 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:52.100817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fab205a-0600-4660-8c33-fb02514c1d04 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:52.101496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fab205a-0600-4660-8c33-fb02514c1d04 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:52.103375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fab205a-0600-4660-8c33-fb02514c1d04 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:52.104220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fab205a-0600-4660-8c33-fb02514c1d04 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:52.104959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fab205a-0600-4660-8c33-fb02514c1d04 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:52.561255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2fab205a-0600-4660-8c33-fb02514c1d04 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:52.583547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2fab205a-0600-4660-8c33-fb02514c1d04 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:52.602043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2fab205a-0600-4660-8c33-fb02514c1d04 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:52.608200 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2fab205a-0600-4660-8c33-fb02514c1d04 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1750 microversion: 2.20 time: 0.526595 Oct 27 19:01:52.628875 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1914/3663] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:52 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1750 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:01:52.634117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-44d0093d-266d-45bf-88fd-45bb78836d69 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:52.657655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-44d0093d-266d-45bf-88fd-45bb78836d69 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:52.686615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44d0093d-266d-45bf-88fd-45bb78836d69 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:52.695169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44d0093d-266d-45bf-88fd-45bb78836d69 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:52.695867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44d0093d-266d-45bf-88fd-45bb78836d69 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:52.696836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44d0093d-266d-45bf-88fd-45bb78836d69 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:52.705251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44d0093d-266d-45bf-88fd-45bb78836d69 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:52.705843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44d0093d-266d-45bf-88fd-45bb78836d69 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:53.072874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a118c105-cda0-4487-b9a4-11a138d8c560 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:53.091116 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a118c105-cda0-4487-b9a4-11a138d8c560 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1388 microversion: 2.1 time: 1.317308 Oct 27 19:01:53.099799 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1750/3664] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:51 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1388 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:53.447158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-8774fc42-59f3-45bc-a1c2-336558b5edbd req-d4c9fd7a-2dee-47f7-aef3-b1a1fb54a3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a0b276-1f26-4c66-9c0f-8ada81266162", "name": "network-vif-deleted", "tag": "2b54e61c-2e06-4b78-9fd7-f1f2dde7fd49"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:53.471029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8774fc42-59f3-45bc-a1c2-336558b5edbd req-d4c9fd7a-2dee-47f7-aef3-b1a1fb54a3d9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:53.472012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8774fc42-59f3-45bc-a1c2-336558b5edbd req-d4c9fd7a-2dee-47f7-aef3-b1a1fb54a3d9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:53.474670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8774fc42-59f3-45bc-a1c2-336558b5edbd req-d4c9fd7a-2dee-47f7-aef3-b1a1fb54a3d9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:53.504534 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-8774fc42-59f3-45bc-a1c2-336558b5edbd req-d4c9fd7a-2dee-47f7-aef3-b1a1fb54a3d9 service nova] Creating event network-vif-deleted:2b54e61c-2e06-4b78-9fd7-f1f2dde7fd49 for instance 06a0b276-1f26-4c66-9c0f-8ada81266162 on n-h1-860687-3 Oct 27 19:01:53.516964 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-8774fc42-59f3-45bc-a1c2-336558b5edbd req-d4c9fd7a-2dee-47f7-aef3-b1a1fb54a3d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074810 Oct 27 19:01:53.517936 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1751/3665] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:53.580246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-07e28dd3-a61e-4aab-b30a-6eb68815f72a req-8bad6b78-e190-4810-98cd-01b6c515f1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce1ae62-f242-46bb-a382-24da7cd449ab", "name": "network-vif-plugged", "status": "completed", "tag": "9a97ad41-b667-46fe-9eff-7cf3a35d64d1"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:53.604737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-07e28dd3-a61e-4aab-b30a-6eb68815f72a req-8bad6b78-e190-4810-98cd-01b6c515f1fd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:53.608202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-07e28dd3-a61e-4aab-b30a-6eb68815f72a req-8bad6b78-e190-4810-98cd-01b6c515f1fd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:53.610134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-07e28dd3-a61e-4aab-b30a-6eb68815f72a req-8bad6b78-e190-4810-98cd-01b6c515f1fd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:53.676162 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-07e28dd3-a61e-4aab-b30a-6eb68815f72a req-8bad6b78-e190-4810-98cd-01b6c515f1fd service nova] Creating event network-vif-plugged:9a97ad41-b667-46fe-9eff-7cf3a35d64d1 for instance 0ce1ae62-f242-46bb-a382-24da7cd449ab on n-h1-860687-3 Oct 27 19:01:53.683965 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-07e28dd3-a61e-4aab-b30a-6eb68815f72a req-8bad6b78-e190-4810-98cd-01b6c515f1fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109783 Oct 27 19:01:53.685278 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1752/3666] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 27 19:01:53.709931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-95b9aa4a-2baa-424f-8a43-98c5269b14b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:53.711499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-95b9aa4a-2baa-424f-8a43-98c5269b14b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:53.725879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b9aa4a-2baa-424f-8a43-98c5269b14b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:53.732881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b9aa4a-2baa-424f-8a43-98c5269b14b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:53.736615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b9aa4a-2baa-424f-8a43-98c5269b14b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:53.737709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b9aa4a-2baa-424f-8a43-98c5269b14b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:53.744206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b9aa4a-2baa-424f-8a43-98c5269b14b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:53.750231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b9aa4a-2baa-424f-8a43-98c5269b14b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:53.896441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-44d0093d-266d-45bf-88fd-45bb78836d69 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:53.906139 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-44d0093d-266d-45bf-88fd-45bb78836d69 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1316 microversion: 2.1 time: 1.275867 Oct 27 19:01:53.911545 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1915/3667] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:52 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1316 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:54.126141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0b2c6c2f-3ccd-415c-bf51-9ca85983eedf tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:54.127320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0b2c6c2f-3ccd-415c-bf51-9ca85983eedf tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:54.143370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b2c6c2f-3ccd-415c-bf51-9ca85983eedf tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:54.145342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b2c6c2f-3ccd-415c-bf51-9ca85983eedf tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:54.145892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b2c6c2f-3ccd-415c-bf51-9ca85983eedf tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:54.146921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b2c6c2f-3ccd-415c-bf51-9ca85983eedf tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:54.147750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b2c6c2f-3ccd-415c-bf51-9ca85983eedf tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:54.148427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b2c6c2f-3ccd-415c-bf51-9ca85983eedf tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:54.250483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-95b9aa4a-2baa-424f-8a43-98c5269b14b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:54.271020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-95b9aa4a-2baa-424f-8a43-98c5269b14b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:54.273466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-95b9aa4a-2baa-424f-8a43-98c5269b14b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:54.275891 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-95b9aa4a-2baa-424f-8a43-98c5269b14b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1750 microversion: 2.20 time: 0.589249 Oct 27 19:01:54.276755 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1753/3668] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:53 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1750 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:54.290781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-db0c84d1-0bbd-4ec0-8319-04da483c3169 req-74cb3805-0786-47bc-891f-972b1aa13da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b227794-9896-4ec9-b8a1-3b1f3cce38c3", "tag": "3d9a6379-167d-4e6c-ac72-73f1bd8e4a6b"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:54.314289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0b2c6c2f-3ccd-415c-bf51-9ca85983eedf tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:54.323969 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0b2c6c2f-3ccd-415c-bf51-9ca85983eedf tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1183 microversion: 2.1 time: 0.201643 Oct 27 19:01:54.327307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-db0c84d1-0bbd-4ec0-8319-04da483c3169 req-74cb3805-0786-47bc-891f-972b1aa13da6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:54.336022 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1916/3669] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:54 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:54.337731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-db0c84d1-0bbd-4ec0-8319-04da483c3169 req-74cb3805-0786-47bc-891f-972b1aa13da6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:54.344285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-db0c84d1-0bbd-4ec0-8319-04da483c3169 req-74cb3805-0786-47bc-891f-972b1aa13da6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:54.361026 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-db0c84d1-0bbd-4ec0-8319-04da483c3169 req-74cb3805-0786-47bc-891f-972b1aa13da6 service nova] Creating event network-changed:3d9a6379-167d-4e6c-ac72-73f1bd8e4a6b for instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 on n-h1-860687-3 Oct 27 19:01:54.367160 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-db0c84d1-0bbd-4ec0-8319-04da483c3169 req-74cb3805-0786-47bc-891f-972b1aa13da6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088777 Oct 27 19:01:54.368449 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1754/3670] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:54.940991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-974e8d72-dd23-485e-a4f2-f4d058946895 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:54.941714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-974e8d72-dd23-485e-a4f2-f4d058946895 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:54.953566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-974e8d72-dd23-485e-a4f2-f4d058946895 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:54.954075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-974e8d72-dd23-485e-a4f2-f4d058946895 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:54.963717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-974e8d72-dd23-485e-a4f2-f4d058946895 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:54.964623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-974e8d72-dd23-485e-a4f2-f4d058946895 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:54.965207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-974e8d72-dd23-485e-a4f2-f4d058946895 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:54.965670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-974e8d72-dd23-485e-a4f2-f4d058946895 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:55.266717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-974e8d72-dd23-485e-a4f2-f4d058946895 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:55.308679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b6572c44-8191-415d-94fe-9b13d28003df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:55.309416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b6572c44-8191-415d-94fe-9b13d28003df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:55.316082 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-974e8d72-dd23-485e-a4f2-f4d058946895 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1316 microversion: 2.1 time: 0.375655 Oct 27 19:01:55.318993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6572c44-8191-415d-94fe-9b13d28003df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:55.319502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6572c44-8191-415d-94fe-9b13d28003df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:55.319954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6572c44-8191-415d-94fe-9b13d28003df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:55.326920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6572c44-8191-415d-94fe-9b13d28003df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:55.327436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6572c44-8191-415d-94fe-9b13d28003df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:55.327904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6572c44-8191-415d-94fe-9b13d28003df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:55.333316 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1917/3671] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:54 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:55.362644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-214b8c72-8d05-482c-a519-27ebad7dea30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:55.363279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-214b8c72-8d05-482c-a519-27ebad7dea30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:55.387599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-214b8c72-8d05-482c-a519-27ebad7dea30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:55.388111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-214b8c72-8d05-482c-a519-27ebad7dea30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:55.388553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-214b8c72-8d05-482c-a519-27ebad7dea30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:55.395300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-214b8c72-8d05-482c-a519-27ebad7dea30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:55.395734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-214b8c72-8d05-482c-a519-27ebad7dea30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:55.396187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-214b8c72-8d05-482c-a519-27ebad7dea30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:55.577576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-214b8c72-8d05-482c-a519-27ebad7dea30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:55.596509 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-214b8c72-8d05-482c-a519-27ebad7dea30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1183 microversion: 2.1 time: 0.239832 Oct 27 19:01:55.606656 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1918/3672] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:55 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:55.706109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6572c44-8191-415d-94fe-9b13d28003df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:55.725023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6572c44-8191-415d-94fe-9b13d28003df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:55.726542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6572c44-8191-415d-94fe-9b13d28003df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:55.727822 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b6572c44-8191-415d-94fe-9b13d28003df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1750 microversion: 2.20 time: 0.423757 Oct 27 19:01:55.728721 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1755/3673] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:55 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1750 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:56.354617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e1e6b7e2-5b22-437a-b13d-ef56812bab9a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:56.355323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e1e6b7e2-5b22-437a-b13d-ef56812bab9a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:56.371727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1e6b7e2-5b22-437a-b13d-ef56812bab9a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:56.372904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1e6b7e2-5b22-437a-b13d-ef56812bab9a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:56.373558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1e6b7e2-5b22-437a-b13d-ef56812bab9a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:56.374808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1e6b7e2-5b22-437a-b13d-ef56812bab9a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:56.378790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1e6b7e2-5b22-437a-b13d-ef56812bab9a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:56.379535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1e6b7e2-5b22-437a-b13d-ef56812bab9a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:56.629034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ad087fcd-d790-45f1-8348-5d342ec432df tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:56.629651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ad087fcd-d790-45f1-8348-5d342ec432df tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:56.637847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad087fcd-d790-45f1-8348-5d342ec432df tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:56.638752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad087fcd-d790-45f1-8348-5d342ec432df tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:56.639049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad087fcd-d790-45f1-8348-5d342ec432df tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:56.639535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad087fcd-d790-45f1-8348-5d342ec432df tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:56.640062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad087fcd-d790-45f1-8348-5d342ec432df tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:56.640443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad087fcd-d790-45f1-8348-5d342ec432df tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:56.660401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1e6b7e2-5b22-437a-b13d-ef56812bab9a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:56.676435 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e1e6b7e2-5b22-437a-b13d-ef56812bab9a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1504 microversion: 2.1 time: 0.327980 Oct 27 19:01:56.698265 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1919/3674] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:56 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:01:56.708129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ab58d92f-23a1-4ee4-9c58-b7626c705736 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:56.709004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ab58d92f-23a1-4ee4-9c58-b7626c705736 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:56.718616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:56.721485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab58d92f-23a1-4ee4-9c58-b7626c705736 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:56.722445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab58d92f-23a1-4ee4-9c58-b7626c705736 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:56.723178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab58d92f-23a1-4ee4-9c58-b7626c705736 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:56.724329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab58d92f-23a1-4ee4-9c58-b7626c705736 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:56.725013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab58d92f-23a1-4ee4-9c58-b7626c705736 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:56.725914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab58d92f-23a1-4ee4-9c58-b7626c705736 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:56.765746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ad087fcd-d790-45f1-8348-5d342ec432df tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:56.775106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ab58d92f-23a1-4ee4-9c58-b7626c705736 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:01:56.775547 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ad087fcd-d790-45f1-8348-5d342ec432df tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1183 microversion: 2.1 time: 0.150496 Oct 27 19:01:56.779528 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1756/3675] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:56 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:56.789926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aae2d58b-77d9-4dd4-9f77-3f652bd6747a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:56.790782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aae2d58b-77d9-4dd4-9f77-3f652bd6747a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:56.813477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aae2d58b-77d9-4dd4-9f77-3f652bd6747a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:56.815772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aae2d58b-77d9-4dd4-9f77-3f652bd6747a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:56.817389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aae2d58b-77d9-4dd4-9f77-3f652bd6747a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:56.820126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aae2d58b-77d9-4dd4-9f77-3f652bd6747a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:56.822900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aae2d58b-77d9-4dd4-9f77-3f652bd6747a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:56.823553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aae2d58b-77d9-4dd4-9f77-3f652bd6747a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:56.940888 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ab58d92f-23a1-4ee4-9c58-b7626c705736 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 204 len: 0 microversion: 2.1 time: 0.235676 Oct 27 19:01:56.946309 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1920/3676] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:01:56 2022] DELETE /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:01:56.953436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-acad6e1f-3d31-4ad2-be09-455f6cde0a9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:56.954187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-acad6e1f-3d31-4ad2-be09-455f6cde0a9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:56.964608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-acad6e1f-3d31-4ad2-be09-455f6cde0a9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:56.965107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-acad6e1f-3d31-4ad2-be09-455f6cde0a9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:56.965671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-acad6e1f-3d31-4ad2-be09-455f6cde0a9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:56.966578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-acad6e1f-3d31-4ad2-be09-455f6cde0a9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:56.967819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-acad6e1f-3d31-4ad2-be09-455f6cde0a9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:56.968262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-acad6e1f-3d31-4ad2-be09-455f6cde0a9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:57.061664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aae2d58b-77d9-4dd4-9f77-3f652bd6747a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:57.071899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aae2d58b-77d9-4dd4-9f77-3f652bd6747a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:57.073641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aae2d58b-77d9-4dd4-9f77-3f652bd6747a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:57.075109 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aae2d58b-77d9-4dd4-9f77-3f652bd6747a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1750 microversion: 2.20 time: 0.294620 Oct 27 19:01:57.075678 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1757/3677] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:56 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1750 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:57.205427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-acad6e1f-3d31-4ad2-be09-455f6cde0a9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:57.221062 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-acad6e1f-3d31-4ad2-be09-455f6cde0a9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1510 microversion: 2.1 time: 0.272604 Oct 27 19:01:57.222011 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1921/3678] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:56 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:57.801352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ce5ec6b-8350-457b-a1c7-4e75dcfa8756 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:57.802617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ce5ec6b-8350-457b-a1c7-4e75dcfa8756 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:57.810231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ce5ec6b-8350-457b-a1c7-4e75dcfa8756 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:57.810753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ce5ec6b-8350-457b-a1c7-4e75dcfa8756 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:57.811198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ce5ec6b-8350-457b-a1c7-4e75dcfa8756 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:57.811905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ce5ec6b-8350-457b-a1c7-4e75dcfa8756 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:57.812362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ce5ec6b-8350-457b-a1c7-4e75dcfa8756 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:57.812792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ce5ec6b-8350-457b-a1c7-4e75dcfa8756 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:57.817388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:57.903243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9ce5ec6b-8350-457b-a1c7-4e75dcfa8756 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:57.912464 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ce5ec6b-8350-457b-a1c7-4e75dcfa8756 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1183 microversion: 2.1 time: 0.115072 Oct 27 19:01:57.913770 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1758/3679] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:57 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:58.102843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bbf88cc7-51ad-4318-8528-c25a8b76deb3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:58.103475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bbf88cc7-51ad-4318-8528-c25a8b76deb3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:58.110590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbf88cc7-51ad-4318-8528-c25a8b76deb3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:58.111334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbf88cc7-51ad-4318-8528-c25a8b76deb3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:58.111940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbf88cc7-51ad-4318-8528-c25a8b76deb3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:58.112851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbf88cc7-51ad-4318-8528-c25a8b76deb3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:58.113511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbf88cc7-51ad-4318-8528-c25a8b76deb3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:58.114121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbf88cc7-51ad-4318-8528-c25a8b76deb3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:58.144433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:01:58.265572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d037173f-b2ea-4077-925a-9cc767da3f91 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:58.266472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d037173f-b2ea-4077-925a-9cc767da3f91 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:58.275657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d037173f-b2ea-4077-925a-9cc767da3f91 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:58.276686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d037173f-b2ea-4077-925a-9cc767da3f91 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:58.277553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d037173f-b2ea-4077-925a-9cc767da3f91 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:58.278969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d037173f-b2ea-4077-925a-9cc767da3f91 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:58.279625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d037173f-b2ea-4077-925a-9cc767da3f91 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:58.280247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d037173f-b2ea-4077-925a-9cc767da3f91 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:58.339191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bbf88cc7-51ad-4318-8528-c25a8b76deb3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:58.347662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bbf88cc7-51ad-4318-8528-c25a8b76deb3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:58.349412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bbf88cc7-51ad-4318-8528-c25a8b76deb3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:58.351356 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bbf88cc7-51ad-4318-8528-c25a8b76deb3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1750 microversion: 2.20 time: 0.253188 Oct 27 19:01:58.352325 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1922/3680] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:58 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1750 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:58.610302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d037173f-b2ea-4077-925a-9cc767da3f91 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:58.624918 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d037173f-b2ea-4077-925a-9cc767da3f91 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1510 microversion: 2.1 time: 0.383752 Oct 27 19:01:58.638474 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1759/3681] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:58 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1510 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:58.943395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a331054-9b28-4d4e-9d25-ed6ca26f5f2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:58.944217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1a331054-9b28-4d4e-9d25-ed6ca26f5f2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:58.956089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a331054-9b28-4d4e-9d25-ed6ca26f5f2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:58.956973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a331054-9b28-4d4e-9d25-ed6ca26f5f2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:58.957674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a331054-9b28-4d4e-9d25-ed6ca26f5f2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:58.958425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a331054-9b28-4d4e-9d25-ed6ca26f5f2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:58.958952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a331054-9b28-4d4e-9d25-ed6ca26f5f2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:58.959355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a331054-9b28-4d4e-9d25-ed6ca26f5f2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:59.033978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1a331054-9b28-4d4e-9d25-ed6ca26f5f2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:59.043666 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1a331054-9b28-4d4e-9d25-ed6ca26f5f2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1183 microversion: 2.1 time: 0.110690 Oct 27 19:01:59.044336 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1923/3682] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:58 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:01:59.246599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-652f05c6-47ec-462a-9510-882c051f73df req-fd893eb9-2ef4-4e0e-8709-dd7509222173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce1ae62-f242-46bb-a382-24da7cd449ab", "name": "network-vif-deleted", "tag": "9a97ad41-b667-46fe-9eff-7cf3a35d64d1"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:59.261451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-652f05c6-47ec-462a-9510-882c051f73df req-fd893eb9-2ef4-4e0e-8709-dd7509222173 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:59.262324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-652f05c6-47ec-462a-9510-882c051f73df req-fd893eb9-2ef4-4e0e-8709-dd7509222173 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:59.263020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-652f05c6-47ec-462a-9510-882c051f73df req-fd893eb9-2ef4-4e0e-8709-dd7509222173 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:59.282358 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-652f05c6-47ec-462a-9510-882c051f73df req-fd893eb9-2ef4-4e0e-8709-dd7509222173 service nova] Creating event network-vif-deleted:9a97ad41-b667-46fe-9eff-7cf3a35d64d1 for instance 0ce1ae62-f242-46bb-a382-24da7cd449ab on n-h1-860687-3 Oct 27 19:01:59.300475 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-652f05c6-47ec-462a-9510-882c051f73df req-fd893eb9-2ef4-4e0e-8709-dd7509222173 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064387 Oct 27 19:01:59.304344 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1760/3683] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:01:59.380256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af068b98-d994-4fd6-b521-e18a35fb016e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:59.382492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-af068b98-d994-4fd6-b521-e18a35fb016e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:59.391995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af068b98-d994-4fd6-b521-e18a35fb016e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:59.392719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af068b98-d994-4fd6-b521-e18a35fb016e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:59.393395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af068b98-d994-4fd6-b521-e18a35fb016e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:59.394346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af068b98-d994-4fd6-b521-e18a35fb016e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:59.395081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af068b98-d994-4fd6-b521-e18a35fb016e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:59.395732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af068b98-d994-4fd6-b521-e18a35fb016e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:59.501521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b731b992-a21c-48b6-9950-9deb428721a7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc1635f3-5222-4072-893b-3c26884e3aa5"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:01:59.505978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b731b992-a21c-48b6-9950-9deb428721a7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:59.521876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b731b992-a21c-48b6-9950-9deb428721a7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:59.522447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b731b992-a21c-48b6-9950-9deb428721a7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:59.525807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b731b992-a21c-48b6-9950-9deb428721a7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:59.528155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b731b992-a21c-48b6-9950-9deb428721a7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:59.528649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b731b992-a21c-48b6-9950-9deb428721a7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:59.529146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b731b992-a21c-48b6-9950-9deb428721a7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:59.706116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-af068b98-d994-4fd6-b521-e18a35fb016e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:59.721448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-af068b98-d994-4fd6-b521-e18a35fb016e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:59.725109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-af068b98-d994-4fd6-b521-e18a35fb016e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:59.726341 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-af068b98-d994-4fd6-b521-e18a35fb016e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1750 microversion: 2.20 time: 0.350437 Oct 27 19:01:59.740349 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1924/3684] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:01:59 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1750 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:01:59.749845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4aba4b33-5013-4b37-b019-064d248ef767 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:01:59.750526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4aba4b33-5013-4b37-b019-064d248ef767 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:01:59.757193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aba4b33-5013-4b37-b019-064d248ef767 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:59.757688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aba4b33-5013-4b37-b019-064d248ef767 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:59.758946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aba4b33-5013-4b37-b019-064d248ef767 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:59.760131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aba4b33-5013-4b37-b019-064d248ef767 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:59.760750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aba4b33-5013-4b37-b019-064d248ef767 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:59.761324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aba4b33-5013-4b37-b019-064d248ef767 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:59.811043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aba4b33-5013-4b37-b019-064d248ef767 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:01:59.811809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aba4b33-5013-4b37-b019-064d248ef767 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:01:59.812391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aba4b33-5013-4b37-b019-064d248ef767 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:01:59.813263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-4aba4b33-5013-4b37-b019-064d248ef767 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lazy-loading 'fault' on Instance uuid 0ce1ae62-f242-46bb-a382-24da7cd449ab {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:01:59.880164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4aba4b33-5013-4b37-b019-064d248ef767 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc869326800402785fc9a7804ae9a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f3252ed23b44c9b3608b1e954e7094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:01:59.893810 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4aba4b33-5013-4b37-b019-064d248ef767 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 200 len: 1306 microversion: 2.1 time: 0.152012 Oct 27 19:01:59.909747 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1925/3685] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:01:59 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 1306 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:00.068056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-090289f4-3cd3-4a3c-8538-ebda1dbbf529 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:00.068799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-090289f4-3cd3-4a3c-8538-ebda1dbbf529 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:00.084886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-090289f4-3cd3-4a3c-8538-ebda1dbbf529 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:00.085481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-090289f4-3cd3-4a3c-8538-ebda1dbbf529 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:00.086193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-090289f4-3cd3-4a3c-8538-ebda1dbbf529 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:00.088571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-090289f4-3cd3-4a3c-8538-ebda1dbbf529 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:00.089055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-090289f4-3cd3-4a3c-8538-ebda1dbbf529 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:00.090542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-090289f4-3cd3-4a3c-8538-ebda1dbbf529 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:00.229969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-090289f4-3cd3-4a3c-8538-ebda1dbbf529 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:00.240785 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-090289f4-3cd3-4a3c-8538-ebda1dbbf529 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1183 microversion: 2.1 time: 0.176857 Oct 27 19:02:00.241894 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1926/3686] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:00 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:00.757897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d820e211-6a6e-4b4a-b19d-2e768250e045 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:00.758911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d820e211-6a6e-4b4a-b19d-2e768250e045 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:00.767061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d820e211-6a6e-4b4a-b19d-2e768250e045 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:00.767823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d820e211-6a6e-4b4a-b19d-2e768250e045 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:00.768338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d820e211-6a6e-4b4a-b19d-2e768250e045 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:00.769420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d820e211-6a6e-4b4a-b19d-2e768250e045 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:00.770513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d820e211-6a6e-4b4a-b19d-2e768250e045 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:00.771044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d820e211-6a6e-4b4a-b19d-2e768250e045 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:00.916438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d820e211-6a6e-4b4a-b19d-2e768250e045 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:00.926288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d820e211-6a6e-4b4a-b19d-2e768250e045 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:00.927949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d820e211-6a6e-4b4a-b19d-2e768250e045 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:00.929550 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d820e211-6a6e-4b4a-b19d-2e768250e045 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1750 microversion: 2.20 time: 0.177064 Oct 27 19:02:00.941736 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1927/3687] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:00 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1750 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:00.955145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b4ef3f0d-0297-4f08-bdda-9532aeaae82a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:00.956119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b4ef3f0d-0297-4f08-bdda-9532aeaae82a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:00.963414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4ef3f0d-0297-4f08-bdda-9532aeaae82a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:00.964158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4ef3f0d-0297-4f08-bdda-9532aeaae82a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:00.964748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4ef3f0d-0297-4f08-bdda-9532aeaae82a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:00.965611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4ef3f0d-0297-4f08-bdda-9532aeaae82a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:00.966212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4ef3f0d-0297-4f08-bdda-9532aeaae82a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:00.966834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4ef3f0d-0297-4f08-bdda-9532aeaae82a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:00.983704 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-b4ef3f0d-0297-4f08-bdda-9532aeaae82a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] HTTP exception thrown: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b4ef3f0d-0297-4f08-bdda-9532aeaae82a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Request method failure captured: Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab HTTP/1.1 Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtWMnmA4kA4Li83PYnEo6EMM4JkbWP-PqfCMKFReWVgqZLqG4_rTx69zYAmg2bg8-cJO_YBgzFxLxy0ORIkVRL9LE36KirF_NRBFdLhidXugc-aRCCvr-sE-IHkYzyeFHmixgtbgwOeO4vEdyH0MEZHUM7-NF2O8hhnJAHv55_GXBaY Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 32f3252ed23b44c9b3608b1e954e7094 Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_32f3252ed23b44c9b3608b1e954e7094", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 32f3252ed23b44c9b3608b1e954e7094 Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesNegativeTestJSON-1347377780-project Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 6dc869326800402785fc9a7804ae9a03 Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesNegativeTestJSON-1347377780-project Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '0ce1ae62-f242-46bb-a382-24da7cd449ab'} Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:00.985391 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:00.989104 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:00.989104 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:00.989104 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:00.989104 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:00.989104 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:00.989104 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:00.989104 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:00.990186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b4ef3f0d-0297-4f08-bdda-9532aeaae82a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Returning 404 to user: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:00.991252 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b4ef3f0d-0297-4f08-bdda-9532aeaae82a tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 404 len: 111 microversion: 2.1 time: 0.048472 Oct 27 19:02:00.993021 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1928/3688] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:00 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:02:01.001610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0c1ad24-7ba0-48fc-b597-e221ba454b9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-196708993", "metadata": {"image_type": "test"}}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:01.004851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f0c1ad24-7ba0-48fc-b597-e221ba454b9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:01.011984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0c1ad24-7ba0-48fc-b597-e221ba454b9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:01.012490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0c1ad24-7ba0-48fc-b597-e221ba454b9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:01.012940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0c1ad24-7ba0-48fc-b597-e221ba454b9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:01.013655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0c1ad24-7ba0-48fc-b597-e221ba454b9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:01.014184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0c1ad24-7ba0-48fc-b597-e221ba454b9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:01.014750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0c1ad24-7ba0-48fc-b597-e221ba454b9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:01.031292 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-f0c1ad24-7ba0-48fc-b597-e221ba454b9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] HTTP exception thrown: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0c1ad24-7ba0-48fc-b597-e221ba454b9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Request method failure captured: Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab/action HTTP/1.1 Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 111 Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtWMnmA4kA4Li83PYnEo6EMM4JkbWP-PqfCMKFReWVgqZLqG4_rTx69zYAmg2bg8-cJO_YBgzFxLxy0ORIkVRL9LE36KirF_NRBFdLhidXugc-aRCCvr-sE-IHkYzyeFHmixgtbgwOeO4vEdyH0MEZHUM7-NF2O8hhnJAHv55_GXBaY Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 32f3252ed23b44c9b3608b1e954e7094 Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_32f3252ed23b44c9b3608b1e954e7094", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 32f3252ed23b44c9b3608b1e954e7094 Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesNegativeTestJSON-1347377780-project Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 6dc869326800402785fc9a7804ae9a03 Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesNegativeTestJSON-1347377780-project Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-196708993", "metadata": {"image_type": "test"}}} Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '0ce1ae62-f242-46bb-a382-24da7cd449ab', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-196708993', 'metadata': {'image_type': 'test'}}}} Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 19:02:01.033039 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.035900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0c1ad24-7ba0-48fc-b597-e221ba454b9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Returning 404 to user: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:01.038639 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f0c1ad24-7ba0-48fc-b597-e221ba454b9c tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "POST /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab/action" status: 404 len: 111 microversion: 2.1 time: 0.036998 Oct 27 19:02:01.040962 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1929/3689] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Oct 27 19:02:00 2022] POST /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:02:01.052214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-68865cdc-c38c-4944-885c-80534e3ca025 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1754197900", "metadata": {"image_type": "test"}}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:01.056933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-68865cdc-c38c-4944-885c-80534e3ca025 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Failed to fetch instance by id tempest-invalid-1432412150 {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 19:02:01.057581 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-68865cdc-c38c-4944-885c-80534e3ca025 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] HTTP exception thrown: Instance tempest-invalid-1432412150 could not be found. Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-68865cdc-c38c-4944-885c-80534e3ca025 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Request method failure captured: Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/tempest-invalid-1432412150/action HTTP/1.1 Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 112 Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtWMnmA4kA4Li83PYnEo6EMM4JkbWP-PqfCMKFReWVgqZLqG4_rTx69zYAmg2bg8-cJO_YBgzFxLxy0ORIkVRL9LE36KirF_NRBFdLhidXugc-aRCCvr-sE-IHkYzyeFHmixgtbgwOeO4vEdyH0MEZHUM7-NF2O8hhnJAHv55_GXBaY Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 32f3252ed23b44c9b3608b1e954e7094 Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_32f3252ed23b44c9b3608b1e954e7094", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 32f3252ed23b44c9b3608b1e954e7094 Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesNegativeTestJSON-1347377780-project Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 6dc869326800402785fc9a7804ae9a03 Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesNegativeTestJSON-1347377780-project Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1754197900", "metadata": {"image_type": "test"}}} Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance tempest-invalid-1432412150 could not be found. Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'tempest-invalid-1432412150', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1754197900', 'metadata': {'image_type': 'test'}}}} Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1432412150 could not be found. Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:02:01.059726 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1432412150 could not be found. Oct 27 19:02:01.063476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.063476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:01.063476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.063476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.063476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:01.063476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:01.063476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:01.063476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:01.063476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1432412150 could not be found. Oct 27 19:02:01.063476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.064315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-68865cdc-c38c-4944-885c-80534e3ca025 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Returning 404 to user: Instance tempest-invalid-1432412150 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:01.065263 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-68865cdc-c38c-4944-885c-80534e3ca025 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "POST /compute/v2.1/servers/tempest-invalid-1432412150/action" status: 404 len: 101 microversion: 2.1 time: 0.018000 Oct 27 19:02:01.066292 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1930/3690] 10.222.0.42 () {60 vars in 1249 bytes} [Thu Oct 27 19:02:01 2022] POST /compute/v2.1/servers/tempest-invalid-1432412150/action => generated 101 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:02:01.076636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b918274b-6793-4291-8d0a-4bfe1cca262b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1272299645"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:01.079112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b918274b-6793-4291-8d0a-4bfe1cca262b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 19:02:01.079655 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-b918274b-6793-4291-8d0a-4bfe1cca262b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b918274b-6793-4291-8d0a-4bfe1cca262b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Request method failure captured: Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 57 Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtWMnmA4kA4Li83PYnEo6EMM4JkbWP-PqfCMKFReWVgqZLqG4_rTx69zYAmg2bg8-cJO_YBgzFxLxy0ORIkVRL9LE36KirF_NRBFdLhidXugc-aRCCvr-sE-IHkYzyeFHmixgtbgwOeO4vEdyH0MEZHUM7-NF2O8hhnJAHv55_GXBaY Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 32f3252ed23b44c9b3608b1e954e7094 Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_32f3252ed23b44c9b3608b1e954e7094", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 32f3252ed23b44c9b3608b1e954e7094 Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesNegativeTestJSON-1347377780-project Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 6dc869326800402785fc9a7804ae9a03 Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesNegativeTestJSON-1347377780-project Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: {"createImage": {"name": "tempest-test-snap-1272299645"}} Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1272299645'}}} Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 19:02:01.084207 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.092135 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:01.092135 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.092135 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.092135 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:01.092135 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:01.092135 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:01.092135 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:01.092135 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 19:02:01.092135 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.092135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b918274b-6793-4291-8d0a-4bfe1cca262b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:01.092135 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b918274b-6793-4291-8d0a-4bfe1cca262b tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.013717 Oct 27 19:02:01.092135 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1931/3691] 10.222.0.42 () {60 vars in 1275 bytes} [Thu Oct 27 19:02:01 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:02:01.099270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7058c728-3d79-463f-85cc-4a46720b63fa tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1455080497"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:01.102155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7058c728-3d79-463f-85cc-4a46720b63fa tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 19:02:01.103318 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-7058c728-3d79-463f-85cc-4a46720b63fa tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7058c728-3d79-463f-85cc-4a46720b63fa tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Request method failure captured: Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 57 Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtWMnmA4kA4Li83PYnEo6EMM4JkbWP-PqfCMKFReWVgqZLqG4_rTx69zYAmg2bg8-cJO_YBgzFxLxy0ORIkVRL9LE36KirF_NRBFdLhidXugc-aRCCvr-sE-IHkYzyeFHmixgtbgwOeO4vEdyH0MEZHUM7-NF2O8hhnJAHv55_GXBaY Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 32f3252ed23b44c9b3608b1e954e7094 Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_32f3252ed23b44c9b3608b1e954e7094", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 32f3252ed23b44c9b3608b1e954e7094 Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesNegativeTestJSON-1347377780-project Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 6dc869326800402785fc9a7804ae9a03 Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesNegativeTestJSON-1347377780-project Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: {"createImage": {"name": "tempest-test-snap-1455080497"}} Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1455080497'}}} Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 19:02:01.104884 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.112504 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:01.112504 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.112504 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.112504 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:01.112504 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:01.112504 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:01.112504 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:01.112504 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 19:02:01.112504 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.112504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7058c728-3d79-463f-85cc-4a46720b63fa tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:01.112504 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7058c728-3d79-463f-85cc-4a46720b63fa tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011185 Oct 27 19:02:01.112504 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1932/3692] 10.222.0.42 () {60 vars in 1281 bytes} [Thu Oct 27 19:02:01 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:02:01.132094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f84e0f9-450a-4923-a9e2-7f14baf049ef tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:01.132650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6f84e0f9-450a-4923-a9e2-7f14baf049ef tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:01.146785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f84e0f9-450a-4923-a9e2-7f14baf049ef tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:01.147321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f84e0f9-450a-4923-a9e2-7f14baf049ef tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:01.147770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f84e0f9-450a-4923-a9e2-7f14baf049ef tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:01.148577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f84e0f9-450a-4923-a9e2-7f14baf049ef tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:01.149109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f84e0f9-450a-4923-a9e2-7f14baf049ef tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:01.149540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f84e0f9-450a-4923-a9e2-7f14baf049ef tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:01.167970 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-6f84e0f9-450a-4923-a9e2-7f14baf049ef tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] HTTP exception thrown: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f84e0f9-450a-4923-a9e2-7f14baf049ef tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Request method failure captured: Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab HTTP/1.1 Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtWMnmA4kA4Li83PYnEo6EMM4JkbWP-PqfCMKFReWVgqZLqG4_rTx69zYAmg2bg8-cJO_YBgzFxLxy0ORIkVRL9LE36KirF_NRBFdLhidXugc-aRCCvr-sE-IHkYzyeFHmixgtbgwOeO4vEdyH0MEZHUM7-NF2O8hhnJAHv55_GXBaY Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 32f3252ed23b44c9b3608b1e954e7094 Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_32f3252ed23b44c9b3608b1e954e7094", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 32f3252ed23b44c9b3608b1e954e7094 Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesNegativeTestJSON-1347377780-project Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 6dc869326800402785fc9a7804ae9a03 Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesNegativeTestJSON-1347377780-project Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '0ce1ae62-f242-46bb-a382-24da7cd449ab'} Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:02:01.169526 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:02:01.172940 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.172940 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.172940 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:01.172940 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.172940 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.172940 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:01.172940 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:01.172940 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:01.172940 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:01.172940 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.172940 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.172940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f84e0f9-450a-4923-a9e2-7f14baf049ef tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Returning 404 to user: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:01.172940 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6f84e0f9-450a-4923-a9e2-7f14baf049ef tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 404 len: 111 microversion: 2.1 time: 0.058906 Oct 27 19:02:01.175203 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1933/3693] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:02:01 2022] DELETE /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:02:01.182992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d73e446-454c-470a-bbb4-01a766ab0ee8 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:01.183696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9d73e446-454c-470a-bbb4-01a766ab0ee8 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] [instance: 0ce1ae62-f242-46bb-a382-24da7cd449ab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:01.190364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d73e446-454c-470a-bbb4-01a766ab0ee8 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:01.190974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d73e446-454c-470a-bbb4-01a766ab0ee8 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:01.191425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d73e446-454c-470a-bbb4-01a766ab0ee8 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:01.192220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d73e446-454c-470a-bbb4-01a766ab0ee8 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:01.192690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d73e446-454c-470a-bbb4-01a766ab0ee8 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:01.193183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d73e446-454c-470a-bbb4-01a766ab0ee8 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:01.231564 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-9d73e446-454c-470a-bbb4-01a766ab0ee8 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] HTTP exception thrown: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d73e446-454c-470a-bbb4-01a766ab0ee8 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Request method failure captured: Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab HTTP/1.1 Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtWMnmA4kA4Li83PYnEo6EMM4JkbWP-PqfCMKFReWVgqZLqG4_rTx69zYAmg2bg8-cJO_YBgzFxLxy0ORIkVRL9LE36KirF_NRBFdLhidXugc-aRCCvr-sE-IHkYzyeFHmixgtbgwOeO4vEdyH0MEZHUM7-NF2O8hhnJAHv55_GXBaY Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 32f3252ed23b44c9b3608b1e954e7094 Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_32f3252ed23b44c9b3608b1e954e7094", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/32f3252ed23b44c9b3608b1e954e7094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 32f3252ed23b44c9b3608b1e954e7094 Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1347377780 Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesNegativeTestJSON-1347377780-project Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 6dc869326800402785fc9a7804ae9a03 Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesNegativeTestJSON-1347377780-project Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '0ce1ae62-f242-46bb-a382-24da7cd449ab'} Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:01.233331 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.236657 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:01.236657 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:01.236657 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:01.236657 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:01.236657 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:01.236657 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. Oct 27 19:02:01.236657 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:01.238580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d73e446-454c-470a-bbb4-01a766ab0ee8 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] Returning 404 to user: Instance 0ce1ae62-f242-46bb-a382-24da7cd449ab could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:01.239631 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9d73e446-454c-470a-bbb4-01a766ab0ee8 tempest-ImagesNegativeTestJSON-1347377780 tempest-ImagesNegativeTestJSON-1347377780-project] 10.222.0.42 "GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab" status: 404 len: 111 microversion: 2.1 time: 0.063449 Oct 27 19:02:01.240371 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1934/3694] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:01 2022] GET /compute/v2.1/servers/0ce1ae62-f242-46bb-a382-24da7cd449ab => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:02:01.265029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-611d2be0-4222-40a2-94d5-bb41e260b651 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:01.265814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-611d2be0-4222-40a2-94d5-bb41e260b651 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:01.276774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-611d2be0-4222-40a2-94d5-bb41e260b651 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:01.278784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-611d2be0-4222-40a2-94d5-bb41e260b651 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:01.279620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-611d2be0-4222-40a2-94d5-bb41e260b651 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:01.280011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-611d2be0-4222-40a2-94d5-bb41e260b651 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:01.280478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-611d2be0-4222-40a2-94d5-bb41e260b651 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:01.280919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-611d2be0-4222-40a2-94d5-bb41e260b651 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:01.412495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-611d2be0-4222-40a2-94d5-bb41e260b651 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:01.429087 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-611d2be0-4222-40a2-94d5-bb41e260b651 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1183 microversion: 2.1 time: 0.167737 Oct 27 19:02:01.430168 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1935/3695] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:01 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:01.961403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-08f91a66-08d7-4fde-825b-9df53a80a599 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:01.962960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-08f91a66-08d7-4fde-825b-9df53a80a599 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:01.973820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08f91a66-08d7-4fde-825b-9df53a80a599 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:01.977142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08f91a66-08d7-4fde-825b-9df53a80a599 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:01.980253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08f91a66-08d7-4fde-825b-9df53a80a599 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:01.981290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08f91a66-08d7-4fde-825b-9df53a80a599 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:01.985631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08f91a66-08d7-4fde-825b-9df53a80a599 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:01.986357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08f91a66-08d7-4fde-825b-9df53a80a599 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:02.346470 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b731b992-a21c-48b6-9950-9deb428721a7 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.842395 Oct 27 19:02:02.357039 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1761/3696] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:01:59 2022] POST /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments => generated 194 bytes in 2860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:02.457562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f6f47210-502c-42cb-a876-c2b1716bad24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:02.458757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f6f47210-502c-42cb-a876-c2b1716bad24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:02.473743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f47210-502c-42cb-a876-c2b1716bad24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:02.475738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f47210-502c-42cb-a876-c2b1716bad24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:02.476967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f47210-502c-42cb-a876-c2b1716bad24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:02.477740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f47210-502c-42cb-a876-c2b1716bad24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:02.478217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f47210-502c-42cb-a876-c2b1716bad24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:02.490798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f47210-502c-42cb-a876-c2b1716bad24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:02.553914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f47210-502c-42cb-a876-c2b1716bad24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:02.553914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f47210-502c-42cb-a876-c2b1716bad24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:02.553914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f47210-502c-42cb-a876-c2b1716bad24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:02.553914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-f6f47210-502c-42cb-a876-c2b1716bad24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lazy-loading 'fault' on Instance uuid 06a0b276-1f26-4c66-9c0f-8ada81266162 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:02:02.681706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6f47210-502c-42cb-a876-c2b1716bad24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:02.698110 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f6f47210-502c-42cb-a876-c2b1716bad24 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 200 len: 1188 microversion: 2.1 time: 0.245243 Oct 27 19:02:02.698770 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1762/3697] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:02 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 1188 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:03.311250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-08f91a66-08d7-4fde-825b-9df53a80a599 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:03.327092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-08f91a66-08d7-4fde-825b-9df53a80a599 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:03.333911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-08f91a66-08d7-4fde-825b-9df53a80a599 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:03.337833 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-08f91a66-08d7-4fde-825b-9df53a80a599 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1750 microversion: 2.20 time: 1.379926 Oct 27 19:02:03.339015 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1936/3698] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:01 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1750 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:02:03.725499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-521688e4-38cf-427c-bc79-a8081654da52 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:03.726122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-521688e4-38cf-427c-bc79-a8081654da52 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 06a0b276-1f26-4c66-9c0f-8ada81266162] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:03.740538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-521688e4-38cf-427c-bc79-a8081654da52 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:03.741275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-521688e4-38cf-427c-bc79-a8081654da52 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:03.747898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-521688e4-38cf-427c-bc79-a8081654da52 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:03.748682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-521688e4-38cf-427c-bc79-a8081654da52 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:03.749338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-521688e4-38cf-427c-bc79-a8081654da52 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:03.750216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-521688e4-38cf-427c-bc79-a8081654da52 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:03.824082 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-521688e4-38cf-427c-bc79-a8081654da52 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] HTTP exception thrown: Instance 06a0b276-1f26-4c66-9c0f-8ada81266162 could not be found. Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-521688e4-38cf-427c-bc79-a8081654da52 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Request method failure captured: Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 HTTP/1.1 Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtP1jPTQTilIR8Zw_4HVRKuGunH1uFFR6Aza_rOW_ei4NNriDIoMN3kAG42RsPqZdvMxh-Eif7wsdiNUYPbI5HMhikk4gkGhH70O5sSBzRF0eXIX8GDpCHQ5vkXH_PQWi98Ynt6--OLpeG6yCZ_1-kx_z7Tqeg2rDyf961WO0VQwd3s Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 47340475d333442da39184d873995e37 Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-LiveMigrationTest-42422299 Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/47340475d333442da39184d873995e37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47340475d333442da39184d873995e37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_47340475d333442da39184d873995e37", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47340475d333442da39184d873995e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-LiveMigrationTest-42422299 Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 47340475d333442da39184d873995e37 Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-LiveMigrationTest-42422299 Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-LiveMigrationTest-42422299-project Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 59ab6001dda8482a83fbd4dc67eabb68 Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-LiveMigrationTest-42422299-project Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 06a0b276-1f26-4c66-9c0f-8ada81266162 could not be found. Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '06a0b276-1f26-4c66-9c0f-8ada81266162'} Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06a0b276-1f26-4c66-9c0f-8ada81266162 could not be found. Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06a0b276-1f26-4c66-9c0f-8ada81266162 could not be found. Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:03.828768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:03.832048 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:03.832048 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:03.832048 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:03.832048 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:03.832048 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:03.832048 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06a0b276-1f26-4c66-9c0f-8ada81266162 could not be found. Oct 27 19:02:03.832048 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:03.832048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-521688e4-38cf-427c-bc79-a8081654da52 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Returning 404 to user: Instance 06a0b276-1f26-4c66-9c0f-8ada81266162 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:03.832048 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-521688e4-38cf-427c-bc79-a8081654da52 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162" status: 404 len: 111 microversion: 2.1 time: 0.109149 Oct 27 19:02:03.832048 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1763/3699] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:03 2022] GET /compute/v2.1/servers/06a0b276-1f26-4c66-9c0f-8ada81266162 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:02:04.373467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-878807cc-ba41-4775-ba89-8b8ef6300b02 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:04.374951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-878807cc-ba41-4775-ba89-8b8ef6300b02 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:04.402777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-878807cc-ba41-4775-ba89-8b8ef6300b02 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:04.403773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-878807cc-ba41-4775-ba89-8b8ef6300b02 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:04.404546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-878807cc-ba41-4775-ba89-8b8ef6300b02 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:04.405470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-878807cc-ba41-4775-ba89-8b8ef6300b02 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:04.406868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-878807cc-ba41-4775-ba89-8b8ef6300b02 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:04.417361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-878807cc-ba41-4775-ba89-8b8ef6300b02 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:04.934695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-878807cc-ba41-4775-ba89-8b8ef6300b02 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:04.982087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-878807cc-ba41-4775-ba89-8b8ef6300b02 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:04.996811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-878807cc-ba41-4775-ba89-8b8ef6300b02 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:04.998252 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-878807cc-ba41-4775-ba89-8b8ef6300b02 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1750 microversion: 2.20 time: 0.631105 Oct 27 19:02:05.004896 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1937/3700] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:04 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1750 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:06.038999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1d5932fc-6241-436d-9c9a-f47946a51801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:06.040364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1d5932fc-6241-436d-9c9a-f47946a51801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:06.060813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d5932fc-6241-436d-9c9a-f47946a51801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:06.061472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d5932fc-6241-436d-9c9a-f47946a51801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:06.062617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d5932fc-6241-436d-9c9a-f47946a51801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:06.068513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d5932fc-6241-436d-9c9a-f47946a51801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:06.074058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d5932fc-6241-436d-9c9a-f47946a51801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:06.076931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d5932fc-6241-436d-9c9a-f47946a51801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:07.051729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1d5932fc-6241-436d-9c9a-f47946a51801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:07.103902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1d5932fc-6241-436d-9c9a-f47946a51801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:07.115985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1d5932fc-6241-436d-9c9a-f47946a51801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:07.135977 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1d5932fc-6241-436d-9c9a-f47946a51801 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 1.102705 Oct 27 19:02:07.144193 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1764/3701] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:06 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:08.187077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-82380081-4cd5-4560-af94-6b49131caf9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:08.191850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-82380081-4cd5-4560-af94-6b49131caf9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:08.215207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82380081-4cd5-4560-af94-6b49131caf9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:08.215938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82380081-4cd5-4560-af94-6b49131caf9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:08.217631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82380081-4cd5-4560-af94-6b49131caf9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:08.223140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82380081-4cd5-4560-af94-6b49131caf9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:08.224389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82380081-4cd5-4560-af94-6b49131caf9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:08.225415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82380081-4cd5-4560-af94-6b49131caf9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:09.543204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-82380081-4cd5-4560-af94-6b49131caf9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:09.559791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-82380081-4cd5-4560-af94-6b49131caf9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:09.565360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-82380081-4cd5-4560-af94-6b49131caf9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:09.569544 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-82380081-4cd5-4560-af94-6b49131caf9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 1.387964 Oct 27 19:02:09.572664 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1938/3702] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:08 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:10.519299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c91a87be-a5ff-4eeb-9b52-7c1351e57932 req-ac4a9b34-4ef7-45b1-b0e6-a317c0b5eddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a7713a-b78d-425e-a6e8-0e4f5bc8904b", "tag": "9f402fdb-d277-4b7a-b6cc-275f32214caf"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:10.558128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c91a87be-a5ff-4eeb-9b52-7c1351e57932 req-ac4a9b34-4ef7-45b1-b0e6-a317c0b5eddd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:10.558128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c91a87be-a5ff-4eeb-9b52-7c1351e57932 req-ac4a9b34-4ef7-45b1-b0e6-a317c0b5eddd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:10.558128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c91a87be-a5ff-4eeb-9b52-7c1351e57932 req-ac4a9b34-4ef7-45b1-b0e6-a317c0b5eddd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:10.596972 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c91a87be-a5ff-4eeb-9b52-7c1351e57932 req-ac4a9b34-4ef7-45b1-b0e6-a317c0b5eddd service nova] Creating event network-changed:9f402fdb-d277-4b7a-b6cc-275f32214caf for instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b on n-h2-860687-3 Oct 27 19:02:10.603015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e91f6219-edf2-4a89-b872-55960c1b4abf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:10.603518 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c91a87be-a5ff-4eeb-9b52-7c1351e57932 req-ac4a9b34-4ef7-45b1-b0e6-a317c0b5eddd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088215 Oct 27 19:02:10.603650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e91f6219-edf2-4a89-b872-55960c1b4abf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:10.604137 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1765/3703] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:10.626797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e91f6219-edf2-4a89-b872-55960c1b4abf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:10.627324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e91f6219-edf2-4a89-b872-55960c1b4abf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:10.627784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e91f6219-edf2-4a89-b872-55960c1b4abf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:10.628516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e91f6219-edf2-4a89-b872-55960c1b4abf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:10.629016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e91f6219-edf2-4a89-b872-55960c1b4abf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:10.629465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e91f6219-edf2-4a89-b872-55960c1b4abf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:11.226431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e91f6219-edf2-4a89-b872-55960c1b4abf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:11.248608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e91f6219-edf2-4a89-b872-55960c1b4abf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:11.254498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e91f6219-edf2-4a89-b872-55960c1b4abf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:11.256073 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e91f6219-edf2-4a89-b872-55960c1b4abf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.658148 Oct 27 19:02:11.256910 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1939/3704] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:10 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:02:11.757133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-944493374", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:11.899140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:02:12.288272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-98e3aa2f-52a6-4440-a336-022b0ad46ae9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:12.290261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-98e3aa2f-52a6-4440-a336-022b0ad46ae9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:12.301745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e3aa2f-52a6-4440-a336-022b0ad46ae9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:12.307414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e3aa2f-52a6-4440-a336-022b0ad46ae9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:12.308071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e3aa2f-52a6-4440-a336-022b0ad46ae9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:12.309185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e3aa2f-52a6-4440-a336-022b0ad46ae9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:12.310509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e3aa2f-52a6-4440-a336-022b0ad46ae9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:12.314920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e3aa2f-52a6-4440-a336-022b0ad46ae9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:13.216314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:02:13.216899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:02:13.217218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:02:13.217691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:02:13.227539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:02:13.235954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-98e3aa2f-52a6-4440-a336-022b0ad46ae9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:13.247682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-98e3aa2f-52a6-4440-a336-022b0ad46ae9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:13.249183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-98e3aa2f-52a6-4440-a336-022b0ad46ae9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:13.260725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:13.261287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:13.261783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:13.262647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:13.263158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:13.263660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:13.264693 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-98e3aa2f-52a6-4440-a336-022b0ad46ae9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.967300 Oct 27 19:02:13.265488 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1940/3705] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:12 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:13.307651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Getting quotas for project 966aa5bddffa45cda17ec34ac50a439d. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:02:13.319052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Getting quotas for user ea63f2012f7b47eebd9d8fd9fbf14767 and project 966aa5bddffa45cda17ec34ac50a439d. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:02:13.342429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:02:13.345388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:02:13.432733 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b5694f6d-c5e3-46ea-a291-55254b51be20 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.680530 Oct 27 19:02:13.440531 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1766/3706] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:02:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:02:13.449328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-775f1b52-e9e2-4830-ae33-1ec253af47c7 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:13.449886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-775f1b52-e9e2-4830-ae33-1ec253af47c7 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:13.867872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-775f1b52-e9e2-4830-ae33-1ec253af47c7 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:13.894108 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-775f1b52-e9e2-4830-ae33-1ec253af47c7 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1213 microversion: 2.1 time: 0.451421 Oct 27 19:02:13.895168 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1941/3707] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:13 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1213 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:14.298768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f2c4913f-cd61-4723-9b98-0cdf4cd0e354 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:14.300135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f2c4913f-cd61-4723-9b98-0cdf4cd0e354 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:14.326026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2c4913f-cd61-4723-9b98-0cdf4cd0e354 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:14.326771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2c4913f-cd61-4723-9b98-0cdf4cd0e354 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:14.327420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2c4913f-cd61-4723-9b98-0cdf4cd0e354 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:14.329216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2c4913f-cd61-4723-9b98-0cdf4cd0e354 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:14.333033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2c4913f-cd61-4723-9b98-0cdf4cd0e354 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:14.338918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2c4913f-cd61-4723-9b98-0cdf4cd0e354 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:14.921652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cb138991-66d7-49c5-92d2-d87cbe456407 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:14.922564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cb138991-66d7-49c5-92d2-d87cbe456407 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:14.945758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb138991-66d7-49c5-92d2-d87cbe456407 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:14.949660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb138991-66d7-49c5-92d2-d87cbe456407 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:14.952064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb138991-66d7-49c5-92d2-d87cbe456407 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:14.953910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb138991-66d7-49c5-92d2-d87cbe456407 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:14.957853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb138991-66d7-49c5-92d2-d87cbe456407 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:14.958653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb138991-66d7-49c5-92d2-d87cbe456407 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:15.023641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f2c4913f-cd61-4723-9b98-0cdf4cd0e354 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:15.058998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f2c4913f-cd61-4723-9b98-0cdf4cd0e354 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:15.069363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f2c4913f-cd61-4723-9b98-0cdf4cd0e354 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:15.072396 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f2c4913f-cd61-4723-9b98-0cdf4cd0e354 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.779403 Oct 27 19:02:15.081567 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1767/3708] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:14 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:15.323245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cb138991-66d7-49c5-92d2-d87cbe456407 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:15.343443 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cb138991-66d7-49c5-92d2-d87cbe456407 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1217 microversion: 2.1 time: 0.426208 Oct 27 19:02:15.344852 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1942/3709] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:14 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1217 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:16.124274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0268d1e7-acf5-466d-8170-f3361c96e4a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:16.126020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0268d1e7-acf5-466d-8170-f3361c96e4a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:16.147002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0268d1e7-acf5-466d-8170-f3361c96e4a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:16.150051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0268d1e7-acf5-466d-8170-f3361c96e4a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:16.151676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0268d1e7-acf5-466d-8170-f3361c96e4a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:16.155233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0268d1e7-acf5-466d-8170-f3361c96e4a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:16.156118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0268d1e7-acf5-466d-8170-f3361c96e4a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:16.157787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0268d1e7-acf5-466d-8170-f3361c96e4a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:16.375417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4911355b-15fd-4996-8f82-820a32013146 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:16.376186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4911355b-15fd-4996-8f82-820a32013146 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:16.440142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4911355b-15fd-4996-8f82-820a32013146 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:16.442443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4911355b-15fd-4996-8f82-820a32013146 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:16.445456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4911355b-15fd-4996-8f82-820a32013146 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:16.453369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4911355b-15fd-4996-8f82-820a32013146 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:16.454499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4911355b-15fd-4996-8f82-820a32013146 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:16.458164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4911355b-15fd-4996-8f82-820a32013146 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:16.678234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4911355b-15fd-4996-8f82-820a32013146 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:16.688839 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4911355b-15fd-4996-8f82-820a32013146 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1273 microversion: 2.1 time: 0.317924 Oct 27 19:02:16.703879 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1943/3710] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:16 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1273 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:17.395308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0268d1e7-acf5-466d-8170-f3361c96e4a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:17.409946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0268d1e7-acf5-466d-8170-f3361c96e4a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:17.420730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0268d1e7-acf5-466d-8170-f3361c96e4a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:17.426113 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0268d1e7-acf5-466d-8170-f3361c96e4a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 1.318857 Oct 27 19:02:17.443968 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1768/3711] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:16 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:17.717007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d2d8605-16a9-4c4a-9ac0-27c2c5f3197e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:17.718184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9d2d8605-16a9-4c4a-9ac0-27c2c5f3197e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:17.732749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d2d8605-16a9-4c4a-9ac0-27c2c5f3197e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:17.739507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d2d8605-16a9-4c4a-9ac0-27c2c5f3197e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:17.741225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d2d8605-16a9-4c4a-9ac0-27c2c5f3197e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:17.742940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d2d8605-16a9-4c4a-9ac0-27c2c5f3197e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:17.747824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d2d8605-16a9-4c4a-9ac0-27c2c5f3197e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:17.750461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d2d8605-16a9-4c4a-9ac0-27c2c5f3197e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:17.998142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9d2d8605-16a9-4c4a-9ac0-27c2c5f3197e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:18.017398 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9d2d8605-16a9-4c4a-9ac0-27c2c5f3197e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1271 microversion: 2.1 time: 0.304617 Oct 27 19:02:18.018097 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1944/3712] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:17 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1271 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:18.457746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-80a407ec-5653-43a6-8076-d4aec7fd9986 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:18.458990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-80a407ec-5653-43a6-8076-d4aec7fd9986 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:18.519109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80a407ec-5653-43a6-8076-d4aec7fd9986 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:18.522052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80a407ec-5653-43a6-8076-d4aec7fd9986 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:18.524593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80a407ec-5653-43a6-8076-d4aec7fd9986 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:18.529354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80a407ec-5653-43a6-8076-d4aec7fd9986 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:18.532367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80a407ec-5653-43a6-8076-d4aec7fd9986 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:18.534559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80a407ec-5653-43a6-8076-d4aec7fd9986 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:19.047466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-914659cf-f206-4732-ab40-a48111f4e815 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:19.049461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-914659cf-f206-4732-ab40-a48111f4e815 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:19.070236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-914659cf-f206-4732-ab40-a48111f4e815 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:19.072428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-914659cf-f206-4732-ab40-a48111f4e815 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:19.074666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-914659cf-f206-4732-ab40-a48111f4e815 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:19.077631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-914659cf-f206-4732-ab40-a48111f4e815 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:19.080363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-914659cf-f206-4732-ab40-a48111f4e815 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:19.081816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-914659cf-f206-4732-ab40-a48111f4e815 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:19.131831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:19.262914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-914659cf-f206-4732-ab40-a48111f4e815 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:19.276214 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-914659cf-f206-4732-ab40-a48111f4e815 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1271 microversion: 2.1 time: 0.234905 Oct 27 19:02:19.276804 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1945/3713] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:19 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:19.713739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-80a407ec-5653-43a6-8076-d4aec7fd9986 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:19.745818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-80a407ec-5653-43a6-8076-d4aec7fd9986 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:19.760410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-80a407ec-5653-43a6-8076-d4aec7fd9986 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:19.765125 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-80a407ec-5653-43a6-8076-d4aec7fd9986 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 1.314002 Oct 27 19:02:19.771178 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1769/3714] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:18 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:20.139271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-91449405-daa4-4fe2-a1c1-8a89690a7c1a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:20.139881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-91449405-daa4-4fe2-a1c1-8a89690a7c1a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:20.161672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91449405-daa4-4fe2-a1c1-8a89690a7c1a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:20.164716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91449405-daa4-4fe2-a1c1-8a89690a7c1a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:20.165596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91449405-daa4-4fe2-a1c1-8a89690a7c1a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:20.167458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91449405-daa4-4fe2-a1c1-8a89690a7c1a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:20.170069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91449405-daa4-4fe2-a1c1-8a89690a7c1a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:20.172141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91449405-daa4-4fe2-a1c1-8a89690a7c1a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:20.261526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-91449405-daa4-4fe2-a1c1-8a89690a7c1a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:02:20.300743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e08223bb-3224-4f29-b99e-087bc6062e40 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:20.301366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e08223bb-3224-4f29-b99e-087bc6062e40 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:20.329777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e08223bb-3224-4f29-b99e-087bc6062e40 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:20.330292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e08223bb-3224-4f29-b99e-087bc6062e40 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:20.330771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e08223bb-3224-4f29-b99e-087bc6062e40 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:20.331502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e08223bb-3224-4f29-b99e-087bc6062e40 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:20.331968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e08223bb-3224-4f29-b99e-087bc6062e40 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:20.332402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e08223bb-3224-4f29-b99e-087bc6062e40 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:20.478874 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-91449405-daa4-4fe2-a1c1-8a89690a7c1a tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "DELETE /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 204 len: 0 microversion: 2.1 time: 0.345946 Oct 27 19:02:20.481285 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1946/3715] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:02:20 2022] DELETE /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:02:20.491493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-54fb5062-78e8-43ec-b342-aea29d4fcd7b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:20.497384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-54fb5062-78e8-43ec-b342-aea29d4fcd7b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:20.514470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54fb5062-78e8-43ec-b342-aea29d4fcd7b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:20.515324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54fb5062-78e8-43ec-b342-aea29d4fcd7b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:20.518770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54fb5062-78e8-43ec-b342-aea29d4fcd7b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:20.519823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54fb5062-78e8-43ec-b342-aea29d4fcd7b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:20.520572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54fb5062-78e8-43ec-b342-aea29d4fcd7b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:20.522146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54fb5062-78e8-43ec-b342-aea29d4fcd7b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:21.005982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-54fb5062-78e8-43ec-b342-aea29d4fcd7b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:21.022861 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-54fb5062-78e8-43ec-b342-aea29d4fcd7b tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1669 microversion: 2.1 time: 0.535371 Oct 27 19:02:21.026198 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1947/3716] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:20 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1669 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:21.040157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8df28f76-d84e-4bdc-b63e-8025fabf6e5e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:21.042302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8df28f76-d84e-4bdc-b63e-8025fabf6e5e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:21.057751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8df28f76-d84e-4bdc-b63e-8025fabf6e5e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:21.058427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8df28f76-d84e-4bdc-b63e-8025fabf6e5e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:21.058896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8df28f76-d84e-4bdc-b63e-8025fabf6e5e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:21.059637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8df28f76-d84e-4bdc-b63e-8025fabf6e5e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:21.060262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8df28f76-d84e-4bdc-b63e-8025fabf6e5e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:21.060707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8df28f76-d84e-4bdc-b63e-8025fabf6e5e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:21.218638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e08223bb-3224-4f29-b99e-087bc6062e40 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:21.240879 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e08223bb-3224-4f29-b99e-087bc6062e40 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1313 microversion: 2.1 time: 0.944477 Oct 27 19:02:21.245547 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1770/3717] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:20 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1313 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:21.513887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8df28f76-d84e-4bdc-b63e-8025fabf6e5e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:21.549917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8df28f76-d84e-4bdc-b63e-8025fabf6e5e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:21.551915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8df28f76-d84e-4bdc-b63e-8025fabf6e5e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:21.567955 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8df28f76-d84e-4bdc-b63e-8025fabf6e5e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.536637 Oct 27 19:02:21.568899 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1948/3718] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:21 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:22.059194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e75bf7f2-cb10-4cf5-88aa-6a1942bf9564 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:22.059194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e75bf7f2-cb10-4cf5-88aa-6a1942bf9564 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:22.064633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:22.126885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e75bf7f2-cb10-4cf5-88aa-6a1942bf9564 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:22.127792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e75bf7f2-cb10-4cf5-88aa-6a1942bf9564 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:22.128807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e75bf7f2-cb10-4cf5-88aa-6a1942bf9564 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:22.130032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e75bf7f2-cb10-4cf5-88aa-6a1942bf9564 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:22.132135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e75bf7f2-cb10-4cf5-88aa-6a1942bf9564 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:22.139174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e75bf7f2-cb10-4cf5-88aa-6a1942bf9564 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:22.294545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1ed28b02-193e-4391-a7cc-1bc3b7d1a2e0 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:22.295213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1ed28b02-193e-4391-a7cc-1bc3b7d1a2e0 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:22.322095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ed28b02-193e-4391-a7cc-1bc3b7d1a2e0 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:22.323929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ed28b02-193e-4391-a7cc-1bc3b7d1a2e0 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:22.326482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ed28b02-193e-4391-a7cc-1bc3b7d1a2e0 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:22.328608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ed28b02-193e-4391-a7cc-1bc3b7d1a2e0 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:22.330882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ed28b02-193e-4391-a7cc-1bc3b7d1a2e0 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:22.332515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ed28b02-193e-4391-a7cc-1bc3b7d1a2e0 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:22.522952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e75bf7f2-cb10-4cf5-88aa-6a1942bf9564 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:22.541933 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e75bf7f2-cb10-4cf5-88aa-6a1942bf9564 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1669 microversion: 2.1 time: 0.493508 Oct 27 19:02:22.546597 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1771/3719] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:22 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1669 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:22.615710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9486c370-9b29-44cb-ba1a-26036c814535 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:22.616587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9486c370-9b29-44cb-ba1a-26036c814535 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:22.639608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9486c370-9b29-44cb-ba1a-26036c814535 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:22.640303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9486c370-9b29-44cb-ba1a-26036c814535 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:22.644830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9486c370-9b29-44cb-ba1a-26036c814535 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:22.650809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9486c370-9b29-44cb-ba1a-26036c814535 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:22.651398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9486c370-9b29-44cb-ba1a-26036c814535 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:22.651866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9486c370-9b29-44cb-ba1a-26036c814535 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:23.147331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9486c370-9b29-44cb-ba1a-26036c814535 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:23.168818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9486c370-9b29-44cb-ba1a-26036c814535 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:23.170768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9486c370-9b29-44cb-ba1a-26036c814535 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:23.174741 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9486c370-9b29-44cb-ba1a-26036c814535 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.562603 Oct 27 19:02:23.175755 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1772/3720] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:22 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:02:23.251140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1ed28b02-193e-4391-a7cc-1bc3b7d1a2e0 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:23.276991 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1ed28b02-193e-4391-a7cc-1bc3b7d1a2e0 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1313 microversion: 2.1 time: 0.984426 Oct 27 19:02:23.281323 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1949/3721] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:22 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1313 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:23.575447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c43dc2b9-c391-428b-9b89-8c0c7601bc30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:23.588521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c43dc2b9-c391-428b-9b89-8c0c7601bc30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:23.604558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:23.606124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:23.608559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c43dc2b9-c391-428b-9b89-8c0c7601bc30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:23.610710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c43dc2b9-c391-428b-9b89-8c0c7601bc30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:23.612473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c43dc2b9-c391-428b-9b89-8c0c7601bc30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:23.613797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c43dc2b9-c391-428b-9b89-8c0c7601bc30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:23.615970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c43dc2b9-c391-428b-9b89-8c0c7601bc30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:23.618084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c43dc2b9-c391-428b-9b89-8c0c7601bc30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:23.674781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ac91adcc-3786-4e01-9e8e-dd3c6001824d req-8fd91f36-43e7-40bb-b7ed-18b91926dc00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d48593-3e33-41d9-a5f0-f4d1e52d7b55", "tag": "aaf42184-af5c-47cf-ba3b-8943199e8ed6"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:23.719571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ac91adcc-3786-4e01-9e8e-dd3c6001824d req-8fd91f36-43e7-40bb-b7ed-18b91926dc00 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:23.720467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ac91adcc-3786-4e01-9e8e-dd3c6001824d req-8fd91f36-43e7-40bb-b7ed-18b91926dc00 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:23.721508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ac91adcc-3786-4e01-9e8e-dd3c6001824d req-8fd91f36-43e7-40bb-b7ed-18b91926dc00 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:23.769024 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ac91adcc-3786-4e01-9e8e-dd3c6001824d req-8fd91f36-43e7-40bb-b7ed-18b91926dc00 service nova] Creating event network-changed:aaf42184-af5c-47cf-ba3b-8943199e8ed6 for instance e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 on n-h1-860687-3 Oct 27 19:02:23.787628 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ac91adcc-3786-4e01-9e8e-dd3c6001824d req-8fd91f36-43e7-40bb-b7ed-18b91926dc00 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113962 Oct 27 19:02:23.790465 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1950/3722] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:24.165694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c43dc2b9-c391-428b-9b89-8c0c7601bc30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:24.189841 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c43dc2b9-c391-428b-9b89-8c0c7601bc30 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1669 microversion: 2.1 time: 0.623045 Oct 27 19:02:24.191422 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1773/3723] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:23 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1669 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:24.208079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:24.214987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-29d9a62f-3cc9-49f7-8771-6e2863a8c301 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:24.224355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-29d9a62f-3cc9-49f7-8771-6e2863a8c301 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:24.224355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29d9a62f-3cc9-49f7-8771-6e2863a8c301 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:24.224355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29d9a62f-3cc9-49f7-8771-6e2863a8c301 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:24.224971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29d9a62f-3cc9-49f7-8771-6e2863a8c301 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:24.225503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29d9a62f-3cc9-49f7-8771-6e2863a8c301 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:24.225745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29d9a62f-3cc9-49f7-8771-6e2863a8c301 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:24.226495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29d9a62f-3cc9-49f7-8771-6e2863a8c301 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:24.467420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-35c58b98-1b39-4639-9ecd-b4d87c90e842 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:24.468501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-35c58b98-1b39-4639-9ecd-b4d87c90e842 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:24.488220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35c58b98-1b39-4639-9ecd-b4d87c90e842 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:24.490252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35c58b98-1b39-4639-9ecd-b4d87c90e842 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:24.494376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35c58b98-1b39-4639-9ecd-b4d87c90e842 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:24.495881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35c58b98-1b39-4639-9ecd-b4d87c90e842 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:24.496752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35c58b98-1b39-4639-9ecd-b4d87c90e842 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:24.499229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35c58b98-1b39-4639-9ecd-b4d87c90e842 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:25.310321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-35c58b98-1b39-4639-9ecd-b4d87c90e842 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:25.324046 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-35c58b98-1b39-4639-9ecd-b4d87c90e842 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1313 microversion: 2.1 time: 0.861607 Oct 27 19:02:25.327953 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1774/3724] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:24 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1313 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:25.347536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-90ccdc1a-63a7-4e1e-97ad-6ba2e9b6ae2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:25.351375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-90ccdc1a-63a7-4e1e-97ad-6ba2e9b6ae2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:25.381690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90ccdc1a-63a7-4e1e-97ad-6ba2e9b6ae2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:25.384190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90ccdc1a-63a7-4e1e-97ad-6ba2e9b6ae2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:25.385969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90ccdc1a-63a7-4e1e-97ad-6ba2e9b6ae2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:25.390149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90ccdc1a-63a7-4e1e-97ad-6ba2e9b6ae2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:25.390999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90ccdc1a-63a7-4e1e-97ad-6ba2e9b6ae2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:25.396733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90ccdc1a-63a7-4e1e-97ad-6ba2e9b6ae2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:25.652620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-29d9a62f-3cc9-49f7-8771-6e2863a8c301 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:25.669975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-29d9a62f-3cc9-49f7-8771-6e2863a8c301 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:25.671922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-29d9a62f-3cc9-49f7-8771-6e2863a8c301 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:25.673421 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-29d9a62f-3cc9-49f7-8771-6e2863a8c301 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 1.466751 Oct 27 19:02:25.697562 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1951/3725] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:24 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:26.253410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-90ccdc1a-63a7-4e1e-97ad-6ba2e9b6ae2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:26.258939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:26.272758 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-90ccdc1a-63a7-4e1e-97ad-6ba2e9b6ae2e tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1669 microversion: 2.1 time: 0.942710 Oct 27 19:02:26.279994 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1775/3726] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:25 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1669 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:26.357102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e5e83c9a-e3a7-4664-b0c1-8a688fb00baf tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:26.357766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e5e83c9a-e3a7-4664-b0c1-8a688fb00baf tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:26.372929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5e83c9a-e3a7-4664-b0c1-8a688fb00baf tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:26.373474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5e83c9a-e3a7-4664-b0c1-8a688fb00baf tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:26.373934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5e83c9a-e3a7-4664-b0c1-8a688fb00baf tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:26.374711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5e83c9a-e3a7-4664-b0c1-8a688fb00baf tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:26.375183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5e83c9a-e3a7-4664-b0c1-8a688fb00baf tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:26.375626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5e83c9a-e3a7-4664-b0c1-8a688fb00baf tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:26.708822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-907d8676-3f6b-451a-8691-70fce1144825 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:26.709645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-907d8676-3f6b-451a-8691-70fce1144825 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:26.722030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-907d8676-3f6b-451a-8691-70fce1144825 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:26.722577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-907d8676-3f6b-451a-8691-70fce1144825 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:26.723072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-907d8676-3f6b-451a-8691-70fce1144825 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:26.723811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-907d8676-3f6b-451a-8691-70fce1144825 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:26.724278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-907d8676-3f6b-451a-8691-70fce1144825 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:26.724717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-907d8676-3f6b-451a-8691-70fce1144825 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:27.380834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-907d8676-3f6b-451a-8691-70fce1144825 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:27.408977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-907d8676-3f6b-451a-8691-70fce1144825 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:27.422360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-907d8676-3f6b-451a-8691-70fce1144825 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:27.427406 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-907d8676-3f6b-451a-8691-70fce1144825 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.722523 Oct 27 19:02:27.436426 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1776/3727] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:26 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:27.441818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1748d859-8f15-4c66-8e42-3bf7468ec5d9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:27.462012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1748d859-8f15-4c66-8e42-3bf7468ec5d9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:27.477120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1748d859-8f15-4c66-8e42-3bf7468ec5d9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:27.477618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1748d859-8f15-4c66-8e42-3bf7468ec5d9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:27.478317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1748d859-8f15-4c66-8e42-3bf7468ec5d9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:27.479348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1748d859-8f15-4c66-8e42-3bf7468ec5d9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:27.480039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1748d859-8f15-4c66-8e42-3bf7468ec5d9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:27.489790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1748d859-8f15-4c66-8e42-3bf7468ec5d9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:27.571827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-1748d859-8f15-4c66-8e42-3bf7468ec5d9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lazy-loading 'flavor' on Instance uuid 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:02:27.846142 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1748d859-8f15-4c66-8e42-3bf7468ec5d9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/action" status: 200 len: 32 microversion: 2.1 time: 0.408260 Oct 27 19:02:27.851985 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1777/3728] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:02:27 2022] POST /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/action => generated 32 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 19:02:27.867418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-555de194-f43f-40a4-b09b-b2e678e8b4f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:27.868657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-555de194-f43f-40a4-b09b-b2e678e8b4f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:27.884134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-555de194-f43f-40a4-b09b-b2e678e8b4f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:27.887157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-555de194-f43f-40a4-b09b-b2e678e8b4f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:27.888074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-555de194-f43f-40a4-b09b-b2e678e8b4f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:27.889417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e5e83c9a-e3a7-4664-b0c1-8a688fb00baf tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:27.890545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-555de194-f43f-40a4-b09b-b2e678e8b4f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:27.893475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-555de194-f43f-40a4-b09b-b2e678e8b4f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:27.894294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-555de194-f43f-40a4-b09b-b2e678e8b4f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:27.924463 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e5e83c9a-e3a7-4664-b0c1-8a688fb00baf tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1313 microversion: 2.1 time: 1.571711 Oct 27 19:02:27.931186 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1952/3729] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:26 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1313 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:27.949762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eafba2a3-a151-4c20-be2c-ea24dda09e77 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:27.953733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-eafba2a3-a151-4c20-be2c-ea24dda09e77 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:27.979609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:27.981140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eafba2a3-a151-4c20-be2c-ea24dda09e77 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:27.984220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eafba2a3-a151-4c20-be2c-ea24dda09e77 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:27.987091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eafba2a3-a151-4c20-be2c-ea24dda09e77 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:27.988044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eafba2a3-a151-4c20-be2c-ea24dda09e77 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:27.988817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eafba2a3-a151-4c20-be2c-ea24dda09e77 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:27.994727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eafba2a3-a151-4c20-be2c-ea24dda09e77 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:28.497411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-eafba2a3-a151-4c20-be2c-ea24dda09e77 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:28.527999 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eafba2a3-a151-4c20-be2c-ea24dda09e77 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.599882 Oct 27 19:02:28.529168 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1953/3730] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:27 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:28.552962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f8b51c51-186e-42e8-8550-7b4d745d45a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:28.553716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f8b51c51-186e-42e8-8550-7b4d745d45a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:28.565827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8b51c51-186e-42e8-8550-7b4d745d45a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:28.566482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8b51c51-186e-42e8-8550-7b4d745d45a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:28.566953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8b51c51-186e-42e8-8550-7b4d745d45a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:28.567715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8b51c51-186e-42e8-8550-7b4d745d45a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:28.568224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8b51c51-186e-42e8-8550-7b4d745d45a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:28.568665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8b51c51-186e-42e8-8550-7b4d745d45a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:28.614042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-555de194-f43f-40a4-b09b-b2e678e8b4f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:28.633229 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-555de194-f43f-40a4-b09b-b2e678e8b4f9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1601 microversion: 2.1 time: 0.778847 Oct 27 19:02:28.633845 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1778/3731] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:27 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1601 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:28.847907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d7282872-1473-4e2f-b4a9-96abcb2c2f88 req-c8e5f692-e1ad-4078-bf29-d56aa6198af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69afa571-c5fa-4091-9ce1-5dd147316161", "name": "network-vif-deleted", "tag": "a647c899-2362-49df-acbd-1cd3b9f8ec32"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:28.859072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d7282872-1473-4e2f-b4a9-96abcb2c2f88 req-c8e5f692-e1ad-4078-bf29-d56aa6198af7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:28.859924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d7282872-1473-4e2f-b4a9-96abcb2c2f88 req-c8e5f692-e1ad-4078-bf29-d56aa6198af7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:28.860601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d7282872-1473-4e2f-b4a9-96abcb2c2f88 req-c8e5f692-e1ad-4078-bf29-d56aa6198af7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:28.873063 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d7282872-1473-4e2f-b4a9-96abcb2c2f88 req-c8e5f692-e1ad-4078-bf29-d56aa6198af7 service nova] Creating event network-vif-deleted:a647c899-2362-49df-acbd-1cd3b9f8ec32 for instance 69afa571-c5fa-4091-9ce1-5dd147316161 on n-h2-860687-3 Oct 27 19:02:28.884251 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d7282872-1473-4e2f-b4a9-96abcb2c2f88 req-c8e5f692-e1ad-4078-bf29-d56aa6198af7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039937 Oct 27 19:02:28.884945 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1779/3732] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:02:28.959624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0ee3ebc6-24e0-4069-a23c-0cf1ef17c008 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:28.960353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0ee3ebc6-24e0-4069-a23c-0cf1ef17c008 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:28.983708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ee3ebc6-24e0-4069-a23c-0cf1ef17c008 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:28.984220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ee3ebc6-24e0-4069-a23c-0cf1ef17c008 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:28.988362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f8b51c51-186e-42e8-8550-7b4d745d45a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:28.991363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ee3ebc6-24e0-4069-a23c-0cf1ef17c008 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:28.992387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ee3ebc6-24e0-4069-a23c-0cf1ef17c008 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:28.992890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ee3ebc6-24e0-4069-a23c-0cf1ef17c008 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:28.993512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ee3ebc6-24e0-4069-a23c-0cf1ef17c008 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:28.999783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f8b51c51-186e-42e8-8550-7b4d745d45a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:29.002956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f8b51c51-186e-42e8-8550-7b4d745d45a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:29.004529 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f8b51c51-186e-42e8-8550-7b4d745d45a1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.473826 Oct 27 19:02:29.018789 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1954/3733] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:28 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:29.165261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0ee3ebc6-24e0-4069-a23c-0cf1ef17c008 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:29.173726 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0ee3ebc6-24e0-4069-a23c-0cf1ef17c008 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1313 microversion: 2.1 time: 0.218295 Oct 27 19:02:29.174933 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1780/3734] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:28 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:29.385636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-35f3a0eb-4596-43b6-af2f-2f40e3faa1aa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:29.386453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-35f3a0eb-4596-43b6-af2f-2f40e3faa1aa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:29.394144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35f3a0eb-4596-43b6-af2f-2f40e3faa1aa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:29.394886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35f3a0eb-4596-43b6-af2f-2f40e3faa1aa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:29.395485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35f3a0eb-4596-43b6-af2f-2f40e3faa1aa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:29.396371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35f3a0eb-4596-43b6-af2f-2f40e3faa1aa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:29.396985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35f3a0eb-4596-43b6-af2f-2f40e3faa1aa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:29.397587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35f3a0eb-4596-43b6-af2f-2f40e3faa1aa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:29.442555 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-35f3a0eb-4596-43b6-af2f-2f40e3faa1aa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3/ips" status: 200 len: 150 microversion: 2.1 time: 0.061473 Oct 27 19:02:29.450969 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1955/3735] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 19:02:29 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3/ips => generated 150 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:29.456863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-298d9c79-d12b-47e7-9f96-07e4aad170dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4db88c3-83c5-403c-a197-7044b7c96f82"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:29.460166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-298d9c79-d12b-47e7-9f96-07e4aad170dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:29.468542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-298d9c79-d12b-47e7-9f96-07e4aad170dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:29.470188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-298d9c79-d12b-47e7-9f96-07e4aad170dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:29.470977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-298d9c79-d12b-47e7-9f96-07e4aad170dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:29.472897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-298d9c79-d12b-47e7-9f96-07e4aad170dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:29.473633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-298d9c79-d12b-47e7-9f96-07e4aad170dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:29.474264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-298d9c79-d12b-47e7-9f96-07e4aad170dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:29.553659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-494de995-1fed-476b-af04-61afe49b405a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:29.555183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-494de995-1fed-476b-af04-61afe49b405a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:29.564151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-494de995-1fed-476b-af04-61afe49b405a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:29.564860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-494de995-1fed-476b-af04-61afe49b405a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:29.565651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-494de995-1fed-476b-af04-61afe49b405a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:29.567022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-494de995-1fed-476b-af04-61afe49b405a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:29.567794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-494de995-1fed-476b-af04-61afe49b405a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:29.568392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-494de995-1fed-476b-af04-61afe49b405a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:29.683973 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-298d9c79-d12b-47e7-9f96-07e4aad170dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] HTTP exception thrown: Invalid volume: volume c4db88c3-83c5-403c-a197-7044b7c96f82 is already attached to instances: 673d7d02-3b01-418e-825a-8c7ccaffa820 Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-298d9c79-d12b-47e7-9f96-07e4aad170dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Request method failure captured: Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3/os-volume_attachments HTTP/1.1 Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 74 Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtT5H8XP7V9L0TVuuJvAuBoxNkhZhgX8XkK4-GpzHComWgmbBONfMudM4Q8yHeohsrOhf9YccVlwgfDyUGCChaGZWmGukZPYKh-mvkrZX3vZytXvdyVczNY7QyQ7kdcUBjknkaFKQkxOgdDbrstleWDjGVR0bmb658DtZfuMHYOhmds Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52ccbe7e63ab48199790f4676bbf2580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2be49f7bea7a4c8fbf289594e635fd69 Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: {"volumeAttachment": {"volumeId": "c4db88c3-83c5-403c-a197-7044b7c96f82"}} Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid volume: volume c4db88c3-83c5-403c-a197-7044b7c96f82 is already attached to instances: 673d7d02-3b01-418e-825a-8c7ccaffa820 Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'server_id': '0b227794-9896-4ec9-b8a1-3b1f3cce38c3', 'body': {'volumeAttachment': {'volumeId': 'c4db88c3-83c5-403c-a197-7044b7c96f82'}}} Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c4db88c3-83c5-403c-a197-7044b7c96f82 is already attached to instances: 673d7d02-3b01-418e-825a-8c7ccaffa820 Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:29.686592 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c4db88c3-83c5-403c-a197-7044b7c96f82 is already attached to instances: 673d7d02-3b01-418e-825a-8c7ccaffa820 Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c4db88c3-83c5-403c-a197-7044b7c96f82 is already attached to instances: 673d7d02-3b01-418e-825a-8c7ccaffa820 Oct 27 19:02:29.690317 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:29.692038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-298d9c79-d12b-47e7-9f96-07e4aad170dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Returning 400 to user: Invalid volume: volume c4db88c3-83c5-403c-a197-7044b7c96f82 is already attached to instances: 673d7d02-3b01-418e-825a-8c7ccaffa820 {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:29.693274 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-298d9c79-d12b-47e7-9f96-07e4aad170dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "POST /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.240696 Oct 27 19:02:29.694346 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1781/3736] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:02:29 2022] POST /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3/os-volume_attachments => generated 174 bytes in 243 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:02:29.699383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-07b8d532-5d35-40ff-a584-3168cabe3bd6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:29.700319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-07b8d532-5d35-40ff-a584-3168cabe3bd6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:29.707413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07b8d532-5d35-40ff-a584-3168cabe3bd6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:29.708297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07b8d532-5d35-40ff-a584-3168cabe3bd6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:29.708892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07b8d532-5d35-40ff-a584-3168cabe3bd6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:29.709827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07b8d532-5d35-40ff-a584-3168cabe3bd6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:29.710550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07b8d532-5d35-40ff-a584-3168cabe3bd6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:29.711139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07b8d532-5d35-40ff-a584-3168cabe3bd6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:29.820843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-07b8d532-5d35-40ff-a584-3168cabe3bd6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:29.839178 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-07b8d532-5d35-40ff-a584-3168cabe3bd6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1601 microversion: 2.1 time: 0.139293 Oct 27 19:02:29.850427 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1782/3737] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:29 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1601 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:29.854893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a9429906-d032-4c63-b32e-17c49f41094c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:29.864038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-494de995-1fed-476b-af04-61afe49b405a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:29.864393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a9429906-d032-4c63-b32e-17c49f41094c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:29.880283 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-494de995-1fed-476b-af04-61afe49b405a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.331184 Oct 27 19:02:29.881190 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1956/3738] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:29 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:29.889497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9429906-d032-4c63-b32e-17c49f41094c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:29.890011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9429906-d032-4c63-b32e-17c49f41094c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:29.890521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9429906-d032-4c63-b32e-17c49f41094c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:29.893760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9429906-d032-4c63-b32e-17c49f41094c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:29.894249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9429906-d032-4c63-b32e-17c49f41094c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:29.894801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9429906-d032-4c63-b32e-17c49f41094c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:29.977623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a9429906-d032-4c63-b32e-17c49f41094c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:02:30.032829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d78a6983-8274-4ebb-ad8e-196eff761ff1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:30.034286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d78a6983-8274-4ebb-ad8e-196eff761ff1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:30.048170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d78a6983-8274-4ebb-ad8e-196eff761ff1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:30.048773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d78a6983-8274-4ebb-ad8e-196eff761ff1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:30.049451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d78a6983-8274-4ebb-ad8e-196eff761ff1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:30.051584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d78a6983-8274-4ebb-ad8e-196eff761ff1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:30.052250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d78a6983-8274-4ebb-ad8e-196eff761ff1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:30.053671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d78a6983-8274-4ebb-ad8e-196eff761ff1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:30.166543 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a9429906-d032-4c63-b32e-17c49f41094c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 204 len: 0 microversion: 2.1 time: 0.322789 Oct 27 19:02:30.167327 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1783/3739] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:02:29 2022] DELETE /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:02:30.177355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d35b2912-40b4-4ed4-aff9-da77e61553c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:30.178829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d35b2912-40b4-4ed4-aff9-da77e61553c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:30.187188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d35b2912-40b4-4ed4-aff9-da77e61553c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:30.188727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d35b2912-40b4-4ed4-aff9-da77e61553c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:30.189463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d35b2912-40b4-4ed4-aff9-da77e61553c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:30.190629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d35b2912-40b4-4ed4-aff9-da77e61553c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:30.191829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d35b2912-40b4-4ed4-aff9-da77e61553c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:30.192480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d35b2912-40b4-4ed4-aff9-da77e61553c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:30.503175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d35b2912-40b4-4ed4-aff9-da77e61553c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:30.520513 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d35b2912-40b4-4ed4-aff9-da77e61553c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1681 microversion: 2.1 time: 0.348125 Oct 27 19:02:30.546906 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1784/3740] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:30 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1681 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:30.553863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-976fbfcf-a82e-417d-adc3-8e233ac379bb tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:30.555143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-976fbfcf-a82e-417d-adc3-8e233ac379bb tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:30.573836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-976fbfcf-a82e-417d-adc3-8e233ac379bb tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:30.574719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-976fbfcf-a82e-417d-adc3-8e233ac379bb tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:30.575385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-976fbfcf-a82e-417d-adc3-8e233ac379bb tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:30.588979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-976fbfcf-a82e-417d-adc3-8e233ac379bb tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:30.589613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-976fbfcf-a82e-417d-adc3-8e233ac379bb tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:30.590086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-976fbfcf-a82e-417d-adc3-8e233ac379bb tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:30.789326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-976fbfcf-a82e-417d-adc3-8e233ac379bb tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:30.799982 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-976fbfcf-a82e-417d-adc3-8e233ac379bb tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1313 microversion: 2.1 time: 0.251311 Oct 27 19:02:30.800848 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1785/3741] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:30 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:30.854639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d78a6983-8274-4ebb-ad8e-196eff761ff1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:30.863896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d78a6983-8274-4ebb-ad8e-196eff761ff1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:30.865387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d78a6983-8274-4ebb-ad8e-196eff761ff1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:30.866067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f43a233b-8d94-4fae-9b9b-318f79092dc7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:30.867156 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d78a6983-8274-4ebb-ad8e-196eff761ff1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.837888 Oct 27 19:02:30.867542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f43a233b-8d94-4fae-9b9b-318f79092dc7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:30.878115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f43a233b-8d94-4fae-9b9b-318f79092dc7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:30.879242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f43a233b-8d94-4fae-9b9b-318f79092dc7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:30.879879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f43a233b-8d94-4fae-9b9b-318f79092dc7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:30.880886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f43a233b-8d94-4fae-9b9b-318f79092dc7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:30.881539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f43a233b-8d94-4fae-9b9b-318f79092dc7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:30.882160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f43a233b-8d94-4fae-9b9b-318f79092dc7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:30.896796 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1957/3742] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:30 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:02:30.911162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a2c89e56-7af6-45af-80df-e464080ba84b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:30.911792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a2c89e56-7af6-45af-80df-e464080ba84b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:30.918277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2c89e56-7af6-45af-80df-e464080ba84b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:30.918823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2c89e56-7af6-45af-80df-e464080ba84b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:30.919277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2c89e56-7af6-45af-80df-e464080ba84b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:30.919996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2c89e56-7af6-45af-80df-e464080ba84b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:30.920461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2c89e56-7af6-45af-80df-e464080ba84b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:30.920900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2c89e56-7af6-45af-80df-e464080ba84b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:30.946332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f43a233b-8d94-4fae-9b9b-318f79092dc7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:30.946863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f43a233b-8d94-4fae-9b9b-318f79092dc7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:30.947314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f43a233b-8d94-4fae-9b9b-318f79092dc7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:30.948644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-f43a233b-8d94-4fae-9b9b-318f79092dc7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lazy-loading 'fault' on Instance uuid 69afa571-c5fa-4091-9ce1-5dd147316161 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:02:31.003406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f43a233b-8d94-4fae-9b9b-318f79092dc7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:31.016335 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f43a233b-8d94-4fae-9b9b-318f79092dc7 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 200 len: 1325 microversion: 2.1 time: 0.153702 Oct 27 19:02:31.018103 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1786/3743] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:30 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 1325 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:31.258704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a2c89e56-7af6-45af-80df-e464080ba84b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:31.267992 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a2c89e56-7af6-45af-80df-e464080ba84b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.360656 Oct 27 19:02:31.285698 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1958/3744] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:30 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:31.554622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e69bdef5-80be-4081-adf4-98de0e6b0cd5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:31.556073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e69bdef5-80be-4081-adf4-98de0e6b0cd5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:31.566905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e69bdef5-80be-4081-adf4-98de0e6b0cd5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:31.568331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e69bdef5-80be-4081-adf4-98de0e6b0cd5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:31.569140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e69bdef5-80be-4081-adf4-98de0e6b0cd5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:31.571522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e69bdef5-80be-4081-adf4-98de0e6b0cd5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:31.573656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e69bdef5-80be-4081-adf4-98de0e6b0cd5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:31.576145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e69bdef5-80be-4081-adf4-98de0e6b0cd5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:31.605659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-75705e4b-e061-4e09-937d-9015d1c9fdbe req-5559158d-848a-4840-aff3-172b8adf2a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d48593-3e33-41d9-a5f0-f4d1e52d7b55", "name": "network-vif-plugged", "status": "completed", "tag": "aaf42184-af5c-47cf-ba3b-8943199e8ed6"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:31.638491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-75705e4b-e061-4e09-937d-9015d1c9fdbe req-5559158d-848a-4840-aff3-172b8adf2a7a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:31.639570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-75705e4b-e061-4e09-937d-9015d1c9fdbe req-5559158d-848a-4840-aff3-172b8adf2a7a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:31.640228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-75705e4b-e061-4e09-937d-9015d1c9fdbe req-5559158d-848a-4840-aff3-172b8adf2a7a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:31.673236 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-75705e4b-e061-4e09-937d-9015d1c9fdbe req-5559158d-848a-4840-aff3-172b8adf2a7a service nova] Creating event network-vif-plugged:aaf42184-af5c-47cf-ba3b-8943199e8ed6 for instance e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 on n-h1-860687-3 Oct 27 19:02:31.690970 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-75705e4b-e061-4e09-937d-9015d1c9fdbe req-5559158d-848a-4840-aff3-172b8adf2a7a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089147 Oct 27 19:02:31.691624 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1959/3745] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:31.827409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3a428dfa-0210-41a5-8c6f-5233fee22e4b tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:31.828080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3a428dfa-0210-41a5-8c6f-5233fee22e4b tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:31.840695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a428dfa-0210-41a5-8c6f-5233fee22e4b tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:31.841210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a428dfa-0210-41a5-8c6f-5233fee22e4b tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:31.841661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a428dfa-0210-41a5-8c6f-5233fee22e4b tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:31.847115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a428dfa-0210-41a5-8c6f-5233fee22e4b tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:31.847643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a428dfa-0210-41a5-8c6f-5233fee22e4b tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:31.848108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a428dfa-0210-41a5-8c6f-5233fee22e4b tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:32.354642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3a428dfa-0210-41a5-8c6f-5233fee22e4b tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:32.372567 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3a428dfa-0210-41a5-8c6f-5233fee22e4b tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1313 microversion: 2.1 time: 0.549628 Oct 27 19:02:32.378787 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1960/3746] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:31 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1313 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:32.384771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e98ecf08-efbd-4d54-8983-02d8fb452f92 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:32.402238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e98ecf08-efbd-4d54-8983-02d8fb452f92 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:32.418257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e98ecf08-efbd-4d54-8983-02d8fb452f92 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:32.420197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e98ecf08-efbd-4d54-8983-02d8fb452f92 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:32.423340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e98ecf08-efbd-4d54-8983-02d8fb452f92 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:32.424618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e98ecf08-efbd-4d54-8983-02d8fb452f92 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:32.427482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e98ecf08-efbd-4d54-8983-02d8fb452f92 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:32.428113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e98ecf08-efbd-4d54-8983-02d8fb452f92 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:32.828011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e69bdef5-80be-4081-adf4-98de0e6b0cd5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:32.828523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e98ecf08-efbd-4d54-8983-02d8fb452f92 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:32.840803 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e69bdef5-80be-4081-adf4-98de0e6b0cd5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1681 microversion: 2.1 time: 1.293505 Oct 27 19:02:32.841220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:32.847184 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1787/3747] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:31 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1681 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:32.861406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6df2e35d-27e5-49d1-834d-b9fbfe294f46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:32.861886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e98ecf08-efbd-4d54-8983-02d8fb452f92 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:32.863449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e98ecf08-efbd-4d54-8983-02d8fb452f92 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:32.864679 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e98ecf08-efbd-4d54-8983-02d8fb452f92 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.484602 Oct 27 19:02:32.868612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6df2e35d-27e5-49d1-834d-b9fbfe294f46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 69afa571-c5fa-4091-9ce1-5dd147316161] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:32.882061 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1961/3748] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:32 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:32.888831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df2e35d-27e5-49d1-834d-b9fbfe294f46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:32.890248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df2e35d-27e5-49d1-834d-b9fbfe294f46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:32.890904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df2e35d-27e5-49d1-834d-b9fbfe294f46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:32.893790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df2e35d-27e5-49d1-834d-b9fbfe294f46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:32.894514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df2e35d-27e5-49d1-834d-b9fbfe294f46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:32.896601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df2e35d-27e5-49d1-834d-b9fbfe294f46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:32.903698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8c594a25-3a4f-4641-8f09-238542bb8786 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:32.904500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8c594a25-3a4f-4641-8f09-238542bb8786 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:32.927345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c594a25-3a4f-4641-8f09-238542bb8786 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:32.936526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c594a25-3a4f-4641-8f09-238542bb8786 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:32.937351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c594a25-3a4f-4641-8f09-238542bb8786 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:32.938235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c594a25-3a4f-4641-8f09-238542bb8786 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:32.938944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c594a25-3a4f-4641-8f09-238542bb8786 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:32.939840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c594a25-3a4f-4641-8f09-238542bb8786 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:32.940912 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-6df2e35d-27e5-49d1-834d-b9fbfe294f46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] HTTP exception thrown: Instance 69afa571-c5fa-4091-9ce1-5dd147316161 could not be found. Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6df2e35d-27e5-49d1-834d-b9fbfe294f46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Request method failure captured: Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 HTTP/1.1 Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtP1jPTQTilIR8Zw_4HVRKuGunH1uFFR6Aza_rOW_ei4NNriDIoMN3kAG42RsPqZdvMxh-Eif7wsdiNUYPbI5HMhikk4gkGhH70O5sSBzRF0eXIX8GDpCHQ5vkXH_PQWi98Ynt6--OLpeG6yCZ_1-kx_z7Tqeg2rDyf961WO0VQwd3s Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 47340475d333442da39184d873995e37 Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-LiveMigrationTest-42422299 Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/47340475d333442da39184d873995e37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47340475d333442da39184d873995e37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_47340475d333442da39184d873995e37", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47340475d333442da39184d873995e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-LiveMigrationTest-42422299 Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 47340475d333442da39184d873995e37 Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-LiveMigrationTest-42422299 Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-LiveMigrationTest-42422299-project Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 59ab6001dda8482a83fbd4dc67eabb68 Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-LiveMigrationTest-42422299-project Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 69afa571-c5fa-4091-9ce1-5dd147316161 could not be found. Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '69afa571-c5fa-4091-9ce1-5dd147316161'} Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69afa571-c5fa-4091-9ce1-5dd147316161 could not be found. Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69afa571-c5fa-4091-9ce1-5dd147316161 could not be found. Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:32.946812 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:32.950756 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:32.950756 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:32.950756 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:32.950756 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:32.950756 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:32.950756 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69afa571-c5fa-4091-9ce1-5dd147316161 could not be found. Oct 27 19:02:32.950756 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:32.952013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6df2e35d-27e5-49d1-834d-b9fbfe294f46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Returning 404 to user: Instance 69afa571-c5fa-4091-9ce1-5dd147316161 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:32.954281 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6df2e35d-27e5-49d1-834d-b9fbfe294f46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161" status: 404 len: 111 microversion: 2.1 time: 0.105798 Oct 27 19:02:32.956054 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1788/3749] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:32 2022] GET /compute/v2.1/servers/69afa571-c5fa-4091-9ce1-5dd147316161 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:02:33.162746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1571563341", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "f9ed35b9-356a-471b-bf27-3cd9e45d57b6"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:33.254589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] validate_networks() for [('f9ed35b9-356a-471b-bf27-3cd9e45d57b6', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:02:33.295477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8c594a25-3a4f-4641-8f09-238542bb8786 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:33.318332 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8c594a25-3a4f-4641-8f09-238542bb8786 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.431679 Oct 27 19:02:33.320732 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1962/3750] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:32 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:33.333598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b0493f6-bffd-4ded-9fdc-49cc0b4d61f0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '.version_select at 0x7fc86a02e5e0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:33.394825 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1b0493f6-bffd-4ded-9fdc-49cc0b4d61f0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225849210" status: 202 len: 0 microversion: 2.1 time: 0.070922 Oct 27 19:02:33.397104 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1963/3751] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 19:02:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225849210 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:02:33.405388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4e735f70-5b02-4307-8321-7c8881b9ffd2 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:33.406816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4e735f70-5b02-4307-8321-7c8881b9ffd2 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:33.418105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e735f70-5b02-4307-8321-7c8881b9ffd2 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:33.419120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e735f70-5b02-4307-8321-7c8881b9ffd2 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:33.419861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e735f70-5b02-4307-8321-7c8881b9ffd2 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:33.426093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e735f70-5b02-4307-8321-7c8881b9ffd2 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:33.426843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e735f70-5b02-4307-8321-7c8881b9ffd2 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:33.427472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e735f70-5b02-4307-8321-7c8881b9ffd2 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:33.997035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4e735f70-5b02-4307-8321-7c8881b9ffd2 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:34.009579 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4e735f70-5b02-4307-8321-7c8881b9ffd2 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1463 microversion: 2.1 time: 0.606741 Oct 27 19:02:34.011620 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1964/3752] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:33 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1463 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:34.030184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-345cbbe8-ca57-4c5d-a1a1-cf153fc18b6c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:34.031500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-345cbbe8-ca57-4c5d-a1a1-cf153fc18b6c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:34.050745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-345cbbe8-ca57-4c5d-a1a1-cf153fc18b6c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:34.052108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-345cbbe8-ca57-4c5d-a1a1-cf153fc18b6c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:34.053431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-345cbbe8-ca57-4c5d-a1a1-cf153fc18b6c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:34.056150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-345cbbe8-ca57-4c5d-a1a1-cf153fc18b6c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:34.058471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-345cbbe8-ca57-4c5d-a1a1-cf153fc18b6c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:34.059102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-345cbbe8-ca57-4c5d-a1a1-cf153fc18b6c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:34.337663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:02:34.339008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:02:34.339707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:02:34.340357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:02:34.341079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:02:34.352712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:34.353546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:34.354088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:34.355002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:34.355684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:34.356498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:34.377723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Getting quotas for project 7d4f98a2b116433bb88cc3541ea44f8b. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:02:34.384065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Getting quotas for user a4f9579efc194f4c8f9d02d4c21867d8 and project 7d4f98a2b116433bb88cc3541ea44f8b. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:02:34.399996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:02:34.402835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:02:34.496163 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-017a27fa-63e5-4a9d-8438-30742b9812c2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.538540 Oct 27 19:02:34.497147 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1789/3753] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:02:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:02:34.503991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5317f897-4c70-40e0-956a-3e55c0b7d991 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:34.504942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5317f897-4c70-40e0-956a-3e55c0b7d991 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:34.516344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5317f897-4c70-40e0-956a-3e55c0b7d991 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:34.517111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5317f897-4c70-40e0-956a-3e55c0b7d991 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:34.517834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5317f897-4c70-40e0-956a-3e55c0b7d991 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:34.519200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5317f897-4c70-40e0-956a-3e55c0b7d991 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:34.520286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5317f897-4c70-40e0-956a-3e55c0b7d991 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:34.520939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5317f897-4c70-40e0-956a-3e55c0b7d991 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:34.547806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:34.571539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5317f897-4c70-40e0-956a-3e55c0b7d991 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:34.572419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5317f897-4c70-40e0-956a-3e55c0b7d991 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:34.577355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5317f897-4c70-40e0-956a-3e55c0b7d991 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:34.578039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-5317f897-4c70-40e0-956a-3e55c0b7d991 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lazy-loading 'fault' on Instance uuid 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:02:34.643178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5317f897-4c70-40e0-956a-3e55c0b7d991 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:34.652904 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5317f897-4c70-40e0-956a-3e55c0b7d991 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 200 len: 1330 microversion: 2.1 time: 0.154391 Oct 27 19:02:34.665637 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1790/3754] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:34 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 1330 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:34.674032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-345cbbe8-ca57-4c5d-a1a1-cf153fc18b6c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:34.678074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-229f1099-643d-417c-8356-e37a96479fc9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:34.679492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-229f1099-643d-417c-8356-e37a96479fc9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:34.687553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-229f1099-643d-417c-8356-e37a96479fc9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:34.688301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-229f1099-643d-417c-8356-e37a96479fc9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:34.688920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-229f1099-643d-417c-8356-e37a96479fc9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:34.689567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-345cbbe8-ca57-4c5d-a1a1-cf153fc18b6c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:34.689975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-229f1099-643d-417c-8356-e37a96479fc9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:34.690666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-229f1099-643d-417c-8356-e37a96479fc9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:34.691273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-229f1099-643d-417c-8356-e37a96479fc9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:34.691717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-345cbbe8-ca57-4c5d-a1a1-cf153fc18b6c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:34.693108 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-345cbbe8-ca57-4c5d-a1a1-cf153fc18b6c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2950 microversion: 2.42 time: 0.679316 Oct 27 19:02:34.695259 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1965/3755] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:34 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2950 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:34.707334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-4a11cd47-4f98-445a-a2e4-877e64c935d0 req-ce3cc269-1df4-4af7-afe3-354cc56fb35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b227794-9896-4ec9-b8a1-3b1f3cce38c3", "name": "network-vif-deleted", "tag": "3d9a6379-167d-4e6c-ac72-73f1bd8e4a6b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:34.764524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4a11cd47-4f98-445a-a2e4-877e64c935d0 req-ce3cc269-1df4-4af7-afe3-354cc56fb35e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:34.765025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4a11cd47-4f98-445a-a2e4-877e64c935d0 req-ce3cc269-1df4-4af7-afe3-354cc56fb35e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:34.765468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4a11cd47-4f98-445a-a2e4-877e64c935d0 req-ce3cc269-1df4-4af7-afe3-354cc56fb35e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:34.793244 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-4a11cd47-4f98-445a-a2e4-877e64c935d0 req-ce3cc269-1df4-4af7-afe3-354cc56fb35e service nova] Creating event network-vif-deleted:3d9a6379-167d-4e6c-ac72-73f1bd8e4a6b for instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 on n-h1-860687-3 Oct 27 19:02:34.815185 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-4a11cd47-4f98-445a-a2e4-877e64c935d0 req-ce3cc269-1df4-4af7-afe3-354cc56fb35e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118292 Oct 27 19:02:34.815824 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1966/3756] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:34.828564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4cdeb777-42a0-42d3-bad8-dc01e6cc0e80 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d128941f-db55-4d3d-87da-56ac9b995897", "device": "/dev/sdb"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:34.850787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4cdeb777-42a0-42d3-bad8-dc01e6cc0e80 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:34.880073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cdeb777-42a0-42d3-bad8-dc01e6cc0e80 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:34.881437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cdeb777-42a0-42d3-bad8-dc01e6cc0e80 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:34.882076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cdeb777-42a0-42d3-bad8-dc01e6cc0e80 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:34.887591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cdeb777-42a0-42d3-bad8-dc01e6cc0e80 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:34.888464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cdeb777-42a0-42d3-bad8-dc01e6cc0e80 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:34.890944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cdeb777-42a0-42d3-bad8-dc01e6cc0e80 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:35.016422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-229f1099-643d-417c-8356-e37a96479fc9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:35.028192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-229f1099-643d-417c-8356-e37a96479fc9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:35.030301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-229f1099-643d-417c-8356-e37a96479fc9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:35.032230 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-229f1099-643d-417c-8356-e37a96479fc9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.365401 Oct 27 19:02:35.054945 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1791/3757] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:34 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:35.059878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6e46d0f0-710a-4af1-9a40-027fd6c0c226 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:35.060470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6e46d0f0-710a-4af1-9a40-027fd6c0c226 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:35.069063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e46d0f0-710a-4af1-9a40-027fd6c0c226 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:35.069571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e46d0f0-710a-4af1-9a40-027fd6c0c226 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:35.070123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e46d0f0-710a-4af1-9a40-027fd6c0c226 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:35.071059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e46d0f0-710a-4af1-9a40-027fd6c0c226 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:35.071524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e46d0f0-710a-4af1-9a40-027fd6c0c226 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:35.072167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e46d0f0-710a-4af1-9a40-027fd6c0c226 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:35.346889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6e46d0f0-710a-4af1-9a40-027fd6c0c226 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:35.360692 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6e46d0f0-710a-4af1-9a40-027fd6c0c226 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.306479 Oct 27 19:02:35.361617 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1792/3758] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:35 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:35.368625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-40915d1e-b396-4343-b78c-2cb2799f1dee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:35.369516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-40915d1e-b396-4343-b78c-2cb2799f1dee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:35.445943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-40915d1e-b396-4343-b78c-2cb2799f1dee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:35.456793 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-40915d1e-b396-4343-b78c-2cb2799f1dee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1225 microversion: 2.1 time: 0.093362 Oct 27 19:02:35.457529 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1793/3759] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:35 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:35.482217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-66bee398-55a3-4f43-9675-90d06a9b49cf tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:35.483154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-66bee398-55a3-4f43-9675-90d06a9b49cf tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:35.493217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66bee398-55a3-4f43-9675-90d06a9b49cf tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:35.494338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66bee398-55a3-4f43-9675-90d06a9b49cf tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:35.495315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66bee398-55a3-4f43-9675-90d06a9b49cf tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:35.496305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66bee398-55a3-4f43-9675-90d06a9b49cf tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:35.496982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66bee398-55a3-4f43-9675-90d06a9b49cf tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:35.497676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66bee398-55a3-4f43-9675-90d06a9b49cf tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:35.530483 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4cdeb777-42a0-42d3-bad8-dc01e6cc0e80 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "POST /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.706743 Oct 27 19:02:35.532573 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1967/3760] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:02:34 2022] POST /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:35.688990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a6c37d19-7f03-4b80-97ce-d2058189d7fa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:35.692868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a6c37d19-7f03-4b80-97ce-d2058189d7fa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:35.707042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6c37d19-7f03-4b80-97ce-d2058189d7fa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:35.707797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6c37d19-7f03-4b80-97ce-d2058189d7fa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:35.709036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6c37d19-7f03-4b80-97ce-d2058189d7fa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:35.710888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6c37d19-7f03-4b80-97ce-d2058189d7fa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:35.711820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6c37d19-7f03-4b80-97ce-d2058189d7fa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:35.712902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6c37d19-7f03-4b80-97ce-d2058189d7fa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:35.777694 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-66bee398-55a3-4f43-9675-90d06a9b49cf tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.301812 Oct 27 19:02:35.778344 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1794/3761] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Oct 27 19:02:35 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b/os-interface => generated 1831 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:35.782645 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-a6c37d19-7f03-4b80-97ce-d2058189d7fa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] HTTP exception thrown: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a6c37d19-7f03-4b80-97ce-d2058189d7fa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Request method failure captured: Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 HTTP/1.1 Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtT5H8XP7V9L0TVuuJvAuBoxNkhZhgX8XkK4-GpzHComWgmbBONfMudM4Q8yHeohsrOhf9YccVlwgfDyUGCChaGZWmGukZPYKh-mvkrZX3vZytXvdyVczNY7QyQ7kdcUBjknkaFKQkxOgdDbrstleWDjGVR0bmb658DtZfuMHYOhmds Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52ccbe7e63ab48199790f4676bbf2580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2be49f7bea7a4c8fbf289594e635fd69 Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '0b227794-9896-4ec9-b8a1-3b1f3cce38c3'} Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:35.812457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:35.816872 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:35.816872 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:35.816872 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:35.816872 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:35.816872 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:35.816872 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:02:35.816872 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:35.816872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a6c37d19-7f03-4b80-97ce-d2058189d7fa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Returning 404 to user: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:35.816872 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a6c37d19-7f03-4b80-97ce-d2058189d7fa tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 404 len: 111 microversion: 2.1 time: 0.136279 Oct 27 19:02:35.818300 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1968/3762] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:35 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:02:35.831014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e5d03197-10e5-419b-abb9-c12c7170783b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '.version_select at 0x7fc8732f5820>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:35.888600 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e5d03197-10e5-419b-abb9-c12c7170783b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-496167742" status: 202 len: 0 microversion: 2.1 time: 0.063535 Oct 27 19:02:35.910014 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1795/3763] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Oct 27 19:02:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-496167742 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:02:36.060398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-be33a4f5-1101-4b70-a199-213e46c0709b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:36.061039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-be33a4f5-1101-4b70-a199-213e46c0709b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:36.080758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be33a4f5-1101-4b70-a199-213e46c0709b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:36.081309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be33a4f5-1101-4b70-a199-213e46c0709b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:36.081763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be33a4f5-1101-4b70-a199-213e46c0709b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:36.084507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be33a4f5-1101-4b70-a199-213e46c0709b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:36.087707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be33a4f5-1101-4b70-a199-213e46c0709b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:36.088319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be33a4f5-1101-4b70-a199-213e46c0709b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:36.386088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0cd98397-ad38-4fc9-af0e-d03892f11ddf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:36.388558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0cd98397-ad38-4fc9-af0e-d03892f11ddf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:36.402849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cd98397-ad38-4fc9-af0e-d03892f11ddf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:36.407323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cd98397-ad38-4fc9-af0e-d03892f11ddf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:36.408726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cd98397-ad38-4fc9-af0e-d03892f11ddf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:36.412184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cd98397-ad38-4fc9-af0e-d03892f11ddf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:36.414110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cd98397-ad38-4fc9-af0e-d03892f11ddf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:36.418455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cd98397-ad38-4fc9-af0e-d03892f11ddf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:37.107310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-be33a4f5-1101-4b70-a199-213e46c0709b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:37.125082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-be33a4f5-1101-4b70-a199-213e46c0709b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:37.130268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-be33a4f5-1101-4b70-a199-213e46c0709b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:37.131897 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-be33a4f5-1101-4b70-a199-213e46c0709b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 1.076495 Oct 27 19:02:37.137811 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1969/3764] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:36 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:37.161865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-369d4e83-9709-4fde-98e1-5253044c9cf7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:37.165454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-369d4e83-9709-4fde-98e1-5253044c9cf7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:37.189071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-369d4e83-9709-4fde-98e1-5253044c9cf7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:37.189833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-369d4e83-9709-4fde-98e1-5253044c9cf7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:37.190478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-369d4e83-9709-4fde-98e1-5253044c9cf7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:37.191840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-369d4e83-9709-4fde-98e1-5253044c9cf7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:37.193200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-369d4e83-9709-4fde-98e1-5253044c9cf7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:37.194049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-369d4e83-9709-4fde-98e1-5253044c9cf7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:37.197093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0cd98397-ad38-4fc9-af0e-d03892f11ddf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:37.220507 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0cd98397-ad38-4fc9-af0e-d03892f11ddf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.839199 Oct 27 19:02:37.221656 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1796/3765] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:36 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:37.229769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2091378e-56d5-473f-91d4-4517059a3b77 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:37.231080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2091378e-56d5-473f-91d4-4517059a3b77 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:37.250891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2091378e-56d5-473f-91d4-4517059a3b77 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:37.252149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2091378e-56d5-473f-91d4-4517059a3b77 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:37.256027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2091378e-56d5-473f-91d4-4517059a3b77 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:37.260892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2091378e-56d5-473f-91d4-4517059a3b77 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:37.263009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2091378e-56d5-473f-91d4-4517059a3b77 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:37.263506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2091378e-56d5-473f-91d4-4517059a3b77 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:37.370715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2091378e-56d5-473f-91d4-4517059a3b77 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:02:37.481850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-369d4e83-9709-4fde-98e1-5253044c9cf7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:37.496035 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-369d4e83-9709-4fde-98e1-5253044c9cf7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1283 microversion: 2.1 time: 0.350735 Oct 27 19:02:37.496494 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1970/3766] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:37 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1283 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:37.576134 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2091378e-56d5-473f-91d4-4517059a3b77 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 204 len: 0 microversion: 2.1 time: 0.352669 Oct 27 19:02:37.591657 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1797/3767] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:02:37 2022] DELETE /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:02:37.600740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5163461b-bf08-44e0-afe7-566ac4b349c3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:37.601964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5163461b-bf08-44e0-afe7-566ac4b349c3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:37.611248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5163461b-bf08-44e0-afe7-566ac4b349c3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:37.611773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5163461b-bf08-44e0-afe7-566ac4b349c3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:37.612238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5163461b-bf08-44e0-afe7-566ac4b349c3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:37.612971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5163461b-bf08-44e0-afe7-566ac4b349c3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:37.616070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5163461b-bf08-44e0-afe7-566ac4b349c3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:37.616587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5163461b-bf08-44e0-afe7-566ac4b349c3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:37.899874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5163461b-bf08-44e0-afe7-566ac4b349c3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:37.915946 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5163461b-bf08-44e0-afe7-566ac4b349c3 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1485 microversion: 2.1 time: 0.319088 Oct 27 19:02:37.931556 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1971/3768] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:37 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1485 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:38.172997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bcb8da05-ff5f-4898-b7ba-7cc9ed18f482 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:38.173752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bcb8da05-ff5f-4898-b7ba-7cc9ed18f482 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:38.181208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cc8d63ac-d6d3-4760-842a-e4695d224901 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:38.182585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cc8d63ac-d6d3-4760-842a-e4695d224901 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:38.197537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc8d63ac-d6d3-4760-842a-e4695d224901 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:38.199644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcb8da05-ff5f-4898-b7ba-7cc9ed18f482 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:38.200322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc8d63ac-d6d3-4760-842a-e4695d224901 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:38.200992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcb8da05-ff5f-4898-b7ba-7cc9ed18f482 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:38.201594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc8d63ac-d6d3-4760-842a-e4695d224901 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:38.204077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc8d63ac-d6d3-4760-842a-e4695d224901 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:38.204888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcb8da05-ff5f-4898-b7ba-7cc9ed18f482 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:38.208146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcb8da05-ff5f-4898-b7ba-7cc9ed18f482 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:38.208868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc8d63ac-d6d3-4760-842a-e4695d224901 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:38.209459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc8d63ac-d6d3-4760-842a-e4695d224901 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:38.210090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcb8da05-ff5f-4898-b7ba-7cc9ed18f482 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:38.215666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcb8da05-ff5f-4898-b7ba-7cc9ed18f482 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:38.386799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-cc8d63ac-d6d3-4760-842a-e4695d224901 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lazy-loading 'services' on Instance uuid 673d7d02-3b01-418e-825a-8c7ccaffa820 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:02:38.532938 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cc8d63ac-d6d3-4760-842a-e4695d224901 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments/c4db88c3-83c5-403c-a197-7044b7c96f82" status: 202 len: 0 microversion: 2.1 time: 0.355951 Oct 27 19:02:38.534134 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1972/3769] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:02:38 2022] DELETE /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments/c4db88c3-83c5-403c-a197-7044b7c96f82 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:02:38.559051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fefcddf0-4240-457d-af8e-881781e3c3c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:38.559960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fefcddf0-4240-457d-af8e-881781e3c3c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:38.574916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fefcddf0-4240-457d-af8e-881781e3c3c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:38.575748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fefcddf0-4240-457d-af8e-881781e3c3c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:38.576394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fefcddf0-4240-457d-af8e-881781e3c3c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:38.577466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fefcddf0-4240-457d-af8e-881781e3c3c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:38.578140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fefcddf0-4240-457d-af8e-881781e3c3c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:38.578824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fefcddf0-4240-457d-af8e-881781e3c3c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:38.887431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fefcddf0-4240-457d-af8e-881781e3c3c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:38.897730 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fefcddf0-4240-457d-af8e-881781e3c3c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.361978 Oct 27 19:02:38.915409 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1973/3770] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:38 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:38.926357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5d58d49a-e1a1-43c8-95cc-9a6cac769c66 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:38.927958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5d58d49a-e1a1-43c8-95cc-9a6cac769c66 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:38.938887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d58d49a-e1a1-43c8-95cc-9a6cac769c66 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:38.939388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d58d49a-e1a1-43c8-95cc-9a6cac769c66 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:38.940522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d58d49a-e1a1-43c8-95cc-9a6cac769c66 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:38.941282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d58d49a-e1a1-43c8-95cc-9a6cac769c66 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:38.942705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d58d49a-e1a1-43c8-95cc-9a6cac769c66 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:38.943515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d58d49a-e1a1-43c8-95cc-9a6cac769c66 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:39.043900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5d58d49a-e1a1-43c8-95cc-9a6cac769c66 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:39.059335 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5d58d49a-e1a1-43c8-95cc-9a6cac769c66 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1283 microversion: 2.1 time: 0.142644 Oct 27 19:02:39.063411 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1974/3771] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:38 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1283 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:39.077087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-56921be3-1852-4c6f-b928-742b2360f01b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:39.084524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-56921be3-1852-4c6f-b928-742b2360f01b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:39.100268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56921be3-1852-4c6f-b928-742b2360f01b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:39.102603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56921be3-1852-4c6f-b928-742b2360f01b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:39.104167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56921be3-1852-4c6f-b928-742b2360f01b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:39.106981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56921be3-1852-4c6f-b928-742b2360f01b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:39.107592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56921be3-1852-4c6f-b928-742b2360f01b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:39.112158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bcb8da05-ff5f-4898-b7ba-7cc9ed18f482 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:39.121754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56921be3-1852-4c6f-b928-742b2360f01b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:39.131090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bcb8da05-ff5f-4898-b7ba-7cc9ed18f482 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:39.138313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bcb8da05-ff5f-4898-b7ba-7cc9ed18f482 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:39.145896 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bcb8da05-ff5f-4898-b7ba-7cc9ed18f482 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.978321 Oct 27 19:02:39.148682 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1798/3772] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:38 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:39.160923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-02d1ce81-3ce8-47c3-8e5f-23d530b978a0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:39.161562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-02d1ce81-3ce8-47c3-8e5f-23d530b978a0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:39.185229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02d1ce81-3ce8-47c3-8e5f-23d530b978a0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:39.187907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02d1ce81-3ce8-47c3-8e5f-23d530b978a0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:39.188400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02d1ce81-3ce8-47c3-8e5f-23d530b978a0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:39.190015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02d1ce81-3ce8-47c3-8e5f-23d530b978a0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:39.193012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02d1ce81-3ce8-47c3-8e5f-23d530b978a0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:39.193714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02d1ce81-3ce8-47c3-8e5f-23d530b978a0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:39.224575 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-56921be3-1852-4c6f-b928-742b2360f01b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158806 Oct 27 19:02:39.227158 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1975/3773] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:02:39 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:39.650167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-02d1ce81-3ce8-47c3-8e5f-23d530b978a0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:39.669656 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-02d1ce81-3ce8-47c3-8e5f-23d530b978a0 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1485 microversion: 2.1 time: 0.515670 Oct 27 19:02:39.671345 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1799/3774] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:39 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1485 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:39.933243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84bafd17-58ac-46f0-8d52-a581f0f4c257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:39.934377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-84bafd17-58ac-46f0-8d52-a581f0f4c257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:39.943268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84bafd17-58ac-46f0-8d52-a581f0f4c257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:39.944050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84bafd17-58ac-46f0-8d52-a581f0f4c257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:39.945399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84bafd17-58ac-46f0-8d52-a581f0f4c257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:39.946357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84bafd17-58ac-46f0-8d52-a581f0f4c257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:39.947275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84bafd17-58ac-46f0-8d52-a581f0f4c257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:39.948347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84bafd17-58ac-46f0-8d52-a581f0f4c257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:40.098969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f6dd8d8-7b27-4e21-8530-e3b3044dbdf5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:40.099901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0f6dd8d8-7b27-4e21-8530-e3b3044dbdf5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:40.116350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f6dd8d8-7b27-4e21-8530-e3b3044dbdf5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:40.117972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f6dd8d8-7b27-4e21-8530-e3b3044dbdf5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:40.121165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f6dd8d8-7b27-4e21-8530-e3b3044dbdf5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:40.122328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f6dd8d8-7b27-4e21-8530-e3b3044dbdf5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:40.123230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f6dd8d8-7b27-4e21-8530-e3b3044dbdf5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:40.125806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f6dd8d8-7b27-4e21-8530-e3b3044dbdf5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:40.327581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0f6dd8d8-7b27-4e21-8530-e3b3044dbdf5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:40.336825 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0f6dd8d8-7b27-4e21-8530-e3b3044dbdf5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1325 microversion: 2.1 time: 0.251036 Oct 27 19:02:40.339619 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1800/3775] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:40 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1325 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:40.348793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cbcad21f-46df-4057-a509-7b93d77be269 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:40.351638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cbcad21f-46df-4057-a509-7b93d77be269 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:40.368245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbcad21f-46df-4057-a509-7b93d77be269 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:40.372064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbcad21f-46df-4057-a509-7b93d77be269 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:40.372849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbcad21f-46df-4057-a509-7b93d77be269 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:40.373817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbcad21f-46df-4057-a509-7b93d77be269 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:40.376851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbcad21f-46df-4057-a509-7b93d77be269 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:40.377527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbcad21f-46df-4057-a509-7b93d77be269 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:40.552720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-84bafd17-58ac-46f0-8d52-a581f0f4c257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:40.574328 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-84bafd17-58ac-46f0-8d52-a581f0f4c257 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.652335 Oct 27 19:02:40.575808 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1976/3776] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:39 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:40.581235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-467247b2-bf66-4a2e-a788-9c2122e2cd61 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:40.589570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-467247b2-bf66-4a2e-a788-9c2122e2cd61 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:40.613201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-467247b2-bf66-4a2e-a788-9c2122e2cd61 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:40.615636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-467247b2-bf66-4a2e-a788-9c2122e2cd61 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:40.617560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-467247b2-bf66-4a2e-a788-9c2122e2cd61 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:40.631074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-467247b2-bf66-4a2e-a788-9c2122e2cd61 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:40.637038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-467247b2-bf66-4a2e-a788-9c2122e2cd61 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:40.638627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-467247b2-bf66-4a2e-a788-9c2122e2cd61 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:40.753179 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-467247b2-bf66-4a2e-a788-9c2122e2cd61 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175803 Oct 27 19:02:40.755504 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1977/3777] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:02:40 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:40.764140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-8a272ded-83cd-46a3-83de-60affe157639 req-1fc9d705-03f3-4bd5-beda-cad84493f870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eff0154-2475-4b5b-8c32-0b2ffb3481cf", "name": "network-vif-deleted", "tag": "35e4fff4-8327-4345-bb97-8dfe37b06d07"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:40.798082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8a272ded-83cd-46a3-83de-60affe157639 req-1fc9d705-03f3-4bd5-beda-cad84493f870 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:40.799020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8a272ded-83cd-46a3-83de-60affe157639 req-1fc9d705-03f3-4bd5-beda-cad84493f870 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:40.800069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8a272ded-83cd-46a3-83de-60affe157639 req-1fc9d705-03f3-4bd5-beda-cad84493f870 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:40.824350 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8a272ded-83cd-46a3-83de-60affe157639 req-1fc9d705-03f3-4bd5-beda-cad84493f870 service nova] Creating event network-vif-deleted:35e4fff4-8327-4345-bb97-8dfe37b06d07 for instance 1eff0154-2475-4b5b-8c32-0b2ffb3481cf on n-h2-860687-3 Oct 27 19:02:40.838299 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-8a272ded-83cd-46a3-83de-60affe157639 req-1fc9d705-03f3-4bd5-beda-cad84493f870 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078629 Oct 27 19:02:40.839392 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1978/3778] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:40.848522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dda4d619-bdd6-442d-975c-337db8815459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:40.849814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dda4d619-bdd6-442d-975c-337db8815459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:40.850258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cbcad21f-46df-4057-a509-7b93d77be269 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:40.858259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dda4d619-bdd6-442d-975c-337db8815459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:40.859006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dda4d619-bdd6-442d-975c-337db8815459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:40.859627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dda4d619-bdd6-442d-975c-337db8815459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:40.860599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dda4d619-bdd6-442d-975c-337db8815459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:40.861243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dda4d619-bdd6-442d-975c-337db8815459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:40.861871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dda4d619-bdd6-442d-975c-337db8815459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:40.865665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cbcad21f-46df-4057-a509-7b93d77be269 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:40.872089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cbcad21f-46df-4057-a509-7b93d77be269 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:40.878596 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cbcad21f-46df-4057-a509-7b93d77be269 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.536898 Oct 27 19:02:40.879574 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1801/3779] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:40 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:40.904554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:40.966905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dda4d619-bdd6-442d-975c-337db8815459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:40.971091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dda4d619-bdd6-442d-975c-337db8815459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:40.971731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dda4d619-bdd6-442d-975c-337db8815459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:40.972344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-dda4d619-bdd6-442d-975c-337db8815459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lazy-loading 'fault' on Instance uuid 1eff0154-2475-4b5b-8c32-0b2ffb3481cf {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:02:41.091694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dda4d619-bdd6-442d-975c-337db8815459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:41.103542 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dda4d619-bdd6-442d-975c-337db8815459 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 200 len: 1301 microversion: 2.1 time: 0.262263 Oct 27 19:02:41.118732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-5745e762-311b-40c0-812d-2cbfe7e95056 req-52942e84-8e30-4397-b1d9-43d99fbe6d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a809542-e7e8-400f-9493-fb9869b28927", "tag": "bd303fcc-c0fe-45c7-87d1-c450eaae0832"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:41.121675 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1979/3780] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:40 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 1301 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:41.139979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5745e762-311b-40c0-812d-2cbfe7e95056 req-52942e84-8e30-4397-b1d9-43d99fbe6d97 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:41.140478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5745e762-311b-40c0-812d-2cbfe7e95056 req-52942e84-8e30-4397-b1d9-43d99fbe6d97 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:41.140913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5745e762-311b-40c0-812d-2cbfe7e95056 req-52942e84-8e30-4397-b1d9-43d99fbe6d97 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:41.186223 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5745e762-311b-40c0-812d-2cbfe7e95056 req-52942e84-8e30-4397-b1d9-43d99fbe6d97 service nova] Creating event network-changed:bd303fcc-c0fe-45c7-87d1-c450eaae0832 for instance 2a809542-e7e8-400f-9493-fb9869b28927 on n-h2-860687-3 Oct 27 19:02:41.204035 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-5745e762-311b-40c0-812d-2cbfe7e95056 req-52942e84-8e30-4397-b1d9-43d99fbe6d97 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091311 Oct 27 19:02:41.210889 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1802/3781] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:41.370799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4e332f65-bd41-4b02-acba-dc00654720f5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:41.371656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4e332f65-bd41-4b02-acba-dc00654720f5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:41.379868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e332f65-bd41-4b02-acba-dc00654720f5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:41.380375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e332f65-bd41-4b02-acba-dc00654720f5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:41.380823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e332f65-bd41-4b02-acba-dc00654720f5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:41.381546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e332f65-bd41-4b02-acba-dc00654720f5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:41.383699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e332f65-bd41-4b02-acba-dc00654720f5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:41.384219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e332f65-bd41-4b02-acba-dc00654720f5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:41.588994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4e332f65-bd41-4b02-acba-dc00654720f5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:41.597461 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4e332f65-bd41-4b02-acba-dc00654720f5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1325 microversion: 2.1 time: 0.231065 Oct 27 19:02:41.598818 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1980/3782] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:41 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1325 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:41.608034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-82adc663-198a-4b3a-9f4a-1fb7f0f0521c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:41.608681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-82adc663-198a-4b3a-9f4a-1fb7f0f0521c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:41.615403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82adc663-198a-4b3a-9f4a-1fb7f0f0521c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:41.616158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82adc663-198a-4b3a-9f4a-1fb7f0f0521c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:41.617432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82adc663-198a-4b3a-9f4a-1fb7f0f0521c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:41.618519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82adc663-198a-4b3a-9f4a-1fb7f0f0521c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:41.619144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82adc663-198a-4b3a-9f4a-1fb7f0f0521c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:41.619740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82adc663-198a-4b3a-9f4a-1fb7f0f0521c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:41.769147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae203e2c-78c7-4e20-bf8d-bc592461dd65 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:41.771635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ae203e2c-78c7-4e20-bf8d-bc592461dd65 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:41.779060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae203e2c-78c7-4e20-bf8d-bc592461dd65 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:41.779563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae203e2c-78c7-4e20-bf8d-bc592461dd65 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:41.780173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae203e2c-78c7-4e20-bf8d-bc592461dd65 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:41.781362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae203e2c-78c7-4e20-bf8d-bc592461dd65 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:41.782182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae203e2c-78c7-4e20-bf8d-bc592461dd65 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:41.782930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae203e2c-78c7-4e20-bf8d-bc592461dd65 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:41.824749 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ae203e2c-78c7-4e20-bf8d-bc592461dd65 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060056 Oct 27 19:02:41.826208 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1981/3783] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:02:41 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:02:41.851978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-82adc663-198a-4b3a-9f4a-1fb7f0f0521c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:41.872719 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-82adc663-198a-4b3a-9f4a-1fb7f0f0521c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.267437 Oct 27 19:02:41.886639 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1803/3784] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:41 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:41.907997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c85e81c1-c576-43d9-99df-0055b1fb13e9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:41.908997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c85e81c1-c576-43d9-99df-0055b1fb13e9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:41.920185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c85e81c1-c576-43d9-99df-0055b1fb13e9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:41.921785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c85e81c1-c576-43d9-99df-0055b1fb13e9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:41.922897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c85e81c1-c576-43d9-99df-0055b1fb13e9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:41.925268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c85e81c1-c576-43d9-99df-0055b1fb13e9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:41.926986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c85e81c1-c576-43d9-99df-0055b1fb13e9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:41.929502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c85e81c1-c576-43d9-99df-0055b1fb13e9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:42.132156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-68ee9ce7-c4fb-4b03-b0aa-b2be796488e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:42.133429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-68ee9ce7-c4fb-4b03-b0aa-b2be796488e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 1eff0154-2475-4b5b-8c32-0b2ffb3481cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:42.135889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:42.141830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68ee9ce7-c4fb-4b03-b0aa-b2be796488e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:42.142828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68ee9ce7-c4fb-4b03-b0aa-b2be796488e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:42.144095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68ee9ce7-c4fb-4b03-b0aa-b2be796488e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:42.145017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68ee9ce7-c4fb-4b03-b0aa-b2be796488e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:42.145653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68ee9ce7-c4fb-4b03-b0aa-b2be796488e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:42.146276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68ee9ce7-c4fb-4b03-b0aa-b2be796488e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:42.170145 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-68ee9ce7-c4fb-4b03-b0aa-b2be796488e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] HTTP exception thrown: Instance 1eff0154-2475-4b5b-8c32-0b2ffb3481cf could not be found. Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-68ee9ce7-c4fb-4b03-b0aa-b2be796488e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Request method failure captured: Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf HTTP/1.1 Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtP1jPTQTilIR8Zw_4HVRKuGunH1uFFR6Aza_rOW_ei4NNriDIoMN3kAG42RsPqZdvMxh-Eif7wsdiNUYPbI5HMhikk4gkGhH70O5sSBzRF0eXIX8GDpCHQ5vkXH_PQWi98Ynt6--OLpeG6yCZ_1-kx_z7Tqeg2rDyf961WO0VQwd3s Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 47340475d333442da39184d873995e37 Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-LiveMigrationTest-42422299 Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/47340475d333442da39184d873995e37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47340475d333442da39184d873995e37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_47340475d333442da39184d873995e37", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47340475d333442da39184d873995e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-LiveMigrationTest-42422299 Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 47340475d333442da39184d873995e37 Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-LiveMigrationTest-42422299 Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-LiveMigrationTest-42422299-project Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 59ab6001dda8482a83fbd4dc67eabb68 Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-LiveMigrationTest-42422299-project Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 1eff0154-2475-4b5b-8c32-0b2ffb3481cf could not be found. Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '1eff0154-2475-4b5b-8c32-0b2ffb3481cf'} Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eff0154-2475-4b5b-8c32-0b2ffb3481cf could not be found. Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eff0154-2475-4b5b-8c32-0b2ffb3481cf could not be found. Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:42.172263 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:42.176475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:42.176475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:42.176475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:42.176475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:42.176475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:42.176475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eff0154-2475-4b5b-8c32-0b2ffb3481cf could not be found. Oct 27 19:02:42.176475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:42.178207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-68ee9ce7-c4fb-4b03-b0aa-b2be796488e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Returning 404 to user: Instance 1eff0154-2475-4b5b-8c32-0b2ffb3481cf could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:42.189470 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-68ee9ce7-c4fb-4b03-b0aa-b2be796488e9 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf" status: 404 len: 111 microversion: 2.1 time: 0.051961 Oct 27 19:02:42.190802 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1804/3785] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:42 2022] GET /compute/v2.1/servers/1eff0154-2475-4b5b-8c32-0b2ffb3481cf => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:02:42.201331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1637fe44-cea0-4db7-9f71-1e41db2658d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:42.202273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1637fe44-cea0-4db7-9f71-1e41db2658d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:42.215299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1637fe44-cea0-4db7-9f71-1e41db2658d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:42.216226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1637fe44-cea0-4db7-9f71-1e41db2658d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:42.216938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1637fe44-cea0-4db7-9f71-1e41db2658d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:42.217878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1637fe44-cea0-4db7-9f71-1e41db2658d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:42.218592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1637fe44-cea0-4db7-9f71-1e41db2658d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:42.219396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1637fe44-cea0-4db7-9f71-1e41db2658d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:42.254548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1637fe44-cea0-4db7-9f71-1e41db2658d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:02:42.358169 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1637fe44-cea0-4db7-9f71-1e41db2658d6 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "DELETE /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 204 len: 0 microversion: 2.1 time: 0.162093 Oct 27 19:02:42.363770 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1805/3786] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:02:42 2022] DELETE /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:02:42.371055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e6dbc2c6-6462-42a2-8759-1e16e72cba46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:42.371859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e6dbc2c6-6462-42a2-8759-1e16e72cba46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:42.380290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6dbc2c6-6462-42a2-8759-1e16e72cba46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:42.380773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6dbc2c6-6462-42a2-8759-1e16e72cba46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:42.381267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6dbc2c6-6462-42a2-8759-1e16e72cba46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:42.382097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6dbc2c6-6462-42a2-8759-1e16e72cba46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:42.382692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6dbc2c6-6462-42a2-8759-1e16e72cba46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:42.384470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6dbc2c6-6462-42a2-8759-1e16e72cba46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:42.572354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c85e81c1-c576-43d9-99df-0055b1fb13e9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:42.581857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c85e81c1-c576-43d9-99df-0055b1fb13e9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:42.586414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c85e81c1-c576-43d9-99df-0055b1fb13e9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:42.587931 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c85e81c1-c576-43d9-99df-0055b1fb13e9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.684180 Oct 27 19:02:42.588575 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1982/3787] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:41 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:42.621694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ca31e879-16e1-43ec-8956-3b128d58612e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:42.622314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ca31e879-16e1-43ec-8956-3b128d58612e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:42.626983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e6dbc2c6-6462-42a2-8759-1e16e72cba46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:42.631505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca31e879-16e1-43ec-8956-3b128d58612e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:42.632567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca31e879-16e1-43ec-8956-3b128d58612e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:42.633155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca31e879-16e1-43ec-8956-3b128d58612e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:42.633920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca31e879-16e1-43ec-8956-3b128d58612e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:42.634404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca31e879-16e1-43ec-8956-3b128d58612e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:42.639434 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e6dbc2c6-6462-42a2-8759-1e16e72cba46 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1501 microversion: 2.1 time: 0.274194 Oct 27 19:02:42.640292 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1806/3788] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:42 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1501 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:42.646682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca31e879-16e1-43ec-8956-3b128d58612e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:42.837982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-80674822-e1c9-406e-905b-76b7f2037ef3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:42.840224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-80674822-e1c9-406e-905b-76b7f2037ef3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:42.858042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80674822-e1c9-406e-905b-76b7f2037ef3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:42.858676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80674822-e1c9-406e-905b-76b7f2037ef3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:42.859338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80674822-e1c9-406e-905b-76b7f2037ef3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:42.860181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80674822-e1c9-406e-905b-76b7f2037ef3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:42.860774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80674822-e1c9-406e-905b-76b7f2037ef3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:42.861209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80674822-e1c9-406e-905b-76b7f2037ef3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:42.866515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:42.868857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ca31e879-16e1-43ec-8956-3b128d58612e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:42.883672 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ca31e879-16e1-43ec-8956-3b128d58612e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1325 microversion: 2.1 time: 0.265823 Oct 27 19:02:42.886498 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1983/3789] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:42 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:42.900770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fd5c5d99-8787-40b9-863d-dd42eada843f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:42.902138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fd5c5d99-8787-40b9-863d-dd42eada843f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:42.914498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5c5d99-8787-40b9-863d-dd42eada843f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:42.916167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5c5d99-8787-40b9-863d-dd42eada843f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:42.916850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5c5d99-8787-40b9-863d-dd42eada843f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:42.917888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5c5d99-8787-40b9-863d-dd42eada843f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:42.918671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5c5d99-8787-40b9-863d-dd42eada843f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:42.920027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5c5d99-8787-40b9-863d-dd42eada843f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:42.929448 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-80674822-e1c9-406e-905b-76b7f2037ef3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095972 Oct 27 19:02:42.942826 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1807/3790] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:02:42 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:43.178330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fd5c5d99-8787-40b9-863d-dd42eada843f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:43.189122 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fd5c5d99-8787-40b9-863d-dd42eada843f tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.294268 Oct 27 19:02:43.190159 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1984/3791] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:42 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:43.615855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5f8d77ae-3f2a-42b6-bac2-b49af619cf25 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:43.616500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5f8d77ae-3f2a-42b6-bac2-b49af619cf25 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:43.624234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f8d77ae-3f2a-42b6-bac2-b49af619cf25 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:43.624727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f8d77ae-3f2a-42b6-bac2-b49af619cf25 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:43.625233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f8d77ae-3f2a-42b6-bac2-b49af619cf25 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:43.626198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f8d77ae-3f2a-42b6-bac2-b49af619cf25 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:43.626680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f8d77ae-3f2a-42b6-bac2-b49af619cf25 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:43.627112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f8d77ae-3f2a-42b6-bac2-b49af619cf25 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:43.669667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4c1d6cce-918b-4337-89a1-60aa9acda130 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:43.671169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4c1d6cce-918b-4337-89a1-60aa9acda130 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:43.678068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c1d6cce-918b-4337-89a1-60aa9acda130 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:43.678586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c1d6cce-918b-4337-89a1-60aa9acda130 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:43.679146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c1d6cce-918b-4337-89a1-60aa9acda130 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:43.680104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c1d6cce-918b-4337-89a1-60aa9acda130 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:43.680872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c1d6cce-918b-4337-89a1-60aa9acda130 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:43.681587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c1d6cce-918b-4337-89a1-60aa9acda130 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:43.839932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4c1d6cce-918b-4337-89a1-60aa9acda130 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:43.857243 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4c1d6cce-918b-4337-89a1-60aa9acda130 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1501 microversion: 2.1 time: 0.194118 Oct 27 19:02:43.857863 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1985/3792] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:43 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1501 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:43.887615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5f8d77ae-3f2a-42b6-bac2-b49af619cf25 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:43.896713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5f8d77ae-3f2a-42b6-bac2-b49af619cf25 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:43.898662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5f8d77ae-3f2a-42b6-bac2-b49af619cf25 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:43.899583 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5f8d77ae-3f2a-42b6-bac2-b49af619cf25 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.287816 Oct 27 19:02:43.900360 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1808/3793] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:43 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:43.921292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d15e806e-74d7-4c99-aa79-b648c3a39804 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:43.921925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d15e806e-74d7-4c99-aa79-b648c3a39804 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:43.930976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d15e806e-74d7-4c99-aa79-b648c3a39804 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:43.930976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d15e806e-74d7-4c99-aa79-b648c3a39804 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:43.930976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d15e806e-74d7-4c99-aa79-b648c3a39804 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:43.931843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d15e806e-74d7-4c99-aa79-b648c3a39804 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:43.932321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d15e806e-74d7-4c99-aa79-b648c3a39804 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:43.932848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d15e806e-74d7-4c99-aa79-b648c3a39804 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:43.941683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-18d760a1-252b-4123-a7e9-12cd00aba6cf tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:43.946754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-18d760a1-252b-4123-a7e9-12cd00aba6cf tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:43.954952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18d760a1-252b-4123-a7e9-12cd00aba6cf tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:43.957815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18d760a1-252b-4123-a7e9-12cd00aba6cf tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:43.958471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18d760a1-252b-4123-a7e9-12cd00aba6cf tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:43.959371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18d760a1-252b-4123-a7e9-12cd00aba6cf tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:43.960812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18d760a1-252b-4123-a7e9-12cd00aba6cf tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:43.961438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18d760a1-252b-4123-a7e9-12cd00aba6cf tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:44.000117 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-18d760a1-252b-4123-a7e9-12cd00aba6cf tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062723 Oct 27 19:02:44.007567 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1809/3794] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:02:43 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:02:44.214646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-22dcc411-5878-4c38-8fc5-672583c0a2a3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:44.215636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-22dcc411-5878-4c38-8fc5-672583c0a2a3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:44.228376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22dcc411-5878-4c38-8fc5-672583c0a2a3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:44.230844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22dcc411-5878-4c38-8fc5-672583c0a2a3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:44.231819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22dcc411-5878-4c38-8fc5-672583c0a2a3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:44.233636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22dcc411-5878-4c38-8fc5-672583c0a2a3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:44.234557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22dcc411-5878-4c38-8fc5-672583c0a2a3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:44.234745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d15e806e-74d7-4c99-aa79-b648c3a39804 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:44.235355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22dcc411-5878-4c38-8fc5-672583c0a2a3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:44.250189 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d15e806e-74d7-4c99-aa79-b648c3a39804 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1325 microversion: 2.1 time: 0.333925 Oct 27 19:02:44.250842 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1986/3795] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:43 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1325 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:44.369160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:44.394833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-fdbbee56-c18c-4431-8360-78f1edf06851 req-5c3ae4b1-a20c-4277-b7ff-b5587ee3dd4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a7713a-b78d-425e-a6e8-0e4f5bc8904b", "name": "network-vif-plugged", "status": "completed", "tag": "9f402fdb-d277-4b7a-b6cc-275f32214caf"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:44.420090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fdbbee56-c18c-4431-8360-78f1edf06851 req-5c3ae4b1-a20c-4277-b7ff-b5587ee3dd4b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:44.420640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fdbbee56-c18c-4431-8360-78f1edf06851 req-5c3ae4b1-a20c-4277-b7ff-b5587ee3dd4b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:44.421296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fdbbee56-c18c-4431-8360-78f1edf06851 req-5c3ae4b1-a20c-4277-b7ff-b5587ee3dd4b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:44.454776 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-fdbbee56-c18c-4431-8360-78f1edf06851 req-5c3ae4b1-a20c-4277-b7ff-b5587ee3dd4b service nova] Creating event network-vif-plugged:9f402fdb-d277-4b7a-b6cc-275f32214caf for instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b on n-h2-860687-3 Oct 27 19:02:44.472345 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-fdbbee56-c18c-4431-8360-78f1edf06851 req-5c3ae4b1-a20c-4277-b7ff-b5587ee3dd4b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079505 Oct 27 19:02:44.474018 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1987/3796] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:02:44.604018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-22dcc411-5878-4c38-8fc5-672583c0a2a3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:44.615798 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-22dcc411-5878-4c38-8fc5-672583c0a2a3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.406452 Oct 27 19:02:44.617245 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1810/3797] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:44 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:44.881793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fa01a0f3-05d8-4e5c-8359-dd20171f0871 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:44.883960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fa01a0f3-05d8-4e5c-8359-dd20171f0871 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:44.895741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa01a0f3-05d8-4e5c-8359-dd20171f0871 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:44.896528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa01a0f3-05d8-4e5c-8359-dd20171f0871 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:44.898450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa01a0f3-05d8-4e5c-8359-dd20171f0871 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:44.899600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa01a0f3-05d8-4e5c-8359-dd20171f0871 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:44.901987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa01a0f3-05d8-4e5c-8359-dd20171f0871 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:44.902709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa01a0f3-05d8-4e5c-8359-dd20171f0871 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:44.927223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aa334101-12e8-487c-9237-3fe803818ea6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:44.927848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aa334101-12e8-487c-9237-3fe803818ea6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:44.939600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa334101-12e8-487c-9237-3fe803818ea6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:44.940105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa334101-12e8-487c-9237-3fe803818ea6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:44.940554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa334101-12e8-487c-9237-3fe803818ea6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:44.941276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa334101-12e8-487c-9237-3fe803818ea6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:44.946145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa334101-12e8-487c-9237-3fe803818ea6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:44.946687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa334101-12e8-487c-9237-3fe803818ea6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:45.213367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fa01a0f3-05d8-4e5c-8359-dd20171f0871 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:45.230939 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fa01a0f3-05d8-4e5c-8359-dd20171f0871 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1501 microversion: 2.1 time: 0.348377 Oct 27 19:02:45.237408 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1988/3798] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:44 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1501 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:45.243591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6c755dc6-df13-4fbf-8ba7-089570d17270 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:45.246328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6c755dc6-df13-4fbf-8ba7-089570d17270 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:45.253655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c755dc6-df13-4fbf-8ba7-089570d17270 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:45.254237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c755dc6-df13-4fbf-8ba7-089570d17270 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:45.254721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c755dc6-df13-4fbf-8ba7-089570d17270 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:45.255635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c755dc6-df13-4fbf-8ba7-089570d17270 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:45.256406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c755dc6-df13-4fbf-8ba7-089570d17270 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:45.256857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c755dc6-df13-4fbf-8ba7-089570d17270 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:45.328432 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6c755dc6-df13-4fbf-8ba7-089570d17270 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094106 Oct 27 19:02:45.330263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aa334101-12e8-487c-9237-3fe803818ea6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:45.330701 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1989/3799] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:02:45 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:45.338527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-920b4dfe-0d22-418b-b737-57d51c975faa tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:45.339421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-920b4dfe-0d22-418b-b737-57d51c975faa tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:45.341043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aa334101-12e8-487c-9237-3fe803818ea6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:45.348862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-920b4dfe-0d22-418b-b737-57d51c975faa tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:45.349547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-920b4dfe-0d22-418b-b737-57d51c975faa tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:45.351101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-920b4dfe-0d22-418b-b737-57d51c975faa tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:45.351721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aa334101-12e8-487c-9237-3fe803818ea6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:45.352331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-920b4dfe-0d22-418b-b737-57d51c975faa tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:45.352866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-920b4dfe-0d22-418b-b737-57d51c975faa tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:45.353313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-920b4dfe-0d22-418b-b737-57d51c975faa tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:45.357137 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aa334101-12e8-487c-9237-3fe803818ea6 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.434061 Oct 27 19:02:45.358648 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1811/3800] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:44 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:02:45.641276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7dec4c34-d48b-4374-849d-f85af37b77ce tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:45.641859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7dec4c34-d48b-4374-849d-f85af37b77ce tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:45.651762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:45.656231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7dec4c34-d48b-4374-849d-f85af37b77ce tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:45.657005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7dec4c34-d48b-4374-849d-f85af37b77ce tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:45.660914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7dec4c34-d48b-4374-849d-f85af37b77ce tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:45.661923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7dec4c34-d48b-4374-849d-f85af37b77ce tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:45.662672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7dec4c34-d48b-4374-849d-f85af37b77ce tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:45.669675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7dec4c34-d48b-4374-849d-f85af37b77ce tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:45.825587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-920b4dfe-0d22-418b-b737-57d51c975faa tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:45.834953 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-920b4dfe-0d22-418b-b737-57d51c975faa tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1325 microversion: 2.1 time: 0.502526 Oct 27 19:02:45.841272 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1990/3801] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:45 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1325 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:45.846098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d6a0d750-a7bd-44d0-8a81-bfccfc98c0cf req-cc543511-b8a8-44cf-97b7-31d17fb31ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592bd675-3b12-4ab8-8e8f-be99ea57e702", "name": "network-vif-deleted", "tag": "1f047cd7-16bb-416c-8bf4-ce6a1d8f9459"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:45.857787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d6a0d750-a7bd-44d0-8a81-bfccfc98c0cf req-cc543511-b8a8-44cf-97b7-31d17fb31ace service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:45.858490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d6a0d750-a7bd-44d0-8a81-bfccfc98c0cf req-cc543511-b8a8-44cf-97b7-31d17fb31ace service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:45.859084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d6a0d750-a7bd-44d0-8a81-bfccfc98c0cf req-cc543511-b8a8-44cf-97b7-31d17fb31ace service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:45.874681 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d6a0d750-a7bd-44d0-8a81-bfccfc98c0cf req-cc543511-b8a8-44cf-97b7-31d17fb31ace service nova] Creating event network-vif-deleted:1f047cd7-16bb-416c-8bf4-ce6a1d8f9459 for instance 592bd675-3b12-4ab8-8e8f-be99ea57e702 on n-h2-860687-3 Oct 27 19:02:45.882890 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d6a0d750-a7bd-44d0-8a81-bfccfc98c0cf req-cc543511-b8a8-44cf-97b7-31d17fb31ace service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039129 Oct 27 19:02:45.888306 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1991/3802] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:45.976791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7dec4c34-d48b-4374-849d-f85af37b77ce tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:46.000802 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7dec4c34-d48b-4374-849d-f85af37b77ce tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.362642 Oct 27 19:02:46.012111 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1812/3803] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:45 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:46.267795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d557da83-d925-4a7d-be4f-f04e616aedf8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:46.276813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d557da83-d925-4a7d-be4f-f04e616aedf8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:46.309188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d557da83-d925-4a7d-be4f-f04e616aedf8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:46.311468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d557da83-d925-4a7d-be4f-f04e616aedf8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:46.312279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d557da83-d925-4a7d-be4f-f04e616aedf8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:46.314165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d557da83-d925-4a7d-be4f-f04e616aedf8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:46.315507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d557da83-d925-4a7d-be4f-f04e616aedf8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:46.316444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d557da83-d925-4a7d-be4f-f04e616aedf8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:46.346072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f3888959-a348-4dfa-9143-4ca8d7862d21 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:46.353773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f3888959-a348-4dfa-9143-4ca8d7862d21 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:46.391486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3888959-a348-4dfa-9143-4ca8d7862d21 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:46.396642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3888959-a348-4dfa-9143-4ca8d7862d21 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:46.397448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3888959-a348-4dfa-9143-4ca8d7862d21 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:46.403579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3888959-a348-4dfa-9143-4ca8d7862d21 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:46.407140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3888959-a348-4dfa-9143-4ca8d7862d21 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:46.410647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3888959-a348-4dfa-9143-4ca8d7862d21 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:46.455861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d557da83-d925-4a7d-be4f-f04e616aedf8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:46.456480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d557da83-d925-4a7d-be4f-f04e616aedf8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:46.458159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d557da83-d925-4a7d-be4f-f04e616aedf8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:46.459607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-d557da83-d925-4a7d-be4f-f04e616aedf8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lazy-loading 'fault' on Instance uuid 592bd675-3b12-4ab8-8e8f-be99ea57e702 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:02:46.553961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d557da83-d925-4a7d-be4f-f04e616aedf8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ab6001dda8482a83fbd4dc67eabb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47340475d333442da39184d873995e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:46.581463 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d557da83-d925-4a7d-be4f-f04e616aedf8 tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 200 len: 1301 microversion: 2.1 time: 0.325387 Oct 27 19:02:46.587831 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1992/3804] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:46 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 1301 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:46.602878 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f3888959-a348-4dfa-9143-4ca8d7862d21 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.262361 Oct 27 19:02:46.605113 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1813/3805] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:02:46 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments => generated 197 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:02:46.606477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-29a9e214-a771-46d1-8a47-a7ab0ab03d0b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:46.609521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-29a9e214-a771-46d1-8a47-a7ab0ab03d0b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:46.633354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29a9e214-a771-46d1-8a47-a7ab0ab03d0b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:46.633861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29a9e214-a771-46d1-8a47-a7ab0ab03d0b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:46.634318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29a9e214-a771-46d1-8a47-a7ab0ab03d0b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:46.640908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29a9e214-a771-46d1-8a47-a7ab0ab03d0b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:46.641282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29a9e214-a771-46d1-8a47-a7ab0ab03d0b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:46.641768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29a9e214-a771-46d1-8a47-a7ab0ab03d0b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:46.875112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb64ce7b-92a4-4a25-b9c4-20c44d4768e4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:46.875780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fb64ce7b-92a4-4a25-b9c4-20c44d4768e4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:46.898787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb64ce7b-92a4-4a25-b9c4-20c44d4768e4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:46.899350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb64ce7b-92a4-4a25-b9c4-20c44d4768e4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:46.901584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb64ce7b-92a4-4a25-b9c4-20c44d4768e4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:46.902353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb64ce7b-92a4-4a25-b9c4-20c44d4768e4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:46.907822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb64ce7b-92a4-4a25-b9c4-20c44d4768e4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:46.908617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb64ce7b-92a4-4a25-b9c4-20c44d4768e4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:47.012602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-29a9e214-a771-46d1-8a47-a7ab0ab03d0b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:47.032140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-29a9e214-a771-46d1-8a47-a7ab0ab03d0b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:47.034285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-29a9e214-a771-46d1-8a47-a7ab0ab03d0b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:47.036675 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-29a9e214-a771-46d1-8a47-a7ab0ab03d0b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.448111 Oct 27 19:02:47.037430 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1993/3806] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:46 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:47.048837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aafb7b1a-452a-4329-9f9f-70180a26ce9a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:47.050618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-aafb7b1a-452a-4329-9f9f-70180a26ce9a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:47.060750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aafb7b1a-452a-4329-9f9f-70180a26ce9a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:47.061542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aafb7b1a-452a-4329-9f9f-70180a26ce9a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:47.062757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aafb7b1a-452a-4329-9f9f-70180a26ce9a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:47.063762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aafb7b1a-452a-4329-9f9f-70180a26ce9a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:47.064484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aafb7b1a-452a-4329-9f9f-70180a26ce9a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:47.065472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aafb7b1a-452a-4329-9f9f-70180a26ce9a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:47.410604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fb64ce7b-92a4-4a25-b9c4-20c44d4768e4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:47.428530 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fb64ce7b-92a4-4a25-b9c4-20c44d4768e4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1325 microversion: 2.1 time: 0.563479 Oct 27 19:02:47.429704 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1814/3807] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:46 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1325 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:47.431620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-aafb7b1a-452a-4329-9f9f-70180a26ce9a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:47.449125 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aafb7b1a-452a-4329-9f9f-70180a26ce9a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.409122 Oct 27 19:02:47.461557 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1994/3808] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:47 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:47.618053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5cb582c7-d4e4-47e2-a9a8-bbf8627203a5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:47.619216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-87d6bd35-b502-4914-a42e-85a1612d10fb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:47.620101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-87d6bd35-b502-4914-a42e-85a1612d10fb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] [instance: 592bd675-3b12-4ab8-8e8f-be99ea57e702] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:47.620702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5cb582c7-d4e4-47e2-a9a8-bbf8627203a5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:47.627377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87d6bd35-b502-4914-a42e-85a1612d10fb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:47.628138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87d6bd35-b502-4914-a42e-85a1612d10fb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:47.628830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87d6bd35-b502-4914-a42e-85a1612d10fb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:47.629840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87d6bd35-b502-4914-a42e-85a1612d10fb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:47.630555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87d6bd35-b502-4914-a42e-85a1612d10fb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:47.631202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87d6bd35-b502-4914-a42e-85a1612d10fb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:47.637650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cb582c7-d4e4-47e2-a9a8-bbf8627203a5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:47.638139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cb582c7-d4e4-47e2-a9a8-bbf8627203a5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:47.638609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cb582c7-d4e4-47e2-a9a8-bbf8627203a5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:47.641692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cb582c7-d4e4-47e2-a9a8-bbf8627203a5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:47.642312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cb582c7-d4e4-47e2-a9a8-bbf8627203a5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:47.643889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cb582c7-d4e4-47e2-a9a8-bbf8627203a5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:47.674565 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-87d6bd35-b502-4914-a42e-85a1612d10fb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] HTTP exception thrown: Instance 592bd675-3b12-4ab8-8e8f-be99ea57e702 could not be found. Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-87d6bd35-b502-4914-a42e-85a1612d10fb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Request method failure captured: Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 HTTP/1.1 Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtP1jPTQTilIR8Zw_4HVRKuGunH1uFFR6Aza_rOW_ei4NNriDIoMN3kAG42RsPqZdvMxh-Eif7wsdiNUYPbI5HMhikk4gkGhH70O5sSBzRF0eXIX8GDpCHQ5vkXH_PQWi98Ynt6--OLpeG6yCZ_1-kx_z7Tqeg2rDyf961WO0VQwd3s Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 47340475d333442da39184d873995e37 Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-LiveMigrationTest-42422299 Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/47340475d333442da39184d873995e37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47340475d333442da39184d873995e37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_47340475d333442da39184d873995e37", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47340475d333442da39184d873995e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-LiveMigrationTest-42422299 Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 47340475d333442da39184d873995e37 Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-LiveMigrationTest-42422299 Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-LiveMigrationTest-42422299-project Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 59ab6001dda8482a83fbd4dc67eabb68 Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-LiveMigrationTest-42422299-project Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 592bd675-3b12-4ab8-8e8f-be99ea57e702 could not be found. Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '592bd675-3b12-4ab8-8e8f-be99ea57e702'} Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 592bd675-3b12-4ab8-8e8f-be99ea57e702 could not be found. Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 592bd675-3b12-4ab8-8e8f-be99ea57e702 could not be found. Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:47.677024 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:47.681768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:47.681768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:47.681768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:47.681768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:47.681768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:47.681768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 592bd675-3b12-4ab8-8e8f-be99ea57e702 could not be found. Oct 27 19:02:47.681768 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:47.684753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-87d6bd35-b502-4914-a42e-85a1612d10fb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] Returning 404 to user: Instance 592bd675-3b12-4ab8-8e8f-be99ea57e702 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:47.686148 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-87d6bd35-b502-4914-a42e-85a1612d10fb tempest-LiveMigrationTest-42422299 tempest-LiveMigrationTest-42422299-project] 10.222.0.42 "GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702" status: 404 len: 111 microversion: 2.1 time: 0.077896 Oct 27 19:02:47.687547 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1815/3809] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:47 2022] GET /compute/v2.1/servers/592bd675-3b12-4ab8-8e8f-be99ea57e702 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:02:47.749038 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5cb582c7-d4e4-47e2-a9a8-bbf8627203a5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135989 Oct 27 19:02:47.753646 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1995/3810] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:02:47 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 19:02:47.863908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-470e0dd7-1b89-4c37-96ea-cb9801487327 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:47.864853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-470e0dd7-1b89-4c37-96ea-cb9801487327 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:47.871430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-470e0dd7-1b89-4c37-96ea-cb9801487327 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:47.872125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-470e0dd7-1b89-4c37-96ea-cb9801487327 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:47.873029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-470e0dd7-1b89-4c37-96ea-cb9801487327 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:47.873908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-470e0dd7-1b89-4c37-96ea-cb9801487327 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:47.874608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-470e0dd7-1b89-4c37-96ea-cb9801487327 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:47.875397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-470e0dd7-1b89-4c37-96ea-cb9801487327 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:47.929785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-470e0dd7-1b89-4c37-96ea-cb9801487327 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:02:48.074900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85211ff0-eccd-465f-b08b-ebf08a146e28 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:48.076081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-85211ff0-eccd-465f-b08b-ebf08a146e28 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:48.092889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85211ff0-eccd-465f-b08b-ebf08a146e28 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:48.093633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85211ff0-eccd-465f-b08b-ebf08a146e28 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:48.094229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85211ff0-eccd-465f-b08b-ebf08a146e28 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:48.095335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85211ff0-eccd-465f-b08b-ebf08a146e28 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:48.095951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85211ff0-eccd-465f-b08b-ebf08a146e28 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:48.097090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85211ff0-eccd-465f-b08b-ebf08a146e28 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:48.136480 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-470e0dd7-1b89-4c37-96ea-cb9801487327 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 204 len: 0 microversion: 2.1 time: 0.276011 Oct 27 19:02:48.140229 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1816/3811] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:02:47 2022] DELETE /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:02:48.146559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-66050bb5-8fbb-40a3-9918-d012e29f6bf7 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:48.147274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-66050bb5-8fbb-40a3-9918-d012e29f6bf7 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:48.160167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66050bb5-8fbb-40a3-9918-d012e29f6bf7 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:48.160748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66050bb5-8fbb-40a3-9918-d012e29f6bf7 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:48.161187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66050bb5-8fbb-40a3-9918-d012e29f6bf7 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:48.161902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66050bb5-8fbb-40a3-9918-d012e29f6bf7 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:48.162361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66050bb5-8fbb-40a3-9918-d012e29f6bf7 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:48.164999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66050bb5-8fbb-40a3-9918-d012e29f6bf7 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:48.456973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-66050bb5-8fbb-40a3-9918-d012e29f6bf7 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:48.473187 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-66050bb5-8fbb-40a3-9918-d012e29f6bf7 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1683 microversion: 2.1 time: 0.327738 Oct 27 19:02:48.473852 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1817/3812] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:48 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1683 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:48.481595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bff034c5-7b9d-493a-bc11-b90505ba1009 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:48.482150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bff034c5-7b9d-493a-bc11-b90505ba1009 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:48.510632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bff034c5-7b9d-493a-bc11-b90505ba1009 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:48.511875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bff034c5-7b9d-493a-bc11-b90505ba1009 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:48.519200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bff034c5-7b9d-493a-bc11-b90505ba1009 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:48.521593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bff034c5-7b9d-493a-bc11-b90505ba1009 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:48.523321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bff034c5-7b9d-493a-bc11-b90505ba1009 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:48.526214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bff034c5-7b9d-493a-bc11-b90505ba1009 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:48.532563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-85211ff0-eccd-465f-b08b-ebf08a146e28 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:48.537389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:48.550015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-85211ff0-eccd-465f-b08b-ebf08a146e28 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:48.556304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-85211ff0-eccd-465f-b08b-ebf08a146e28 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:48.558314 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-85211ff0-eccd-465f-b08b-ebf08a146e28 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1806 microversion: 2.20 time: 0.490336 Oct 27 19:02:48.588094 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1996/3813] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:48 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1806 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:48.588353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6bc78204-10e0-470f-88fa-558d2733db18 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:48.589217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6bc78204-10e0-470f-88fa-558d2733db18 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:48.607884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc78204-10e0-470f-88fa-558d2733db18 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:48.611840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc78204-10e0-470f-88fa-558d2733db18 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:48.612681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc78204-10e0-470f-88fa-558d2733db18 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:48.614799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc78204-10e0-470f-88fa-558d2733db18 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:48.615517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc78204-10e0-470f-88fa-558d2733db18 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:48.618138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bc78204-10e0-470f-88fa-558d2733db18 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:49.003385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bff034c5-7b9d-493a-bc11-b90505ba1009 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:49.012210 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bff034c5-7b9d-493a-bc11-b90505ba1009 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1325 microversion: 2.1 time: 0.536692 Oct 27 19:02:49.013406 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1818/3814] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:48 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1325 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:49.034694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6bc78204-10e0-470f-88fa-558d2733db18 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:49.046307 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6bc78204-10e0-470f-88fa-558d2733db18 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.465486 Oct 27 19:02:49.054538 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1997/3815] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:48 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:49.505890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7fe4e9d-2cbf-440b-ae61-aa9db253154f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:49.508050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a7fe4e9d-2cbf-440b-ae61-aa9db253154f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:49.519672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7fe4e9d-2cbf-440b-ae61-aa9db253154f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:49.520379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7fe4e9d-2cbf-440b-ae61-aa9db253154f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:49.521157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7fe4e9d-2cbf-440b-ae61-aa9db253154f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:49.522228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7fe4e9d-2cbf-440b-ae61-aa9db253154f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:49.523952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7fe4e9d-2cbf-440b-ae61-aa9db253154f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:49.524662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7fe4e9d-2cbf-440b-ae61-aa9db253154f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:49.592799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b206cdae-ae89-4d62-8d68-fa82d0b7ecf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:49.594927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b206cdae-ae89-4d62-8d68-fa82d0b7ecf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:49.612519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b206cdae-ae89-4d62-8d68-fa82d0b7ecf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:49.618786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b206cdae-ae89-4d62-8d68-fa82d0b7ecf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:49.623831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b206cdae-ae89-4d62-8d68-fa82d0b7ecf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:49.624807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b206cdae-ae89-4d62-8d68-fa82d0b7ecf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:49.631736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b206cdae-ae89-4d62-8d68-fa82d0b7ecf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:49.632604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b206cdae-ae89-4d62-8d68-fa82d0b7ecf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:49.848692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a7fe4e9d-2cbf-440b-ae61-aa9db253154f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:49.858971 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7fe4e9d-2cbf-440b-ae61-aa9db253154f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1683 microversion: 2.1 time: 0.361023 Oct 27 19:02:49.880076 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1819/3816] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:49 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1683 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:49.942162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b206cdae-ae89-4d62-8d68-fa82d0b7ecf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:49.959694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b206cdae-ae89-4d62-8d68-fa82d0b7ecf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:49.961457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b206cdae-ae89-4d62-8d68-fa82d0b7ecf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:49.962733 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b206cdae-ae89-4d62-8d68-fa82d0b7ecf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1793 microversion: 2.20 time: 0.376393 Oct 27 19:02:49.963316 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1998/3817] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:02:49 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1793 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:02:50.037809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-126f009b-be62-40e3-b506-a3c61a26edab tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:50.040315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-126f009b-be62-40e3-b506-a3c61a26edab tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:50.051014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-126f009b-be62-40e3-b506-a3c61a26edab tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:50.051839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-126f009b-be62-40e3-b506-a3c61a26edab tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:50.052493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-126f009b-be62-40e3-b506-a3c61a26edab tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:50.053574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-126f009b-be62-40e3-b506-a3c61a26edab tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:50.055018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-126f009b-be62-40e3-b506-a3c61a26edab tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:50.055752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-126f009b-be62-40e3-b506-a3c61a26edab tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:50.074293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b0adfbe-cf21-4ae5-bf00-4ec26629741b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:50.075516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1b0adfbe-cf21-4ae5-bf00-4ec26629741b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:50.091696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b0adfbe-cf21-4ae5-bf00-4ec26629741b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:50.094606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b0adfbe-cf21-4ae5-bf00-4ec26629741b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:50.135888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b0adfbe-cf21-4ae5-bf00-4ec26629741b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:50.137244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b0adfbe-cf21-4ae5-bf00-4ec26629741b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:50.142680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b0adfbe-cf21-4ae5-bf00-4ec26629741b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:50.145008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b0adfbe-cf21-4ae5-bf00-4ec26629741b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:50.553576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1b0adfbe-cf21-4ae5-bf00-4ec26629741b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:50.568479 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1b0adfbe-cf21-4ae5-bf00-4ec26629741b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.498999 Oct 27 19:02:50.600404 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 1999/3818] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:50 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:50.807399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-126f009b-be62-40e3-b506-a3c61a26edab tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:50.816591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-07e5f54f-4be9-44ae-9562-de54cd217adf req-29499e1f-78eb-418b-8f35-16bf5429fbdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a809542-e7e8-400f-9493-fb9869b28927", "name": "network-vif-plugged", "status": "completed", "tag": "bd303fcc-c0fe-45c7-87d1-c450eaae0832"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:50.830443 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-126f009b-be62-40e3-b506-a3c61a26edab tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1325 microversion: 2.1 time: 0.797511 Oct 27 19:02:50.831051 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1820/3819] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:50 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1325 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:50.840892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:50.852570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-07e5f54f-4be9-44ae-9562-de54cd217adf req-29499e1f-78eb-418b-8f35-16bf5429fbdc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:50.853066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-07e5f54f-4be9-44ae-9562-de54cd217adf req-29499e1f-78eb-418b-8f35-16bf5429fbdc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:50.854981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-07e5f54f-4be9-44ae-9562-de54cd217adf req-29499e1f-78eb-418b-8f35-16bf5429fbdc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:50.888440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6c786b2e-b8bf-4763-a0d5-f1a3dad0743f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:50.889068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6c786b2e-b8bf-4763-a0d5-f1a3dad0743f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:50.892408 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-07e5f54f-4be9-44ae-9562-de54cd217adf req-29499e1f-78eb-418b-8f35-16bf5429fbdc service nova] Creating event network-vif-plugged:bd303fcc-c0fe-45c7-87d1-c450eaae0832 for instance 2a809542-e7e8-400f-9493-fb9869b28927 on n-h2-860687-3 Oct 27 19:02:50.904047 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-07e5f54f-4be9-44ae-9562-de54cd217adf req-29499e1f-78eb-418b-8f35-16bf5429fbdc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094930 Oct 27 19:02:50.906620 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2000/3820] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:50.907585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c786b2e-b8bf-4763-a0d5-f1a3dad0743f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:50.908146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c786b2e-b8bf-4763-a0d5-f1a3dad0743f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:50.908607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c786b2e-b8bf-4763-a0d5-f1a3dad0743f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:50.912117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c786b2e-b8bf-4763-a0d5-f1a3dad0743f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:50.912826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c786b2e-b8bf-4763-a0d5-f1a3dad0743f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:50.914113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c786b2e-b8bf-4763-a0d5-f1a3dad0743f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:51.355347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6c786b2e-b8bf-4763-a0d5-f1a3dad0743f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:51.368646 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6c786b2e-b8bf-4763-a0d5-f1a3dad0743f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1683 microversion: 2.1 time: 0.483958 Oct 27 19:02:51.369932 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1821/3821] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:50 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1683 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:51.600192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fb19574c-cd7a-4127-b327-b5cf310d501b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:51.601743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fb19574c-cd7a-4127-b327-b5cf310d501b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:51.612078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb19574c-cd7a-4127-b327-b5cf310d501b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:51.612718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb19574c-cd7a-4127-b327-b5cf310d501b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:51.613172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb19574c-cd7a-4127-b327-b5cf310d501b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:51.613958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb19574c-cd7a-4127-b327-b5cf310d501b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:51.614517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb19574c-cd7a-4127-b327-b5cf310d501b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:51.615095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb19574c-cd7a-4127-b327-b5cf310d501b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:51.853612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8153422c-469a-48ca-acd2-b03007c06e2a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:51.854630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8153422c-469a-48ca-acd2-b03007c06e2a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:51.861842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8153422c-469a-48ca-acd2-b03007c06e2a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:51.862567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8153422c-469a-48ca-acd2-b03007c06e2a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:51.863018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8153422c-469a-48ca-acd2-b03007c06e2a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:51.863935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8153422c-469a-48ca-acd2-b03007c06e2a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:51.864850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8153422c-469a-48ca-acd2-b03007c06e2a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:51.865485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8153422c-469a-48ca-acd2-b03007c06e2a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:51.999758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fb19574c-cd7a-4127-b327-b5cf310d501b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:52.016393 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fb19574c-cd7a-4127-b327-b5cf310d501b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.422591 Oct 27 19:02:52.017861 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2001/3822] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:51 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:52.065636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-1a12a818-1ef9-48f0-ac7d-170cd1accda2 req-b49cb650-aadb-4142-b69a-ca322d08f0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "673d7d02-3b01-418e-825a-8c7ccaffa820", "name": "network-vif-deleted", "tag": "dc9bfd96-0979-420c-a567-d63bd7ef7915"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:52.097113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1a12a818-1ef9-48f0-ac7d-170cd1accda2 req-b49cb650-aadb-4142-b69a-ca322d08f0c0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:52.098684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1a12a818-1ef9-48f0-ac7d-170cd1accda2 req-b49cb650-aadb-4142-b69a-ca322d08f0c0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:52.102157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1a12a818-1ef9-48f0-ac7d-170cd1accda2 req-b49cb650-aadb-4142-b69a-ca322d08f0c0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:52.139828 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-1a12a818-1ef9-48f0-ac7d-170cd1accda2 req-b49cb650-aadb-4142-b69a-ca322d08f0c0 service nova] Creating event network-vif-deleted:dc9bfd96-0979-420c-a567-d63bd7ef7915 for instance 673d7d02-3b01-418e-825a-8c7ccaffa820 on n-h2-860687-3 Oct 27 19:02:52.155866 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-1a12a818-1ef9-48f0-ac7d-170cd1accda2 req-b49cb650-aadb-4142-b69a-ca322d08f0c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094119 Oct 27 19:02:52.160646 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2002/3823] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:52.182607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8153422c-469a-48ca-acd2-b03007c06e2a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:52.189944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:02:52.197596 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8153422c-469a-48ca-acd2-b03007c06e2a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1325 microversion: 2.1 time: 0.347404 Oct 27 19:02:52.200507 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1822/3824] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:51 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1325 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:52.395928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d979dd63-a85c-49c0-a89f-76039b3e674e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:52.397158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d979dd63-a85c-49c0-a89f-76039b3e674e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:52.408527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d979dd63-a85c-49c0-a89f-76039b3e674e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:52.409298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d979dd63-a85c-49c0-a89f-76039b3e674e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:52.409892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d979dd63-a85c-49c0-a89f-76039b3e674e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:52.411282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d979dd63-a85c-49c0-a89f-76039b3e674e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:52.411973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d979dd63-a85c-49c0-a89f-76039b3e674e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:52.412630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d979dd63-a85c-49c0-a89f-76039b3e674e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:52.468059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d979dd63-a85c-49c0-a89f-76039b3e674e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:52.473864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d979dd63-a85c-49c0-a89f-76039b3e674e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:52.474595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d979dd63-a85c-49c0-a89f-76039b3e674e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:52.475228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-d979dd63-a85c-49c0-a89f-76039b3e674e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lazy-loading 'fault' on Instance uuid 673d7d02-3b01-418e-825a-8c7ccaffa820 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:02:52.608207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d979dd63-a85c-49c0-a89f-76039b3e674e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:52.631377 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d979dd63-a85c-49c0-a89f-76039b3e674e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 200 len: 1331 microversion: 2.1 time: 0.238247 Oct 27 19:02:52.632208 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2003/3825] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:52 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 1331 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:53.044154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2bee3b45-bbb6-445b-95e9-98e9df043b8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:53.044782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2bee3b45-bbb6-445b-95e9-98e9df043b8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:53.065660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bee3b45-bbb6-445b-95e9-98e9df043b8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:53.068072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bee3b45-bbb6-445b-95e9-98e9df043b8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:53.068546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bee3b45-bbb6-445b-95e9-98e9df043b8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:53.069354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bee3b45-bbb6-445b-95e9-98e9df043b8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:53.069877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bee3b45-bbb6-445b-95e9-98e9df043b8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:53.070465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bee3b45-bbb6-445b-95e9-98e9df043b8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:53.226644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a1f571fc-1a71-4dec-9e4c-aaacb622ef6e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:53.229944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a1f571fc-1a71-4dec-9e4c-aaacb622ef6e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:53.258139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1f571fc-1a71-4dec-9e4c-aaacb622ef6e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:53.261185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1f571fc-1a71-4dec-9e4c-aaacb622ef6e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:53.262103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1f571fc-1a71-4dec-9e4c-aaacb622ef6e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:53.263230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1f571fc-1a71-4dec-9e4c-aaacb622ef6e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:53.264063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1f571fc-1a71-4dec-9e4c-aaacb622ef6e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:53.264785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1f571fc-1a71-4dec-9e4c-aaacb622ef6e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:53.489279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2bee3b45-bbb6-445b-95e9-98e9df043b8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:53.503981 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2bee3b45-bbb6-445b-95e9-98e9df043b8a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.466650 Oct 27 19:02:53.507362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1f571fc-1a71-4dec-9e4c-aaacb622ef6e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:53.508208 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1823/3826] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:53 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:53.520590 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a1f571fc-1a71-4dec-9e4c-aaacb622ef6e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1521 microversion: 2.1 time: 0.299809 Oct 27 19:02:53.524960 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2004/3827] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:53 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:53.555893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-21c69aa3-377f-4133-9371-231051fc7f35 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:53.556722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-21c69aa3-377f-4133-9371-231051fc7f35 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:53.567271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21c69aa3-377f-4133-9371-231051fc7f35 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:53.574782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21c69aa3-377f-4133-9371-231051fc7f35 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:53.577875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21c69aa3-377f-4133-9371-231051fc7f35 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:53.578985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21c69aa3-377f-4133-9371-231051fc7f35 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:53.579629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21c69aa3-377f-4133-9371-231051fc7f35 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:53.580410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21c69aa3-377f-4133-9371-231051fc7f35 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:53.666371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14b70381-1d64-44ba-8411-643e6675d4ac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:53.667037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-14b70381-1d64-44ba-8411-643e6675d4ac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:53.684931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14b70381-1d64-44ba-8411-643e6675d4ac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:53.686035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14b70381-1d64-44ba-8411-643e6675d4ac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:53.686694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14b70381-1d64-44ba-8411-643e6675d4ac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:53.689850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14b70381-1d64-44ba-8411-643e6675d4ac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:53.690856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14b70381-1d64-44ba-8411-643e6675d4ac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:53.691498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14b70381-1d64-44ba-8411-643e6675d4ac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:53.708358 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-14b70381-1d64-44ba-8411-643e6675d4ac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] HTTP exception thrown: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14b70381-1d64-44ba-8411-643e6675d4ac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Request method failure captured: Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 HTTP/1.1 Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtT5H8XP7V9L0TVuuJvAuBoxNkhZhgX8XkK4-GpzHComWgmbBONfMudM4Q8yHeohsrOhf9YccVlwgfDyUGCChaGZWmGukZPYKh-mvkrZX3vZytXvdyVczNY7QyQ7kdcUBjknkaFKQkxOgdDbrstleWDjGVR0bmb658DtZfuMHYOhmds Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52ccbe7e63ab48199790f4676bbf2580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2be49f7bea7a4c8fbf289594e635fd69 Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '673d7d02-3b01-418e-825a-8c7ccaffa820'} Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:53.711139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:53.714568 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:53.714568 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:53.714568 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:53.714568 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:53.714568 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:53.714568 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:02:53.714568 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:53.716142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14b70381-1d64-44ba-8411-643e6675d4ac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Returning 404 to user: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:53.717180 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-14b70381-1d64-44ba-8411-643e6675d4ac tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 404 len: 111 microversion: 2.1 time: 0.061464 Oct 27 19:02:53.718243 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2005/3828] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:53 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:02:53.727002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-15dda3d1-70c1-4e20-82a8-e5bd06fc2f22 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '.version_select at 0x7fc869fd3820>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:53.760698 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-15dda3d1-70c1-4e20-82a8-e5bd06fc2f22 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045009007" status: 202 len: 0 microversion: 2.1 time: 0.037272 Oct 27 19:02:53.761646 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2006/3829] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 19:02:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045009007 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:02:54.039562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-21c69aa3-377f-4133-9371-231051fc7f35 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:54.055255 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-21c69aa3-377f-4133-9371-231051fc7f35 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1521 microversion: 2.1 time: 0.505489 Oct 27 19:02:54.071608 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1824/3830] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:53 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1521 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:54.083136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-31e7ac7d-f6b8-4837-a686-100b3f3e26fc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1895852758", "metadata": {"": ""}}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-31e7ac7d-f6b8-4837-a686-100b3f3e26fc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Request method failure captured: Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927/action HTTP/1.1 Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 107 Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtXIBO-oIT-HYTB2aEriLPPQy4zwsnSlx9DGo1owgDeViDL8xz9gdgxBZ6h4yaNReHUFDpmMjxtiWf7mVDXaedJvOc8Qwc8zJEa7KWRfdPMYJLUDfqmLkDFiFu3cWColj_-lSB8MMmJyxn24nK4fQdr9h8etZXRJSRnN6iLr8tUpzOk Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d4f98a2b116433bb88cc3541ea44f8b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a4f9579efc194f4c8f9d02d4c21867d8 Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1895852758", "metadata": {"": ""}}} Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '2a809542-e7e8-400f-9493-fb9869b28927', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1895852758', 'metadata': {'': ''}}}} Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'': ''} Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:54.094858 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:54.098371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-31e7ac7d-f6b8-4837-a686-100b3f3e26fc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:54.105487 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-31e7ac7d-f6b8-4837-a686-100b3f3e26fc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "POST /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927/action" status: 400 len: 170 microversion: 2.1 time: 0.021538 Oct 27 19:02:54.105487 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2007/3831] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Oct 27 19:02:54 2022] POST /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927/action => generated 170 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:02:54.110281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-79e24df6-91f7-429d-b635-1f5b342df668 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:54.111201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-79e24df6-91f7-429d-b635-1f5b342df668 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:54.127822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79e24df6-91f7-429d-b635-1f5b342df668 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:54.128314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79e24df6-91f7-429d-b635-1f5b342df668 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:54.128952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79e24df6-91f7-429d-b635-1f5b342df668 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:54.130129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79e24df6-91f7-429d-b635-1f5b342df668 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:54.130874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79e24df6-91f7-429d-b635-1f5b342df668 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:54.131455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79e24df6-91f7-429d-b635-1f5b342df668 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:54.514007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-79e24df6-91f7-429d-b635-1f5b342df668 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:54.523318 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-79e24df6-91f7-429d-b635-1f5b342df668 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1521 microversion: 2.1 time: 0.418547 Oct 27 19:02:54.532700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4a66404d-ac7f-4db1-8322-85c6ca4e3e7a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:54.533621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4a66404d-ac7f-4db1-8322-85c6ca4e3e7a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:54.539470 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1825/3832] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:54 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:54.545509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a66404d-ac7f-4db1-8322-85c6ca4e3e7a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:54.546156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a66404d-ac7f-4db1-8322-85c6ca4e3e7a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:54.546856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a66404d-ac7f-4db1-8322-85c6ca4e3e7a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:54.547826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a66404d-ac7f-4db1-8322-85c6ca4e3e7a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:54.548895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-16b0ac27-0ecb-48f5-a262-dfa3e6d02cfc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:54.549282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a66404d-ac7f-4db1-8322-85c6ca4e3e7a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:54.550080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a66404d-ac7f-4db1-8322-85c6ca4e3e7a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:54.550292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-16b0ac27-0ecb-48f5-a262-dfa3e6d02cfc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:54.557692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16b0ac27-0ecb-48f5-a262-dfa3e6d02cfc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:54.558448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16b0ac27-0ecb-48f5-a262-dfa3e6d02cfc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:54.559083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16b0ac27-0ecb-48f5-a262-dfa3e6d02cfc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:54.559966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16b0ac27-0ecb-48f5-a262-dfa3e6d02cfc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:54.560581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16b0ac27-0ecb-48f5-a262-dfa3e6d02cfc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:54.561167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16b0ac27-0ecb-48f5-a262-dfa3e6d02cfc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:54.728507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4a66404d-ac7f-4db1-8322-85c6ca4e3e7a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:54.736955 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4a66404d-ac7f-4db1-8322-85c6ca4e3e7a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.208996 Oct 27 19:02:54.737616 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2008/3833] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:54 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:54.742856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7f722e50-9001-4071-8336-bc9806358b56 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Action: 'create', calling method: .version_select at 0x7fc869fd3940>, body: {"keypair": {"name": "tempest-keypair-480985877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsc7ZKgZU2DlQ+IYBH2Uqa+qfr5U6d+gV/J78rRvL9OeC7wr9VPe7LW6q3FQJvZjTljDRbWWRLzI/hzGTvK1Kk92yq0LKgZeZeAJsnXGTtAG9XJuKzF/xR4K96roN89vw=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:54.759277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-7f722e50-9001-4071-8336-bc9806358b56 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:02:54.764503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-7f722e50-9001-4071-8336-bc9806358b56 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for user 2be49f7bea7a4c8fbf289594e635fd69 and project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:02:54.788677 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7f722e50-9001-4071-8336-bc9806358b56 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049889 Oct 27 19:02:54.789309 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2009/3834] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:02:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:02:54.905760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-16b0ac27-0ecb-48f5-a262-dfa3e6d02cfc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:54.916083 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-16b0ac27-0ecb-48f5-a262-dfa3e6d02cfc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1521 microversion: 2.1 time: 0.370792 Oct 27 19:02:54.923098 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1826/3835] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:54 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:54.946153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b916c640-b25a-4f32-a4f2-cdef5c1f24b0 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2005612946", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b916c640-b25a-4f32-a4f2-cdef5c1f24b0 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Request method failure captured: Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927/action HTTP/1.1 Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 619 Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtXIBO-oIT-HYTB2aEriLPPQy4zwsnSlx9DGo1owgDeViDL8xz9gdgxBZ6h4yaNReHUFDpmMjxtiWf7mVDXaedJvOc8Qwc8zJEa7KWRfdPMYJLUDfqmLkDFiFu3cWColj_-lSB8MMmJyxn24nK4fQdr9h8etZXRJSRnN6iLr8tUpzOk Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d4f98a2b116433bb88cc3541ea44f8b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a4f9579efc194f4c8f9d02d4c21867d8 Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2005612946", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '2a809542-e7e8-400f-9493-fb9869b28927', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2005612946', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 19:02:54.950921 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 19:02:54.954607 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:54.959354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b916c640-b25a-4f32-a4f2-cdef5c1f24b0 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:54.960908 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b916c640-b25a-4f32-a4f2-cdef5c1f24b0 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "POST /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927/action" status: 400 len: 938 microversion: 2.1 time: 0.021102 Oct 27 19:02:54.961651 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2010/3836] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Oct 27 19:02:54 2022] POST /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927/action => generated 938 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:02:54.973220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-801bcfde-a52a-4c65-8c86-e5398ee9ed8d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:54.974059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-801bcfde-a52a-4c65-8c86-e5398ee9ed8d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:54.981105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-801bcfde-a52a-4c65-8c86-e5398ee9ed8d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:54.981721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-801bcfde-a52a-4c65-8c86-e5398ee9ed8d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:54.982244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-801bcfde-a52a-4c65-8c86-e5398ee9ed8d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:54.983063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-801bcfde-a52a-4c65-8c86-e5398ee9ed8d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:54.983536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-801bcfde-a52a-4c65-8c86-e5398ee9ed8d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:54.984245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-801bcfde-a52a-4c65-8c86-e5398ee9ed8d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:55.268738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-801bcfde-a52a-4c65-8c86-e5398ee9ed8d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:55.308362 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-801bcfde-a52a-4c65-8c86-e5398ee9ed8d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1521 microversion: 2.1 time: 0.339921 Oct 27 19:02:55.336981 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1827/3837] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:54 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:55.337475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a4a374d7-4e55-42ec-9388-91a7b0b66427 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:55.338326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a4a374d7-4e55-42ec-9388-91a7b0b66427 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:55.348502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4a374d7-4e55-42ec-9388-91a7b0b66427 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:55.349436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4a374d7-4e55-42ec-9388-91a7b0b66427 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:55.350082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4a374d7-4e55-42ec-9388-91a7b0b66427 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:55.351752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4a374d7-4e55-42ec-9388-91a7b0b66427 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:55.352527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4a374d7-4e55-42ec-9388-91a7b0b66427 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:55.353201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4a374d7-4e55-42ec-9388-91a7b0b66427 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:55.627015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a4a374d7-4e55-42ec-9388-91a7b0b66427 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:55.660048 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a4a374d7-4e55-42ec-9388-91a7b0b66427 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1521 microversion: 2.1 time: 0.326982 Oct 27 19:02:55.661035 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2011/3838] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:55 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:55.689233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-451a57ea-393d-4003-9be6-d8dc025cad3f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-451a57ea-393d-4003-9be6-d8dc025cad3f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Request method failure captured: Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927/action HTTP/1.1 Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 285 Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtXIBO-oIT-HYTB2aEriLPPQy4zwsnSlx9DGo1owgDeViDL8xz9gdgxBZ6h4yaNReHUFDpmMjxtiWf7mVDXaedJvOc8Qwc8zJEa7KWRfdPMYJLUDfqmLkDFiFu3cWColj_-lSB8MMmJyxn24nK4fQdr9h8etZXRJSRnN6iLr8tUpzOk Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d4f98a2b116433bb88cc3541ea44f8b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: a4f9579efc194f4c8f9d02d4c21867d8 Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '2a809542-e7e8-400f-9493-fb9869b28927', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:55.695619 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 19:02:55.699083 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:02:55.702686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-451a57ea-393d-4003-9be6-d8dc025cad3f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:55.705011 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-451a57ea-393d-4003-9be6-d8dc025cad3f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "POST /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927/action" status: 400 len: 619 microversion: 2.1 time: 0.021175 Oct 27 19:02:55.710857 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1828/3839] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Oct 27 19:02:55 2022] POST /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927/action => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:02:55.720658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9ba91b2e-335a-4f4c-9a49-df39a4deface tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:55.720658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9ba91b2e-335a-4f4c-9a49-df39a4deface tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:55.730136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ba91b2e-335a-4f4c-9a49-df39a4deface tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:55.730799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ba91b2e-335a-4f4c-9a49-df39a4deface tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:55.731182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ba91b2e-335a-4f4c-9a49-df39a4deface tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:55.732022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ba91b2e-335a-4f4c-9a49-df39a4deface tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:55.732520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ba91b2e-335a-4f4c-9a49-df39a4deface tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:55.732998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ba91b2e-335a-4f4c-9a49-df39a4deface tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:55.762170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a01ca59f-3fe2-4e43-b721-4cc3e0bc414b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:55.762979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a01ca59f-3fe2-4e43-b721-4cc3e0bc414b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:55.776792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a01ca59f-3fe2-4e43-b721-4cc3e0bc414b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:55.777305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a01ca59f-3fe2-4e43-b721-4cc3e0bc414b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:55.777756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a01ca59f-3fe2-4e43-b721-4cc3e0bc414b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:55.778495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a01ca59f-3fe2-4e43-b721-4cc3e0bc414b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:55.780884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a01ca59f-3fe2-4e43-b721-4cc3e0bc414b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:55.782989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a01ca59f-3fe2-4e43-b721-4cc3e0bc414b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:56.123988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9ba91b2e-335a-4f4c-9a49-df39a4deface tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:56.133006 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9ba91b2e-335a-4f4c-9a49-df39a4deface tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1521 microversion: 2.1 time: 0.417434 Oct 27 19:02:56.133581 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2012/3840] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:55 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:56.175744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c7c57f07-e1ed-4f95-9818-60ae6bc6f5f3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:56.177974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c7c57f07-e1ed-4f95-9818-60ae6bc6f5f3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:56.195004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7c57f07-e1ed-4f95-9818-60ae6bc6f5f3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:56.196880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7c57f07-e1ed-4f95-9818-60ae6bc6f5f3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:56.199203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7c57f07-e1ed-4f95-9818-60ae6bc6f5f3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:56.200407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7c57f07-e1ed-4f95-9818-60ae6bc6f5f3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:56.201227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7c57f07-e1ed-4f95-9818-60ae6bc6f5f3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:56.202949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7c57f07-e1ed-4f95-9818-60ae6bc6f5f3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:56.453627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a01ca59f-3fe2-4e43-b721-4cc3e0bc414b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:56.490030 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a01ca59f-3fe2-4e43-b721-4cc3e0bc414b tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.731810 Oct 27 19:02:56.491966 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1829/3841] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:55 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:56.575817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c7c57f07-e1ed-4f95-9818-60ae6bc6f5f3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:56.602972 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c7c57f07-e1ed-4f95-9818-60ae6bc6f5f3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1521 microversion: 2.1 time: 0.436146 Oct 27 19:02:56.603592 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2013/3842] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:56 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:56.637158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4019be4c-5efa-4c17-bd53-72bf288df1fb tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-675440618"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:56.642960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4019be4c-5efa-4c17-bd53-72bf288df1fb tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:56.652813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4019be4c-5efa-4c17-bd53-72bf288df1fb tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:56.653394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4019be4c-5efa-4c17-bd53-72bf288df1fb tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:56.653852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4019be4c-5efa-4c17-bd53-72bf288df1fb tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:56.654608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4019be4c-5efa-4c17-bd53-72bf288df1fb tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:56.655073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4019be4c-5efa-4c17-bd53-72bf288df1fb tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:56.655506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4019be4c-5efa-4c17-bd53-72bf288df1fb tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:56.972570 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4019be4c-5efa-4c17-bd53-72bf288df1fb tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "POST /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927/action" status: 202 len: 0 microversion: 2.1 time: 0.340754 Oct 27 19:02:56.973838 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1830/3843] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:02:56 2022] POST /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 19:02:56.985069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f6943384-f60a-4bdb-87f6-6aa97564deb5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-178478352"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:56.987424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f6943384-f60a-4bdb-87f6-6aa97564deb5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:57.002481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6943384-f60a-4bdb-87f6-6aa97564deb5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:57.003056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6943384-f60a-4bdb-87f6-6aa97564deb5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:57.003505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6943384-f60a-4bdb-87f6-6aa97564deb5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:57.004741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6943384-f60a-4bdb-87f6-6aa97564deb5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:57.005849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6943384-f60a-4bdb-87f6-6aa97564deb5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:57.010704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6943384-f60a-4bdb-87f6-6aa97564deb5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:57.072288 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-f6943384-f60a-4bdb-87f6-6aa97564deb5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] HTTP exception thrown: Cannot 'createImage' instance 2a809542-e7e8-400f-9493-fb9869b28927 while it is in task_state image_snapshot_pending Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f6943384-f60a-4bdb-87f6-6aa97564deb5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Request method failure captured: Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927/action HTTP/1.1 Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 84 Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtXIBO-oIT-HYTB2aEriLPPQy4zwsnSlx9DGo1owgDeViDL8xz9gdgxBZ6h4yaNReHUFDpmMjxtiWf7mVDXaedJvOc8Qwc8zJEa7KWRfdPMYJLUDfqmLkDFiFu3cWColj_-lSB8MMmJyxn24nK4fQdr9h8etZXRJSRnN6iLr8tUpzOk Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d4f98a2b116433bb88cc3541ea44f8b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a4f9579efc194f4c8f9d02d4c21867d8 Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-178478352"}} Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: exception: Cannot 'createImage' instance 2a809542-e7e8-400f-9493-fb9869b28927 while it is in task_state image_snapshot_pending Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '2a809542-e7e8-400f-9493-fb9869b28927', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-178478352'}}} Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2a809542-e7e8-400f-9493-fb9869b28927 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 19:02:57.086860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 19:02:57.090307 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 2a809542-e7e8-400f-9493-fb9869b28927 while it is in task_state image_snapshot_pending Oct 27 19:02:57.090307 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:57.090307 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:02:57.090307 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:57.090307 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:02:57.090307 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:02:57.090307 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:02:57.090307 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:02:57.090307 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:02:57.090307 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 2a809542-e7e8-400f-9493-fb9869b28927 while it is in task_state image_snapshot_pending Oct 27 19:02:57.090307 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:02:57.090307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f6943384-f60a-4bdb-87f6-6aa97564deb5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Returning 409 to user: Cannot 'createImage' instance 2a809542-e7e8-400f-9493-fb9869b28927 while it is in task_state image_snapshot_pending {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:02:57.090307 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f6943384-f60a-4bdb-87f6-6aa97564deb5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "POST /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927/action" status: 409 len: 167 microversion: 2.1 time: 0.107421 Oct 27 19:02:57.094309 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2014/3844] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:02:56 2022] POST /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927/action => generated 167 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:02:57.098364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-26770a34-a40a-434b-a22f-b53cfafd061e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '.version_select at 0x7fc869bdddc0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:57.284383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-22946740", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2cfbe0bf-f6fb-46ad-9a6c-606f41f6cc6f"}], "security_groups": [{"name": "tempest-securitygroup--960013853"}], "key_name": "tempest-keypair-480985877", "user_data": "}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:02:57.346649 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-26770a34-a40a-434b-a22f-b53cfafd061e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "DELETE /compute/v2.1/images/2a6d60e0-6b81-4288-bb98-91c5bc7f0466" status: 204 len: 0 microversion: 2.1 time: 0.251371 Oct 27 19:02:57.347794 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1831/3845] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:57 2022] DELETE /compute/v2.1/images/2a6d60e0-6b81-4288-bb98-91c5bc7f0466 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:02:57.360206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-918dea7c-9c75-4634-8bda-0538523a8c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:57.361394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-918dea7c-9c75-4634-8bda-0538523a8c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:57.382371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-918dea7c-9c75-4634-8bda-0538523a8c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:57.384573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-918dea7c-9c75-4634-8bda-0538523a8c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:57.387801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-918dea7c-9c75-4634-8bda-0538523a8c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:57.391392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-918dea7c-9c75-4634-8bda-0538523a8c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:57.392093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-918dea7c-9c75-4634-8bda-0538523a8c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:57.394442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-918dea7c-9c75-4634-8bda-0538523a8c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:57.484120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] validate_networks() for [('2cfbe0bf-f6fb-46ad-9a6c-606f41f6cc6f', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:02:57.771847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-918dea7c-9c75-4634-8bda-0538523a8c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:57.786098 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-918dea7c-9c75-4634-8bda-0538523a8c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1533 microversion: 2.1 time: 0.432201 Oct 27 19:02:57.810504 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1832/3846] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:57 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1533 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:57.825387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf755b6c-8e21-4c58-9ffd-943ab0656e84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:57.825996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cf755b6c-8e21-4c58-9ffd-943ab0656e84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:57.842003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf755b6c-8e21-4c58-9ffd-943ab0656e84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:57.842533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf755b6c-8e21-4c58-9ffd-943ab0656e84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:57.843201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf755b6c-8e21-4c58-9ffd-943ab0656e84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:57.844098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf755b6c-8e21-4c58-9ffd-943ab0656e84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:57.844726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf755b6c-8e21-4c58-9ffd-943ab0656e84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:57.845393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf755b6c-8e21-4c58-9ffd-943ab0656e84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:58.177810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cf755b6c-8e21-4c58-9ffd-943ab0656e84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:58.191597 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cf755b6c-8e21-4c58-9ffd-943ab0656e84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.379714 Oct 27 19:02:58.206456 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1833/3847] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:57 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:58.237796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:02:58.237796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:02:58.238428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:02:58.238841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:02:58.239264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:02:58.260911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:58.261411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:58.261857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:58.262656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:58.263119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:58.263554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:58.304551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:02:58.312505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for user 2be49f7bea7a4c8fbf289594e635fd69 and project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:02:58.326773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:02:58.330738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:02:58.410044 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d5a420d2-31ce-444b-9c2b-8ab585426783 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.131721 Oct 27 19:02:58.411484 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2015/3848] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:02:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:02:58.423780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a031e7a7-ca03-4926-b133-6aae04b2b8d0 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:58.424966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a031e7a7-ca03-4926-b133-6aae04b2b8d0 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:58.614813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a031e7a7-ca03-4926-b133-6aae04b2b8d0 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:58.626076 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a031e7a7-ca03-4926-b133-6aae04b2b8d0 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1239 microversion: 2.1 time: 0.206271 Oct 27 19:02:58.627516 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1834/3849] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:58 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1239 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:58.818087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-51c863f2-70fe-419a-aa4b-189356cc4c40 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:58.819532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-51c863f2-70fe-419a-aa4b-189356cc4c40 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:58.851520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51c863f2-70fe-419a-aa4b-189356cc4c40 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:58.857730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51c863f2-70fe-419a-aa4b-189356cc4c40 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:58.858747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51c863f2-70fe-419a-aa4b-189356cc4c40 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:58.859826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51c863f2-70fe-419a-aa4b-189356cc4c40 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:58.860547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51c863f2-70fe-419a-aa4b-189356cc4c40 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:58.861209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51c863f2-70fe-419a-aa4b-189356cc4c40 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:59.218678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-51c863f2-70fe-419a-aa4b-189356cc4c40 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:59.221360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d401b71d-e254-4b2e-903b-c496ce74d0b0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:59.222551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d401b71d-e254-4b2e-903b-c496ce74d0b0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:59.231652 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-51c863f2-70fe-419a-aa4b-189356cc4c40 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1533 microversion: 2.1 time: 0.418575 Oct 27 19:02:59.233957 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2016/3850] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:58 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1533 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:02:59.239717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d401b71d-e254-4b2e-903b-c496ce74d0b0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:59.242050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d401b71d-e254-4b2e-903b-c496ce74d0b0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:59.242950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d401b71d-e254-4b2e-903b-c496ce74d0b0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:59.244090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d401b71d-e254-4b2e-903b-c496ce74d0b0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:59.244658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d401b71d-e254-4b2e-903b-c496ce74d0b0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:59.246235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d401b71d-e254-4b2e-903b-c496ce74d0b0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:59.560545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d401b71d-e254-4b2e-903b-c496ce74d0b0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:59.583005 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d401b71d-e254-4b2e-903b-c496ce74d0b0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.356983 Oct 27 19:02:59.585784 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1835/3851] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:59 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:02:59.653906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f5133552-0697-4ef2-a165-416c48767d6c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:02:59.655490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f5133552-0697-4ef2-a165-416c48767d6c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:02:59.666906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5133552-0697-4ef2-a165-416c48767d6c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:59.667859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5133552-0697-4ef2-a165-416c48767d6c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:59.668634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5133552-0697-4ef2-a165-416c48767d6c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:59.669583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5133552-0697-4ef2-a165-416c48767d6c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:02:59.670368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5133552-0697-4ef2-a165-416c48767d6c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:02:59.671273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5133552-0697-4ef2-a165-416c48767d6c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:02:59.812656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f5133552-0697-4ef2-a165-416c48767d6c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:02:59.824168 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f5133552-0697-4ef2-a165-416c48767d6c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1235 microversion: 2.1 time: 0.172613 Oct 27 19:02:59.825815 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2017/3852] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:02:59 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1235 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:00.268585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a11a78c2-1f8c-4aa3-a95d-25130c71c502 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:00.270207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a11a78c2-1f8c-4aa3-a95d-25130c71c502 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:00.292411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a11a78c2-1f8c-4aa3-a95d-25130c71c502 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:00.293128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a11a78c2-1f8c-4aa3-a95d-25130c71c502 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:00.294466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a11a78c2-1f8c-4aa3-a95d-25130c71c502 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:00.295551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a11a78c2-1f8c-4aa3-a95d-25130c71c502 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:00.296046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a11a78c2-1f8c-4aa3-a95d-25130c71c502 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:00.296492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a11a78c2-1f8c-4aa3-a95d-25130c71c502 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:00.536559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a11a78c2-1f8c-4aa3-a95d-25130c71c502 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:00.545582 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a11a78c2-1f8c-4aa3-a95d-25130c71c502 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1539 microversion: 2.1 time: 0.290433 Oct 27 19:03:00.563308 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1836/3853] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:00 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1539 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:00.607333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-939c99c9-c494-49f0-9d35-5fc2972e24e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:00.607961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-939c99c9-c494-49f0-9d35-5fc2972e24e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:00.615369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-939c99c9-c494-49f0-9d35-5fc2972e24e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:00.616179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-939c99c9-c494-49f0-9d35-5fc2972e24e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:00.617091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-939c99c9-c494-49f0-9d35-5fc2972e24e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:00.618040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-939c99c9-c494-49f0-9d35-5fc2972e24e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:00.618752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-939c99c9-c494-49f0-9d35-5fc2972e24e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:00.619405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-939c99c9-c494-49f0-9d35-5fc2972e24e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:00.848254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0cc1920c-57ce-40ef-b0f6-111221b99906 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:00.849225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0cc1920c-57ce-40ef-b0f6-111221b99906 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:00.858359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cc1920c-57ce-40ef-b0f6-111221b99906 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:00.862801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cc1920c-57ce-40ef-b0f6-111221b99906 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:00.863281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cc1920c-57ce-40ef-b0f6-111221b99906 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:00.864044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cc1920c-57ce-40ef-b0f6-111221b99906 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:00.864526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cc1920c-57ce-40ef-b0f6-111221b99906 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:00.864967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cc1920c-57ce-40ef-b0f6-111221b99906 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:01.134515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0cc1920c-57ce-40ef-b0f6-111221b99906 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:01.143332 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0cc1920c-57ce-40ef-b0f6-111221b99906 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1299 microversion: 2.1 time: 0.298857 Oct 27 19:03:01.164023 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1837/3854] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:00 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1299 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:01.297420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-939c99c9-c494-49f0-9d35-5fc2972e24e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:01.321374 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-939c99c9-c494-49f0-9d35-5fc2972e24e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.717705 Oct 27 19:03:01.336043 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2018/3855] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:00 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:01.570674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cd583526-4c94-4953-ac76-833b9ba6eb4f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:01.571302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cd583526-4c94-4953-ac76-833b9ba6eb4f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:01.583827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd583526-4c94-4953-ac76-833b9ba6eb4f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:01.589448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd583526-4c94-4953-ac76-833b9ba6eb4f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:01.589916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd583526-4c94-4953-ac76-833b9ba6eb4f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:01.590704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd583526-4c94-4953-ac76-833b9ba6eb4f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:01.591179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd583526-4c94-4953-ac76-833b9ba6eb4f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:01.591609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd583526-4c94-4953-ac76-833b9ba6eb4f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:02.081349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cd583526-4c94-4953-ac76-833b9ba6eb4f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:02.094331 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cd583526-4c94-4953-ac76-833b9ba6eb4f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1539 microversion: 2.1 time: 0.527739 Oct 27 19:03:02.097537 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1838/3856] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:01 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1539 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:02.177522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e5c15d43-331d-4981-9d4c-4746b91f7ed1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:02.178145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e5c15d43-331d-4981-9d4c-4746b91f7ed1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:02.190677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5c15d43-331d-4981-9d4c-4746b91f7ed1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:02.191172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5c15d43-331d-4981-9d4c-4746b91f7ed1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:02.191613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5c15d43-331d-4981-9d4c-4746b91f7ed1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:02.196173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5c15d43-331d-4981-9d4c-4746b91f7ed1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:02.200488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5c15d43-331d-4981-9d4c-4746b91f7ed1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:02.200982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e5c15d43-331d-4981-9d4c-4746b91f7ed1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:02.349504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d09007ec-03f6-455a-9693-f55568905033 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:02.350125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d09007ec-03f6-455a-9693-f55568905033 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:02.360739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d09007ec-03f6-455a-9693-f55568905033 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:02.363109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d09007ec-03f6-455a-9693-f55568905033 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:02.370536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d09007ec-03f6-455a-9693-f55568905033 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:02.371613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d09007ec-03f6-455a-9693-f55568905033 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:02.373988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d09007ec-03f6-455a-9693-f55568905033 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:02.374676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d09007ec-03f6-455a-9693-f55568905033 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:02.400771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e5c15d43-331d-4981-9d4c-4746b91f7ed1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:02.404744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:02.420253 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e5c15d43-331d-4981-9d4c-4746b91f7ed1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1297 microversion: 2.1 time: 0.243056 Oct 27 19:03:02.421201 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2019/3857] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:02 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1297 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:02.636619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d09007ec-03f6-455a-9693-f55568905033 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:02.651631 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d09007ec-03f6-455a-9693-f55568905033 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1736 microversion: 2.1 time: 0.306122 Oct 27 19:03:02.652217 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1839/3858] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:02 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1736 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:02.898677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ce239ec7-d688-4d61-a0e1-309a54916df8 req-5a09d989-4a9a-4cbe-93bd-d95debc9e228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a809542-e7e8-400f-9493-fb9869b28927", "name": "network-vif-plugged", "status": "completed", "tag": "bd303fcc-c0fe-45c7-87d1-c450eaae0832"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:02.950725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ce239ec7-d688-4d61-a0e1-309a54916df8 req-5a09d989-4a9a-4cbe-93bd-d95debc9e228 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:02.955129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ce239ec7-d688-4d61-a0e1-309a54916df8 req-5a09d989-4a9a-4cbe-93bd-d95debc9e228 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:02.956861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ce239ec7-d688-4d61-a0e1-309a54916df8 req-5a09d989-4a9a-4cbe-93bd-d95debc9e228 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:02.983871 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ce239ec7-d688-4d61-a0e1-309a54916df8 req-5a09d989-4a9a-4cbe-93bd-d95debc9e228 service nova] Creating event network-vif-plugged:bd303fcc-c0fe-45c7-87d1-c450eaae0832 for instance 2a809542-e7e8-400f-9493-fb9869b28927 on n-h2-860687-3 Oct 27 19:03:02.991526 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ce239ec7-d688-4d61-a0e1-309a54916df8 req-5a09d989-4a9a-4cbe-93bd-d95debc9e228 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102216 Oct 27 19:03:03.003098 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2020/3859] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:03.125632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-265369ff-f30c-4950-811c-484aff2ff473 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:03.126488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-265369ff-f30c-4950-811c-484aff2ff473 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:03.140335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-265369ff-f30c-4950-811c-484aff2ff473 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:03.141069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-265369ff-f30c-4950-811c-484aff2ff473 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:03.141844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-265369ff-f30c-4950-811c-484aff2ff473 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:03.142914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-265369ff-f30c-4950-811c-484aff2ff473 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:03.143529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-265369ff-f30c-4950-811c-484aff2ff473 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:03.144106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-265369ff-f30c-4950-811c-484aff2ff473 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:03.450544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b7cf520-6156-4f13-a9e3-bc279e0352ef tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:03.451976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b7cf520-6156-4f13-a9e3-bc279e0352ef tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:03.460426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b7cf520-6156-4f13-a9e3-bc279e0352ef tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:03.461173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b7cf520-6156-4f13-a9e3-bc279e0352ef tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:03.461873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b7cf520-6156-4f13-a9e3-bc279e0352ef tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:03.463050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b7cf520-6156-4f13-a9e3-bc279e0352ef tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:03.463719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b7cf520-6156-4f13-a9e3-bc279e0352ef tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:03.464374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b7cf520-6156-4f13-a9e3-bc279e0352ef tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:03.585152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-265369ff-f30c-4950-811c-484aff2ff473 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:03.609996 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-265369ff-f30c-4950-811c-484aff2ff473 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1539 microversion: 2.1 time: 0.479679 Oct 27 19:03:03.629002 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1840/3860] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:03 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1539 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:03.684820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3e93ccba-0f09-4392-a52d-c5e79e7f8c5a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:03.685459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3e93ccba-0f09-4392-a52d-c5e79e7f8c5a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:03.694936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e93ccba-0f09-4392-a52d-c5e79e7f8c5a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:03.695496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e93ccba-0f09-4392-a52d-c5e79e7f8c5a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:03.695962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e93ccba-0f09-4392-a52d-c5e79e7f8c5a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:03.696657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e93ccba-0f09-4392-a52d-c5e79e7f8c5a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:03.697217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e93ccba-0f09-4392-a52d-c5e79e7f8c5a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:03.698016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e93ccba-0f09-4392-a52d-c5e79e7f8c5a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:03.707610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:03.795969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3b7cf520-6156-4f13-a9e3-bc279e0352ef tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:03.816638 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b7cf520-6156-4f13-a9e3-bc279e0352ef tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1364 microversion: 2.1 time: 0.369059 Oct 27 19:03:03.820735 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2021/3861] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:03 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1364 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:04.186786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3e93ccba-0f09-4392-a52d-c5e79e7f8c5a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:04.206953 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3e93ccba-0f09-4392-a52d-c5e79e7f8c5a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1716 microversion: 2.1 time: 0.528809 Oct 27 19:03:04.210456 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1841/3862] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:03 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1716 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:04.426293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-277289f3-955c-4300-9537-8c08c25f1dc1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:04.427959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-277289f3-955c-4300-9537-8c08c25f1dc1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:04.439789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-277289f3-955c-4300-9537-8c08c25f1dc1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:04.440657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-277289f3-955c-4300-9537-8c08c25f1dc1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:04.441357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-277289f3-955c-4300-9537-8c08c25f1dc1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:04.442868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-277289f3-955c-4300-9537-8c08c25f1dc1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:04.443743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-277289f3-955c-4300-9537-8c08c25f1dc1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:04.446293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-277289f3-955c-4300-9537-8c08c25f1dc1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:04.634761 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-277289f3-955c-4300-9537-8c08c25f1dc1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] HTTP exception thrown: Cannot 'detach_volume' instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 while it is in vm_state rescued Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-277289f3-955c-4300-9537-8c08c25f1dc1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Request method failure captured: Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments/fc1635f3-5222-4072-893b-3c26884e3aa5 HTTP/1.1 Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtTOhZ4eSrUIbh7FOH8abPh8o6s1SrCC6rl-rUyuXuq1ygfePdb0jYAcyGuJrVudmd8OxoZzpYzhODw3ejjYW0-ti5IZ9xJMsPzlMbC7OoicnuCUnW_JwGkg6OKXbZMBkqYeQENn4eoxSAgVgRaELA_KPYJgZbVCfoUL02eTSzGcONI Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_adeacece438645c4a0c5844d1ef83793", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2b706e9394a642cda315809db15ecbb3 Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: exception: Cannot 'detach_volume' instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 while it is in vm_state rescued Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'server_id': '0c958b48-5e00-49c6-95ab-a36acdbdf6e2', 'id': 'fc1635f3-5222-4072-893b-3c26884e3aa5'} Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 while it is in vm_state rescued Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:04.640262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:04.644608 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:04.644608 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:04.644608 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:03:04.644608 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:03:04.644608 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 while it is in vm_state rescued Oct 27 19:03:04.644608 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:04.644608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-277289f3-955c-4300-9537-8c08c25f1dc1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Returning 409 to user: Cannot 'detach_volume' instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 while it is in vm_state rescued {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:03:04.644608 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-277289f3-955c-4300-9537-8c08c25f1dc1 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments/fc1635f3-5222-4072-893b-3c26884e3aa5" status: 409 len: 152 microversion: 2.1 time: 0.226759 Oct 27 19:03:04.648832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-20a65179-1e0b-4aa3-8a66-70cdbaec6938 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:04.649452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-20a65179-1e0b-4aa3-8a66-70cdbaec6938 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:04.650549 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2022/3863] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:03:04 2022] DELETE /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments/fc1635f3-5222-4072-893b-3c26884e3aa5 => generated 152 bytes in 236 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:03:04.661872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20a65179-1e0b-4aa3-8a66-70cdbaec6938 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:04.663368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20a65179-1e0b-4aa3-8a66-70cdbaec6938 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:04.663368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20a65179-1e0b-4aa3-8a66-70cdbaec6938 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:04.663570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20a65179-1e0b-4aa3-8a66-70cdbaec6938 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:04.663972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20a65179-1e0b-4aa3-8a66-70cdbaec6938 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:04.664867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fcf2c554-2b8e-45a9-9766-a7327bc5968d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:04.665427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fcf2c554-2b8e-45a9-9766-a7327bc5968d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:04.671713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20a65179-1e0b-4aa3-8a66-70cdbaec6938 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:04.693560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf2c554-2b8e-45a9-9766-a7327bc5968d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:04.694788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf2c554-2b8e-45a9-9766-a7327bc5968d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:04.699655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf2c554-2b8e-45a9-9766-a7327bc5968d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:04.700679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf2c554-2b8e-45a9-9766-a7327bc5968d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:04.701721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf2c554-2b8e-45a9-9766-a7327bc5968d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:04.708547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf2c554-2b8e-45a9-9766-a7327bc5968d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:04.927847 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fcf2c554-2b8e-45a9-9766-a7327bc5968d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/action" status: 202 len: 0 microversion: 2.1 time: 0.275276 Oct 27 19:03:04.931732 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2023/3864] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:03:04 2022] POST /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:03:04.939145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-45907cdc-1ff1-4236-b937-3ef4022308be req-b377142d-d27f-4938-a584-2fc07af57c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83449394-d485-488c-853e-d928636b406e", "tag": "34511b60-81df-41ae-8c51-1294a7bdb507"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:04.966554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-45907cdc-1ff1-4236-b937-3ef4022308be req-b377142d-d27f-4938-a584-2fc07af57c1a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:04.967328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-45907cdc-1ff1-4236-b937-3ef4022308be req-b377142d-d27f-4938-a584-2fc07af57c1a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:04.967933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-45907cdc-1ff1-4236-b937-3ef4022308be req-b377142d-d27f-4938-a584-2fc07af57c1a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:04.994303 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-45907cdc-1ff1-4236-b937-3ef4022308be req-b377142d-d27f-4938-a584-2fc07af57c1a service nova] Creating event network-changed:34511b60-81df-41ae-8c51-1294a7bdb507 for instance 83449394-d485-488c-853e-d928636b406e on n-h1-860687-3 Oct 27 19:03:05.008079 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-45907cdc-1ff1-4236-b937-3ef4022308be req-b377142d-d27f-4938-a584-2fc07af57c1a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076543 Oct 27 19:03:05.008997 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2024/3865] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:05.017016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-156771df-f194-42a7-830a-383e64e238c2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:05.022957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-156771df-f194-42a7-830a-383e64e238c2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:05.041418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-156771df-f194-42a7-830a-383e64e238c2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:05.042129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-156771df-f194-42a7-830a-383e64e238c2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:05.042795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-156771df-f194-42a7-830a-383e64e238c2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:05.044338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-156771df-f194-42a7-830a-383e64e238c2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:05.044968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-156771df-f194-42a7-830a-383e64e238c2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:05.045565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-156771df-f194-42a7-830a-383e64e238c2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:05.280716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-156771df-f194-42a7-830a-383e64e238c2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:05.289859 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-156771df-f194-42a7-830a-383e64e238c2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1364 microversion: 2.1 time: 0.279633 Oct 27 19:03:05.299013 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2025/3866] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:05 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1364 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:05.328661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d5927c99-472d-436d-8f31-6d399a3f8082 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:05.329288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d5927c99-472d-436d-8f31-6d399a3f8082 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:05.341107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5927c99-472d-436d-8f31-6d399a3f8082 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:05.347821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5927c99-472d-436d-8f31-6d399a3f8082 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:05.348292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5927c99-472d-436d-8f31-6d399a3f8082 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:05.349058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5927c99-472d-436d-8f31-6d399a3f8082 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:05.354215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5927c99-472d-436d-8f31-6d399a3f8082 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:05.369795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5927c99-472d-436d-8f31-6d399a3f8082 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:05.586644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-20a65179-1e0b-4aa3-8a66-70cdbaec6938 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:05.602090 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-20a65179-1e0b-4aa3-8a66-70cdbaec6938 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1521 microversion: 2.1 time: 0.960533 Oct 27 19:03:05.602969 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1842/3867] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:04 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1521 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:05.630433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b33b21c0-f195-4483-9e20-0841f1d7b411 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:05.631295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b33b21c0-f195-4483-9e20-0841f1d7b411 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:05.645887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b33b21c0-f195-4483-9e20-0841f1d7b411 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:05.648797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b33b21c0-f195-4483-9e20-0841f1d7b411 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:05.650740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b33b21c0-f195-4483-9e20-0841f1d7b411 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:05.652250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b33b21c0-f195-4483-9e20-0841f1d7b411 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:05.653726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b33b21c0-f195-4483-9e20-0841f1d7b411 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:05.655020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b33b21c0-f195-4483-9e20-0841f1d7b411 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:05.700759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d5927c99-472d-436d-8f31-6d399a3f8082 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:05.712106 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d5927c99-472d-436d-8f31-6d399a3f8082 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1724 microversion: 2.1 time: 0.408612 Oct 27 19:03:05.713241 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2026/3868] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:05 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1724 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:05.727353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b33b21c0-f195-4483-9e20-0841f1d7b411 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:03:05.885279 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b33b21c0-f195-4483-9e20-0841f1d7b411 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 204 len: 0 microversion: 2.1 time: 0.260125 Oct 27 19:03:05.886860 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1843/3869] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:03:05 2022] DELETE /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:03:05.895683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2aeb4c95-6ff1-48fa-90c6-7af98314fb30 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:05.896556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2aeb4c95-6ff1-48fa-90c6-7af98314fb30 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:05.907005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2aeb4c95-6ff1-48fa-90c6-7af98314fb30 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:05.908629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2aeb4c95-6ff1-48fa-90c6-7af98314fb30 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:05.909321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2aeb4c95-6ff1-48fa-90c6-7af98314fb30 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:05.910210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2aeb4c95-6ff1-48fa-90c6-7af98314fb30 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:05.910853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2aeb4c95-6ff1-48fa-90c6-7af98314fb30 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:05.911451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2aeb4c95-6ff1-48fa-90c6-7af98314fb30 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:06.221505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2aeb4c95-6ff1-48fa-90c6-7af98314fb30 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:06.251747 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2aeb4c95-6ff1-48fa-90c6-7af98314fb30 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1527 microversion: 2.1 time: 0.359012 Oct 27 19:03:06.254521 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2027/3870] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:05 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1527 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:06.325080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cc2fc168-920a-408f-8588-619f03ea29df tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:06.326338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cc2fc168-920a-408f-8588-619f03ea29df tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:06.335304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc2fc168-920a-408f-8588-619f03ea29df tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:06.336028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc2fc168-920a-408f-8588-619f03ea29df tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:06.336745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc2fc168-920a-408f-8588-619f03ea29df tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:06.337750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc2fc168-920a-408f-8588-619f03ea29df tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:06.338541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc2fc168-920a-408f-8588-619f03ea29df tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:06.339293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc2fc168-920a-408f-8588-619f03ea29df tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:06.590966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cc2fc168-920a-408f-8588-619f03ea29df tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:06.600123 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cc2fc168-920a-408f-8588-619f03ea29df tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1364 microversion: 2.1 time: 0.279644 Oct 27 19:03:06.601622 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1844/3871] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:06 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1364 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:06.737111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-01dd6891-fe23-47a5-9c63-63aab5d727c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:06.738945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-01dd6891-fe23-47a5-9c63-63aab5d727c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:06.748012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01dd6891-fe23-47a5-9c63-63aab5d727c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:06.748964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01dd6891-fe23-47a5-9c63-63aab5d727c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:06.749735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01dd6891-fe23-47a5-9c63-63aab5d727c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:06.750711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01dd6891-fe23-47a5-9c63-63aab5d727c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:06.751934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01dd6891-fe23-47a5-9c63-63aab5d727c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:06.752582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01dd6891-fe23-47a5-9c63-63aab5d727c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:07.018868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-01dd6891-fe23-47a5-9c63-63aab5d727c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:07.030076 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-01dd6891-fe23-47a5-9c63-63aab5d727c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1724 microversion: 2.1 time: 0.296664 Oct 27 19:03:07.043048 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2028/3872] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:06 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:07.284855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4e7896e0-2d22-41e6-8b68-4338f62443cf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:07.289400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4e7896e0-2d22-41e6-8b68-4338f62443cf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:07.300506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e7896e0-2d22-41e6-8b68-4338f62443cf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:07.301113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e7896e0-2d22-41e6-8b68-4338f62443cf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:07.301839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e7896e0-2d22-41e6-8b68-4338f62443cf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:07.303202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e7896e0-2d22-41e6-8b68-4338f62443cf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:07.303974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e7896e0-2d22-41e6-8b68-4338f62443cf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:07.304638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e7896e0-2d22-41e6-8b68-4338f62443cf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:07.626818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-73f73ed7-31e1-400c-81b4-d83f84f48e4a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:07.627803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-73f73ed7-31e1-400c-81b4-d83f84f48e4a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:07.640980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73f73ed7-31e1-400c-81b4-d83f84f48e4a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:07.642080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73f73ed7-31e1-400c-81b4-d83f84f48e4a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:07.642804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73f73ed7-31e1-400c-81b4-d83f84f48e4a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:07.644122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73f73ed7-31e1-400c-81b4-d83f84f48e4a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:07.644806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73f73ed7-31e1-400c-81b4-d83f84f48e4a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:07.645472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73f73ed7-31e1-400c-81b4-d83f84f48e4a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:07.746588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4e7896e0-2d22-41e6-8b68-4338f62443cf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:07.755498 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4e7896e0-2d22-41e6-8b68-4338f62443cf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1527 microversion: 2.1 time: 0.478099 Oct 27 19:03:07.756092 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1845/3873] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:07 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1527 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:08.058507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2054294848", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:08.076065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:08.157009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:03:08.247725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-73f73ed7-31e1-400c-81b4-d83f84f48e4a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:08.286608 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-73f73ed7-31e1-400c-81b4-d83f84f48e4a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1364 microversion: 2.1 time: 0.659089 Oct 27 19:03:08.291457 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2029/3874] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:07 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1364 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:08.297145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:08.314212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5b5dcb55-f4fd-4254-9c15-7bf4e835fe55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:08.315458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5b5dcb55-f4fd-4254-9c15-7bf4e835fe55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:08.322342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=10 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:08.325081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b5dcb55-f4fd-4254-9c15-7bf4e835fe55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:08.326081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b5dcb55-f4fd-4254-9c15-7bf4e835fe55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:08.326927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b5dcb55-f4fd-4254-9c15-7bf4e835fe55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:08.327900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b5dcb55-f4fd-4254-9c15-7bf4e835fe55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:08.328707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b5dcb55-f4fd-4254-9c15-7bf4e835fe55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:08.331547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b5dcb55-f4fd-4254-9c15-7bf4e835fe55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:08.626018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:08.705895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:03:08.706602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:03:08.707074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:03:08.707793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:03:08.708375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:03:08.724593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:08.726791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:08.728174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:08.729155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:08.730608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:08.731246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:08.761529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Getting quotas for project 16b6ca515d694f398401546452ca2605. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:03:08.769094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Getting quotas for user ccac1edbadb748f0b4b2e8e2e19260ed and project 16b6ca515d694f398401546452ca2605. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:03:08.788926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:03:08.793235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:03:08.861523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5b5dcb55-f4fd-4254-9c15-7bf4e835fe55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:08.895639 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5b5dcb55-f4fd-4254-9c15-7bf4e835fe55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1724 microversion: 2.1 time: 0.599386 Oct 27 19:03:08.911434 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2030/3875] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:08 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1724 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:08.920388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-58dbe365-fc94-41ce-9143-7d441df75fa3 req-387baea2-12bd-4497-80f5-937946e3f904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a809542-e7e8-400f-9493-fb9869b28927", "name": "network-vif-unplugged", "status": "completed", "tag": "bd303fcc-c0fe-45c7-87d1-c450eaae0832"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:08.931257 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e64e48cb-02de-463f-aa2e-bbd3541d47d4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171694 Oct 27 19:03:08.932530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-58dbe365-fc94-41ce-9143-7d441df75fa3 req-387baea2-12bd-4497-80f5-937946e3f904 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:08.933291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-58dbe365-fc94-41ce-9143-7d441df75fa3 req-387baea2-12bd-4497-80f5-937946e3f904 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:08.934032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-58dbe365-fc94-41ce-9143-7d441df75fa3 req-387baea2-12bd-4497-80f5-937946e3f904 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:08.939771 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1846/3876] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:03:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:03:08.960453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-302afcc2-acaa-4776-b2ee-4da182326671 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:08.965173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-302afcc2-acaa-4776-b2ee-4da182326671 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:08.984751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-302afcc2-acaa-4776-b2ee-4da182326671 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:08.986662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-302afcc2-acaa-4776-b2ee-4da182326671 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:08.987278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-302afcc2-acaa-4776-b2ee-4da182326671 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:08.988452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-302afcc2-acaa-4776-b2ee-4da182326671 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:08.989074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-302afcc2-acaa-4776-b2ee-4da182326671 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:08.989668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-302afcc2-acaa-4776-b2ee-4da182326671 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:08.997159 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-58dbe365-fc94-41ce-9143-7d441df75fa3 req-387baea2-12bd-4497-80f5-937946e3f904 service nova] Creating event network-vif-unplugged:bd303fcc-c0fe-45c7-87d1-c450eaae0832 for instance 2a809542-e7e8-400f-9493-fb9869b28927 on n-h2-860687-3 Oct 27 19:03:09.019761 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-58dbe365-fc94-41ce-9143-7d441df75fa3 req-387baea2-12bd-4497-80f5-937946e3f904 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105031 Oct 27 19:03:09.021453 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2031/3877] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:09.029607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-778d8ccb-000b-4ab3-9139-97d0a5c63fe2 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:09.030766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-778d8ccb-000b-4ab3-9139-97d0a5c63fe2 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:09.202632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-778d8ccb-000b-4ab3-9139-97d0a5c63fe2 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:09.213351 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-778d8ccb-000b-4ab3-9139-97d0a5c63fe2 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1219 microversion: 2.1 time: 0.188676 Oct 27 19:03:09.227544 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2032/3878] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:09 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1219 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:09.268105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-302afcc2-acaa-4776-b2ee-4da182326671 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:09.283692 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-302afcc2-acaa-4776-b2ee-4da182326671 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1527 microversion: 2.1 time: 0.341784 Oct 27 19:03:09.284290 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1847/3879] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:08 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1527 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:09.314005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-708bae9e-feac-475e-b0d3-e2a2698d749a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:09.315823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-708bae9e-feac-475e-b0d3-e2a2698d749a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:09.323092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708bae9e-feac-475e-b0d3-e2a2698d749a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:09.323597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708bae9e-feac-475e-b0d3-e2a2698d749a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:09.324047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708bae9e-feac-475e-b0d3-e2a2698d749a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:09.324767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708bae9e-feac-475e-b0d3-e2a2698d749a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:09.325778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708bae9e-feac-475e-b0d3-e2a2698d749a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:09.326246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708bae9e-feac-475e-b0d3-e2a2698d749a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:09.451284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-13b559d7-e9f7-40c8-ad2a-5231eb09d1fd req-68de1e79-36cd-45f2-b956-f3c8a20cf8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a809542-e7e8-400f-9493-fb9869b28927", "name": "network-vif-deleted", "tag": "bd303fcc-c0fe-45c7-87d1-c450eaae0832"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:09.473823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-13b559d7-e9f7-40c8-ad2a-5231eb09d1fd req-68de1e79-36cd-45f2-b956-f3c8a20cf8da service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:09.474299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-13b559d7-e9f7-40c8-ad2a-5231eb09d1fd req-68de1e79-36cd-45f2-b956-f3c8a20cf8da service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:09.479076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-13b559d7-e9f7-40c8-ad2a-5231eb09d1fd req-68de1e79-36cd-45f2-b956-f3c8a20cf8da service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:09.527338 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-13b559d7-e9f7-40c8-ad2a-5231eb09d1fd req-68de1e79-36cd-45f2-b956-f3c8a20cf8da service nova] Creating event network-vif-deleted:bd303fcc-c0fe-45c7-87d1-c450eaae0832 for instance 2a809542-e7e8-400f-9493-fb9869b28927 on n-h2-860687-3 Oct 27 19:03:09.546030 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-13b559d7-e9f7-40c8-ad2a-5231eb09d1fd req-68de1e79-36cd-45f2-b956-f3c8a20cf8da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095389 Oct 27 19:03:09.552142 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1848/3880] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:03:09.618301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-708bae9e-feac-475e-b0d3-e2a2698d749a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:09.638773 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-708bae9e-feac-475e-b0d3-e2a2698d749a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1364 microversion: 2.1 time: 0.328426 Oct 27 19:03:09.639655 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2033/3881] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:09 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:09.938414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d15f637e-08f2-4f56-849c-b97decc14221 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:09.939718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d15f637e-08f2-4f56-849c-b97decc14221 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:09.948165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d15f637e-08f2-4f56-849c-b97decc14221 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:09.948947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d15f637e-08f2-4f56-849c-b97decc14221 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:09.949619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d15f637e-08f2-4f56-849c-b97decc14221 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:09.950497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d15f637e-08f2-4f56-849c-b97decc14221 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:09.951284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d15f637e-08f2-4f56-849c-b97decc14221 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:09.951852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d15f637e-08f2-4f56-849c-b97decc14221 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:10.118987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d15f637e-08f2-4f56-849c-b97decc14221 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:10.135086 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d15f637e-08f2-4f56-849c-b97decc14221 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1724 microversion: 2.1 time: 0.201511 Oct 27 19:03:10.147907 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1849/3882] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:09 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:10.237086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-83d30729-0a75-457b-8109-285f4bd1a24d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:10.237734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-83d30729-0a75-457b-8109-285f4bd1a24d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:10.245312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d30729-0a75-457b-8109-285f4bd1a24d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:10.245810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d30729-0a75-457b-8109-285f4bd1a24d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:10.246547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d30729-0a75-457b-8109-285f4bd1a24d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:10.247411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d30729-0a75-457b-8109-285f4bd1a24d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:10.248500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d30729-0a75-457b-8109-285f4bd1a24d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:10.248500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d30729-0a75-457b-8109-285f4bd1a24d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:10.308212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f0ed05d5-1c2e-480b-8908-f1f383917b86 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:10.308917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f0ed05d5-1c2e-480b-8908-f1f383917b86 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:10.316310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0ed05d5-1c2e-480b-8908-f1f383917b86 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:10.327041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0ed05d5-1c2e-480b-8908-f1f383917b86 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:10.327749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0ed05d5-1c2e-480b-8908-f1f383917b86 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:10.328489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0ed05d5-1c2e-480b-8908-f1f383917b86 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:10.328961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0ed05d5-1c2e-480b-8908-f1f383917b86 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:10.329390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0ed05d5-1c2e-480b-8908-f1f383917b86 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:10.359189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-83d30729-0a75-457b-8109-285f4bd1a24d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:10.370094 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-83d30729-0a75-457b-8109-285f4bd1a24d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1223 microversion: 2.1 time: 0.137697 Oct 27 19:03:10.376411 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2034/3883] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:10 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1223 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:10.460423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f0ed05d5-1c2e-480b-8908-f1f383917b86 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:10.474224 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f0ed05d5-1c2e-480b-8908-f1f383917b86 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1485 microversion: 2.1 time: 0.167390 Oct 27 19:03:10.474914 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1850/3884] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:10 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1485 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:10.665947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-00e8c7b8-6959-4253-8b0a-c48ddf4b43b2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:10.666600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-00e8c7b8-6959-4253-8b0a-c48ddf4b43b2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:10.672663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00e8c7b8-6959-4253-8b0a-c48ddf4b43b2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:10.673157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00e8c7b8-6959-4253-8b0a-c48ddf4b43b2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:10.673600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00e8c7b8-6959-4253-8b0a-c48ddf4b43b2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:10.674300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00e8c7b8-6959-4253-8b0a-c48ddf4b43b2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:10.675061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00e8c7b8-6959-4253-8b0a-c48ddf4b43b2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:10.675491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00e8c7b8-6959-4253-8b0a-c48ddf4b43b2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:10.883609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-00e8c7b8-6959-4253-8b0a-c48ddf4b43b2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:10.892294 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-00e8c7b8-6959-4253-8b0a-c48ddf4b43b2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1364 microversion: 2.1 time: 0.230378 Oct 27 19:03:10.893196 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2035/3885] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:10 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:11.036335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-38f487ff-2ad0-4888-a899-085995269c13 req-2c8e39ef-564f-4781-af8c-7aa4e832d865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83449394-d485-488c-853e-d928636b406e", "name": "network-vif-plugged", "status": "completed", "tag": "34511b60-81df-41ae-8c51-1294a7bdb507"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:11.046699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-38f487ff-2ad0-4888-a899-085995269c13 req-2c8e39ef-564f-4781-af8c-7aa4e832d865 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:11.047123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-38f487ff-2ad0-4888-a899-085995269c13 req-2c8e39ef-564f-4781-af8c-7aa4e832d865 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:11.047566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-38f487ff-2ad0-4888-a899-085995269c13 req-2c8e39ef-564f-4781-af8c-7aa4e832d865 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:11.070640 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-38f487ff-2ad0-4888-a899-085995269c13 req-2c8e39ef-564f-4781-af8c-7aa4e832d865 service nova] Creating event network-vif-plugged:34511b60-81df-41ae-8c51-1294a7bdb507 for instance 83449394-d485-488c-853e-d928636b406e on n-h1-860687-3 Oct 27 19:03:11.076898 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-38f487ff-2ad0-4888-a899-085995269c13 req-2c8e39ef-564f-4781-af8c-7aa4e832d865 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044200 Oct 27 19:03:11.082626 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1851/3886] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:11.161809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ad724fef-fbeb-4adc-a183-6655555a82e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:11.163449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ad724fef-fbeb-4adc-a183-6655555a82e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:11.170930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:11.181836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad724fef-fbeb-4adc-a183-6655555a82e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:11.182656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad724fef-fbeb-4adc-a183-6655555a82e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:11.183489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad724fef-fbeb-4adc-a183-6655555a82e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:11.184564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad724fef-fbeb-4adc-a183-6655555a82e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:11.185412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad724fef-fbeb-4adc-a183-6655555a82e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:11.185958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad724fef-fbeb-4adc-a183-6655555a82e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:11.384411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ad724fef-fbeb-4adc-a183-6655555a82e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:11.393097 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ad724fef-fbeb-4adc-a183-6655555a82e4 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1730 microversion: 2.1 time: 0.235928 Oct 27 19:03:11.393676 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2036/3887] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:11 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:11.400928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1d533674-1cab-4afb-b1d2-a82b2a667ff8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:11.401725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1d533674-1cab-4afb-b1d2-a82b2a667ff8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:11.408961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d533674-1cab-4afb-b1d2-a82b2a667ff8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:11.409715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d533674-1cab-4afb-b1d2-a82b2a667ff8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:11.410222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d533674-1cab-4afb-b1d2-a82b2a667ff8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:11.411074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d533674-1cab-4afb-b1d2-a82b2a667ff8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:11.411604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d533674-1cab-4afb-b1d2-a82b2a667ff8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:11.412271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d533674-1cab-4afb-b1d2-a82b2a667ff8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:11.420141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-29c6631d-56db-4f67-a8ad-b7f64bcb3831 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:11.420932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-29c6631d-56db-4f67-a8ad-b7f64bcb3831 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:11.427806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29c6631d-56db-4f67-a8ad-b7f64bcb3831 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:11.429905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29c6631d-56db-4f67-a8ad-b7f64bcb3831 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:11.430668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29c6631d-56db-4f67-a8ad-b7f64bcb3831 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:11.431644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29c6631d-56db-4f67-a8ad-b7f64bcb3831 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:11.432288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29c6631d-56db-4f67-a8ad-b7f64bcb3831 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:11.433033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29c6631d-56db-4f67-a8ad-b7f64bcb3831 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:11.582585 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-29c6631d-56db-4f67-a8ad-b7f64bcb3831 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168566 Oct 27 19:03:11.589498 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2037/3888] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:03:11 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-interface => generated 285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:11.603858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-daac5e24-fdd4-401a-bf8f-26f00da410ac tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:11.607405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-daac5e24-fdd4-401a-bf8f-26f00da410ac tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:11.619991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-daac5e24-fdd4-401a-bf8f-26f00da410ac tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:11.622785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-daac5e24-fdd4-401a-bf8f-26f00da410ac tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:11.623758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-daac5e24-fdd4-401a-bf8f-26f00da410ac tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:11.624736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-daac5e24-fdd4-401a-bf8f-26f00da410ac tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:11.625563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-daac5e24-fdd4-401a-bf8f-26f00da410ac tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:11.626254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-daac5e24-fdd4-401a-bf8f-26f00da410ac tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:11.687532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-daac5e24-fdd4-401a-bf8f-26f00da410ac tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:11.689039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-daac5e24-fdd4-401a-bf8f-26f00da410ac tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:11.689915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-daac5e24-fdd4-401a-bf8f-26f00da410ac tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:11.692677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-daac5e24-fdd4-401a-bf8f-26f00da410ac tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lazy-loading 'fault' on Instance uuid 2a809542-e7e8-400f-9493-fb9869b28927 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:03:11.698310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1d533674-1cab-4afb-b1d2-a82b2a667ff8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:11.698818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:11.712306 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1d533674-1cab-4afb-b1d2-a82b2a667ff8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1215 microversion: 2.1 time: 0.317138 Oct 27 19:03:11.712921 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1852/3889] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:11 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1215 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:11.791011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-daac5e24-fdd4-401a-bf8f-26f00da410ac tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:11.802494 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-daac5e24-fdd4-401a-bf8f-26f00da410ac tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 200 len: 1315 microversion: 2.1 time: 0.210801 Oct 27 19:03:11.803873 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2038/3890] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:11 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:11.918628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c5bce651-902d-49e0-af3f-365b94b137c4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:11.919506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c5bce651-902d-49e0-af3f-365b94b137c4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:11.930316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5bce651-902d-49e0-af3f-365b94b137c4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:11.931376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5bce651-902d-49e0-af3f-365b94b137c4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:11.932356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5bce651-902d-49e0-af3f-365b94b137c4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:11.933897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5bce651-902d-49e0-af3f-365b94b137c4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:11.935491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5bce651-902d-49e0-af3f-365b94b137c4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:11.936487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5bce651-902d-49e0-af3f-365b94b137c4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:12.363592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c5bce651-902d-49e0-af3f-365b94b137c4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:12.373078 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c5bce651-902d-49e0-af3f-365b94b137c4 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1364 microversion: 2.1 time: 0.458618 Oct 27 19:03:12.380162 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1853/3891] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:11 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1364 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:12.741824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6473380-72cc-42c6-ba5f-f4277fee8efe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:12.743879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d6473380-72cc-42c6-ba5f-f4277fee8efe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:12.753055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6473380-72cc-42c6-ba5f-f4277fee8efe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:12.754424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6473380-72cc-42c6-ba5f-f4277fee8efe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:12.755127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6473380-72cc-42c6-ba5f-f4277fee8efe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:12.756096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6473380-72cc-42c6-ba5f-f4277fee8efe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:12.758216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6473380-72cc-42c6-ba5f-f4277fee8efe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:12.758997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6473380-72cc-42c6-ba5f-f4277fee8efe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:12.830605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-297f24c3-64a1-40c8-8f48-fe7594ab669d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:12.831242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-297f24c3-64a1-40c8-8f48-fe7594ab669d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:12.844542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-297f24c3-64a1-40c8-8f48-fe7594ab669d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:12.845049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-297f24c3-64a1-40c8-8f48-fe7594ab669d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:12.845715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-297f24c3-64a1-40c8-8f48-fe7594ab669d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:12.846640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-297f24c3-64a1-40c8-8f48-fe7594ab669d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:12.847436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-297f24c3-64a1-40c8-8f48-fe7594ab669d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:12.848152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-297f24c3-64a1-40c8-8f48-fe7594ab669d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:12.868946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d6473380-72cc-42c6-ba5f-f4277fee8efe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:12.877827 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-297f24c3-64a1-40c8-8f48-fe7594ab669d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] HTTP exception thrown: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-297f24c3-64a1-40c8-8f48-fe7594ab669d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Request method failure captured: Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 HTTP/1.1 Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtXIBO-oIT-HYTB2aEriLPPQy4zwsnSlx9DGo1owgDeViDL8xz9gdgxBZ6h4yaNReHUFDpmMjxtiWf7mVDXaedJvOc8Qwc8zJEa7KWRfdPMYJLUDfqmLkDFiFu3cWColj_-lSB8MMmJyxn24nK4fQdr9h8etZXRJSRnN6iLr8tUpzOk Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d4f98a2b116433bb88cc3541ea44f8b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: a4f9579efc194f4c8f9d02d4c21867d8 Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '2a809542-e7e8-400f-9493-fb9869b28927'} Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:12.880148 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:12.884039 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:12.884039 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:12.884039 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:12.884039 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:12.884039 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:03:12.884039 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:03:12.884039 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:03:12.884039 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:12.884489 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d6473380-72cc-42c6-ba5f-f4277fee8efe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1277 microversion: 2.1 time: 0.143173 Oct 27 19:03:12.884489 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2039/3892] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:12 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:12.886077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-297f24c3-64a1-40c8-8f48-fe7594ab669d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Returning 404 to user: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:03:12.887243 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-297f24c3-64a1-40c8-8f48-fe7594ab669d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 404 len: 111 microversion: 2.1 time: 0.060913 Oct 27 19:03:12.894576 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1854/3893] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:12 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:03:12.900069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f7646593-c948-498c-8d3f-983982fc3a2f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Action: 'create', calling method: .version_select at 0x7fc86a019ca0>, body: {"keypair": {"name": "tempest-keypair-1221579010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnk6kh3RydcFZ+KbbxfU7qYub9qZ06miePhpzlDnkCTQy2so7LBFiEeHunQBJSn8YgvEEmc7BRC2wLeVn9auvuBqVwYZQR9pg1uDZEO4FLOhYPB/9GhupMGi3QyAD+0rw=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:12.954897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-f7646593-c948-498c-8d3f-983982fc3a2f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Getting quotas for project 7d4f98a2b116433bb88cc3541ea44f8b. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:03:12.976309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-f7646593-c948-498c-8d3f-983982fc3a2f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Getting quotas for user a4f9579efc194f4c8f9d02d4c21867d8 and project 7d4f98a2b116433bb88cc3541ea44f8b. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:03:13.030479 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f7646593-c948-498c-8d3f-983982fc3a2f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134858 Oct 27 19:03:13.031814 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2040/3894] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:03:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:03:13.404145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a3d23fab-30d5-4c9f-8ca9-365d36c65c13 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:13.405444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a3d23fab-30d5-4c9f-8ca9-365d36c65c13 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:13.419600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3d23fab-30d5-4c9f-8ca9-365d36c65c13 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:13.420421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3d23fab-30d5-4c9f-8ca9-365d36c65c13 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:13.421092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3d23fab-30d5-4c9f-8ca9-365d36c65c13 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:13.422073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3d23fab-30d5-4c9f-8ca9-365d36c65c13 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:13.425711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3d23fab-30d5-4c9f-8ca9-365d36c65c13 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:13.426427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3d23fab-30d5-4c9f-8ca9-365d36c65c13 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:13.601639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-798846f9-b471-4b69-80dc-b178964ff4bb req-2d7caf80-8828-44a3-91de-ef5b6097e7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c958b48-5e00-49c6-95ab-a36acdbdf6e2", "tag": "f5c0b623-9e29-4d46-9459-e03cfbf0d547"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:13.616356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-798846f9-b471-4b69-80dc-b178964ff4bb req-2d7caf80-8828-44a3-91de-ef5b6097e7c9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:13.616869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-798846f9-b471-4b69-80dc-b178964ff4bb req-2d7caf80-8828-44a3-91de-ef5b6097e7c9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:13.618575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-798846f9-b471-4b69-80dc-b178964ff4bb req-2d7caf80-8828-44a3-91de-ef5b6097e7c9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:13.652007 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-798846f9-b471-4b69-80dc-b178964ff4bb req-2d7caf80-8828-44a3-91de-ef5b6097e7c9 service nova] Creating event network-changed:f5c0b623-9e29-4d46-9459-e03cfbf0d547 for instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 on n-h2-860687-3 Oct 27 19:03:13.657641 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-798846f9-b471-4b69-80dc-b178964ff4bb req-2d7caf80-8828-44a3-91de-ef5b6097e7c9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061225 Oct 27 19:03:13.658288 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2041/3895] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:13.797840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a3d23fab-30d5-4c9f-8ca9-365d36c65c13 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:13.808739 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a3d23fab-30d5-4c9f-8ca9-365d36c65c13 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1554 microversion: 2.1 time: 0.409296 Oct 27 19:03:13.812041 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1855/3896] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:13 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1554 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:13.834225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2f93084e-2e9a-45c9-858d-96d799f2633d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:13.835500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2f93084e-2e9a-45c9-858d-96d799f2633d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:13.843354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f93084e-2e9a-45c9-858d-96d799f2633d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:13.844037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f93084e-2e9a-45c9-858d-96d799f2633d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:13.844737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f93084e-2e9a-45c9-858d-96d799f2633d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:13.847214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f93084e-2e9a-45c9-858d-96d799f2633d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:13.847949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f93084e-2e9a-45c9-858d-96d799f2633d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:13.848584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f93084e-2e9a-45c9-858d-96d799f2633d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:13.908788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d0a987e7-e9c0-46e3-bede-a9cd5211a9e7 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:13.909637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d0a987e7-e9c0-46e3-bede-a9cd5211a9e7 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:13.922683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0a987e7-e9c0-46e3-bede-a9cd5211a9e7 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:13.925887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0a987e7-e9c0-46e3-bede-a9cd5211a9e7 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:13.926560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0a987e7-e9c0-46e3-bede-a9cd5211a9e7 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:13.927461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0a987e7-e9c0-46e3-bede-a9cd5211a9e7 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:13.928086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0a987e7-e9c0-46e3-bede-a9cd5211a9e7 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:13.932003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0a987e7-e9c0-46e3-bede-a9cd5211a9e7 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:14.101407 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2f93084e-2e9a-45c9-858d-96d799f2633d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.271705 Oct 27 19:03:14.102219 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2042/3897] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:03:13 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-interface => generated 284 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:14.526179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d0a987e7-e9c0-46e3-bede-a9cd5211a9e7 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:14.542946 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d0a987e7-e9c0-46e3-bede-a9cd5211a9e7 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1319 microversion: 2.1 time: 0.636350 Oct 27 19:03:14.544330 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1856/3898] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:13 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1319 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:15.568701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9a6c9a05-102f-4f46-a0bf-da41be17c843 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:15.570414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9a6c9a05-102f-4f46-a0bf-da41be17c843 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:15.589069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a6c9a05-102f-4f46-a0bf-da41be17c843 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:15.595585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a6c9a05-102f-4f46-a0bf-da41be17c843 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:15.597955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a6c9a05-102f-4f46-a0bf-da41be17c843 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:15.599039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a6c9a05-102f-4f46-a0bf-da41be17c843 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:15.599737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a6c9a05-102f-4f46-a0bf-da41be17c843 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:15.600549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a6c9a05-102f-4f46-a0bf-da41be17c843 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:15.995685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-1c94821a-6e8b-4904-ad4c-41fd96be27f0 req-86adbb6d-1e97-4293-9ebe-4fe8750d6e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb548e1-fdb6-420e-af5b-690399b898e6", "tag": "0f25fd90-2bd6-4cfe-a985-09e4c0ca3212"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:16.033649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1c94821a-6e8b-4904-ad4c-41fd96be27f0 req-86adbb6d-1e97-4293-9ebe-4fe8750d6e7b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:16.034089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1c94821a-6e8b-4904-ad4c-41fd96be27f0 req-86adbb6d-1e97-4293-9ebe-4fe8750d6e7b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:16.034560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1c94821a-6e8b-4904-ad4c-41fd96be27f0 req-86adbb6d-1e97-4293-9ebe-4fe8750d6e7b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:16.097857 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-1c94821a-6e8b-4904-ad4c-41fd96be27f0 req-86adbb6d-1e97-4293-9ebe-4fe8750d6e7b service nova] Creating event network-changed:0f25fd90-2bd6-4cfe-a985-09e4c0ca3212 for instance eeb548e1-fdb6-420e-af5b-690399b898e6 on n-h2-860687-3 Oct 27 19:03:16.121435 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-1c94821a-6e8b-4904-ad4c-41fd96be27f0 req-86adbb6d-1e97-4293-9ebe-4fe8750d6e7b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130244 Oct 27 19:03:16.122070 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1857/3899] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:03:16.183049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-7cab2e6c-f6cf-4c53-928f-073957173852 req-120dd166-249f-4e38-b099-0ceaeedd6a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c958b48-5e00-49c6-95ab-a36acdbdf6e2", "tag": "f5c0b623-9e29-4d46-9459-e03cfbf0d547"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:16.186835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9a6c9a05-102f-4f46-a0bf-da41be17c843 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:16.210027 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9a6c9a05-102f-4f46-a0bf-da41be17c843 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1319 microversion: 2.1 time: 0.640583 Oct 27 19:03:16.210745 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2043/3900] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:15 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1319 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:16.221847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7cab2e6c-f6cf-4c53-928f-073957173852 req-120dd166-249f-4e38-b099-0ceaeedd6a52 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:16.224386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7cab2e6c-f6cf-4c53-928f-073957173852 req-120dd166-249f-4e38-b099-0ceaeedd6a52 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:16.224844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7cab2e6c-f6cf-4c53-928f-073957173852 req-120dd166-249f-4e38-b099-0ceaeedd6a52 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:16.243180 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-7cab2e6c-f6cf-4c53-928f-073957173852 req-120dd166-249f-4e38-b099-0ceaeedd6a52 service nova] Creating event network-changed:f5c0b623-9e29-4d46-9459-e03cfbf0d547 for instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 on n-h2-860687-3 Oct 27 19:03:16.248914 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-7cab2e6c-f6cf-4c53-928f-073957173852 req-120dd166-249f-4e38-b099-0ceaeedd6a52 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076868 Oct 27 19:03:16.249840 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1858/3901] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:03:17.238822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-45d842fe-f950-4685-bc70-d1a38e3ea252 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:17.241365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-45d842fe-f950-4685-bc70-d1a38e3ea252 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:17.265467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45d842fe-f950-4685-bc70-d1a38e3ea252 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:17.267535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45d842fe-f950-4685-bc70-d1a38e3ea252 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:17.269340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45d842fe-f950-4685-bc70-d1a38e3ea252 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:17.272996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45d842fe-f950-4685-bc70-d1a38e3ea252 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:17.289089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45d842fe-f950-4685-bc70-d1a38e3ea252 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:17.290067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-45d842fe-f950-4685-bc70-d1a38e3ea252 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:18.454869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-662857819", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:18.541378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] validate_networks() for [('f9ed35b9-356a-471b-bf27-3cd9e45d57b6', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:03:18.640077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-45d842fe-f950-4685-bc70-d1a38e3ea252 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:18.655360 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-45d842fe-f950-4685-bc70-d1a38e3ea252 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1319 microversion: 2.1 time: 1.415760 Oct 27 19:03:18.657667 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2044/3902] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:17 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1319 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:18.688948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-1d089f7d-1f7d-4f99-ad34-8b1f4a859254 req-339b9849-7948-436e-a36a-3da077445131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83449394-d485-488c-853e-d928636b406e", "tag": "34511b60-81df-41ae-8c51-1294a7bdb507"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:18.744711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1d089f7d-1f7d-4f99-ad34-8b1f4a859254 req-339b9849-7948-436e-a36a-3da077445131 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:18.745200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1d089f7d-1f7d-4f99-ad34-8b1f4a859254 req-339b9849-7948-436e-a36a-3da077445131 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:18.745638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1d089f7d-1f7d-4f99-ad34-8b1f4a859254 req-339b9849-7948-436e-a36a-3da077445131 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:18.747431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:18.782628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:18.785958 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-1d089f7d-1f7d-4f99-ad34-8b1f4a859254 req-339b9849-7948-436e-a36a-3da077445131 service nova] Creating event network-changed:34511b60-81df-41ae-8c51-1294a7bdb507 for instance 83449394-d485-488c-853e-d928636b406e on n-h1-860687-3 Oct 27 19:03:18.804830 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-1d089f7d-1f7d-4f99-ad34-8b1f4a859254 req-339b9849-7948-436e-a36a-3da077445131 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144545 Oct 27 19:03:18.805463 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2045/3903] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:19.687417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-63d01cda-b7e7-4a43-b674-a25c115e7c4e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:19.688418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-63d01cda-b7e7-4a43-b674-a25c115e7c4e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:19.708100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63d01cda-b7e7-4a43-b674-a25c115e7c4e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:19.708738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63d01cda-b7e7-4a43-b674-a25c115e7c4e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:19.709175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63d01cda-b7e7-4a43-b674-a25c115e7c4e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:19.714100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63d01cda-b7e7-4a43-b674-a25c115e7c4e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:19.714606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63d01cda-b7e7-4a43-b674-a25c115e7c4e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:19.715234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63d01cda-b7e7-4a43-b674-a25c115e7c4e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:20.204296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-63d01cda-b7e7-4a43-b674-a25c115e7c4e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:20.218891 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-63d01cda-b7e7-4a43-b674-a25c115e7c4e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1319 microversion: 2.1 time: 0.538092 Oct 27 19:03:20.230499 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2046/3904] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:19 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1319 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:20.360984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:03:20.361545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:03:20.363011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:03:20.363532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:03:20.364186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:03:20.385406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:20.389581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:20.390461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:20.395514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:20.397790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:20.398552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:20.445957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Getting quotas for project 7d4f98a2b116433bb88cc3541ea44f8b. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:03:20.469757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Getting quotas for user a4f9579efc194f4c8f9d02d4c21867d8 and project 7d4f98a2b116433bb88cc3541ea44f8b. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:03:20.519430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:03:20.529416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:03:20.661045 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-df6865fe-65a2-4643-ac7d-33aed7154ca5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.221610 Oct 27 19:03:20.663087 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1859/3905] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:03:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 19:03:20.675476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ec53ed5c-50c9-486c-972c-c36ef3b1462b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:20.676484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ec53ed5c-50c9-486c-972c-c36ef3b1462b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:20.894283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ec53ed5c-50c9-486c-972c-c36ef3b1462b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:20.914477 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ec53ed5c-50c9-486c-972c-c36ef3b1462b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1224 microversion: 2.1 time: 0.240558 Oct 27 19:03:20.920796 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2047/3906] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:20 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1224 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:21.248978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4b03f49f-83cb-4c2a-af20-7313a86676ee tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:21.250329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4b03f49f-83cb-4c2a-af20-7313a86676ee tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:21.264133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b03f49f-83cb-4c2a-af20-7313a86676ee tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:21.264434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b03f49f-83cb-4c2a-af20-7313a86676ee tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:21.265195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b03f49f-83cb-4c2a-af20-7313a86676ee tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:21.268498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b03f49f-83cb-4c2a-af20-7313a86676ee tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:21.269303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b03f49f-83cb-4c2a-af20-7313a86676ee tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:21.270076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b03f49f-83cb-4c2a-af20-7313a86676ee tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:21.546213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4b03f49f-83cb-4c2a-af20-7313a86676ee tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:21.553988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:21.567741 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4b03f49f-83cb-4c2a-af20-7313a86676ee tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1319 microversion: 2.1 time: 0.325388 Oct 27 19:03:21.569433 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1860/3907] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:21 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:21.947139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7b301239-cd3f-420f-8149-da5a27ed0371 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:21.950587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7b301239-cd3f-420f-8149-da5a27ed0371 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:21.965179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b301239-cd3f-420f-8149-da5a27ed0371 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:21.965676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b301239-cd3f-420f-8149-da5a27ed0371 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:21.966119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b301239-cd3f-420f-8149-da5a27ed0371 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:21.975484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b301239-cd3f-420f-8149-da5a27ed0371 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:21.976147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b301239-cd3f-420f-8149-da5a27ed0371 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:21.976598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b301239-cd3f-420f-8149-da5a27ed0371 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:22.121863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7b301239-cd3f-420f-8149-da5a27ed0371 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:22.131916 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7b301239-cd3f-420f-8149-da5a27ed0371 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1276 microversion: 2.1 time: 0.191408 Oct 27 19:03:22.134857 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2048/3908] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:21 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:22.593236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d90eee98-2bf2-49f0-8d4c-26a2e4545c41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:22.594581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d90eee98-2bf2-49f0-8d4c-26a2e4545c41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:22.607303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d90eee98-2bf2-49f0-8d4c-26a2e4545c41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:22.608077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d90eee98-2bf2-49f0-8d4c-26a2e4545c41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:22.608682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d90eee98-2bf2-49f0-8d4c-26a2e4545c41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:22.610588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d90eee98-2bf2-49f0-8d4c-26a2e4545c41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:22.614796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d90eee98-2bf2-49f0-8d4c-26a2e4545c41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:22.615431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d90eee98-2bf2-49f0-8d4c-26a2e4545c41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:23.159891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b545948-2b8f-4f2f-b4e8-63188a7fba08 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:23.161796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1b545948-2b8f-4f2f-b4e8-63188a7fba08 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:23.171195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b545948-2b8f-4f2f-b4e8-63188a7fba08 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:23.172015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b545948-2b8f-4f2f-b4e8-63188a7fba08 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:23.172704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b545948-2b8f-4f2f-b4e8-63188a7fba08 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:23.173653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b545948-2b8f-4f2f-b4e8-63188a7fba08 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:23.175220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b545948-2b8f-4f2f-b4e8-63188a7fba08 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:23.175877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b545948-2b8f-4f2f-b4e8-63188a7fba08 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:23.314808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d90eee98-2bf2-49f0-8d4c-26a2e4545c41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:23.335884 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d90eee98-2bf2-49f0-8d4c-26a2e4545c41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1319 microversion: 2.1 time: 0.746564 Oct 27 19:03:23.350604 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1861/3909] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:22 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1319 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:23.967666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1b545948-2b8f-4f2f-b4e8-63188a7fba08 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:23.977367 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1b545948-2b8f-4f2f-b4e8-63188a7fba08 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1324 microversion: 2.1 time: 0.823224 Oct 27 19:03:23.978737 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2049/3910] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:23 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1324 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:24.368219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e2b10f88-e69a-4622-9bf5-d78ac2895fc9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:24.371002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e2b10f88-e69a-4622-9bf5-d78ac2895fc9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:24.384031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2b10f88-e69a-4622-9bf5-d78ac2895fc9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:24.384856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2b10f88-e69a-4622-9bf5-d78ac2895fc9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:24.385482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2b10f88-e69a-4622-9bf5-d78ac2895fc9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:24.387810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2b10f88-e69a-4622-9bf5-d78ac2895fc9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:24.388468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2b10f88-e69a-4622-9bf5-d78ac2895fc9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:24.389135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2b10f88-e69a-4622-9bf5-d78ac2895fc9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:24.753302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e2b10f88-e69a-4622-9bf5-d78ac2895fc9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:24.762069 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e2b10f88-e69a-4622-9bf5-d78ac2895fc9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1319 microversion: 2.1 time: 0.405903 Oct 27 19:03:24.763315 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1862/3911] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:24 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:24.911044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-12665c46-c867-45f0-bbc7-a277874106d6 req-6a68041f-d892-45b9-9d69-30e1fde319c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7473ff5e-df54-4fe1-ad84-88acc1fe0def", "tag": "6cbd8d96-273b-4d5e-a1b4-9a9a109deae2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:24.927796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-12665c46-c867-45f0-bbc7-a277874106d6 req-6a68041f-d892-45b9-9d69-30e1fde319c4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:24.928323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-12665c46-c867-45f0-bbc7-a277874106d6 req-6a68041f-d892-45b9-9d69-30e1fde319c4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:24.930936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-12665c46-c867-45f0-bbc7-a277874106d6 req-6a68041f-d892-45b9-9d69-30e1fde319c4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:24.948604 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-12665c46-c867-45f0-bbc7-a277874106d6 req-6a68041f-d892-45b9-9d69-30e1fde319c4 service nova] Creating event network-changed:6cbd8d96-273b-4d5e-a1b4-9a9a109deae2 for instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def on n-h2-860687-3 Oct 27 19:03:24.967889 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-12665c46-c867-45f0-bbc7-a277874106d6 req-6a68041f-d892-45b9-9d69-30e1fde319c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060334 Oct 27 19:03:24.972513 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2050/3912] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:24.976930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-a1700495-f40f-49f2-b9d1-23bc5cd8e56a req-03ca7df8-f2dc-4786-a78b-345ab379e7fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb548e1-fdb6-420e-af5b-690399b898e6", "name": "network-vif-plugged", "status": "completed", "tag": "0f25fd90-2bd6-4cfe-a985-09e4c0ca3212"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:25.002996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-787d86a6-20e8-4976-a0b0-4b2436f8cca1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:25.003547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a1700495-f40f-49f2-b9d1-23bc5cd8e56a req-03ca7df8-f2dc-4786-a78b-345ab379e7fa service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:25.003694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-787d86a6-20e8-4976-a0b0-4b2436f8cca1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:25.004043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a1700495-f40f-49f2-b9d1-23bc5cd8e56a req-03ca7df8-f2dc-4786-a78b-345ab379e7fa service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:25.004484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a1700495-f40f-49f2-b9d1-23bc5cd8e56a req-03ca7df8-f2dc-4786-a78b-345ab379e7fa service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:25.018662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-787d86a6-20e8-4976-a0b0-4b2436f8cca1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:25.019326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-787d86a6-20e8-4976-a0b0-4b2436f8cca1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:25.022552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-787d86a6-20e8-4976-a0b0-4b2436f8cca1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:25.023619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-787d86a6-20e8-4976-a0b0-4b2436f8cca1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:25.029345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-787d86a6-20e8-4976-a0b0-4b2436f8cca1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:25.029969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-787d86a6-20e8-4976-a0b0-4b2436f8cca1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:25.039726 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a1700495-f40f-49f2-b9d1-23bc5cd8e56a req-03ca7df8-f2dc-4786-a78b-345ab379e7fa service nova] Creating event network-vif-plugged:0f25fd90-2bd6-4cfe-a985-09e4c0ca3212 for instance eeb548e1-fdb6-420e-af5b-690399b898e6 on n-h2-860687-3 Oct 27 19:03:25.056253 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-a1700495-f40f-49f2-b9d1-23bc5cd8e56a req-03ca7df8-f2dc-4786-a78b-345ab379e7fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087228 Oct 27 19:03:25.069692 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1863/3913] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:03:25.430526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-787d86a6-20e8-4976-a0b0-4b2436f8cca1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:25.441084 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-787d86a6-20e8-4976-a0b0-4b2436f8cca1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1324 microversion: 2.1 time: 0.441796 Oct 27 19:03:25.445831 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2051/3914] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:24 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1324 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:25.787052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c97b471d-6088-4f6c-8ce0-9a4847b9dac8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:25.788247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c97b471d-6088-4f6c-8ce0-9a4847b9dac8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:25.804588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c97b471d-6088-4f6c-8ce0-9a4847b9dac8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:25.805298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c97b471d-6088-4f6c-8ce0-9a4847b9dac8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:25.805809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c97b471d-6088-4f6c-8ce0-9a4847b9dac8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:25.808471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c97b471d-6088-4f6c-8ce0-9a4847b9dac8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:25.808960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c97b471d-6088-4f6c-8ce0-9a4847b9dac8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:25.809402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c97b471d-6088-4f6c-8ce0-9a4847b9dac8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:25.970057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c97b471d-6088-4f6c-8ce0-9a4847b9dac8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:25.984934 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c97b471d-6088-4f6c-8ce0-9a4847b9dac8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1319 microversion: 2.1 time: 0.202507 Oct 27 19:03:25.985887 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1864/3915] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:25 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:26.472767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c98fe2d1-b8b6-47a9-aca5-9e6d95d8d5b1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:26.473477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c98fe2d1-b8b6-47a9-aca5-9e6d95d8d5b1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:26.481736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c98fe2d1-b8b6-47a9-aca5-9e6d95d8d5b1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:26.482158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c98fe2d1-b8b6-47a9-aca5-9e6d95d8d5b1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:26.482814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c98fe2d1-b8b6-47a9-aca5-9e6d95d8d5b1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:26.483734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c98fe2d1-b8b6-47a9-aca5-9e6d95d8d5b1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:26.484345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c98fe2d1-b8b6-47a9-aca5-9e6d95d8d5b1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:26.485088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c98fe2d1-b8b6-47a9-aca5-9e6d95d8d5b1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:26.828122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c98fe2d1-b8b6-47a9-aca5-9e6d95d8d5b1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:26.857503 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c98fe2d1-b8b6-47a9-aca5-9e6d95d8d5b1 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1324 microversion: 2.1 time: 0.389364 Oct 27 19:03:26.858353 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2052/3916] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:26 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1324 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:27.009448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f7b61589-66c6-432c-b093-8ba220ca7d41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:27.010077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f7b61589-66c6-432c-b093-8ba220ca7d41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:27.019153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7b61589-66c6-432c-b093-8ba220ca7d41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:27.019988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7b61589-66c6-432c-b093-8ba220ca7d41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:27.020653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7b61589-66c6-432c-b093-8ba220ca7d41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:27.021622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7b61589-66c6-432c-b093-8ba220ca7d41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:27.023331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7b61589-66c6-432c-b093-8ba220ca7d41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:27.024209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7b61589-66c6-432c-b093-8ba220ca7d41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:27.324286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f7b61589-66c6-432c-b093-8ba220ca7d41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:27.338679 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f7b61589-66c6-432c-b093-8ba220ca7d41 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1319 microversion: 2.1 time: 0.332965 Oct 27 19:03:27.339891 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1865/3917] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:27 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:27.882982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4119c4da-5400-4f3c-a241-3f1fa4a4bf0d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:27.883606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4119c4da-5400-4f3c-a241-3f1fa4a4bf0d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:27.894934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4119c4da-5400-4f3c-a241-3f1fa4a4bf0d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:27.896507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4119c4da-5400-4f3c-a241-3f1fa4a4bf0d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:27.896507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4119c4da-5400-4f3c-a241-3f1fa4a4bf0d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:27.897831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4119c4da-5400-4f3c-a241-3f1fa4a4bf0d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:27.899728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4119c4da-5400-4f3c-a241-3f1fa4a4bf0d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:27.899728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4119c4da-5400-4f3c-a241-3f1fa4a4bf0d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:28.157786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4119c4da-5400-4f3c-a241-3f1fa4a4bf0d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:28.167142 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4119c4da-5400-4f3c-a241-3f1fa4a4bf0d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1324 microversion: 2.1 time: 0.288723 Oct 27 19:03:28.175102 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2053/3918] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:27 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:28.364244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a81fb62b-4313-4fbe-b23a-78c8875e7551 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:28.365730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a81fb62b-4313-4fbe-b23a-78c8875e7551 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:28.374511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a81fb62b-4313-4fbe-b23a-78c8875e7551 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:28.375430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a81fb62b-4313-4fbe-b23a-78c8875e7551 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:28.376085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a81fb62b-4313-4fbe-b23a-78c8875e7551 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:28.376850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a81fb62b-4313-4fbe-b23a-78c8875e7551 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:28.377312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a81fb62b-4313-4fbe-b23a-78c8875e7551 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:28.377743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a81fb62b-4313-4fbe-b23a-78c8875e7551 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:28.639866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a81fb62b-4313-4fbe-b23a-78c8875e7551 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:28.661189 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a81fb62b-4313-4fbe-b23a-78c8875e7551 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1319 microversion: 2.1 time: 0.301977 Oct 27 19:03:28.664608 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1866/3919] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:28 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:29.198602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a78c7585-d43b-4eb1-868b-5354704b9d1c tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:29.201107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a78c7585-d43b-4eb1-868b-5354704b9d1c tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:29.208046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a78c7585-d43b-4eb1-868b-5354704b9d1c tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:29.221175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a78c7585-d43b-4eb1-868b-5354704b9d1c tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:29.221832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a78c7585-d43b-4eb1-868b-5354704b9d1c tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:29.222797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a78c7585-d43b-4eb1-868b-5354704b9d1c tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:29.223409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a78c7585-d43b-4eb1-868b-5354704b9d1c tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:29.224105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a78c7585-d43b-4eb1-868b-5354704b9d1c tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:29.480467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a78c7585-d43b-4eb1-868b-5354704b9d1c tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:29.493247 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a78c7585-d43b-4eb1-868b-5354704b9d1c tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1324 microversion: 2.1 time: 0.298371 Oct 27 19:03:29.498710 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2054/3920] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:29 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:29.687479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a5bcbd0f-f165-4247-b20a-30f0044c45b9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:29.688974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a5bcbd0f-f165-4247-b20a-30f0044c45b9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:29.697768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5bcbd0f-f165-4247-b20a-30f0044c45b9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:29.698633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5bcbd0f-f165-4247-b20a-30f0044c45b9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:29.699416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5bcbd0f-f165-4247-b20a-30f0044c45b9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:29.700575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5bcbd0f-f165-4247-b20a-30f0044c45b9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:29.701407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5bcbd0f-f165-4247-b20a-30f0044c45b9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:29.702048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5bcbd0f-f165-4247-b20a-30f0044c45b9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:29.994026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a5bcbd0f-f165-4247-b20a-30f0044c45b9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:30.007192 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a5bcbd0f-f165-4247-b20a-30f0044c45b9 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1469 microversion: 2.1 time: 0.324392 Oct 27 19:03:30.008656 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1867/3921] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:29 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1469 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:30.285479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-682739b6-3896-4581-8814-f7cc6b62d207 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-816369014", "block_migration": true, "disk_over_commit": false}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:30.288004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-682739b6-3896-4581-8814-f7cc6b62d207 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:30.304125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-682739b6-3896-4581-8814-f7cc6b62d207 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:30.304705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-682739b6-3896-4581-8814-f7cc6b62d207 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:30.305147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-682739b6-3896-4581-8814-f7cc6b62d207 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:30.305860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-682739b6-3896-4581-8814-f7cc6b62d207 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:30.306313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-682739b6-3896-4581-8814-f7cc6b62d207 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:30.306973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-682739b6-3896-4581-8814-f7cc6b62d207 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:30.344255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-682739b6-3896-4581-8814-f7cc6b62d207 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lazy-loading 'flavor' on Instance uuid eeb548e1-fdb6-420e-af5b-690399b898e6 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:03:30.358200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-682739b6-3896-4581-8814-f7cc6b62d207 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Going to try to live migrate instance to tempest-host-816369014 {{(pid=127029) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 19:03:30.366339 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-682739b6-3896-4581-8814-f7cc6b62d207 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] HTTP exception thrown: Compute host tempest-host-816369014 could not be found. Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-682739b6-3896-4581-8814-f7cc6b62d207 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Request method failure captured: Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6/action HTTP/1.1 Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 106 Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtXrHGF6vGW0tRF3ZFBCI6Pd77-mn42eCHelFq2ucngqIIz5WkPdGkYjRUgcztCknhfBciAV4mgvh8Mf4yGLFgcOFQdL7LexFOQ_EstF2xg08rfahBtLRKr_fd5tcywKcPlX95vOoKzIOOhc9g9ZmexdESXkPJjfN3WtDhauvZfxkXc Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: b9841756dd5e4e14b6f7f37a5ce78962 Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-LiveMigrationNegativeTest-203977238 Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b9841756dd5e4e14b6f7f37a5ce78962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9841756dd5e4e14b6f7f37a5ce78962"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b9841756dd5e4e14b6f7f37a5ce78962", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9841756dd5e4e14b6f7f37a5ce78962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-LiveMigrationNegativeTest-203977238 Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: b9841756dd5e4e14b6f7f37a5ce78962 Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-203977238 Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-LiveMigrationNegativeTest-203977238-project-admin Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 32842afd2ab0402484fccd3a4673686d Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-LiveMigrationNegativeTest-203977238-project-admin Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: {"os-migrateLive": {"host": "tempest-host-816369014", "block_migration": true, "disk_over_commit": false}} Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: exception: Compute host tempest-host-816369014 could not be found. Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'eeb548e1-fdb6-420e-af5b-690399b898e6', 'body': {'os-migrateLive': {'host': 'tempest-host-816369014', 'block_migration': True, 'disk_over_commit': False}}} Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 27 19:03:30.380299 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-816369014 could not be found. Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-816369014 could not be found. Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-816369014 could not be found. Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-682739b6-3896-4581-8814-f7cc6b62d207 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Returning 400 to user: Compute host tempest-host-816369014 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-682739b6-3896-4581-8814-f7cc6b62d207 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6/action" status: 400 len: 99 microversion: 2.1 time: 0.354559 Oct 27 19:03:30.386060 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2055/3922] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Oct 27 19:03:30 2022] POST /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6/action => generated 99 bytes in 356 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 19:03:30.393920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-068e4142-a230-44b0-b69f-2094bf365a30 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:30.394581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-068e4142-a230-44b0-b69f-2094bf365a30 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:30.401728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-068e4142-a230-44b0-b69f-2094bf365a30 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:30.402181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-068e4142-a230-44b0-b69f-2094bf365a30 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:30.402652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-068e4142-a230-44b0-b69f-2094bf365a30 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:30.403365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-068e4142-a230-44b0-b69f-2094bf365a30 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:30.403827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-068e4142-a230-44b0-b69f-2094bf365a30 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:30.404260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-068e4142-a230-44b0-b69f-2094bf365a30 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:30.425177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:30.505907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:30.525601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f02b1fba-ca28-44d8-b14d-b8c64d03df73 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:30.526376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f02b1fba-ca28-44d8-b14d-b8c64d03df73 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:30.534536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f02b1fba-ca28-44d8-b14d-b8c64d03df73 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:30.535194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f02b1fba-ca28-44d8-b14d-b8c64d03df73 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:30.535729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f02b1fba-ca28-44d8-b14d-b8c64d03df73 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:30.536651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f02b1fba-ca28-44d8-b14d-b8c64d03df73 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:30.537760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f02b1fba-ca28-44d8-b14d-b8c64d03df73 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:30.538767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f02b1fba-ca28-44d8-b14d-b8c64d03df73 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:30.635936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-068e4142-a230-44b0-b69f-2094bf365a30 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:30.644826 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-068e4142-a230-44b0-b69f-2094bf365a30 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1469 microversion: 2.1 time: 0.254722 Oct 27 19:03:30.645732 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1868/3923] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:30 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1469 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:30.764256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f02b1fba-ca28-44d8-b14d-b8c64d03df73 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:30.774549 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f02b1fba-ca28-44d8-b14d-b8c64d03df73 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1324 microversion: 2.1 time: 0.253140 Oct 27 19:03:30.776495 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2056/3924] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:30 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1324 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:30.803669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1281088039", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:30.870714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:03:31.350781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:03:31.351222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:03:31.351743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:03:31.352164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:03:31.352584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:03:31.374165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:31.374703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:31.375158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:31.375902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:31.376369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:31.378236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:31.426193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Getting quotas for project 16b6ca515d694f398401546452ca2605. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:03:31.433989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Getting quotas for user ccac1edbadb748f0b4b2e8e2e19260ed and project 16b6ca515d694f398401546452ca2605. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:03:31.454600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:03:31.457673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:03:31.483365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-8fb4c97b-7fce-4dc2-8a0b-68a2ae2da103 req-32f58870-f860-45dc-bf1d-1b0c2888897c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7473ff5e-df54-4fe1-ad84-88acc1fe0def", "name": "network-vif-plugged", "status": "completed", "tag": "6cbd8d96-273b-4d5e-a1b4-9a9a109deae2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:31.498998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:31.505646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8fb4c97b-7fce-4dc2-8a0b-68a2ae2da103 req-32f58870-f860-45dc-bf1d-1b0c2888897c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:31.508995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8fb4c97b-7fce-4dc2-8a0b-68a2ae2da103 req-32f58870-f860-45dc-bf1d-1b0c2888897c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:31.509486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8fb4c97b-7fce-4dc2-8a0b-68a2ae2da103 req-32f58870-f860-45dc-bf1d-1b0c2888897c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:31.538737 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8fb4c97b-7fce-4dc2-8a0b-68a2ae2da103 req-32f58870-f860-45dc-bf1d-1b0c2888897c service nova] Creating event network-vif-plugged:6cbd8d96-273b-4d5e-a1b4-9a9a109deae2 for instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def on n-h2-860687-3 Oct 27 19:03:31.545913 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-8fb4c97b-7fce-4dc2-8a0b-68a2ae2da103 req-32f58870-f860-45dc-bf1d-1b0c2888897c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065914 Oct 27 19:03:31.546952 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2057/3925] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:31.595058 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2723b425-2189-4971-a8bd-7175d9a98294 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797387 Oct 27 19:03:31.604761 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1869/3926] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:03:31.613721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fbac114e-894a-41af-ae14-04a3ba394ebd tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:31.621550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fbac114e-894a-41af-ae14-04a3ba394ebd tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:31.733641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fbac114e-894a-41af-ae14-04a3ba394ebd tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:31.742821 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fbac114e-894a-41af-ae14-04a3ba394ebd tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1219 microversion: 2.1 time: 0.133155 Oct 27 19:03:31.747779 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2058/3927] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:31 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1219 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:31.805329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-52f66d7a-9c16-43ba-a0ff-befa6ee6e00f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:31.806477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-52f66d7a-9c16-43ba-a0ff-befa6ee6e00f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:31.814800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52f66d7a-9c16-43ba-a0ff-befa6ee6e00f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:31.816148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52f66d7a-9c16-43ba-a0ff-befa6ee6e00f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:31.822293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52f66d7a-9c16-43ba-a0ff-befa6ee6e00f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:31.823358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52f66d7a-9c16-43ba-a0ff-befa6ee6e00f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:31.824643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52f66d7a-9c16-43ba-a0ff-befa6ee6e00f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:31.825260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52f66d7a-9c16-43ba-a0ff-befa6ee6e00f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:32.079315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-52f66d7a-9c16-43ba-a0ff-befa6ee6e00f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:32.087980 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-52f66d7a-9c16-43ba-a0ff-befa6ee6e00f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1324 microversion: 2.1 time: 0.287804 Oct 27 19:03:32.088614 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1870/3928] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:31 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:32.770681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f16ebf41-9d09-4220-a77b-6f8cd768943a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:32.771512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f16ebf41-9d09-4220-a77b-6f8cd768943a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:32.795744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f16ebf41-9d09-4220-a77b-6f8cd768943a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:32.796523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f16ebf41-9d09-4220-a77b-6f8cd768943a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:32.797229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f16ebf41-9d09-4220-a77b-6f8cd768943a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:32.798134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f16ebf41-9d09-4220-a77b-6f8cd768943a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:32.799076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f16ebf41-9d09-4220-a77b-6f8cd768943a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:32.799949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f16ebf41-9d09-4220-a77b-6f8cd768943a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:32.977613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f16ebf41-9d09-4220-a77b-6f8cd768943a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:32.991396 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f16ebf41-9d09-4220-a77b-6f8cd768943a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1271 microversion: 2.1 time: 0.224157 Oct 27 19:03:32.992535 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2059/3929] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:32 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1271 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:33.116317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0adc1e85-f3bd-4a4e-ad17-a34645818268 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:33.117646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0adc1e85-f3bd-4a4e-ad17-a34645818268 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:33.124196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0adc1e85-f3bd-4a4e-ad17-a34645818268 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:33.124898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0adc1e85-f3bd-4a4e-ad17-a34645818268 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:33.125546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0adc1e85-f3bd-4a4e-ad17-a34645818268 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:33.126493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0adc1e85-f3bd-4a4e-ad17-a34645818268 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:33.127101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0adc1e85-f3bd-4a4e-ad17-a34645818268 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:33.127684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0adc1e85-f3bd-4a4e-ad17-a34645818268 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:33.401211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0adc1e85-f3bd-4a4e-ad17-a34645818268 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:33.425078 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0adc1e85-f3bd-4a4e-ad17-a34645818268 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1324 microversion: 2.1 time: 0.314570 Oct 27 19:03:33.427013 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1871/3930] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:33 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1324 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:34.016337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-231f69fe-6eb4-4860-86c9-7c841276fd01 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:34.018112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-231f69fe-6eb4-4860-86c9-7c841276fd01 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:34.032311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231f69fe-6eb4-4860-86c9-7c841276fd01 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:34.032809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231f69fe-6eb4-4860-86c9-7c841276fd01 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:34.033258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231f69fe-6eb4-4860-86c9-7c841276fd01 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:34.033975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231f69fe-6eb4-4860-86c9-7c841276fd01 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:34.041780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231f69fe-6eb4-4860-86c9-7c841276fd01 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:34.042446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231f69fe-6eb4-4860-86c9-7c841276fd01 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:34.219201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-231f69fe-6eb4-4860-86c9-7c841276fd01 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:34.223446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:34.232030 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-231f69fe-6eb4-4860-86c9-7c841276fd01 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1277 microversion: 2.1 time: 0.220151 Oct 27 19:03:34.232982 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2060/3931] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:34 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1277 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:34.461518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7187830-33a2-4024-9fe0-e9d2c7c050bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:34.462154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a7187830-33a2-4024-9fe0-e9d2c7c050bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:34.531513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7187830-33a2-4024-9fe0-e9d2c7c050bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:34.535355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7187830-33a2-4024-9fe0-e9d2c7c050bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:34.539778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7187830-33a2-4024-9fe0-e9d2c7c050bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:34.540826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7187830-33a2-4024-9fe0-e9d2c7c050bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:34.547956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7187830-33a2-4024-9fe0-e9d2c7c050bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:34.548740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7187830-33a2-4024-9fe0-e9d2c7c050bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:34.836048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a7187830-33a2-4024-9fe0-e9d2c7c050bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:34.847116 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7187830-33a2-4024-9fe0-e9d2c7c050bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1521 microversion: 2.1 time: 0.397650 Oct 27 19:03:34.853154 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1872/3932] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:34 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:34.887464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-44957307-46d3-43ec-b100-64c0a468b455 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:34.888211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-44957307-46d3-43ec-b100-64c0a468b455 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:34.904046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44957307-46d3-43ec-b100-64c0a468b455 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:34.904600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44957307-46d3-43ec-b100-64c0a468b455 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:34.905105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44957307-46d3-43ec-b100-64c0a468b455 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:34.905833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44957307-46d3-43ec-b100-64c0a468b455 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:34.906345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44957307-46d3-43ec-b100-64c0a468b455 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:34.906829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44957307-46d3-43ec-b100-64c0a468b455 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:35.258243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ccb1ce0-31ea-477b-acec-d968c2e4e17e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:35.259195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3ccb1ce0-31ea-477b-acec-d968c2e4e17e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:35.272060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ccb1ce0-31ea-477b-acec-d968c2e4e17e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:35.276000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ccb1ce0-31ea-477b-acec-d968c2e4e17e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:35.276000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ccb1ce0-31ea-477b-acec-d968c2e4e17e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:35.276000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ccb1ce0-31ea-477b-acec-d968c2e4e17e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:35.276000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ccb1ce0-31ea-477b-acec-d968c2e4e17e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:35.276000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ccb1ce0-31ea-477b-acec-d968c2e4e17e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:35.454549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-44957307-46d3-43ec-b100-64c0a468b455 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:35.467879 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-44957307-46d3-43ec-b100-64c0a468b455 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1521 microversion: 2.1 time: 0.584434 Oct 27 19:03:35.468488 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2061/3933] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:34 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1521 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:35.495658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0c689e03-5ed3-438d-8879-62dc581bcea7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-839816320"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:35.498755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0c689e03-5ed3-438d-8879-62dc581bcea7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:35.505545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c689e03-5ed3-438d-8879-62dc581bcea7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:35.506804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c689e03-5ed3-438d-8879-62dc581bcea7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:35.507423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c689e03-5ed3-438d-8879-62dc581bcea7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:35.508304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c689e03-5ed3-438d-8879-62dc581bcea7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:35.508908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c689e03-5ed3-438d-8879-62dc581bcea7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:35.509497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c689e03-5ed3-438d-8879-62dc581bcea7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:35.560062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ccb1ce0-31ea-477b-acec-d968c2e4e17e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:35.597189 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3ccb1ce0-31ea-477b-acec-d968c2e4e17e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1319 microversion: 2.1 time: 0.340436 Oct 27 19:03:35.598786 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1873/3934] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:35 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:35.689612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ea60ffa9-1262-488f-9c11-d0b88a0abcc1 req-58b8274e-95e7-44ad-a50a-2a24c8d22c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "610e9c6a-5022-488f-9af2-952ca1c2774b", "tag": "f39c4a19-94b4-4741-a433-df4eeb3cbaf2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:35.731040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ea60ffa9-1262-488f-9c11-d0b88a0abcc1 req-58b8274e-95e7-44ad-a50a-2a24c8d22c71 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:35.731562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ea60ffa9-1262-488f-9c11-d0b88a0abcc1 req-58b8274e-95e7-44ad-a50a-2a24c8d22c71 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:35.732189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ea60ffa9-1262-488f-9c11-d0b88a0abcc1 req-58b8274e-95e7-44ad-a50a-2a24c8d22c71 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:35.759262 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ea60ffa9-1262-488f-9c11-d0b88a0abcc1 req-58b8274e-95e7-44ad-a50a-2a24c8d22c71 service nova] Creating event network-changed:f39c4a19-94b4-4741-a433-df4eeb3cbaf2 for instance 610e9c6a-5022-488f-9af2-952ca1c2774b on n-h1-860687-3 Oct 27 19:03:35.768993 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ea60ffa9-1262-488f-9c11-d0b88a0abcc1 req-58b8274e-95e7-44ad-a50a-2a24c8d22c71 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083727 Oct 27 19:03:35.770470 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1874/3935] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:03:35.868335 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0c689e03-5ed3-438d-8879-62dc581bcea7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "POST /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def/action" status: 202 len: 0 microversion: 2.1 time: 0.375960 Oct 27 19:03:35.869491 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2062/3936] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:03:35 2022] POST /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 19:03:35.881421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7f21c19-2e64-43ff-b591-6ac000106c8a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '.version_select at 0x7fc869c25700>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:36.090094 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7f21c19-2e64-43ff-b591-6ac000106c8a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "DELETE /compute/v2.1/images/ac3120a0-cbb5-4bda-bbbd-72b22b260bb4" status: 204 len: 0 microversion: 2.1 time: 0.213442 Oct 27 19:03:36.091325 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1875/3937] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:35 2022] DELETE /compute/v2.1/images/ac3120a0-cbb5-4bda-bbbd-72b22b260bb4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:03:36.102348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-31ae9016-42de-49fb-b0c1-5688b37440a4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '.version_select at 0x7fc869f8f1f0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:36.137238 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-31ae9016-42de-49fb-b0c1-5688b37440a4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] HTTP exception thrown: Image not found. Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-31ae9016-42de-49fb-b0c1-5688b37440a4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Request method failure captured: Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/images/ac3120a0-cbb5-4bda-bbbd-72b22b260bb4 HTTP/1.1 Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtXIBO-oIT-HYTB2aEriLPPQy4zwsnSlx9DGo1owgDeViDL8xz9gdgxBZ6h4yaNReHUFDpmMjxtiWf7mVDXaedJvOc8Qwc8zJEa7KWRfdPMYJLUDfqmLkDFiFu3cWColj_-lSB8MMmJyxn24nK4fQdr9h8etZXRJSRnN6iLr8tUpzOk Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d4f98a2b116433bb88cc3541ea44f8b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a4f9579efc194f4c8f9d02d4c21867d8 Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: exception: Image not found. Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'ac3120a0-cbb5-4bda-bbbd-72b22b260bb4'} Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ac3120a0-cbb5-4bda-bbbd-72b22b260bb4 Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 19:03:36.139497 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac3120a0-cbb5-4bda-bbbd-72b22b260bb4 could not be found. Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 19:03:36.142960 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:36.148064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-31ae9016-42de-49fb-b0c1-5688b37440a4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Returning 404 to user: Image not found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:03:36.149070 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-31ae9016-42de-49fb-b0c1-5688b37440a4 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/images/ac3120a0-cbb5-4bda-bbbd-72b22b260bb4" status: 404 len: 62 microversion: 2.1 time: 0.053319 Oct 27 19:03:36.153426 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2063/3938] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 19:03:36 2022] GET /compute/v2.1/images/ac3120a0-cbb5-4bda-bbbd-72b22b260bb4 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:03:36.158824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-35db51ed-c114-42ac-bb5f-9dd96459d1bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:36.159577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-35db51ed-c114-42ac-bb5f-9dd96459d1bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:36.166043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:36.168322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35db51ed-c114-42ac-bb5f-9dd96459d1bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:36.170646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35db51ed-c114-42ac-bb5f-9dd96459d1bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:36.170646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35db51ed-c114-42ac-bb5f-9dd96459d1bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:36.171115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35db51ed-c114-42ac-bb5f-9dd96459d1bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:36.172079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35db51ed-c114-42ac-bb5f-9dd96459d1bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:36.172792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35db51ed-c114-42ac-bb5f-9dd96459d1bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:36.632511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6c0646cb-a67e-46d8-a73b-121bb860f357 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:36.633257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6c0646cb-a67e-46d8-a73b-121bb860f357 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:36.650653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c0646cb-a67e-46d8-a73b-121bb860f357 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:36.653775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c0646cb-a67e-46d8-a73b-121bb860f357 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:36.654242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c0646cb-a67e-46d8-a73b-121bb860f357 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:36.655159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c0646cb-a67e-46d8-a73b-121bb860f357 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:36.660802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c0646cb-a67e-46d8-a73b-121bb860f357 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:36.661761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c0646cb-a67e-46d8-a73b-121bb860f357 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:36.887512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-35db51ed-c114-42ac-bb5f-9dd96459d1bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:36.902488 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-35db51ed-c114-42ac-bb5f-9dd96459d1bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1533 microversion: 2.1 time: 0.743199 Oct 27 19:03:36.926593 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1876/3939] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:36 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1533 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:37.004682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6c0646cb-a67e-46d8-a73b-121bb860f357 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:37.015787 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6c0646cb-a67e-46d8-a73b-121bb860f357 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1319 microversion: 2.1 time: 0.389553 Oct 27 19:03:37.016763 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2064/3940] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:36 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:37.940217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4015f4ff-95a6-4740-bd9b-0fcb68825388 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:37.942731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4015f4ff-95a6-4740-bd9b-0fcb68825388 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:37.950716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4015f4ff-95a6-4740-bd9b-0fcb68825388 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:37.951437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4015f4ff-95a6-4740-bd9b-0fcb68825388 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:37.952054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4015f4ff-95a6-4740-bd9b-0fcb68825388 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:37.952940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4015f4ff-95a6-4740-bd9b-0fcb68825388 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:37.953563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4015f4ff-95a6-4740-bd9b-0fcb68825388 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:37.954159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4015f4ff-95a6-4740-bd9b-0fcb68825388 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:38.041747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c781ea91-ba75-404e-8942-b4c175b1a1ba tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:38.042459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c781ea91-ba75-404e-8942-b4c175b1a1ba tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:38.049393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c781ea91-ba75-404e-8942-b4c175b1a1ba tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:38.050147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c781ea91-ba75-404e-8942-b4c175b1a1ba tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:38.050624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c781ea91-ba75-404e-8942-b4c175b1a1ba tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:38.051336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c781ea91-ba75-404e-8942-b4c175b1a1ba tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:38.051791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c781ea91-ba75-404e-8942-b4c175b1a1ba tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:38.065920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c781ea91-ba75-404e-8942-b4c175b1a1ba tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:38.251892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c781ea91-ba75-404e-8942-b4c175b1a1ba tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:38.262055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4015f4ff-95a6-4740-bd9b-0fcb68825388 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:38.262949 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c781ea91-ba75-404e-8942-b4c175b1a1ba tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1319 microversion: 2.1 time: 0.225951 Oct 27 19:03:38.269686 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2065/3941] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:38 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:38.287945 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4015f4ff-95a6-4740-bd9b-0fcb68825388 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1533 microversion: 2.1 time: 0.351869 Oct 27 19:03:38.307283 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1877/3942] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:37 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1533 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:39.286755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7fe3a9b4-5d27-475c-9c1f-c67e03c2e75f tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:39.288727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7fe3a9b4-5d27-475c-9c1f-c67e03c2e75f tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:39.297432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fe3a9b4-5d27-475c-9c1f-c67e03c2e75f tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:39.297935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fe3a9b4-5d27-475c-9c1f-c67e03c2e75f tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:39.298376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fe3a9b4-5d27-475c-9c1f-c67e03c2e75f tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:39.299117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fe3a9b4-5d27-475c-9c1f-c67e03c2e75f tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:39.299571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fe3a9b4-5d27-475c-9c1f-c67e03c2e75f tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:39.300254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fe3a9b4-5d27-475c-9c1f-c67e03c2e75f tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:39.320434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-45400929-8bad-497f-8e87-40bda6b1a5e3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:39.321108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-45400929-8bad-497f-8e87-40bda6b1a5e3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:39.332312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45400929-8bad-497f-8e87-40bda6b1a5e3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:39.333024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45400929-8bad-497f-8e87-40bda6b1a5e3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:39.333703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45400929-8bad-497f-8e87-40bda6b1a5e3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:39.350807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45400929-8bad-497f-8e87-40bda6b1a5e3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:39.352687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45400929-8bad-497f-8e87-40bda6b1a5e3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:39.354055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45400929-8bad-497f-8e87-40bda6b1a5e3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:39.569882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-45400929-8bad-497f-8e87-40bda6b1a5e3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:39.582311 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-45400929-8bad-497f-8e87-40bda6b1a5e3 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1539 microversion: 2.1 time: 0.267129 Oct 27 19:03:39.583813 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1878/3943] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:39 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1539 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:39.606304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7fe3a9b4-5d27-475c-9c1f-c67e03c2e75f tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:39.614735 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7fe3a9b4-5d27-475c-9c1f-c67e03c2e75f tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1319 microversion: 2.1 time: 0.331808 Oct 27 19:03:39.616526 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2066/3944] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:39 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:40.615855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00e86342-1ebf-49a6-bb71-283e6972cde8 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:40.617801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-00e86342-1ebf-49a6-bb71-283e6972cde8 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:40.625424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00e86342-1ebf-49a6-bb71-283e6972cde8 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:40.626232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00e86342-1ebf-49a6-bb71-283e6972cde8 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:40.626830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00e86342-1ebf-49a6-bb71-283e6972cde8 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:40.627622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00e86342-1ebf-49a6-bb71-283e6972cde8 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:40.628348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00e86342-1ebf-49a6-bb71-283e6972cde8 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:40.628972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00e86342-1ebf-49a6-bb71-283e6972cde8 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:40.643406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c446d57a-67b4-40e5-b1d6-89d5d5d2eaa2 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:40.644655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c446d57a-67b4-40e5-b1d6-89d5d5d2eaa2 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:40.656168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c446d57a-67b4-40e5-b1d6-89d5d5d2eaa2 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:40.660279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c446d57a-67b4-40e5-b1d6-89d5d5d2eaa2 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:40.661933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c446d57a-67b4-40e5-b1d6-89d5d5d2eaa2 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:40.664694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c446d57a-67b4-40e5-b1d6-89d5d5d2eaa2 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:40.665913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c446d57a-67b4-40e5-b1d6-89d5d5d2eaa2 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:40.667639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c446d57a-67b4-40e5-b1d6-89d5d5d2eaa2 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:40.859620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c446d57a-67b4-40e5-b1d6-89d5d5d2eaa2 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:40.872433 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c446d57a-67b4-40e5-b1d6-89d5d5d2eaa2 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1319 microversion: 2.1 time: 0.233391 Oct 27 19:03:40.875744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-00e86342-1ebf-49a6-bb71-283e6972cde8 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:40.886038 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2067/3945] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:40 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:40.889329 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-00e86342-1ebf-49a6-bb71-283e6972cde8 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1539 microversion: 2.1 time: 0.279491 Oct 27 19:03:40.891118 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1879/3946] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:40 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1539 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:41.290741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-b4b08cd1-7466-4597-b957-8709b3846590 req-61ef0ace-c2bb-458d-9e7a-e505c7055287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7473ff5e-df54-4fe1-ad84-88acc1fe0def", "name": "network-vif-plugged", "status": "completed", "tag": "6cbd8d96-273b-4d5e-a1b4-9a9a109deae2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:41.299649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:41.302251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b4b08cd1-7466-4597-b957-8709b3846590 req-61ef0ace-c2bb-458d-9e7a-e505c7055287 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:41.303457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b4b08cd1-7466-4597-b957-8709b3846590 req-61ef0ace-c2bb-458d-9e7a-e505c7055287 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:41.303773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b4b08cd1-7466-4597-b957-8709b3846590 req-61ef0ace-c2bb-458d-9e7a-e505c7055287 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:41.317949 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-b4b08cd1-7466-4597-b957-8709b3846590 req-61ef0ace-c2bb-458d-9e7a-e505c7055287 service nova] Creating event network-vif-plugged:6cbd8d96-273b-4d5e-a1b4-9a9a109deae2 for instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def on n-h2-860687-3 Oct 27 19:03:41.323850 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-b4b08cd1-7466-4597-b957-8709b3846590 req-61ef0ace-c2bb-458d-9e7a-e505c7055287 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037079 Oct 27 19:03:41.324771 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2068/3947] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:41.918214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cfb975d1-7dae-41e5-97f5-f56be4b14c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:41.920847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:41.926226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-258563d8-9a93-4ab1-951b-4102a9951805 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:41.926677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cfb975d1-7dae-41e5-97f5-f56be4b14c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:41.930171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-258563d8-9a93-4ab1-951b-4102a9951805 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:41.933974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:41.935173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:41.947716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-258563d8-9a93-4ab1-951b-4102a9951805 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:41.949869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-258563d8-9a93-4ab1-951b-4102a9951805 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:41.951410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-258563d8-9a93-4ab1-951b-4102a9951805 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:41.953099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfb975d1-7dae-41e5-97f5-f56be4b14c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:41.953786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-258563d8-9a93-4ab1-951b-4102a9951805 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:41.955038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-258563d8-9a93-4ab1-951b-4102a9951805 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:41.955204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfb975d1-7dae-41e5-97f5-f56be4b14c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:41.955554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-258563d8-9a93-4ab1-951b-4102a9951805 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:41.955709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfb975d1-7dae-41e5-97f5-f56be4b14c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:41.956712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfb975d1-7dae-41e5-97f5-f56be4b14c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:41.957453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfb975d1-7dae-41e5-97f5-f56be4b14c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:41.958047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfb975d1-7dae-41e5-97f5-f56be4b14c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:41.983850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:42.146685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-258563d8-9a93-4ab1-951b-4102a9951805 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:42.159694 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-258563d8-9a93-4ab1-951b-4102a9951805 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1319 microversion: 2.1 time: 0.246444 Oct 27 19:03:42.172252 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2069/3948] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:41 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:42.190880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cfb975d1-7dae-41e5-97f5-f56be4b14c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:42.200999 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cfb975d1-7dae-41e5-97f5-f56be4b14c0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1539 microversion: 2.1 time: 0.286829 Oct 27 19:03:42.201773 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1880/3949] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:41 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1539 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:43.185680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f9aab71d-55a4-44c4-8a2c-aab913d3a325 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:43.186842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f9aab71d-55a4-44c4-8a2c-aab913d3a325 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:43.194188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9aab71d-55a4-44c4-8a2c-aab913d3a325 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:43.194943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9aab71d-55a4-44c4-8a2c-aab913d3a325 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:43.195535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9aab71d-55a4-44c4-8a2c-aab913d3a325 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:43.196434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9aab71d-55a4-44c4-8a2c-aab913d3a325 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:43.197053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9aab71d-55a4-44c4-8a2c-aab913d3a325 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:43.197629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9aab71d-55a4-44c4-8a2c-aab913d3a325 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:43.227934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5d596af2-00c0-4bbb-bfee-2b682ca60a63 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:43.228698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5d596af2-00c0-4bbb-bfee-2b682ca60a63 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:43.239394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d596af2-00c0-4bbb-bfee-2b682ca60a63 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:43.240744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d596af2-00c0-4bbb-bfee-2b682ca60a63 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:43.241360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d596af2-00c0-4bbb-bfee-2b682ca60a63 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:43.242251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d596af2-00c0-4bbb-bfee-2b682ca60a63 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:43.242894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d596af2-00c0-4bbb-bfee-2b682ca60a63 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:43.243500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d596af2-00c0-4bbb-bfee-2b682ca60a63 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:43.372310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f9aab71d-55a4-44c4-8a2c-aab913d3a325 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:43.384906 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f9aab71d-55a4-44c4-8a2c-aab913d3a325 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1319 microversion: 2.1 time: 0.203187 Oct 27 19:03:43.387093 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2070/3950] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:43 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:43.409632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-294d3968-8c53-4c0f-a315-5f40b8f5e462 req-b440432b-6f3c-4716-b296-feaff54caed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "610e9c6a-5022-488f-9af2-952ca1c2774b", "name": "network-vif-plugged", "status": "completed", "tag": "f39c4a19-94b4-4741-a433-df4eeb3cbaf2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:43.423746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-294d3968-8c53-4c0f-a315-5f40b8f5e462 req-b440432b-6f3c-4716-b296-feaff54caed4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:43.424246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-294d3968-8c53-4c0f-a315-5f40b8f5e462 req-b440432b-6f3c-4716-b296-feaff54caed4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:43.424692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-294d3968-8c53-4c0f-a315-5f40b8f5e462 req-b440432b-6f3c-4716-b296-feaff54caed4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:43.441712 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-294d3968-8c53-4c0f-a315-5f40b8f5e462 req-b440432b-6f3c-4716-b296-feaff54caed4 service nova] Creating event network-vif-plugged:f39c4a19-94b4-4741-a433-df4eeb3cbaf2 for instance 610e9c6a-5022-488f-9af2-952ca1c2774b on n-h1-860687-3 Oct 27 19:03:43.448592 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-294d3968-8c53-4c0f-a315-5f40b8f5e462 req-b440432b-6f3c-4716-b296-feaff54caed4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045289 Oct 27 19:03:43.449432 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2071/3951] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:03:43.477882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5d596af2-00c0-4bbb-bfee-2b682ca60a63 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:43.492462 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5d596af2-00c0-4bbb-bfee-2b682ca60a63 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1539 microversion: 2.1 time: 0.268725 Oct 27 19:03:43.493855 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1881/3952] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:43 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1539 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:44.410998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2653307f-51d7-46d5-9459-59f5cdb134fc tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:44.411823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2653307f-51d7-46d5-9459-59f5cdb134fc tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:44.422488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2653307f-51d7-46d5-9459-59f5cdb134fc tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:44.422957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2653307f-51d7-46d5-9459-59f5cdb134fc tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:44.423711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2653307f-51d7-46d5-9459-59f5cdb134fc tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:44.425292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2653307f-51d7-46d5-9459-59f5cdb134fc tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:44.426096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2653307f-51d7-46d5-9459-59f5cdb134fc tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:44.426714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2653307f-51d7-46d5-9459-59f5cdb134fc tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:44.525317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c6ad844b-eaaa-490c-9afa-51b62aed3bef tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:44.526007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c6ad844b-eaaa-490c-9afa-51b62aed3bef tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:44.535153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6ad844b-eaaa-490c-9afa-51b62aed3bef tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:44.535824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6ad844b-eaaa-490c-9afa-51b62aed3bef tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:44.536529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6ad844b-eaaa-490c-9afa-51b62aed3bef tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:44.538297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6ad844b-eaaa-490c-9afa-51b62aed3bef tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:44.539147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6ad844b-eaaa-490c-9afa-51b62aed3bef tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:44.539601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c6ad844b-eaaa-490c-9afa-51b62aed3bef tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:44.630086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2653307f-51d7-46d5-9459-59f5cdb134fc tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:44.639646 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2653307f-51d7-46d5-9459-59f5cdb134fc tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1319 microversion: 2.1 time: 0.233807 Oct 27 19:03:44.654577 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2072/3953] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:44 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:44.811537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c6ad844b-eaaa-490c-9afa-51b62aed3bef tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:44.824879 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c6ad844b-eaaa-490c-9afa-51b62aed3bef tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1521 microversion: 2.1 time: 0.310126 Oct 27 19:03:44.825907 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1882/3954] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:44 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:44.852944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3f980817-881f-41c5-b1b8-6d7c479f52ad tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:44.853826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3f980817-881f-41c5-b1b8-6d7c479f52ad tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:44.861369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f980817-881f-41c5-b1b8-6d7c479f52ad tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:44.862149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f980817-881f-41c5-b1b8-6d7c479f52ad tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:44.862722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f980817-881f-41c5-b1b8-6d7c479f52ad tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:44.863671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f980817-881f-41c5-b1b8-6d7c479f52ad tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:44.864345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f980817-881f-41c5-b1b8-6d7c479f52ad tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:44.865751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f980817-881f-41c5-b1b8-6d7c479f52ad tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:44.932483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3f980817-881f-41c5-b1b8-6d7c479f52ad tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:03:45.288863 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3f980817-881f-41c5-b1b8-6d7c479f52ad tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 204 len: 0 microversion: 2.1 time: 0.443327 Oct 27 19:03:45.290108 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2073/3955] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:03:44 2022] DELETE /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:03:45.298635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7632080-fbaf-45e0-83a1-84e41916db5d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:45.299457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a7632080-fbaf-45e0-83a1-84e41916db5d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:45.306788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7632080-fbaf-45e0-83a1-84e41916db5d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:45.307352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7632080-fbaf-45e0-83a1-84e41916db5d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:45.307911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7632080-fbaf-45e0-83a1-84e41916db5d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:45.308736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7632080-fbaf-45e0-83a1-84e41916db5d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:45.309330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7632080-fbaf-45e0-83a1-84e41916db5d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:45.309889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7632080-fbaf-45e0-83a1-84e41916db5d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:45.483935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a7632080-fbaf-45e0-83a1-84e41916db5d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:45.492783 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7632080-fbaf-45e0-83a1-84e41916db5d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1527 microversion: 2.1 time: 0.198075 Oct 27 19:03:45.493375 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1883/3956] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:45 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1527 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:45.671791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3257217c-e714-402f-a6d7-8d3cbdab8019 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:45.672513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3257217c-e714-402f-a6d7-8d3cbdab8019 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:45.681089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3257217c-e714-402f-a6d7-8d3cbdab8019 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:45.681587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3257217c-e714-402f-a6d7-8d3cbdab8019 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:45.682037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3257217c-e714-402f-a6d7-8d3cbdab8019 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:45.682873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3257217c-e714-402f-a6d7-8d3cbdab8019 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:45.683251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3257217c-e714-402f-a6d7-8d3cbdab8019 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:45.684582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3257217c-e714-402f-a6d7-8d3cbdab8019 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:45.858943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3257217c-e714-402f-a6d7-8d3cbdab8019 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:45.870300 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3257217c-e714-402f-a6d7-8d3cbdab8019 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1469 microversion: 2.1 time: 0.202615 Oct 27 19:03:45.871729 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2074/3957] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:45 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1469 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:45.893628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e91dd069-b613-4ac7-8189-1fdbe88e62d5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:45.894279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e91dd069-b613-4ac7-8189-1fdbe88e62d5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:45.915239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e91dd069-b613-4ac7-8189-1fdbe88e62d5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:45.915936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e91dd069-b613-4ac7-8189-1fdbe88e62d5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:45.916514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e91dd069-b613-4ac7-8189-1fdbe88e62d5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:45.917242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e91dd069-b613-4ac7-8189-1fdbe88e62d5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:45.918002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e91dd069-b613-4ac7-8189-1fdbe88e62d5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:45.919030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e91dd069-b613-4ac7-8189-1fdbe88e62d5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:45.944938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-e91dd069-b613-4ac7-8189-1fdbe88e62d5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lazy-loading 'flavor' on Instance uuid 610e9c6a-5022-488f-9af2-952ca1c2774b {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:03:46.025938 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e91dd069-b613-4ac7-8189-1fdbe88e62d5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b/action" status: 202 len: 0 microversion: 2.1 time: 0.135840 Oct 27 19:03:46.029836 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1884/3958] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:03:45 2022] POST /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:03:46.038811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-838fab45-072e-4fa0-81d4-b3bf217e8cb4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:46.039348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-838fab45-072e-4fa0-81d4-b3bf217e8cb4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:46.051784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-838fab45-072e-4fa0-81d4-b3bf217e8cb4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:46.053637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-838fab45-072e-4fa0-81d4-b3bf217e8cb4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:46.053809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-838fab45-072e-4fa0-81d4-b3bf217e8cb4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:46.054756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-838fab45-072e-4fa0-81d4-b3bf217e8cb4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:46.055589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-838fab45-072e-4fa0-81d4-b3bf217e8cb4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:46.058497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-838fab45-072e-4fa0-81d4-b3bf217e8cb4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:46.244373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-838fab45-072e-4fa0-81d4-b3bf217e8cb4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:46.259085 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-838fab45-072e-4fa0-81d4-b3bf217e8cb4 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1477 microversion: 2.1 time: 0.227991 Oct 27 19:03:46.260047 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2075/3959] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:46 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1477 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:46.517373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-24f07f7f-7eb5-443c-82a9-4ece253c7cec tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:46.518344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-24f07f7f-7eb5-443c-82a9-4ece253c7cec tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:46.526493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24f07f7f-7eb5-443c-82a9-4ece253c7cec tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:46.527275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24f07f7f-7eb5-443c-82a9-4ece253c7cec tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:46.527835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24f07f7f-7eb5-443c-82a9-4ece253c7cec tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:46.529089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24f07f7f-7eb5-443c-82a9-4ece253c7cec tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:46.529722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24f07f7f-7eb5-443c-82a9-4ece253c7cec tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:46.530293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24f07f7f-7eb5-443c-82a9-4ece253c7cec tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:46.719723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-24f07f7f-7eb5-443c-82a9-4ece253c7cec tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:46.732079 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-24f07f7f-7eb5-443c-82a9-4ece253c7cec tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1527 microversion: 2.1 time: 0.219570 Oct 27 19:03:46.732924 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1885/3960] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:46 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1527 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:47.286773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0809addf-f847-4c99-85d5-20dd1d3ad30e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:47.288347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0809addf-f847-4c99-85d5-20dd1d3ad30e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:47.303505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-38027ce9-a765-49d0-a481-1e2b3c889405 req-5b01a009-089a-4525-9bdc-d61e3711c975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7473ff5e-df54-4fe1-ad84-88acc1fe0def", "name": "network-vif-unplugged", "status": "completed", "tag": "6cbd8d96-273b-4d5e-a1b4-9a9a109deae2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:47.305754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0809addf-f847-4c99-85d5-20dd1d3ad30e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:47.306688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0809addf-f847-4c99-85d5-20dd1d3ad30e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:47.307792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0809addf-f847-4c99-85d5-20dd1d3ad30e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:47.309177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0809addf-f847-4c99-85d5-20dd1d3ad30e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:47.309877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0809addf-f847-4c99-85d5-20dd1d3ad30e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:47.310711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0809addf-f847-4c99-85d5-20dd1d3ad30e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:47.334896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-38027ce9-a765-49d0-a481-1e2b3c889405 req-5b01a009-089a-4525-9bdc-d61e3711c975 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:47.335690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-38027ce9-a765-49d0-a481-1e2b3c889405 req-5b01a009-089a-4525-9bdc-d61e3711c975 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:47.337398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-38027ce9-a765-49d0-a481-1e2b3c889405 req-5b01a009-089a-4525-9bdc-d61e3711c975 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:47.358614 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-38027ce9-a765-49d0-a481-1e2b3c889405 req-5b01a009-089a-4525-9bdc-d61e3711c975 service nova] Creating event network-vif-unplugged:6cbd8d96-273b-4d5e-a1b4-9a9a109deae2 for instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def on n-h2-860687-3 Oct 27 19:03:47.364095 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-38027ce9-a765-49d0-a481-1e2b3c889405 req-5b01a009-089a-4525-9bdc-d61e3711c975 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069667 Oct 27 19:03:47.364716 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1886/3961] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:47.525299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0809addf-f847-4c99-85d5-20dd1d3ad30e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:47.529736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:47.534776 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0809addf-f847-4c99-85d5-20dd1d3ad30e tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1460 microversion: 2.1 time: 0.253029 Oct 27 19:03:47.535843 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2076/3962] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:47 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1460 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:47.559630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-af754634-210c-40e8-a736-9e33f8392dfe tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:47.560551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-af754634-210c-40e8-a736-9e33f8392dfe tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:47.570142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af754634-210c-40e8-a736-9e33f8392dfe tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:47.570906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af754634-210c-40e8-a736-9e33f8392dfe tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:47.571508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af754634-210c-40e8-a736-9e33f8392dfe tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:47.572505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af754634-210c-40e8-a736-9e33f8392dfe tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:47.573287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af754634-210c-40e8-a736-9e33f8392dfe tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:47.573872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af754634-210c-40e8-a736-9e33f8392dfe tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:47.763920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f7e8c03f-8e74-48ee-b704-4fe59acb7c15 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:47.766046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f7e8c03f-8e74-48ee-b704-4fe59acb7c15 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:47.783298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7e8c03f-8e74-48ee-b704-4fe59acb7c15 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:47.788678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7e8c03f-8e74-48ee-b704-4fe59acb7c15 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:47.789888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7e8c03f-8e74-48ee-b704-4fe59acb7c15 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:47.790888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7e8c03f-8e74-48ee-b704-4fe59acb7c15 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:47.791526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7e8c03f-8e74-48ee-b704-4fe59acb7c15 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:47.793006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7e8c03f-8e74-48ee-b704-4fe59acb7c15 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:47.933324 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-af754634-210c-40e8-a736-9e33f8392dfe tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1611 microversion: 2.1 time: 0.377916 Oct 27 19:03:47.951143 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1887/3963] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:47 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1611 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:47.960736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2a53ab89-8270-4ca6-96c0-436ec35a24e5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:47.965693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a53ab89-8270-4ca6-96c0-436ec35a24e5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:47.966657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a53ab89-8270-4ca6-96c0-436ec35a24e5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:47.967202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a53ab89-8270-4ca6-96c0-436ec35a24e5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:47.968060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a53ab89-8270-4ca6-96c0-436ec35a24e5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:47.968628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a53ab89-8270-4ca6-96c0-436ec35a24e5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:47.969162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a53ab89-8270-4ca6-96c0-436ec35a24e5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:48.022927 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2a53ab89-8270-4ca6-96c0-436ec35a24e5 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.066633 Oct 27 19:03:48.023478 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1888/3964] 10.222.0.42 () {58 vars in 1176 bytes} [Thu Oct 27 19:03:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:48.028592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f7e8c03f-8e74-48ee-b704-4fe59acb7c15 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:48.040115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b004bc74-bb36-4af0-bff2-048013584131 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860687-3", "block_migration": true, "disk_over_commit": false}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:48.043196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b004bc74-bb36-4af0-bff2-048013584131 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:48.043474 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f7e8c03f-8e74-48ee-b704-4fe59acb7c15 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1527 microversion: 2.1 time: 0.289009 Oct 27 19:03:48.044075 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2077/3965] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:47 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1527 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:48.053189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b004bc74-bb36-4af0-bff2-048013584131 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:48.054015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b004bc74-bb36-4af0-bff2-048013584131 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:48.054961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b004bc74-bb36-4af0-bff2-048013584131 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:48.056029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b004bc74-bb36-4af0-bff2-048013584131 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:48.056957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b004bc74-bb36-4af0-bff2-048013584131 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:48.057584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b004bc74-bb36-4af0-bff2-048013584131 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:48.087463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-b004bc74-bb36-4af0-bff2-048013584131 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Lazy-loading 'flavor' on Instance uuid 610e9c6a-5022-488f-9af2-952ca1c2774b {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:03:48.101446 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-b004bc74-bb36-4af0-bff2-048013584131 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 610e9c6a-5022-488f-9af2-952ca1c2774b while it is in vm_state suspended Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b004bc74-bb36-4af0-bff2-048013584131 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Request method failure captured: Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b/action HTTP/1.1 Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 97 Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtXrHGF6vGW0tRF3ZFBCI6Pd77-mn42eCHelFq2ucngqIIz5WkPdGkYjRUgcztCknhfBciAV4mgvh8Mf4yGLFgcOFQdL7LexFOQ_EstF2xg08rfahBtLRKr_fd5tcywKcPlX95vOoKzIOOhc9g9ZmexdESXkPJjfN3WtDhauvZfxkXc Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: b9841756dd5e4e14b6f7f37a5ce78962 Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-LiveMigrationNegativeTest-203977238 Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b9841756dd5e4e14b6f7f37a5ce78962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9841756dd5e4e14b6f7f37a5ce78962"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b9841756dd5e4e14b6f7f37a5ce78962", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9841756dd5e4e14b6f7f37a5ce78962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-LiveMigrationNegativeTest-203977238 Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: b9841756dd5e4e14b6f7f37a5ce78962 Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-203977238 Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-LiveMigrationNegativeTest-203977238-project-admin Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 32842afd2ab0402484fccd3a4673686d Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-LiveMigrationNegativeTest-203977238-project-admin Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: {"os-migrateLive": {"host": "n-h2-860687-3", "block_migration": true, "disk_over_commit": false}} Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: exception: Cannot 'os-migrateLive' instance 610e9c6a-5022-488f-9af2-952ca1c2774b while it is in vm_state suspended Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '610e9c6a-5022-488f-9af2-952ca1c2774b', 'body': {'os-migrateLive': {'host': 'n-h2-860687-3', 'block_migration': True, 'disk_over_commit': False}}} Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 610e9c6a-5022-488f-9af2-952ca1c2774b in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:48.103876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 610e9c6a-5022-488f-9af2-952ca1c2774b while it is in vm_state suspended Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 610e9c6a-5022-488f-9af2-952ca1c2774b while it is in vm_state suspended Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:48.108802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b004bc74-bb36-4af0-bff2-048013584131 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 610e9c6a-5022-488f-9af2-952ca1c2774b while it is in vm_state suspended {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:03:48.117135 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b004bc74-bb36-4af0-bff2-048013584131 tempest-LiveMigrationNegativeTest-203977238 tempest-LiveMigrationNegativeTest-203977238-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b/action" status: 409 len: 155 microversion: 2.1 time: 0.077081 Oct 27 19:03:48.117135 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1889/3966] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:03:48 2022] POST /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b/action => generated 155 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:03:48.121176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f4c3b683-edcc-41c9-a72c-38d4c00f8c90 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:48.121686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f4c3b683-edcc-41c9-a72c-38d4c00f8c90 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:48.127966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4c3b683-edcc-41c9-a72c-38d4c00f8c90 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:48.128632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4c3b683-edcc-41c9-a72c-38d4c00f8c90 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:48.129218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4c3b683-edcc-41c9-a72c-38d4c00f8c90 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:48.130081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4c3b683-edcc-41c9-a72c-38d4c00f8c90 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:48.130510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4c3b683-edcc-41c9-a72c-38d4c00f8c90 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:48.132236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4c3b683-edcc-41c9-a72c-38d4c00f8c90 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:48.167156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f4c3b683-edcc-41c9-a72c-38d4c00f8c90 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:03:48.277651 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f4c3b683-edcc-41c9-a72c-38d4c00f8c90 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "DELETE /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 204 len: 0 microversion: 2.1 time: 0.159946 Oct 27 19:03:48.279120 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2078/3967] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:03:48 2022] DELETE /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:03:48.288873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cbed09cc-89a9-4ff9-815b-2fa1db9f777d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:48.290932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cbed09cc-89a9-4ff9-815b-2fa1db9f777d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:48.300387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbed09cc-89a9-4ff9-815b-2fa1db9f777d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:48.301293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbed09cc-89a9-4ff9-815b-2fa1db9f777d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:48.302127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbed09cc-89a9-4ff9-815b-2fa1db9f777d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:48.303703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbed09cc-89a9-4ff9-815b-2fa1db9f777d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:48.304288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6a1c5306-445c-4ec2-93ec-b781069d1b2c req-38876a58-301d-4a58-b153-9703cdfe5004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7473ff5e-df54-4fe1-ad84-88acc1fe0def", "name": "network-vif-deleted", "tag": "6cbd8d96-273b-4d5e-a1b4-9a9a109deae2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:48.305338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbed09cc-89a9-4ff9-815b-2fa1db9f777d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:48.305978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbed09cc-89a9-4ff9-815b-2fa1db9f777d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:48.320322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6a1c5306-445c-4ec2-93ec-b781069d1b2c req-38876a58-301d-4a58-b153-9703cdfe5004 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:48.321195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6a1c5306-445c-4ec2-93ec-b781069d1b2c req-38876a58-301d-4a58-b153-9703cdfe5004 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:48.323071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6a1c5306-445c-4ec2-93ec-b781069d1b2c req-38876a58-301d-4a58-b153-9703cdfe5004 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:48.336976 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6a1c5306-445c-4ec2-93ec-b781069d1b2c req-38876a58-301d-4a58-b153-9703cdfe5004 service nova] Creating event network-vif-deleted:6cbd8d96-273b-4d5e-a1b4-9a9a109deae2 for instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def on n-h2-860687-3 Oct 27 19:03:48.343335 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6a1c5306-445c-4ec2-93ec-b781069d1b2c req-38876a58-301d-4a58-b153-9703cdfe5004 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051887 Oct 27 19:03:48.345013 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2079/3968] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:48.586518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cbed09cc-89a9-4ff9-815b-2fa1db9f777d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:48.597686 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cbed09cc-89a9-4ff9-815b-2fa1db9f777d tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1466 microversion: 2.1 time: 0.314276 Oct 27 19:03:48.598958 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1890/3969] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:48 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1466 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:49.068969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5c94349d-198e-4b21-aba4-f93eb0f15d2d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:49.069979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5c94349d-198e-4b21-aba4-f93eb0f15d2d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:49.092831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c94349d-198e-4b21-aba4-f93eb0f15d2d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:49.093602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c94349d-198e-4b21-aba4-f93eb0f15d2d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:49.098037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c94349d-198e-4b21-aba4-f93eb0f15d2d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:49.099026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c94349d-198e-4b21-aba4-f93eb0f15d2d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:49.100432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c94349d-198e-4b21-aba4-f93eb0f15d2d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:49.100944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c94349d-198e-4b21-aba4-f93eb0f15d2d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:49.136455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c94349d-198e-4b21-aba4-f93eb0f15d2d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:49.137070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c94349d-198e-4b21-aba4-f93eb0f15d2d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:49.137624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c94349d-198e-4b21-aba4-f93eb0f15d2d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:49.138230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-5c94349d-198e-4b21-aba4-f93eb0f15d2d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lazy-loading 'fault' on Instance uuid 7473ff5e-df54-4fe1-ad84-88acc1fe0def {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:03:49.207341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5c94349d-198e-4b21-aba4-f93eb0f15d2d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:49.226929 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5c94349d-198e-4b21-aba4-f93eb0f15d2d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 200 len: 1314 microversion: 2.1 time: 0.162900 Oct 27 19:03:49.228661 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2080/3970] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:49 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:49.634177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-95a4850d-eace-43fe-af53-3bd688c7463b tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:49.635042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-95a4850d-eace-43fe-af53-3bd688c7463b tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:49.646718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95a4850d-eace-43fe-af53-3bd688c7463b tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:49.648492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95a4850d-eace-43fe-af53-3bd688c7463b tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:49.649341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95a4850d-eace-43fe-af53-3bd688c7463b tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:49.650494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95a4850d-eace-43fe-af53-3bd688c7463b tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:49.651237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95a4850d-eace-43fe-af53-3bd688c7463b tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:49.651897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95a4850d-eace-43fe-af53-3bd688c7463b tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:49.919096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-95a4850d-eace-43fe-af53-3bd688c7463b tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:49.929050 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-95a4850d-eace-43fe-af53-3bd688c7463b tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1466 microversion: 2.1 time: 0.301771 Oct 27 19:03:49.930159 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1891/3971] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:49 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1466 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:50.252242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4bbe0d2c-2f78-4ec1-b2dd-0625edc96ae2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:50.253495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4bbe0d2c-2f78-4ec1-b2dd-0625edc96ae2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:50.261690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bbe0d2c-2f78-4ec1-b2dd-0625edc96ae2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:50.262566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bbe0d2c-2f78-4ec1-b2dd-0625edc96ae2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:50.263237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bbe0d2c-2f78-4ec1-b2dd-0625edc96ae2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:50.264180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bbe0d2c-2f78-4ec1-b2dd-0625edc96ae2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:50.264879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bbe0d2c-2f78-4ec1-b2dd-0625edc96ae2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:50.265535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4bbe0d2c-2f78-4ec1-b2dd-0625edc96ae2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:50.290928 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-4bbe0d2c-2f78-4ec1-b2dd-0625edc96ae2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] HTTP exception thrown: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4bbe0d2c-2f78-4ec1-b2dd-0625edc96ae2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Request method failure captured: Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def HTTP/1.1 Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtXIBO-oIT-HYTB2aEriLPPQy4zwsnSlx9DGo1owgDeViDL8xz9gdgxBZ6h4yaNReHUFDpmMjxtiWf7mVDXaedJvOc8Qwc8zJEa7KWRfdPMYJLUDfqmLkDFiFu3cWColj_-lSB8MMmJyxn24nK4fQdr9h8etZXRJSRnN6iLr8tUpzOk Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d4f98a2b116433bb88cc3541ea44f8b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a4f9579efc194f4c8f9d02d4c21867d8 Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '7473ff5e-df54-4fe1-ad84-88acc1fe0def'} Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:50.294082 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:50.297785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:50.297785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:50.297785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:50.297785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:50.297785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:03:50.297785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:03:50.297785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:03:50.297785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:50.297785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4bbe0d2c-2f78-4ec1-b2dd-0625edc96ae2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Returning 404 to user: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:03:50.297785 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4bbe0d2c-2f78-4ec1-b2dd-0625edc96ae2 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 404 len: 111 microversion: 2.1 time: 0.047667 Oct 27 19:03:50.310788 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2081/3972] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:50 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:03:50.496082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1324392343", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:50.604591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] validate_networks() for [('f9ed35b9-356a-471b-bf27-3cd9e45d57b6', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:03:50.768059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-9cb922e6-d816-4e4d-8145-f8287b111f77 req-546b3b0a-be4a-4221-b0ce-1904d93e8d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "610e9c6a-5022-488f-9af2-952ca1c2774b", "name": "network-vif-deleted", "tag": "f39c4a19-94b4-4741-a433-df4eeb3cbaf2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:50.794496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9cb922e6-d816-4e4d-8145-f8287b111f77 req-546b3b0a-be4a-4221-b0ce-1904d93e8d90 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:50.794998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9cb922e6-d816-4e4d-8145-f8287b111f77 req-546b3b0a-be4a-4221-b0ce-1904d93e8d90 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:50.804712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9cb922e6-d816-4e4d-8145-f8287b111f77 req-546b3b0a-be4a-4221-b0ce-1904d93e8d90 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:50.829724 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-9cb922e6-d816-4e4d-8145-f8287b111f77 req-546b3b0a-be4a-4221-b0ce-1904d93e8d90 service nova] Creating event network-vif-deleted:f39c4a19-94b4-4741-a433-df4eeb3cbaf2 for instance 610e9c6a-5022-488f-9af2-952ca1c2774b on n-h1-860687-3 Oct 27 19:03:50.836740 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-9cb922e6-d816-4e4d-8145-f8287b111f77 req-546b3b0a-be4a-4221-b0ce-1904d93e8d90 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076585 Oct 27 19:03:50.838043 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2082/3973] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:50.955405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-20e7d37f-fe06-4492-a9ab-b655b3d26c57 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:50.956589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-20e7d37f-fe06-4492-a9ab-b655b3d26c57 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:50.968664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20e7d37f-fe06-4492-a9ab-b655b3d26c57 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:50.969168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20e7d37f-fe06-4492-a9ab-b655b3d26c57 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:50.969615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20e7d37f-fe06-4492-a9ab-b655b3d26c57 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:50.970333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20e7d37f-fe06-4492-a9ab-b655b3d26c57 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:50.971368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20e7d37f-fe06-4492-a9ab-b655b3d26c57 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:50.971368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20e7d37f-fe06-4492-a9ab-b655b3d26c57 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:51.048820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20e7d37f-fe06-4492-a9ab-b655b3d26c57 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:51.049328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20e7d37f-fe06-4492-a9ab-b655b3d26c57 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:51.049783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20e7d37f-fe06-4492-a9ab-b655b3d26c57 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:51.050552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-20e7d37f-fe06-4492-a9ab-b655b3d26c57 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lazy-loading 'fault' on Instance uuid 610e9c6a-5022-488f-9af2-952ca1c2774b {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:03:51.200520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-20e7d37f-fe06-4492-a9ab-b655b3d26c57 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:51.215068 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-20e7d37f-fe06-4492-a9ab-b655b3d26c57 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 200 len: 1309 microversion: 2.1 time: 0.264579 Oct 27 19:03:51.217512 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2083/3974] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:50 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 1309 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:03:51.254109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:03:51.254631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:03:51.255048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:03:51.255757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:03:51.256461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:03:51.266300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:51.266827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:51.267478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:51.268221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:51.269351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:51.269803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:51.288801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Getting quotas for project 7d4f98a2b116433bb88cc3541ea44f8b. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:03:51.293948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Getting quotas for user a4f9579efc194f4c8f9d02d4c21867d8 and project 7d4f98a2b116433bb88cc3541ea44f8b. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:03:51.308117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:03:51.310320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:03:51.359890 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-44b70634-8f10-47a6-8db3-73d2e58f89ee tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.870490 Oct 27 19:03:51.366994 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1892/3975] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:03:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:03:51.377928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d48be5f3-85f7-434c-b3db-bd38c0dba6b7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:51.379722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d48be5f3-85f7-434c-b3db-bd38c0dba6b7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:51.385612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00a09c8f-05a7-4fd4-80d6-f5d5a278aae9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:51.385907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-00a09c8f-05a7-4fd4-80d6-f5d5a278aae9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:51.396507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00a09c8f-05a7-4fd4-80d6-f5d5a278aae9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:51.397056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00a09c8f-05a7-4fd4-80d6-f5d5a278aae9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:51.397890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00a09c8f-05a7-4fd4-80d6-f5d5a278aae9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:51.398868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00a09c8f-05a7-4fd4-80d6-f5d5a278aae9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:51.399725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00a09c8f-05a7-4fd4-80d6-f5d5a278aae9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:51.400401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00a09c8f-05a7-4fd4-80d6-f5d5a278aae9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:51.428085 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-00a09c8f-05a7-4fd4-80d6-f5d5a278aae9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/ips" status: 200 len: 149 microversion: 2.1 time: 0.047316 Oct 27 19:03:51.428854 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1893/3976] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 19:03:51 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:51.563933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d48be5f3-85f7-434c-b3db-bd38c0dba6b7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:51.578910 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d48be5f3-85f7-434c-b3db-bd38c0dba6b7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1225 microversion: 2.1 time: 0.210397 Oct 27 19:03:51.579510 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2084/3977] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:51 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1225 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:52.245348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8aa14b1e-d10b-4bec-9b1b-8f39348a8ee8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:52.245984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8aa14b1e-d10b-4bec-9b1b-8f39348a8ee8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: 610e9c6a-5022-488f-9af2-952ca1c2774b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:52.262070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aa14b1e-d10b-4bec-9b1b-8f39348a8ee8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:52.263874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aa14b1e-d10b-4bec-9b1b-8f39348a8ee8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:52.264606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aa14b1e-d10b-4bec-9b1b-8f39348a8ee8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:52.265752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aa14b1e-d10b-4bec-9b1b-8f39348a8ee8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:52.266259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aa14b1e-d10b-4bec-9b1b-8f39348a8ee8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:52.267364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aa14b1e-d10b-4bec-9b1b-8f39348a8ee8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:52.291984 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-8aa14b1e-d10b-4bec-9b1b-8f39348a8ee8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] HTTP exception thrown: Instance 610e9c6a-5022-488f-9af2-952ca1c2774b could not be found. Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8aa14b1e-d10b-4bec-9b1b-8f39348a8ee8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Request method failure captured: Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b HTTP/1.1 Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtXqWEgC8KBT3Wyu8neOyanTcW-wgcrJTCkJF95sN5XCgzkfBHQzQYAmNDcEQdDnFzO5neqtj1LPRUiKNQUoiSMa3pwO_k8_OCUjjiDeLx6mzKTx5OEnA9rh5EAAgdMrw02g6EfJFOQYdYy30T2ekCoTFx1Z1LuQToi1G3jDRFu-7Qg Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 16b6ca515d694f398401546452ca2605 Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-LiveMigrationNegativeTest-612309235 Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/16b6ca515d694f398401546452ca2605"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/16b6ca515d694f398401546452ca2605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_16b6ca515d694f398401546452ca2605", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/16b6ca515d694f398401546452ca2605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-LiveMigrationNegativeTest-612309235 Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 16b6ca515d694f398401546452ca2605 Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-612309235 Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-LiveMigrationNegativeTest-612309235-project Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ccac1edbadb748f0b4b2e8e2e19260ed Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-LiveMigrationNegativeTest-612309235-project Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 610e9c6a-5022-488f-9af2-952ca1c2774b could not be found. Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '610e9c6a-5022-488f-9af2-952ca1c2774b'} Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 610e9c6a-5022-488f-9af2-952ca1c2774b could not be found. Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 610e9c6a-5022-488f-9af2-952ca1c2774b could not be found. Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:52.293883 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:52.297427 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:52.297427 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:52.297427 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:52.297427 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:03:52.297427 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:03:52.297427 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 610e9c6a-5022-488f-9af2-952ca1c2774b could not be found. Oct 27 19:03:52.297427 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:03:52.297427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8aa14b1e-d10b-4bec-9b1b-8f39348a8ee8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Returning 404 to user: Instance 610e9c6a-5022-488f-9af2-952ca1c2774b could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:03:52.297427 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8aa14b1e-d10b-4bec-9b1b-8f39348a8ee8 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b" status: 404 len: 111 microversion: 2.1 time: 0.056214 Oct 27 19:03:52.308110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f17a6905-d734-442e-b256-e965771c164a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:52.308670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f17a6905-d734-442e-b256-e965771c164a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:52.313195 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1894/3978] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:52 2022] GET /compute/v2.1/servers/610e9c6a-5022-488f-9af2-952ca1c2774b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:03:52.317060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f17a6905-d734-442e-b256-e965771c164a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:52.317612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f17a6905-d734-442e-b256-e965771c164a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:52.318947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f17a6905-d734-442e-b256-e965771c164a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:52.320190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f17a6905-d734-442e-b256-e965771c164a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:52.320662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f17a6905-d734-442e-b256-e965771c164a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:52.321164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f17a6905-d734-442e-b256-e965771c164a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:52.379398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f17a6905-d734-442e-b256-e965771c164a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:03:52.541319 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f17a6905-d734-442e-b256-e965771c164a tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 204 len: 0 microversion: 2.1 time: 0.238801 Oct 27 19:03:52.543726 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2085/3979] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:03:52 2022] DELETE /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:03:52.552961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-070f1a81-4435-4cd5-8e41-f71febad3c11 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:52.554348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-070f1a81-4435-4cd5-8e41-f71febad3c11 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:52.561915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-070f1a81-4435-4cd5-8e41-f71febad3c11 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:52.562725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-070f1a81-4435-4cd5-8e41-f71febad3c11 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:52.563409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-070f1a81-4435-4cd5-8e41-f71febad3c11 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:52.565043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-070f1a81-4435-4cd5-8e41-f71febad3c11 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:52.565776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-070f1a81-4435-4cd5-8e41-f71febad3c11 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:52.566462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-070f1a81-4435-4cd5-8e41-f71febad3c11 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:52.609842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8afe01e6-4524-46d2-8685-d71a65b364bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:52.613360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8afe01e6-4524-46d2-8685-d71a65b364bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:52.620959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8afe01e6-4524-46d2-8685-d71a65b364bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:52.630090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8afe01e6-4524-46d2-8685-d71a65b364bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:52.632129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8afe01e6-4524-46d2-8685-d71a65b364bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:52.632912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8afe01e6-4524-46d2-8685-d71a65b364bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:52.633395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8afe01e6-4524-46d2-8685-d71a65b364bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:52.633875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8afe01e6-4524-46d2-8685-d71a65b364bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:52.732734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8afe01e6-4524-46d2-8685-d71a65b364bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:52.742017 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8afe01e6-4524-46d2-8685-d71a65b364bf tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1277 microversion: 2.1 time: 0.136315 Oct 27 19:03:52.757134 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2086/3980] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:52 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:52.816542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-070f1a81-4435-4cd5-8e41-f71febad3c11 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:52.828324 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-070f1a81-4435-4cd5-8e41-f71febad3c11 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1475 microversion: 2.1 time: 0.280010 Oct 27 19:03:52.829126 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1895/3981] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:52 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1475 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:53.768736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b796014b-bc71-4118-9f91-13c428f5bc0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:53.769445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b796014b-bc71-4118-9f91-13c428f5bc0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:53.776804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b796014b-bc71-4118-9f91-13c428f5bc0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:53.777308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b796014b-bc71-4118-9f91-13c428f5bc0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:53.777964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b796014b-bc71-4118-9f91-13c428f5bc0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:53.779147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b796014b-bc71-4118-9f91-13c428f5bc0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:53.779782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b796014b-bc71-4118-9f91-13c428f5bc0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:53.780377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b796014b-bc71-4118-9f91-13c428f5bc0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:53.853663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1ca4d76c-36a9-4ba3-83bd-6c85d18ba4ce tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:53.854335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1ca4d76c-36a9-4ba3-83bd-6c85d18ba4ce tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:53.861162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ca4d76c-36a9-4ba3-83bd-6c85d18ba4ce tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:53.861840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ca4d76c-36a9-4ba3-83bd-6c85d18ba4ce tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:53.862673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ca4d76c-36a9-4ba3-83bd-6c85d18ba4ce tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:53.863635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ca4d76c-36a9-4ba3-83bd-6c85d18ba4ce tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:53.864095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ca4d76c-36a9-4ba3-83bd-6c85d18ba4ce tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:53.864534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ca4d76c-36a9-4ba3-83bd-6c85d18ba4ce tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:53.877409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b796014b-bc71-4118-9f91-13c428f5bc0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:53.887313 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b796014b-bc71-4118-9f91-13c428f5bc0e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1277 microversion: 2.1 time: 0.124132 Oct 27 19:03:53.887905 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2087/3982] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:53 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1277 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:54.054874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9dd8e42d-92a5-405a-afb7-a24d2cfac4f5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee7b6e93-7066-495c-9dcc-f7e12e2a84f3"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:54.057712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9dd8e42d-92a5-405a-afb7-a24d2cfac4f5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:54.064221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1ca4d76c-36a9-4ba3-83bd-6c85d18ba4ce tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:54.065475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd8e42d-92a5-405a-afb7-a24d2cfac4f5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:54.066300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd8e42d-92a5-405a-afb7-a24d2cfac4f5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:54.067081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd8e42d-92a5-405a-afb7-a24d2cfac4f5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:54.068251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd8e42d-92a5-405a-afb7-a24d2cfac4f5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:54.069203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd8e42d-92a5-405a-afb7-a24d2cfac4f5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:54.069848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd8e42d-92a5-405a-afb7-a24d2cfac4f5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:54.077026 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1ca4d76c-36a9-4ba3-83bd-6c85d18ba4ce tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1475 microversion: 2.1 time: 0.227852 Oct 27 19:03:54.077624 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1896/3983] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:53 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1475 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:54.471231 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9dd8e42d-92a5-405a-afb7-a24d2cfac4f5 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "POST /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417033 Oct 27 19:03:54.472125 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2088/3984] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:03:54 2022] POST /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments => generated 194 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:54.911367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-04316b89-e7f5-4564-8db6-ea43f0a5927d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:54.913035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04316b89-e7f5-4564-8db6-ea43f0a5927d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:54.926807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04316b89-e7f5-4564-8db6-ea43f0a5927d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:54.929074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04316b89-e7f5-4564-8db6-ea43f0a5927d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:54.929528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04316b89-e7f5-4564-8db6-ea43f0a5927d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:54.938348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04316b89-e7f5-4564-8db6-ea43f0a5927d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:54.938722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04316b89-e7f5-4564-8db6-ea43f0a5927d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:54.939839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04316b89-e7f5-4564-8db6-ea43f0a5927d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:55.104794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e60b76c-a82e-44ee-8edf-890a3f6951e1 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:55.106352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6e60b76c-a82e-44ee-8edf-890a3f6951e1 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:55.122659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e60b76c-a82e-44ee-8edf-890a3f6951e1 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:55.123990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e60b76c-a82e-44ee-8edf-890a3f6951e1 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:55.126484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e60b76c-a82e-44ee-8edf-890a3f6951e1 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:55.127487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e60b76c-a82e-44ee-8edf-890a3f6951e1 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:55.128249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e60b76c-a82e-44ee-8edf-890a3f6951e1 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:55.133365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e60b76c-a82e-44ee-8edf-890a3f6951e1 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:55.154094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-04316b89-e7f5-4564-8db6-ea43f0a5927d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:55.182716 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-04316b89-e7f5-4564-8db6-ea43f0a5927d tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1283 microversion: 2.1 time: 0.275087 Oct 27 19:03:55.183377 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1897/3985] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:54 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1283 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:55.383927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b5a4c634-e590-4e17-aebb-0c960b392fba req-6704637e-a978-48cc-8474-a0f21f0fb52e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb548e1-fdb6-420e-af5b-690399b898e6", "name": "network-vif-deleted", "tag": "0f25fd90-2bd6-4cfe-a985-09e4c0ca3212"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:55.407230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b5a4c634-e590-4e17-aebb-0c960b392fba req-6704637e-a978-48cc-8474-a0f21f0fb52e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:55.420153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b5a4c634-e590-4e17-aebb-0c960b392fba req-6704637e-a978-48cc-8474-a0f21f0fb52e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:55.421107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b5a4c634-e590-4e17-aebb-0c960b392fba req-6704637e-a978-48cc-8474-a0f21f0fb52e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:55.458033 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b5a4c634-e590-4e17-aebb-0c960b392fba req-6704637e-a978-48cc-8474-a0f21f0fb52e service nova] Creating event network-vif-deleted:0f25fd90-2bd6-4cfe-a985-09e4c0ca3212 for instance eeb548e1-fdb6-420e-af5b-690399b898e6 on n-h2-860687-3 Oct 27 19:03:55.472353 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b5a4c634-e590-4e17-aebb-0c960b392fba req-6704637e-a978-48cc-8474-a0f21f0fb52e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093141 Oct 27 19:03:55.473302 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1898/3986] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:03:55.629469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6e60b76c-a82e-44ee-8edf-890a3f6951e1 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccac1edbadb748f0b4b2e8e2e19260ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6ca515d694f398401546452ca2605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:55.643188 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6e60b76c-a82e-44ee-8edf-890a3f6951e1 tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 200 len: 1433 microversion: 2.1 time: 0.546192 Oct 27 19:03:55.655866 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2089/3987] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:55 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 1433 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:56.207345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4f419d7b-afad-4ba2-9341-fe0353b640d5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:56.209479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4f419d7b-afad-4ba2-9341-fe0353b640d5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:56.221740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f419d7b-afad-4ba2-9341-fe0353b640d5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:56.225871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f419d7b-afad-4ba2-9341-fe0353b640d5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:56.226782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f419d7b-afad-4ba2-9341-fe0353b640d5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:56.227707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f419d7b-afad-4ba2-9341-fe0353b640d5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:56.228375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f419d7b-afad-4ba2-9341-fe0353b640d5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:56.229272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f419d7b-afad-4ba2-9341-fe0353b640d5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:56.234209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:56.425324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4f419d7b-afad-4ba2-9341-fe0353b640d5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:56.438857 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4f419d7b-afad-4ba2-9341-fe0353b640d5 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1325 microversion: 2.1 time: 0.235368 Oct 27 19:03:56.454472 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1899/3988] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:56 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1325 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:56.705333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f1204135-36d3-45cb-b22b-1ec2fa3f7dbe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:56.706156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f1204135-36d3-45cb-b22b-1ec2fa3f7dbe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] [instance: eeb548e1-fdb6-420e-af5b-690399b898e6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:56.715253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1204135-36d3-45cb-b22b-1ec2fa3f7dbe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:56.716110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1204135-36d3-45cb-b22b-1ec2fa3f7dbe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:56.717489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1204135-36d3-45cb-b22b-1ec2fa3f7dbe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:56.718503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1204135-36d3-45cb-b22b-1ec2fa3f7dbe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:56.723933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1204135-36d3-45cb-b22b-1ec2fa3f7dbe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:56.727058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1204135-36d3-45cb-b22b-1ec2fa3f7dbe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:56.790220 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-f1204135-36d3-45cb-b22b-1ec2fa3f7dbe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] HTTP exception thrown: Instance eeb548e1-fdb6-420e-af5b-690399b898e6 could not be found. Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f1204135-36d3-45cb-b22b-1ec2fa3f7dbe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Request method failure captured: Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 HTTP/1.1 Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtXqWEgC8KBT3Wyu8neOyanTcW-wgcrJTCkJF95sN5XCgzkfBHQzQYAmNDcEQdDnFzO5neqtj1LPRUiKNQUoiSMa3pwO_k8_OCUjjiDeLx6mzKTx5OEnA9rh5EAAgdMrw02g6EfJFOQYdYy30T2ekCoTFx1Z1LuQToi1G3jDRFu-7Qg Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 16b6ca515d694f398401546452ca2605 Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-LiveMigrationNegativeTest-612309235 Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/16b6ca515d694f398401546452ca2605"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/16b6ca515d694f398401546452ca2605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_16b6ca515d694f398401546452ca2605", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/16b6ca515d694f398401546452ca2605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-LiveMigrationNegativeTest-612309235 Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 16b6ca515d694f398401546452ca2605 Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-612309235 Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-LiveMigrationNegativeTest-612309235-project Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ccac1edbadb748f0b4b2e8e2e19260ed Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-LiveMigrationNegativeTest-612309235-project Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance eeb548e1-fdb6-420e-af5b-690399b898e6 could not be found. Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'eeb548e1-fdb6-420e-af5b-690399b898e6'} Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb548e1-fdb6-420e-af5b-690399b898e6 could not be found. Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb548e1-fdb6-420e-af5b-690399b898e6 could not be found. Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:03:56.793961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:56.798572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:03:56.798572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:03:56.798572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:03:56.798572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:03:56.798572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:03:56.798572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb548e1-fdb6-420e-af5b-690399b898e6 could not be found. Oct 27 19:03:56.798572 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:03:56.800789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f1204135-36d3-45cb-b22b-1ec2fa3f7dbe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] Returning 404 to user: Instance eeb548e1-fdb6-420e-af5b-690399b898e6 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:03:56.803487 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f1204135-36d3-45cb-b22b-1ec2fa3f7dbe tempest-LiveMigrationNegativeTest-612309235 tempest-LiveMigrationNegativeTest-612309235-project] 10.222.0.42 "GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6" status: 404 len: 111 microversion: 2.1 time: 0.115277 Oct 27 19:03:56.807767 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2090/3989] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:56 2022] GET /compute/v2.1/servers/eeb548e1-fdb6-420e-af5b-690399b898e6 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:03:57.170070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8da06607-b1e3-43b0-84aa-b179fcca823b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:57.170648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8da06607-b1e3-43b0-84aa-b179fcca823b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:57.189869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8da06607-b1e3-43b0-84aa-b179fcca823b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:57.190538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8da06607-b1e3-43b0-84aa-b179fcca823b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:57.192229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8da06607-b1e3-43b0-84aa-b179fcca823b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:57.193034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8da06607-b1e3-43b0-84aa-b179fcca823b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:57.193507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8da06607-b1e3-43b0-84aa-b179fcca823b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:57.199741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-cded4590-3322-4544-8437-8345225c6c95 req-ef3f2de1-abbd-446d-baca-8b4382bd9bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ccfdb33-58dd-46ff-b9f7-c945ab79deab", "tag": "6d255296-6aa7-422d-a38c-91931d6bc22e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:03:57.201874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8da06607-b1e3-43b0-84aa-b179fcca823b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:57.219333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cded4590-3322-4544-8437-8345225c6c95 req-ef3f2de1-abbd-446d-baca-8b4382bd9bfc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:57.221872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cded4590-3322-4544-8437-8345225c6c95 req-ef3f2de1-abbd-446d-baca-8b4382bd9bfc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:57.222549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cded4590-3322-4544-8437-8345225c6c95 req-ef3f2de1-abbd-446d-baca-8b4382bd9bfc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:57.258543 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-cded4590-3322-4544-8437-8345225c6c95 req-ef3f2de1-abbd-446d-baca-8b4382bd9bfc service nova] Creating event network-changed:6d255296-6aa7-422d-a38c-91931d6bc22e for instance 2ccfdb33-58dd-46ff-b9f7-c945ab79deab on n-h2-860687-3 Oct 27 19:03:57.268353 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-cded4590-3322-4544-8437-8345225c6c95 req-ef3f2de1-abbd-446d-baca-8b4382bd9bfc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073073 Oct 27 19:03:57.270358 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2091/3990] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:03:57.276952 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8da06607-b1e3-43b0-84aa-b179fcca823b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments/a1f8ee7a-0ff3-45c8-9c0c-61cb6fc84d5e" status: 200 len: 194 microversion: 2.20 time: 0.112355 Oct 27 19:03:57.284100 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1900/3991] 10.222.0.42 () {60 vars in 1454 bytes} [Thu Oct 27 19:03:57 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments/a1f8ee7a-0ff3-45c8-9c0c-61cb6fc84d5e => generated 194 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:03:57.396195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6c87a853-4dc4-4a85-ad8c-dfd130f49d69 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:57.396803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6c87a853-4dc4-4a85-ad8c-dfd130f49d69 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:57.417835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c87a853-4dc4-4a85-ad8c-dfd130f49d69 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:57.419712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c87a853-4dc4-4a85-ad8c-dfd130f49d69 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:57.421368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c87a853-4dc4-4a85-ad8c-dfd130f49d69 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:57.425414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c87a853-4dc4-4a85-ad8c-dfd130f49d69 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:57.426178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c87a853-4dc4-4a85-ad8c-dfd130f49d69 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:57.428908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c87a853-4dc4-4a85-ad8c-dfd130f49d69 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:57.476110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d0f8e085-5cea-4cad-8f7a-b803930f174e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:57.477193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d0f8e085-5cea-4cad-8f7a-b803930f174e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:57.488408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0f8e085-5cea-4cad-8f7a-b803930f174e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:57.491104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0f8e085-5cea-4cad-8f7a-b803930f174e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:57.491744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0f8e085-5cea-4cad-8f7a-b803930f174e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:57.492652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0f8e085-5cea-4cad-8f7a-b803930f174e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:57.493276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0f8e085-5cea-4cad-8f7a-b803930f174e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:57.497190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0f8e085-5cea-4cad-8f7a-b803930f174e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:57.505073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:03:57.674032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-6c87a853-4dc4-4a85-ad8c-dfd130f49d69 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lazy-loading 'services' on Instance uuid f4a7713a-b78d-425e-a6e8-0e4f5bc8904b {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:03:57.841380 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6c87a853-4dc4-4a85-ad8c-dfd130f49d69 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments/a1f8ee7a-0ff3-45c8-9c0c-61cb6fc84d5e" status: 202 len: 0 microversion: 2.20 time: 0.449536 Oct 27 19:03:57.845254 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2092/3992] 10.222.0.42 () {60 vars in 1457 bytes} [Thu Oct 27 19:03:57 2022] DELETE /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments/a1f8ee7a-0ff3-45c8-9c0c-61cb6fc84d5e => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:03:57.869939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7b73adc2-0487-4b6b-9f93-8618cb2d58d3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:57.879515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7b73adc2-0487-4b6b-9f93-8618cb2d58d3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:57.901762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b73adc2-0487-4b6b-9f93-8618cb2d58d3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:57.905500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b73adc2-0487-4b6b-9f93-8618cb2d58d3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:57.906675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b73adc2-0487-4b6b-9f93-8618cb2d58d3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:57.907885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b73adc2-0487-4b6b-9f93-8618cb2d58d3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:57.909984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b73adc2-0487-4b6b-9f93-8618cb2d58d3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:57.911208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b73adc2-0487-4b6b-9f93-8618cb2d58d3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:57.993658 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7b73adc2-0487-4b6b-9f93-8618cb2d58d3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.141702 Oct 27 19:03:57.994935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d0f8e085-5cea-4cad-8f7a-b803930f174e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:57.996467 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2093/3993] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 19:03:57 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:03:58.005252 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d0f8e085-5cea-4cad-8f7a-b803930f174e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1325 microversion: 2.1 time: 0.541259 Oct 27 19:03:58.007280 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1901/3994] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:57 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1325 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:03:59.010567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-65fa55ff-705d-4365-8a4f-096af28ebae2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:59.013828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-65fa55ff-705d-4365-8a4f-096af28ebae2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:59.022270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65fa55ff-705d-4365-8a4f-096af28ebae2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:59.023091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65fa55ff-705d-4365-8a4f-096af28ebae2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:59.023825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65fa55ff-705d-4365-8a4f-096af28ebae2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:59.024759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65fa55ff-705d-4365-8a4f-096af28ebae2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:59.025429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65fa55ff-705d-4365-8a4f-096af28ebae2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:59.026070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65fa55ff-705d-4365-8a4f-096af28ebae2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:59.033419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0ce23263-d6e0-4b09-9562-2b71b047301f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:03:59.034972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0ce23263-d6e0-4b09-9562-2b71b047301f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:03:59.047432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce23263-d6e0-4b09-9562-2b71b047301f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:59.048305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce23263-d6e0-4b09-9562-2b71b047301f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:59.051307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce23263-d6e0-4b09-9562-2b71b047301f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:59.054597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce23263-d6e0-4b09-9562-2b71b047301f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:03:59.055315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce23263-d6e0-4b09-9562-2b71b047301f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:03:59.055857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ce23263-d6e0-4b09-9562-2b71b047301f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:03:59.109133 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-65fa55ff-705d-4365-8a4f-096af28ebae2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104474 Oct 27 19:03:59.111147 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2094/3995] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 19:03:59 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 19:03:59.320937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0ce23263-d6e0-4b09-9562-2b71b047301f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:03:59.334055 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0ce23263-d6e0-4b09-9562-2b71b047301f tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1325 microversion: 2.1 time: 0.303531 Oct 27 19:03:59.335086 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1902/3996] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:03:59 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1325 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:00.123336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af4c81d0-b0bd-442f-b9cb-8b1293882bda tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:00.133299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-af4c81d0-b0bd-442f-b9cb-8b1293882bda tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:00.141708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af4c81d0-b0bd-442f-b9cb-8b1293882bda tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:00.142195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af4c81d0-b0bd-442f-b9cb-8b1293882bda tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:00.142832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af4c81d0-b0bd-442f-b9cb-8b1293882bda tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:00.143730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af4c81d0-b0bd-442f-b9cb-8b1293882bda tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:00.144345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af4c81d0-b0bd-442f-b9cb-8b1293882bda tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:00.145408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af4c81d0-b0bd-442f-b9cb-8b1293882bda tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:00.180631 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-af4c81d0-b0bd-442f-b9cb-8b1293882bda tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061227 Oct 27 19:04:00.181232 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2095/3997] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 19:04:00 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:04:00.359876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a4c3b681-b3ea-4d40-9ba4-a45934d4a017 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:00.362681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a4c3b681-b3ea-4d40-9ba4-a45934d4a017 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:00.387615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4c3b681-b3ea-4d40-9ba4-a45934d4a017 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:00.389546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4c3b681-b3ea-4d40-9ba4-a45934d4a017 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:00.390232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4c3b681-b3ea-4d40-9ba4-a45934d4a017 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:00.391260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4c3b681-b3ea-4d40-9ba4-a45934d4a017 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:00.391736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4c3b681-b3ea-4d40-9ba4-a45934d4a017 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:00.395119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4c3b681-b3ea-4d40-9ba4-a45934d4a017 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:01.264408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a4c3b681-b3ea-4d40-9ba4-a45934d4a017 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:01.275105 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a4c3b681-b3ea-4d40-9ba4-a45934d4a017 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1325 microversion: 2.1 time: 0.919515 Oct 27 19:04:01.276216 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1903/3998] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:00 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1325 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:01.281449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fd0035a5-3423-4694-b77d-a67976b01518 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:01.284326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fd0035a5-3423-4694-b77d-a67976b01518 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:01.294006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:01.297076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd0035a5-3423-4694-b77d-a67976b01518 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:01.297907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd0035a5-3423-4694-b77d-a67976b01518 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:01.298582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd0035a5-3423-4694-b77d-a67976b01518 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:01.299883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd0035a5-3423-4694-b77d-a67976b01518 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:01.300820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd0035a5-3423-4694-b77d-a67976b01518 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:01.301460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd0035a5-3423-4694-b77d-a67976b01518 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:01.302082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:01.328610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6bfd5d18-9f6a-463e-b825-8c7fed366b7f tempest-QuotaClassesAdmin257Test-941677978 tempest-QuotaClassesAdmin257Test-941677978-project-admin] Calling method '.version_select at 0x7fc869ff75e0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:01.359492 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6bfd5d18-9f6a-463e-b825-8c7fed366b7f tempest-QuotaClassesAdmin257Test-941677978 tempest-QuotaClassesAdmin257Test-941677978-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.271932 Oct 27 19:04:01.360647 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2096/3999] 10.222.0.42 () {60 vars in 1226 bytes} [Thu Oct 27 19:04:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 19:04:01.367847 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fd0035a5-3423-4694-b77d-a67976b01518 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090395 Oct 27 19:04:01.369259 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1904/4000] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 19:04:01 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:04:01.375142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-03d517ca-910e-4978-b447-6a8fe935c3a3 tempest-QuotaClassesAdmin257Test-941677978 tempest-QuotaClassesAdmin257Test-941677978-project-admin] Action: 'update', calling method: .version_select at 0x7fc869ff70d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:01.493749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=10,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:01.519878 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-03d517ca-910e-4978-b447-6a8fe935c3a3 tempest-QuotaClassesAdmin257Test-941677978 tempest-QuotaClassesAdmin257Test-941677978-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.148576 Oct 27 19:04:01.521697 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2097/4001] 10.222.0.42 () {62 vars in 1247 bytes} [Thu Oct 27 19:04:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:04:01.533081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4122fda1-a6ed-4e3f-aac0-f81856ce2ddd tempest-QuotaClassesAdmin257Test-941677978 tempest-QuotaClassesAdmin257Test-941677978-project-admin] Calling method '.version_select at 0x7fc869b9a160>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:01.561282 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4122fda1-a6ed-4e3f-aac0-f81856ce2ddd tempest-QuotaClassesAdmin257Test-941677978 tempest-QuotaClassesAdmin257Test-941677978-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.026950 Oct 27 19:04:01.562431 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1905/4002] 10.222.0.42 () {60 vars in 1226 bytes} [Thu Oct 27 19:04:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:04:01.576815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7557af74-fbf0-490d-bfde-8f2ddfe6e08f tempest-QuotaClassesAdmin257Test-941677978 tempest-QuotaClassesAdmin257Test-941677978-project-admin] Action: 'update', calling method: .version_select at 0x7fc86a03ee50>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:01.683764 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7557af74-fbf0-490d-bfde-8f2ddfe6e08f tempest-QuotaClassesAdmin257Test-941677978 tempest-QuotaClassesAdmin257Test-941677978-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.112957 Oct 27 19:04:01.684633 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2098/4003] 10.222.0.42 () {62 vars in 1247 bytes} [Thu Oct 27 19:04:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:04:02.303872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-20b40b08-6e0b-430f-8073-263a8fd16e58 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:02.305311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-20b40b08-6e0b-430f-8073-263a8fd16e58 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:02.316411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20b40b08-6e0b-430f-8073-263a8fd16e58 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:02.316914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20b40b08-6e0b-430f-8073-263a8fd16e58 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:02.317378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20b40b08-6e0b-430f-8073-263a8fd16e58 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:02.318543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20b40b08-6e0b-430f-8073-263a8fd16e58 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:02.319005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20b40b08-6e0b-430f-8073-263a8fd16e58 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:02.319442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20b40b08-6e0b-430f-8073-263a8fd16e58 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:02.403769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-06c6cfa6-6578-467f-a52f-ec8a86d123af tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:02.408345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-06c6cfa6-6578-467f-a52f-ec8a86d123af tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:02.435023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06c6cfa6-6578-467f-a52f-ec8a86d123af tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:02.436486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06c6cfa6-6578-467f-a52f-ec8a86d123af tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:02.439387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06c6cfa6-6578-467f-a52f-ec8a86d123af tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:02.440341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06c6cfa6-6578-467f-a52f-ec8a86d123af tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:02.441010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06c6cfa6-6578-467f-a52f-ec8a86d123af tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:02.442092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06c6cfa6-6578-467f-a52f-ec8a86d123af tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:02.516973 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-06c6cfa6-6578-467f-a52f-ec8a86d123af tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.137723 Oct 27 19:04:02.519542 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2099/4004] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 19:04:02 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:04:02.577294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-20b40b08-6e0b-430f-8073-263a8fd16e58 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:02.606099 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-20b40b08-6e0b-430f-8073-263a8fd16e58 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1325 microversion: 2.1 time: 0.304934 Oct 27 19:04:02.608457 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1906/4005] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:02 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1325 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:03.507755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-7e4e3c41-0484-4031-bce3-00b7be8007f4 req-d7e02905-c9e8-45c0-9897-290789ada88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ccfdb33-58dd-46ff-b9f7-c945ab79deab", "name": "network-vif-plugged", "status": "completed", "tag": "6d255296-6aa7-422d-a38c-91931d6bc22e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:03.533389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1b911ae6-7270-426c-9806-0d3544e31548 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:03.538711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1b911ae6-7270-426c-9806-0d3544e31548 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:03.553906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7e4e3c41-0484-4031-bce3-00b7be8007f4 req-d7e02905-c9e8-45c0-9897-290789ada88d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:03.554466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7e4e3c41-0484-4031-bce3-00b7be8007f4 req-d7e02905-c9e8-45c0-9897-290789ada88d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:03.554927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7e4e3c41-0484-4031-bce3-00b7be8007f4 req-d7e02905-c9e8-45c0-9897-290789ada88d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:03.565302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b911ae6-7270-426c-9806-0d3544e31548 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:03.573419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b911ae6-7270-426c-9806-0d3544e31548 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:03.575671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b911ae6-7270-426c-9806-0d3544e31548 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:03.580823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b911ae6-7270-426c-9806-0d3544e31548 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:03.581419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b911ae6-7270-426c-9806-0d3544e31548 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:03.581763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b911ae6-7270-426c-9806-0d3544e31548 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:03.601282 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-7e4e3c41-0484-4031-bce3-00b7be8007f4 req-d7e02905-c9e8-45c0-9897-290789ada88d service nova] Creating event network-vif-plugged:6d255296-6aa7-422d-a38c-91931d6bc22e for instance 2ccfdb33-58dd-46ff-b9f7-c945ab79deab on n-h2-860687-3 Oct 27 19:04:03.613587 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-7e4e3c41-0484-4031-bce3-00b7be8007f4 req-d7e02905-c9e8-45c0-9897-290789ada88d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107963 Oct 27 19:04:03.616202 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2100/4006] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:03.637619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aa452709-610e-4c1a-acd6-8944b3fa73da tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:03.639215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-aa452709-610e-4c1a-acd6-8944b3fa73da tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:03.653584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa452709-610e-4c1a-acd6-8944b3fa73da tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:03.657551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa452709-610e-4c1a-acd6-8944b3fa73da tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:03.658228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa452709-610e-4c1a-acd6-8944b3fa73da tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:03.660650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa452709-610e-4c1a-acd6-8944b3fa73da tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:03.663871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa452709-610e-4c1a-acd6-8944b3fa73da tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:03.664773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa452709-610e-4c1a-acd6-8944b3fa73da tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:03.683374 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1b911ae6-7270-426c-9806-0d3544e31548 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.155183 Oct 27 19:04:03.684262 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1907/4007] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 19:04:03 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:04:03.933721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-aa452709-610e-4c1a-acd6-8944b3fa73da tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:03.945827 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aa452709-610e-4c1a-acd6-8944b3fa73da tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1325 microversion: 2.1 time: 0.314983 Oct 27 19:04:03.950591 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2101/4008] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:03 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1325 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:04:04.696676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-071d8a4d-957a-4479-8987-8606bbb4471c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:04.698884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-071d8a4d-957a-4479-8987-8606bbb4471c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:04.706053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-071d8a4d-957a-4479-8987-8606bbb4471c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:04.706596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-071d8a4d-957a-4479-8987-8606bbb4471c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:04.707041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-071d8a4d-957a-4479-8987-8606bbb4471c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:04.707752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-071d8a4d-957a-4479-8987-8606bbb4471c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:04.708324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-071d8a4d-957a-4479-8987-8606bbb4471c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:04.708790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-071d8a4d-957a-4479-8987-8606bbb4471c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:04.741689 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-071d8a4d-957a-4479-8987-8606bbb4471c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049651 Oct 27 19:04:04.742279 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1908/4009] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 19:04:04 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:04:04.971308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6966c0a-40c8-46ff-9fff-2a763c423cea tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:04.972641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d6966c0a-40c8-46ff-9fff-2a763c423cea tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:04.980388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6966c0a-40c8-46ff-9fff-2a763c423cea tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:04.980902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6966c0a-40c8-46ff-9fff-2a763c423cea tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:04.981552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6966c0a-40c8-46ff-9fff-2a763c423cea tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:04.982305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6966c0a-40c8-46ff-9fff-2a763c423cea tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:04.982812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6966c0a-40c8-46ff-9fff-2a763c423cea tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:04.983255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6966c0a-40c8-46ff-9fff-2a763c423cea tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:05.134042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d6966c0a-40c8-46ff-9fff-2a763c423cea tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:05.143241 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d6966c0a-40c8-46ff-9fff-2a763c423cea tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1325 microversion: 2.1 time: 0.177354 Oct 27 19:04:05.145327 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2102/4010] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:04 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1325 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:05.277495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-133152656", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:05.365166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:04:05.600873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:04:05.601299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:04:05.601791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:04:05.602212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:04:05.602694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:04:05.612147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:05.612646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:05.613098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:05.613841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:05.614307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:05.614856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:05.632810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Getting quotas for project 205376348cc54a0aaa4e6c16ba2a86c3. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:04:05.638050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Getting quotas for user 9a92df7118a54f49bc7c623b4451e498 and project 205376348cc54a0aaa4e6c16ba2a86c3. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:04:05.651353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:04:05.653714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:04:05.704082 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d36185d7-0016-41b7-addb-e6e14c1a3961 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598874 Oct 27 19:04:05.705113 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1909/4011] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:04:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:04:05.716438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8698b527-4293-4c5d-a36a-5cc8cc222b68 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:05.717065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8698b527-4293-4c5d-a36a-5cc8cc222b68 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:05.753179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-faec0c7d-ac46-48d3-be19-0b870a184d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:05.755413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-faec0c7d-ac46-48d3-be19-0b870a184d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:05.774971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-faec0c7d-ac46-48d3-be19-0b870a184d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:05.786240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8698b527-4293-4c5d-a36a-5cc8cc222b68 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:05.787520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-faec0c7d-ac46-48d3-be19-0b870a184d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:05.788241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-faec0c7d-ac46-48d3-be19-0b870a184d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:05.792577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-faec0c7d-ac46-48d3-be19-0b870a184d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:05.793302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-faec0c7d-ac46-48d3-be19-0b870a184d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:05.793999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-faec0c7d-ac46-48d3-be19-0b870a184d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:05.795460 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8698b527-4293-4c5d-a36a-5cc8cc222b68 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 200 len: 1221 microversion: 2.1 time: 0.082923 Oct 27 19:04:05.814258 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2103/4012] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:05 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 1221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:05.842451 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-faec0c7d-ac46-48d3-be19-0b870a184d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093024 Oct 27 19:04:05.843927 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1910/4013] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 19:04:05 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 19:04:06.168608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-49501374-bc42-4eae-8af4-7c7f9796d8f7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:06.171946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-49501374-bc42-4eae-8af4-7c7f9796d8f7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:06.184647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49501374-bc42-4eae-8af4-7c7f9796d8f7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:06.185307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49501374-bc42-4eae-8af4-7c7f9796d8f7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:06.185854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49501374-bc42-4eae-8af4-7c7f9796d8f7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:06.190334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49501374-bc42-4eae-8af4-7c7f9796d8f7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:06.191042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49501374-bc42-4eae-8af4-7c7f9796d8f7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:06.191708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49501374-bc42-4eae-8af4-7c7f9796d8f7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:06.369814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-49501374-bc42-4eae-8af4-7c7f9796d8f7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:06.380736 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-49501374-bc42-4eae-8af4-7c7f9796d8f7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1522 microversion: 2.1 time: 0.215562 Oct 27 19:04:06.381969 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2104/4014] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:06 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:06.408950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b0906587-f4ba-482f-bfc9-22ac4b73f21a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:06.409725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0906587-f4ba-482f-bfc9-22ac4b73f21a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:06.417165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:06.419319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0906587-f4ba-482f-bfc9-22ac4b73f21a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:06.420164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0906587-f4ba-482f-bfc9-22ac4b73f21a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:06.420659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0906587-f4ba-482f-bfc9-22ac4b73f21a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:06.421618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0906587-f4ba-482f-bfc9-22ac4b73f21a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:06.422331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0906587-f4ba-482f-bfc9-22ac4b73f21a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:06.423010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0906587-f4ba-482f-bfc9-22ac4b73f21a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:06.458867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0906587-f4ba-482f-bfc9-22ac4b73f21a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:04:06.621044 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b0906587-f4ba-482f-bfc9-22ac4b73f21a tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 204 len: 0 microversion: 2.1 time: 0.217073 Oct 27 19:04:06.621643 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1911/4015] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:04:06 2022] DELETE /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:04:06.629764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a7337859-194d-48a9-a143-f53a4de0739e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:06.631508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a7337859-194d-48a9-a143-f53a4de0739e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:06.644024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7337859-194d-48a9-a143-f53a4de0739e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:06.644522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7337859-194d-48a9-a143-f53a4de0739e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:06.644965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7337859-194d-48a9-a143-f53a4de0739e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:06.645674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7337859-194d-48a9-a143-f53a4de0739e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:06.646253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7337859-194d-48a9-a143-f53a4de0739e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:06.647028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7337859-194d-48a9-a143-f53a4de0739e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:06.811566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a7337859-194d-48a9-a143-f53a4de0739e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:06.820778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-20e9c255-afcd-4cbb-82dd-25aeca6991c8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:06.821743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-20e9c255-afcd-4cbb-82dd-25aeca6991c8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:06.829900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20e9c255-afcd-4cbb-82dd-25aeca6991c8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:06.830871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20e9c255-afcd-4cbb-82dd-25aeca6991c8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:06.831558 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a7337859-194d-48a9-a143-f53a4de0739e tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1528 microversion: 2.1 time: 0.205571 Oct 27 19:04:06.831952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20e9c255-afcd-4cbb-82dd-25aeca6991c8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:06.832603 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2105/4016] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:06 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1528 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:06.834466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20e9c255-afcd-4cbb-82dd-25aeca6991c8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:06.835608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20e9c255-afcd-4cbb-82dd-25aeca6991c8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:06.836344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20e9c255-afcd-4cbb-82dd-25aeca6991c8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:06.856151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f5ede206-252e-47f3-857a-29952ec9a003 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:06.858929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f5ede206-252e-47f3-857a-29952ec9a003 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:06.868857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5ede206-252e-47f3-857a-29952ec9a003 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:06.869623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5ede206-252e-47f3-857a-29952ec9a003 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:06.870230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5ede206-252e-47f3-857a-29952ec9a003 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:06.871167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5ede206-252e-47f3-857a-29952ec9a003 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:06.871861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5ede206-252e-47f3-857a-29952ec9a003 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:06.872468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5ede206-252e-47f3-857a-29952ec9a003 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:06.917222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-20e9c255-afcd-4cbb-82dd-25aeca6991c8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:06.920142 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f5ede206-252e-47f3-857a-29952ec9a003 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068016 Oct 27 19:04:06.921040 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2106/4017] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 19:04:06 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 19:04:06.926171 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-20e9c255-afcd-4cbb-82dd-25aeca6991c8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 200 len: 1273 microversion: 2.1 time: 0.110277 Oct 27 19:04:06.927667 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1912/4018] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:06 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 1273 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:04:07.856689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-904b22df-8594-4afe-82db-a68e79616617 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:07.857672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-904b22df-8594-4afe-82db-a68e79616617 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:07.873529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-904b22df-8594-4afe-82db-a68e79616617 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:07.874565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-904b22df-8594-4afe-82db-a68e79616617 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:07.877900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-904b22df-8594-4afe-82db-a68e79616617 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:07.878870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-904b22df-8594-4afe-82db-a68e79616617 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:07.891484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-904b22df-8594-4afe-82db-a68e79616617 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:07.893656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-904b22df-8594-4afe-82db-a68e79616617 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:07.933996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4fc57787-a6ff-443b-b25d-c195287f71fb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:07.936606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4fc57787-a6ff-443b-b25d-c195287f71fb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:07.950610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fc57787-a6ff-443b-b25d-c195287f71fb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:07.951369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fc57787-a6ff-443b-b25d-c195287f71fb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:07.953647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fc57787-a6ff-443b-b25d-c195287f71fb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:07.954723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fc57787-a6ff-443b-b25d-c195287f71fb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:07.955501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fc57787-a6ff-443b-b25d-c195287f71fb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:07.956323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fc57787-a6ff-443b-b25d-c195287f71fb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:08.016212 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4fc57787-a6ff-443b-b25d-c195287f71fb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.086519 Oct 27 19:04:08.017547 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1913/4019] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 19:04:07 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:08.022835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5517cb22-708c-4224-9be2-e5cf66ba6ea6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:08.036923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5517cb22-708c-4224-9be2-e5cf66ba6ea6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:08.052846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5517cb22-708c-4224-9be2-e5cf66ba6ea6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:08.057199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5517cb22-708c-4224-9be2-e5cf66ba6ea6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:08.057906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5517cb22-708c-4224-9be2-e5cf66ba6ea6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:08.058947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5517cb22-708c-4224-9be2-e5cf66ba6ea6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:08.059632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5517cb22-708c-4224-9be2-e5cf66ba6ea6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:08.060272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5517cb22-708c-4224-9be2-e5cf66ba6ea6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:08.187736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5517cb22-708c-4224-9be2-e5cf66ba6ea6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:08.201825 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5517cb22-708c-4224-9be2-e5cf66ba6ea6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 200 len: 1279 microversion: 2.1 time: 0.181227 Oct 27 19:04:08.202462 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1914/4020] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:08 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:08.211262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ef2fb6b1-48c6-4bf3-911d-c26809a2beb7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:08.211768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ef2fb6b1-48c6-4bf3-911d-c26809a2beb7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:08.218833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef2fb6b1-48c6-4bf3-911d-c26809a2beb7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:08.219327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef2fb6b1-48c6-4bf3-911d-c26809a2beb7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:08.219999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef2fb6b1-48c6-4bf3-911d-c26809a2beb7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:08.220939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef2fb6b1-48c6-4bf3-911d-c26809a2beb7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:08.221589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef2fb6b1-48c6-4bf3-911d-c26809a2beb7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:08.222021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef2fb6b1-48c6-4bf3-911d-c26809a2beb7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:08.264645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ef2fb6b1-48c6-4bf3-911d-c26809a2beb7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:04:08.268783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:08.387821 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ef2fb6b1-48c6-4bf3-911d-c26809a2beb7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 204 len: 0 microversion: 2.20 time: 0.182122 Oct 27 19:04:08.388446 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1915/4021] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 19:04:08 2022] DELETE /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:04:08.404245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f72fd510-a507-42e1-9a25-d2e26cde7167 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:08.405597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f72fd510-a507-42e1-9a25-d2e26cde7167 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:08.413967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f72fd510-a507-42e1-9a25-d2e26cde7167 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:08.414678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f72fd510-a507-42e1-9a25-d2e26cde7167 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:08.415397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f72fd510-a507-42e1-9a25-d2e26cde7167 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:08.416088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f72fd510-a507-42e1-9a25-d2e26cde7167 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:08.416648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f72fd510-a507-42e1-9a25-d2e26cde7167 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:08.417428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f72fd510-a507-42e1-9a25-d2e26cde7167 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:08.504405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-904b22df-8594-4afe-82db-a68e79616617 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:08.521927 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-904b22df-8594-4afe-82db-a68e79616617 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1528 microversion: 2.1 time: 0.668257 Oct 27 19:04:08.523151 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2107/4022] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:07 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1528 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:08.761281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f72fd510-a507-42e1-9a25-d2e26cde7167 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:08.770310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f72fd510-a507-42e1-9a25-d2e26cde7167 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:08.775692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f72fd510-a507-42e1-9a25-d2e26cde7167 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:08.776888 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f72fd510-a507-42e1-9a25-d2e26cde7167 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1721 microversion: 2.20 time: 0.382074 Oct 27 19:04:08.790414 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1916/4023] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:08 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1721 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:09.027965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1f9ff652-9562-44c9-815d-a1de4e8b433e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee7b6e93-7066-495c-9dcc-f7e12e2a84f3"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:09.031002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1f9ff652-9562-44c9-815d-a1de4e8b433e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:09.041887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f9ff652-9562-44c9-815d-a1de4e8b433e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:09.042804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f9ff652-9562-44c9-815d-a1de4e8b433e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:09.043724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f9ff652-9562-44c9-815d-a1de4e8b433e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:09.045161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f9ff652-9562-44c9-815d-a1de4e8b433e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:09.045954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f9ff652-9562-44c9-815d-a1de4e8b433e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:09.046711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f9ff652-9562-44c9-815d-a1de4e8b433e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:09.189311 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-1f9ff652-9562-44c9-815d-a1de4e8b433e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] HTTP exception thrown: Invalid volume: volume ee7b6e93-7066-495c-9dcc-f7e12e2a84f3 is already attached to instances: 83449394-d485-488c-853e-d928636b406e Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1f9ff652-9562-44c9-815d-a1de4e8b433e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Request method failure captured: Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments HTTP/1.1 Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 74 Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtT5H8XP7V9L0TVuuJvAuBoxNkhZhgX8XkK4-GpzHComWgmbBONfMudM4Q8yHeohsrOhf9YccVlwgfDyUGCChaGZWmGukZPYKh-mvkrZX3vZytXvdyVczNY7QyQ7kdcUBjknkaFKQkxOgdDbrstleWDjGVR0bmb658DtZfuMHYOhmds Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52ccbe7e63ab48199790f4676bbf2580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2be49f7bea7a4c8fbf289594e635fd69 Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: {"volumeAttachment": {"volumeId": "ee7b6e93-7066-495c-9dcc-f7e12e2a84f3"}} Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid volume: volume ee7b6e93-7066-495c-9dcc-f7e12e2a84f3 is already attached to instances: 83449394-d485-488c-853e-d928636b406e Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'server_id': '83449394-d485-488c-853e-d928636b406e', 'body': {'volumeAttachment': {'volumeId': 'ee7b6e93-7066-495c-9dcc-f7e12e2a84f3'}}} Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ee7b6e93-7066-495c-9dcc-f7e12e2a84f3 is already attached to instances: 83449394-d485-488c-853e-d928636b406e Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:04:09.191852 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ee7b6e93-7066-495c-9dcc-f7e12e2a84f3 is already attached to instances: 83449394-d485-488c-853e-d928636b406e Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ee7b6e93-7066-495c-9dcc-f7e12e2a84f3 is already attached to instances: 83449394-d485-488c-853e-d928636b406e Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1f9ff652-9562-44c9-815d-a1de4e8b433e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Returning 400 to user: Invalid volume: volume ee7b6e93-7066-495c-9dcc-f7e12e2a84f3 is already attached to instances: 83449394-d485-488c-853e-d928636b406e {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:09.196529 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1f9ff652-9562-44c9-815d-a1de4e8b433e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "POST /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.172524 Oct 27 19:04:09.206582 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2108/4024] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:04:09 2022] POST /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments => generated 174 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:04:09.234834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-19dc44bc-c8ae-4427-8660-24288524c111 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:09.234834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-19dc44bc-c8ae-4427-8660-24288524c111 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:09.250051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-19dc44bc-c8ae-4427-8660-24288524c111 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:09.250974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-19dc44bc-c8ae-4427-8660-24288524c111 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:09.252467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-19dc44bc-c8ae-4427-8660-24288524c111 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:09.253560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-19dc44bc-c8ae-4427-8660-24288524c111 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:09.259803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-19dc44bc-c8ae-4427-8660-24288524c111 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:09.260528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-19dc44bc-c8ae-4427-8660-24288524c111 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:09.319693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-927ae217-25ea-4a7f-9b5b-f64ca6f6bbd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:09.320809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-927ae217-25ea-4a7f-9b5b-f64ca6f6bbd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:09.334221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927ae217-25ea-4a7f-9b5b-f64ca6f6bbd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:09.335068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927ae217-25ea-4a7f-9b5b-f64ca6f6bbd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:09.335535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927ae217-25ea-4a7f-9b5b-f64ca6f6bbd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:09.336247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927ae217-25ea-4a7f-9b5b-f64ca6f6bbd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:09.336704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927ae217-25ea-4a7f-9b5b-f64ca6f6bbd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:09.343471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927ae217-25ea-4a7f-9b5b-f64ca6f6bbd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:09.548827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-927ae217-25ea-4a7f-9b5b-f64ca6f6bbd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lazy-loading 'services' on Instance uuid 83449394-d485-488c-853e-d928636b406e {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:04:09.734257 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-927ae217-25ea-4a7f-9b5b-f64ca6f6bbd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments/ee7b6e93-7066-495c-9dcc-f7e12e2a84f3" status: 202 len: 0 microversion: 2.1 time: 0.417901 Oct 27 19:04:09.738606 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2109/4025] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:04:09 2022] DELETE /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments/ee7b6e93-7066-495c-9dcc-f7e12e2a84f3 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:04:09.761698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ca983160-c96b-4acc-897e-a8c1de280a7e req-b455032f-536a-4420-b012-47582582beac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ccfdb33-58dd-46ff-b9f7-c945ab79deab", "name": "network-vif-deleted", "tag": "6d255296-6aa7-422d-a38c-91931d6bc22e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:09.768658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-19dc44bc-c8ae-4427-8660-24288524c111 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:09.784016 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-19dc44bc-c8ae-4427-8660-24288524c111 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 200 len: 1321 microversion: 2.1 time: 0.554178 Oct 27 19:04:09.784016 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1917/4026] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:09 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 1321 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:09.799484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4adaa336-9820-49d2-b13b-b5eb7cebda68 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:09.800515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4adaa336-9820-49d2-b13b-b5eb7cebda68 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:09.807716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ca983160-c96b-4acc-897e-a8c1de280a7e req-b455032f-536a-4420-b012-47582582beac service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:09.808561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ca983160-c96b-4acc-897e-a8c1de280a7e req-b455032f-536a-4420-b012-47582582beac service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:09.808678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4adaa336-9820-49d2-b13b-b5eb7cebda68 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:09.809187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4adaa336-9820-49d2-b13b-b5eb7cebda68 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:09.809643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4adaa336-9820-49d2-b13b-b5eb7cebda68 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:09.809891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ca983160-c96b-4acc-897e-a8c1de280a7e req-b455032f-536a-4420-b012-47582582beac service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:09.810359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4adaa336-9820-49d2-b13b-b5eb7cebda68 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:09.816047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4adaa336-9820-49d2-b13b-b5eb7cebda68 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:09.816528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4adaa336-9820-49d2-b13b-b5eb7cebda68 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:09.825648 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ca983160-c96b-4acc-897e-a8c1de280a7e req-b455032f-536a-4420-b012-47582582beac service nova] Creating event network-vif-deleted:6d255296-6aa7-422d-a38c-91931d6bc22e for instance 2ccfdb33-58dd-46ff-b9f7-c945ab79deab on n-h2-860687-3 Oct 27 19:04:09.851543 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ca983160-c96b-4acc-897e-a8c1de280a7e req-b455032f-536a-4420-b012-47582582beac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103999 Oct 27 19:04:09.857289 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2110/4027] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:09.864012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-723ec582-ae55-4c58-8072-a00e6200538d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:09.867516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-723ec582-ae55-4c58-8072-a00e6200538d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:09.885137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723ec582-ae55-4c58-8072-a00e6200538d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:09.885849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723ec582-ae55-4c58-8072-a00e6200538d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:09.888995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723ec582-ae55-4c58-8072-a00e6200538d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:09.889899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723ec582-ae55-4c58-8072-a00e6200538d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:09.890490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723ec582-ae55-4c58-8072-a00e6200538d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:09.893281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723ec582-ae55-4c58-8072-a00e6200538d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:09.902836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4adaa336-9820-49d2-b13b-b5eb7cebda68 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:09.903339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4adaa336-9820-49d2-b13b-b5eb7cebda68 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:09.903792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4adaa336-9820-49d2-b13b-b5eb7cebda68 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:09.904263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-4adaa336-9820-49d2-b13b-b5eb7cebda68 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lazy-loading 'fault' on Instance uuid 2ccfdb33-58dd-46ff-b9f7-c945ab79deab {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:04:09.950825 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-723ec582-ae55-4c58-8072-a00e6200538d tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091978 Oct 27 19:04:09.951778 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2111/4028] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:09 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:09.962633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c2062ea2-10d0-4118-b245-35fcebb568d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:09.972801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c2062ea2-10d0-4118-b245-35fcebb568d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:09.990713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2062ea2-10d0-4118-b245-35fcebb568d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:09.991610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2062ea2-10d0-4118-b245-35fcebb568d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:09.992255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2062ea2-10d0-4118-b245-35fcebb568d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:09.993220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2062ea2-10d0-4118-b245-35fcebb568d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:09.994268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2062ea2-10d0-4118-b245-35fcebb568d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:09.995591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2062ea2-10d0-4118-b245-35fcebb568d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:10.039397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4adaa336-9820-49d2-b13b-b5eb7cebda68 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f9579efc194f4c8f9d02d4c21867d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4f98a2b116433bb88cc3541ea44f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:10.049003 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4adaa336-9820-49d2-b13b-b5eb7cebda68 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 200 len: 1315 microversion: 2.1 time: 0.264712 Oct 27 19:04:10.063312 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1918/4029] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:09 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:10.213888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c2062ea2-10d0-4118-b245-35fcebb568d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:10.223176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c2062ea2-10d0-4118-b245-35fcebb568d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:10.225323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c2062ea2-10d0-4118-b245-35fcebb568d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:10.226612 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c2062ea2-10d0-4118-b245-35fcebb568d9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1721 microversion: 2.20 time: 0.273522 Oct 27 19:04:10.227913 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2112/4030] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:09 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:10.602748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-901a9c9a-9416-4b6e-b5d5-9859d50b389f req-a8fdd0f4-7dcf-403b-b480-3f43058ad299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dac382c-7cdf-44b2-af5e-dc8f459aabec", "tag": "74e4c9fb-ab89-47fe-aed1-8a3504bf6d35"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:10.636641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-901a9c9a-9416-4b6e-b5d5-9859d50b389f req-a8fdd0f4-7dcf-403b-b480-3f43058ad299 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:10.637309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-901a9c9a-9416-4b6e-b5d5-9859d50b389f req-a8fdd0f4-7dcf-403b-b480-3f43058ad299 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:10.637981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-901a9c9a-9416-4b6e-b5d5-9859d50b389f req-a8fdd0f4-7dcf-403b-b480-3f43058ad299 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:10.693610 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-901a9c9a-9416-4b6e-b5d5-9859d50b389f req-a8fdd0f4-7dcf-403b-b480-3f43058ad299 service nova] Creating event network-changed:74e4c9fb-ab89-47fe-aed1-8a3504bf6d35 for instance 7dac382c-7cdf-44b2-af5e-dc8f459aabec on n-h1-860687-3 Oct 27 19:04:10.705683 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-901a9c9a-9416-4b6e-b5d5-9859d50b389f req-a8fdd0f4-7dcf-403b-b480-3f43058ad299 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106785 Oct 27 19:04:10.706301 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1919/4031] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:10.807368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ad75831c-d3cb-4c20-80fc-4d8428b4013a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:10.808154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ad75831c-d3cb-4c20-80fc-4d8428b4013a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:10.818686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad75831c-d3cb-4c20-80fc-4d8428b4013a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:10.823171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad75831c-d3cb-4c20-80fc-4d8428b4013a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:10.823941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad75831c-d3cb-4c20-80fc-4d8428b4013a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:10.824917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad75831c-d3cb-4c20-80fc-4d8428b4013a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:10.826775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad75831c-d3cb-4c20-80fc-4d8428b4013a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:10.827469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad75831c-d3cb-4c20-80fc-4d8428b4013a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:10.835311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:10.968135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-82b682c5-ff09-4ee5-b295-261820e7051b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:10.970967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-82b682c5-ff09-4ee5-b295-261820e7051b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:10.985086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82b682c5-ff09-4ee5-b295-261820e7051b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:10.985610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82b682c5-ff09-4ee5-b295-261820e7051b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:10.986084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82b682c5-ff09-4ee5-b295-261820e7051b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:10.986868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82b682c5-ff09-4ee5-b295-261820e7051b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:10.987333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82b682c5-ff09-4ee5-b295-261820e7051b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:10.988148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82b682c5-ff09-4ee5-b295-261820e7051b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:11.050982 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-82b682c5-ff09-4ee5-b295-261820e7051b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087440 Oct 27 19:04:11.051887 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1920/4032] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:10 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:11.077168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-909caa81-0c30-4fc0-9fb1-57365df1f979 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:11.077696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-909caa81-0c30-4fc0-9fb1-57365df1f979 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2ccfdb33-58dd-46ff-b9f7-c945ab79deab] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:11.095284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-909caa81-0c30-4fc0-9fb1-57365df1f979 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:11.096387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-909caa81-0c30-4fc0-9fb1-57365df1f979 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:11.097042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-909caa81-0c30-4fc0-9fb1-57365df1f979 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:11.097965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-909caa81-0c30-4fc0-9fb1-57365df1f979 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:11.098730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-909caa81-0c30-4fc0-9fb1-57365df1f979 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:11.100082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-909caa81-0c30-4fc0-9fb1-57365df1f979 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:11.116893 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-909caa81-0c30-4fc0-9fb1-57365df1f979 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] HTTP exception thrown: Instance 2ccfdb33-58dd-46ff-b9f7-c945ab79deab could not be found. Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-909caa81-0c30-4fc0-9fb1-57365df1f979 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Request method failure captured: Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab HTTP/1.1 Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtXIBO-oIT-HYTB2aEriLPPQy4zwsnSlx9DGo1owgDeViDL8xz9gdgxBZ6h4yaNReHUFDpmMjxtiWf7mVDXaedJvOc8Qwc8zJEa7KWRfdPMYJLUDfqmLkDFiFu3cWColj_-lSB8MMmJyxn24nK4fQdr9h8etZXRJSRnN6iLr8tUpzOk Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d4f98a2b116433bb88cc3541ea44f8b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: a4f9579efc194f4c8f9d02d4c21867d8 Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 2ccfdb33-58dd-46ff-b9f7-c945ab79deab could not be found. Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '2ccfdb33-58dd-46ff-b9f7-c945ab79deab'} Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ccfdb33-58dd-46ff-b9f7-c945ab79deab could not be found. Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ccfdb33-58dd-46ff-b9f7-c945ab79deab could not be found. Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.119036 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:11.123843 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.123843 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:11.123843 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:11.123843 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:11.123843 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:11.123843 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:11.123843 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ccfdb33-58dd-46ff-b9f7-c945ab79deab could not be found. Oct 27 19:04:11.123843 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.126223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-909caa81-0c30-4fc0-9fb1-57365df1f979 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Returning 404 to user: Instance 2ccfdb33-58dd-46ff-b9f7-c945ab79deab could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:11.127314 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-909caa81-0c30-4fc0-9fb1-57365df1f979 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab" status: 404 len: 111 microversion: 2.1 time: 0.055267 Oct 27 19:04:11.128402 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1921/4033] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:11 2022] GET /compute/v2.1/servers/2ccfdb33-58dd-46ff-b9f7-c945ab79deab => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:04:11.137654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b4ca53e8-0dd3-4b34-9ea1-97510ff537e7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '.version_select at 0x7fc869b00820>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:11.186824 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-b4ca53e8-0dd3-4b34-9ea1-97510ff537e7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] HTTP exception thrown: Image not found. Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b4ca53e8-0dd3-4b34-9ea1-97510ff537e7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Request method failure captured: Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/images/ac3120a0-cbb5-4bda-bbbd-72b22b260bb4 HTTP/1.1 Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtXIBO-oIT-HYTB2aEriLPPQy4zwsnSlx9DGo1owgDeViDL8xz9gdgxBZ6h4yaNReHUFDpmMjxtiWf7mVDXaedJvOc8Qwc8zJEa7KWRfdPMYJLUDfqmLkDFiFu3cWColj_-lSB8MMmJyxn24nK4fQdr9h8etZXRJSRnN6iLr8tUpzOk Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d4f98a2b116433bb88cc3541ea44f8b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: a4f9579efc194f4c8f9d02d4c21867d8 Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: exception: Image not found. Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'ac3120a0-cbb5-4bda-bbbd-72b22b260bb4'} Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ac3120a0-cbb5-4bda-bbbd-72b22b260bb4 to delete Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac3120a0-cbb5-4bda-bbbd-72b22b260bb4 could not be found. Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:11.188904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 19:04:11.194014 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.196632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b4ca53e8-0dd3-4b34-9ea1-97510ff537e7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Returning 404 to user: Image not found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:11.197676 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b4ca53e8-0dd3-4b34-9ea1-97510ff537e7 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "DELETE /compute/v2.1/images/ac3120a0-cbb5-4bda-bbbd-72b22b260bb4" status: 404 len: 62 microversion: 2.1 time: 0.064037 Oct 27 19:04:11.198858 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1922/4034] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:11 2022] DELETE /compute/v2.1/images/ac3120a0-cbb5-4bda-bbbd-72b22b260bb4 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:04:11.206887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3f82fa69-6391-4d84-bf7b-480b1f03f484 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:11.207676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3f82fa69-6391-4d84-bf7b-480b1f03f484 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:11.228538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f82fa69-6391-4d84-bf7b-480b1f03f484 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:11.229260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f82fa69-6391-4d84-bf7b-480b1f03f484 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:11.229881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f82fa69-6391-4d84-bf7b-480b1f03f484 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:11.230833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f82fa69-6391-4d84-bf7b-480b1f03f484 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:11.231482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f82fa69-6391-4d84-bf7b-480b1f03f484 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:11.232081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f82fa69-6391-4d84-bf7b-480b1f03f484 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:11.263990 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-3f82fa69-6391-4d84-bf7b-480b1f03f484 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] HTTP exception thrown: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3f82fa69-6391-4d84-bf7b-480b1f03f484 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Request method failure captured: Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def HTTP/1.1 Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtXIBO-oIT-HYTB2aEriLPPQy4zwsnSlx9DGo1owgDeViDL8xz9gdgxBZ6h4yaNReHUFDpmMjxtiWf7mVDXaedJvOc8Qwc8zJEa7KWRfdPMYJLUDfqmLkDFiFu3cWColj_-lSB8MMmJyxn24nK4fQdr9h8etZXRJSRnN6iLr8tUpzOk Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d4f98a2b116433bb88cc3541ea44f8b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: a4f9579efc194f4c8f9d02d4c21867d8 Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '7473ff5e-df54-4fe1-ad84-88acc1fe0def'} Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:04:11.265865 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:04:11.270230 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:04:11.270230 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.270230 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:11.270230 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.270230 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:11.270230 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:11.270230 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:11.270230 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:11.270230 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:11.270230 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:04:11.270230 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.272511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3f82fa69-6391-4d84-bf7b-480b1f03f484 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Returning 404 to user: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:11.273576 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3f82fa69-6391-4d84-bf7b-480b1f03f484 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 404 len: 111 microversion: 2.1 time: 0.070692 Oct 27 19:04:11.282447 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1923/4035] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:04:11 2022] DELETE /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:04:11.290176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3c3049fc-4652-4a73-b025-fbcecdb5d5d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:11.291139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3c3049fc-4652-4a73-b025-fbcecdb5d5d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:11.303077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c3049fc-4652-4a73-b025-fbcecdb5d5d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:11.306868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c3049fc-4652-4a73-b025-fbcecdb5d5d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:11.308451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c3049fc-4652-4a73-b025-fbcecdb5d5d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:11.309418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c3049fc-4652-4a73-b025-fbcecdb5d5d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:11.312326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c3049fc-4652-4a73-b025-fbcecdb5d5d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:11.313007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c3049fc-4652-4a73-b025-fbcecdb5d5d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:11.430215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ad75831c-d3cb-4c20-80fc-4d8428b4013a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:11.441382 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ad75831c-d3cb-4c20-80fc-4d8428b4013a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 200 len: 1321 microversion: 2.1 time: 0.638104 Oct 27 19:04:11.455656 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2113/4036] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:10 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 1321 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:11.471504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e11afd99-12ee-4008-be3e-fa8c66cacb20 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:11.472856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e11afd99-12ee-4008-be3e-fa8c66cacb20 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 7473ff5e-df54-4fe1-ad84-88acc1fe0def] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:11.486526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e11afd99-12ee-4008-be3e-fa8c66cacb20 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:11.489133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e11afd99-12ee-4008-be3e-fa8c66cacb20 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:11.490289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e11afd99-12ee-4008-be3e-fa8c66cacb20 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:11.491315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e11afd99-12ee-4008-be3e-fa8c66cacb20 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:11.492825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e11afd99-12ee-4008-be3e-fa8c66cacb20 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:11.494706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e11afd99-12ee-4008-be3e-fa8c66cacb20 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:11.528912 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-e11afd99-12ee-4008-be3e-fa8c66cacb20 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] HTTP exception thrown: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e11afd99-12ee-4008-be3e-fa8c66cacb20 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Request method failure captured: Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def HTTP/1.1 Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtXIBO-oIT-HYTB2aEriLPPQy4zwsnSlx9DGo1owgDeViDL8xz9gdgxBZ6h4yaNReHUFDpmMjxtiWf7mVDXaedJvOc8Qwc8zJEa7KWRfdPMYJLUDfqmLkDFiFu3cWColj_-lSB8MMmJyxn24nK4fQdr9h8etZXRJSRnN6iLr8tUpzOk Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d4f98a2b116433bb88cc3541ea44f8b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a4f9579efc194f4c8f9d02d4c21867d8 Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '7473ff5e-df54-4fe1-ad84-88acc1fe0def'} Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.531146 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:11.534849 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.534849 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:11.534849 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:11.534849 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:11.534849 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:11.534849 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:11.534849 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. Oct 27 19:04:11.534849 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:11.540979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e11afd99-12ee-4008-be3e-fa8c66cacb20 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Returning 404 to user: Instance 7473ff5e-df54-4fe1-ad84-88acc1fe0def could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:11.546675 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e11afd99-12ee-4008-be3e-fa8c66cacb20 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def" status: 404 len: 111 microversion: 2.1 time: 0.089520 Oct 27 19:04:11.548042 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2114/4037] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:11 2022] GET /compute/v2.1/servers/7473ff5e-df54-4fe1-ad84-88acc1fe0def => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:04:11.571037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-627a7b67-7572-4122-8cde-376d10475a07 req-43430173-8641-40ef-91aa-d7620872fcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a7713a-b78d-425e-a6e8-0e4f5bc8904b", "name": "network-vif-unplugged", "status": "completed", "tag": "9f402fdb-d277-4b7a-b6cc-275f32214caf"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:11.608145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-627a7b67-7572-4122-8cde-376d10475a07 req-43430173-8641-40ef-91aa-d7620872fcd2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:11.611465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-627a7b67-7572-4122-8cde-376d10475a07 req-43430173-8641-40ef-91aa-d7620872fcd2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:11.612213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-627a7b67-7572-4122-8cde-376d10475a07 req-43430173-8641-40ef-91aa-d7620872fcd2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:11.651978 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-627a7b67-7572-4122-8cde-376d10475a07 req-43430173-8641-40ef-91aa-d7620872fcd2 service nova] Creating event network-vif-unplugged:9f402fdb-d277-4b7a-b6cc-275f32214caf for instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b on n-h2-860687-3 Oct 27 19:04:11.654132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3c3049fc-4652-4a73-b025-fbcecdb5d5d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:11.660354 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-627a7b67-7572-4122-8cde-376d10475a07 req-43430173-8641-40ef-91aa-d7620872fcd2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110721 Oct 27 19:04:11.662229 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2115/4038] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:11.669487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d952a7e5-0196-4112-8401-d82f9e9f99c0 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '.version_select at 0x7fc86a68f310>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:11.674814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3c3049fc-4652-4a73-b025-fbcecdb5d5d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:11.676817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3c3049fc-4652-4a73-b025-fbcecdb5d5d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:11.678510 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3c3049fc-4652-4a73-b025-fbcecdb5d5d1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1721 microversion: 2.20 time: 0.394797 Oct 27 19:04:11.679396 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1924/4039] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:11 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1721 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:11.714896 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d952a7e5-0196-4112-8401-d82f9e9f99c0 tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221579010" status: 202 len: 0 microversion: 2.1 time: 0.050920 Oct 27 19:04:11.716539 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2116/4040] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 19:04:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221579010 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:04:12.065220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03632d80-28df-4937-81d8-ca679159dbb1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:12.068910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-03632d80-28df-4937-81d8-ca679159dbb1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:12.082170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03632d80-28df-4937-81d8-ca679159dbb1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:12.083039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03632d80-28df-4937-81d8-ca679159dbb1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:12.084450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03632d80-28df-4937-81d8-ca679159dbb1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:12.085462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03632d80-28df-4937-81d8-ca679159dbb1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:12.086086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03632d80-28df-4937-81d8-ca679159dbb1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:12.086726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03632d80-28df-4937-81d8-ca679159dbb1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:12.135294 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-03632d80-28df-4937-81d8-ca679159dbb1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074864 Oct 27 19:04:12.137197 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1925/4041] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:12 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:12.479602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5bc56db3-6fe5-42c2-8690-0a65603d2411 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:12.480925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5bc56db3-6fe5-42c2-8690-0a65603d2411 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:12.494890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bc56db3-6fe5-42c2-8690-0a65603d2411 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:12.495696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bc56db3-6fe5-42c2-8690-0a65603d2411 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:12.496462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bc56db3-6fe5-42c2-8690-0a65603d2411 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:12.497380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bc56db3-6fe5-42c2-8690-0a65603d2411 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:12.498208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bc56db3-6fe5-42c2-8690-0a65603d2411 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:12.499185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bc56db3-6fe5-42c2-8690-0a65603d2411 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:12.707845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bcf7f558-e570-457d-9fa5-35374db510b7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:12.708983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bcf7f558-e570-457d-9fa5-35374db510b7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:12.720734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcf7f558-e570-457d-9fa5-35374db510b7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:12.723397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcf7f558-e570-457d-9fa5-35374db510b7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:12.724693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcf7f558-e570-457d-9fa5-35374db510b7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:12.732366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcf7f558-e570-457d-9fa5-35374db510b7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:12.733338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcf7f558-e570-457d-9fa5-35374db510b7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:12.734012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcf7f558-e570-457d-9fa5-35374db510b7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:12.938418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bcf7f558-e570-457d-9fa5-35374db510b7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:12.966773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bcf7f558-e570-457d-9fa5-35374db510b7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:12.969054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bcf7f558-e570-457d-9fa5-35374db510b7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:12.971146 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bcf7f558-e570-457d-9fa5-35374db510b7 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 200 len: 1654 microversion: 2.20 time: 0.267152 Oct 27 19:04:12.974873 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1926/4042] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:12 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 1654 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:13.037305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-aac057be-fedc-40b6-8442-5893b41679c1 req-c401a8c6-0e58-4474-8317-01525942b407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a7713a-b78d-425e-a6e8-0e4f5bc8904b", "name": "network-vif-deleted", "tag": "9f402fdb-d277-4b7a-b6cc-275f32214caf"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:13.054919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-aac057be-fedc-40b6-8442-5893b41679c1 req-c401a8c6-0e58-4474-8317-01525942b407 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:13.055442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-aac057be-fedc-40b6-8442-5893b41679c1 req-c401a8c6-0e58-4474-8317-01525942b407 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:13.055896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-aac057be-fedc-40b6-8442-5893b41679c1 req-c401a8c6-0e58-4474-8317-01525942b407 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:13.085063 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-aac057be-fedc-40b6-8442-5893b41679c1 req-c401a8c6-0e58-4474-8317-01525942b407 service nova] Creating event network-vif-deleted:9f402fdb-d277-4b7a-b6cc-275f32214caf for instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b on n-h2-860687-3 Oct 27 19:04:13.095288 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-aac057be-fedc-40b6-8442-5893b41679c1 req-c401a8c6-0e58-4474-8317-01525942b407 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061756 Oct 27 19:04:13.096455 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1927/4043] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:04:13.150767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5db34b13-6b02-4657-9ce3-496f424f9e53 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:13.153398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5db34b13-6b02-4657-9ce3-496f424f9e53 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:13.168530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5db34b13-6b02-4657-9ce3-496f424f9e53 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:13.169356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5db34b13-6b02-4657-9ce3-496f424f9e53 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:13.169977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5db34b13-6b02-4657-9ce3-496f424f9e53 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:13.170916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5db34b13-6b02-4657-9ce3-496f424f9e53 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:13.173816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5db34b13-6b02-4657-9ce3-496f424f9e53 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:13.174642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5db34b13-6b02-4657-9ce3-496f424f9e53 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:13.180925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5bc56db3-6fe5-42c2-8690-0a65603d2411 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:13.213555 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5bc56db3-6fe5-42c2-8690-0a65603d2411 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 200 len: 1321 microversion: 2.1 time: 0.738019 Oct 27 19:04:13.215439 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2117/4044] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:12 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 1321 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:13.237450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-87970a29-70d8-49f4-b723-1dc50fc749af tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '.version_select at 0x7fc86a89aa60>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:13.251868 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5db34b13-6b02-4657-9ce3-496f424f9e53 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105948 Oct 27 19:04:13.258260 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1928/4045] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:13 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:13.277270 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-87970a29-70d8-49f4-b723-1dc50fc749af tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] HTTP exception thrown: Image not found. Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-87970a29-70d8-49f4-b723-1dc50fc749af tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Request method failure captured: Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/images/2a6d60e0-6b81-4288-bb98-91c5bc7f0466 HTTP/1.1 Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtXIBO-oIT-HYTB2aEriLPPQy4zwsnSlx9DGo1owgDeViDL8xz9gdgxBZ6h4yaNReHUFDpmMjxtiWf7mVDXaedJvOc8Qwc8zJEa7KWRfdPMYJLUDfqmLkDFiFu3cWColj_-lSB8MMmJyxn24nK4fQdr9h8etZXRJSRnN6iLr8tUpzOk Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d4f98a2b116433bb88cc3541ea44f8b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a4f9579efc194f4c8f9d02d4c21867d8 Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: method: Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: exception: Image not found. Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '2a6d60e0-6b81-4288-bb98-91c5bc7f0466'} Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2a6d60e0-6b81-4288-bb98-91c5bc7f0466 to delete Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2a6d60e0-6b81-4288-bb98-91c5bc7f0466 could not be found. Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:13.279308 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-87970a29-70d8-49f4-b723-1dc50fc749af tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Returning 404 to user: Image not found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-87970a29-70d8-49f4-b723-1dc50fc749af tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "DELETE /compute/v2.1/images/2a6d60e0-6b81-4288-bb98-91c5bc7f0466" status: 404 len: 62 microversion: 2.1 time: 0.048279 Oct 27 19:04:13.283350 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2118/4046] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:13 2022] DELETE /compute/v2.1/images/2a6d60e0-6b81-4288-bb98-91c5bc7f0466 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 19:04:13.292562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7ee736a4-ba8d-4940-a6e0-e16ec9dcc8cc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:13.293120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7ee736a4-ba8d-4940-a6e0-e16ec9dcc8cc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:13.307299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ee736a4-ba8d-4940-a6e0-e16ec9dcc8cc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:13.307821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ee736a4-ba8d-4940-a6e0-e16ec9dcc8cc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:13.308282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ee736a4-ba8d-4940-a6e0-e16ec9dcc8cc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:13.309023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ee736a4-ba8d-4940-a6e0-e16ec9dcc8cc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:13.314854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ee736a4-ba8d-4940-a6e0-e16ec9dcc8cc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:13.315487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ee736a4-ba8d-4940-a6e0-e16ec9dcc8cc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:13.352002 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-7ee736a4-ba8d-4940-a6e0-e16ec9dcc8cc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] HTTP exception thrown: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7ee736a4-ba8d-4940-a6e0-e16ec9dcc8cc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Request method failure captured: Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 HTTP/1.1 Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtXIBO-oIT-HYTB2aEriLPPQy4zwsnSlx9DGo1owgDeViDL8xz9gdgxBZ6h4yaNReHUFDpmMjxtiWf7mVDXaedJvOc8Qwc8zJEa7KWRfdPMYJLUDfqmLkDFiFu3cWColj_-lSB8MMmJyxn24nK4fQdr9h8etZXRJSRnN6iLr8tUpzOk Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d4f98a2b116433bb88cc3541ea44f8b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: a4f9579efc194f4c8f9d02d4c21867d8 Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '2a809542-e7e8-400f-9493-fb9869b28927'} Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:04:13.354173 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:04:13.358231 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:04:13.358231 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.358231 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:13.358231 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.358231 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:13.358231 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:13.358231 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:13.358231 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:13.358231 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:13.358231 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:04:13.358231 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.360793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7ee736a4-ba8d-4940-a6e0-e16ec9dcc8cc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Returning 404 to user: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:13.361880 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7ee736a4-ba8d-4940-a6e0-e16ec9dcc8cc tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 404 len: 111 microversion: 2.1 time: 0.075673 Oct 27 19:04:13.372000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42c9cd67-6446-40dd-bd2e-15ec2de6cc9b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:13.373003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-42c9cd67-6446-40dd-bd2e-15ec2de6cc9b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] [instance: 2a809542-e7e8-400f-9493-fb9869b28927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:13.377590 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1929/4047] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:04:13 2022] DELETE /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:04:13.383918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c9cd67-6446-40dd-bd2e-15ec2de6cc9b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:13.386985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c9cd67-6446-40dd-bd2e-15ec2de6cc9b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:13.388081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c9cd67-6446-40dd-bd2e-15ec2de6cc9b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:13.391598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c9cd67-6446-40dd-bd2e-15ec2de6cc9b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:13.393308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c9cd67-6446-40dd-bd2e-15ec2de6cc9b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:13.393784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c9cd67-6446-40dd-bd2e-15ec2de6cc9b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:13.431672 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-42c9cd67-6446-40dd-bd2e-15ec2de6cc9b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] HTTP exception thrown: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42c9cd67-6446-40dd-bd2e-15ec2de6cc9b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Request method failure captured: Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 HTTP/1.1 Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtXIBO-oIT-HYTB2aEriLPPQy4zwsnSlx9DGo1owgDeViDL8xz9gdgxBZ6h4yaNReHUFDpmMjxtiWf7mVDXaedJvOc8Qwc8zJEa7KWRfdPMYJLUDfqmLkDFiFu3cWColj_-lSB8MMmJyxn24nK4fQdr9h8etZXRJSRnN6iLr8tUpzOk Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d4f98a2b116433bb88cc3541ea44f8b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d4f98a2b116433bb88cc3541ea44f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 7d4f98a2b116433bb88cc3541ea44f8b Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125 Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a4f9579efc194f4c8f9d02d4c21867d8 Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1273312125-project Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '2a809542-e7e8-400f-9493-fb9869b28927'} Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.437017 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:13.440728 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.440728 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:13.440728 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:13.440728 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:13.440728 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:13.440728 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:13.440728 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. Oct 27 19:04:13.440728 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:13.442973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42c9cd67-6446-40dd-bd2e-15ec2de6cc9b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] Returning 404 to user: Instance 2a809542-e7e8-400f-9493-fb9869b28927 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:13.444189 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-42c9cd67-6446-40dd-bd2e-15ec2de6cc9b tempest-ImagesOneServerNegativeTestJSON-1273312125 tempest-ImagesOneServerNegativeTestJSON-1273312125-project] 10.222.0.42 "GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927" status: 404 len: 111 microversion: 2.1 time: 0.076490 Oct 27 19:04:13.445286 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2119/4048] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:13 2022] GET /compute/v2.1/servers/2a809542-e7e8-400f-9493-fb9869b28927 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:04:14.001775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a2c9004f-c864-4027-9e5a-0c0847981c22 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:14.002503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a2c9004f-c864-4027-9e5a-0c0847981c22 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:14.026233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2c9004f-c864-4027-9e5a-0c0847981c22 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:14.029080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2c9004f-c864-4027-9e5a-0c0847981c22 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:14.030931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2c9004f-c864-4027-9e5a-0c0847981c22 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:14.034369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2c9004f-c864-4027-9e5a-0c0847981c22 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:14.038663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2c9004f-c864-4027-9e5a-0c0847981c22 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:14.039125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2c9004f-c864-4027-9e5a-0c0847981c22 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-a2c9004f-c864-4027-9e5a-0c0847981c22 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] HTTP exception thrown: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a2c9004f-c864-4027-9e5a-0c0847981c22 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Request method failure captured: Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b HTTP/1.1 Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtUUQyB6SOBVl-52U3dSziCl2YsU9ZgNNncrnhwIfxoSAofDzyZtVZEEpgkoaInknyIkrELp2G0Dir7G4OIR7s5DCkQnHvpSlonGokmFZL4OaHeeaiW_SVJEXEEBQj50879mm2-37qYzpjAgmfGPKFeq8vL_BkbLbyi352o1GqN2xk8 Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: ab4798756472413683fb46917781e89f Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab4798756472413683fb46917781e89f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab4798756472413683fb46917781e89f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab4798756472413683fb46917781e89f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab4798756472413683fb46917781e89f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: ab4798756472413683fb46917781e89f Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AttachVolumeShelveTestJSON-1562836379-project Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 434e7a9a50b340928126550ed66c5590 Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1562836379-project Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'f4a7713a-b78d-425e-a6e8-0e4f5bc8904b'} Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:04:14.094589 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a2c9004f-c864-4027-9e5a-0c0847981c22 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Returning 404 to user: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a2c9004f-c864-4027-9e5a-0c0847981c22 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 404 len: 111 microversion: 2.20 time: 0.100822 Oct 27 19:04:14.098113 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1930/4049] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:13 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:04:14.107358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f665e344-cfb3-4033-a53f-4cbd45aeb20e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '.version_select at 0x7fc869ff7430>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:14.157737 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f665e344-cfb3-4033-a53f-4cbd45aeb20e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-390191596" status: 204 len: 0 microversion: 2.20 time: 0.053970 Oct 27 19:04:14.162007 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2120/4050] 10.222.0.42 () {60 vars in 1259 bytes} [Thu Oct 27 19:04:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-390191596 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:04:14.246359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-be422e9c-be70-4cdc-8725-14c6bafdf663 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:14.254587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-be422e9c-be70-4cdc-8725-14c6bafdf663 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:14.265442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d3ef5526-d282-4757-a59e-c343e6d3cdd9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:14.273680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d3ef5526-d282-4757-a59e-c343e6d3cdd9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:14.275182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be422e9c-be70-4cdc-8725-14c6bafdf663 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:14.284449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be422e9c-be70-4cdc-8725-14c6bafdf663 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:14.285636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be422e9c-be70-4cdc-8725-14c6bafdf663 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:14.287452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ef5526-d282-4757-a59e-c343e6d3cdd9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:14.288839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be422e9c-be70-4cdc-8725-14c6bafdf663 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:14.289480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be422e9c-be70-4cdc-8725-14c6bafdf663 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:14.289781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ef5526-d282-4757-a59e-c343e6d3cdd9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:14.290476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ef5526-d282-4757-a59e-c343e6d3cdd9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:14.291017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be422e9c-be70-4cdc-8725-14c6bafdf663 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:14.291166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ef5526-d282-4757-a59e-c343e6d3cdd9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:14.291641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ef5526-d282-4757-a59e-c343e6d3cdd9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:14.294978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ef5526-d282-4757-a59e-c343e6d3cdd9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:14.365955 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d3ef5526-d282-4757-a59e-c343e6d3cdd9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104644 Oct 27 19:04:14.369311 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2121/4051] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:14 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:04:14.659856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-be422e9c-be70-4cdc-8725-14c6bafdf663 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:14.686656 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-be422e9c-be70-4cdc-8725-14c6bafdf663 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 200 len: 1321 microversion: 2.1 time: 0.445395 Oct 27 19:04:14.710500 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1931/4052] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:14 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:15.382945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13114d4d-fcb6-44a5-a5cf-335d58953b81 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:15.386271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-13114d4d-fcb6-44a5-a5cf-335d58953b81 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:15.414916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13114d4d-fcb6-44a5-a5cf-335d58953b81 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:15.422903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13114d4d-fcb6-44a5-a5cf-335d58953b81 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:15.423379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13114d4d-fcb6-44a5-a5cf-335d58953b81 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:15.424140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13114d4d-fcb6-44a5-a5cf-335d58953b81 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:15.424782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13114d4d-fcb6-44a5-a5cf-335d58953b81 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:15.425658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13114d4d-fcb6-44a5-a5cf-335d58953b81 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:15.513134 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13114d4d-fcb6-44a5-a5cf-335d58953b81 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133823 Oct 27 19:04:15.521824 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2122/4053] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:15 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:15.712615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dc01bce4-7710-4e34-8773-34ce3e35d79a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:15.713234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dc01bce4-7710-4e34-8773-34ce3e35d79a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:15.717548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:15.718291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:15.747388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc01bce4-7710-4e34-8773-34ce3e35d79a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:15.751029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc01bce4-7710-4e34-8773-34ce3e35d79a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:15.751948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc01bce4-7710-4e34-8773-34ce3e35d79a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:15.754418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc01bce4-7710-4e34-8773-34ce3e35d79a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:15.755938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc01bce4-7710-4e34-8773-34ce3e35d79a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:15.760002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc01bce4-7710-4e34-8773-34ce3e35d79a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:16.184467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dc01bce4-7710-4e34-8773-34ce3e35d79a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:16.204809 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dc01bce4-7710-4e34-8773-34ce3e35d79a tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 200 len: 1321 microversion: 2.1 time: 0.497092 Oct 27 19:04:16.205624 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1932/4054] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:15 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 1321 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:04:16.517549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e2dc62f2-c7d5-43b9-988d-451d88e0e94a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Action: 'create', calling method: .version_select at 0x7fc86aa2ae50>, body: {"keypair": {"name": "tempest-keypair-1017511835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeHXISQ9XELoyusSd7NsmsrcIoOdCaY0JbXmsl6641+3GhOGG3wuSfjjey/uFf/kx21VHVDoJX3cdrcabDTHam9DtuH6baPAAVFIM4iLer29npjYO45AjuGr/pDBpkFMA=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:16.528437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1da46b44-3672-44e0-a351-d34ccf391180 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:16.530742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1da46b44-3672-44e0-a351-d34ccf391180 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:16.544654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=16,nova_cell0:UPDATE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:16.551392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1da46b44-3672-44e0-a351-d34ccf391180 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:16.553812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1da46b44-3672-44e0-a351-d34ccf391180 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:16.554273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1da46b44-3672-44e0-a351-d34ccf391180 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:16.555057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1da46b44-3672-44e0-a351-d34ccf391180 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:16.560822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1da46b44-3672-44e0-a351-d34ccf391180 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:16.561485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1da46b44-3672-44e0-a351-d34ccf391180 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:16.599997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-e2dc62f2-c7d5-43b9-988d-451d88e0e94a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Getting quotas for project ab4798756472413683fb46917781e89f. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:04:16.610953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-e2dc62f2-c7d5-43b9-988d-451d88e0e94a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Getting quotas for user 434e7a9a50b340928126550ed66c5590 and project ab4798756472413683fb46917781e89f. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:04:16.704927 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e2dc62f2-c7d5-43b9-988d-451d88e0e94a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.192324 Oct 27 19:04:16.709814 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2123/4055] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Oct 27 19:04:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 198 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 19:04:17.231865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9397950f-f58d-4ec0-bf81-de529ff201d4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:17.232753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9397950f-f58d-4ec0-bf81-de529ff201d4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:17.244283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9397950f-f58d-4ec0-bf81-de529ff201d4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:17.245041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9397950f-f58d-4ec0-bf81-de529ff201d4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:17.251207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9397950f-f58d-4ec0-bf81-de529ff201d4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:17.252488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9397950f-f58d-4ec0-bf81-de529ff201d4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:17.253194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9397950f-f58d-4ec0-bf81-de529ff201d4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:17.253860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9397950f-f58d-4ec0-bf81-de529ff201d4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:17.587831 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1da46b44-3672-44e0-a351-d34ccf391180 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 1.053181 Oct 27 19:04:17.589688 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1933/4056] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:16 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments => generated 197 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:18.250996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9397950f-f58d-4ec0-bf81-de529ff201d4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:18.295973 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9397950f-f58d-4ec0-bf81-de529ff201d4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 200 len: 1321 microversion: 2.1 time: 1.060718 Oct 27 19:04:18.318641 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2124/4057] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:17 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 1321 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:18.605478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-05e0384a-d9ff-4d00-b4dd-41a8e9269bb6 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:18.615205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-05e0384a-d9ff-4d00-b4dd-41a8e9269bb6 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:18.637941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05e0384a-d9ff-4d00-b4dd-41a8e9269bb6 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:18.640207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05e0384a-d9ff-4d00-b4dd-41a8e9269bb6 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:18.640949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05e0384a-d9ff-4d00-b4dd-41a8e9269bb6 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:18.646940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05e0384a-d9ff-4d00-b4dd-41a8e9269bb6 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:18.647620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05e0384a-d9ff-4d00-b4dd-41a8e9269bb6 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:18.649383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05e0384a-d9ff-4d00-b4dd-41a8e9269bb6 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:18.703819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-73d7f177-4812-4386-a897-017bbefb1e5e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:18.706199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-73d7f177-4812-4386-a897-017bbefb1e5e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:18.732498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73d7f177-4812-4386-a897-017bbefb1e5e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:18.737014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73d7f177-4812-4386-a897-017bbefb1e5e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:18.737480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73d7f177-4812-4386-a897-017bbefb1e5e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:18.743887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73d7f177-4812-4386-a897-017bbefb1e5e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:18.744409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73d7f177-4812-4386-a897-017bbefb1e5e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:18.744862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73d7f177-4812-4386-a897-017bbefb1e5e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:18.843175 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-05e0384a-d9ff-4d00-b4dd-41a8e9269bb6 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.242539 Oct 27 19:04:18.851857 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1934/4058] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:18 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments => generated 197 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:04:18.883308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-3052eed8-522d-400e-a933-8ef8f1e23376 req-7fc0b194-10fb-44bd-8624-e7b195f02486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dac382c-7cdf-44b2-af5e-dc8f459aabec", "name": "network-vif-plugged", "status": "completed", "tag": "74e4c9fb-ab89-47fe-aed1-8a3504bf6d35"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:18.960207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3052eed8-522d-400e-a933-8ef8f1e23376 req-7fc0b194-10fb-44bd-8624-e7b195f02486 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:18.961250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3052eed8-522d-400e-a933-8ef8f1e23376 req-7fc0b194-10fb-44bd-8624-e7b195f02486 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:18.962844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3052eed8-522d-400e-a933-8ef8f1e23376 req-7fc0b194-10fb-44bd-8624-e7b195f02486 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:19.015232 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-3052eed8-522d-400e-a933-8ef8f1e23376 req-7fc0b194-10fb-44bd-8624-e7b195f02486 service nova] Creating event network-vif-plugged:74e4c9fb-ab89-47fe-aed1-8a3504bf6d35 for instance 7dac382c-7cdf-44b2-af5e-dc8f459aabec on n-h1-860687-3 Oct 27 19:04:19.058140 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-3052eed8-522d-400e-a933-8ef8f1e23376 req-7fc0b194-10fb-44bd-8624-e7b195f02486 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198105 Oct 27 19:04:19.064057 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1935/4059] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:19.173003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-73d7f177-4812-4386-a897-017bbefb1e5e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lazy-loading 'services' on Instance uuid 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:04:19.329020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-61c827d8-dd6e-4204-9dd9-931f3e89971e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:19.331820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-61c827d8-dd6e-4204-9dd9-931f3e89971e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:19.353722 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-73d7f177-4812-4386-a897-017bbefb1e5e tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments/fc1635f3-5222-4072-893b-3c26884e3aa5" status: 202 len: 0 microversion: 2.1 time: 0.655606 Oct 27 19:04:19.360129 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2125/4060] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:04:18 2022] DELETE /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments/fc1635f3-5222-4072-893b-3c26884e3aa5 => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:04:19.364188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61c827d8-dd6e-4204-9dd9-931f3e89971e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:19.368925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61c827d8-dd6e-4204-9dd9-931f3e89971e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:19.371613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-709dbedb-9aea-49f0-be3c-cfc3da533181 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:19.372957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61c827d8-dd6e-4204-9dd9-931f3e89971e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:19.373853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61c827d8-dd6e-4204-9dd9-931f3e89971e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:19.374365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61c827d8-dd6e-4204-9dd9-931f3e89971e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:19.378697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61c827d8-dd6e-4204-9dd9-931f3e89971e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:19.382892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-709dbedb-9aea-49f0-be3c-cfc3da533181 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:19.390653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:19.411869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-709dbedb-9aea-49f0-be3c-cfc3da533181 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:19.413343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-709dbedb-9aea-49f0-be3c-cfc3da533181 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:19.414065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-709dbedb-9aea-49f0-be3c-cfc3da533181 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:19.415073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-709dbedb-9aea-49f0-be3c-cfc3da533181 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:19.415790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-709dbedb-9aea-49f0-be3c-cfc3da533181 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:19.416475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-709dbedb-9aea-49f0-be3c-cfc3da533181 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:19.499665 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-709dbedb-9aea-49f0-be3c-cfc3da533181 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135029 Oct 27 19:04:19.507829 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2126/4061] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:19 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:19.833497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-61c827d8-dd6e-4204-9dd9-931f3e89971e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:19.860347 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-61c827d8-dd6e-4204-9dd9-931f3e89971e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 200 len: 1321 microversion: 2.1 time: 0.538258 Oct 27 19:04:19.860937 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1936/4062] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:19 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 1321 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:19.864595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b48f4e87-fa68-430c-8ec3-9fdc051cc1d3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:19.866961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b48f4e87-fa68-430c-8ec3-9fdc051cc1d3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:19.873748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b48f4e87-fa68-430c-8ec3-9fdc051cc1d3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:19.874223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b48f4e87-fa68-430c-8ec3-9fdc051cc1d3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:19.889380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b48f4e87-fa68-430c-8ec3-9fdc051cc1d3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:19.890666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b48f4e87-fa68-430c-8ec3-9fdc051cc1d3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:19.891582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b48f4e87-fa68-430c-8ec3-9fdc051cc1d3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:19.892126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b48f4e87-fa68-430c-8ec3-9fdc051cc1d3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:19.939873 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b48f4e87-fa68-430c-8ec3-9fdc051cc1d3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082408 Oct 27 19:04:19.945945 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2127/4063] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:19 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:20.517593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c82aab6d-f7ec-4dca-acb7-038c5451d947 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:20.520248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c82aab6d-f7ec-4dca-acb7-038c5451d947 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:20.532328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c82aab6d-f7ec-4dca-acb7-038c5451d947 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:20.533749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c82aab6d-f7ec-4dca-acb7-038c5451d947 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:20.534288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c82aab6d-f7ec-4dca-acb7-038c5451d947 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:20.535082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c82aab6d-f7ec-4dca-acb7-038c5451d947 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:20.535671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c82aab6d-f7ec-4dca-acb7-038c5451d947 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:20.536014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c82aab6d-f7ec-4dca-acb7-038c5451d947 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:20.613544 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c82aab6d-f7ec-4dca-acb7-038c5451d947 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098949 Oct 27 19:04:20.616678 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1937/4064] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:20 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:20.888545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1bd04a68-e16d-4f53-b371-48650c9369df tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:20.889762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1bd04a68-e16d-4f53-b371-48650c9369df tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:20.911752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bd04a68-e16d-4f53-b371-48650c9369df tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:20.920385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bd04a68-e16d-4f53-b371-48650c9369df tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:20.921205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bd04a68-e16d-4f53-b371-48650c9369df tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:20.922213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bd04a68-e16d-4f53-b371-48650c9369df tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:20.922830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bd04a68-e16d-4f53-b371-48650c9369df tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:20.923523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bd04a68-e16d-4f53-b371-48650c9369df tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:20.953723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9df5e873-7986-42be-90fd-b065be9d9dd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:20.956046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9df5e873-7986-42be-90fd-b065be9d9dd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:20.969135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9df5e873-7986-42be-90fd-b065be9d9dd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:20.969641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9df5e873-7986-42be-90fd-b065be9d9dd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:20.970092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9df5e873-7986-42be-90fd-b065be9d9dd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:20.970845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9df5e873-7986-42be-90fd-b065be9d9dd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:20.971310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9df5e873-7986-42be-90fd-b065be9d9dd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:20.971748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9df5e873-7986-42be-90fd-b065be9d9dd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:21.091022 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9df5e873-7986-42be-90fd-b065be9d9dd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137421 Oct 27 19:04:21.095724 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1938/4065] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:20 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:21.134454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1bd04a68-e16d-4f53-b371-48650c9369df tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:21.143774 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1bd04a68-e16d-4f53-b371-48650c9369df tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 200 len: 1470 microversion: 2.1 time: 0.260344 Oct 27 19:04:21.146626 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2128/4066] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:20 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 1470 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:21.237674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1747622235", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0be16ab7-102f-4dbe-a96c-e35358c95fd1"}], "security_groups": [{"name": "tempest-securitygroup--1656288639"}], "key_name": "tempest-keypair-1017511835", "user_data": "}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:21.287255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-73108fbf-dc46-4468-88eb-9ad94fd941a5 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:21.287855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-73108fbf-dc46-4468-88eb-9ad94fd941a5 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] [instance: 3fda19fa-966a-4ff5-b6b4-5db412b6f54e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:21.300392 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-73108fbf-dc46-4468-88eb-9ad94fd941a5 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] HTTP exception thrown: Instance 3fda19fa-966a-4ff5-b6b4-5db412b6f54e could not be found. Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-73108fbf-dc46-4468-88eb-9ad94fd941a5 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Request method failure captured: Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/3fda19fa-966a-4ff5-b6b4-5db412b6f54e/action HTTP/1.1 Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 15 Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtYkVce5yyED_9m68n-P1QgKVLVxxcKV7oy5inEoJOAsb4PeWzsdc3PKjKBVEQHhuAAheKkT6uh5E0YJRo1ZdXd70NBogvl6hL9JefQVn2vu2EBcVcmrKrUABZ3Q6RlYXVnkRDyGP5wbCVonF6x-1aas3RqPK6ZC0t9D3xG4KJm9TgM Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: b00a200c78784e8b94b9ce1d9967f1c5 Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b00a200c78784e8b94b9ce1d9967f1c5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: b00a200c78784e8b94b9ce1d9967f1c5 Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersAdminNegativeTestJSON-2117974073-project-admin Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e0aedc2a3cf74860b23680057359888d Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2117974073-project-admin Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: {"migrate": {}} Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 3fda19fa-966a-4ff5-b6b4-5db412b6f54e could not be found. Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '3fda19fa-966a-4ff5-b6b4-5db412b6f54e', 'body': {'migrate': {}}} Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fda19fa-966a-4ff5-b6b4-5db412b6f54e could not be found. Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fda19fa-966a-4ff5-b6b4-5db412b6f54e could not be found. Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:21.308021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:21.311972 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:21.311972 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:21.311972 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:21.311972 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:21.311972 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fda19fa-966a-4ff5-b6b4-5db412b6f54e could not be found. Oct 27 19:04:21.311972 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:21.313574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-73108fbf-dc46-4468-88eb-9ad94fd941a5 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Returning 404 to user: Instance 3fda19fa-966a-4ff5-b6b4-5db412b6f54e could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:21.315269 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-73108fbf-dc46-4468-88eb-9ad94fd941a5 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/3fda19fa-966a-4ff5-b6b4-5db412b6f54e/action" status: 404 len: 111 microversion: 2.1 time: 0.147671 Oct 27 19:04:21.326209 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1939/4067] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:04:21 2022] POST /compute/v2.1/servers/3fda19fa-966a-4ff5-b6b4-5db412b6f54e/action => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:04:21.375627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-23484331", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:21.453580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] validate_networks() for [('0be16ab7-102f-4dbe-a96c-e35358c95fd1', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:04:21.460269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:04:21.916581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:04:21.917012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:04:21.917878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:04:21.918485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:04:21.919023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:04:21.919471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:04:21.919785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:04:21.919944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:04:21.920814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:04:21.921254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:04:21.932854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:21.933919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:21.934655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:21.935687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:21.936306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:21.936936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:21.937059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:21.937543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:21.942937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:21.943849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:21.944514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:21.945119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:21.957485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=89,nova_api:UPDATE=7,nova_api:DELETE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:21.965031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Getting quotas for project ab4798756472413683fb46917781e89f. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:04:21.967100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Getting quotas for project 205376348cc54a0aaa4e6c16ba2a86c3. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:04:21.973994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Getting quotas for user 9a92df7118a54f49bc7c623b4451e498 and project 205376348cc54a0aaa4e6c16ba2a86c3. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:04:21.976184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Getting quotas for user 434e7a9a50b340928126550ed66c5590 and project ab4798756472413683fb46917781e89f. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:04:21.988114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:04:21.991918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:04:21.995315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:04:21.997685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:04:22.079405 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-374a1740-1df4-427d-b72b-da81262a165b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708328 Oct 27 19:04:22.079636 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-306b6532-a803-4a31-bdb7-47ec0f268638 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.846204 Oct 27 19:04:22.086558 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2129/4068] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 19:04:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 27 19:04:22.086558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b6ac6d7b-47ad-4ea6-9fbb-b23dd1f7513d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:22.088023 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1940/4069] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:04:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 19:04:22.088319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b6ac6d7b-47ad-4ea6-9fbb-b23dd1f7513d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:22.095518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6ac6d7b-47ad-4ea6-9fbb-b23dd1f7513d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:22.096031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6ac6d7b-47ad-4ea6-9fbb-b23dd1f7513d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:22.096671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6ac6d7b-47ad-4ea6-9fbb-b23dd1f7513d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:22.097562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6ac6d7b-47ad-4ea6-9fbb-b23dd1f7513d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:22.098434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6ac6d7b-47ad-4ea6-9fbb-b23dd1f7513d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:22.099890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e12402f2-89fa-4139-8d7b-fd4c95b76c62 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:22.100099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6ac6d7b-47ad-4ea6-9fbb-b23dd1f7513d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:22.100651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e12402f2-89fa-4139-8d7b-fd4c95b76c62 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:22.138423 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b6ac6d7b-47ad-4ea6-9fbb-b23dd1f7513d tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056521 Oct 27 19:04:22.139259 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2130/4070] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:22 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:22.144510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-747d1451-ea09-40dd-9d22-a8b4774e82cd tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:22.145393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-747d1451-ea09-40dd-9d22-a8b4774e82cd tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:22.217389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-747d1451-ea09-40dd-9d22-a8b4774e82cd tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:22.227010 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-747d1451-ea09-40dd-9d22-a8b4774e82cd tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1220 microversion: 2.1 time: 0.086525 Oct 27 19:04:22.228523 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2131/4071] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:22 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:22.234705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7f59ae95-c106-4839-ba5c-6da367d05052 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:22.237351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7f59ae95-c106-4839-ba5c-6da367d05052 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:22.245704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f59ae95-c106-4839-ba5c-6da367d05052 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:22.246494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f59ae95-c106-4839-ba5c-6da367d05052 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:22.247476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f59ae95-c106-4839-ba5c-6da367d05052 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:22.248455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f59ae95-c106-4839-ba5c-6da367d05052 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:22.249078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f59ae95-c106-4839-ba5c-6da367d05052 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:22.249673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f59ae95-c106-4839-ba5c-6da367d05052 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:22.300624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e12402f2-89fa-4139-8d7b-fd4c95b76c62 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:22.303844 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7f59ae95-c106-4839-ba5c-6da367d05052 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074084 Oct 27 19:04:22.304800 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2132/4072] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:22 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:22.316584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e12402f2-89fa-4139-8d7b-fd4c95b76c62 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:22.318671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e12402f2-89fa-4139-8d7b-fd4c95b76c62 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:22.320091 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e12402f2-89fa-4139-8d7b-fd4c95b76c62 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1282 microversion: 2.20 time: 0.230571 Oct 27 19:04:22.352474 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1941/4073] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:22 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1282 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:22.484344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0ce4449f-b467-4264-9e0e-1dcf118a8cec tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:22.484911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0ce4449f-b467-4264-9e0e-1dcf118a8cec tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:22.507576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ce4449f-b467-4264-9e0e-1dcf118a8cec tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:22.511466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ce4449f-b467-4264-9e0e-1dcf118a8cec tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:22.512265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ce4449f-b467-4264-9e0e-1dcf118a8cec tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:22.515557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ce4449f-b467-4264-9e0e-1dcf118a8cec tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:22.516089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ce4449f-b467-4264-9e0e-1dcf118a8cec tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:22.525351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ce4449f-b467-4264-9e0e-1dcf118a8cec tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:22.872363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-0ce4449f-b467-4264-9e0e-1dcf118a8cec tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lazy-loading 'services' on Instance uuid e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:04:23.102815 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0ce4449f-b467-4264-9e0e-1dcf118a8cec tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55/os-volume_attachments/d128941f-db55-4d3d-87da-56ac9b995897" status: 202 len: 0 microversion: 2.1 time: 0.623686 Oct 27 19:04:23.106854 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2133/4074] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:04:22 2022] DELETE /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55/os-volume_attachments/d128941f-db55-4d3d-87da-56ac9b995897 => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:04:23.153732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7890c34-8a1c-4990-93f2-809bc78a9fd3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:23.156482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7890c34-8a1c-4990-93f2-809bc78a9fd3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:23.184897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7890c34-8a1c-4990-93f2-809bc78a9fd3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:23.185461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7890c34-8a1c-4990-93f2-809bc78a9fd3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:23.185949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7890c34-8a1c-4990-93f2-809bc78a9fd3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:23.190874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7890c34-8a1c-4990-93f2-809bc78a9fd3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:23.192326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7890c34-8a1c-4990-93f2-809bc78a9fd3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:23.193872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7890c34-8a1c-4990-93f2-809bc78a9fd3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:23.259065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9cd1983b-c08c-4ce7-900a-6f7ea7f1ad76 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:23.260172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9cd1983b-c08c-4ce7-900a-6f7ea7f1ad76 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:23.268883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cd1983b-c08c-4ce7-900a-6f7ea7f1ad76 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:23.269710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cd1983b-c08c-4ce7-900a-6f7ea7f1ad76 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:23.271145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cd1983b-c08c-4ce7-900a-6f7ea7f1ad76 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:23.272725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cd1983b-c08c-4ce7-900a-6f7ea7f1ad76 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:23.276532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cd1983b-c08c-4ce7-900a-6f7ea7f1ad76 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:23.282538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cd1983b-c08c-4ce7-900a-6f7ea7f1ad76 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:23.321422 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7890c34-8a1c-4990-93f2-809bc78a9fd3 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172357 Oct 27 19:04:23.328040 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1942/4075] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:23 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:23.345409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b4710642-1839-42ff-8d86-c868a70a3d8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:23.354409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b4710642-1839-42ff-8d86-c868a70a3d8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:23.372814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4710642-1839-42ff-8d86-c868a70a3d8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:23.374037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4710642-1839-42ff-8d86-c868a70a3d8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:23.375832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4710642-1839-42ff-8d86-c868a70a3d8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:23.378785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4710642-1839-42ff-8d86-c868a70a3d8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:23.381466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4710642-1839-42ff-8d86-c868a70a3d8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:23.382275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4710642-1839-42ff-8d86-c868a70a3d8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:23.458751 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b4710642-1839-42ff-8d86-c868a70a3d8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120810 Oct 27 19:04:23.459455 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1943/4076] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:23 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 19:04:23.464689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-39093894-4913-423b-9b76-36b451a98672 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:23.466574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-39093894-4913-423b-9b76-36b451a98672 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:23.485524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39093894-4913-423b-9b76-36b451a98672 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:23.492912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39093894-4913-423b-9b76-36b451a98672 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:23.493391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39093894-4913-423b-9b76-36b451a98672 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:23.494153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39093894-4913-423b-9b76-36b451a98672 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:23.494653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39093894-4913-423b-9b76-36b451a98672 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:23.495095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39093894-4913-423b-9b76-36b451a98672 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:23.508553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9cd1983b-c08c-4ce7-900a-6f7ea7f1ad76 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:23.516733 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9cd1983b-c08c-4ce7-900a-6f7ea7f1ad76 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1272 microversion: 2.1 time: 0.263000 Oct 27 19:04:23.517321 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2134/4077] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:23 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:04:23.617739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4c3833a1-96e3-4eea-ac50-0688652fd716 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:23.618358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4c3833a1-96e3-4eea-ac50-0688652fd716 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:23.630465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c3833a1-96e3-4eea-ac50-0688652fd716 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:23.634943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c3833a1-96e3-4eea-ac50-0688652fd716 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:23.639227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c3833a1-96e3-4eea-ac50-0688652fd716 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:23.640279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c3833a1-96e3-4eea-ac50-0688652fd716 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:23.642253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c3833a1-96e3-4eea-ac50-0688652fd716 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:23.643465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c3833a1-96e3-4eea-ac50-0688652fd716 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:23.658686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-39093894-4913-423b-9b76-36b451a98672 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:23.671778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-39093894-4913-423b-9b76-36b451a98672 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:23.693026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-39093894-4913-423b-9b76-36b451a98672 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:23.694925 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-39093894-4913-423b-9b76-36b451a98672 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1278 microversion: 2.20 time: 0.234229 Oct 27 19:04:23.717430 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1944/4078] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:23 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:23.737345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4c3833a1-96e3-4eea-ac50-0688652fd716 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:04:23.775078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:23.909083 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4c3833a1-96e3-4eea-ac50-0688652fd716 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 204 len: 0 microversion: 2.1 time: 0.295136 Oct 27 19:04:23.910277 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2135/4079] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:04:23 2022] DELETE /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:04:23.920022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bbf537bc-678f-42bb-9cca-0ba16e81964a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:23.920783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bbf537bc-678f-42bb-9cca-0ba16e81964a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:23.933397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbf537bc-678f-42bb-9cca-0ba16e81964a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:23.941048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbf537bc-678f-42bb-9cca-0ba16e81964a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:23.942028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbf537bc-678f-42bb-9cca-0ba16e81964a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:23.944036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbf537bc-678f-42bb-9cca-0ba16e81964a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:23.947810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbf537bc-678f-42bb-9cca-0ba16e81964a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:23.948412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbf537bc-678f-42bb-9cca-0ba16e81964a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:24.337172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-74cec9dd-8542-45ee-a687-81725b7a6d80 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:24.340699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-74cec9dd-8542-45ee-a687-81725b7a6d80 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:24.359232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74cec9dd-8542-45ee-a687-81725b7a6d80 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:24.360192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74cec9dd-8542-45ee-a687-81725b7a6d80 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:24.360933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74cec9dd-8542-45ee-a687-81725b7a6d80 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:24.361897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74cec9dd-8542-45ee-a687-81725b7a6d80 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:24.365296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74cec9dd-8542-45ee-a687-81725b7a6d80 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:24.366260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74cec9dd-8542-45ee-a687-81725b7a6d80 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:24.405886 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-74cec9dd-8542-45ee-a687-81725b7a6d80 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073825 Oct 27 19:04:24.406680 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2136/4080] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:24 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:04:24.548248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a9da0445-4026-4cc8-986c-37ac00028b25 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:24.549322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a9da0445-4026-4cc8-986c-37ac00028b25 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:24.564935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9da0445-4026-4cc8-986c-37ac00028b25 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:24.567022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9da0445-4026-4cc8-986c-37ac00028b25 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:24.571622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9da0445-4026-4cc8-986c-37ac00028b25 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:24.589917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9da0445-4026-4cc8-986c-37ac00028b25 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:24.591492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9da0445-4026-4cc8-986c-37ac00028b25 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:24.592676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9da0445-4026-4cc8-986c-37ac00028b25 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:24.818372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a9da0445-4026-4cc8-986c-37ac00028b25 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:24.834216 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a9da0445-4026-4cc8-986c-37ac00028b25 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1278 microversion: 2.1 time: 0.289494 Oct 27 19:04:24.839491 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2137/4081] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:24 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1278 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:04:24.855778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-760735b9-03cd-4e4e-ac4d-a8d73a3924bc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:24.856792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-760735b9-03cd-4e4e-ac4d-a8d73a3924bc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:24.868070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-760735b9-03cd-4e4e-ac4d-a8d73a3924bc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:24.875600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-760735b9-03cd-4e4e-ac4d-a8d73a3924bc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:24.877018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-760735b9-03cd-4e4e-ac4d-a8d73a3924bc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:24.881962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-760735b9-03cd-4e4e-ac4d-a8d73a3924bc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:24.890998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-760735b9-03cd-4e4e-ac4d-a8d73a3924bc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:24.891639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-760735b9-03cd-4e4e-ac4d-a8d73a3924bc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:24.936456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bbf537bc-678f-42bb-9cca-0ba16e81964a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:24.949793 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bbf537bc-678f-42bb-9cca-0ba16e81964a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1678 microversion: 2.1 time: 1.034226 Oct 27 19:04:24.950688 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1945/4082] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:23 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1678 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:04:25.004222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-760735b9-03cd-4e4e-ac4d-a8d73a3924bc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:25.016796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-760735b9-03cd-4e4e-ac4d-a8d73a3924bc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:25.018517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-760735b9-03cd-4e4e-ac4d-a8d73a3924bc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:25.019660 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-760735b9-03cd-4e4e-ac4d-a8d73a3924bc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1340 microversion: 2.20 time: 0.178697 Oct 27 19:04:25.023404 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2138/4083] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:24 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1340 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:25.422610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b6aef784-bfc9-45ba-b0ee-b489fef5ac43 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:25.425491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b6aef784-bfc9-45ba-b0ee-b489fef5ac43 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:25.453493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6aef784-bfc9-45ba-b0ee-b489fef5ac43 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:25.455308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6aef784-bfc9-45ba-b0ee-b489fef5ac43 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:25.459567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6aef784-bfc9-45ba-b0ee-b489fef5ac43 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:25.462601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6aef784-bfc9-45ba-b0ee-b489fef5ac43 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:25.463304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6aef784-bfc9-45ba-b0ee-b489fef5ac43 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:25.463937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6aef784-bfc9-45ba-b0ee-b489fef5ac43 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:25.597154 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b6aef784-bfc9-45ba-b0ee-b489fef5ac43 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181772 Oct 27 19:04:25.604657 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1946/4084] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:25 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:25.861049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-76ce1664-02b1-4a7f-8f41-791bc50c6fb4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:25.861878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-76ce1664-02b1-4a7f-8f41-791bc50c6fb4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:25.885241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76ce1664-02b1-4a7f-8f41-791bc50c6fb4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:25.886901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76ce1664-02b1-4a7f-8f41-791bc50c6fb4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:25.887672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76ce1664-02b1-4a7f-8f41-791bc50c6fb4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:25.888699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76ce1664-02b1-4a7f-8f41-791bc50c6fb4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:25.889373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76ce1664-02b1-4a7f-8f41-791bc50c6fb4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:25.891284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-76ce1664-02b1-4a7f-8f41-791bc50c6fb4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:25.973011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ed3a8a6e-5b29-4d50-b1cb-7f2f1809399b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:25.975142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ed3a8a6e-5b29-4d50-b1cb-7f2f1809399b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:25.978487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:25.982323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed3a8a6e-5b29-4d50-b1cb-7f2f1809399b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:25.995159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed3a8a6e-5b29-4d50-b1cb-7f2f1809399b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:25.995981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed3a8a6e-5b29-4d50-b1cb-7f2f1809399b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:25.996948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed3a8a6e-5b29-4d50-b1cb-7f2f1809399b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:25.997645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed3a8a6e-5b29-4d50-b1cb-7f2f1809399b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:25.998292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed3a8a6e-5b29-4d50-b1cb-7f2f1809399b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:26.275247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-76ce1664-02b1-4a7f-8f41-791bc50c6fb4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:26.291606 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-76ce1664-02b1-4a7f-8f41-791bc50c6fb4 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1320 microversion: 2.1 time: 0.434505 Oct 27 19:04:26.292235 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2139/4085] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:25 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1320 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:26.303895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fac2bc68-c3de-4028-9763-61fc8d2f4d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:26.307219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fac2bc68-c3de-4028-9763-61fc8d2f4d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:26.327978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fac2bc68-c3de-4028-9763-61fc8d2f4d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:26.328396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fac2bc68-c3de-4028-9763-61fc8d2f4d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:26.331238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fac2bc68-c3de-4028-9763-61fc8d2f4d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:26.332359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fac2bc68-c3de-4028-9763-61fc8d2f4d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:26.333713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fac2bc68-c3de-4028-9763-61fc8d2f4d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:26.334357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fac2bc68-c3de-4028-9763-61fc8d2f4d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:26.642577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fac2bc68-c3de-4028-9763-61fc8d2f4d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:26.653535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fac2bc68-c3de-4028-9763-61fc8d2f4d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:26.667326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fac2bc68-c3de-4028-9763-61fc8d2f4d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:26.668553 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fac2bc68-c3de-4028-9763-61fc8d2f4d9b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1408 microversion: 2.20 time: 0.368946 Oct 27 19:04:26.669150 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2140/4086] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:26 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1408 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:26.680391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-91a3de05-6abd-4153-a8a9-587061cd000a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:26.696321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-91a3de05-6abd-4153-a8a9-587061cd000a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:26.708151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a3de05-6abd-4153-a8a9-587061cd000a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:26.710316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a3de05-6abd-4153-a8a9-587061cd000a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:26.718734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a3de05-6abd-4153-a8a9-587061cd000a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:26.719847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a3de05-6abd-4153-a8a9-587061cd000a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:26.720508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a3de05-6abd-4153-a8a9-587061cd000a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:26.721124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a3de05-6abd-4153-a8a9-587061cd000a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:26.773430 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-91a3de05-6abd-4153-a8a9-587061cd000a tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103095 Oct 27 19:04:26.778970 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2141/4087] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:26 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:26.811405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ed3a8a6e-5b29-4d50-b1cb-7f2f1809399b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:26.827095 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ed3a8a6e-5b29-4d50-b1cb-7f2f1809399b tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1678 microversion: 2.1 time: 0.857798 Oct 27 19:04:26.839362 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1947/4088] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:25 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1678 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:27.317938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-804f2567-7740-468f-a999-88abf12bb639 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:27.319167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-804f2567-7740-468f-a999-88abf12bb639 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:27.331031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-804f2567-7740-468f-a999-88abf12bb639 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:27.331402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-804f2567-7740-468f-a999-88abf12bb639 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:27.339813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-804f2567-7740-468f-a999-88abf12bb639 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:27.340784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-804f2567-7740-468f-a999-88abf12bb639 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:27.341464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-804f2567-7740-468f-a999-88abf12bb639 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:27.342073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-804f2567-7740-468f-a999-88abf12bb639 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:27.387476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-446fc894-a062-4d99-b778-b6c3644cb3f3 req-be891a70-e7b6-46b5-b377-39136c49ee0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08376c5b-32eb-4676-ac6b-f29f971cda31", "tag": "1e3ef788-9aeb-41ff-915b-70e35dff85a9"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:27.425561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-446fc894-a062-4d99-b778-b6c3644cb3f3 req-be891a70-e7b6-46b5-b377-39136c49ee0c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:27.426015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-446fc894-a062-4d99-b778-b6c3644cb3f3 req-be891a70-e7b6-46b5-b377-39136c49ee0c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:27.426528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-446fc894-a062-4d99-b778-b6c3644cb3f3 req-be891a70-e7b6-46b5-b377-39136c49ee0c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:27.459865 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-446fc894-a062-4d99-b778-b6c3644cb3f3 req-be891a70-e7b6-46b5-b377-39136c49ee0c service nova] Creating event network-changed:1e3ef788-9aeb-41ff-915b-70e35dff85a9 for instance 08376c5b-32eb-4676-ac6b-f29f971cda31 on n-h2-860687-3 Oct 27 19:04:27.476351 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-446fc894-a062-4d99-b778-b6c3644cb3f3 req-be891a70-e7b6-46b5-b377-39136c49ee0c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092707 Oct 27 19:04:27.476988 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1948/4089] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:04:27.678570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-804f2567-7740-468f-a999-88abf12bb639 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:27.687172 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-804f2567-7740-468f-a999-88abf12bb639 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1320 microversion: 2.1 time: 0.373788 Oct 27 19:04:27.688250 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2142/4090] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:27 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1320 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:27.700299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-062ba59d-78e6-4b7a-8d2b-6eb7997bf08a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:27.701304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-062ba59d-78e6-4b7a-8d2b-6eb7997bf08a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:27.712997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-062ba59d-78e6-4b7a-8d2b-6eb7997bf08a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:27.713708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-062ba59d-78e6-4b7a-8d2b-6eb7997bf08a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:27.714347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-062ba59d-78e6-4b7a-8d2b-6eb7997bf08a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:27.715414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-062ba59d-78e6-4b7a-8d2b-6eb7997bf08a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:27.716050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-062ba59d-78e6-4b7a-8d2b-6eb7997bf08a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:27.716794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-062ba59d-78e6-4b7a-8d2b-6eb7997bf08a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:27.787578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d2408fb-0584-49db-a5fa-6314e967eb41 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:27.790212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3d2408fb-0584-49db-a5fa-6314e967eb41 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:27.801074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2408fb-0584-49db-a5fa-6314e967eb41 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:27.802714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2408fb-0584-49db-a5fa-6314e967eb41 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:27.803342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2408fb-0584-49db-a5fa-6314e967eb41 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:27.804248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2408fb-0584-49db-a5fa-6314e967eb41 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:27.804879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2408fb-0584-49db-a5fa-6314e967eb41 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:27.805507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2408fb-0584-49db-a5fa-6314e967eb41 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:27.881410 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3d2408fb-0584-49db-a5fa-6314e967eb41 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097158 Oct 27 19:04:27.886457 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2143/4091] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:27 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:27.899858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-305bb342-4f23-40b1-968d-18ea7835f482 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:27.903618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-305bb342-4f23-40b1-968d-18ea7835f482 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:27.930531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-305bb342-4f23-40b1-968d-18ea7835f482 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:27.931198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-305bb342-4f23-40b1-968d-18ea7835f482 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:27.931666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-305bb342-4f23-40b1-968d-18ea7835f482 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:27.935004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-305bb342-4f23-40b1-968d-18ea7835f482 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:27.945456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-305bb342-4f23-40b1-968d-18ea7835f482 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:27.945943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-305bb342-4f23-40b1-968d-18ea7835f482 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:28.071967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-305bb342-4f23-40b1-968d-18ea7835f482 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:28.109283 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-305bb342-4f23-40b1-968d-18ea7835f482 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1611 microversion: 2.1 time: 0.222601 Oct 27 19:04:28.113763 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2144/4092] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:27 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1611 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:28.340081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-062ba59d-78e6-4b7a-8d2b-6eb7997bf08a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:28.362043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-062ba59d-78e6-4b7a-8d2b-6eb7997bf08a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:28.369011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-062ba59d-78e6-4b7a-8d2b-6eb7997bf08a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:28.374879 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-062ba59d-78e6-4b7a-8d2b-6eb7997bf08a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1408 microversion: 2.20 time: 0.676525 Oct 27 19:04:28.378661 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1949/4093] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:27 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1408 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:28.653393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-745f6276-8825-4c30-9be8-070c047ad43c req-80f78372-bbed-491d-9efe-7f7fcb559dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83449394-d485-488c-853e-d928636b406e", "name": "network-vif-deleted", "tag": "34511b60-81df-41ae-8c51-1294a7bdb507"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:28.712816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eac78a1e-be3c-49aa-9f8c-59a472fe35c2 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:28.714153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eac78a1e-be3c-49aa-9f8c-59a472fe35c2 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:28.720655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-745f6276-8825-4c30-9be8-070c047ad43c req-80f78372-bbed-491d-9efe-7f7fcb559dd0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:28.721465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-745f6276-8825-4c30-9be8-070c047ad43c req-80f78372-bbed-491d-9efe-7f7fcb559dd0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:28.722278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-745f6276-8825-4c30-9be8-070c047ad43c req-80f78372-bbed-491d-9efe-7f7fcb559dd0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:28.729333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eac78a1e-be3c-49aa-9f8c-59a472fe35c2 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:28.731367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eac78a1e-be3c-49aa-9f8c-59a472fe35c2 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:28.732149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eac78a1e-be3c-49aa-9f8c-59a472fe35c2 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:28.734715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eac78a1e-be3c-49aa-9f8c-59a472fe35c2 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:28.736466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eac78a1e-be3c-49aa-9f8c-59a472fe35c2 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:28.738183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eac78a1e-be3c-49aa-9f8c-59a472fe35c2 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:28.755050 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-745f6276-8825-4c30-9be8-070c047ad43c req-80f78372-bbed-491d-9efe-7f7fcb559dd0 service nova] Creating event network-vif-deleted:34511b60-81df-41ae-8c51-1294a7bdb507 for instance 83449394-d485-488c-853e-d928636b406e on n-h1-860687-3 Oct 27 19:04:28.764748 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-745f6276-8825-4c30-9be8-070c047ad43c req-80f78372-bbed-491d-9efe-7f7fcb559dd0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123281 Oct 27 19:04:28.766417 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2145/4094] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:28.896471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8fe019a4-52dc-4e08-b9ca-6434abe7ca42 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:28.900076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8fe019a4-52dc-4e08-b9ca-6434abe7ca42 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:28.919226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fe019a4-52dc-4e08-b9ca-6434abe7ca42 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:28.920040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fe019a4-52dc-4e08-b9ca-6434abe7ca42 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:28.920680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fe019a4-52dc-4e08-b9ca-6434abe7ca42 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:28.921948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fe019a4-52dc-4e08-b9ca-6434abe7ca42 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:28.926782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fe019a4-52dc-4e08-b9ca-6434abe7ca42 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:28.927731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fe019a4-52dc-4e08-b9ca-6434abe7ca42 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:29.029091 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8fe019a4-52dc-4e08-b9ca-6434abe7ca42 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139147 Oct 27 19:04:29.031600 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2146/4095] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:28 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:04:29.138567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0211b11-a703-4a69-8c47-294a6148393f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:29.139475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f0211b11-a703-4a69-8c47-294a6148393f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:29.154872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0211b11-a703-4a69-8c47-294a6148393f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:29.155793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0211b11-a703-4a69-8c47-294a6148393f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:29.156152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0211b11-a703-4a69-8c47-294a6148393f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:29.157073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0211b11-a703-4a69-8c47-294a6148393f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:29.157327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-eac78a1e-be3c-49aa-9f8c-59a472fe35c2 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:29.158356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0211b11-a703-4a69-8c47-294a6148393f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:29.159051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0211b11-a703-4a69-8c47-294a6148393f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:29.183648 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eac78a1e-be3c-49aa-9f8c-59a472fe35c2 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1320 microversion: 2.1 time: 0.476799 Oct 27 19:04:29.184250 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1950/4096] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:28 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1320 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:29.198848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0211b11-a703-4a69-8c47-294a6148393f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:29.199737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0211b11-a703-4a69-8c47-294a6148393f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:29.200440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0211b11-a703-4a69-8c47-294a6148393f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:29.201135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-f0211b11-a703-4a69-8c47-294a6148393f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lazy-loading 'fault' on Instance uuid 83449394-d485-488c-853e-d928636b406e {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:04:29.408732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d931cd36-5b36-4de0-88db-ae581bde2d34 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:29.409372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d931cd36-5b36-4de0-88db-ae581bde2d34 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:29.419860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d931cd36-5b36-4de0-88db-ae581bde2d34 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:29.426180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d931cd36-5b36-4de0-88db-ae581bde2d34 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:29.427983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d931cd36-5b36-4de0-88db-ae581bde2d34 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:29.428438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d931cd36-5b36-4de0-88db-ae581bde2d34 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:29.428922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d931cd36-5b36-4de0-88db-ae581bde2d34 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:29.429366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d931cd36-5b36-4de0-88db-ae581bde2d34 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:29.470445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f0211b11-a703-4a69-8c47-294a6148393f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:29.484269 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f0211b11-a703-4a69-8c47-294a6148393f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 200 len: 1329 microversion: 2.1 time: 0.350908 Oct 27 19:04:29.485063 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2147/4097] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:29 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 1329 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:29.749969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d931cd36-5b36-4de0-88db-ae581bde2d34 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:29.769631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d931cd36-5b36-4de0-88db-ae581bde2d34 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:29.772354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d931cd36-5b36-4de0-88db-ae581bde2d34 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:29.773734 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d931cd36-5b36-4de0-88db-ae581bde2d34 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1408 microversion: 2.20 time: 0.370386 Oct 27 19:04:29.774487 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1951/4098] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:29 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1408 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:04:30.046438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b726cf41-7799-4086-bd12-34b8ca82e0bc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:30.050015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b726cf41-7799-4086-bd12-34b8ca82e0bc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:30.063077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b726cf41-7799-4086-bd12-34b8ca82e0bc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:30.063858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b726cf41-7799-4086-bd12-34b8ca82e0bc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:30.064575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b726cf41-7799-4086-bd12-34b8ca82e0bc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:30.065478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b726cf41-7799-4086-bd12-34b8ca82e0bc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:30.066103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b726cf41-7799-4086-bd12-34b8ca82e0bc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:30.066833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b726cf41-7799-4086-bd12-34b8ca82e0bc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:30.135963 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b726cf41-7799-4086-bd12-34b8ca82e0bc tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096097 Oct 27 19:04:30.137070 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2148/4099] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:30 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:30.213567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-59cf1b64-83b8-4f24-bca0-0b8d4288ecc7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:30.214515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-59cf1b64-83b8-4f24-bca0-0b8d4288ecc7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:30.224544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59cf1b64-83b8-4f24-bca0-0b8d4288ecc7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:30.227216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59cf1b64-83b8-4f24-bca0-0b8d4288ecc7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:30.228017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59cf1b64-83b8-4f24-bca0-0b8d4288ecc7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:30.228937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59cf1b64-83b8-4f24-bca0-0b8d4288ecc7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:30.235935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59cf1b64-83b8-4f24-bca0-0b8d4288ecc7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:30.236916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59cf1b64-83b8-4f24-bca0-0b8d4288ecc7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:30.517227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e53c984d-2b5c-48c8-a09c-195135506646 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:30.518111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e53c984d-2b5c-48c8-a09c-195135506646 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:30.527933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e53c984d-2b5c-48c8-a09c-195135506646 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:30.529771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e53c984d-2b5c-48c8-a09c-195135506646 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:30.562021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e53c984d-2b5c-48c8-a09c-195135506646 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:30.569008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e53c984d-2b5c-48c8-a09c-195135506646 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:30.569915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e53c984d-2b5c-48c8-a09c-195135506646 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:30.570630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e53c984d-2b5c-48c8-a09c-195135506646 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:30.590946 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-e53c984d-2b5c-48c8-a09c-195135506646 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] HTTP exception thrown: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e53c984d-2b5c-48c8-a09c-195135506646 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Request method failure captured: Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e HTTP/1.1 Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtT5H8XP7V9L0TVuuJvAuBoxNkhZhgX8XkK4-GpzHComWgmbBONfMudM4Q8yHeohsrOhf9YccVlwgfDyUGCChaGZWmGukZPYKh-mvkrZX3vZytXvdyVczNY7QyQ7kdcUBjknkaFKQkxOgdDbrstleWDjGVR0bmb658DtZfuMHYOhmds Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52ccbe7e63ab48199790f4676bbf2580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2be49f7bea7a4c8fbf289594e635fd69 Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '83449394-d485-488c-853e-d928636b406e'} Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:30.593085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:30.597431 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:30.597431 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:30.597431 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:30.597431 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:30.597431 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:30.597431 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:04:30.597431 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:30.599380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e53c984d-2b5c-48c8-a09c-195135506646 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Returning 404 to user: Instance 83449394-d485-488c-853e-d928636b406e could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:30.601878 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e53c984d-2b5c-48c8-a09c-195135506646 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 404 len: 111 microversion: 2.1 time: 0.088713 Oct 27 19:04:30.604215 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2149/4100] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:30 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:04:30.612090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e89f5140-95f0-4ee5-9c09-acab8b9da1fd tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '.version_select at 0x7fc86a8a9e50>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:30.649645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-59cf1b64-83b8-4f24-bca0-0b8d4288ecc7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:30.659366 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-59cf1b64-83b8-4f24-bca0-0b8d4288ecc7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1320 microversion: 2.1 time: 0.449587 Oct 27 19:04:30.663503 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1952/4101] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:30 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1320 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:30.677161 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e89f5140-95f0-4ee5-9c09-acab8b9da1fd tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-480985877" status: 202 len: 0 microversion: 2.1 time: 0.068618 Oct 27 19:04:30.678519 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2150/4102] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Oct 27 19:04:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-480985877 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:04:30.788384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ea0aec4c-8a1c-4942-b1ec-ab2946810fa5 req-56f0bbf4-3bff-4f3c-aa0c-fecf269c029c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b128ff-a00c-4607-8088-1988263fbe79", "tag": "2beafeb2-d863-4916-9b9f-2b9876bdf5ff"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:30.801621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1fed9b5f-a7c5-4aa5-bcf3-7d320000f5f2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:30.803297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ea0aec4c-8a1c-4942-b1ec-ab2946810fa5 req-56f0bbf4-3bff-4f3c-aa0c-fecf269c029c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:30.805295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1fed9b5f-a7c5-4aa5-bcf3-7d320000f5f2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:30.808149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ea0aec4c-8a1c-4942-b1ec-ab2946810fa5 req-56f0bbf4-3bff-4f3c-aa0c-fecf269c029c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:30.813441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ea0aec4c-8a1c-4942-b1ec-ab2946810fa5 req-56f0bbf4-3bff-4f3c-aa0c-fecf269c029c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:30.825798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fed9b5f-a7c5-4aa5-bcf3-7d320000f5f2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:30.831322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fed9b5f-a7c5-4aa5-bcf3-7d320000f5f2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:30.832071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fed9b5f-a7c5-4aa5-bcf3-7d320000f5f2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:30.833749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fed9b5f-a7c5-4aa5-bcf3-7d320000f5f2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:30.834507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fed9b5f-a7c5-4aa5-bcf3-7d320000f5f2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:30.835171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fed9b5f-a7c5-4aa5-bcf3-7d320000f5f2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:30.845081 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ea0aec4c-8a1c-4942-b1ec-ab2946810fa5 req-56f0bbf4-3bff-4f3c-aa0c-fecf269c029c service nova] Creating event network-changed:2beafeb2-d863-4916-9b9f-2b9876bdf5ff for instance 96b128ff-a00c-4607-8088-1988263fbe79 on n-h2-860687-3 Oct 27 19:04:30.866127 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ea0aec4c-8a1c-4942-b1ec-ab2946810fa5 req-56f0bbf4-3bff-4f3c-aa0c-fecf269c029c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082381 Oct 27 19:04:30.867733 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1953/4103] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:31.151142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-853ceea7-71dc-4668-a967-906cb64c9ebf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:31.154985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-853ceea7-71dc-4668-a967-906cb64c9ebf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:31.178125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-853ceea7-71dc-4668-a967-906cb64c9ebf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:31.181406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-853ceea7-71dc-4668-a967-906cb64c9ebf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:31.182154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-853ceea7-71dc-4668-a967-906cb64c9ebf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:31.185662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-853ceea7-71dc-4668-a967-906cb64c9ebf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:31.186475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-853ceea7-71dc-4668-a967-906cb64c9ebf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:31.187333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-853ceea7-71dc-4668-a967-906cb64c9ebf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:31.274213 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-853ceea7-71dc-4668-a967-906cb64c9ebf tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.126652 Oct 27 19:04:31.282276 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1954/4104] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:04:31 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 19:04:31.452777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3e17ceb8-6ce7-4817-9fb1-be00ff8bfa8c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:31.455041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3e17ceb8-6ce7-4817-9fb1-be00ff8bfa8c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:31.474189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e17ceb8-6ce7-4817-9fb1-be00ff8bfa8c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:31.474866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e17ceb8-6ce7-4817-9fb1-be00ff8bfa8c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:31.475323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e17ceb8-6ce7-4817-9fb1-be00ff8bfa8c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:31.478787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e17ceb8-6ce7-4817-9fb1-be00ff8bfa8c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:31.479293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e17ceb8-6ce7-4817-9fb1-be00ff8bfa8c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:31.479746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e17ceb8-6ce7-4817-9fb1-be00ff8bfa8c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:31.554149 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-3e17ceb8-6ce7-4817-9fb1-be00ff8bfa8c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] HTTP exception thrown: Cannot 'reboot' instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 while it is in vm_state rescued Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3e17ceb8-6ce7-4817-9fb1-be00ff8bfa8c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Request method failure captured: Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8/action HTTP/1.1 Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 28 Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtTOhZ4eSrUIbh7FOH8abPh8o6s1SrCC6rl-rUyuXuq1ygfePdb0jYAcyGuJrVudmd8OxoZzpYzhODw3ejjYW0-ti5IZ9xJMsPzlMbC7OoicnuCUnW_JwGkg6OKXbZMBkqYeQENn4eoxSAgVgRaELA_KPYJgZbVCfoUL02eTSzGcONI Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_adeacece438645c4a0c5844d1ef83793", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2b706e9394a642cda315809db15ecbb3 Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: {"reboot": {"type": "HARD"}} Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: exception: Cannot 'reboot' instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 while it is in vm_state rescued Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8', 'body': {'reboot': {'type': 'HARD'}}} Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 19:04:31.555962 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 19:04:31.559787 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 while it is in vm_state rescued Oct 27 19:04:31.559787 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:31.559787 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:31.559787 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:31.559787 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:31.559787 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:31.559787 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:31.559787 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:31.559787 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:31.559787 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 while it is in vm_state rescued Oct 27 19:04:31.559787 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:31.559787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3e17ceb8-6ce7-4817-9fb1-be00ff8bfa8c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Returning 409 to user: Cannot 'reboot' instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 while it is in vm_state rescued {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:31.581621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1fed9b5f-a7c5-4aa5-bcf3-7d320000f5f2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:31.590367 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3e17ceb8-6ce7-4817-9fb1-be00ff8bfa8c tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8/action" status: 409 len: 145 microversion: 2.1 time: 0.113464 Oct 27 19:04:31.591023 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1955/4105] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:04:31 2022] POST /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8/action => generated 145 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:04:31.600645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1fed9b5f-a7c5-4aa5-bcf3-7d320000f5f2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:31.602140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8751fdbf-0a29-4a9d-b246-da184e7be3c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:31.605336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1fed9b5f-a7c5-4aa5-bcf3-7d320000f5f2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:31.607886 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1fed9b5f-a7c5-4aa5-bcf3-7d320000f5f2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1408 microversion: 2.20 time: 0.811274 Oct 27 19:04:31.610719 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2151/4106] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:30 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1408 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:04:31.616555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8751fdbf-0a29-4a9d-b246-da184e7be3c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:31.626242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8751fdbf-0a29-4a9d-b246-da184e7be3c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:31.628777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8751fdbf-0a29-4a9d-b246-da184e7be3c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:31.629241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8751fdbf-0a29-4a9d-b246-da184e7be3c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:31.630040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8751fdbf-0a29-4a9d-b246-da184e7be3c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:31.630579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8751fdbf-0a29-4a9d-b246-da184e7be3c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:31.631022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8751fdbf-0a29-4a9d-b246-da184e7be3c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:31.677115 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-8751fdbf-0a29-4a9d-b246-da184e7be3c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] HTTP exception thrown: Cannot 'rebuild' instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 while it is in vm_state rescued Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8751fdbf-0a29-4a9d-b246-da184e7be3c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Request method failure captured: Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8/action HTTP/1.1 Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 65 Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtTOhZ4eSrUIbh7FOH8abPh8o6s1SrCC6rl-rUyuXuq1ygfePdb0jYAcyGuJrVudmd8OxoZzpYzhODw3ejjYW0-ti5IZ9xJMsPzlMbC7OoicnuCUnW_JwGkg6OKXbZMBkqYeQENn4eoxSAgVgRaELA_KPYJgZbVCfoUL02eTSzGcONI Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_adeacece438645c4a0c5844d1ef83793", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2b706e9394a642cda315809db15ecbb3 Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: {"rebuild": {"imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00"}} Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: exception: Cannot 'rebuild' instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 while it is in vm_state rescued Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8', 'body': {'rebuild': {'imageRef': '77589569-9b6a-4afc-8af7-7a43ef9ebc00'}}} Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:04:31.690411 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 while it is in vm_state rescued Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 while it is in vm_state rescued Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8751fdbf-0a29-4a9d-b246-da184e7be3c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Returning 409 to user: Cannot 'rebuild' instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 while it is in vm_state rescued {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8751fdbf-0a29-4a9d-b246-da184e7be3c8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "POST /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8/action" status: 409 len: 146 microversion: 2.1 time: 0.084141 Oct 27 19:04:31.697396 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1956/4107] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:04:31 2022] POST /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8/action => generated 146 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 19:04:31.699451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b3ac49d2-d39f-4223-b1c9-b9dd153d724b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:31.699451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b3ac49d2-d39f-4223-b1c9-b9dd153d724b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:31.699731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3ac49d2-d39f-4223-b1c9-b9dd153d724b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:31.700236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3ac49d2-d39f-4223-b1c9-b9dd153d724b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:31.700700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3ac49d2-d39f-4223-b1c9-b9dd153d724b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:31.701431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3ac49d2-d39f-4223-b1c9-b9dd153d724b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:31.701902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3ac49d2-d39f-4223-b1c9-b9dd153d724b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:31.702346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3ac49d2-d39f-4223-b1c9-b9dd153d724b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:31.706239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a3251110-fbb8-4317-a4bc-89d077f60045 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:31.706873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a3251110-fbb8-4317-a4bc-89d077f60045 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:31.721771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3251110-fbb8-4317-a4bc-89d077f60045 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:31.722283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3251110-fbb8-4317-a4bc-89d077f60045 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:31.722779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3251110-fbb8-4317-a4bc-89d077f60045 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:31.723616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3251110-fbb8-4317-a4bc-89d077f60045 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:31.724095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3251110-fbb8-4317-a4bc-89d077f60045 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:31.724529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3251110-fbb8-4317-a4bc-89d077f60045 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:31.779022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:31.784226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a3251110-fbb8-4317-a4bc-89d077f60045 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:04:31.943672 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a3251110-fbb8-4317-a4bc-89d077f60045 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 204 len: 0 microversion: 2.1 time: 0.250181 Oct 27 19:04:31.944666 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1957/4108] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:04:31 2022] DELETE /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:04:31.945588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:31.962042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-434e0bd3-80bc-409b-8e22-08aa55c07f84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:31.968654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-434e0bd3-80bc-409b-8e22-08aa55c07f84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:31.981575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:31.984068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-434e0bd3-80bc-409b-8e22-08aa55c07f84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:31.984816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-434e0bd3-80bc-409b-8e22-08aa55c07f84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:31.985439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-434e0bd3-80bc-409b-8e22-08aa55c07f84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:31.986585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-434e0bd3-80bc-409b-8e22-08aa55c07f84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:31.987223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-434e0bd3-80bc-409b-8e22-08aa55c07f84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:31.987655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-434e0bd3-80bc-409b-8e22-08aa55c07f84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:32.222651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=12 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:32.298593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b3ac49d2-d39f-4223-b1c9-b9dd153d724b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:32.305718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:32.314478 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b3ac49d2-d39f-4223-b1c9-b9dd153d724b tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1320 microversion: 2.1 time: 0.628511 Oct 27 19:04:32.315748 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2152/4109] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:31 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1320 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:32.413127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-434e0bd3-80bc-409b-8e22-08aa55c07f84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:32.424720 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-434e0bd3-80bc-409b-8e22-08aa55c07f84 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1690 microversion: 2.1 time: 0.472846 Oct 27 19:04:32.425836 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1958/4110] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:31 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1690 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:32.472373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-919e9ecb-1c57-4e99-950e-fa8bd5b4ee1a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Action: 'create', calling method: .version_select at 0x7fc869ff7430>, body: {"keypair": {"name": "tempest-keypair-869254833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCcSAKBr/yVn0dQ+docFpRUaJylIu3Oof2p9/cXLgbj6RLUr2+TMvQBUK/cD3w+yo2fgH5FkvrtzHvRZBmUFzJFgGcidVKxk7+ZpRh2v4NXpZjgwPRc3ZIwv28OanFY8Q=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:32.493404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-919e9ecb-1c57-4e99-950e-fa8bd5b4ee1a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:04:32.500294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-919e9ecb-1c57-4e99-950e-fa8bd5b4ee1a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for user 2be49f7bea7a4c8fbf289594e635fd69 and project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:04:32.536716 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-919e9ecb-1c57-4e99-950e-fa8bd5b4ee1a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.077060 Oct 27 19:04:32.538086 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2153/4111] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:04:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:04:32.641151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-def6f461-3015-47d1-9c8c-0aa03cd5a7df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:32.642778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-def6f461-3015-47d1-9c8c-0aa03cd5a7df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:32.668915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-def6f461-3015-47d1-9c8c-0aa03cd5a7df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:32.674212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-def6f461-3015-47d1-9c8c-0aa03cd5a7df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:32.678347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-def6f461-3015-47d1-9c8c-0aa03cd5a7df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:32.679479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-def6f461-3015-47d1-9c8c-0aa03cd5a7df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:32.691682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-def6f461-3015-47d1-9c8c-0aa03cd5a7df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:32.693226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-def6f461-3015-47d1-9c8c-0aa03cd5a7df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:33.026476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-def6f461-3015-47d1-9c8c-0aa03cd5a7df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:33.040489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-def6f461-3015-47d1-9c8c-0aa03cd5a7df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:33.046585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-def6f461-3015-47d1-9c8c-0aa03cd5a7df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:33.051017 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-def6f461-3015-47d1-9c8c-0aa03cd5a7df tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1408 microversion: 2.20 time: 0.413025 Oct 27 19:04:33.052774 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1959/4112] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:32 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1408 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:33.337978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4cf3693c-d1da-4884-b232-a77409aac618 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:33.339332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4cf3693c-d1da-4884-b232-a77409aac618 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:33.351382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cf3693c-d1da-4884-b232-a77409aac618 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:33.352148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cf3693c-d1da-4884-b232-a77409aac618 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:33.352849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cf3693c-d1da-4884-b232-a77409aac618 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:33.353799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cf3693c-d1da-4884-b232-a77409aac618 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:33.359162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cf3693c-d1da-4884-b232-a77409aac618 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:33.359919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cf3693c-d1da-4884-b232-a77409aac618 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:33.371092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:33.483900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-35ff5714-50a6-4ce7-bafe-d1310be9d5e8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:33.484531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-35ff5714-50a6-4ce7-bafe-d1310be9d5e8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:33.523435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35ff5714-50a6-4ce7-bafe-d1310be9d5e8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:33.523965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35ff5714-50a6-4ce7-bafe-d1310be9d5e8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:33.524427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35ff5714-50a6-4ce7-bafe-d1310be9d5e8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:33.525455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35ff5714-50a6-4ce7-bafe-d1310be9d5e8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:33.525903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35ff5714-50a6-4ce7-bafe-d1310be9d5e8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:33.526340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35ff5714-50a6-4ce7-bafe-d1310be9d5e8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:34.224493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4cf3693c-d1da-4884-b232-a77409aac618 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:34.234882 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4cf3693c-d1da-4884-b232-a77409aac618 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1320 microversion: 2.1 time: 0.900964 Oct 27 19:04:34.253570 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2154/4113] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:33 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1320 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:34.473072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-35ff5714-50a6-4ce7-bafe-d1310be9d5e8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:34.491716 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-35ff5714-50a6-4ce7-bafe-d1310be9d5e8 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1690 microversion: 2.1 time: 1.011535 Oct 27 19:04:34.493551 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1960/4114] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:33 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1690 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:34.632991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9c3867b2-238e-4df1-a99a-d0bb16725123 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:34.634408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9c3867b2-238e-4df1-a99a-d0bb16725123 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:34.652801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c3867b2-238e-4df1-a99a-d0bb16725123 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:34.653638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c3867b2-238e-4df1-a99a-d0bb16725123 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:34.655377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c3867b2-238e-4df1-a99a-d0bb16725123 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:34.656346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c3867b2-238e-4df1-a99a-d0bb16725123 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:34.658935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c3867b2-238e-4df1-a99a-d0bb16725123 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:34.659795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c3867b2-238e-4df1-a99a-d0bb16725123 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:34.986733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9c3867b2-238e-4df1-a99a-d0bb16725123 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:34.999009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9c3867b2-238e-4df1-a99a-d0bb16725123 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:35.000515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9c3867b2-238e-4df1-a99a-d0bb16725123 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:35.001699 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9c3867b2-238e-4df1-a99a-d0bb16725123 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1408 microversion: 2.20 time: 0.745708 Oct 27 19:04:35.002272 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2155/4115] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:34 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1408 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:35.261400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-92778173-c48c-4386-bc13-3a761ba93981 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:35.262455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-92778173-c48c-4386-bc13-3a761ba93981 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:35.271563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92778173-c48c-4386-bc13-3a761ba93981 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:35.272407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92778173-c48c-4386-bc13-3a761ba93981 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:35.273144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92778173-c48c-4386-bc13-3a761ba93981 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:35.274709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92778173-c48c-4386-bc13-3a761ba93981 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:35.276071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92778173-c48c-4386-bc13-3a761ba93981 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:35.277177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92778173-c48c-4386-bc13-3a761ba93981 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:35.517297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d709feb-e0e6-4b3e-a24c-d65a8c0092c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:35.518357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3d709feb-e0e6-4b3e-a24c-d65a8c0092c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:35.535999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d709feb-e0e6-4b3e-a24c-d65a8c0092c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:35.539983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d709feb-e0e6-4b3e-a24c-d65a8c0092c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:35.540784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d709feb-e0e6-4b3e-a24c-d65a8c0092c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:35.541888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d709feb-e0e6-4b3e-a24c-d65a8c0092c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:35.544377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d709feb-e0e6-4b3e-a24c-d65a8c0092c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:35.545197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d709feb-e0e6-4b3e-a24c-d65a8c0092c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:35.607847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-92778173-c48c-4386-bc13-3a761ba93981 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:35.626225 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-92778173-c48c-4386-bc13-3a761ba93981 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1320 microversion: 2.1 time: 0.364018 Oct 27 19:04:35.647477 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1961/4116] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:35 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1320 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:35.904084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3d709feb-e0e6-4b3e-a24c-d65a8c0092c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:35.919926 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3d709feb-e0e6-4b3e-a24c-d65a8c0092c9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1690 microversion: 2.1 time: 0.406255 Oct 27 19:04:35.923359 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2156/4117] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:35 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1690 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:36.029873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-61d1feae-72e7-4114-bfaf-dbd1617fc6d0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:36.030728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-61d1feae-72e7-4114-bfaf-dbd1617fc6d0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:36.042277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61d1feae-72e7-4114-bfaf-dbd1617fc6d0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:36.044041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61d1feae-72e7-4114-bfaf-dbd1617fc6d0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:36.045609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61d1feae-72e7-4114-bfaf-dbd1617fc6d0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:36.047260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61d1feae-72e7-4114-bfaf-dbd1617fc6d0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:36.049279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61d1feae-72e7-4114-bfaf-dbd1617fc6d0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:36.049906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61d1feae-72e7-4114-bfaf-dbd1617fc6d0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:36.285053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-51148390-6595-4c24-9c2b-3ae75213abed req-4b865cee-ba80-4baf-b75e-4ecaf2e69018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08376c5b-32eb-4676-ac6b-f29f971cda31", "name": "network-vif-plugged", "status": "completed", "tag": "1e3ef788-9aeb-41ff-915b-70e35dff85a9"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:36.318437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-51148390-6595-4c24-9c2b-3ae75213abed req-4b865cee-ba80-4baf-b75e-4ecaf2e69018 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:36.318944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-51148390-6595-4c24-9c2b-3ae75213abed req-4b865cee-ba80-4baf-b75e-4ecaf2e69018 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:36.319409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-51148390-6595-4c24-9c2b-3ae75213abed req-4b865cee-ba80-4baf-b75e-4ecaf2e69018 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:36.361175 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-51148390-6595-4c24-9c2b-3ae75213abed req-4b865cee-ba80-4baf-b75e-4ecaf2e69018 service nova] Creating event network-vif-plugged:1e3ef788-9aeb-41ff-915b-70e35dff85a9 for instance 08376c5b-32eb-4676-ac6b-f29f971cda31 on n-h2-860687-3 Oct 27 19:04:36.376074 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-51148390-6595-4c24-9c2b-3ae75213abed req-4b865cee-ba80-4baf-b75e-4ecaf2e69018 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097302 Oct 27 19:04:36.382127 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2157/4118] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:04:36.401743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1805543996", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2cfbe0bf-f6fb-46ad-9a6c-606f41f6cc6f"}], "security_groups": [{"name": "tempest-securitygroup--1504346914"}], "key_name": "tempest-keypair-869254833", "user_data": "}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:36.412125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-61d1feae-72e7-4114-bfaf-dbd1617fc6d0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:36.435127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-61d1feae-72e7-4114-bfaf-dbd1617fc6d0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:36.436966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-61d1feae-72e7-4114-bfaf-dbd1617fc6d0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:36.444120 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-61d1feae-72e7-4114-bfaf-dbd1617fc6d0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1408 microversion: 2.20 time: 0.418816 Oct 27 19:04:36.445281 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1962/4119] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:36 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1408 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:36.600017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] validate_networks() for [('2cfbe0bf-f6fb-46ad-9a6c-606f41f6cc6f', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:04:36.654768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-de29c312-0f90-4ac9-ba73-2a42305e913d tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:36.656995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-de29c312-0f90-4ac9-ba73-2a42305e913d tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:36.668117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de29c312-0f90-4ac9-ba73-2a42305e913d tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:36.670691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de29c312-0f90-4ac9-ba73-2a42305e913d tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:36.672123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de29c312-0f90-4ac9-ba73-2a42305e913d tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:36.676221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de29c312-0f90-4ac9-ba73-2a42305e913d tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:36.677992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de29c312-0f90-4ac9-ba73-2a42305e913d tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:36.681591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de29c312-0f90-4ac9-ba73-2a42305e913d tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:36.958361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-de29c312-0f90-4ac9-ba73-2a42305e913d tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:36.979121 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-de29c312-0f90-4ac9-ba73-2a42305e913d tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1320 microversion: 2.1 time: 0.328738 Oct 27 19:04:36.980073 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1963/4120] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:36 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1320 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:37.139891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ba1033c8-f55f-4d54-9839-74bbaa3c38cd tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Action: 'create', calling method: .version_select at 0x7fc869b434c0>, body: {"keypair": {"name": "tempest-keypair-1128217567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJbj5BfM4TbT6kPlHUVOnpyUgDbcaMYwxEb4qTBLSkw0ItQp29UTtbrhU5aAhoTbW5ghW7jaom5TBOWxfW7jmUbK7PuqTievd3lp1Sa2vM78Su6hzsjeEpntxOjAZnHpw=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:37.191849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-ba1033c8-f55f-4d54-9839-74bbaa3c38cd tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Getting quotas for project 28491a788f494c9f81f9fd8a5cf10702. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:04:37.205639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-ba1033c8-f55f-4d54-9839-74bbaa3c38cd tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Getting quotas for user da2b7686c7474be3b0b0317e997516f4 and project 28491a788f494c9f81f9fd8a5cf10702. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:04:37.260900 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ba1033c8-f55f-4d54-9839-74bbaa3c38cd tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.279510 Oct 27 19:04:37.262118 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1964/4121] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:04:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:37.273025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1ceeb985-cb39-435b-9bba-3e6e87950f85 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:37.273866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1ceeb985-cb39-435b-9bba-3e6e87950f85 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:37.298781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ceeb985-cb39-435b-9bba-3e6e87950f85 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:37.299301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ceeb985-cb39-435b-9bba-3e6e87950f85 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:37.299765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ceeb985-cb39-435b-9bba-3e6e87950f85 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:37.300752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ceeb985-cb39-435b-9bba-3e6e87950f85 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:37.301216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ceeb985-cb39-435b-9bba-3e6e87950f85 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:37.302220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ceeb985-cb39-435b-9bba-3e6e87950f85 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:37.802713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:04:37.803801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:04:37.804518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:04:37.805126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:04:37.805736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:04:37.825110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:37.825989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:37.826653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:37.827606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:37.846559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:37.852057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:37.933198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:04:37.955332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Getting quotas for user 2be49f7bea7a4c8fbf289594e635fd69 and project 52ccbe7e63ab48199790f4676bbf2580. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:04:37.966093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:38.018146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:04:38.022115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:04:38.040055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1ceeb985-cb39-435b-9bba-3e6e87950f85 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:38.050836 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1ceeb985-cb39-435b-9bba-3e6e87950f85 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1690 microversion: 2.1 time: 0.785113 Oct 27 19:04:38.052886 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1965/4122] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:37 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1690 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:38.064756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-809bb7c9-cd01-463f-94b5-83cfb66c3043 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:38.074690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-809bb7c9-cd01-463f-94b5-83cfb66c3043 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:38.097974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-809bb7c9-cd01-463f-94b5-83cfb66c3043 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:38.099667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-809bb7c9-cd01-463f-94b5-83cfb66c3043 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:38.100145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-809bb7c9-cd01-463f-94b5-83cfb66c3043 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:38.102116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-809bb7c9-cd01-463f-94b5-83cfb66c3043 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:38.102628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-809bb7c9-cd01-463f-94b5-83cfb66c3043 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:38.103084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-809bb7c9-cd01-463f-94b5-83cfb66c3043 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:38.152842 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-325737ee-7030-4bf3-8571-d9eb0f66fad9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.768217 Oct 27 19:04:38.162243 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2158/4123] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:04:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:04:38.173265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6a18bda-b0f8-4e2f-9e3a-5a1ff92145bc tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:38.177387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d6a18bda-b0f8-4e2f-9e3a-5a1ff92145bc tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:38.194920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6a18bda-b0f8-4e2f-9e3a-5a1ff92145bc tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:38.199718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6a18bda-b0f8-4e2f-9e3a-5a1ff92145bc tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:38.200427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6a18bda-b0f8-4e2f-9e3a-5a1ff92145bc tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:38.216328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6a18bda-b0f8-4e2f-9e3a-5a1ff92145bc tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:38.217072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6a18bda-b0f8-4e2f-9e3a-5a1ff92145bc tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:38.229827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6a18bda-b0f8-4e2f-9e3a-5a1ff92145bc tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:38.316554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d6a18bda-b0f8-4e2f-9e3a-5a1ff92145bc tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:04:38.511997 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d6a18bda-b0f8-4e2f-9e3a-5a1ff92145bc tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 204 len: 0 microversion: 2.1 time: 0.345217 Oct 27 19:04:38.514410 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2159/4124] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:04:38 2022] DELETE /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:04:38.531253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-03f6fc9c-bd91-462e-a174-99b038602ea7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:38.534102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-03f6fc9c-bd91-462e-a174-99b038602ea7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:38.575996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03f6fc9c-bd91-462e-a174-99b038602ea7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:38.579034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03f6fc9c-bd91-462e-a174-99b038602ea7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:38.581135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03f6fc9c-bd91-462e-a174-99b038602ea7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:38.582160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03f6fc9c-bd91-462e-a174-99b038602ea7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:38.583509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03f6fc9c-bd91-462e-a174-99b038602ea7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:38.584664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03f6fc9c-bd91-462e-a174-99b038602ea7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:39.318750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-809bb7c9-cd01-463f-94b5-83cfb66c3043 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:39.340510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-809bb7c9-cd01-463f-94b5-83cfb66c3043 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:39.342544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-809bb7c9-cd01-463f-94b5-83cfb66c3043 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:39.343748 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-809bb7c9-cd01-463f-94b5-83cfb66c3043 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1408 microversion: 2.20 time: 1.289394 Oct 27 19:04:39.363058 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1966/4125] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:38 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1408 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:39.373971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e576887f-cdce-48f0-963b-92e62710e10a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:39.377428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e576887f-cdce-48f0-963b-92e62710e10a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:39.451484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-03f6fc9c-bd91-462e-a174-99b038602ea7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:39.464980 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-03f6fc9c-bd91-462e-a174-99b038602ea7 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1320 microversion: 2.1 time: 0.946973 Oct 27 19:04:39.470242 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2160/4126] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:38 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1320 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:39.477498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cf71fc7d-7c04-474d-9d1c-75b1b1f0f19e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:39.482139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cf71fc7d-7c04-474d-9d1c-75b1b1f0f19e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:39.489471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf71fc7d-7c04-474d-9d1c-75b1b1f0f19e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:39.490669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf71fc7d-7c04-474d-9d1c-75b1b1f0f19e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:39.491348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf71fc7d-7c04-474d-9d1c-75b1b1f0f19e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:39.492347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf71fc7d-7c04-474d-9d1c-75b1b1f0f19e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:39.493696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf71fc7d-7c04-474d-9d1c-75b1b1f0f19e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:39.499730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf71fc7d-7c04-474d-9d1c-75b1b1f0f19e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:39.587904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e576887f-cdce-48f0-963b-92e62710e10a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:39.610989 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e576887f-cdce-48f0-963b-92e62710e10a tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1241 microversion: 2.1 time: 0.246674 Oct 27 19:04:39.615766 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1967/4127] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:39 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1241 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:39.632296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4f949a9b-0341-4702-a428-fb0e4ac28862 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:39.645582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4f949a9b-0341-4702-a428-fb0e4ac28862 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:39.668164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f949a9b-0341-4702-a428-fb0e4ac28862 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:39.673251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f949a9b-0341-4702-a428-fb0e4ac28862 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:39.673853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f949a9b-0341-4702-a428-fb0e4ac28862 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:39.674775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f949a9b-0341-4702-a428-fb0e4ac28862 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:39.675610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f949a9b-0341-4702-a428-fb0e4ac28862 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:39.690125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f949a9b-0341-4702-a428-fb0e4ac28862 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:39.831096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4f949a9b-0341-4702-a428-fb0e4ac28862 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:39.844424 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4f949a9b-0341-4702-a428-fb0e4ac28862 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 200 len: 1623 microversion: 2.1 time: 0.216585 Oct 27 19:04:39.847509 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1968/4128] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:39 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 1623 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:40.055811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-89a6f663-98b3-4d4f-8bf4-23923720f2b7 req-b4ce5913-daf1-4e96-899d-5bc76b35e2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c958b48-5e00-49c6-95ab-a36acdbdf6e2", "name": "network-vif-deleted", "tag": "f5c0b623-9e29-4d46-9459-e03cfbf0d547"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:40.072120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-89a6f663-98b3-4d4f-8bf4-23923720f2b7 req-b4ce5913-daf1-4e96-899d-5bc76b35e2db service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:40.073069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-89a6f663-98b3-4d4f-8bf4-23923720f2b7 req-b4ce5913-daf1-4e96-899d-5bc76b35e2db service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:40.073727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-89a6f663-98b3-4d4f-8bf4-23923720f2b7 req-b4ce5913-daf1-4e96-899d-5bc76b35e2db service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:40.092612 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-89a6f663-98b3-4d4f-8bf4-23923720f2b7 req-b4ce5913-daf1-4e96-899d-5bc76b35e2db service nova] Creating event network-vif-deleted:f5c0b623-9e29-4d46-9459-e03cfbf0d547 for instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 on n-h2-860687-3 Oct 27 19:04:40.101623 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-89a6f663-98b3-4d4f-8bf4-23923720f2b7 req-b4ce5913-daf1-4e96-899d-5bc76b35e2db service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050999 Oct 27 19:04:40.122812 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1969/4129] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:04:40.137713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cf71fc7d-7c04-474d-9d1c-75b1b1f0f19e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:40.161679 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cf71fc7d-7c04-474d-9d1c-75b1b1f0f19e tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1469 microversion: 2.1 time: 0.679232 Oct 27 19:04:40.163664 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2161/4130] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:39 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1469 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:40.391832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7868ac4b-5ba0-425b-9731-391fe25f8847 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:40.393631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7868ac4b-5ba0-425b-9731-391fe25f8847 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:40.413406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7868ac4b-5ba0-425b-9731-391fe25f8847 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:40.415745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7868ac4b-5ba0-425b-9731-391fe25f8847 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:40.416508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7868ac4b-5ba0-425b-9731-391fe25f8847 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:40.419209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7868ac4b-5ba0-425b-9731-391fe25f8847 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:40.420321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7868ac4b-5ba0-425b-9731-391fe25f8847 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:40.422509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7868ac4b-5ba0-425b-9731-391fe25f8847 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:40.497947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2ea0afa1-6964-47a7-b397-4eda7c1cfadb tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:40.498917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2ea0afa1-6964-47a7-b397-4eda7c1cfadb tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:40.518116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea0afa1-6964-47a7-b397-4eda7c1cfadb tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:40.524198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea0afa1-6964-47a7-b397-4eda7c1cfadb tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:40.524716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea0afa1-6964-47a7-b397-4eda7c1cfadb tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:40.530707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea0afa1-6964-47a7-b397-4eda7c1cfadb tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:40.531433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea0afa1-6964-47a7-b397-4eda7c1cfadb tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:40.534145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea0afa1-6964-47a7-b397-4eda7c1cfadb tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:41.060744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2ea0afa1-6964-47a7-b397-4eda7c1cfadb tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:41.069153 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2ea0afa1-6964-47a7-b397-4eda7c1cfadb tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1470 microversion: 2.1 time: 0.576431 Oct 27 19:04:41.073111 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2162/4131] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:40 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1470 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:04:41.080316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c460861c-3b69-4214-8cf3-3c04dbef2e8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:41.081232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c460861c-3b69-4214-8cf3-3c04dbef2e8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:41.087684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c460861c-3b69-4214-8cf3-3c04dbef2e8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:41.088389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c460861c-3b69-4214-8cf3-3c04dbef2e8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:41.089023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c460861c-3b69-4214-8cf3-3c04dbef2e8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:41.089909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c460861c-3b69-4214-8cf3-3c04dbef2e8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:41.090571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c460861c-3b69-4214-8cf3-3c04dbef2e8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:41.104996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c460861c-3b69-4214-8cf3-3c04dbef2e8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:41.278795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c460861c-3b69-4214-8cf3-3c04dbef2e8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:41.289188 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c460861c-3b69-4214-8cf3-3c04dbef2e8f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1293 microversion: 2.1 time: 0.214683 Oct 27 19:04:41.289808 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2163/4132] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:41 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1293 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:41.299276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3568da97-d898-4b94-8ae6-f059add4ced9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:41.300963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3568da97-d898-4b94-8ae6-f059add4ced9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: 0c958b48-5e00-49c6-95ab-a36acdbdf6e2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:41.318071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3568da97-d898-4b94-8ae6-f059add4ced9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:41.318622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3568da97-d898-4b94-8ae6-f059add4ced9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:41.319084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3568da97-d898-4b94-8ae6-f059add4ced9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:41.319826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3568da97-d898-4b94-8ae6-f059add4ced9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:41.324926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3568da97-d898-4b94-8ae6-f059add4ced9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:41.326822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3568da97-d898-4b94-8ae6-f059add4ced9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:41.374926 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-3568da97-d898-4b94-8ae6-f059add4ced9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] HTTP exception thrown: Instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 could not be found. Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3568da97-d898-4b94-8ae6-f059add4ced9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Request method failure captured: Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 HTTP/1.1 Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtTOhZ4eSrUIbh7FOH8abPh8o6s1SrCC6rl-rUyuXuq1ygfePdb0jYAcyGuJrVudmd8OxoZzpYzhODw3ejjYW0-ti5IZ9xJMsPzlMbC7OoicnuCUnW_JwGkg6OKXbZMBkqYeQENn4eoxSAgVgRaELA_KPYJgZbVCfoUL02eTSzGcONI Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_adeacece438645c4a0c5844d1ef83793", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2b706e9394a642cda315809db15ecbb3 Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 could not be found. Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '0c958b48-5e00-49c6-95ab-a36acdbdf6e2'} Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 could not be found. Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 could not be found. Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:41.376685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:41.381203 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:41.381203 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:41.381203 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:41.381203 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:41.381203 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:41.381203 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:41.381203 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 could not be found. Oct 27 19:04:41.381203 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:41.381203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3568da97-d898-4b94-8ae6-f059add4ced9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Returning 404 to user: Instance 0c958b48-5e00-49c6-95ab-a36acdbdf6e2 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:41.381203 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3568da97-d898-4b94-8ae6-f059add4ced9 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2" status: 404 len: 111 microversion: 2.1 time: 0.087371 Oct 27 19:04:41.394947 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2164/4133] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:41 2022] GET /compute/v2.1/servers/0c958b48-5e00-49c6-95ab-a36acdbdf6e2 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:04:41.405171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b2d3d1c5-c3ec-4b03-96f3-cb86b92e25ff tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:41.405737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b2d3d1c5-c3ec-4b03-96f3-cb86b92e25ff tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:41.420750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2d3d1c5-c3ec-4b03-96f3-cb86b92e25ff tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:41.420928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7868ac4b-5ba0-425b-9731-391fe25f8847 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:41.421387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2d3d1c5-c3ec-4b03-96f3-cb86b92e25ff tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:41.421748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2d3d1c5-c3ec-4b03-96f3-cb86b92e25ff tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:41.422600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2d3d1c5-c3ec-4b03-96f3-cb86b92e25ff tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:41.423078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2d3d1c5-c3ec-4b03-96f3-cb86b92e25ff tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:41.423561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2d3d1c5-c3ec-4b03-96f3-cb86b92e25ff tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:41.440747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7868ac4b-5ba0-425b-9731-391fe25f8847 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:41.454452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7868ac4b-5ba0-425b-9731-391fe25f8847 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:41.457339 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7868ac4b-5ba0-425b-9731-391fe25f8847 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1408 microversion: 2.20 time: 1.071484 Oct 27 19:04:41.461682 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1970/4134] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:40 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1408 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:41.478732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb7fe0a8-8fff-4cbd-838e-ebefc405e269 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:41.494981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cb7fe0a8-8fff-4cbd-838e-ebefc405e269 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:41.509676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-b2d3d1c5-c3ec-4b03-96f3-cb86b92e25ff tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lazy-loading 'flavor' on Instance uuid 08376c5b-32eb-4676-ac6b-f29f971cda31 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:04:41.554241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb7fe0a8-8fff-4cbd-838e-ebefc405e269 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:41.566828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb7fe0a8-8fff-4cbd-838e-ebefc405e269 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:41.570552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb7fe0a8-8fff-4cbd-838e-ebefc405e269 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:41.574094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb7fe0a8-8fff-4cbd-838e-ebefc405e269 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:41.575829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb7fe0a8-8fff-4cbd-838e-ebefc405e269 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:41.580373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb7fe0a8-8fff-4cbd-838e-ebefc405e269 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:41.733062 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b2d3d1c5-c3ec-4b03-96f3-cb86b92e25ff tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31/action" status: 202 len: 0 microversion: 2.1 time: 0.330680 Oct 27 19:04:41.734122 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2165/4135] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:04:41 2022] POST /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:04:41.747551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a0fd3fc-1ade-401d-9cd7-fa52de32d9e0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '.version_select at 0x7fc86a7d1ca0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:41.791919 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8a0fd3fc-1ade-401d-9cd7-fa52de32d9e0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883309253" status: 202 len: 0 microversion: 2.1 time: 0.055863 Oct 27 19:04:41.793053 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2166/4136] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 19:04:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883309253 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:04:41.922274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cb7fe0a8-8fff-4cbd-838e-ebefc405e269 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea63f2012f7b47eebd9d8fd9fbf14767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966aa5bddffa45cda17ec34ac50a439d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:41.941677 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cb7fe0a8-8fff-4cbd-838e-ebefc405e269 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 200 len: 1427 microversion: 2.1 time: 0.475170 Oct 27 19:04:41.961774 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1971/4137] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:41 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 1427 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:41.982283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cdbf5dd0-9335-4aa9-8463-6cd4bb125852 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:41.984870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cdbf5dd0-9335-4aa9-8463-6cd4bb125852 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:42.009379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdbf5dd0-9335-4aa9-8463-6cd4bb125852 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:42.013187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdbf5dd0-9335-4aa9-8463-6cd4bb125852 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:42.013955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdbf5dd0-9335-4aa9-8463-6cd4bb125852 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:42.016445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdbf5dd0-9335-4aa9-8463-6cd4bb125852 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:42.017910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdbf5dd0-9335-4aa9-8463-6cd4bb125852 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:42.021358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdbf5dd0-9335-4aa9-8463-6cd4bb125852 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:42.094142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dbc2c33e-31a5-4592-9d31-09e312ab720a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:42.095038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dbc2c33e-31a5-4592-9d31-09e312ab720a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:42.117794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbc2c33e-31a5-4592-9d31-09e312ab720a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:42.121488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbc2c33e-31a5-4592-9d31-09e312ab720a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:42.122224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbc2c33e-31a5-4592-9d31-09e312ab720a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:42.127294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbc2c33e-31a5-4592-9d31-09e312ab720a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:42.128580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbc2c33e-31a5-4592-9d31-09e312ab720a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:42.133550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbc2c33e-31a5-4592-9d31-09e312ab720a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:42.235646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dbc2c33e-31a5-4592-9d31-09e312ab720a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:04:42.451987 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dbc2c33e-31a5-4592-9d31-09e312ab720a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 204 len: 0 microversion: 2.42 time: 0.657195 Oct 27 19:04:42.456341 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2167/4138] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 19:04:41 2022] DELETE /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 0 bytes in 659 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:04:42.472625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-c7645e64-9571-4f96-981c-3af75e7214a8 req-df06b664-7bc6-4c20-afee-8f464cfc904b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d48593-3e33-41d9-a5f0-f4d1e52d7b55", "name": "network-vif-deleted", "tag": "aaf42184-af5c-47cf-ba3b-8943199e8ed6"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:42.505975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c7645e64-9571-4f96-981c-3af75e7214a8 req-df06b664-7bc6-4c20-afee-8f464cfc904b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:42.505975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c7645e64-9571-4f96-981c-3af75e7214a8 req-df06b664-7bc6-4c20-afee-8f464cfc904b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:42.505975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c7645e64-9571-4f96-981c-3af75e7214a8 req-df06b664-7bc6-4c20-afee-8f464cfc904b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:42.581835 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-c7645e64-9571-4f96-981c-3af75e7214a8 req-df06b664-7bc6-4c20-afee-8f464cfc904b service nova] Creating event network-vif-deleted:aaf42184-af5c-47cf-ba3b-8943199e8ed6 for instance e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 on n-h1-860687-3 Oct 27 19:04:42.607120 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-c7645e64-9571-4f96-981c-3af75e7214a8 req-df06b664-7bc6-4c20-afee-8f464cfc904b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148890 Oct 27 19:04:42.607760 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2168/4139] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:42.628401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f8ad14ad-dc10-412d-8a09-7a2241f172dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:42.629324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f8ad14ad-dc10-412d-8a09-7a2241f172dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:42.647765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8ad14ad-dc10-412d-8a09-7a2241f172dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:42.648298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8ad14ad-dc10-412d-8a09-7a2241f172dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:42.649414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8ad14ad-dc10-412d-8a09-7a2241f172dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:42.651435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8ad14ad-dc10-412d-8a09-7a2241f172dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:42.652330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8ad14ad-dc10-412d-8a09-7a2241f172dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:42.653034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8ad14ad-dc10-412d-8a09-7a2241f172dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:42.693374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:42.784437 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cdbf5dd0-9335-4aa9-8463-6cd4bb125852 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1629 microversion: 2.1 time: 0.821308 Oct 27 19:04:42.791516 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1972/4140] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:41 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1629 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:42.796561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e4be168a-2a73-4fe6-a508-7beb547e979e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:42.814148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e4be168a-2a73-4fe6-a508-7beb547e979e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:42.840571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4be168a-2a73-4fe6-a508-7beb547e979e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:42.842463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4be168a-2a73-4fe6-a508-7beb547e979e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:42.844291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4be168a-2a73-4fe6-a508-7beb547e979e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:42.845933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4be168a-2a73-4fe6-a508-7beb547e979e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:42.859405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4be168a-2a73-4fe6-a508-7beb547e979e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:42.865506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4be168a-2a73-4fe6-a508-7beb547e979e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:42.897693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f8ad14ad-dc10-412d-8a09-7a2241f172dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:42.912509 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f8ad14ad-dc10-412d-8a09-7a2241f172dc tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1299 microversion: 2.1 time: 0.299110 Oct 27 19:04:42.946052 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2169/4141] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:42 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1299 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:42.952680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a0442be8-9da6-490b-b472-668fe2eea292 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:42.957787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a0442be8-9da6-490b-b472-668fe2eea292 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:42.970666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0442be8-9da6-490b-b472-668fe2eea292 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:42.971421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0442be8-9da6-490b-b472-668fe2eea292 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:42.972037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0442be8-9da6-490b-b472-668fe2eea292 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:42.972980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0442be8-9da6-490b-b472-668fe2eea292 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:42.974006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0442be8-9da6-490b-b472-668fe2eea292 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:42.974771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0442be8-9da6-490b-b472-668fe2eea292 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:43.366556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e4be168a-2a73-4fe6-a508-7beb547e979e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:43.381285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e4be168a-2a73-4fe6-a508-7beb547e979e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:43.382833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e4be168a-2a73-4fe6-a508-7beb547e979e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:43.387416 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e4be168a-2a73-4fe6-a508-7beb547e979e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2956 microversion: 2.42 time: 0.594211 Oct 27 19:04:43.394362 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1973/4142] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:42 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2956 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:43.401994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1573444002", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "818956fe-a67f-4d48-b5cc-f7d3fdc2953d"}], "security_groups": [{"name": "tempest-securitygroup--1287136612"}], "key_name": "tempest-keypair-1128217567", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:43.627888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] validate_networks() for [('818956fe-a67f-4d48-b5cc-f7d3fdc2953d', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:04:43.735565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a0442be8-9da6-490b-b472-668fe2eea292 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:43.751481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a0442be8-9da6-490b-b472-668fe2eea292 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:43.753007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a0442be8-9da6-490b-b472-668fe2eea292 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:43.757325 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a0442be8-9da6-490b-b472-668fe2eea292 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1408 microversion: 2.20 time: 0.809708 Oct 27 19:04:43.760412 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2170/4143] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:42 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1408 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:43.766529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-56afaeee-c3cb-4af3-b922-35fad0f43e22 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:43.767366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-56afaeee-c3cb-4af3-b922-35fad0f43e22 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] [instance: e5d48593-3e33-41d9-a5f0-f4d1e52d7b55] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:43.789795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56afaeee-c3cb-4af3-b922-35fad0f43e22 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:43.790979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56afaeee-c3cb-4af3-b922-35fad0f43e22 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:43.794222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56afaeee-c3cb-4af3-b922-35fad0f43e22 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:43.796988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56afaeee-c3cb-4af3-b922-35fad0f43e22 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:43.797655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56afaeee-c3cb-4af3-b922-35fad0f43e22 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:43.800716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56afaeee-c3cb-4af3-b922-35fad0f43e22 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:43.844871 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-56afaeee-c3cb-4af3-b922-35fad0f43e22 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] HTTP exception thrown: Instance e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 could not be found. Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-56afaeee-c3cb-4af3-b922-35fad0f43e22 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Request method failure captured: Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 HTTP/1.1 Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtWw62MeF2LJ3FJUGvWVWFtmoelxzWxb1cI-Z7dDEUTQch4YaVtQ5rWBsP_BA1W8rLOh1kf9aekxAgVNrDkQUmbQ9aZg7epUFkJhEkySghY8mG39Pckmi_LkjxWF2AOqjgkBCK7Ur6XfcCvRRU9tTqejkaT3z0CA-9Aa3n1PJP1EuKE Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 966aa5bddffa45cda17ec34ac50a439d Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-VolumesBackupsTest-1964133757 Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/966aa5bddffa45cda17ec34ac50a439d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/966aa5bddffa45cda17ec34ac50a439d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_966aa5bddffa45cda17ec34ac50a439d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/966aa5bddffa45cda17ec34ac50a439d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-VolumesBackupsTest-1964133757 Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 966aa5bddffa45cda17ec34ac50a439d Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-VolumesBackupsTest-1964133757 Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-VolumesBackupsTest-1964133757-project Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ea63f2012f7b47eebd9d8fd9fbf14767 Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-VolumesBackupsTest-1964133757-project Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 could not be found. Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'e5d48593-3e33-41d9-a5f0-f4d1e52d7b55'} Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 could not be found. Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 could not be found. Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:43.853478 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:43.857346 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:43.857346 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:43.857346 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:43.857346 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:43.857346 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:43.857346 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 could not be found. Oct 27 19:04:43.857346 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:43.857346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-56afaeee-c3cb-4af3-b922-35fad0f43e22 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] Returning 404 to user: Instance e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:43.857915 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-56afaeee-c3cb-4af3-b922-35fad0f43e22 tempest-VolumesBackupsTest-1964133757 tempest-VolumesBackupsTest-1964133757-project] 10.222.0.42 "GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55" status: 404 len: 111 microversion: 2.1 time: 0.094152 Oct 27 19:04:43.868242 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2171/4144] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:43 2022] GET /compute/v2.1/servers/e5d48593-3e33-41d9-a5f0-f4d1e52d7b55 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:04:43.873155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-243494e1-ff56-45c7-bbb1-f1655bdd2ce7 req-608d22f4-defc-4b7f-a1e3-2a45682295db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b128ff-a00c-4607-8088-1988263fbe79", "name": "network-vif-plugged", "status": "completed", "tag": "2beafeb2-d863-4916-9b9f-2b9876bdf5ff"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:43.893731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-243494e1-ff56-45c7-bbb1-f1655bdd2ce7 req-608d22f4-defc-4b7f-a1e3-2a45682295db service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:43.896489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-243494e1-ff56-45c7-bbb1-f1655bdd2ce7 req-608d22f4-defc-4b7f-a1e3-2a45682295db service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:43.896964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-243494e1-ff56-45c7-bbb1-f1655bdd2ce7 req-608d22f4-defc-4b7f-a1e3-2a45682295db service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:43.964963 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-243494e1-ff56-45c7-bbb1-f1655bdd2ce7 req-608d22f4-defc-4b7f-a1e3-2a45682295db service nova] Creating event network-vif-plugged:2beafeb2-d863-4916-9b9f-2b9876bdf5ff for instance 96b128ff-a00c-4607-8088-1988263fbe79 on n-h2-860687-3 Oct 27 19:04:43.977795 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-243494e1-ff56-45c7-bbb1-f1655bdd2ce7 req-608d22f4-defc-4b7f-a1e3-2a45682295db service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108206 Oct 27 19:04:43.978475 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2172/4145] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:43.988866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2bc9eeb7-72ff-491d-8f1b-ad9c40a82745 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:44.006469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2bc9eeb7-72ff-491d-8f1b-ad9c40a82745 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:44.027202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc9eeb7-72ff-491d-8f1b-ad9c40a82745 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:44.027966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc9eeb7-72ff-491d-8f1b-ad9c40a82745 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:44.029347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc9eeb7-72ff-491d-8f1b-ad9c40a82745 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:44.031435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc9eeb7-72ff-491d-8f1b-ad9c40a82745 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:44.034768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc9eeb7-72ff-491d-8f1b-ad9c40a82745 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:44.035400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bc9eeb7-72ff-491d-8f1b-ad9c40a82745 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:44.534939 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2bc9eeb7-72ff-491d-8f1b-ad9c40a82745 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1612 microversion: 2.1 time: 0.553283 Oct 27 19:04:44.549308 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2173/4146] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:43 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1612 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:44.571112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4924020e-ddf1-42a0-b8e2-bbf56f237035 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:44.571748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4924020e-ddf1-42a0-b8e2-bbf56f237035 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:44.588144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4924020e-ddf1-42a0-b8e2-bbf56f237035 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:44.588725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4924020e-ddf1-42a0-b8e2-bbf56f237035 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:44.590236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4924020e-ddf1-42a0-b8e2-bbf56f237035 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:44.591659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4924020e-ddf1-42a0-b8e2-bbf56f237035 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:44.592172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4924020e-ddf1-42a0-b8e2-bbf56f237035 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:44.593623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4924020e-ddf1-42a0-b8e2-bbf56f237035 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:44.720126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Getting quotas for project 28491a788f494c9f81f9fd8a5cf10702. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:04:44.734408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Getting quotas for user da2b7686c7474be3b0b0317e997516f4 and project 28491a788f494c9f81f9fd8a5cf10702. Resources: dict_keys(['metadata_items']) {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:04:44.772101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:04:44.773458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:04:44.773956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:04:44.774376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:04:44.774826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:04:44.775757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4924020e-ddf1-42a0-b8e2-bbf56f237035 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:44.788813 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4924020e-ddf1-42a0-b8e2-bbf56f237035 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1299 microversion: 2.1 time: 0.230582 Oct 27 19:04:44.789388 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2174/4147] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:44 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1299 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:44.800295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ea140ecf-6831-4b4d-b84c-82a813fcfb2f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:44.801175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ea140ecf-6831-4b4d-b84c-82a813fcfb2f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:44.811032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:44.811561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:44.812007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:44.812897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:44.813365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:44.813799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:44.822972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea140ecf-6831-4b4d-b84c-82a813fcfb2f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:44.823483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea140ecf-6831-4b4d-b84c-82a813fcfb2f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:44.823931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea140ecf-6831-4b4d-b84c-82a813fcfb2f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:44.824750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea140ecf-6831-4b4d-b84c-82a813fcfb2f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:44.828442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea140ecf-6831-4b4d-b84c-82a813fcfb2f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:44.828899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea140ecf-6831-4b4d-b84c-82a813fcfb2f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:44.860322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Getting quotas for project 28491a788f494c9f81f9fd8a5cf10702. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:04:44.871911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Getting quotas for user da2b7686c7474be3b0b0317e997516f4 and project 28491a788f494c9f81f9fd8a5cf10702. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:04:44.904324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:04:44.906818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:04:45.023982 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-17ac7125-4f38-463c-ae47-0974fde36365 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.627486 Oct 27 19:04:45.032736 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1974/4148] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:04:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:04:45.044515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71963566-9412-4b3e-af1b-3bbe96548675 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:45.044655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-71963566-9412-4b3e-af1b-3bbe96548675 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:45.061593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71963566-9412-4b3e-af1b-3bbe96548675 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:45.062284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71963566-9412-4b3e-af1b-3bbe96548675 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:45.062951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71963566-9412-4b3e-af1b-3bbe96548675 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:45.064861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71963566-9412-4b3e-af1b-3bbe96548675 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:45.079914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71963566-9412-4b3e-af1b-3bbe96548675 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:45.080697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71963566-9412-4b3e-af1b-3bbe96548675 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:45.165315 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-71963566-9412-4b3e-af1b-3bbe96548675 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] HTTP exception thrown: Cannot 'migrate' instance 08376c5b-32eb-4676-ac6b-f29f971cda31 while it is in vm_state suspended Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71963566-9412-4b3e-af1b-3bbe96548675 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Request method failure captured: Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31/action HTTP/1.1 Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 15 Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtYkVce5yyED_9m68n-P1QgKVLVxxcKV7oy5inEoJOAsb4PeWzsdc3PKjKBVEQHhuAAheKkT6uh5E0YJRo1ZdXd70NBogvl6hL9JefQVn2vu2EBcVcmrKrUABZ3Q6RlYXVnkRDyGP5wbCVonF6x-1aas3RqPK6ZC0t9D3xG4KJm9TgM Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: b00a200c78784e8b94b9ce1d9967f1c5 Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b00a200c78784e8b94b9ce1d9967f1c5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: b00a200c78784e8b94b9ce1d9967f1c5 Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersAdminNegativeTestJSON-2117974073-project-admin Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e0aedc2a3cf74860b23680057359888d Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2117974073-project-admin Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: {"migrate": {}} Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: exception: Cannot 'migrate' instance 08376c5b-32eb-4676-ac6b-f29f971cda31 while it is in vm_state suspended Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '08376c5b-32eb-4676-ac6b-f29f971cda31', 'body': {'migrate': {}}} Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08376c5b-32eb-4676-ac6b-f29f971cda31 in vm_state suspended. Cannot resize while the instance is in this state. Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:04:45.179505 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 08376c5b-32eb-4676-ac6b-f29f971cda31 while it is in vm_state suspended Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 08376c5b-32eb-4676-ac6b-f29f971cda31 while it is in vm_state suspended Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.184830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71963566-9412-4b3e-af1b-3bbe96548675 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Returning 409 to user: Cannot 'migrate' instance 08376c5b-32eb-4676-ac6b-f29f971cda31 while it is in vm_state suspended {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:45.186014 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-71963566-9412-4b3e-af1b-3bbe96548675 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31/action" status: 409 len: 148 microversion: 2.1 time: 0.147175 Oct 27 19:04:45.193946 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1975/4149] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:04:45 2022] POST /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31/action => generated 148 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:04:45.205874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28f89a94-de10-48af-bb1a-a8bf544420b0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:45.210463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-28f89a94-de10-48af-bb1a-a8bf544420b0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:45.224153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:45.228254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28f89a94-de10-48af-bb1a-a8bf544420b0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:45.231006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28f89a94-de10-48af-bb1a-a8bf544420b0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:45.233034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28f89a94-de10-48af-bb1a-a8bf544420b0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:45.236713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28f89a94-de10-48af-bb1a-a8bf544420b0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:45.237749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28f89a94-de10-48af-bb1a-a8bf544420b0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:45.238466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28f89a94-de10-48af-bb1a-a8bf544420b0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:45.253777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:45.256985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ea140ecf-6831-4b4d-b84c-82a813fcfb2f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:45.281371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ea140ecf-6831-4b4d-b84c-82a813fcfb2f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:45.289351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ea140ecf-6831-4b4d-b84c-82a813fcfb2f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:45.293771 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ea140ecf-6831-4b4d-b84c-82a813fcfb2f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2956 microversion: 2.42 time: 0.495129 Oct 27 19:04:45.310519 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2175/4150] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:44 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2956 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:45.310519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0c93b40d-8af1-4f74-bb2c-5c056793f0b2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:45.312700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0c93b40d-8af1-4f74-bb2c-5c056793f0b2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:45.434106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0c93b40d-8af1-4f74-bb2c-5c056793f0b2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:45.455590 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0c93b40d-8af1-4f74-bb2c-5c056793f0b2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1278 microversion: 2.1 time: 0.159512 Oct 27 19:04:45.459646 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2176/4151] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:45 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:45.484580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-02be1b6b-002e-4d37-9487-1bbd7db16a0a tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-02be1b6b-002e-4d37-9487-1bbd7db16a0a tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Request method failure captured: Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec/action HTTP/1.1 Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 39 Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtYkVce5yyED_9m68n-P1QgKVLVxxcKV7oy5inEoJOAsb4PeWzsdc3PKjKBVEQHhuAAheKkT6uh5E0YJRo1ZdXd70NBogvl6hL9JefQVn2vu2EBcVcmrKrUABZ3Q6RlYXVnkRDyGP5wbCVonF6x-1aas3RqPK6ZC0t9D3xG4KJm9TgM Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: b00a200c78784e8b94b9ce1d9967f1c5 Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b00a200c78784e8b94b9ce1d9967f1c5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: b00a200c78784e8b94b9ce1d9967f1c5 Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersAdminNegativeTestJSON-2117974073-project-admin Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e0aedc2a3cf74860b23680057359888d Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2117974073-project-admin Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: {"os-resetState": {"state": "invalid"}} Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '7dac382c-7cdf-44b2-af5e-dc8f459aabec', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 19:04:45.501157 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 19:04:45.507354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 27 19:04:45.507354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.507354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:45.507354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.507354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:45.507354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:45.507354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:45.507354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 19:04:45.507354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 19:04:45.507354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 27 19:04:45.507354 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.509192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-02be1b6b-002e-4d37-9487-1bbd7db16a0a tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:45.513108 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-02be1b6b-002e-4d37-9487-1bbd7db16a0a tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec/action" status: 400 len: 144 microversion: 2.1 time: 0.051662 Oct 27 19:04:45.513801 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2177/4152] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:04:45 2022] POST /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec/action => generated 144 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:04:45.529026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bc4862a3-e9cc-411b-aa22-157cf892f539 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bc4862a3-e9cc-411b-aa22-157cf892f539 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Request method failure captured: Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec/action HTTP/1.1 Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 31 Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtYkVce5yyED_9m68n-P1QgKVLVxxcKV7oy5inEoJOAsb4PeWzsdc3PKjKBVEQHhuAAheKkT6uh5E0YJRo1ZdXd70NBogvl6hL9JefQVn2vu2EBcVcmrKrUABZ3Q6RlYXVnkRDyGP5wbCVonF6x-1aas3RqPK6ZC0t9D3xG4KJm9TgM Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: b00a200c78784e8b94b9ce1d9967f1c5 Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b00a200c78784e8b94b9ce1d9967f1c5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: b00a200c78784e8b94b9ce1d9967f1c5 Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersAdminNegativeTestJSON-2117974073-project-admin Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e0aedc2a3cf74860b23680057359888d Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2117974073-project-admin Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: {"os-resetState": {"state": 1}} Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '7dac382c-7cdf-44b2-af5e-dc8f459aabec', 'body': {'os-resetState': {'state': 1}}} Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise error Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi 1 Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 27 19:04:45.549747 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.553961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:45.553961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.553961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:45.553961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:45.553961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:45.553961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 19:04:45.553961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 19:04:45.553961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 27 19:04:45.553961 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.553961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bc4862a3-e9cc-411b-aa22-157cf892f539 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:45.553961 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bc4862a3-e9cc-411b-aa22-157cf892f539 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec/action" status: 400 len: 120 microversion: 2.1 time: 0.030221 Oct 27 19:04:45.569166 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2178/4153] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:04:45 2022] POST /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec/action => generated 120 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:04:45.591885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-250ef91b-c932-4e68-a2b5-effc019cf9e0 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:45.597538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-28f89a94-de10-48af-bb1a-a8bf544420b0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:45.599676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-250ef91b-c932-4e68-a2b5-effc019cf9e0 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Failed to fetch instance by id 999 {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 19:04:45.601314 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-250ef91b-c932-4e68-a2b5-effc019cf9e0 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-250ef91b-c932-4e68-a2b5-effc019cf9e0 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Request method failure captured: Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 37 Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtYkVce5yyED_9m68n-P1QgKVLVxxcKV7oy5inEoJOAsb4PeWzsdc3PKjKBVEQHhuAAheKkT6uh5E0YJRo1ZdXd70NBogvl6hL9JefQVn2vu2EBcVcmrKrUABZ3Q6RlYXVnkRDyGP5wbCVonF6x-1aas3RqPK6ZC0t9D3xG4KJm9TgM Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: b00a200c78784e8b94b9ce1d9967f1c5 Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b00a200c78784e8b94b9ce1d9967f1c5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b00a200c78784e8b94b9ce1d9967f1c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: b00a200c78784e8b94b9ce1d9967f1c5 Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2117974073 Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersAdminNegativeTestJSON-2117974073-project-admin Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e0aedc2a3cf74860b23680057359888d Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2117974073-project-admin Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: {"os-resetState": {"state": "error"}} Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 999 could not be found. Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:45.615463 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:45.620528 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:45.620528 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 27 19:04:45.620528 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:45.620528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-250ef91b-c932-4e68-a2b5-effc019cf9e0 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:45.620814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-28f89a94-de10-48af-bb1a-a8bf544420b0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:45.620906 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-250ef91b-c932-4e68-a2b5-effc019cf9e0 tempest-ServersAdminNegativeTestJSON-2117974073 tempest-ServersAdminNegativeTestJSON-2117974073-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.049060 Oct 27 19:04:45.626047 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2179/4154] 10.222.0.42 () {60 vars in 1179 bytes} [Thu Oct 27 19:04:45 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:04:45.627486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-28f89a94-de10-48af-bb1a-a8bf544420b0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:45.632278 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-28f89a94-de10-48af-bb1a-a8bf544420b0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1408 microversion: 2.20 time: 0.431220 Oct 27 19:04:45.642453 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1976/4155] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:45 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1408 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:45.652754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-940026bf-7e22-4776-9153-c36672ba348e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:45.652754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-940026bf-7e22-4776-9153-c36672ba348e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:45.664951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-940026bf-7e22-4776-9153-c36672ba348e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:45.667690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-940026bf-7e22-4776-9153-c36672ba348e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:45.668291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-940026bf-7e22-4776-9153-c36672ba348e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:45.669144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-940026bf-7e22-4776-9153-c36672ba348e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:45.670956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-940026bf-7e22-4776-9153-c36672ba348e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:45.671797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-940026bf-7e22-4776-9153-c36672ba348e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:45.781179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-940026bf-7e22-4776-9153-c36672ba348e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:04:45.819568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-deab5f9f-94d0-4e78-9127-fc381817ffcd tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:45.821040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-deab5f9f-94d0-4e78-9127-fc381817ffcd tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:45.841492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-deab5f9f-94d0-4e78-9127-fc381817ffcd tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:45.842000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-deab5f9f-94d0-4e78-9127-fc381817ffcd tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:45.842474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-deab5f9f-94d0-4e78-9127-fc381817ffcd tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:45.852235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-deab5f9f-94d0-4e78-9127-fc381817ffcd tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:45.855345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-deab5f9f-94d0-4e78-9127-fc381817ffcd tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:45.855811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-deab5f9f-94d0-4e78-9127-fc381817ffcd tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:45.989969 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-940026bf-7e22-4776-9153-c36672ba348e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "DELETE /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 204 len: 0 microversion: 2.1 time: 0.359256 Oct 27 19:04:45.991731 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2180/4156] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:04:45 2022] DELETE /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:04:46.006530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fe7b9cb1-0f67-4093-ad13-44344a63bc15 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:46.009710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fe7b9cb1-0f67-4093-ad13-44344a63bc15 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:46.052053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe7b9cb1-0f67-4093-ad13-44344a63bc15 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:46.053714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe7b9cb1-0f67-4093-ad13-44344a63bc15 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:46.054531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe7b9cb1-0f67-4093-ad13-44344a63bc15 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:46.057390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe7b9cb1-0f67-4093-ad13-44344a63bc15 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:46.059204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe7b9cb1-0f67-4093-ad13-44344a63bc15 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:46.060846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe7b9cb1-0f67-4093-ad13-44344a63bc15 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:46.298198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-deab5f9f-94d0-4e78-9127-fc381817ffcd tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:46.314814 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-deab5f9f-94d0-4e78-9127-fc381817ffcd tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1367 microversion: 2.1 time: 0.503128 Oct 27 19:04:46.319424 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1977/4157] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:45 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1367 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:04:46.341404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-34a7c4ef-3a48-4db6-81f3-ed05d37b68de tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:46.342133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-34a7c4ef-3a48-4db6-81f3-ed05d37b68de tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:46.359545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34a7c4ef-3a48-4db6-81f3-ed05d37b68de tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:46.363006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34a7c4ef-3a48-4db6-81f3-ed05d37b68de tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:46.363995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34a7c4ef-3a48-4db6-81f3-ed05d37b68de tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:46.364969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34a7c4ef-3a48-4db6-81f3-ed05d37b68de tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:46.368632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34a7c4ef-3a48-4db6-81f3-ed05d37b68de tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:46.369362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34a7c4ef-3a48-4db6-81f3-ed05d37b68de tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:46.671876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fe7b9cb1-0f67-4093-ad13-44344a63bc15 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:46.680862 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fe7b9cb1-0f67-4093-ad13-44344a63bc15 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1467 microversion: 2.1 time: 0.684854 Oct 27 19:04:46.681455 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2181/4158] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:45 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1467 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:46.689152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6df86aa8-5d6d-4b35-84df-204565c443e5 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:46.689814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6df86aa8-5d6d-4b35-84df-204565c443e5 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:46.708805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6df86aa8-5d6d-4b35-84df-204565c443e5 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:46.709313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6df86aa8-5d6d-4b35-84df-204565c443e5 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:46.709772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6df86aa8-5d6d-4b35-84df-204565c443e5 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:46.710527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6df86aa8-5d6d-4b35-84df-204565c443e5 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:46.711004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6df86aa8-5d6d-4b35-84df-204565c443e5 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:46.711457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6df86aa8-5d6d-4b35-84df-204565c443e5 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:46.716289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-34a7c4ef-3a48-4db6-81f3-ed05d37b68de tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:46.728527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-34a7c4ef-3a48-4db6-81f3-ed05d37b68de tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:46.730676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-34a7c4ef-3a48-4db6-81f3-ed05d37b68de tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:46.732358 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-34a7c4ef-3a48-4db6-81f3-ed05d37b68de tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2956 microversion: 2.42 time: 0.394949 Oct 27 19:04:46.733483 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1978/4159] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:46 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2956 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:46.738603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b0b9fc94-039d-4eea-a89a-514d878c1414 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:46.740566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0b9fc94-039d-4eea-a89a-514d878c1414 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:46.747606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0b9fc94-039d-4eea-a89a-514d878c1414 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:46.748343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0b9fc94-039d-4eea-a89a-514d878c1414 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:46.749004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0b9fc94-039d-4eea-a89a-514d878c1414 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:46.750061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0b9fc94-039d-4eea-a89a-514d878c1414 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:46.750886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0b9fc94-039d-4eea-a89a-514d878c1414 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:46.751696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0b9fc94-039d-4eea-a89a-514d878c1414 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:46.830178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6df86aa8-5d6d-4b35-84df-204565c443e5 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:46.839559 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6df86aa8-5d6d-4b35-84df-204565c443e5 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1282 microversion: 2.1 time: 0.157054 Oct 27 19:04:46.844350 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2182/4160] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:46 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:46.926760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0b9fc94-039d-4eea-a89a-514d878c1414 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:46.939822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0b9fc94-039d-4eea-a89a-514d878c1414 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:46.942726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0b9fc94-039d-4eea-a89a-514d878c1414 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:46.944235 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b0b9fc94-039d-4eea-a89a-514d878c1414 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1408 microversion: 2.20 time: 0.209488 Oct 27 19:04:46.945057 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1979/4161] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:46 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:47.333408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-b0866e7b-3f9c-4ecd-a1ed-b1e4904278e8 req-2efd3ecb-9df0-46dc-8d17-e240320c3650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9", "tag": "37a53b22-60d3-4cbe-a630-561426159264"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:47.344205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b0866e7b-3f9c-4ecd-a1ed-b1e4904278e8 req-2efd3ecb-9df0-46dc-8d17-e240320c3650 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:47.345199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b0866e7b-3f9c-4ecd-a1ed-b1e4904278e8 req-2efd3ecb-9df0-46dc-8d17-e240320c3650 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:47.345870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b0866e7b-3f9c-4ecd-a1ed-b1e4904278e8 req-2efd3ecb-9df0-46dc-8d17-e240320c3650 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:47.346923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-defe986f-51c0-4655-a296-56715c109c89 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:47.350011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-defe986f-51c0-4655-a296-56715c109c89 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:47.368369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-defe986f-51c0-4655-a296-56715c109c89 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:47.370289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-defe986f-51c0-4655-a296-56715c109c89 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:47.370824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-defe986f-51c0-4655-a296-56715c109c89 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:47.374907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-defe986f-51c0-4655-a296-56715c109c89 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:47.375420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-defe986f-51c0-4655-a296-56715c109c89 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:47.375868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-defe986f-51c0-4655-a296-56715c109c89 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:47.378367 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-b0866e7b-3f9c-4ecd-a1ed-b1e4904278e8 req-2efd3ecb-9df0-46dc-8d17-e240320c3650 service nova] Creating event network-changed:37a53b22-60d3-4cbe-a630-561426159264 for instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 on n-h1-860687-3 Oct 27 19:04:47.386352 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-b0866e7b-3f9c-4ecd-a1ed-b1e4904278e8 req-2efd3ecb-9df0-46dc-8d17-e240320c3650 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059276 Oct 27 19:04:47.389501 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2183/4162] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:47.646378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-defe986f-51c0-4655-a296-56715c109c89 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:47.662796 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-defe986f-51c0-4655-a296-56715c109c89 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1367 microversion: 2.1 time: 0.322224 Oct 27 19:04:47.663400 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1980/4163] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:47 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:47.708400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f091055-a57e-4d82-8583-a56bd60025ad tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:47.709581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6f091055-a57e-4d82-8583-a56bd60025ad tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:47.723063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f091055-a57e-4d82-8583-a56bd60025ad tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:47.724865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f091055-a57e-4d82-8583-a56bd60025ad tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:47.725729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f091055-a57e-4d82-8583-a56bd60025ad tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:47.727125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f091055-a57e-4d82-8583-a56bd60025ad tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:47.727831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f091055-a57e-4d82-8583-a56bd60025ad tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:47.728783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f091055-a57e-4d82-8583-a56bd60025ad tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:47.766743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ede89ab0-7328-4562-b878-42a849dd6daa tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:47.767544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ede89ab0-7328-4562-b878-42a849dd6daa tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:47.781962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ede89ab0-7328-4562-b878-42a849dd6daa tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:47.788694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ede89ab0-7328-4562-b878-42a849dd6daa tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:47.789329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ede89ab0-7328-4562-b878-42a849dd6daa tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:47.796097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ede89ab0-7328-4562-b878-42a849dd6daa tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:47.797167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ede89ab0-7328-4562-b878-42a849dd6daa tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:47.799569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ede89ab0-7328-4562-b878-42a849dd6daa tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:47.886961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:48.235309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ede89ab0-7328-4562-b878-42a849dd6daa tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:48.253934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ede89ab0-7328-4562-b878-42a849dd6daa tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:48.255941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ede89ab0-7328-4562-b878-42a849dd6daa tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:48.259493 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ede89ab0-7328-4562-b878-42a849dd6daa tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2956 microversion: 2.42 time: 0.497705 Oct 27 19:04:48.265111 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1981/4164] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:47 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2956 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:48.277119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-7d7a89b2-445e-4c63-8338-71b9b909bbe1 req-71b11848-b90e-40de-a23e-829d8764fb7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-unplugged", "status": "completed", "tag": "09a712fe-98b4-4234-9815-ee2620c789f9"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:48.313051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7d7a89b2-445e-4c63-8338-71b9b909bbe1 req-71b11848-b90e-40de-a23e-829d8764fb7f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:48.313588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7d7a89b2-445e-4c63-8338-71b9b909bbe1 req-71b11848-b90e-40de-a23e-829d8764fb7f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:48.314051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7d7a89b2-445e-4c63-8338-71b9b909bbe1 req-71b11848-b90e-40de-a23e-829d8764fb7f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:48.332260 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-7d7a89b2-445e-4c63-8338-71b9b909bbe1 req-71b11848-b90e-40de-a23e-829d8764fb7f service nova] Creating event network-vif-unplugged:09a712fe-98b4-4234-9815-ee2620c789f9 for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:04:48.334087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6f091055-a57e-4d82-8583-a56bd60025ad tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:48.341237 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-7d7a89b2-445e-4c63-8338-71b9b909bbe1 req-71b11848-b90e-40de-a23e-829d8764fb7f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074548 Oct 27 19:04:48.342417 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1982/4165] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:48.343994 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6f091055-a57e-4d82-8583-a56bd60025ad tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1467 microversion: 2.1 time: 0.641119 Oct 27 19:04:48.344577 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2184/4166] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:47 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1467 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:48.362702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-77ad70f9-b4a8-430e-8527-17330b81ce76 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:48.364938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-77ad70f9-b4a8-430e-8527-17330b81ce76 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:48.368758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e135cb34-306f-453e-ab6f-10b12b0b8062 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:48.369521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e135cb34-306f-453e-ab6f-10b12b0b8062 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:48.374726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77ad70f9-b4a8-430e-8527-17330b81ce76 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:48.375484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77ad70f9-b4a8-430e-8527-17330b81ce76 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:48.376277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77ad70f9-b4a8-430e-8527-17330b81ce76 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:48.377977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77ad70f9-b4a8-430e-8527-17330b81ce76 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:48.378837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77ad70f9-b4a8-430e-8527-17330b81ce76 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:48.380039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77ad70f9-b4a8-430e-8527-17330b81ce76 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:48.397063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e135cb34-306f-453e-ab6f-10b12b0b8062 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:48.398663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e135cb34-306f-453e-ab6f-10b12b0b8062 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:48.399602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e135cb34-306f-453e-ab6f-10b12b0b8062 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:48.407433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e135cb34-306f-453e-ab6f-10b12b0b8062 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:48.407965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e135cb34-306f-453e-ab6f-10b12b0b8062 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:48.408417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e135cb34-306f-453e-ab6f-10b12b0b8062 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:48.556881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-77ad70f9-b4a8-430e-8527-17330b81ce76 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:48.569793 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-77ad70f9-b4a8-430e-8527-17330b81ce76 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1330 microversion: 2.1 time: 0.225243 Oct 27 19:04:48.571812 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1983/4167] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:48 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1330 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:48.688472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ab2ed04-6b3e-4ba4-b816-2f6e582228de tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:48.689098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5ab2ed04-6b3e-4ba4-b816-2f6e582228de tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:48.698806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab2ed04-6b3e-4ba4-b816-2f6e582228de tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:48.699209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab2ed04-6b3e-4ba4-b816-2f6e582228de tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:48.703269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab2ed04-6b3e-4ba4-b816-2f6e582228de tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:48.704078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab2ed04-6b3e-4ba4-b816-2f6e582228de tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:48.704556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab2ed04-6b3e-4ba4-b816-2f6e582228de tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:48.704992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ab2ed04-6b3e-4ba4-b816-2f6e582228de tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:48.986801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e135cb34-306f-453e-ab6f-10b12b0b8062 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:49.002547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e135cb34-306f-453e-ab6f-10b12b0b8062 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:49.011813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e135cb34-306f-453e-ab6f-10b12b0b8062 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:49.015949 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e135cb34-306f-453e-ab6f-10b12b0b8062 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1600 microversion: 2.20 time: 0.661172 Oct 27 19:04:49.026772 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2185/4168] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:48 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1600 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:49.048843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a0ad1a8c-58b4-4bfe-979e-7081ad59aacc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:49.058793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a0ad1a8c-58b4-4bfe-979e-7081ad59aacc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:49.066258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ad1a8c-58b4-4bfe-979e-7081ad59aacc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:49.067107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ad1a8c-58b4-4bfe-979e-7081ad59aacc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:49.067743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ad1a8c-58b4-4bfe-979e-7081ad59aacc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:49.068853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ad1a8c-58b4-4bfe-979e-7081ad59aacc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:49.069662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ad1a8c-58b4-4bfe-979e-7081ad59aacc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:49.070363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ad1a8c-58b4-4bfe-979e-7081ad59aacc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:49.139735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5ab2ed04-6b3e-4ba4-b816-2f6e582228de tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:49.149606 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5ab2ed04-6b3e-4ba4-b816-2f6e582228de tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1367 microversion: 2.1 time: 0.465014 Oct 27 19:04:49.150199 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1984/4169] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:48 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1367 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:04:49.295415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fdbc6ffd-3630-43a4-99b4-7c757bc0c2fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:49.296031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fdbc6ffd-3630-43a4-99b4-7c757bc0c2fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:49.310439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdbc6ffd-3630-43a4-99b4-7c757bc0c2fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:49.315922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdbc6ffd-3630-43a4-99b4-7c757bc0c2fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:49.315922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdbc6ffd-3630-43a4-99b4-7c757bc0c2fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:49.316456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdbc6ffd-3630-43a4-99b4-7c757bc0c2fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:49.327723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdbc6ffd-3630-43a4-99b4-7c757bc0c2fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:49.328446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdbc6ffd-3630-43a4-99b4-7c757bc0c2fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:49.440311 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a0ad1a8c-58b4-4bfe-979e-7081ad59aacc tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.395292 Oct 27 19:04:49.441228 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2186/4170] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Oct 27 19:04:49 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79/os-interface => generated 284 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 19:04:49.447616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eade6f69-e3f5-410a-bf67-e7dd10cc3773 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:49.448561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-eade6f69-e3f5-410a-bf67-e7dd10cc3773 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:49.468369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eade6f69-e3f5-410a-bf67-e7dd10cc3773 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:49.469474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eade6f69-e3f5-410a-bf67-e7dd10cc3773 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:49.470493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eade6f69-e3f5-410a-bf67-e7dd10cc3773 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:49.471598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eade6f69-e3f5-410a-bf67-e7dd10cc3773 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:49.472979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eade6f69-e3f5-410a-bf67-e7dd10cc3773 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:49.485276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eade6f69-e3f5-410a-bf67-e7dd10cc3773 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:50.470785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fdbc6ffd-3630-43a4-99b4-7c757bc0c2fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:50.484638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fdbc6ffd-3630-43a4-99b4-7c757bc0c2fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:50.492395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fdbc6ffd-3630-43a4-99b4-7c757bc0c2fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:50.494272 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fdbc6ffd-3630-43a4-99b4-7c757bc0c2fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2935 microversion: 2.42 time: 1.203537 Oct 27 19:04:50.495370 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1985/4171] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:49 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2935 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:04:50.500404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-65ffddef-bc6c-4e09-a205-f9ef5823e563 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:50.505171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-65ffddef-bc6c-4e09-a205-f9ef5823e563 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:50.520607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ffddef-bc6c-4e09-a205-f9ef5823e563 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:50.521387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ffddef-bc6c-4e09-a205-f9ef5823e563 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:50.521844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ffddef-bc6c-4e09-a205-f9ef5823e563 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:50.522615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ffddef-bc6c-4e09-a205-f9ef5823e563 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:50.523285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ffddef-bc6c-4e09-a205-f9ef5823e563 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:50.524059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ffddef-bc6c-4e09-a205-f9ef5823e563 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:50.774771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-eade6f69-e3f5-410a-bf67-e7dd10cc3773 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:50.798900 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eade6f69-e3f5-410a-bf67-e7dd10cc3773 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 200 len: 1425 microversion: 2.1 time: 1.353122 Oct 27 19:04:50.804374 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2187/4172] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:49 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 1425 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:50.814358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a4854bb7-075b-475e-b21e-7c83ed8b55ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:50.815297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a4854bb7-075b-475e-b21e-7c83ed8b55ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:50.831358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4854bb7-075b-475e-b21e-7c83ed8b55ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:50.832227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4854bb7-075b-475e-b21e-7c83ed8b55ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:50.836224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4854bb7-075b-475e-b21e-7c83ed8b55ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:50.837734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4854bb7-075b-475e-b21e-7c83ed8b55ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:50.838440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4854bb7-075b-475e-b21e-7c83ed8b55ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:50.839073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4854bb7-075b-475e-b21e-7c83ed8b55ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:50.843304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-65ffddef-bc6c-4e09-a205-f9ef5823e563 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:50.855275 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-65ffddef-bc6c-4e09-a205-f9ef5823e563 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1336 microversion: 2.1 time: 0.358586 Oct 27 19:04:50.859818 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1986/4173] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:50 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1336 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:50.884221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-4e21f1db-8755-431e-a4c5-d217b7440acb req-a953a3fc-f199-42da-a1b4-d07194348ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08376c5b-32eb-4676-ac6b-f29f971cda31", "name": "network-vif-deleted", "tag": "1e3ef788-9aeb-41ff-915b-70e35dff85a9"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:50.905274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4e21f1db-8755-431e-a4c5-d217b7440acb req-a953a3fc-f199-42da-a1b4-d07194348ff2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:50.916899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4e21f1db-8755-431e-a4c5-d217b7440acb req-a953a3fc-f199-42da-a1b4-d07194348ff2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:50.917632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4e21f1db-8755-431e-a4c5-d217b7440acb req-a953a3fc-f199-42da-a1b4-d07194348ff2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:50.958407 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-4e21f1db-8755-431e-a4c5-d217b7440acb req-a953a3fc-f199-42da-a1b4-d07194348ff2 service nova] Creating event network-vif-deleted:1e3ef788-9aeb-41ff-915b-70e35dff85a9 for instance 08376c5b-32eb-4676-ac6b-f29f971cda31 on n-h2-860687-3 Oct 27 19:04:50.969441 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-4e21f1db-8755-431e-a4c5-d217b7440acb req-a953a3fc-f199-42da-a1b4-d07194348ff2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102671 Oct 27 19:04:50.972546 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1987/4174] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:50.988027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-140ab2cc-7611-4601-93ae-b63f0b8a0121 req-00e6d721-2aa3-4581-af8d-f3ea81e30b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-unplugged", "status": "completed", "tag": "2ab12411-7d95-4e74-8e80-f62b068f58be"}, {"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-unplugged", "status": "completed", "tag": "5caa00b6-63fd-476a-9d5a-0faa8aa4baad"}, {"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-unplugged", "status": "completed", "tag": "2a34a33b-11c6-4dcd-a52b-4a26af50fc18"}, {"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-unplugged", "status": "completed", "tag": "932a9230-1751-47ce-9693-0eddb2a30ee1"}, {"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-unplugged", "status": "completed", "tag": "84b5f126-b4b7-4b2f-9238-d2b20b3ec67d"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:51.008346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-140ab2cc-7611-4601-93ae-b63f0b8a0121 req-00e6d721-2aa3-4581-af8d-f3ea81e30b34 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:51.008848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-140ab2cc-7611-4601-93ae-b63f0b8a0121 req-00e6d721-2aa3-4581-af8d-f3ea81e30b34 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:51.009334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-140ab2cc-7611-4601-93ae-b63f0b8a0121 req-00e6d721-2aa3-4581-af8d-f3ea81e30b34 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:51.043891 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-140ab2cc-7611-4601-93ae-b63f0b8a0121 req-00e6d721-2aa3-4581-af8d-f3ea81e30b34 service nova] Creating event network-vif-unplugged:2ab12411-7d95-4e74-8e80-f62b068f58be for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:04:51.044635 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-140ab2cc-7611-4601-93ae-b63f0b8a0121 req-00e6d721-2aa3-4581-af8d-f3ea81e30b34 service nova] Creating event network-vif-unplugged:5caa00b6-63fd-476a-9d5a-0faa8aa4baad for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:04:51.045306 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-140ab2cc-7611-4601-93ae-b63f0b8a0121 req-00e6d721-2aa3-4581-af8d-f3ea81e30b34 service nova] Creating event network-vif-unplugged:2a34a33b-11c6-4dcd-a52b-4a26af50fc18 for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:04:51.046235 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-140ab2cc-7611-4601-93ae-b63f0b8a0121 req-00e6d721-2aa3-4581-af8d-f3ea81e30b34 service nova] Creating event network-vif-unplugged:932a9230-1751-47ce-9693-0eddb2a30ee1 for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:04:51.046919 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-140ab2cc-7611-4601-93ae-b63f0b8a0121 req-00e6d721-2aa3-4581-af8d-f3ea81e30b34 service nova] Creating event network-vif-unplugged:84b5f126-b4b7-4b2f-9238-d2b20b3ec67d for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:04:51.060344 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-140ab2cc-7611-4601-93ae-b63f0b8a0121 req-00e6d721-2aa3-4581-af8d-f3ea81e30b34 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.078101 Oct 27 19:04:51.061242 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1988/4175] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:51.527695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c472f49f-6cd6-41ef-90be-6f1bc12a9ed1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:51.528357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c472f49f-6cd6-41ef-90be-6f1bc12a9ed1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:51.545616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c472f49f-6cd6-41ef-90be-6f1bc12a9ed1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:51.546127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c472f49f-6cd6-41ef-90be-6f1bc12a9ed1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:51.546937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c472f49f-6cd6-41ef-90be-6f1bc12a9ed1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:51.548027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c472f49f-6cd6-41ef-90be-6f1bc12a9ed1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:51.551626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c472f49f-6cd6-41ef-90be-6f1bc12a9ed1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:51.552346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c472f49f-6cd6-41ef-90be-6f1bc12a9ed1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:51.663174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a4854bb7-075b-475e-b21e-7c83ed8b55ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:51.673422 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a4854bb7-075b-475e-b21e-7c83ed8b55ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1367 microversion: 2.1 time: 0.867715 Oct 27 19:04:51.681050 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2188/4176] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:50 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1367 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:51.830444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-18c7f175-3191-4eac-9bda-2cc26ef546b0 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:51.831225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-18c7f175-3191-4eac-9bda-2cc26ef546b0 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 08376c5b-32eb-4676-ac6b-f29f971cda31] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:51.866193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c7f175-3191-4eac-9bda-2cc26ef546b0 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:51.871622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c7f175-3191-4eac-9bda-2cc26ef546b0 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:51.872577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c7f175-3191-4eac-9bda-2cc26ef546b0 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:51.874100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c7f175-3191-4eac-9bda-2cc26ef546b0 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:51.876417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c7f175-3191-4eac-9bda-2cc26ef546b0 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:51.877955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18c7f175-3191-4eac-9bda-2cc26ef546b0 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:51.917227 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-18c7f175-3191-4eac-9bda-2cc26ef546b0 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] HTTP exception thrown: Instance 08376c5b-32eb-4676-ac6b-f29f971cda31 could not be found. Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-18c7f175-3191-4eac-9bda-2cc26ef546b0 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Request method failure captured: Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 HTTP/1.1 Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtYkLNry1UttMdDSKkjDx_4sgXtq2WKex1FIqWNmtuKwdlPAm5KZXcxAp5l61EwqDbxMryg9nHYgSyEM_WtaQXkrC2rG9rfPGTXM0hJoeuCM-9nZiYvEdGGZPGOR2mSP6Sl1Wm9DITK4A3C4hdNNiTL1CqajkBx5HPsDOnqHouu2uBU Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 205376348cc54a0aaa4e6c16ba2a86c3 Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1664299762 Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/205376348cc54a0aaa4e6c16ba2a86c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/205376348cc54a0aaa4e6c16ba2a86c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_205376348cc54a0aaa4e6c16ba2a86c3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/205376348cc54a0aaa4e6c16ba2a86c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1664299762 Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 205376348cc54a0aaa4e6c16ba2a86c3 Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1664299762 Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersAdminNegativeTestJSON-1664299762-project Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 9a92df7118a54f49bc7c623b4451e498 Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1664299762-project Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 08376c5b-32eb-4676-ac6b-f29f971cda31 could not be found. Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '08376c5b-32eb-4676-ac6b-f29f971cda31'} Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08376c5b-32eb-4676-ac6b-f29f971cda31 could not be found. Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08376c5b-32eb-4676-ac6b-f29f971cda31 could not be found. Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:51.923971 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:51.929605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:51.929605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:51.929605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:51.929605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:51.929605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:51.929605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:51.929605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08376c5b-32eb-4676-ac6b-f29f971cda31 could not be found. Oct 27 19:04:51.929605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:04:51.934833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-18c7f175-3191-4eac-9bda-2cc26ef546b0 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Returning 404 to user: Instance 08376c5b-32eb-4676-ac6b-f29f971cda31 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:51.936947 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-18c7f175-3191-4eac-9bda-2cc26ef546b0 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31" status: 404 len: 111 microversion: 2.1 time: 0.112153 Oct 27 19:04:51.945827 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2189/4177] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:51 2022] GET /compute/v2.1/servers/08376c5b-32eb-4676-ac6b-f29f971cda31 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:04:51.952030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-061babe6-1580-4b1b-8eff-d0521ca1f993 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:51.958194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-061babe6-1580-4b1b-8eff-d0521ca1f993 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:51.979223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-061babe6-1580-4b1b-8eff-d0521ca1f993 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:51.979741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-061babe6-1580-4b1b-8eff-d0521ca1f993 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:51.982866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-061babe6-1580-4b1b-8eff-d0521ca1f993 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:51.983632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-061babe6-1580-4b1b-8eff-d0521ca1f993 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:51.984117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-061babe6-1580-4b1b-8eff-d0521ca1f993 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:51.990496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-061babe6-1580-4b1b-8eff-d0521ca1f993 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:52.063040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c472f49f-6cd6-41ef-90be-6f1bc12a9ed1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:52.075775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c472f49f-6cd6-41ef-90be-6f1bc12a9ed1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:52.078637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c472f49f-6cd6-41ef-90be-6f1bc12a9ed1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:52.084122 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c472f49f-6cd6-41ef-90be-6f1bc12a9ed1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2935 microversion: 2.42 time: 0.559178 Oct 27 19:04:52.084740 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1989/4178] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:51 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2935 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:52.112728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5635b94a-e2a5-4b18-abbd-ede0b81be6c6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:52.112728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5635b94a-e2a5-4b18-abbd-ede0b81be6c6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:52.132719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5635b94a-e2a5-4b18-abbd-ede0b81be6c6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:52.136505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5635b94a-e2a5-4b18-abbd-ede0b81be6c6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:52.137493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5635b94a-e2a5-4b18-abbd-ede0b81be6c6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:52.138500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5635b94a-e2a5-4b18-abbd-ede0b81be6c6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:52.140081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5635b94a-e2a5-4b18-abbd-ede0b81be6c6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:52.141405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5635b94a-e2a5-4b18-abbd-ede0b81be6c6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:52.241209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5635b94a-e2a5-4b18-abbd-ede0b81be6c6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:04:52.541736 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5635b94a-e2a5-4b18-abbd-ede0b81be6c6 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 204 len: 0 microversion: 2.1 time: 0.440294 Oct 27 19:04:52.542703 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1990/4179] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:04:52 2022] DELETE /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:04:52.556516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-366d47db-b6a6-40cc-9ca7-75c9e5f4bbb8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:52.556635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-366d47db-b6a6-40cc-9ca7-75c9e5f4bbb8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:52.564005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-366d47db-b6a6-40cc-9ca7-75c9e5f4bbb8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:52.564713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-366d47db-b6a6-40cc-9ca7-75c9e5f4bbb8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:52.565335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-366d47db-b6a6-40cc-9ca7-75c9e5f4bbb8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:52.566247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-366d47db-b6a6-40cc-9ca7-75c9e5f4bbb8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:52.567061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-366d47db-b6a6-40cc-9ca7-75c9e5f4bbb8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:52.568028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-366d47db-b6a6-40cc-9ca7-75c9e5f4bbb8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:52.900116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-061babe6-1580-4b1b-8eff-d0521ca1f993 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:52.917702 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-061babe6-1580-4b1b-8eff-d0521ca1f993 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1404 microversion: 2.1 time: 0.966840 Oct 27 19:04:52.918361 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2190/4180] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:51 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1404 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:52.931467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b4344e7f-b10a-40a7-adae-f187d0d5dcd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:52.932116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b4344e7f-b10a-40a7-adae-f187d0d5dcd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:52.958436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4344e7f-b10a-40a7-adae-f187d0d5dcd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:52.959823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4344e7f-b10a-40a7-adae-f187d0d5dcd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:52.961797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4344e7f-b10a-40a7-adae-f187d0d5dcd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:52.965942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4344e7f-b10a-40a7-adae-f187d0d5dcd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:52.967130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4344e7f-b10a-40a7-adae-f187d0d5dcd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:52.970023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4344e7f-b10a-40a7-adae-f187d0d5dcd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:53.020587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:53.067707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-366d47db-b6a6-40cc-9ca7-75c9e5f4bbb8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:53.077381 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-366d47db-b6a6-40cc-9ca7-75c9e5f4bbb8 tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 200 len: 1476 microversion: 2.1 time: 0.530077 Oct 27 19:04:53.084514 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1991/4181] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:52 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 1476 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:53.114568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7c718845-22cb-434d-9c15-c8d2e601c65a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:53.115209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7c718845-22cb-434d-9c15-c8d2e601c65a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:53.138310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c718845-22cb-434d-9c15-c8d2e601c65a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:53.138844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c718845-22cb-434d-9c15-c8d2e601c65a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:53.139290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c718845-22cb-434d-9c15-c8d2e601c65a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:53.140013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c718845-22cb-434d-9c15-c8d2e601c65a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:53.140478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c718845-22cb-434d-9c15-c8d2e601c65a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:53.140914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c718845-22cb-434d-9c15-c8d2e601c65a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:53.282984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4344e7f-b10a-40a7-adae-f187d0d5dcd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:53.292273 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b4344e7f-b10a-40a7-adae-f187d0d5dcd1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1367 microversion: 2.1 time: 0.368008 Oct 27 19:04:53.296050 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2191/4182] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:52 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:53.689935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7c718845-22cb-434d-9c15-c8d2e601c65a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:53.700209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7c718845-22cb-434d-9c15-c8d2e601c65a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:53.701685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7c718845-22cb-434d-9c15-c8d2e601c65a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:53.703019 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7c718845-22cb-434d-9c15-c8d2e601c65a tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2914 microversion: 2.42 time: 0.593320 Oct 27 19:04:53.711005 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1992/4183] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:53 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2914 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:04:53.941814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-19f9d8fe-3b0c-4113-9495-2eff13cbdf17 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:53.943825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-19f9d8fe-3b0c-4113-9495-2eff13cbdf17 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:53.963468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19f9d8fe-3b0c-4113-9495-2eff13cbdf17 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:53.964326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19f9d8fe-3b0c-4113-9495-2eff13cbdf17 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:53.964929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19f9d8fe-3b0c-4113-9495-2eff13cbdf17 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:53.965812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19f9d8fe-3b0c-4113-9495-2eff13cbdf17 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:53.972923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19f9d8fe-3b0c-4113-9495-2eff13cbdf17 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:53.973835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19f9d8fe-3b0c-4113-9495-2eff13cbdf17 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:54.112073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-604de48b-c015-433b-b15d-62fba4c3119e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:54.112804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-604de48b-c015-433b-b15d-62fba4c3119e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:54.124724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-604de48b-c015-433b-b15d-62fba4c3119e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:54.131584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-604de48b-c015-433b-b15d-62fba4c3119e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:54.133035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-604de48b-c015-433b-b15d-62fba4c3119e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:54.134733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-604de48b-c015-433b-b15d-62fba4c3119e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:54.136011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-604de48b-c015-433b-b15d-62fba4c3119e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:54.137351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-604de48b-c015-433b-b15d-62fba4c3119e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:54.215945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:54.806898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-604de48b-c015-433b-b15d-62fba4c3119e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:54.816459 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-604de48b-c015-433b-b15d-62fba4c3119e tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 200 len: 1434 microversion: 2.1 time: 0.708685 Oct 27 19:04:54.822173 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1993/4184] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:54 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 1434 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:54.828546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-202be433-043e-4452-be68-2728d500e467 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:54.836067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-202be433-043e-4452-be68-2728d500e467 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:54.845488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:54.864347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-202be433-043e-4452-be68-2728d500e467 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:54.864856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-202be433-043e-4452-be68-2728d500e467 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:54.865310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-202be433-043e-4452-be68-2728d500e467 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:54.866046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-202be433-043e-4452-be68-2728d500e467 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:54.874466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-202be433-043e-4452-be68-2728d500e467 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:54.875119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-202be433-043e-4452-be68-2728d500e467 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:54.927312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=16 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:55.438740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=12 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:55.564101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-19f9d8fe-3b0c-4113-9495-2eff13cbdf17 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:55.582280 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-19f9d8fe-3b0c-4113-9495-2eff13cbdf17 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1404 microversion: 2.1 time: 1.644793 Oct 27 19:04:55.587673 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2192/4185] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:53 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1404 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:55.624585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5db96745-1077-44ba-93f9-7d6610be9fe4 req-6059a416-7514-4159-a883-ed9a5f6bda0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9", "name": "network-vif-plugged", "status": "completed", "tag": "37a53b22-60d3-4cbe-a630-561426159264"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:55.636554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5db96745-1077-44ba-93f9-7d6610be9fe4 req-6059a416-7514-4159-a883-ed9a5f6bda0b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:55.644060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5db96745-1077-44ba-93f9-7d6610be9fe4 req-6059a416-7514-4159-a883-ed9a5f6bda0b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:55.647150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5db96745-1077-44ba-93f9-7d6610be9fe4 req-6059a416-7514-4159-a883-ed9a5f6bda0b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:55.670137 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5db96745-1077-44ba-93f9-7d6610be9fe4 req-6059a416-7514-4159-a883-ed9a5f6bda0b service nova] Creating event network-vif-plugged:37a53b22-60d3-4cbe-a630-561426159264 for instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 on n-h1-860687-3 Oct 27 19:04:55.696070 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5db96745-1077-44ba-93f9-7d6610be9fe4 req-6059a416-7514-4159-a883-ed9a5f6bda0b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078171 Oct 27 19:04:55.697626 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2193/4186] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:55.719492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bca24271-5af5-466a-8874-b84e6c1f82a1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:55.762221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bca24271-5af5-466a-8874-b84e6c1f82a1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:55.776301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bca24271-5af5-466a-8874-b84e6c1f82a1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:55.781280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bca24271-5af5-466a-8874-b84e6c1f82a1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:55.783809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bca24271-5af5-466a-8874-b84e6c1f82a1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:55.784835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bca24271-5af5-466a-8874-b84e6c1f82a1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:55.794464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-202be433-043e-4452-be68-2728d500e467 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:55.794666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bca24271-5af5-466a-8874-b84e6c1f82a1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:55.794666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bca24271-5af5-466a-8874-b84e6c1f82a1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:55.836494 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-202be433-043e-4452-be68-2728d500e467 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1367 microversion: 2.1 time: 1.013089 Oct 27 19:04:55.839097 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1994/4187] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:54 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1367 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:55.862164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-eb5f6217-fb1d-4f36-bbcc-1a28c6918544 req-437e4b00-4411-452b-9eb7-42f31a360c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3567a7a-6f12-4d01-a9b1-adcb0310bd10", "tag": "37e8973e-da31-49a3-8c92-aa75229fb28f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:55.896854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-eb5f6217-fb1d-4f36-bbcc-1a28c6918544 req-437e4b00-4411-452b-9eb7-42f31a360c95 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:55.897555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-eb5f6217-fb1d-4f36-bbcc-1a28c6918544 req-437e4b00-4411-452b-9eb7-42f31a360c95 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:55.898147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-eb5f6217-fb1d-4f36-bbcc-1a28c6918544 req-437e4b00-4411-452b-9eb7-42f31a360c95 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:55.929325 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-eb5f6217-fb1d-4f36-bbcc-1a28c6918544 req-437e4b00-4411-452b-9eb7-42f31a360c95 service nova] Creating event network-changed:37e8973e-da31-49a3-8c92-aa75229fb28f for instance b3567a7a-6f12-4d01-a9b1-adcb0310bd10 on n-h2-860687-3 Oct 27 19:04:55.948354 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-eb5f6217-fb1d-4f36-bbcc-1a28c6918544 req-437e4b00-4411-452b-9eb7-42f31a360c95 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106458 Oct 27 19:04:55.952787 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1995/4188] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:55.971263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-68f594e0-a63e-411f-978a-63d3146ad6c3 req-6bcad2a9-320b-406c-871e-e8bd92efbc27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b128ff-a00c-4607-8088-1988263fbe79", "tag": "2beafeb2-d863-4916-9b9f-2b9876bdf5ff"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:56.005017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-68f594e0-a63e-411f-978a-63d3146ad6c3 req-6bcad2a9-320b-406c-871e-e8bd92efbc27 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:56.010230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-68f594e0-a63e-411f-978a-63d3146ad6c3 req-6bcad2a9-320b-406c-871e-e8bd92efbc27 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:56.011601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-68f594e0-a63e-411f-978a-63d3146ad6c3 req-6bcad2a9-320b-406c-871e-e8bd92efbc27 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:56.050887 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-68f594e0-a63e-411f-978a-63d3146ad6c3 req-6bcad2a9-320b-406c-871e-e8bd92efbc27 service nova] Creating event network-changed:2beafeb2-d863-4916-9b9f-2b9876bdf5ff for instance 96b128ff-a00c-4607-8088-1988263fbe79 on n-h2-860687-3 Oct 27 19:04:56.062258 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-68f594e0-a63e-411f-978a-63d3146ad6c3 req-6bcad2a9-320b-406c-871e-e8bd92efbc27 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107682 Oct 27 19:04:56.062931 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1996/4189] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:56.076376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-68460b47-2f23-48bd-bae4-07326d2e74dc tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:56.077114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-68460b47-2f23-48bd-bae4-07326d2e74dc tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:56.088512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68460b47-2f23-48bd-bae4-07326d2e74dc tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:56.089279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68460b47-2f23-48bd-bae4-07326d2e74dc tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:56.089906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68460b47-2f23-48bd-bae4-07326d2e74dc tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:56.091293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68460b47-2f23-48bd-bae4-07326d2e74dc tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:56.091995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68460b47-2f23-48bd-bae4-07326d2e74dc tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:56.092603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68460b47-2f23-48bd-bae4-07326d2e74dc tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:56.177613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68460b47-2f23-48bd-bae4-07326d2e74dc tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:56.183135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68460b47-2f23-48bd-bae4-07326d2e74dc tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:56.185576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68460b47-2f23-48bd-bae4-07326d2e74dc tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:56.187612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-68460b47-2f23-48bd-bae4-07326d2e74dc tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lazy-loading 'fault' on Instance uuid 7dac382c-7cdf-44b2-af5e-dc8f459aabec {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:04:56.344671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-68460b47-2f23-48bd-bae4-07326d2e74dc tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a92df7118a54f49bc7c623b4451e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205376348cc54a0aaa4e6c16ba2a86c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:56.359035 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-68460b47-2f23-48bd-bae4-07326d2e74dc tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 200 len: 1311 microversion: 2.1 time: 0.292524 Oct 27 19:04:56.359646 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1997/4190] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:56 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 1311 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:56.387450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bca24271-5af5-466a-8874-b84e6c1f82a1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:56.409222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bca24271-5af5-466a-8874-b84e6c1f82a1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:56.416654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bca24271-5af5-466a-8874-b84e6c1f82a1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:56.422119 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bca24271-5af5-466a-8874-b84e6c1f82a1 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2914 microversion: 2.42 time: 0.717760 Oct 27 19:04:56.425308 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2194/4191] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:55 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2914 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:56.611036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7af23459-a39c-4264-8531-b4eeb111ce14 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:56.612026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7af23459-a39c-4264-8531-b4eeb111ce14 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:56.628856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7af23459-a39c-4264-8531-b4eeb111ce14 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:56.629905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7af23459-a39c-4264-8531-b4eeb111ce14 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:56.630364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7af23459-a39c-4264-8531-b4eeb111ce14 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:56.632230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7af23459-a39c-4264-8531-b4eeb111ce14 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:56.632870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7af23459-a39c-4264-8531-b4eeb111ce14 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:56.633255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7af23459-a39c-4264-8531-b4eeb111ce14 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:56.863542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c43a840c-c679-4bec-ae29-6f0553431fee tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:56.865066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c43a840c-c679-4bec-ae29-6f0553431fee tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:56.881031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c43a840c-c679-4bec-ae29-6f0553431fee tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:56.881782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c43a840c-c679-4bec-ae29-6f0553431fee tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:56.882454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c43a840c-c679-4bec-ae29-6f0553431fee tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:56.883357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c43a840c-c679-4bec-ae29-6f0553431fee tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:56.883989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c43a840c-c679-4bec-ae29-6f0553431fee tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:56.884594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c43a840c-c679-4bec-ae29-6f0553431fee tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:57.073328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7af23459-a39c-4264-8531-b4eeb111ce14 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:57.099019 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7af23459-a39c-4264-8531-b4eeb111ce14 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1404 microversion: 2.1 time: 0.491801 Oct 27 19:04:57.107429 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1998/4192] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:56 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:57.340945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c43a840c-c679-4bec-ae29-6f0553431fee tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:57.356225 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c43a840c-c679-4bec-ae29-6f0553431fee tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1367 microversion: 2.1 time: 0.496497 Oct 27 19:04:57.358989 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2195/4193] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:56 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1367 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:04:57.388265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9172a77-8a51-4cf3-819b-90fceabfd3ee tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:57.389280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c9172a77-8a51-4cf3-819b-90fceabfd3ee tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] [instance: 7dac382c-7cdf-44b2-af5e-dc8f459aabec] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:57.398684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9172a77-8a51-4cf3-819b-90fceabfd3ee tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:57.402050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9172a77-8a51-4cf3-819b-90fceabfd3ee tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:57.405039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9172a77-8a51-4cf3-819b-90fceabfd3ee tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:57.406307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9172a77-8a51-4cf3-819b-90fceabfd3ee tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:57.406984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9172a77-8a51-4cf3-819b-90fceabfd3ee tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:57.409230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9172a77-8a51-4cf3-819b-90fceabfd3ee tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:57.455354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-786fb6c8-98bb-4e09-b498-15fc0201eb56 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:57.455744 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-c9172a77-8a51-4cf3-819b-90fceabfd3ee tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] HTTP exception thrown: Instance 7dac382c-7cdf-44b2-af5e-dc8f459aabec could not be found. Oct 27 19:04:57.455992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-786fb6c8-98bb-4e09-b498-15fc0201eb56 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9172a77-8a51-4cf3-819b-90fceabfd3ee tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Request method failure captured: Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec HTTP/1.1 Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtYkLNry1UttMdDSKkjDx_4sgXtq2WKex1FIqWNmtuKwdlPAm5KZXcxAp5l61EwqDbxMryg9nHYgSyEM_WtaQXkrC2rG9rfPGTXM0hJoeuCM-9nZiYvEdGGZPGOR2mSP6Sl1Wm9DITK4A3C4hdNNiTL1CqajkBx5HPsDOnqHouu2uBU Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 205376348cc54a0aaa4e6c16ba2a86c3 Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1664299762 Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/205376348cc54a0aaa4e6c16ba2a86c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/205376348cc54a0aaa4e6c16ba2a86c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_205376348cc54a0aaa4e6c16ba2a86c3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/205376348cc54a0aaa4e6c16ba2a86c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1664299762 Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 205376348cc54a0aaa4e6c16ba2a86c3 Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1664299762 Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersAdminNegativeTestJSON-1664299762-project Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 9a92df7118a54f49bc7c623b4451e498 Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1664299762-project Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 7dac382c-7cdf-44b2-af5e-dc8f459aabec could not be found. Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '7dac382c-7cdf-44b2-af5e-dc8f459aabec'} Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dac382c-7cdf-44b2-af5e-dc8f459aabec could not be found. Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dac382c-7cdf-44b2-af5e-dc8f459aabec could not be found. Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:57.458650 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:04:57.462590 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:57.462590 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:04:57.462590 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:04:57.462590 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:04:57.462590 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:04:57.462590 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:04:57.462590 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dac382c-7cdf-44b2-af5e-dc8f459aabec could not be found. Oct 27 19:04:57.462590 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:04:57.463566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-786fb6c8-98bb-4e09-b498-15fc0201eb56 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:57.464745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9172a77-8a51-4cf3-819b-90fceabfd3ee tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] Returning 404 to user: Instance 7dac382c-7cdf-44b2-af5e-dc8f459aabec could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:04:57.465706 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c9172a77-8a51-4cf3-819b-90fceabfd3ee tempest-ServersAdminNegativeTestJSON-1664299762 tempest-ServersAdminNegativeTestJSON-1664299762-project] 10.222.0.42 "GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec" status: 404 len: 111 microversion: 2.1 time: 0.082715 Oct 27 19:04:57.466378 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1999/4194] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:57 2022] GET /compute/v2.1/servers/7dac382c-7cdf-44b2-af5e-dc8f459aabec => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:04:57.467128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-786fb6c8-98bb-4e09-b498-15fc0201eb56 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:57.467638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-786fb6c8-98bb-4e09-b498-15fc0201eb56 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:57.468397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-786fb6c8-98bb-4e09-b498-15fc0201eb56 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:57.468926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-786fb6c8-98bb-4e09-b498-15fc0201eb56 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:57.470776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-786fb6c8-98bb-4e09-b498-15fc0201eb56 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:57.834935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-786fb6c8-98bb-4e09-b498-15fc0201eb56 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:57.854086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-786fb6c8-98bb-4e09-b498-15fc0201eb56 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:57.860709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-786fb6c8-98bb-4e09-b498-15fc0201eb56 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:57.862735 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-786fb6c8-98bb-4e09-b498-15fc0201eb56 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2868 microversion: 2.42 time: 0.410904 Oct 27 19:04:57.863963 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2196/4195] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:57 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2868 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:04:57.978202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-3d930fac-a7a6-4d08-9657-6f3f17c07a27 req-d0cf34ca-e684-4d89-8594-ac452efa25f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dac382c-7cdf-44b2-af5e-dc8f459aabec", "name": "network-vif-deleted", "tag": "74e4c9fb-ab89-47fe-aed1-8a3504bf6d35"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:57.997789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3d930fac-a7a6-4d08-9657-6f3f17c07a27 req-d0cf34ca-e684-4d89-8594-ac452efa25f7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:57.998314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3d930fac-a7a6-4d08-9657-6f3f17c07a27 req-d0cf34ca-e684-4d89-8594-ac452efa25f7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:57.998804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3d930fac-a7a6-4d08-9657-6f3f17c07a27 req-d0cf34ca-e684-4d89-8594-ac452efa25f7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:58.029264 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-3d930fac-a7a6-4d08-9657-6f3f17c07a27 req-d0cf34ca-e684-4d89-8594-ac452efa25f7 service nova] Creating event network-vif-deleted:74e4c9fb-ab89-47fe-aed1-8a3504bf6d35 for instance 7dac382c-7cdf-44b2-af5e-dc8f459aabec on n-h1-860687-3 Oct 27 19:04:58.038611 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-3d930fac-a7a6-4d08-9657-6f3f17c07a27 req-d0cf34ca-e684-4d89-8594-ac452efa25f7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064104 Oct 27 19:04:58.042371 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2000/4196] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:04:58.095127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c859b492-60e3-4d86-ac6a-f768550d05f0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:58.095919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c859b492-60e3-4d86-ac6a-f768550d05f0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:58.105599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:04:58.110116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c859b492-60e3-4d86-ac6a-f768550d05f0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:58.111282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c859b492-60e3-4d86-ac6a-f768550d05f0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:58.113528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c859b492-60e3-4d86-ac6a-f768550d05f0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:58.114866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c859b492-60e3-4d86-ac6a-f768550d05f0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:58.118209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c859b492-60e3-4d86-ac6a-f768550d05f0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:58.118943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c859b492-60e3-4d86-ac6a-f768550d05f0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:58.131058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-927612a3-e3a7-4086-b0f0-cb15787edfe8 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:58.132457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-927612a3-e3a7-4086-b0f0-cb15787edfe8 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:58.151272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-927612a3-e3a7-4086-b0f0-cb15787edfe8 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:58.156005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-927612a3-e3a7-4086-b0f0-cb15787edfe8 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:58.157734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-927612a3-e3a7-4086-b0f0-cb15787edfe8 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:58.161136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-927612a3-e3a7-4086-b0f0-cb15787edfe8 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:58.169220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-927612a3-e3a7-4086-b0f0-cb15787edfe8 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:58.171406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-927612a3-e3a7-4086-b0f0-cb15787edfe8 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:58.254899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c859b492-60e3-4d86-ac6a-f768550d05f0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:04:58.477288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-927612a3-e3a7-4086-b0f0-cb15787edfe8 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:58.490603 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-927612a3-e3a7-4086-b0f0-cb15787edfe8 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1404 microversion: 2.1 time: 0.364943 Oct 27 19:04:58.491916 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2001/4197] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:58 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1404 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:58.501871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b7e8acd1-923d-4743-85df-a66f91a07bf9 req-5d4e90c1-5bab-4540-88c0-33a726ffdfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-deleted", "tag": "09a712fe-98b4-4234-9815-ee2620c789f9"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:04:58.511592 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c859b492-60e3-4d86-ac6a-f768550d05f0 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "DELETE /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 204 len: 0 microversion: 2.1 time: 0.412735 Oct 27 19:04:58.514243 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2197/4198] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:04:58 2022] DELETE /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:04:58.524019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b7e8acd1-923d-4743-85df-a66f91a07bf9 req-5d4e90c1-5bab-4540-88c0-33a726ffdfa9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:58.524519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b7e8acd1-923d-4743-85df-a66f91a07bf9 req-5d4e90c1-5bab-4540-88c0-33a726ffdfa9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:58.525026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b7e8acd1-923d-4743-85df-a66f91a07bf9 req-5d4e90c1-5bab-4540-88c0-33a726ffdfa9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:58.542024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6330043e-ba37-4031-95e5-e2097a866176 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:58.550323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6330043e-ba37-4031-95e5-e2097a866176 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:58.561166 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b7e8acd1-923d-4743-85df-a66f91a07bf9 req-5d4e90c1-5bab-4540-88c0-33a726ffdfa9 service nova] Creating event network-vif-deleted:09a712fe-98b4-4234-9815-ee2620c789f9 for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:04:58.567510 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b7e8acd1-923d-4743-85df-a66f91a07bf9 req-5d4e90c1-5bab-4540-88c0-33a726ffdfa9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073564 Oct 27 19:04:58.568739 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2002/4199] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:04:58.580326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b2850042-9a67-4daf-b3a3-29ef36627382 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:58.581363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b2850042-9a67-4daf-b3a3-29ef36627382 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:58.587971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6330043e-ba37-4031-95e5-e2097a866176 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:58.591929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6330043e-ba37-4031-95e5-e2097a866176 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:58.595117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6330043e-ba37-4031-95e5-e2097a866176 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:58.596129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6330043e-ba37-4031-95e5-e2097a866176 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:58.599985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2850042-9a67-4daf-b3a3-29ef36627382 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:58.600256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6330043e-ba37-4031-95e5-e2097a866176 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:58.600559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6330043e-ba37-4031-95e5-e2097a866176 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:58.600797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2850042-9a67-4daf-b3a3-29ef36627382 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:58.601650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2850042-9a67-4daf-b3a3-29ef36627382 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:58.602647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2850042-9a67-4daf-b3a3-29ef36627382 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:58.603343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2850042-9a67-4daf-b3a3-29ef36627382 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:58.604001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b2850042-9a67-4daf-b3a3-29ef36627382 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:59.000748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b2850042-9a67-4daf-b3a3-29ef36627382 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:59.013400 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b2850042-9a67-4daf-b3a3-29ef36627382 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1508 microversion: 2.1 time: 0.443236 Oct 27 19:04:59.017651 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2003/4200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:58 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1508 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:59.026507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bfb26f78-eaa6-4aa6-8619-0814bb793d03 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:59.036595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bfb26f78-eaa6-4aa6-8619-0814bb793d03 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:59.048937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfb26f78-eaa6-4aa6-8619-0814bb793d03 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:59.049805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfb26f78-eaa6-4aa6-8619-0814bb793d03 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:59.050279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfb26f78-eaa6-4aa6-8619-0814bb793d03 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:59.052078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfb26f78-eaa6-4aa6-8619-0814bb793d03 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:59.052560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfb26f78-eaa6-4aa6-8619-0814bb793d03 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:59.053009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfb26f78-eaa6-4aa6-8619-0814bb793d03 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:59.341065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6330043e-ba37-4031-95e5-e2097a866176 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:59.349616 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6330043e-ba37-4031-95e5-e2097a866176 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1557 microversion: 2.1 time: 0.831257 Oct 27 19:04:59.373960 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2198/4201] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:58 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1557 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:04:59.423713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a3ca2d5-574d-493f-969a-9cbb98455d80 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:59.424238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8a3ca2d5-574d-493f-969a-9cbb98455d80 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:59.455062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a3ca2d5-574d-493f-969a-9cbb98455d80 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:59.455674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a3ca2d5-574d-493f-969a-9cbb98455d80 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:59.462194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a3ca2d5-574d-493f-969a-9cbb98455d80 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:59.463941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a3ca2d5-574d-493f-969a-9cbb98455d80 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:59.468646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a3ca2d5-574d-493f-969a-9cbb98455d80 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:59.469140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a3ca2d5-574d-493f-969a-9cbb98455d80 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:59.856600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bfb26f78-eaa6-4aa6-8619-0814bb793d03 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:59.874189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bfb26f78-eaa6-4aa6-8619-0814bb793d03 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:59.879732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bfb26f78-eaa6-4aa6-8619-0814bb793d03 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:04:59.897287 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bfb26f78-eaa6-4aa6-8619-0814bb793d03 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2868 microversion: 2.42 time: 0.874817 Oct 27 19:04:59.901271 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2004/4202] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:04:59 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2868 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:04:59.921581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ab924abb-cdf6-4db2-8899-acc1f427d9e9 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:04:59.925334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ab924abb-cdf6-4db2-8899-acc1f427d9e9 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:04:59.956586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab924abb-cdf6-4db2-8899-acc1f427d9e9 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:59.960018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab924abb-cdf6-4db2-8899-acc1f427d9e9 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:59.960714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab924abb-cdf6-4db2-8899-acc1f427d9e9 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:04:59.964760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab924abb-cdf6-4db2-8899-acc1f427d9e9 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:04:59.965681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab924abb-cdf6-4db2-8899-acc1f427d9e9 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:04:59.966325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab924abb-cdf6-4db2-8899-acc1f427d9e9 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:00.399365 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8a3ca2d5-574d-493f-969a-9cbb98455d80 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.998623 Oct 27 19:05:00.400531 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2199/4203] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:04:59 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-interface => generated 284 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:00.412171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-12e540f6-da77-4e42-9455-ebc1458bdf55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:00.413120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-12e540f6-da77-4e42-9455-ebc1458bdf55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:00.427396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12e540f6-da77-4e42-9455-ebc1458bdf55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:00.427927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12e540f6-da77-4e42-9455-ebc1458bdf55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:00.428398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12e540f6-da77-4e42-9455-ebc1458bdf55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:00.429149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12e540f6-da77-4e42-9455-ebc1458bdf55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:00.429626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12e540f6-da77-4e42-9455-ebc1458bdf55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:00.430950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12e540f6-da77-4e42-9455-ebc1458bdf55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:00.539245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ab924abb-cdf6-4db2-8899-acc1f427d9e9 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:00.555565 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ab924abb-cdf6-4db2-8899-acc1f427d9e9 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1404 microversion: 2.1 time: 0.652414 Oct 27 19:05:00.560575 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2005/4204] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:04:59 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1404 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:00.939425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ba7e223b-0774-451c-bfd9-cb43214d83b3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:00.940078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ba7e223b-0774-451c-bfd9-cb43214d83b3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:00.955866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba7e223b-0774-451c-bfd9-cb43214d83b3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:00.956548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba7e223b-0774-451c-bfd9-cb43214d83b3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:00.957014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba7e223b-0774-451c-bfd9-cb43214d83b3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:00.980881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba7e223b-0774-451c-bfd9-cb43214d83b3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:00.982464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba7e223b-0774-451c-bfd9-cb43214d83b3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:00.984074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba7e223b-0774-451c-bfd9-cb43214d83b3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:01.392106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ba7e223b-0774-451c-bfd9-cb43214d83b3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:01.404358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ba7e223b-0774-451c-bfd9-cb43214d83b3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:01.406146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ba7e223b-0774-451c-bfd9-cb43214d83b3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:01.407467 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ba7e223b-0774-451c-bfd9-cb43214d83b3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2532 microversion: 2.42 time: 0.476719 Oct 27 19:05:01.422408 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2006/4205] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:00 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2532 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:05:01.422408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-32e7d7dd-e4dc-4125-a3cc-7309c486aa4f req-f2595d73-3eb2-4bde-9dcc-f1ddf2515dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8", "name": "network-vif-deleted", "tag": "2435268e-6b80-4862-89cd-cdd63a9b63a6"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:01.436074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-32e7d7dd-e4dc-4125-a3cc-7309c486aa4f req-f2595d73-3eb2-4bde-9dcc-f1ddf2515dc9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:01.436777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-12e540f6-da77-4e42-9455-ebc1458bdf55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:01.437249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-32e7d7dd-e4dc-4125-a3cc-7309c486aa4f req-f2595d73-3eb2-4bde-9dcc-f1ddf2515dc9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:01.437615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-32e7d7dd-e4dc-4125-a3cc-7309c486aa4f req-f2595d73-3eb2-4bde-9dcc-f1ddf2515dc9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:01.452796 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-32e7d7dd-e4dc-4125-a3cc-7309c486aa4f req-f2595d73-3eb2-4bde-9dcc-f1ddf2515dc9 service nova] Creating event network-vif-deleted:2435268e-6b80-4862-89cd-cdd63a9b63a6 for instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 on n-h1-860687-3 Oct 27 19:05:01.453292 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-12e540f6-da77-4e42-9455-ebc1458bdf55 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 200 len: 1508 microversion: 2.1 time: 1.051598 Oct 27 19:05:01.453901 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2200/4206] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:00 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 1508 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:01.478415 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-32e7d7dd-e4dc-4125-a3cc-7309c486aa4f req-f2595d73-3eb2-4bde-9dcc-f1ddf2515dc9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064845 Oct 27 19:05:01.479405 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2007/4207] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:01.583646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0455a81-3ecf-4a5b-a65c-11b7e0fbb80a tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:01.584603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f0455a81-3ecf-4a5b-a65c-11b7e0fbb80a tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:01.598185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0455a81-3ecf-4a5b-a65c-11b7e0fbb80a tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:01.598726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0455a81-3ecf-4a5b-a65c-11b7e0fbb80a tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:01.599278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0455a81-3ecf-4a5b-a65c-11b7e0fbb80a tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:01.600755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0455a81-3ecf-4a5b-a65c-11b7e0fbb80a tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:01.601228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0455a81-3ecf-4a5b-a65c-11b7e0fbb80a tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:01.601682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0455a81-3ecf-4a5b-a65c-11b7e0fbb80a tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:02.044139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-defad18c-efcb-49d2-9618-c0bcb5f258a1 req-4217cfc2-5c98-4725-879c-fd3225fdb70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3567a7a-6f12-4d01-a9b1-adcb0310bd10", "name": "network-vif-plugged", "status": "completed", "tag": "37e8973e-da31-49a3-8c92-aa75229fb28f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:02.095553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-defad18c-efcb-49d2-9618-c0bcb5f258a1 req-4217cfc2-5c98-4725-879c-fd3225fdb70d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:02.098493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-defad18c-efcb-49d2-9618-c0bcb5f258a1 req-4217cfc2-5c98-4725-879c-fd3225fdb70d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:02.103355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-defad18c-efcb-49d2-9618-c0bcb5f258a1 req-4217cfc2-5c98-4725-879c-fd3225fdb70d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:02.132177 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-defad18c-efcb-49d2-9618-c0bcb5f258a1 req-4217cfc2-5c98-4725-879c-fd3225fdb70d service nova] Creating event network-vif-plugged:37e8973e-da31-49a3-8c92-aa75229fb28f for instance b3567a7a-6f12-4d01-a9b1-adcb0310bd10 on n-h2-860687-3 Oct 27 19:05:02.145502 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-defad18c-efcb-49d2-9618-c0bcb5f258a1 req-4217cfc2-5c98-4725-879c-fd3225fdb70d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103203 Oct 27 19:05:02.147065 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2008/4208] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:02.440763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c4191dee-b8df-410a-97de-1504ea18c31f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:02.441572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c4191dee-b8df-410a-97de-1504ea18c31f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:02.453148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4191dee-b8df-410a-97de-1504ea18c31f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:02.453921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4191dee-b8df-410a-97de-1504ea18c31f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:02.454725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4191dee-b8df-410a-97de-1504ea18c31f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:02.455796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4191dee-b8df-410a-97de-1504ea18c31f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:02.464478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4191dee-b8df-410a-97de-1504ea18c31f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:02.465372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4191dee-b8df-410a-97de-1504ea18c31f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:02.780490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c4191dee-b8df-410a-97de-1504ea18c31f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:02.792173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c4191dee-b8df-410a-97de-1504ea18c31f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:02.793867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c4191dee-b8df-410a-97de-1504ea18c31f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:02.798907 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c4191dee-b8df-410a-97de-1504ea18c31f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2532 microversion: 2.42 time: 0.362951 Oct 27 19:05:02.799963 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2009/4209] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:02 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2532 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:02.805369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-973818e9-4abd-42c5-a596-6b3d2a112357 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:02.806213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-973818e9-4abd-42c5-a596-6b3d2a112357 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:02.812679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-973818e9-4abd-42c5-a596-6b3d2a112357 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:02.813350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-973818e9-4abd-42c5-a596-6b3d2a112357 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:02.814006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-973818e9-4abd-42c5-a596-6b3d2a112357 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:02.815105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-973818e9-4abd-42c5-a596-6b3d2a112357 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:02.815784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-973818e9-4abd-42c5-a596-6b3d2a112357 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:02.816469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-973818e9-4abd-42c5-a596-6b3d2a112357 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:02.860807 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-973818e9-4abd-42c5-a596-6b3d2a112357 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] HTTP exception thrown: Instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 could not be found. Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-973818e9-4abd-42c5-a596-6b3d2a112357 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Request method failure captured: Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 HTTP/1.1 Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtTOhZ4eSrUIbh7FOH8abPh8o6s1SrCC6rl-rUyuXuq1ygfePdb0jYAcyGuJrVudmd8OxoZzpYzhODw3ejjYW0-ti5IZ9xJMsPzlMbC7OoicnuCUnW_JwGkg6OKXbZMBkqYeQENn4eoxSAgVgRaELA_KPYJgZbVCfoUL02eTSzGcONI Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_adeacece438645c4a0c5844d1ef83793", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2b706e9394a642cda315809db15ecbb3 Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 could not be found. Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8'} Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 could not be found. Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 could not be found. Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:02.866082 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:05:02.873483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:02.873483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:02.873483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:05:02.873483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:05:02.873483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:05:02.873483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:05:02.873483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 could not be found. Oct 27 19:05:02.873483 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:02.873483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-973818e9-4abd-42c5-a596-6b3d2a112357 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Returning 404 to user: Instance db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:05:02.873483 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-973818e9-4abd-42c5-a596-6b3d2a112357 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8" status: 404 len: 111 microversion: 2.1 time: 0.065963 Oct 27 19:05:02.873483 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2010/4210] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:02 2022] GET /compute/v2.1/servers/db2a36c1-faf7-4ab6-b0ab-1086fd39ccb8 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:05:02.886882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-66fa65d2-5913-47f8-a3bb-7ea8ea339d20 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:02.887429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-66fa65d2-5913-47f8-a3bb-7ea8ea339d20 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:02.896077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fa65d2-5913-47f8-a3bb-7ea8ea339d20 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:02.896590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fa65d2-5913-47f8-a3bb-7ea8ea339d20 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:02.897049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fa65d2-5913-47f8-a3bb-7ea8ea339d20 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:02.897780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fa65d2-5913-47f8-a3bb-7ea8ea339d20 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:02.898245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fa65d2-5913-47f8-a3bb-7ea8ea339d20 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:02.906686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fa65d2-5913-47f8-a3bb-7ea8ea339d20 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:02.975700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-66fa65d2-5913-47f8-a3bb-7ea8ea339d20 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:05:02.983939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f0455a81-3ecf-4a5b-a65c-11b7e0fbb80a tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:03.017759 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f0455a81-3ecf-4a5b-a65c-11b7e0fbb80a tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1404 microversion: 2.1 time: 1.438163 Oct 27 19:05:03.021385 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2201/4211] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:01 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1404 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:03.217514 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-66fa65d2-5913-47f8-a3bb-7ea8ea339d20 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 204 len: 0 microversion: 2.1 time: 0.343513 Oct 27 19:05:03.219278 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2011/4212] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:05:02 2022] DELETE /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:05:03.228770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f1b527bf-1ad7-422b-a84e-19f31c839e57 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:03.229423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f1b527bf-1ad7-422b-a84e-19f31c839e57 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:03.244166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1b527bf-1ad7-422b-a84e-19f31c839e57 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:03.246308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1b527bf-1ad7-422b-a84e-19f31c839e57 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:03.248393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1b527bf-1ad7-422b-a84e-19f31c839e57 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:03.249355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1b527bf-1ad7-422b-a84e-19f31c839e57 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:03.250505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1b527bf-1ad7-422b-a84e-19f31c839e57 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:03.251107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1b527bf-1ad7-422b-a84e-19f31c839e57 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:03.622147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-fd05b9cd-b30f-4970-82af-2052795ade89 req-1dac23cf-9cf8-491f-bf29-7a1327a6c7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-deleted", "tag": "5caa00b6-63fd-476a-9d5a-0faa8aa4baad"}, {"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-deleted", "tag": "84b5f126-b4b7-4b2f-9238-d2b20b3ec67d"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:03.635050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fd05b9cd-b30f-4970-82af-2052795ade89 req-1dac23cf-9cf8-491f-bf29-7a1327a6c7d9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:03.636040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fd05b9cd-b30f-4970-82af-2052795ade89 req-1dac23cf-9cf8-491f-bf29-7a1327a6c7d9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:03.636679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fd05b9cd-b30f-4970-82af-2052795ade89 req-1dac23cf-9cf8-491f-bf29-7a1327a6c7d9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:03.648803 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-fd05b9cd-b30f-4970-82af-2052795ade89 req-1dac23cf-9cf8-491f-bf29-7a1327a6c7d9 service nova] Creating event network-vif-deleted:5caa00b6-63fd-476a-9d5a-0faa8aa4baad for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:05:03.649630 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-fd05b9cd-b30f-4970-82af-2052795ade89 req-1dac23cf-9cf8-491f-bf29-7a1327a6c7d9 service nova] Creating event network-vif-deleted:84b5f126-b4b7-4b2f-9238-d2b20b3ec67d for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:05:03.655876 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-fd05b9cd-b30f-4970-82af-2052795ade89 req-1dac23cf-9cf8-491f-bf29-7a1327a6c7d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038463 Oct 27 19:05:03.657700 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2012/4213] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:05:03.886176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f1b527bf-1ad7-422b-a84e-19f31c839e57 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:03.897817 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f1b527bf-1ad7-422b-a84e-19f31c839e57 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 0.673856 Oct 27 19:05:03.903423 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2202/4214] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:03 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:03.917928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-488379044", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:03.918850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8859738e-9b92-40c9-b335-94b27ebebab6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:03.919565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8859738e-9b92-40c9-b335-94b27ebebab6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:03.931183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8859738e-9b92-40c9-b335-94b27ebebab6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:03.931867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8859738e-9b92-40c9-b335-94b27ebebab6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:03.932403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8859738e-9b92-40c9-b335-94b27ebebab6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:03.933237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8859738e-9b92-40c9-b335-94b27ebebab6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:03.933780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8859738e-9b92-40c9-b335-94b27ebebab6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:03.934300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8859738e-9b92-40c9-b335-94b27ebebab6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:04.162593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:05:04.452861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8859738e-9b92-40c9-b335-94b27ebebab6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:04.467387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8859738e-9b92-40c9-b335-94b27ebebab6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:04.473892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8859738e-9b92-40c9-b335-94b27ebebab6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:04.481145 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8859738e-9b92-40c9-b335-94b27ebebab6 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2258 microversion: 2.42 time: 0.576043 Oct 27 19:05:04.482618 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2203/4215] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:03 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2258 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:04.488064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d8d40b97-e335-4add-aac9-9b6d6cad3969 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:04.489710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d8d40b97-e335-4add-aac9-9b6d6cad3969 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:04.496633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8d40b97-e335-4add-aac9-9b6d6cad3969 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:04.497512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8d40b97-e335-4add-aac9-9b6d6cad3969 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:04.498252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8d40b97-e335-4add-aac9-9b6d6cad3969 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:04.499200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8d40b97-e335-4add-aac9-9b6d6cad3969 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:04.499865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8d40b97-e335-4add-aac9-9b6d6cad3969 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:04.500655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8d40b97-e335-4add-aac9-9b6d6cad3969 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:04.729525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d8d40b97-e335-4add-aac9-9b6d6cad3969 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:04.767061 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d8d40b97-e335-4add-aac9-9b6d6cad3969 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1592 microversion: 2.1 time: 0.283106 Oct 27 19:05:04.768217 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2204/4216] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:04 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1592 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:04.798431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b1be4d4d-a24f-428b-9830-f1c4cadbdf12 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:04.799524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b1be4d4d-a24f-428b-9830-f1c4cadbdf12 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:04.818305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1be4d4d-a24f-428b-9830-f1c4cadbdf12 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:04.820388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1be4d4d-a24f-428b-9830-f1c4cadbdf12 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:04.820872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1be4d4d-a24f-428b-9830-f1c4cadbdf12 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:04.821632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1be4d4d-a24f-428b-9830-f1c4cadbdf12 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:04.822111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1be4d4d-a24f-428b-9830-f1c4cadbdf12 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:04.822589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1be4d4d-a24f-428b-9830-f1c4cadbdf12 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:04.892947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:05:04.894872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:05:04.896370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:05:04.896975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:05:04.897867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:05:04.921811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:04.922724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:04.926163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:04.927850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:04.928580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:04.930195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:04.959879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:04.967108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:04.992156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:05:04.996499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:05:05.023582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:05.093688 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b6812875-f365-4d1a-85ed-5e56ad363511 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.356383 Oct 27 19:05:05.101714 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b1be4d4d-a24f-428b-9830-f1c4cadbdf12 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.311855 Oct 27 19:05:05.106798 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2013/4217] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:05:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 19:05:05.119942 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2205/4218] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:05:04 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10/os-interface => generated 285 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:05.124800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-12053b32-5ddf-4bb4-8a90-9d6f1c6ffa52 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:05.125565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a3263576-8859-4c2f-8b13-9744ec36cb12 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:05.128221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a3263576-8859-4c2f-8b13-9744ec36cb12 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:05.146716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-12053b32-5ddf-4bb4-8a90-9d6f1c6ffa52 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:05.173640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12053b32-5ddf-4bb4-8a90-9d6f1c6ffa52 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:05.174700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12053b32-5ddf-4bb4-8a90-9d6f1c6ffa52 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:05.174961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12053b32-5ddf-4bb4-8a90-9d6f1c6ffa52 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:05.175984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12053b32-5ddf-4bb4-8a90-9d6f1c6ffa52 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:05.177733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12053b32-5ddf-4bb4-8a90-9d6f1c6ffa52 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:05.178426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12053b32-5ddf-4bb4-8a90-9d6f1c6ffa52 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:05.270552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:05.321385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a3263576-8859-4c2f-8b13-9744ec36cb12 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:05.328576 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a3263576-8859-4c2f-8b13-9744ec36cb12 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1216 microversion: 2.1 time: 0.207277 Oct 27 19:05:05.333357 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2206/4219] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:05 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1216 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:05.514813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-32de05c1-bfe6-41e9-af69-6dcc4a570324 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:05.515440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-32de05c1-bfe6-41e9-af69-6dcc4a570324 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:05.557693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32de05c1-bfe6-41e9-af69-6dcc4a570324 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:05.559044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32de05c1-bfe6-41e9-af69-6dcc4a570324 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:05.560308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32de05c1-bfe6-41e9-af69-6dcc4a570324 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:05.562990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32de05c1-bfe6-41e9-af69-6dcc4a570324 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:05.565340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32de05c1-bfe6-41e9-af69-6dcc4a570324 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:05.580394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32de05c1-bfe6-41e9-af69-6dcc4a570324 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:05.994881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-12053b32-5ddf-4bb4-8a90-9d6f1c6ffa52 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:06.014018 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-12053b32-5ddf-4bb4-8a90-9d6f1c6ffa52 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1523 microversion: 2.1 time: 0.894705 Oct 27 19:05:06.014982 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2014/4220] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:05 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1523 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:06.026373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ff1ddc9d-dcd0-4021-9e82-0933e30a5194 req-eafaf07b-3057-4adb-b6d5-b8a60da06d7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9", "tag": "37a53b22-60d3-4cbe-a630-561426159264"}, {"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-deleted", "tag": "2ab12411-7d95-4e74-8e80-f62b068f58be"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:06.061340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ff1ddc9d-dcd0-4021-9e82-0933e30a5194 req-eafaf07b-3057-4adb-b6d5-b8a60da06d7d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:06.061844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ff1ddc9d-dcd0-4021-9e82-0933e30a5194 req-eafaf07b-3057-4adb-b6d5-b8a60da06d7d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:06.062280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ff1ddc9d-dcd0-4021-9e82-0933e30a5194 req-eafaf07b-3057-4adb-b6d5-b8a60da06d7d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:06.087383 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ff1ddc9d-dcd0-4021-9e82-0933e30a5194 req-eafaf07b-3057-4adb-b6d5-b8a60da06d7d service nova] Creating event network-changed:37a53b22-60d3-4cbe-a630-561426159264 for instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 on n-h1-860687-3 Oct 27 19:05:06.093221 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ff1ddc9d-dcd0-4021-9e82-0933e30a5194 req-eafaf07b-3057-4adb-b6d5-b8a60da06d7d service nova] Creating event network-vif-deleted:2ab12411-7d95-4e74-8e80-f62b068f58be for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:05:06.111259 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ff1ddc9d-dcd0-4021-9e82-0933e30a5194 req-eafaf07b-3057-4adb-b6d5-b8a60da06d7d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.094770 Oct 27 19:05:06.123160 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2015/4221] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:06.360795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4411d64b-2fe7-42fc-b8d4-40ae60f87a1e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:06.361595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4411d64b-2fe7-42fc-b8d4-40ae60f87a1e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:06.381409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4411d64b-2fe7-42fc-b8d4-40ae60f87a1e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:06.383163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4411d64b-2fe7-42fc-b8d4-40ae60f87a1e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:06.383993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4411d64b-2fe7-42fc-b8d4-40ae60f87a1e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:06.385664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4411d64b-2fe7-42fc-b8d4-40ae60f87a1e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:06.387450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4411d64b-2fe7-42fc-b8d4-40ae60f87a1e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:06.389845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4411d64b-2fe7-42fc-b8d4-40ae60f87a1e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:06.391979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-32de05c1-bfe6-41e9-af69-6dcc4a570324 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:06.422068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-32de05c1-bfe6-41e9-af69-6dcc4a570324 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:06.432192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-32de05c1-bfe6-41e9-af69-6dcc4a570324 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:06.433508 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-32de05c1-bfe6-41e9-af69-6dcc4a570324 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 2212 microversion: 2.42 time: 0.922662 Oct 27 19:05:06.442466 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2207/4222] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:05 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 2212 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:05:06.710713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4411d64b-2fe7-42fc-b8d4-40ae60f87a1e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:06.721649 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4411d64b-2fe7-42fc-b8d4-40ae60f87a1e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1212 microversion: 2.1 time: 0.366053 Oct 27 19:05:06.725088 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2016/4223] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:06 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1212 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:07.043296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f77463e2-5ec7-4941-abb3-d23c5a641cd6 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:07.043973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f77463e2-5ec7-4941-abb3-d23c5a641cd6 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:07.062747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f77463e2-5ec7-4941-abb3-d23c5a641cd6 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:07.066140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f77463e2-5ec7-4941-abb3-d23c5a641cd6 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:07.069135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f77463e2-5ec7-4941-abb3-d23c5a641cd6 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:07.069953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f77463e2-5ec7-4941-abb3-d23c5a641cd6 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:07.075502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f77463e2-5ec7-4941-abb3-d23c5a641cd6 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:07.076421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f77463e2-5ec7-4941-abb3-d23c5a641cd6 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:07.378727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f77463e2-5ec7-4941-abb3-d23c5a641cd6 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b706e9394a642cda315809db15ecbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adeacece438645c4a0c5844d1ef83793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:07.383833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:07.397760 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f77463e2-5ec7-4941-abb3-d23c5a641cd6 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 200 len: 1307 microversion: 2.1 time: 0.355007 Oct 27 19:05:07.401807 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2208/4224] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:07 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 1307 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:07.480174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-77e5223e-849f-4653-8b8f-e03eaabb409f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:07.481482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-77e5223e-849f-4653-8b8f-e03eaabb409f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:07.503136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77e5223e-849f-4653-8b8f-e03eaabb409f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:07.507047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77e5223e-849f-4653-8b8f-e03eaabb409f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:07.510558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77e5223e-849f-4653-8b8f-e03eaabb409f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:07.512450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77e5223e-849f-4653-8b8f-e03eaabb409f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:07.513189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77e5223e-849f-4653-8b8f-e03eaabb409f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:07.515857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77e5223e-849f-4653-8b8f-e03eaabb409f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:07.731082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-77e5223e-849f-4653-8b8f-e03eaabb409f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:07.742005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-77e5223e-849f-4653-8b8f-e03eaabb409f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:07.744320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-77e5223e-849f-4653-8b8f-e03eaabb409f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:07.745863 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-77e5223e-849f-4653-8b8f-e03eaabb409f tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.277250 Oct 27 19:05:07.747300 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2017/4225] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:07 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:07.770843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9744742b-4369-48fa-81a9-2b542a00e60c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:07.772435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9744742b-4369-48fa-81a9-2b542a00e60c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:07.780681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9744742b-4369-48fa-81a9-2b542a00e60c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:07.781445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9744742b-4369-48fa-81a9-2b542a00e60c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:07.782308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9744742b-4369-48fa-81a9-2b542a00e60c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:07.783891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9744742b-4369-48fa-81a9-2b542a00e60c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:07.784842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9744742b-4369-48fa-81a9-2b542a00e60c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:07.785550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9744742b-4369-48fa-81a9-2b542a00e60c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:07.877248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9744742b-4369-48fa-81a9-2b542a00e60c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:07.888776 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9744742b-4369-48fa-81a9-2b542a00e60c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1274 microversion: 2.1 time: 0.143541 Oct 27 19:05:07.894024 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2209/4226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:07 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:08.153373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-1e2e8fc3-eafd-45fb-a776-ff938b788a40 req-e730cddd-4f14-43cc-9553-df8c28f25739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0681d889-2d45-4226-9d32-0f36c94a3c2b", "name": "network-vif-deleted", "tag": "932a9230-1751-47ce-9693-0eddb2a30ee1"}, {"server_uuid": "fd8ee1a0-1df0-4488-bffd-1406e9762843", "name": "network-vif-deleted", "tag": "c6498581-54ac-4f2f-90e8-789b7cd18a29"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:08.172129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1e2e8fc3-eafd-45fb-a776-ff938b788a40 req-e730cddd-4f14-43cc-9553-df8c28f25739 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:08.172641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1e2e8fc3-eafd-45fb-a776-ff938b788a40 req-e730cddd-4f14-43cc-9553-df8c28f25739 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:08.173074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1e2e8fc3-eafd-45fb-a776-ff938b788a40 req-e730cddd-4f14-43cc-9553-df8c28f25739 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:08.235570 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-1e2e8fc3-eafd-45fb-a776-ff938b788a40 req-e730cddd-4f14-43cc-9553-df8c28f25739 service nova] Creating event network-vif-deleted:932a9230-1751-47ce-9693-0eddb2a30ee1 for instance 0681d889-2d45-4226-9d32-0f36c94a3c2b on n-h2-860687-3 Oct 27 19:05:08.236148 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-1e2e8fc3-eafd-45fb-a776-ff938b788a40 req-e730cddd-4f14-43cc-9553-df8c28f25739 service nova] Creating event network-vif-deleted:c6498581-54ac-4f2f-90e8-789b7cd18a29 for instance fd8ee1a0-1df0-4488-bffd-1406e9762843 on n-h1-860687-3 Oct 27 19:05:08.252115 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-1e2e8fc3-eafd-45fb-a776-ff938b788a40 req-e730cddd-4f14-43cc-9553-df8c28f25739 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103732 Oct 27 19:05:08.256195 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2018/4227] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:08.366889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7eb519e3-f011-467f-874c-539c218e8673 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:08.367529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7eb519e3-f011-467f-874c-539c218e8673 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:08.386817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-4e983bed-2d7f-4c02-ba46-08f6eac35eae req-98292397-c64c-4722-86bc-daa5f5cd00b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3567a7a-6f12-4d01-a9b1-adcb0310bd10", "tag": "37e8973e-da31-49a3-8c92-aa75229fb28f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:08.387076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb519e3-f011-467f-874c-539c218e8673 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:08.387728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb519e3-f011-467f-874c-539c218e8673 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:08.389723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb519e3-f011-467f-874c-539c218e8673 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:08.393879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb519e3-f011-467f-874c-539c218e8673 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:08.394538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb519e3-f011-467f-874c-539c218e8673 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:08.395827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb519e3-f011-467f-874c-539c218e8673 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:08.417499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4e983bed-2d7f-4c02-ba46-08f6eac35eae req-98292397-c64c-4722-86bc-daa5f5cd00b8 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:08.425031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4e983bed-2d7f-4c02-ba46-08f6eac35eae req-98292397-c64c-4722-86bc-daa5f5cd00b8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:08.426052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4e983bed-2d7f-4c02-ba46-08f6eac35eae req-98292397-c64c-4722-86bc-daa5f5cd00b8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:08.469894 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-4e983bed-2d7f-4c02-ba46-08f6eac35eae req-98292397-c64c-4722-86bc-daa5f5cd00b8 service nova] Creating event network-changed:37e8973e-da31-49a3-8c92-aa75229fb28f for instance b3567a7a-6f12-4d01-a9b1-adcb0310bd10 on n-h2-860687-3 Oct 27 19:05:08.488161 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-4e983bed-2d7f-4c02-ba46-08f6eac35eae req-98292397-c64c-4722-86bc-daa5f5cd00b8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105950 Oct 27 19:05:08.494710 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2019/4228] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 27 19:05:08.502123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5996f72e-9165-4a3c-a4ce-68f98c688768 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:08.523243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5996f72e-9165-4a3c-a4ce-68f98c688768 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] [instance: fd8ee1a0-1df0-4488-bffd-1406e9762843] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:08.542911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5996f72e-9165-4a3c-a4ce-68f98c688768 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:08.545189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5996f72e-9165-4a3c-a4ce-68f98c688768 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:08.548722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5996f72e-9165-4a3c-a4ce-68f98c688768 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:08.549775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5996f72e-9165-4a3c-a4ce-68f98c688768 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:08.550836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5996f72e-9165-4a3c-a4ce-68f98c688768 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:08.552189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5996f72e-9165-4a3c-a4ce-68f98c688768 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:08.584304 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-5996f72e-9165-4a3c-a4ce-68f98c688768 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] HTTP exception thrown: Instance fd8ee1a0-1df0-4488-bffd-1406e9762843 could not be found. Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5996f72e-9165-4a3c-a4ce-68f98c688768 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Request method failure captured: Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 HTTP/1.1 Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtTOhZ4eSrUIbh7FOH8abPh8o6s1SrCC6rl-rUyuXuq1ygfePdb0jYAcyGuJrVudmd8OxoZzpYzhODw3ejjYW0-ti5IZ9xJMsPzlMbC7OoicnuCUnW_JwGkg6OKXbZMBkqYeQENn4eoxSAgVgRaELA_KPYJgZbVCfoUL02eTSzGcONI Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_adeacece438645c4a0c5844d1ef83793", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/adeacece438645c4a0c5844d1ef83793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: adeacece438645c4a0c5844d1ef83793 Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-983402444 Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2b706e9394a642cda315809db15ecbb3 Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-983402444-project Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance fd8ee1a0-1df0-4488-bffd-1406e9762843 could not be found. Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'fd8ee1a0-1df0-4488-bffd-1406e9762843'} Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd8ee1a0-1df0-4488-bffd-1406e9762843 could not be found. Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd8ee1a0-1df0-4488-bffd-1406e9762843 could not be found. Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:08.590182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:05:08.595360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:08.595360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:08.595360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:05:08.595360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:05:08.595360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:05:08.595360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:05:08.595360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd8ee1a0-1df0-4488-bffd-1406e9762843 could not be found. Oct 27 19:05:08.595360 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:08.597126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5996f72e-9165-4a3c-a4ce-68f98c688768 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] Returning 404 to user: Instance fd8ee1a0-1df0-4488-bffd-1406e9762843 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:05:08.602121 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5996f72e-9165-4a3c-a4ce-68f98c688768 tempest-ServerRescueNegativeTestJSON-983402444 tempest-ServerRescueNegativeTestJSON-983402444-project] 10.222.0.42 "GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843" status: 404 len: 111 microversion: 2.1 time: 0.102580 Oct 27 19:05:08.603322 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2020/4229] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:08 2022] GET /compute/v2.1/servers/fd8ee1a0-1df0-4488-bffd-1406e9762843 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:05:08.778136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e6d7165a-5c23-4370-9e25-155ca9e696a4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:08.778805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e6d7165a-5c23-4370-9e25-155ca9e696a4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:08.790531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6d7165a-5c23-4370-9e25-155ca9e696a4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:08.791032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6d7165a-5c23-4370-9e25-155ca9e696a4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:08.797265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6d7165a-5c23-4370-9e25-155ca9e696a4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:08.798105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6d7165a-5c23-4370-9e25-155ca9e696a4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:08.798630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6d7165a-5c23-4370-9e25-155ca9e696a4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:08.799079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6d7165a-5c23-4370-9e25-155ca9e696a4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:09.010089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e6d7165a-5c23-4370-9e25-155ca9e696a4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:09.030191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e6d7165a-5c23-4370-9e25-155ca9e696a4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:09.033633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e6d7165a-5c23-4370-9e25-155ca9e696a4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:09.045360 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e6d7165a-5c23-4370-9e25-155ca9e696a4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.271717 Oct 27 19:05:09.048651 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2021/4230] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:08 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:09.056553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b35c36a3-8c9b-47ea-a81a-4f9340adb3ea tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:09.058102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b35c36a3-8c9b-47ea-a81a-4f9340adb3ea tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:09.092537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b35c36a3-8c9b-47ea-a81a-4f9340adb3ea tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:09.096029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b35c36a3-8c9b-47ea-a81a-4f9340adb3ea tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:09.097878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b35c36a3-8c9b-47ea-a81a-4f9340adb3ea tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:09.103561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b35c36a3-8c9b-47ea-a81a-4f9340adb3ea tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:09.106052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b35c36a3-8c9b-47ea-a81a-4f9340adb3ea tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:09.107802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b35c36a3-8c9b-47ea-a81a-4f9340adb3ea tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:09.394893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7eb519e3-f011-467f-874c-539c218e8673 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:09.417267 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7eb519e3-f011-467f-874c-539c218e8673 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1592 microversion: 2.1 time: 1.055275 Oct 27 19:05:09.430786 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2210/4231] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:08 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1592 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:09.742477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b35c36a3-8c9b-47ea-a81a-4f9340adb3ea tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:09.756763 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b35c36a3-8c9b-47ea-a81a-4f9340adb3ea tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1316 microversion: 2.1 time: 0.704351 Oct 27 19:05:09.757653 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2022/4232] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:09 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1316 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:10.082898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0f0b4391-81ad-4e01-9915-50311ee756fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:10.084762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0f0b4391-81ad-4e01-9915-50311ee756fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:10.097550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f0b4391-81ad-4e01-9915-50311ee756fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:10.106057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f0b4391-81ad-4e01-9915-50311ee756fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:10.107642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f0b4391-81ad-4e01-9915-50311ee756fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:10.113852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f0b4391-81ad-4e01-9915-50311ee756fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:10.116565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f0b4391-81ad-4e01-9915-50311ee756fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:10.122345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f0b4391-81ad-4e01-9915-50311ee756fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:10.386635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0f0b4391-81ad-4e01-9915-50311ee756fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:10.401615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0f0b4391-81ad-4e01-9915-50311ee756fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:10.404940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0f0b4391-81ad-4e01-9915-50311ee756fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:10.407210 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0f0b4391-81ad-4e01-9915-50311ee756fe tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.328663 Oct 27 19:05:10.409646 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2211/4233] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:10 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:10.782319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7a4f9b80-550a-4ebe-88ad-529a169cb0a3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:10.784725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7a4f9b80-550a-4ebe-88ad-529a169cb0a3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:10.807097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a4f9b80-550a-4ebe-88ad-529a169cb0a3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:10.810313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a4f9b80-550a-4ebe-88ad-529a169cb0a3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:10.811085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a4f9b80-550a-4ebe-88ad-529a169cb0a3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:10.812112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a4f9b80-550a-4ebe-88ad-529a169cb0a3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:10.814100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a4f9b80-550a-4ebe-88ad-529a169cb0a3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:10.831123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a4f9b80-550a-4ebe-88ad-529a169cb0a3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:11.437483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1cf38a3c-8045-4cf6-948e-edfca37e4b78 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:11.438707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1cf38a3c-8045-4cf6-948e-edfca37e4b78 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:11.451587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cf38a3c-8045-4cf6-948e-edfca37e4b78 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:11.455219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cf38a3c-8045-4cf6-948e-edfca37e4b78 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:11.456152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cf38a3c-8045-4cf6-948e-edfca37e4b78 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:11.457678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cf38a3c-8045-4cf6-948e-edfca37e4b78 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:11.459947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cf38a3c-8045-4cf6-948e-edfca37e4b78 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:11.461628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cf38a3c-8045-4cf6-948e-edfca37e4b78 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:11.532500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7a4f9b80-550a-4ebe-88ad-529a169cb0a3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:11.543729 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7a4f9b80-550a-4ebe-88ad-529a169cb0a3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1316 microversion: 2.1 time: 0.765468 Oct 27 19:05:11.544354 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2023/4234] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:10 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1316 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:11.712501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1cf38a3c-8045-4cf6-948e-edfca37e4b78 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:11.726924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1cf38a3c-8045-4cf6-948e-edfca37e4b78 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:11.743772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1cf38a3c-8045-4cf6-948e-edfca37e4b78 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:11.746040 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1cf38a3c-8045-4cf6-948e-edfca37e4b78 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.312541 Oct 27 19:05:11.750101 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2212/4235] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:11 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:12.272901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-87759da4-d1f6-492f-9f4c-d52b081487b5 req-c63b06c7-428a-4048-867e-621386d766c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847d3fc3-fa4c-4211-9900-d6a2fdcaae8a", "tag": "8464d399-181b-42ad-948a-83acea404715"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:12.323480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-87759da4-d1f6-492f-9f4c-d52b081487b5 req-c63b06c7-428a-4048-867e-621386d766c3 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:12.326266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-87759da4-d1f6-492f-9f4c-d52b081487b5 req-c63b06c7-428a-4048-867e-621386d766c3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:12.328688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-87759da4-d1f6-492f-9f4c-d52b081487b5 req-c63b06c7-428a-4048-867e-621386d766c3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:12.352381 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-87759da4-d1f6-492f-9f4c-d52b081487b5 req-c63b06c7-428a-4048-867e-621386d766c3 service nova] Creating event network-changed:8464d399-181b-42ad-948a-83acea404715 for instance 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a on n-h1-860687-3 Oct 27 19:05:12.368307 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-87759da4-d1f6-492f-9f4c-d52b081487b5 req-c63b06c7-428a-4048-867e-621386d766c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099386 Oct 27 19:05:12.369411 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2024/4236] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:12.582615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-71f8f494-dade-4420-9e7f-3fafc9f9a25b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:12.583609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-71f8f494-dade-4420-9e7f-3fafc9f9a25b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:12.599131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71f8f494-dade-4420-9e7f-3fafc9f9a25b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:12.599642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71f8f494-dade-4420-9e7f-3fafc9f9a25b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:12.600095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71f8f494-dade-4420-9e7f-3fafc9f9a25b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:12.606568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71f8f494-dade-4420-9e7f-3fafc9f9a25b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:12.607084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71f8f494-dade-4420-9e7f-3fafc9f9a25b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:12.607571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71f8f494-dade-4420-9e7f-3fafc9f9a25b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:12.783981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9939437e-9741-4372-9653-1181f396cc33 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:12.784714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9939437e-9741-4372-9653-1181f396cc33 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:12.801778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9939437e-9741-4372-9653-1181f396cc33 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:12.805073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9939437e-9741-4372-9653-1181f396cc33 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:12.807384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9939437e-9741-4372-9653-1181f396cc33 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:12.808567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9939437e-9741-4372-9653-1181f396cc33 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:12.814551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9939437e-9741-4372-9653-1181f396cc33 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:12.818471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9939437e-9741-4372-9653-1181f396cc33 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:12.950232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-71f8f494-dade-4420-9e7f-3fafc9f9a25b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:12.961512 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-71f8f494-dade-4420-9e7f-3fafc9f9a25b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1316 microversion: 2.1 time: 0.393726 Oct 27 19:05:12.979188 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2213/4237] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:12 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:13.017405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9939437e-9741-4372-9653-1181f396cc33 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:13.029802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9939437e-9741-4372-9653-1181f396cc33 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:13.035985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9939437e-9741-4372-9653-1181f396cc33 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:13.037822 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9939437e-9741-4372-9653-1181f396cc33 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.258192 Oct 27 19:05:13.038592 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2025/4238] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:12 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:05:13.985150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b252527-c0b7-4aaa-b57e-093c4a6d9e59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:13.986404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1b252527-c0b7-4aaa-b57e-093c4a6d9e59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:13.994877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b252527-c0b7-4aaa-b57e-093c4a6d9e59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:13.997075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b252527-c0b7-4aaa-b57e-093c4a6d9e59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:13.997717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b252527-c0b7-4aaa-b57e-093c4a6d9e59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:13.999946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b252527-c0b7-4aaa-b57e-093c4a6d9e59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:14.002146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b252527-c0b7-4aaa-b57e-093c4a6d9e59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:14.005022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b252527-c0b7-4aaa-b57e-093c4a6d9e59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:14.065284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf70c55d-5382-4158-aaa2-9c783f56d968 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:14.067002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cf70c55d-5382-4158-aaa2-9c783f56d968 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:14.081143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf70c55d-5382-4158-aaa2-9c783f56d968 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:14.081637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf70c55d-5382-4158-aaa2-9c783f56d968 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:14.085146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf70c55d-5382-4158-aaa2-9c783f56d968 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:14.085960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf70c55d-5382-4158-aaa2-9c783f56d968 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:14.089987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf70c55d-5382-4158-aaa2-9c783f56d968 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:14.090663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf70c55d-5382-4158-aaa2-9c783f56d968 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:14.240390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cf70c55d-5382-4158-aaa2-9c783f56d968 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:14.256673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cf70c55d-5382-4158-aaa2-9c783f56d968 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:14.258295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cf70c55d-5382-4158-aaa2-9c783f56d968 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:14.259777 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cf70c55d-5382-4158-aaa2-9c783f56d968 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.199467 Oct 27 19:05:14.262623 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2026/4239] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:14 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:05:14.500728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1b252527-c0b7-4aaa-b57e-093c4a6d9e59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:14.517068 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1b252527-c0b7-4aaa-b57e-093c4a6d9e59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1316 microversion: 2.1 time: 0.533202 Oct 27 19:05:14.517725 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2214/4240] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:13 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:15.303485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a8fac12a-b179-4c91-ba38-1ccf37e57746 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:15.305371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a8fac12a-b179-4c91-ba38-1ccf37e57746 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:15.312870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:15.319497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:15.335342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8fac12a-b179-4c91-ba38-1ccf37e57746 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:15.336199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8fac12a-b179-4c91-ba38-1ccf37e57746 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:15.337976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8fac12a-b179-4c91-ba38-1ccf37e57746 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:15.339650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8fac12a-b179-4c91-ba38-1ccf37e57746 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:15.341758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8fac12a-b179-4c91-ba38-1ccf37e57746 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:15.342473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8fac12a-b179-4c91-ba38-1ccf37e57746 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:15.480723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a8fac12a-b179-4c91-ba38-1ccf37e57746 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:15.495489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a8fac12a-b179-4c91-ba38-1ccf37e57746 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:15.501093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a8fac12a-b179-4c91-ba38-1ccf37e57746 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:15.502370 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a8fac12a-b179-4c91-ba38-1ccf37e57746 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.210707 Oct 27 19:05:15.512419 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2027/4241] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:15 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:15.547129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2abc18a4-59cb-485a-8146-dc5880f51679 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:15.548435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2abc18a4-59cb-485a-8146-dc5880f51679 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:15.568341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:15.573261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2abc18a4-59cb-485a-8146-dc5880f51679 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:15.577583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2abc18a4-59cb-485a-8146-dc5880f51679 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:15.578286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2abc18a4-59cb-485a-8146-dc5880f51679 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:15.579248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2abc18a4-59cb-485a-8146-dc5880f51679 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:15.580014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2abc18a4-59cb-485a-8146-dc5880f51679 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:15.580617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2abc18a4-59cb-485a-8146-dc5880f51679 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:15.873668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2abc18a4-59cb-485a-8146-dc5880f51679 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:15.895095 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2abc18a4-59cb-485a-8146-dc5880f51679 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1316 microversion: 2.1 time: 0.353633 Oct 27 19:05:15.901108 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2215/4242] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:15 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:16.534485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b874434-e8e2-49d3-b286-dab06ede76f4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:16.537369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7b874434-e8e2-49d3-b286-dab06ede76f4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:16.551747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b874434-e8e2-49d3-b286-dab06ede76f4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:16.555816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b874434-e8e2-49d3-b286-dab06ede76f4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:16.556486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b874434-e8e2-49d3-b286-dab06ede76f4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:16.557446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b874434-e8e2-49d3-b286-dab06ede76f4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:16.559845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b874434-e8e2-49d3-b286-dab06ede76f4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:16.562189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b874434-e8e2-49d3-b286-dab06ede76f4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:16.689460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7b874434-e8e2-49d3-b286-dab06ede76f4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:16.710645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7b874434-e8e2-49d3-b286-dab06ede76f4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:16.712828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7b874434-e8e2-49d3-b286-dab06ede76f4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:16.714600 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7b874434-e8e2-49d3-b286-dab06ede76f4 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.184225 Oct 27 19:05:16.715589 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2028/4243] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:16 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:16.925352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2a879b82-492a-44cb-b80e-94f313dc82dd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:16.927003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2a879b82-492a-44cb-b80e-94f313dc82dd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:16.945241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a879b82-492a-44cb-b80e-94f313dc82dd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:16.945241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a879b82-492a-44cb-b80e-94f313dc82dd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:16.945241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a879b82-492a-44cb-b80e-94f313dc82dd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:16.952177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a879b82-492a-44cb-b80e-94f313dc82dd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:16.952675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a879b82-492a-44cb-b80e-94f313dc82dd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:16.953126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2a879b82-492a-44cb-b80e-94f313dc82dd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:17.248383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2a879b82-492a-44cb-b80e-94f313dc82dd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:17.261121 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2a879b82-492a-44cb-b80e-94f313dc82dd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1316 microversion: 2.1 time: 0.339642 Oct 27 19:05:17.261643 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2216/4244] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:16 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1316 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:17.748195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5c2a57ff-f757-417c-84e2-b607d0d443d3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:17.749490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5c2a57ff-f757-417c-84e2-b607d0d443d3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:17.758012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c2a57ff-f757-417c-84e2-b607d0d443d3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:17.780182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c2a57ff-f757-417c-84e2-b607d0d443d3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:17.780740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c2a57ff-f757-417c-84e2-b607d0d443d3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:17.781533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c2a57ff-f757-417c-84e2-b607d0d443d3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:17.782025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c2a57ff-f757-417c-84e2-b607d0d443d3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:17.796690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c2a57ff-f757-417c-84e2-b607d0d443d3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:17.912914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5c2a57ff-f757-417c-84e2-b607d0d443d3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:17.927378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5c2a57ff-f757-417c-84e2-b607d0d443d3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:17.930773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5c2a57ff-f757-417c-84e2-b607d0d443d3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:17.933390 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5c2a57ff-f757-417c-84e2-b607d0d443d3 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.190140 Oct 27 19:05:17.944776 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2029/4245] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:17 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:18.286300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cebe45b0-4078-4b98-9cbb-5bbf420e36eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:18.287894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cebe45b0-4078-4b98-9cbb-5bbf420e36eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:18.306736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cebe45b0-4078-4b98-9cbb-5bbf420e36eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:18.319324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cebe45b0-4078-4b98-9cbb-5bbf420e36eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:18.321961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-616381bd-2afb-4ca4-a315-9a2cc7d54ce3 req-31feeee7-1983-4318-805a-4855c51371eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847d3fc3-fa4c-4211-9900-d6a2fdcaae8a", "name": "network-vif-plugged", "status": "completed", "tag": "8464d399-181b-42ad-948a-83acea404715"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:18.324864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cebe45b0-4078-4b98-9cbb-5bbf420e36eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:18.329309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cebe45b0-4078-4b98-9cbb-5bbf420e36eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:18.330324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cebe45b0-4078-4b98-9cbb-5bbf420e36eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:18.330967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cebe45b0-4078-4b98-9cbb-5bbf420e36eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:18.358976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-616381bd-2afb-4ca4-a315-9a2cc7d54ce3 req-31feeee7-1983-4318-805a-4855c51371eb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:18.366200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-616381bd-2afb-4ca4-a315-9a2cc7d54ce3 req-31feeee7-1983-4318-805a-4855c51371eb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:18.366725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-616381bd-2afb-4ca4-a315-9a2cc7d54ce3 req-31feeee7-1983-4318-805a-4855c51371eb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:18.391964 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-616381bd-2afb-4ca4-a315-9a2cc7d54ce3 req-31feeee7-1983-4318-805a-4855c51371eb service nova] Creating event network-vif-plugged:8464d399-181b-42ad-948a-83acea404715 for instance 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a on n-h1-860687-3 Oct 27 19:05:18.404915 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-616381bd-2afb-4ca4-a315-9a2cc7d54ce3 req-31feeee7-1983-4318-805a-4855c51371eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087014 Oct 27 19:05:18.405835 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2030/4246] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:05:18.617849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cebe45b0-4078-4b98-9cbb-5bbf420e36eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:18.632304 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cebe45b0-4078-4b98-9cbb-5bbf420e36eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1316 microversion: 2.1 time: 0.350219 Oct 27 19:05:18.648826 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2217/4247] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:18 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:18.964829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-058c3fb2-1ec1-4fce-bb25-6c457356fcf0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:18.965349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-058c3fb2-1ec1-4fce-bb25-6c457356fcf0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:18.981786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-058c3fb2-1ec1-4fce-bb25-6c457356fcf0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:18.983130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-058c3fb2-1ec1-4fce-bb25-6c457356fcf0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:18.985405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-058c3fb2-1ec1-4fce-bb25-6c457356fcf0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:18.987030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-058c3fb2-1ec1-4fce-bb25-6c457356fcf0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:18.988858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-058c3fb2-1ec1-4fce-bb25-6c457356fcf0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:18.990713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-058c3fb2-1ec1-4fce-bb25-6c457356fcf0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:19.143814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-058c3fb2-1ec1-4fce-bb25-6c457356fcf0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:19.167594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-058c3fb2-1ec1-4fce-bb25-6c457356fcf0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:19.169380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-058c3fb2-1ec1-4fce-bb25-6c457356fcf0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:19.172136 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-058c3fb2-1ec1-4fce-bb25-6c457356fcf0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.212045 Oct 27 19:05:19.174972 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2031/4248] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:18 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:19.655629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b631e15a-8d82-4054-9961-d25227299492 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:19.656377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b631e15a-8d82-4054-9961-d25227299492 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:19.677312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b631e15a-8d82-4054-9961-d25227299492 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:19.678108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b631e15a-8d82-4054-9961-d25227299492 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:19.678746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b631e15a-8d82-4054-9961-d25227299492 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:19.679633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b631e15a-8d82-4054-9961-d25227299492 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:19.680305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b631e15a-8d82-4054-9961-d25227299492 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:19.680941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b631e15a-8d82-4054-9961-d25227299492 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:19.982609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b631e15a-8d82-4054-9961-d25227299492 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:19.991555 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b631e15a-8d82-4054-9961-d25227299492 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1316 microversion: 2.1 time: 0.339908 Oct 27 19:05:19.996791 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2218/4249] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:19 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:20.203957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-82d36f8f-cbff-45d1-b7c3-eb4146579fd0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:20.204503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-82d36f8f-cbff-45d1-b7c3-eb4146579fd0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:20.215559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82d36f8f-cbff-45d1-b7c3-eb4146579fd0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:20.216412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82d36f8f-cbff-45d1-b7c3-eb4146579fd0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:20.217090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82d36f8f-cbff-45d1-b7c3-eb4146579fd0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:20.218024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82d36f8f-cbff-45d1-b7c3-eb4146579fd0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:20.218830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82d36f8f-cbff-45d1-b7c3-eb4146579fd0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:20.219517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82d36f8f-cbff-45d1-b7c3-eb4146579fd0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:20.518808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-82d36f8f-cbff-45d1-b7c3-eb4146579fd0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:20.534630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-82d36f8f-cbff-45d1-b7c3-eb4146579fd0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:20.548322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-82d36f8f-cbff-45d1-b7c3-eb4146579fd0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:20.555628 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-82d36f8f-cbff-45d1-b7c3-eb4146579fd0 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.355782 Oct 27 19:05:20.558694 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2032/4250] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:20 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:21.022098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-50c6e715-b961-444b-a494-68b7309ba504 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:21.022763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-50c6e715-b961-444b-a494-68b7309ba504 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:21.037320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50c6e715-b961-444b-a494-68b7309ba504 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:21.039548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50c6e715-b961-444b-a494-68b7309ba504 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:21.042230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50c6e715-b961-444b-a494-68b7309ba504 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:21.045119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50c6e715-b961-444b-a494-68b7309ba504 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:21.047640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50c6e715-b961-444b-a494-68b7309ba504 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:21.048344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50c6e715-b961-444b-a494-68b7309ba504 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:21.395208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-50c6e715-b961-444b-a494-68b7309ba504 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:21.411226 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-50c6e715-b961-444b-a494-68b7309ba504 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1466 microversion: 2.1 time: 0.387618 Oct 27 19:05:21.412199 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2219/4251] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:21 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1466 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:21.601270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3907e32e-d2eb-45ae-bea9-87caf9cf8a43 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:21.602584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3907e32e-d2eb-45ae-bea9-87caf9cf8a43 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:21.620744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3907e32e-d2eb-45ae-bea9-87caf9cf8a43 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:21.621632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3907e32e-d2eb-45ae-bea9-87caf9cf8a43 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:21.624542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3907e32e-d2eb-45ae-bea9-87caf9cf8a43 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:21.628036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3907e32e-d2eb-45ae-bea9-87caf9cf8a43 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:21.629959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3907e32e-d2eb-45ae-bea9-87caf9cf8a43 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:21.635970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3907e32e-d2eb-45ae-bea9-87caf9cf8a43 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:21.799043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3907e32e-d2eb-45ae-bea9-87caf9cf8a43 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:21.816121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3907e32e-d2eb-45ae-bea9-87caf9cf8a43 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:21.837297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3907e32e-d2eb-45ae-bea9-87caf9cf8a43 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:21.839053 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3907e32e-d2eb-45ae-bea9-87caf9cf8a43 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.245975 Oct 27 19:05:21.839902 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2220/4252] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:21 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:05:21.899736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b037e014-6a03-4437-9f2e-4dc2d12ec648 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:21.900361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b037e014-6a03-4437-9f2e-4dc2d12ec648 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:21.906734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b037e014-6a03-4437-9f2e-4dc2d12ec648 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:21.907464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b037e014-6a03-4437-9f2e-4dc2d12ec648 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:21.908066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b037e014-6a03-4437-9f2e-4dc2d12ec648 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:21.908931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b037e014-6a03-4437-9f2e-4dc2d12ec648 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:21.909544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b037e014-6a03-4437-9f2e-4dc2d12ec648 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:21.910673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b037e014-6a03-4437-9f2e-4dc2d12ec648 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:22.417041 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b037e014-6a03-4437-9f2e-4dc2d12ec648 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1617 microversion: 2.1 time: 0.981407 Oct 27 19:05:22.429612 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2033/4253] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:21 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1617 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:22.445578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-427f96b3-2238-4064-b54f-8b38bcd00980 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Action: 'create', calling method: .version_select at 0x7fc86b2f5550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-658813291", "policies": ["affinity"]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:22.493625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-427f96b3-2238-4064-b54f-8b38bcd00980 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_groups'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:22.508648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-427f96b3-2238-4064-b54f-8b38bcd00980 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_groups'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:22.607476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-427f96b3-2238-4064-b54f-8b38bcd00980 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_groups'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:22.614840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-427f96b3-2238-4064-b54f-8b38bcd00980 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_groups'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:22.632200 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-427f96b3-2238-4064-b54f-8b38bcd00980 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.193317 Oct 27 19:05:22.633146 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2221/4254] 10.222.0.42 () {60 vars in 1174 bytes} [Thu Oct 27 19:05:22 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:22.846313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1472681552", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d836588a-4f56-4bf7-ba64-9659822c7304"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:22.868882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b4d5cbdf-c0c4-4aff-9337-9743b4b93dec tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:22.869886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b4d5cbdf-c0c4-4aff-9337-9743b4b93dec tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:22.882654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4d5cbdf-c0c4-4aff-9337-9743b4b93dec tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:22.885167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4d5cbdf-c0c4-4aff-9337-9743b4b93dec tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:22.886808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4d5cbdf-c0c4-4aff-9337-9743b4b93dec tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:22.891754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4d5cbdf-c0c4-4aff-9337-9743b4b93dec tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:22.893189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4d5cbdf-c0c4-4aff-9337-9743b4b93dec tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:22.900938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4d5cbdf-c0c4-4aff-9337-9743b4b93dec tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:22.936741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:05:23.053425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4d5cbdf-c0c4-4aff-9337-9743b4b93dec tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:23.071275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4d5cbdf-c0c4-4aff-9337-9743b4b93dec tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:23.078271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4d5cbdf-c0c4-4aff-9337-9743b4b93dec tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:23.081928 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b4d5cbdf-c0c4-4aff-9337-9743b4b93dec tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.217034 Oct 27 19:05:23.085606 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2222/4255] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:22 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:23.392417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:05:23.393305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:05:23.393942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:05:23.395681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:05:23.396000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:05:23.446322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:23.449417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:23.450282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:23.452747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:23.453556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:23.456551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:23.517372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:23.540263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:23.559921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Going to run 2 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:05:23.563052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 50a43387-291d-4b06-9156-c4873b20591b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:05:23.620089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127028) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 27 19:05:23.693104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:23.715332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:23.817531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:23.833810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:23.895741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=50a43387-291d-4b06-9156-c4873b20591b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:05:24.010978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:24.017768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:24.023549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=90 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:24.091570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:24.106285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:24.115878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-21ed8c10-89ee-4896-8cca-0d50b369dd2b tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:24.117271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-21ed8c10-89ee-4896-8cca-0d50b369dd2b tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:24.136610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-21ed8c10-89ee-4896-8cca-0d50b369dd2b tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:24.137585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-21ed8c10-89ee-4896-8cca-0d50b369dd2b tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:24.138978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-21ed8c10-89ee-4896-8cca-0d50b369dd2b tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:24.139896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-21ed8c10-89ee-4896-8cca-0d50b369dd2b tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:24.142852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-21ed8c10-89ee-4896-8cca-0d50b369dd2b tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:24.143779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-21ed8c10-89ee-4896-8cca-0d50b369dd2b tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:24.240149 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-af3aae58-b0fe-46b5-adee-3d856981229f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.398722 Oct 27 19:05:24.241305 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2034/4256] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:05:22 2022] POST /compute/v2.1/servers => generated 32 bytes in 1400 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 27 19:05:24.257850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3569e59a-47c2-46a6-810b-fa1bdb4bb83d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:24.279637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3569e59a-47c2-46a6-810b-fa1bdb4bb83d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:24.286804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3569e59a-47c2-46a6-810b-fa1bdb4bb83d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Searching by: {'deleted': False, 'project_id': '50a8ecec5b084df386bc976017133fd8'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 19:05:24.339841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3569e59a-47c2-46a6-810b-fa1bdb4bb83d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:24.340816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3569e59a-47c2-46a6-810b-fa1bdb4bb83d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:24.341374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3569e59a-47c2-46a6-810b-fa1bdb4bb83d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:24.347060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3569e59a-47c2-46a6-810b-fa1bdb4bb83d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:24.347674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3569e59a-47c2-46a6-810b-fa1bdb4bb83d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:24.348252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3569e59a-47c2-46a6-810b-fa1bdb4bb83d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:24.375556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-21ed8c10-89ee-4896-8cca-0d50b369dd2b tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:24.402143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-3569e59a-47c2-46a6-810b-fa1bdb4bb83d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 19:05:24.407290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-21ed8c10-89ee-4896-8cca-0d50b369dd2b tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:24.416226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-21ed8c10-89ee-4896-8cca-0d50b369dd2b tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:24.424257 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-21ed8c10-89ee-4896-8cca-0d50b369dd2b tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.309830 Oct 27 19:05:24.427745 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2223/4257] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:24 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:05:24.429019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:24.457319 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3569e59a-47c2-46a6-810b-fa1bdb4bb83d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.203528 Oct 27 19:05:24.467274 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2035/4258] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 19:05:24 2022] GET /compute/v2.1/servers => generated 1003 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:24.483882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8b265eb3-a2ae-444e-8c85-ac10e77dcea8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:24.484877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8b265eb3-a2ae-444e-8c85-ac10e77dcea8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:24.745445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8b265eb3-a2ae-444e-8c85-ac10e77dcea8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:24.753038 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8b265eb3-a2ae-444e-8c85-ac10e77dcea8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1219 microversion: 2.1 time: 0.277420 Oct 27 19:05:24.755504 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2224/4259] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:24 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1219 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:25.455839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cfeea886-cbcb-4037-b4b9-5de85e221912 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:25.457205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cfeea886-cbcb-4037-b4b9-5de85e221912 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:25.489264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfeea886-cbcb-4037-b4b9-5de85e221912 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:25.489896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfeea886-cbcb-4037-b4b9-5de85e221912 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:25.490570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfeea886-cbcb-4037-b4b9-5de85e221912 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:25.491337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfeea886-cbcb-4037-b4b9-5de85e221912 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:25.491811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfeea886-cbcb-4037-b4b9-5de85e221912 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:25.492254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfeea886-cbcb-4037-b4b9-5de85e221912 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:25.642225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cfeea886-cbcb-4037-b4b9-5de85e221912 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:25.652869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cfeea886-cbcb-4037-b4b9-5de85e221912 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:25.654351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cfeea886-cbcb-4037-b4b9-5de85e221912 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:25.660595 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cfeea886-cbcb-4037-b4b9-5de85e221912 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.208757 Oct 27 19:05:25.666712 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2036/4260] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:25 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:25.777022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3e1c75ef-d8a1-44ff-ad39-75fd73283223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:25.777656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3e1c75ef-d8a1-44ff-ad39-75fd73283223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:25.794369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e1c75ef-d8a1-44ff-ad39-75fd73283223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:25.808855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e1c75ef-d8a1-44ff-ad39-75fd73283223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:25.809593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e1c75ef-d8a1-44ff-ad39-75fd73283223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:25.810602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e1c75ef-d8a1-44ff-ad39-75fd73283223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:25.811245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e1c75ef-d8a1-44ff-ad39-75fd73283223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:25.813598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e1c75ef-d8a1-44ff-ad39-75fd73283223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:25.977216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3e1c75ef-d8a1-44ff-ad39-75fd73283223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:25.991929 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3e1c75ef-d8a1-44ff-ad39-75fd73283223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1223 microversion: 2.1 time: 0.218877 Oct 27 19:05:25.992904 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2225/4261] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:25 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1223 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:26.715087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b7e0d15a-9469-4366-a7a9-978bf231b190 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:26.718291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b7e0d15a-9469-4366-a7a9-978bf231b190 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:26.751421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7e0d15a-9469-4366-a7a9-978bf231b190 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:26.751937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7e0d15a-9469-4366-a7a9-978bf231b190 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:26.752393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7e0d15a-9469-4366-a7a9-978bf231b190 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:26.753131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7e0d15a-9469-4366-a7a9-978bf231b190 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:26.753628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7e0d15a-9469-4366-a7a9-978bf231b190 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:26.755055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7e0d15a-9469-4366-a7a9-978bf231b190 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:26.892890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b7e0d15a-9469-4366-a7a9-978bf231b190 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:26.914059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b7e0d15a-9469-4366-a7a9-978bf231b190 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:26.917167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b7e0d15a-9469-4366-a7a9-978bf231b190 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:26.919573 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b7e0d15a-9469-4366-a7a9-978bf231b190 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.230554 Oct 27 19:05:26.922122 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2037/4262] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:26 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:27.032627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-26b4b844-4245-49ae-b125-e97a70ce7040 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:27.033489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-26b4b844-4245-49ae-b125-e97a70ce7040 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:27.052498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26b4b844-4245-49ae-b125-e97a70ce7040 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:27.055095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26b4b844-4245-49ae-b125-e97a70ce7040 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:27.056966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26b4b844-4245-49ae-b125-e97a70ce7040 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:27.059142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26b4b844-4245-49ae-b125-e97a70ce7040 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:27.059834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26b4b844-4245-49ae-b125-e97a70ce7040 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:27.061500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26b4b844-4245-49ae-b125-e97a70ce7040 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:27.210263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-314718149", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "0e03b86b-4627-4072-8ddb-a6a80f18beba"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:27.324776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-26b4b844-4245-49ae-b125-e97a70ce7040 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:27.340320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] validate_networks() for [('0e03b86b-4627-4072-8ddb-a6a80f18beba', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:05:27.340689 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-26b4b844-4245-49ae-b125-e97a70ce7040 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1271 microversion: 2.1 time: 0.324008 Oct 27 19:05:27.341774 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2226/4263] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:27 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:27.956514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8c0751a2-9fb0-4a1a-a9b4-31c5434380f8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:27.957824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8c0751a2-9fb0-4a1a-a9b4-31c5434380f8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:27.964808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c0751a2-9fb0-4a1a-a9b4-31c5434380f8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:27.965322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c0751a2-9fb0-4a1a-a9b4-31c5434380f8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:27.965799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c0751a2-9fb0-4a1a-a9b4-31c5434380f8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:27.966541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c0751a2-9fb0-4a1a-a9b4-31c5434380f8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:27.968773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c0751a2-9fb0-4a1a-a9b4-31c5434380f8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:27.969248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c0751a2-9fb0-4a1a-a9b4-31c5434380f8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:28.044238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:28.127863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8c0751a2-9fb0-4a1a-a9b4-31c5434380f8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:28.145576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8c0751a2-9fb0-4a1a-a9b4-31c5434380f8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:28.149498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8c0751a2-9fb0-4a1a-a9b4-31c5434380f8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:28.151225 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8c0751a2-9fb0-4a1a-a9b4-31c5434380f8 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.200621 Oct 27 19:05:28.152701 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2227/4264] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:27 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:05:28.373101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1bf78ef8-83a7-4470-b8a0-aa70835f5cd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:28.374419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1bf78ef8-83a7-4470-b8a0-aa70835f5cd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:28.400122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:28.408987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bf78ef8-83a7-4470-b8a0-aa70835f5cd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:28.410607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bf78ef8-83a7-4470-b8a0-aa70835f5cd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:28.418476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bf78ef8-83a7-4470-b8a0-aa70835f5cd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:28.420675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bf78ef8-83a7-4470-b8a0-aa70835f5cd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:28.427913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bf78ef8-83a7-4470-b8a0-aa70835f5cd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:28.429581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bf78ef8-83a7-4470-b8a0-aa70835f5cd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:28.528179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:05:28.528817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:05:28.529128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:05:28.529691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:05:28.530198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:05:28.547016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:28.551737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:28.552303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:28.553052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:28.553745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:28.554203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:28.610460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:28.631209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for user e7d5767d1dc249cd8e97097588ee4728 and project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:28.656323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1bf78ef8-83a7-4470-b8a0-aa70835f5cd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:28.668350 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1bf78ef8-83a7-4470-b8a0-aa70835f5cd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1277 microversion: 2.1 time: 0.306450 Oct 27 19:05:28.669341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:05:28.671725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:05:28.673734 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2228/4265] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:28 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1277 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:28.783773 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3897ad37-ae53-44c3-bfb7-578798c7f304 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.720452 Oct 27 19:05:28.785747 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2038/4266] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:05:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:05:28.797960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-68c8579f-c6c2-49eb-bc1b-48be821a2398 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:28.799258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-68c8579f-c6c2-49eb-bc1b-48be821a2398 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:28.915299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-68c8579f-c6c2-49eb-bc1b-48be821a2398 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:28.931170 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-68c8579f-c6c2-49eb-bc1b-48be821a2398 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1192 microversion: 2.1 time: 0.134210 Oct 27 19:05:28.932585 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2229/4267] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:28 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1192 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:29.186117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-02421907-1573-44dd-bd34-b32b52a9cb07 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:29.186863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-02421907-1573-44dd-bd34-b32b52a9cb07 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:29.209441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02421907-1573-44dd-bd34-b32b52a9cb07 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:29.209984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02421907-1573-44dd-bd34-b32b52a9cb07 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:29.210488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02421907-1573-44dd-bd34-b32b52a9cb07 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:29.211252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02421907-1573-44dd-bd34-b32b52a9cb07 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:29.216995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02421907-1573-44dd-bd34-b32b52a9cb07 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:29.218195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02421907-1573-44dd-bd34-b32b52a9cb07 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:29.703003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f417bd34-0ca2-44ac-9f3e-002c05af1c1f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:29.704192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f417bd34-0ca2-44ac-9f3e-002c05af1c1f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:29.721752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f417bd34-0ca2-44ac-9f3e-002c05af1c1f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:29.722374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f417bd34-0ca2-44ac-9f3e-002c05af1c1f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:29.751956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f417bd34-0ca2-44ac-9f3e-002c05af1c1f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:29.752873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f417bd34-0ca2-44ac-9f3e-002c05af1c1f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:29.753436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f417bd34-0ca2-44ac-9f3e-002c05af1c1f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:29.768957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f417bd34-0ca2-44ac-9f3e-002c05af1c1f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:29.845479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-02421907-1573-44dd-bd34-b32b52a9cb07 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:29.873255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-02421907-1573-44dd-bd34-b32b52a9cb07 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:29.896561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-02421907-1573-44dd-bd34-b32b52a9cb07 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee8aa94e9b046babadd8dc67177a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530ba49ebcd34fdf954a813de6fdc501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:29.899696 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-02421907-1573-44dd-bd34-b32b52a9cb07 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 200 len: 1605 microversion: 2.42 time: 0.719523 Oct 27 19:05:29.909992 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2039/4268] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:29 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 1605 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:05:29.933312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-a74a4dc4-1a34-44f1-a7d6-95e75cba3c49 req-d0665300-73bb-45a3-ac4b-18a2142bcd0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a43387-291d-4b06-9156-c4873b20591b", "tag": "88c80340-3885-4652-96cc-6fd565c0932a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:30.016930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a74a4dc4-1a34-44f1-a7d6-95e75cba3c49 req-d0665300-73bb-45a3-ac4b-18a2142bcd0b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:30.017441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a74a4dc4-1a34-44f1-a7d6-95e75cba3c49 req-d0665300-73bb-45a3-ac4b-18a2142bcd0b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:30.024264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a74a4dc4-1a34-44f1-a7d6-95e75cba3c49 req-d0665300-73bb-45a3-ac4b-18a2142bcd0b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:30.079026 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a74a4dc4-1a34-44f1-a7d6-95e75cba3c49 req-d0665300-73bb-45a3-ac4b-18a2142bcd0b service nova] Creating event network-changed:88c80340-3885-4652-96cc-6fd565c0932a for instance 50a43387-291d-4b06-9156-c4873b20591b on n-h2-860687-3 Oct 27 19:05:30.107976 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-a74a4dc4-1a34-44f1-a7d6-95e75cba3c49 req-d0665300-73bb-45a3-ac4b-18a2142bcd0b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196375 Oct 27 19:05:30.110185 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2040/4269] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:30.124195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f8f9b381-a670-4467-91c7-022ae86f4760 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:30.148182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f8f9b381-a670-4467-91c7-022ae86f4760 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:30.167536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8f9b381-a670-4467-91c7-022ae86f4760 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:30.170448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8f9b381-a670-4467-91c7-022ae86f4760 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:30.172410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8f9b381-a670-4467-91c7-022ae86f4760 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:30.174582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8f9b381-a670-4467-91c7-022ae86f4760 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:30.175427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8f9b381-a670-4467-91c7-022ae86f4760 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:30.177627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8f9b381-a670-4467-91c7-022ae86f4760 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:30.399031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f8f9b381-a670-4467-91c7-022ae86f4760 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:30.402270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f417bd34-0ca2-44ac-9f3e-002c05af1c1f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:30.412975 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f8f9b381-a670-4467-91c7-022ae86f4760 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1244 microversion: 2.1 time: 0.288823 Oct 27 19:05:30.413767 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2041/4270] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:30 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1244 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:30.413928 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f417bd34-0ca2-44ac-9f3e-002c05af1c1f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1319 microversion: 2.1 time: 0.715457 Oct 27 19:05:30.424246 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2230/4271] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:29 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1319 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:30.937431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0920bec8-0fd6-4230-994d-883077ea282c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:30.937957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0920bec8-0fd6-4230-994d-883077ea282c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:30.955643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0920bec8-0fd6-4230-994d-883077ea282c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:30.956152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0920bec8-0fd6-4230-994d-883077ea282c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:30.956609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0920bec8-0fd6-4230-994d-883077ea282c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:30.957456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0920bec8-0fd6-4230-994d-883077ea282c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:30.958032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0920bec8-0fd6-4230-994d-883077ea282c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:30.958505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0920bec8-0fd6-4230-994d-883077ea282c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:31.008638 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-0920bec8-0fd6-4230-994d-883077ea282c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] HTTP exception thrown: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0920bec8-0fd6-4230-994d-883077ea282c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Request method failure captured: Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b HTTP/1.1 Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtT1Ki4e1a_2k5gsi8KyQVgzsGGtlkOnr-zscE7o5tu0IDTyw_AEFSuKXVwCYmKJbfBNxB-zyWQvqcB6wRsPESOVABKxScT_x-0Cr1NU-fgOjvFnjhWkur4DUBFZ17x6FdnHA6-aUCuB0fPBxbvTr_fruIgU-ixt1qjoL19KD5m3AGw Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.42 Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 530ba49ebcd34fdf954a813de6fdc501 Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-313605836 Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/530ba49ebcd34fdf954a813de6fdc501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/530ba49ebcd34fdf954a813de6fdc501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_530ba49ebcd34fdf954a813de6fdc501", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/530ba49ebcd34fdf954a813de6fdc501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TaggedBootDevicesTest_v242-313605836 Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 530ba49ebcd34fdf954a813de6fdc501 Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-313605836 Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TaggedBootDevicesTest_v242-313605836-project Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 7ee8aa94e9b046babadd8dc67177a487 Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TaggedBootDevicesTest_v242-313605836-project Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '0681d889-2d45-4226-9d32-0f36c94a3c2b'} Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:31.013182 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:05:31.018196 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:31.018196 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:31.018196 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:05:31.018196 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:05:31.018196 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:05:31.018196 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:05:31.018196 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:31.018196 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:31.022203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0920bec8-0fd6-4230-994d-883077ea282c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Returning 404 to user: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:05:31.025527 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0920bec8-0fd6-4230-994d-883077ea282c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 404 len: 111 microversion: 2.42 time: 0.092188 Oct 27 19:05:31.026654 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2042/4272] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:30 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:05:31.037331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eff22846-5db0-49b6-b525-da342b970d6e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '.version_select at 0x7fc86ab925e0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:31.108002 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eff22846-5db0-49b6-b525-da342b970d6e tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412603031" status: 204 len: 0 microversion: 2.42 time: 0.076638 Oct 27 19:05:31.114122 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2231/4273] 10.222.0.42 () {60 vars in 1262 bytes} [Thu Oct 27 19:05:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412603031 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:05:31.436596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e3003809-ba59-4e04-949e-741df7c00489 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:31.437492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e3003809-ba59-4e04-949e-741df7c00489 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:31.446904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3003809-ba59-4e04-949e-741df7c00489 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:31.452808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d4d8190a-82a8-4325-827e-09c01a32fa80 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:31.454246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d4d8190a-82a8-4325-827e-09c01a32fa80 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:31.461683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3003809-ba59-4e04-949e-741df7c00489 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:31.466469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3003809-ba59-4e04-949e-741df7c00489 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:31.467568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3003809-ba59-4e04-949e-741df7c00489 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:31.469641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4d8190a-82a8-4325-827e-09c01a32fa80 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:31.470327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3003809-ba59-4e04-949e-741df7c00489 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:31.471034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3003809-ba59-4e04-949e-741df7c00489 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:31.474736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4d8190a-82a8-4325-827e-09c01a32fa80 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:31.475383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4d8190a-82a8-4325-827e-09c01a32fa80 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:31.477761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4d8190a-82a8-4325-827e-09c01a32fa80 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:31.480942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4d8190a-82a8-4325-827e-09c01a32fa80 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:31.481577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4d8190a-82a8-4325-827e-09c01a32fa80 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:31.635783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e3003809-ba59-4e04-949e-741df7c00489 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:31.646745 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e3003809-ba59-4e04-949e-741df7c00489 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1250 microversion: 2.1 time: 0.214256 Oct 27 19:05:31.665512 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2043/4274] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:31 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1250 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:31.811763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-2cae8325-4fa1-43cb-84cf-6760a8e5149b req-d23d6994-09d7-424a-8ead-2f85c3637a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73ce77c-368a-405b-9114-6610934665eb", "tag": "7c30fb5c-147c-449a-aa50-cb73be243ed9"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:31.845667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d4d8190a-82a8-4325-827e-09c01a32fa80 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:31.853419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2cae8325-4fa1-43cb-84cf-6760a8e5149b req-d23d6994-09d7-424a-8ead-2f85c3637a1b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:31.854348 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d4d8190a-82a8-4325-827e-09c01a32fa80 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1319 microversion: 2.1 time: 0.405424 Oct 27 19:05:31.854625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2cae8325-4fa1-43cb-84cf-6760a8e5149b req-d23d6994-09d7-424a-8ead-2f85c3637a1b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:31.856344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2cae8325-4fa1-43cb-84cf-6760a8e5149b req-d23d6994-09d7-424a-8ead-2f85c3637a1b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:31.873830 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2232/4275] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:31 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:31.874747 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-2cae8325-4fa1-43cb-84cf-6760a8e5149b req-d23d6994-09d7-424a-8ead-2f85c3637a1b service nova] Creating event network-changed:7c30fb5c-147c-449a-aa50-cb73be243ed9 for instance c73ce77c-368a-405b-9114-6610934665eb on n-h2-860687-3 Oct 27 19:05:31.880986 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-2cae8325-4fa1-43cb-84cf-6760a8e5149b req-d23d6994-09d7-424a-8ead-2f85c3637a1b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082709 Oct 27 19:05:31.882132 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2044/4276] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:32.674830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d3462336-2df8-4a9d-ba77-8a65da0cfc7e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:32.677864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d3462336-2df8-4a9d-ba77-8a65da0cfc7e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:32.692363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3462336-2df8-4a9d-ba77-8a65da0cfc7e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:32.694491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3462336-2df8-4a9d-ba77-8a65da0cfc7e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:32.695510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3462336-2df8-4a9d-ba77-8a65da0cfc7e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:32.697086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3462336-2df8-4a9d-ba77-8a65da0cfc7e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:32.697814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3462336-2df8-4a9d-ba77-8a65da0cfc7e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:32.698570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3462336-2df8-4a9d-ba77-8a65da0cfc7e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:32.886293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c54c8ae7-9ee8-4845-aff2-2ea12825b257 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:32.889008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c54c8ae7-9ee8-4845-aff2-2ea12825b257 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:32.912300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c54c8ae7-9ee8-4845-aff2-2ea12825b257 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:32.914467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c54c8ae7-9ee8-4845-aff2-2ea12825b257 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:32.914896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c54c8ae7-9ee8-4845-aff2-2ea12825b257 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:32.916879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c54c8ae7-9ee8-4845-aff2-2ea12825b257 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:32.918537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c54c8ae7-9ee8-4845-aff2-2ea12825b257 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:32.919001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c54c8ae7-9ee8-4845-aff2-2ea12825b257 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:33.202848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c54c8ae7-9ee8-4845-aff2-2ea12825b257 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:33.214686 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c54c8ae7-9ee8-4845-aff2-2ea12825b257 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1319 microversion: 2.1 time: 0.338523 Oct 27 19:05:33.216070 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2045/4277] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:32 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:33.224741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d3462336-2df8-4a9d-ba77-8a65da0cfc7e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:33.237800 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d3462336-2df8-4a9d-ba77-8a65da0cfc7e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1292 microversion: 2.1 time: 0.568717 Oct 27 19:05:33.239540 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2233/4278] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:32 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1292 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:34.245486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e3f67658-d423-4686-9eaf-9dbd426d210f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:34.246119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e3f67658-d423-4686-9eaf-9dbd426d210f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:34.267205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2f9a5c29-41a6-473b-ace9-ab0aa54e3113 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:34.270850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2f9a5c29-41a6-473b-ace9-ab0aa54e3113 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:34.293963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3f67658-d423-4686-9eaf-9dbd426d210f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:34.297602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f9a5c29-41a6-473b-ace9-ab0aa54e3113 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:34.298203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3f67658-d423-4686-9eaf-9dbd426d210f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:34.298919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3f67658-d423-4686-9eaf-9dbd426d210f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:34.299916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3f67658-d423-4686-9eaf-9dbd426d210f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:34.301375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3f67658-d423-4686-9eaf-9dbd426d210f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:34.302337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f9a5c29-41a6-473b-ace9-ab0aa54e3113 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:34.303035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f9a5c29-41a6-473b-ace9-ab0aa54e3113 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:34.303757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3f67658-d423-4686-9eaf-9dbd426d210f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:34.305374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f9a5c29-41a6-473b-ace9-ab0aa54e3113 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:34.311650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f9a5c29-41a6-473b-ace9-ab0aa54e3113 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:34.313259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f9a5c29-41a6-473b-ace9-ab0aa54e3113 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:34.957153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e3f67658-d423-4686-9eaf-9dbd426d210f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:34.968033 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e3f67658-d423-4686-9eaf-9dbd426d210f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1319 microversion: 2.1 time: 0.728953 Oct 27 19:05:34.972461 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2046/4279] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:34 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1319 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:35.344182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2f9a5c29-41a6-473b-ace9-ab0aa54e3113 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:35.371558 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2f9a5c29-41a6-473b-ace9-ab0aa54e3113 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1292 microversion: 2.1 time: 1.111625 Oct 27 19:05:35.372406 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2234/4280] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:34 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1292 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:35.783901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-686790fa-7287-42c4-9fc0-776c5507449b req-ffccfc27-a18d-4618-b58f-3e82250ba87c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d3abfc-e621-46a7-9e2b-3dad1673ff89", "tag": "c6f45d77-1900-4222-9094-2324c63a93c7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:35.817896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-686790fa-7287-42c4-9fc0-776c5507449b req-ffccfc27-a18d-4618-b58f-3e82250ba87c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:35.818929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-686790fa-7287-42c4-9fc0-776c5507449b req-ffccfc27-a18d-4618-b58f-3e82250ba87c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:35.819742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-686790fa-7287-42c4-9fc0-776c5507449b req-ffccfc27-a18d-4618-b58f-3e82250ba87c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:35.855141 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-686790fa-7287-42c4-9fc0-776c5507449b req-ffccfc27-a18d-4618-b58f-3e82250ba87c service nova] Creating event network-changed:c6f45d77-1900-4222-9094-2324c63a93c7 for instance 18d3abfc-e621-46a7-9e2b-3dad1673ff89 on n-h1-860687-3 Oct 27 19:05:35.867989 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-686790fa-7287-42c4-9fc0-776c5507449b req-ffccfc27-a18d-4618-b58f-3e82250ba87c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089180 Oct 27 19:05:35.869337 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2047/4281] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:35.994332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fd6f9785-2508-49b0-b2b9-3698738c094b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:35.994982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fd6f9785-2508-49b0-b2b9-3698738c094b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:36.007883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd6f9785-2508-49b0-b2b9-3698738c094b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:36.008419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd6f9785-2508-49b0-b2b9-3698738c094b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:36.008871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd6f9785-2508-49b0-b2b9-3698738c094b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:36.009622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd6f9785-2508-49b0-b2b9-3698738c094b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:36.010084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd6f9785-2508-49b0-b2b9-3698738c094b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:36.010561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd6f9785-2508-49b0-b2b9-3698738c094b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:36.382267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-7b62e0c2-39c2-4e49-94c6-7839f3e46520 req-532c5fab-8311-4299-9fb9-e98175637e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a43387-291d-4b06-9156-c4873b20591b", "name": "network-vif-plugged", "status": "completed", "tag": "88c80340-3885-4652-96cc-6fd565c0932a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:36.408454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7b62e0c2-39c2-4e49-94c6-7839f3e46520 req-532c5fab-8311-4299-9fb9-e98175637e84 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:36.413222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7b62e0c2-39c2-4e49-94c6-7839f3e46520 req-532c5fab-8311-4299-9fb9-e98175637e84 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:36.413672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7b62e0c2-39c2-4e49-94c6-7839f3e46520 req-532c5fab-8311-4299-9fb9-e98175637e84 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:36.443321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fd6f9785-2508-49b0-b2b9-3698738c094b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:36.446896 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-7b62e0c2-39c2-4e49-94c6-7839f3e46520 req-532c5fab-8311-4299-9fb9-e98175637e84 service nova] Creating event network-vif-plugged:88c80340-3885-4652-96cc-6fd565c0932a for instance 50a43387-291d-4b06-9156-c4873b20591b on n-h2-860687-3 Oct 27 19:05:36.458904 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-7b62e0c2-39c2-4e49-94c6-7839f3e46520 req-532c5fab-8311-4299-9fb9-e98175637e84 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089070 Oct 27 19:05:36.460469 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2048/4282] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:05:36.469708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-64336276-c794-47f6-9c59-d3a19cf37613 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:36.470829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-64336276-c794-47f6-9c59-d3a19cf37613 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:36.475959 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fd6f9785-2508-49b0-b2b9-3698738c094b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1319 microversion: 2.1 time: 0.486356 Oct 27 19:05:36.480836 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2235/4283] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:35 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:36.514076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64336276-c794-47f6-9c59-d3a19cf37613 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:36.516196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64336276-c794-47f6-9c59-d3a19cf37613 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:36.517452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64336276-c794-47f6-9c59-d3a19cf37613 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:36.521665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64336276-c794-47f6-9c59-d3a19cf37613 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:36.523243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64336276-c794-47f6-9c59-d3a19cf37613 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:36.525187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64336276-c794-47f6-9c59-d3a19cf37613 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:36.765068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-64336276-c794-47f6-9c59-d3a19cf37613 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:36.777294 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-64336276-c794-47f6-9c59-d3a19cf37613 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1292 microversion: 2.1 time: 0.312690 Oct 27 19:05:36.788517 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2049/4284] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:36 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1292 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:37.507410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5d87237f-9803-4864-a76c-006d3b1bec70 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:37.508681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5d87237f-9803-4864-a76c-006d3b1bec70 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:37.518461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d87237f-9803-4864-a76c-006d3b1bec70 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:37.519567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d87237f-9803-4864-a76c-006d3b1bec70 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:37.521142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d87237f-9803-4864-a76c-006d3b1bec70 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:37.522037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d87237f-9803-4864-a76c-006d3b1bec70 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:37.522875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d87237f-9803-4864-a76c-006d3b1bec70 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:37.524252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d87237f-9803-4864-a76c-006d3b1bec70 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:37.703751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5d87237f-9803-4864-a76c-006d3b1bec70 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:37.725671 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5d87237f-9803-4864-a76c-006d3b1bec70 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1319 microversion: 2.1 time: 0.224297 Oct 27 19:05:37.731929 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2236/4285] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:37 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:37.801535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dce08450-abb2-424f-9c38-eb1facba7b0b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:37.802073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dce08450-abb2-424f-9c38-eb1facba7b0b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:37.809306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dce08450-abb2-424f-9c38-eb1facba7b0b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:37.809805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dce08450-abb2-424f-9c38-eb1facba7b0b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:37.810252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dce08450-abb2-424f-9c38-eb1facba7b0b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:37.811030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dce08450-abb2-424f-9c38-eb1facba7b0b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:37.811492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dce08450-abb2-424f-9c38-eb1facba7b0b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:37.811924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dce08450-abb2-424f-9c38-eb1facba7b0b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:37.935074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-05d2f471-3e1f-4975-ba27-9ce4547c219c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:37.935587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-05d2f471-3e1f-4975-ba27-9ce4547c219c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:37.949157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05d2f471-3e1f-4975-ba27-9ce4547c219c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:37.950265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05d2f471-3e1f-4975-ba27-9ce4547c219c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:37.950932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05d2f471-3e1f-4975-ba27-9ce4547c219c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:37.951883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05d2f471-3e1f-4975-ba27-9ce4547c219c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:37.953467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05d2f471-3e1f-4975-ba27-9ce4547c219c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:37.954104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05d2f471-3e1f-4975-ba27-9ce4547c219c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:37.972010 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-05d2f471-3e1f-4975-ba27-9ce4547c219c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] HTTP exception thrown: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-05d2f471-3e1f-4975-ba27-9ce4547c219c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Request method failure captured: Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b HTTP/1.1 Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtT1Ki4e1a_2k5gsi8KyQVgzsGGtlkOnr-zscE7o5tu0IDTyw_AEFSuKXVwCYmKJbfBNxB-zyWQvqcB6wRsPESOVABKxScT_x-0Cr1NU-fgOjvFnjhWkur4DUBFZ17x6FdnHA6-aUCuB0fPBxbvTr_fruIgU-ixt1qjoL19KD5m3AGw Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.42 Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 530ba49ebcd34fdf954a813de6fdc501 Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-313605836 Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/530ba49ebcd34fdf954a813de6fdc501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/530ba49ebcd34fdf954a813de6fdc501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_530ba49ebcd34fdf954a813de6fdc501", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/530ba49ebcd34fdf954a813de6fdc501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TaggedBootDevicesTest_v242-313605836 Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 530ba49ebcd34fdf954a813de6fdc501 Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-313605836 Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TaggedBootDevicesTest_v242-313605836-project Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 7ee8aa94e9b046babadd8dc67177a487 Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TaggedBootDevicesTest_v242-313605836-project Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '0681d889-2d45-4226-9d32-0f36c94a3c2b'} Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:05:37.974533 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:05:37.978237 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:37.978237 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:05:37.978237 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:05:37.978237 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:05:37.978237 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:37.978237 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:05:37.978237 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:05:37.978237 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:05:37.978237 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:05:37.978237 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:37.978237 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:05:37.978237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-05d2f471-3e1f-4975-ba27-9ce4547c219c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Returning 404 to user: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:05:37.978237 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-05d2f471-3e1f-4975-ba27-9ce4547c219c tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 404 len: 111 microversion: 2.42 time: 0.044930 Oct 27 19:05:37.978237 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2237/4286] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 19:05:37 2022] DELETE /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:05:37.984966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6048341-ee64-43aa-be19-842313e15b75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:37.985596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c6048341-ee64-43aa-be19-842313e15b75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] [instance: 0681d889-2d45-4226-9d32-0f36c94a3c2b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:37.993275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6048341-ee64-43aa-be19-842313e15b75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:37.993777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6048341-ee64-43aa-be19-842313e15b75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:37.994222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6048341-ee64-43aa-be19-842313e15b75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:37.994968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6048341-ee64-43aa-be19-842313e15b75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:37.995432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6048341-ee64-43aa-be19-842313e15b75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:37.995869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6048341-ee64-43aa-be19-842313e15b75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:38.003583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dce08450-abb2-424f-9c38-eb1facba7b0b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:38.012933 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dce08450-abb2-424f-9c38-eb1facba7b0b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1292 microversion: 2.1 time: 0.215625 Oct 27 19:05:38.013606 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-c6048341-ee64-43aa-be19-842313e15b75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] HTTP exception thrown: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:38.021630 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2050/4287] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:37 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1292 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6048341-ee64-43aa-be19-842313e15b75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Request method failure captured: Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b HTTP/1.1 Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtT1Ki4e1a_2k5gsi8KyQVgzsGGtlkOnr-zscE7o5tu0IDTyw_AEFSuKXVwCYmKJbfBNxB-zyWQvqcB6wRsPESOVABKxScT_x-0Cr1NU-fgOjvFnjhWkur4DUBFZ17x6FdnHA6-aUCuB0fPBxbvTr_fruIgU-ixt1qjoL19KD5m3AGw Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.42 Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 530ba49ebcd34fdf954a813de6fdc501 Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-313605836 Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/530ba49ebcd34fdf954a813de6fdc501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/530ba49ebcd34fdf954a813de6fdc501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_530ba49ebcd34fdf954a813de6fdc501", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/530ba49ebcd34fdf954a813de6fdc501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TaggedBootDevicesTest_v242-313605836 Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 530ba49ebcd34fdf954a813de6fdc501 Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-313605836 Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TaggedBootDevicesTest_v242-313605836-project Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 7ee8aa94e9b046babadd8dc67177a487 Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TaggedBootDevicesTest_v242-313605836-project Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '0681d889-2d45-4226-9d32-0f36c94a3c2b'} Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:05:38.021781 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:05:38.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:05:38.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:38.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:05:38.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:05:38.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:05:38.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:05:38.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. Oct 27 19:05:38.032998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:05:38.032998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6048341-ee64-43aa-be19-842313e15b75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] Returning 404 to user: Instance 0681d889-2d45-4226-9d32-0f36c94a3c2b could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:05:38.032998 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c6048341-ee64-43aa-be19-842313e15b75 tempest-TaggedBootDevicesTest_v242-313605836 tempest-TaggedBootDevicesTest_v242-313605836-project] 10.222.0.42 "GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b" status: 404 len: 111 microversion: 2.42 time: 0.036737 Oct 27 19:05:38.032998 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2238/4288] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:05:37 2022] GET /compute/v2.1/servers/0681d889-2d45-4226-9d32-0f36c94a3c2b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:05:38.551353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fdbab902-6e59-45cf-a6b7-79916d9c2706 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:38.552426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fdbab902-6e59-45cf-a6b7-79916d9c2706 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:38.571641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:38.577910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdbab902-6e59-45cf-a6b7-79916d9c2706 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:38.578753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdbab902-6e59-45cf-a6b7-79916d9c2706 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:38.579404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdbab902-6e59-45cf-a6b7-79916d9c2706 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:38.580370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdbab902-6e59-45cf-a6b7-79916d9c2706 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:38.583165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdbab902-6e59-45cf-a6b7-79916d9c2706 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:38.583898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdbab902-6e59-45cf-a6b7-79916d9c2706 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:38.652566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=28 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:38.663197 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fdbab902-6e59-45cf-a6b7-79916d9c2706 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/ips" status: 200 len: 149 microversion: 2.1 time: 0.118183 Oct 27 19:05:38.664177 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2051/4289] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 19:05:38 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/ips => generated 149 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:38.767262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4c3e64d3-662b-4c61-84e6-e4f33b7d5ae0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:38.768632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4c3e64d3-662b-4c61-84e6-e4f33b7d5ae0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:38.787947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c3e64d3-662b-4c61-84e6-e4f33b7d5ae0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:38.790089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c3e64d3-662b-4c61-84e6-e4f33b7d5ae0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:38.790973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c3e64d3-662b-4c61-84e6-e4f33b7d5ae0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:38.791962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c3e64d3-662b-4c61-84e6-e4f33b7d5ae0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:38.792652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c3e64d3-662b-4c61-84e6-e4f33b7d5ae0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:38.793301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c3e64d3-662b-4c61-84e6-e4f33b7d5ae0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:38.921073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=12 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:39.047521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55eca9ea-ccac-4bf6-a4bb-9b72e968506e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:39.048327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-55eca9ea-ccac-4bf6-a4bb-9b72e968506e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:39.074801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55eca9ea-ccac-4bf6-a4bb-9b72e968506e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:39.078370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55eca9ea-ccac-4bf6-a4bb-9b72e968506e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:39.078982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55eca9ea-ccac-4bf6-a4bb-9b72e968506e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:39.081730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55eca9ea-ccac-4bf6-a4bb-9b72e968506e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:39.082599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55eca9ea-ccac-4bf6-a4bb-9b72e968506e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:39.084507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55eca9ea-ccac-4bf6-a4bb-9b72e968506e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:39.092384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4c3e64d3-662b-4c61-84e6-e4f33b7d5ae0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:39.106465 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4c3e64d3-662b-4c61-84e6-e4f33b7d5ae0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1319 microversion: 2.1 time: 0.355594 Oct 27 19:05:39.118429 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2239/4290] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:38 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:39.355832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-55eca9ea-ccac-4bf6-a4bb-9b72e968506e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:39.404259 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-55eca9ea-ccac-4bf6-a4bb-9b72e968506e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1292 microversion: 2.1 time: 0.363703 Oct 27 19:05:39.431748 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2052/4291] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:39 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1292 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:40.147413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14dea137-4664-47a5-91ed-b269b693f311 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:40.151721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-14dea137-4664-47a5-91ed-b269b693f311 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:40.168983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14dea137-4664-47a5-91ed-b269b693f311 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:40.169475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14dea137-4664-47a5-91ed-b269b693f311 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:40.171984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14dea137-4664-47a5-91ed-b269b693f311 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:40.174605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14dea137-4664-47a5-91ed-b269b693f311 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:40.175356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14dea137-4664-47a5-91ed-b269b693f311 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:40.179484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14dea137-4664-47a5-91ed-b269b693f311 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:40.445386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8c8ae91c-62d2-4bf8-971c-91565a8a23d1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:40.446807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8c8ae91c-62d2-4bf8-971c-91565a8a23d1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:40.476777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c8ae91c-62d2-4bf8-971c-91565a8a23d1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:40.477570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c8ae91c-62d2-4bf8-971c-91565a8a23d1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:40.478193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c8ae91c-62d2-4bf8-971c-91565a8a23d1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:40.479150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c8ae91c-62d2-4bf8-971c-91565a8a23d1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:40.480073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c8ae91c-62d2-4bf8-971c-91565a8a23d1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:40.480945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c8ae91c-62d2-4bf8-971c-91565a8a23d1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:40.597889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-14dea137-4664-47a5-91ed-b269b693f311 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:40.608550 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-14dea137-4664-47a5-91ed-b269b693f311 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1319 microversion: 2.1 time: 0.466398 Oct 27 19:05:40.625465 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2240/4292] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:40 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:40.733006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8c8ae91c-62d2-4bf8-971c-91565a8a23d1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:40.749514 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8c8ae91c-62d2-4bf8-971c-91565a8a23d1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1292 microversion: 2.1 time: 0.319034 Oct 27 19:05:40.750465 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2053/4293] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:40 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1292 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:41.632473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5078d3a8-0385-455c-8d8d-8995c6e461b4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:41.633103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5078d3a8-0385-455c-8d8d-8995c6e461b4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:41.656913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5078d3a8-0385-455c-8d8d-8995c6e461b4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:41.657659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5078d3a8-0385-455c-8d8d-8995c6e461b4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:41.658287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5078d3a8-0385-455c-8d8d-8995c6e461b4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:41.659237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5078d3a8-0385-455c-8d8d-8995c6e461b4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:41.664626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5078d3a8-0385-455c-8d8d-8995c6e461b4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:41.665501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5078d3a8-0385-455c-8d8d-8995c6e461b4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:41.688758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-20286c60-baa1-4ea0-a2bc-76d3fee1604c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d33f4cb1-7cee-4bf9-bb18-badb0d0415ee"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:41.691712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-20286c60-baa1-4ea0-a2bc-76d3fee1604c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:41.709652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20286c60-baa1-4ea0-a2bc-76d3fee1604c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:41.710158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20286c60-baa1-4ea0-a2bc-76d3fee1604c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:41.710642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20286c60-baa1-4ea0-a2bc-76d3fee1604c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:41.711369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20286c60-baa1-4ea0-a2bc-76d3fee1604c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:41.711834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20286c60-baa1-4ea0-a2bc-76d3fee1604c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:41.712272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20286c60-baa1-4ea0-a2bc-76d3fee1604c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:41.916553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5078d3a8-0385-455c-8d8d-8995c6e461b4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:41.927561 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5078d3a8-0385-455c-8d8d-8995c6e461b4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1319 microversion: 2.1 time: 0.299675 Oct 27 19:05:41.928836 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2241/4294] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:41 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:41.933381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6008e014-dc50-4fea-8d68-cdf64456662f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:41.934058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6008e014-dc50-4fea-8d68-cdf64456662f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:41.942305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6008e014-dc50-4fea-8d68-cdf64456662f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:41.943283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6008e014-dc50-4fea-8d68-cdf64456662f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:41.943919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6008e014-dc50-4fea-8d68-cdf64456662f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:41.944911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6008e014-dc50-4fea-8d68-cdf64456662f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:41.945607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6008e014-dc50-4fea-8d68-cdf64456662f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:41.946261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6008e014-dc50-4fea-8d68-cdf64456662f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:42.148903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6008e014-dc50-4fea-8d68-cdf64456662f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:42.160880 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6008e014-dc50-4fea-8d68-cdf64456662f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1292 microversion: 2.1 time: 0.230959 Oct 27 19:05:42.183999 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2242/4295] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:41 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1292 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:42.198452 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-20286c60-baa1-4ea0-a2bc-76d3fee1604c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "POST /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513386 Oct 27 19:05:42.201312 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2054/4296] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:05:41 2022] POST /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:42.430482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ff8591e7-a8eb-4cfe-859b-f3a196e97026 req-fa4235b8-7321-4b5b-a1b7-3d05ba4e920b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d3abfc-e621-46a7-9e2b-3dad1673ff89", "name": "network-vif-plugged", "status": "completed", "tag": "c6f45d77-1900-4222-9094-2324c63a93c7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:42.450520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ff8591e7-a8eb-4cfe-859b-f3a196e97026 req-fa4235b8-7321-4b5b-a1b7-3d05ba4e920b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:42.451022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ff8591e7-a8eb-4cfe-859b-f3a196e97026 req-fa4235b8-7321-4b5b-a1b7-3d05ba4e920b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:42.451471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ff8591e7-a8eb-4cfe-859b-f3a196e97026 req-fa4235b8-7321-4b5b-a1b7-3d05ba4e920b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:42.464806 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ff8591e7-a8eb-4cfe-859b-f3a196e97026 req-fa4235b8-7321-4b5b-a1b7-3d05ba4e920b service nova] Creating event network-vif-plugged:c6f45d77-1900-4222-9094-2324c63a93c7 for instance 18d3abfc-e621-46a7-9e2b-3dad1673ff89 on n-h1-860687-3 Oct 27 19:05:42.471626 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ff8591e7-a8eb-4cfe-859b-f3a196e97026 req-fa4235b8-7321-4b5b-a1b7-3d05ba4e920b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045975 Oct 27 19:05:42.473441 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2243/4297] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:42.987138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-78b6071a-cc97-4b22-a482-b8bd6c39aea6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:42.988353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-78b6071a-cc97-4b22-a482-b8bd6c39aea6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:43.002011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78b6071a-cc97-4b22-a482-b8bd6c39aea6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:43.002858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78b6071a-cc97-4b22-a482-b8bd6c39aea6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:43.004051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78b6071a-cc97-4b22-a482-b8bd6c39aea6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:43.005062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78b6071a-cc97-4b22-a482-b8bd6c39aea6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:43.005723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78b6071a-cc97-4b22-a482-b8bd6c39aea6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:43.006423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78b6071a-cc97-4b22-a482-b8bd6c39aea6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:43.011294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:43.190598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-10ba34c4-6fe1-497a-9cdc-38621183cee8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:43.191900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-10ba34c4-6fe1-497a-9cdc-38621183cee8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:43.225324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10ba34c4-6fe1-497a-9cdc-38621183cee8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:43.225324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10ba34c4-6fe1-497a-9cdc-38621183cee8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:43.225324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10ba34c4-6fe1-497a-9cdc-38621183cee8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:43.225324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10ba34c4-6fe1-497a-9cdc-38621183cee8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:43.225324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10ba34c4-6fe1-497a-9cdc-38621183cee8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:43.225324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10ba34c4-6fe1-497a-9cdc-38621183cee8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:43.276859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-78b6071a-cc97-4b22-a482-b8bd6c39aea6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:43.286677 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-78b6071a-cc97-4b22-a482-b8bd6c39aea6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1319 microversion: 2.1 time: 0.323928 Oct 27 19:05:43.287261 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2055/4298] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:42 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:43.310674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-968521052", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "3071293e-5a23-4372-a3d6-6843524992ea"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:43.393795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] validate_networks() for [('3071293e-5a23-4372-a3d6-6843524992ea', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:05:43.469686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-10ba34c4-6fe1-497a-9cdc-38621183cee8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:43.479739 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-10ba34c4-6fe1-497a-9cdc-38621183cee8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1292 microversion: 2.1 time: 0.294871 Oct 27 19:05:43.480905 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2244/4299] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:43 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1292 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:43.907451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:05:43.907897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:05:43.908383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:05:43.909167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:05:43.909879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:05:43.929738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:43.930297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:43.932187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:43.932187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:43.939025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:43.939265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:43.977870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Getting quotas for project 6ea0b947e6f34941b45e54389d98e4af. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:43.984310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Getting quotas for user 0ca60b2c6a474a02a55e9e53e3954f47 and project 6ea0b947e6f34941b45e54389d98e4af. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:44.014775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:05:44.017996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:05:44.074451 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-983b7696-358a-4ca0-bbb1-d2bf27024a71 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769450 Oct 27 19:05:44.087487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-264d658f-69a1-40e6-ace0-818f3c737b00 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:44.088122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-264d658f-69a1-40e6-ace0-818f3c737b00 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:44.090469 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2056/4300] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:05:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:05:44.196352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-264d658f-69a1-40e6-ace0-818f3c737b00 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:44.210128 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-264d658f-69a1-40e6-ace0-818f3c737b00 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1213 microversion: 2.1 time: 0.126891 Oct 27 19:05:44.211878 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2245/4301] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:44 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:44.317437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8e1634a8-5bce-4c75-b27c-b1480bfe0d57 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:44.318467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8e1634a8-5bce-4c75-b27c-b1480bfe0d57 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:44.335941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1634a8-5bce-4c75-b27c-b1480bfe0d57 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:44.337978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1634a8-5bce-4c75-b27c-b1480bfe0d57 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:44.340402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1634a8-5bce-4c75-b27c-b1480bfe0d57 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:44.343226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1634a8-5bce-4c75-b27c-b1480bfe0d57 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:44.344589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1634a8-5bce-4c75-b27c-b1480bfe0d57 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:44.345423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e1634a8-5bce-4c75-b27c-b1480bfe0d57 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:44.491363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d2bc616a-d771-4b28-b17a-4bb525c2eb73 req-2df4526f-bdad-4131-8d22-69edf3c048d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73ce77c-368a-405b-9114-6610934665eb", "name": "network-vif-plugged", "status": "completed", "tag": "7c30fb5c-147c-449a-aa50-cb73be243ed9"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:44.521239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d2bc616a-d771-4b28-b17a-4bb525c2eb73 req-2df4526f-bdad-4131-8d22-69edf3c048d8 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:44.522028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d2bc616a-d771-4b28-b17a-4bb525c2eb73 req-2df4526f-bdad-4131-8d22-69edf3c048d8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:44.524309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d2bc616a-d771-4b28-b17a-4bb525c2eb73 req-2df4526f-bdad-4131-8d22-69edf3c048d8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:44.547356 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d2bc616a-d771-4b28-b17a-4bb525c2eb73 req-2df4526f-bdad-4131-8d22-69edf3c048d8 service nova] Creating event network-vif-plugged:7c30fb5c-147c-449a-aa50-cb73be243ed9 for instance c73ce77c-368a-405b-9114-6610934665eb on n-h2-860687-3 Oct 27 19:05:44.570550 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d2bc616a-d771-4b28-b17a-4bb525c2eb73 req-2df4526f-bdad-4131-8d22-69edf3c048d8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082906 Oct 27 19:05:44.577240 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2246/4302] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:44.596738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d1e2a816-b632-4869-b414-a71fed8e5556 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:44.598575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d1e2a816-b632-4869-b414-a71fed8e5556 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:44.612152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1e2a816-b632-4869-b414-a71fed8e5556 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:44.614666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1e2a816-b632-4869-b414-a71fed8e5556 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:44.615314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1e2a816-b632-4869-b414-a71fed8e5556 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:44.617198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1e2a816-b632-4869-b414-a71fed8e5556 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:44.641570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1e2a816-b632-4869-b414-a71fed8e5556 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:44.642258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1e2a816-b632-4869-b414-a71fed8e5556 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:44.716878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8e1634a8-5bce-4c75-b27c-b1480bfe0d57 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:44.729105 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8e1634a8-5bce-4c75-b27c-b1480bfe0d57 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1319 microversion: 2.1 time: 0.417136 Oct 27 19:05:44.729886 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2057/4303] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:44 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:44.914758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d1e2a816-b632-4869-b414-a71fed8e5556 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:44.922984 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d1e2a816-b632-4869-b414-a71fed8e5556 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1472 microversion: 2.1 time: 0.334936 Oct 27 19:05:44.923578 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2247/4304] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:44 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1472 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:45.065473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-345344400", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:45.169294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] validate_networks() for [('0e03b86b-4627-4072-8ddb-a6a80f18beba', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:05:45.233696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-04820e7d-bd5c-4084-9ad2-6c6bd1a4829e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:45.235211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-04820e7d-bd5c-4084-9ad2-6c6bd1a4829e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:45.249237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04820e7d-bd5c-4084-9ad2-6c6bd1a4829e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:45.256509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04820e7d-bd5c-4084-9ad2-6c6bd1a4829e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:45.257244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04820e7d-bd5c-4084-9ad2-6c6bd1a4829e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:45.258192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04820e7d-bd5c-4084-9ad2-6c6bd1a4829e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:45.260128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04820e7d-bd5c-4084-9ad2-6c6bd1a4829e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:45.260754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04820e7d-bd5c-4084-9ad2-6c6bd1a4829e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:45.405495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-04820e7d-bd5c-4084-9ad2-6c6bd1a4829e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:45.422442 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-04820e7d-bd5c-4084-9ad2-6c6bd1a4829e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1209 microversion: 2.1 time: 0.192850 Oct 27 19:05:45.423574 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2248/4305] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:45 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1209 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:45.755249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b3deff06-fdb2-479f-ac9e-deafdb31a355 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:45.756116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b3deff06-fdb2-479f-ac9e-deafdb31a355 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:45.762777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3deff06-fdb2-479f-ac9e-deafdb31a355 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:45.763548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3deff06-fdb2-479f-ac9e-deafdb31a355 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:45.764189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3deff06-fdb2-479f-ac9e-deafdb31a355 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:45.765065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3deff06-fdb2-479f-ac9e-deafdb31a355 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:45.765687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3deff06-fdb2-479f-ac9e-deafdb31a355 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:45.766280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3deff06-fdb2-479f-ac9e-deafdb31a355 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:46.042225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b3deff06-fdb2-479f-ac9e-deafdb31a355 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:46.052313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:46.069824 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b3deff06-fdb2-479f-ac9e-deafdb31a355 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1319 microversion: 2.1 time: 0.317945 Oct 27 19:05:46.072471 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2249/4306] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:45 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:46.339822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:05:46.340873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:05:46.341558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:05:46.342134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:05:46.342748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:05:46.353065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:46.354078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:46.354712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:46.356394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:46.357080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:46.357697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:46.379533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:46.386462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for user e7d5767d1dc249cd8e97097588ee4728 and project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:46.401590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:46.404045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:05:46.406929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: a7f303ec-0462-4187-9eaf-73d0d503bf2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:05:46.448056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d96162de-08c9-404b-9a3b-d5d9e0b406ef tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:46.449358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d96162de-08c9-404b-9a3b-d5d9e0b406ef tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:46.461799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d96162de-08c9-404b-9a3b-d5d9e0b406ef tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:46.463416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d96162de-08c9-404b-9a3b-d5d9e0b406ef tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:46.465453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d96162de-08c9-404b-9a3b-d5d9e0b406ef tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:46.466456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d96162de-08c9-404b-9a3b-d5d9e0b406ef tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:46.467527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d96162de-08c9-404b-9a3b-d5d9e0b406ef tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:46.470920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d96162de-08c9-404b-9a3b-d5d9e0b406ef tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:46.493133 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b1db231e-f40c-4f59-9fd1-b9cc46bcf9ac tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.432983 Oct 27 19:05:46.494415 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2058/4307] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:05:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:05:46.506658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-11e85400-04d7-4630-8da7-b18fdef85f39 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:46.507404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-11e85400-04d7-4630-8da7-b18fdef85f39 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: a7f303ec-0462-4187-9eaf-73d0d503bf2c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:46.552790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-11e85400-04d7-4630-8da7-b18fdef85f39 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: a7f303ec-0462-4187-9eaf-73d0d503bf2c] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:05:46.609064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d96162de-08c9-404b-9a3b-d5d9e0b406ef tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:46.625134 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d96162de-08c9-404b-9a3b-d5d9e0b406ef tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1271 microversion: 2.1 time: 0.181258 Oct 27 19:05:46.628192 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2250/4308] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:46 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:47.094252 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-11e85400-04d7-4630-8da7-b18fdef85f39 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a7f303ec-0462-4187-9eaf-73d0d503bf2c" status: 204 len: 0 microversion: 2.1 time: 0.592171 Oct 27 19:05:47.100954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a7913919-82eb-498f-840b-d7abd230093f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:47.104149 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2059/4309] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:05:46 2022] DELETE /compute/v2.1/servers/a7f303ec-0462-4187-9eaf-73d0d503bf2c => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:05:47.104296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a7913919-82eb-498f-840b-d7abd230093f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:47.109938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7aa300a4-7c01-4497-9280-0ac03cb947f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:47.121837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7913919-82eb-498f-840b-d7abd230093f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:47.122442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7913919-82eb-498f-840b-d7abd230093f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:47.122829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7913919-82eb-498f-840b-d7abd230093f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:47.123557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7913919-82eb-498f-840b-d7abd230093f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:47.127453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7aa300a4-7c01-4497-9280-0ac03cb947f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: a7f303ec-0462-4187-9eaf-73d0d503bf2c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:47.144621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7913919-82eb-498f-840b-d7abd230093f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:47.147723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7913919-82eb-498f-840b-d7abd230093f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:47.156407 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-7aa300a4-7c01-4497-9280-0ac03cb947f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7aa300a4-7c01-4497-9280-0ac03cb947f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/a7f303ec-0462-4187-9eaf-73d0d503bf2c HTTP/1.1 Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a7f303ec-0462-4187-9eaf-73d0d503bf2c'} Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:05:47.159906 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:05:47.165161 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:05:47.165161 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:05:47.165161 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:05:47.165161 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:05:47.169169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7aa300a4-7c01-4497-9280-0ac03cb947f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:05:47.173652 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7aa300a4-7c01-4497-9280-0ac03cb947f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f303ec-0462-4187-9eaf-73d0d503bf2c" status: 404 len: 111 microversion: 2.1 time: 0.066763 Oct 27 19:05:47.186235 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2060/4310] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:47 2022] GET /compute/v2.1/servers/a7f303ec-0462-4187-9eaf-73d0d503bf2c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:05:47.250481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1818790545", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "0e03b86b-4627-4072-8ddb-a6a80f18beba"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:47.355900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] validate_networks() for [('0e03b86b-4627-4072-8ddb-a6a80f18beba', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:05:47.609518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a7913919-82eb-498f-840b-d7abd230093f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:47.619105 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a7913919-82eb-498f-840b-d7abd230093f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1468 microversion: 2.1 time: 0.523488 Oct 27 19:05:47.624731 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2251/4311] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:47 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1468 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:47.655196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-df8eff57-553c-43a0-b460-bada256a1dab tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:47.656031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-df8eff57-553c-43a0-b460-bada256a1dab tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 50a43387-291d-4b06-9156-c4873b20591b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:47.670097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df8eff57-553c-43a0-b460-bada256a1dab tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:47.676385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df8eff57-553c-43a0-b460-bada256a1dab tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:47.677039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df8eff57-553c-43a0-b460-bada256a1dab tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:47.678007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df8eff57-553c-43a0-b460-bada256a1dab tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:47.678817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df8eff57-553c-43a0-b460-bada256a1dab tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:47.679464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df8eff57-553c-43a0-b460-bada256a1dab tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:48.182040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:05:48.184012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:05:48.184514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:05:48.184942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:05:48.185369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:05:48.198581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:48.199353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:48.199994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:48.200919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:48.201603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:48.202209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:48.226750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:48.234193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for user e7d5767d1dc249cd8e97097588ee4728 and project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:48.256200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:05:48.259067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:05:48.358656 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ef36f6f0-154f-4042-874c-1e42c1f55657 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110323 Oct 27 19:05:48.366339 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2061/4312] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:05:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:05:48.378117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-183c9774-ccf8-4b09-97d4-1de6df3f4cb5 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:48.379976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-183c9774-ccf8-4b09-97d4-1de6df3f4cb5 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:48.393670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-183c9774-ccf8-4b09-97d4-1de6df3f4cb5 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:48.394844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-183c9774-ccf8-4b09-97d4-1de6df3f4cb5 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:48.395777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-183c9774-ccf8-4b09-97d4-1de6df3f4cb5 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:48.396689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-183c9774-ccf8-4b09-97d4-1de6df3f4cb5 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:48.397401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-183c9774-ccf8-4b09-97d4-1de6df3f4cb5 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:48.398083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-183c9774-ccf8-4b09-97d4-1de6df3f4cb5 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:48.610747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-183c9774-ccf8-4b09-97d4-1de6df3f4cb5 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:48.645882 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-183c9774-ccf8-4b09-97d4-1de6df3f4cb5 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1313 microversion: 2.1 time: 0.280430 Oct 27 19:05:48.662653 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2062/4313] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:48 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:48.668436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2642be5d-18ae-4c0e-bec2-00ac95a6423e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:48.668436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2642be5d-18ae-4c0e-bec2-00ac95a6423e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:48.774315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2642be5d-18ae-4c0e-bec2-00ac95a6423e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:48.787545 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2642be5d-18ae-4c0e-bec2-00ac95a6423e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1221 microversion: 2.1 time: 0.137093 Oct 27 19:05:48.788456 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2063/4314] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:48 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1221 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:48.966827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-df8eff57-553c-43a0-b460-bada256a1dab tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:48.985856 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-df8eff57-553c-43a0-b460-bada256a1dab tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b" status: 200 len: 1469 microversion: 2.1 time: 1.334852 Oct 27 19:05:48.988681 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2252/4315] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:47 2022] GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b => generated 1469 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:49.030021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:49.057444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:49.058421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Searching by: {'reservation_id': 'r-p8395xwq', 'deleted': False, 'project_id': '50a8ecec5b084df386bc976017133fd8'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 19:05:49.073493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:49.073990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:49.074467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:49.075231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:49.075700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:49.076137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:49.221341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 19:05:49.382433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:49.410327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:49.411074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:49.412717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:49.530060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-9b74734d-8993-4537-9321-1c7570ea23e3 req-5da393b6-5ce4-4280-946c-d4d0e2ed85bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829be0ce-7a93-4656-8a57-319d6f73a55d", "tag": "1dc9acd5-4abb-4e56-86b1-45d76c7ab298"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:49.544907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9b74734d-8993-4537-9321-1c7570ea23e3 req-5da393b6-5ce4-4280-946c-d4d0e2ed85bc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:49.545693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9b74734d-8993-4537-9321-1c7570ea23e3 req-5da393b6-5ce4-4280-946c-d4d0e2ed85bc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:49.546345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9b74734d-8993-4537-9321-1c7570ea23e3 req-5da393b6-5ce4-4280-946c-d4d0e2ed85bc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:49.563038 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-9b74734d-8993-4537-9321-1c7570ea23e3 req-5da393b6-5ce4-4280-946c-d4d0e2ed85bc service nova] Creating event network-changed:1dc9acd5-4abb-4e56-86b1-45d76c7ab298 for instance 829be0ce-7a93-4656-8a57-319d6f73a55d on n-h1-860687-3 Oct 27 19:05:49.572761 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-9b74734d-8993-4537-9321-1c7570ea23e3 req-5da393b6-5ce4-4280-946c-d4d0e2ed85bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292384 Oct 27 19:05:49.574178 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2253/4316] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:05:49.649873 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-44384f6b-4d8f-4393-be86-de21734293e9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?reservation_id=r-p8395xwq" status: 200 len: 2930 microversion: 2.1 time: 0.623700 Oct 27 19:05:49.650510 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2064/4317] 10.222.0.42 () {58 vars in 1197 bytes} [Thu Oct 27 19:05:49 2022] GET /compute/v2.1/servers/detail?reservation_id=r-p8395xwq => generated 2930 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:49.677324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-574d0ef4-c7a1-4b68-bdc1-495b055b42c0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:49.683386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-37841df6-255c-4131-ae2b-0c74529c5c52 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:49.684107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-37841df6-255c-4131-ae2b-0c74529c5c52 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:49.695730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37841df6-255c-4131-ae2b-0c74529c5c52 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:49.696234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37841df6-255c-4131-ae2b-0c74529c5c52 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:49.699429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37841df6-255c-4131-ae2b-0c74529c5c52 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:49.707052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37841df6-255c-4131-ae2b-0c74529c5c52 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:49.707736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37841df6-255c-4131-ae2b-0c74529c5c52 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:49.708196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-37841df6-255c-4131-ae2b-0c74529c5c52 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:49.718657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.compute.server_groups [None req-574d0ef4-c7a1-4b68-bdc1-495b055b42c0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Querying cell af35862a-071a-430c-affa-82567dc9805c(cell1) for 2 instances {{(pid=127028) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 19:05:49.719386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-574d0ef4-c7a1-4b68-bdc1-495b055b42c0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:49.719879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-574d0ef4-c7a1-4b68-bdc1-495b055b42c0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:49.720326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-574d0ef4-c7a1-4b68-bdc1-495b055b42c0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:49.780239 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-574d0ef4-c7a1-4b68-bdc1-495b055b42c0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/d836588a-4f56-4bf7-ba64-9659822c7304" status: 200 len: 265 microversion: 2.1 time: 0.106928 Oct 27 19:05:49.787267 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2065/4318] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 19:05:49 2022] GET /compute/v2.1/os-server-groups/d836588a-4f56-4bf7-ba64-9659822c7304 => generated 265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:49.793582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8eaa323b-3a9c-4c1a-a62c-1b3e9229d36b tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:49.794210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8eaa323b-3a9c-4c1a-a62c-1b3e9229d36b tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] [instance: 50a43387-291d-4b06-9156-c4873b20591b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:49.811824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8eaa323b-3a9c-4c1a-a62c-1b3e9229d36b tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:49.813968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8eaa323b-3a9c-4c1a-a62c-1b3e9229d36b tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:49.817429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8eaa323b-3a9c-4c1a-a62c-1b3e9229d36b tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:49.820655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8eaa323b-3a9c-4c1a-a62c-1b3e9229d36b tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:49.821702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8eaa323b-3a9c-4c1a-a62c-1b3e9229d36b tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:49.823189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8eaa323b-3a9c-4c1a-a62c-1b3e9229d36b tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:50.025875 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8eaa323b-3a9c-4c1a-a62c-1b3e9229d36b tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b" status: 200 len: 1620 microversion: 2.1 time: 0.236135 Oct 27 19:05:50.031532 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2066/4319] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:49 2022] GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b => generated 1620 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:50.053312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8c21cc12-4342-4bc0-a575-83521d5b530f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:50.065769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8c21cc12-4342-4bc0-a575-83521d5b530f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:50.082650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c21cc12-4342-4bc0-a575-83521d5b530f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:50.083154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c21cc12-4342-4bc0-a575-83521d5b530f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:50.083606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c21cc12-4342-4bc0-a575-83521d5b530f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:50.084318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c21cc12-4342-4bc0-a575-83521d5b530f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:50.084783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c21cc12-4342-4bc0-a575-83521d5b530f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:50.085217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c21cc12-4342-4bc0-a575-83521d5b530f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:50.102903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-37841df6-255c-4131-ae2b-0c74529c5c52 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:50.110932 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-37841df6-255c-4131-ae2b-0c74529c5c52 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1313 microversion: 2.1 time: 0.431516 Oct 27 19:05:50.112131 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2254/4320] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:49 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:50.117346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-82c51000-fa25-477c-a04e-63c3a331ebcf tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:50.118280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-82c51000-fa25-477c-a04e-63c3a331ebcf tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:50.125781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82c51000-fa25-477c-a04e-63c3a331ebcf tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:50.126667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82c51000-fa25-477c-a04e-63c3a331ebcf tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:50.127327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82c51000-fa25-477c-a04e-63c3a331ebcf tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:50.128290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82c51000-fa25-477c-a04e-63c3a331ebcf tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:50.128969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82c51000-fa25-477c-a04e-63c3a331ebcf tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:50.129617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82c51000-fa25-477c-a04e-63c3a331ebcf tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:50.190174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8c21cc12-4342-4bc0-a575-83521d5b530f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:50.199871 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8c21cc12-4342-4bc0-a575-83521d5b530f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1273 microversion: 2.1 time: 0.166386 Oct 27 19:05:50.200780 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2067/4321] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:50 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:50.271567 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-82c51000-fa25-477c-a04e-63c3a331ebcf tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 200 len: 1619 microversion: 2.1 time: 0.157918 Oct 27 19:05:50.272656 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2255/4322] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:50 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 1619 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:50.304023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7a5b1c5c-ca08-4134-bcd1-06b633b68d81 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Action: 'create', calling method: .version_select at 0x7fc869b23a60>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-88614426", "policies": ["anti-affinity"]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:50.346838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-7a5b1c5c-ca08-4134-bcd1-06b633b68d81 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:50.354630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-7a5b1c5c-ca08-4134-bcd1-06b633b68d81 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:50.414349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-7a5b1c5c-ca08-4134-bcd1-06b633b68d81 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:50.423362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-7a5b1c5c-ca08-4134-bcd1-06b633b68d81 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:50.440066 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7a5b1c5c-ca08-4134-bcd1-06b633b68d81 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 191 microversion: 2.1 time: 0.142214 Oct 27 19:05:50.441859 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2068/4323] 10.222.0.42 () {60 vars in 1174 bytes} [Thu Oct 27 19:05:50 2022] POST /compute/v2.1/os-server-groups => generated 191 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:50.589922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-691305621", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "35edbec0-d013-404e-b6d6-c0ec180c98ee"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:50.682331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:05:51.102701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:05:51.103477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:05:51.104694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:05:51.105631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:05:51.106548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:05:51.150810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7a156306-00ea-4130-a9f3-493f1a489839 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:51.150810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7a156306-00ea-4130-a9f3-493f1a489839 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:51.152910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a156306-00ea-4130-a9f3-493f1a489839 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:51.153418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a156306-00ea-4130-a9f3-493f1a489839 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:51.153860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a156306-00ea-4130-a9f3-493f1a489839 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:51.156689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a156306-00ea-4130-a9f3-493f1a489839 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:51.158075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a156306-00ea-4130-a9f3-493f1a489839 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:51.160659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a156306-00ea-4130-a9f3-493f1a489839 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:51.162502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:51.163252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:51.164430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:51.167140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:51.167738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:51.168372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:51.238463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:51.246906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:51.264130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Going to run 2 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:05:51.266922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 66c337e5-0721-4c5e-a3f2-daa9af6f23a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:05:51.321968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127029) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 27 19:05:51.365339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:51.379512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:51.412506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7a156306-00ea-4130-a9f3-493f1a489839 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:51.431611 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7a156306-00ea-4130-a9f3-493f1a489839 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1313 microversion: 2.1 time: 0.295783 Oct 27 19:05:51.434482 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2069/4324] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:51 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:51.439593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-95edae43-fe85-4b97-a041-09f3fbb85211 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:51.440397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-95edae43-fe85-4b97-a041-09f3fbb85211 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:51.447195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95edae43-fe85-4b97-a041-09f3fbb85211 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:51.447948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95edae43-fe85-4b97-a041-09f3fbb85211 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:51.448574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95edae43-fe85-4b97-a041-09f3fbb85211 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:51.449455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95edae43-fe85-4b97-a041-09f3fbb85211 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:51.450076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95edae43-fe85-4b97-a041-09f3fbb85211 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:51.450696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95edae43-fe85-4b97-a041-09f3fbb85211 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:51.481439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:51.490449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:51.492047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:51.536054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=66c337e5-0721-4c5e-a3f2-daa9af6f23a4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:05:51.576642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-95edae43-fe85-4b97-a041-09f3fbb85211 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:51.591203 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-95edae43-fe85-4b97-a041-09f3fbb85211 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1279 microversion: 2.1 time: 0.155471 Oct 27 19:05:51.606496 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2070/4325] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:51 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:51.647850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:51.653832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:51.701685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:05:51.707833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'server_group_members'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:05:51.758521 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b0fa4127-7488-4bfe-9592-c0e86308cd99 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.172371 Oct 27 19:05:51.760758 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2256/4326] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:05:50 2022] POST /compute/v2.1/servers => generated 32 bytes in 1176 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 27 19:05:51.768268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e8560cc9-9bae-460c-954e-6f340d6bbc66 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:51.776793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8560cc9-9bae-460c-954e-6f340d6bbc66 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:51.779733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e8560cc9-9bae-460c-954e-6f340d6bbc66 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Searching by: {'deleted': False, 'project_id': '50a8ecec5b084df386bc976017133fd8'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 19:05:51.806339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8560cc9-9bae-460c-954e-6f340d6bbc66 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:51.817582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8560cc9-9bae-460c-954e-6f340d6bbc66 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:51.818204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8560cc9-9bae-460c-954e-6f340d6bbc66 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:51.823081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8560cc9-9bae-460c-954e-6f340d6bbc66 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:51.823694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8560cc9-9bae-460c-954e-6f340d6bbc66 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:51.824270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8560cc9-9bae-460c-954e-6f340d6bbc66 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:51.883578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-e8560cc9-9bae-460c-954e-6f340d6bbc66 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 19:05:51.928831 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e8560cc9-9bae-460c-954e-6f340d6bbc66 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.163948 Oct 27 19:05:51.930048 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2071/4327] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 19:05:51 2022] GET /compute/v2.1/servers => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:51.944862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-880dac44-ab46-4dc8-be86-f47c9712a226 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:51.945670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-880dac44-ab46-4dc8-be86-f47c9712a226 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:52.158090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-880dac44-ab46-4dc8-be86-f47c9712a226 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:52.167933 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-880dac44-ab46-4dc8-be86-f47c9712a226 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1218 microversion: 2.1 time: 0.229205 Oct 27 19:05:52.168561 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2257/4328] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:51 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1218 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:52.459865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8fb0a82e-e08e-4dc8-bc62-57beca770613 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:52.461122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8fb0a82e-e08e-4dc8-bc62-57beca770613 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:52.469725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fb0a82e-e08e-4dc8-bc62-57beca770613 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:52.471102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fb0a82e-e08e-4dc8-bc62-57beca770613 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:52.471734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fb0a82e-e08e-4dc8-bc62-57beca770613 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:52.473804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fb0a82e-e08e-4dc8-bc62-57beca770613 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:52.475030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fb0a82e-e08e-4dc8-bc62-57beca770613 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:52.475634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fb0a82e-e08e-4dc8-bc62-57beca770613 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:52.618557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-98a03eea-62f9-433e-9995-d441f4bdcbc7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:52.620220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-98a03eea-62f9-433e-9995-d441f4bdcbc7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:52.627618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98a03eea-62f9-433e-9995-d441f4bdcbc7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:52.630848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98a03eea-62f9-433e-9995-d441f4bdcbc7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:52.631682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98a03eea-62f9-433e-9995-d441f4bdcbc7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:52.633302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98a03eea-62f9-433e-9995-d441f4bdcbc7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:52.637313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98a03eea-62f9-433e-9995-d441f4bdcbc7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:52.638029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98a03eea-62f9-433e-9995-d441f4bdcbc7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:52.756320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8fb0a82e-e08e-4dc8-bc62-57beca770613 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:52.766016 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8fb0a82e-e08e-4dc8-bc62-57beca770613 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1313 microversion: 2.1 time: 0.311467 Oct 27 19:05:52.767486 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2072/4329] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:52 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:53.022135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-98a03eea-62f9-433e-9995-d441f4bdcbc7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:53.034638 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-98a03eea-62f9-433e-9995-d441f4bdcbc7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1321 microversion: 2.1 time: 0.420335 Oct 27 19:05:53.035987 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2258/4330] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:52 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:53.191789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ae51917-ae01-4e5e-993e-ca3d4a84a4bb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:53.192504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ae51917-ae01-4e5e-993e-ca3d4a84a4bb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:53.212540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ae51917-ae01-4e5e-993e-ca3d4a84a4bb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:53.223461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ae51917-ae01-4e5e-993e-ca3d4a84a4bb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:53.224143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ae51917-ae01-4e5e-993e-ca3d4a84a4bb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:53.225081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ae51917-ae01-4e5e-993e-ca3d4a84a4bb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:53.225729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ae51917-ae01-4e5e-993e-ca3d4a84a4bb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:53.226156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ae51917-ae01-4e5e-993e-ca3d4a84a4bb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:53.368055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9ae51917-ae01-4e5e-993e-ca3d4a84a4bb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:53.389236 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ae51917-ae01-4e5e-993e-ca3d4a84a4bb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1222 microversion: 2.1 time: 0.201432 Oct 27 19:05:53.394932 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2073/4331] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:53 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1222 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:53.501784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e8aaaac3-d660-4520-83ae-f5aaa6bc1fc0 req-1d40d082-1b56-4639-b1f4-fbe75dddaf47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0eab732-8c21-49ce-9687-a3fecd1284b4", "tag": "7062376b-cb6d-4c72-9cbc-a947196bbf05"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:53.536974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e8aaaac3-d660-4520-83ae-f5aaa6bc1fc0 req-1d40d082-1b56-4639-b1f4-fbe75dddaf47 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:53.541060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e8aaaac3-d660-4520-83ae-f5aaa6bc1fc0 req-1d40d082-1b56-4639-b1f4-fbe75dddaf47 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:53.541959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e8aaaac3-d660-4520-83ae-f5aaa6bc1fc0 req-1d40d082-1b56-4639-b1f4-fbe75dddaf47 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:53.569150 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e8aaaac3-d660-4520-83ae-f5aaa6bc1fc0 req-1d40d082-1b56-4639-b1f4-fbe75dddaf47 service nova] Creating event network-changed:7062376b-cb6d-4c72-9cbc-a947196bbf05 for instance d0eab732-8c21-49ce-9687-a3fecd1284b4 on n-h2-860687-3 Oct 27 19:05:53.576517 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e8aaaac3-d660-4520-83ae-f5aaa6bc1fc0 req-1d40d082-1b56-4639-b1f4-fbe75dddaf47 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085856 Oct 27 19:05:53.588490 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2259/4332] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:53.791930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c4ecdc91-62a0-44ac-aee3-a519485b6dad tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:53.793121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c4ecdc91-62a0-44ac-aee3-a519485b6dad tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:53.800352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ecdc91-62a0-44ac-aee3-a519485b6dad tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:53.801282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ecdc91-62a0-44ac-aee3-a519485b6dad tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:53.801893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ecdc91-62a0-44ac-aee3-a519485b6dad tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:53.802826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ecdc91-62a0-44ac-aee3-a519485b6dad tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:53.803453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ecdc91-62a0-44ac-aee3-a519485b6dad tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:53.804052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ecdc91-62a0-44ac-aee3-a519485b6dad tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:53.957812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c4ecdc91-62a0-44ac-aee3-a519485b6dad tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:53.966951 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c4ecdc91-62a0-44ac-aee3-a519485b6dad tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1313 microversion: 2.1 time: 0.178778 Oct 27 19:05:53.969499 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2074/4333] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:53 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:54.079041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-963d20ff-95c2-4903-8d66-f8cc97a6d1d4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:54.079899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-963d20ff-95c2-4903-8d66-f8cc97a6d1d4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:54.100094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-963d20ff-95c2-4903-8d66-f8cc97a6d1d4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:54.107065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-963d20ff-95c2-4903-8d66-f8cc97a6d1d4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:54.109359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-963d20ff-95c2-4903-8d66-f8cc97a6d1d4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:54.110430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-963d20ff-95c2-4903-8d66-f8cc97a6d1d4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:54.114037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-963d20ff-95c2-4903-8d66-f8cc97a6d1d4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:54.114553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-963d20ff-95c2-4903-8d66-f8cc97a6d1d4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:54.412070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aa3f0a8e-5cdb-4e67-819f-a851a04dbcde tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:54.413000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aa3f0a8e-5cdb-4e67-819f-a851a04dbcde tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:54.423803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa3f0a8e-5cdb-4e67-819f-a851a04dbcde tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:54.427017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa3f0a8e-5cdb-4e67-819f-a851a04dbcde tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:54.427817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa3f0a8e-5cdb-4e67-819f-a851a04dbcde tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:54.428756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa3f0a8e-5cdb-4e67-819f-a851a04dbcde tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:54.429398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa3f0a8e-5cdb-4e67-819f-a851a04dbcde tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:54.431101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa3f0a8e-5cdb-4e67-819f-a851a04dbcde tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:54.793251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aa3f0a8e-5cdb-4e67-819f-a851a04dbcde tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:54.803140 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aa3f0a8e-5cdb-4e67-819f-a851a04dbcde tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1270 microversion: 2.1 time: 0.395000 Oct 27 19:05:54.809449 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2075/4334] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:54 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1270 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:54.991919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-10baba8c-478c-4a1b-9528-009dccdccf1d tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:54.992846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-10baba8c-478c-4a1b-9528-009dccdccf1d tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:55.004211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10baba8c-478c-4a1b-9528-009dccdccf1d tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:55.008334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10baba8c-478c-4a1b-9528-009dccdccf1d tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:55.008959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10baba8c-478c-4a1b-9528-009dccdccf1d tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:55.009850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10baba8c-478c-4a1b-9528-009dccdccf1d tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:55.012463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10baba8c-478c-4a1b-9528-009dccdccf1d tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:55.013113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10baba8c-478c-4a1b-9528-009dccdccf1d tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:55.017097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-963d20ff-95c2-4903-8d66-f8cc97a6d1d4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:55.029528 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-963d20ff-95c2-4903-8d66-f8cc97a6d1d4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1321 microversion: 2.1 time: 0.969404 Oct 27 19:05:55.030134 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2260/4335] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:54 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1321 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:55.419657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-10baba8c-478c-4a1b-9528-009dccdccf1d tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:55.429168 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-10baba8c-478c-4a1b-9528-009dccdccf1d tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1313 microversion: 2.1 time: 0.441005 Oct 27 19:05:55.438854 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2076/4336] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:54 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:05:55.833606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-64ccf639-1945-43f6-abe8-948384a58dbc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:55.834542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-64ccf639-1945-43f6-abe8-948384a58dbc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:55.847564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64ccf639-1945-43f6-abe8-948384a58dbc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:55.851679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64ccf639-1945-43f6-abe8-948384a58dbc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:55.853203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64ccf639-1945-43f6-abe8-948384a58dbc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:55.855246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64ccf639-1945-43f6-abe8-948384a58dbc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:55.856608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64ccf639-1945-43f6-abe8-948384a58dbc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:55.857990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64ccf639-1945-43f6-abe8-948384a58dbc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:56.055013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f68f622e-d4c8-4aa3-b0e3-8a1c656d1021 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:56.056250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f68f622e-d4c8-4aa3-b0e3-8a1c656d1021 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:56.059486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:56.077689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f68f622e-d4c8-4aa3-b0e3-8a1c656d1021 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:56.078595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f68f622e-d4c8-4aa3-b0e3-8a1c656d1021 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:56.079196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f68f622e-d4c8-4aa3-b0e3-8a1c656d1021 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:56.080063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f68f622e-d4c8-4aa3-b0e3-8a1c656d1021 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:56.080676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f68f622e-d4c8-4aa3-b0e3-8a1c656d1021 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:56.081789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f68f622e-d4c8-4aa3-b0e3-8a1c656d1021 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:56.137566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:56.328919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-64ccf639-1945-43f6-abe8-948384a58dbc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:56.330087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f68f622e-d4c8-4aa3-b0e3-8a1c656d1021 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:56.338316 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-64ccf639-1945-43f6-abe8-948384a58dbc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1318 microversion: 2.1 time: 0.509066 Oct 27 19:05:56.339010 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2261/4337] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:55 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:56.365961 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f68f622e-d4c8-4aa3-b0e3-8a1c656d1021 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1321 microversion: 2.1 time: 0.316434 Oct 27 19:05:56.381718 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2077/4338] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:56 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:56.455788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7f903b61-b191-49c7-86bc-082c02780947 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:56.456487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7f903b61-b191-49c7-86bc-082c02780947 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:56.481369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f903b61-b191-49c7-86bc-082c02780947 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:56.481899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f903b61-b191-49c7-86bc-082c02780947 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:56.482366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f903b61-b191-49c7-86bc-082c02780947 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:56.483144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f903b61-b191-49c7-86bc-082c02780947 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:56.483634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f903b61-b191-49c7-86bc-082c02780947 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:56.484120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f903b61-b191-49c7-86bc-082c02780947 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:56.907946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-a07ff37d-1159-4e83-b9e0-2ccb10a80cc8 req-7e6115ee-731e-4e6c-a124-0136064397b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829be0ce-7a93-4656-8a57-319d6f73a55d", "name": "network-vif-plugged", "status": "completed", "tag": "1dc9acd5-4abb-4e56-86b1-45d76c7ab298"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:56.930497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a07ff37d-1159-4e83-b9e0-2ccb10a80cc8 req-7e6115ee-731e-4e6c-a124-0136064397b7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:56.931051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a07ff37d-1159-4e83-b9e0-2ccb10a80cc8 req-7e6115ee-731e-4e6c-a124-0136064397b7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:56.931502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a07ff37d-1159-4e83-b9e0-2ccb10a80cc8 req-7e6115ee-731e-4e6c-a124-0136064397b7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:56.959947 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a07ff37d-1159-4e83-b9e0-2ccb10a80cc8 req-7e6115ee-731e-4e6c-a124-0136064397b7 service nova] Creating event network-vif-plugged:1dc9acd5-4abb-4e56-86b1-45d76c7ab298 for instance 829be0ce-7a93-4656-8a57-319d6f73a55d on n-h1-860687-3 Oct 27 19:05:56.969724 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-a07ff37d-1159-4e83-b9e0-2ccb10a80cc8 req-7e6115ee-731e-4e6c-a124-0136064397b7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184361 Oct 27 19:05:56.972849 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2078/4339] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:05:57.006361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7f903b61-b191-49c7-86bc-082c02780947 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:57.024285 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7f903b61-b191-49c7-86bc-082c02780947 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1313 microversion: 2.1 time: 0.562576 Oct 27 19:05:57.024987 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2262/4340] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:56 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1313 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:57.367848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-296abafd-6fbd-4fb9-91d3-6efa3cc176e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:57.368767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-296abafd-6fbd-4fb9-91d3-6efa3cc176e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:57.385193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-296abafd-6fbd-4fb9-91d3-6efa3cc176e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:57.386285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-296abafd-6fbd-4fb9-91d3-6efa3cc176e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:57.393534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b55e33d9-8e84-46e3-af8b-6f4d9cba2849 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:57.395061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b55e33d9-8e84-46e3-af8b-6f4d9cba2849 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:57.395629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-296abafd-6fbd-4fb9-91d3-6efa3cc176e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:57.396454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-296abafd-6fbd-4fb9-91d3-6efa3cc176e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:57.396976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-296abafd-6fbd-4fb9-91d3-6efa3cc176e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:57.397389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-296abafd-6fbd-4fb9-91d3-6efa3cc176e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:57.408159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b55e33d9-8e84-46e3-af8b-6f4d9cba2849 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:57.409071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b55e33d9-8e84-46e3-af8b-6f4d9cba2849 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:57.410299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b55e33d9-8e84-46e3-af8b-6f4d9cba2849 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:57.415557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b55e33d9-8e84-46e3-af8b-6f4d9cba2849 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:57.416341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b55e33d9-8e84-46e3-af8b-6f4d9cba2849 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:57.416997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b55e33d9-8e84-46e3-af8b-6f4d9cba2849 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:57.827090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b55e33d9-8e84-46e3-af8b-6f4d9cba2849 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:57.837577 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b55e33d9-8e84-46e3-af8b-6f4d9cba2849 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1321 microversion: 2.1 time: 0.446646 Oct 27 19:05:57.839786 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2263/4341] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:57 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1321 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:58.001187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f071d2df-50a7-48d5-9da1-58546877fb3e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:58.002614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f071d2df-50a7-48d5-9da1-58546877fb3e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:58.011304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f071d2df-50a7-48d5-9da1-58546877fb3e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:58.012823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f071d2df-50a7-48d5-9da1-58546877fb3e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:58.016147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f071d2df-50a7-48d5-9da1-58546877fb3e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:58.020982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-296abafd-6fbd-4fb9-91d3-6efa3cc176e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:58.028441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f071d2df-50a7-48d5-9da1-58546877fb3e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:58.037674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f071d2df-50a7-48d5-9da1-58546877fb3e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:58.040673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f071d2df-50a7-48d5-9da1-58546877fb3e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:58.043546 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-296abafd-6fbd-4fb9-91d3-6efa3cc176e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1318 microversion: 2.1 time: 0.678620 Oct 27 19:05:58.048025 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2079/4342] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:57 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1318 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:58.055410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-95b42aa7-40bc-43fb-8516-a71799d880f3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:58.056442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-95b42aa7-40bc-43fb-8516-a71799d880f3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:58.063661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b42aa7-40bc-43fb-8516-a71799d880f3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:58.064452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b42aa7-40bc-43fb-8516-a71799d880f3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:58.065340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b42aa7-40bc-43fb-8516-a71799d880f3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:58.067428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b42aa7-40bc-43fb-8516-a71799d880f3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:58.068143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b42aa7-40bc-43fb-8516-a71799d880f3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:58.068807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95b42aa7-40bc-43fb-8516-a71799d880f3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:58.187225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-f071d2df-50a7-48d5-9da1-58546877fb3e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lazy-loading 'services' on Instance uuid 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:05:58.311196 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f071d2df-50a7-48d5-9da1-58546877fb3e tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments/d33f4cb1-7cee-4bf9-bb18-badb0d0415ee" status: 202 len: 0 microversion: 2.1 time: 0.316371 Oct 27 19:05:58.313954 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2264/4343] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:05:57 2022] DELETE /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments/d33f4cb1-7cee-4bf9-bb18-badb0d0415ee => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:05:58.341132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a5fe7931-d0ef-4de1-bfef-09895fc73edf req-58d7f897-a8e8-41a6-a6e6-6b5f5163195d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c337e5-0721-4c5e-a3f2-daa9af6f23a4", "tag": "194390f6-52bd-40ae-b4a7-a28c5dab955b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:58.362762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a5fe7931-d0ef-4de1-bfef-09895fc73edf req-58d7f897-a8e8-41a6-a6e6-6b5f5163195d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:58.373069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a5fe7931-d0ef-4de1-bfef-09895fc73edf req-58d7f897-a8e8-41a6-a6e6-6b5f5163195d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:58.375100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a5fe7931-d0ef-4de1-bfef-09895fc73edf req-58d7f897-a8e8-41a6-a6e6-6b5f5163195d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:58.398544 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a5fe7931-d0ef-4de1-bfef-09895fc73edf req-58d7f897-a8e8-41a6-a6e6-6b5f5163195d service nova] Creating event network-changed:194390f6-52bd-40ae-b4a7-a28c5dab955b for instance 66c337e5-0721-4c5e-a3f2-daa9af6f23a4 on n-h1-860687-3 Oct 27 19:05:58.407912 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a5fe7931-d0ef-4de1-bfef-09895fc73edf req-58d7f897-a8e8-41a6-a6e6-6b5f5163195d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091573 Oct 27 19:05:58.408530 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2265/4344] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:58.420981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3609a096-b91a-45f7-a738-79a33e465608 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:58.423768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3609a096-b91a-45f7-a738-79a33e465608 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:58.435920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3609a096-b91a-45f7-a738-79a33e465608 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:58.437915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3609a096-b91a-45f7-a738-79a33e465608 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:58.438713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3609a096-b91a-45f7-a738-79a33e465608 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:58.439834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3609a096-b91a-45f7-a738-79a33e465608 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:58.440315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3609a096-b91a-45f7-a738-79a33e465608 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:58.440845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3609a096-b91a-45f7-a738-79a33e465608 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:58.459642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-95b42aa7-40bc-43fb-8516-a71799d880f3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:58.467924 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-95b42aa7-40bc-43fb-8516-a71799d880f3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1313 microversion: 2.1 time: 0.418769 Oct 27 19:05:58.478949 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2080/4345] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:58 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:58.492904 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3609a096-b91a-45f7-a738-79a33e465608 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082771 Oct 27 19:05:58.500535 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2266/4346] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:05:58 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:58.863334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-243624a1-07d5-4b1f-a74b-d28f0808fca2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:58.863887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-243624a1-07d5-4b1f-a74b-d28f0808fca2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:58.870239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-243624a1-07d5-4b1f-a74b-d28f0808fca2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:58.871130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-243624a1-07d5-4b1f-a74b-d28f0808fca2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:58.871583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-243624a1-07d5-4b1f-a74b-d28f0808fca2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:58.872561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-243624a1-07d5-4b1f-a74b-d28f0808fca2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:58.873027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-243624a1-07d5-4b1f-a74b-d28f0808fca2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:58.873639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-243624a1-07d5-4b1f-a74b-d28f0808fca2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:59.044344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-61cb7a9c-c6a3-4da2-99be-a1640f64c871 req-3147d385-6838-4d51-97b3-ba04c0e4b663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dd3bbdb-8e43-4751-a5b3-508d9f78f98c", "tag": "f95d90b7-71ce-4796-9b14-b63a26ab7627"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:05:59.062158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-61cb7a9c-c6a3-4da2-99be-a1640f64c871 req-3147d385-6838-4d51-97b3-ba04c0e4b663 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:59.063528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-61cb7a9c-c6a3-4da2-99be-a1640f64c871 req-3147d385-6838-4d51-97b3-ba04c0e4b663 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:59.065716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-61cb7a9c-c6a3-4da2-99be-a1640f64c871 req-3147d385-6838-4d51-97b3-ba04c0e4b663 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:59.100826 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-61cb7a9c-c6a3-4da2-99be-a1640f64c871 req-3147d385-6838-4d51-97b3-ba04c0e4b663 service nova] Creating event network-changed:f95d90b7-71ce-4796-9b14-b63a26ab7627 for instance 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c on n-h2-860687-3 Oct 27 19:05:59.117821 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-61cb7a9c-c6a3-4da2-99be-a1640f64c871 req-3147d385-6838-4d51-97b3-ba04c0e4b663 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209977 Oct 27 19:05:59.119077 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2267/4347] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:05:59.125962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f222fe90-2af9-4513-ab8c-9f8d1eb6d295 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:59.127627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f222fe90-2af9-4513-ab8c-9f8d1eb6d295 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:59.146400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f222fe90-2af9-4513-ab8c-9f8d1eb6d295 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:59.146922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f222fe90-2af9-4513-ab8c-9f8d1eb6d295 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:59.148855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f222fe90-2af9-4513-ab8c-9f8d1eb6d295 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:59.149631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f222fe90-2af9-4513-ab8c-9f8d1eb6d295 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:59.150115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f222fe90-2af9-4513-ab8c-9f8d1eb6d295 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:59.150597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f222fe90-2af9-4513-ab8c-9f8d1eb6d295 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:59.436229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f222fe90-2af9-4513-ab8c-9f8d1eb6d295 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:59.453411 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f222fe90-2af9-4513-ab8c-9f8d1eb6d295 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1318 microversion: 2.1 time: 0.332887 Oct 27 19:05:59.456924 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2268/4348] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:59 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:59.493810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-122d24d8-8175-482b-946f-ff8c0a098d0e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:59.494938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-122d24d8-8175-482b-946f-ff8c0a098d0e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:59.502845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-122d24d8-8175-482b-946f-ff8c0a098d0e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:59.503532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-122d24d8-8175-482b-946f-ff8c0a098d0e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:59.504004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-122d24d8-8175-482b-946f-ff8c0a098d0e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:59.504791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-122d24d8-8175-482b-946f-ff8c0a098d0e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:59.505446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-122d24d8-8175-482b-946f-ff8c0a098d0e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:59.506060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-122d24d8-8175-482b-946f-ff8c0a098d0e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:59.825076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-122d24d8-8175-482b-946f-ff8c0a098d0e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:59.826271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-243624a1-07d5-4b1f-a74b-d28f0808fca2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:05:59.835224 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-122d24d8-8175-482b-946f-ff8c0a098d0e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1496 microversion: 2.1 time: 0.346076 Oct 27 19:05:59.839825 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-243624a1-07d5-4b1f-a74b-d28f0808fca2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1321 microversion: 2.1 time: 0.977863 Oct 27 19:05:59.839996 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2269/4349] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:59 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1496 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:59.857303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-43e4ee9d-a985-441e-89e8-af7a46a63e77 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:05:59.857303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-43e4ee9d-a985-441e-89e8-af7a46a63e77 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:05:59.869922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e4ee9d-a985-441e-89e8-af7a46a63e77 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:59.870469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e4ee9d-a985-441e-89e8-af7a46a63e77 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:59.870932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e4ee9d-a985-441e-89e8-af7a46a63e77 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:59.873903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e4ee9d-a985-441e-89e8-af7a46a63e77 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:05:59.875181 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2081/4350] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:05:58 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1321 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:05:59.894532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e4ee9d-a985-441e-89e8-af7a46a63e77 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:05:59.895024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e4ee9d-a985-441e-89e8-af7a46a63e77 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:05:59.906810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:05:59.985870 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-43e4ee9d-a985-441e-89e8-af7a46a63e77 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144655 Oct 27 19:05:59.990546 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2270/4351] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:05:59 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:00.487085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5a7d920d-5e6c-458b-8df5-1b9257816e7c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:00.488712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5a7d920d-5e6c-458b-8df5-1b9257816e7c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:00.498618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=32 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:00.500320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a7d920d-5e6c-458b-8df5-1b9257816e7c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:00.501233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a7d920d-5e6c-458b-8df5-1b9257816e7c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:00.503109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a7d920d-5e6c-458b-8df5-1b9257816e7c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:00.503790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a7d920d-5e6c-458b-8df5-1b9257816e7c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:00.504621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a7d920d-5e6c-458b-8df5-1b9257816e7c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:00.505707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a7d920d-5e6c-458b-8df5-1b9257816e7c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:00.513229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a55adda-bb3f-44c2-a1e8-8434b9c0eba8 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:00.513726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8a55adda-bb3f-44c2-a1e8-8434b9c0eba8 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:00.529896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a55adda-bb3f-44c2-a1e8-8434b9c0eba8 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:00.533597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a55adda-bb3f-44c2-a1e8-8434b9c0eba8 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:00.534132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a55adda-bb3f-44c2-a1e8-8434b9c0eba8 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:00.536274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a55adda-bb3f-44c2-a1e8-8434b9c0eba8 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:00.536769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a55adda-bb3f-44c2-a1e8-8434b9c0eba8 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:00.539016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a55adda-bb3f-44c2-a1e8-8434b9c0eba8 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:00.576155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8a55adda-bb3f-44c2-a1e8-8434b9c0eba8 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:06:00.695433 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8a55adda-bb3f-44c2-a1e8-8434b9c0eba8 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "DELETE /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 204 len: 0 microversion: 2.1 time: 0.186162 Oct 27 19:06:00.699611 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2271/4352] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:06:00 2022] DELETE /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:06:00.707144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-64c6cf2a-4ae4-4f04-8968-886e52e6c1ea tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:00.708269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-64c6cf2a-4ae4-4f04-8968-886e52e6c1ea tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:00.719777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64c6cf2a-4ae4-4f04-8968-886e52e6c1ea tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:00.720700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64c6cf2a-4ae4-4f04-8968-886e52e6c1ea tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:00.723033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64c6cf2a-4ae4-4f04-8968-886e52e6c1ea tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:00.724010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64c6cf2a-4ae4-4f04-8968-886e52e6c1ea tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:00.725545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64c6cf2a-4ae4-4f04-8968-886e52e6c1ea tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:00.726226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64c6cf2a-4ae4-4f04-8968-886e52e6c1ea tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:00.896051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5a7d920d-5e6c-458b-8df5-1b9257816e7c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:00.907315 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5a7d920d-5e6c-458b-8df5-1b9257816e7c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1318 microversion: 2.1 time: 0.426706 Oct 27 19:06:00.909716 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2082/4353] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:00 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:00.927686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-45e96c59-59cd-4f05-8067-930681340be5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:00.933223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-45e96c59-59cd-4f05-8067-930681340be5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:00.950648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45e96c59-59cd-4f05-8067-930681340be5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:00.963266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45e96c59-59cd-4f05-8067-930681340be5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:00.964024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45e96c59-59cd-4f05-8067-930681340be5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:00.964946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45e96c59-59cd-4f05-8067-930681340be5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:00.965588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45e96c59-59cd-4f05-8067-930681340be5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:00.966201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45e96c59-59cd-4f05-8067-930681340be5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:01.131791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-64c6cf2a-4ae4-4f04-8968-886e52e6c1ea tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:01.141454 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-64c6cf2a-4ae4-4f04-8968-886e52e6c1ea tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1502 microversion: 2.1 time: 0.439925 Oct 27 19:06:01.142691 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2272/4354] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:00 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1502 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:01.168544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3dd7e159-38ea-45ee-a158-b2aac827683c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:01.176700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3dd7e159-38ea-45ee-a158-b2aac827683c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:01.183768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dd7e159-38ea-45ee-a158-b2aac827683c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:01.184376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dd7e159-38ea-45ee-a158-b2aac827683c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:01.184905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dd7e159-38ea-45ee-a158-b2aac827683c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:01.185871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dd7e159-38ea-45ee-a158-b2aac827683c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:01.187120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dd7e159-38ea-45ee-a158-b2aac827683c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:01.187639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dd7e159-38ea-45ee-a158-b2aac827683c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:01.228151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:01.269648 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3dd7e159-38ea-45ee-a158-b2aac827683c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124809 Oct 27 19:06:01.270981 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2273/4355] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:06:01 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:01.359437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-45e96c59-59cd-4f05-8067-930681340be5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:01.382957 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-45e96c59-59cd-4f05-8067-930681340be5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1321 microversion: 2.1 time: 0.467554 Oct 27 19:06:01.397047 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2083/4356] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:00 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1321 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:01.668966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-8a398f9c-c4d3-40f2-849e-2c7ddd9d774d req-dac3fbb5-882d-49d5-a881-473cba9beee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0eab732-8c21-49ce-9687-a3fecd1284b4", "name": "network-vif-plugged", "status": "completed", "tag": "7062376b-cb6d-4c72-9cbc-a947196bbf05"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:01.695094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8a398f9c-c4d3-40f2-849e-2c7ddd9d774d req-dac3fbb5-882d-49d5-a881-473cba9beee2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:01.695518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8a398f9c-c4d3-40f2-849e-2c7ddd9d774d req-dac3fbb5-882d-49d5-a881-473cba9beee2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:01.696382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8a398f9c-c4d3-40f2-849e-2c7ddd9d774d req-dac3fbb5-882d-49d5-a881-473cba9beee2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:01.723064 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8a398f9c-c4d3-40f2-849e-2c7ddd9d774d req-dac3fbb5-882d-49d5-a881-473cba9beee2 service nova] Creating event network-vif-plugged:7062376b-cb6d-4c72-9cbc-a947196bbf05 for instance d0eab732-8c21-49ce-9687-a3fecd1284b4 on n-h2-860687-3 Oct 27 19:06:01.736915 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-8a398f9c-c4d3-40f2-849e-2c7ddd9d774d req-dac3fbb5-882d-49d5-a881-473cba9beee2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070051 Oct 27 19:06:01.740104 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2274/4357] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:01.936565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e67a57b0-f314-4883-920a-66cb620918ed tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:01.937929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e67a57b0-f314-4883-920a-66cb620918ed tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:01.941825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=10 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:01.949250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e67a57b0-f314-4883-920a-66cb620918ed tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:01.950074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e67a57b0-f314-4883-920a-66cb620918ed tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:01.950788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e67a57b0-f314-4883-920a-66cb620918ed tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:01.951779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e67a57b0-f314-4883-920a-66cb620918ed tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:01.952522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e67a57b0-f314-4883-920a-66cb620918ed tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:01.953173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e67a57b0-f314-4883-920a-66cb620918ed tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:02.167207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14cc891f-d7a6-4037-a9cd-31af25190b28 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:02.167975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-14cc891f-d7a6-4037-a9cd-31af25190b28 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:02.171334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=26 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:02.187330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14cc891f-d7a6-4037-a9cd-31af25190b28 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:02.188718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14cc891f-d7a6-4037-a9cd-31af25190b28 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:02.192011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14cc891f-d7a6-4037-a9cd-31af25190b28 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:02.195045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14cc891f-d7a6-4037-a9cd-31af25190b28 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:02.195751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14cc891f-d7a6-4037-a9cd-31af25190b28 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:02.197068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14cc891f-d7a6-4037-a9cd-31af25190b28 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:02.574912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e67a57b0-f314-4883-920a-66cb620918ed tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:02.597319 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e67a57b0-f314-4883-920a-66cb620918ed tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1318 microversion: 2.1 time: 0.661055 Oct 27 19:06:02.616004 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2084/4358] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:01 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:02.621124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-682c5e5b-f219-472c-acbf-2f3ec87f1047 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:02.624691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-682c5e5b-f219-472c-acbf-2f3ec87f1047 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:02.632785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-682c5e5b-f219-472c-acbf-2f3ec87f1047 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:02.633500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-682c5e5b-f219-472c-acbf-2f3ec87f1047 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:02.634107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-682c5e5b-f219-472c-acbf-2f3ec87f1047 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:02.635179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-682c5e5b-f219-472c-acbf-2f3ec87f1047 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:02.636383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-682c5e5b-f219-472c-acbf-2f3ec87f1047 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:02.636988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-682c5e5b-f219-472c-acbf-2f3ec87f1047 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:02.701404 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-682c5e5b-f219-472c-acbf-2f3ec87f1047 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084144 Oct 27 19:06:02.704844 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2085/4359] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:06:02 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:02.717651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2f68baef-e02b-40fe-80be-2966abd3a6f9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:02.718285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2f68baef-e02b-40fe-80be-2966abd3a6f9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:02.740982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f68baef-e02b-40fe-80be-2966abd3a6f9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:02.741497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f68baef-e02b-40fe-80be-2966abd3a6f9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:02.741952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f68baef-e02b-40fe-80be-2966abd3a6f9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:02.748045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f68baef-e02b-40fe-80be-2966abd3a6f9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:02.748678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f68baef-e02b-40fe-80be-2966abd3a6f9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:02.749148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f68baef-e02b-40fe-80be-2966abd3a6f9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:03.018717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-14cc891f-d7a6-4037-a9cd-31af25190b28 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:03.036968 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-14cc891f-d7a6-4037-a9cd-31af25190b28 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1502 microversion: 2.1 time: 0.873652 Oct 27 19:06:03.051033 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2275/4360] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:02 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1502 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:03.174367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2f68baef-e02b-40fe-80be-2966abd3a6f9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:03.189192 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2f68baef-e02b-40fe-80be-2966abd3a6f9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1321 microversion: 2.1 time: 0.477072 Oct 27 19:06:03.190119 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2086/4361] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:02 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1321 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:03.632116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e2c1bc8e-4f8b-454c-83e8-3205e4fa0b9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:03.633260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e2c1bc8e-4f8b-454c-83e8-3205e4fa0b9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:03.639946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2c1bc8e-4f8b-454c-83e8-3205e4fa0b9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:03.640785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2c1bc8e-4f8b-454c-83e8-3205e4fa0b9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:03.641399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2c1bc8e-4f8b-454c-83e8-3205e4fa0b9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:03.642509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2c1bc8e-4f8b-454c-83e8-3205e4fa0b9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:03.643258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2c1bc8e-4f8b-454c-83e8-3205e4fa0b9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:03.644854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2c1bc8e-4f8b-454c-83e8-3205e4fa0b9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:03.655818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-17accb02-2361-447f-af89-a2cdaeab5d94 req-0cbed670-00cf-4964-8bd7-82b08a4678b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829be0ce-7a93-4656-8a57-319d6f73a55d", "name": "network-vif-deleted", "tag": "1dc9acd5-4abb-4e56-86b1-45d76c7ab298"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:03.687480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-17accb02-2361-447f-af89-a2cdaeab5d94 req-0cbed670-00cf-4964-8bd7-82b08a4678b5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:03.691627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-17accb02-2361-447f-af89-a2cdaeab5d94 req-0cbed670-00cf-4964-8bd7-82b08a4678b5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:03.692600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-17accb02-2361-447f-af89-a2cdaeab5d94 req-0cbed670-00cf-4964-8bd7-82b08a4678b5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:03.732686 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-17accb02-2361-447f-af89-a2cdaeab5d94 req-0cbed670-00cf-4964-8bd7-82b08a4678b5 service nova] Creating event network-vif-deleted:1dc9acd5-4abb-4e56-86b1-45d76c7ab298 for instance 829be0ce-7a93-4656-8a57-319d6f73a55d on n-h1-860687-3 Oct 27 19:06:03.750029 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-17accb02-2361-447f-af89-a2cdaeab5d94 req-0cbed670-00cf-4964-8bd7-82b08a4678b5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096878 Oct 27 19:06:03.751431 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2087/4362] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:06:03.763442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9136b3eb-0696-4fab-baa9-9a5503e74ce2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:03.765973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9136b3eb-0696-4fab-baa9-9a5503e74ce2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:03.792789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9136b3eb-0696-4fab-baa9-9a5503e74ce2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:03.793656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9136b3eb-0696-4fab-baa9-9a5503e74ce2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:03.794332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9136b3eb-0696-4fab-baa9-9a5503e74ce2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:03.799503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9136b3eb-0696-4fab-baa9-9a5503e74ce2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:03.800922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9136b3eb-0696-4fab-baa9-9a5503e74ce2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:03.801842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9136b3eb-0696-4fab-baa9-9a5503e74ce2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:03.932082 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9136b3eb-0696-4fab-baa9-9a5503e74ce2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180090 Oct 27 19:06:03.940931 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2088/4363] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:06:03 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:04.053398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e2c1bc8e-4f8b-454c-83e8-3205e4fa0b9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:04.063355 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e2c1bc8e-4f8b-454c-83e8-3205e4fa0b9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1318 microversion: 2.1 time: 0.435911 Oct 27 19:06:04.064906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-29883f05-6255-48c4-917b-ca9a8469d5e1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:04.067150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-29883f05-6255-48c4-917b-ca9a8469d5e1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:04.068502 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2276/4364] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:03 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:04.088434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29883f05-6255-48c4-917b-ca9a8469d5e1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:04.090219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29883f05-6255-48c4-917b-ca9a8469d5e1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:04.091601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29883f05-6255-48c4-917b-ca9a8469d5e1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:04.093957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29883f05-6255-48c4-917b-ca9a8469d5e1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:04.094857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29883f05-6255-48c4-917b-ca9a8469d5e1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:04.098432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29883f05-6255-48c4-917b-ca9a8469d5e1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:04.179557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29883f05-6255-48c4-917b-ca9a8469d5e1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:04.180197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29883f05-6255-48c4-917b-ca9a8469d5e1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:04.180543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29883f05-6255-48c4-917b-ca9a8469d5e1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:04.182533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-29883f05-6255-48c4-917b-ca9a8469d5e1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lazy-loading 'fault' on Instance uuid 829be0ce-7a93-4656-8a57-319d6f73a55d {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:06:04.213124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8e0e7cbc-08f2-4722-9b7b-4b51bbf110ab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:04.213755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8e0e7cbc-08f2-4722-9b7b-4b51bbf110ab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:04.226553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e0e7cbc-08f2-4722-9b7b-4b51bbf110ab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:04.227472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e0e7cbc-08f2-4722-9b7b-4b51bbf110ab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:04.228083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e0e7cbc-08f2-4722-9b7b-4b51bbf110ab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:04.228967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e0e7cbc-08f2-4722-9b7b-4b51bbf110ab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:04.229591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e0e7cbc-08f2-4722-9b7b-4b51bbf110ab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:04.230188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e0e7cbc-08f2-4722-9b7b-4b51bbf110ab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:04.291335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-29883f05-6255-48c4-917b-ca9a8469d5e1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:04.303947 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-29883f05-6255-48c4-917b-ca9a8469d5e1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 200 len: 1303 microversion: 2.1 time: 0.240618 Oct 27 19:06:04.308058 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2089/4365] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:04 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 1303 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:06:04.608679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8e0e7cbc-08f2-4722-9b7b-4b51bbf110ab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:04.617503 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8e0e7cbc-08f2-4722-9b7b-4b51bbf110ab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1321 microversion: 2.1 time: 0.408088 Oct 27 19:06:04.626789 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2277/4366] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:04 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:04.693683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d4769760-0800-4b12-a109-dfc37ecb8921 req-31a954da-de15-45eb-aaf6-75a14f762585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c337e5-0721-4c5e-a3f2-daa9af6f23a4", "name": "network-vif-plugged", "status": "completed", "tag": "194390f6-52bd-40ae-b4a7-a28c5dab955b"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:04.713517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d4769760-0800-4b12-a109-dfc37ecb8921 req-31a954da-de15-45eb-aaf6-75a14f762585 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:04.714031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d4769760-0800-4b12-a109-dfc37ecb8921 req-31a954da-de15-45eb-aaf6-75a14f762585 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:04.717856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d4769760-0800-4b12-a109-dfc37ecb8921 req-31a954da-de15-45eb-aaf6-75a14f762585 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:04.743331 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d4769760-0800-4b12-a109-dfc37ecb8921 req-31a954da-de15-45eb-aaf6-75a14f762585 service nova] Creating event network-vif-plugged:194390f6-52bd-40ae-b4a7-a28c5dab955b for instance 66c337e5-0721-4c5e-a3f2-daa9af6f23a4 on n-h1-860687-3 Oct 27 19:06:04.758435 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d4769760-0800-4b12-a109-dfc37ecb8921 req-31a954da-de15-45eb-aaf6-75a14f762585 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068996 Oct 27 19:06:04.761796 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2090/4367] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:04.948326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ea4bd417-0a2c-4434-a2f9-3513219396f0 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:04.951594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ea4bd417-0a2c-4434-a2f9-3513219396f0 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:04.967635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea4bd417-0a2c-4434-a2f9-3513219396f0 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:04.968811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea4bd417-0a2c-4434-a2f9-3513219396f0 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:04.970549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea4bd417-0a2c-4434-a2f9-3513219396f0 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:04.972833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea4bd417-0a2c-4434-a2f9-3513219396f0 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:04.973410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea4bd417-0a2c-4434-a2f9-3513219396f0 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:04.973913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea4bd417-0a2c-4434-a2f9-3513219396f0 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:05.048230 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ea4bd417-0a2c-4434-a2f9-3513219396f0 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103802 Oct 27 19:06:05.051613 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2278/4368] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:06:04 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:05.093858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5c4591d5-ad30-4d4c-9945-3a042c0f40d1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:05.096196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5c4591d5-ad30-4d4c-9945-3a042c0f40d1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:05.111835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c4591d5-ad30-4d4c-9945-3a042c0f40d1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:05.113603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c4591d5-ad30-4d4c-9945-3a042c0f40d1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:05.114331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c4591d5-ad30-4d4c-9945-3a042c0f40d1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:05.115367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c4591d5-ad30-4d4c-9945-3a042c0f40d1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:05.116035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c4591d5-ad30-4d4c-9945-3a042c0f40d1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:05.116667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c4591d5-ad30-4d4c-9945-3a042c0f40d1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:05.333076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-63a6ca7b-d348-4856-87e9-9682cfa56aec tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:05.333728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-63a6ca7b-d348-4856-87e9-9682cfa56aec tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: 829be0ce-7a93-4656-8a57-319d6f73a55d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:05.354111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63a6ca7b-d348-4856-87e9-9682cfa56aec tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:05.354643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63a6ca7b-d348-4856-87e9-9682cfa56aec tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:05.357986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63a6ca7b-d348-4856-87e9-9682cfa56aec tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:05.359026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63a6ca7b-d348-4856-87e9-9682cfa56aec tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:05.359674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63a6ca7b-d348-4856-87e9-9682cfa56aec tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:05.363564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63a6ca7b-d348-4856-87e9-9682cfa56aec tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:05.392565 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-63a6ca7b-d348-4856-87e9-9682cfa56aec tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] HTTP exception thrown: Instance 829be0ce-7a93-4656-8a57-319d6f73a55d could not be found. Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-63a6ca7b-d348-4856-87e9-9682cfa56aec tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Request method failure captured: Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d HTTP/1.1 Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtaDjfptpus3pd0bqOcRPbi_gI5eQoNczlZFV51g-fvXOCcWPqfCIqfTWc-yBUmQ8bDB0ghGBMsiTxdlbgx3XENBRh7QjGEKk40wBFfDXFTKZg_A-ZaRi1fGy-nSDTutbRgLAH534ODHUATileT-iAq6-RmV8blV1iLcKGxGAOUB0fY Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 6ea0b947e6f34941b45e54389d98e4af Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-VolumesActionsTest-2117659430 Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6ea0b947e6f34941b45e54389d98e4af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ea0b947e6f34941b45e54389d98e4af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6ea0b947e6f34941b45e54389d98e4af", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ea0b947e6f34941b45e54389d98e4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-VolumesActionsTest-2117659430 Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 6ea0b947e6f34941b45e54389d98e4af Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-VolumesActionsTest-2117659430 Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-VolumesActionsTest-2117659430-project Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 0ca60b2c6a474a02a55e9e53e3954f47 Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-VolumesActionsTest-2117659430-project Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 829be0ce-7a93-4656-8a57-319d6f73a55d could not be found. Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '829be0ce-7a93-4656-8a57-319d6f73a55d'} Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829be0ce-7a93-4656-8a57-319d6f73a55d could not be found. Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829be0ce-7a93-4656-8a57-319d6f73a55d could not be found. Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:05.399234 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:05.404113 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:05.404113 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:05.404113 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:05.404113 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:06:05.404113 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:06:05.404113 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829be0ce-7a93-4656-8a57-319d6f73a55d could not be found. Oct 27 19:06:05.404113 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:05.404113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-63a6ca7b-d348-4856-87e9-9682cfa56aec tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Returning 404 to user: Instance 829be0ce-7a93-4656-8a57-319d6f73a55d could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:06:05.406135 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-63a6ca7b-d348-4856-87e9-9682cfa56aec tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d" status: 404 len: 111 microversion: 2.1 time: 0.078081 Oct 27 19:06:05.415242 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2279/4369] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:05 2022] GET /compute/v2.1/servers/829be0ce-7a93-4656-8a57-319d6f73a55d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:06:05.471270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5c4591d5-ad30-4d4c-9945-3a042c0f40d1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:05.481390 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5c4591d5-ad30-4d4c-9945-3a042c0f40d1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1318 microversion: 2.1 time: 0.393234 Oct 27 19:06:05.483574 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2091/4370] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:05 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:05.522343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-529427809", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "3071293e-5a23-4372-a3d6-6843524992ea"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:05.628905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] validate_networks() for [('3071293e-5a23-4372-a3d6-6843524992ea', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:06:05.645008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7815c5cf-c030-44bc-92d2-2aaeadb4082c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:05.645645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7815c5cf-c030-44bc-92d2-2aaeadb4082c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:05.657141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7815c5cf-c030-44bc-92d2-2aaeadb4082c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:05.657655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7815c5cf-c030-44bc-92d2-2aaeadb4082c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:05.661304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7815c5cf-c030-44bc-92d2-2aaeadb4082c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:05.663468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7815c5cf-c030-44bc-92d2-2aaeadb4082c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:05.665085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7815c5cf-c030-44bc-92d2-2aaeadb4082c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:05.666094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7815c5cf-c030-44bc-92d2-2aaeadb4082c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:05.994061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7815c5cf-c030-44bc-92d2-2aaeadb4082c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:06.006780 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7815c5cf-c030-44bc-92d2-2aaeadb4082c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1501 microversion: 2.1 time: 0.369482 Oct 27 19:06:06.007513 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2092/4371] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:05 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1501 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:06:06.031922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b079868-068c-4e98-842f-59ac6b20499f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:06.032548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7b079868-068c-4e98-842f-59ac6b20499f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:06.039722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b079868-068c-4e98-842f-59ac6b20499f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:06.040229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b079868-068c-4e98-842f-59ac6b20499f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:06.040871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b079868-068c-4e98-842f-59ac6b20499f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:06.041836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b079868-068c-4e98-842f-59ac6b20499f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:06.042059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b079868-068c-4e98-842f-59ac6b20499f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:06.042523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b079868-068c-4e98-842f-59ac6b20499f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:06.208268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7b079868-068c-4e98-842f-59ac6b20499f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:06.217846 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7b079868-068c-4e98-842f-59ac6b20499f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1501 microversion: 2.1 time: 0.189667 Oct 27 19:06:06.221112 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2093/4372] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:06 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1501 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:06:06.228570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-08972072-f7f8-4c73-b715-3c826873b9ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:06.244551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-08972072-f7f8-4c73-b715-3c826873b9ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:06.255951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08972072-f7f8-4c73-b715-3c826873b9ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:06.257453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08972072-f7f8-4c73-b715-3c826873b9ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:06.258142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08972072-f7f8-4c73-b715-3c826873b9ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:06.259161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08972072-f7f8-4c73-b715-3c826873b9ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:06.260038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08972072-f7f8-4c73-b715-3c826873b9ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:06.260715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08972072-f7f8-4c73-b715-3c826873b9ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:06.305030 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-08972072-f7f8-4c73-b715-3c826873b9ec tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082736 Oct 27 19:06:06.309629 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2094/4373] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:06:06 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:06.335171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f2446e7-f89f-499e-b711-06f82f9cd8fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:06.335699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0f2446e7-f89f-499e-b711-06f82f9cd8fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:06.356765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f2446e7-f89f-499e-b711-06f82f9cd8fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:06.357275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f2446e7-f89f-499e-b711-06f82f9cd8fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:06.360941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f2446e7-f89f-499e-b711-06f82f9cd8fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:06.365429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f2446e7-f89f-499e-b711-06f82f9cd8fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:06.366037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f2446e7-f89f-499e-b711-06f82f9cd8fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:06.366523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f2446e7-f89f-499e-b711-06f82f9cd8fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:06.410664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:06.434863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0f2446e7-f89f-499e-b711-06f82f9cd8fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:06:06.607760 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0f2446e7-f89f-499e-b711-06f82f9cd8fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 204 len: 0 microversion: 2.1 time: 0.285728 Oct 27 19:06:06.611569 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2095/4374] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:06:06 2022] DELETE /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:06:06.615974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-912e1d4b-6471-4e01-b07f-35e44c680326 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:06.616860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-912e1d4b-6471-4e01-b07f-35e44c680326 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:06.623774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-912e1d4b-6471-4e01-b07f-35e44c680326 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:06.624493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-912e1d4b-6471-4e01-b07f-35e44c680326 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:06.624939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-912e1d4b-6471-4e01-b07f-35e44c680326 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:06.626028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-912e1d4b-6471-4e01-b07f-35e44c680326 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:06.627203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-912e1d4b-6471-4e01-b07f-35e44c680326 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:06.627648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-912e1d4b-6471-4e01-b07f-35e44c680326 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:06.817735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-912e1d4b-6471-4e01-b07f-35e44c680326 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:06.827300 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-912e1d4b-6471-4e01-b07f-35e44c680326 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1318 microversion: 2.1 time: 0.217193 Oct 27 19:06:06.828206 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2096/4375] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:06 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:06.844486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f0c38126-9d93-430d-8bae-f8c4de95ea2a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:06.845098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f0c38126-9d93-430d-8bae-f8c4de95ea2a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:06.851616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0c38126-9d93-430d-8bae-f8c4de95ea2a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:06.852101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0c38126-9d93-430d-8bae-f8c4de95ea2a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:06.852575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0c38126-9d93-430d-8bae-f8c4de95ea2a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:06.853271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0c38126-9d93-430d-8bae-f8c4de95ea2a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:06.853781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0c38126-9d93-430d-8bae-f8c4de95ea2a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:06.854212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0c38126-9d93-430d-8bae-f8c4de95ea2a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:06.912732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:06:06.913190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:06:06.913652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:06:06.914071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:06:06.914528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:06:06.937887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:06.938622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:06.939224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:06.941803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:06.942491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:06.943121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:06.968591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Getting quotas for project 6ea0b947e6f34941b45e54389d98e4af. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:06:06.978900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Getting quotas for user 0ca60b2c6a474a02a55e9e53e3954f47 and project 6ea0b947e6f34941b45e54389d98e4af. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:06:06.994120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:06:06.997071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:06:07.010630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:07.088192 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-77bc4675-83d0-41a8-a72b-65fea56b19d1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.570273 Oct 27 19:06:07.089448 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2280/4376] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:06:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:06:07.099558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6986b800-b9ee-4b23-8672-2e636b72bcb0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:07.100078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6986b800-b9ee-4b23-8672-2e636b72bcb0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:07.106212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f0c38126-9d93-430d-8bae-f8c4de95ea2a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:07.115516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6986b800-b9ee-4b23-8672-2e636b72bcb0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:07.118704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6986b800-b9ee-4b23-8672-2e636b72bcb0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:07.119239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6986b800-b9ee-4b23-8672-2e636b72bcb0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:07.119997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6986b800-b9ee-4b23-8672-2e636b72bcb0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:07.120477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6986b800-b9ee-4b23-8672-2e636b72bcb0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:07.120918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6986b800-b9ee-4b23-8672-2e636b72bcb0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:07.125353 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f0c38126-9d93-430d-8bae-f8c4de95ea2a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1507 microversion: 2.1 time: 0.280778 Oct 27 19:06:07.127063 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2097/4377] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:06 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1507 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:07.136469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1184a554-f65d-4b58-a26c-c0476f4b8b16 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:07.137329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1184a554-f65d-4b58-a26c-c0476f4b8b16 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:07.200357 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6986b800-b9ee-4b23-8672-2e636b72bcb0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79/ips" status: 200 len: 152 microversion: 2.20 time: 0.109132 Oct 27 19:06:07.205760 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2281/4378] 10.222.0.42 () {60 vars in 1289 bytes} [Thu Oct 27 19:06:07 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79/ips => generated 152 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:06:07.214129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1184a554-f65d-4b58-a26c-c0476f4b8b16 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:07.239902 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1184a554-f65d-4b58-a26c-c0476f4b8b16 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1213 microversion: 2.1 time: 0.104616 Oct 27 19:06:07.241117 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2098/4379] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:07 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:07.318911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d471ebc3-c6a8-449c-b66b-552a2f9e3708 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:07.328276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d471ebc3-c6a8-449c-b66b-552a2f9e3708 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:07.357005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d471ebc3-c6a8-449c-b66b-552a2f9e3708 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:07.359220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d471ebc3-c6a8-449c-b66b-552a2f9e3708 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:07.359778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d471ebc3-c6a8-449c-b66b-552a2f9e3708 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:07.361429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d471ebc3-c6a8-449c-b66b-552a2f9e3708 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:07.364719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d471ebc3-c6a8-449c-b66b-552a2f9e3708 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:07.369936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d471ebc3-c6a8-449c-b66b-552a2f9e3708 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:07.432586 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d471ebc3-c6a8-449c-b66b-552a2f9e3708 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119249 Oct 27 19:06:07.439482 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2282/4380] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:06:07 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 19:06:07.518354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-07c66398-509d-4296-b3b4-8946318a0474 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:07.519773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-07c66398-509d-4296-b3b4-8946318a0474 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:07.526183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07c66398-509d-4296-b3b4-8946318a0474 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:07.526860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07c66398-509d-4296-b3b4-8946318a0474 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:07.527620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07c66398-509d-4296-b3b4-8946318a0474 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:07.528748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07c66398-509d-4296-b3b4-8946318a0474 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:07.529415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07c66398-509d-4296-b3b4-8946318a0474 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:07.530042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07c66398-509d-4296-b3b4-8946318a0474 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:07.588868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-07c66398-509d-4296-b3b4-8946318a0474 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:06:07.758036 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-07c66398-509d-4296-b3b4-8946318a0474 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 204 len: 0 microversion: 2.1 time: 0.243523 Oct 27 19:06:07.762140 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2099/4381] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:06:07 2022] DELETE /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:06:07.787972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e7a2f52-002e-47de-839e-cdc9baa03941 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:07.788613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6e7a2f52-002e-47de-839e-cdc9baa03941 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:07.807535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7a2f52-002e-47de-839e-cdc9baa03941 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:07.812345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7a2f52-002e-47de-839e-cdc9baa03941 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:07.814587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7a2f52-002e-47de-839e-cdc9baa03941 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:07.816033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7a2f52-002e-47de-839e-cdc9baa03941 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:07.818701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7a2f52-002e-47de-839e-cdc9baa03941 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:07.819176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7a2f52-002e-47de-839e-cdc9baa03941 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:07.854416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-74368d78-f730-45aa-8a2b-bbc0ceb2b3e5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:07.855134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-74368d78-f730-45aa-8a2b-bbc0ceb2b3e5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:07.875307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74368d78-f730-45aa-8a2b-bbc0ceb2b3e5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:07.875808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74368d78-f730-45aa-8a2b-bbc0ceb2b3e5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:07.876253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74368d78-f730-45aa-8a2b-bbc0ceb2b3e5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:07.876967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74368d78-f730-45aa-8a2b-bbc0ceb2b3e5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:07.877424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74368d78-f730-45aa-8a2b-bbc0ceb2b3e5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:07.878433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74368d78-f730-45aa-8a2b-bbc0ceb2b3e5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:08.194908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-74368d78-f730-45aa-8a2b-bbc0ceb2b3e5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:08.204532 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-74368d78-f730-45aa-8a2b-bbc0ceb2b3e5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1318 microversion: 2.1 time: 0.356371 Oct 27 19:06:08.211361 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2100/4382] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:07 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:08.224667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03eedb5a-1be2-43d1-93a1-186b7d9da695 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:08.225540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-03eedb5a-1be2-43d1-93a1-186b7d9da695 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:08.241952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03eedb5a-1be2-43d1-93a1-186b7d9da695 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:08.246984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03eedb5a-1be2-43d1-93a1-186b7d9da695 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:08.248602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03eedb5a-1be2-43d1-93a1-186b7d9da695 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:08.250476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03eedb5a-1be2-43d1-93a1-186b7d9da695 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:08.251119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03eedb5a-1be2-43d1-93a1-186b7d9da695 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:08.251734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03eedb5a-1be2-43d1-93a1-186b7d9da695 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:08.493708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-03eedb5a-1be2-43d1-93a1-186b7d9da695 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:08.502085 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-03eedb5a-1be2-43d1-93a1-186b7d9da695 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1507 microversion: 2.1 time: 0.289116 Oct 27 19:06:08.504776 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2101/4383] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:08 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1507 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:08.516470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1997bc1c-66ef-4438-b1dc-5b57d587de35 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:08.517386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1997bc1c-66ef-4438-b1dc-5b57d587de35 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:08.528007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1997bc1c-66ef-4438-b1dc-5b57d587de35 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:08.528751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1997bc1c-66ef-4438-b1dc-5b57d587de35 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:08.536072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1997bc1c-66ef-4438-b1dc-5b57d587de35 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:08.538035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1997bc1c-66ef-4438-b1dc-5b57d587de35 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:08.539772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1997bc1c-66ef-4438-b1dc-5b57d587de35 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:08.540986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1997bc1c-66ef-4438-b1dc-5b57d587de35 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:08.762015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6e7a2f52-002e-47de-839e-cdc9baa03941 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:08.774201 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6e7a2f52-002e-47de-839e-cdc9baa03941 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1681 microversion: 2.1 time: 1.010402 Oct 27 19:06:08.775414 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2283/4384] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:07 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1681 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:08.790724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-f01ea3d9-b179-47d8-b0db-c9ed9aeebb45 req-864f5165-4abf-49f5-b8ca-d09e32bddd26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd3bbdb-8e43-4751-a5b3-508d9f78f98c", "name": "network-vif-plugged", "status": "completed", "tag": "f95d90b7-71ce-4796-9b14-b63a26ab7627"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:08.833753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1997bc1c-66ef-4438-b1dc-5b57d587de35 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:08.837720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f01ea3d9-b179-47d8-b0db-c9ed9aeebb45 req-864f5165-4abf-49f5-b8ca-d09e32bddd26 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:08.840427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f01ea3d9-b179-47d8-b0db-c9ed9aeebb45 req-864f5165-4abf-49f5-b8ca-d09e32bddd26 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:08.842850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f01ea3d9-b179-47d8-b0db-c9ed9aeebb45 req-864f5165-4abf-49f5-b8ca-d09e32bddd26 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:08.868458 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1997bc1c-66ef-4438-b1dc-5b57d587de35 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1217 microversion: 2.1 time: 0.361964 Oct 27 19:06:08.869635 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2102/4385] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:08 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1217 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:08.891974 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-f01ea3d9-b179-47d8-b0db-c9ed9aeebb45 req-864f5165-4abf-49f5-b8ca-d09e32bddd26 service nova] Creating event network-vif-plugged:f95d90b7-71ce-4796-9b14-b63a26ab7627 for instance 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c on n-h2-860687-3 Oct 27 19:06:08.902109 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-f01ea3d9-b179-47d8-b0db-c9ed9aeebb45 req-864f5165-4abf-49f5-b8ca-d09e32bddd26 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123869 Oct 27 19:06:08.904473 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2284/4386] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:09.235072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7c218d3f-43b4-46be-a7cb-84a2bd8cce37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:09.235591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7c218d3f-43b4-46be-a7cb-84a2bd8cce37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:09.246214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c218d3f-43b4-46be-a7cb-84a2bd8cce37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:09.246734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c218d3f-43b4-46be-a7cb-84a2bd8cce37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:09.267445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c218d3f-43b4-46be-a7cb-84a2bd8cce37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:09.268293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c218d3f-43b4-46be-a7cb-84a2bd8cce37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:09.270523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c218d3f-43b4-46be-a7cb-84a2bd8cce37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:09.271138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c218d3f-43b4-46be-a7cb-84a2bd8cce37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:09.536075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-678a13f3-0dec-4d36-9fcd-eb211ae91edf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:09.543646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-678a13f3-0dec-4d36-9fcd-eb211ae91edf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:09.566824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-678a13f3-0dec-4d36-9fcd-eb211ae91edf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:09.568159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-678a13f3-0dec-4d36-9fcd-eb211ae91edf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:09.570666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-678a13f3-0dec-4d36-9fcd-eb211ae91edf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:09.571792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-678a13f3-0dec-4d36-9fcd-eb211ae91edf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:09.575671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-678a13f3-0dec-4d36-9fcd-eb211ae91edf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:09.576523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-678a13f3-0dec-4d36-9fcd-eb211ae91edf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:09.915124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7c218d3f-43b4-46be-a7cb-84a2bd8cce37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:09.928553 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7c218d3f-43b4-46be-a7cb-84a2bd8cce37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1318 microversion: 2.1 time: 0.697440 Oct 27 19:06:09.932345 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2103/4387] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:09 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1318 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:09.946105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9c50246f-9900-4648-b69d-5662189cecb2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:09.947026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9c50246f-9900-4648-b69d-5662189cecb2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:09.957812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c50246f-9900-4648-b69d-5662189cecb2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:09.958460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c50246f-9900-4648-b69d-5662189cecb2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:09.958985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c50246f-9900-4648-b69d-5662189cecb2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:09.959809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c50246f-9900-4648-b69d-5662189cecb2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:09.960348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c50246f-9900-4648-b69d-5662189cecb2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:09.960916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c50246f-9900-4648-b69d-5662189cecb2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:10.021837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-678a13f3-0dec-4d36-9fcd-eb211ae91edf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:10.039550 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-678a13f3-0dec-4d36-9fcd-eb211ae91edf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1507 microversion: 2.1 time: 0.514722 Oct 27 19:06:10.043393 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2285/4388] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:09 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1507 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:10.065268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7029df4c-0832-4cc0-a815-2d15c810a1ae tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:10.078139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7029df4c-0832-4cc0-a815-2d15c810a1ae tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:10.106316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7029df4c-0832-4cc0-a815-2d15c810a1ae tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:10.107189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7029df4c-0832-4cc0-a815-2d15c810a1ae tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:10.107877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7029df4c-0832-4cc0-a815-2d15c810a1ae tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:10.109159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7029df4c-0832-4cc0-a815-2d15c810a1ae tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:10.110181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7029df4c-0832-4cc0-a815-2d15c810a1ae tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:10.111646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7029df4c-0832-4cc0-a815-2d15c810a1ae tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:10.386453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7029df4c-0832-4cc0-a815-2d15c810a1ae tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:10.401914 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7029df4c-0832-4cc0-a815-2d15c810a1ae tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1265 microversion: 2.1 time: 0.357188 Oct 27 19:06:10.405205 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2286/4389] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:10 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1265 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:10.420389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-fe30c30e-7fb0-4b7b-b64b-8449b94204f8 req-b8d9c112-8a22-4758-a92c-88d3960045c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0eab732-8c21-49ce-9687-a3fecd1284b4", "name": "network-vif-deleted", "tag": "7062376b-cb6d-4c72-9cbc-a947196bbf05"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:10.444597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fe30c30e-7fb0-4b7b-b64b-8449b94204f8 req-b8d9c112-8a22-4758-a92c-88d3960045c6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:10.445095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fe30c30e-7fb0-4b7b-b64b-8449b94204f8 req-b8d9c112-8a22-4758-a92c-88d3960045c6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:10.451128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fe30c30e-7fb0-4b7b-b64b-8449b94204f8 req-b8d9c112-8a22-4758-a92c-88d3960045c6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:10.479219 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-fe30c30e-7fb0-4b7b-b64b-8449b94204f8 req-b8d9c112-8a22-4758-a92c-88d3960045c6 service nova] Creating event network-vif-deleted:7062376b-cb6d-4c72-9cbc-a947196bbf05 for instance d0eab732-8c21-49ce-9687-a3fecd1284b4 on n-h2-860687-3 Oct 27 19:06:10.493175 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-fe30c30e-7fb0-4b7b-b64b-8449b94204f8 req-b8d9c112-8a22-4758-a92c-88d3960045c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084217 Oct 27 19:06:10.494122 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2287/4390] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:10.532151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-60617ca3-d26e-4007-bfe5-6d6063221f66 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:10.540442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-60617ca3-d26e-4007-bfe5-6d6063221f66 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:10.564620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60617ca3-d26e-4007-bfe5-6d6063221f66 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:10.565175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60617ca3-d26e-4007-bfe5-6d6063221f66 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:10.568420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60617ca3-d26e-4007-bfe5-6d6063221f66 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:10.569584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60617ca3-d26e-4007-bfe5-6d6063221f66 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:10.575792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60617ca3-d26e-4007-bfe5-6d6063221f66 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:10.579061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60617ca3-d26e-4007-bfe5-6d6063221f66 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:10.686583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-60617ca3-d26e-4007-bfe5-6d6063221f66 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lazy-loading 'flavor' on Instance uuid 96b128ff-a00c-4607-8088-1988263fbe79 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:06:10.707510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:11.191507 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-60617ca3-d26e-4007-bfe5-6d6063221f66 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "POST /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79/action" status: 202 len: 0 microversion: 2.20 time: 0.682981 Oct 27 19:06:11.192231 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2288/4391] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 19:06:10 2022] POST /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:06:11.213400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-278ae5d3-7aea-430c-a0da-9acaf381053f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:11.214037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-278ae5d3-7aea-430c-a0da-9acaf381053f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:11.238326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-278ae5d3-7aea-430c-a0da-9acaf381053f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:11.239969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-278ae5d3-7aea-430c-a0da-9acaf381053f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:11.240450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-278ae5d3-7aea-430c-a0da-9acaf381053f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:11.241307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-278ae5d3-7aea-430c-a0da-9acaf381053f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:11.241702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-278ae5d3-7aea-430c-a0da-9acaf381053f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:11.242138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-278ae5d3-7aea-430c-a0da-9acaf381053f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:11.402309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9c50246f-9900-4648-b69d-5662189cecb2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:11.419679 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9c50246f-9900-4648-b69d-5662189cecb2 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1681 microversion: 2.1 time: 1.480615 Oct 27 19:06:11.431292 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2104/4392] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:09 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1681 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:11.436331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5367ae87-aef0-4d60-b887-f3af721457ee tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:11.437126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5367ae87-aef0-4d60-b887-f3af721457ee tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:11.447652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5367ae87-aef0-4d60-b887-f3af721457ee tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:11.448159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5367ae87-aef0-4d60-b887-f3af721457ee tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:11.448605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5367ae87-aef0-4d60-b887-f3af721457ee tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:11.449321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5367ae87-aef0-4d60-b887-f3af721457ee tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:11.449781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5367ae87-aef0-4d60-b887-f3af721457ee tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:11.450215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5367ae87-aef0-4d60-b887-f3af721457ee tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:11.528076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5367ae87-aef0-4d60-b887-f3af721457ee tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:11.528576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5367ae87-aef0-4d60-b887-f3af721457ee tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:11.529026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5367ae87-aef0-4d60-b887-f3af721457ee tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:11.529493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-5367ae87-aef0-4d60-b887-f3af721457ee tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lazy-loading 'fault' on Instance uuid d0eab732-8c21-49ce-9687-a3fecd1284b4 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:06:11.626330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5367ae87-aef0-4d60-b887-f3af721457ee tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:11.637616 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5367ae87-aef0-4d60-b887-f3af721457ee tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1311 microversion: 2.1 time: 0.204946 Oct 27 19:06:11.638223 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2105/4393] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:11 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1311 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:11.644798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa8bb4aa-0019-4b1c-a81f-722f77501403 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:11.645421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa8bb4aa-0019-4b1c-a81f-722f77501403 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:11.652936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa8bb4aa-0019-4b1c-a81f-722f77501403 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:11.653442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa8bb4aa-0019-4b1c-a81f-722f77501403 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:11.653898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa8bb4aa-0019-4b1c-a81f-722f77501403 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:11.654662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa8bb4aa-0019-4b1c-a81f-722f77501403 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:11.655130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa8bb4aa-0019-4b1c-a81f-722f77501403 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:11.656127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa8bb4aa-0019-4b1c-a81f-722f77501403 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:11.880763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fa8bb4aa-0019-4b1c-a81f-722f77501403 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:11.884330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-278ae5d3-7aea-430c-a0da-9acaf381053f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:11.937292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fa8bb4aa-0019-4b1c-a81f-722f77501403 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:11.939660 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-278ae5d3-7aea-430c-a0da-9acaf381053f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1466 microversion: 2.1 time: 0.737028 Oct 27 19:06:11.941466 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2289/4394] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:11 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1466 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:11.944961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fa8bb4aa-0019-4b1c-a81f-722f77501403 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:11.949679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-536efd5c-256d-4915-b79d-faba640e37e3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:11.950768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-536efd5c-256d-4915-b79d-faba640e37e3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:11.953572 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fa8bb4aa-0019-4b1c-a81f-722f77501403 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1725 microversion: 2.20 time: 0.309383 Oct 27 19:06:11.955174 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2106/4395] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:11 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1725 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:11.998729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f77dd291-ad56-4095-8c06-52f422da3f59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:12.000256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f77dd291-ad56-4095-8c06-52f422da3f59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 66c337e5-0721-4c5e-a3f2-daa9af6f23a4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:12.008034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-536efd5c-256d-4915-b79d-faba640e37e3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:12.010920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-536efd5c-256d-4915-b79d-faba640e37e3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:12.014080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-536efd5c-256d-4915-b79d-faba640e37e3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:12.015189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-536efd5c-256d-4915-b79d-faba640e37e3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:12.016007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-536efd5c-256d-4915-b79d-faba640e37e3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:12.016792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-536efd5c-256d-4915-b79d-faba640e37e3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:12.022350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f77dd291-ad56-4095-8c06-52f422da3f59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:12.023595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f77dd291-ad56-4095-8c06-52f422da3f59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:12.027358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f77dd291-ad56-4095-8c06-52f422da3f59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:12.029169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f77dd291-ad56-4095-8c06-52f422da3f59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:12.030565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f77dd291-ad56-4095-8c06-52f422da3f59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:12.034781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f77dd291-ad56-4095-8c06-52f422da3f59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:12.302631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-536efd5c-256d-4915-b79d-faba640e37e3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:12.311823 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-536efd5c-256d-4915-b79d-faba640e37e3 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1271 microversion: 2.1 time: 0.368755 Oct 27 19:06:12.316831 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2290/4396] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:11 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1271 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:12.446864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e3b338f9-8623-49c3-b1fb-65a9520a2ea3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:12.447592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e3b338f9-8623-49c3-b1fb-65a9520a2ea3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:12.454661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3b338f9-8623-49c3-b1fb-65a9520a2ea3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:12.455391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3b338f9-8623-49c3-b1fb-65a9520a2ea3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:12.456740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3b338f9-8623-49c3-b1fb-65a9520a2ea3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:12.457650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3b338f9-8623-49c3-b1fb-65a9520a2ea3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:12.458483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3b338f9-8623-49c3-b1fb-65a9520a2ea3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:12.459080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3b338f9-8623-49c3-b1fb-65a9520a2ea3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:12.609602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e3b338f9-8623-49c3-b1fb-65a9520a2ea3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:12.628863 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e3b338f9-8623-49c3-b1fb-65a9520a2ea3 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1613 microversion: 2.1 time: 0.185516 Oct 27 19:06:12.630367 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2291/4397] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:12 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1613 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:12.643793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f77dd291-ad56-4095-8c06-52f422da3f59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:12.667037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-98e4b500-6a5c-4080-bdbe-f0e5ed288709 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:12.667871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-98e4b500-6a5c-4080-bdbe-f0e5ed288709 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:12.668268 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f77dd291-ad56-4095-8c06-52f422da3f59 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4" status: 200 len: 1468 microversion: 2.1 time: 0.704630 Oct 27 19:06:12.669208 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2107/4398] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:11 2022] GET /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4 => generated 1468 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:12.678567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e4b500-6a5c-4080-bdbe-f0e5ed288709 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:12.683495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e4b500-6a5c-4080-bdbe-f0e5ed288709 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:12.684409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e4b500-6a5c-4080-bdbe-f0e5ed288709 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:12.685459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e4b500-6a5c-4080-bdbe-f0e5ed288709 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:12.686252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e4b500-6a5c-4080-bdbe-f0e5ed288709 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:12.687139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e4b500-6a5c-4080-bdbe-f0e5ed288709 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:12.699844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:12.723412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:12.729124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Searching by: {'reservation_id': 'r-jg0qavd2', 'deleted': False, 'project_id': '50a8ecec5b084df386bc976017133fd8'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 19:06:12.742210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:12.742494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:12.742937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:12.743671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:12.744131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:12.744566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:12.782331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e4b500-6a5c-4080-bdbe-f0e5ed288709 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:12.783213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e4b500-6a5c-4080-bdbe-f0e5ed288709 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:12.783887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98e4b500-6a5c-4080-bdbe-f0e5ed288709 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:12.784771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-98e4b500-6a5c-4080-bdbe-f0e5ed288709 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lazy-loading 'fault' on Instance uuid d0eab732-8c21-49ce-9687-a3fecd1284b4 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:06:12.913569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 19:06:12.952234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-98e4b500-6a5c-4080-bdbe-f0e5ed288709 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:12.964605 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-98e4b500-6a5c-4080-bdbe-f0e5ed288709 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 200 len: 1311 microversion: 2.1 time: 0.301470 Oct 27 19:06:12.966173 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2292/4399] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:12 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 1311 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:13.013729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-92c1b8dd-e9c4-451d-80d6-538b83bb435f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:13.020710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-92c1b8dd-e9c4-451d-80d6-538b83bb435f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:13.040848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92c1b8dd-e9c4-451d-80d6-538b83bb435f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:13.045378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92c1b8dd-e9c4-451d-80d6-538b83bb435f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:13.045851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92c1b8dd-e9c4-451d-80d6-538b83bb435f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:13.046628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92c1b8dd-e9c4-451d-80d6-538b83bb435f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:13.047276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92c1b8dd-e9c4-451d-80d6-538b83bb435f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:13.047902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-92c1b8dd-e9c4-451d-80d6-538b83bb435f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:13.079370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:13.094671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:13.101529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:13.102193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:13.107835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:13.356884 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-29c5ef03-7c10-4e63-94ec-263d15444725 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?reservation_id=r-jg0qavd2" status: 200 len: 2927 microversion: 2.1 time: 0.664905 Oct 27 19:06:13.357763 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2108/4400] 10.222.0.42 () {58 vars in 1197 bytes} [Thu Oct 27 19:06:12 2022] GET /compute/v2.1/servers/detail?reservation_id=r-jg0qavd2 => generated 2927 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:06:13.374369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c5558fe8-8547-4c67-a573-846d3c980123 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:13.375220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c5558fe8-8547-4c67-a573-846d3c980123 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:13.385297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5558fe8-8547-4c67-a573-846d3c980123 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:13.386026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5558fe8-8547-4c67-a573-846d3c980123 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:13.386662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5558fe8-8547-4c67-a573-846d3c980123 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:13.390657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5558fe8-8547-4c67-a573-846d3c980123 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:13.391293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5558fe8-8547-4c67-a573-846d3c980123 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:13.391892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5558fe8-8547-4c67-a573-846d3c980123 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:13.556024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-92c1b8dd-e9c4-451d-80d6-538b83bb435f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:13.567887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-92c1b8dd-e9c4-451d-80d6-538b83bb435f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:13.569356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-92c1b8dd-e9c4-451d-80d6-538b83bb435f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:13.572798 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-92c1b8dd-e9c4-451d-80d6-538b83bb435f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1725 microversion: 2.20 time: 0.571977 Oct 27 19:06:13.573408 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2293/4401] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:12 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1725 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:13.578039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-14bf58e1-29d9-4a42-9cc2-74c47c57db38 req-643ecefa-921a-4cfe-afef-7271d5eb7b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9", "name": "network-vif-deleted", "tag": "37a53b22-60d3-4cbe-a630-561426159264"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:13.623827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-14bf58e1-29d9-4a42-9cc2-74c47c57db38 req-643ecefa-921a-4cfe-afef-7271d5eb7b2d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:13.624329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-14bf58e1-29d9-4a42-9cc2-74c47c57db38 req-643ecefa-921a-4cfe-afef-7271d5eb7b2d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:13.624778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-14bf58e1-29d9-4a42-9cc2-74c47c57db38 req-643ecefa-921a-4cfe-afef-7271d5eb7b2d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:13.644289 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-14bf58e1-29d9-4a42-9cc2-74c47c57db38 req-643ecefa-921a-4cfe-afef-7271d5eb7b2d service nova] Creating event network-vif-deleted:37a53b22-60d3-4cbe-a630-561426159264 for instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 on n-h1-860687-3 Oct 27 19:06:13.656022 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-14bf58e1-29d9-4a42-9cc2-74c47c57db38 req-643ecefa-921a-4cfe-afef-7271d5eb7b2d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081244 Oct 27 19:06:13.657309 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2294/4402] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:13.666469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-47f7d046-0714-435d-8896-311a652a21b3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:13.686733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.compute.server_groups [None req-47f7d046-0714-435d-8896-311a652a21b3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Querying cell af35862a-071a-430c-affa-82567dc9805c(cell1) for 2 instances {{(pid=127029) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 19:06:13.687484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47f7d046-0714-435d-8896-311a652a21b3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:13.687961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47f7d046-0714-435d-8896-311a652a21b3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:13.688407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47f7d046-0714-435d-8896-311a652a21b3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:13.703478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c5558fe8-8547-4c67-a573-846d3c980123 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:13.718426 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c5558fe8-8547-4c67-a573-846d3c980123 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1313 microversion: 2.1 time: 0.358566 Oct 27 19:06:13.735972 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2109/4403] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:13 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:13.741838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d2cb3b7-8db3-48d6-8be9-b91e393946da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:13.742483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0d2cb3b7-8db3-48d6-8be9-b91e393946da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:13.750357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2cb3b7-8db3-48d6-8be9-b91e393946da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:13.751139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2cb3b7-8db3-48d6-8be9-b91e393946da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:13.751841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2cb3b7-8db3-48d6-8be9-b91e393946da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:13.752757 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-47f7d046-0714-435d-8896-311a652a21b3 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/35edbec0-d013-404e-b6d6-c0ec180c98ee" status: 200 len: 269 microversion: 2.1 time: 0.093965 Oct 27 19:06:13.752929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2cb3b7-8db3-48d6-8be9-b91e393946da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:13.758773 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2295/4404] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 19:06:13 2022] GET /compute/v2.1/os-server-groups/35edbec0-d013-404e-b6d6-c0ec180c98ee => generated 269 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:13.760731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2cb3b7-8db3-48d6-8be9-b91e393946da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:13.761404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2cb3b7-8db3-48d6-8be9-b91e393946da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:13.768134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-54d4463c-407a-4b75-b204-26ca9aa72141 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:13.769730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-54d4463c-407a-4b75-b204-26ca9aa72141 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:13.781895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54d4463c-407a-4b75-b204-26ca9aa72141 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:13.782414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54d4463c-407a-4b75-b204-26ca9aa72141 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:13.784944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54d4463c-407a-4b75-b204-26ca9aa72141 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:13.785693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54d4463c-407a-4b75-b204-26ca9aa72141 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:13.786178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54d4463c-407a-4b75-b204-26ca9aa72141 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:13.789968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54d4463c-407a-4b75-b204-26ca9aa72141 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:13.812964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2cb3b7-8db3-48d6-8be9-b91e393946da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:13.813909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2cb3b7-8db3-48d6-8be9-b91e393946da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:13.814355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2cb3b7-8db3-48d6-8be9-b91e393946da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:13.814845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-0d2cb3b7-8db3-48d6-8be9-b91e393946da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lazy-loading 'fault' on Instance uuid 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:06:13.878308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0d2cb3b7-8db3-48d6-8be9-b91e393946da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be49f7bea7a4c8fbf289594e635fd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccbe7e63ab48199790f4676bbf2580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:13.889272 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d2cb3b7-8db3-48d6-8be9-b91e393946da tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 200 len: 1331 microversion: 2.1 time: 0.150127 Oct 27 19:06:13.890518 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2110/4405] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:13 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 1331 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:13.990327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4704464d-3a99-429d-9687-04df9391eadc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:13.991427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4704464d-3a99-429d-9687-04df9391eadc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:14.005084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4704464d-3a99-429d-9687-04df9391eadc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:14.008626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4704464d-3a99-429d-9687-04df9391eadc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:14.009273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4704464d-3a99-429d-9687-04df9391eadc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:14.010676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4704464d-3a99-429d-9687-04df9391eadc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:14.014121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4704464d-3a99-429d-9687-04df9391eadc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:14.014836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4704464d-3a99-429d-9687-04df9391eadc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:14.039981 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-4704464d-3a99-429d-9687-04df9391eadc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4704464d-3a99-429d-9687-04df9391eadc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 HTTP/1.1 Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'd0eab732-8c21-49ce-9687-a3fecd1284b4'} Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:14.042018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:14.047822 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:14.047822 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:14.047822 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:06:14.047822 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:06:14.047822 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:06:14.047822 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:14.049920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4704464d-3a99-429d-9687-04df9391eadc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:06:14.051483 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4704464d-3a99-429d-9687-04df9391eadc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 404 len: 111 microversion: 2.1 time: 0.066541 Oct 27 19:06:14.052589 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2111/4406] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:13 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:06:14.068392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f4dc4d90-998a-4e7f-adf6-c843aeca33d7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Action: 'create', calling method: .version_select at 0x7fc86a38f8b0>, body: {"keypair": {"name": "tempest-key-1121334629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCvko1pOcx+wdXhORIrWQRWaYH6JufoWfbf0XFOHPocYj9xq3+WoMLqE2ri/Yyfqsi/O7NTk3OLSk+Nm4eq7dIghyosiOEXE1LdKw6ZUQwSLWAGdBOIx6Z8lB8ZFITl2w=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:14.086562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-f4dc4d90-998a-4e7f-adf6-c843aeca33d7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:06:14.092551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-f4dc4d90-998a-4e7f-adf6-c843aeca33d7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for user e7d5767d1dc249cd8e97097588ee4728 and project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:06:14.109852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:14.133280 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f4dc4d90-998a-4e7f-adf6-c843aeca33d7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.069250 Oct 27 19:06:14.134692 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2112/4407] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:06:14 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:14.146244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-44a66ed7-22a5-417c-9dc1-0ef0e1a4d4d3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '.version_select at 0x7fc869d32c10>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:14.152236 n-d-860687-3 devstack@n-api.service[127028]: WARNING oslo_db.sqlalchemy.utils [None req-44a66ed7-22a5-417c-9dc1-0ef0e1a4d4d3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 19:06:14.162196 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-44a66ed7-22a5-417c-9dc1-0ef0e1a4d4d3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.020908 Oct 27 19:06:14.163564 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2113/4408] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 19:06:14 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:14.193383 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-54d4463c-407a-4b75-b204-26ca9aa72141 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1617 microversion: 2.1 time: 0.428959 Oct 27 19:06:14.194577 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2296/4409] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:13 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1617 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:14.220319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-98411747-0735-4d66-9449-e3a7dfac0480 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:14.221107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-98411747-0735-4d66-9449-e3a7dfac0480 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] [instance: 66c337e5-0721-4c5e-a3f2-daa9af6f23a4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:14.231648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98411747-0735-4d66-9449-e3a7dfac0480 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:14.234957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98411747-0735-4d66-9449-e3a7dfac0480 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:14.235983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98411747-0735-4d66-9449-e3a7dfac0480 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:14.237731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98411747-0735-4d66-9449-e3a7dfac0480 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:14.239422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98411747-0735-4d66-9449-e3a7dfac0480 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:14.239991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98411747-0735-4d66-9449-e3a7dfac0480 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:14.384388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-421249033", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "key_name": "tempest-key-1121334629", "networks": [{"uuid": "0e03b86b-4627-4072-8ddb-a6a80f18beba"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:14.492853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] validate_networks() for [('0e03b86b-4627-4072-8ddb-a6a80f18beba', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:06:14.600132 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-98411747-0735-4d66-9449-e3a7dfac0480 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4" status: 200 len: 1619 microversion: 2.1 time: 0.383459 Oct 27 19:06:14.601353 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2114/4410] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:14 2022] GET /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4 => generated 1619 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:14.607335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d17a3757-0808-43ad-8be8-d47b486955b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:14.608391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d17a3757-0808-43ad-8be8-d47b486955b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:14.652332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d17a3757-0808-43ad-8be8-d47b486955b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:14.658255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d17a3757-0808-43ad-8be8-d47b486955b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:14.660911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d17a3757-0808-43ad-8be8-d47b486955b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:14.662414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d17a3757-0808-43ad-8be8-d47b486955b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:14.665450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d17a3757-0808-43ad-8be8-d47b486955b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:14.666263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d17a3757-0808-43ad-8be8-d47b486955b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:14.973369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d17a3757-0808-43ad-8be8-d47b486955b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:14.984785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d17a3757-0808-43ad-8be8-d47b486955b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:14.986618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d17a3757-0808-43ad-8be8-d47b486955b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:14.989026 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d17a3757-0808-43ad-8be8-d47b486955b9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1725 microversion: 2.20 time: 0.386432 Oct 27 19:06:15.004904 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2115/4411] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:14 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1725 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:15.021025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-582790df-d121-43e0-9c8a-ace16ed201f9 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:15.021958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-582790df-d121-43e0-9c8a-ace16ed201f9 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:15.029073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-582790df-d121-43e0-9c8a-ace16ed201f9 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:15.030043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-582790df-d121-43e0-9c8a-ace16ed201f9 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:15.030736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-582790df-d121-43e0-9c8a-ace16ed201f9 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:15.031683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-582790df-d121-43e0-9c8a-ace16ed201f9 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:15.032324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-582790df-d121-43e0-9c8a-ace16ed201f9 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:15.032940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-582790df-d121-43e0-9c8a-ace16ed201f9 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:15.249503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-582790df-d121-43e0-9c8a-ace16ed201f9 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:15.259577 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-582790df-d121-43e0-9c8a-ace16ed201f9 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1313 microversion: 2.1 time: 0.253400 Oct 27 19:06:15.260793 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2116/4412] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:15 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:15.267158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1269814170", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "847d3fc3-fa4c-4211-9900-d6a2fdcaae8a"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:15.356901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:06:15.446641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:06:15.447166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:06:15.447626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:06:15.449342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:06:15.449780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:06:15.476525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:15.477226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:15.477679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:15.478465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:15.478927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:15.481893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:15.508175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:06:15.515732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for user e7d5767d1dc249cd8e97097588ee4728 and project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:06:15.532008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:06:15.535933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:06:15.637564 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3918f236-576b-4279-b0ce-521abb2e2d72 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257539 Oct 27 19:06:15.648188 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2297/4413] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:06:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:06:15.656092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d18fb7c-1472-42cb-81bd-eb211b43be9f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:15.656092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0d18fb7c-1472-42cb-81bd-eb211b43be9f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:15.697372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d18fb7c-1472-42cb-81bd-eb211b43be9f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:15.697881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d18fb7c-1472-42cb-81bd-eb211b43be9f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:15.698322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d18fb7c-1472-42cb-81bd-eb211b43be9f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:15.699754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d18fb7c-1472-42cb-81bd-eb211b43be9f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:15.700381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d18fb7c-1472-42cb-81bd-eb211b43be9f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:15.701062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d18fb7c-1472-42cb-81bd-eb211b43be9f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:15.708911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:06:15.709354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:06:15.709842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:06:15.710260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:06:15.710902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:06:15.725768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:15.726460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:15.727068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:15.727999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:15.728620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:15.729216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:15.738534 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-0d18fb7c-1472-42cb-81bd-eb211b43be9f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] HTTP exception thrown: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d18fb7c-1472-42cb-81bd-eb211b43be9f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Request method failure captured: Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 HTTP/1.1 Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtT5H8XP7V9L0TVuuJvAuBoxNkhZhgX8XkK4-GpzHComWgmbBONfMudM4Q8yHeohsrOhf9YccVlwgfDyUGCChaGZWmGukZPYKh-mvkrZX3vZytXvdyVczNY7QyQ7kdcUBjknkaFKQkxOgdDbrstleWDjGVR0bmb658DtZfuMHYOhmds Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52ccbe7e63ab48199790f4676bbf2580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2be49f7bea7a4c8fbf289594e635fd69 Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9'} Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:15.745193 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:15.750062 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:15.750062 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:15.750062 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:15.750062 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:06:15.750062 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:06:15.750062 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:15.750062 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:15.750062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d18fb7c-1472-42cb-81bd-eb211b43be9f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Returning 404 to user: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:06:15.750062 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0d18fb7c-1472-42cb-81bd-eb211b43be9f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 404 len: 111 microversion: 2.1 time: 0.097226 Oct 27 19:06:15.751167 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2298/4414] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:15 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:06:15.756835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:06:15.758779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-4020d3b9-f2b4-481a-8093-8c5429133434 req-f6837572-e8e3-4d61-97fc-eed7d80dfdcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeb7a67e-0b58-4410-aab2-40f18a73eec0", "tag": "a8254093-57e1-42ac-8e04-a284dcc2675e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:15.763177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:06:15.769351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4020d3b9-f2b4-481a-8093-8c5429133434 req-f6837572-e8e3-4d61-97fc-eed7d80dfdcb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:15.769848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4020d3b9-f2b4-481a-8093-8c5429133434 req-f6837572-e8e3-4d61-97fc-eed7d80dfdcb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:15.770369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4020d3b9-f2b4-481a-8093-8c5429133434 req-f6837572-e8e3-4d61-97fc-eed7d80dfdcb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:15.783386 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-4020d3b9-f2b4-481a-8093-8c5429133434 req-f6837572-e8e3-4d61-97fc-eed7d80dfdcb service nova] Creating event network-changed:a8254093-57e1-42ac-8e04-a284dcc2675e for instance aeb7a67e-0b58-4410-aab2-40f18a73eec0 on n-h1-860687-3 Oct 27 19:06:15.795385 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-4020d3b9-f2b4-481a-8093-8c5429133434 req-f6837572-e8e3-4d61-97fc-eed7d80dfdcb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042901 Oct 27 19:06:15.796291 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2299/4415] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:15.798947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:06:15.802264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:06:15.804245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cbc59c29-9615-46fd-9b9e-c8e4baea682d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:15.806682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cbc59c29-9615-46fd-9b9e-c8e4baea682d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:15.901817 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3e76bda1-b61e-41ff-a12f-9ff105105799 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639606 Oct 27 19:06:15.902964 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2117/4416] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:06:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:06:15.907817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-38a83f0b-4999-48da-a98c-693161d49c60 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '.version_select at 0x7fc86b1fa700>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:15.952634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cbc59c29-9615-46fd-9b9e-c8e4baea682d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:15.956632 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-38a83f0b-4999-48da-a98c-693161d49c60 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-869254833" status: 202 len: 0 microversion: 2.1 time: 0.051772 Oct 27 19:06:15.957777 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2118/4417] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Oct 27 19:06:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-869254833 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:06:15.964248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-af7f015f-95ef-4012-8b26-aca58b8af390 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:15.964886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-af7f015f-95ef-4012-8b26-aca58b8af390 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:15.965494 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cbc59c29-9615-46fd-9b9e-c8e4baea682d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1228 microversion: 2.1 time: 0.167648 Oct 27 19:06:15.967638 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2300/4418] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:15 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1228 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:16.025765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ec1e6972-fbcc-4c32-a65c-0a391aebc8a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:16.027372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ec1e6972-fbcc-4c32-a65c-0a391aebc8a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:16.037900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec1e6972-fbcc-4c32-a65c-0a391aebc8a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:16.038966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec1e6972-fbcc-4c32-a65c-0a391aebc8a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:16.042800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec1e6972-fbcc-4c32-a65c-0a391aebc8a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:16.043783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec1e6972-fbcc-4c32-a65c-0a391aebc8a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:16.044503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec1e6972-fbcc-4c32-a65c-0a391aebc8a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:16.045156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec1e6972-fbcc-4c32-a65c-0a391aebc8a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:16.149099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-af7f015f-95ef-4012-8b26-aca58b8af390 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:16.157717 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-af7f015f-95ef-4012-8b26-aca58b8af390 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1217 microversion: 2.1 time: 0.198608 Oct 27 19:06:16.161019 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2119/4419] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:15 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1217 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:16.283211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-17bccab9-d8e7-418f-b96b-d7b2c6f30002 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:16.284771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-17bccab9-d8e7-418f-b96b-d7b2c6f30002 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:16.304465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17bccab9-d8e7-418f-b96b-d7b2c6f30002 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:16.306666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17bccab9-d8e7-418f-b96b-d7b2c6f30002 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:16.307230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17bccab9-d8e7-418f-b96b-d7b2c6f30002 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:16.310228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17bccab9-d8e7-418f-b96b-d7b2c6f30002 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:16.310937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17bccab9-d8e7-418f-b96b-d7b2c6f30002 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:16.311500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17bccab9-d8e7-418f-b96b-d7b2c6f30002 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:16.423832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ec1e6972-fbcc-4c32-a65c-0a391aebc8a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:16.436250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ec1e6972-fbcc-4c32-a65c-0a391aebc8a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:16.437753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ec1e6972-fbcc-4c32-a65c-0a391aebc8a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:16.439012 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ec1e6972-fbcc-4c32-a65c-0a391aebc8a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1725 microversion: 2.20 time: 0.417225 Oct 27 19:06:16.439777 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2301/4420] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:16 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1725 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:16.582961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-17bccab9-d8e7-418f-b96b-d7b2c6f30002 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:16.603188 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-17bccab9-d8e7-418f-b96b-d7b2c6f30002 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1313 microversion: 2.1 time: 0.323840 Oct 27 19:06:16.603803 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2120/4421] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:16 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:16.994665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-141ddacf-afb3-4316-b8d5-877bfed90bd7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:16.999522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-141ddacf-afb3-4316-b8d5-877bfed90bd7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:17.013994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-141ddacf-afb3-4316-b8d5-877bfed90bd7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:17.016172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-141ddacf-afb3-4316-b8d5-877bfed90bd7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:17.016935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-141ddacf-afb3-4316-b8d5-877bfed90bd7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:17.019125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-141ddacf-afb3-4316-b8d5-877bfed90bd7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:17.020542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-141ddacf-afb3-4316-b8d5-877bfed90bd7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:17.022484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-141ddacf-afb3-4316-b8d5-877bfed90bd7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:17.109304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-141ddacf-afb3-4316-b8d5-877bfed90bd7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:17.129542 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-141ddacf-afb3-4316-b8d5-877bfed90bd7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1280 microversion: 2.1 time: 0.138555 Oct 27 19:06:17.130739 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2302/4422] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:16 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1280 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:17.187916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9a76b23d-aaa3-4c97-a820-9f16467c7c9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:17.188516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9a76b23d-aaa3-4c97-a820-9f16467c7c9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:17.197968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a76b23d-aaa3-4c97-a820-9f16467c7c9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:17.198572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a76b23d-aaa3-4c97-a820-9f16467c7c9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:17.199020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a76b23d-aaa3-4c97-a820-9f16467c7c9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:17.199732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a76b23d-aaa3-4c97-a820-9f16467c7c9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:17.200413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a76b23d-aaa3-4c97-a820-9f16467c7c9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:17.200850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a76b23d-aaa3-4c97-a820-9f16467c7c9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:17.290254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9a76b23d-aaa3-4c97-a820-9f16467c7c9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:17.305420 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9a76b23d-aaa3-4c97-a820-9f16467c7c9f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1213 microversion: 2.1 time: 0.124828 Oct 27 19:06:17.306826 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2121/4423] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:17 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:17.470181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2e02520b-e0f1-44d4-9a5f-c931b5d1df48 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:17.472052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2e02520b-e0f1-44d4-9a5f-c931b5d1df48 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:17.490277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e02520b-e0f1-44d4-9a5f-c931b5d1df48 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:17.492399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e02520b-e0f1-44d4-9a5f-c931b5d1df48 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:17.493407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e02520b-e0f1-44d4-9a5f-c931b5d1df48 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:17.494793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e02520b-e0f1-44d4-9a5f-c931b5d1df48 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:17.495274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e02520b-e0f1-44d4-9a5f-c931b5d1df48 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:17.499541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e02520b-e0f1-44d4-9a5f-c931b5d1df48 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:17.626407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-020ee370-3498-42c3-a289-f7ddc6bb8f7a tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:17.627313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-020ee370-3498-42c3-a289-f7ddc6bb8f7a tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:17.637534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-020ee370-3498-42c3-a289-f7ddc6bb8f7a tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:17.640904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-020ee370-3498-42c3-a289-f7ddc6bb8f7a tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:17.641561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-020ee370-3498-42c3-a289-f7ddc6bb8f7a tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:17.644231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-020ee370-3498-42c3-a289-f7ddc6bb8f7a tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:17.644971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-020ee370-3498-42c3-a289-f7ddc6bb8f7a tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:17.645575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-020ee370-3498-42c3-a289-f7ddc6bb8f7a tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:18.002899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2e02520b-e0f1-44d4-9a5f-c931b5d1df48 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:18.016925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2e02520b-e0f1-44d4-9a5f-c931b5d1df48 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:18.019367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2e02520b-e0f1-44d4-9a5f-c931b5d1df48 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:18.020993 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2e02520b-e0f1-44d4-9a5f-c931b5d1df48 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1725 microversion: 2.20 time: 0.558098 Oct 27 19:06:18.022161 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2303/4424] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:17 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1725 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:18.103008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-020ee370-3498-42c3-a289-f7ddc6bb8f7a tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:18.114128 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-020ee370-3498-42c3-a289-f7ddc6bb8f7a tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1313 microversion: 2.1 time: 0.491897 Oct 27 19:06:18.125275 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2122/4425] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:17 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:18.160861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-52e94181-4ef1-4db1-a010-0b32f7a2d736 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:18.161947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-52e94181-4ef1-4db1-a010-0b32f7a2d736 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:18.172551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52e94181-4ef1-4db1-a010-0b32f7a2d736 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:18.173422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52e94181-4ef1-4db1-a010-0b32f7a2d736 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:18.176610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52e94181-4ef1-4db1-a010-0b32f7a2d736 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:18.177618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52e94181-4ef1-4db1-a010-0b32f7a2d736 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:18.178318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52e94181-4ef1-4db1-a010-0b32f7a2d736 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:18.180474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52e94181-4ef1-4db1-a010-0b32f7a2d736 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:18.329148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e1f47ba7-5ae8-4b64-b3c5-0faccc3988ec tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:18.329771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e1f47ba7-5ae8-4b64-b3c5-0faccc3988ec tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:18.343362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-52e94181-4ef1-4db1-a010-0b32f7a2d736 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:18.345245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1f47ba7-5ae8-4b64-b3c5-0faccc3988ec tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:18.345835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1f47ba7-5ae8-4b64-b3c5-0faccc3988ec tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:18.346671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1f47ba7-5ae8-4b64-b3c5-0faccc3988ec tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:18.347587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1f47ba7-5ae8-4b64-b3c5-0faccc3988ec tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:18.348642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1f47ba7-5ae8-4b64-b3c5-0faccc3988ec tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:18.349086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1f47ba7-5ae8-4b64-b3c5-0faccc3988ec tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:18.353815 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-52e94181-4ef1-4db1-a010-0b32f7a2d736 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1286 microversion: 2.1 time: 0.197435 Oct 27 19:06:18.366418 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2304/4426] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:18 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1286 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:18.521373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e1f47ba7-5ae8-4b64-b3c5-0faccc3988ec tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:18.535854 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e1f47ba7-5ae8-4b64-b3c5-0faccc3988ec tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1277 microversion: 2.1 time: 0.210410 Oct 27 19:06:18.550864 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2123/4427] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:18 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1277 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:19.047674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7e663017-3d86-406b-95eb-393ade36d227 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:19.048314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7e663017-3d86-406b-95eb-393ade36d227 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:19.069266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e663017-3d86-406b-95eb-393ade36d227 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:19.069779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e663017-3d86-406b-95eb-393ade36d227 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:19.070463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e663017-3d86-406b-95eb-393ade36d227 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:19.071374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e663017-3d86-406b-95eb-393ade36d227 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:19.072044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e663017-3d86-406b-95eb-393ade36d227 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:19.072481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e663017-3d86-406b-95eb-393ade36d227 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:19.142598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae908754-49a9-4db2-8435-a14e5e5e533b tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:19.157239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ae908754-49a9-4db2-8435-a14e5e5e533b tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:19.168368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae908754-49a9-4db2-8435-a14e5e5e533b tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:19.169078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae908754-49a9-4db2-8435-a14e5e5e533b tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:19.169694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae908754-49a9-4db2-8435-a14e5e5e533b tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:19.176112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae908754-49a9-4db2-8435-a14e5e5e533b tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:19.177040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae908754-49a9-4db2-8435-a14e5e5e533b tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:19.177697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae908754-49a9-4db2-8435-a14e5e5e533b tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:20.095597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7e663017-3d86-406b-95eb-393ade36d227 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:20.109063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7e663017-3d86-406b-95eb-393ade36d227 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:20.112587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7e663017-3d86-406b-95eb-393ade36d227 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:20.114222 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7e663017-3d86-406b-95eb-393ade36d227 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1725 microversion: 2.20 time: 1.070543 Oct 27 19:06:20.137899 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2305/4428] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:19 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1725 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:20.147922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ceaf9697-e8df-4444-add1-fa5f88790954 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:20.148857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ceaf9697-e8df-4444-add1-fa5f88790954 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:20.156172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ceaf9697-e8df-4444-add1-fa5f88790954 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:20.157045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ceaf9697-e8df-4444-add1-fa5f88790954 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:20.157649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ceaf9697-e8df-4444-add1-fa5f88790954 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:20.158592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ceaf9697-e8df-4444-add1-fa5f88790954 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:20.161009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae908754-49a9-4db2-8435-a14e5e5e533b tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:20.164397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ceaf9697-e8df-4444-add1-fa5f88790954 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:20.169758 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ae908754-49a9-4db2-8435-a14e5e5e533b tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1313 microversion: 2.1 time: 1.030876 Oct 27 19:06:20.182778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ceaf9697-e8df-4444-add1-fa5f88790954 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:20.189384 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2124/4429] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:19 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1313 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:06:20.204578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c379724e-c731-4643-a9ee-77294e95f79d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:20.205389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c379724e-c731-4643-a9ee-77294e95f79d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:20.221946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c379724e-c731-4643-a9ee-77294e95f79d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:20.222666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c379724e-c731-4643-a9ee-77294e95f79d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:20.227757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c379724e-c731-4643-a9ee-77294e95f79d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:20.228782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c379724e-c731-4643-a9ee-77294e95f79d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:20.229912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c379724e-c731-4643-a9ee-77294e95f79d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:20.230566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c379724e-c731-4643-a9ee-77294e95f79d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:20.505557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ceaf9697-e8df-4444-add1-fa5f88790954 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:20.525802 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ceaf9697-e8df-4444-add1-fa5f88790954 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1328 microversion: 2.1 time: 0.385458 Oct 27 19:06:20.528267 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2306/4430] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:20 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1328 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:21.145111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1d0dbe4b-353e-40b5-a994-6ebc4f69dbad tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:21.145746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1d0dbe4b-353e-40b5-a994-6ebc4f69dbad tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:21.161162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d0dbe4b-353e-40b5-a994-6ebc4f69dbad tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:21.161676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d0dbe4b-353e-40b5-a994-6ebc4f69dbad tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:21.162122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d0dbe4b-353e-40b5-a994-6ebc4f69dbad tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:21.162871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d0dbe4b-353e-40b5-a994-6ebc4f69dbad tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:21.163325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d0dbe4b-353e-40b5-a994-6ebc4f69dbad tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:21.167510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d0dbe4b-353e-40b5-a994-6ebc4f69dbad tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:21.192845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:21.251197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c379724e-c731-4643-a9ee-77294e95f79d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:21.269285 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c379724e-c731-4643-a9ee-77294e95f79d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1317 microversion: 2.1 time: 1.077284 Oct 27 19:06:21.269932 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2125/4431] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:20 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1317 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:21.308431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-753136be-dac6-4d8b-897c-f9f6afdd088e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:21.310073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-753136be-dac6-4d8b-897c-f9f6afdd088e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:21.329229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-753136be-dac6-4d8b-897c-f9f6afdd088e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:21.334675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-753136be-dac6-4d8b-897c-f9f6afdd088e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:21.343948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-753136be-dac6-4d8b-897c-f9f6afdd088e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:21.344987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-753136be-dac6-4d8b-897c-f9f6afdd088e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:21.345629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-753136be-dac6-4d8b-897c-f9f6afdd088e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:21.346281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-753136be-dac6-4d8b-897c-f9f6afdd088e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:21.627118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1d0dbe4b-353e-40b5-a994-6ebc4f69dbad tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:21.644652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1d0dbe4b-353e-40b5-a994-6ebc4f69dbad tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:21.650308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1d0dbe4b-353e-40b5-a994-6ebc4f69dbad tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:21.652997 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1d0dbe4b-353e-40b5-a994-6ebc4f69dbad tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1725 microversion: 2.20 time: 0.512655 Oct 27 19:06:21.655596 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2307/4432] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:21 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1725 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:06:21.669712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3597671c-ca1d-4a84-a2dd-d23f4663aa46 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:21.673124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3597671c-ca1d-4a84-a2dd-d23f4663aa46 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:21.693166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3597671c-ca1d-4a84-a2dd-d23f4663aa46 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:21.695147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3597671c-ca1d-4a84-a2dd-d23f4663aa46 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:21.697221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3597671c-ca1d-4a84-a2dd-d23f4663aa46 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:21.699087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3597671c-ca1d-4a84-a2dd-d23f4663aa46 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:21.700483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3597671c-ca1d-4a84-a2dd-d23f4663aa46 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:21.701094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3597671c-ca1d-4a84-a2dd-d23f4663aa46 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:21.863398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-753136be-dac6-4d8b-897c-f9f6afdd088e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:21.879069 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-753136be-dac6-4d8b-897c-f9f6afdd088e tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1313 microversion: 2.1 time: 0.588740 Oct 27 19:06:21.879683 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2126/4433] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:21 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1313 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:22.102012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3597671c-ca1d-4a84-a2dd-d23f4663aa46 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:22.111062 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3597671c-ca1d-4a84-a2dd-d23f4663aa46 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1328 microversion: 2.1 time: 0.453335 Oct 27 19:06:22.115176 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2308/4434] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:21 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1328 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:22.297390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b540a49d-9b6f-4e80-8173-c57d240862b9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:22.297930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b540a49d-9b6f-4e80-8173-c57d240862b9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:22.311792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b540a49d-9b6f-4e80-8173-c57d240862b9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:22.315610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b540a49d-9b6f-4e80-8173-c57d240862b9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:22.316272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b540a49d-9b6f-4e80-8173-c57d240862b9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:22.317051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b540a49d-9b6f-4e80-8173-c57d240862b9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:22.317525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b540a49d-9b6f-4e80-8173-c57d240862b9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:22.317957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b540a49d-9b6f-4e80-8173-c57d240862b9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:22.486132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-146f854a-853e-44c9-9c49-1ce77885693d req-81a8c17a-77fb-4d17-b695-ec82819b47c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efdf069b-5366-4fb9-8997-0ec6a55a2746", "tag": "136540f7-7531-431d-8e2c-68e2f6c910f8"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:22.521926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-146f854a-853e-44c9-9c49-1ce77885693d req-81a8c17a-77fb-4d17-b695-ec82819b47c1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:22.525021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-146f854a-853e-44c9-9c49-1ce77885693d req-81a8c17a-77fb-4d17-b695-ec82819b47c1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:22.529753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-146f854a-853e-44c9-9c49-1ce77885693d req-81a8c17a-77fb-4d17-b695-ec82819b47c1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:22.597804 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-146f854a-853e-44c9-9c49-1ce77885693d req-81a8c17a-77fb-4d17-b695-ec82819b47c1 service nova] Creating event network-changed:136540f7-7531-431d-8e2c-68e2f6c910f8 for instance efdf069b-5366-4fb9-8997-0ec6a55a2746 on n-h2-860687-3 Oct 27 19:06:22.617893 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-146f854a-853e-44c9-9c49-1ce77885693d req-81a8c17a-77fb-4d17-b695-ec82819b47c1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135869 Oct 27 19:06:22.624117 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2309/4435] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:06:22.688804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b2dcb1e9-7b9f-4cf8-8725-c80a3ebf3662 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:22.689540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b2dcb1e9-7b9f-4cf8-8725-c80a3ebf3662 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:22.699391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2dcb1e9-7b9f-4cf8-8725-c80a3ebf3662 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:22.700102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2dcb1e9-7b9f-4cf8-8725-c80a3ebf3662 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:22.700730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2dcb1e9-7b9f-4cf8-8725-c80a3ebf3662 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:22.701649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2dcb1e9-7b9f-4cf8-8725-c80a3ebf3662 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:22.702282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2dcb1e9-7b9f-4cf8-8725-c80a3ebf3662 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:22.702974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2dcb1e9-7b9f-4cf8-8725-c80a3ebf3662 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:22.993290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b540a49d-9b6f-4e80-8173-c57d240862b9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:23.004375 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b540a49d-9b6f-4e80-8173-c57d240862b9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1317 microversion: 2.1 time: 0.711270 Oct 27 19:06:23.008107 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2127/4436] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:22 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1317 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:23.018351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3cf99e34-f9d1-452f-ab32-71b939aa7658 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:23.021644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3cf99e34-f9d1-452f-ab32-71b939aa7658 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:23.040291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cf99e34-f9d1-452f-ab32-71b939aa7658 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:23.041057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cf99e34-f9d1-452f-ab32-71b939aa7658 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:23.041770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cf99e34-f9d1-452f-ab32-71b939aa7658 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:23.042708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cf99e34-f9d1-452f-ab32-71b939aa7658 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:23.043477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cf99e34-f9d1-452f-ab32-71b939aa7658 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:23.044063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cf99e34-f9d1-452f-ab32-71b939aa7658 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:23.125885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b2dcb1e9-7b9f-4cf8-8725-c80a3ebf3662 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:23.159378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b2dcb1e9-7b9f-4cf8-8725-c80a3ebf3662 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:23.161455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b2dcb1e9-7b9f-4cf8-8725-c80a3ebf3662 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:23.166884 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b2dcb1e9-7b9f-4cf8-8725-c80a3ebf3662 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1725 microversion: 2.20 time: 0.479922 Oct 27 19:06:23.178979 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2310/4437] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:22 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1725 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:06:23.203760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d937583f-9ea9-4d16-bf6e-7aef8230e5ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:23.204787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d937583f-9ea9-4d16-bf6e-7aef8230e5ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:23.211522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d937583f-9ea9-4d16-bf6e-7aef8230e5ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:23.212374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d937583f-9ea9-4d16-bf6e-7aef8230e5ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:23.212989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d937583f-9ea9-4d16-bf6e-7aef8230e5ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:23.213868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d937583f-9ea9-4d16-bf6e-7aef8230e5ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:23.214541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d937583f-9ea9-4d16-bf6e-7aef8230e5ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:23.215170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d937583f-9ea9-4d16-bf6e-7aef8230e5ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:23.546910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d937583f-9ea9-4d16-bf6e-7aef8230e5ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:23.571243 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d937583f-9ea9-4d16-bf6e-7aef8230e5ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1328 microversion: 2.1 time: 0.390606 Oct 27 19:06:23.573549 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2311/4438] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:23 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1328 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:23.583465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-70f3617b-dfd7-4955-b035-33030c44b08f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:23.584259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-70f3617b-dfd7-4955-b035-33030c44b08f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:23.603086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70f3617b-dfd7-4955-b035-33030c44b08f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:23.603880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70f3617b-dfd7-4955-b035-33030c44b08f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:23.604516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70f3617b-dfd7-4955-b035-33030c44b08f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:23.607545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70f3617b-dfd7-4955-b035-33030c44b08f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:23.608203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70f3617b-dfd7-4955-b035-33030c44b08f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:23.608817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70f3617b-dfd7-4955-b035-33030c44b08f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:23.643730 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-70f3617b-dfd7-4955-b035-33030c44b08f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] HTTP exception thrown: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-70f3617b-dfd7-4955-b035-33030c44b08f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Request method failure captured: Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 HTTP/1.1 Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtT5H8XP7V9L0TVuuJvAuBoxNkhZhgX8XkK4-GpzHComWgmbBONfMudM4Q8yHeohsrOhf9YccVlwgfDyUGCChaGZWmGukZPYKh-mvkrZX3vZytXvdyVczNY7QyQ7kdcUBjknkaFKQkxOgdDbrstleWDjGVR0bmb658DtZfuMHYOhmds Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52ccbe7e63ab48199790f4676bbf2580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2be49f7bea7a4c8fbf289594e635fd69 Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9'} Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:06:23.659821 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:06:23.665085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:23.665085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:23.665085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:23.665085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:23.665085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:23.665085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:23.665085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:23.665085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:06:23.665085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:06:23.665085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:23.665085 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:23.668901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-70f3617b-dfd7-4955-b035-33030c44b08f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Returning 404 to user: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:06:23.670491 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-70f3617b-dfd7-4955-b035-33030c44b08f tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 404 len: 111 microversion: 2.1 time: 0.093677 Oct 27 19:06:23.671716 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2312/4439] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:06:23 2022] DELETE /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:06:23.682482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b12f7a3a-3bda-4eca-a28a-3643337d78c9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:23.683929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b12f7a3a-3bda-4eca-a28a-3643337d78c9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:23.692612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b12f7a3a-3bda-4eca-a28a-3643337d78c9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:23.693433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b12f7a3a-3bda-4eca-a28a-3643337d78c9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:23.694117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b12f7a3a-3bda-4eca-a28a-3643337d78c9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:23.695124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b12f7a3a-3bda-4eca-a28a-3643337d78c9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:23.696669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b12f7a3a-3bda-4eca-a28a-3643337d78c9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:23.697432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b12f7a3a-3bda-4eca-a28a-3643337d78c9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:23.717094 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-b12f7a3a-3bda-4eca-a28a-3643337d78c9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] HTTP exception thrown: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b12f7a3a-3bda-4eca-a28a-3643337d78c9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Request method failure captured: Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 HTTP/1.1 Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtT5H8XP7V9L0TVuuJvAuBoxNkhZhgX8XkK4-GpzHComWgmbBONfMudM4Q8yHeohsrOhf9YccVlwgfDyUGCChaGZWmGukZPYKh-mvkrZX3vZytXvdyVczNY7QyQ7kdcUBjknkaFKQkxOgdDbrstleWDjGVR0bmb658DtZfuMHYOhmds Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52ccbe7e63ab48199790f4676bbf2580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2be49f7bea7a4c8fbf289594e635fd69 Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9'} Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:23.720035 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:23.726056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:23.726056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:23.726056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:23.726056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:06:23.726056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:06:23.726056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. Oct 27 19:06:23.726056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:23.727861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b12f7a3a-3bda-4eca-a28a-3643337d78c9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Returning 404 to user: Instance 3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:06:23.729034 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b12f7a3a-3bda-4eca-a28a-3643337d78c9 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9" status: 404 len: 111 microversion: 2.1 time: 0.053214 Oct 27 19:06:23.731132 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2313/4440] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:23 2022] GET /compute/v2.1/servers/3f852570-7f9d-4f85-8f08-3e9fe3c6d4f9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:06:23.777682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3cf99e34-f9d1-452f-ab32-71b939aa7658 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:23.793853 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3cf99e34-f9d1-452f-ab32-71b939aa7658 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1313 microversion: 2.1 time: 0.784182 Oct 27 19:06:23.795063 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2128/4441] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:23 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1313 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:24.036738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a3c4a974-206c-4626-99e6-611de663b77d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:24.037965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a3c4a974-206c-4626-99e6-611de663b77d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:24.051988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3c4a974-206c-4626-99e6-611de663b77d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:24.052712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3c4a974-206c-4626-99e6-611de663b77d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:24.053379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3c4a974-206c-4626-99e6-611de663b77d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:24.054310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3c4a974-206c-4626-99e6-611de663b77d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:24.056271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3c4a974-206c-4626-99e6-611de663b77d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:24.057260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3c4a974-206c-4626-99e6-611de663b77d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:24.197882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-86612ffd-d64e-4792-af62-1adc313b7e86 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:24.198563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-86612ffd-d64e-4792-af62-1adc313b7e86 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:24.207450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86612ffd-d64e-4792-af62-1adc313b7e86 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:24.207954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86612ffd-d64e-4792-af62-1adc313b7e86 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:24.216369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86612ffd-d64e-4792-af62-1adc313b7e86 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:24.217259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86612ffd-d64e-4792-af62-1adc313b7e86 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:24.217762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86612ffd-d64e-4792-af62-1adc313b7e86 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:24.218225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86612ffd-d64e-4792-af62-1adc313b7e86 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:24.527520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a3c4a974-206c-4626-99e6-611de663b77d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:24.537230 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a3c4a974-206c-4626-99e6-611de663b77d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1317 microversion: 2.1 time: 0.507941 Oct 27 19:06:24.546075 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2314/4442] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:24 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:24.568501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-cf3bde8a-1ea1-4bdf-a6cf-e2e5cdd98a50 req-bc4423ab-3057-43f2-9a9a-18dfebb4339f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5917fe3b-b247-4012-8137-7539241f129e", "tag": "de73b8b1-fc8a-4ab0-a748-9f523293daaa"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:24.591303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cf3bde8a-1ea1-4bdf-a6cf-e2e5cdd98a50 req-bc4423ab-3057-43f2-9a9a-18dfebb4339f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:24.594150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cf3bde8a-1ea1-4bdf-a6cf-e2e5cdd98a50 req-bc4423ab-3057-43f2-9a9a-18dfebb4339f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:24.595038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cf3bde8a-1ea1-4bdf-a6cf-e2e5cdd98a50 req-bc4423ab-3057-43f2-9a9a-18dfebb4339f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:24.615600 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-cf3bde8a-1ea1-4bdf-a6cf-e2e5cdd98a50 req-bc4423ab-3057-43f2-9a9a-18dfebb4339f service nova] Creating event network-changed:de73b8b1-fc8a-4ab0-a748-9f523293daaa for instance 5917fe3b-b247-4012-8137-7539241f129e on n-h2-860687-3 Oct 27 19:06:24.624380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-86612ffd-d64e-4792-af62-1adc313b7e86 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:24.628665 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-cf3bde8a-1ea1-4bdf-a6cf-e2e5cdd98a50 req-bc4423ab-3057-43f2-9a9a-18dfebb4339f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079929 Oct 27 19:06:24.631131 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2315/4443] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:24.646156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-314c987f-4580-4ecd-9c51-6aa50884f00b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:24.647093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-314c987f-4580-4ecd-9c51-6aa50884f00b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:24.649265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-86612ffd-d64e-4792-af62-1adc313b7e86 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:24.650834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-86612ffd-d64e-4792-af62-1adc313b7e86 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:24.655091 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-86612ffd-d64e-4792-af62-1adc313b7e86 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1746 microversion: 2.20 time: 0.458590 Oct 27 19:06:24.662895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-314c987f-4580-4ecd-9c51-6aa50884f00b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:24.662895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-314c987f-4580-4ecd-9c51-6aa50884f00b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:24.662895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-314c987f-4580-4ecd-9c51-6aa50884f00b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:24.663624 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2129/4444] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:24 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1746 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:06:24.667189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-314c987f-4580-4ecd-9c51-6aa50884f00b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:24.667820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-314c987f-4580-4ecd-9c51-6aa50884f00b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:24.673245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-314c987f-4580-4ecd-9c51-6aa50884f00b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:24.825257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0351f74c-7e5a-4c22-aae5-b6159b9a020c tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:24.826461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0351f74c-7e5a-4c22-aae5-b6159b9a020c tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:24.839927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0351f74c-7e5a-4c22-aae5-b6159b9a020c tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:24.841964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0351f74c-7e5a-4c22-aae5-b6159b9a020c tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:24.844686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0351f74c-7e5a-4c22-aae5-b6159b9a020c tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:24.849327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0351f74c-7e5a-4c22-aae5-b6159b9a020c tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:24.850802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0351f74c-7e5a-4c22-aae5-b6159b9a020c tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:24.851136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0351f74c-7e5a-4c22-aae5-b6159b9a020c tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:24.928830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:25.074450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-314c987f-4580-4ecd-9c51-6aa50884f00b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:25.097949 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-314c987f-4580-4ecd-9c51-6aa50884f00b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1328 microversion: 2.1 time: 0.459588 Oct 27 19:06:25.110477 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2316/4445] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:24 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1328 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:25.248360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0351f74c-7e5a-4c22-aae5-b6159b9a020c tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:25.259267 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0351f74c-7e5a-4c22-aae5-b6159b9a020c tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1313 microversion: 2.1 time: 0.439265 Oct 27 19:06:25.259867 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2130/4446] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:24 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:06:25.473133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e089dd81-ede5-4b6c-82f3-369cb476aa8f req-43c52fa4-ac3a-4337-8d0b-b28f16ba93b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb7a67e-0b58-4410-aab2-40f18a73eec0", "name": "network-vif-plugged", "status": "completed", "tag": "a8254093-57e1-42ac-8e04-a284dcc2675e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:25.498952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:25.501256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e089dd81-ede5-4b6c-82f3-369cb476aa8f req-43c52fa4-ac3a-4337-8d0b-b28f16ba93b1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:25.501418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e089dd81-ede5-4b6c-82f3-369cb476aa8f req-43c52fa4-ac3a-4337-8d0b-b28f16ba93b1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:25.501726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e089dd81-ede5-4b6c-82f3-369cb476aa8f req-43c52fa4-ac3a-4337-8d0b-b28f16ba93b1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:25.565296 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e089dd81-ede5-4b6c-82f3-369cb476aa8f req-43c52fa4-ac3a-4337-8d0b-b28f16ba93b1 service nova] Creating event network-vif-plugged:a8254093-57e1-42ac-8e04-a284dcc2675e for instance aeb7a67e-0b58-4410-aab2-40f18a73eec0 on n-h1-860687-3 Oct 27 19:06:25.570340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-64495d97-b2dc-4a2e-bbb7-88a143c8a2fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:25.571278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-64495d97-b2dc-4a2e-bbb7-88a143c8a2fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:25.582439 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e089dd81-ede5-4b6c-82f3-369cb476aa8f req-43c52fa4-ac3a-4337-8d0b-b28f16ba93b1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113034 Oct 27 19:06:25.588872 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2317/4447] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:25.623946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64495d97-b2dc-4a2e-bbb7-88a143c8a2fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:25.624654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64495d97-b2dc-4a2e-bbb7-88a143c8a2fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:25.625523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64495d97-b2dc-4a2e-bbb7-88a143c8a2fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:25.626776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64495d97-b2dc-4a2e-bbb7-88a143c8a2fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:25.627503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64495d97-b2dc-4a2e-bbb7-88a143c8a2fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:25.631958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64495d97-b2dc-4a2e-bbb7-88a143c8a2fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:25.685478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-49559689-4e5f-4cf1-b4ae-3d8c5250078c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:25.686216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-49559689-4e5f-4cf1-b4ae-3d8c5250078c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:25.703911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:25.709738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49559689-4e5f-4cf1-b4ae-3d8c5250078c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:25.710258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49559689-4e5f-4cf1-b4ae-3d8c5250078c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:25.710835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49559689-4e5f-4cf1-b4ae-3d8c5250078c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:25.713457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49559689-4e5f-4cf1-b4ae-3d8c5250078c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:25.718613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49559689-4e5f-4cf1-b4ae-3d8c5250078c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:25.720881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49559689-4e5f-4cf1-b4ae-3d8c5250078c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:25.749727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:25.965220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=14 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:25.981948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-64495d97-b2dc-4a2e-bbb7-88a143c8a2fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:25.997081 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-64495d97-b2dc-4a2e-bbb7-88a143c8a2fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1317 microversion: 2.1 time: 0.431751 Oct 27 19:06:25.999070 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2131/4448] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:25 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:06:26.125487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c55480ea-b8f1-4726-bada-d8fd4e518893 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:26.126298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c55480ea-b8f1-4726-bada-d8fd4e518893 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:26.140760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c55480ea-b8f1-4726-bada-d8fd4e518893 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:26.141373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c55480ea-b8f1-4726-bada-d8fd4e518893 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:26.142032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c55480ea-b8f1-4726-bada-d8fd4e518893 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:26.149143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c55480ea-b8f1-4726-bada-d8fd4e518893 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:26.149964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c55480ea-b8f1-4726-bada-d8fd4e518893 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:26.151352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c55480ea-b8f1-4726-bada-d8fd4e518893 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:26.157707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=16 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:26.460619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-49559689-4e5f-4cf1-b4ae-3d8c5250078c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:26.471790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-49559689-4e5f-4cf1-b4ae-3d8c5250078c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:26.485317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-49559689-4e5f-4cf1-b4ae-3d8c5250078c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:26.494210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c55480ea-b8f1-4726-bada-d8fd4e518893 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:26.508397 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c55480ea-b8f1-4726-bada-d8fd4e518893 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1328 microversion: 2.1 time: 0.386431 Oct 27 19:06:26.509808 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2132/4449] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:26 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1328 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:26.516240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-52355e00-4ae8-427d-80aa-1ce969df2b77 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:26.517148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-52355e00-4ae8-427d-80aa-1ce969df2b77 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:26.525599 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-49559689-4e5f-4cf1-b4ae-3d8c5250078c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1746 microversion: 2.20 time: 0.812645 Oct 27 19:06:26.531920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52355e00-4ae8-427d-80aa-1ce969df2b77 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:26.532756 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2318/4450] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:25 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1746 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:06:26.537394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52355e00-4ae8-427d-80aa-1ce969df2b77 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:26.538189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52355e00-4ae8-427d-80aa-1ce969df2b77 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:26.539292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52355e00-4ae8-427d-80aa-1ce969df2b77 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:26.539988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52355e00-4ae8-427d-80aa-1ce969df2b77 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:26.540630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52355e00-4ae8-427d-80aa-1ce969df2b77 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:26.554501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-081bb37f-d188-4a73-9d71-9cf24b796c75 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:26.575660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-081bb37f-d188-4a73-9d71-9cf24b796c75 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:26.577001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-081bb37f-d188-4a73-9d71-9cf24b796c75 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Searching by: {'deleted': False, 'project_id': '28491a788f494c9f81f9fd8a5cf10702'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 19:06:26.592251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-081bb37f-d188-4a73-9d71-9cf24b796c75 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:26.593919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-081bb37f-d188-4a73-9d71-9cf24b796c75 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:26.594588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-081bb37f-d188-4a73-9d71-9cf24b796c75 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:26.595550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-081bb37f-d188-4a73-9d71-9cf24b796c75 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:26.597876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-081bb37f-d188-4a73-9d71-9cf24b796c75 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:26.598536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-081bb37f-d188-4a73-9d71-9cf24b796c75 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:26.662039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-081bb37f-d188-4a73-9d71-9cf24b796c75 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 19:06:26.739790 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-081bb37f-d188-4a73-9d71-9cf24b796c75 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.194585 Oct 27 19:06:26.758755 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2319/4451] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 19:06:26 2022] GET /compute/v2.1/servers => generated 340 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:26.765338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:26.779246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:26.797035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Searching by: {'deleted': False, 'project_id': '28491a788f494c9f81f9fd8a5cf10702'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 19:06:26.810711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:26.818497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:26.819245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:26.820238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:26.820869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:26.821471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:26.828918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-52355e00-4ae8-427d-80aa-1ce969df2b77 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:26.838033 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-52355e00-4ae8-427d-80aa-1ce969df2b77 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1313 microversion: 2.1 time: 0.326806 Oct 27 19:06:26.839216 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2133/4452] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:26 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:26.879292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 19:06:26.942761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:26.950206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:26.950663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:26.951281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:27.025989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0b1c650a-b7b8-47ef-983b-23011fcb8f85 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:27.027763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0b1c650a-b7b8-47ef-983b-23011fcb8f85 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:27.035372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b1c650a-b7b8-47ef-983b-23011fcb8f85 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:27.036201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b1c650a-b7b8-47ef-983b-23011fcb8f85 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:27.036976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b1c650a-b7b8-47ef-983b-23011fcb8f85 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:27.037943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b1c650a-b7b8-47ef-983b-23011fcb8f85 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:27.038689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b1c650a-b7b8-47ef-983b-23011fcb8f85 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:27.039367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b1c650a-b7b8-47ef-983b-23011fcb8f85 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:27.178066 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a09ce782-3b08-4d16-a208-ae813692e458 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 1714 microversion: 2.1 time: 0.417886 Oct 27 19:06:27.179402 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2320/4453] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 19:06:26 2022] GET /compute/v2.1/servers/detail => generated 1714 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:27.208785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3dbec7e4-ca11-49fa-b8cf-2b63649acf4f tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:27.217699 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3dbec7e4-ca11-49fa-b8cf-2b63649acf4f tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014120 Oct 27 19:06:27.224673 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2321/4454] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 19:06:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:06:27.543569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-818e9f73-87de-4c86-9c38-673fd8c38c77 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:27.544357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-818e9f73-87de-4c86-9c38-673fd8c38c77 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:27.560302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0b1c650a-b7b8-47ef-983b-23011fcb8f85 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:27.569361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-818e9f73-87de-4c86-9c38-673fd8c38c77 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:27.569877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-818e9f73-87de-4c86-9c38-673fd8c38c77 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:27.570334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-818e9f73-87de-4c86-9c38-673fd8c38c77 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:27.571196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-818e9f73-87de-4c86-9c38-673fd8c38c77 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:27.575829 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0b1c650a-b7b8-47ef-983b-23011fcb8f85 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1317 microversion: 2.1 time: 0.548544 Oct 27 19:06:27.578614 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2134/4455] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:27 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:27.585087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-818e9f73-87de-4c86-9c38-673fd8c38c77 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:27.585796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-818e9f73-87de-4c86-9c38-673fd8c38c77 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:27.589257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-72e62dc3-64f8-4765-b6b1-00a5c8db6cdf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:27.590131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-72e62dc3-64f8-4765-b6b1-00a5c8db6cdf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:27.605517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72e62dc3-64f8-4765-b6b1-00a5c8db6cdf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:27.608580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72e62dc3-64f8-4765-b6b1-00a5c8db6cdf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:27.615297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72e62dc3-64f8-4765-b6b1-00a5c8db6cdf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:27.616465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72e62dc3-64f8-4765-b6b1-00a5c8db6cdf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:27.617208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72e62dc3-64f8-4765-b6b1-00a5c8db6cdf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:27.617878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72e62dc3-64f8-4765-b6b1-00a5c8db6cdf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:27.658652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-818e9f73-87de-4c86-9c38-673fd8c38c77 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:06:27.846160 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-818e9f73-87de-4c86-9c38-673fd8c38c77 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 204 len: 0 microversion: 2.1 time: 0.306404 Oct 27 19:06:27.847433 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2322/4456] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:06:27 2022] DELETE /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:06:27.861337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cf859fdb-dcd5-436d-b644-aad2724d95f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:27.862974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cf859fdb-dcd5-436d-b644-aad2724d95f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:27.874527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf859fdb-dcd5-436d-b644-aad2724d95f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:27.875238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf859fdb-dcd5-436d-b644-aad2724d95f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:27.875892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf859fdb-dcd5-436d-b644-aad2724d95f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:27.876932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf859fdb-dcd5-436d-b644-aad2724d95f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:27.879181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf859fdb-dcd5-436d-b644-aad2724d95f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:27.881069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf859fdb-dcd5-436d-b644-aad2724d95f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:28.108274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-72e62dc3-64f8-4765-b6b1-00a5c8db6cdf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:28.120276 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-72e62dc3-64f8-4765-b6b1-00a5c8db6cdf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1328 microversion: 2.1 time: 0.540276 Oct 27 19:06:28.121709 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2135/4457] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:27 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1328 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:28.129790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28393ae9-64c2-4e7c-8a7a-9fd92302e5a2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:28.130844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-28393ae9-64c2-4e7c-8a7a-9fd92302e5a2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:28.137321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28393ae9-64c2-4e7c-8a7a-9fd92302e5a2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:28.138045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28393ae9-64c2-4e7c-8a7a-9fd92302e5a2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:28.138745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28393ae9-64c2-4e7c-8a7a-9fd92302e5a2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:28.140004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28393ae9-64c2-4e7c-8a7a-9fd92302e5a2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:28.140658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28393ae9-64c2-4e7c-8a7a-9fd92302e5a2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:28.141275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28393ae9-64c2-4e7c-8a7a-9fd92302e5a2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:28.358694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-28393ae9-64c2-4e7c-8a7a-9fd92302e5a2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:28.373804 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-28393ae9-64c2-4e7c-8a7a-9fd92302e5a2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1717 microversion: 2.1 time: 0.250780 Oct 27 19:06:28.383343 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2136/4458] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:28 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1717 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:28.403559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-533db79a-b816-4e7b-9468-5fb3d7171e22 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:28.404206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-533db79a-b816-4e7b-9468-5fb3d7171e22 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:28.415288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-533db79a-b816-4e7b-9468-5fb3d7171e22 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:28.419127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-533db79a-b816-4e7b-9468-5fb3d7171e22 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:28.420054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-533db79a-b816-4e7b-9468-5fb3d7171e22 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:28.421766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-533db79a-b816-4e7b-9468-5fb3d7171e22 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:28.422657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-533db79a-b816-4e7b-9468-5fb3d7171e22 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:28.423103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-533db79a-b816-4e7b-9468-5fb3d7171e22 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:28.683294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-533db79a-b816-4e7b-9468-5fb3d7171e22 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:28.692030 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-533db79a-b816-4e7b-9468-5fb3d7171e22 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1497 microversion: 2.1 time: 0.307312 Oct 27 19:06:28.693311 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2137/4459] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:28 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1497 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:28.701973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-571dbf92-8c50-4daf-8381-ecaf28ef8c37 req-ee6eb140-6d35-471b-81f6-a0dc8929d6bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b128ff-a00c-4607-8088-1988263fbe79", "name": "network-vif-plugged", "status": "completed", "tag": "2beafeb2-d863-4916-9b9f-2b9876bdf5ff"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:28.725670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-571dbf92-8c50-4daf-8381-ecaf28ef8c37 req-ee6eb140-6d35-471b-81f6-a0dc8929d6bd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:28.728846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-571dbf92-8c50-4daf-8381-ecaf28ef8c37 req-ee6eb140-6d35-471b-81f6-a0dc8929d6bd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:28.730588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-571dbf92-8c50-4daf-8381-ecaf28ef8c37 req-ee6eb140-6d35-471b-81f6-a0dc8929d6bd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:28.756686 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-571dbf92-8c50-4daf-8381-ecaf28ef8c37 req-ee6eb140-6d35-471b-81f6-a0dc8929d6bd service nova] Creating event network-vif-plugged:2beafeb2-d863-4916-9b9f-2b9876bdf5ff for instance 96b128ff-a00c-4607-8088-1988263fbe79 on n-h2-860687-3 Oct 27 19:06:28.772072 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-571dbf92-8c50-4daf-8381-ecaf28ef8c37 req-ee6eb140-6d35-471b-81f6-a0dc8929d6bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076344 Oct 27 19:06:28.773279 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2138/4460] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:28.789093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f450aa0b-1414-4e01-8ee6-bd1144869c7d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:28.790059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f450aa0b-1414-4e01-8ee6-bd1144869c7d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:28.796911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f450aa0b-1414-4e01-8ee6-bd1144869c7d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:28.797589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f450aa0b-1414-4e01-8ee6-bd1144869c7d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:28.798220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f450aa0b-1414-4e01-8ee6-bd1144869c7d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:28.799235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f450aa0b-1414-4e01-8ee6-bd1144869c7d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:28.800450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f450aa0b-1414-4e01-8ee6-bd1144869c7d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:28.801094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f450aa0b-1414-4e01-8ee6-bd1144869c7d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:28.810598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cf859fdb-dcd5-436d-b644-aad2724d95f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:28.826537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cf859fdb-dcd5-436d-b644-aad2724d95f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:28.828349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cf859fdb-dcd5-436d-b644-aad2724d95f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:28.834010 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cf859fdb-dcd5-436d-b644-aad2724d95f5 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1746 microversion: 2.20 time: 0.985310 Oct 27 19:06:28.839094 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2323/4461] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:27 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1746 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:29.144568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fd04b285-62f2-4e8e-8f01-30b0d13d023a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:29.145223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fd04b285-62f2-4e8e-8f01-30b0d13d023a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:29.171405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd04b285-62f2-4e8e-8f01-30b0d13d023a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:29.180211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd04b285-62f2-4e8e-8f01-30b0d13d023a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:29.180737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd04b285-62f2-4e8e-8f01-30b0d13d023a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:29.181509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd04b285-62f2-4e8e-8f01-30b0d13d023a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:29.192715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd04b285-62f2-4e8e-8f01-30b0d13d023a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:29.193290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd04b285-62f2-4e8e-8f01-30b0d13d023a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:29.392570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f450aa0b-1414-4e01-8ee6-bd1144869c7d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:29.409529 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f450aa0b-1414-4e01-8ee6-bd1144869c7d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1317 microversion: 2.1 time: 0.633034 Oct 27 19:06:29.410084 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2139/4462] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:28 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1317 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:29.430013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-31d3c136-fa85-4de3-b4ff-fe2fb9e19701 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:29.430682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-31d3c136-fa85-4de3-b4ff-fe2fb9e19701 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:29.450233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d3c136-fa85-4de3-b4ff-fe2fb9e19701 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:29.450958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d3c136-fa85-4de3-b4ff-fe2fb9e19701 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:29.451598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d3c136-fa85-4de3-b4ff-fe2fb9e19701 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:29.452472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d3c136-fa85-4de3-b4ff-fe2fb9e19701 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:29.454674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d3c136-fa85-4de3-b4ff-fe2fb9e19701 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:29.455338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d3c136-fa85-4de3-b4ff-fe2fb9e19701 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:29.764129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-31d3c136-fa85-4de3-b4ff-fe2fb9e19701 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:29.775174 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-31d3c136-fa85-4de3-b4ff-fe2fb9e19701 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1717 microversion: 2.1 time: 0.359614 Oct 27 19:06:29.775775 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2140/4463] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:29 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1717 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:29.801292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0bc83a49-99a7-474e-84a3-60e07fae34a1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:29.802060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0bc83a49-99a7-474e-84a3-60e07fae34a1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:29.818934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bc83a49-99a7-474e-84a3-60e07fae34a1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:29.819523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bc83a49-99a7-474e-84a3-60e07fae34a1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:29.819881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bc83a49-99a7-474e-84a3-60e07fae34a1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:29.820613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bc83a49-99a7-474e-84a3-60e07fae34a1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:29.821081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bc83a49-99a7-474e-84a3-60e07fae34a1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:29.821521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bc83a49-99a7-474e-84a3-60e07fae34a1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:29.847032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fd04b285-62f2-4e8e-8f01-30b0d13d023a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:29.857393 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fd04b285-62f2-4e8e-8f01-30b0d13d023a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1328 microversion: 2.1 time: 0.717968 Oct 27 19:06:29.878419 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2324/4464] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:29 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1328 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:06:29.878829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0bc83a49-99a7-474e-84a3-60e07fae34a1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:06:29.886822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ff86aefd-67dd-45b3-8a83-729fc4fbccf9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:29.887934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ff86aefd-67dd-45b3-8a83-729fc4fbccf9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:29.903748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff86aefd-67dd-45b3-8a83-729fc4fbccf9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:29.904281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff86aefd-67dd-45b3-8a83-729fc4fbccf9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:29.904738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff86aefd-67dd-45b3-8a83-729fc4fbccf9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:29.905477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff86aefd-67dd-45b3-8a83-729fc4fbccf9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:29.905955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff86aefd-67dd-45b3-8a83-729fc4fbccf9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:29.906413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff86aefd-67dd-45b3-8a83-729fc4fbccf9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:29.986018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:30.055786 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0bc83a49-99a7-474e-84a3-60e07fae34a1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "DELETE /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 204 len: 0 microversion: 2.1 time: 0.266456 Oct 27 19:06:30.056632 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2141/4465] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:06:29 2022] DELETE /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:06:30.065861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4d53847e-b89b-4aee-97d6-49a7ebb6eecc tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:30.067230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4d53847e-b89b-4aee-97d6-49a7ebb6eecc tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:30.106858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d53847e-b89b-4aee-97d6-49a7ebb6eecc tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:30.110850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d53847e-b89b-4aee-97d6-49a7ebb6eecc tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:30.115093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d53847e-b89b-4aee-97d6-49a7ebb6eecc tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:30.118415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d53847e-b89b-4aee-97d6-49a7ebb6eecc tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:30.119098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d53847e-b89b-4aee-97d6-49a7ebb6eecc tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:30.120907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d53847e-b89b-4aee-97d6-49a7ebb6eecc tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:30.435793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ff86aefd-67dd-45b3-8a83-729fc4fbccf9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:30.447824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ff86aefd-67dd-45b3-8a83-729fc4fbccf9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:30.449628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ff86aefd-67dd-45b3-8a83-729fc4fbccf9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:30.451131 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ff86aefd-67dd-45b3-8a83-729fc4fbccf9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1746 microversion: 2.20 time: 0.580169 Oct 27 19:06:30.451703 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2325/4466] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:29 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1746 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:30.632693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-193326524", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "f1e2833d-6015-42c6-bdb3-c4c5da6b8611"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:30.638251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4d53847e-b89b-4aee-97d6-49a7ebb6eecc tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:30.651311 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4d53847e-b89b-4aee-97d6-49a7ebb6eecc tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1503 microversion: 2.1 time: 0.590067 Oct 27 19:06:30.652211 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2142/4467] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:30 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1503 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:30.656858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6420a906-108b-4ba6-8317-09a888e7e360 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:30.657478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6420a906-108b-4ba6-8317-09a888e7e360 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:30.665299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6420a906-108b-4ba6-8317-09a888e7e360 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:30.665811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6420a906-108b-4ba6-8317-09a888e7e360 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:30.666307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6420a906-108b-4ba6-8317-09a888e7e360 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:30.667481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6420a906-108b-4ba6-8317-09a888e7e360 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:30.668528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6420a906-108b-4ba6-8317-09a888e7e360 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:30.668528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6420a906-108b-4ba6-8317-09a888e7e360 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:30.718784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] validate_networks() for [('f1e2833d-6015-42c6-bdb3-c4c5da6b8611', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:06:30.973215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6420a906-108b-4ba6-8317-09a888e7e360 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:30.981701 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6420a906-108b-4ba6-8317-09a888e7e360 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1317 microversion: 2.1 time: 0.328276 Oct 27 19:06:30.985083 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2143/4468] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:30 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:30.991146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ff1aaeb9-f9c6-4e65-b63c-26ba3982fbb8 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:30.996530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ff1aaeb9-f9c6-4e65-b63c-26ba3982fbb8 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:31.009726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff1aaeb9-f9c6-4e65-b63c-26ba3982fbb8 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:31.010237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff1aaeb9-f9c6-4e65-b63c-26ba3982fbb8 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:31.016903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff1aaeb9-f9c6-4e65-b63c-26ba3982fbb8 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:31.017836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff1aaeb9-f9c6-4e65-b63c-26ba3982fbb8 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:31.027081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff1aaeb9-f9c6-4e65-b63c-26ba3982fbb8 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:31.027721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff1aaeb9-f9c6-4e65-b63c-26ba3982fbb8 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:31.054979 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-ff1aaeb9-f9c6-4e65-b63c-26ba3982fbb8 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] HTTP exception thrown: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ff1aaeb9-f9c6-4e65-b63c-26ba3982fbb8 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Request method failure captured: Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e HTTP/1.1 Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtT5H8XP7V9L0TVuuJvAuBoxNkhZhgX8XkK4-GpzHComWgmbBONfMudM4Q8yHeohsrOhf9YccVlwgfDyUGCChaGZWmGukZPYKh-mvkrZX3vZytXvdyVczNY7QyQ7kdcUBjknkaFKQkxOgdDbrstleWDjGVR0bmb658DtZfuMHYOhmds Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52ccbe7e63ab48199790f4676bbf2580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2be49f7bea7a4c8fbf289594e635fd69 Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '83449394-d485-488c-853e-d928636b406e'} Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:06:31.057737 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:06:31.062747 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:06:31.062747 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:31.062747 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:31.062747 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:31.062747 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:31.062747 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:31.062747 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:31.062747 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:06:31.062747 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:06:31.062747 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:06:31.062747 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:31.064371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ff1aaeb9-f9c6-4e65-b63c-26ba3982fbb8 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Returning 404 to user: Instance 83449394-d485-488c-853e-d928636b406e could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:06:31.065478 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ff1aaeb9-f9c6-4e65-b63c-26ba3982fbb8 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 404 len: 111 microversion: 2.1 time: 0.079472 Oct 27 19:06:31.069704 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2144/4469] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:06:30 2022] DELETE /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:06:31.074653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6a7a7059-aba6-400d-95c5-9739b2e3947f tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:31.075510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6a7a7059-aba6-400d-95c5-9739b2e3947f tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:31.082739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a7a7059-aba6-400d-95c5-9739b2e3947f tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:31.083450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a7a7059-aba6-400d-95c5-9739b2e3947f tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:31.084065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a7a7059-aba6-400d-95c5-9739b2e3947f tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:31.084951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a7a7059-aba6-400d-95c5-9739b2e3947f tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:31.085674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a7a7059-aba6-400d-95c5-9739b2e3947f tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:31.086278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a7a7059-aba6-400d-95c5-9739b2e3947f tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:31.336159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:06:31.336760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:06:31.337325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:06:31.338026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:06:31.339188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:06:31.354746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:31.355594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:31.357550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:31.361788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:31.364750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:31.365230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:31.409514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Getting quotas for project 5c21c511d9424e63b900c5cecc28f2c9. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:06:31.421707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Getting quotas for user 29d7b88b73614736826d197244990123 and project 5c21c511d9424e63b900c5cecc28f2c9. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:06:31.452428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:06:31.454908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:06:31.600333 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-287802fa-0f48-4176-a122-744ce1963242 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.143728 Oct 27 19:06:31.603048 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2326/4470] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:06:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:06:31.625664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-df9dd594-3229-41ab-9e86-7ee3f4b065a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:31.626645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-df9dd594-3229-41ab-9e86-7ee3f4b065a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:31.647465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df9dd594-3229-41ab-9e86-7ee3f4b065a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:31.647984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df9dd594-3229-41ab-9e86-7ee3f4b065a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:31.649267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df9dd594-3229-41ab-9e86-7ee3f4b065a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:31.650022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df9dd594-3229-41ab-9e86-7ee3f4b065a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:31.652725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df9dd594-3229-41ab-9e86-7ee3f4b065a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:31.653192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df9dd594-3229-41ab-9e86-7ee3f4b065a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:31.895162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-df9dd594-3229-41ab-9e86-7ee3f4b065a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:31.907332 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-df9dd594-3229-41ab-9e86-7ee3f4b065a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1328 microversion: 2.1 time: 0.300533 Oct 27 19:06:31.910654 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2327/4471] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:31 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1328 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:31.919866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f802086-2202-488a-88d9-38e257635457 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:31.923978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6f802086-2202-488a-88d9-38e257635457 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 83449394-d485-488c-853e-d928636b406e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:31.937977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f802086-2202-488a-88d9-38e257635457 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:31.939565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f802086-2202-488a-88d9-38e257635457 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:31.945213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f802086-2202-488a-88d9-38e257635457 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:31.946564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f802086-2202-488a-88d9-38e257635457 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:31.947285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f802086-2202-488a-88d9-38e257635457 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:31.947938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f802086-2202-488a-88d9-38e257635457 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:31.988969 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-6f802086-2202-488a-88d9-38e257635457 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] HTTP exception thrown: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f802086-2202-488a-88d9-38e257635457 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Request method failure captured: Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e HTTP/1.1 Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtT5H8XP7V9L0TVuuJvAuBoxNkhZhgX8XkK4-GpzHComWgmbBONfMudM4Q8yHeohsrOhf9YccVlwgfDyUGCChaGZWmGukZPYKh-mvkrZX3vZytXvdyVczNY7QyQ7kdcUBjknkaFKQkxOgdDbrstleWDjGVR0bmb658DtZfuMHYOhmds Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52ccbe7e63ab48199790f4676bbf2580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2be49f7bea7a4c8fbf289594e635fd69 Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '83449394-d485-488c-853e-d928636b406e'} Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:31.991255 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:31.995060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:31.995060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:31.995060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:31.995060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:06:31.995060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:06:31.995060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83449394-d485-488c-853e-d928636b406e could not be found. Oct 27 19:06:31.995060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:32.006830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f802086-2202-488a-88d9-38e257635457 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Returning 404 to user: Instance 83449394-d485-488c-853e-d928636b406e could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:06:32.008005 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6f802086-2202-488a-88d9-38e257635457 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e" status: 404 len: 111 microversion: 2.1 time: 0.096049 Oct 27 19:06:32.009203 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2328/4472] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:31 2022] GET /compute/v2.1/servers/83449394-d485-488c-853e-d928636b406e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:06:32.016225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e665d679-61a8-4446-81c0-70d145d90133 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:32.018118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e665d679-61a8-4446-81c0-70d145d90133 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:32.026034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e665d679-61a8-4446-81c0-70d145d90133 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:32.026777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e665d679-61a8-4446-81c0-70d145d90133 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:32.027391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e665d679-61a8-4446-81c0-70d145d90133 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:32.028252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e665d679-61a8-4446-81c0-70d145d90133 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:32.028376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6a7a7059-aba6-400d-95c5-9739b2e3947f tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:32.029689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e665d679-61a8-4446-81c0-70d145d90133 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:32.030281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e665d679-61a8-4446-81c0-70d145d90133 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:32.066002 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6a7a7059-aba6-400d-95c5-9739b2e3947f tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1649 microversion: 2.1 time: 0.984832 Oct 27 19:06:32.067903 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2145/4473] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:31 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1649 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:32.079133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a051cf8b-18a5-41c7-945d-d29ecb22c3ce tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:32.081387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a051cf8b-18a5-41c7-945d-d29ecb22c3ce tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:32.242826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a051cf8b-18a5-41c7-945d-d29ecb22c3ce tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:32.254039 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a051cf8b-18a5-41c7-945d-d29ecb22c3ce tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1216 microversion: 2.1 time: 0.184901 Oct 27 19:06:32.257009 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2146/4474] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:32 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1216 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:32.285728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b08fdfd4-6f31-4f6d-87b0-34e41e3beca1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:32.291390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b08fdfd4-6f31-4f6d-87b0-34e41e3beca1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:32.308843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b08fdfd4-6f31-4f6d-87b0-34e41e3beca1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:32.309627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b08fdfd4-6f31-4f6d-87b0-34e41e3beca1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:32.310307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b08fdfd4-6f31-4f6d-87b0-34e41e3beca1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:32.311163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b08fdfd4-6f31-4f6d-87b0-34e41e3beca1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:32.311740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b08fdfd4-6f31-4f6d-87b0-34e41e3beca1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:32.312290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b08fdfd4-6f31-4f6d-87b0-34e41e3beca1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:32.496808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e665d679-61a8-4446-81c0-70d145d90133 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:32.496808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e665d679-61a8-4446-81c0-70d145d90133 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:32.496808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e665d679-61a8-4446-81c0-70d145d90133 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:32.496808 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e665d679-61a8-4446-81c0-70d145d90133 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1746 microversion: 2.20 time: 0.483752 Oct 27 19:06:32.496808 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2329/4475] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:32 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1746 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:32.500335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0e307bfc-61f8-44aa-8e54-5da3f5249c96 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:32.504137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0e307bfc-61f8-44aa-8e54-5da3f5249c96 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:32.515732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e307bfc-61f8-44aa-8e54-5da3f5249c96 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:32.519002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e307bfc-61f8-44aa-8e54-5da3f5249c96 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:32.519739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e307bfc-61f8-44aa-8e54-5da3f5249c96 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:32.520680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e307bfc-61f8-44aa-8e54-5da3f5249c96 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:32.521341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e307bfc-61f8-44aa-8e54-5da3f5249c96 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:32.521886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e307bfc-61f8-44aa-8e54-5da3f5249c96 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:32.902967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b08fdfd4-6f31-4f6d-87b0-34e41e3beca1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:32.912882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:32.915513 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b08fdfd4-6f31-4f6d-87b0-34e41e3beca1 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1503 microversion: 2.1 time: 0.639910 Oct 27 19:06:32.916462 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2147/4476] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:32 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1503 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:32.939281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-05c4ce5f-a019-48e7-91cb-074d2eca31c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:32.941767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-05c4ce5f-a019-48e7-91cb-074d2eca31c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:32.949459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:32.960759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05c4ce5f-a019-48e7-91cb-074d2eca31c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:32.966281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05c4ce5f-a019-48e7-91cb-074d2eca31c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:32.967200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05c4ce5f-a019-48e7-91cb-074d2eca31c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:32.968249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05c4ce5f-a019-48e7-91cb-074d2eca31c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:32.968792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05c4ce5f-a019-48e7-91cb-074d2eca31c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:32.969302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05c4ce5f-a019-48e7-91cb-074d2eca31c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.000217 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-05c4ce5f-a019-48e7-91cb-074d2eca31c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] HTTP exception thrown: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-05c4ce5f-a019-48e7-91cb-074d2eca31c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Request method failure captured: Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 HTTP/1.1 Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtT5H8XP7V9L0TVuuJvAuBoxNkhZhgX8XkK4-GpzHComWgmbBONfMudM4Q8yHeohsrOhf9YccVlwgfDyUGCChaGZWmGukZPYKh-mvkrZX3vZytXvdyVczNY7QyQ7kdcUBjknkaFKQkxOgdDbrstleWDjGVR0bmb658DtZfuMHYOhmds Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52ccbe7e63ab48199790f4676bbf2580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2be49f7bea7a4c8fbf289594e635fd69 Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '0b227794-9896-4ec9-b8a1-3b1f3cce38c3'} Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:06:33.009449 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:06:33.014358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:06:33.014358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:33.014358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:33.014358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:33.014358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:33.014358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:33.014358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:33.014358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:06:33.014358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:06:33.014358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:06:33.014358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:33.017331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-05c4ce5f-a019-48e7-91cb-074d2eca31c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Returning 404 to user: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:06:33.024035 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-05c4ce5f-a019-48e7-91cb-074d2eca31c1 tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 404 len: 111 microversion: 2.1 time: 0.094029 Oct 27 19:06:33.026083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0e307bfc-61f8-44aa-8e54-5da3f5249c96 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:33.027688 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2148/4477] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:06:32 2022] DELETE /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:06:33.032525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-4777797b-592b-41e4-a6e7-5a2b7ab119a2 req-8018f96e-c5a2-46fe-8f92-0e1ba4dfe696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdf069b-5366-4fb9-8997-0ec6a55a2746", "name": "network-vif-plugged", "status": "completed", "tag": "136540f7-7531-431d-8e2c-68e2f6c910f8"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:33.046750 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0e307bfc-61f8-44aa-8e54-5da3f5249c96 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1317 microversion: 2.1 time: 0.550714 Oct 27 19:06:33.057751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4777797b-592b-41e4-a6e7-5a2b7ab119a2 req-8018f96e-c5a2-46fe-8f92-0e1ba4dfe696 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.060285 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2330/4478] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:32 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:33.061242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4777797b-592b-41e4-a6e7-5a2b7ab119a2 req-8018f96e-c5a2-46fe-8f92-0e1ba4dfe696 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.061949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4777797b-592b-41e4-a6e7-5a2b7ab119a2 req-8018f96e-c5a2-46fe-8f92-0e1ba4dfe696 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.076080 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-4777797b-592b-41e4-a6e7-5a2b7ab119a2 req-8018f96e-c5a2-46fe-8f92-0e1ba4dfe696 service nova] Creating event network-vif-plugged:136540f7-7531-431d-8e2c-68e2f6c910f8 for instance efdf069b-5366-4fb9-8997-0ec6a55a2746 on n-h2-860687-3 Oct 27 19:06:33.084106 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-4777797b-592b-41e4-a6e7-5a2b7ab119a2 req-8018f96e-c5a2-46fe-8f92-0e1ba4dfe696 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054936 Oct 27 19:06:33.085376 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2149/4479] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:33.093111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-259793f8-0e4b-4f9d-a6d8-5c42a44d4baf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:33.093754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-259793f8-0e4b-4f9d-a6d8-5c42a44d4baf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:33.094588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf26204f-a7ec-4be6-b56c-309e950ba73c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:33.096229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cf26204f-a7ec-4be6-b56c-309e950ba73c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 0b227794-9896-4ec9-b8a1-3b1f3cce38c3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:33.104710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf26204f-a7ec-4be6-b56c-309e950ba73c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.105755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf26204f-a7ec-4be6-b56c-309e950ba73c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.106497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf26204f-a7ec-4be6-b56c-309e950ba73c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.107504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf26204f-a7ec-4be6-b56c-309e950ba73c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.107953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-259793f8-0e4b-4f9d-a6d8-5c42a44d4baf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.108455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-259793f8-0e4b-4f9d-a6d8-5c42a44d4baf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.108680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf26204f-a7ec-4be6-b56c-309e950ba73c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.108898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-259793f8-0e4b-4f9d-a6d8-5c42a44d4baf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.109480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf26204f-a7ec-4be6-b56c-309e950ba73c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.114816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-259793f8-0e4b-4f9d-a6d8-5c42a44d4baf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.115495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-259793f8-0e4b-4f9d-a6d8-5c42a44d4baf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.116788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-259793f8-0e4b-4f9d-a6d8-5c42a44d4baf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.145040 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-cf26204f-a7ec-4be6-b56c-309e950ba73c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] HTTP exception thrown: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf26204f-a7ec-4be6-b56c-309e950ba73c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Request method failure captured: Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 HTTP/1.1 Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtT5H8XP7V9L0TVuuJvAuBoxNkhZhgX8XkK4-GpzHComWgmbBONfMudM4Q8yHeohsrOhf9YccVlwgfDyUGCChaGZWmGukZPYKh-mvkrZX3vZytXvdyVczNY7QyQ7kdcUBjknkaFKQkxOgdDbrstleWDjGVR0bmb658DtZfuMHYOhmds Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52ccbe7e63ab48199790f4676bbf2580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 2be49f7bea7a4c8fbf289594e635fd69 Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '0b227794-9896-4ec9-b8a1-3b1f3cce38c3'} Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:33.147937 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:33.152558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:33.152558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:33.152558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:33.152558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:06:33.152558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:06:33.152558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. Oct 27 19:06:33.152558 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:33.154966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf26204f-a7ec-4be6-b56c-309e950ba73c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Returning 404 to user: Instance 0b227794-9896-4ec9-b8a1-3b1f3cce38c3 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:06:33.154966 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cf26204f-a7ec-4be6-b56c-309e950ba73c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3" status: 404 len: 111 microversion: 2.1 time: 0.067605 Oct 27 19:06:33.158641 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2150/4480] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:33 2022] GET /compute/v2.1/servers/0b227794-9896-4ec9-b8a1-3b1f3cce38c3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:06:33.170981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-90964046-8090-4feb-a5a0-dda21675b8ca req-2ade398f-45bc-49bd-aa5b-0e282c713230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3567a7a-6f12-4d01-a9b1-adcb0310bd10", "name": "network-vif-deleted", "tag": "37e8973e-da31-49a3-8c92-aa75229fb28f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:33.195004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-90964046-8090-4feb-a5a0-dda21675b8ca req-2ade398f-45bc-49bd-aa5b-0e282c713230 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.195908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-90964046-8090-4feb-a5a0-dda21675b8ca req-2ade398f-45bc-49bd-aa5b-0e282c713230 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.196619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-90964046-8090-4feb-a5a0-dda21675b8ca req-2ade398f-45bc-49bd-aa5b-0e282c713230 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.216140 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-90964046-8090-4feb-a5a0-dda21675b8ca req-2ade398f-45bc-49bd-aa5b-0e282c713230 service nova] Creating event network-vif-deleted:37e8973e-da31-49a3-8c92-aa75229fb28f for instance b3567a7a-6f12-4d01-a9b1-adcb0310bd10 on n-h2-860687-3 Oct 27 19:06:33.232151 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-90964046-8090-4feb-a5a0-dda21675b8ca req-2ade398f-45bc-49bd-aa5b-0e282c713230 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071447 Oct 27 19:06:33.233174 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2151/4481] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:33.249791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ceffd32-aad7-45e6-ae2a-b843784223b2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:33.252796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3ceffd32-aad7-45e6-ae2a-b843784223b2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:33.301260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ceffd32-aad7-45e6-ae2a-b843784223b2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.304591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ceffd32-aad7-45e6-ae2a-b843784223b2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.305338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ceffd32-aad7-45e6-ae2a-b843784223b2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.306668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ceffd32-aad7-45e6-ae2a-b843784223b2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.307665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ceffd32-aad7-45e6-ae2a-b843784223b2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.309366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ceffd32-aad7-45e6-ae2a-b843784223b2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.409897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ceffd32-aad7-45e6-ae2a-b843784223b2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:33.420693 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3ceffd32-aad7-45e6-ae2a-b843784223b2 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1649 microversion: 2.1 time: 0.179152 Oct 27 19:06:33.421455 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2152/4482] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:33 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1649 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:33.428961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ff7a18a2-dcca-4cbe-9d5f-87f9b6d232f8 req-07b3d95b-492f-4b06-ae1c-b5d6fd3748a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb7a67e-0b58-4410-aab2-40f18a73eec0", "name": "network-vif-deleted", "tag": "a8254093-57e1-42ac-8e04-a284dcc2675e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:33.452466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ff7a18a2-dcca-4cbe-9d5f-87f9b6d232f8 req-07b3d95b-492f-4b06-ae1c-b5d6fd3748a6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.453278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ff7a18a2-dcca-4cbe-9d5f-87f9b6d232f8 req-07b3d95b-492f-4b06-ae1c-b5d6fd3748a6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.453964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ff7a18a2-dcca-4cbe-9d5f-87f9b6d232f8 req-07b3d95b-492f-4b06-ae1c-b5d6fd3748a6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.475735 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ff7a18a2-dcca-4cbe-9d5f-87f9b6d232f8 req-07b3d95b-492f-4b06-ae1c-b5d6fd3748a6 service nova] Creating event network-vif-deleted:a8254093-57e1-42ac-8e04-a284dcc2675e for instance aeb7a67e-0b58-4410-aab2-40f18a73eec0 on n-h1-860687-3 Oct 27 19:06:33.481464 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ff7a18a2-dcca-4cbe-9d5f-87f9b6d232f8 req-07b3d95b-492f-4b06-ae1c-b5d6fd3748a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058378 Oct 27 19:06:33.482838 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2153/4483] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:33.490817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f17d3c1b-9d91-4e78-8898-baad3733aa69 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:33.499677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f17d3c1b-9d91-4e78-8898-baad3733aa69 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:33.512771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f17d3c1b-9d91-4e78-8898-baad3733aa69 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.513654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f17d3c1b-9d91-4e78-8898-baad3733aa69 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.514470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f17d3c1b-9d91-4e78-8898-baad3733aa69 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.515667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f17d3c1b-9d91-4e78-8898-baad3733aa69 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.516368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f17d3c1b-9d91-4e78-8898-baad3733aa69 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.517061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f17d3c1b-9d91-4e78-8898-baad3733aa69 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.564643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-259793f8-0e4b-4f9d-a6d8-5c42a44d4baf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:33.579886 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-259793f8-0e4b-4f9d-a6d8-5c42a44d4baf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1328 microversion: 2.1 time: 0.503143 Oct 27 19:06:33.582782 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2331/4484] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:33 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1328 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:33.618033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d0754c7-271d-4c3c-bf36-b052958ff3a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:33.626196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0d0754c7-271d-4c3c-bf36-b052958ff3a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:33.661130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d0754c7-271d-4c3c-bf36-b052958ff3a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.661909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d0754c7-271d-4c3c-bf36-b052958ff3a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.663457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d0754c7-271d-4c3c-bf36-b052958ff3a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.668976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d0754c7-271d-4c3c-bf36-b052958ff3a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.671036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d0754c7-271d-4c3c-bf36-b052958ff3a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.671675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d0754c7-271d-4c3c-bf36-b052958ff3a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.694829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f17d3c1b-9d91-4e78-8898-baad3733aa69 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:33.706661 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f17d3c1b-9d91-4e78-8898-baad3733aa69 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1268 microversion: 2.1 time: 0.220811 Oct 27 19:06:33.707603 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2154/4485] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:33 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1268 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:33.942567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b161cb49-8bdb-4af3-85fa-327d2f4c0024 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:33.943393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b161cb49-8bdb-4af3-85fa-327d2f4c0024 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:33.954324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b161cb49-8bdb-4af3-85fa-327d2f4c0024 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.959664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b161cb49-8bdb-4af3-85fa-327d2f4c0024 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.963378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b161cb49-8bdb-4af3-85fa-327d2f4c0024 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:33.967969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b161cb49-8bdb-4af3-85fa-327d2f4c0024 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:33.968617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b161cb49-8bdb-4af3-85fa-327d2f4c0024 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:33.969218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b161cb49-8bdb-4af3-85fa-327d2f4c0024 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:34.125735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b161cb49-8bdb-4af3-85fa-327d2f4c0024 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:34.126333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b161cb49-8bdb-4af3-85fa-327d2f4c0024 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:34.134266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b161cb49-8bdb-4af3-85fa-327d2f4c0024 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:34.135328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-b161cb49-8bdb-4af3-85fa-327d2f4c0024 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lazy-loading 'fault' on Instance uuid aeb7a67e-0b58-4410-aab2-40f18a73eec0 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:06:34.215654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b161cb49-8bdb-4af3-85fa-327d2f4c0024 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:34.225024 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b161cb49-8bdb-4af3-85fa-327d2f4c0024 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1303 microversion: 2.1 time: 0.287742 Oct 27 19:06:34.227749 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2155/4486] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:33 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1303 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:06:34.232753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2f10f9fb-419e-4d70-8db7-c5a00d4111bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:34.241693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2f10f9fb-419e-4d70-8db7-c5a00d4111bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:34.252968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f10f9fb-419e-4d70-8db7-c5a00d4111bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:34.253978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f10f9fb-419e-4d70-8db7-c5a00d4111bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:34.254916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f10f9fb-419e-4d70-8db7-c5a00d4111bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:34.256094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f10f9fb-419e-4d70-8db7-c5a00d4111bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:34.257174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f10f9fb-419e-4d70-8db7-c5a00d4111bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:34.257922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f10f9fb-419e-4d70-8db7-c5a00d4111bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:34.296239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0d0754c7-271d-4c3c-bf36-b052958ff3a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:34.312153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0d0754c7-271d-4c3c-bf36-b052958ff3a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:34.314615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0d0754c7-271d-4c3c-bf36-b052958ff3a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:34.333593 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0d0754c7-271d-4c3c-bf36-b052958ff3a3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1741 microversion: 2.20 time: 0.748708 Oct 27 19:06:34.338352 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2332/4487] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:33 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1741 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:34.460200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9acfa13c-a4b4-45c4-a8c7-7244defdf265 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:34.461050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9acfa13c-a4b4-45c4-a8c7-7244defdf265 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:34.468356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acfa13c-a4b4-45c4-a8c7-7244defdf265 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:34.469071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acfa13c-a4b4-45c4-a8c7-7244defdf265 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:34.469704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acfa13c-a4b4-45c4-a8c7-7244defdf265 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:34.470772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acfa13c-a4b4-45c4-a8c7-7244defdf265 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:34.472454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acfa13c-a4b4-45c4-a8c7-7244defdf265 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:34.473077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acfa13c-a4b4-45c4-a8c7-7244defdf265 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:34.534720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2f10f9fb-419e-4d70-8db7-c5a00d4111bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:34.550887 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2f10f9fb-419e-4d70-8db7-c5a00d4111bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1317 microversion: 2.1 time: 0.321748 Oct 27 19:06:34.551747 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2156/4488] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:34 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:34.562681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acfa13c-a4b4-45c4-a8c7-7244defdf265 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:34.563297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acfa13c-a4b4-45c4-a8c7-7244defdf265 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:34.564877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acfa13c-a4b4-45c4-a8c7-7244defdf265 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:34.570089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-9acfa13c-a4b4-45c4-a8c7-7244defdf265 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lazy-loading 'fault' on Instance uuid b3567a7a-6f12-4d01-a9b1-adcb0310bd10 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:06:34.610422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ca0a14c6-e2ea-4a96-b030-ca3567e0098a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:34.611337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ca0a14c6-e2ea-4a96-b030-ca3567e0098a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:34.631970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca0a14c6-e2ea-4a96-b030-ca3567e0098a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:34.638756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca0a14c6-e2ea-4a96-b030-ca3567e0098a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:34.640582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca0a14c6-e2ea-4a96-b030-ca3567e0098a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:34.643573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca0a14c6-e2ea-4a96-b030-ca3567e0098a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:34.644397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca0a14c6-e2ea-4a96-b030-ca3567e0098a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:34.646090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca0a14c6-e2ea-4a96-b030-ca3567e0098a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:34.732945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9acfa13c-a4b4-45c4-a8c7-7244defdf265 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:34.769508 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9acfa13c-a4b4-45c4-a8c7-7244defdf265 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1368 microversion: 2.1 time: 0.317528 Oct 27 19:06:34.777776 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2333/4489] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:34 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1368 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:34.788295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4819c857-3b15-400b-9cb3-f5a9a181efe5 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:34.796299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4819c857-3b15-400b-9cb3-f5a9a181efe5 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:34.875490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4819c857-3b15-400b-9cb3-f5a9a181efe5 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:34.876009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4819c857-3b15-400b-9cb3-f5a9a181efe5 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:34.879561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4819c857-3b15-400b-9cb3-f5a9a181efe5 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:34.886903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4819c857-3b15-400b-9cb3-f5a9a181efe5 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:34.888837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4819c857-3b15-400b-9cb3-f5a9a181efe5 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:34.891622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4819c857-3b15-400b-9cb3-f5a9a181efe5 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:35.149828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4819c857-3b15-400b-9cb3-f5a9a181efe5 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:35.171895 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4819c857-3b15-400b-9cb3-f5a9a181efe5 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1276 microversion: 2.1 time: 0.390447 Oct 27 19:06:35.173823 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2334/4490] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:34 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1276 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:35.256735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-86c0a8b9-6b27-477a-9799-1915681c38d6 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:35.257519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-86c0a8b9-6b27-477a-9799-1915681c38d6 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:35.279336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86c0a8b9-6b27-477a-9799-1915681c38d6 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:35.288647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ca0a14c6-e2ea-4a96-b030-ca3567e0098a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:35.307921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86c0a8b9-6b27-477a-9799-1915681c38d6 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:35.308843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86c0a8b9-6b27-477a-9799-1915681c38d6 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:35.311281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86c0a8b9-6b27-477a-9799-1915681c38d6 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:35.311768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86c0a8b9-6b27-477a-9799-1915681c38d6 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:35.316203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86c0a8b9-6b27-477a-9799-1915681c38d6 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:35.316771 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ca0a14c6-e2ea-4a96-b030-ca3567e0098a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1328 microversion: 2.1 time: 0.710547 Oct 27 19:06:35.342110 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2157/4491] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:34 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1328 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:35.365903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d6c4c45-ccb0-4c9b-a245-2bafca16ae6b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:35.366826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0d6c4c45-ccb0-4c9b-a245-2bafca16ae6b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:35.385953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d6c4c45-ccb0-4c9b-a245-2bafca16ae6b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:35.386673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d6c4c45-ccb0-4c9b-a245-2bafca16ae6b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:35.387130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d6c4c45-ccb0-4c9b-a245-2bafca16ae6b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:35.392760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d6c4c45-ccb0-4c9b-a245-2bafca16ae6b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:35.403540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d6c4c45-ccb0-4c9b-a245-2bafca16ae6b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:35.404156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d6c4c45-ccb0-4c9b-a245-2bafca16ae6b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:35.549844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86c0a8b9-6b27-477a-9799-1915681c38d6 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:35.552679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86c0a8b9-6b27-477a-9799-1915681c38d6 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:35.554399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86c0a8b9-6b27-477a-9799-1915681c38d6 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:35.558141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-86c0a8b9-6b27-477a-9799-1915681c38d6 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lazy-loading 'fault' on Instance uuid aeb7a67e-0b58-4410-aab2-40f18a73eec0 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:06:35.751583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-86c0a8b9-6b27-477a-9799-1915681c38d6 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca60b2c6a474a02a55e9e53e3954f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea0b947e6f34941b45e54389d98e4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:35.761334 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-86c0a8b9-6b27-477a-9799-1915681c38d6 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 200 len: 1303 microversion: 2.1 time: 0.510160 Oct 27 19:06:35.767539 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2335/4492] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:35 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 1303 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:35.781558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-44845953-214f-4162-a28b-abd67371d48b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:35.795629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-44845953-214f-4162-a28b-abd67371d48b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:35.818356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44845953-214f-4162-a28b-abd67371d48b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:35.818898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44845953-214f-4162-a28b-abd67371d48b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:35.819356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44845953-214f-4162-a28b-abd67371d48b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:35.830845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44845953-214f-4162-a28b-abd67371d48b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:35.831392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44845953-214f-4162-a28b-abd67371d48b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:35.835284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44845953-214f-4162-a28b-abd67371d48b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:35.968527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0d6c4c45-ccb0-4c9b-a245-2bafca16ae6b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:35.983760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0d6c4c45-ccb0-4c9b-a245-2bafca16ae6b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:35.990159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0d6c4c45-ccb0-4c9b-a245-2bafca16ae6b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:35.994714 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d6c4c45-ccb0-4c9b-a245-2bafca16ae6b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1741 microversion: 2.20 time: 0.633921 Oct 27 19:06:35.999345 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2158/4493] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:35 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1741 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:36.014696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5bf71c81-18a0-4627-af8d-fa8d372d543e tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:36.015812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5bf71c81-18a0-4627-af8d-fa8d372d543e tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:36.030549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bf71c81-18a0-4627-af8d-fa8d372d543e tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:36.031356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bf71c81-18a0-4627-af8d-fa8d372d543e tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:36.034925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bf71c81-18a0-4627-af8d-fa8d372d543e tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:36.037296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bf71c81-18a0-4627-af8d-fa8d372d543e tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:36.037955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bf71c81-18a0-4627-af8d-fa8d372d543e tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:36.040257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bf71c81-18a0-4627-af8d-fa8d372d543e tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:36.210804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bf71c81-18a0-4627-af8d-fa8d372d543e tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:36.211378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bf71c81-18a0-4627-af8d-fa8d372d543e tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:36.211776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bf71c81-18a0-4627-af8d-fa8d372d543e tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:36.212247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-5bf71c81-18a0-4627-af8d-fa8d372d543e tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lazy-loading 'fault' on Instance uuid b3567a7a-6f12-4d01-a9b1-adcb0310bd10 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:06:36.365146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5bf71c81-18a0-4627-af8d-fa8d372d543e tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2b7686c7474be3b0b0317e997516f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28491a788f494c9f81f9fd8a5cf10702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:36.375253 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5bf71c81-18a0-4627-af8d-fa8d372d543e tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 200 len: 1368 microversion: 2.1 time: 0.374328 Oct 27 19:06:36.379283 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2159/4494] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:35 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 1368 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:36.405642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa13bff3-b4f1-43e5-80ca-dc0a42728b0f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:36.409994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa13bff3-b4f1-43e5-80ca-dc0a42728b0f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:36.420146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa13bff3-b4f1-43e5-80ca-dc0a42728b0f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:36.420968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa13bff3-b4f1-43e5-80ca-dc0a42728b0f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:36.422016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa13bff3-b4f1-43e5-80ca-dc0a42728b0f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:36.422946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa13bff3-b4f1-43e5-80ca-dc0a42728b0f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:36.423566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa13bff3-b4f1-43e5-80ca-dc0a42728b0f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:36.425100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa13bff3-b4f1-43e5-80ca-dc0a42728b0f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:36.437085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-44845953-214f-4162-a28b-abd67371d48b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:36.454012 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-44845953-214f-4162-a28b-abd67371d48b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1467 microversion: 2.1 time: 0.684504 Oct 27 19:06:36.454678 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2336/4495] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:35 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1467 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:36.465915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c375d245-15f3-4f72-9fe6-f4411256c8dd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:36.466499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c375d245-15f3-4f72-9fe6-f4411256c8dd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:36.534611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c375d245-15f3-4f72-9fe6-f4411256c8dd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:36.537648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c375d245-15f3-4f72-9fe6-f4411256c8dd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:36.538421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c375d245-15f3-4f72-9fe6-f4411256c8dd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:36.540376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c375d245-15f3-4f72-9fe6-f4411256c8dd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:36.541374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c375d245-15f3-4f72-9fe6-f4411256c8dd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:36.541819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c375d245-15f3-4f72-9fe6-f4411256c8dd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:36.560503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fa13bff3-b4f1-43e5-80ca-dc0a42728b0f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:36.574529 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fa13bff3-b4f1-43e5-80ca-dc0a42728b0f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1274 microversion: 2.1 time: 0.179624 Oct 27 19:06:36.576794 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2160/4496] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:36 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:36.591203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-073db211-6db1-49e8-ac1a-0501a4e025ad tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:36.601217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-073db211-6db1-49e8-ac1a-0501a4e025ad tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:36.640512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-073db211-6db1-49e8-ac1a-0501a4e025ad tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:36.642239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-073db211-6db1-49e8-ac1a-0501a4e025ad tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:36.643001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-073db211-6db1-49e8-ac1a-0501a4e025ad tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:36.644512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-073db211-6db1-49e8-ac1a-0501a4e025ad tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:36.645248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-073db211-6db1-49e8-ac1a-0501a4e025ad tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:36.645839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-073db211-6db1-49e8-ac1a-0501a4e025ad tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:36.880100 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-073db211-6db1-49e8-ac1a-0501a4e025ad tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1618 microversion: 2.1 time: 0.301959 Oct 27 19:06:36.895283 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2161/4497] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:36 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1618 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:36.912145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c5e2f28c-5864-4dc2-9bfe-50459b550b85 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:36.915275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c5e2f28c-5864-4dc2-9bfe-50459b550b85 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] [instance: aeb7a67e-0b58-4410-aab2-40f18a73eec0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:36.921977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5e2f28c-5864-4dc2-9bfe-50459b550b85 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:36.923240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5e2f28c-5864-4dc2-9bfe-50459b550b85 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:36.923841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5e2f28c-5864-4dc2-9bfe-50459b550b85 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:36.925945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5e2f28c-5864-4dc2-9bfe-50459b550b85 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:36.926868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5e2f28c-5864-4dc2-9bfe-50459b550b85 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:36.927458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5e2f28c-5864-4dc2-9bfe-50459b550b85 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:36.944692 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-c5e2f28c-5864-4dc2-9bfe-50459b550b85 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] HTTP exception thrown: Instance aeb7a67e-0b58-4410-aab2-40f18a73eec0 could not be found. Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c5e2f28c-5864-4dc2-9bfe-50459b550b85 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Request method failure captured: Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 HTTP/1.1 Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtaDjfptpus3pd0bqOcRPbi_gI5eQoNczlZFV51g-fvXOCcWPqfCIqfTWc-yBUmQ8bDB0ghGBMsiTxdlbgx3XENBRh7QjGEKk40wBFfDXFTKZg_A-ZaRi1fGy-nSDTutbRgLAH534ODHUATileT-iAq6-RmV8blV1iLcKGxGAOUB0fY Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 6ea0b947e6f34941b45e54389d98e4af Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesActionsTest-2117659430 Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6ea0b947e6f34941b45e54389d98e4af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ea0b947e6f34941b45e54389d98e4af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6ea0b947e6f34941b45e54389d98e4af", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ea0b947e6f34941b45e54389d98e4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-VolumesActionsTest-2117659430 Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 6ea0b947e6f34941b45e54389d98e4af Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesActionsTest-2117659430 Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-VolumesActionsTest-2117659430-project Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 0ca60b2c6a474a02a55e9e53e3954f47 Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-VolumesActionsTest-2117659430-project Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance aeb7a67e-0b58-4410-aab2-40f18a73eec0 could not be found. Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'aeb7a67e-0b58-4410-aab2-40f18a73eec0'} Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeb7a67e-0b58-4410-aab2-40f18a73eec0 could not be found. Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeb7a67e-0b58-4410-aab2-40f18a73eec0 could not be found. Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:36.946673 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:36.951377 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:36.951377 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:36.951377 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:36.951377 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:06:36.951377 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:06:36.951377 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeb7a67e-0b58-4410-aab2-40f18a73eec0 could not be found. Oct 27 19:06:36.951377 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:36.952667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c5e2f28c-5864-4dc2-9bfe-50459b550b85 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] Returning 404 to user: Instance aeb7a67e-0b58-4410-aab2-40f18a73eec0 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:06:36.954297 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c5e2f28c-5864-4dc2-9bfe-50459b550b85 tempest-VolumesActionsTest-2117659430 tempest-VolumesActionsTest-2117659430-project] 10.222.0.42 "GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0" status: 404 len: 111 microversion: 2.1 time: 0.057737 Oct 27 19:06:36.955363 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2162/4498] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:36 2022] GET /compute/v2.1/servers/aeb7a67e-0b58-4410-aab2-40f18a73eec0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:06:37.028702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-46c4d1aa-84a1-42ba-9365-dcb1add65607 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:37.029591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-46c4d1aa-84a1-42ba-9365-dcb1add65607 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:37.046981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46c4d1aa-84a1-42ba-9365-dcb1add65607 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:37.047473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46c4d1aa-84a1-42ba-9365-dcb1add65607 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:37.049660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46c4d1aa-84a1-42ba-9365-dcb1add65607 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:37.051108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46c4d1aa-84a1-42ba-9365-dcb1add65607 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:37.051816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46c4d1aa-84a1-42ba-9365-dcb1add65607 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:37.052293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46c4d1aa-84a1-42ba-9365-dcb1add65607 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:37.195346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c375d245-15f3-4f72-9fe6-f4411256c8dd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:37.204544 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c375d245-15f3-4f72-9fe6-f4411256c8dd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1328 microversion: 2.1 time: 0.748817 Oct 27 19:06:37.207772 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2337/4499] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:36 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1328 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:37.231282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-695891044", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["847d3fc3-fa4c-4211-9900-d6a2fdcaae8a"]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:37.291288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-46c4d1aa-84a1-42ba-9365-dcb1add65607 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:37.303668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-46c4d1aa-84a1-42ba-9365-dcb1add65607 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:37.306138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-46c4d1aa-84a1-42ba-9365-dcb1add65607 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:37.307555 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-46c4d1aa-84a1-42ba-9365-dcb1add65607 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1741 microversion: 2.20 time: 0.283406 Oct 27 19:06:37.311401 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2163/4500] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:37 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1741 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:37.351545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:06:37.406253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d1145af-1792-4846-8aea-a622a1410d11 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:37.406916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9d1145af-1792-4846-8aea-a622a1410d11 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] [instance: b3567a7a-6f12-4d01-a9b1-adcb0310bd10] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:37.425947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d1145af-1792-4846-8aea-a622a1410d11 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:37.437000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d1145af-1792-4846-8aea-a622a1410d11 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:37.442351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d1145af-1792-4846-8aea-a622a1410d11 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:37.443240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d1145af-1792-4846-8aea-a622a1410d11 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:37.443733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d1145af-1792-4846-8aea-a622a1410d11 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:37.444180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d1145af-1792-4846-8aea-a622a1410d11 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:37.508373 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-9d1145af-1792-4846-8aea-a622a1410d11 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] HTTP exception thrown: Instance b3567a7a-6f12-4d01-a9b1-adcb0310bd10 could not be found. Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d1145af-1792-4846-8aea-a622a1410d11 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Request method failure captured: Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 HTTP/1.1 Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZEozh2bog8MWkqJTP_b0oXFVQThLHkbkUJLpif1EpVotAC32PYlcahD4ngnjHWZsEVT260LdebkWYpwia1_L9numBwElSUBhji5bD6xl1hYDaavAcGzUqaqBB_I8qrUzNobe9_p3K2WCVi4PCqMM-migvYfH0WuPc8X8yIMoM-PEo Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 28491a788f494c9f81f9fd8a5cf10702 Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestManualDisk-526338589 Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/28491a788f494c9f81f9fd8a5cf10702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/28491a788f494c9f81f9fd8a5cf10702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_28491a788f494c9f81f9fd8a5cf10702", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/28491a788f494c9f81f9fd8a5cf10702"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestManualDisk-526338589 Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 28491a788f494c9f81f9fd8a5cf10702 Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestManualDisk-526338589 Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestManualDisk-526338589-project Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: da2b7686c7474be3b0b0317e997516f4 Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestManualDisk-526338589-project Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance b3567a7a-6f12-4d01-a9b1-adcb0310bd10 could not be found. Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'b3567a7a-6f12-4d01-a9b1-adcb0310bd10'} Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3567a7a-6f12-4d01-a9b1-adcb0310bd10 could not be found. Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3567a7a-6f12-4d01-a9b1-adcb0310bd10 could not be found. Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:37.514358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:37.518921 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:37.518921 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:37.518921 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:37.518921 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:06:37.518921 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:06:37.518921 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3567a7a-6f12-4d01-a9b1-adcb0310bd10 could not be found. Oct 27 19:06:37.518921 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:06:37.518921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d1145af-1792-4846-8aea-a622a1410d11 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Returning 404 to user: Instance b3567a7a-6f12-4d01-a9b1-adcb0310bd10 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:06:37.524509 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9d1145af-1792-4846-8aea-a622a1410d11 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10" status: 404 len: 111 microversion: 2.1 time: 0.117767 Oct 27 19:06:37.527818 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2164/4501] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:37 2022] GET /compute/v2.1/servers/b3567a7a-6f12-4d01-a9b1-adcb0310bd10 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:06:37.543746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1bc02aac-32a3-4d9f-b44d-34b0ac1dafd0 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] Calling method '.version_select at 0x7fc86ae60a60>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:37.606844 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1bc02aac-32a3-4d9f-b44d-34b0ac1dafd0 tempest-ServersTestManualDisk-526338589 tempest-ServersTestManualDisk-526338589-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128217567" status: 202 len: 0 microversion: 2.1 time: 0.077342 Oct 27 19:06:37.607566 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2165/4502] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 19:06:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128217567 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:06:37.616250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6158e2ab-e78d-4540-8d7a-c81302ef7e74 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:37.618741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6158e2ab-e78d-4540-8d7a-c81302ef7e74 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:37.641256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6158e2ab-e78d-4540-8d7a-c81302ef7e74 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:37.641872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6158e2ab-e78d-4540-8d7a-c81302ef7e74 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:37.642606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6158e2ab-e78d-4540-8d7a-c81302ef7e74 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:37.643714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6158e2ab-e78d-4540-8d7a-c81302ef7e74 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:37.644415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6158e2ab-e78d-4540-8d7a-c81302ef7e74 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:37.645077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6158e2ab-e78d-4540-8d7a-c81302ef7e74 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:38.131484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6158e2ab-e78d-4540-8d7a-c81302ef7e74 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:38.140233 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6158e2ab-e78d-4540-8d7a-c81302ef7e74 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1316 microversion: 2.1 time: 0.531511 Oct 27 19:06:38.140822 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2166/4503] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:37 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1316 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:38.233086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-19424371-40bc-414a-835c-12f1c91c2afa tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:38.233711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-19424371-40bc-414a-835c-12f1c91c2afa tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:38.241189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-19424371-40bc-414a-835c-12f1c91c2afa tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:38.241623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-19424371-40bc-414a-835c-12f1c91c2afa tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:38.242075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-19424371-40bc-414a-835c-12f1c91c2afa tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:38.242827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-19424371-40bc-414a-835c-12f1c91c2afa tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:38.243297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-19424371-40bc-414a-835c-12f1c91c2afa tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:38.243739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-19424371-40bc-414a-835c-12f1c91c2afa tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:38.421950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:06:38.423289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:06:38.423998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:06:38.425209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:06:38.426125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:06:38.455859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:38.461093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:38.467973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:38.472709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:38.473661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:38.478955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:38.644176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:06:38.683912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-19424371-40bc-414a-835c-12f1c91c2afa tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:38.693609 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-19424371-40bc-414a-835c-12f1c91c2afa tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1328 microversion: 2.1 time: 0.463861 Oct 27 19:06:38.698887 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2167/4504] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:38 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1328 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:38.703959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:06:38.715426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9535d574-c6b8-4245-a698-38b499595248 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:38.721980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9535d574-c6b8-4245-a698-38b499595248 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:38.733356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9535d574-c6b8-4245-a698-38b499595248 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:38.733865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9535d574-c6b8-4245-a698-38b499595248 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:38.734315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9535d574-c6b8-4245-a698-38b499595248 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:38.744702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9535d574-c6b8-4245-a698-38b499595248 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:38.745460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9535d574-c6b8-4245-a698-38b499595248 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:38.748717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9535d574-c6b8-4245-a698-38b499595248 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:38.763581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:06:38.766288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:06:38.912486 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d2c52b49-9587-480d-af5d-c0395cf53442 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.692410 Oct 27 19:06:38.915337 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2338/4505] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:06:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:06:38.920906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-7e0897e0-c769-41b9-a276-9c99d8fe04d0 req-cd90a6d6-ddb7-460e-b7bb-003239ef618c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5917fe3b-b247-4012-8137-7539241f129e", "name": "network-vif-plugged", "status": "completed", "tag": "de73b8b1-fc8a-4ab0-a748-9f523293daaa"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:38.951449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7e0897e0-c769-41b9-a276-9c99d8fe04d0 req-cd90a6d6-ddb7-460e-b7bb-003239ef618c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:38.952369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7e0897e0-c769-41b9-a276-9c99d8fe04d0 req-cd90a6d6-ddb7-460e-b7bb-003239ef618c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:38.959579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7e0897e0-c769-41b9-a276-9c99d8fe04d0 req-cd90a6d6-ddb7-460e-b7bb-003239ef618c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:39.053613 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-7e0897e0-c769-41b9-a276-9c99d8fe04d0 req-cd90a6d6-ddb7-460e-b7bb-003239ef618c service nova] Creating event network-vif-plugged:de73b8b1-fc8a-4ab0-a748-9f523293daaa for instance 5917fe3b-b247-4012-8137-7539241f129e on n-h2-860687-3 Oct 27 19:06:39.097885 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-7e0897e0-c769-41b9-a276-9c99d8fe04d0 req-cd90a6d6-ddb7-460e-b7bb-003239ef618c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174605 Oct 27 19:06:39.101958 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2339/4506] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:39.131690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-58ef24b3-2fce-412d-9bd9-9638ca01a02e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:39.132411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-58ef24b3-2fce-412d-9bd9-9638ca01a02e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:39.209901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9535d574-c6b8-4245-a698-38b499595248 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:39.223475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9535d574-c6b8-4245-a698-38b499595248 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:39.223801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9535d574-c6b8-4245-a698-38b499595248 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:39.225941 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9535d574-c6b8-4245-a698-38b499595248 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1741 microversion: 2.20 time: 0.525101 Oct 27 19:06:39.225941 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2168/4507] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:38 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1741 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:39.276995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-84c73312-7cc9-4ec7-894d-e768c43230db tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:39.278845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-84c73312-7cc9-4ec7-894d-e768c43230db tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:39.307816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84c73312-7cc9-4ec7-894d-e768c43230db tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:39.310674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84c73312-7cc9-4ec7-894d-e768c43230db tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:39.313006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84c73312-7cc9-4ec7-894d-e768c43230db tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:39.314040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84c73312-7cc9-4ec7-894d-e768c43230db tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:39.321813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84c73312-7cc9-4ec7-894d-e768c43230db tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:39.321813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84c73312-7cc9-4ec7-894d-e768c43230db tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:39.378757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:39.622342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-58ef24b3-2fce-412d-9bd9-9638ca01a02e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:39.642330 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-58ef24b3-2fce-412d-9bd9-9638ca01a02e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1216 microversion: 2.1 time: 0.536526 Oct 27 19:06:39.644026 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2340/4508] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:39 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1216 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:39.717118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-33e4e957-78ba-4a66-a7c5-4b34c962406a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:39.718207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-33e4e957-78ba-4a66-a7c5-4b34c962406a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:39.733111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33e4e957-78ba-4a66-a7c5-4b34c962406a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:39.735310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33e4e957-78ba-4a66-a7c5-4b34c962406a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:39.735970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33e4e957-78ba-4a66-a7c5-4b34c962406a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:39.738877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33e4e957-78ba-4a66-a7c5-4b34c962406a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:39.739813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33e4e957-78ba-4a66-a7c5-4b34c962406a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:39.740430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33e4e957-78ba-4a66-a7c5-4b34c962406a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:40.456719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-84c73312-7cc9-4ec7-894d-e768c43230db tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:40.470611 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-84c73312-7cc9-4ec7-894d-e768c43230db tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1316 microversion: 2.1 time: 1.204925 Oct 27 19:06:40.471809 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2169/4509] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:39 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1316 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:40.514152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4edf7d72-bdbb-41e8-8686-093f184c3e3f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:40.517246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4edf7d72-bdbb-41e8-8686-093f184c3e3f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:40.540255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4edf7d72-bdbb-41e8-8686-093f184c3e3f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:40.543830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4edf7d72-bdbb-41e8-8686-093f184c3e3f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:40.544588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4edf7d72-bdbb-41e8-8686-093f184c3e3f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:40.545646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4edf7d72-bdbb-41e8-8686-093f184c3e3f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:40.547140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4edf7d72-bdbb-41e8-8686-093f184c3e3f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:40.548495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4edf7d72-bdbb-41e8-8686-093f184c3e3f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:41.143185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-33e4e957-78ba-4a66-a7c5-4b34c962406a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:41.160046 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-33e4e957-78ba-4a66-a7c5-4b34c962406a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1328 microversion: 2.1 time: 1.446635 Oct 27 19:06:41.160824 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2341/4510] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:39 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1328 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:41.179328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8c8e3701-cbb9-4d1f-b82f-b1984728352f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:41.183153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8c8e3701-cbb9-4d1f-b82f-b1984728352f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:41.216996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c8e3701-cbb9-4d1f-b82f-b1984728352f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:41.219490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c8e3701-cbb9-4d1f-b82f-b1984728352f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:41.226248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c8e3701-cbb9-4d1f-b82f-b1984728352f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:41.227088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c8e3701-cbb9-4d1f-b82f-b1984728352f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:41.227559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c8e3701-cbb9-4d1f-b82f-b1984728352f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:41.228004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c8e3701-cbb9-4d1f-b82f-b1984728352f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:41.610213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8c8e3701-cbb9-4d1f-b82f-b1984728352f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:41.619990 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8c8e3701-cbb9-4d1f-b82f-b1984728352f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1268 microversion: 2.1 time: 0.457223 Oct 27 19:06:41.641849 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2342/4511] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:41 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1268 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:41.665506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14a6e27d-e13b-44ab-892c-1c3165e9a01a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:41.668839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-14a6e27d-e13b-44ab-892c-1c3165e9a01a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:41.707595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14a6e27d-e13b-44ab-892c-1c3165e9a01a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:41.708133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14a6e27d-e13b-44ab-892c-1c3165e9a01a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:41.708594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14a6e27d-e13b-44ab-892c-1c3165e9a01a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:41.709357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14a6e27d-e13b-44ab-892c-1c3165e9a01a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:41.709846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14a6e27d-e13b-44ab-892c-1c3165e9a01a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:41.710271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14a6e27d-e13b-44ab-892c-1c3165e9a01a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:41.793932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4edf7d72-bdbb-41e8-8686-093f184c3e3f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:41.813597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4edf7d72-bdbb-41e8-8686-093f184c3e3f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:41.816798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4edf7d72-bdbb-41e8-8686-093f184c3e3f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:41.818250 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4edf7d72-bdbb-41e8-8686-093f184c3e3f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1741 microversion: 2.20 time: 1.342509 Oct 27 19:06:41.821258 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2170/4512] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:40 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1741 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:42.059929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d6a32f4d-9620-44a3-a628-53d9997dd45d req-1436c6fb-c65c-4a25-8843-04e1c896bbbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6b630b-532e-4cae-a7ec-4425b7e94d0e", "tag": "43575250-3770-4612-8105-6f12c8b1ffaa"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:42.101509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d6a32f4d-9620-44a3-a628-53d9997dd45d req-1436c6fb-c65c-4a25-8843-04e1c896bbbd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:42.108727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d6a32f4d-9620-44a3-a628-53d9997dd45d req-1436c6fb-c65c-4a25-8843-04e1c896bbbd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:42.116109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d6a32f4d-9620-44a3-a628-53d9997dd45d req-1436c6fb-c65c-4a25-8843-04e1c896bbbd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:42.191587 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d6a32f4d-9620-44a3-a628-53d9997dd45d req-1436c6fb-c65c-4a25-8843-04e1c896bbbd service nova] Creating event network-changed:43575250-3770-4612-8105-6f12c8b1ffaa for instance eb6b630b-532e-4cae-a7ec-4425b7e94d0e on n-h1-860687-3 Oct 27 19:06:42.232744 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d6a32f4d-9620-44a3-a628-53d9997dd45d req-1436c6fb-c65c-4a25-8843-04e1c896bbbd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168431 Oct 27 19:06:42.233355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-14a6e27d-e13b-44ab-892c-1c3165e9a01a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:42.234661 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2171/4513] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:42.251041 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-14a6e27d-e13b-44ab-892c-1c3165e9a01a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1316 microversion: 2.1 time: 0.603268 Oct 27 19:06:42.253431 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2343/4514] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:41 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:42.255960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1afb8688-482c-4c83-8cfb-237ee9656bcf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:42.262368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1afb8688-482c-4c83-8cfb-237ee9656bcf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:42.292081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:42.302134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1afb8688-482c-4c83-8cfb-237ee9656bcf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:42.305641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1afb8688-482c-4c83-8cfb-237ee9656bcf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:42.306289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1afb8688-482c-4c83-8cfb-237ee9656bcf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:42.309403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1afb8688-482c-4c83-8cfb-237ee9656bcf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:42.310144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1afb8688-482c-4c83-8cfb-237ee9656bcf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:42.311882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1afb8688-482c-4c83-8cfb-237ee9656bcf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:42.451299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de210106-8ddd-4559-92f3-b5bb3ede77fb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:42.451972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-de210106-8ddd-4559-92f3-b5bb3ede77fb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:42.488310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de210106-8ddd-4559-92f3-b5bb3ede77fb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:42.495609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de210106-8ddd-4559-92f3-b5bb3ede77fb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:42.500283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de210106-8ddd-4559-92f3-b5bb3ede77fb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:42.505501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de210106-8ddd-4559-92f3-b5bb3ede77fb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:42.507552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de210106-8ddd-4559-92f3-b5bb3ede77fb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:42.518794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de210106-8ddd-4559-92f3-b5bb3ede77fb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:42.614813 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-de210106-8ddd-4559-92f3-b5bb3ede77fb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] HTTP exception thrown: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de210106-8ddd-4559-92f3-b5bb3ede77fb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Request method failure captured: Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 HTTP/1.1 Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtT5H8XP7V9L0TVuuJvAuBoxNkhZhgX8XkK4-GpzHComWgmbBONfMudM4Q8yHeohsrOhf9YccVlwgfDyUGCChaGZWmGukZPYKh-mvkrZX3vZytXvdyVczNY7QyQ7kdcUBjknkaFKQkxOgdDbrstleWDjGVR0bmb658DtZfuMHYOhmds Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52ccbe7e63ab48199790f4676bbf2580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2be49f7bea7a4c8fbf289594e635fd69 Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '673d7d02-3b01-418e-825a-8c7ccaffa820'} Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:06:42.630189 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:06:42.635172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:06:42.635172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:42.635172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:42.635172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:42.635172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:42.635172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:42.635172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:42.635172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:06:42.635172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:06:42.635172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:06:42.635172 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:42.639105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de210106-8ddd-4559-92f3-b5bb3ede77fb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Returning 404 to user: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:06:42.647743 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-de210106-8ddd-4559-92f3-b5bb3ede77fb tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "DELETE /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 404 len: 111 microversion: 2.1 time: 0.196786 Oct 27 19:06:42.654520 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2344/4515] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:06:42 2022] DELETE /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:06:42.671669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6d4349f3-cfbc-4416-b5f5-0add62c2e76c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:42.684363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6d4349f3-cfbc-4416-b5f5-0add62c2e76c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] [instance: 673d7d02-3b01-418e-825a-8c7ccaffa820] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:42.711973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d4349f3-cfbc-4416-b5f5-0add62c2e76c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:42.714897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d4349f3-cfbc-4416-b5f5-0add62c2e76c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:42.715474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d4349f3-cfbc-4416-b5f5-0add62c2e76c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:42.716333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d4349f3-cfbc-4416-b5f5-0add62c2e76c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:42.718425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d4349f3-cfbc-4416-b5f5-0add62c2e76c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:42.720338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d4349f3-cfbc-4416-b5f5-0add62c2e76c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:42.761667 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-6d4349f3-cfbc-4416-b5f5-0add62c2e76c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] HTTP exception thrown: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6d4349f3-cfbc-4416-b5f5-0add62c2e76c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Request method failure captured: Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 HTTP/1.1 Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtT5H8XP7V9L0TVuuJvAuBoxNkhZhgX8XkK4-GpzHComWgmbBONfMudM4Q8yHeohsrOhf9YccVlwgfDyUGCChaGZWmGukZPYKh-mvkrZX3vZytXvdyVczNY7QyQ7kdcUBjknkaFKQkxOgdDbrstleWDjGVR0bmb658DtZfuMHYOhmds Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52ccbe7e63ab48199790f4676bbf2580", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52ccbe7e63ab48199790f4676bbf2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 52ccbe7e63ab48199790f4676bbf2580 Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1574719576 Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 2be49f7bea7a4c8fbf289594e635fd69 Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeNegativeTest-1574719576-project Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '673d7d02-3b01-418e-825a-8c7ccaffa820'} Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:42.771107 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:42.777644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:42.777644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:42.777644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:42.777644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:06:42.777644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:06:42.777644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. Oct 27 19:06:42.777644 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:42.788377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6d4349f3-cfbc-4416-b5f5-0add62c2e76c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] Returning 404 to user: Instance 673d7d02-3b01-418e-825a-8c7ccaffa820 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:06:42.790472 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6d4349f3-cfbc-4416-b5f5-0add62c2e76c tempest-AttachVolumeNegativeTest-1574719576 tempest-AttachVolumeNegativeTest-1574719576-project] 10.222.0.42 "GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820" status: 404 len: 111 microversion: 2.1 time: 0.130172 Oct 27 19:06:42.792155 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2345/4516] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:42 2022] GET /compute/v2.1/servers/673d7d02-3b01-418e-825a-8c7ccaffa820 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:06:42.800539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-34a66489-0e9d-409a-9739-7f6dccb232b2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:42.802653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-34a66489-0e9d-409a-9739-7f6dccb232b2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:42.818682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34a66489-0e9d-409a-9739-7f6dccb232b2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:42.821718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34a66489-0e9d-409a-9739-7f6dccb232b2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:42.826444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34a66489-0e9d-409a-9739-7f6dccb232b2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:42.827547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34a66489-0e9d-409a-9739-7f6dccb232b2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:42.828264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34a66489-0e9d-409a-9739-7f6dccb232b2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:42.829814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34a66489-0e9d-409a-9739-7f6dccb232b2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:42.881724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:43.251390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-34a66489-0e9d-409a-9739-7f6dccb232b2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:43.261180 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-34a66489-0e9d-409a-9739-7f6dccb232b2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1274 microversion: 2.1 time: 0.467728 Oct 27 19:06:43.265100 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2346/4517] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:42 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1274 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:43.288131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e1cfe961-5723-4385-9352-f1b6349c85d2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:43.289140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e1cfe961-5723-4385-9352-f1b6349c85d2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:43.295324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:43.297061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1cfe961-5723-4385-9352-f1b6349c85d2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:43.297800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1cfe961-5723-4385-9352-f1b6349c85d2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:43.298618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1cfe961-5723-4385-9352-f1b6349c85d2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:43.299864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1cfe961-5723-4385-9352-f1b6349c85d2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:43.300928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1cfe961-5723-4385-9352-f1b6349c85d2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:43.301976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1cfe961-5723-4385-9352-f1b6349c85d2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:43.751732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1afb8688-482c-4c83-8cfb-237ee9656bcf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:43.844501 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1afb8688-482c-4c83-8cfb-237ee9656bcf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1508 microversion: 2.1 time: 1.608403 Oct 27 19:06:43.858844 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2172/4518] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:42 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1508 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:43.869944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ce9bb76d-db10-4e7d-bea6-4701213d68d9 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:43.873171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ce9bb76d-db10-4e7d-bea6-4701213d68d9 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:43.892058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce9bb76d-db10-4e7d-bea6-4701213d68d9 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:43.894215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce9bb76d-db10-4e7d-bea6-4701213d68d9 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:43.896054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce9bb76d-db10-4e7d-bea6-4701213d68d9 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:43.897031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce9bb76d-db10-4e7d-bea6-4701213d68d9 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:43.900377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce9bb76d-db10-4e7d-bea6-4701213d68d9 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:43.912606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce9bb76d-db10-4e7d-bea6-4701213d68d9 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:44.092572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1cfe961-5723-4385-9352-f1b6349c85d2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:44.108324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1cfe961-5723-4385-9352-f1b6349c85d2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:44.110170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1cfe961-5723-4385-9352-f1b6349c85d2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:44.112222 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e1cfe961-5723-4385-9352-f1b6349c85d2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1741 microversion: 2.20 time: 0.831613 Oct 27 19:06:44.136810 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2347/4519] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:43 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1741 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:44.146223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-49a9dc54-6555-43eb-9002-8fc6243e0116 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:44.147280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-49a9dc54-6555-43eb-9002-8fc6243e0116 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:44.163987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49a9dc54-6555-43eb-9002-8fc6243e0116 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:44.164822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49a9dc54-6555-43eb-9002-8fc6243e0116 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:44.165477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49a9dc54-6555-43eb-9002-8fc6243e0116 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:44.166417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49a9dc54-6555-43eb-9002-8fc6243e0116 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:44.167067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49a9dc54-6555-43eb-9002-8fc6243e0116 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:44.167693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49a9dc54-6555-43eb-9002-8fc6243e0116 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:45.503309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-49a9dc54-6555-43eb-9002-8fc6243e0116 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:45.512808 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-49a9dc54-6555-43eb-9002-8fc6243e0116 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1508 microversion: 2.1 time: 1.374409 Oct 27 19:06:45.517274 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2348/4520] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:44 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1508 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:45.535254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b73e0c54-0ec1-4538-bb60-4ee48530c108 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:45.543901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b73e0c54-0ec1-4538-bb60-4ee48530c108 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:45.572355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ce9bb76d-db10-4e7d-bea6-4701213d68d9 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:45.574300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73e0c54-0ec1-4538-bb60-4ee48530c108 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:45.576953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73e0c54-0ec1-4538-bb60-4ee48530c108 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:45.577436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73e0c54-0ec1-4538-bb60-4ee48530c108 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:45.578157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73e0c54-0ec1-4538-bb60-4ee48530c108 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:45.578646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73e0c54-0ec1-4538-bb60-4ee48530c108 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:45.579080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73e0c54-0ec1-4538-bb60-4ee48530c108 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:45.601572 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ce9bb76d-db10-4e7d-bea6-4701213d68d9 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1316 microversion: 2.1 time: 1.741236 Oct 27 19:06:45.619108 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2173/4521] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:43 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1316 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:45.624475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b6194073-042d-4508-ade2-e74d8fec3059 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:45.625443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b6194073-042d-4508-ade2-e74d8fec3059 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:45.632313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6194073-042d-4508-ade2-e74d8fec3059 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:45.638989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6194073-042d-4508-ade2-e74d8fec3059 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:45.644157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6194073-042d-4508-ade2-e74d8fec3059 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:45.649478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6194073-042d-4508-ade2-e74d8fec3059 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:45.651579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6194073-042d-4508-ade2-e74d8fec3059 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:45.656017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6194073-042d-4508-ade2-e74d8fec3059 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:46.398219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b73e0c54-0ec1-4538-bb60-4ee48530c108 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:46.406755 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b73e0c54-0ec1-4538-bb60-4ee48530c108 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1316 microversion: 2.1 time: 0.886716 Oct 27 19:06:46.416034 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2349/4522] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:45 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1316 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:46.430197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d5af8f88-ba91-4769-97c8-7e6b5d990ac0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:46.431102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d5af8f88-ba91-4769-97c8-7e6b5d990ac0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:46.462673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5af8f88-ba91-4769-97c8-7e6b5d990ac0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:46.466690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5af8f88-ba91-4769-97c8-7e6b5d990ac0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:46.467532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5af8f88-ba91-4769-97c8-7e6b5d990ac0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:46.475484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5af8f88-ba91-4769-97c8-7e6b5d990ac0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:46.477204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5af8f88-ba91-4769-97c8-7e6b5d990ac0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:46.477903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d5af8f88-ba91-4769-97c8-7e6b5d990ac0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:46.539623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d5af8f88-ba91-4769-97c8-7e6b5d990ac0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:06:46.757811 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d5af8f88-ba91-4769-97c8-7e6b5d990ac0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 204 len: 0 microversion: 2.1 time: 0.336932 Oct 27 19:06:46.762986 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2350/4523] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:06:46 2022] DELETE /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:06:46.788545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-17642e6d-1c38-4860-8b1f-75da3914bd14 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:46.789472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-17642e6d-1c38-4860-8b1f-75da3914bd14 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:46.805699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17642e6d-1c38-4860-8b1f-75da3914bd14 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:46.809639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17642e6d-1c38-4860-8b1f-75da3914bd14 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:46.811001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17642e6d-1c38-4860-8b1f-75da3914bd14 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:46.818741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17642e6d-1c38-4860-8b1f-75da3914bd14 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:46.819511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17642e6d-1c38-4860-8b1f-75da3914bd14 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:46.820110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17642e6d-1c38-4860-8b1f-75da3914bd14 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:47.435219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6194073-042d-4508-ade2-e74d8fec3059 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:47.444900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6194073-042d-4508-ade2-e74d8fec3059 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:47.458029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6194073-042d-4508-ade2-e74d8fec3059 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:47.469156 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b6194073-042d-4508-ade2-e74d8fec3059 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1741 microversion: 2.20 time: 1.848416 Oct 27 19:06:47.470015 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2174/4524] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:45 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1741 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:47.491967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e7362605-18e5-4ef5-a098-e4f41e9039de tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:47.492885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e7362605-18e5-4ef5-a098-e4f41e9039de tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:47.515904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7362605-18e5-4ef5-a098-e4f41e9039de tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:47.516693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7362605-18e5-4ef5-a098-e4f41e9039de tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:47.517332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7362605-18e5-4ef5-a098-e4f41e9039de tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:47.518828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7362605-18e5-4ef5-a098-e4f41e9039de tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:47.519473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7362605-18e5-4ef5-a098-e4f41e9039de tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:47.520091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7362605-18e5-4ef5-a098-e4f41e9039de tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:47.774695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-17642e6d-1c38-4860-8b1f-75da3914bd14 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:47.785764 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-17642e6d-1c38-4860-8b1f-75da3914bd14 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1316 microversion: 2.1 time: 1.021963 Oct 27 19:06:47.816910 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2351/4525] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:46 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1316 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:47.823995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3c93114d-caea-4cb3-bd57-d028e776d8e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:47.843509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3c93114d-caea-4cb3-bd57-d028e776d8e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:47.856954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c93114d-caea-4cb3-bd57-d028e776d8e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:47.866285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c93114d-caea-4cb3-bd57-d028e776d8e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:47.866978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c93114d-caea-4cb3-bd57-d028e776d8e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:47.868378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c93114d-caea-4cb3-bd57-d028e776d8e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:47.870321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c93114d-caea-4cb3-bd57-d028e776d8e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:47.870913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c93114d-caea-4cb3-bd57-d028e776d8e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:48.353037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e7362605-18e5-4ef5-a098-e4f41e9039de tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:48.361917 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e7362605-18e5-4ef5-a098-e4f41e9039de tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1514 microversion: 2.1 time: 0.873499 Oct 27 19:06:48.363096 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2175/4526] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:47 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1514 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:48.466827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3c93114d-caea-4cb3-bd57-d028e776d8e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:48.490809 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3c93114d-caea-4cb3-bd57-d028e776d8e0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1316 microversion: 2.1 time: 0.672519 Oct 27 19:06:48.501542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f2c76faa-0116-4f55-a313-601686e636e3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:48.511089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f2c76faa-0116-4f55-a313-601686e636e3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:48.537943 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2352/4527] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:47 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1316 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:48.558238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2c76faa-0116-4f55-a313-601686e636e3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:48.562373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2c76faa-0116-4f55-a313-601686e636e3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:48.568507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2c76faa-0116-4f55-a313-601686e636e3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:48.574608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2c76faa-0116-4f55-a313-601686e636e3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:48.585437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2c76faa-0116-4f55-a313-601686e636e3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:48.587364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2c76faa-0116-4f55-a313-601686e636e3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:48.835018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a293a8e9-d15a-4ec0-b440-8f4fd6f693ca tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:48.837959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a293a8e9-d15a-4ec0-b440-8f4fd6f693ca tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:48.843004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:48.874286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a293a8e9-d15a-4ec0-b440-8f4fd6f693ca tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:48.879113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a293a8e9-d15a-4ec0-b440-8f4fd6f693ca tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:48.880213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a293a8e9-d15a-4ec0-b440-8f4fd6f693ca tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:48.881080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a293a8e9-d15a-4ec0-b440-8f4fd6f693ca tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:48.888113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a293a8e9-d15a-4ec0-b440-8f4fd6f693ca tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:48.888833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a293a8e9-d15a-4ec0-b440-8f4fd6f693ca tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:49.326907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f2c76faa-0116-4f55-a313-601686e636e3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:49.347221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f2c76faa-0116-4f55-a313-601686e636e3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:49.351454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f2c76faa-0116-4f55-a313-601686e636e3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:49.360497 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f2c76faa-0116-4f55-a313-601686e636e3 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1741 microversion: 2.20 time: 0.864114 Oct 27 19:06:49.362692 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2176/4528] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:48 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1741 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:49.405408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-be8cefd3-1ee2-4add-88e7-ca4e59972897 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:49.406289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-be8cefd3-1ee2-4add-88e7-ca4e59972897 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:49.443462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be8cefd3-1ee2-4add-88e7-ca4e59972897 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:49.445455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be8cefd3-1ee2-4add-88e7-ca4e59972897 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:49.446172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be8cefd3-1ee2-4add-88e7-ca4e59972897 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:49.454979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be8cefd3-1ee2-4add-88e7-ca4e59972897 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:49.456560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be8cefd3-1ee2-4add-88e7-ca4e59972897 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:49.457570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be8cefd3-1ee2-4add-88e7-ca4e59972897 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:49.588558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a293a8e9-d15a-4ec0-b440-8f4fd6f693ca tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:49.610519 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a293a8e9-d15a-4ec0-b440-8f4fd6f693ca tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1316 microversion: 2.1 time: 0.774524 Oct 27 19:06:49.620157 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2353/4529] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:48 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1316 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:06:49.628596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=16 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:49.655912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-be678477-6cd0-413b-a6b5-7f134ca3c959 req-f038f76e-a404-4f3e-81ef-a831ff634c7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "705c6206-67e4-43dc-8bb1-7ea3367b308f", "tag": "6ac99626-c0d5-4edf-9802-a94a88adee2d"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:49.710857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-be678477-6cd0-413b-a6b5-7f134ca3c959 req-f038f76e-a404-4f3e-81ef-a831ff634c7f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:49.717965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-be678477-6cd0-413b-a6b5-7f134ca3c959 req-f038f76e-a404-4f3e-81ef-a831ff634c7f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:49.719488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-be678477-6cd0-413b-a6b5-7f134ca3c959 req-f038f76e-a404-4f3e-81ef-a831ff634c7f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:49.763443 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-be678477-6cd0-413b-a6b5-7f134ca3c959 req-f038f76e-a404-4f3e-81ef-a831ff634c7f service nova] Creating event network-changed:6ac99626-c0d5-4edf-9802-a94a88adee2d for instance 705c6206-67e4-43dc-8bb1-7ea3367b308f on n-h2-860687-3 Oct 27 19:06:49.791194 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-be678477-6cd0-413b-a6b5-7f134ca3c959 req-f038f76e-a404-4f3e-81ef-a831ff634c7f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160611 Oct 27 19:06:49.799850 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2354/4530] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:49.819764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ff56006c-417b-4413-9cef-a21cb404b2bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:49.821828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ff56006c-417b-4413-9cef-a21cb404b2bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:49.859815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff56006c-417b-4413-9cef-a21cb404b2bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:49.861658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff56006c-417b-4413-9cef-a21cb404b2bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:49.864677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff56006c-417b-4413-9cef-a21cb404b2bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:49.866180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff56006c-417b-4413-9cef-a21cb404b2bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:49.868814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff56006c-417b-4413-9cef-a21cb404b2bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:49.870287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ff56006c-417b-4413-9cef-a21cb404b2bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:50.681952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-be8cefd3-1ee2-4add-88e7-ca4e59972897 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:50.695532 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-be8cefd3-1ee2-4add-88e7-ca4e59972897 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1472 microversion: 2.1 time: 1.307481 Oct 27 19:06:50.720558 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2177/4531] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:49 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1472 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:50.726667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71276e13-c8d1-4dd1-bb76-2b35b25cb060 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:50.727508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-71276e13-c8d1-4dd1-bb76-2b35b25cb060 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:50.734287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71276e13-c8d1-4dd1-bb76-2b35b25cb060 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:50.735048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71276e13-c8d1-4dd1-bb76-2b35b25cb060 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:50.735664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71276e13-c8d1-4dd1-bb76-2b35b25cb060 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:50.737421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71276e13-c8d1-4dd1-bb76-2b35b25cb060 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:50.738473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71276e13-c8d1-4dd1-bb76-2b35b25cb060 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:50.739459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71276e13-c8d1-4dd1-bb76-2b35b25cb060 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:51.728631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ff56006c-417b-4413-9cef-a21cb404b2bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:51.741698 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ff56006c-417b-4413-9cef-a21cb404b2bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1316 microversion: 2.1 time: 1.936178 Oct 27 19:06:51.759965 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2355/4532] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:49 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1316 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:51.766323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-71276e13-c8d1-4dd1-bb76-2b35b25cb060 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:51.784825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-71276e13-c8d1-4dd1-bb76-2b35b25cb060 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:51.792000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-71276e13-c8d1-4dd1-bb76-2b35b25cb060 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:51.799486 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-71276e13-c8d1-4dd1-bb76-2b35b25cb060 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1741 microversion: 2.20 time: 1.076068 Oct 27 19:06:51.801341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-105a251d-e005-494b-bb30-77d6d18daaed tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:51.805075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-105a251d-e005-494b-bb30-77d6d18daaed tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:51.811138 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2178/4533] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:50 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1741 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:51.824229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-a46b43da-7e73-47ac-a1a0-d374a7fd574a req-9cc5f5ad-58bc-47d7-86b0-74fb3fa9eee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5917fe3b-b247-4012-8137-7539241f129e", "name": "network-vif-deleted", "tag": "de73b8b1-fc8a-4ab0-a748-9f523293daaa"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:51.847954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-105a251d-e005-494b-bb30-77d6d18daaed tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:51.855690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a46b43da-7e73-47ac-a1a0-d374a7fd574a req-9cc5f5ad-58bc-47d7-86b0-74fb3fa9eee4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:51.859180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-105a251d-e005-494b-bb30-77d6d18daaed tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:51.859925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a46b43da-7e73-47ac-a1a0-d374a7fd574a req-9cc5f5ad-58bc-47d7-86b0-74fb3fa9eee4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:51.860745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-105a251d-e005-494b-bb30-77d6d18daaed tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:51.862024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a46b43da-7e73-47ac-a1a0-d374a7fd574a req-9cc5f5ad-58bc-47d7-86b0-74fb3fa9eee4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:51.862831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-105a251d-e005-494b-bb30-77d6d18daaed tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:51.864677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-105a251d-e005-494b-bb30-77d6d18daaed tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:51.870281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-105a251d-e005-494b-bb30-77d6d18daaed tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:51.909456 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a46b43da-7e73-47ac-a1a0-d374a7fd574a req-9cc5f5ad-58bc-47d7-86b0-74fb3fa9eee4 service nova] Creating event network-vif-deleted:de73b8b1-fc8a-4ab0-a748-9f523293daaa for instance 5917fe3b-b247-4012-8137-7539241f129e on n-h2-860687-3 Oct 27 19:06:51.929071 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-a46b43da-7e73-47ac-a1a0-d374a7fd574a req-9cc5f5ad-58bc-47d7-86b0-74fb3fa9eee4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111418 Oct 27 19:06:51.930774 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2179/4534] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:51.954703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d45c021b-a32b-4db6-94e1-fa33ace885f8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:51.956708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d45c021b-a32b-4db6-94e1-fa33ace885f8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:51.975519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d45c021b-a32b-4db6-94e1-fa33ace885f8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:51.984857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d45c021b-a32b-4db6-94e1-fa33ace885f8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:51.987909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d45c021b-a32b-4db6-94e1-fa33ace885f8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:51.989277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d45c021b-a32b-4db6-94e1-fa33ace885f8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:51.992465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d45c021b-a32b-4db6-94e1-fa33ace885f8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:51.993305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d45c021b-a32b-4db6-94e1-fa33ace885f8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:52.127611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d45c021b-a32b-4db6-94e1-fa33ace885f8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:52.135974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d45c021b-a32b-4db6-94e1-fa33ace885f8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:52.136899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d45c021b-a32b-4db6-94e1-fa33ace885f8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:52.139061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-d45c021b-a32b-4db6-94e1-fa33ace885f8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lazy-loading 'fault' on Instance uuid 5917fe3b-b247-4012-8137-7539241f129e {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:06:52.360097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d45c021b-a32b-4db6-94e1-fa33ace885f8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:52.382165 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d45c021b-a32b-4db6-94e1-fa33ace885f8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 200 len: 1318 microversion: 2.1 time: 0.449915 Oct 27 19:06:52.394459 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2180/4535] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:51 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:52.765796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-94790005-7dfc-4695-a357-6e074db53a11 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:52.766717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-94790005-7dfc-4695-a357-6e074db53a11 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:52.791135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94790005-7dfc-4695-a357-6e074db53a11 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:52.794192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94790005-7dfc-4695-a357-6e074db53a11 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:52.795129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94790005-7dfc-4695-a357-6e074db53a11 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:52.797472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94790005-7dfc-4695-a357-6e074db53a11 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:52.797966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94790005-7dfc-4695-a357-6e074db53a11 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:52.801282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94790005-7dfc-4695-a357-6e074db53a11 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:52.902715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-105a251d-e005-494b-bb30-77d6d18daaed tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:52.921439 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-105a251d-e005-494b-bb30-77d6d18daaed tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1316 microversion: 2.1 time: 1.156979 Oct 27 19:06:52.927103 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2356/4536] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:51 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1316 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:52.947890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-22973118-f486-4fcd-a542-556e531410b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:52.948961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-22973118-f486-4fcd-a542-556e531410b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:52.963690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22973118-f486-4fcd-a542-556e531410b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:52.964506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22973118-f486-4fcd-a542-556e531410b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:52.965263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22973118-f486-4fcd-a542-556e531410b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:52.966169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22973118-f486-4fcd-a542-556e531410b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:52.969755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22973118-f486-4fcd-a542-556e531410b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:52.970592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22973118-f486-4fcd-a542-556e531410b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:53.816184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-22973118-f486-4fcd-a542-556e531410b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:53.838216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-22973118-f486-4fcd-a542-556e531410b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:53.840316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-22973118-f486-4fcd-a542-556e531410b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:53.845438 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-22973118-f486-4fcd-a542-556e531410b2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1741 microversion: 2.20 time: 0.909877 Oct 27 19:06:53.850567 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2357/4537] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:52 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1741 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:53.875404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7d78a5bc-18ea-4e49-818d-f7b57389c3fe tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:53.875945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7d78a5bc-18ea-4e49-818d-f7b57389c3fe tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:53.905539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d78a5bc-18ea-4e49-818d-f7b57389c3fe tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:53.908852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d78a5bc-18ea-4e49-818d-f7b57389c3fe tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:53.911687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d78a5bc-18ea-4e49-818d-f7b57389c3fe tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:53.912647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d78a5bc-18ea-4e49-818d-f7b57389c3fe tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:53.915451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d78a5bc-18ea-4e49-818d-f7b57389c3fe tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:53.916644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d78a5bc-18ea-4e49-818d-f7b57389c3fe tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:53.942047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-94790005-7dfc-4695-a357-6e074db53a11 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:53.953042 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-7d78a5bc-18ea-4e49-818d-f7b57389c3fe tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7d78a5bc-18ea-4e49-818d-f7b57389c3fe tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e HTTP/1.1 Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '5917fe3b-b247-4012-8137-7539241f129e'} Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:53.957785 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:06:53.963077 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:06:53.963077 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:06:53.963077 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:06:53.963077 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:06:53.963077 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:06:53.963077 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:06:53.967129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7d78a5bc-18ea-4e49-818d-f7b57389c3fe tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:06:53.968211 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7d78a5bc-18ea-4e49-818d-f7b57389c3fe tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 404 len: 111 microversion: 2.1 time: 0.116311 Oct 27 19:06:53.972413 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2358/4538] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:53 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:06:53.973567 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-94790005-7dfc-4695-a357-6e074db53a11 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1316 microversion: 2.1 time: 1.211912 Oct 27 19:06:53.974293 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2181/4539] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:52 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1316 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:53.995387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c22727f8-1f30-453c-8b85-8d2d13de84e3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '.version_select at 0x7fc86ae60310>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:54.011797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-060cfa88-de85-4bd4-a747-4439ca2c575b tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:54.012459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-060cfa88-de85-4bd4-a747-4439ca2c575b tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:54.068307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-060cfa88-de85-4bd4-a747-4439ca2c575b tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:54.069380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-060cfa88-de85-4bd4-a747-4439ca2c575b tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:54.071256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-060cfa88-de85-4bd4-a747-4439ca2c575b tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:54.073416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-060cfa88-de85-4bd4-a747-4439ca2c575b tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:54.074041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-060cfa88-de85-4bd4-a747-4439ca2c575b tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:54.074527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-060cfa88-de85-4bd4-a747-4439ca2c575b tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:54.078120 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c22727f8-1f30-453c-8b85-8d2d13de84e3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-key-1121334629" status: 202 len: 0 microversion: 2.1 time: 0.097987 Oct 27 19:06:54.105719 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2182/4540] 10.222.0.42 () {58 vars in 1209 bytes} [Thu Oct 27 19:06:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1121334629 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:06:54.383481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1979196732", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "0e03b86b-4627-4072-8ddb-a6a80f18beba"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:54.918495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-060cfa88-de85-4bd4-a747-4439ca2c575b tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:54.945605 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-060cfa88-de85-4bd4-a747-4439ca2c575b tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1316 microversion: 2.1 time: 0.968326 Oct 27 19:06:54.950828 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2359/4541] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:53 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1316 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:54.958313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b4e028dc-6345-49e1-b466-a70cb168fbeb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:54.969492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b4e028dc-6345-49e1-b466-a70cb168fbeb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:54.989508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4e028dc-6345-49e1-b466-a70cb168fbeb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:54.994342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4e028dc-6345-49e1-b466-a70cb168fbeb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:54.995129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4e028dc-6345-49e1-b466-a70cb168fbeb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:54.996170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4e028dc-6345-49e1-b466-a70cb168fbeb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:54.996816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4e028dc-6345-49e1-b466-a70cb168fbeb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:54.997425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4e028dc-6345-49e1-b466-a70cb168fbeb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:55.563722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4e028dc-6345-49e1-b466-a70cb168fbeb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:55.582097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4e028dc-6345-49e1-b466-a70cb168fbeb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:55.588927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4e028dc-6345-49e1-b466-a70cb168fbeb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:55.595089 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b4e028dc-6345-49e1-b466-a70cb168fbeb tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1741 microversion: 2.20 time: 0.639093 Oct 27 19:06:55.596689 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2360/4542] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:54 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1741 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:55.609771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f5ccec1e-3d48-468f-9441-27c436778bbd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:55.613804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f5ccec1e-3d48-468f-9441-27c436778bbd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:55.637349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5ccec1e-3d48-468f-9441-27c436778bbd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:55.637854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5ccec1e-3d48-468f-9441-27c436778bbd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:55.638308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5ccec1e-3d48-468f-9441-27c436778bbd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:55.639066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5ccec1e-3d48-468f-9441-27c436778bbd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:55.639611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5ccec1e-3d48-468f-9441-27c436778bbd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:55.639991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5ccec1e-3d48-468f-9441-27c436778bbd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:56.532956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f5ccec1e-3d48-468f-9441-27c436778bbd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:56.629708 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f5ccec1e-3d48-468f-9441-27c436778bbd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1316 microversion: 2.1 time: 1.031494 Oct 27 19:06:56.631461 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2361/4543] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:55 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1316 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:56.641852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-857bb79d-aa40-4043-a0f1-143d9d5e33eb tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:56.648050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-857bb79d-aa40-4043-a0f1-143d9d5e33eb tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:56.683518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-857bb79d-aa40-4043-a0f1-143d9d5e33eb tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:56.684243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-857bb79d-aa40-4043-a0f1-143d9d5e33eb tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:56.684851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-857bb79d-aa40-4043-a0f1-143d9d5e33eb tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:56.685763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-857bb79d-aa40-4043-a0f1-143d9d5e33eb tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:56.686419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-857bb79d-aa40-4043-a0f1-143d9d5e33eb tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:56.687076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-857bb79d-aa40-4043-a0f1-143d9d5e33eb tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:57.375827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-857bb79d-aa40-4043-a0f1-143d9d5e33eb tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:57.386503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:06:57.410262 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-857bb79d-aa40-4043-a0f1-143d9d5e33eb tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1316 microversion: 2.1 time: 0.777466 Oct 27 19:06:57.414524 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2362/4544] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:56 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1316 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:57.430734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-142d11f4-8447-4d7a-b740-91bb7f7b2213 req-f35ad660-58f0-449c-a41d-a3dce59a2bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6b630b-532e-4cae-a7ec-4425b7e94d0e", "name": "network-vif-plugged", "status": "completed", "tag": "43575250-3770-4612-8105-6f12c8b1ffaa"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:06:57.463968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-142d11f4-8447-4d7a-b740-91bb7f7b2213 req-f35ad660-58f0-449c-a41d-a3dce59a2bbd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:57.465084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-142d11f4-8447-4d7a-b740-91bb7f7b2213 req-f35ad660-58f0-449c-a41d-a3dce59a2bbd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:57.465689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-142d11f4-8447-4d7a-b740-91bb7f7b2213 req-f35ad660-58f0-449c-a41d-a3dce59a2bbd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:57.488426 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-142d11f4-8447-4d7a-b740-91bb7f7b2213 req-f35ad660-58f0-449c-a41d-a3dce59a2bbd service nova] Creating event network-vif-plugged:43575250-3770-4612-8105-6f12c8b1ffaa for instance eb6b630b-532e-4cae-a7ec-4425b7e94d0e on n-h1-860687-3 Oct 27 19:06:57.511185 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-142d11f4-8447-4d7a-b740-91bb7f7b2213 req-f35ad660-58f0-449c-a41d-a3dce59a2bbd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094921 Oct 27 19:06:57.512586 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2363/4545] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:06:57.520931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d65167a0-5523-4298-bf13-17e4c7bd384e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:57.522222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d65167a0-5523-4298-bf13-17e4c7bd384e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:57.531548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65167a0-5523-4298-bf13-17e4c7bd384e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:57.535126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65167a0-5523-4298-bf13-17e4c7bd384e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:57.536485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65167a0-5523-4298-bf13-17e4c7bd384e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:57.537681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65167a0-5523-4298-bf13-17e4c7bd384e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:57.538327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65167a0-5523-4298-bf13-17e4c7bd384e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:57.538970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65167a0-5523-4298-bf13-17e4c7bd384e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:58.327764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d65167a0-5523-4298-bf13-17e4c7bd384e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:58.347951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d65167a0-5523-4298-bf13-17e4c7bd384e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:58.349868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d65167a0-5523-4298-bf13-17e4c7bd384e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:58.351383 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d65167a0-5523-4298-bf13-17e4c7bd384e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1741 microversion: 2.20 time: 0.837434 Oct 27 19:06:58.352518 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2364/4546] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:06:57 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1741 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:06:58.362897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b5fbf7c7-6654-46d6-8584-f283715acf37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:58.368114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b5fbf7c7-6654-46d6-8584-f283715acf37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:58.384826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5fbf7c7-6654-46d6-8584-f283715acf37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:58.385647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5fbf7c7-6654-46d6-8584-f283715acf37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:58.386313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5fbf7c7-6654-46d6-8584-f283715acf37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:58.387309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5fbf7c7-6654-46d6-8584-f283715acf37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:58.387991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5fbf7c7-6654-46d6-8584-f283715acf37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:58.389730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5fbf7c7-6654-46d6-8584-f283715acf37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:59.124714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b5fbf7c7-6654-46d6-8584-f283715acf37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:06:59.141416 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b5fbf7c7-6654-46d6-8584-f283715acf37 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1316 microversion: 2.1 time: 0.787560 Oct 27 19:06:59.163312 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2365/4547] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:58 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1316 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:06:59.196104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c361c560-abc5-48e7-aaac-dbd76fe60991 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:06:59.197188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c361c560-abc5-48e7-aaac-dbd76fe60991 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:06:59.222698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c361c560-abc5-48e7-aaac-dbd76fe60991 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:59.223225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c361c560-abc5-48e7-aaac-dbd76fe60991 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:59.223689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c361c560-abc5-48e7-aaac-dbd76fe60991 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:06:59.224454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c361c560-abc5-48e7-aaac-dbd76fe60991 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:06:59.227890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c361c560-abc5-48e7-aaac-dbd76fe60991 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:06:59.228346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c361c560-abc5-48e7-aaac-dbd76fe60991 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:00.029135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c361c560-abc5-48e7-aaac-dbd76fe60991 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:00.043100 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c361c560-abc5-48e7-aaac-dbd76fe60991 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1316 microversion: 2.1 time: 0.876959 Oct 27 19:07:00.047345 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2366/4548] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:06:59 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1316 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:00.057735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-89e6461c-3664-4066-96e5-bff64f38d124 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:00.058364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-89e6461c-3664-4066-96e5-bff64f38d124 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:00.088676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89e6461c-3664-4066-96e5-bff64f38d124 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:00.089245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89e6461c-3664-4066-96e5-bff64f38d124 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:00.089700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89e6461c-3664-4066-96e5-bff64f38d124 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:00.091568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89e6461c-3664-4066-96e5-bff64f38d124 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:00.093202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89e6461c-3664-4066-96e5-bff64f38d124 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:00.093655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89e6461c-3664-4066-96e5-bff64f38d124 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:00.456973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-89e6461c-3664-4066-96e5-bff64f38d124 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:00.469551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-89e6461c-3664-4066-96e5-bff64f38d124 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:00.478223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-89e6461c-3664-4066-96e5-bff64f38d124 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:00.480320 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-89e6461c-3664-4066-96e5-bff64f38d124 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1741 microversion: 2.20 time: 0.426537 Oct 27 19:07:00.484463 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2367/4549] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:00 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1741 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:00.494987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-361ab1bf-3719-41bc-921e-b7854341c395 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:00.498326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-361ab1bf-3719-41bc-921e-b7854341c395 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:00.513127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-361ab1bf-3719-41bc-921e-b7854341c395 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:00.514031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-361ab1bf-3719-41bc-921e-b7854341c395 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:00.515908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-361ab1bf-3719-41bc-921e-b7854341c395 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:00.517413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-361ab1bf-3719-41bc-921e-b7854341c395 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:00.520077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-361ab1bf-3719-41bc-921e-b7854341c395 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:00.521622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-361ab1bf-3719-41bc-921e-b7854341c395 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:00.792637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-361ab1bf-3719-41bc-921e-b7854341c395 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:00.805653 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-361ab1bf-3719-41bc-921e-b7854341c395 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1316 microversion: 2.1 time: 0.319281 Oct 27 19:07:00.810647 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2368/4550] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:00 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:01.073646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d2a03235-2399-4cba-9223-f4e4770be346 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:01.075194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d2a03235-2399-4cba-9223-f4e4770be346 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:01.090648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2a03235-2399-4cba-9223-f4e4770be346 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:01.097502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2a03235-2399-4cba-9223-f4e4770be346 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:01.098780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2a03235-2399-4cba-9223-f4e4770be346 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:01.102295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2a03235-2399-4cba-9223-f4e4770be346 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:01.103687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2a03235-2399-4cba-9223-f4e4770be346 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:01.104943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2a03235-2399-4cba-9223-f4e4770be346 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:01.371420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d2a03235-2399-4cba-9223-f4e4770be346 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:01.387958 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d2a03235-2399-4cba-9223-f4e4770be346 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1506 microversion: 2.1 time: 0.319575 Oct 27 19:07:01.389499 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2369/4551] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:01 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:01.417003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-96e3e07a-cadb-4674-9cd8-3870033bad0e tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:01.424982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-96e3e07a-cadb-4674-9cd8-3870033bad0e tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:01.441437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96e3e07a-cadb-4674-9cd8-3870033bad0e tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:01.446082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96e3e07a-cadb-4674-9cd8-3870033bad0e tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:01.447043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96e3e07a-cadb-4674-9cd8-3870033bad0e tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:01.450119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96e3e07a-cadb-4674-9cd8-3870033bad0e tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:01.455778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96e3e07a-cadb-4674-9cd8-3870033bad0e tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:01.457543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96e3e07a-cadb-4674-9cd8-3870033bad0e tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:01.559857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-96e3e07a-cadb-4674-9cd8-3870033bad0e tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:01.561484 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-96e3e07a-cadb-4674-9cd8-3870033bad0e tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e/os-instance-actions/req-287802fa-0f48-4176-a122-744ce1963242" status: 200 len: 313 microversion: 2.1 time: 0.148772 Oct 27 19:07:01.581837 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2370/4552] 10.222.0.42 () {58 vars in 1419 bytes} [Thu Oct 27 19:07:01 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e/os-instance-actions/req-287802fa-0f48-4176-a122-744ce1963242 => generated 313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:01.593289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-86107f8b-e01e-4575-8bfa-f3feee4792bd tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:01.596945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-86107f8b-e01e-4575-8bfa-f3feee4792bd tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:01.607856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86107f8b-e01e-4575-8bfa-f3feee4792bd tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:01.608504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86107f8b-e01e-4575-8bfa-f3feee4792bd tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:01.609057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86107f8b-e01e-4575-8bfa-f3feee4792bd tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:01.609903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86107f8b-e01e-4575-8bfa-f3feee4792bd tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:01.610481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86107f8b-e01e-4575-8bfa-f3feee4792bd tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:01.611005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86107f8b-e01e-4575-8bfa-f3feee4792bd tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:01.852796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-86107f8b-e01e-4575-8bfa-f3feee4792bd tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:01.865637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-86107f8b-e01e-4575-8bfa-f3feee4792bd tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:01.874458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-86107f8b-e01e-4575-8bfa-f3feee4792bd tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:01.876289 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-86107f8b-e01e-4575-8bfa-f3feee4792bd tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1741 microversion: 2.20 time: 0.292660 Oct 27 19:07:01.895708 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2371/4553] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:01 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1741 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:01.901768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1026845b-a88c-4640-b33b-3d7e10611d9f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:01.909216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1026845b-a88c-4640-b33b-3d7e10611d9f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:01.928611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1026845b-a88c-4640-b33b-3d7e10611d9f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:01.929224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1026845b-a88c-4640-b33b-3d7e10611d9f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:01.929575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1026845b-a88c-4640-b33b-3d7e10611d9f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:01.930295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1026845b-a88c-4640-b33b-3d7e10611d9f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:01.930787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1026845b-a88c-4640-b33b-3d7e10611d9f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:01.931226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1026845b-a88c-4640-b33b-3d7e10611d9f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:02.109939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] validate_networks() for [('0e03b86b-4627-4072-8ddb-a6a80f18beba', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:07:02.118084 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1026845b-a88c-4640-b33b-3d7e10611d9f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "POST /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e/action" status: 202 len: 0 microversion: 2.1 time: 0.220678 Oct 27 19:07:02.122494 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2372/4554] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:07:01 2022] POST /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:07:02.131355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-90c74a0b-94f8-4b72-bb6f-305218f396e2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:02.136880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-90c74a0b-94f8-4b72-bb6f-305218f396e2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:02.150080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90c74a0b-94f8-4b72-bb6f-305218f396e2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:02.150955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90c74a0b-94f8-4b72-bb6f-305218f396e2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:02.154879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90c74a0b-94f8-4b72-bb6f-305218f396e2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:02.155927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90c74a0b-94f8-4b72-bb6f-305218f396e2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:02.156612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90c74a0b-94f8-4b72-bb6f-305218f396e2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:02.159749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90c74a0b-94f8-4b72-bb6f-305218f396e2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:02.697255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-90c74a0b-94f8-4b72-bb6f-305218f396e2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:02.715621 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-90c74a0b-94f8-4b72-bb6f-305218f396e2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1316 microversion: 2.1 time: 0.591721 Oct 27 19:07:02.722068 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2373/4555] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:02 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1316 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:02.729566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0b5c27b7-adc2-4005-b3a6-078566558363 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:02.730211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0b5c27b7-adc2-4005-b3a6-078566558363 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:02.761689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b5c27b7-adc2-4005-b3a6-078566558363 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:02.762216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b5c27b7-adc2-4005-b3a6-078566558363 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:02.762696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b5c27b7-adc2-4005-b3a6-078566558363 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:02.765418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b5c27b7-adc2-4005-b3a6-078566558363 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:02.765902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b5c27b7-adc2-4005-b3a6-078566558363 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:02.774177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b5c27b7-adc2-4005-b3a6-078566558363 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:03.460434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0b5c27b7-adc2-4005-b3a6-078566558363 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:03.468999 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0b5c27b7-adc2-4005-b3a6-078566558363 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1508 microversion: 2.1 time: 0.745575 Oct 27 19:07:03.474070 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2374/4556] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:02 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1508 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:03.481068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7157d940-3054-4398-8a11-a6ab2f16b06a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:03.484049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7157d940-3054-4398-8a11-a6ab2f16b06a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:03.498549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7157d940-3054-4398-8a11-a6ab2f16b06a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:03.499312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7157d940-3054-4398-8a11-a6ab2f16b06a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:03.499926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7157d940-3054-4398-8a11-a6ab2f16b06a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:03.500845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7157d940-3054-4398-8a11-a6ab2f16b06a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:03.503066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7157d940-3054-4398-8a11-a6ab2f16b06a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:03.503810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7157d940-3054-4398-8a11-a6ab2f16b06a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:03.742421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:07:03.743422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:07:03.744063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:07:03.744816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:07:03.745404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:07:03.750088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:03.772011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:03.773818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:03.775293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:03.778739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:03.779435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:03.780111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:03.850699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:07:03.863184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for user e7d5767d1dc249cd8e97097588ee4728 and project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:07:03.898812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:07:03.907960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:07:04.012040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7157d940-3054-4398-8a11-a6ab2f16b06a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:04.022406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7157d940-3054-4398-8a11-a6ab2f16b06a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:04.030398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7157d940-3054-4398-8a11-a6ab2f16b06a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:04.031950 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7157d940-3054-4398-8a11-a6ab2f16b06a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1723 microversion: 2.20 time: 0.556598 Oct 27 19:07:04.056459 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2375/4557] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:03 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1723 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:04.068452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-4c804467-9fec-4154-a45c-c3642402678c req-64254138-09be-43d7-a5ff-91389f98a1ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "705c6206-67e4-43dc-8bb1-7ea3367b308f", "name": "network-vif-plugged", "status": "completed", "tag": "6ac99626-c0d5-4edf-9802-a94a88adee2d"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:04.089187 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-408fd366-38a2-4886-b119-8c4ead7a375a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.707079 Oct 27 19:07:04.091025 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2183/4558] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:06:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 9712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 19:07:04.098823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4c804467-9fec-4154-a45c-c3642402678c req-64254138-09be-43d7-a5ff-91389f98a1ba service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:04.120381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4c804467-9fec-4154-a45c-c3642402678c req-64254138-09be-43d7-a5ff-91389f98a1ba service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:04.121283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4c804467-9fec-4154-a45c-c3642402678c req-64254138-09be-43d7-a5ff-91389f98a1ba service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:04.125402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b9de8096-1335-456d-8545-0d21f585eb22 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:04.127759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b9de8096-1335-456d-8545-0d21f585eb22 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:04.177708 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-4c804467-9fec-4154-a45c-c3642402678c req-64254138-09be-43d7-a5ff-91389f98a1ba service nova] Creating event network-vif-plugged:6ac99626-c0d5-4edf-9802-a94a88adee2d for instance 705c6206-67e4-43dc-8bb1-7ea3367b308f on n-h2-860687-3 Oct 27 19:07:04.192940 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-4c804467-9fec-4154-a45c-c3642402678c req-64254138-09be-43d7-a5ff-91389f98a1ba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134523 Oct 27 19:07:04.193613 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2376/4559] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:04.210808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4c316f8f-ba3a-49b8-a843-bcba92004bdc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:04.211523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4c316f8f-ba3a-49b8-a843-bcba92004bdc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:04.221061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9de8096-1335-456d-8545-0d21f585eb22 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:04.221562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9de8096-1335-456d-8545-0d21f585eb22 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:04.222024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9de8096-1335-456d-8545-0d21f585eb22 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:04.250359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9de8096-1335-456d-8545-0d21f585eb22 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:04.251147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9de8096-1335-456d-8545-0d21f585eb22 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:04.275719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9de8096-1335-456d-8545-0d21f585eb22 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:04.328108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4c316f8f-ba3a-49b8-a843-bcba92004bdc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:04.344619 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4c316f8f-ba3a-49b8-a843-bcba92004bdc tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1209 microversion: 2.1 time: 0.149771 Oct 27 19:07:04.370276 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2377/4560] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:04 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1209 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:04.498198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-16b125e4-72a6-4919-9dbe-44fbe356619a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:04.498858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-16b125e4-72a6-4919-9dbe-44fbe356619a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:04.506504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16b125e4-72a6-4919-9dbe-44fbe356619a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:04.507061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16b125e4-72a6-4919-9dbe-44fbe356619a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:04.507511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16b125e4-72a6-4919-9dbe-44fbe356619a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:04.508225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16b125e4-72a6-4919-9dbe-44fbe356619a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:04.508683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16b125e4-72a6-4919-9dbe-44fbe356619a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:04.523854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16b125e4-72a6-4919-9dbe-44fbe356619a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:05.041621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-16b125e4-72a6-4919-9dbe-44fbe356619a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:05.050709 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-16b125e4-72a6-4919-9dbe-44fbe356619a tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1513 microversion: 2.1 time: 0.556576 Oct 27 19:07:05.054704 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2378/4561] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:04 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1513 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:07:05.069645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e207cb79-ffc1-4b90-ba9a-f21d3e52ca42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:05.070695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e207cb79-ffc1-4b90-ba9a-f21d3e52ca42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:05.083268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e207cb79-ffc1-4b90-ba9a-f21d3e52ca42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:05.086855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e207cb79-ffc1-4b90-ba9a-f21d3e52ca42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:05.087524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e207cb79-ffc1-4b90-ba9a-f21d3e52ca42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:05.088483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e207cb79-ffc1-4b90-ba9a-f21d3e52ca42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:05.089109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e207cb79-ffc1-4b90-ba9a-f21d3e52ca42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:05.091082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e207cb79-ffc1-4b90-ba9a-f21d3e52ca42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:05.124977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b9de8096-1335-456d-8545-0d21f585eb22 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:05.135599 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b9de8096-1335-456d-8545-0d21f585eb22 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1316 microversion: 2.1 time: 1.042832 Oct 27 19:07:05.143601 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2184/4562] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:04 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1316 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:05.373153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f5000a6d-cecc-4a2f-9fbd-080ff27b9c1b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:05.374060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f5000a6d-cecc-4a2f-9fbd-080ff27b9c1b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:05.425475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e207cb79-ffc1-4b90-ba9a-f21d3e52ca42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:05.435121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e207cb79-ffc1-4b90-ba9a-f21d3e52ca42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:05.453165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e207cb79-ffc1-4b90-ba9a-f21d3e52ca42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:05.458416 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e207cb79-ffc1-4b90-ba9a-f21d3e52ca42 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1723 microversion: 2.20 time: 0.392906 Oct 27 19:07:05.459314 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2379/4563] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:05 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1723 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:07:05.660324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f5000a6d-cecc-4a2f-9fbd-080ff27b9c1b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:05.672147 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f5000a6d-cecc-4a2f-9fbd-080ff27b9c1b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1209 microversion: 2.1 time: 0.303226 Oct 27 19:07:05.677310 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2185/4564] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:05 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1209 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:07:06.078343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-69aa219e-4da2-4ecd-b49a-ef5744af694d tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:06.079142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-69aa219e-4da2-4ecd-b49a-ef5744af694d tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:06.094449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69aa219e-4da2-4ecd-b49a-ef5744af694d tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:06.098220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69aa219e-4da2-4ecd-b49a-ef5744af694d tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:06.105337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69aa219e-4da2-4ecd-b49a-ef5744af694d tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:06.120152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69aa219e-4da2-4ecd-b49a-ef5744af694d tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:06.121038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69aa219e-4da2-4ecd-b49a-ef5744af694d tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:06.127420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69aa219e-4da2-4ecd-b49a-ef5744af694d tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:06.175370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a4fb8adc-1a9b-4c71-9271-eeb9e455019f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:06.176302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a4fb8adc-1a9b-4c71-9271-eeb9e455019f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:06.223045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4fb8adc-1a9b-4c71-9271-eeb9e455019f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:06.225997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4fb8adc-1a9b-4c71-9271-eeb9e455019f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:06.228180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4fb8adc-1a9b-4c71-9271-eeb9e455019f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:06.230477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4fb8adc-1a9b-4c71-9271-eeb9e455019f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:06.244215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4fb8adc-1a9b-4c71-9271-eeb9e455019f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:06.250057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4fb8adc-1a9b-4c71-9271-eeb9e455019f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:06.578264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-69aa219e-4da2-4ecd-b49a-ef5744af694d tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:06.587903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:06.596349 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-69aa219e-4da2-4ecd-b49a-ef5744af694d tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1506 microversion: 2.1 time: 0.521599 Oct 27 19:07:06.601088 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2380/4565] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:06 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1506 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:06.610700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d853741a-2f36-4e36-9bfa-5abf8dca398f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:06.612732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d853741a-2f36-4e36-9bfa-5abf8dca398f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:06.626347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d853741a-2f36-4e36-9bfa-5abf8dca398f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:06.631107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d853741a-2f36-4e36-9bfa-5abf8dca398f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:06.632526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d853741a-2f36-4e36-9bfa-5abf8dca398f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:06.633690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d853741a-2f36-4e36-9bfa-5abf8dca398f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:06.635421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d853741a-2f36-4e36-9bfa-5abf8dca398f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:06.640738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d853741a-2f36-4e36-9bfa-5abf8dca398f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:06.985545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d853741a-2f36-4e36-9bfa-5abf8dca398f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:06.996547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d853741a-2f36-4e36-9bfa-5abf8dca398f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:06.998256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d853741a-2f36-4e36-9bfa-5abf8dca398f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:07.002279 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d853741a-2f36-4e36-9bfa-5abf8dca398f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1723 microversion: 2.20 time: 0.399539 Oct 27 19:07:07.037963 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2381/4566] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:06 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:07.052662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42002f2d-28eb-4b31-9622-c4844dac0d44 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '.version_select at 0x7fc86a0e9af0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:07.060426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-42002f2d-28eb-4b31-9622-c4844dac0d44 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:07.091953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42002f2d-28eb-4b31-9622-c4844dac0d44 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:07.094294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42002f2d-28eb-4b31-9622-c4844dac0d44 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:07.101311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42002f2d-28eb-4b31-9622-c4844dac0d44 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:07.102372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42002f2d-28eb-4b31-9622-c4844dac0d44 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:07.103081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42002f2d-28eb-4b31-9622-c4844dac0d44 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:07.103710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42002f2d-28eb-4b31-9622-c4844dac0d44 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:07.170751 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-42002f2d-28eb-4b31-9622-c4844dac0d44 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.131222 Oct 27 19:07:07.175525 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2382/4567] 10.222.0.42 () {58 vars in 1296 bytes} [Thu Oct 27 19:07:07 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e/os-instance-actions => generated 611 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:07.180911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a5336851-fdfd-4577-a213-c4808d52b9c2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:07.192441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a5336851-fdfd-4577-a213-c4808d52b9c2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:07.199541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5336851-fdfd-4577-a213-c4808d52b9c2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:07.202204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5336851-fdfd-4577-a213-c4808d52b9c2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:07.202952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5336851-fdfd-4577-a213-c4808d52b9c2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:07.203877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5336851-fdfd-4577-a213-c4808d52b9c2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:07.204503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5336851-fdfd-4577-a213-c4808d52b9c2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:07.205396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5336851-fdfd-4577-a213-c4808d52b9c2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:07.347997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a4fb8adc-1a9b-4c71-9271-eeb9e455019f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:07.356029 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a4fb8adc-1a9b-4c71-9271-eeb9e455019f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1316 microversion: 2.1 time: 1.186621 Oct 27 19:07:07.363667 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2186/4568] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:06 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1316 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:07:07.374889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-6ae9988e-9e08-47fc-86dd-2548b3b83140 req-dd987c35-6732-4d1e-be0c-bb501955a55b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b128ff-a00c-4607-8088-1988263fbe79", "name": "network-vif-unplugged", "status": "completed", "tag": "2beafeb2-d863-4916-9b9f-2b9876bdf5ff"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:07.427784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a5336851-fdfd-4577-a213-c4808d52b9c2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:07.437995 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a5336851-fdfd-4577-a213-c4808d52b9c2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1279 microversion: 2.1 time: 0.260906 Oct 27 19:07:07.446981 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2383/4569] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:07 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1279 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:07.460864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b654e88-2671-4ba1-8785-685c28b19d8f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:07.461748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1b654e88-2671-4ba1-8785-685c28b19d8f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:07.480429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b654e88-2671-4ba1-8785-685c28b19d8f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:07.483433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b654e88-2671-4ba1-8785-685c28b19d8f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:07.487054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b654e88-2671-4ba1-8785-685c28b19d8f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:07.490143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b654e88-2671-4ba1-8785-685c28b19d8f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:07.490853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b654e88-2671-4ba1-8785-685c28b19d8f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:07.496158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6ae9988e-9e08-47fc-86dd-2548b3b83140 req-dd987c35-6732-4d1e-be0c-bb501955a55b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:07.498092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b654e88-2671-4ba1-8785-685c28b19d8f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:07.500065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6ae9988e-9e08-47fc-86dd-2548b3b83140 req-dd987c35-6732-4d1e-be0c-bb501955a55b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:07.500537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6ae9988e-9e08-47fc-86dd-2548b3b83140 req-dd987c35-6732-4d1e-be0c-bb501955a55b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:07.559284 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-6ae9988e-9e08-47fc-86dd-2548b3b83140 req-dd987c35-6732-4d1e-be0c-bb501955a55b service nova] Creating event network-vif-unplugged:2beafeb2-d863-4916-9b9f-2b9876bdf5ff for instance 96b128ff-a00c-4607-8088-1988263fbe79 on n-h2-860687-3 Oct 27 19:07:07.561864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1b654e88-2671-4ba1-8785-685c28b19d8f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:07:07.571436 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-6ae9988e-9e08-47fc-86dd-2548b3b83140 req-dd987c35-6732-4d1e-be0c-bb501955a55b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.203846 Oct 27 19:07:07.572680 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2187/4570] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:07.858724 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1b654e88-2671-4ba1-8785-685c28b19d8f tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 204 len: 0 microversion: 2.1 time: 0.410039 Oct 27 19:07:07.859219 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2384/4571] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:07:07 2022] DELETE /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:07:07.869235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0cdea7c1-1159-49b8-b1d3-57b46c4218cd tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:07.870034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0cdea7c1-1159-49b8-b1d3-57b46c4218cd tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:07.887193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cdea7c1-1159-49b8-b1d3-57b46c4218cd tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:07.888722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cdea7c1-1159-49b8-b1d3-57b46c4218cd tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:07.893035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cdea7c1-1159-49b8-b1d3-57b46c4218cd tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:07.896237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cdea7c1-1159-49b8-b1d3-57b46c4218cd tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:07.897087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cdea7c1-1159-49b8-b1d3-57b46c4218cd tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:07.899357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cdea7c1-1159-49b8-b1d3-57b46c4218cd tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:08.038782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7eefbbbb-47f2-4bc7-b372-bb470f1fa550 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:08.041296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7eefbbbb-47f2-4bc7-b372-bb470f1fa550 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:08.073244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eefbbbb-47f2-4bc7-b372-bb470f1fa550 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:08.075685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eefbbbb-47f2-4bc7-b372-bb470f1fa550 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:08.079197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eefbbbb-47f2-4bc7-b372-bb470f1fa550 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:08.082026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eefbbbb-47f2-4bc7-b372-bb470f1fa550 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:08.084143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eefbbbb-47f2-4bc7-b372-bb470f1fa550 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:08.090217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eefbbbb-47f2-4bc7-b372-bb470f1fa550 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:08.552748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0cdea7c1-1159-49b8-b1d3-57b46c4218cd tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:08.582875 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0cdea7c1-1159-49b8-b1d3-57b46c4218cd tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1512 microversion: 2.1 time: 0.718816 Oct 27 19:07:08.602745 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2188/4572] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:07 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1512 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:08.608170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-79028f6b-59c8-428f-b738-862d797731c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:08.609801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-79028f6b-59c8-428f-b738-862d797731c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:08.635611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79028f6b-59c8-428f-b738-862d797731c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:08.636354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79028f6b-59c8-428f-b738-862d797731c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:08.636979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79028f6b-59c8-428f-b738-862d797731c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:08.637883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79028f6b-59c8-428f-b738-862d797731c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:08.638552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79028f6b-59c8-428f-b738-862d797731c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:08.639169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79028f6b-59c8-428f-b738-862d797731c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:09.292374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7eefbbbb-47f2-4bc7-b372-bb470f1fa550 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:09.321437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7eefbbbb-47f2-4bc7-b372-bb470f1fa550 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:09.328680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7eefbbbb-47f2-4bc7-b372-bb470f1fa550 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:09.332218 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7eefbbbb-47f2-4bc7-b372-bb470f1fa550 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1723 microversion: 2.20 time: 1.299639 Oct 27 19:07:09.335683 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2385/4573] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:08 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1723 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:07:09.346897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e61c23eb-2437-40d0-8e27-1d4f696b69a7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:09.355603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e61c23eb-2437-40d0-8e27-1d4f696b69a7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:09.383950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e61c23eb-2437-40d0-8e27-1d4f696b69a7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:09.388773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e61c23eb-2437-40d0-8e27-1d4f696b69a7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:09.390972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e61c23eb-2437-40d0-8e27-1d4f696b69a7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:09.404360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e61c23eb-2437-40d0-8e27-1d4f696b69a7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:09.409994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e61c23eb-2437-40d0-8e27-1d4f696b69a7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:09.410737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e61c23eb-2437-40d0-8e27-1d4f696b69a7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:10.111899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-79028f6b-59c8-428f-b738-862d797731c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:10.115795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:10.124591 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-79028f6b-59c8-428f-b738-862d797731c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1466 microversion: 2.1 time: 1.520425 Oct 27 19:07:10.126039 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2189/4574] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:08 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1466 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:10.132257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-145bcd6c-8d71-44e6-a429-035916fe3854 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:10.133142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-145bcd6c-8d71-44e6-a429-035916fe3854 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:10.140417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-145bcd6c-8d71-44e6-a429-035916fe3854 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:10.141267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-145bcd6c-8d71-44e6-a429-035916fe3854 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:10.141890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-145bcd6c-8d71-44e6-a429-035916fe3854 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:10.143092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-145bcd6c-8d71-44e6-a429-035916fe3854 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:10.143748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-145bcd6c-8d71-44e6-a429-035916fe3854 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:10.144345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-145bcd6c-8d71-44e6-a429-035916fe3854 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:10.485660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e61c23eb-2437-40d0-8e27-1d4f696b69a7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:10.499833 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e61c23eb-2437-40d0-8e27-1d4f696b69a7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1309 microversion: 2.1 time: 1.162346 Oct 27 19:07:10.522642 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2386/4575] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:09 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1309 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:10.531183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-312c6090-0d35-4992-89bd-44ee49acca02 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:10.533969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-312c6090-0d35-4992-89bd-44ee49acca02 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:10.545422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-312c6090-0d35-4992-89bd-44ee49acca02 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:10.546439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-312c6090-0d35-4992-89bd-44ee49acca02 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:10.547166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-312c6090-0d35-4992-89bd-44ee49acca02 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:10.570593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-312c6090-0d35-4992-89bd-44ee49acca02 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:10.571564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-312c6090-0d35-4992-89bd-44ee49acca02 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:10.572649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-312c6090-0d35-4992-89bd-44ee49acca02 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:11.169625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-145bcd6c-8d71-44e6-a429-035916fe3854 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:11.187424 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-145bcd6c-8d71-44e6-a429-035916fe3854 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1512 microversion: 2.1 time: 1.052384 Oct 27 19:07:11.194667 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2190/4576] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:10 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1512 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:11.206743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7a3fee84-3d9f-4d7d-8698-13e43d44720e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:11.208405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7a3fee84-3d9f-4d7d-8698-13e43d44720e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:11.224607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a3fee84-3d9f-4d7d-8698-13e43d44720e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:11.225112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a3fee84-3d9f-4d7d-8698-13e43d44720e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:11.225740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a3fee84-3d9f-4d7d-8698-13e43d44720e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:11.231721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a3fee84-3d9f-4d7d-8698-13e43d44720e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:11.232475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a3fee84-3d9f-4d7d-8698-13e43d44720e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:11.233155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a3fee84-3d9f-4d7d-8698-13e43d44720e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:11.398760 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-312c6090-0d35-4992-89bd-44ee49acca02 tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1617 microversion: 2.1 time: 0.870655 Oct 27 19:07:11.399401 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2387/4577] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:10 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1617 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:11.532501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d85a06d0-1707-4e2a-8348-3d922335cfda tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:11.533478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d85a06d0-1707-4e2a-8348-3d922335cfda tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:11.552939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d85a06d0-1707-4e2a-8348-3d922335cfda tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:11.554714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d85a06d0-1707-4e2a-8348-3d922335cfda tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:11.555193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d85a06d0-1707-4e2a-8348-3d922335cfda tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:11.558538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d85a06d0-1707-4e2a-8348-3d922335cfda tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:11.569961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d85a06d0-1707-4e2a-8348-3d922335cfda tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:11.571087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d85a06d0-1707-4e2a-8348-3d922335cfda tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:12.375019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7a3fee84-3d9f-4d7d-8698-13e43d44720e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:12.399524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7a3fee84-3d9f-4d7d-8698-13e43d44720e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:12.403401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7a3fee84-3d9f-4d7d-8698-13e43d44720e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:12.405825 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7a3fee84-3d9f-4d7d-8698-13e43d44720e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1666 microversion: 2.20 time: 1.209730 Oct 27 19:07:12.408685 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2191/4578] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:11 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1666 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:12.434620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-658990125", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "847d3fc3-fa4c-4211-9900-d6a2fdcaae8a"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:12.507721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d85a06d0-1707-4e2a-8348-3d922335cfda tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:12.517537 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d85a06d0-1707-4e2a-8348-3d922335cfda tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1309 microversion: 2.1 time: 0.992170 Oct 27 19:07:12.521585 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2388/4579] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:11 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1309 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:07:12.530818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6357fbca-7440-4f7f-92e6-ede0ed871575 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:12.538361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6357fbca-7440-4f7f-92e6-ede0ed871575 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:12.549222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6357fbca-7440-4f7f-92e6-ede0ed871575 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:12.555122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6357fbca-7440-4f7f-92e6-ede0ed871575 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:12.555987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6357fbca-7440-4f7f-92e6-ede0ed871575 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:12.556926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6357fbca-7440-4f7f-92e6-ede0ed871575 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:12.557553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6357fbca-7440-4f7f-92e6-ede0ed871575 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:12.558148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6357fbca-7440-4f7f-92e6-ede0ed871575 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:12.653828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:07:12.670669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:12.688844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6357fbca-7440-4f7f-92e6-ede0ed871575 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:12.692034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6357fbca-7440-4f7f-92e6-ede0ed871575 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:12.693083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6357fbca-7440-4f7f-92e6-ede0ed871575 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:12.697294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-6357fbca-7440-4f7f-92e6-ede0ed871575 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lazy-loading 'fault' on Instance uuid eb6b630b-532e-4cae-a7ec-4425b7e94d0e {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:07:12.971203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6357fbca-7440-4f7f-92e6-ede0ed871575 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d7b88b73614736826d197244990123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c21c511d9424e63b900c5cecc28f2c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:13.022011 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6357fbca-7440-4f7f-92e6-ede0ed871575 tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 200 len: 1306 microversion: 2.1 time: 0.498470 Oct 27 19:07:13.049275 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2389/4580] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:12 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 1306 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:13.081075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-42f3d412-f824-404a-b88a-eb731d35c834 req-7aaa0486-ae78-4133-a892-d665b651c86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6b630b-532e-4cae-a7ec-4425b7e94d0e", "name": "network-vif-deleted", "tag": "43575250-3770-4612-8105-6f12c8b1ffaa"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:13.133693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-42f3d412-f824-404a-b88a-eb731d35c834 req-7aaa0486-ae78-4133-a892-d665b651c86c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:13.135379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-42f3d412-f824-404a-b88a-eb731d35c834 req-7aaa0486-ae78-4133-a892-d665b651c86c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:13.136618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-42f3d412-f824-404a-b88a-eb731d35c834 req-7aaa0486-ae78-4133-a892-d665b651c86c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:13.181850 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-42f3d412-f824-404a-b88a-eb731d35c834 req-7aaa0486-ae78-4133-a892-d665b651c86c service nova] Creating event network-vif-deleted:43575250-3770-4612-8105-6f12c8b1ffaa for instance eb6b630b-532e-4cae-a7ec-4425b7e94d0e on n-h1-860687-3 Oct 27 19:07:13.191565 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-42f3d412-f824-404a-b88a-eb731d35c834 req-7aaa0486-ae78-4133-a892-d665b651c86c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139520 Oct 27 19:07:13.192964 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2390/4581] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:13.200187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-18acf155-3e50-4325-80ac-d64b654d0382 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5df621f2-ab73-4348-98db-237a004f5d93"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:13.203681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-18acf155-3e50-4325-80ac-d64b654d0382 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:13.212771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18acf155-3e50-4325-80ac-d64b654d0382 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:13.213735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18acf155-3e50-4325-80ac-d64b654d0382 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:13.214687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18acf155-3e50-4325-80ac-d64b654d0382 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:13.216106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18acf155-3e50-4325-80ac-d64b654d0382 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:13.216433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18acf155-3e50-4325-80ac-d64b654d0382 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:13.217071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18acf155-3e50-4325-80ac-d64b654d0382 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:13.684164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:07:13.685272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:07:13.685978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:07:13.686686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:07:13.687349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:07:13.710905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:13.711747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:13.712457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:13.714318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:13.715076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:13.720981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:13.782304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for project 50a8ecec5b084df386bc976017133fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:07:13.810368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Getting quotas for user ad24b0a4144342ceaa2c7470cf529f15 and project 50a8ecec5b084df386bc976017133fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:07:13.843302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:07:13.849903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:07:13.979490 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-02c89bcc-23ab-4b0e-a2e6-0bbe286d316e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.569582 Oct 27 19:07:13.983729 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2192/4582] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:07:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:07:13.992485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-75b5a70d-619c-4fac-830b-adc64bad68e8 req-348522f2-4cd9-4dff-a54b-e0073ec90d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59682c2-3372-419f-b903-46d5e52dfcbb", "tag": "83220988-6c10-4402-a973-6d9b68efdae2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:14.023372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-75b5a70d-619c-4fac-830b-adc64bad68e8 req-348522f2-4cd9-4dff-a54b-e0073ec90d73 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:14.024877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-75b5a70d-619c-4fac-830b-adc64bad68e8 req-348522f2-4cd9-4dff-a54b-e0073ec90d73 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:14.025563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-75b5a70d-619c-4fac-830b-adc64bad68e8 req-348522f2-4cd9-4dff-a54b-e0073ec90d73 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:14.051648 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-75b5a70d-619c-4fac-830b-adc64bad68e8 req-348522f2-4cd9-4dff-a54b-e0073ec90d73 service nova] Creating event network-changed:83220988-6c10-4402-a973-6d9b68efdae2 for instance b59682c2-3372-419f-b903-46d5e52dfcbb on n-h1-860687-3 Oct 27 19:07:14.059880 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-75b5a70d-619c-4fac-830b-adc64bad68e8 req-348522f2-4cd9-4dff-a54b-e0073ec90d73 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074558 Oct 27 19:07:14.062954 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2193/4583] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:14.075853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fd9e4e79-6c8f-4d64-a2ca-7ef1a1f9e284 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:14.079093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fd9e4e79-6c8f-4d64-a2ca-7ef1a1f9e284 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:14.104623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd9e4e79-6c8f-4d64-a2ca-7ef1a1f9e284 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:14.105592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd9e4e79-6c8f-4d64-a2ca-7ef1a1f9e284 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:14.106291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd9e4e79-6c8f-4d64-a2ca-7ef1a1f9e284 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:14.107290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd9e4e79-6c8f-4d64-a2ca-7ef1a1f9e284 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:14.108032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd9e4e79-6c8f-4d64-a2ca-7ef1a1f9e284 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:14.109137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd9e4e79-6c8f-4d64-a2ca-7ef1a1f9e284 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:14.230475 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-18acf155-3e50-4325-80ac-d64b654d0382 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "POST /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.036039 Oct 27 19:07:14.237556 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2391/4584] 10.222.0.42 () {62 vars in 1364 bytes} [Thu Oct 27 19:07:13 2022] POST /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79/os-volume_attachments => generated 188 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:07:14.242430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ef10ac08-0e90-484c-ada4-94a6d5ca9dff tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:14.258676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ef10ac08-0e90-484c-ada4-94a6d5ca9dff tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:14.345730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:14.513772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ef10ac08-0e90-484c-ada4-94a6d5ca9dff tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:14.530665 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ef10ac08-0e90-484c-ada4-94a6d5ca9dff tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1216 microversion: 2.1 time: 0.291035 Oct 27 19:07:14.531598 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2392/4585] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:14 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1216 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:14.545134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-30ce123f-321b-4b13-b936-e52c00bdb0df tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:14.546302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-30ce123f-321b-4b13-b936-e52c00bdb0df tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] [instance: eb6b630b-532e-4cae-a7ec-4425b7e94d0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:14.567382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ce123f-321b-4b13-b936-e52c00bdb0df tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:14.572488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ce123f-321b-4b13-b936-e52c00bdb0df tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:14.573859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ce123f-321b-4b13-b936-e52c00bdb0df tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:14.574679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ce123f-321b-4b13-b936-e52c00bdb0df tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:14.577115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ce123f-321b-4b13-b936-e52c00bdb0df tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:14.577586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-30ce123f-321b-4b13-b936-e52c00bdb0df tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:14.622045 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-30ce123f-321b-4b13-b936-e52c00bdb0df tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] HTTP exception thrown: Instance eb6b630b-532e-4cae-a7ec-4425b7e94d0e could not be found. Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-30ce123f-321b-4b13-b936-e52c00bdb0df tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Request method failure captured: Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e HTTP/1.1 Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWta1fQtdEioCsq6ptAPKL7yUNnDoU5asWYw0mGjVTvhTyF97DYgO-0inWxmWCAAuC-P5gNgaW10hL8EXkQGdglE1kbwSqkWcivCMrlgITrJB_BCxxdQ3KPW3ZejaaqzZaSYxS0WozwaUCCIvsZqI8WUH4R9RZkQ-hi9bAE8ua9EA4_c Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 5c21c511d9424e63b900c5cecc28f2c9 Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-InstanceActionsTestJSON-804588687 Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5c21c511d9424e63b900c5cecc28f2c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5c21c511d9424e63b900c5cecc28f2c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5c21c511d9424e63b900c5cecc28f2c9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5c21c511d9424e63b900c5cecc28f2c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-InstanceActionsTestJSON-804588687 Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 5c21c511d9424e63b900c5cecc28f2c9 Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-InstanceActionsTestJSON-804588687 Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-InstanceActionsTestJSON-804588687-project Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 29d7b88b73614736826d197244990123 Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-InstanceActionsTestJSON-804588687-project Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance eb6b630b-532e-4cae-a7ec-4425b7e94d0e could not be found. Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'eb6b630b-532e-4cae-a7ec-4425b7e94d0e'} Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6b630b-532e-4cae-a7ec-4425b7e94d0e could not be found. Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6b630b-532e-4cae-a7ec-4425b7e94d0e could not be found. Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:07:14.633006 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:07:14.638887 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:07:14.638887 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:07:14.638887 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:07:14.638887 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:07:14.638887 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:07:14.638887 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6b630b-532e-4cae-a7ec-4425b7e94d0e could not be found. Oct 27 19:07:14.638887 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:07:14.643351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-30ce123f-321b-4b13-b936-e52c00bdb0df tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] Returning 404 to user: Instance eb6b630b-532e-4cae-a7ec-4425b7e94d0e could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:07:14.649764 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-30ce123f-321b-4b13-b936-e52c00bdb0df tempest-InstanceActionsTestJSON-804588687 tempest-InstanceActionsTestJSON-804588687-project] 10.222.0.42 "GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e" status: 404 len: 111 microversion: 2.1 time: 0.114664 Oct 27 19:07:14.654872 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2393/4586] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:14 2022] GET /compute/v2.1/servers/eb6b630b-532e-4cae-a7ec-4425b7e94d0e => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:07:14.667277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4749d8f0-904a-4c5f-80b0-bfa36e3caa9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:14.688619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4749d8f0-904a-4c5f-80b0-bfa36e3caa9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:14.710481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4749d8f0-904a-4c5f-80b0-bfa36e3caa9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:14.710985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4749d8f0-904a-4c5f-80b0-bfa36e3caa9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:14.711444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4749d8f0-904a-4c5f-80b0-bfa36e3caa9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:14.714351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4749d8f0-904a-4c5f-80b0-bfa36e3caa9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:14.714879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4749d8f0-904a-4c5f-80b0-bfa36e3caa9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:14.715318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4749d8f0-904a-4c5f-80b0-bfa36e3caa9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:14.954301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:15.074637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd9e4e79-6c8f-4d64-a2ca-7ef1a1f9e284 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:15.101905 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fd9e4e79-6c8f-4d64-a2ca-7ef1a1f9e284 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1309 microversion: 2.1 time: 1.037403 Oct 27 19:07:15.115083 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2194/4587] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:14 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1309 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:15.528609 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4749d8f0-904a-4c5f-80b0-bfa36e3caa9f tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "DELETE /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79/os-volume_attachments/5df621f2-ab73-4348-98db-237a004f5d93" status: 202 len: 0 microversion: 2.20 time: 0.872323 Oct 27 19:07:15.531167 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2394/4588] 10.222.0.42 () {60 vars in 1457 bytes} [Thu Oct 27 19:07:14 2022] DELETE /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79/os-volume_attachments/5df621f2-ab73-4348-98db-237a004f5d93 => generated 0 bytes in 875 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:07:15.554063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-910ec8a4-5c6b-4d21-9d36-44e7cb8995c5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:15.555211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-910ec8a4-5c6b-4d21-9d36-44e7cb8995c5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:15.563834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-910ec8a4-5c6b-4d21-9d36-44e7cb8995c5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:15.609847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-910ec8a4-5c6b-4d21-9d36-44e7cb8995c5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:15.610696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-910ec8a4-5c6b-4d21-9d36-44e7cb8995c5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:15.615829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-910ec8a4-5c6b-4d21-9d36-44e7cb8995c5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:15.616594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-910ec8a4-5c6b-4d21-9d36-44e7cb8995c5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:15.618687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-910ec8a4-5c6b-4d21-9d36-44e7cb8995c5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:15.725076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f7da56b8-0acc-48f4-a72a-4b2153964764 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:15.726142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f7da56b8-0acc-48f4-a72a-4b2153964764 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:15.780255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7da56b8-0acc-48f4-a72a-4b2153964764 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:15.780816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7da56b8-0acc-48f4-a72a-4b2153964764 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:15.787050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7da56b8-0acc-48f4-a72a-4b2153964764 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:15.795430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7da56b8-0acc-48f4-a72a-4b2153964764 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:15.800455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7da56b8-0acc-48f4-a72a-4b2153964764 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:15.801803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7da56b8-0acc-48f4-a72a-4b2153964764 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:15.827805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-910ec8a4-5c6b-4d21-9d36-44e7cb8995c5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:15.838187 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-910ec8a4-5c6b-4d21-9d36-44e7cb8995c5 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1220 microversion: 2.1 time: 0.288238 Oct 27 19:07:15.838827 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2195/4589] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:15 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1220 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:15.926753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f7da56b8-0acc-48f4-a72a-4b2153964764 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127029) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 19:07:16.135443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e8181304-d2b8-4c39-97a8-104098d94b1f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:16.136931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e8181304-d2b8-4c39-97a8-104098d94b1f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:16.149318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8181304-d2b8-4c39-97a8-104098d94b1f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:16.156893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8181304-d2b8-4c39-97a8-104098d94b1f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:16.157666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8181304-d2b8-4c39-97a8-104098d94b1f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:16.161154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8181304-d2b8-4c39-97a8-104098d94b1f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:16.162021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8181304-d2b8-4c39-97a8-104098d94b1f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:16.166410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8181304-d2b8-4c39-97a8-104098d94b1f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:16.213974 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f7da56b8-0acc-48f4-a72a-4b2153964764 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "POST /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79/action" status: 202 len: 0 microversion: 2.20 time: 0.494771 Oct 27 19:07:16.217304 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2395/4590] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 19:07:15 2022] POST /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:07:16.232689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9f9a142d-275e-4c4c-9e3a-612c5d98291c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:16.234159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9f9a142d-275e-4c4c-9e3a-612c5d98291c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:16.256079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f9a142d-275e-4c4c-9e3a-612c5d98291c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:16.259058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f9a142d-275e-4c4c-9e3a-612c5d98291c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:16.261371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f9a142d-275e-4c4c-9e3a-612c5d98291c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:16.264482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f9a142d-275e-4c4c-9e3a-612c5d98291c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:16.313122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f9a142d-275e-4c4c-9e3a-612c5d98291c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:16.319186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f9a142d-275e-4c4c-9e3a-612c5d98291c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.051s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:16.728756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8181304-d2b8-4c39-97a8-104098d94b1f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:16.737836 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e8181304-d2b8-4c39-97a8-104098d94b1f tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1309 microversion: 2.1 time: 0.607767 Oct 27 19:07:16.756096 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2196/4591] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:16 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1309 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:16.865592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8b2fe1d6-6136-4629-b10b-1a723b336a47 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:16.866223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8b2fe1d6-6136-4629-b10b-1a723b336a47 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:16.875434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b2fe1d6-6136-4629-b10b-1a723b336a47 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:16.877794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b2fe1d6-6136-4629-b10b-1a723b336a47 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:16.885807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b2fe1d6-6136-4629-b10b-1a723b336a47 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:16.890522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b2fe1d6-6136-4629-b10b-1a723b336a47 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:16.892120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b2fe1d6-6136-4629-b10b-1a723b336a47 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:16.893146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b2fe1d6-6136-4629-b10b-1a723b336a47 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:17.224142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8b2fe1d6-6136-4629-b10b-1a723b336a47 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:17.242059 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8b2fe1d6-6136-4629-b10b-1a723b336a47 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1268 microversion: 2.1 time: 0.377855 Oct 27 19:07:17.244954 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2197/4592] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:16 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1268 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:17.775490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1df026b1-43ef-4a52-98b4-b8f49f450563 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:17.776671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1df026b1-43ef-4a52-98b4-b8f49f450563 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:17.812564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df026b1-43ef-4a52-98b4-b8f49f450563 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:17.813791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df026b1-43ef-4a52-98b4-b8f49f450563 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:17.814414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df026b1-43ef-4a52-98b4-b8f49f450563 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:17.815974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df026b1-43ef-4a52-98b4-b8f49f450563 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:17.817347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df026b1-43ef-4a52-98b4-b8f49f450563 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:17.819082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df026b1-43ef-4a52-98b4-b8f49f450563 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:17.838472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9f9a142d-275e-4c4c-9e3a-612c5d98291c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:17.869915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9f9a142d-275e-4c4c-9e3a-612c5d98291c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:17.880524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9f9a142d-275e-4c4c-9e3a-612c5d98291c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:17.894478 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9f9a142d-275e-4c4c-9e3a-612c5d98291c tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1674 microversion: 2.20 time: 1.665143 Oct 27 19:07:17.894478 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2396/4593] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:16 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1674 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:18.249573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1df026b1-43ef-4a52-98b4-b8f49f450563 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:18.263578 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1df026b1-43ef-4a52-98b4-b8f49f450563 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1309 microversion: 2.1 time: 0.493374 Oct 27 19:07:18.264768 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2198/4594] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:17 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1309 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:18.277566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-66582574-c1ae-4057-9f7e-30c4b8b12bd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:18.284111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-66582574-c1ae-4057-9f7e-30c4b8b12bd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:18.297286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66582574-c1ae-4057-9f7e-30c4b8b12bd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:18.299553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66582574-c1ae-4057-9f7e-30c4b8b12bd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:18.300353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66582574-c1ae-4057-9f7e-30c4b8b12bd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:18.304018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66582574-c1ae-4057-9f7e-30c4b8b12bd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:18.304749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66582574-c1ae-4057-9f7e-30c4b8b12bd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:18.305410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66582574-c1ae-4057-9f7e-30c4b8b12bd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:18.474511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-66582574-c1ae-4057-9f7e-30c4b8b12bd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:18.483028 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-66582574-c1ae-4057-9f7e-30c4b8b12bd8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1274 microversion: 2.1 time: 0.216477 Oct 27 19:07:18.487495 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2199/4595] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:18 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1274 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:18.503811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2096582644", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "e7d83c6b-c0c0-42e5-b094-5dc26599221d"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:18.638838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] validate_networks() for [('e7d83c6b-c0c0-42e5-b094-5dc26599221d', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:07:18.914272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f037c119-4437-4174-9369-6d61342dcdc4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:18.915140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f037c119-4437-4174-9369-6d61342dcdc4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:18.925642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f037c119-4437-4174-9369-6d61342dcdc4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:18.932899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f037c119-4437-4174-9369-6d61342dcdc4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:18.933467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f037c119-4437-4174-9369-6d61342dcdc4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:18.934235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f037c119-4437-4174-9369-6d61342dcdc4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:18.934743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f037c119-4437-4174-9369-6d61342dcdc4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:18.935184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f037c119-4437-4174-9369-6d61342dcdc4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:19.229587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f037c119-4437-4174-9369-6d61342dcdc4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:19.314665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f037c119-4437-4174-9369-6d61342dcdc4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:19.328624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f037c119-4437-4174-9369-6d61342dcdc4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:19.329983 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f037c119-4437-4174-9369-6d61342dcdc4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1674 microversion: 2.20 time: 0.419553 Oct 27 19:07:19.346477 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2200/4596] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:18 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1674 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:07:19.351891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-afafe196-e071-41c7-bade-792ce094ce1b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:19.364060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-afafe196-e071-41c7-bade-792ce094ce1b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:19.384739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afafe196-e071-41c7-bade-792ce094ce1b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:19.385616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afafe196-e071-41c7-bade-792ce094ce1b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:19.386846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afafe196-e071-41c7-bade-792ce094ce1b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:19.387839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afafe196-e071-41c7-bade-792ce094ce1b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:19.389055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afafe196-e071-41c7-bade-792ce094ce1b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:19.389726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afafe196-e071-41c7-bade-792ce094ce1b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:19.682034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-afafe196-e071-41c7-bade-792ce094ce1b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:19.691638 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-afafe196-e071-41c7-bade-792ce094ce1b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1309 microversion: 2.1 time: 0.343616 Oct 27 19:07:19.714916 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2201/4597] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:19 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1309 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:19.726202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a098baea-7c10-41b9-9085-ff87b82783eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:19.727186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a098baea-7c10-41b9-9085-ff87b82783eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:19.742223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a098baea-7c10-41b9-9085-ff87b82783eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:19.742875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a098baea-7c10-41b9-9085-ff87b82783eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:19.743587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a098baea-7c10-41b9-9085-ff87b82783eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:19.744579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a098baea-7c10-41b9-9085-ff87b82783eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:19.745292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a098baea-7c10-41b9-9085-ff87b82783eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:19.745985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a098baea-7c10-41b9-9085-ff87b82783eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:20.010443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a098baea-7c10-41b9-9085-ff87b82783eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:20.019548 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a098baea-7c10-41b9-9085-ff87b82783eb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1274 microversion: 2.1 time: 0.303382 Oct 27 19:07:20.024500 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2202/4598] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:19 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1274 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:20.365302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55eb0f3c-94b5-4861-a16b-fa7b3d4fad24 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:20.375276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-55eb0f3c-94b5-4861-a16b-fa7b3d4fad24 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:20.425736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55eb0f3c-94b5-4861-a16b-fa7b3d4fad24 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:20.438798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55eb0f3c-94b5-4861-a16b-fa7b3d4fad24 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:20.440017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55eb0f3c-94b5-4861-a16b-fa7b3d4fad24 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:20.440796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55eb0f3c-94b5-4861-a16b-fa7b3d4fad24 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:20.441277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55eb0f3c-94b5-4861-a16b-fa7b3d4fad24 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:20.441716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55eb0f3c-94b5-4861-a16b-fa7b3d4fad24 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:21.059968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-55eb0f3c-94b5-4861-a16b-fa7b3d4fad24 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:21.108071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-55eb0f3c-94b5-4861-a16b-fa7b3d4fad24 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:21.110277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:07:21.112922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:07:21.113744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:07:21.114480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:07:21.115167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:07:21.130440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:21.132522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:21.132884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-55eb0f3c-94b5-4861-a16b-fa7b3d4fad24 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:21.134314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:21.135801 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-55eb0f3c-94b5-4861-a16b-fa7b3d4fad24 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1674 microversion: 2.20 time: 0.776541 Oct 27 19:07:21.136903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:21.137618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:21.140658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:21.144380 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2203/4599] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:20 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1674 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:21.170412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bc53a6c2-3084-48e6-ae78-3ee99324f1d5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:21.171039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bc53a6c2-3084-48e6-ae78-3ee99324f1d5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:21.197093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Getting quotas for project 1798d878b8344ec69c9ef0699467718a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:07:21.208270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Getting quotas for user b2237837d17c43e99f4e9961cd27cbb5 and project 1798d878b8344ec69c9ef0699467718a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:07:21.237459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:07:21.242156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc53a6c2-3084-48e6-ae78-3ee99324f1d5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:21.242686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:07:21.242841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc53a6c2-3084-48e6-ae78-3ee99324f1d5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:21.249611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc53a6c2-3084-48e6-ae78-3ee99324f1d5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:21.253184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc53a6c2-3084-48e6-ae78-3ee99324f1d5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:21.255373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc53a6c2-3084-48e6-ae78-3ee99324f1d5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:21.256706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc53a6c2-3084-48e6-ae78-3ee99324f1d5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:21.365813 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fb138e4a-282a-49fb-9cee-eb8a6138e9ee tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.314467 Oct 27 19:07:21.371364 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2397/4600] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:07:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:07:21.386925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7cac037c-b5a4-4683-b58e-7582895bacc4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:21.388511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7cac037c-b5a4-4683-b58e-7582895bacc4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:21.416239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7cac037c-b5a4-4683-b58e-7582895bacc4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:21.418023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7cac037c-b5a4-4683-b58e-7582895bacc4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:21.421338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7cac037c-b5a4-4683-b58e-7582895bacc4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:21.425696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7cac037c-b5a4-4683-b58e-7582895bacc4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:21.429848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7cac037c-b5a4-4683-b58e-7582895bacc4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:21.432639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7cac037c-b5a4-4683-b58e-7582895bacc4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:21.766018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7cac037c-b5a4-4683-b58e-7582895bacc4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:21.773343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bc53a6c2-3084-48e6-ae78-3ee99324f1d5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:21.781493 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7cac037c-b5a4-4683-b58e-7582895bacc4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1274 microversion: 2.1 time: 0.408782 Oct 27 19:07:21.815675 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bc53a6c2-3084-48e6-ae78-3ee99324f1d5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1309 microversion: 2.1 time: 0.670135 Oct 27 19:07:21.816294 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2204/4601] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:21 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1309 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:21.817603 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2398/4602] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:21 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1274 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:21.843030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-edd43be3-c7d6-4602-85f1-b90e5aa71fd3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:21.844078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-edd43be3-c7d6-4602-85f1-b90e5aa71fd3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:22.040083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-edd43be3-c7d6-4602-85f1-b90e5aa71fd3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:22.053708 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-edd43be3-c7d6-4602-85f1-b90e5aa71fd3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1215 microversion: 2.1 time: 0.229068 Oct 27 19:07:22.056662 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2205/4603] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:21 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:22.175838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-081b71cf-7041-4bab-858a-b389ec01a755 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:22.178011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-081b71cf-7041-4bab-858a-b389ec01a755 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:22.192034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-081b71cf-7041-4bab-858a-b389ec01a755 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:22.193499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-081b71cf-7041-4bab-858a-b389ec01a755 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:22.194200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-081b71cf-7041-4bab-858a-b389ec01a755 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:22.196538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-081b71cf-7041-4bab-858a-b389ec01a755 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:22.197348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-081b71cf-7041-4bab-858a-b389ec01a755 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:22.198549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-081b71cf-7041-4bab-858a-b389ec01a755 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:22.812285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c8e0448a-5603-4c9f-b93a-b0f2376e0c34 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:22.815344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c8e0448a-5603-4c9f-b93a-b0f2376e0c34 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:22.845146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8e0448a-5603-4c9f-b93a-b0f2376e0c34 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:22.847624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8e0448a-5603-4c9f-b93a-b0f2376e0c34 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:22.850880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8e0448a-5603-4c9f-b93a-b0f2376e0c34 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:22.854725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8e0448a-5603-4c9f-b93a-b0f2376e0c34 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:22.855766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8e0448a-5603-4c9f-b93a-b0f2376e0c34 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:22.859058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8e0448a-5603-4c9f-b93a-b0f2376e0c34 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:23.078165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-081b71cf-7041-4bab-858a-b389ec01a755 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:23.109568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-081b71cf-7041-4bab-858a-b389ec01a755 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:23.114421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-081b71cf-7041-4bab-858a-b389ec01a755 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:23.124096 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-081b71cf-7041-4bab-858a-b389ec01a755 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.952310 Oct 27 19:07:23.129960 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2399/4604] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:22 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:23.151889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-743e2ed0-2879-4a2d-9cad-283353486712 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:23.154736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-743e2ed0-2879-4a2d-9cad-283353486712 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:23.201569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-743e2ed0-2879-4a2d-9cad-283353486712 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:23.206185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-743e2ed0-2879-4a2d-9cad-283353486712 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:23.206712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-743e2ed0-2879-4a2d-9cad-283353486712 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:23.219593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-743e2ed0-2879-4a2d-9cad-283353486712 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:23.226809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-743e2ed0-2879-4a2d-9cad-283353486712 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:23.227432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-743e2ed0-2879-4a2d-9cad-283353486712 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:23.741651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:23.956626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c8e0448a-5603-4c9f-b93a-b0f2376e0c34 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:23.972325 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c8e0448a-5603-4c9f-b93a-b0f2376e0c34 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1316 microversion: 2.1 time: 1.166699 Oct 27 19:07:23.973365 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2206/4605] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:22 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1316 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:24.008194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-934733e3-86e5-4b27-9e64-066c135391f0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:24.012646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-934733e3-86e5-4b27-9e64-066c135391f0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:24.033769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-934733e3-86e5-4b27-9e64-066c135391f0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:24.034279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-934733e3-86e5-4b27-9e64-066c135391f0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:24.034761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-934733e3-86e5-4b27-9e64-066c135391f0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:24.035490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-934733e3-86e5-4b27-9e64-066c135391f0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:24.046691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-934733e3-86e5-4b27-9e64-066c135391f0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:24.051127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-934733e3-86e5-4b27-9e64-066c135391f0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:24.157883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-743e2ed0-2879-4a2d-9cad-283353486712 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:24.185924 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-743e2ed0-2879-4a2d-9cad-283353486712 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1309 microversion: 2.1 time: 1.052305 Oct 27 19:07:24.189551 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2400/4606] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:23 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1309 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:24.218680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5e14f004-5c80-4427-a93d-7c31c82b670d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:24.222425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5e14f004-5c80-4427-a93d-7c31c82b670d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:24.307824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e14f004-5c80-4427-a93d-7c31c82b670d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:24.313593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e14f004-5c80-4427-a93d-7c31c82b670d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:24.314296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e14f004-5c80-4427-a93d-7c31c82b670d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:24.315284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e14f004-5c80-4427-a93d-7c31c82b670d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:24.316028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e14f004-5c80-4427-a93d-7c31c82b670d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:24.316978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e14f004-5c80-4427-a93d-7c31c82b670d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:24.460564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-934733e3-86e5-4b27-9e64-066c135391f0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:24.481883 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-934733e3-86e5-4b27-9e64-066c135391f0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1267 microversion: 2.1 time: 0.502992 Oct 27 19:07:24.491156 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2207/4607] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:23 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1267 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:25.011696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1db51dbe-8e60-48b0-b72c-1d65f385e8f9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:25.019929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1db51dbe-8e60-48b0-b72c-1d65f385e8f9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:25.030931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1db51dbe-8e60-48b0-b72c-1d65f385e8f9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:25.031726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1db51dbe-8e60-48b0-b72c-1d65f385e8f9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:25.032356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1db51dbe-8e60-48b0-b72c-1d65f385e8f9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:25.033407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1db51dbe-8e60-48b0-b72c-1d65f385e8f9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:25.034031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1db51dbe-8e60-48b0-b72c-1d65f385e8f9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:25.034666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1db51dbe-8e60-48b0-b72c-1d65f385e8f9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:25.390493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1db51dbe-8e60-48b0-b72c-1d65f385e8f9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:25.398290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:25.407246 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1db51dbe-8e60-48b0-b72c-1d65f385e8f9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1316 microversion: 2.1 time: 0.409731 Oct 27 19:07:25.430854 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2208/4608] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:24 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:25.453824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-228b5394-fecd-4fe7-9600-f836af70f904 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:25.458560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-228b5394-fecd-4fe7-9600-f836af70f904 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:25.486364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-228b5394-fecd-4fe7-9600-f836af70f904 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:25.510312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-228b5394-fecd-4fe7-9600-f836af70f904 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:25.516154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-228b5394-fecd-4fe7-9600-f836af70f904 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:25.518198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-228b5394-fecd-4fe7-9600-f836af70f904 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:25.519067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-228b5394-fecd-4fe7-9600-f836af70f904 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:25.520786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-228b5394-fecd-4fe7-9600-f836af70f904 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:25.964998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-228b5394-fecd-4fe7-9600-f836af70f904 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:25.974134 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-228b5394-fecd-4fe7-9600-f836af70f904 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1309 microversion: 2.1 time: 0.539587 Oct 27 19:07:25.985007 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2209/4609] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:25 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1309 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:25.992932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-edba8bfb-f5ab-4597-a9f0-710f595a793b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:25.999854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-edba8bfb-f5ab-4597-a9f0-710f595a793b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:26.029320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edba8bfb-f5ab-4597-a9f0-710f595a793b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:26.030013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edba8bfb-f5ab-4597-a9f0-710f595a793b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:26.030704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edba8bfb-f5ab-4597-a9f0-710f595a793b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:26.033395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edba8bfb-f5ab-4597-a9f0-710f595a793b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:26.046374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edba8bfb-f5ab-4597-a9f0-710f595a793b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:26.048536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edba8bfb-f5ab-4597-a9f0-710f595a793b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:26.288059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-edba8bfb-f5ab-4597-a9f0-710f595a793b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:26.311436 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-edba8bfb-f5ab-4597-a9f0-710f595a793b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1273 microversion: 2.1 time: 0.323318 Oct 27 19:07:26.313386 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2210/4610] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:25 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1273 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:26.442233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-56b163f3-6276-47f8-90e3-3ec95f9985a0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:26.447678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-56b163f3-6276-47f8-90e3-3ec95f9985a0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:26.472030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56b163f3-6276-47f8-90e3-3ec95f9985a0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:26.475166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56b163f3-6276-47f8-90e3-3ec95f9985a0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:26.475808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56b163f3-6276-47f8-90e3-3ec95f9985a0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:26.479529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56b163f3-6276-47f8-90e3-3ec95f9985a0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:26.480380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56b163f3-6276-47f8-90e3-3ec95f9985a0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:26.482565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56b163f3-6276-47f8-90e3-3ec95f9985a0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:27.594116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-56b163f3-6276-47f8-90e3-3ec95f9985a0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:27.605596 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-56b163f3-6276-47f8-90e3-3ec95f9985a0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1316 microversion: 2.1 time: 1.169304 Oct 27 19:07:27.635429 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2211/4611] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:26 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1316 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:27.665513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-1dadc171-ec01-4683-a3e5-c36bcfabc16e req-c88da1b2-c525-47dc-b97d-6c9f3eb95bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59682c2-3372-419f-b903-46d5e52dfcbb", "name": "network-vif-plugged", "status": "completed", "tag": "83220988-6c10-4402-a973-6d9b68efdae2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:27.698627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1dadc171-ec01-4683-a3e5-c36bcfabc16e req-c88da1b2-c525-47dc-b97d-6c9f3eb95bfa service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:27.705167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1dadc171-ec01-4683-a3e5-c36bcfabc16e req-c88da1b2-c525-47dc-b97d-6c9f3eb95bfa service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:27.707300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1dadc171-ec01-4683-a3e5-c36bcfabc16e req-c88da1b2-c525-47dc-b97d-6c9f3eb95bfa service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:27.775782 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-1dadc171-ec01-4683-a3e5-c36bcfabc16e req-c88da1b2-c525-47dc-b97d-6c9f3eb95bfa service nova] Creating event network-vif-plugged:83220988-6c10-4402-a973-6d9b68efdae2 for instance b59682c2-3372-419f-b903-46d5e52dfcbb on n-h1-860687-3 Oct 27 19:07:27.816810 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-1dadc171-ec01-4683-a3e5-c36bcfabc16e req-c88da1b2-c525-47dc-b97d-6c9f3eb95bfa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175264 Oct 27 19:07:27.821908 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2212/4612] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:27.843851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7d96799d-e2aa-4b60-88a4-1a377be7601d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:27.845895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7d96799d-e2aa-4b60-88a4-1a377be7601d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:27.893621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d96799d-e2aa-4b60-88a4-1a377be7601d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:27.903914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d96799d-e2aa-4b60-88a4-1a377be7601d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:27.904637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d96799d-e2aa-4b60-88a4-1a377be7601d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:27.906243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d96799d-e2aa-4b60-88a4-1a377be7601d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:27.911138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d96799d-e2aa-4b60-88a4-1a377be7601d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:27.918683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d96799d-e2aa-4b60-88a4-1a377be7601d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:28.261698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5e14f004-5c80-4427-a93d-7c31c82b670d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:28.273450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5e14f004-5c80-4427-a93d-7c31c82b670d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:28.276441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5e14f004-5c80-4427-a93d-7c31c82b670d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:28.279001 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5e14f004-5c80-4427-a93d-7c31c82b670d tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 4.084745 Oct 27 19:07:28.313372 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2401/4613] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:24 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 4119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:28.339865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85428bb4-3742-4d2a-a412-2290bed21c5a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:28.341561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-85428bb4-3742-4d2a-a412-2290bed21c5a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:28.361097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85428bb4-3742-4d2a-a412-2290bed21c5a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:28.364772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85428bb4-3742-4d2a-a412-2290bed21c5a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:28.365455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85428bb4-3742-4d2a-a412-2290bed21c5a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:28.366726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85428bb4-3742-4d2a-a412-2290bed21c5a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:28.371195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85428bb4-3742-4d2a-a412-2290bed21c5a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:28.380233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85428bb4-3742-4d2a-a412-2290bed21c5a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:28.692286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-85428bb4-3742-4d2a-a412-2290bed21c5a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:28.720368 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-85428bb4-3742-4d2a-a412-2290bed21c5a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1273 microversion: 2.1 time: 0.398334 Oct 27 19:07:28.721829 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2402/4614] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:28 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1273 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:28.732671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b1ca049b-542f-479a-9101-9ea2c5f07525 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:28.733502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b1ca049b-542f-479a-9101-9ea2c5f07525 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:28.764957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1ca049b-542f-479a-9101-9ea2c5f07525 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:28.766884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1ca049b-542f-479a-9101-9ea2c5f07525 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:28.771141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1ca049b-542f-479a-9101-9ea2c5f07525 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:28.772393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1ca049b-542f-479a-9101-9ea2c5f07525 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:28.773152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1ca049b-542f-479a-9101-9ea2c5f07525 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:28.774050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1ca049b-542f-479a-9101-9ea2c5f07525 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:29.269098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7d96799d-e2aa-4b60-88a4-1a377be7601d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:29.307198 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7d96799d-e2aa-4b60-88a4-1a377be7601d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1309 microversion: 2.1 time: 1.481941 Oct 27 19:07:29.308466 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2213/4615] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:27 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1309 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:29.333455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-15f03541-f5eb-4dcf-ba6f-f113144b5e06 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:29.334881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-15f03541-f5eb-4dcf-ba6f-f113144b5e06 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:29.356581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15f03541-f5eb-4dcf-ba6f-f113144b5e06 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:29.357351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15f03541-f5eb-4dcf-ba6f-f113144b5e06 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:29.359904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15f03541-f5eb-4dcf-ba6f-f113144b5e06 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:29.371167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15f03541-f5eb-4dcf-ba6f-f113144b5e06 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:29.371912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15f03541-f5eb-4dcf-ba6f-f113144b5e06 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:29.373772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15f03541-f5eb-4dcf-ba6f-f113144b5e06 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:29.538777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b1ca049b-542f-479a-9101-9ea2c5f07525 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:29.557644 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b1ca049b-542f-479a-9101-9ea2c5f07525 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1316 microversion: 2.1 time: 0.832727 Oct 27 19:07:29.575967 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2403/4616] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:28 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1316 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:29.750368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c935201d-69ec-4772-8494-6be7052af25e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:29.752523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c935201d-69ec-4772-8494-6be7052af25e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:29.769268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c935201d-69ec-4772-8494-6be7052af25e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:29.770446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c935201d-69ec-4772-8494-6be7052af25e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:29.773193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c935201d-69ec-4772-8494-6be7052af25e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:29.774242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c935201d-69ec-4772-8494-6be7052af25e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:29.774985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c935201d-69ec-4772-8494-6be7052af25e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:29.777138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c935201d-69ec-4772-8494-6be7052af25e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:30.079289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-15f03541-f5eb-4dcf-ba6f-f113144b5e06 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:30.090776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-15f03541-f5eb-4dcf-ba6f-f113144b5e06 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:30.097696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-15f03541-f5eb-4dcf-ba6f-f113144b5e06 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:30.101843 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-15f03541-f5eb-4dcf-ba6f-f113144b5e06 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.790140 Oct 27 19:07:30.102878 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2214/4617] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:29 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:07:30.113685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-6aa36be6-8900-495b-89a5-deb9bd867ee8 req-c9ba9426-290d-44b2-8da8-a6d77605b732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6306e250-f4e8-42d2-a797-34cc197ad70a", "tag": "b015d979-dcfd-4f51-a259-cc637b0d2e57"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:30.134746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6aa36be6-8900-495b-89a5-deb9bd867ee8 req-c9ba9426-290d-44b2-8da8-a6d77605b732 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:30.135609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6aa36be6-8900-495b-89a5-deb9bd867ee8 req-c9ba9426-290d-44b2-8da8-a6d77605b732 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:30.136294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6aa36be6-8900-495b-89a5-deb9bd867ee8 req-c9ba9426-290d-44b2-8da8-a6d77605b732 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:30.167335 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-6aa36be6-8900-495b-89a5-deb9bd867ee8 req-c9ba9426-290d-44b2-8da8-a6d77605b732 service nova] Creating event network-changed:b015d979-dcfd-4f51-a259-cc637b0d2e57 for instance 6306e250-f4e8-42d2-a797-34cc197ad70a on n-h1-860687-3 Oct 27 19:07:30.186044 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-6aa36be6-8900-495b-89a5-deb9bd867ee8 req-c9ba9426-290d-44b2-8da8-a6d77605b732 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080222 Oct 27 19:07:30.187105 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2215/4618] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:30.352583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-98e690a0-3dc1-47ac-9134-5da4106d6245 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:30.355461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-98e690a0-3dc1-47ac-9134-5da4106d6245 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:30.394245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98e690a0-3dc1-47ac-9134-5da4106d6245 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:30.400614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98e690a0-3dc1-47ac-9134-5da4106d6245 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:30.401854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98e690a0-3dc1-47ac-9134-5da4106d6245 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:30.406976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98e690a0-3dc1-47ac-9134-5da4106d6245 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:30.410684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98e690a0-3dc1-47ac-9134-5da4106d6245 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:30.411831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98e690a0-3dc1-47ac-9134-5da4106d6245 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:31.047236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-98e690a0-3dc1-47ac-9134-5da4106d6245 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:31.073389 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-98e690a0-3dc1-47ac-9134-5da4106d6245 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1489 microversion: 2.1 time: 0.738463 Oct 27 19:07:31.078554 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2216/4619] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:30 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1489 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:31.101564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bfe92c3f-1edf-480c-83f7-6c517901910f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:31.110789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bfe92c3f-1edf-480c-83f7-6c517901910f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:31.141847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c935201d-69ec-4772-8494-6be7052af25e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:31.153556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfe92c3f-1edf-480c-83f7-6c517901910f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:31.154252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfe92c3f-1edf-480c-83f7-6c517901910f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:31.156137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfe92c3f-1edf-480c-83f7-6c517901910f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:31.158190 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c935201d-69ec-4772-8494-6be7052af25e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1315 microversion: 2.1 time: 1.408211 Oct 27 19:07:31.160326 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2404/4620] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:29 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1315 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:07:31.179665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3393b69e-428a-413b-bbe9-33c1dee07405 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:31.181911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfe92c3f-1edf-480c-83f7-6c517901910f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:31.182819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3393b69e-428a-413b-bbe9-33c1dee07405 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:31.183612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfe92c3f-1edf-480c-83f7-6c517901910f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:31.196090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfe92c3f-1edf-480c-83f7-6c517901910f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:31.206733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:31.230058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3393b69e-428a-413b-bbe9-33c1dee07405 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:31.230623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3393b69e-428a-413b-bbe9-33c1dee07405 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:31.231088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3393b69e-428a-413b-bbe9-33c1dee07405 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:31.231831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3393b69e-428a-413b-bbe9-33c1dee07405 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:31.232304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3393b69e-428a-413b-bbe9-33c1dee07405 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:31.232747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3393b69e-428a-413b-bbe9-33c1dee07405 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:31.233293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:32.051074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=16 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:32.206127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bfe92c3f-1edf-480c-83f7-6c517901910f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:32.215816 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bfe92c3f-1edf-480c-83f7-6c517901910f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1316 microversion: 2.1 time: 1.139261 Oct 27 19:07:32.228079 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2217/4621] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:31 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1316 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:32.234197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3393b69e-428a-413b-bbe9-33c1dee07405 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:32.242733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1979196732", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "0e03b86b-4627-4072-8ddb-a6a80f18beba"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:32.247758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3393b69e-428a-413b-bbe9-33c1dee07405 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:32.249802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3393b69e-428a-413b-bbe9-33c1dee07405 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:32.252987 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3393b69e-428a-413b-bbe9-33c1dee07405 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 1.089995 Oct 27 19:07:32.253784 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2405/4622] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:31 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:32.259920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0f2335b7-c786-42f7-9de9-6a9431a7ad14 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:32.260986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0f2335b7-c786-42f7-9de9-6a9431a7ad14 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:32.277723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f2335b7-c786-42f7-9de9-6a9431a7ad14 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:32.278641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f2335b7-c786-42f7-9de9-6a9431a7ad14 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:32.279262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f2335b7-c786-42f7-9de9-6a9431a7ad14 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:32.281451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f2335b7-c786-42f7-9de9-6a9431a7ad14 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:32.282323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f2335b7-c786-42f7-9de9-6a9431a7ad14 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:32.284001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f2335b7-c786-42f7-9de9-6a9431a7ad14 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:32.324481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:32.378277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] validate_networks() for [('0e03b86b-4627-4072-8ddb-a6a80f18beba', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:07:32.936578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0f2335b7-c786-42f7-9de9-6a9431a7ad14 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:32.962945 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0f2335b7-c786-42f7-9de9-6a9431a7ad14 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1315 microversion: 2.1 time: 0.691578 Oct 27 19:07:32.984239 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2406/4623] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:32 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1315 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:33.247670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5595cf73-e2c8-4e61-a1f7-ac79ab1c9742 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:33.249545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5595cf73-e2c8-4e61-a1f7-ac79ab1c9742 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:33.278658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5595cf73-e2c8-4e61-a1f7-ac79ab1c9742 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:33.280061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5595cf73-e2c8-4e61-a1f7-ac79ab1c9742 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:33.284271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5595cf73-e2c8-4e61-a1f7-ac79ab1c9742 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:33.285393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5595cf73-e2c8-4e61-a1f7-ac79ab1c9742 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:33.286148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5595cf73-e2c8-4e61-a1f7-ac79ab1c9742 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:33.287136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5595cf73-e2c8-4e61-a1f7-ac79ab1c9742 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:33.782069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5595cf73-e2c8-4e61-a1f7-ac79ab1c9742 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:33.797592 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5595cf73-e2c8-4e61-a1f7-ac79ab1c9742 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1316 microversion: 2.1 time: 0.553958 Oct 27 19:07:33.799918 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2407/4624] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:33 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1316 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:07:33.810355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6bea9cc8-f16a-4fdb-ba7a-47af697fcff8 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:33.820880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6bea9cc8-f16a-4fdb-ba7a-47af697fcff8 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:33.835174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bea9cc8-f16a-4fdb-ba7a-47af697fcff8 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:33.841252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bea9cc8-f16a-4fdb-ba7a-47af697fcff8 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:33.842227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bea9cc8-f16a-4fdb-ba7a-47af697fcff8 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:33.843224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bea9cc8-f16a-4fdb-ba7a-47af697fcff8 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:33.846536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bea9cc8-f16a-4fdb-ba7a-47af697fcff8 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:33.847246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bea9cc8-f16a-4fdb-ba7a-47af697fcff8 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:34.351263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6bea9cc8-f16a-4fdb-ba7a-47af697fcff8 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:34.365439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6bea9cc8-f16a-4fdb-ba7a-47af697fcff8 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:34.367266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6bea9cc8-f16a-4fdb-ba7a-47af697fcff8 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:34.368648 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6bea9cc8-f16a-4fdb-ba7a-47af697fcff8 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.562436 Oct 27 19:07:34.370796 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2408/4625] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:33 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:34.385765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ef17ac51-cc3e-4d26-abbc-7c4923937626 req-87959c06-4da1-46d7-8cc7-d41be5f9109f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0ba883-2279-48c5-a46f-f99d99ad0320", "tag": "b7b9e7d5-ac1c-4e75-9d45-512fada58d92"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:34.406709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ef17ac51-cc3e-4d26-abbc-7c4923937626 req-87959c06-4da1-46d7-8cc7-d41be5f9109f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:34.407319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ef17ac51-cc3e-4d26-abbc-7c4923937626 req-87959c06-4da1-46d7-8cc7-d41be5f9109f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:34.408294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ef17ac51-cc3e-4d26-abbc-7c4923937626 req-87959c06-4da1-46d7-8cc7-d41be5f9109f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:34.458313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:34.474336 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ef17ac51-cc3e-4d26-abbc-7c4923937626 req-87959c06-4da1-46d7-8cc7-d41be5f9109f service nova] Creating event network-changed:b7b9e7d5-ac1c-4e75-9d45-512fada58d92 for instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 on n-h2-860687-3 Oct 27 19:07:34.485358 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ef17ac51-cc3e-4d26-abbc-7c4923937626 req-87959c06-4da1-46d7-8cc7-d41be5f9109f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112193 Oct 27 19:07:34.488678 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2409/4626] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:34.501174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6eb31434-214c-42a0-b0f8-c39fc5febce5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:34.503644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6eb31434-214c-42a0-b0f8-c39fc5febce5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:34.523573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6eb31434-214c-42a0-b0f8-c39fc5febce5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:34.524337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6eb31434-214c-42a0-b0f8-c39fc5febce5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:34.525002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6eb31434-214c-42a0-b0f8-c39fc5febce5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:34.526045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6eb31434-214c-42a0-b0f8-c39fc5febce5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:34.526906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6eb31434-214c-42a0-b0f8-c39fc5febce5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:34.527622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6eb31434-214c-42a0-b0f8-c39fc5febce5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:34.623425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:07:34.624252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:07:34.624770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:07:34.625183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:07:34.625834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:07:34.663231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:34.663742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:34.664197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:34.664949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:34.671877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:34.678555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:34.722094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:07:34.736072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for user e7d5767d1dc249cd8e97097588ee4728 and project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:07:34.759829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:07:34.762264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:07:34.833855 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c4b63674-0700-4098-bf0c-0d60a66e93e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.604192 Oct 27 19:07:34.837057 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2218/4627] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:07:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:07:34.846317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-26113ca2-9888-44d5-846e-9022a0c95de8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:34.850056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-26113ca2-9888-44d5-846e-9022a0c95de8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:34.874689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26113ca2-9888-44d5-846e-9022a0c95de8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:34.877021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26113ca2-9888-44d5-846e-9022a0c95de8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:34.879746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26113ca2-9888-44d5-846e-9022a0c95de8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:34.887060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26113ca2-9888-44d5-846e-9022a0c95de8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:34.887763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26113ca2-9888-44d5-846e-9022a0c95de8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:34.888399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-26113ca2-9888-44d5-846e-9022a0c95de8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:35.567924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-26113ca2-9888-44d5-846e-9022a0c95de8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:35.578260 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-26113ca2-9888-44d5-846e-9022a0c95de8 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1316 microversion: 2.1 time: 0.739748 Oct 27 19:07:35.579603 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2219/4628] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:34 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1316 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:35.584687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-130ec919-ffc2-4f39-96a1-2c8d22061216 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:35.585632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-130ec919-ffc2-4f39-96a1-2c8d22061216 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:35.688599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-130ec919-ffc2-4f39-96a1-2c8d22061216 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:35.698125 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-130ec919-ffc2-4f39-96a1-2c8d22061216 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1209 microversion: 2.1 time: 0.117150 Oct 27 19:07:35.701591 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2220/4629] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:35 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1209 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:35.724441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d0c069fc-02f4-42bd-b705-e20d3101b736 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:35.730838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d0c069fc-02f4-42bd-b705-e20d3101b736 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:35.757855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0c069fc-02f4-42bd-b705-e20d3101b736 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:35.760716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0c069fc-02f4-42bd-b705-e20d3101b736 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:35.761328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0c069fc-02f4-42bd-b705-e20d3101b736 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:35.763425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0c069fc-02f4-42bd-b705-e20d3101b736 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:35.768186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0c069fc-02f4-42bd-b705-e20d3101b736 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:35.770047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0c069fc-02f4-42bd-b705-e20d3101b736 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:36.477309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d0c069fc-02f4-42bd-b705-e20d3101b736 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:36.499327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d0c069fc-02f4-42bd-b705-e20d3101b736 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:36.508184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d0c069fc-02f4-42bd-b705-e20d3101b736 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:36.514804 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d0c069fc-02f4-42bd-b705-e20d3101b736 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.802676 Oct 27 19:07:36.531054 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2221/4630] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:35 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:36.575189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6eb31434-214c-42a0-b0f8-c39fc5febce5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:36.603517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5971c060-c6e3-40a1-ba20-a90204030daa tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:36.605559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5971c060-c6e3-40a1-ba20-a90204030daa tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:36.619112 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6eb31434-214c-42a0-b0f8-c39fc5febce5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1315 microversion: 2.1 time: 2.128123 Oct 27 19:07:36.626911 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2410/4631] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:34 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1315 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:36.640418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5971c060-c6e3-40a1-ba20-a90204030daa tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:36.646668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5971c060-c6e3-40a1-ba20-a90204030daa tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:36.652390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5971c060-c6e3-40a1-ba20-a90204030daa tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:36.653513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5971c060-c6e3-40a1-ba20-a90204030daa tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:36.655995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5971c060-c6e3-40a1-ba20-a90204030daa tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:36.656864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5971c060-c6e3-40a1-ba20-a90204030daa tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:36.731224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-66e06567-a0ae-4df8-ad15-aefe8d5208eb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:36.732080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-66e06567-a0ae-4df8-ad15-aefe8d5208eb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:36.751132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66e06567-a0ae-4df8-ad15-aefe8d5208eb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:36.753116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66e06567-a0ae-4df8-ad15-aefe8d5208eb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:36.754518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66e06567-a0ae-4df8-ad15-aefe8d5208eb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:36.755449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66e06567-a0ae-4df8-ad15-aefe8d5208eb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:36.758674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66e06567-a0ae-4df8-ad15-aefe8d5208eb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:36.760570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66e06567-a0ae-4df8-ad15-aefe8d5208eb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:37.099791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-66e06567-a0ae-4df8-ad15-aefe8d5208eb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:37.108494 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-66e06567-a0ae-4df8-ad15-aefe8d5208eb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1261 microversion: 2.1 time: 0.383898 Oct 27 19:07:37.122293 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2411/4632] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:36 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1261 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:37.555509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-70ef090e-9868-4fcf-aafa-a35d163e386b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:37.556724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5971c060-c6e3-40a1-ba20-a90204030daa tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:37.567292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-70ef090e-9868-4fcf-aafa-a35d163e386b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:37.569742 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5971c060-c6e3-40a1-ba20-a90204030daa tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1316 microversion: 2.1 time: 0.971588 Oct 27 19:07:37.584771 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2222/4633] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:36 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1316 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:07:37.640230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70ef090e-9868-4fcf-aafa-a35d163e386b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:37.641398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70ef090e-9868-4fcf-aafa-a35d163e386b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:37.653395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-db2e5605-4f15-4d4b-94ec-02e377d0c515 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:37.654195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-db2e5605-4f15-4d4b-94ec-02e377d0c515 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:37.659831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70ef090e-9868-4fcf-aafa-a35d163e386b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:37.667815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70ef090e-9868-4fcf-aafa-a35d163e386b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:37.668608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70ef090e-9868-4fcf-aafa-a35d163e386b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:37.669391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70ef090e-9868-4fcf-aafa-a35d163e386b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:37.674980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db2e5605-4f15-4d4b-94ec-02e377d0c515 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:37.675677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db2e5605-4f15-4d4b-94ec-02e377d0c515 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:37.676254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db2e5605-4f15-4d4b-94ec-02e377d0c515 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:37.677523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db2e5605-4f15-4d4b-94ec-02e377d0c515 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:37.678189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db2e5605-4f15-4d4b-94ec-02e377d0c515 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:37.680149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db2e5605-4f15-4d4b-94ec-02e377d0c515 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:38.354433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-db2e5605-4f15-4d4b-94ec-02e377d0c515 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:38.372853 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-db2e5605-4f15-4d4b-94ec-02e377d0c515 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1315 microversion: 2.1 time: 0.720556 Oct 27 19:07:38.373789 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2223/4634] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:37 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:07:38.403330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ca33959-731f-4eac-aa89-dfe7184a48e7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:38.404257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5ca33959-731f-4eac-aa89-dfe7184a48e7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:38.431861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ca33959-731f-4eac-aa89-dfe7184a48e7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:38.437829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ca33959-731f-4eac-aa89-dfe7184a48e7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:38.439770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ca33959-731f-4eac-aa89-dfe7184a48e7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:38.441568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ca33959-731f-4eac-aa89-dfe7184a48e7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:38.445591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ca33959-731f-4eac-aa89-dfe7184a48e7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:38.446951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ca33959-731f-4eac-aa89-dfe7184a48e7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:38.696178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-70ef090e-9868-4fcf-aafa-a35d163e386b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:38.713470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-70ef090e-9868-4fcf-aafa-a35d163e386b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:38.716819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5ca33959-731f-4eac-aa89-dfe7184a48e7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:38.726302 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5ca33959-731f-4eac-aa89-dfe7184a48e7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1267 microversion: 2.1 time: 0.344496 Oct 27 19:07:38.732132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-70ef090e-9868-4fcf-aafa-a35d163e386b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:38.732659 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2224/4635] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:38 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1267 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:38.736560 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-70ef090e-9868-4fcf-aafa-a35d163e386b tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 1.186419 Oct 27 19:07:38.749594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a025da49-97e1-416a-bcc5-05b87579cd3c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:38.755431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a025da49-97e1-416a-bcc5-05b87579cd3c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:38.772053 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2412/4636] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:37 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:38.773933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a025da49-97e1-416a-bcc5-05b87579cd3c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:38.774472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a025da49-97e1-416a-bcc5-05b87579cd3c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:38.779423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a025da49-97e1-416a-bcc5-05b87579cd3c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:38.780237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a025da49-97e1-416a-bcc5-05b87579cd3c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:38.780726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a025da49-97e1-416a-bcc5-05b87579cd3c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:38.781175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a025da49-97e1-416a-bcc5-05b87579cd3c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:39.325891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a025da49-97e1-416a-bcc5-05b87579cd3c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:39.344718 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a025da49-97e1-416a-bcc5-05b87579cd3c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1316 microversion: 2.1 time: 0.610229 Oct 27 19:07:39.359216 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2225/4637] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:38 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:39.404743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-194c851d-3377-4553-b7b5-50ca197c1df4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:39.406288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-194c851d-3377-4553-b7b5-50ca197c1df4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:39.421529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-194c851d-3377-4553-b7b5-50ca197c1df4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:39.427750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-194c851d-3377-4553-b7b5-50ca197c1df4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:39.428391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-194c851d-3377-4553-b7b5-50ca197c1df4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:39.429276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-194c851d-3377-4553-b7b5-50ca197c1df4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:39.431496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-194c851d-3377-4553-b7b5-50ca197c1df4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:39.432075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-194c851d-3377-4553-b7b5-50ca197c1df4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:39.758715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ca9371d-cc7b-40d9-af3f-c4a3b211c6e5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:39.759522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3ca9371d-cc7b-40d9-af3f-c4a3b211c6e5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:39.777130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ca9371d-cc7b-40d9-af3f-c4a3b211c6e5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:39.777811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ca9371d-cc7b-40d9-af3f-c4a3b211c6e5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:39.778408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ca9371d-cc7b-40d9-af3f-c4a3b211c6e5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:39.779406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ca9371d-cc7b-40d9-af3f-c4a3b211c6e5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:39.780162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ca9371d-cc7b-40d9-af3f-c4a3b211c6e5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:39.780855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ca9371d-cc7b-40d9-af3f-c4a3b211c6e5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:39.863313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-194c851d-3377-4553-b7b5-50ca197c1df4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:39.877730 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-194c851d-3377-4553-b7b5-50ca197c1df4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1315 microversion: 2.1 time: 0.475776 Oct 27 19:07:39.887565 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2413/4638] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:39 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:39.892565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e23ec95a-d68b-4f6f-a8d2-35c31fb4c663 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:39.893435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e23ec95a-d68b-4f6f-a8d2-35c31fb4c663 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:39.907961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e23ec95a-d68b-4f6f-a8d2-35c31fb4c663 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:39.911034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e23ec95a-d68b-4f6f-a8d2-35c31fb4c663 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:39.911629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e23ec95a-d68b-4f6f-a8d2-35c31fb4c663 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:39.914286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e23ec95a-d68b-4f6f-a8d2-35c31fb4c663 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:39.914995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e23ec95a-d68b-4f6f-a8d2-35c31fb4c663 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:39.916389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e23ec95a-d68b-4f6f-a8d2-35c31fb4c663 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:40.346082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e23ec95a-d68b-4f6f-a8d2-35c31fb4c663 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:40.364598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e23ec95a-d68b-4f6f-a8d2-35c31fb4c663 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:40.384516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e23ec95a-d68b-4f6f-a8d2-35c31fb4c663 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:40.391357 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e23ec95a-d68b-4f6f-a8d2-35c31fb4c663 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.510185 Oct 27 19:07:40.410418 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2414/4639] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:39 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:40.437470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-034f3a16-534e-42fb-86b9-67ea3cc8e303 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:40.438419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-034f3a16-534e-42fb-86b9-67ea3cc8e303 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:40.460960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-034f3a16-534e-42fb-86b9-67ea3cc8e303 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:40.462004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-034f3a16-534e-42fb-86b9-67ea3cc8e303 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:40.465714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-034f3a16-534e-42fb-86b9-67ea3cc8e303 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:40.469275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-034f3a16-534e-42fb-86b9-67ea3cc8e303 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:40.471626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-034f3a16-534e-42fb-86b9-67ea3cc8e303 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:40.472472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-034f3a16-534e-42fb-86b9-67ea3cc8e303 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:40.771756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ca9371d-cc7b-40d9-af3f-c4a3b211c6e5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:40.793755 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3ca9371d-cc7b-40d9-af3f-c4a3b211c6e5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1267 microversion: 2.1 time: 1.041207 Oct 27 19:07:40.795287 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2226/4640] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:39 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1267 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:07:40.806157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-9c45239b-bfe9-4438-9654-04e20cd64abc req-111bf0f7-336b-4249-bb8f-b8bb42f079e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6306e250-f4e8-42d2-a797-34cc197ad70a", "name": "network-vif-plugged", "status": "completed", "tag": "b015d979-dcfd-4f51-a259-cc637b0d2e57"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:40.823414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9c45239b-bfe9-4438-9654-04e20cd64abc req-111bf0f7-336b-4249-bb8f-b8bb42f079e6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:40.824412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9c45239b-bfe9-4438-9654-04e20cd64abc req-111bf0f7-336b-4249-bb8f-b8bb42f079e6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:40.825285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9c45239b-bfe9-4438-9654-04e20cd64abc req-111bf0f7-336b-4249-bb8f-b8bb42f079e6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:40.844757 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-9c45239b-bfe9-4438-9654-04e20cd64abc req-111bf0f7-336b-4249-bb8f-b8bb42f079e6 service nova] Creating event network-vif-plugged:b015d979-dcfd-4f51-a259-cc637b0d2e57 for instance 6306e250-f4e8-42d2-a797-34cc197ad70a on n-h1-860687-3 Oct 27 19:07:40.851119 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-9c45239b-bfe9-4438-9654-04e20cd64abc req-111bf0f7-336b-4249-bb8f-b8bb42f079e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054283 Oct 27 19:07:40.852592 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2227/4641] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:40.868248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-034f3a16-534e-42fb-86b9-67ea3cc8e303 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:40.903081 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-034f3a16-534e-42fb-86b9-67ea3cc8e303 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1316 microversion: 2.1 time: 0.504246 Oct 27 19:07:40.913721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a49943f1-89be-40ae-9184-62c6b9323f8f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:40.918256 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2415/4642] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:40 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:40.922658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a49943f1-89be-40ae-9184-62c6b9323f8f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:40.942360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a49943f1-89be-40ae-9184-62c6b9323f8f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:40.942901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a49943f1-89be-40ae-9184-62c6b9323f8f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:40.943354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a49943f1-89be-40ae-9184-62c6b9323f8f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:40.944099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a49943f1-89be-40ae-9184-62c6b9323f8f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:40.944635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a49943f1-89be-40ae-9184-62c6b9323f8f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:40.944996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a49943f1-89be-40ae-9184-62c6b9323f8f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:41.289781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a49943f1-89be-40ae-9184-62c6b9323f8f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:41.309744 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a49943f1-89be-40ae-9184-62c6b9323f8f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1315 microversion: 2.1 time: 0.398559 Oct 27 19:07:41.310366 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2228/4643] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:40 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:41.425890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6832cdfd-3a52-4bdc-9297-cb06604e9bf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:41.426545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6832cdfd-3a52-4bdc-9297-cb06604e9bf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:41.440152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6832cdfd-3a52-4bdc-9297-cb06604e9bf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:41.440840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6832cdfd-3a52-4bdc-9297-cb06604e9bf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:41.441301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6832cdfd-3a52-4bdc-9297-cb06604e9bf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:41.442047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6832cdfd-3a52-4bdc-9297-cb06604e9bf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:41.442547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6832cdfd-3a52-4bdc-9297-cb06604e9bf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:41.443155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6832cdfd-3a52-4bdc-9297-cb06604e9bf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:41.676317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6832cdfd-3a52-4bdc-9297-cb06604e9bf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:41.685423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6832cdfd-3a52-4bdc-9297-cb06604e9bf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:41.686924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6832cdfd-3a52-4bdc-9297-cb06604e9bf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:41.688111 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6832cdfd-3a52-4bdc-9297-cb06604e9bf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.266947 Oct 27 19:07:41.696964 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2416/4644] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:41 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:41.835179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-857e11d0-2395-45b1-961e-e95ba379e951 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:41.836060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-857e11d0-2395-45b1-961e-e95ba379e951 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:41.871564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-857e11d0-2395-45b1-961e-e95ba379e951 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:41.872113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-857e11d0-2395-45b1-961e-e95ba379e951 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:41.875486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-857e11d0-2395-45b1-961e-e95ba379e951 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:41.876834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-857e11d0-2395-45b1-961e-e95ba379e951 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:41.877325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-857e11d0-2395-45b1-961e-e95ba379e951 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:41.877783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-857e11d0-2395-45b1-961e-e95ba379e951 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:41.895844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:41.943478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-08ab95fe-770f-4036-9ce5-e2853805f6c9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:41.945095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-08ab95fe-770f-4036-9ce5-e2853805f6c9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:41.963358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08ab95fe-770f-4036-9ce5-e2853805f6c9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:41.963861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08ab95fe-770f-4036-9ce5-e2853805f6c9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:41.964308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08ab95fe-770f-4036-9ce5-e2853805f6c9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:41.965029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08ab95fe-770f-4036-9ce5-e2853805f6c9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:41.980969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08ab95fe-770f-4036-9ce5-e2853805f6c9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:41.981706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08ab95fe-770f-4036-9ce5-e2853805f6c9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:42.184899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-857e11d0-2395-45b1-961e-e95ba379e951 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:42.221328 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-857e11d0-2395-45b1-961e-e95ba379e951 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1267 microversion: 2.1 time: 0.404855 Oct 27 19:07:42.224184 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2229/4645] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:41 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1267 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:07:42.339793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2bdacf0c-3aab-4ffb-8c9e-58b53a08c596 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:42.340422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2bdacf0c-3aab-4ffb-8c9e-58b53a08c596 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:42.355420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bdacf0c-3aab-4ffb-8c9e-58b53a08c596 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:42.357212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bdacf0c-3aab-4ffb-8c9e-58b53a08c596 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:42.358187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bdacf0c-3aab-4ffb-8c9e-58b53a08c596 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:42.360326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bdacf0c-3aab-4ffb-8c9e-58b53a08c596 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:42.366077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bdacf0c-3aab-4ffb-8c9e-58b53a08c596 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:42.367024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bdacf0c-3aab-4ffb-8c9e-58b53a08c596 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:42.372944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-08ab95fe-770f-4036-9ce5-e2853805f6c9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:42.387093 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-08ab95fe-770f-4036-9ce5-e2853805f6c9 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1316 microversion: 2.1 time: 0.448727 Oct 27 19:07:42.388194 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2417/4646] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:41 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:42.726744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f169b82f-9fd0-4a34-9e1f-55ea5c9cb8c9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:42.727516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f169b82f-9fd0-4a34-9e1f-55ea5c9cb8c9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:42.730745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:42.755722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f169b82f-9fd0-4a34-9e1f-55ea5c9cb8c9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:42.758730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f169b82f-9fd0-4a34-9e1f-55ea5c9cb8c9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:42.759208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f169b82f-9fd0-4a34-9e1f-55ea5c9cb8c9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:42.759951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f169b82f-9fd0-4a34-9e1f-55ea5c9cb8c9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:42.760422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f169b82f-9fd0-4a34-9e1f-55ea5c9cb8c9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:42.760861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f169b82f-9fd0-4a34-9e1f-55ea5c9cb8c9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:43.196818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f169b82f-9fd0-4a34-9e1f-55ea5c9cb8c9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:43.211621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f169b82f-9fd0-4a34-9e1f-55ea5c9cb8c9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:43.221846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f169b82f-9fd0-4a34-9e1f-55ea5c9cb8c9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:43.223948 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f169b82f-9fd0-4a34-9e1f-55ea5c9cb8c9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.501371 Oct 27 19:07:43.227596 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2418/4647] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:42 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:43.253922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9a19df05-b630-4bdc-9cf0-2ed77884f79c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:43.255474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9a19df05-b630-4bdc-9cf0-2ed77884f79c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:43.269374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a19df05-b630-4bdc-9cf0-2ed77884f79c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:43.271108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a19df05-b630-4bdc-9cf0-2ed77884f79c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:43.273008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a19df05-b630-4bdc-9cf0-2ed77884f79c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:43.275895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a19df05-b630-4bdc-9cf0-2ed77884f79c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:43.276613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a19df05-b630-4bdc-9cf0-2ed77884f79c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:43.277758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a19df05-b630-4bdc-9cf0-2ed77884f79c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:43.550116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9a19df05-b630-4bdc-9cf0-2ed77884f79c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:43.565690 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9a19df05-b630-4bdc-9cf0-2ed77884f79c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1267 microversion: 2.1 time: 0.316681 Oct 27 19:07:43.566214 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2419/4648] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:43 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:07:43.592585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fa611d51-414e-4caa-b0cc-91ed2652ff90 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:43.593308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fa611d51-414e-4caa-b0cc-91ed2652ff90 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:43.620251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa611d51-414e-4caa-b0cc-91ed2652ff90 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:43.620764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa611d51-414e-4caa-b0cc-91ed2652ff90 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:43.621216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa611d51-414e-4caa-b0cc-91ed2652ff90 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:43.622072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa611d51-414e-4caa-b0cc-91ed2652ff90 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:43.634778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa611d51-414e-4caa-b0cc-91ed2652ff90 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:43.641107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa611d51-414e-4caa-b0cc-91ed2652ff90 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:43.739204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2bdacf0c-3aab-4ffb-8c9e-58b53a08c596 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:43.755493 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2bdacf0c-3aab-4ffb-8c9e-58b53a08c596 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1315 microversion: 2.1 time: 1.421855 Oct 27 19:07:43.771805 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2230/4649] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:42 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1315 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:44.182790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fa611d51-414e-4caa-b0cc-91ed2652ff90 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:44.198533 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fa611d51-414e-4caa-b0cc-91ed2652ff90 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1466 microversion: 2.1 time: 0.608222 Oct 27 19:07:44.200094 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2420/4650] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:43 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1466 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:44.228141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb98c5ed-d9f3-4087-a272-11e9f0d137fe tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:44.228781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cb98c5ed-d9f3-4087-a272-11e9f0d137fe tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:44.243164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb98c5ed-d9f3-4087-a272-11e9f0d137fe tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:44.243949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb98c5ed-d9f3-4087-a272-11e9f0d137fe tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:44.244583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb98c5ed-d9f3-4087-a272-11e9f0d137fe tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:44.245486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb98c5ed-d9f3-4087-a272-11e9f0d137fe tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:44.246130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb98c5ed-d9f3-4087-a272-11e9f0d137fe tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:44.246782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb98c5ed-d9f3-4087-a272-11e9f0d137fe tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:44.256355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2535a801-079e-4a77-894a-57c40aea4447 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:44.257264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2535a801-079e-4a77-894a-57c40aea4447 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:44.268943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2535a801-079e-4a77-894a-57c40aea4447 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:44.269729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2535a801-079e-4a77-894a-57c40aea4447 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:44.270461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2535a801-079e-4a77-894a-57c40aea4447 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:44.284601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2535a801-079e-4a77-894a-57c40aea4447 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:44.285528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2535a801-079e-4a77-894a-57c40aea4447 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:44.286335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2535a801-079e-4a77-894a-57c40aea4447 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:44.703208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:45.043186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2535a801-079e-4a77-894a-57c40aea4447 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:45.076492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2535a801-079e-4a77-894a-57c40aea4447 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:45.082325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2535a801-079e-4a77-894a-57c40aea4447 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:45.084269 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cb98c5ed-d9f3-4087-a272-11e9f0d137fe tempest-ServersOnMultiNodesTest-1820456240 tempest-ServersOnMultiNodesTest-1820456240-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1617 microversion: 2.1 time: 0.860402 Oct 27 19:07:45.087306 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2535a801-079e-4a77-894a-57c40aea4447 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.834803 Oct 27 19:07:45.091248 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2421/4651] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:44 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:45.092313 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2231/4652] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:44 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1617 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:45.106849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7b099bc1-a810-4e7d-ac14-d0a6460d2633 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:45.108120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7b099bc1-a810-4e7d-ac14-d0a6460d2633 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:45.112043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7049bd7e-eb36-4aca-b4b5-1c9d90d9c756 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:45.115511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7049bd7e-eb36-4aca-b4b5-1c9d90d9c756 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:45.140828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7049bd7e-eb36-4aca-b4b5-1c9d90d9c756 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:45.142294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b099bc1-a810-4e7d-ac14-d0a6460d2633 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:45.144453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b099bc1-a810-4e7d-ac14-d0a6460d2633 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:45.145491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b099bc1-a810-4e7d-ac14-d0a6460d2633 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:45.145788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7049bd7e-eb36-4aca-b4b5-1c9d90d9c756 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:45.146254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7049bd7e-eb36-4aca-b4b5-1c9d90d9c756 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:45.150670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b099bc1-a810-4e7d-ac14-d0a6460d2633 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:45.150955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7049bd7e-eb36-4aca-b4b5-1c9d90d9c756 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:45.152641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b099bc1-a810-4e7d-ac14-d0a6460d2633 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:45.152904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7049bd7e-eb36-4aca-b4b5-1c9d90d9c756 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:45.154985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b099bc1-a810-4e7d-ac14-d0a6460d2633 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:45.155508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7049bd7e-eb36-4aca-b4b5-1c9d90d9c756 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:45.490800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7b099bc1-a810-4e7d-ac14-d0a6460d2633 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:45.500273 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7b099bc1-a810-4e7d-ac14-d0a6460d2633 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1309 microversion: 2.1 time: 0.406429 Oct 27 19:07:45.503266 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2422/4653] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:45 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1309 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:45.574480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e623412e-884d-4e60-9ee8-e2a1f04aa1cc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:45.575153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e623412e-884d-4e60-9ee8-e2a1f04aa1cc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:45.609780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e623412e-884d-4e60-9ee8-e2a1f04aa1cc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:45.615152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e623412e-884d-4e60-9ee8-e2a1f04aa1cc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:45.616048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e623412e-884d-4e60-9ee8-e2a1f04aa1cc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:45.619441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e623412e-884d-4e60-9ee8-e2a1f04aa1cc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:45.619908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e623412e-884d-4e60-9ee8-e2a1f04aa1cc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:45.624956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e623412e-884d-4e60-9ee8-e2a1f04aa1cc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:45.694006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:45.746340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e623412e-884d-4e60-9ee8-e2a1f04aa1cc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:07:45.924841 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e623412e-884d-4e60-9ee8-e2a1f04aa1cc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 204 len: 0 microversion: 2.1 time: 0.392163 Oct 27 19:07:45.925741 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2423/4654] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:07:45 2022] DELETE /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:07:45.934422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-61a805a4-746a-498a-81d7-5e612694c2fc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:45.935155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-61a805a4-746a-498a-81d7-5e612694c2fc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:45.949855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-61a805a4-746a-498a-81d7-5e612694c2fc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:45.950359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-61a805a4-746a-498a-81d7-5e612694c2fc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:45.950865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-61a805a4-746a-498a-81d7-5e612694c2fc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:45.951587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-61a805a4-746a-498a-81d7-5e612694c2fc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:45.952053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-61a805a4-746a-498a-81d7-5e612694c2fc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:45.952492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-61a805a4-746a-498a-81d7-5e612694c2fc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:45.998016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7049bd7e-eb36-4aca-b4b5-1c9d90d9c756 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:46.022875 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7049bd7e-eb36-4aca-b4b5-1c9d90d9c756 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1315 microversion: 2.1 time: 0.923377 Oct 27 19:07:46.024415 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2232/4655] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:45 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1315 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:46.134766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d9c96b4-b023-4cf9-a7a0-b1f859c37dc2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:46.135442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d9c96b4-b023-4cf9-a7a0-b1f859c37dc2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:46.150913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d9c96b4-b023-4cf9-a7a0-b1f859c37dc2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:46.151465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d9c96b4-b023-4cf9-a7a0-b1f859c37dc2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:46.153316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d9c96b4-b023-4cf9-a7a0-b1f859c37dc2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:46.154120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d9c96b4-b023-4cf9-a7a0-b1f859c37dc2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:46.154627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d9c96b4-b023-4cf9-a7a0-b1f859c37dc2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:46.159420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d9c96b4-b023-4cf9-a7a0-b1f859c37dc2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:46.638419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d9c96b4-b023-4cf9-a7a0-b1f859c37dc2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:46.650498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-61a805a4-746a-498a-81d7-5e612694c2fc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:46.653386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:46.655096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d9c96b4-b023-4cf9-a7a0-b1f859c37dc2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:46.663004 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-61a805a4-746a-498a-81d7-5e612694c2fc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1472 microversion: 2.1 time: 0.732761 Oct 27 19:07:46.668738 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2424/4656] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:45 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1472 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:07:46.669086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d9c96b4-b023-4cf9-a7a0-b1f859c37dc2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:46.671577 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d9c96b4-b023-4cf9-a7a0-b1f859c37dc2 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.542087 Oct 27 19:07:46.672149 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2233/4657] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:46 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:07:46.685359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a0f9ef2c-a7d3-4009-a56a-65765c5541a8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:46.707349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a0f9ef2c-a7d3-4009-a56a-65765c5541a8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:46.715496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0f9ef2c-a7d3-4009-a56a-65765c5541a8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:46.716388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0f9ef2c-a7d3-4009-a56a-65765c5541a8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:46.717049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0f9ef2c-a7d3-4009-a56a-65765c5541a8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:46.718012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0f9ef2c-a7d3-4009-a56a-65765c5541a8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:46.718742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0f9ef2c-a7d3-4009-a56a-65765c5541a8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:46.719372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0f9ef2c-a7d3-4009-a56a-65765c5541a8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:47.044388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-4a348e17-bce9-451c-ae1f-9683fe8a29ae req-ce45cddd-cd4d-4fed-8df0-cfc8a3cbada8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0ba883-2279-48c5-a46f-f99d99ad0320", "name": "network-vif-plugged", "status": "completed", "tag": "b7b9e7d5-ac1c-4e75-9d45-512fada58d92"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:47.057084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4a348e17-bce9-451c-ae1f-9683fe8a29ae req-ce45cddd-cd4d-4fed-8df0-cfc8a3cbada8 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:47.057872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4a348e17-bce9-451c-ae1f-9683fe8a29ae req-ce45cddd-cd4d-4fed-8df0-cfc8a3cbada8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:47.058511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4a348e17-bce9-451c-ae1f-9683fe8a29ae req-ce45cddd-cd4d-4fed-8df0-cfc8a3cbada8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:47.074480 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-4a348e17-bce9-451c-ae1f-9683fe8a29ae req-ce45cddd-cd4d-4fed-8df0-cfc8a3cbada8 service nova] Creating event network-vif-plugged:b7b9e7d5-ac1c-4e75-9d45-512fada58d92 for instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 on n-h2-860687-3 Oct 27 19:07:47.082479 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-4a348e17-bce9-451c-ae1f-9683fe8a29ae req-ce45cddd-cd4d-4fed-8df0-cfc8a3cbada8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041818 Oct 27 19:07:47.087177 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2234/4658] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:07:47.101942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f2698785-2138-423e-ad34-7d2720fc5a29 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:47.105052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f2698785-2138-423e-ad34-7d2720fc5a29 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:47.117423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2698785-2138-423e-ad34-7d2720fc5a29 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:47.118195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2698785-2138-423e-ad34-7d2720fc5a29 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:47.118853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2698785-2138-423e-ad34-7d2720fc5a29 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:47.119763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2698785-2138-423e-ad34-7d2720fc5a29 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:47.120447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2698785-2138-423e-ad34-7d2720fc5a29 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:47.121055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2698785-2138-423e-ad34-7d2720fc5a29 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:47.275631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a0f9ef2c-a7d3-4009-a56a-65765c5541a8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:47.303465 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a0f9ef2c-a7d3-4009-a56a-65765c5541a8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1309 microversion: 2.1 time: 0.632825 Oct 27 19:07:47.305870 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2425/4659] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:46 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1309 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:47.355753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f2698785-2138-423e-ad34-7d2720fc5a29 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:47.366624 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f2698785-2138-423e-ad34-7d2720fc5a29 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1315 microversion: 2.1 time: 0.276461 Oct 27 19:07:47.371835 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2235/4660] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:47 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:47.622536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e372a5a1-357b-41a2-89e6-263e080b16af req-7526969f-6c8b-4257-9abc-dc81be6ddc33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b8db6d-ccea-4fb9-bdae-06d0f08708ed", "tag": "c6e3bf93-23fe-4e1e-b8d8-4282d0d7f593"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:47.643031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e372a5a1-357b-41a2-89e6-263e080b16af req-7526969f-6c8b-4257-9abc-dc81be6ddc33 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:47.643794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e372a5a1-357b-41a2-89e6-263e080b16af req-7526969f-6c8b-4257-9abc-dc81be6ddc33 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:47.644489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e372a5a1-357b-41a2-89e6-263e080b16af req-7526969f-6c8b-4257-9abc-dc81be6ddc33 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:47.676473 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e372a5a1-357b-41a2-89e6-263e080b16af req-7526969f-6c8b-4257-9abc-dc81be6ddc33 service nova] Creating event network-changed:c6e3bf93-23fe-4e1e-b8d8-4282d0d7f593 for instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed on n-h2-860687-3 Oct 27 19:07:47.690919 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e372a5a1-357b-41a2-89e6-263e080b16af req-7526969f-6c8b-4257-9abc-dc81be6ddc33 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078461 Oct 27 19:07:47.691645 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2426/4661] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:47.710496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-003cfe00-0bf8-48ef-8131-03eddac06a35 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:47.712916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-003cfe00-0bf8-48ef-8131-03eddac06a35 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:47.722612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-003cfe00-0bf8-48ef-8131-03eddac06a35 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:47.729565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-003cfe00-0bf8-48ef-8131-03eddac06a35 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:47.730460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-003cfe00-0bf8-48ef-8131-03eddac06a35 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:47.731510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-003cfe00-0bf8-48ef-8131-03eddac06a35 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:47.732355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-003cfe00-0bf8-48ef-8131-03eddac06a35 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:47.733011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-003cfe00-0bf8-48ef-8131-03eddac06a35 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:47.777191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b42285f9-5df2-47ce-abbe-51879c93bb45 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:47.777907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b42285f9-5df2-47ce-abbe-51879c93bb45 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:47.808770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42285f9-5df2-47ce-abbe-51879c93bb45 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:47.809104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42285f9-5df2-47ce-abbe-51879c93bb45 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:47.818029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42285f9-5df2-47ce-abbe-51879c93bb45 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:47.819182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42285f9-5df2-47ce-abbe-51879c93bb45 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:47.822310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42285f9-5df2-47ce-abbe-51879c93bb45 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:47.822799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42285f9-5df2-47ce-abbe-51879c93bb45 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:47.974828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-003cfe00-0bf8-48ef-8131-03eddac06a35 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:47.994635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-003cfe00-0bf8-48ef-8131-03eddac06a35 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:47.996107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-003cfe00-0bf8-48ef-8131-03eddac06a35 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:48.016353 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-003cfe00-0bf8-48ef-8131-03eddac06a35 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.318508 Oct 27 19:07:48.038021 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2236/4662] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:47 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:07:48.332634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc28b640-3995-4f20-ab85-e16b6b98c29d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:48.333375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fc28b640-3995-4f20-ab85-e16b6b98c29d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:48.349406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc28b640-3995-4f20-ab85-e16b6b98c29d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:48.349948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc28b640-3995-4f20-ab85-e16b6b98c29d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:48.351556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc28b640-3995-4f20-ab85-e16b6b98c29d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:48.352373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc28b640-3995-4f20-ab85-e16b6b98c29d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:48.352850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc28b640-3995-4f20-ab85-e16b6b98c29d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:48.353289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc28b640-3995-4f20-ab85-e16b6b98c29d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:48.648670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc28b640-3995-4f20-ab85-e16b6b98c29d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:48.658297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b42285f9-5df2-47ce-abbe-51879c93bb45 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:48.670962 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b42285f9-5df2-47ce-abbe-51879c93bb45 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1472 microversion: 2.1 time: 0.898176 Oct 27 19:07:48.673945 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2427/4663] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:47 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1472 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:48.691308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c59fa9da-8e8d-4aec-85e7-92afb4392257 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:48.691920 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc28b640-3995-4f20-ab85-e16b6b98c29d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1309 microversion: 2.1 time: 0.363972 Oct 27 19:07:48.692042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c59fa9da-8e8d-4aec-85e7-92afb4392257 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:48.715936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c59fa9da-8e8d-4aec-85e7-92afb4392257 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:48.716433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c59fa9da-8e8d-4aec-85e7-92afb4392257 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:48.716958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c59fa9da-8e8d-4aec-85e7-92afb4392257 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:48.717640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c59fa9da-8e8d-4aec-85e7-92afb4392257 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:48.718121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c59fa9da-8e8d-4aec-85e7-92afb4392257 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:48.718659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c59fa9da-8e8d-4aec-85e7-92afb4392257 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:48.724198 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2237/4664] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:48 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1309 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:49.046804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f390c0a8-b123-454c-a982-a270c3f3da7a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:49.047541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f390c0a8-b123-454c-a982-a270c3f3da7a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:49.061260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f390c0a8-b123-454c-a982-a270c3f3da7a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:49.067160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f390c0a8-b123-454c-a982-a270c3f3da7a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:49.068196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f390c0a8-b123-454c-a982-a270c3f3da7a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:49.069646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f390c0a8-b123-454c-a982-a270c3f3da7a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:49.070076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f390c0a8-b123-454c-a982-a270c3f3da7a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:49.070951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f390c0a8-b123-454c-a982-a270c3f3da7a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:49.315965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c59fa9da-8e8d-4aec-85e7-92afb4392257 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:49.328393 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c59fa9da-8e8d-4aec-85e7-92afb4392257 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1315 microversion: 2.1 time: 0.649532 Oct 27 19:07:49.346556 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2428/4665] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:48 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:49.480385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f390c0a8-b123-454c-a982-a270c3f3da7a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:49.502874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f390c0a8-b123-454c-a982-a270c3f3da7a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:49.504791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f390c0a8-b123-454c-a982-a270c3f3da7a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:49.507004 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f390c0a8-b123-454c-a982-a270c3f3da7a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.465772 Oct 27 19:07:49.508258 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2238/4666] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:49 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:49.620479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-fbc9120d-6b7c-4a05-93cd-bf3364626f77 req-abc5ab95-c1a2-427e-b387-d7c0794755dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6306e250-f4e8-42d2-a797-34cc197ad70a", "name": "network-vif-deleted", "tag": "b015d979-dcfd-4f51-a259-cc637b0d2e57"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:49.646427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fbc9120d-6b7c-4a05-93cd-bf3364626f77 req-abc5ab95-c1a2-427e-b387-d7c0794755dd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:49.647535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fbc9120d-6b7c-4a05-93cd-bf3364626f77 req-abc5ab95-c1a2-427e-b387-d7c0794755dd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:49.648857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fbc9120d-6b7c-4a05-93cd-bf3364626f77 req-abc5ab95-c1a2-427e-b387-d7c0794755dd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:49.665952 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-fbc9120d-6b7c-4a05-93cd-bf3364626f77 req-abc5ab95-c1a2-427e-b387-d7c0794755dd service nova] Creating event network-vif-deleted:b015d979-dcfd-4f51-a259-cc637b0d2e57 for instance 6306e250-f4e8-42d2-a797-34cc197ad70a on n-h1-860687-3 Oct 27 19:07:49.677998 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-fbc9120d-6b7c-4a05-93cd-bf3364626f77 req-abc5ab95-c1a2-427e-b387-d7c0794755dd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060804 Oct 27 19:07:49.680164 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2429/4667] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:49.698520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9fabfbdc-20fe-401e-b607-52be4e3037f1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:49.700637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9fabfbdc-20fe-401e-b607-52be4e3037f1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:49.724148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fabfbdc-20fe-401e-b607-52be4e3037f1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:49.727645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fabfbdc-20fe-401e-b607-52be4e3037f1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:49.730103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fabfbdc-20fe-401e-b607-52be4e3037f1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:49.732563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fabfbdc-20fe-401e-b607-52be4e3037f1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:49.733949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4e5b2ff1-1e96-4231-ae13-c0a6cdbdd040 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:49.736871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4e5b2ff1-1e96-4231-ae13-c0a6cdbdd040 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:49.737861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fabfbdc-20fe-401e-b607-52be4e3037f1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:49.739282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fabfbdc-20fe-401e-b607-52be4e3037f1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:49.771498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e5b2ff1-1e96-4231-ae13-c0a6cdbdd040 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:49.772025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e5b2ff1-1e96-4231-ae13-c0a6cdbdd040 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:49.772486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e5b2ff1-1e96-4231-ae13-c0a6cdbdd040 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:49.781749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e5b2ff1-1e96-4231-ae13-c0a6cdbdd040 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:49.785534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e5b2ff1-1e96-4231-ae13-c0a6cdbdd040 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:49.786248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e5b2ff1-1e96-4231-ae13-c0a6cdbdd040 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:49.803100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fabfbdc-20fe-401e-b607-52be4e3037f1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:49.804207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fabfbdc-20fe-401e-b607-52be4e3037f1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:49.806026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fabfbdc-20fe-401e-b607-52be4e3037f1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:49.806986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-9fabfbdc-20fe-401e-b607-52be4e3037f1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lazy-loading 'fault' on Instance uuid 6306e250-f4e8-42d2-a797-34cc197ad70a {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:07:49.980796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9fabfbdc-20fe-401e-b607-52be4e3037f1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:50.015226 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9fabfbdc-20fe-401e-b607-52be4e3037f1 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 200 len: 1306 microversion: 2.1 time: 0.316591 Oct 27 19:07:50.017969 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2239/4668] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:49 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 1306 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:50.212245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4e5b2ff1-1e96-4231-ae13-c0a6cdbdd040 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:50.223650 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4e5b2ff1-1e96-4231-ae13-c0a6cdbdd040 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1309 microversion: 2.1 time: 0.511756 Oct 27 19:07:50.224278 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2430/4669] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:49 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1309 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:50.372427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7475ba2f-e329-4d8a-8da7-39a2aaae29a5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:50.375194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7475ba2f-e329-4d8a-8da7-39a2aaae29a5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:50.393872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7475ba2f-e329-4d8a-8da7-39a2aaae29a5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:50.394080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7475ba2f-e329-4d8a-8da7-39a2aaae29a5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:50.394826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7475ba2f-e329-4d8a-8da7-39a2aaae29a5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:50.395815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7475ba2f-e329-4d8a-8da7-39a2aaae29a5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:50.396507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7475ba2f-e329-4d8a-8da7-39a2aaae29a5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:50.397114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7475ba2f-e329-4d8a-8da7-39a2aaae29a5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:50.539868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8f2ab94b-45e9-46c0-a176-70bde481a1bf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:50.541326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8f2ab94b-45e9-46c0-a176-70bde481a1bf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:50.572444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f2ab94b-45e9-46c0-a176-70bde481a1bf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:50.576045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f2ab94b-45e9-46c0-a176-70bde481a1bf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:50.576636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f2ab94b-45e9-46c0-a176-70bde481a1bf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:50.581317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f2ab94b-45e9-46c0-a176-70bde481a1bf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:50.582667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f2ab94b-45e9-46c0-a176-70bde481a1bf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:50.586081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f2ab94b-45e9-46c0-a176-70bde481a1bf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:50.862272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7475ba2f-e329-4d8a-8da7-39a2aaae29a5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:50.872865 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7475ba2f-e329-4d8a-8da7-39a2aaae29a5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1315 microversion: 2.1 time: 0.523632 Oct 27 19:07:50.873614 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2240/4670] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:50 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:50.998361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8f2ab94b-45e9-46c0-a176-70bde481a1bf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:51.015133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8f2ab94b-45e9-46c0-a176-70bde481a1bf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:51.018193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8f2ab94b-45e9-46c0-a176-70bde481a1bf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:51.021024 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8f2ab94b-45e9-46c0-a176-70bde481a1bf tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.486611 Oct 27 19:07:51.051801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eadf4468-d4c3-428d-a49c-34469263d823 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:51.053331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eadf4468-d4c3-428d-a49c-34469263d823 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 6306e250-f4e8-42d2-a797-34cc197ad70a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:51.077685 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2431/4671] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:50 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:07:51.087514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eadf4468-d4c3-428d-a49c-34469263d823 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:51.088495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eadf4468-d4c3-428d-a49c-34469263d823 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:51.088961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eadf4468-d4c3-428d-a49c-34469263d823 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:51.089714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eadf4468-d4c3-428d-a49c-34469263d823 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:51.090203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eadf4468-d4c3-428d-a49c-34469263d823 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:51.090665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eadf4468-d4c3-428d-a49c-34469263d823 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:51.135752 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-eadf4468-d4c3-428d-a49c-34469263d823 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] HTTP exception thrown: Instance 6306e250-f4e8-42d2-a797-34cc197ad70a could not be found. Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eadf4468-d4c3-428d-a49c-34469263d823 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Request method failure captured: Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a HTTP/1.1 Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZeT9JPp7V7IoGkiXDzNbB7JD8tfbBXTPauWmMdx2WDhDyD5iVjcLW-nUWXE5ckU6xH2S7IVDvIpwFjGdpDedZ54N7y867wj50YGs9KWbewr9tvEOMQMWKFdTeys5mixRsyrl7LwzG64-0nrzQR90dLbhf6GsXBq9lzSMg8XienA0w Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50a8ecec5b084df386bc976017133fd8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ad24b0a4144342ceaa2c7470cf529f15 Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 6306e250-f4e8-42d2-a797-34cc197ad70a could not be found. Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '6306e250-f4e8-42d2-a797-34cc197ad70a'} Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6306e250-f4e8-42d2-a797-34cc197ad70a could not be found. Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6306e250-f4e8-42d2-a797-34cc197ad70a could not be found. Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:07:51.146803 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:07:51.152115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:07:51.152115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:07:51.152115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:07:51.152115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:07:51.152115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:07:51.152115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6306e250-f4e8-42d2-a797-34cc197ad70a could not be found. Oct 27 19:07:51.152115 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:07:51.152115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eadf4468-d4c3-428d-a49c-34469263d823 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Returning 404 to user: Instance 6306e250-f4e8-42d2-a797-34cc197ad70a could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:07:51.152115 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eadf4468-d4c3-428d-a49c-34469263d823 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a" status: 404 len: 111 microversion: 2.1 time: 0.111364 Oct 27 19:07:51.156639 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2241/4672] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:51 2022] GET /compute/v2.1/servers/6306e250-f4e8-42d2-a797-34cc197ad70a => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:07:51.165384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-577796dc-20f5-4ae3-a1c5-237f7ed534bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:51.166989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-577796dc-20f5-4ae3-a1c5-237f7ed534bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:51.178626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-577796dc-20f5-4ae3-a1c5-237f7ed534bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:51.187572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-577796dc-20f5-4ae3-a1c5-237f7ed534bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:51.195545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-577796dc-20f5-4ae3-a1c5-237f7ed534bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:51.196595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-577796dc-20f5-4ae3-a1c5-237f7ed534bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:51.197287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-577796dc-20f5-4ae3-a1c5-237f7ed534bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:51.197946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-577796dc-20f5-4ae3-a1c5-237f7ed534bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:51.250375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e0b1e546-70ef-4f69-962f-f224070bd875 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:51.251783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e0b1e546-70ef-4f69-962f-f224070bd875 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:51.270068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-577796dc-20f5-4ae3-a1c5-237f7ed534bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:07:51.271074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e0b1e546-70ef-4f69-962f-f224070bd875 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:51.271797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e0b1e546-70ef-4f69-962f-f224070bd875 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:51.273883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e0b1e546-70ef-4f69-962f-f224070bd875 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:51.275549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e0b1e546-70ef-4f69-962f-f224070bd875 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:51.277429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e0b1e546-70ef-4f69-962f-f224070bd875 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:51.279755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e0b1e546-70ef-4f69-962f-f224070bd875 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:51.453966 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-577796dc-20f5-4ae3-a1c5-237f7ed534bc tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "DELETE /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 204 len: 0 microversion: 2.1 time: 0.296092 Oct 27 19:07:51.458426 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2432/4673] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:07:51 2022] DELETE /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:07:51.464386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-57e8398b-6fe7-43a8-92f4-5c22cf770a02 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:51.465108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-57e8398b-6fe7-43a8-92f4-5c22cf770a02 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:51.487942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57e8398b-6fe7-43a8-92f4-5c22cf770a02 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:51.493071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57e8398b-6fe7-43a8-92f4-5c22cf770a02 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:51.497530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57e8398b-6fe7-43a8-92f4-5c22cf770a02 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:51.498777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57e8398b-6fe7-43a8-92f4-5c22cf770a02 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:51.500065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57e8398b-6fe7-43a8-92f4-5c22cf770a02 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:51.500685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57e8398b-6fe7-43a8-92f4-5c22cf770a02 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:51.655084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e0b1e546-70ef-4f69-962f-f224070bd875 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:51.665799 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e0b1e546-70ef-4f69-962f-f224070bd875 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1309 microversion: 2.1 time: 0.421422 Oct 27 19:07:51.677094 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2242/4674] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:51 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1309 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:51.897203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-035eb804-cc06-4a57-a83e-9d36952ff023 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:51.897859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-035eb804-cc06-4a57-a83e-9d36952ff023 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:51.911082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-035eb804-cc06-4a57-a83e-9d36952ff023 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:51.911897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-035eb804-cc06-4a57-a83e-9d36952ff023 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:51.913145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-035eb804-cc06-4a57-a83e-9d36952ff023 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:51.917637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-035eb804-cc06-4a57-a83e-9d36952ff023 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:51.918734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-035eb804-cc06-4a57-a83e-9d36952ff023 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:51.919388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-035eb804-cc06-4a57-a83e-9d36952ff023 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:52.227687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-035eb804-cc06-4a57-a83e-9d36952ff023 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:52.237403 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-035eb804-cc06-4a57-a83e-9d36952ff023 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1315 microversion: 2.1 time: 0.344165 Oct 27 19:07:52.254598 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2243/4675] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:51 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:52.261536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a9b78e0d-ff44-4638-ab6e-5609d0990a00 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:52.262476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a9b78e0d-ff44-4638-ab6e-5609d0990a00 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:52.269652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9b78e0d-ff44-4638-ab6e-5609d0990a00 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:52.270716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9b78e0d-ff44-4638-ab6e-5609d0990a00 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:52.271444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9b78e0d-ff44-4638-ab6e-5609d0990a00 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:52.272337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9b78e0d-ff44-4638-ab6e-5609d0990a00 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:52.273250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9b78e0d-ff44-4638-ab6e-5609d0990a00 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:52.273857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9b78e0d-ff44-4638-ab6e-5609d0990a00 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:52.476011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a9b78e0d-ff44-4638-ab6e-5609d0990a00 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:52.493879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a9b78e0d-ff44-4638-ab6e-5609d0990a00 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:52.503180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a9b78e0d-ff44-4638-ab6e-5609d0990a00 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:52.505311 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a9b78e0d-ff44-4638-ab6e-5609d0990a00 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.249466 Oct 27 19:07:52.510589 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2244/4676] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:52 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:52.535591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-57e8398b-6fe7-43a8-92f4-5c22cf770a02 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:52.544629 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-57e8398b-6fe7-43a8-92f4-5c22cf770a02 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1472 microversion: 2.1 time: 1.084426 Oct 27 19:07:52.545238 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2433/4677] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:51 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1472 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:07:52.697110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2eeda471-92f2-44f3-bc27-a63df6318538 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:52.698915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2eeda471-92f2-44f3-bc27-a63df6318538 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:52.709166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eeda471-92f2-44f3-bc27-a63df6318538 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:52.710941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eeda471-92f2-44f3-bc27-a63df6318538 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:52.711671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eeda471-92f2-44f3-bc27-a63df6318538 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:52.712679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eeda471-92f2-44f3-bc27-a63df6318538 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:52.713412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eeda471-92f2-44f3-bc27-a63df6318538 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:52.714516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eeda471-92f2-44f3-bc27-a63df6318538 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:53.013780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2eeda471-92f2-44f3-bc27-a63df6318538 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:53.024574 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2eeda471-92f2-44f3-bc27-a63df6318538 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1309 microversion: 2.1 time: 0.339180 Oct 27 19:07:53.034421 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2245/4678] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:52 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1309 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:53.270622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9aad3c5c-72de-4796-9aa2-23c8e8cb5b56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:53.271260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9aad3c5c-72de-4796-9aa2-23c8e8cb5b56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:53.277838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aad3c5c-72de-4796-9aa2-23c8e8cb5b56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:53.278346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aad3c5c-72de-4796-9aa2-23c8e8cb5b56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:53.278831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aad3c5c-72de-4796-9aa2-23c8e8cb5b56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:53.279552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aad3c5c-72de-4796-9aa2-23c8e8cb5b56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:53.280020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aad3c5c-72de-4796-9aa2-23c8e8cb5b56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:53.280459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9aad3c5c-72de-4796-9aa2-23c8e8cb5b56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:53.540961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5f66c215-12c6-4c1b-a0fd-10eaa21aedf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:53.542015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5f66c215-12c6-4c1b-a0fd-10eaa21aedf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:53.553789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f66c215-12c6-4c1b-a0fd-10eaa21aedf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:53.566266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f66c215-12c6-4c1b-a0fd-10eaa21aedf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:53.568980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f66c215-12c6-4c1b-a0fd-10eaa21aedf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:53.569907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f66c215-12c6-4c1b-a0fd-10eaa21aedf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:53.570415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f66c215-12c6-4c1b-a0fd-10eaa21aedf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:53.572804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f66c215-12c6-4c1b-a0fd-10eaa21aedf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:53.733838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9aad3c5c-72de-4796-9aa2-23c8e8cb5b56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:53.744952 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9aad3c5c-72de-4796-9aa2-23c8e8cb5b56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1315 microversion: 2.1 time: 0.488517 Oct 27 19:07:53.754534 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2434/4679] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:53 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:53.755418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4898eff8-a8d8-4f66-9ac8-41002ec8612c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:53.756037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4898eff8-a8d8-4f66-9ac8-41002ec8612c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:53.770526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4898eff8-a8d8-4f66-9ac8-41002ec8612c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:53.773379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4898eff8-a8d8-4f66-9ac8-41002ec8612c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:53.775322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4898eff8-a8d8-4f66-9ac8-41002ec8612c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:53.776355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4898eff8-a8d8-4f66-9ac8-41002ec8612c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:53.778406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4898eff8-a8d8-4f66-9ac8-41002ec8612c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:53.779073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4898eff8-a8d8-4f66-9ac8-41002ec8612c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:54.426139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4898eff8-a8d8-4f66-9ac8-41002ec8612c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:54.438237 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4898eff8-a8d8-4f66-9ac8-41002ec8612c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1472 microversion: 2.1 time: 0.687073 Oct 27 19:07:54.441122 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2435/4680] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:53 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1472 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:54.441447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5f66c215-12c6-4c1b-a0fd-10eaa21aedf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:54.449465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:54.458516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fe6c7c55-e3d6-402c-b0dd-c27f86c05a24 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:54.461398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fe6c7c55-e3d6-402c-b0dd-c27f86c05a24 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:54.465490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5f66c215-12c6-4c1b-a0fd-10eaa21aedf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:54.474378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5f66c215-12c6-4c1b-a0fd-10eaa21aedf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:54.482026 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5f66c215-12c6-4c1b-a0fd-10eaa21aedf1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.942804 Oct 27 19:07:54.482752 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2246/4681] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:53 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:54.490674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe6c7c55-e3d6-402c-b0dd-c27f86c05a24 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:54.491504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe6c7c55-e3d6-402c-b0dd-c27f86c05a24 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:54.491964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe6c7c55-e3d6-402c-b0dd-c27f86c05a24 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:54.492692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe6c7c55-e3d6-402c-b0dd-c27f86c05a24 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:54.493169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe6c7c55-e3d6-402c-b0dd-c27f86c05a24 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:54.493614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe6c7c55-e3d6-402c-b0dd-c27f86c05a24 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:54.755117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fe6c7c55-e3d6-402c-b0dd-c27f86c05a24 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:54.768765 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fe6c7c55-e3d6-402c-b0dd-c27f86c05a24 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1309 microversion: 2.1 time: 0.320713 Oct 27 19:07:54.770934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-94582133-af2a-4ce5-99f1-e3e9fbb60ca1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:54.771559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-94582133-af2a-4ce5-99f1-e3e9fbb60ca1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:54.784073 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2436/4682] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:54 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1309 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:54.794149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94582133-af2a-4ce5-99f1-e3e9fbb60ca1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:54.799560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94582133-af2a-4ce5-99f1-e3e9fbb60ca1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:54.800703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94582133-af2a-4ce5-99f1-e3e9fbb60ca1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:54.801645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94582133-af2a-4ce5-99f1-e3e9fbb60ca1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:54.802184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94582133-af2a-4ce5-99f1-e3e9fbb60ca1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:54.802923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94582133-af2a-4ce5-99f1-e3e9fbb60ca1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:54.925187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-b47e5ddb-7ff3-44f0-8868-5caadb8f846f req-939d2345-646e-4f49-a460-3a5b796f1854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "705c6206-67e4-43dc-8bb1-7ea3367b308f", "name": "network-vif-deleted", "tag": "6ac99626-c0d5-4edf-9802-a94a88adee2d"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:54.941075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b47e5ddb-7ff3-44f0-8868-5caadb8f846f req-939d2345-646e-4f49-a460-3a5b796f1854 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:54.947295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b47e5ddb-7ff3-44f0-8868-5caadb8f846f req-939d2345-646e-4f49-a460-3a5b796f1854 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:54.948004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b47e5ddb-7ff3-44f0-8868-5caadb8f846f req-939d2345-646e-4f49-a460-3a5b796f1854 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:54.972061 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-b47e5ddb-7ff3-44f0-8868-5caadb8f846f req-939d2345-646e-4f49-a460-3a5b796f1854 service nova] Creating event network-vif-deleted:6ac99626-c0d5-4edf-9802-a94a88adee2d for instance 705c6206-67e4-43dc-8bb1-7ea3367b308f on n-h2-860687-3 Oct 27 19:07:54.983919 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-b47e5ddb-7ff3-44f0-8868-5caadb8f846f req-939d2345-646e-4f49-a460-3a5b796f1854 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063246 Oct 27 19:07:54.992285 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2437/4683] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:55.470567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5bafd45f-4eb4-4d06-8624-fcc16792c42d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:55.471362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5bafd45f-4eb4-4d06-8624-fcc16792c42d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:55.488501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bafd45f-4eb4-4d06-8624-fcc16792c42d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:55.495201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bafd45f-4eb4-4d06-8624-fcc16792c42d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:55.496204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bafd45f-4eb4-4d06-8624-fcc16792c42d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:55.497143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bafd45f-4eb4-4d06-8624-fcc16792c42d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:55.498017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bafd45f-4eb4-4d06-8624-fcc16792c42d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:55.498661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bafd45f-4eb4-4d06-8624-fcc16792c42d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:55.671419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5bafd45f-4eb4-4d06-8624-fcc16792c42d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:55.682190 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5bafd45f-4eb4-4d06-8624-fcc16792c42d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1430 microversion: 2.1 time: 0.216479 Oct 27 19:07:55.689305 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2438/4684] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:55 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1430 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:55.697124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d41a3685-52d1-43eb-8797-3eb79a0a6724 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:55.700319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d41a3685-52d1-43eb-8797-3eb79a0a6724 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:55.708439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d41a3685-52d1-43eb-8797-3eb79a0a6724 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:55.709189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d41a3685-52d1-43eb-8797-3eb79a0a6724 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:55.709872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d41a3685-52d1-43eb-8797-3eb79a0a6724 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:55.710859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d41a3685-52d1-43eb-8797-3eb79a0a6724 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:55.711609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d41a3685-52d1-43eb-8797-3eb79a0a6724 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:55.712269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d41a3685-52d1-43eb-8797-3eb79a0a6724 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:55.976280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-94582133-af2a-4ce5-99f1-e3e9fbb60ca1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:55.991816 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-94582133-af2a-4ce5-99f1-e3e9fbb60ca1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1501 microversion: 2.1 time: 1.224059 Oct 27 19:07:55.995078 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2247/4685] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:54 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1501 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:56.005846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-90171e77-dd77-402b-bd3c-31fa3600ed83 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:56.006737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-90171e77-dd77-402b-bd3c-31fa3600ed83 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:56.020076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90171e77-dd77-402b-bd3c-31fa3600ed83 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:56.023073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90171e77-dd77-402b-bd3c-31fa3600ed83 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:56.024485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90171e77-dd77-402b-bd3c-31fa3600ed83 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:56.025558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90171e77-dd77-402b-bd3c-31fa3600ed83 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:56.034682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90171e77-dd77-402b-bd3c-31fa3600ed83 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:56.037706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90171e77-dd77-402b-bd3c-31fa3600ed83 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:56.097770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d41a3685-52d1-43eb-8797-3eb79a0a6724 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:56.113554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d41a3685-52d1-43eb-8797-3eb79a0a6724 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:56.115056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d41a3685-52d1-43eb-8797-3eb79a0a6724 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:56.116284 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d41a3685-52d1-43eb-8797-3eb79a0a6724 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.425870 Oct 27 19:07:56.142418 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2439/4686] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:55 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:56.144329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dbd17ed6-5cdf-4250-bc0b-d1d7c7f2502a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:56.144844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dbd17ed6-5cdf-4250-bc0b-d1d7c7f2502a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:56.166025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbd17ed6-5cdf-4250-bc0b-d1d7c7f2502a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:56.166551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbd17ed6-5cdf-4250-bc0b-d1d7c7f2502a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:56.166993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbd17ed6-5cdf-4250-bc0b-d1d7c7f2502a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:56.167703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbd17ed6-5cdf-4250-bc0b-d1d7c7f2502a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:56.168163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbd17ed6-5cdf-4250-bc0b-d1d7c7f2502a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:56.168587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbd17ed6-5cdf-4250-bc0b-d1d7c7f2502a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:56.233520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dbd17ed6-5cdf-4250-bc0b-d1d7c7f2502a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:07:56.309737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:07:56.405119 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dbd17ed6-5cdf-4250-bc0b-d1d7c7f2502a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 204 len: 0 microversion: 2.1 time: 0.272760 Oct 27 19:07:56.406052 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2440/4687] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:07:56 2022] DELETE /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:07:56.453925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-90171e77-dd77-402b-bd3c-31fa3600ed83 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:56.466157 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-90171e77-dd77-402b-bd3c-31fa3600ed83 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1309 microversion: 2.1 time: 0.469172 Oct 27 19:07:56.468328 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2248/4688] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:55 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1309 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:56.703181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9e1b94f5-8235-4071-8070-1aa550dd9cf0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'create', calling method: .version_select at 0x7fc86b2849d0>, body: {"keypair": {"name": "tempest-keypair-1261240092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqTpW03fqviZBPeYpmFXNPwN0uOmzH04Cj9A1fVYwRrBsnvJwJHnUbG9w3kk0M2WhELf0BmGhCVv1OfQyyrwGN2RTEcbIgpJDNnsNfRlHA7HpC9YgUMD7e0/2Cuva5C8Q=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:56.734842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d731ad8a-14c7-4931-844b-a0da5395d27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784 tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784-project-admin] Calling method '.version_select at 0x7fc869ddbd30>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:56.737265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d731ad8a-14c7-4931-844b-a0da5395d27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784 tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:56.737768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d731ad8a-14c7-4931-844b-a0da5395d27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784 tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:56.738215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d731ad8a-14c7-4931-844b-a0da5395d27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784 tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:56.740735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-9e1b94f5-8235-4071-8070-1aa550dd9cf0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Getting quotas for project 79c27f02ea6549bea54242ab81741f97. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:07:56.747341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-9e1b94f5-8235-4071-8070-1aa550dd9cf0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Getting quotas for user 7019e4c367c0470f95bc66e32def747a and project 79c27f02ea6549bea54242ab81741f97. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:07:56.755032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d731ad8a-14c7-4931-844b-a0da5395d27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784 tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:56.755528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d731ad8a-14c7-4931-844b-a0da5395d27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784 tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:56.756664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d731ad8a-14c7-4931-844b-a0da5395d27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784 tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:56.785195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d731ad8a-14c7-4931-844b-a0da5395d27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784 tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:56.786002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d731ad8a-14c7-4931-844b-a0da5395d27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784 tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:56.786744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d731ad8a-14c7-4931-844b-a0da5395d27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784 tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:56.801407 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d731ad8a-14c7-4931-844b-a0da5395d27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784 tempest-PortsAdminExtendedAttrsIpV6TestJSON-450646784-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.331525 Oct 27 19:07:56.803439 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2249/4689] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 19:07:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:56.810276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5d40cab7-0dd9-4fe7-a723-b612a52adeb7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:56.811702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5d40cab7-0dd9-4fe7-a723-b612a52adeb7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:56.819221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d40cab7-0dd9-4fe7-a723-b612a52adeb7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:56.819976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d40cab7-0dd9-4fe7-a723-b612a52adeb7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:56.820625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d40cab7-0dd9-4fe7-a723-b612a52adeb7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:56.821579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d40cab7-0dd9-4fe7-a723-b612a52adeb7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:56.822249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d40cab7-0dd9-4fe7-a723-b612a52adeb7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:56.822900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d40cab7-0dd9-4fe7-a723-b612a52adeb7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:56.825895 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9e1b94f5-8235-4071-8070-1aa550dd9cf0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.418392 Oct 27 19:07:56.827266 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2441/4690] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:07:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:56.832330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d85a028b-0ca9-4a3b-b7a0-07d3ff9371d2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:56.834873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d85a028b-0ca9-4a3b-b7a0-07d3ff9371d2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:56.843928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d85a028b-0ca9-4a3b-b7a0-07d3ff9371d2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:56.844436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d85a028b-0ca9-4a3b-b7a0-07d3ff9371d2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:56.846145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d85a028b-0ca9-4a3b-b7a0-07d3ff9371d2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:56.847068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d85a028b-0ca9-4a3b-b7a0-07d3ff9371d2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:56.847794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d85a028b-0ca9-4a3b-b7a0-07d3ff9371d2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:56.848254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d85a028b-0ca9-4a3b-b7a0-07d3ff9371d2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:56.945775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d85a028b-0ca9-4a3b-b7a0-07d3ff9371d2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:56.954423 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d85a028b-0ca9-4a3b-b7a0-07d3ff9371d2 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1301 microversion: 2.1 time: 0.125943 Oct 27 19:07:56.955198 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2442/4691] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:56 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1301 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:57.125400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5d40cab7-0dd9-4fe7-a723-b612a52adeb7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:57.135725 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5d40cab7-0dd9-4fe7-a723-b612a52adeb7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1507 microversion: 2.1 time: 0.330877 Oct 27 19:07:57.136856 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2250/4692] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:56 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:57.163277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-610560ef-f151-4248-8f0f-4eec9a576198 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:57.163981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-610560ef-f151-4248-8f0f-4eec9a576198 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:57.179262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-610560ef-f151-4248-8f0f-4eec9a576198 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:57.183732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-610560ef-f151-4248-8f0f-4eec9a576198 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:57.184356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-610560ef-f151-4248-8f0f-4eec9a576198 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:57.186156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-610560ef-f151-4248-8f0f-4eec9a576198 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:57.189593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-610560ef-f151-4248-8f0f-4eec9a576198 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:57.190416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-610560ef-f151-4248-8f0f-4eec9a576198 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:57.494848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eccca6f0-05c7-4d21-96c2-6d1484b63fb8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:57.495476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eccca6f0-05c7-4d21-96c2-6d1484b63fb8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:57.510979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eccca6f0-05c7-4d21-96c2-6d1484b63fb8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:57.511550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eccca6f0-05c7-4d21-96c2-6d1484b63fb8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:57.516020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eccca6f0-05c7-4d21-96c2-6d1484b63fb8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:57.518838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eccca6f0-05c7-4d21-96c2-6d1484b63fb8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:57.521384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eccca6f0-05c7-4d21-96c2-6d1484b63fb8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:57.521842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eccca6f0-05c7-4d21-96c2-6d1484b63fb8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:57.536918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-610560ef-f151-4248-8f0f-4eec9a576198 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:57.551715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-610560ef-f151-4248-8f0f-4eec9a576198 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:57.553655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-610560ef-f151-4248-8f0f-4eec9a576198 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:57.558985 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-610560ef-f151-4248-8f0f-4eec9a576198 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.401643 Oct 27 19:07:57.561040 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2443/4693] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:57 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:57.914022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-eccca6f0-05c7-4d21-96c2-6d1484b63fb8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:57.952136 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eccca6f0-05c7-4d21-96c2-6d1484b63fb8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1309 microversion: 2.1 time: 0.461047 Oct 27 19:07:57.952747 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2251/4694] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:57 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1309 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:57.980322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f1ae9209-49a4-41e1-97e1-5b5272ad891f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:57.981089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f1ae9209-49a4-41e1-97e1-5b5272ad891f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:58.005983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ae9209-49a4-41e1-97e1-5b5272ad891f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:58.006770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ae9209-49a4-41e1-97e1-5b5272ad891f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:58.007227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ae9209-49a4-41e1-97e1-5b5272ad891f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:58.008132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ae9209-49a4-41e1-97e1-5b5272ad891f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:58.008598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ae9209-49a4-41e1-97e1-5b5272ad891f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:58.009032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ae9209-49a4-41e1-97e1-5b5272ad891f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:58.085060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ae9209-49a4-41e1-97e1-5b5272ad891f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:58.085754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ae9209-49a4-41e1-97e1-5b5272ad891f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:58.086399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ae9209-49a4-41e1-97e1-5b5272ad891f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:58.088868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-f1ae9209-49a4-41e1-97e1-5b5272ad891f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lazy-loading 'fault' on Instance uuid 705c6206-67e4-43dc-8bb1-7ea3367b308f {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:07:58.163819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-33099d7c-cea1-48ad-bc17-a44f41b21bf5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:58.165035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-33099d7c-cea1-48ad-bc17-a44f41b21bf5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:58.180886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33099d7c-cea1-48ad-bc17-a44f41b21bf5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:58.181455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33099d7c-cea1-48ad-bc17-a44f41b21bf5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:58.181912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33099d7c-cea1-48ad-bc17-a44f41b21bf5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:58.182669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33099d7c-cea1-48ad-bc17-a44f41b21bf5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:58.183133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33099d7c-cea1-48ad-bc17-a44f41b21bf5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:58.197228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33099d7c-cea1-48ad-bc17-a44f41b21bf5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:58.247268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f1ae9209-49a4-41e1-97e1-5b5272ad891f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:58.266313 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f1ae9209-49a4-41e1-97e1-5b5272ad891f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 200 len: 1306 microversion: 2.1 time: 0.289870 Oct 27 19:07:58.271838 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2444/4695] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:57 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 1306 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:58.607590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c1ba7a02-703a-4342-a1c6-1f68e8ed8549 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:58.608805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c1ba7a02-703a-4342-a1c6-1f68e8ed8549 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:58.623787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1ba7a02-703a-4342-a1c6-1f68e8ed8549 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:58.624680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1ba7a02-703a-4342-a1c6-1f68e8ed8549 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:58.629878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1ba7a02-703a-4342-a1c6-1f68e8ed8549 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:58.631398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1ba7a02-703a-4342-a1c6-1f68e8ed8549 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:58.632218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1ba7a02-703a-4342-a1c6-1f68e8ed8549 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:58.633249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1ba7a02-703a-4342-a1c6-1f68e8ed8549 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:58.941662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-33099d7c-cea1-48ad-bc17-a44f41b21bf5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:58.957975 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-33099d7c-cea1-48ad-bc17-a44f41b21bf5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1507 microversion: 2.1 time: 0.796223 Oct 27 19:07:58.964946 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2252/4696] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:58 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1507 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:07:58.983748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-18d1e5aa-aa4a-4bd7-b8c4-8e1670e2cdcb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:58.992886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-18d1e5aa-aa4a-4bd7-b8c4-8e1670e2cdcb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:59.036978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18d1e5aa-aa4a-4bd7-b8c4-8e1670e2cdcb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:59.037610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18d1e5aa-aa4a-4bd7-b8c4-8e1670e2cdcb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:59.038076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18d1e5aa-aa4a-4bd7-b8c4-8e1670e2cdcb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:59.038869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18d1e5aa-aa4a-4bd7-b8c4-8e1670e2cdcb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:59.039333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18d1e5aa-aa4a-4bd7-b8c4-8e1670e2cdcb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:59.039770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18d1e5aa-aa4a-4bd7-b8c4-8e1670e2cdcb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:59.290065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c1ba7a02-703a-4342-a1c6-1f68e8ed8549 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:59.305825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c1ba7a02-703a-4342-a1c6-1f68e8ed8549 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:59.309030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c1ba7a02-703a-4342-a1c6-1f68e8ed8549 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:59.310766 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c1ba7a02-703a-4342-a1c6-1f68e8ed8549 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.722476 Oct 27 19:07:59.313224 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2445/4697] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:07:58 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:07:59.330575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e68ebd35-40fa-4ef6-94c2-f3f29b8997a1 req-c3177f76-e075-4bea-af2c-fd762208e12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b128ff-a00c-4607-8088-1988263fbe79", "name": "network-vif-plugged", "status": "completed", "tag": "2beafeb2-d863-4916-9b9f-2b9876bdf5ff"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:07:59.369372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e68ebd35-40fa-4ef6-94c2-f3f29b8997a1 req-c3177f76-e075-4bea-af2c-fd762208e12f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:59.372901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e68ebd35-40fa-4ef6-94c2-f3f29b8997a1 req-c3177f76-e075-4bea-af2c-fd762208e12f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:59.378058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e68ebd35-40fa-4ef6-94c2-f3f29b8997a1 req-c3177f76-e075-4bea-af2c-fd762208e12f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:59.444514 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e68ebd35-40fa-4ef6-94c2-f3f29b8997a1 req-c3177f76-e075-4bea-af2c-fd762208e12f service nova] Creating event network-vif-plugged:2beafeb2-d863-4916-9b9f-2b9876bdf5ff for instance 96b128ff-a00c-4607-8088-1988263fbe79 on n-h2-860687-3 Oct 27 19:07:59.449223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-18d1e5aa-aa4a-4bd7-b8c4-8e1670e2cdcb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:07:59.469043 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-18d1e5aa-aa4a-4bd7-b8c4-8e1670e2cdcb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1309 microversion: 2.1 time: 0.489023 Oct 27 19:07:59.470856 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2253/4698] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:58 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1309 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:07:59.479393 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e68ebd35-40fa-4ef6-94c2-f3f29b8997a1 req-c3177f76-e075-4bea-af2c-fd762208e12f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162567 Oct 27 19:07:59.480329 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2446/4699] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:07:59.494844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-054f9339-f185-4968-9276-383027ccf702 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:59.495746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-054f9339-f185-4968-9276-383027ccf702 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 705c6206-67e4-43dc-8bb1-7ea3367b308f] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:59.504127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-054f9339-f185-4968-9276-383027ccf702 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:59.505010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-054f9339-f185-4968-9276-383027ccf702 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:59.505953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-054f9339-f185-4968-9276-383027ccf702 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:59.507176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-054f9339-f185-4968-9276-383027ccf702 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:59.508044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-054f9339-f185-4968-9276-383027ccf702 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:59.508639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-054f9339-f185-4968-9276-383027ccf702 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:59.571366 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-054f9339-f185-4968-9276-383027ccf702 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] HTTP exception thrown: Instance 705c6206-67e4-43dc-8bb1-7ea3367b308f could not be found. Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-054f9339-f185-4968-9276-383027ccf702 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Request method failure captured: Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f HTTP/1.1 Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZeT9JPp7V7IoGkiXDzNbB7JD8tfbBXTPauWmMdx2WDhDyD5iVjcLW-nUWXE5ckU6xH2S7IVDvIpwFjGdpDedZ54N7y867wj50YGs9KWbewr9tvEOMQMWKFdTeys5mixRsyrl7LwzG64-0nrzQR90dLbhf6GsXBq9lzSMg8XienA0w Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50a8ecec5b084df386bc976017133fd8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ad24b0a4144342ceaa2c7470cf529f15 Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 705c6206-67e4-43dc-8bb1-7ea3367b308f could not be found. Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '705c6206-67e4-43dc-8bb1-7ea3367b308f'} Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 705c6206-67e4-43dc-8bb1-7ea3367b308f could not be found. Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 705c6206-67e4-43dc-8bb1-7ea3367b308f could not be found. Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:07:59.577373 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:07:59.583868 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:07:59.583868 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:07:59.583868 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:07:59.583868 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:07:59.583868 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:07:59.583868 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 705c6206-67e4-43dc-8bb1-7ea3367b308f could not be found. Oct 27 19:07:59.583868 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:07:59.586108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-054f9339-f185-4968-9276-383027ccf702 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Returning 404 to user: Instance 705c6206-67e4-43dc-8bb1-7ea3367b308f could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:07:59.587496 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-054f9339-f185-4968-9276-383027ccf702 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f" status: 404 len: 111 microversion: 2.1 time: 0.101716 Oct 27 19:07:59.588866 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2254/4700] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:59 2022] GET /compute/v2.1/servers/705c6206-67e4-43dc-8bb1-7ea3367b308f => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:07:59.600762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3bcc4bbf-2d61-45d9-863a-aa6944ef4243 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:59.601366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3bcc4bbf-2d61-45d9-863a-aa6944ef4243 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:59.632885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3bcc4bbf-2d61-45d9-863a-aa6944ef4243 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:59.635130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3bcc4bbf-2d61-45d9-863a-aa6944ef4243 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:59.637711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3bcc4bbf-2d61-45d9-863a-aa6944ef4243 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:59.642712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3bcc4bbf-2d61-45d9-863a-aa6944ef4243 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:59.643831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3bcc4bbf-2d61-45d9-863a-aa6944ef4243 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:59.647062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3bcc4bbf-2d61-45d9-863a-aa6944ef4243 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:59.692992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3bcc4bbf-2d61-45d9-863a-aa6944ef4243 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:07:59.884037 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3bcc4bbf-2d61-45d9-863a-aa6944ef4243 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "DELETE /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 204 len: 0 microversion: 2.1 time: 0.289032 Oct 27 19:07:59.885442 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2447/4701] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:07:59 2022] DELETE /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:07:59.893457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4c981339-7a22-4dff-a6cf-15ac980e53a4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:59.894279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4c981339-7a22-4dff-a6cf-15ac980e53a4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:07:59.916251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c981339-7a22-4dff-a6cf-15ac980e53a4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:59.916919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c981339-7a22-4dff-a6cf-15ac980e53a4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:59.917488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c981339-7a22-4dff-a6cf-15ac980e53a4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:59.918328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c981339-7a22-4dff-a6cf-15ac980e53a4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:07:59.924377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c981339-7a22-4dff-a6cf-15ac980e53a4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:07:59.925554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c981339-7a22-4dff-a6cf-15ac980e53a4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:07:59.991870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1e03be03-201e-4531-8135-0274b5a0e603 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:07:59.992597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1e03be03-201e-4531-8135-0274b5a0e603 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:00.005229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e03be03-201e-4531-8135-0274b5a0e603 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:00.005736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e03be03-201e-4531-8135-0274b5a0e603 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:00.006183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e03be03-201e-4531-8135-0274b5a0e603 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:00.010086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e03be03-201e-4531-8135-0274b5a0e603 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:00.010670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e03be03-201e-4531-8135-0274b5a0e603 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:00.011660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e03be03-201e-4531-8135-0274b5a0e603 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:00.292492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1e03be03-201e-4531-8135-0274b5a0e603 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:00.304938 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1e03be03-201e-4531-8135-0274b5a0e603 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1507 microversion: 2.1 time: 0.319497 Oct 27 19:08:00.307555 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2448/4702] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:59 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1507 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:00.343238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b219b15b-21b6-4081-a9fb-872d0c5f2bf4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:00.344180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b219b15b-21b6-4081-a9fb-872d0c5f2bf4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:00.354849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b219b15b-21b6-4081-a9fb-872d0c5f2bf4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:00.359155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b219b15b-21b6-4081-a9fb-872d0c5f2bf4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:00.362217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b219b15b-21b6-4081-a9fb-872d0c5f2bf4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:00.363251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b219b15b-21b6-4081-a9fb-872d0c5f2bf4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:00.363924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b219b15b-21b6-4081-a9fb-872d0c5f2bf4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:00.368417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b219b15b-21b6-4081-a9fb-872d0c5f2bf4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:00.474995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4c981339-7a22-4dff-a6cf-15ac980e53a4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:00.495731 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4c981339-7a22-4dff-a6cf-15ac980e53a4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1473 microversion: 2.1 time: 0.606197 Oct 27 19:08:00.498034 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2255/4703] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:07:59 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1473 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:00.520491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-147ed2df-2528-470d-8dfb-10f8653731a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:00.522844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-147ed2df-2528-470d-8dfb-10f8653731a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:00.554657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-147ed2df-2528-470d-8dfb-10f8653731a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:00.555080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-147ed2df-2528-470d-8dfb-10f8653731a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:00.555705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-147ed2df-2528-470d-8dfb-10f8653731a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:00.556581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-147ed2df-2528-470d-8dfb-10f8653731a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:00.559342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-147ed2df-2528-470d-8dfb-10f8653731a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:00.560016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-147ed2df-2528-470d-8dfb-10f8653731a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:00.741946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b219b15b-21b6-4081-a9fb-872d0c5f2bf4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:00.753376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b219b15b-21b6-4081-a9fb-872d0c5f2bf4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:00.755319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b219b15b-21b6-4081-a9fb-872d0c5f2bf4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:00.756909 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b219b15b-21b6-4081-a9fb-872d0c5f2bf4 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.417952 Oct 27 19:08:00.784592 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2449/4704] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:00 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:08:01.332412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9caff6b6-a7df-419a-bc54-556dd23f3bce tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:01.333293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9caff6b6-a7df-419a-bc54-556dd23f3bce tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:01.347329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:01.351084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9caff6b6-a7df-419a-bc54-556dd23f3bce tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:01.354698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9caff6b6-a7df-419a-bc54-556dd23f3bce tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:01.355468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9caff6b6-a7df-419a-bc54-556dd23f3bce tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:01.356726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9caff6b6-a7df-419a-bc54-556dd23f3bce tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:01.357573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9caff6b6-a7df-419a-bc54-556dd23f3bce tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:01.364704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9caff6b6-a7df-419a-bc54-556dd23f3bce tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:01.480184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-147ed2df-2528-470d-8dfb-10f8653731a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:01.497712 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-147ed2df-2528-470d-8dfb-10f8653731a0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1309 microversion: 2.1 time: 0.998341 Oct 27 19:08:01.503995 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2256/4705] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:00 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1309 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:01.528946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a8774cae-3b40-4932-8b2b-fb8c235f0dac tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:01.530075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a8774cae-3b40-4932-8b2b-fb8c235f0dac tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:01.539833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8774cae-3b40-4932-8b2b-fb8c235f0dac tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:01.541728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8774cae-3b40-4932-8b2b-fb8c235f0dac tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:01.543341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8774cae-3b40-4932-8b2b-fb8c235f0dac tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:01.544832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8774cae-3b40-4932-8b2b-fb8c235f0dac tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:01.549388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8774cae-3b40-4932-8b2b-fb8c235f0dac tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:01.550434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8774cae-3b40-4932-8b2b-fb8c235f0dac tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:01.636378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9caff6b6-a7df-419a-bc54-556dd23f3bce tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:01.652916 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9caff6b6-a7df-419a-bc54-556dd23f3bce tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1465 microversion: 2.1 time: 0.327476 Oct 27 19:08:01.654282 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2450/4706] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:01 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1465 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:01.661524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d3199358-d4f9-4098-bf84-2460e1857c4a req-2f9c8f89-e0fe-40a4-a580-21c3ec404814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0ba883-2279-48c5-a46f-f99d99ad0320", "name": "network-vif-deleted", "tag": "b7b9e7d5-ac1c-4e75-9d45-512fada58d92"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:01.680743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d3199358-d4f9-4098-bf84-2460e1857c4a req-2f9c8f89-e0fe-40a4-a580-21c3ec404814 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:01.681560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d3199358-d4f9-4098-bf84-2460e1857c4a req-2f9c8f89-e0fe-40a4-a580-21c3ec404814 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:01.682600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d3199358-d4f9-4098-bf84-2460e1857c4a req-2f9c8f89-e0fe-40a4-a580-21c3ec404814 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:01.702635 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d3199358-d4f9-4098-bf84-2460e1857c4a req-2f9c8f89-e0fe-40a4-a580-21c3ec404814 service nova] Creating event network-vif-deleted:b7b9e7d5-ac1c-4e75-9d45-512fada58d92 for instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 on n-h2-860687-3 Oct 27 19:08:01.713969 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d3199358-d4f9-4098-bf84-2460e1857c4a req-2f9c8f89-e0fe-40a4-a580-21c3ec404814 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056516 Oct 27 19:08:01.715553 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2451/4707] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:01.792254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-efe3b3c4-ec6b-4d2b-a1cb-3bfb5b688d36 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:01.793551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-efe3b3c4-ec6b-4d2b-a1cb-3bfb5b688d36 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:01.821559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efe3b3c4-ec6b-4d2b-a1cb-3bfb5b688d36 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:01.824201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efe3b3c4-ec6b-4d2b-a1cb-3bfb5b688d36 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:01.827101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efe3b3c4-ec6b-4d2b-a1cb-3bfb5b688d36 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:01.832682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efe3b3c4-ec6b-4d2b-a1cb-3bfb5b688d36 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:01.833482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efe3b3c4-ec6b-4d2b-a1cb-3bfb5b688d36 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:01.835031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efe3b3c4-ec6b-4d2b-a1cb-3bfb5b688d36 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:02.076237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a8774cae-3b40-4932-8b2b-fb8c235f0dac tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:02.087937 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a8774cae-3b40-4932-8b2b-fb8c235f0dac tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1473 microversion: 2.1 time: 0.568734 Oct 27 19:08:02.088585 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2257/4708] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:01 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1473 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:02.187941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1015703201", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e58f16a0-9265-4d79-a24b-f3342cfd8059"}], "security_groups": [{"name": "tempest-securitygroup--164106685"}], "key_name": "tempest-keypair-1261240092", "user_data": "}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:02.215945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:02.229358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-efe3b3c4-ec6b-4d2b-a1cb-3bfb5b688d36 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:02.244000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-efe3b3c4-ec6b-4d2b-a1cb-3bfb5b688d36 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:02.247220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-efe3b3c4-ec6b-4d2b-a1cb-3bfb5b688d36 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:02.248789 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-efe3b3c4-ec6b-4d2b-a1cb-3bfb5b688d36 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.463423 Oct 27 19:08:02.263811 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2452/4709] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:01 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:08:02.467937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] validate_networks() for [('e58f16a0-9265-4d79-a24b-f3342cfd8059', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:08:02.529098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4f128d66-f48f-41bc-afe6-ea28acfd3813 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:02.531389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4f128d66-f48f-41bc-afe6-ea28acfd3813 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:02.560143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f128d66-f48f-41bc-afe6-ea28acfd3813 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:02.561355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f128d66-f48f-41bc-afe6-ea28acfd3813 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:02.564840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f128d66-f48f-41bc-afe6-ea28acfd3813 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:02.565833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f128d66-f48f-41bc-afe6-ea28acfd3813 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:02.568803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f128d66-f48f-41bc-afe6-ea28acfd3813 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:02.571134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f128d66-f48f-41bc-afe6-ea28acfd3813 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:03.106526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4f128d66-f48f-41bc-afe6-ea28acfd3813 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:03.133781 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4f128d66-f48f-41bc-afe6-ea28acfd3813 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1309 microversion: 2.1 time: 0.605408 Oct 27 19:08:03.137629 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2453/4710] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:02 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1309 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:03.173503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-673af723-1936-4347-8401-4f42fb1a59a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:03.177975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-673af723-1936-4347-8401-4f42fb1a59a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:03.217946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673af723-1936-4347-8401-4f42fb1a59a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:03.220674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673af723-1936-4347-8401-4f42fb1a59a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:03.221777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673af723-1936-4347-8401-4f42fb1a59a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:03.243490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673af723-1936-4347-8401-4f42fb1a59a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:03.246819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673af723-1936-4347-8401-4f42fb1a59a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:03.251370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673af723-1936-4347-8401-4f42fb1a59a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:03.391935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673af723-1936-4347-8401-4f42fb1a59a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:03.392739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673af723-1936-4347-8401-4f42fb1a59a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:03.393476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673af723-1936-4347-8401-4f42fb1a59a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:03.395023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-673af723-1936-4347-8401-4f42fb1a59a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lazy-loading 'fault' on Instance uuid 3d0ba883-2279-48c5-a46f-f99d99ad0320 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:08:03.530208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-673af723-1936-4347-8401-4f42fb1a59a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:03.549514 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-673af723-1936-4347-8401-4f42fb1a59a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 200 len: 1305 microversion: 2.1 time: 0.403899 Oct 27 19:08:03.550522 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2454/4711] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:03 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 1305 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:03.560584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b73f91b4-4ada-41f3-9f04-1fb63d1fbf4d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:03.563033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b73f91b4-4ada-41f3-9f04-1fb63d1fbf4d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:03.590942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73f91b4-4ada-41f3-9f04-1fb63d1fbf4d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:03.594121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73f91b4-4ada-41f3-9f04-1fb63d1fbf4d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:03.597108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73f91b4-4ada-41f3-9f04-1fb63d1fbf4d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:03.604136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73f91b4-4ada-41f3-9f04-1fb63d1fbf4d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:03.604734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73f91b4-4ada-41f3-9f04-1fb63d1fbf4d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:03.605219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73f91b4-4ada-41f3-9f04-1fb63d1fbf4d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:03.714212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73f91b4-4ada-41f3-9f04-1fb63d1fbf4d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:03.714750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73f91b4-4ada-41f3-9f04-1fb63d1fbf4d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:03.715203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b73f91b4-4ada-41f3-9f04-1fb63d1fbf4d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:03.715677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-b73f91b4-4ada-41f3-9f04-1fb63d1fbf4d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lazy-loading 'fault' on Instance uuid efdf069b-5366-4fb9-8997-0ec6a55a2746 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:08:03.893263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b73f91b4-4ada-41f3-9f04-1fb63d1fbf4d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:03.904522 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b73f91b4-4ada-41f3-9f04-1fb63d1fbf4d tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 200 len: 1307 microversion: 2.1 time: 0.347737 Oct 27 19:08:03.919830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:08:03.920315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:08:03.920735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:08:03.923759 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2455/4712] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:03 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 1307 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:03.927693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:08:03.928228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:08:03.937899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-36a10ca3-a503-4b18-bc72-62aa6ee9f78a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:03.938931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-36a10ca3-a503-4b18-bc72-62aa6ee9f78a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:03.956464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-36a10ca3-a503-4b18-bc72-62aa6ee9f78a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:03.957044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-36a10ca3-a503-4b18-bc72-62aa6ee9f78a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:03.957957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-36a10ca3-a503-4b18-bc72-62aa6ee9f78a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:03.963941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-36a10ca3-a503-4b18-bc72-62aa6ee9f78a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:03.964678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-36a10ca3-a503-4b18-bc72-62aa6ee9f78a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:03.965513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-36a10ca3-a503-4b18-bc72-62aa6ee9f78a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:03.966556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:03.973109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:03.973701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:03.974777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:03.975557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:03.976532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:04.025532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Getting quotas for project 79c27f02ea6549bea54242ab81741f97. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:08:04.033460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:04.045138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Getting quotas for user 7019e4c367c0470f95bc66e32def747a and project 79c27f02ea6549bea54242ab81741f97. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:08:04.084629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:08:04.087259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:08:04.605129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-36a10ca3-a503-4b18-bc72-62aa6ee9f78a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:04.605129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-36a10ca3-a503-4b18-bc72-62aa6ee9f78a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:04.605129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-36a10ca3-a503-4b18-bc72-62aa6ee9f78a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:04.605129 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-36a10ca3-a503-4b18-bc72-62aa6ee9f78a tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1732 microversion: 2.20 time: 0.506412 Oct 27 19:08:04.605129 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2456/4713] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:03 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1732 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:04.613344 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0f0b7c68-bc63-4783-9881-e856ebcee021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.268619 Oct 27 19:08:04.613344 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2258/4714] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:08:02 2022] POST /compute/v2.1/servers => generated 408 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 19:08:04.615467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-72037aaf-eebd-469e-a5cb-d51447198e0f req-0ddaf6d8-dae5-45f5-853c-9873cb3ea9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdf069b-5366-4fb9-8997-0ec6a55a2746", "name": "network-vif-deleted", "tag": "136540f7-7531-431d-8e2c-68e2f6c910f8"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:04.615467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-72037aaf-eebd-469e-a5cb-d51447198e0f req-0ddaf6d8-dae5-45f5-853c-9873cb3ea9d1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:04.615467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-72037aaf-eebd-469e-a5cb-d51447198e0f req-0ddaf6d8-dae5-45f5-853c-9873cb3ea9d1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:04.615467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-72037aaf-eebd-469e-a5cb-d51447198e0f req-0ddaf6d8-dae5-45f5-853c-9873cb3ea9d1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:04.618979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c6115880-7e93-4cb4-a7d8-6e2e8845308f req-83e73f6d-959b-48a9-af95-ea9941c56a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b8db6d-ccea-4fb9-bdae-06d0f08708ed", "name": "network-vif-plugged", "status": "completed", "tag": "c6e3bf93-23fe-4e1e-b8d8-4282d0d7f593"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:04.619193 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-72037aaf-eebd-469e-a5cb-d51447198e0f req-0ddaf6d8-dae5-45f5-853c-9873cb3ea9d1 service nova] Creating event network-vif-deleted:136540f7-7531-431d-8e2c-68e2f6c910f8 for instance efdf069b-5366-4fb9-8997-0ec6a55a2746 on n-h2-860687-3 Oct 27 19:08:04.619193 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-72037aaf-eebd-469e-a5cb-d51447198e0f req-0ddaf6d8-dae5-45f5-853c-9873cb3ea9d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115407 Oct 27 19:08:04.619193 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2457/4715] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:04.619537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c6115880-7e93-4cb4-a7d8-6e2e8845308f req-83e73f6d-959b-48a9-af95-ea9941c56a4f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:04.619537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c6115880-7e93-4cb4-a7d8-6e2e8845308f req-83e73f6d-959b-48a9-af95-ea9941c56a4f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:04.619537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c6115880-7e93-4cb4-a7d8-6e2e8845308f req-83e73f6d-959b-48a9-af95-ea9941c56a4f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:04.621038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-61c13cf4-7e1e-46c7-9d13-868ec0859807 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:04.621869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-61c13cf4-7e1e-46c7-9d13-868ec0859807 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:04.639386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-61c13cf4-7e1e-46c7-9d13-868ec0859807 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:04.640550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-61c13cf4-7e1e-46c7-9d13-868ec0859807 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:04.642549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-61c13cf4-7e1e-46c7-9d13-868ec0859807 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:04.646015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-61c13cf4-7e1e-46c7-9d13-868ec0859807 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:04.648063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-61c13cf4-7e1e-46c7-9d13-868ec0859807 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:04.651054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-61c13cf4-7e1e-46c7-9d13-868ec0859807 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:04.654008 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c6115880-7e93-4cb4-a7d8-6e2e8845308f req-83e73f6d-959b-48a9-af95-ea9941c56a4f service nova] Creating event network-vif-plugged:c6e3bf93-23fe-4e1e-b8d8-4282d0d7f593 for instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed on n-h2-860687-3 Oct 27 19:08:04.675574 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c6115880-7e93-4cb4-a7d8-6e2e8845308f req-83e73f6d-959b-48a9-af95-ea9941c56a4f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208939 Oct 27 19:08:04.676196 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2259/4716] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:04.703643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-21c0fb6d-dcb4-4d27-b1f5-98dc496d9d7f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:04.705416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-21c0fb6d-dcb4-4d27-b1f5-98dc496d9d7f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:05.116908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-21c0fb6d-dcb4-4d27-b1f5-98dc496d9d7f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:05.138908 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-21c0fb6d-dcb4-4d27-b1f5-98dc496d9d7f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1239 microversion: 2.1 time: 0.451486 Oct 27 19:08:05.141736 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2260/4717] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:04 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1239 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:05.160452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13e0aca7-9201-4625-ac57-78b9e3619e81 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:05.163500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-13e0aca7-9201-4625-ac57-78b9e3619e81 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:05.195492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13e0aca7-9201-4625-ac57-78b9e3619e81 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:05.196048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13e0aca7-9201-4625-ac57-78b9e3619e81 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:05.200895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13e0aca7-9201-4625-ac57-78b9e3619e81 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:05.204278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13e0aca7-9201-4625-ac57-78b9e3619e81 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:05.207093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13e0aca7-9201-4625-ac57-78b9e3619e81 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:05.208747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13e0aca7-9201-4625-ac57-78b9e3619e81 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:05.270175 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-13e0aca7-9201-4625-ac57-78b9e3619e81 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13e0aca7-9201-4625-ac57-78b9e3619e81 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 HTTP/1.1 Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '3d0ba883-2279-48c5-a46f-f99d99ad0320'} Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:05.280210 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:05.286892 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:05.286892 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:05.286892 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:05.286892 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:08:05.286892 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:08:05.286892 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:08:05.286892 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:05.286892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13e0aca7-9201-4625-ac57-78b9e3619e81 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:08:05.288720 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-13e0aca7-9201-4625-ac57-78b9e3619e81 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 404 len: 111 microversion: 2.1 time: 0.140108 Oct 27 19:08:05.290023 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2261/4718] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:05 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:08:05.320731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-94c64c09-d13e-4e74-bb61-406594567ecd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:05.323556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-94c64c09-d13e-4e74-bb61-406594567ecd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: efdf069b-5366-4fb9-8997-0ec6a55a2746] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:05.346343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94c64c09-d13e-4e74-bb61-406594567ecd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:05.346858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94c64c09-d13e-4e74-bb61-406594567ecd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:05.351138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94c64c09-d13e-4e74-bb61-406594567ecd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:05.353599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94c64c09-d13e-4e74-bb61-406594567ecd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:05.354267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94c64c09-d13e-4e74-bb61-406594567ecd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:05.356122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94c64c09-d13e-4e74-bb61-406594567ecd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:05.389295 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-94c64c09-d13e-4e74-bb61-406594567ecd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] HTTP exception thrown: Instance efdf069b-5366-4fb9-8997-0ec6a55a2746 could not be found. Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-94c64c09-d13e-4e74-bb61-406594567ecd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Request method failure captured: Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 HTTP/1.1 Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZeT9JPp7V7IoGkiXDzNbB7JD8tfbBXTPauWmMdx2WDhDyD5iVjcLW-nUWXE5ckU6xH2S7IVDvIpwFjGdpDedZ54N7y867wj50YGs9KWbewr9tvEOMQMWKFdTeys5mixRsyrl7LwzG64-0nrzQR90dLbhf6GsXBq9lzSMg8XienA0w Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50a8ecec5b084df386bc976017133fd8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ad24b0a4144342ceaa2c7470cf529f15 Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance efdf069b-5366-4fb9-8997-0ec6a55a2746 could not be found. Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'efdf069b-5366-4fb9-8997-0ec6a55a2746'} Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efdf069b-5366-4fb9-8997-0ec6a55a2746 could not be found. Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efdf069b-5366-4fb9-8997-0ec6a55a2746 could not be found. Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:05.392154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:05.399430 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:05.399430 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:05.399430 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:05.399430 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:08:05.399430 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:08:05.399430 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efdf069b-5366-4fb9-8997-0ec6a55a2746 could not be found. Oct 27 19:08:05.399430 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:05.401780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-94c64c09-d13e-4e74-bb61-406594567ecd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Returning 404 to user: Instance efdf069b-5366-4fb9-8997-0ec6a55a2746 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:08:05.429728 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-94c64c09-d13e-4e74-bb61-406594567ecd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746" status: 404 len: 111 microversion: 2.1 time: 0.138314 Oct 27 19:08:05.439710 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2262/4719] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:05 2022] GET /compute/v2.1/servers/efdf069b-5366-4fb9-8997-0ec6a55a2746 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:08:05.451197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-52ab2e92-f3a8-467f-98b9-5bc31153628c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:05.456532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-52ab2e92-f3a8-467f-98b9-5bc31153628c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 66c337e5-0721-4c5e-a3f2-daa9af6f23a4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:05.469666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52ab2e92-f3a8-467f-98b9-5bc31153628c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:05.473416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52ab2e92-f3a8-467f-98b9-5bc31153628c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:05.475218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52ab2e92-f3a8-467f-98b9-5bc31153628c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:05.477991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52ab2e92-f3a8-467f-98b9-5bc31153628c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:05.478627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52ab2e92-f3a8-467f-98b9-5bc31153628c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:05.480021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52ab2e92-f3a8-467f-98b9-5bc31153628c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:05.513744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-61c13cf4-7e1e-46c7-9d13-868ec0859807 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:05.543314 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-61c13cf4-7e1e-46c7-9d13-868ec0859807 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1309 microversion: 2.1 time: 0.936316 Oct 27 19:08:05.543843 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2458/4720] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:04 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1309 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:05.554080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-52ab2e92-f3a8-467f-98b9-5bc31153628c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 66c337e5-0721-4c5e-a3f2-daa9af6f23a4] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:08:05.600377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e1fb46dd-011d-4e66-8adb-22450a59ae78 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:05.606866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e1fb46dd-011d-4e66-8adb-22450a59ae78 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:05.661130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1fb46dd-011d-4e66-8adb-22450a59ae78 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:05.665273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1fb46dd-011d-4e66-8adb-22450a59ae78 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:05.669077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1fb46dd-011d-4e66-8adb-22450a59ae78 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:05.673119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1fb46dd-011d-4e66-8adb-22450a59ae78 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:05.676166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1fb46dd-011d-4e66-8adb-22450a59ae78 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:05.678142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1fb46dd-011d-4e66-8adb-22450a59ae78 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:05.829378 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-52ab2e92-f3a8-467f-98b9-5bc31153628c tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "DELETE /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4" status: 204 len: 0 microversion: 2.1 time: 0.387720 Oct 27 19:08:05.830552 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2263/4721] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:08:05 2022] DELETE /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:08:05.847769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-937135967", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "e7d83c6b-c0c0-42e5-b094-5dc26599221d"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:05.957793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] validate_networks() for [('e7d83c6b-c0c0-42e5-b094-5dc26599221d', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:08:06.484834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1fb46dd-011d-4e66-8adb-22450a59ae78 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:06.503280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1fb46dd-011d-4e66-8adb-22450a59ae78 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:06.521805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:08:06.522619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:08:06.523763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:08:06.524186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:08:06.524598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:08:06.530636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1fb46dd-011d-4e66-8adb-22450a59ae78 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:06.536369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:06.537789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:06.538466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:06.539931 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e1fb46dd-011d-4e66-8adb-22450a59ae78 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1719 microversion: 2.20 time: 0.978583 Oct 27 19:08:06.551047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:06.551805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:06.552717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:06.559524 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2459/4722] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:05 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1719 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:06.573912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b9636a18-1e63-49c6-a1db-2d6ba5711d17 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:06.574636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b9636a18-1e63-49c6-a1db-2d6ba5711d17 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:06.606584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9636a18-1e63-49c6-a1db-2d6ba5711d17 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:06.608065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9636a18-1e63-49c6-a1db-2d6ba5711d17 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:06.608627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9636a18-1e63-49c6-a1db-2d6ba5711d17 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:06.611574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9636a18-1e63-49c6-a1db-2d6ba5711d17 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:06.613700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9636a18-1e63-49c6-a1db-2d6ba5711d17 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:06.614537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9636a18-1e63-49c6-a1db-2d6ba5711d17 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:06.637762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Getting quotas for project 1798d878b8344ec69c9ef0699467718a. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:08:06.652312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Getting quotas for user b2237837d17c43e99f4e9961cd27cbb5 and project 1798d878b8344ec69c9ef0699467718a. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:08:06.678988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:08:06.687611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:08:06.703635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b9636a18-1e63-49c6-a1db-2d6ba5711d17 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:08:06.775249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:06.783266 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b57375d3-2ea2-42ab-b69c-405d1103eae8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.950957 Oct 27 19:08:06.790999 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2264/4723] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:08:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:08:06.802040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3fdaca79-6ad7-471a-8fa8-7caf6bb87391 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:06.802855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3fdaca79-6ad7-471a-8fa8-7caf6bb87391 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:06.817310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3fdaca79-6ad7-471a-8fa8-7caf6bb87391 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:06.817827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3fdaca79-6ad7-471a-8fa8-7caf6bb87391 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:06.818274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3fdaca79-6ad7-471a-8fa8-7caf6bb87391 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:06.819544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3fdaca79-6ad7-471a-8fa8-7caf6bb87391 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:06.820279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3fdaca79-6ad7-471a-8fa8-7caf6bb87391 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:06.820901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3fdaca79-6ad7-471a-8fa8-7caf6bb87391 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:07.004496 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b9636a18-1e63-49c6-a1db-2d6ba5711d17 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 204 len: 0 microversion: 2.1 time: 0.435236 Oct 27 19:08:07.005441 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2460/4724] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:08:06 2022] DELETE /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:08:07.017740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8b9a25c8-e566-478d-bc42-e65901713109 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:07.024459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8b9a25c8-e566-478d-bc42-e65901713109 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:07.040359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9a25c8-e566-478d-bc42-e65901713109 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:07.041828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9a25c8-e566-478d-bc42-e65901713109 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:07.044402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9a25c8-e566-478d-bc42-e65901713109 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:07.045235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9a25c8-e566-478d-bc42-e65901713109 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:07.046524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9a25c8-e566-478d-bc42-e65901713109 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:07.048732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9a25c8-e566-478d-bc42-e65901713109 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:07.069879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3fdaca79-6ad7-471a-8fa8-7caf6bb87391 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:07.088266 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3fdaca79-6ad7-471a-8fa8-7caf6bb87391 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1243 microversion: 2.1 time: 0.296086 Oct 27 19:08:07.097009 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2265/4725] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:06 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1243 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:07.114260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-be74fa3a-a19a-48c4-8f8c-d296b95a0d32 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:07.120968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-be74fa3a-a19a-48c4-8f8c-d296b95a0d32 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:07.260054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-be74fa3a-a19a-48c4-8f8c-d296b95a0d32 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:07.270182 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-be74fa3a-a19a-48c4-8f8c-d296b95a0d32 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1214 microversion: 2.1 time: 0.170726 Oct 27 19:08:07.291334 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2266/4726] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:07 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:07.302326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9f677d79-30b0-4027-924b-5a23ca42e6fd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:07.303289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9f677d79-30b0-4027-924b-5a23ca42e6fd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 66c337e5-0721-4c5e-a3f2-daa9af6f23a4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:07.310835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f677d79-30b0-4027-924b-5a23ca42e6fd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:07.311340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f677d79-30b0-4027-924b-5a23ca42e6fd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:07.311793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f677d79-30b0-4027-924b-5a23ca42e6fd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:07.312548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f677d79-30b0-4027-924b-5a23ca42e6fd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:07.314049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f677d79-30b0-4027-924b-5a23ca42e6fd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:07.314899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f677d79-30b0-4027-924b-5a23ca42e6fd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:07.495429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8b9a25c8-e566-478d-bc42-e65901713109 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:07.522317 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8b9a25c8-e566-478d-bc42-e65901713109 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1490 microversion: 2.1 time: 0.510904 Oct 27 19:08:07.543194 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2461/4727] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:07 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1490 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:07.588664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9f677d79-30b0-4027-924b-5a23ca42e6fd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:07.593663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:07.604370 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9f677d79-30b0-4027-924b-5a23ca42e6fd tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4" status: 200 len: 1474 microversion: 2.1 time: 0.311861 Oct 27 19:08:07.609157 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2267/4728] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:07 2022] GET /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4 => generated 1474 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:07.624614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ec2f9bd5-01a4-4ac3-b27f-2df1d41a57e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:07.624614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ec2f9bd5-01a4-4ac3-b27f-2df1d41a57e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:07.652137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec2f9bd5-01a4-4ac3-b27f-2df1d41a57e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:07.652137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec2f9bd5-01a4-4ac3-b27f-2df1d41a57e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:07.652137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec2f9bd5-01a4-4ac3-b27f-2df1d41a57e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:07.652137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec2f9bd5-01a4-4ac3-b27f-2df1d41a57e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:07.652137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec2f9bd5-01a4-4ac3-b27f-2df1d41a57e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:07.652137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec2f9bd5-01a4-4ac3-b27f-2df1d41a57e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:08.127283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d4ffe66-228d-4af2-a39d-0c766bee1d4f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:08.127907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d4ffe66-228d-4af2-a39d-0c766bee1d4f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:08.140452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d4ffe66-228d-4af2-a39d-0c766bee1d4f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:08.140956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d4ffe66-228d-4af2-a39d-0c766bee1d4f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:08.141505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d4ffe66-228d-4af2-a39d-0c766bee1d4f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:08.142953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d4ffe66-228d-4af2-a39d-0c766bee1d4f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:08.143420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d4ffe66-228d-4af2-a39d-0c766bee1d4f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:08.149179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d4ffe66-228d-4af2-a39d-0c766bee1d4f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:08.227632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ec2f9bd5-01a4-4ac3-b27f-2df1d41a57e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:08.237348 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ec2f9bd5-01a4-4ac3-b27f-2df1d41a57e1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1489 microversion: 2.1 time: 0.677462 Oct 27 19:08:08.251987 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2462/4729] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:07 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1489 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:08.279795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-54c58517-b775-44c1-a0cd-47c23d0b6678 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:08.280491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-54c58517-b775-44c1-a0cd-47c23d0b6678 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:08.303762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54c58517-b775-44c1-a0cd-47c23d0b6678 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:08.304571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54c58517-b775-44c1-a0cd-47c23d0b6678 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:08.305506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54c58517-b775-44c1-a0cd-47c23d0b6678 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:08.309175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54c58517-b775-44c1-a0cd-47c23d0b6678 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:08.309861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54c58517-b775-44c1-a0cd-47c23d0b6678 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:08.310504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54c58517-b775-44c1-a0cd-47c23d0b6678 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:08.411784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6d4ffe66-228d-4af2-a39d-0c766bee1d4f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:08.421931 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d4ffe66-228d-4af2-a39d-0c766bee1d4f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1291 microversion: 2.1 time: 0.299803 Oct 27 19:08:08.435061 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2268/4730] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:08 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1291 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:08:08.445404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7af85224-5a7f-41bd-bba9-b9cbd0c2cf4a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:08.446306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7af85224-5a7f-41bd-bba9-b9cbd0c2cf4a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:08.456010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7af85224-5a7f-41bd-bba9-b9cbd0c2cf4a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:08.457464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7af85224-5a7f-41bd-bba9-b9cbd0c2cf4a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:08.458181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7af85224-5a7f-41bd-bba9-b9cbd0c2cf4a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:08.459294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7af85224-5a7f-41bd-bba9-b9cbd0c2cf4a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:08.460120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7af85224-5a7f-41bd-bba9-b9cbd0c2cf4a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:08.460787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7af85224-5a7f-41bd-bba9-b9cbd0c2cf4a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:08.819250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7af85224-5a7f-41bd-bba9-b9cbd0c2cf4a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:08.834990 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7af85224-5a7f-41bd-bba9-b9cbd0c2cf4a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1210 microversion: 2.1 time: 0.394884 Oct 27 19:08:08.835253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-54c58517-b775-44c1-a0cd-47c23d0b6678 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:08.852377 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2269/4731] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:08 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1210 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:08.860480 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-54c58517-b775-44c1-a0cd-47c23d0b6678 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1490 microversion: 2.1 time: 0.594359 Oct 27 19:08:08.861585 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2463/4732] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:08 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1490 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:08.865670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e04aed19-9640-40dd-95f6-e5b252c50052 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:08.866642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e04aed19-9640-40dd-95f6-e5b252c50052 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 66c337e5-0721-4c5e-a3f2-daa9af6f23a4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:08.879022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e04aed19-9640-40dd-95f6-e5b252c50052 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:08.879915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e04aed19-9640-40dd-95f6-e5b252c50052 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:08.881329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e04aed19-9640-40dd-95f6-e5b252c50052 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:08.882337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e04aed19-9640-40dd-95f6-e5b252c50052 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:08.884728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e04aed19-9640-40dd-95f6-e5b252c50052 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:08.885438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e04aed19-9640-40dd-95f6-e5b252c50052 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:08.886360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-383941eb-91e7-4594-a647-443466889cff tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:08.887358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-383941eb-91e7-4594-a647-443466889cff tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:08.894378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-383941eb-91e7-4594-a647-443466889cff tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:08.895310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-383941eb-91e7-4594-a647-443466889cff tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:08.896080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-383941eb-91e7-4594-a647-443466889cff tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:08.897981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-383941eb-91e7-4594-a647-443466889cff tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:08.899371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-383941eb-91e7-4594-a647-443466889cff tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:08.900068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-383941eb-91e7-4594-a647-443466889cff tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:08.933267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-383941eb-91e7-4594-a647-443466889cff tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:08:09.124085 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-383941eb-91e7-4594-a647-443466889cff tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 204 len: 0 microversion: 2.1 time: 0.241934 Oct 27 19:08:09.125392 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2464/4733] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:08:08 2022] DELETE /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:08:09.182862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2115c10f-935a-4cae-9415-912ea28f3385 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:09.188660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2115c10f-935a-4cae-9415-912ea28f3385 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:09.211739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2115c10f-935a-4cae-9415-912ea28f3385 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:09.212252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2115c10f-935a-4cae-9415-912ea28f3385 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:09.212700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2115c10f-935a-4cae-9415-912ea28f3385 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:09.213417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2115c10f-935a-4cae-9415-912ea28f3385 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:09.213878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2115c10f-935a-4cae-9415-912ea28f3385 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:09.214316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2115c10f-935a-4cae-9415-912ea28f3385 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:09.318304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e04aed19-9640-40dd-95f6-e5b252c50052 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:09.327461 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e04aed19-9640-40dd-95f6-e5b252c50052 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4" status: 200 len: 1432 microversion: 2.1 time: 0.473815 Oct 27 19:08:09.341126 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2270/4734] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:08 2022] GET /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4 => generated 1432 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:09.365215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ed2be9ef-1c1e-4bba-b316-fcc57958bc2a req-2c4557bc-5db8-40a9-a152-27182a6b014e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c337e5-0721-4c5e-a3f2-daa9af6f23a4", "name": "network-vif-deleted", "tag": "194390f6-52bd-40ae-b4a7-a28c5dab955b"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:09.404665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ed2be9ef-1c1e-4bba-b316-fcc57958bc2a req-2c4557bc-5db8-40a9-a152-27182a6b014e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:09.406533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ed2be9ef-1c1e-4bba-b316-fcc57958bc2a req-2c4557bc-5db8-40a9-a152-27182a6b014e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:09.407533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ed2be9ef-1c1e-4bba-b316-fcc57958bc2a req-2c4557bc-5db8-40a9-a152-27182a6b014e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:09.450993 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ed2be9ef-1c1e-4bba-b316-fcc57958bc2a req-2c4557bc-5db8-40a9-a152-27182a6b014e service nova] Creating event network-vif-deleted:194390f6-52bd-40ae-b4a7-a28c5dab955b for instance 66c337e5-0721-4c5e-a3f2-daa9af6f23a4 on n-h1-860687-3 Oct 27 19:08:09.464780 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ed2be9ef-1c1e-4bba-b316-fcc57958bc2a req-2c4557bc-5db8-40a9-a152-27182a6b014e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121797 Oct 27 19:08:09.472653 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2271/4735] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:09.478609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a1144a66-f6bf-4a13-84fb-b3e9b74e4df7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:09.482128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a1144a66-f6bf-4a13-84fb-b3e9b74e4df7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:09.498910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1144a66-f6bf-4a13-84fb-b3e9b74e4df7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:09.503043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1144a66-f6bf-4a13-84fb-b3e9b74e4df7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:09.503802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1144a66-f6bf-4a13-84fb-b3e9b74e4df7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:09.505811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1144a66-f6bf-4a13-84fb-b3e9b74e4df7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:09.508494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1144a66-f6bf-4a13-84fb-b3e9b74e4df7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:09.509123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1144a66-f6bf-4a13-84fb-b3e9b74e4df7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:09.884544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a1144a66-f6bf-4a13-84fb-b3e9b74e4df7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:09.897057 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a1144a66-f6bf-4a13-84fb-b3e9b74e4df7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1297 microversion: 2.1 time: 0.422789 Oct 27 19:08:09.897644 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2272/4736] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:09 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1297 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:09.911249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7e50a393-d88d-4f33-9410-f2773808a1b3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:09.913215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7e50a393-d88d-4f33-9410-f2773808a1b3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:09.931064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e50a393-d88d-4f33-9410-f2773808a1b3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:09.932341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e50a393-d88d-4f33-9410-f2773808a1b3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:09.934972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e50a393-d88d-4f33-9410-f2773808a1b3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:09.936409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e50a393-d88d-4f33-9410-f2773808a1b3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:09.937059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e50a393-d88d-4f33-9410-f2773808a1b3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:09.939796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e50a393-d88d-4f33-9410-f2773808a1b3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:10.071113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2115c10f-935a-4cae-9415-912ea28f3385 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:10.083707 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2115c10f-935a-4cae-9415-912ea28f3385 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1496 microversion: 2.1 time: 0.952859 Oct 27 19:08:10.084303 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2465/4737] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:09 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1496 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:10.142744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7e50a393-d88d-4f33-9410-f2773808a1b3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:10.153659 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7e50a393-d88d-4f33-9410-f2773808a1b3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1272 microversion: 2.1 time: 0.251146 Oct 27 19:08:10.154252 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2273/4738] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:09 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1272 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:10.362523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-50a1595d-6f9d-4931-badc-c43e8a438308 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:10.363589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-50a1595d-6f9d-4931-badc-c43e8a438308 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 66c337e5-0721-4c5e-a3f2-daa9af6f23a4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:10.375412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a1595d-6f9d-4931-badc-c43e8a438308 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:10.376510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a1595d-6f9d-4931-badc-c43e8a438308 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:10.377345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a1595d-6f9d-4931-badc-c43e8a438308 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:10.383730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a1595d-6f9d-4931-badc-c43e8a438308 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:10.384511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a1595d-6f9d-4931-badc-c43e8a438308 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:10.385805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a1595d-6f9d-4931-badc-c43e8a438308 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:10.462445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a1595d-6f9d-4931-badc-c43e8a438308 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:10.466898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a1595d-6f9d-4931-badc-c43e8a438308 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:10.467356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50a1595d-6f9d-4931-badc-c43e8a438308 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:10.467955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-50a1595d-6f9d-4931-badc-c43e8a438308 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lazy-loading 'fault' on Instance uuid 66c337e5-0721-4c5e-a3f2-daa9af6f23a4 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:08:10.570799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-50a1595d-6f9d-4931-badc-c43e8a438308 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:10.586834 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-50a1595d-6f9d-4931-badc-c43e8a438308 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4" status: 200 len: 1308 microversion: 2.1 time: 0.229074 Oct 27 19:08:10.588626 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2466/4739] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:10 2022] GET /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4 => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:10.925495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-89189dfd-29a3-4c2d-af61-44f65fd34ca7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:10.926035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-89189dfd-29a3-4c2d-af61-44f65fd34ca7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:10.934769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89189dfd-29a3-4c2d-af61-44f65fd34ca7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:10.935304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89189dfd-29a3-4c2d-af61-44f65fd34ca7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:10.935710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89189dfd-29a3-4c2d-af61-44f65fd34ca7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:10.936585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89189dfd-29a3-4c2d-af61-44f65fd34ca7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:10.937050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89189dfd-29a3-4c2d-af61-44f65fd34ca7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:10.939570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89189dfd-29a3-4c2d-af61-44f65fd34ca7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:11.057849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-89189dfd-29a3-4c2d-af61-44f65fd34ca7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:11.073074 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-89189dfd-29a3-4c2d-af61-44f65fd34ca7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1297 microversion: 2.1 time: 0.150409 Oct 27 19:08:11.074192 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2274/4740] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:10 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1297 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:11.112798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5600264e-011c-4042-84dc-6ce094270c94 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:11.113971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5600264e-011c-4042-84dc-6ce094270c94 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:11.127709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5600264e-011c-4042-84dc-6ce094270c94 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:11.129423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5600264e-011c-4042-84dc-6ce094270c94 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:11.130043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5600264e-011c-4042-84dc-6ce094270c94 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:11.131934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5600264e-011c-4042-84dc-6ce094270c94 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:11.136696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5600264e-011c-4042-84dc-6ce094270c94 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:11.137335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5600264e-011c-4042-84dc-6ce094270c94 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:11.198203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-83b0b0d9-eecc-43d2-a794-9b4cb08ede4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:11.202191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-83b0b0d9-eecc-43d2-a794-9b4cb08ede4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:11.235109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83b0b0d9-eecc-43d2-a794-9b4cb08ede4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:11.237686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83b0b0d9-eecc-43d2-a794-9b4cb08ede4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:11.240191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83b0b0d9-eecc-43d2-a794-9b4cb08ede4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:11.244399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83b0b0d9-eecc-43d2-a794-9b4cb08ede4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:11.246504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83b0b0d9-eecc-43d2-a794-9b4cb08ede4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:11.249202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83b0b0d9-eecc-43d2-a794-9b4cb08ede4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:11.795264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-83b0b0d9-eecc-43d2-a794-9b4cb08ede4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:11.808629 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-83b0b0d9-eecc-43d2-a794-9b4cb08ede4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1314 microversion: 2.1 time: 0.632713 Oct 27 19:08:11.814299 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2275/4741] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:11 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:11.821252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-5a8147b5-6aa4-4225-a133-ca78aff888fb req-882995d9-fc9b-4eb7-bdfd-6d37cfd76422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd3bbdb-8e43-4751-a5b3-508d9f78f98c", "name": "network-vif-deleted", "tag": "f95d90b7-71ce-4796-9b14-b63a26ab7627"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:11.857811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5a8147b5-6aa4-4225-a133-ca78aff888fb req-882995d9-fc9b-4eb7-bdfd-6d37cfd76422 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:11.860604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5a8147b5-6aa4-4225-a133-ca78aff888fb req-882995d9-fc9b-4eb7-bdfd-6d37cfd76422 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:11.861393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5a8147b5-6aa4-4225-a133-ca78aff888fb req-882995d9-fc9b-4eb7-bdfd-6d37cfd76422 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:11.898459 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5a8147b5-6aa4-4225-a133-ca78aff888fb req-882995d9-fc9b-4eb7-bdfd-6d37cfd76422 service nova] Creating event network-vif-deleted:f95d90b7-71ce-4796-9b14-b63a26ab7627 for instance 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c on n-h2-860687-3 Oct 27 19:08:11.911103 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-5a8147b5-6aa4-4225-a133-ca78aff888fb req-882995d9-fc9b-4eb7-bdfd-6d37cfd76422 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094049 Oct 27 19:08:11.915551 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2276/4742] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:11.923897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6de1800-c78e-42eb-bfd3-ee220ef4239f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:11.931641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d6de1800-c78e-42eb-bfd3-ee220ef4239f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 66c337e5-0721-4c5e-a3f2-daa9af6f23a4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:11.950313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6de1800-c78e-42eb-bfd3-ee220ef4239f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:11.951151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6de1800-c78e-42eb-bfd3-ee220ef4239f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:11.951611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6de1800-c78e-42eb-bfd3-ee220ef4239f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:11.952346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6de1800-c78e-42eb-bfd3-ee220ef4239f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:11.952814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6de1800-c78e-42eb-bfd3-ee220ef4239f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:11.953312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6de1800-c78e-42eb-bfd3-ee220ef4239f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:11.995945 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d6de1800-c78e-42eb-bfd3-ee220ef4239f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] HTTP exception thrown: Instance 66c337e5-0721-4c5e-a3f2-daa9af6f23a4 could not be found. Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6de1800-c78e-42eb-bfd3-ee220ef4239f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Request method failure captured: Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4 HTTP/1.1 Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZeT9JPp7V7IoGkiXDzNbB7JD8tfbBXTPauWmMdx2WDhDyD5iVjcLW-nUWXE5ckU6xH2S7IVDvIpwFjGdpDedZ54N7y867wj50YGs9KWbewr9tvEOMQMWKFdTeys5mixRsyrl7LwzG64-0nrzQR90dLbhf6GsXBq9lzSMg8XienA0w Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50a8ecec5b084df386bc976017133fd8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ad24b0a4144342ceaa2c7470cf529f15 Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 66c337e5-0721-4c5e-a3f2-daa9af6f23a4 could not be found. Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '66c337e5-0721-4c5e-a3f2-daa9af6f23a4'} Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66c337e5-0721-4c5e-a3f2-daa9af6f23a4 could not be found. Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66c337e5-0721-4c5e-a3f2-daa9af6f23a4 could not be found. Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:12.000651 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:12.006181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:12.006181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:12.006181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:12.006181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:08:12.006181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:08:12.006181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66c337e5-0721-4c5e-a3f2-daa9af6f23a4 could not be found. Oct 27 19:08:12.006181 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:12.008126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6de1800-c78e-42eb-bfd3-ee220ef4239f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Returning 404 to user: Instance 66c337e5-0721-4c5e-a3f2-daa9af6f23a4 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:08:12.009214 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d6de1800-c78e-42eb-bfd3-ee220ef4239f tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4" status: 404 len: 111 microversion: 2.1 time: 0.092195 Oct 27 19:08:12.011593 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2277/4743] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:11 2022] GET /compute/v2.1/servers/66c337e5-0721-4c5e-a3f2-daa9af6f23a4 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:08:12.025739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-acf37f39-1955-4e1d-95b7-6537aff5bff0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:12.028167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-acf37f39-1955-4e1d-95b7-6537aff5bff0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:12.037274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acf37f39-1955-4e1d-95b7-6537aff5bff0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:12.038059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acf37f39-1955-4e1d-95b7-6537aff5bff0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:12.038751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acf37f39-1955-4e1d-95b7-6537aff5bff0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:12.039918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acf37f39-1955-4e1d-95b7-6537aff5bff0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:12.040564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acf37f39-1955-4e1d-95b7-6537aff5bff0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:12.041183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acf37f39-1955-4e1d-95b7-6537aff5bff0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:12.091576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acf37f39-1955-4e1d-95b7-6537aff5bff0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:12.092391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acf37f39-1955-4e1d-95b7-6537aff5bff0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:12.093898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acf37f39-1955-4e1d-95b7-6537aff5bff0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:12.094935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-acf37f39-1955-4e1d-95b7-6537aff5bff0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lazy-loading 'fault' on Instance uuid 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:08:12.157167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5600264e-011c-4042-84dc-6ce094270c94 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:12.180798 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5600264e-011c-4042-84dc-6ce094270c94 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1496 microversion: 2.1 time: 1.072282 Oct 27 19:08:12.181791 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2467/4744] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:11 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1496 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:12.192934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-acf37f39-1955-4e1d-95b7-6537aff5bff0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:12.204241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d77803ba-2ca4-47fb-8bfa-2ff707e5106a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:12.206711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d77803ba-2ca4-47fb-8bfa-2ff707e5106a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:12.208369 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-acf37f39-1955-4e1d-95b7-6537aff5bff0 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 200 len: 1308 microversion: 2.1 time: 0.189984 Oct 27 19:08:12.209808 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2278/4745] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:12 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 1308 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:12.232956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d77803ba-2ca4-47fb-8bfa-2ff707e5106a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:12.235685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d77803ba-2ca4-47fb-8bfa-2ff707e5106a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:12.237402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d77803ba-2ca4-47fb-8bfa-2ff707e5106a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:12.238944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d77803ba-2ca4-47fb-8bfa-2ff707e5106a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:12.239858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d77803ba-2ca4-47fb-8bfa-2ff707e5106a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:12.240475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d77803ba-2ca4-47fb-8bfa-2ff707e5106a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:12.816731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d77803ba-2ca4-47fb-8bfa-2ff707e5106a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:12.825492 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d77803ba-2ca4-47fb-8bfa-2ff707e5106a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1364 microversion: 2.1 time: 0.642177 Oct 27 19:08:12.838644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-100d607e-977e-40cd-b47f-a350bb950422 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:12.839266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-100d607e-977e-40cd-b47f-a350bb950422 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:12.849901 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2468/4746] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:12 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1364 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:12.857826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-100d607e-977e-40cd-b47f-a350bb950422 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:12.859545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-100d607e-977e-40cd-b47f-a350bb950422 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:12.861751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-100d607e-977e-40cd-b47f-a350bb950422 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:12.862872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-100d607e-977e-40cd-b47f-a350bb950422 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:12.863514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-100d607e-977e-40cd-b47f-a350bb950422 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:12.864168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-100d607e-977e-40cd-b47f-a350bb950422 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:13.029093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e5b58820-e24c-438f-bdd0-b0877c3eff1e req-46eb482b-7b35-4009-b7ba-fc8e12bb5fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b8db6d-ccea-4fb9-bdae-06d0f08708ed", "name": "network-vif-deleted", "tag": "c6e3bf93-23fe-4e1e-b8d8-4282d0d7f593"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:13.048274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e5b58820-e24c-438f-bdd0-b0877c3eff1e req-46eb482b-7b35-4009-b7ba-fc8e12bb5fd5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:13.057045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e5b58820-e24c-438f-bdd0-b0877c3eff1e req-46eb482b-7b35-4009-b7ba-fc8e12bb5fd5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:13.057801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e5b58820-e24c-438f-bdd0-b0877c3eff1e req-46eb482b-7b35-4009-b7ba-fc8e12bb5fd5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:13.105721 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e5b58820-e24c-438f-bdd0-b0877c3eff1e req-46eb482b-7b35-4009-b7ba-fc8e12bb5fd5 service nova] Creating event network-vif-deleted:c6e3bf93-23fe-4e1e-b8d8-4282d0d7f593 for instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed on n-h2-860687-3 Oct 27 19:08:13.143782 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e5b58820-e24c-438f-bdd0-b0877c3eff1e req-46eb482b-7b35-4009-b7ba-fc8e12bb5fd5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127578 Oct 27 19:08:13.144872 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2469/4747] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 27 19:08:13.206059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a080128-8fd5-4acc-a994-6338e80cb399 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:13.212128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8a080128-8fd5-4acc-a994-6338e80cb399 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:13.235148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a080128-8fd5-4acc-a994-6338e80cb399 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:13.245284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a080128-8fd5-4acc-a994-6338e80cb399 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:13.247368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a080128-8fd5-4acc-a994-6338e80cb399 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:13.251174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a080128-8fd5-4acc-a994-6338e80cb399 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:13.258133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a080128-8fd5-4acc-a994-6338e80cb399 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:13.260212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a080128-8fd5-4acc-a994-6338e80cb399 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:13.338617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a080128-8fd5-4acc-a994-6338e80cb399 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:13.341421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a080128-8fd5-4acc-a994-6338e80cb399 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:13.342055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a080128-8fd5-4acc-a994-6338e80cb399 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:13.342922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-8a080128-8fd5-4acc-a994-6338e80cb399 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lazy-loading 'fault' on Instance uuid 27b8db6d-ccea-4fb9-bdae-06d0f08708ed {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:08:13.348878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:13.447665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-100d607e-977e-40cd-b47f-a350bb950422 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:13.458739 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-100d607e-977e-40cd-b47f-a350bb950422 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1314 microversion: 2.1 time: 0.624386 Oct 27 19:08:13.459335 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2279/4748] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:12 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:08:13.465388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8a080128-8fd5-4acc-a994-6338e80cb399 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:13.465862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c1c0a597-ce0f-49c7-95c1-04ee5ea31a72 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:13.466692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c1c0a597-ce0f-49c7-95c1-04ee5ea31a72 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:13.475187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1c0a597-ce0f-49c7-95c1-04ee5ea31a72 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:13.475579 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8a080128-8fd5-4acc-a994-6338e80cb399 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 200 len: 1299 microversion: 2.1 time: 0.273929 Oct 27 19:08:13.476210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1c0a597-ce0f-49c7-95c1-04ee5ea31a72 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:13.477006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1c0a597-ce0f-49c7-95c1-04ee5ea31a72 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:13.477958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1c0a597-ce0f-49c7-95c1-04ee5ea31a72 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:13.478856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1c0a597-ce0f-49c7-95c1-04ee5ea31a72 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:13.479751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1c0a597-ce0f-49c7-95c1-04ee5ea31a72 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:13.490730 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2470/4749] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:13 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 1299 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:08:13.499254 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-c1c0a597-ce0f-49c7-95c1-04ee5ea31a72 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] HTTP exception thrown: Instance 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c could not be found. Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c1c0a597-ce0f-49c7-95c1-04ee5ea31a72 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Request method failure captured: Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c HTTP/1.1 Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZeT9JPp7V7IoGkiXDzNbB7JD8tfbBXTPauWmMdx2WDhDyD5iVjcLW-nUWXE5ckU6xH2S7IVDvIpwFjGdpDedZ54N7y867wj50YGs9KWbewr9tvEOMQMWKFdTeys5mixRsyrl7LwzG64-0nrzQR90dLbhf6GsXBq9lzSMg8XienA0w Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50a8ecec5b084df386bc976017133fd8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ad24b0a4144342ceaa2c7470cf529f15 Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c could not be found. Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '5dd3bbdb-8e43-4751-a5b3-508d9f78f98c'} Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c could not be found. Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c could not be found. Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:13.501251 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:13.505320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:13.505320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:13.505320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:13.505320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:08:13.505320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:08:13.505320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c could not be found. Oct 27 19:08:13.505320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:13.507388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c1c0a597-ce0f-49c7-95c1-04ee5ea31a72 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Returning 404 to user: Instance 5dd3bbdb-8e43-4751-a5b3-508d9f78f98c could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:08:13.508471 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c1c0a597-ce0f-49c7-95c1-04ee5ea31a72 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c" status: 404 len: 111 microversion: 2.1 time: 0.046523 Oct 27 19:08:13.509265 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2280/4750] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:13 2022] GET /compute/v2.1/servers/5dd3bbdb-8e43-4751-a5b3-508d9f78f98c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:08:13.517920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b290a3ef-b02a-4bb0-84f4-8933ee34c262 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:13.571620 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b290a3ef-b02a-4bb0-84f4-8933ee34c262 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/35edbec0-d013-404e-b6d6-c0ec180c98ee" status: 204 len: 0 microversion: 2.1 time: 0.058015 Oct 27 19:08:13.573811 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2471/4751] 10.222.0.42 () {58 vars in 1266 bytes} [Thu Oct 27 19:08:13 2022] DELETE /compute/v2.1/os-server-groups/35edbec0-d013-404e-b6d6-c0ec180c98ee => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:08:13.589713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-04350f3a-4dcf-48cc-8f94-48f555f9118a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:13.590477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04350f3a-4dcf-48cc-8f94-48f555f9118a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 50a43387-291d-4b06-9156-c4873b20591b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:13.597902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04350f3a-4dcf-48cc-8f94-48f555f9118a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:13.599794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04350f3a-4dcf-48cc-8f94-48f555f9118a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:13.599794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04350f3a-4dcf-48cc-8f94-48f555f9118a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:13.599794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04350f3a-4dcf-48cc-8f94-48f555f9118a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:13.600950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04350f3a-4dcf-48cc-8f94-48f555f9118a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:13.601930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04350f3a-4dcf-48cc-8f94-48f555f9118a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:13.668360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04350f3a-4dcf-48cc-8f94-48f555f9118a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 50a43387-291d-4b06-9156-c4873b20591b] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:08:13.859134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2914b27b-ffc3-41ce-8b70-6e12eb7695b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:13.861445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2914b27b-ffc3-41ce-8b70-6e12eb7695b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:13.897991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2914b27b-ffc3-41ce-8b70-6e12eb7695b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:13.901233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2914b27b-ffc3-41ce-8b70-6e12eb7695b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:13.901817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2914b27b-ffc3-41ce-8b70-6e12eb7695b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:13.904099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2914b27b-ffc3-41ce-8b70-6e12eb7695b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:13.909094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2914b27b-ffc3-41ce-8b70-6e12eb7695b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:13.910309 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-04350f3a-4dcf-48cc-8f94-48f555f9118a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "DELETE /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b" status: 204 len: 0 microversion: 2.1 time: 0.331630 Oct 27 19:08:13.910714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2914b27b-ffc3-41ce-8b70-6e12eb7695b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:13.911882 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2281/4752] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:08:13 2022] DELETE /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:08:13.922931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cec1feea-f042-4b7e-8961-98ae4850e7df tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:13.923803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cec1feea-f042-4b7e-8961-98ae4850e7df tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:13.942075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec1feea-f042-4b7e-8961-98ae4850e7df tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:13.942766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec1feea-f042-4b7e-8961-98ae4850e7df tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:13.944950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec1feea-f042-4b7e-8961-98ae4850e7df tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:13.947086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec1feea-f042-4b7e-8961-98ae4850e7df tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:13.949835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec1feea-f042-4b7e-8961-98ae4850e7df tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:13.951781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec1feea-f042-4b7e-8961-98ae4850e7df tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:14.040712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cec1feea-f042-4b7e-8961-98ae4850e7df tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:08:14.187645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:14.203201 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cec1feea-f042-4b7e-8961-98ae4850e7df tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 204 len: 0 microversion: 2.1 time: 0.285836 Oct 27 19:08:14.204505 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2282/4753] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:08:13 2022] DELETE /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:08:14.214518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c354e9fa-9334-4880-96ad-088cc7ae5f7e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:14.215660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c354e9fa-9334-4880-96ad-088cc7ae5f7e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 50a43387-291d-4b06-9156-c4873b20591b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:14.225905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c354e9fa-9334-4880-96ad-088cc7ae5f7e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:14.226776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c354e9fa-9334-4880-96ad-088cc7ae5f7e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:14.227601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c354e9fa-9334-4880-96ad-088cc7ae5f7e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:14.229816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c354e9fa-9334-4880-96ad-088cc7ae5f7e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:14.230663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c354e9fa-9334-4880-96ad-088cc7ae5f7e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:14.231337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c354e9fa-9334-4880-96ad-088cc7ae5f7e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:14.264115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:14.440060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2914b27b-ffc3-41ce-8b70-6e12eb7695b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:14.449026 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2914b27b-ffc3-41ce-8b70-6e12eb7695b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1364 microversion: 2.1 time: 0.595695 Oct 27 19:08:14.449614 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2472/4754] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:13 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1364 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:08:14.486339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8d44a00e-ab0d-4975-b6d9-99d862eead72 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:14.487278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8d44a00e-ab0d-4975-b6d9-99d862eead72 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:14.508434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d44a00e-ab0d-4975-b6d9-99d862eead72 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:14.508434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d44a00e-ab0d-4975-b6d9-99d862eead72 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:14.508434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d44a00e-ab0d-4975-b6d9-99d862eead72 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:14.508434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d44a00e-ab0d-4975-b6d9-99d862eead72 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:14.508434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d44a00e-ab0d-4975-b6d9-99d862eead72 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:14.508434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d44a00e-ab0d-4975-b6d9-99d862eead72 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:14.523426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c354e9fa-9334-4880-96ad-088cc7ae5f7e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:14.532451 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c354e9fa-9334-4880-96ad-088cc7ae5f7e tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b" status: 200 len: 1475 microversion: 2.1 time: 0.322506 Oct 27 19:08:14.538795 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2283/4755] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:14 2022] GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b => generated 1475 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:14.546414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bdaada87-1037-41f2-ac35-ac3ef7d3a348 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:14.547049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bdaada87-1037-41f2-ac35-ac3ef7d3a348 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:14.567522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdaada87-1037-41f2-ac35-ac3ef7d3a348 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:14.570859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdaada87-1037-41f2-ac35-ac3ef7d3a348 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:14.571520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdaada87-1037-41f2-ac35-ac3ef7d3a348 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:14.574684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdaada87-1037-41f2-ac35-ac3ef7d3a348 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:14.577239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdaada87-1037-41f2-ac35-ac3ef7d3a348 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:14.577902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdaada87-1037-41f2-ac35-ac3ef7d3a348 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:14.612167 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-bdaada87-1037-41f2-ac35-ac3ef7d3a348 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bdaada87-1037-41f2-ac35-ac3ef7d3a348 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed HTTP/1.1 Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '27b8db6d-ccea-4fb9-bdae-06d0f08708ed'} Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:14.614154 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:14.619318 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:14.619318 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:14.619318 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:08:14.619318 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:08:14.619318 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:08:14.619318 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:14.626618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bdaada87-1037-41f2-ac35-ac3ef7d3a348 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:08:14.627687 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bdaada87-1037-41f2-ac35-ac3ef7d3a348 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 404 len: 111 microversion: 2.1 time: 0.087853 Oct 27 19:08:14.631883 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2284/4756] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:14 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:08:14.641607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fe8a970e-2f62-49e9-9356-90f6f2738d87 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:14.644353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fe8a970e-2f62-49e9-9356-90f6f2738d87 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:14.658657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe8a970e-2f62-49e9-9356-90f6f2738d87 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:14.659387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe8a970e-2f62-49e9-9356-90f6f2738d87 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:14.663050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe8a970e-2f62-49e9-9356-90f6f2738d87 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:14.664003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe8a970e-2f62-49e9-9356-90f6f2738d87 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:14.664874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe8a970e-2f62-49e9-9356-90f6f2738d87 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:14.665502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe8a970e-2f62-49e9-9356-90f6f2738d87 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:14.710752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fe8a970e-2f62-49e9-9356-90f6f2738d87 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:08:14.851915 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fe8a970e-2f62-49e9-9356-90f6f2738d87 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 204 len: 0 microversion: 2.1 time: 0.218356 Oct 27 19:08:14.856489 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2285/4757] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:08:14 2022] DELETE /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:08:14.880150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6e7aa57e-0b06-4e2f-b516-1eb11d152eca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:14.880150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6e7aa57e-0b06-4e2f-b516-1eb11d152eca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:14.887936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e7aa57e-0b06-4e2f-b516-1eb11d152eca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:14.888561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e7aa57e-0b06-4e2f-b516-1eb11d152eca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:14.889114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e7aa57e-0b06-4e2f-b516-1eb11d152eca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:14.889923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e7aa57e-0b06-4e2f-b516-1eb11d152eca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:14.890550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e7aa57e-0b06-4e2f-b516-1eb11d152eca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:14.891154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e7aa57e-0b06-4e2f-b516-1eb11d152eca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:15.186950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6e7aa57e-0b06-4e2f-b516-1eb11d152eca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:15.196880 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6e7aa57e-0b06-4e2f-b516-1eb11d152eca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1495 microversion: 2.1 time: 0.338553 Oct 27 19:08:15.198095 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2286/4758] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:14 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1495 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:15.477332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13ba82dc-12ac-4e54-97c7-6c01e068361a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:15.478173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-13ba82dc-12ac-4e54-97c7-6c01e068361a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:15.485020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba82dc-12ac-4e54-97c7-6c01e068361a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:15.486291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba82dc-12ac-4e54-97c7-6c01e068361a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:15.487020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba82dc-12ac-4e54-97c7-6c01e068361a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:15.488021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba82dc-12ac-4e54-97c7-6c01e068361a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:15.488686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba82dc-12ac-4e54-97c7-6c01e068361a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:15.489302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba82dc-12ac-4e54-97c7-6c01e068361a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:15.627705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8d44a00e-ab0d-4975-b6d9-99d862eead72 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:15.653593 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8d44a00e-ab0d-4975-b6d9-99d862eead72 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1314 microversion: 2.1 time: 1.162754 Oct 27 19:08:15.654655 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2473/4759] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:14 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1314 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:08:15.665674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f1599ac4-27c5-4c2e-8f38-3aee9f4350c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:15.666624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f1599ac4-27c5-4c2e-8f38-3aee9f4350c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 50a43387-291d-4b06-9156-c4873b20591b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:15.675859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1599ac4-27c5-4c2e-8f38-3aee9f4350c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:15.680319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1599ac4-27c5-4c2e-8f38-3aee9f4350c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:15.680835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1599ac4-27c5-4c2e-8f38-3aee9f4350c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:15.681818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1599ac4-27c5-4c2e-8f38-3aee9f4350c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:15.683881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1599ac4-27c5-4c2e-8f38-3aee9f4350c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:15.684334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1599ac4-27c5-4c2e-8f38-3aee9f4350c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:15.745398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-13ba82dc-12ac-4e54-97c7-6c01e068361a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:15.758025 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-13ba82dc-12ac-4e54-97c7-6c01e068361a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1364 microversion: 2.1 time: 0.284881 Oct 27 19:08:15.759155 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2287/4760] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:15 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:08:16.080013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ea1a0849-2a8d-4bca-8ed8-c0cbd1da73a0 req-43687e35-2232-4c42-95a1-8c0aeb37b384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d62a58-bc77-4e6f-bc0c-9fa193005049", "tag": "eb7020ef-d1f7-4471-8bef-9313f01b5b35"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:16.102920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ea1a0849-2a8d-4bca-8ed8-c0cbd1da73a0 req-43687e35-2232-4c42-95a1-8c0aeb37b384 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:16.103680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ea1a0849-2a8d-4bca-8ed8-c0cbd1da73a0 req-43687e35-2232-4c42-95a1-8c0aeb37b384 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:16.103912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f1599ac4-27c5-4c2e-8f38-3aee9f4350c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:16.104549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ea1a0849-2a8d-4bca-8ed8-c0cbd1da73a0 req-43687e35-2232-4c42-95a1-8c0aeb37b384 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:16.121519 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f1599ac4-27c5-4c2e-8f38-3aee9f4350c6 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b" status: 200 len: 1475 microversion: 2.1 time: 0.465527 Oct 27 19:08:16.122417 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2474/4761] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:15 2022] GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b => generated 1475 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:16.123742 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ea1a0849-2a8d-4bca-8ed8-c0cbd1da73a0 req-43687e35-2232-4c42-95a1-8c0aeb37b384 service nova] Creating event network-changed:eb7020ef-d1f7-4471-8bef-9313f01b5b35 for instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 on n-h1-860687-3 Oct 27 19:08:16.136776 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ea1a0849-2a8d-4bca-8ed8-c0cbd1da73a0 req-43687e35-2232-4c42-95a1-8c0aeb37b384 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055199 Oct 27 19:08:16.136776 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2288/4762] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:08:16.224500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f720edb0-728d-4d4a-a476-9b5357a9ec29 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:16.225000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f720edb0-728d-4d4a-a476-9b5357a9ec29 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:16.246320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f720edb0-728d-4d4a-a476-9b5357a9ec29 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:16.246857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f720edb0-728d-4d4a-a476-9b5357a9ec29 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:16.247306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f720edb0-728d-4d4a-a476-9b5357a9ec29 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:16.248059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f720edb0-728d-4d4a-a476-9b5357a9ec29 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:16.248747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f720edb0-728d-4d4a-a476-9b5357a9ec29 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:16.249470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f720edb0-728d-4d4a-a476-9b5357a9ec29 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:16.679552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:16.685815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5145bf64-25e5-4ccb-b3d9-fdade3ec5492 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:16.686858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5145bf64-25e5-4ccb-b3d9-fdade3ec5492 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:16.709142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5145bf64-25e5-4ccb-b3d9-fdade3ec5492 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:16.709681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5145bf64-25e5-4ccb-b3d9-fdade3ec5492 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:16.710460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5145bf64-25e5-4ccb-b3d9-fdade3ec5492 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:16.714667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5145bf64-25e5-4ccb-b3d9-fdade3ec5492 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:16.715173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5145bf64-25e5-4ccb-b3d9-fdade3ec5492 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:16.715629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5145bf64-25e5-4ccb-b3d9-fdade3ec5492 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:16.884678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f720edb0-728d-4d4a-a476-9b5357a9ec29 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:16.895370 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f720edb0-728d-4d4a-a476-9b5357a9ec29 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1495 microversion: 2.1 time: 0.674775 Oct 27 19:08:16.898985 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2475/4763] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:16 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1495 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:16.918366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c76e45c8-00db-4c56-bd76-2e550caf8049 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:16.919498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c76e45c8-00db-4c56-bd76-2e550caf8049 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:16.926490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c76e45c8-00db-4c56-bd76-2e550caf8049 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:16.929658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c76e45c8-00db-4c56-bd76-2e550caf8049 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:16.937428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c76e45c8-00db-4c56-bd76-2e550caf8049 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:16.938540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c76e45c8-00db-4c56-bd76-2e550caf8049 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:16.939487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c76e45c8-00db-4c56-bd76-2e550caf8049 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:16.940098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c76e45c8-00db-4c56-bd76-2e550caf8049 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:17.159126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5145bf64-25e5-4ccb-b3d9-fdade3ec5492 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:17.169200 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5145bf64-25e5-4ccb-b3d9-fdade3ec5492 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1314 microversion: 2.1 time: 0.491048 Oct 27 19:08:17.175573 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2289/4764] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:16 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:08:17.180874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f6fd920b-3af5-43e0-ac99-7e807e0c8f6a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:17.186261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f6fd920b-3af5-43e0-ac99-7e807e0c8f6a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 50a43387-291d-4b06-9156-c4873b20591b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:17.203018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6fd920b-3af5-43e0-ac99-7e807e0c8f6a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:17.204409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6fd920b-3af5-43e0-ac99-7e807e0c8f6a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:17.205183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6fd920b-3af5-43e0-ac99-7e807e0c8f6a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:17.206251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6fd920b-3af5-43e0-ac99-7e807e0c8f6a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:17.206900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6fd920b-3af5-43e0-ac99-7e807e0c8f6a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:17.216449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6fd920b-3af5-43e0-ac99-7e807e0c8f6a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:17.276988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=16 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:17.619383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c76e45c8-00db-4c56-bd76-2e550caf8049 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:17.640812 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c76e45c8-00db-4c56-bd76-2e550caf8049 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1364 microversion: 2.1 time: 0.739324 Oct 27 19:08:17.662841 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2476/4765] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:16 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1364 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:17.671388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6fd920b-3af5-43e0-ac99-7e807e0c8f6a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:17.710561 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f6fd920b-3af5-43e0-ac99-7e807e0c8f6a tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b" status: 200 len: 1475 microversion: 2.1 time: 0.526701 Oct 27 19:08:17.715714 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2290/4766] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:17 2022] GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b => generated 1475 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:17.929642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-961b0435-9bff-478e-8d7d-def6f1f4d144 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:17.930223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-961b0435-9bff-478e-8d7d-def6f1f4d144 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:17.944703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-961b0435-9bff-478e-8d7d-def6f1f4d144 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:17.945333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-961b0435-9bff-478e-8d7d-def6f1f4d144 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:17.946004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-961b0435-9bff-478e-8d7d-def6f1f4d144 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:17.949026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-961b0435-9bff-478e-8d7d-def6f1f4d144 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:17.949866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-961b0435-9bff-478e-8d7d-def6f1f4d144 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:17.950613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-961b0435-9bff-478e-8d7d-def6f1f4d144 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:18.195215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-0b6ea6ab-d99c-44b4-b80d-68a058d326b3 req-e0eda7d2-a028-4c9f-aefb-e33e0bab3151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c", "tag": "80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:18.201133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-961b0435-9bff-478e-8d7d-def6f1f4d144 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:18.217390 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-961b0435-9bff-478e-8d7d-def6f1f4d144 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1453 microversion: 2.1 time: 0.291836 Oct 27 19:08:18.221764 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2477/4767] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:17 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1453 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:18.230998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0b6ea6ab-d99c-44b4-b80d-68a058d326b3 req-e0eda7d2-a028-4c9f-aefb-e33e0bab3151 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:18.233320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0b6ea6ab-d99c-44b4-b80d-68a058d326b3 req-e0eda7d2-a028-4c9f-aefb-e33e0bab3151 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:18.240177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0b6ea6ab-d99c-44b4-b80d-68a058d326b3 req-e0eda7d2-a028-4c9f-aefb-e33e0bab3151 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:18.244615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-16b0f9ad-ff17-4464-9356-f96a28e1c8b2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:18.245247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-16b0f9ad-ff17-4464-9356-f96a28e1c8b2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:18.276674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16b0f9ad-ff17-4464-9356-f96a28e1c8b2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:18.277184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16b0f9ad-ff17-4464-9356-f96a28e1c8b2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:18.277629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16b0f9ad-ff17-4464-9356-f96a28e1c8b2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:18.278358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16b0f9ad-ff17-4464-9356-f96a28e1c8b2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:18.300333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16b0f9ad-ff17-4464-9356-f96a28e1c8b2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:18.300814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16b0f9ad-ff17-4464-9356-f96a28e1c8b2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:18.336953 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-0b6ea6ab-d99c-44b4-b80d-68a058d326b3 req-e0eda7d2-a028-4c9f-aefb-e33e0bab3151 service nova] Creating event network-changed:80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4 for instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c on n-h1-860687-3 Oct 27 19:08:18.366273 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-0b6ea6ab-d99c-44b4-b80d-68a058d326b3 req-e0eda7d2-a028-4c9f-aefb-e33e0bab3151 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175313 Oct 27 19:08:18.370112 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2291/4768] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:18.550091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-00d73c17-5462-404a-a8ed-004214392087 req-deea3429-ccc2-4422-b1c6-6503a8bfeb5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59682c2-3372-419f-b903-46d5e52dfcbb", "name": "network-vif-deleted", "tag": "83220988-6c10-4402-a973-6d9b68efdae2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:18.580117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-00d73c17-5462-404a-a8ed-004214392087 req-deea3429-ccc2-4422-b1c6-6503a8bfeb5e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:18.581832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-00d73c17-5462-404a-a8ed-004214392087 req-deea3429-ccc2-4422-b1c6-6503a8bfeb5e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:18.583686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-00d73c17-5462-404a-a8ed-004214392087 req-deea3429-ccc2-4422-b1c6-6503a8bfeb5e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:18.635020 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-00d73c17-5462-404a-a8ed-004214392087 req-deea3429-ccc2-4422-b1c6-6503a8bfeb5e service nova] Creating event network-vif-deleted:83220988-6c10-4402-a973-6d9b68efdae2 for instance b59682c2-3372-419f-b903-46d5e52dfcbb on n-h1-860687-3 Oct 27 19:08:18.654037 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-00d73c17-5462-404a-a8ed-004214392087 req-deea3429-ccc2-4422-b1c6-6503a8bfeb5e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107598 Oct 27 19:08:18.661533 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2292/4769] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:18.679648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-31763318-4d16-4f64-b5a6-bf048ff9deda tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:18.680369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-31763318-4d16-4f64-b5a6-bf048ff9deda tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:18.701797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31763318-4d16-4f64-b5a6-bf048ff9deda tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:18.708568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31763318-4d16-4f64-b5a6-bf048ff9deda tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:18.709128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31763318-4d16-4f64-b5a6-bf048ff9deda tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:18.709904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31763318-4d16-4f64-b5a6-bf048ff9deda tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:18.710406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31763318-4d16-4f64-b5a6-bf048ff9deda tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:18.710839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31763318-4d16-4f64-b5a6-bf048ff9deda tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:18.981780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-16b0f9ad-ff17-4464-9356-f96a28e1c8b2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:19.026776 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-16b0f9ad-ff17-4464-9356-f96a28e1c8b2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1314 microversion: 2.1 time: 0.801326 Oct 27 19:08:19.046917 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2478/4770] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:18 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:19.069910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de12eeb5-2189-4301-af56-96a773b14a63 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:19.073418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-de12eeb5-2189-4301-af56-96a773b14a63 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 50a43387-291d-4b06-9156-c4873b20591b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:19.103131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de12eeb5-2189-4301-af56-96a773b14a63 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:19.103905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de12eeb5-2189-4301-af56-96a773b14a63 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:19.104372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de12eeb5-2189-4301-af56-96a773b14a63 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:19.106633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de12eeb5-2189-4301-af56-96a773b14a63 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:19.107127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de12eeb5-2189-4301-af56-96a773b14a63 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:19.107583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de12eeb5-2189-4301-af56-96a773b14a63 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:19.294221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-31763318-4d16-4f64-b5a6-bf048ff9deda tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:19.313503 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-31763318-4d16-4f64-b5a6-bf048ff9deda tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1364 microversion: 2.1 time: 0.643087 Oct 27 19:08:19.316997 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2293/4771] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:18 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1364 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:19.345749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c2b8a53a-eabc-4b2a-9a76-dd73136acad2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:19.347119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c2b8a53a-eabc-4b2a-9a76-dd73136acad2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:19.380564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b8a53a-eabc-4b2a-9a76-dd73136acad2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:19.381086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b8a53a-eabc-4b2a-9a76-dd73136acad2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:19.384094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b8a53a-eabc-4b2a-9a76-dd73136acad2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:19.384900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b8a53a-eabc-4b2a-9a76-dd73136acad2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:19.398209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b8a53a-eabc-4b2a-9a76-dd73136acad2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:19.400646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b8a53a-eabc-4b2a-9a76-dd73136acad2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:19.501768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b8a53a-eabc-4b2a-9a76-dd73136acad2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:19.502281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b8a53a-eabc-4b2a-9a76-dd73136acad2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:19.502760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b8a53a-eabc-4b2a-9a76-dd73136acad2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:19.503224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-c2b8a53a-eabc-4b2a-9a76-dd73136acad2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lazy-loading 'fault' on Instance uuid b59682c2-3372-419f-b903-46d5e52dfcbb {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:08:19.633355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c2b8a53a-eabc-4b2a-9a76-dd73136acad2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:19.660038 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c2b8a53a-eabc-4b2a-9a76-dd73136acad2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1299 microversion: 2.1 time: 0.341232 Oct 27 19:08:19.661381 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2294/4772] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:19 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1299 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:19.710379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-de12eeb5-2189-4301-af56-96a773b14a63 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:19.734601 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-de12eeb5-2189-4301-af56-96a773b14a63 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b" status: 200 len: 1433 microversion: 2.1 time: 0.680523 Oct 27 19:08:19.738054 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2479/4773] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:19 2022] GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b => generated 1433 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:20.056801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f0c97e3d-fe88-4780-b5c1-6f6a192136c2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:20.058109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f0c97e3d-fe88-4780-b5c1-6f6a192136c2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:20.080265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0c97e3d-fe88-4780-b5c1-6f6a192136c2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:20.082018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0c97e3d-fe88-4780-b5c1-6f6a192136c2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:20.083132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0c97e3d-fe88-4780-b5c1-6f6a192136c2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:20.085667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0c97e3d-fe88-4780-b5c1-6f6a192136c2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:20.086558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0c97e3d-fe88-4780-b5c1-6f6a192136c2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:20.087750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0c97e3d-fe88-4780-b5c1-6f6a192136c2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:20.354506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-44c49c08-41ab-49e4-aa7b-288ee32d00e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:20.358573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-44c49c08-41ab-49e4-aa7b-288ee32d00e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:20.382443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44c49c08-41ab-49e4-aa7b-288ee32d00e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:20.383211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44c49c08-41ab-49e4-aa7b-288ee32d00e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:20.383570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44c49c08-41ab-49e4-aa7b-288ee32d00e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:20.384545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44c49c08-41ab-49e4-aa7b-288ee32d00e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:20.385023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44c49c08-41ab-49e4-aa7b-288ee32d00e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:20.385485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44c49c08-41ab-49e4-aa7b-288ee32d00e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:20.551710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f0c97e3d-fe88-4780-b5c1-6f6a192136c2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:20.565309 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f0c97e3d-fe88-4780-b5c1-6f6a192136c2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1314 microversion: 2.1 time: 0.514978 Oct 27 19:08:20.568915 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2295/4774] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:20 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:20.596933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-720eecbc-de71-44e4-ad8c-e2da0430f4ce req-65b49e32-112c-4b55-ba91-0bd1abe5bfc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a43387-291d-4b06-9156-c4873b20591b", "name": "network-vif-deleted", "tag": "88c80340-3885-4652-96cc-6fd565c0932a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:20.609466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-720eecbc-de71-44e4-ad8c-e2da0430f4ce req-65b49e32-112c-4b55-ba91-0bd1abe5bfc6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:20.611402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-720eecbc-de71-44e4-ad8c-e2da0430f4ce req-65b49e32-112c-4b55-ba91-0bd1abe5bfc6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:20.612699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-720eecbc-de71-44e4-ad8c-e2da0430f4ce req-65b49e32-112c-4b55-ba91-0bd1abe5bfc6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:20.630511 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-720eecbc-de71-44e4-ad8c-e2da0430f4ce req-65b49e32-112c-4b55-ba91-0bd1abe5bfc6 service nova] Creating event network-vif-deleted:88c80340-3885-4652-96cc-6fd565c0932a for instance 50a43387-291d-4b06-9156-c4873b20591b on n-h2-860687-3 Oct 27 19:08:20.651057 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-720eecbc-de71-44e4-ad8c-e2da0430f4ce req-65b49e32-112c-4b55-ba91-0bd1abe5bfc6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066072 Oct 27 19:08:20.651913 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2296/4775] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:20.686789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-938ee56d-48bc-47ef-bb6f-cbfa8e9f3307 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:20.688164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-938ee56d-48bc-47ef-bb6f-cbfa8e9f3307 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:20.712336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-938ee56d-48bc-47ef-bb6f-cbfa8e9f3307 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:20.713008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-938ee56d-48bc-47ef-bb6f-cbfa8e9f3307 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:20.713475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-938ee56d-48bc-47ef-bb6f-cbfa8e9f3307 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:20.714280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-938ee56d-48bc-47ef-bb6f-cbfa8e9f3307 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:20.714809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-938ee56d-48bc-47ef-bb6f-cbfa8e9f3307 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:20.715251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-938ee56d-48bc-47ef-bb6f-cbfa8e9f3307 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:20.803770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-44c49c08-41ab-49e4-aa7b-288ee32d00e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:20.818127 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-44c49c08-41ab-49e4-aa7b-288ee32d00e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1364 microversion: 2.1 time: 0.479162 Oct 27 19:08:20.821440 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2480/4776] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:20 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1364 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:08:20.849681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-938ee56d-48bc-47ef-bb6f-cbfa8e9f3307 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:20.849825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-b1fef2a8-574b-414e-9078-95c7758296e3 req-f86dc6be-9d7c-4518-b797-31febb817601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73ce77c-368a-405b-9114-6610934665eb", "name": "network-vif-deleted", "tag": "7c30fb5c-147c-449a-aa50-cb73be243ed9"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:20.850915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-938ee56d-48bc-47ef-bb6f-cbfa8e9f3307 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:20.851490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-938ee56d-48bc-47ef-bb6f-cbfa8e9f3307 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:20.853272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-938ee56d-48bc-47ef-bb6f-cbfa8e9f3307 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lazy-loading 'fault' on Instance uuid b59682c2-3372-419f-b903-46d5e52dfcbb {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:08:20.864828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b1fef2a8-574b-414e-9078-95c7758296e3 req-f86dc6be-9d7c-4518-b797-31febb817601 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:20.865370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b1fef2a8-574b-414e-9078-95c7758296e3 req-f86dc6be-9d7c-4518-b797-31febb817601 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:20.866081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b1fef2a8-574b-414e-9078-95c7758296e3 req-f86dc6be-9d7c-4518-b797-31febb817601 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:20.897727 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-b1fef2a8-574b-414e-9078-95c7758296e3 req-f86dc6be-9d7c-4518-b797-31febb817601 service nova] Creating event network-vif-deleted:7c30fb5c-147c-449a-aa50-cb73be243ed9 for instance c73ce77c-368a-405b-9114-6610934665eb on n-h2-860687-3 Oct 27 19:08:20.913559 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-b1fef2a8-574b-414e-9078-95c7758296e3 req-f86dc6be-9d7c-4518-b797-31febb817601 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073164 Oct 27 19:08:20.914184 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2481/4777] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:20.921004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5cc8d75e-22d7-43eb-8d53-9bc29ebb6803 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:20.922037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5cc8d75e-22d7-43eb-8d53-9bc29ebb6803 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 50a43387-291d-4b06-9156-c4873b20591b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:20.932194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cc8d75e-22d7-43eb-8d53-9bc29ebb6803 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:20.933202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cc8d75e-22d7-43eb-8d53-9bc29ebb6803 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:20.934365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cc8d75e-22d7-43eb-8d53-9bc29ebb6803 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:20.935355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cc8d75e-22d7-43eb-8d53-9bc29ebb6803 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:20.936325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cc8d75e-22d7-43eb-8d53-9bc29ebb6803 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:20.936778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cc8d75e-22d7-43eb-8d53-9bc29ebb6803 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:20.936909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-938ee56d-48bc-47ef-bb6f-cbfa8e9f3307 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:20.948035 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-938ee56d-48bc-47ef-bb6f-cbfa8e9f3307 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 200 len: 1299 microversion: 2.1 time: 0.266098 Oct 27 19:08:20.949305 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2297/4778] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:20 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 1299 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:20.983205 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-5cc8d75e-22d7-43eb-8d53-9bc29ebb6803 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] HTTP exception thrown: Instance 50a43387-291d-4b06-9156-c4873b20591b could not be found. Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5cc8d75e-22d7-43eb-8d53-9bc29ebb6803 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Request method failure captured: Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b HTTP/1.1 Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtZeT9JPp7V7IoGkiXDzNbB7JD8tfbBXTPauWmMdx2WDhDyD5iVjcLW-nUWXE5ckU6xH2S7IVDvIpwFjGdpDedZ54N7y867wj50YGs9KWbewr9tvEOMQMWKFdTeys5mixRsyrl7LwzG64-0nrzQR90dLbhf6GsXBq9lzSMg8XienA0w Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50a8ecec5b084df386bc976017133fd8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ad24b0a4144342ceaa2c7470cf529f15 Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 50a43387-291d-4b06-9156-c4873b20591b could not be found. Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '50a43387-291d-4b06-9156-c4873b20591b'} Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a43387-291d-4b06-9156-c4873b20591b could not be found. Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a43387-291d-4b06-9156-c4873b20591b could not be found. Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:20.985639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:08:20.992446 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:20.992446 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:20.992446 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:20.992446 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:08:20.992446 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:08:20.992446 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a43387-291d-4b06-9156-c4873b20591b could not be found. Oct 27 19:08:20.992446 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:08:20.992446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5cc8d75e-22d7-43eb-8d53-9bc29ebb6803 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Returning 404 to user: Instance 50a43387-291d-4b06-9156-c4873b20591b could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:08:20.992446 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5cc8d75e-22d7-43eb-8d53-9bc29ebb6803 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b" status: 404 len: 111 microversion: 2.1 time: 0.071537 Oct 27 19:08:20.992446 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2482/4779] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:20 2022] GET /compute/v2.1/servers/50a43387-291d-4b06-9156-c4873b20591b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:08:20.996600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b28a067-51ae-4af7-9f47-6ee45ea2f913 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:20.997523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7b28a067-51ae-4af7-9f47-6ee45ea2f913 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: c73ce77c-368a-405b-9114-6610934665eb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:21.006433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b28a067-51ae-4af7-9f47-6ee45ea2f913 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:21.007362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b28a067-51ae-4af7-9f47-6ee45ea2f913 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:21.007819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b28a067-51ae-4af7-9f47-6ee45ea2f913 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:21.008589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b28a067-51ae-4af7-9f47-6ee45ea2f913 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:21.009071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b28a067-51ae-4af7-9f47-6ee45ea2f913 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:21.009518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b28a067-51ae-4af7-9f47-6ee45ea2f913 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:21.026471 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-7b28a067-51ae-4af7-9f47-6ee45ea2f913 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] HTTP exception thrown: Instance c73ce77c-368a-405b-9114-6610934665eb could not be found. Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b28a067-51ae-4af7-9f47-6ee45ea2f913 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Request method failure captured: Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb HTTP/1.1 Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZeT9JPp7V7IoGkiXDzNbB7JD8tfbBXTPauWmMdx2WDhDyD5iVjcLW-nUWXE5ckU6xH2S7IVDvIpwFjGdpDedZ54N7y867wj50YGs9KWbewr9tvEOMQMWKFdTeys5mixRsyrl7LwzG64-0nrzQR90dLbhf6GsXBq9lzSMg8XienA0w Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50a8ecec5b084df386bc976017133fd8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ad24b0a4144342ceaa2c7470cf529f15 Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance c73ce77c-368a-405b-9114-6610934665eb could not be found. Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'c73ce77c-368a-405b-9114-6610934665eb'} Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c73ce77c-368a-405b-9114-6610934665eb could not be found. Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73ce77c-368a-405b-9114-6610934665eb could not be found. Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:21.028399 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:21.034475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:21.034475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:21.034475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:21.034475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:08:21.034475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:08:21.034475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73ce77c-368a-405b-9114-6610934665eb could not be found. Oct 27 19:08:21.034475 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:21.034475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b28a067-51ae-4af7-9f47-6ee45ea2f913 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Returning 404 to user: Instance c73ce77c-368a-405b-9114-6610934665eb could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:08:21.034475 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7b28a067-51ae-4af7-9f47-6ee45ea2f913 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb" status: 404 len: 111 microversion: 2.1 time: 0.038758 Oct 27 19:08:21.037985 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2298/4780] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:20 2022] GET /compute/v2.1/servers/c73ce77c-368a-405b-9114-6610934665eb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:08:21.043664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cc25ae2d-47bc-46a5-95f8-6f436fdd8de4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:21.084952 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cc25ae2d-47bc-46a5-95f8-6f436fdd8de4 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/d836588a-4f56-4bf7-ba64-9659822c7304" status: 204 len: 0 microversion: 2.1 time: 0.045874 Oct 27 19:08:21.085845 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2483/4781] 10.222.0.42 () {58 vars in 1266 bytes} [Thu Oct 27 19:08:21 2022] DELETE /compute/v2.1/os-server-groups/d836588a-4f56-4bf7-ba64-9659822c7304 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:08:21.094872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7507d98-d5f1-4396-aac5-db75c8c071fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:21.095405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7507d98-d5f1-4396-aac5-db75c8c071fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:21.127338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7507d98-d5f1-4396-aac5-db75c8c071fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:21.127860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7507d98-d5f1-4396-aac5-db75c8c071fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:21.128321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7507d98-d5f1-4396-aac5-db75c8c071fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:21.129092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7507d98-d5f1-4396-aac5-db75c8c071fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:21.129691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7507d98-d5f1-4396-aac5-db75c8c071fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:21.130354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7507d98-d5f1-4396-aac5-db75c8c071fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:21.202317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7507d98-d5f1-4396-aac5-db75c8c071fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:08:21.320662 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7507d98-d5f1-4396-aac5-db75c8c071fb tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "DELETE /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 204 len: 0 microversion: 2.1 time: 0.229191 Oct 27 19:08:21.321868 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2299/4782] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:08:21 2022] DELETE /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:08:21.332835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e3aabb6e-8cf8-4479-a206-0a7f5ba7dd71 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:21.333691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e3aabb6e-8cf8-4479-a206-0a7f5ba7dd71 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:21.342082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:21.352422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3aabb6e-8cf8-4479-a206-0a7f5ba7dd71 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:21.352937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3aabb6e-8cf8-4479-a206-0a7f5ba7dd71 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:21.353394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3aabb6e-8cf8-4479-a206-0a7f5ba7dd71 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:21.354126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3aabb6e-8cf8-4479-a206-0a7f5ba7dd71 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:21.354630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3aabb6e-8cf8-4479-a206-0a7f5ba7dd71 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:21.355350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3aabb6e-8cf8-4479-a206-0a7f5ba7dd71 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:21.543403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e3aabb6e-8cf8-4479-a206-0a7f5ba7dd71 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:21.553441 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e3aabb6e-8cf8-4479-a206-0a7f5ba7dd71 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1472 microversion: 2.1 time: 0.226598 Oct 27 19:08:21.587131 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2484/4783] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:21 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:21.600273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a0ae5406-a7ee-464c-a66f-1bff4afddb56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:21.601255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a0ae5406-a7ee-464c-a66f-1bff4afddb56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:21.608619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0ae5406-a7ee-464c-a66f-1bff4afddb56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:21.609288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0ae5406-a7ee-464c-a66f-1bff4afddb56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:21.609905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0ae5406-a7ee-464c-a66f-1bff4afddb56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:21.610770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0ae5406-a7ee-464c-a66f-1bff4afddb56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:21.611526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0ae5406-a7ee-464c-a66f-1bff4afddb56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:21.612073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0ae5406-a7ee-464c-a66f-1bff4afddb56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:21.636791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:21.845837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eb5cc806-417f-4569-a4cc-4372d545a906 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:21.852580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-eb5cc806-417f-4569-a4cc-4372d545a906 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:21.860456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb5cc806-417f-4569-a4cc-4372d545a906 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:21.861339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb5cc806-417f-4569-a4cc-4372d545a906 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:21.861810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb5cc806-417f-4569-a4cc-4372d545a906 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:21.862589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb5cc806-417f-4569-a4cc-4372d545a906 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:21.863333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb5cc806-417f-4569-a4cc-4372d545a906 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:21.863833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb5cc806-417f-4569-a4cc-4372d545a906 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:21.919360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0ae5406-a7ee-464c-a66f-1bff4afddb56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:21.929570 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a0ae5406-a7ee-464c-a66f-1bff4afddb56 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1314 microversion: 2.1 time: 0.335793 Oct 27 19:08:21.930929 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2300/4784] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:21 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:21.985627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e473c4c7-3d92-4257-92f1-a655b039213a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:21.988471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e473c4c7-3d92-4257-92f1-a655b039213a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:21.996715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e473c4c7-3d92-4257-92f1-a655b039213a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:21.997245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e473c4c7-3d92-4257-92f1-a655b039213a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:21.997942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e473c4c7-3d92-4257-92f1-a655b039213a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:21.998918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e473c4c7-3d92-4257-92f1-a655b039213a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:21.999603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e473c4c7-3d92-4257-92f1-a655b039213a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:22.000270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e473c4c7-3d92-4257-92f1-a655b039213a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:22.030447 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-e473c4c7-3d92-4257-92f1-a655b039213a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e473c4c7-3d92-4257-92f1-a655b039213a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb HTTP/1.1 Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'b59682c2-3372-419f-b903-46d5e52dfcbb'} Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:22.033005 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:22.037342 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:22.037342 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:22.037342 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:08:22.037342 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:08:22.037342 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:08:22.037342 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:22.052573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e473c4c7-3d92-4257-92f1-a655b039213a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:08:22.055797 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e473c4c7-3d92-4257-92f1-a655b039213a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 404 len: 111 microversion: 2.1 time: 0.082449 Oct 27 19:08:22.058034 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2301/4785] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:21 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:08:22.150981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-eb5cc806-417f-4569-a4cc-4372d545a906 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:22.160971 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eb5cc806-417f-4569-a4cc-4372d545a906 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1364 microversion: 2.1 time: 0.319265 Oct 27 19:08:22.165535 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2485/4786] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:21 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1364 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:08:22.341751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-470298492", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "0e03b86b-4627-4072-8ddb-a6a80f18beba"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:22.440948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] validate_networks() for [('0e03b86b-4627-4072-8ddb-a6a80f18beba', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:08:22.602998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-63f5dfb6-2261-460e-9beb-a07499a8bf25 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:22.605444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-63f5dfb6-2261-460e-9beb-a07499a8bf25 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:22.618264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63f5dfb6-2261-460e-9beb-a07499a8bf25 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:22.619959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63f5dfb6-2261-460e-9beb-a07499a8bf25 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:22.620589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63f5dfb6-2261-460e-9beb-a07499a8bf25 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:22.621837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63f5dfb6-2261-460e-9beb-a07499a8bf25 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:22.623115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63f5dfb6-2261-460e-9beb-a07499a8bf25 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:22.623740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63f5dfb6-2261-460e-9beb-a07499a8bf25 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:22.978794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-63f5dfb6-2261-460e-9beb-a07499a8bf25 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:22.989237 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-63f5dfb6-2261-460e-9beb-a07499a8bf25 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1472 microversion: 2.1 time: 0.401076 Oct 27 19:08:22.992976 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2486/4787] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:22 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1472 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:23.003953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-82d92a8c-0850-4c91-8028-694caff36870 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:23.004586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-82d92a8c-0850-4c91-8028-694caff36870 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:23.023612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82d92a8c-0850-4c91-8028-694caff36870 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:23.024375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82d92a8c-0850-4c91-8028-694caff36870 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:23.025848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82d92a8c-0850-4c91-8028-694caff36870 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:23.030838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82d92a8c-0850-4c91-8028-694caff36870 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:23.031550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82d92a8c-0850-4c91-8028-694caff36870 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:23.033951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82d92a8c-0850-4c91-8028-694caff36870 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:23.107610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:08:23.116882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:08:23.116882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:08:23.116882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:08:23.116882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:08:23.151066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:23.151614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:23.151917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:23.152659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:23.153122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:23.153558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:23.199659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:08:23.207953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for user e7d5767d1dc249cd8e97097588ee4728 and project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:08:23.224403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:08:23.238022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:08:23.383877 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf278a48-0060-4e1f-a123-adbef9f605ae tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.044210 Oct 27 19:08:23.384557 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2302/4788] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:08:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:08:23.398523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e4d4d624-5cdd-49ec-8478-c97986d3dfff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:23.399153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e4d4d624-5cdd-49ec-8478-c97986d3dfff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:23.421420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4d4d624-5cdd-49ec-8478-c97986d3dfff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:23.421931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4d4d624-5cdd-49ec-8478-c97986d3dfff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:23.422493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4d4d624-5cdd-49ec-8478-c97986d3dfff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:23.435447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4d4d624-5cdd-49ec-8478-c97986d3dfff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:23.435953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4d4d624-5cdd-49ec-8478-c97986d3dfff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:23.436410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4d4d624-5cdd-49ec-8478-c97986d3dfff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:23.720930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e4d4d624-5cdd-49ec-8478-c97986d3dfff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:23.734579 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e4d4d624-5cdd-49ec-8478-c97986d3dfff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1364 microversion: 2.1 time: 0.348276 Oct 27 19:08:23.751264 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2303/4789] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:23 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1364 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:23.759172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dc67abaf-1c93-4edf-abaf-71fe36b0add0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:23.759956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dc67abaf-1c93-4edf-abaf-71fe36b0add0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:23.848381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dc67abaf-1c93-4edf-abaf-71fe36b0add0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:23.859282 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dc67abaf-1c93-4edf-abaf-71fe36b0add0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1208 microversion: 2.1 time: 0.104652 Oct 27 19:08:23.875752 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2304/4790] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:23 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1208 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:24.013210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-24fd1b02-6676-4ff0-b804-6cafd122a3da tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:24.014438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-24fd1b02-6676-4ff0-b804-6cafd122a3da tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:24.031062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24fd1b02-6676-4ff0-b804-6cafd122a3da tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:24.035123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24fd1b02-6676-4ff0-b804-6cafd122a3da tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:24.036035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24fd1b02-6676-4ff0-b804-6cafd122a3da tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:24.039336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24fd1b02-6676-4ff0-b804-6cafd122a3da tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:24.041491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24fd1b02-6676-4ff0-b804-6cafd122a3da tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:24.043358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24fd1b02-6676-4ff0-b804-6cafd122a3da tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:24.211094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-82d92a8c-0850-4c91-8028-694caff36870 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:24.230850 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-82d92a8c-0850-4c91-8028-694caff36870 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1314 microversion: 2.1 time: 1.236583 Oct 27 19:08:24.231764 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2487/4791] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:22 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1314 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:24.523759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-24fd1b02-6676-4ff0-b804-6cafd122a3da tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:24.540406 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-24fd1b02-6676-4ff0-b804-6cafd122a3da tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1472 microversion: 2.1 time: 0.531113 Oct 27 19:08:24.546554 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2305/4792] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:24 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1472 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:08:24.760085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-579e52dc-b2e1-4c1f-9c15-abed8d7131a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:24.760687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-579e52dc-b2e1-4c1f-9c15-abed8d7131a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:24.786465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-579e52dc-b2e1-4c1f-9c15-abed8d7131a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:24.787272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-579e52dc-b2e1-4c1f-9c15-abed8d7131a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:24.787909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-579e52dc-b2e1-4c1f-9c15-abed8d7131a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:24.789025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-579e52dc-b2e1-4c1f-9c15-abed8d7131a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:24.789699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-579e52dc-b2e1-4c1f-9c15-abed8d7131a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:24.790305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-579e52dc-b2e1-4c1f-9c15-abed8d7131a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:24.883322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f1a4c070-2708-45b8-810a-a7aff3e8c40a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:24.884042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f1a4c070-2708-45b8-810a-a7aff3e8c40a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:24.895340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1a4c070-2708-45b8-810a-a7aff3e8c40a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:24.902698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1a4c070-2708-45b8-810a-a7aff3e8c40a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:24.903279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1a4c070-2708-45b8-810a-a7aff3e8c40a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:24.910539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1a4c070-2708-45b8-810a-a7aff3e8c40a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:24.911255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1a4c070-2708-45b8-810a-a7aff3e8c40a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:24.912051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1a4c070-2708-45b8-810a-a7aff3e8c40a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:25.518718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-579e52dc-b2e1-4c1f-9c15-abed8d7131a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:25.532221 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-579e52dc-b2e1-4c1f-9c15-abed8d7131a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1364 microversion: 2.1 time: 0.775224 Oct 27 19:08:25.532815 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2488/4793] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:24 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1364 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:25.546629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d0c06bab-5f86-4595-88ed-24c72e5c39cb req-a9c6c4a8-2e28-4178-89f3-e0ae3782de92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c", "name": "network-vif-plugged", "status": "completed", "tag": "80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:25.600651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d0c06bab-5f86-4595-88ed-24c72e5c39cb req-a9c6c4a8-2e28-4178-89f3-e0ae3782de92 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:25.601150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d0c06bab-5f86-4595-88ed-24c72e5c39cb req-a9c6c4a8-2e28-4178-89f3-e0ae3782de92 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:25.601595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d0c06bab-5f86-4595-88ed-24c72e5c39cb req-a9c6c4a8-2e28-4178-89f3-e0ae3782de92 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:25.618880 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d0c06bab-5f86-4595-88ed-24c72e5c39cb req-a9c6c4a8-2e28-4178-89f3-e0ae3782de92 service nova] Creating event network-vif-plugged:80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4 for instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c on n-h1-860687-3 Oct 27 19:08:25.640548 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d0c06bab-5f86-4595-88ed-24c72e5c39cb req-a9c6c4a8-2e28-4178-89f3-e0ae3782de92 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106434 Oct 27 19:08:25.642375 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2489/4794] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:25.661141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d79016cd-63df-484c-aaad-895c8ec07d35 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:25.661863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d79016cd-63df-484c-aaad-895c8ec07d35 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:25.676918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d79016cd-63df-484c-aaad-895c8ec07d35 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:25.680400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d79016cd-63df-484c-aaad-895c8ec07d35 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:25.681047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d79016cd-63df-484c-aaad-895c8ec07d35 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:25.681965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d79016cd-63df-484c-aaad-895c8ec07d35 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:25.687916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d79016cd-63df-484c-aaad-895c8ec07d35 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:25.688896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d79016cd-63df-484c-aaad-895c8ec07d35 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:25.799479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f1a4c070-2708-45b8-810a-a7aff3e8c40a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:25.818552 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f1a4c070-2708-45b8-810a-a7aff3e8c40a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1260 microversion: 2.1 time: 0.936448 Oct 27 19:08:25.819824 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2306/4795] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:24 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1260 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:25.841316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cea40f57-38e4-4b81-b345-096a612c439b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:25.846171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cea40f57-38e4-4b81-b345-096a612c439b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:25.859631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cea40f57-38e4-4b81-b345-096a612c439b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:25.860187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cea40f57-38e4-4b81-b345-096a612c439b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:25.860638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cea40f57-38e4-4b81-b345-096a612c439b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:25.861363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cea40f57-38e4-4b81-b345-096a612c439b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:25.861826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cea40f57-38e4-4b81-b345-096a612c439b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:25.862260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cea40f57-38e4-4b81-b345-096a612c439b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:26.029949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cea40f57-38e4-4b81-b345-096a612c439b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:26.044973 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cea40f57-38e4-4b81-b345-096a612c439b tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1430 microversion: 2.1 time: 0.222780 Oct 27 19:08:26.053583 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2307/4796] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:25 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1430 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:26.061335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-356bf4f1-643c-48e5-b9bc-7bacef8caaea req-e5c059d1-428a-4479-bc32-ac9b92e2cec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847d3fc3-fa4c-4211-9900-d6a2fdcaae8a", "name": "network-vif-deleted", "tag": "8464d399-181b-42ad-948a-83acea404715"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:26.088278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-356bf4f1-643c-48e5-b9bc-7bacef8caaea req-e5c059d1-428a-4479-bc32-ac9b92e2cec9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:26.089099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-356bf4f1-643c-48e5-b9bc-7bacef8caaea req-e5c059d1-428a-4479-bc32-ac9b92e2cec9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:26.089717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-356bf4f1-643c-48e5-b9bc-7bacef8caaea req-e5c059d1-428a-4479-bc32-ac9b92e2cec9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:26.117128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d79016cd-63df-484c-aaad-895c8ec07d35 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:26.126006 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d79016cd-63df-484c-aaad-895c8ec07d35 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1314 microversion: 2.1 time: 0.482186 Oct 27 19:08:26.133413 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-356bf4f1-643c-48e5-b9bc-7bacef8caaea req-e5c059d1-428a-4479-bc32-ac9b92e2cec9 service nova] Creating event network-vif-deleted:8464d399-181b-42ad-948a-83acea404715 for instance 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a on n-h1-860687-3 Oct 27 19:08:26.136651 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2490/4797] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:25 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:26.158474 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-356bf4f1-643c-48e5-b9bc-7bacef8caaea req-e5c059d1-428a-4479-bc32-ac9b92e2cec9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103189 Oct 27 19:08:26.161225 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2308/4798] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:26.569086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b7461552-eed0-4aa4-ad86-5fe63e54c4a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:26.569699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b7461552-eed0-4aa4-ad86-5fe63e54c4a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:26.581658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7461552-eed0-4aa4-ad86-5fe63e54c4a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:26.582806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7461552-eed0-4aa4-ad86-5fe63e54c4a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:26.583278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7461552-eed0-4aa4-ad86-5fe63e54c4a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:26.584030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7461552-eed0-4aa4-ad86-5fe63e54c4a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:26.584536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7461552-eed0-4aa4-ad86-5fe63e54c4a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:26.584979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7461552-eed0-4aa4-ad86-5fe63e54c4a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:26.589846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:26.826205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b7461552-eed0-4aa4-ad86-5fe63e54c4a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:26.843588 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b7461552-eed0-4aa4-ad86-5fe63e54c4a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1364 microversion: 2.1 time: 0.282322 Oct 27 19:08:26.848604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7aff9b3b-79a2-4740-85b9-6dec31824f6e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:26.849468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7aff9b3b-79a2-4740-85b9-6dec31824f6e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:26.855662 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2491/4799] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:26 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1364 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:26.864475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7aff9b3b-79a2-4740-85b9-6dec31824f6e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:26.865260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7aff9b3b-79a2-4740-85b9-6dec31824f6e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:26.865980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7aff9b3b-79a2-4740-85b9-6dec31824f6e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:26.866836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7aff9b3b-79a2-4740-85b9-6dec31824f6e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:26.867409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7aff9b3b-79a2-4740-85b9-6dec31824f6e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:26.868893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7aff9b3b-79a2-4740-85b9-6dec31824f6e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:26.968577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7aff9b3b-79a2-4740-85b9-6dec31824f6e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:26.980799 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7aff9b3b-79a2-4740-85b9-6dec31824f6e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1266 microversion: 2.1 time: 0.137545 Oct 27 19:08:26.981872 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2309/4800] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:26 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:27.075919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-723470d1-498e-4380-8d5f-f10dca2f0223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:27.076624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-723470d1-498e-4380-8d5f-f10dca2f0223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:27.085172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723470d1-498e-4380-8d5f-f10dca2f0223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:27.086036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723470d1-498e-4380-8d5f-f10dca2f0223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:27.086678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723470d1-498e-4380-8d5f-f10dca2f0223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:27.087683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723470d1-498e-4380-8d5f-f10dca2f0223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:27.088418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723470d1-498e-4380-8d5f-f10dca2f0223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:27.089045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723470d1-498e-4380-8d5f-f10dca2f0223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:27.129260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723470d1-498e-4380-8d5f-f10dca2f0223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:27.130031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723470d1-498e-4380-8d5f-f10dca2f0223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:27.130725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-723470d1-498e-4380-8d5f-f10dca2f0223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:27.131539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-723470d1-498e-4380-8d5f-f10dca2f0223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lazy-loading 'fault' on Instance uuid 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:08:27.161993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e47027fe-6a27-4ffd-943e-b409eeeb561d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:27.162639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e47027fe-6a27-4ffd-943e-b409eeeb561d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:27.170145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e47027fe-6a27-4ffd-943e-b409eeeb561d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:27.170910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e47027fe-6a27-4ffd-943e-b409eeeb561d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:27.171521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e47027fe-6a27-4ffd-943e-b409eeeb561d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:27.172459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e47027fe-6a27-4ffd-943e-b409eeeb561d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:27.173090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e47027fe-6a27-4ffd-943e-b409eeeb561d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:27.173761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e47027fe-6a27-4ffd-943e-b409eeeb561d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:27.243264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-723470d1-498e-4380-8d5f-f10dca2f0223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad24b0a4144342ceaa2c7470cf529f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a8ecec5b084df386bc976017133fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:27.255471 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-723470d1-498e-4380-8d5f-f10dca2f0223 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 200 len: 1306 microversion: 2.1 time: 0.184791 Oct 27 19:08:27.257746 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2492/4801] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:27 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 1306 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:27.342187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e47027fe-6a27-4ffd-943e-b409eeeb561d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:27.356560 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e47027fe-6a27-4ffd-943e-b409eeeb561d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1314 microversion: 2.1 time: 0.198204 Oct 27 19:08:27.357640 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2310/4802] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:27 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:27.748011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-98d9566c-cb35-4d13-88ea-5eb98bb101b4 req-029520f5-2dc8-4cc0-9e4b-c0d5de77b5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d62a58-bc77-4e6f-bc0c-9fa193005049", "name": "network-vif-plugged", "status": "completed", "tag": "eb7020ef-d1f7-4471-8bef-9313f01b5b35"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:27.801310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-98d9566c-cb35-4d13-88ea-5eb98bb101b4 req-029520f5-2dc8-4cc0-9e4b-c0d5de77b5d7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:27.804583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-98d9566c-cb35-4d13-88ea-5eb98bb101b4 req-029520f5-2dc8-4cc0-9e4b-c0d5de77b5d7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:27.806323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-98d9566c-cb35-4d13-88ea-5eb98bb101b4 req-029520f5-2dc8-4cc0-9e4b-c0d5de77b5d7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:27.837429 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-98d9566c-cb35-4d13-88ea-5eb98bb101b4 req-029520f5-2dc8-4cc0-9e4b-c0d5de77b5d7 service nova] Creating event network-vif-plugged:eb7020ef-d1f7-4471-8bef-9313f01b5b35 for instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 on n-h1-860687-3 Oct 27 19:08:27.849395 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-98d9566c-cb35-4d13-88ea-5eb98bb101b4 req-029520f5-2dc8-4cc0-9e4b-c0d5de77b5d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105590 Oct 27 19:08:27.863561 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2493/4803] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:27.869376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-100acc52-ab40-4bff-a630-2e734514f7ed tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:27.870156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-100acc52-ab40-4bff-a630-2e734514f7ed tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:27.884422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-100acc52-ab40-4bff-a630-2e734514f7ed tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:27.888894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-100acc52-ab40-4bff-a630-2e734514f7ed tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:27.902817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-100acc52-ab40-4bff-a630-2e734514f7ed tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:27.905372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-100acc52-ab40-4bff-a630-2e734514f7ed tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:27.913670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-100acc52-ab40-4bff-a630-2e734514f7ed tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:27.918921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-100acc52-ab40-4bff-a630-2e734514f7ed tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:28.006649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ecb49b1f-2b35-4136-91c5-23278ea1de31 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:28.007653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ecb49b1f-2b35-4136-91c5-23278ea1de31 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:28.024067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ecb49b1f-2b35-4136-91c5-23278ea1de31 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:28.024757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ecb49b1f-2b35-4136-91c5-23278ea1de31 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:28.025368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ecb49b1f-2b35-4136-91c5-23278ea1de31 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:28.027316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ecb49b1f-2b35-4136-91c5-23278ea1de31 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:28.029006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ecb49b1f-2b35-4136-91c5-23278ea1de31 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:28.030268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ecb49b1f-2b35-4136-91c5-23278ea1de31 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:28.333316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ecb49b1f-2b35-4136-91c5-23278ea1de31 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:28.346218 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ecb49b1f-2b35-4136-91c5-23278ea1de31 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1308 microversion: 2.1 time: 0.345608 Oct 27 19:08:28.350223 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2494/4804] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:27 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1308 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:08:28.365352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-78714fbd-81fc-438b-8f75-4318584d5096 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:28.366281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-78714fbd-81fc-438b-8f75-4318584d5096 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] [instance: 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:28.372787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78714fbd-81fc-438b-8f75-4318584d5096 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:28.381385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78714fbd-81fc-438b-8f75-4318584d5096 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:28.382032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78714fbd-81fc-438b-8f75-4318584d5096 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:28.382974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78714fbd-81fc-438b-8f75-4318584d5096 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:28.383603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78714fbd-81fc-438b-8f75-4318584d5096 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:28.384321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78714fbd-81fc-438b-8f75-4318584d5096 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:28.412556 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-78714fbd-81fc-438b-8f75-4318584d5096 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] HTTP exception thrown: Instance 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a could not be found. Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-78714fbd-81fc-438b-8f75-4318584d5096 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Request method failure captured: Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a HTTP/1.1 Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtZeT9JPp7V7IoGkiXDzNbB7JD8tfbBXTPauWmMdx2WDhDyD5iVjcLW-nUWXE5ckU6xH2S7IVDvIpwFjGdpDedZ54N7y867wj50YGs9KWbewr9tvEOMQMWKFdTeys5mixRsyrl7LwzG64-0nrzQR90dLbhf6GsXBq9lzSMg8XienA0w Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50a8ecec5b084df386bc976017133fd8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50a8ecec5b084df386bc976017133fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 50a8ecec5b084df386bc976017133fd8 Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2002011375 Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ad24b0a4144342ceaa2c7470cf529f15 Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersOnMultiNodesTest-2002011375-project Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a could not be found. Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '847d3fc3-fa4c-4211-9900-d6a2fdcaae8a'} Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a could not be found. Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a could not be found. Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:28.414464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:08:28.419671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:28.419671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:28.419671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:28.419671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:08:28.419671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:08:28.419671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a could not be found. Oct 27 19:08:28.419671 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:08:28.423589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-78714fbd-81fc-438b-8f75-4318584d5096 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] Returning 404 to user: Instance 847d3fc3-fa4c-4211-9900-d6a2fdcaae8a could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:08:28.424677 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-78714fbd-81fc-438b-8f75-4318584d5096 tempest-ServersOnMultiNodesTest-2002011375 tempest-ServersOnMultiNodesTest-2002011375-project] 10.222.0.42 "GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a" status: 404 len: 111 microversion: 2.1 time: 0.073286 Oct 27 19:08:28.429493 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2495/4805] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:28 2022] GET /compute/v2.1/servers/847d3fc3-fa4c-4211-9900-d6a2fdcaae8a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:08:28.434888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-100acc52-ab40-4bff-a630-2e734514f7ed tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:28.440320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bfad26cd-05bd-48da-8348-8fc52059c98b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:28.441368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bfad26cd-05bd-48da-8348-8fc52059c98b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:28.455786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfad26cd-05bd-48da-8348-8fc52059c98b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:28.456405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfad26cd-05bd-48da-8348-8fc52059c98b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:28.457012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfad26cd-05bd-48da-8348-8fc52059c98b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:28.457929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfad26cd-05bd-48da-8348-8fc52059c98b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:28.458427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfad26cd-05bd-48da-8348-8fc52059c98b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:28.463960 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-100acc52-ab40-4bff-a630-2e734514f7ed tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1551 microversion: 2.1 time: 0.598307 Oct 27 19:08:28.465233 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2311/4806] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:27 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1551 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:28.467102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfad26cd-05bd-48da-8348-8fc52059c98b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:28.495218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ceb5641d-e9b4-457d-a495-865f24e1b31d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:28.496137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ceb5641d-e9b4-457d-a495-865f24e1b31d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:28.512531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ceb5641d-e9b4-457d-a495-865f24e1b31d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:28.515190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ceb5641d-e9b4-457d-a495-865f24e1b31d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:28.517694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ceb5641d-e9b4-457d-a495-865f24e1b31d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:28.520784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ceb5641d-e9b4-457d-a495-865f24e1b31d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:28.521577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ceb5641d-e9b4-457d-a495-865f24e1b31d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:28.537477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ceb5641d-e9b4-457d-a495-865f24e1b31d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:28.714190 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ceb5641d-e9b4-457d-a495-865f24e1b31d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.224190 Oct 27 19:08:28.714958 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2312/4807] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:08:28 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/os-interface => generated 285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:08:28.939211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bfad26cd-05bd-48da-8348-8fc52059c98b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:28.948806 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bfad26cd-05bd-48da-8348-8fc52059c98b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1314 microversion: 2.1 time: 0.517943 Oct 27 19:08:28.955119 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2496/4808] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:28 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:29.271244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d45051ee-d5d9-4e90-b7e5-2d6072f04bcf req-bcb1d412-a816-4fa0-9dfe-49b358d3af71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949c81d5-cb44-4624-b4bf-f3a4aab10ba8", "tag": "e1aaa861-2351-487e-aa0e-f2ba791d2bad"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:29.298347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d45051ee-d5d9-4e90-b7e5-2d6072f04bcf req-bcb1d412-a816-4fa0-9dfe-49b358d3af71 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:29.298858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d45051ee-d5d9-4e90-b7e5-2d6072f04bcf req-bcb1d412-a816-4fa0-9dfe-49b358d3af71 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:29.302286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d45051ee-d5d9-4e90-b7e5-2d6072f04bcf req-bcb1d412-a816-4fa0-9dfe-49b358d3af71 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:29.327837 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d45051ee-d5d9-4e90-b7e5-2d6072f04bcf req-bcb1d412-a816-4fa0-9dfe-49b358d3af71 service nova] Creating event network-changed:e1aaa861-2351-487e-aa0e-f2ba791d2bad for instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 on n-h2-860687-3 Oct 27 19:08:29.339384 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d45051ee-d5d9-4e90-b7e5-2d6072f04bcf req-bcb1d412-a816-4fa0-9dfe-49b358d3af71 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070521 Oct 27 19:08:29.341532 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2313/4809] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:29.380515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6fc7e20-b810-4fdd-b42a-b25d6261fdd0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:29.381142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c6fc7e20-b810-4fdd-b42a-b25d6261fdd0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:29.395065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6fc7e20-b810-4fdd-b42a-b25d6261fdd0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:29.396499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6fc7e20-b810-4fdd-b42a-b25d6261fdd0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:29.397665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6fc7e20-b810-4fdd-b42a-b25d6261fdd0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:29.400479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6fc7e20-b810-4fdd-b42a-b25d6261fdd0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:29.400933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6fc7e20-b810-4fdd-b42a-b25d6261fdd0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:29.402530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6fc7e20-b810-4fdd-b42a-b25d6261fdd0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:29.924998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c6fc7e20-b810-4fdd-b42a-b25d6261fdd0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:29.940663 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c6fc7e20-b810-4fdd-b42a-b25d6261fdd0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1308 microversion: 2.1 time: 0.563879 Oct 27 19:08:29.941348 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2497/4810] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:29 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1308 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:29.981969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ba054709-84bd-49ff-ab4d-4c6caa5be5b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:29.983265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ba054709-84bd-49ff-ab4d-4c6caa5be5b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:30.008708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba054709-84bd-49ff-ab4d-4c6caa5be5b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:30.012843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba054709-84bd-49ff-ab4d-4c6caa5be5b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:30.013795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba054709-84bd-49ff-ab4d-4c6caa5be5b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:30.014594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba054709-84bd-49ff-ab4d-4c6caa5be5b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:30.019772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba054709-84bd-49ff-ab4d-4c6caa5be5b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:30.020759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba054709-84bd-49ff-ab4d-4c6caa5be5b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:30.410831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ba054709-84bd-49ff-ab4d-4c6caa5be5b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:30.418954 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ba054709-84bd-49ff-ab4d-4c6caa5be5b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1500 microversion: 2.1 time: 0.441742 Oct 27 19:08:30.419556 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2314/4811] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:29 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1500 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:30.970416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7bf814e5-d884-4b0f-b405-638091e53edd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:30.971220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7bf814e5-d884-4b0f-b405-638091e53edd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:30.998666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bf814e5-d884-4b0f-b405-638091e53edd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:30.999519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bf814e5-d884-4b0f-b405-638091e53edd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:31.001364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bf814e5-d884-4b0f-b405-638091e53edd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:31.010647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bf814e5-d884-4b0f-b405-638091e53edd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:31.011762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bf814e5-d884-4b0f-b405-638091e53edd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:31.012426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bf814e5-d884-4b0f-b405-638091e53edd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:31.411927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-1c51ae5a-111e-4924-8bbf-e01304160cab req-caaedb6c-578b-44f0-9586-d1e064f93d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c", "tag": "80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:31.417075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7bf814e5-d884-4b0f-b405-638091e53edd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:31.428529 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7bf814e5-d884-4b0f-b405-638091e53edd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1308 microversion: 2.1 time: 0.462175 Oct 27 19:08:31.429764 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2498/4812] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:30 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:31.445648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:31.449697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1c51ae5a-111e-4924-8bbf-e01304160cab req-caaedb6c-578b-44f0-9586-d1e064f93d5a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:31.458999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1c51ae5a-111e-4924-8bbf-e01304160cab req-caaedb6c-578b-44f0-9586-d1e064f93d5a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:31.459923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1c51ae5a-111e-4924-8bbf-e01304160cab req-caaedb6c-578b-44f0-9586-d1e064f93d5a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:31.511336 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-1c51ae5a-111e-4924-8bbf-e01304160cab req-caaedb6c-578b-44f0-9586-d1e064f93d5a service nova] Creating event network-changed:80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4 for instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c on n-h1-860687-3 Oct 27 19:08:31.529587 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-1c51ae5a-111e-4924-8bbf-e01304160cab req-caaedb6c-578b-44f0-9586-d1e064f93d5a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118337 Oct 27 19:08:31.530720 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2315/4813] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:08:32.468808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7fd463a1-314b-4c03-8d73-f27706df9fc1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:32.470093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7fd463a1-314b-4c03-8d73-f27706df9fc1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:32.494883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fd463a1-314b-4c03-8d73-f27706df9fc1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:32.497661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fd463a1-314b-4c03-8d73-f27706df9fc1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:32.501769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fd463a1-314b-4c03-8d73-f27706df9fc1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:32.502901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fd463a1-314b-4c03-8d73-f27706df9fc1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:32.506319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fd463a1-314b-4c03-8d73-f27706df9fc1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:32.506982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fd463a1-314b-4c03-8d73-f27706df9fc1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:33.489631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7fd463a1-314b-4c03-8d73-f27706df9fc1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:33.508809 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7fd463a1-314b-4c03-8d73-f27706df9fc1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1308 microversion: 2.1 time: 1.048929 Oct 27 19:08:33.516845 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2499/4814] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:32 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1308 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:34.555077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3d521091-fdf2-48fa-81e2-7634ece47cf4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:34.555835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3d521091-fdf2-48fa-81e2-7634ece47cf4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:34.556230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0dd2000b-be3a-4f2b-bdfb-8b1907ffa6e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6491e2b-2f96-42ed-ac04-de7286b73fec"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:34.574233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0dd2000b-be3a-4f2b-bdfb-8b1907ffa6e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:34.581075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:34.583120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:34.590662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dd2000b-be3a-4f2b-bdfb-8b1907ffa6e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:34.592392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dd2000b-be3a-4f2b-bdfb-8b1907ffa6e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:34.595577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dd2000b-be3a-4f2b-bdfb-8b1907ffa6e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:34.598085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dd2000b-be3a-4f2b-bdfb-8b1907ffa6e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:34.599205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dd2000b-be3a-4f2b-bdfb-8b1907ffa6e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:34.601349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dd2000b-be3a-4f2b-bdfb-8b1907ffa6e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:34.603121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d521091-fdf2-48fa-81e2-7634ece47cf4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:34.605755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d521091-fdf2-48fa-81e2-7634ece47cf4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:34.606211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d521091-fdf2-48fa-81e2-7634ece47cf4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:34.608582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d521091-fdf2-48fa-81e2-7634ece47cf4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:34.612405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d521091-fdf2-48fa-81e2-7634ece47cf4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:34.613385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d521091-fdf2-48fa-81e2-7634ece47cf4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:35.025992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d521091-fdf2-48fa-81e2-7634ece47cf4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:35.040165 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3d521091-fdf2-48fa-81e2-7634ece47cf4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1308 microversion: 2.1 time: 0.503941 Oct 27 19:08:35.041770 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2316/4815] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:34 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1308 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:35.240967 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0dd2000b-be3a-4f2b-bdfb-8b1907ffa6e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "POST /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.701713 Oct 27 19:08:35.242107 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2500/4816] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:08:34 2022] POST /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049/os-volume_attachments => generated 194 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:35.726564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-446923293", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": "none"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:35.816743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:08:35.817111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:08:35.817597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:08:35.818018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:08:35.818469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:08:35.846582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:35.848874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:35.852520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:35.853533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:35.854091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:35.855448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:35.929918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Getting quotas for project c5bac9dc6eec4e44abd820c2a8fad0ab. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:08:35.971899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Getting quotas for user ed1b473270d540ba8ae0e27f68e65827 and project c5bac9dc6eec4e44abd820c2a8fad0ab. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:08:36.024203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:08:36.038097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:08:36.078103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-411e54b7-dacf-4647-9f5e-1c0513aa37ce tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:36.079553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-411e54b7-dacf-4647-9f5e-1c0513aa37ce tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:36.101779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-411e54b7-dacf-4647-9f5e-1c0513aa37ce tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:36.103477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-411e54b7-dacf-4647-9f5e-1c0513aa37ce tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:36.103940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-411e54b7-dacf-4647-9f5e-1c0513aa37ce tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:36.109107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-411e54b7-dacf-4647-9f5e-1c0513aa37ce tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:36.110305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-411e54b7-dacf-4647-9f5e-1c0513aa37ce tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:36.112653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-411e54b7-dacf-4647-9f5e-1c0513aa37ce tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:36.160541 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ff08bc4-e90d-411b-b3f9-6b8293cb55b3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.710493 Oct 27 19:08:36.164900 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2317/4817] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 19:08:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 19:08:36.183139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc55c547-fc02-4af4-baa5-cc7d5c073b01 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:36.188155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fc55c547-fc02-4af4-baa5-cc7d5c073b01 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:36.338120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc55c547-fc02-4af4-baa5-cc7d5c073b01 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:36.363190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc55c547-fc02-4af4-baa5-cc7d5c073b01 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:36.366766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc55c547-fc02-4af4-baa5-cc7d5c073b01 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:36.386755 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc55c547-fc02-4af4-baa5-cc7d5c073b01 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1452 microversion: 2.91 time: 0.209958 Oct 27 19:08:36.406439 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2318/4818] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:36 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1452 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:36.740801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-411e54b7-dacf-4647-9f5e-1c0513aa37ce tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:36.753791 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-411e54b7-dacf-4647-9f5e-1c0513aa37ce tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1308 microversion: 2.1 time: 0.680686 Oct 27 19:08:36.754710 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2501/4819] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:36 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1308 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:08:37.433723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0cc07877-2c97-4a32-87e5-9adcd7c8175b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:37.440190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0cc07877-2c97-4a32-87e5-9adcd7c8175b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:37.477389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cc07877-2c97-4a32-87e5-9adcd7c8175b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:37.479766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cc07877-2c97-4a32-87e5-9adcd7c8175b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:37.480851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cc07877-2c97-4a32-87e5-9adcd7c8175b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:37.484170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cc07877-2c97-4a32-87e5-9adcd7c8175b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:37.487405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cc07877-2c97-4a32-87e5-9adcd7c8175b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:37.489900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cc07877-2c97-4a32-87e5-9adcd7c8175b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:37.630538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0cc07877-2c97-4a32-87e5-9adcd7c8175b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:37.651596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0cc07877-2c97-4a32-87e5-9adcd7c8175b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:37.666300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0cc07877-2c97-4a32-87e5-9adcd7c8175b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:37.687080 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0cc07877-2c97-4a32-87e5-9adcd7c8175b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1448 microversion: 2.91 time: 0.262072 Oct 27 19:08:37.689651 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2319/4820] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:37 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1448 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:37.783352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-928cf781-425b-459a-9361-475ea5960d86 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:37.784250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-928cf781-425b-459a-9361-475ea5960d86 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:37.799579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-928cf781-425b-459a-9361-475ea5960d86 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:37.800705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-928cf781-425b-459a-9361-475ea5960d86 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:37.803106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-928cf781-425b-459a-9361-475ea5960d86 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:37.804981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-928cf781-425b-459a-9361-475ea5960d86 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:37.808392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-928cf781-425b-459a-9361-475ea5960d86 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:37.809177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-928cf781-425b-459a-9361-475ea5960d86 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:38.199602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-2c4c826d-6f3f-4a2d-ac13-3519e2519b12 req-a52a35ad-8fc6-4858-af43-be760a477671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949c81d5-cb44-4624-b4bf-f3a4aab10ba8", "name": "network-vif-plugged", "status": "completed", "tag": "e1aaa861-2351-487e-aa0e-f2ba791d2bad"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:38.206552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-928cf781-425b-459a-9361-475ea5960d86 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:38.221638 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-928cf781-425b-459a-9361-475ea5960d86 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1308 microversion: 2.1 time: 0.445777 Oct 27 19:08:38.221820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2c4c826d-6f3f-4a2d-ac13-3519e2519b12 req-a52a35ad-8fc6-4858-af43-be760a477671 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:38.222364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2c4c826d-6f3f-4a2d-ac13-3519e2519b12 req-a52a35ad-8fc6-4858-af43-be760a477671 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:38.222835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2c4c826d-6f3f-4a2d-ac13-3519e2519b12 req-a52a35ad-8fc6-4858-af43-be760a477671 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:38.226543 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2502/4821] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:37 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:38.248774 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-2c4c826d-6f3f-4a2d-ac13-3519e2519b12 req-a52a35ad-8fc6-4858-af43-be760a477671 service nova] Creating event network-vif-plugged:e1aaa861-2351-487e-aa0e-f2ba791d2bad for instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 on n-h2-860687-3 Oct 27 19:08:38.272216 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-2c4c826d-6f3f-4a2d-ac13-3519e2519b12 req-a52a35ad-8fc6-4858-af43-be760a477671 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076568 Oct 27 19:08:38.284909 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2320/4822] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:38.726775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-71a8b297-5bed-45d2-8a99-b9ad49042ad2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:38.727754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-71a8b297-5bed-45d2-8a99-b9ad49042ad2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:38.737610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71a8b297-5bed-45d2-8a99-b9ad49042ad2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:38.738466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71a8b297-5bed-45d2-8a99-b9ad49042ad2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:38.739155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71a8b297-5bed-45d2-8a99-b9ad49042ad2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:38.740186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71a8b297-5bed-45d2-8a99-b9ad49042ad2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:38.741217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71a8b297-5bed-45d2-8a99-b9ad49042ad2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:38.741872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71a8b297-5bed-45d2-8a99-b9ad49042ad2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:38.917297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-71a8b297-5bed-45d2-8a99-b9ad49042ad2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:38.935327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-71a8b297-5bed-45d2-8a99-b9ad49042ad2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:38.936792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-71a8b297-5bed-45d2-8a99-b9ad49042ad2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:38.958399 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-71a8b297-5bed-45d2-8a99-b9ad49042ad2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1522 microversion: 2.91 time: 0.235594 Oct 27 19:08:38.959354 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2503/4823] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:38 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:39.271674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ad05933e-2c9a-4e03-9010-5e79ca35d314 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:39.275796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ad05933e-2c9a-4e03-9010-5e79ca35d314 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:39.284598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad05933e-2c9a-4e03-9010-5e79ca35d314 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:39.285165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad05933e-2c9a-4e03-9010-5e79ca35d314 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:39.285569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad05933e-2c9a-4e03-9010-5e79ca35d314 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:39.286253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad05933e-2c9a-4e03-9010-5e79ca35d314 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:39.288314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad05933e-2c9a-4e03-9010-5e79ca35d314 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:39.289087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad05933e-2c9a-4e03-9010-5e79ca35d314 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:39.614055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ad05933e-2c9a-4e03-9010-5e79ca35d314 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:39.636876 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ad05933e-2c9a-4e03-9010-5e79ca35d314 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1308 microversion: 2.1 time: 0.370973 Oct 27 19:08:39.637481 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2321/4824] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:39 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1308 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:39.998523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ad268faf-3d0a-4730-a02b-7655ce8c9b8a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:39.999745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ad268faf-3d0a-4730-a02b-7655ce8c9b8a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:40.017066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad268faf-3d0a-4730-a02b-7655ce8c9b8a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:40.019278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad268faf-3d0a-4730-a02b-7655ce8c9b8a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:40.021761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad268faf-3d0a-4730-a02b-7655ce8c9b8a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:40.024173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad268faf-3d0a-4730-a02b-7655ce8c9b8a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:40.024889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad268faf-3d0a-4730-a02b-7655ce8c9b8a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:40.025761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad268faf-3d0a-4730-a02b-7655ce8c9b8a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:40.190543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ad268faf-3d0a-4730-a02b-7655ce8c9b8a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:40.213098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ad268faf-3d0a-4730-a02b-7655ce8c9b8a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:40.215054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ad268faf-3d0a-4730-a02b-7655ce8c9b8a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:40.222160 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ad268faf-3d0a-4730-a02b-7655ce8c9b8a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1510 microversion: 2.91 time: 0.232166 Oct 27 19:08:40.223480 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2504/4825] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:39 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:40.669235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-02f50eee-3182-4427-90d9-6f501da429fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:40.669954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-02f50eee-3182-4427-90d9-6f501da429fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:40.683721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02f50eee-3182-4427-90d9-6f501da429fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:40.684618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02f50eee-3182-4427-90d9-6f501da429fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:40.685298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02f50eee-3182-4427-90d9-6f501da429fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:40.686238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02f50eee-3182-4427-90d9-6f501da429fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:40.686972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02f50eee-3182-4427-90d9-6f501da429fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:40.688511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-02f50eee-3182-4427-90d9-6f501da429fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:40.872450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-02f50eee-3182-4427-90d9-6f501da429fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:40.882496 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-02f50eee-3182-4427-90d9-6f501da429fd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1308 microversion: 2.1 time: 0.217351 Oct 27 19:08:40.898316 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2322/4826] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:40 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:41.257673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6bdade58-2184-47ba-8b40-5fa50f345b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:41.258302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6bdade58-2184-47ba-8b40-5fa50f345b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:41.266668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bdade58-2184-47ba-8b40-5fa50f345b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:41.267475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bdade58-2184-47ba-8b40-5fa50f345b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:41.268177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bdade58-2184-47ba-8b40-5fa50f345b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:41.269732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bdade58-2184-47ba-8b40-5fa50f345b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:41.270453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bdade58-2184-47ba-8b40-5fa50f345b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:41.271142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bdade58-2184-47ba-8b40-5fa50f345b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:41.411224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6bdade58-2184-47ba-8b40-5fa50f345b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:41.424067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6bdade58-2184-47ba-8b40-5fa50f345b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:41.427532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6bdade58-2184-47ba-8b40-5fa50f345b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:41.434807 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6bdade58-2184-47ba-8b40-5fa50f345b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1510 microversion: 2.91 time: 0.181345 Oct 27 19:08:41.451199 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2505/4827] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:41 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:41.909192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e924bbf2-4391-4caa-af31-8c39bfa0bebd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:41.909945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e924bbf2-4391-4caa-af31-8c39bfa0bebd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:41.918596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e924bbf2-4391-4caa-af31-8c39bfa0bebd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:41.919164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e924bbf2-4391-4caa-af31-8c39bfa0bebd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:41.919717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e924bbf2-4391-4caa-af31-8c39bfa0bebd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:41.920557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e924bbf2-4391-4caa-af31-8c39bfa0bebd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:41.921071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e924bbf2-4391-4caa-af31-8c39bfa0bebd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:41.921554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e924bbf2-4391-4caa-af31-8c39bfa0bebd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:42.199099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e924bbf2-4391-4caa-af31-8c39bfa0bebd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:42.204470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:42.231244 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e924bbf2-4391-4caa-af31-8c39bfa0bebd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1488 microversion: 2.1 time: 0.328087 Oct 27 19:08:42.232140 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2323/4828] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:41 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1488 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:42.258001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-52ab7eaf-f37d-4d08-b759-0e79380c9018 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:42.261211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-52ab7eaf-f37d-4d08-b759-0e79380c9018 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:42.273007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52ab7eaf-f37d-4d08-b759-0e79380c9018 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:42.273571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52ab7eaf-f37d-4d08-b759-0e79380c9018 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:42.274020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52ab7eaf-f37d-4d08-b759-0e79380c9018 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:42.275049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52ab7eaf-f37d-4d08-b759-0e79380c9018 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:42.275637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52ab7eaf-f37d-4d08-b759-0e79380c9018 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:42.276135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52ab7eaf-f37d-4d08-b759-0e79380c9018 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:42.364613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:42.382901 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-52ab7eaf-f37d-4d08-b759-0e79380c9018 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "PUT /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1083 microversion: 2.1 time: 0.129298 Oct 27 19:08:42.384119 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2506/4829] 10.222.0.42 () {60 vars in 1256 bytes} [Thu Oct 27 19:08:42 2022] PUT /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1083 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:42.405030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ab6756f-0aea-4718-91ef-09e4fd19ef28 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:42.407279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3ab6756f-0aea-4718-91ef-09e4fd19ef28 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:42.416815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ab6756f-0aea-4718-91ef-09e4fd19ef28 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:42.417489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ab6756f-0aea-4718-91ef-09e4fd19ef28 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:42.418241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ab6756f-0aea-4718-91ef-09e4fd19ef28 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:42.419262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ab6756f-0aea-4718-91ef-09e4fd19ef28 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:42.419799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ab6756f-0aea-4718-91ef-09e4fd19ef28 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:42.420927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ab6756f-0aea-4718-91ef-09e4fd19ef28 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:42.465566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-427850be-4e62-43a6-a0d7-68c54d4e297d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:42.466557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-427850be-4e62-43a6-a0d7-68c54d4e297d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:42.479743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-427850be-4e62-43a6-a0d7-68c54d4e297d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:42.482150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-427850be-4e62-43a6-a0d7-68c54d4e297d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:42.482816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-427850be-4e62-43a6-a0d7-68c54d4e297d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:42.486525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-427850be-4e62-43a6-a0d7-68c54d4e297d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:42.487189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-427850be-4e62-43a6-a0d7-68c54d4e297d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:42.487838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-427850be-4e62-43a6-a0d7-68c54d4e297d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:42.590341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-427850be-4e62-43a6-a0d7-68c54d4e297d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:42.603388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-427850be-4e62-43a6-a0d7-68c54d4e297d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:42.605998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-427850be-4e62-43a6-a0d7-68c54d4e297d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:42.612013 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-427850be-4e62-43a6-a0d7-68c54d4e297d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1510 microversion: 2.91 time: 0.150785 Oct 27 19:08:42.625934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ab6756f-0aea-4718-91ef-09e4fd19ef28 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:42.627704 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2507/4830] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:42 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:08:42.634855 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3ab6756f-0aea-4718-91ef-09e4fd19ef28 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1509 microversion: 2.1 time: 0.234811 Oct 27 19:08:42.636069 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2324/4831] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:42 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:42.661073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-608a67af-0ca1-4f7e-89bb-a632b275083e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:42.662221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-608a67af-0ca1-4f7e-89bb-a632b275083e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:42.668668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-608a67af-0ca1-4f7e-89bb-a632b275083e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:42.669169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-608a67af-0ca1-4f7e-89bb-a632b275083e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:42.669597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-608a67af-0ca1-4f7e-89bb-a632b275083e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:42.670306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-608a67af-0ca1-4f7e-89bb-a632b275083e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:42.670819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-608a67af-0ca1-4f7e-89bb-a632b275083e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:42.671457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-608a67af-0ca1-4f7e-89bb-a632b275083e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:42.917714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-608a67af-0ca1-4f7e-89bb-a632b275083e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:42.929409 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-608a67af-0ca1-4f7e-89bb-a632b275083e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1509 microversion: 2.1 time: 0.274065 Oct 27 19:08:42.933248 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2508/4832] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:42 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:42.964328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f86b9dcc-abaa-4821-a65c-bbabeba1b8ef tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:42.965433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f86b9dcc-abaa-4821-a65c-bbabeba1b8ef tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:42.979378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f86b9dcc-abaa-4821-a65c-bbabeba1b8ef tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:42.983512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f86b9dcc-abaa-4821-a65c-bbabeba1b8ef tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:42.984194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f86b9dcc-abaa-4821-a65c-bbabeba1b8ef tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:42.986664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f86b9dcc-abaa-4821-a65c-bbabeba1b8ef tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:42.987415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f86b9dcc-abaa-4821-a65c-bbabeba1b8ef tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:42.989569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f86b9dcc-abaa-4821-a65c-bbabeba1b8ef tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:43.040760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f86b9dcc-abaa-4821-a65c-bbabeba1b8ef tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:08:43.153811 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f86b9dcc-abaa-4821-a65c-bbabeba1b8ef tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 204 len: 0 microversion: 2.1 time: 0.197204 Oct 27 19:08:43.160013 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2325/4833] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:08:42 2022] DELETE /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:08:43.164842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-840295ce-d040-4f3a-a7ce-fab4c815adf1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:43.165454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-840295ce-d040-4f3a-a7ce-fab4c815adf1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:43.179903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-840295ce-d040-4f3a-a7ce-fab4c815adf1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:43.180403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-840295ce-d040-4f3a-a7ce-fab4c815adf1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:43.180850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-840295ce-d040-4f3a-a7ce-fab4c815adf1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:43.181564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-840295ce-d040-4f3a-a7ce-fab4c815adf1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:43.182020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-840295ce-d040-4f3a-a7ce-fab4c815adf1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:43.182472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-840295ce-d040-4f3a-a7ce-fab4c815adf1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:43.651647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-430bed6d-42a9-4c57-9ab2-60d3b40025f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:43.652614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-430bed6d-42a9-4c57-9ab2-60d3b40025f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:43.658040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-840295ce-d040-4f3a-a7ce-fab4c815adf1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:43.662225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-430bed6d-42a9-4c57-9ab2-60d3b40025f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:43.663735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-430bed6d-42a9-4c57-9ab2-60d3b40025f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:43.664384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-430bed6d-42a9-4c57-9ab2-60d3b40025f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:43.665748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-430bed6d-42a9-4c57-9ab2-60d3b40025f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:43.667143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-430bed6d-42a9-4c57-9ab2-60d3b40025f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:43.667783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-430bed6d-42a9-4c57-9ab2-60d3b40025f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:43.669163 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-840295ce-d040-4f3a-a7ce-fab4c815adf1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1515 microversion: 2.1 time: 0.508154 Oct 27 19:08:43.670440 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2509/4834] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:43 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1515 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:08:44.245941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-430bed6d-42a9-4c57-9ab2-60d3b40025f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:44.294341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-430bed6d-42a9-4c57-9ab2-60d3b40025f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:44.318357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-430bed6d-42a9-4c57-9ab2-60d3b40025f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:44.359309 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-430bed6d-42a9-4c57-9ab2-60d3b40025f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1531 microversion: 2.91 time: 0.718807 Oct 27 19:08:44.367305 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2326/4835] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:43 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1531 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:44.495259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-954f481d-ef10-475c-8568-da8306917b37 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:44.495892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-954f481d-ef10-475c-8568-da8306917b37 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:44.519582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-954f481d-ef10-475c-8568-da8306917b37 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:44.520102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-954f481d-ef10-475c-8568-da8306917b37 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:44.520562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-954f481d-ef10-475c-8568-da8306917b37 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:44.521289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-954f481d-ef10-475c-8568-da8306917b37 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:44.521753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-954f481d-ef10-475c-8568-da8306917b37 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:44.522187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-954f481d-ef10-475c-8568-da8306917b37 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:44.673282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-954f481d-ef10-475c-8568-da8306917b37 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lazy-loading 'services' on Instance uuid 29737b20-81b1-443b-9b80-e9ca92bbfdad {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:08:44.695614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-39861345-ba68-4803-bd62-1cf8d1f91909 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:44.696551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-39861345-ba68-4803-bd62-1cf8d1f91909 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:44.708158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39861345-ba68-4803-bd62-1cf8d1f91909 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:44.709957 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-954f481d-ef10-475c-8568-da8306917b37 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1936 microversion: 2.91 time: 0.319456 Oct 27 19:08:44.711654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39861345-ba68-4803-bd62-1cf8d1f91909 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:44.714086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39861345-ba68-4803-bd62-1cf8d1f91909 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:44.714857 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2510/4836] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:44 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1936 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:44.716123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39861345-ba68-4803-bd62-1cf8d1f91909 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:44.719446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39861345-ba68-4803-bd62-1cf8d1f91909 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:44.720516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39861345-ba68-4803-bd62-1cf8d1f91909 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:44.746022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5022a834-eda4-4aa7-85a4-2cd85992a21a tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:44.746847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5022a834-eda4-4aa7-85a4-2cd85992a21a tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:44.756338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5022a834-eda4-4aa7-85a4-2cd85992a21a tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:44.757235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5022a834-eda4-4aa7-85a4-2cd85992a21a tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:44.764279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5022a834-eda4-4aa7-85a4-2cd85992a21a tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:44.766496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5022a834-eda4-4aa7-85a4-2cd85992a21a tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:44.770647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5022a834-eda4-4aa7-85a4-2cd85992a21a tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:44.771409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5022a834-eda4-4aa7-85a4-2cd85992a21a tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:45.024235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-5022a834-eda4-4aa7-85a4-2cd85992a21a tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lazy-loading 'services' on Instance uuid 29737b20-81b1-443b-9b80-e9ca92bbfdad {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:08:45.073360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-39861345-ba68-4803-bd62-1cf8d1f91909 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:45.073930 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5022a834-eda4-4aa7-85a4-2cd85992a21a tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1936 microversion: 2.91 time: 0.331647 Oct 27 19:08:45.074881 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2511/4837] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:44 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1936 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:08:45.087739 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-39861345-ba68-4803-bd62-1cf8d1f91909 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1515 microversion: 2.1 time: 0.393634 Oct 27 19:08:45.102577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b8694be-dac0-45da-8615-08642b9a8318 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:45.103133 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2327/4838] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:44 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1515 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:45.105249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b8694be-dac0-45da-8615-08642b9a8318 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:45.105747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b8694be-dac0-45da-8615-08642b9a8318 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:45.108855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b8694be-dac0-45da-8615-08642b9a8318 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:45.108855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b8694be-dac0-45da-8615-08642b9a8318 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:45.108855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b8694be-dac0-45da-8615-08642b9a8318 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:45.108855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b8694be-dac0-45da-8615-08642b9a8318 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:45.143959 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1b8694be-dac0-45da-8615-08642b9a8318 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.046200 Oct 27 19:08:45.151873 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2512/4839] 10.222.0.42 () {60 vars in 1217 bytes} [Thu Oct 27 19:08:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:08:45.157571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b6fe512-bf28-41fe-8715-da87d9b20366 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:45.158535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6b6fe512-bf28-41fe-8715-da87d9b20366 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:45.170494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b6fe512-bf28-41fe-8715-da87d9b20366 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:45.171282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b6fe512-bf28-41fe-8715-da87d9b20366 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:45.172524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b6fe512-bf28-41fe-8715-da87d9b20366 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:45.175910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b6fe512-bf28-41fe-8715-da87d9b20366 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:45.176626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b6fe512-bf28-41fe-8715-da87d9b20366 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:45.177275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b6fe512-bf28-41fe-8715-da87d9b20366 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:45.212403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-6b6fe512-bf28-41fe-8715-da87d9b20366 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lazy-loading 'flavor' on Instance uuid 29737b20-81b1-443b-9b80-e9ca92bbfdad {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:08:45.620323 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b6fe512-bf28-41fe-8715-da87d9b20366 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "POST /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad/action" status: 202 len: 0 microversion: 2.91 time: 0.466626 Oct 27 19:08:45.632710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e1251144-769d-4872-a3cb-671ff6291daa tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:45.633532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e1251144-769d-4872-a3cb-671ff6291daa tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:45.640800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1251144-769d-4872-a3cb-671ff6291daa tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:45.641135 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2328/4840] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 19:08:45 2022] POST /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:08:45.649934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1251144-769d-4872-a3cb-671ff6291daa tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:45.662662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1251144-769d-4872-a3cb-671ff6291daa tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:45.665969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1251144-769d-4872-a3cb-671ff6291daa tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:45.668731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1251144-769d-4872-a3cb-671ff6291daa tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:45.669386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1251144-769d-4872-a3cb-671ff6291daa tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:45.962241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1251144-769d-4872-a3cb-671ff6291daa tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:45.973522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1251144-769d-4872-a3cb-671ff6291daa tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:45.994156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1251144-769d-4872-a3cb-671ff6291daa tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:46.030274 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e1251144-769d-4872-a3cb-671ff6291daa tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.403586 Oct 27 19:08:46.030929 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2513/4841] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:45 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:46.126421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-cfac291c-ddbf-4a1c-ab4b-23ada010efce req-95cd9879-c3e9-447d-a186-7c87f37af333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949c81d5-cb44-4624-b4bf-f3a4aab10ba8", "name": "network-vif-deleted", "tag": "e1aaa861-2351-487e-aa0e-f2ba791d2bad"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:46.131534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-60ac2e25-52f9-445e-a4cf-06d410d40c3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:46.132651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-60ac2e25-52f9-445e-a4cf-06d410d40c3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:46.134943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:46.144796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cfac291c-ddbf-4a1c-ab4b-23ada010efce req-95cd9879-c3e9-447d-a186-7c87f37af333 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:46.148978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cfac291c-ddbf-4a1c-ab4b-23ada010efce req-95cd9879-c3e9-447d-a186-7c87f37af333 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:46.149616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cfac291c-ddbf-4a1c-ab4b-23ada010efce req-95cd9879-c3e9-447d-a186-7c87f37af333 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:46.155705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60ac2e25-52f9-445e-a4cf-06d410d40c3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:46.157291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60ac2e25-52f9-445e-a4cf-06d410d40c3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:46.157910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60ac2e25-52f9-445e-a4cf-06d410d40c3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:46.159421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60ac2e25-52f9-445e-a4cf-06d410d40c3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:46.165387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60ac2e25-52f9-445e-a4cf-06d410d40c3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:46.166117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60ac2e25-52f9-445e-a4cf-06d410d40c3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:46.172587 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-cfac291c-ddbf-4a1c-ab4b-23ada010efce req-95cd9879-c3e9-447d-a186-7c87f37af333 service nova] Creating event network-vif-deleted:e1aaa861-2351-487e-aa0e-f2ba791d2bad for instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 on n-h2-860687-3 Oct 27 19:08:46.184200 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-cfac291c-ddbf-4a1c-ab4b-23ada010efce req-95cd9879-c3e9-447d-a186-7c87f37af333 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065113 Oct 27 19:08:46.188594 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2514/4842] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:46.301661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-60ac2e25-52f9-445e-a4cf-06d410d40c3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:46.322839 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-60ac2e25-52f9-445e-a4cf-06d410d40c3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 200 len: 1314 microversion: 2.1 time: 0.205290 Oct 27 19:08:46.323685 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2329/4843] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:46 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:47.063525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6158c170-55e3-4073-b9c6-cf1be2d37d63 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:47.064320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6158c170-55e3-4073-b9c6-cf1be2d37d63 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:47.090922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6158c170-55e3-4073-b9c6-cf1be2d37d63 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:47.094000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6158c170-55e3-4073-b9c6-cf1be2d37d63 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:47.094888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6158c170-55e3-4073-b9c6-cf1be2d37d63 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:47.100464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6158c170-55e3-4073-b9c6-cf1be2d37d63 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:47.105222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6158c170-55e3-4073-b9c6-cf1be2d37d63 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:47.105690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6158c170-55e3-4073-b9c6-cf1be2d37d63 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:47.291149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6158c170-55e3-4073-b9c6-cf1be2d37d63 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:47.301298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6158c170-55e3-4073-b9c6-cf1be2d37d63 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:47.303474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6158c170-55e3-4073-b9c6-cf1be2d37d63 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:47.309227 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6158c170-55e3-4073-b9c6-cf1be2d37d63 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.250643 Oct 27 19:08:47.310425 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2515/4844] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:47 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:47.348003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ebbf480-e0a3-4b85-9a29-28e7037bdb53 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:47.348644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5ebbf480-e0a3-4b85-9a29-28e7037bdb53 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:47.350606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:47.369233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ebbf480-e0a3-4b85-9a29-28e7037bdb53 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:47.370424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ebbf480-e0a3-4b85-9a29-28e7037bdb53 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:47.371141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ebbf480-e0a3-4b85-9a29-28e7037bdb53 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:47.372234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ebbf480-e0a3-4b85-9a29-28e7037bdb53 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:47.373317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ebbf480-e0a3-4b85-9a29-28e7037bdb53 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:47.374906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ebbf480-e0a3-4b85-9a29-28e7037bdb53 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:47.427919 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-5ebbf480-e0a3-4b85-9a29-28e7037bdb53 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ebbf480-e0a3-4b85-9a29-28e7037bdb53 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 HTTP/1.1 Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '949c81d5-cb44-4624-b4bf-f3a4aab10ba8'} Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:47.430351 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:08:47.435735 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:08:47.435735 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:08:47.435735 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:08:47.435735 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:08:47.435735 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:08:47.435735 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:08:47.439005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ebbf480-e0a3-4b85-9a29-28e7037bdb53 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:08:47.440344 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5ebbf480-e0a3-4b85-9a29-28e7037bdb53 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 404 len: 111 microversion: 2.1 time: 0.097534 Oct 27 19:08:47.441523 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2330/4845] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:47 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:08:47.584189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1660236882", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "0e03b86b-4627-4072-8ddb-a6a80f18beba"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:47.681181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] validate_networks() for [('0e03b86b-4627-4072-8ddb-a6a80f18beba', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:08:48.339301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5a3c1105-deb8-4f07-8e90-5090578541bc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:48.340196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5a3c1105-deb8-4f07-8e90-5090578541bc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:48.376692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a3c1105-deb8-4f07-8e90-5090578541bc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:48.385954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a3c1105-deb8-4f07-8e90-5090578541bc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:48.386768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a3c1105-deb8-4f07-8e90-5090578541bc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:48.390724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a3c1105-deb8-4f07-8e90-5090578541bc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:48.393291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a3c1105-deb8-4f07-8e90-5090578541bc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:48.397013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a3c1105-deb8-4f07-8e90-5090578541bc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:48.660560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5a3c1105-deb8-4f07-8e90-5090578541bc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:48.679172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5a3c1105-deb8-4f07-8e90-5090578541bc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:48.680858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5a3c1105-deb8-4f07-8e90-5090578541bc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:48.701437 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5a3c1105-deb8-4f07-8e90-5090578541bc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.366416 Oct 27 19:08:48.702652 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2331/4846] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:48 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:48.914504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:08:48.915364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:08:48.915494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:08:48.916032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:08:48.916720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:08:48.928552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:48.929122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:48.929721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:48.930486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:48.931021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:48.931523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:48.952594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:08:48.959138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Getting quotas for user e7d5767d1dc249cd8e97097588ee4728 and project 5e5ccdbb2594418aa42c014a1ec60554. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:08:48.973230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:08:48.975606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:08:49.043026 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a709a4c4-c3a2-4e47-a4da-4a88dc981557 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.463263 Oct 27 19:08:49.049197 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2516/4847] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:08:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:08:49.058693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fec07806-f77b-4804-9468-657f348bdfc7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:49.059540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fec07806-f77b-4804-9468-657f348bdfc7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:49.157741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fec07806-f77b-4804-9468-657f348bdfc7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:49.168457 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fec07806-f77b-4804-9468-657f348bdfc7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1209 microversion: 2.1 time: 0.114043 Oct 27 19:08:49.170784 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2332/4848] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:49 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1209 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:49.733544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4c2a1645-2044-4998-a59e-bfbeb8326c3a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:49.750323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4c2a1645-2044-4998-a59e-bfbeb8326c3a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:49.762672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:49.767776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c2a1645-2044-4998-a59e-bfbeb8326c3a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:49.783636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c2a1645-2044-4998-a59e-bfbeb8326c3a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:49.795210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c2a1645-2044-4998-a59e-bfbeb8326c3a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:49.798144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c2a1645-2044-4998-a59e-bfbeb8326c3a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:49.800538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c2a1645-2044-4998-a59e-bfbeb8326c3a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:49.804548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c2a1645-2044-4998-a59e-bfbeb8326c3a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:50.023042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4c2a1645-2044-4998-a59e-bfbeb8326c3a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:50.039748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4c2a1645-2044-4998-a59e-bfbeb8326c3a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:50.042309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4c2a1645-2044-4998-a59e-bfbeb8326c3a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:50.057557 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4c2a1645-2044-4998-a59e-bfbeb8326c3a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.331225 Oct 27 19:08:50.060389 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2517/4849] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:49 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:50.193073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-34f8e916-9fce-47b5-9036-2a0501f873ad tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:50.194615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-34f8e916-9fce-47b5-9036-2a0501f873ad tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:50.210971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34f8e916-9fce-47b5-9036-2a0501f873ad tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:50.211472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34f8e916-9fce-47b5-9036-2a0501f873ad tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:50.211965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34f8e916-9fce-47b5-9036-2a0501f873ad tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:50.212599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34f8e916-9fce-47b5-9036-2a0501f873ad tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:50.213234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34f8e916-9fce-47b5-9036-2a0501f873ad tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:50.214014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34f8e916-9fce-47b5-9036-2a0501f873ad tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:50.317763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-34f8e916-9fce-47b5-9036-2a0501f873ad tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:50.344556 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-34f8e916-9fce-47b5-9036-2a0501f873ad tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1213 microversion: 2.1 time: 0.138401 Oct 27 19:08:50.345545 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2333/4850] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:50 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1213 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:51.094918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2c12053b-1eea-4402-a370-5094855afdf2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:51.095787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2c12053b-1eea-4402-a370-5094855afdf2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:51.109312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c12053b-1eea-4402-a370-5094855afdf2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:51.110328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c12053b-1eea-4402-a370-5094855afdf2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:51.111043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c12053b-1eea-4402-a370-5094855afdf2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:51.112047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c12053b-1eea-4402-a370-5094855afdf2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:51.112876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c12053b-1eea-4402-a370-5094855afdf2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:51.113529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c12053b-1eea-4402-a370-5094855afdf2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:51.245539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2c12053b-1eea-4402-a370-5094855afdf2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:51.254417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2c12053b-1eea-4402-a370-5094855afdf2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:51.259474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2c12053b-1eea-4402-a370-5094855afdf2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:51.276058 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2c12053b-1eea-4402-a370-5094855afdf2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.187077 Oct 27 19:08:51.295511 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2518/4851] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:51 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:51.377040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-138f5f6a-28b2-4054-820b-a6a11882c05d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:51.378271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-138f5f6a-28b2-4054-820b-a6a11882c05d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:51.395260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-138f5f6a-28b2-4054-820b-a6a11882c05d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:51.395883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-138f5f6a-28b2-4054-820b-a6a11882c05d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:51.397179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-138f5f6a-28b2-4054-820b-a6a11882c05d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:51.401029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-138f5f6a-28b2-4054-820b-a6a11882c05d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:51.401860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-138f5f6a-28b2-4054-820b-a6a11882c05d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:51.402694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-138f5f6a-28b2-4054-820b-a6a11882c05d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:51.597571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-138f5f6a-28b2-4054-820b-a6a11882c05d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:51.610994 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-138f5f6a-28b2-4054-820b-a6a11882c05d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1269 microversion: 2.1 time: 0.244117 Oct 27 19:08:51.613317 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2334/4852] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:51 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1269 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:51.881073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b37dfcb8-9f9c-4be7-a0ae-dba747b7d041 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:51.882110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b37dfcb8-9f9c-4be7-a0ae-dba747b7d041 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:51.890020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b37dfcb8-9f9c-4be7-a0ae-dba747b7d041 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:51.891829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b37dfcb8-9f9c-4be7-a0ae-dba747b7d041 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:51.894768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b37dfcb8-9f9c-4be7-a0ae-dba747b7d041 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:51.895758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b37dfcb8-9f9c-4be7-a0ae-dba747b7d041 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:51.896491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b37dfcb8-9f9c-4be7-a0ae-dba747b7d041 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:51.897105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b37dfcb8-9f9c-4be7-a0ae-dba747b7d041 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:51.981308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b37dfcb8-9f9c-4be7-a0ae-dba747b7d041 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:08:52.097827 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b37dfcb8-9f9c-4be7-a0ae-dba747b7d041 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 204 len: 0 microversion: 2.1 time: 0.221176 Oct 27 19:08:52.100185 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2519/4853] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:08:51 2022] DELETE /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:08:52.111434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d3ccc800-3bd0-4d03-bdfb-7f10deec9d3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:52.112136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d3ccc800-3bd0-4d03-bdfb-7f10deec9d3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:52.121177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3ccc800-3bd0-4d03-bdfb-7f10deec9d3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:52.121789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3ccc800-3bd0-4d03-bdfb-7f10deec9d3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:52.122593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3ccc800-3bd0-4d03-bdfb-7f10deec9d3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:52.123426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3ccc800-3bd0-4d03-bdfb-7f10deec9d3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:52.124099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3ccc800-3bd0-4d03-bdfb-7f10deec9d3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:52.124672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3ccc800-3bd0-4d03-bdfb-7f10deec9d3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:52.316212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7ff98a0e-4694-4184-b5d2-187dbb62baf5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:52.317244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7ff98a0e-4694-4184-b5d2-187dbb62baf5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:52.328252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ff98a0e-4694-4184-b5d2-187dbb62baf5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:52.329024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ff98a0e-4694-4184-b5d2-187dbb62baf5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:52.330480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ff98a0e-4694-4184-b5d2-187dbb62baf5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:52.332668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ff98a0e-4694-4184-b5d2-187dbb62baf5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:52.334516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ff98a0e-4694-4184-b5d2-187dbb62baf5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:52.335191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ff98a0e-4694-4184-b5d2-187dbb62baf5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:52.389547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d3ccc800-3bd0-4d03-bdfb-7f10deec9d3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:52.398705 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d3ccc800-3bd0-4d03-bdfb-7f10deec9d3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1552 microversion: 2.1 time: 0.294031 Oct 27 19:08:52.405024 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2335/4854] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:52 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1552 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:52.464708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7ff98a0e-4694-4184-b5d2-187dbb62baf5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:52.478711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7ff98a0e-4694-4184-b5d2-187dbb62baf5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:52.480645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7ff98a0e-4694-4184-b5d2-187dbb62baf5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:52.487988 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7ff98a0e-4694-4184-b5d2-187dbb62baf5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.179673 Oct 27 19:08:52.488987 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2520/4855] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:52 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:52.638788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-beae1c89-f0ee-447b-bfe3-f7fa9a19cf77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:52.639350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-beae1c89-f0ee-447b-bfe3-f7fa9a19cf77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:52.652355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beae1c89-f0ee-447b-bfe3-f7fa9a19cf77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:52.653229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beae1c89-f0ee-447b-bfe3-f7fa9a19cf77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:52.653894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beae1c89-f0ee-447b-bfe3-f7fa9a19cf77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:52.656910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beae1c89-f0ee-447b-bfe3-f7fa9a19cf77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:52.658059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beae1c89-f0ee-447b-bfe3-f7fa9a19cf77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:52.658985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-beae1c89-f0ee-447b-bfe3-f7fa9a19cf77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:53.085419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-beae1c89-f0ee-447b-bfe3-f7fa9a19cf77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:53.098293 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-beae1c89-f0ee-447b-bfe3-f7fa9a19cf77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1309 microversion: 2.1 time: 0.464958 Oct 27 19:08:53.100754 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2336/4856] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:52 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1309 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:53.437997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9476f611-1b73-49a1-9299-b5cc9c5d1cc2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:53.439235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9476f611-1b73-49a1-9299-b5cc9c5d1cc2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:53.455101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9476f611-1b73-49a1-9299-b5cc9c5d1cc2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:53.455612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9476f611-1b73-49a1-9299-b5cc9c5d1cc2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:53.456064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9476f611-1b73-49a1-9299-b5cc9c5d1cc2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:53.456790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9476f611-1b73-49a1-9299-b5cc9c5d1cc2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:53.457259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9476f611-1b73-49a1-9299-b5cc9c5d1cc2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:53.457695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9476f611-1b73-49a1-9299-b5cc9c5d1cc2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:53.522569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d31e779-173d-422a-b477-0d181da405ea tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:53.523816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9d31e779-173d-422a-b477-0d181da405ea tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:53.534244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d31e779-173d-422a-b477-0d181da405ea tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:53.535068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d31e779-173d-422a-b477-0d181da405ea tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:53.535692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d31e779-173d-422a-b477-0d181da405ea tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:53.536584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d31e779-173d-422a-b477-0d181da405ea tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:53.537203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d31e779-173d-422a-b477-0d181da405ea tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:53.537992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d31e779-173d-422a-b477-0d181da405ea tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:53.668107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d31e779-173d-422a-b477-0d181da405ea tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:53.683573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d31e779-173d-422a-b477-0d181da405ea tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:53.685359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d31e779-173d-422a-b477-0d181da405ea tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:53.692180 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9d31e779-173d-422a-b477-0d181da405ea tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.173390 Oct 27 19:08:53.703551 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2337/4857] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:53 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:53.897835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9476f611-1b73-49a1-9299-b5cc9c5d1cc2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:53.917118 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9476f611-1b73-49a1-9299-b5cc9c5d1cc2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1552 microversion: 2.1 time: 0.492143 Oct 27 19:08:53.917995 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2521/4858] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:53 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1552 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:54.125865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-df1db3bf-1174-4f29-987c-dd7b70f571cf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:54.127050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-df1db3bf-1174-4f29-987c-dd7b70f571cf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:54.141128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df1db3bf-1174-4f29-987c-dd7b70f571cf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:54.142656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df1db3bf-1174-4f29-987c-dd7b70f571cf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:54.143661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df1db3bf-1174-4f29-987c-dd7b70f571cf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:54.147698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df1db3bf-1174-4f29-987c-dd7b70f571cf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:54.148338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df1db3bf-1174-4f29-987c-dd7b70f571cf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:54.148895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df1db3bf-1174-4f29-987c-dd7b70f571cf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:54.179325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:54.547339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-df1db3bf-1174-4f29-987c-dd7b70f571cf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:54.558122 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-df1db3bf-1174-4f29-987c-dd7b70f571cf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1309 microversion: 2.1 time: 0.437125 Oct 27 19:08:54.570410 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2338/4859] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:54 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:54.682556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-07b34219-0ea0-4490-bd3e-20e2d597b974 req-668cb830-32c2-4318-9def-7892eabafd31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2b4bcc-c45c-49b4-af4e-039935fe8285", "tag": "99a02cc6-b61f-44d5-b04a-d834e2db33e8"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:54.704044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-07b34219-0ea0-4490-bd3e-20e2d597b974 req-668cb830-32c2-4318-9def-7892eabafd31 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:54.706361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-07b34219-0ea0-4490-bd3e-20e2d597b974 req-668cb830-32c2-4318-9def-7892eabafd31 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:54.708781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-07b34219-0ea0-4490-bd3e-20e2d597b974 req-668cb830-32c2-4318-9def-7892eabafd31 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:54.722052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b70b6f3a-da38-48f5-8e5f-6d11ee3359b7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:54.722947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b70b6f3a-da38-48f5-8e5f-6d11ee3359b7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:54.734797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b70b6f3a-da38-48f5-8e5f-6d11ee3359b7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:54.735356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b70b6f3a-da38-48f5-8e5f-6d11ee3359b7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:54.739187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b70b6f3a-da38-48f5-8e5f-6d11ee3359b7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:54.740131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b70b6f3a-da38-48f5-8e5f-6d11ee3359b7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:54.743232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b70b6f3a-da38-48f5-8e5f-6d11ee3359b7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:54.743622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b70b6f3a-da38-48f5-8e5f-6d11ee3359b7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:54.760247 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-07b34219-0ea0-4490-bd3e-20e2d597b974 req-668cb830-32c2-4318-9def-7892eabafd31 service nova] Creating event network-changed:99a02cc6-b61f-44d5-b04a-d834e2db33e8 for instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 on n-h2-860687-3 Oct 27 19:08:54.773274 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-07b34219-0ea0-4490-bd3e-20e2d597b974 req-668cb830-32c2-4318-9def-7892eabafd31 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095342 Oct 27 19:08:54.775126 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2522/4860] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:08:54.877648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b70b6f3a-da38-48f5-8e5f-6d11ee3359b7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:54.898411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b70b6f3a-da38-48f5-8e5f-6d11ee3359b7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:54.900323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b70b6f3a-da38-48f5-8e5f-6d11ee3359b7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:54.908190 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b70b6f3a-da38-48f5-8e5f-6d11ee3359b7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.190660 Oct 27 19:08:54.909258 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2339/4861] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:54 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:08:54.946181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b2bd7e34-0792-4518-b44d-f75379c9710c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:54.947198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b2bd7e34-0792-4518-b44d-f75379c9710c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:54.961570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2bd7e34-0792-4518-b44d-f75379c9710c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:54.963923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2bd7e34-0792-4518-b44d-f75379c9710c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:54.965936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2bd7e34-0792-4518-b44d-f75379c9710c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:54.971782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2bd7e34-0792-4518-b44d-f75379c9710c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:54.972543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2bd7e34-0792-4518-b44d-f75379c9710c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:54.974899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2bd7e34-0792-4518-b44d-f75379c9710c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:55.371038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b2bd7e34-0792-4518-b44d-f75379c9710c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:55.373516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:55.384747 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b2bd7e34-0792-4518-b44d-f75379c9710c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1552 microversion: 2.1 time: 0.443645 Oct 27 19:08:55.389727 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2523/4862] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:54 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1552 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:55.588784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-04519a75-78cb-49a6-aa72-e566e915ec4c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:55.589410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04519a75-78cb-49a6-aa72-e566e915ec4c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:55.604751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04519a75-78cb-49a6-aa72-e566e915ec4c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:55.605584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04519a75-78cb-49a6-aa72-e566e915ec4c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:55.606776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04519a75-78cb-49a6-aa72-e566e915ec4c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:55.608555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04519a75-78cb-49a6-aa72-e566e915ec4c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:55.611687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04519a75-78cb-49a6-aa72-e566e915ec4c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:55.612321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04519a75-78cb-49a6-aa72-e566e915ec4c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:55.946976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cc406bb6-0635-444e-9428-8eaebc4dfe19 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:55.948363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cc406bb6-0635-444e-9428-8eaebc4dfe19 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:55.966100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc406bb6-0635-444e-9428-8eaebc4dfe19 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:55.966824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc406bb6-0635-444e-9428-8eaebc4dfe19 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:55.972039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc406bb6-0635-444e-9428-8eaebc4dfe19 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:55.973122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc406bb6-0635-444e-9428-8eaebc4dfe19 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:55.977664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc406bb6-0635-444e-9428-8eaebc4dfe19 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:55.978555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc406bb6-0635-444e-9428-8eaebc4dfe19 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:56.056739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-04519a75-78cb-49a6-aa72-e566e915ec4c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:56.084402 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-04519a75-78cb-49a6-aa72-e566e915ec4c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1309 microversion: 2.1 time: 0.502875 Oct 27 19:08:56.085378 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2340/4863] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:55 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1309 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:56.121270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cc406bb6-0635-444e-9428-8eaebc4dfe19 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:56.136831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cc406bb6-0635-444e-9428-8eaebc4dfe19 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:56.138680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cc406bb6-0635-444e-9428-8eaebc4dfe19 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:56.163689 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cc406bb6-0635-444e-9428-8eaebc4dfe19 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.222873 Oct 27 19:08:56.185494 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2524/4864] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:55 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:56.415998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9feffb92-5626-4a0f-a039-bb84ae48012f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:56.416910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9feffb92-5626-4a0f-a039-bb84ae48012f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:56.429392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9feffb92-5626-4a0f-a039-bb84ae48012f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:56.430053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9feffb92-5626-4a0f-a039-bb84ae48012f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:56.433902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9feffb92-5626-4a0f-a039-bb84ae48012f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:56.439071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9feffb92-5626-4a0f-a039-bb84ae48012f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:56.439793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9feffb92-5626-4a0f-a039-bb84ae48012f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:56.440255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9feffb92-5626-4a0f-a039-bb84ae48012f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:56.554652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9feffb92-5626-4a0f-a039-bb84ae48012f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:56.573717 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9feffb92-5626-4a0f-a039-bb84ae48012f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1345 microversion: 2.1 time: 0.161921 Oct 27 19:08:56.575085 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2341/4865] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:56 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1345 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:56.819992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-21b12c86-c5d8-4263-a5ab-e8a85d909713 req-9de3f59f-ad66-455f-814c-681b62bb3794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d62a58-bc77-4e6f-bc0c-9fa193005049", "name": "network-vif-deleted", "tag": "eb7020ef-d1f7-4471-8bef-9313f01b5b35"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:08:56.851982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-21b12c86-c5d8-4263-a5ab-e8a85d909713 req-9de3f59f-ad66-455f-814c-681b62bb3794 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:56.858059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-21b12c86-c5d8-4263-a5ab-e8a85d909713 req-9de3f59f-ad66-455f-814c-681b62bb3794 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:56.859085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-21b12c86-c5d8-4263-a5ab-e8a85d909713 req-9de3f59f-ad66-455f-814c-681b62bb3794 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:56.904152 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-21b12c86-c5d8-4263-a5ab-e8a85d909713 req-9de3f59f-ad66-455f-814c-681b62bb3794 service nova] Creating event network-vif-deleted:eb7020ef-d1f7-4471-8bef-9313f01b5b35 for instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 on n-h1-860687-3 Oct 27 19:08:56.916921 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-21b12c86-c5d8-4263-a5ab-e8a85d909713 req-9de3f59f-ad66-455f-814c-681b62bb3794 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101534 Oct 27 19:08:56.918161 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2525/4866] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:08:57.110543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3c2af7ba-2307-4944-97c0-8009bc7aedb3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:57.111353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3c2af7ba-2307-4944-97c0-8009bc7aedb3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:57.122082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c2af7ba-2307-4944-97c0-8009bc7aedb3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:57.122957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c2af7ba-2307-4944-97c0-8009bc7aedb3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:57.127055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c2af7ba-2307-4944-97c0-8009bc7aedb3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:57.127955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c2af7ba-2307-4944-97c0-8009bc7aedb3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:57.132198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c2af7ba-2307-4944-97c0-8009bc7aedb3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:57.132803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c2af7ba-2307-4944-97c0-8009bc7aedb3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:57.201128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ccc18a3c-840f-4f44-9e51-196a264afa14 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:57.202405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ccc18a3c-840f-4f44-9e51-196a264afa14 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:57.233148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ccc18a3c-840f-4f44-9e51-196a264afa14 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:57.233830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ccc18a3c-840f-4f44-9e51-196a264afa14 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:57.235043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ccc18a3c-840f-4f44-9e51-196a264afa14 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:57.236157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ccc18a3c-840f-4f44-9e51-196a264afa14 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:57.236812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ccc18a3c-840f-4f44-9e51-196a264afa14 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:57.237412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ccc18a3c-840f-4f44-9e51-196a264afa14 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:57.332186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ccc18a3c-840f-4f44-9e51-196a264afa14 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:57.361015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ccc18a3c-840f-4f44-9e51-196a264afa14 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:57.370507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ccc18a3c-840f-4f44-9e51-196a264afa14 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:57.373443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3c2af7ba-2307-4944-97c0-8009bc7aedb3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:57.393433 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ccc18a3c-840f-4f44-9e51-196a264afa14 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.194368 Oct 27 19:08:57.395303 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3c2af7ba-2307-4944-97c0-8009bc7aedb3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1309 microversion: 2.1 time: 0.289556 Oct 27 19:08:57.415801 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2342/4867] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:57 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1309 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:57.416285 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2526/4868] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:57 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:57.605399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f453ddae-78bf-4321-bd24-60ca4ab76725 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:57.606326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f453ddae-78bf-4321-bd24-60ca4ab76725 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:57.621390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f453ddae-78bf-4321-bd24-60ca4ab76725 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:57.621828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f453ddae-78bf-4321-bd24-60ca4ab76725 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:57.622281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f453ddae-78bf-4321-bd24-60ca4ab76725 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:57.623038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f453ddae-78bf-4321-bd24-60ca4ab76725 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:57.623541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f453ddae-78bf-4321-bd24-60ca4ab76725 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:57.624139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f453ddae-78bf-4321-bd24-60ca4ab76725 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:57.754665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f453ddae-78bf-4321-bd24-60ca4ab76725 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:57.764845 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f453ddae-78bf-4321-bd24-60ca4ab76725 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1345 microversion: 2.1 time: 0.163788 Oct 27 19:08:57.767825 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2343/4869] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:57 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1345 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:58.425192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0798719e-9cf1-4198-b5bb-6e2f3633fbd3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:58.425827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0798719e-9cf1-4198-b5bb-6e2f3633fbd3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:58.441305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0798719e-9cf1-4198-b5bb-6e2f3633fbd3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:58.442538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0798719e-9cf1-4198-b5bb-6e2f3633fbd3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:58.443502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0798719e-9cf1-4198-b5bb-6e2f3633fbd3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:58.446063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0798719e-9cf1-4198-b5bb-6e2f3633fbd3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:58.446787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0798719e-9cf1-4198-b5bb-6e2f3633fbd3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:58.447184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a0d737cc-c2ab-43d1-9186-d8c83e66020a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:58.447749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0798719e-9cf1-4198-b5bb-6e2f3633fbd3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:58.451127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a0d737cc-c2ab-43d1-9186-d8c83e66020a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:58.472561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0d737cc-c2ab-43d1-9186-d8c83e66020a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:58.481691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0d737cc-c2ab-43d1-9186-d8c83e66020a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:58.482998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0d737cc-c2ab-43d1-9186-d8c83e66020a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:58.487066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0d737cc-c2ab-43d1-9186-d8c83e66020a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:58.490210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0d737cc-c2ab-43d1-9186-d8c83e66020a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:58.491150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0d737cc-c2ab-43d1-9186-d8c83e66020a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:58.688241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0d737cc-c2ab-43d1-9186-d8c83e66020a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:58.701022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0d737cc-c2ab-43d1-9186-d8c83e66020a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:58.704611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0d737cc-c2ab-43d1-9186-d8c83e66020a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:58.718649 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a0d737cc-c2ab-43d1-9186-d8c83e66020a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.277811 Oct 27 19:08:58.729145 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2344/4870] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:58 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:58.798879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-33f831c9-34ea-4a28-933d-556aacd9b723 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:58.800785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-33f831c9-34ea-4a28-933d-556aacd9b723 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:58.808823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33f831c9-34ea-4a28-933d-556aacd9b723 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:58.809713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33f831c9-34ea-4a28-933d-556aacd9b723 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:58.810473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33f831c9-34ea-4a28-933d-556aacd9b723 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:58.811454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33f831c9-34ea-4a28-933d-556aacd9b723 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:58.812157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33f831c9-34ea-4a28-933d-556aacd9b723 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:58.813379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33f831c9-34ea-4a28-933d-556aacd9b723 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:58.841043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0798719e-9cf1-4198-b5bb-6e2f3633fbd3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:58.849774 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0798719e-9cf1-4198-b5bb-6e2f3633fbd3 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1309 microversion: 2.1 time: 0.430482 Oct 27 19:08:58.851280 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2527/4871] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:58 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1309 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:58.944788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-33f831c9-34ea-4a28-933d-556aacd9b723 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:58.963211 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-33f831c9-34ea-4a28-933d-556aacd9b723 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1345 microversion: 2.1 time: 0.169820 Oct 27 19:08:58.964921 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2345/4872] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:58 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1345 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:08:59.768559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-724a83e5-0337-4e5b-9f44-fb9d3a68dfaf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:59.769225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-724a83e5-0337-4e5b-9f44-fb9d3a68dfaf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:59.784029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:59.786636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:59.795515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-724a83e5-0337-4e5b-9f44-fb9d3a68dfaf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:59.800945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-724a83e5-0337-4e5b-9f44-fb9d3a68dfaf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:59.801740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-724a83e5-0337-4e5b-9f44-fb9d3a68dfaf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:59.802733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-724a83e5-0337-4e5b-9f44-fb9d3a68dfaf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:59.805137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-724a83e5-0337-4e5b-9f44-fb9d3a68dfaf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:59.805868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-724a83e5-0337-4e5b-9f44-fb9d3a68dfaf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:59.872293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f02ee691-df24-469f-b57c-cfae71dc9bb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:59.872989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f02ee691-df24-469f-b57c-cfae71dc9bb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:08:59.892054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:59.894430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:08:59.895937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f02ee691-df24-469f-b57c-cfae71dc9bb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:59.896476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f02ee691-df24-469f-b57c-cfae71dc9bb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:59.897003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f02ee691-df24-469f-b57c-cfae71dc9bb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:59.897722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f02ee691-df24-469f-b57c-cfae71dc9bb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:08:59.898189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f02ee691-df24-469f-b57c-cfae71dc9bb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:08:59.898640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f02ee691-df24-469f-b57c-cfae71dc9bb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:08:59.933050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-724a83e5-0337-4e5b-9f44-fb9d3a68dfaf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:59.949425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-724a83e5-0337-4e5b-9f44-fb9d3a68dfaf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:59.951169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-724a83e5-0337-4e5b-9f44-fb9d3a68dfaf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:08:59.972953 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-724a83e5-0337-4e5b-9f44-fb9d3a68dfaf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.210891 Oct 27 19:08:59.973550 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2528/4873] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:08:59 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:08:59.991698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6a9bcd61-4ae5-40a6-8744-b4142673ce43 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:08:59.992598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6a9bcd61-4ae5-40a6-8744-b4142673ce43 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:00.005085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a9bcd61-4ae5-40a6-8744-b4142673ce43 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:00.005972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a9bcd61-4ae5-40a6-8744-b4142673ce43 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:00.006521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a9bcd61-4ae5-40a6-8744-b4142673ce43 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:00.011398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a9bcd61-4ae5-40a6-8744-b4142673ce43 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:00.011958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a9bcd61-4ae5-40a6-8744-b4142673ce43 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:00.012586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a9bcd61-4ae5-40a6-8744-b4142673ce43 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:00.154799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6a9bcd61-4ae5-40a6-8744-b4142673ce43 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:00.177415 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6a9bcd61-4ae5-40a6-8744-b4142673ce43 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1345 microversion: 2.1 time: 0.189669 Oct 27 19:09:00.178022 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2529/4874] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:59 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1345 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:00.711566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f02ee691-df24-469f-b57c-cfae71dc9bb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:00.719582 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f02ee691-df24-469f-b57c-cfae71dc9bb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1309 microversion: 2.1 time: 0.851136 Oct 27 19:09:00.734585 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2346/4875] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:08:59 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1309 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:01.001267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ece88e65-43a1-4eb4-9b5f-ba2869efa3b6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:01.002561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ece88e65-43a1-4eb4-9b5f-ba2869efa3b6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:01.018109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ece88e65-43a1-4eb4-9b5f-ba2869efa3b6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:01.018959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ece88e65-43a1-4eb4-9b5f-ba2869efa3b6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:01.022923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ece88e65-43a1-4eb4-9b5f-ba2869efa3b6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:01.024065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ece88e65-43a1-4eb4-9b5f-ba2869efa3b6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:01.024848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ece88e65-43a1-4eb4-9b5f-ba2869efa3b6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:01.025482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ece88e65-43a1-4eb4-9b5f-ba2869efa3b6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:01.170431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ece88e65-43a1-4eb4-9b5f-ba2869efa3b6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:01.203826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ece88e65-43a1-4eb4-9b5f-ba2869efa3b6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:01.205316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-22d160c3-4d45-45f1-b83d-5310b2a94481 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:01.206201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ece88e65-43a1-4eb4-9b5f-ba2869efa3b6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:01.209760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-22d160c3-4d45-45f1-b83d-5310b2a94481 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:01.236017 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ece88e65-43a1-4eb4-9b5f-ba2869efa3b6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.224593 Oct 27 19:09:01.237491 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2530/4876] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:00 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:01.249464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22d160c3-4d45-45f1-b83d-5310b2a94481 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:01.258777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22d160c3-4d45-45f1-b83d-5310b2a94481 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:01.262421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22d160c3-4d45-45f1-b83d-5310b2a94481 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:01.269007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22d160c3-4d45-45f1-b83d-5310b2a94481 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:01.273486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22d160c3-4d45-45f1-b83d-5310b2a94481 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:01.276150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22d160c3-4d45-45f1-b83d-5310b2a94481 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:01.418772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22d160c3-4d45-45f1-b83d-5310b2a94481 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:01.431119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22d160c3-4d45-45f1-b83d-5310b2a94481 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:01.437702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22d160c3-4d45-45f1-b83d-5310b2a94481 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:01.438625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-22d160c3-4d45-45f1-b83d-5310b2a94481 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lazy-loading 'fault' on Instance uuid f1d62a58-bc77-4e6f-bc0c-9fa193005049 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:09:01.613219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-22d160c3-4d45-45f1-b83d-5310b2a94481 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:01.625537 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-22d160c3-4d45-45f1-b83d-5310b2a94481 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 200 len: 1350 microversion: 2.1 time: 0.428213 Oct 27 19:09:01.626739 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2347/4877] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:01 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 1350 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:01.689582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-8c0d822e-c410-4860-9a74-8ba06d444346 req-f372887f-3275-489a-929f-96de4978ae32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2b4bcc-c45c-49b4-af4e-039935fe8285", "name": "network-vif-plugged", "status": "completed", "tag": "99a02cc6-b61f-44d5-b04a-d834e2db33e8"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:01.704972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8c0d822e-c410-4860-9a74-8ba06d444346 req-f372887f-3275-489a-929f-96de4978ae32 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:01.705473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8c0d822e-c410-4860-9a74-8ba06d444346 req-f372887f-3275-489a-929f-96de4978ae32 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:01.705925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8c0d822e-c410-4860-9a74-8ba06d444346 req-f372887f-3275-489a-929f-96de4978ae32 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:01.730899 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8c0d822e-c410-4860-9a74-8ba06d444346 req-f372887f-3275-489a-929f-96de4978ae32 service nova] Creating event network-vif-plugged:99a02cc6-b61f-44d5-b04a-d834e2db33e8 for instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 on n-h2-860687-3 Oct 27 19:09:01.749563 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-8c0d822e-c410-4860-9a74-8ba06d444346 req-f372887f-3275-489a-929f-96de4978ae32 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063683 Oct 27 19:09:01.755203 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2531/4878] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:09:01.773463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b658a196-3ee8-4072-a562-c12001c34361 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:01.775466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b658a196-3ee8-4072-a562-c12001c34361 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:01.826707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b658a196-3ee8-4072-a562-c12001c34361 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:01.828400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b658a196-3ee8-4072-a562-c12001c34361 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:01.828905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b658a196-3ee8-4072-a562-c12001c34361 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:01.829662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b658a196-3ee8-4072-a562-c12001c34361 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:01.833845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b658a196-3ee8-4072-a562-c12001c34361 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:01.834874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b658a196-3ee8-4072-a562-c12001c34361 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:02.223081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b658a196-3ee8-4072-a562-c12001c34361 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:02.232340 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b658a196-3ee8-4072-a562-c12001c34361 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1309 microversion: 2.1 time: 0.487635 Oct 27 19:09:02.236491 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2348/4879] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:01 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1309 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:02.278803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bbc8e337-8df8-452d-ab45-76ad93105a54 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:02.280385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bbc8e337-8df8-452d-ab45-76ad93105a54 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:02.291494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbc8e337-8df8-452d-ab45-76ad93105a54 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:02.292039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbc8e337-8df8-452d-ab45-76ad93105a54 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:02.292938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbc8e337-8df8-452d-ab45-76ad93105a54 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:02.293700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbc8e337-8df8-452d-ab45-76ad93105a54 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:02.294172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbc8e337-8df8-452d-ab45-76ad93105a54 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:02.294639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bbc8e337-8df8-452d-ab45-76ad93105a54 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:02.413818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bbc8e337-8df8-452d-ab45-76ad93105a54 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:02.428953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bbc8e337-8df8-452d-ab45-76ad93105a54 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:02.431360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bbc8e337-8df8-452d-ab45-76ad93105a54 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:02.439897 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bbc8e337-8df8-452d-ab45-76ad93105a54 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.168344 Oct 27 19:09:02.441161 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2532/4880] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:02 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:02.652594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-16d79d00-5f56-4c3c-95fd-3775efb5c0fe tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:02.653361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-16d79d00-5f56-4c3c-95fd-3775efb5c0fe tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:02.665114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16d79d00-5f56-4c3c-95fd-3775efb5c0fe tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:02.665786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16d79d00-5f56-4c3c-95fd-3775efb5c0fe tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:02.679103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16d79d00-5f56-4c3c-95fd-3775efb5c0fe tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:02.680042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16d79d00-5f56-4c3c-95fd-3775efb5c0fe tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:02.680634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16d79d00-5f56-4c3c-95fd-3775efb5c0fe tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:02.681176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16d79d00-5f56-4c3c-95fd-3775efb5c0fe tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:02.701839 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-16d79d00-5f56-4c3c-95fd-3775efb5c0fe tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-16d79d00-5f56-4c3c-95fd-3775efb5c0fe tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 HTTP/1.1 Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'f1d62a58-bc77-4e6f-bc0c-9fa193005049'} Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:02.716221 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:02.722795 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:02.722795 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:02.722795 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:02.722795 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:02.722795 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:02.722795 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:09:02.722795 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:02.722795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-16d79d00-5f56-4c3c-95fd-3775efb5c0fe tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:02.722795 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-16d79d00-5f56-4c3c-95fd-3775efb5c0fe tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 404 len: 111 microversion: 2.1 time: 0.071983 Oct 27 19:09:02.725719 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2349/4881] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:02 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:02.909335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84145ef0-22e1-4acd-a1c4-2ebc9f19e852 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:02.911750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-84145ef0-22e1-4acd-a1c4-2ebc9f19e852 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:02.926257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84145ef0-22e1-4acd-a1c4-2ebc9f19e852 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:02.927975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84145ef0-22e1-4acd-a1c4-2ebc9f19e852 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:02.928702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84145ef0-22e1-4acd-a1c4-2ebc9f19e852 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:02.929462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84145ef0-22e1-4acd-a1c4-2ebc9f19e852 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:02.929935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84145ef0-22e1-4acd-a1c4-2ebc9f19e852 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:02.930378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84145ef0-22e1-4acd-a1c4-2ebc9f19e852 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:02.948387 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-84145ef0-22e1-4acd-a1c4-2ebc9f19e852 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84145ef0-22e1-4acd-a1c4-2ebc9f19e852 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049/os-volume_attachments HTTP/1.1 Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'server_id': 'f1d62a58-bc77-4e6f-bc0c-9fa193005049'} Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:02.955267 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:02.960465 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:09:02.960465 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:02.960465 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:02.960465 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:02.960465 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:02.960465 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:02.960465 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:02.960465 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:02.960465 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:02.960465 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:09:02.960465 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:02.962094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84145ef0-22e1-4acd-a1c4-2ebc9f19e852 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:02.963296 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-84145ef0-22e1-4acd-a1c4-2ebc9f19e852 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.058491 Oct 27 19:09:02.971020 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2533/4882] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:09:02 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049/os-volume_attachments => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:03.213544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1047131553", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "e7d83c6b-c0c0-42e5-b094-5dc26599221d"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:03.261097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b06bec41-7100-4951-9f0f-df55d35b2c97 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:03.261724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b06bec41-7100-4951-9f0f-df55d35b2c97 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:03.280979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b06bec41-7100-4951-9f0f-df55d35b2c97 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:03.281692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b06bec41-7100-4951-9f0f-df55d35b2c97 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:03.282301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b06bec41-7100-4951-9f0f-df55d35b2c97 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:03.283048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b06bec41-7100-4951-9f0f-df55d35b2c97 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:03.287807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b06bec41-7100-4951-9f0f-df55d35b2c97 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:03.288480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b06bec41-7100-4951-9f0f-df55d35b2c97 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:03.368590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] validate_networks() for [('e7d83c6b-c0c0-42e5-b094-5dc26599221d', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:09:03.529502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b06bec41-7100-4951-9f0f-df55d35b2c97 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:03.543085 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b06bec41-7100-4951-9f0f-df55d35b2c97 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1309 microversion: 2.1 time: 0.285731 Oct 27 19:09:03.573515 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2534/4883] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:03 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1309 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:03.587999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f37a7f68-1f58-4b21-89b0-69fdf8775927 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:03.588640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f37a7f68-1f58-4b21-89b0-69fdf8775927 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:03.606019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f37a7f68-1f58-4b21-89b0-69fdf8775927 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:03.606577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f37a7f68-1f58-4b21-89b0-69fdf8775927 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:03.607070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f37a7f68-1f58-4b21-89b0-69fdf8775927 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:03.607814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f37a7f68-1f58-4b21-89b0-69fdf8775927 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:03.613517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f37a7f68-1f58-4b21-89b0-69fdf8775927 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:03.614039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f37a7f68-1f58-4b21-89b0-69fdf8775927 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:03.727367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f37a7f68-1f58-4b21-89b0-69fdf8775927 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:03.743009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f37a7f68-1f58-4b21-89b0-69fdf8775927 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:03.744493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f37a7f68-1f58-4b21-89b0-69fdf8775927 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:03.753089 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f37a7f68-1f58-4b21-89b0-69fdf8775927 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.178353 Oct 27 19:09:03.753688 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2535/4884] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:03 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:04.339520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:09:04.340216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:09:04.340887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:09:04.341500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:09:04.342099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:09:04.356675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:04.357217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:04.358032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:04.359211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:04.359685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:04.360441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:04.381695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Getting quotas for project 1798d878b8344ec69c9ef0699467718a. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:09:04.389299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Getting quotas for user b2237837d17c43e99f4e9961cd27cbb5 and project 1798d878b8344ec69c9ef0699467718a. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:09:04.404407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:09:04.408089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:09:04.473807 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e82d33fc-25b5-489b-aa8b-78cb4e6909db tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.266108 Oct 27 19:09:04.476076 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2350/4885] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:09:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:09:04.491228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-256173d3-6c1e-4c87-ac06-85eaed52de70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:04.492748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-256173d3-6c1e-4c87-ac06-85eaed52de70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:04.571467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eba81dc7-70d4-4293-a038-de462573cdb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:04.572229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eba81dc7-70d4-4293-a038-de462573cdb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:04.592306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eba81dc7-70d4-4293-a038-de462573cdb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:04.592819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eba81dc7-70d4-4293-a038-de462573cdb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:04.593279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eba81dc7-70d4-4293-a038-de462573cdb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:04.594110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eba81dc7-70d4-4293-a038-de462573cdb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:04.595097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eba81dc7-70d4-4293-a038-de462573cdb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:04.598909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eba81dc7-70d4-4293-a038-de462573cdb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:04.632691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-256173d3-6c1e-4c87-ac06-85eaed52de70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:04.640621 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-256173d3-6c1e-4c87-ac06-85eaed52de70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c" status: 200 len: 1215 microversion: 2.1 time: 0.157038 Oct 27 19:09:04.656310 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2536/4886] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:04 2022] GET /compute/v2.1/servers/dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:04.676765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e52ed978-136b-41be-9ed1-45449d1e782a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:04.677277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e52ed978-136b-41be-9ed1-45449d1e782a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:04.711163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e52ed978-136b-41be-9ed1-45449d1e782a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:09:05.000472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-eba81dc7-70d4-4293-a038-de462573cdb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:05.013227 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eba81dc7-70d4-4293-a038-de462573cdb1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1489 microversion: 2.1 time: 0.447467 Oct 27 19:09:05.014050 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2351/4887] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:04 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1489 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:05.019202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3675616f-e132-4f77-be70-ede422154f18 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:05.019811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3675616f-e132-4f77-be70-ede422154f18 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:05.037203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3675616f-e132-4f77-be70-ede422154f18 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:05.037709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3675616f-e132-4f77-be70-ede422154f18 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:05.038166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3675616f-e132-4f77-be70-ede422154f18 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:05.038928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3675616f-e132-4f77-be70-ede422154f18 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:05.039400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3675616f-e132-4f77-be70-ede422154f18 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:05.039839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3675616f-e132-4f77-be70-ede422154f18 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:05.096418 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.compute.api [None req-e52ed978-136b-41be-9ed1-45449d1e782a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c] Instance Mapping does not exist while attempting local delete cleanup. Oct 27 19:09:05.097254 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e52ed978-136b-41be-9ed1-45449d1e782a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c" status: 204 len: 0 microversion: 2.1 time: 0.435953 Oct 27 19:09:05.098121 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2537/4888] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:09:04 2022] DELETE /compute/v2.1/servers/dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:09:05.104729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-93fd8f8d-d279-43bf-9ef3-f46f3358cbc0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1009193279"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:05.109350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-93fd8f8d-d279-43bf-9ef3-f46f3358cbc0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:05.117788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93fd8f8d-d279-43bf-9ef3-f46f3358cbc0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:05.122819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3675616f-e132-4f77-be70-ede422154f18 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:05.129105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93fd8f8d-d279-43bf-9ef3-f46f3358cbc0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:05.129583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93fd8f8d-d279-43bf-9ef3-f46f3358cbc0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:05.136380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93fd8f8d-d279-43bf-9ef3-f46f3358cbc0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:05.136875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93fd8f8d-d279-43bf-9ef3-f46f3358cbc0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:05.137329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93fd8f8d-d279-43bf-9ef3-f46f3358cbc0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:05.141336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3675616f-e132-4f77-be70-ede422154f18 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:05.143202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3675616f-e132-4f77-be70-ede422154f18 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:05.149561 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3675616f-e132-4f77-be70-ede422154f18 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.134743 Oct 27 19:09:05.150731 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2352/4889] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:05 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:05.155719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-63f394fa-9f83-4cfe-ab5c-1901e56aad83 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:05.157844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-63f394fa-9f83-4cfe-ab5c-1901e56aad83 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:05.165210 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-63f394fa-9f83-4cfe-ab5c-1901e56aad83 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-63f394fa-9f83-4cfe-ab5c-1901e56aad83 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c HTTP/1.1 Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c'} Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:05.168280 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:05.175484 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:05.175484 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:05.175484 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:05.175484 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:09:05.175484 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:05.175484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-63f394fa-9f83-4cfe-ab5c-1901e56aad83 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:05.175484 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-63f394fa-9f83-4cfe-ab5c-1901e56aad83 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c" status: 404 len: 111 microversion: 2.1 time: 0.017792 Oct 27 19:09:05.179969 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2353/4890] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:05 2022] GET /compute/v2.1/servers/dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:05.240745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-838987445", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "e7d83c6b-c0c0-42e5-b094-5dc26599221d"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:05.276264 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-93fd8f8d-d279-43bf-9ef3-f46f3358cbc0 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "PUT /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1074 microversion: 2.1 time: 0.176699 Oct 27 19:09:05.291718 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2538/4891] 10.222.0.42 () {60 vars in 1256 bytes} [Thu Oct 27 19:09:05 2022] PUT /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1074 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:05.311861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce348a56-8280-402e-9032-43351083cdbf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:05.314568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ce348a56-8280-402e-9032-43351083cdbf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:05.325753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce348a56-8280-402e-9032-43351083cdbf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:05.346836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] validate_networks() for [('e7d83c6b-c0c0-42e5-b094-5dc26599221d', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:09:05.347685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce348a56-8280-402e-9032-43351083cdbf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:05.348274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce348a56-8280-402e-9032-43351083cdbf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:05.349162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce348a56-8280-402e-9032-43351083cdbf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:05.349745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce348a56-8280-402e-9032-43351083cdbf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:05.350945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce348a56-8280-402e-9032-43351083cdbf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:05.654479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ce348a56-8280-402e-9032-43351083cdbf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:05.670366 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce348a56-8280-402e-9032-43351083cdbf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1500 microversion: 2.1 time: 0.377466 Oct 27 19:09:05.678531 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2539/4892] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:05 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1500 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:05.698992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fca3b73f-dd55-412e-aa20-8b07f207c0b7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:05.699968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fca3b73f-dd55-412e-aa20-8b07f207c0b7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:05.708602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fca3b73f-dd55-412e-aa20-8b07f207c0b7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:05.709450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fca3b73f-dd55-412e-aa20-8b07f207c0b7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:05.710160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fca3b73f-dd55-412e-aa20-8b07f207c0b7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:05.711377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fca3b73f-dd55-412e-aa20-8b07f207c0b7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:05.712243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fca3b73f-dd55-412e-aa20-8b07f207c0b7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:05.712946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fca3b73f-dd55-412e-aa20-8b07f207c0b7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:06.082827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fca3b73f-dd55-412e-aa20-8b07f207c0b7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:06.105620 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fca3b73f-dd55-412e-aa20-8b07f207c0b7 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1500 microversion: 2.1 time: 0.411450 Oct 27 19:09:06.107056 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2540/4893] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:05 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1500 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:06.131792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8063a799-f495-48f7-9d3c-c2e476b6aa3c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:06.138867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8063a799-f495-48f7-9d3c-c2e476b6aa3c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:06.139454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8063a799-f495-48f7-9d3c-c2e476b6aa3c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:06.139972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8063a799-f495-48f7-9d3c-c2e476b6aa3c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:06.186341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8063a799-f495-48f7-9d3c-c2e476b6aa3c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Going to try to stop instance {{(pid=127029) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 19:09:06.253362 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8063a799-f495-48f7-9d3c-c2e476b6aa3c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "POST /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285/action" status: 202 len: 0 microversion: 2.1 time: 0.127923 Oct 27 19:09:06.254492 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2541/4894] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:09:06 2022] POST /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:09:06.277213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ab4e4cfd-5b10-4290-915d-4733f74d68af tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:06.278276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ab4e4cfd-5b10-4290-915d-4733f74d68af tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:06.291480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab4e4cfd-5b10-4290-915d-4733f74d68af tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:06.292122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab4e4cfd-5b10-4290-915d-4733f74d68af tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:06.292743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab4e4cfd-5b10-4290-915d-4733f74d68af tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:06.293695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab4e4cfd-5b10-4290-915d-4733f74d68af tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:06.294230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab4e4cfd-5b10-4290-915d-4733f74d68af tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:06.294971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab4e4cfd-5b10-4290-915d-4733f74d68af tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:06.426226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ab4e4cfd-5b10-4290-915d-4733f74d68af tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:06.428824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:06.436800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ab4e4cfd-5b10-4290-915d-4733f74d68af tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:06.439169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ab4e4cfd-5b10-4290-915d-4733f74d68af tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:06.462311 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ab4e4cfd-5b10-4290-915d-4733f74d68af tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.206459 Oct 27 19:09:06.462942 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2542/4895] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:06 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:06.478533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-08b8e653-bdb6-4613-bd40-7f120e4b6aec tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:06.479164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-08b8e653-bdb6-4613-bd40-7f120e4b6aec tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:06.492174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08b8e653-bdb6-4613-bd40-7f120e4b6aec tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:06.492689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08b8e653-bdb6-4613-bd40-7f120e4b6aec tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:06.493125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08b8e653-bdb6-4613-bd40-7f120e4b6aec tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:06.493840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08b8e653-bdb6-4613-bd40-7f120e4b6aec tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:06.494299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08b8e653-bdb6-4613-bd40-7f120e4b6aec tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:06.494758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08b8e653-bdb6-4613-bd40-7f120e4b6aec tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:06.625360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:09:06.626582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:09:06.627310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:09:06.628063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:09:06.628660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:09:06.646075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:06.647000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:06.648538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:06.651939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:06.652718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:06.653395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:06.704667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Getting quotas for project 1798d878b8344ec69c9ef0699467718a. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:09:06.726226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Getting quotas for user b2237837d17c43e99f4e9961cd27cbb5 and project 1798d878b8344ec69c9ef0699467718a. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:09:06.738743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-08b8e653-bdb6-4613-bd40-7f120e4b6aec tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:06.749079 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-08b8e653-bdb6-4613-bd40-7f120e4b6aec tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 0.284280 Oct 27 19:09:06.750085 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2543/4896] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:06 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:06.755062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:09:06.757444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:09:06.777251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cafcf9d3-ce61-447f-bdfe-d0a4e211ed06 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:06.778968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cafcf9d3-ce61-447f-bdfe-d0a4e211ed06 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:06.800309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafcf9d3-ce61-447f-bdfe-d0a4e211ed06 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:06.800820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafcf9d3-ce61-447f-bdfe-d0a4e211ed06 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:06.803588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafcf9d3-ce61-447f-bdfe-d0a4e211ed06 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:06.806329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafcf9d3-ce61-447f-bdfe-d0a4e211ed06 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:06.808526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafcf9d3-ce61-447f-bdfe-d0a4e211ed06 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:06.809222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafcf9d3-ce61-447f-bdfe-d0a4e211ed06 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:06.835024 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-06702912-96cf-4134-b407-154fe5688896 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.598195 Oct 27 19:09:06.842050 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2354/4897] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:09:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 19:09:06.853507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-84282053-602f-42a0-b533-ea7b32d8625f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:06.854231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-84282053-602f-42a0-b533-ea7b32d8625f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:07.104131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cafcf9d3-ce61-447f-bdfe-d0a4e211ed06 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:07.117096 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cafcf9d3-ce61-447f-bdfe-d0a4e211ed06 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.365570 Oct 27 19:09:07.117697 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2544/4898] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:06 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:07.143693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-65f6afe5-dcda-428e-b145-f4a5ff156823 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:07.144853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-65f6afe5-dcda-428e-b145-f4a5ff156823 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:07.159200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65f6afe5-dcda-428e-b145-f4a5ff156823 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:07.160012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65f6afe5-dcda-428e-b145-f4a5ff156823 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:07.165008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65f6afe5-dcda-428e-b145-f4a5ff156823 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:07.166151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65f6afe5-dcda-428e-b145-f4a5ff156823 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:07.166832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65f6afe5-dcda-428e-b145-f4a5ff156823 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:07.167439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65f6afe5-dcda-428e-b145-f4a5ff156823 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:07.320540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-84282053-602f-42a0-b533-ea7b32d8625f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:07.332644 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-84282053-602f-42a0-b533-ea7b32d8625f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1214 microversion: 2.1 time: 0.483106 Oct 27 19:09:07.333925 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2355/4899] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:06 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1214 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:07.453751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-65f6afe5-dcda-428e-b145-f4a5ff156823 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:07.472307 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-65f6afe5-dcda-428e-b145-f4a5ff156823 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.336102 Oct 27 19:09:07.473191 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2545/4900] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:07 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:07.497445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c64e5ac3-0aa2-4a3a-90f6-36d643701c31 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:07.498223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c64e5ac3-0aa2-4a3a-90f6-36d643701c31 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:07.498675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f5b4942-1fca-4e79-81f3-df163c214ae0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:07.499498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0f5b4942-1fca-4e79-81f3-df163c214ae0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:07.512031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f5b4942-1fca-4e79-81f3-df163c214ae0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:07.512734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f5b4942-1fca-4e79-81f3-df163c214ae0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:07.513354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f5b4942-1fca-4e79-81f3-df163c214ae0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:07.514266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f5b4942-1fca-4e79-81f3-df163c214ae0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:07.514959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f5b4942-1fca-4e79-81f3-df163c214ae0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:07.516189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f5b4942-1fca-4e79-81f3-df163c214ae0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:07.527474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c64e5ac3-0aa2-4a3a-90f6-36d643701c31 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:07.533977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c64e5ac3-0aa2-4a3a-90f6-36d643701c31 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:07.534588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c64e5ac3-0aa2-4a3a-90f6-36d643701c31 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:07.535360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c64e5ac3-0aa2-4a3a-90f6-36d643701c31 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:07.535846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c64e5ac3-0aa2-4a3a-90f6-36d643701c31 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:07.539811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c64e5ac3-0aa2-4a3a-90f6-36d643701c31 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:07.647614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c64e5ac3-0aa2-4a3a-90f6-36d643701c31 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:07.658591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c64e5ac3-0aa2-4a3a-90f6-36d643701c31 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:07.660267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c64e5ac3-0aa2-4a3a-90f6-36d643701c31 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:07.666690 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c64e5ac3-0aa2-4a3a-90f6-36d643701c31 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.173323 Oct 27 19:09:07.667339 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2546/4901] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:07 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:07.777474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e06a6af5-43a1-4c33-ae35-3f1f5ef517cd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:07.779197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e06a6af5-43a1-4c33-ae35-3f1f5ef517cd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:07.789970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:07.797142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e06a6af5-43a1-4c33-ae35-3f1f5ef517cd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:07.799049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e06a6af5-43a1-4c33-ae35-3f1f5ef517cd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:07.802979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e06a6af5-43a1-4c33-ae35-3f1f5ef517cd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:07.806012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e06a6af5-43a1-4c33-ae35-3f1f5ef517cd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:07.806880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e06a6af5-43a1-4c33-ae35-3f1f5ef517cd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:07.809104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e06a6af5-43a1-4c33-ae35-3f1f5ef517cd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:07.923269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0f5b4942-1fca-4e79-81f3-df163c214ae0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:07.944315 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0f5b4942-1fca-4e79-81f3-df163c214ae0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.449733 Oct 27 19:09:07.959566 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2356/4902] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:07 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:07.981121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-64d8b42b-8812-4087-9186-c3c3b2b771af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-697613358"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:07.983773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-64d8b42b-8812-4087-9186-c3c3b2b771af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:08.008421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64d8b42b-8812-4087-9186-c3c3b2b771af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:08.016231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64d8b42b-8812-4087-9186-c3c3b2b771af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:08.016859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64d8b42b-8812-4087-9186-c3c3b2b771af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:08.017810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64d8b42b-8812-4087-9186-c3c3b2b771af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:08.021737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64d8b42b-8812-4087-9186-c3c3b2b771af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:08.022946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64d8b42b-8812-4087-9186-c3c3b2b771af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:08.229170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e06a6af5-43a1-4c33-ae35-3f1f5ef517cd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:08.240628 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e06a6af5-43a1-4c33-ae35-3f1f5ef517cd tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 0.467454 Oct 27 19:09:08.256409 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2547/4903] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:07 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:08.360714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-23218a52-1a87-45e1-aefe-5ee84d7c534c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:08.361353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-23218a52-1a87-45e1-aefe-5ee84d7c534c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:08.376417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23218a52-1a87-45e1-aefe-5ee84d7c534c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:08.376417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23218a52-1a87-45e1-aefe-5ee84d7c534c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:08.378979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23218a52-1a87-45e1-aefe-5ee84d7c534c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:08.379823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23218a52-1a87-45e1-aefe-5ee84d7c534c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:08.380312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23218a52-1a87-45e1-aefe-5ee84d7c534c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:08.380753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23218a52-1a87-45e1-aefe-5ee84d7c534c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:08.481794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:08.548238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-23218a52-1a87-45e1-aefe-5ee84d7c534c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:08.556414 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-64d8b42b-8812-4087-9186-c3c3b2b771af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.585799 Oct 27 19:09:08.557679 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2357/4904] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:09:07 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 27 19:09:08.590836 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-23218a52-1a87-45e1-aefe-5ee84d7c534c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1266 microversion: 2.1 time: 0.223649 Oct 27 19:09:08.607714 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2548/4905] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:08 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:08.705583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03fdf3a2-0545-4a1c-be26-33e1e1762fc9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:08.712317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-03fdf3a2-0545-4a1c-be26-33e1e1762fc9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:08.728742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03fdf3a2-0545-4a1c-be26-33e1e1762fc9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:08.731093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03fdf3a2-0545-4a1c-be26-33e1e1762fc9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:08.731691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03fdf3a2-0545-4a1c-be26-33e1e1762fc9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:08.732558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03fdf3a2-0545-4a1c-be26-33e1e1762fc9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:08.734803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03fdf3a2-0545-4a1c-be26-33e1e1762fc9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:08.735190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03fdf3a2-0545-4a1c-be26-33e1e1762fc9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:08.883050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-03fdf3a2-0545-4a1c-be26-33e1e1762fc9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:08.894310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-03fdf3a2-0545-4a1c-be26-33e1e1762fc9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:08.897648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-03fdf3a2-0545-4a1c-be26-33e1e1762fc9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:08.909758 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-03fdf3a2-0545-4a1c-be26-33e1e1762fc9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.213085 Oct 27 19:09:08.910357 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2358/4906] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:08 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:09.268137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8d63d4eb-fec1-4ae4-9771-fcd19180a2b5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:09.269544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8d63d4eb-fec1-4ae4-9771-fcd19180a2b5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:09.275987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d63d4eb-fec1-4ae4-9771-fcd19180a2b5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:09.276753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d63d4eb-fec1-4ae4-9771-fcd19180a2b5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:09.277428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d63d4eb-fec1-4ae4-9771-fcd19180a2b5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:09.278374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d63d4eb-fec1-4ae4-9771-fcd19180a2b5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:09.279070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d63d4eb-fec1-4ae4-9771-fcd19180a2b5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:09.279844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d63d4eb-fec1-4ae4-9771-fcd19180a2b5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:09.526096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8d63d4eb-fec1-4ae4-9771-fcd19180a2b5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:09.542420 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8d63d4eb-fec1-4ae4-9771-fcd19180a2b5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 0.278211 Oct 27 19:09:09.544188 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2549/4907] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:09 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:09.622583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-89c01f86-9f2a-489b-999c-1aa03de0a2c6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:09.625466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-89c01f86-9f2a-489b-999c-1aa03de0a2c6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:09.640904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89c01f86-9f2a-489b-999c-1aa03de0a2c6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:09.643865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89c01f86-9f2a-489b-999c-1aa03de0a2c6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:09.644568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89c01f86-9f2a-489b-999c-1aa03de0a2c6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:09.645527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89c01f86-9f2a-489b-999c-1aa03de0a2c6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:09.647283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89c01f86-9f2a-489b-999c-1aa03de0a2c6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:09.647975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89c01f86-9f2a-489b-999c-1aa03de0a2c6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:09.941305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5c228f98-9298-496e-b8f3-cebc209b393f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:09.945266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5c228f98-9298-496e-b8f3-cebc209b393f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:09.958611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c228f98-9298-496e-b8f3-cebc209b393f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:09.959631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c228f98-9298-496e-b8f3-cebc209b393f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:09.963369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c228f98-9298-496e-b8f3-cebc209b393f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:09.965005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c228f98-9298-496e-b8f3-cebc209b393f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:09.965728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c228f98-9298-496e-b8f3-cebc209b393f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:09.966426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c228f98-9298-496e-b8f3-cebc209b393f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:10.181873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-89c01f86-9f2a-489b-999c-1aa03de0a2c6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:10.204929 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-89c01f86-9f2a-489b-999c-1aa03de0a2c6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1314 microversion: 2.1 time: 0.588330 Oct 27 19:09:10.210212 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2359/4908] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:09 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:10.311650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5c228f98-9298-496e-b8f3-cebc209b393f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:10.342586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5c228f98-9298-496e-b8f3-cebc209b393f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:10.352768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5c228f98-9298-496e-b8f3-cebc209b393f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:10.371728 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5c228f98-9298-496e-b8f3-cebc209b393f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.436628 Oct 27 19:09:10.379606 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2550/4909] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:09 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:10.384327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc51c3a6-40fc-4bf2-82c9-3a4d91dad41e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:10.386703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fc51c3a6-40fc-4bf2-82c9-3a4d91dad41e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:10.408310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc51c3a6-40fc-4bf2-82c9-3a4d91dad41e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:10.408989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc51c3a6-40fc-4bf2-82c9-3a4d91dad41e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:10.409642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc51c3a6-40fc-4bf2-82c9-3a4d91dad41e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:10.414265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc51c3a6-40fc-4bf2-82c9-3a4d91dad41e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:10.417012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc51c3a6-40fc-4bf2-82c9-3a4d91dad41e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:10.419893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc51c3a6-40fc-4bf2-82c9-3a4d91dad41e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:10.487654 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc51c3a6-40fc-4bf2-82c9-3a4d91dad41e tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.107595 Oct 27 19:09:10.488294 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2360/4910] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 19:09:10 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:10.568801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a90611c2-e2ea-43e3-a17e-d00fb949b325 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:10.569484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a90611c2-e2ea-43e3-a17e-d00fb949b325 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:10.593236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a90611c2-e2ea-43e3-a17e-d00fb949b325 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:10.615002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a90611c2-e2ea-43e3-a17e-d00fb949b325 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:10.615510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a90611c2-e2ea-43e3-a17e-d00fb949b325 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:10.621541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a90611c2-e2ea-43e3-a17e-d00fb949b325 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:10.622066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a90611c2-e2ea-43e3-a17e-d00fb949b325 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:10.628850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a90611c2-e2ea-43e3-a17e-d00fb949b325 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:10.659755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-527c5701-49a8-4de6-a169-1fc0b533d0ee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:10.660314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-527c5701-49a8-4de6-a169-1fc0b533d0ee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:10.670889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-527c5701-49a8-4de6-a169-1fc0b533d0ee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:10.671385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-527c5701-49a8-4de6-a169-1fc0b533d0ee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:10.672503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-527c5701-49a8-4de6-a169-1fc0b533d0ee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:10.673248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-527c5701-49a8-4de6-a169-1fc0b533d0ee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:10.677180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-527c5701-49a8-4de6-a169-1fc0b533d0ee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:10.677668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-527c5701-49a8-4de6-a169-1fc0b533d0ee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:10.744020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-527c5701-49a8-4de6-a169-1fc0b533d0ee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:09:11.037065 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-527c5701-49a8-4de6-a169-1fc0b533d0ee tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "DELETE /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 204 len: 0 microversion: 2.20 time: 0.382598 Oct 27 19:09:11.038140 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2361/4911] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 19:09:10 2022] DELETE /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:09:11.060441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-356d78d8-efb3-4d13-8b77-d7a18b9d1cc1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:11.061506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-356d78d8-efb3-4d13-8b77-d7a18b9d1cc1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:11.081022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-356d78d8-efb3-4d13-8b77-d7a18b9d1cc1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:11.081861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-356d78d8-efb3-4d13-8b77-d7a18b9d1cc1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:11.082670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-356d78d8-efb3-4d13-8b77-d7a18b9d1cc1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:11.083750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-356d78d8-efb3-4d13-8b77-d7a18b9d1cc1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:11.084382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-356d78d8-efb3-4d13-8b77-d7a18b9d1cc1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:11.085021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-356d78d8-efb3-4d13-8b77-d7a18b9d1cc1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:11.140535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a90611c2-e2ea-43e3-a17e-d00fb949b325 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:11.158831 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a90611c2-e2ea-43e3-a17e-d00fb949b325 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 0.594582 Oct 27 19:09:11.166187 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2551/4912] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:10 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:11.230860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f1e30266-a2db-485d-848f-6475abbf365c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:11.231468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f1e30266-a2db-485d-848f-6475abbf365c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:11.255800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1e30266-a2db-485d-848f-6475abbf365c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:11.259338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1e30266-a2db-485d-848f-6475abbf365c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:11.260228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1e30266-a2db-485d-848f-6475abbf365c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:11.265861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1e30266-a2db-485d-848f-6475abbf365c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:11.267090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1e30266-a2db-485d-848f-6475abbf365c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:11.267794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1e30266-a2db-485d-848f-6475abbf365c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:11.584134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-356d78d8-efb3-4d13-8b77-d7a18b9d1cc1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:11.593801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-356d78d8-efb3-4d13-8b77-d7a18b9d1cc1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:11.604467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-356d78d8-efb3-4d13-8b77-d7a18b9d1cc1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:11.605784 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-356d78d8-efb3-4d13-8b77-d7a18b9d1cc1 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1725 microversion: 2.20 time: 0.563454 Oct 27 19:09:11.606371 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2362/4913] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:11 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1725 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:09:11.624135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f36d18a2-0807-49ce-9542-c06d5c4e5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:11.624806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f36d18a2-0807-49ce-9542-c06d5c4e5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:11.645729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f36d18a2-0807-49ce-9542-c06d5c4e5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:11.646245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f36d18a2-0807-49ce-9542-c06d5c4e5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:11.646833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f36d18a2-0807-49ce-9542-c06d5c4e5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:11.647443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f36d18a2-0807-49ce-9542-c06d5c4e5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:11.647911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f36d18a2-0807-49ce-9542-c06d5c4e5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:11.649002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f36d18a2-0807-49ce-9542-c06d5c4e5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:11.818710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f36d18a2-0807-49ce-9542-c06d5c4e5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:11.832419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f36d18a2-0807-49ce-9542-c06d5c4e5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:11.837791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f36d18a2-0807-49ce-9542-c06d5c4e5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:11.852690 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f36d18a2-0807-49ce-9542-c06d5c4e5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.244172 Oct 27 19:09:11.853317 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2363/4914] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:11 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:11.951119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f1e30266-a2db-485d-848f-6475abbf365c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:11.959850 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f1e30266-a2db-485d-848f-6475abbf365c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1314 microversion: 2.1 time: 0.733125 Oct 27 19:09:11.960432 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2552/4915] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:11 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1314 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:12.189579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-303199ea-8cd5-4f43-9e9a-9ca62145b4b8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:12.190487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-303199ea-8cd5-4f43-9e9a-9ca62145b4b8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:12.203609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-303199ea-8cd5-4f43-9e9a-9ca62145b4b8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:12.204480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-303199ea-8cd5-4f43-9e9a-9ca62145b4b8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:12.207498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-303199ea-8cd5-4f43-9e9a-9ca62145b4b8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:12.208428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-303199ea-8cd5-4f43-9e9a-9ca62145b4b8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:12.209093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-303199ea-8cd5-4f43-9e9a-9ca62145b4b8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:12.211869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-303199ea-8cd5-4f43-9e9a-9ca62145b4b8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:12.637241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bb5e63c5-8bfb-4b69-a43e-58192a66d590 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:12.638013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bb5e63c5-8bfb-4b69-a43e-58192a66d590 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:12.651237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb5e63c5-8bfb-4b69-a43e-58192a66d590 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:12.651744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb5e63c5-8bfb-4b69-a43e-58192a66d590 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:12.652188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb5e63c5-8bfb-4b69-a43e-58192a66d590 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:12.657648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb5e63c5-8bfb-4b69-a43e-58192a66d590 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:12.658343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb5e63c5-8bfb-4b69-a43e-58192a66d590 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:12.659074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bb5e63c5-8bfb-4b69-a43e-58192a66d590 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:12.847357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-303199ea-8cd5-4f43-9e9a-9ca62145b4b8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:12.888564 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-303199ea-8cd5-4f43-9e9a-9ca62145b4b8 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 0.701753 Oct 27 19:09:12.892651 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2364/4916] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:12 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:12.912448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6ed78a4a-26c4-4a6a-8cb1-dcff086b60f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:12.913088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6ed78a4a-26c4-4a6a-8cb1-dcff086b60f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:12.942450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ed78a4a-26c4-4a6a-8cb1-dcff086b60f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:12.943037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ed78a4a-26c4-4a6a-8cb1-dcff086b60f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:12.943506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ed78a4a-26c4-4a6a-8cb1-dcff086b60f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:12.950071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ed78a4a-26c4-4a6a-8cb1-dcff086b60f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:12.954705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ed78a4a-26c4-4a6a-8cb1-dcff086b60f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:12.955190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ed78a4a-26c4-4a6a-8cb1-dcff086b60f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:13.268719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bb5e63c5-8bfb-4b69-a43e-58192a66d590 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:13.288337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bb5e63c5-8bfb-4b69-a43e-58192a66d590 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:13.289838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bb5e63c5-8bfb-4b69-a43e-58192a66d590 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:13.291113 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bb5e63c5-8bfb-4b69-a43e-58192a66d590 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1725 microversion: 2.20 time: 0.658353 Oct 27 19:09:13.292286 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2553/4917] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:12 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1725 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:09:13.298922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-41c5ca18-d516-49dc-b577-b736fcdd53e2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:13.303178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-41c5ca18-d516-49dc-b577-b736fcdd53e2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:13.318250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41c5ca18-d516-49dc-b577-b736fcdd53e2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:13.321407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41c5ca18-d516-49dc-b577-b736fcdd53e2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:13.321938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41c5ca18-d516-49dc-b577-b736fcdd53e2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:13.322872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41c5ca18-d516-49dc-b577-b736fcdd53e2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:13.326929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41c5ca18-d516-49dc-b577-b736fcdd53e2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:13.327510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41c5ca18-d516-49dc-b577-b736fcdd53e2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:13.367078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6ed78a4a-26c4-4a6a-8cb1-dcff086b60f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:13.380706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6ed78a4a-26c4-4a6a-8cb1-dcff086b60f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:13.382182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6ed78a4a-26c4-4a6a-8cb1-dcff086b60f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:13.418264 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6ed78a4a-26c4-4a6a-8cb1-dcff086b60f0 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.524125 Oct 27 19:09:13.419387 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2365/4918] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:12 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:13.428853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b5169ad7-dce0-478a-b62c-0eea9b3b1afe req-b6283f51-3369-4fe3-9d84-c7b994298a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8", "tag": "dd5f1313-7b8e-4573-a85e-6358373b6e86"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:13.439521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b5169ad7-dce0-478a-b62c-0eea9b3b1afe req-b6283f51-3369-4fe3-9d84-c7b994298a38 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:13.440027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b5169ad7-dce0-478a-b62c-0eea9b3b1afe req-b6283f51-3369-4fe3-9d84-c7b994298a38 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:13.440518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b5169ad7-dce0-478a-b62c-0eea9b3b1afe req-b6283f51-3369-4fe3-9d84-c7b994298a38 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:13.463229 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b5169ad7-dce0-478a-b62c-0eea9b3b1afe req-b6283f51-3369-4fe3-9d84-c7b994298a38 service nova] Creating event network-changed:dd5f1313-7b8e-4573-a85e-6358373b6e86 for instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 on n-h1-860687-3 Oct 27 19:09:13.479472 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b5169ad7-dce0-478a-b62c-0eea9b3b1afe req-b6283f51-3369-4fe3-9d84-c7b994298a38 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058757 Oct 27 19:09:13.480151 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2366/4919] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:09:13.915079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e0801a5-5717-411f-8f70-23bf6232f9ca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:13.915803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9e0801a5-5717-411f-8f70-23bf6232f9ca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:13.934164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e0801a5-5717-411f-8f70-23bf6232f9ca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:13.946796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e0801a5-5717-411f-8f70-23bf6232f9ca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:13.947591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e0801a5-5717-411f-8f70-23bf6232f9ca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:13.948562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e0801a5-5717-411f-8f70-23bf6232f9ca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:13.949239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e0801a5-5717-411f-8f70-23bf6232f9ca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:13.956690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e0801a5-5717-411f-8f70-23bf6232f9ca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:14.025430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-41c5ca18-d516-49dc-b577-b736fcdd53e2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:14.038156 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-41c5ca18-d516-49dc-b577-b736fcdd53e2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1314 microversion: 2.1 time: 0.744032 Oct 27 19:09:14.048572 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2554/4920] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:13 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1314 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:14.323497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-456319ab-12db-4c7b-9b45-5d1f2a8602ff tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:14.324146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-456319ab-12db-4c7b-9b45-5d1f2a8602ff tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:14.341265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-456319ab-12db-4c7b-9b45-5d1f2a8602ff tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:14.341794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-456319ab-12db-4c7b-9b45-5d1f2a8602ff tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:14.342254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-456319ab-12db-4c7b-9b45-5d1f2a8602ff tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:14.348634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-456319ab-12db-4c7b-9b45-5d1f2a8602ff tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:14.349135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-456319ab-12db-4c7b-9b45-5d1f2a8602ff tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:14.349593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-456319ab-12db-4c7b-9b45-5d1f2a8602ff tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:14.836806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:14.980188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9e0801a5-5717-411f-8f70-23bf6232f9ca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:15.000520 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9e0801a5-5717-411f-8f70-23bf6232f9ca tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 1.090545 Oct 27 19:09:15.006915 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2367/4921] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:13 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:15.021757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5b479dee-00c0-4b3b-a916-435734014dab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:15.026919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5b479dee-00c0-4b3b-a916-435734014dab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:15.049196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b479dee-00c0-4b3b-a916-435734014dab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:15.056852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b479dee-00c0-4b3b-a916-435734014dab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:15.062654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b479dee-00c0-4b3b-a916-435734014dab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:15.064002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b479dee-00c0-4b3b-a916-435734014dab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:15.064560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b479dee-00c0-4b3b-a916-435734014dab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:15.076550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b479dee-00c0-4b3b-a916-435734014dab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:15.381514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5b479dee-00c0-4b3b-a916-435734014dab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:15.395260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5b479dee-00c0-4b3b-a916-435734014dab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:15.403157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5b479dee-00c0-4b3b-a916-435734014dab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:15.420114 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5b479dee-00c0-4b3b-a916-435734014dab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1558 microversion: 2.91 time: 0.411834 Oct 27 19:09:15.426430 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2368/4922] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:15 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1558 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:15.441625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-12378d52-e6ee-4f86-bd8c-cb3b9999d724 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:15.442267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-12378d52-e6ee-4f86-bd8c-cb3b9999d724 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:15.466431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12378d52-e6ee-4f86-bd8c-cb3b9999d724 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:15.466950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12378d52-e6ee-4f86-bd8c-cb3b9999d724 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:15.473088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12378d52-e6ee-4f86-bd8c-cb3b9999d724 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:15.473907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12378d52-e6ee-4f86-bd8c-cb3b9999d724 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:15.474417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12378d52-e6ee-4f86-bd8c-cb3b9999d724 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:15.474904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12378d52-e6ee-4f86-bd8c-cb3b9999d724 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:15.763611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-456319ab-12db-4c7b-9b45-5d1f2a8602ff tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:15.779936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-456319ab-12db-4c7b-9b45-5d1f2a8602ff tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:15.785060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-456319ab-12db-4c7b-9b45-5d1f2a8602ff tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:15.789580 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-456319ab-12db-4c7b-9b45-5d1f2a8602ff tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1725 microversion: 2.20 time: 1.470210 Oct 27 19:09:15.802889 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2555/4923] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:14 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1725 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:15.820339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5fe7e966-9045-43ad-a8b9-d6c812ad253d req-9f4be0df-1685-42fe-a86d-ea7cffca788c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c", "name": "network-vif-plugged", "status": "completed", "tag": "80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:15.845494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5fe7e966-9045-43ad-a8b9-d6c812ad253d req-9f4be0df-1685-42fe-a86d-ea7cffca788c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:15.847981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5fe7e966-9045-43ad-a8b9-d6c812ad253d req-9f4be0df-1685-42fe-a86d-ea7cffca788c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:15.850643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5fe7e966-9045-43ad-a8b9-d6c812ad253d req-9f4be0df-1685-42fe-a86d-ea7cffca788c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:15.879891 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5fe7e966-9045-43ad-a8b9-d6c812ad253d req-9f4be0df-1685-42fe-a86d-ea7cffca788c service nova] Creating event network-vif-plugged:80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4 for instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c on n-h1-860687-3 Oct 27 19:09:15.890759 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5fe7e966-9045-43ad-a8b9-d6c812ad253d req-9f4be0df-1685-42fe-a86d-ea7cffca788c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080959 Oct 27 19:09:15.894537 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2556/4924] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:09:16.034045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a9a9d1f0-668c-44bb-be37-b5847fc642f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:16.034889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a9a9d1f0-668c-44bb-be37-b5847fc642f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:16.052262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9a9d1f0-668c-44bb-be37-b5847fc642f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:16.059390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9a9d1f0-668c-44bb-be37-b5847fc642f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:16.061238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9a9d1f0-668c-44bb-be37-b5847fc642f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:16.062284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9a9d1f0-668c-44bb-be37-b5847fc642f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:16.062914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9a9d1f0-668c-44bb-be37-b5847fc642f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:16.075377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9a9d1f0-668c-44bb-be37-b5847fc642f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:16.423978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-12378d52-e6ee-4f86-bd8c-cb3b9999d724 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:16.437843 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-12378d52-e6ee-4f86-bd8c-cb3b9999d724 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1314 microversion: 2.1 time: 1.010103 Oct 27 19:09:16.454493 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2369/4925] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:15 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1314 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:16.465065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d906ccb-c2b4-4b39-a0dd-3f4e2942b451 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:16.465629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9d906ccb-c2b4-4b39-a0dd-3f4e2942b451 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:16.481636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d906ccb-c2b4-4b39-a0dd-3f4e2942b451 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:16.482680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d906ccb-c2b4-4b39-a0dd-3f4e2942b451 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:16.483418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d906ccb-c2b4-4b39-a0dd-3f4e2942b451 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:16.485137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d906ccb-c2b4-4b39-a0dd-3f4e2942b451 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:16.486036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d906ccb-c2b4-4b39-a0dd-3f4e2942b451 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:16.487615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d906ccb-c2b4-4b39-a0dd-3f4e2942b451 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:16.573434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a9a9d1f0-668c-44bb-be37-b5847fc642f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:16.586197 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a9a9d1f0-668c-44bb-be37-b5847fc642f4 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 0.556664 Oct 27 19:09:16.597407 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2557/4926] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:16 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:16.673954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:16.818398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5e976ef6-cdf5-4df6-9fe2-07f457c239c0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:16.819212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5e976ef6-cdf5-4df6-9fe2-07f457c239c0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:16.833185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e976ef6-cdf5-4df6-9fe2-07f457c239c0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:16.835070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e976ef6-cdf5-4df6-9fe2-07f457c239c0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:16.838964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e976ef6-cdf5-4df6-9fe2-07f457c239c0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:16.841853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e976ef6-cdf5-4df6-9fe2-07f457c239c0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:16.845111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e976ef6-cdf5-4df6-9fe2-07f457c239c0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:16.845725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e976ef6-cdf5-4df6-9fe2-07f457c239c0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:17.040031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d906ccb-c2b4-4b39-a0dd-3f4e2942b451 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:17.059170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d906ccb-c2b4-4b39-a0dd-3f4e2942b451 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:17.061020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d906ccb-c2b4-4b39-a0dd-3f4e2942b451 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:17.078295 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9d906ccb-c2b4-4b39-a0dd-3f4e2942b451 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1558 microversion: 2.91 time: 0.625855 Oct 27 19:09:17.083902 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2370/4927] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:16 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1558 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:17.114785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5e976ef6-cdf5-4df6-9fe2-07f457c239c0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:17.128781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5e976ef6-cdf5-4df6-9fe2-07f457c239c0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:17.133814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5e976ef6-cdf5-4df6-9fe2-07f457c239c0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '434e7a9a50b340928126550ed66c5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4798756472413683fb46917781e89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:17.136613 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5e976ef6-cdf5-4df6-9fe2-07f457c239c0 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 200 len: 1657 microversion: 2.20 time: 0.322846 Oct 27 19:09:17.140975 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2558/4928] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:16 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 1657 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:09:17.469905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6e5d56d2-64c2-4825-86df-d43f10a5e699 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:17.471204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6e5d56d2-64c2-4825-86df-d43f10a5e699 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:17.502116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=14 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:17.505103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:17.515997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e5d56d2-64c2-4825-86df-d43f10a5e699 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:17.516560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e5d56d2-64c2-4825-86df-d43f10a5e699 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:17.517035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e5d56d2-64c2-4825-86df-d43f10a5e699 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:17.517788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e5d56d2-64c2-4825-86df-d43f10a5e699 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:17.518259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e5d56d2-64c2-4825-86df-d43f10a5e699 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:17.529691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e5d56d2-64c2-4825-86df-d43f10a5e699 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:17.626237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-47f71ff6-7b5b-4d55-b055-fab3d170025e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:17.626902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-47f71ff6-7b5b-4d55-b055-fab3d170025e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:17.646410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47f71ff6-7b5b-4d55-b055-fab3d170025e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:17.647034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47f71ff6-7b5b-4d55-b055-fab3d170025e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:17.647548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47f71ff6-7b5b-4d55-b055-fab3d170025e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:17.648376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47f71ff6-7b5b-4d55-b055-fab3d170025e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:17.662188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47f71ff6-7b5b-4d55-b055-fab3d170025e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:17.662903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47f71ff6-7b5b-4d55-b055-fab3d170025e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:19.117055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-47f71ff6-7b5b-4d55-b055-fab3d170025e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:19.129404 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-47f71ff6-7b5b-4d55-b055-fab3d170025e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 1.510826 Oct 27 19:09:19.144210 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2559/4929] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:17 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:19.155225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-c9068299-1ade-4952-b5d2-e1e28031dc96 req-99e37983-33ff-4ba6-b045-437154f983e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b128ff-a00c-4607-8088-1988263fbe79", "name": "network-vif-deleted", "tag": "2beafeb2-d863-4916-9b9f-2b9876bdf5ff"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:19.189298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c9068299-1ade-4952-b5d2-e1e28031dc96 req-99e37983-33ff-4ba6-b045-437154f983e3 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:19.195177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c9068299-1ade-4952-b5d2-e1e28031dc96 req-99e37983-33ff-4ba6-b045-437154f983e3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:19.196002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c9068299-1ade-4952-b5d2-e1e28031dc96 req-99e37983-33ff-4ba6-b045-437154f983e3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:19.200949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:19.239400 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-c9068299-1ade-4952-b5d2-e1e28031dc96 req-99e37983-33ff-4ba6-b045-437154f983e3 service nova] Creating event network-vif-deleted:2beafeb2-d863-4916-9b9f-2b9876bdf5ff for instance 96b128ff-a00c-4607-8088-1988263fbe79 on n-h2-860687-3 Oct 27 19:09:19.269445 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-c9068299-1ade-4952-b5d2-e1e28031dc96 req-99e37983-33ff-4ba6-b045-437154f983e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123237 Oct 27 19:09:19.270725 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2560/4930] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:09:19.276112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-519906a5-6a61-4af3-8389-f1d20df8b783 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:19.283791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-519906a5-6a61-4af3-8389-f1d20df8b783 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:19.295662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-519906a5-6a61-4af3-8389-f1d20df8b783 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:19.296470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-519906a5-6a61-4af3-8389-f1d20df8b783 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:19.297179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-519906a5-6a61-4af3-8389-f1d20df8b783 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:19.298674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-519906a5-6a61-4af3-8389-f1d20df8b783 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:19.299315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-519906a5-6a61-4af3-8389-f1d20df8b783 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:19.300271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-519906a5-6a61-4af3-8389-f1d20df8b783 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:19.421157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-519906a5-6a61-4af3-8389-f1d20df8b783 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:19.436334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-519906a5-6a61-4af3-8389-f1d20df8b783 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:19.439769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-519906a5-6a61-4af3-8389-f1d20df8b783 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:19.452438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6e5d56d2-64c2-4825-86df-d43f10a5e699 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:19.470257 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6e5d56d2-64c2-4825-86df-d43f10a5e699 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1314 microversion: 2.1 time: 2.005453 Oct 27 19:09:19.471675 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-519906a5-6a61-4af3-8389-f1d20df8b783 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1558 microversion: 2.91 time: 0.199409 Oct 27 19:09:19.474364 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2561/4931] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:19 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1558 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:19.483660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-34d9a210-fccd-4220-8008-8fdcfa1f9462 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:19.485785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-34d9a210-fccd-4220-8008-8fdcfa1f9462 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:19.489879 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2371/4932] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:17 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1314 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:19.512158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d9a210-fccd-4220-8008-8fdcfa1f9462 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:19.517912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d9a210-fccd-4220-8008-8fdcfa1f9462 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:19.519080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d9a210-fccd-4220-8008-8fdcfa1f9462 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:19.523354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d9a210-fccd-4220-8008-8fdcfa1f9462 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:19.524727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d9a210-fccd-4220-8008-8fdcfa1f9462 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:19.527919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d9a210-fccd-4220-8008-8fdcfa1f9462 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:19.567949 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-34d9a210-fccd-4220-8008-8fdcfa1f9462 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] HTTP exception thrown: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-34d9a210-fccd-4220-8008-8fdcfa1f9462 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Request method failure captured: Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 HTTP/1.1 Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtUUQyB6SOBVl-52U3dSziCl2YsU9ZgNNncrnhwIfxoSAofDzyZtVZEEpgkoaInknyIkrELp2G0Dir7G4OIR7s5DCkQnHvpSlonGokmFZL4OaHeeaiW_SVJEXEEBQj50879mm2-37qYzpjAgmfGPKFeq8vL_BkbLbyi352o1GqN2xk8 Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ab4798756472413683fb46917781e89f Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab4798756472413683fb46917781e89f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab4798756472413683fb46917781e89f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab4798756472413683fb46917781e89f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab4798756472413683fb46917781e89f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ab4798756472413683fb46917781e89f Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeShelveTestJSON-1562836379-project Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 434e7a9a50b340928126550ed66c5590 Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1562836379-project Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '96b128ff-a00c-4607-8088-1988263fbe79'} Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:19.576661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:19.581608 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:19.581608 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:19.581608 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:19.581608 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:19.581608 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:19.581608 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:19.581608 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:19.581608 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:19.599334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-34d9a210-fccd-4220-8008-8fdcfa1f9462 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Returning 404 to user: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:19.600736 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-34d9a210-fccd-4220-8008-8fdcfa1f9462 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 404 len: 111 microversion: 2.20 time: 0.123989 Oct 27 19:09:19.604125 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2562/4933] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:19 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:09:19.642805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-477b3196-57ee-4a12-aa3c-c7b635979cfe tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '.version_select at 0x7fc869a36c10>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:19.663064 n-d-860687-3 devstack@n-api.service[127028]: ERROR oslo.messaging._drivers.impl_rabbit [None req-477b3196-57ee-4a12-aa3c-c7b635979cfe tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [ae950e16-18c6-472e-bd09-615816b04be5] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 19:09:20.153833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d8e87dc-9502-41f8-a89d-246ace5fe23c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:20.155471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0d8e87dc-9502-41f8-a89d-246ace5fe23c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:20.179142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d8e87dc-9502-41f8-a89d-246ace5fe23c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:20.179784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d8e87dc-9502-41f8-a89d-246ace5fe23c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:20.193648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d8e87dc-9502-41f8-a89d-246ace5fe23c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:20.194399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d8e87dc-9502-41f8-a89d-246ace5fe23c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:20.194902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d8e87dc-9502-41f8-a89d-246ace5fe23c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:20.195363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d8e87dc-9502-41f8-a89d-246ace5fe23c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:20.672510 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [None req-477b3196-57ee-4a12-aa3c-c7b635979cfe tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [ae950e16-18c6-472e-bd09-615816b04be5] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 57922. Oct 27 19:09:20.673371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0d8e87dc-9502-41f8-a89d-246ace5fe23c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:20.690423 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0d8e87dc-9502-41f8-a89d-246ace5fe23c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 0.537376 Oct 27 19:09:20.710533 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2563/4934] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:20 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:20.720963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-62aadc27-1873-4408-a56d-72e234277ed7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:20.722921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-62aadc27-1873-4408-a56d-72e234277ed7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:20.731707 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-477b3196-57ee-4a12-aa3c-c7b635979cfe tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017511835" status: 204 len: 0 microversion: 2.20 time: 1.121609 Oct 27 19:09:20.739292 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2372/4935] 10.222.0.42 () {60 vars in 1262 bytes} [Thu Oct 27 19:09:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017511835 => generated 0 bytes in 1130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:09:20.740089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62aadc27-1873-4408-a56d-72e234277ed7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:20.740849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62aadc27-1873-4408-a56d-72e234277ed7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:20.741471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62aadc27-1873-4408-a56d-72e234277ed7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:20.756042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62aadc27-1873-4408-a56d-72e234277ed7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:20.759833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62aadc27-1873-4408-a56d-72e234277ed7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:20.760844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-030da75b-301c-4340-b6bd-f0a57fccbf2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:20.761604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-030da75b-301c-4340-b6bd-f0a57fccbf2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:20.763099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62aadc27-1873-4408-a56d-72e234277ed7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:20.793969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-030da75b-301c-4340-b6bd-f0a57fccbf2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:20.794510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-030da75b-301c-4340-b6bd-f0a57fccbf2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:20.794966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-030da75b-301c-4340-b6bd-f0a57fccbf2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:20.795698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-030da75b-301c-4340-b6bd-f0a57fccbf2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:20.796166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-030da75b-301c-4340-b6bd-f0a57fccbf2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:20.819755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-030da75b-301c-4340-b6bd-f0a57fccbf2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:21.406621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-030da75b-301c-4340-b6bd-f0a57fccbf2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:21.425709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-030da75b-301c-4340-b6bd-f0a57fccbf2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:21.429475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-030da75b-301c-4340-b6bd-f0a57fccbf2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:21.444181 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-030da75b-301c-4340-b6bd-f0a57fccbf2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.700524 Oct 27 19:09:21.446595 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2373/4936] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:20 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:21.721591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1160e81a-ac29-4789-aecd-71a5e3024293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:21.723265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1160e81a-ac29-4789-aecd-71a5e3024293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:21.758675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1160e81a-ac29-4789-aecd-71a5e3024293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:21.759610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1160e81a-ac29-4789-aecd-71a5e3024293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:21.761004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1160e81a-ac29-4789-aecd-71a5e3024293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:21.764632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1160e81a-ac29-4789-aecd-71a5e3024293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:21.768438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1160e81a-ac29-4789-aecd-71a5e3024293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:21.769212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1160e81a-ac29-4789-aecd-71a5e3024293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:21.795784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:22.455052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-62aadc27-1873-4408-a56d-72e234277ed7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:22.468596 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-62aadc27-1873-4408-a56d-72e234277ed7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1314 microversion: 2.1 time: 1.755833 Oct 27 19:09:22.469219 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2564/4937] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:20 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1314 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:22.483276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f15bdb2f-655a-4a23-bd63-9f44ee6ff5e9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:22.487339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f15bdb2f-655a-4a23-bd63-9f44ee6ff5e9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:22.511849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f15bdb2f-655a-4a23-bd63-9f44ee6ff5e9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:22.515829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f15bdb2f-655a-4a23-bd63-9f44ee6ff5e9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:22.516425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f15bdb2f-655a-4a23-bd63-9f44ee6ff5e9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:22.520607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f15bdb2f-655a-4a23-bd63-9f44ee6ff5e9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:22.521119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f15bdb2f-655a-4a23-bd63-9f44ee6ff5e9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:22.521573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f15bdb2f-655a-4a23-bd63-9f44ee6ff5e9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:22.787601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f15bdb2f-655a-4a23-bd63-9f44ee6ff5e9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:22.798372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f15bdb2f-655a-4a23-bd63-9f44ee6ff5e9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:22.808002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f15bdb2f-655a-4a23-bd63-9f44ee6ff5e9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:22.823232 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f15bdb2f-655a-4a23-bd63-9f44ee6ff5e9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.337898 Oct 27 19:09:22.824462 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2565/4938] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:22 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:09:22.897664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1160e81a-ac29-4789-aecd-71a5e3024293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:22.917567 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1160e81a-ac29-4789-aecd-71a5e3024293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 1.203763 Oct 27 19:09:22.924013 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2374/4939] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:21 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:23.498068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b07802f0-0dec-4999-980e-a1424e98c150 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:23.498658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b07802f0-0dec-4999-980e-a1424e98c150 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:23.520275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b07802f0-0dec-4999-980e-a1424e98c150 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:23.520791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b07802f0-0dec-4999-980e-a1424e98c150 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:23.521241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b07802f0-0dec-4999-980e-a1424e98c150 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:23.521972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b07802f0-0dec-4999-980e-a1424e98c150 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:23.522589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b07802f0-0dec-4999-980e-a1424e98c150 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:23.523030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b07802f0-0dec-4999-980e-a1424e98c150 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:23.821982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b07802f0-0dec-4999-980e-a1424e98c150 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:23.832166 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b07802f0-0dec-4999-980e-a1424e98c150 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1314 microversion: 2.1 time: 0.337899 Oct 27 19:09:23.843464 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2566/4940] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:23 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:23.861372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b1a05ace-450b-4972-9225-d40ac8dd42ed tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:23.862299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b1a05ace-450b-4972-9225-d40ac8dd42ed tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:23.877591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1a05ace-450b-4972-9225-d40ac8dd42ed tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:23.878105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1a05ace-450b-4972-9225-d40ac8dd42ed tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:23.878599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1a05ace-450b-4972-9225-d40ac8dd42ed tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:23.879400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1a05ace-450b-4972-9225-d40ac8dd42ed tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:23.879868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1a05ace-450b-4972-9225-d40ac8dd42ed tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:23.880408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1a05ace-450b-4972-9225-d40ac8dd42ed tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:23.950655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-39529992-53b6-4ae9-8e08-046280a87057 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:23.951564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-39529992-53b6-4ae9-8e08-046280a87057 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:23.970119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39529992-53b6-4ae9-8e08-046280a87057 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:23.970653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39529992-53b6-4ae9-8e08-046280a87057 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:23.971118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39529992-53b6-4ae9-8e08-046280a87057 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:23.976126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39529992-53b6-4ae9-8e08-046280a87057 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:23.978119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39529992-53b6-4ae9-8e08-046280a87057 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:23.978789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39529992-53b6-4ae9-8e08-046280a87057 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:24.412198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-39529992-53b6-4ae9-8e08-046280a87057 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:24.424663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b1a05ace-450b-4972-9225-d40ac8dd42ed tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:24.440699 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-39529992-53b6-4ae9-8e08-046280a87057 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 0.489634 Oct 27 19:09:24.441320 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2567/4941] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:23 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:24.443178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b1a05ace-450b-4972-9225-d40ac8dd42ed tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:24.445225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b1a05ace-450b-4972-9225-d40ac8dd42ed tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:24.469405 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b1a05ace-450b-4972-9225-d40ac8dd42ed tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.612279 Oct 27 19:09:24.476282 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2375/4942] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:23 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:24.825242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6293e725-13db-4ca5-a779-737fb44cc79e req-29e1405d-12b9-4a4f-95d3-3ef99b224ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8", "name": "network-vif-plugged", "status": "completed", "tag": "dd5f1313-7b8e-4573-a85e-6358373b6e86"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:24.863720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6293e725-13db-4ca5-a779-737fb44cc79e req-29e1405d-12b9-4a4f-95d3-3ef99b224ee5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:24.873143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6293e725-13db-4ca5-a779-737fb44cc79e req-29e1405d-12b9-4a4f-95d3-3ef99b224ee5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:24.876294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6293e725-13db-4ca5-a779-737fb44cc79e req-29e1405d-12b9-4a4f-95d3-3ef99b224ee5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:24.881661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf9dd053-14b4-4bda-b903-ae5cb2462744 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:24.882696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cf9dd053-14b4-4bda-b903-ae5cb2462744 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:24.904486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf9dd053-14b4-4bda-b903-ae5cb2462744 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:24.913184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf9dd053-14b4-4bda-b903-ae5cb2462744 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:24.913984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf9dd053-14b4-4bda-b903-ae5cb2462744 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:24.919448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf9dd053-14b4-4bda-b903-ae5cb2462744 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:24.922308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf9dd053-14b4-4bda-b903-ae5cb2462744 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:24.922988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf9dd053-14b4-4bda-b903-ae5cb2462744 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:24.955216 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6293e725-13db-4ca5-a779-737fb44cc79e req-29e1405d-12b9-4a4f-95d3-3ef99b224ee5 service nova] Creating event network-vif-plugged:dd5f1313-7b8e-4573-a85e-6358373b6e86 for instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 on n-h1-860687-3 Oct 27 19:09:24.975222 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6293e725-13db-4ca5-a779-737fb44cc79e req-29e1405d-12b9-4a4f-95d3-3ef99b224ee5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152524 Oct 27 19:09:24.979241 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2568/4943] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:09:25.465927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e4568979-f17f-4489-aae9-1b9e8acf8af5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:25.466897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e4568979-f17f-4489-aae9-1b9e8acf8af5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:25.493508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4568979-f17f-4489-aae9-1b9e8acf8af5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:25.503266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4568979-f17f-4489-aae9-1b9e8acf8af5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:25.507891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4568979-f17f-4489-aae9-1b9e8acf8af5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:25.509194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4568979-f17f-4489-aae9-1b9e8acf8af5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:25.520778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4568979-f17f-4489-aae9-1b9e8acf8af5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:25.525752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4568979-f17f-4489-aae9-1b9e8acf8af5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:25.985010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e4568979-f17f-4489-aae9-1b9e8acf8af5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:25.996203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cf9dd053-14b4-4bda-b903-ae5cb2462744 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:26.001082 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e4568979-f17f-4489-aae9-1b9e8acf8af5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 0.534777 Oct 27 19:09:26.007170 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cf9dd053-14b4-4bda-b903-ae5cb2462744 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1314 microversion: 2.1 time: 1.139132 Oct 27 19:09:26.013081 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2376/4944] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:24 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1314 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:26.016061 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2569/4945] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:25 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:26.050797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0cfd4d40-4626-4864-8da2-6bf8ccdd90a8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:26.051760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0cfd4d40-4626-4864-8da2-6bf8ccdd90a8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:26.079831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cfd4d40-4626-4864-8da2-6bf8ccdd90a8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:26.084464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cfd4d40-4626-4864-8da2-6bf8ccdd90a8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:26.085179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cfd4d40-4626-4864-8da2-6bf8ccdd90a8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:26.089282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cfd4d40-4626-4864-8da2-6bf8ccdd90a8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:26.090083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cfd4d40-4626-4864-8da2-6bf8ccdd90a8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:26.093424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cfd4d40-4626-4864-8da2-6bf8ccdd90a8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:26.551052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0cfd4d40-4626-4864-8da2-6bf8ccdd90a8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:26.579575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0cfd4d40-4626-4864-8da2-6bf8ccdd90a8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:26.587706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0cfd4d40-4626-4864-8da2-6bf8ccdd90a8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:26.611002 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0cfd4d40-4626-4864-8da2-6bf8ccdd90a8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.596560 Oct 27 19:09:26.629654 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2377/4946] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:26 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:27.029489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-88896b7d-4136-4802-a64c-bb3d5b440ba2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:27.031569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-88896b7d-4136-4802-a64c-bb3d5b440ba2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:27.041473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-10c6929c-d721-4dca-b9fa-3972d88a52d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:27.042818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-10c6929c-d721-4dca-b9fa-3972d88a52d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:27.056166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88896b7d-4136-4802-a64c-bb3d5b440ba2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:27.074544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10c6929c-d721-4dca-b9fa-3972d88a52d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:27.079137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88896b7d-4136-4802-a64c-bb3d5b440ba2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:27.080223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88896b7d-4136-4802-a64c-bb3d5b440ba2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:27.081653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88896b7d-4136-4802-a64c-bb3d5b440ba2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:27.084394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88896b7d-4136-4802-a64c-bb3d5b440ba2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:27.085050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88896b7d-4136-4802-a64c-bb3d5b440ba2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:27.085902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10c6929c-d721-4dca-b9fa-3972d88a52d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:27.086363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10c6929c-d721-4dca-b9fa-3972d88a52d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:27.087210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10c6929c-d721-4dca-b9fa-3972d88a52d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:27.087682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10c6929c-d721-4dca-b9fa-3972d88a52d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:27.091231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10c6929c-d721-4dca-b9fa-3972d88a52d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:27.539132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-88896b7d-4136-4802-a64c-bb3d5b440ba2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:27.554202 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-88896b7d-4136-4802-a64c-bb3d5b440ba2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 0.528595 Oct 27 19:09:27.572948 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2570/4947] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:27 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:27.650517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8778f26d-b794-4084-9de5-062c2381955d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:27.651219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8778f26d-b794-4084-9de5-062c2381955d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:27.659448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8778f26d-b794-4084-9de5-062c2381955d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:27.673380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8778f26d-b794-4084-9de5-062c2381955d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:27.675798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8778f26d-b794-4084-9de5-062c2381955d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:27.675798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8778f26d-b794-4084-9de5-062c2381955d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:27.675798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8778f26d-b794-4084-9de5-062c2381955d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:27.675798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8778f26d-b794-4084-9de5-062c2381955d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:27.795959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-10c6929c-d721-4dca-b9fa-3972d88a52d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:27.807801 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-10c6929c-d721-4dca-b9fa-3972d88a52d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1500 microversion: 2.1 time: 0.770432 Oct 27 19:09:27.818756 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2378/4948] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:27 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1500 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:27.838114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0087ab3d-8080-42ef-9335-ee4f15c820d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:27.840719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0087ab3d-8080-42ef-9335-ee4f15c820d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:27.894998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0087ab3d-8080-42ef-9335-ee4f15c820d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:27.895512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0087ab3d-8080-42ef-9335-ee4f15c820d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:27.895968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0087ab3d-8080-42ef-9335-ee4f15c820d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:27.896711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0087ab3d-8080-42ef-9335-ee4f15c820d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:27.897188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0087ab3d-8080-42ef-9335-ee4f15c820d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:27.897629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0087ab3d-8080-42ef-9335-ee4f15c820d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:27.925300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8778f26d-b794-4084-9de5-062c2381955d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:27.941046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8778f26d-b794-4084-9de5-062c2381955d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:27.947136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8778f26d-b794-4084-9de5-062c2381955d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:27.979064 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8778f26d-b794-4084-9de5-062c2381955d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.332696 Oct 27 19:09:27.984818 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2571/4949] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:27 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:09:28.128474 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0087ab3d-8080-42ef-9335-ee4f15c820d9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "POST /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8/action" status: 202 len: 0 microversion: 2.1 time: 0.296432 Oct 27 19:09:28.140750 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2379/4950] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:09:27 2022] POST /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:09:28.146741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-79d1588e-32f5-4b66-a571-5a1aeb6c2161 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:28.148691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-79d1588e-32f5-4b66-a571-5a1aeb6c2161 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:28.162977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79d1588e-32f5-4b66-a571-5a1aeb6c2161 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:28.166818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79d1588e-32f5-4b66-a571-5a1aeb6c2161 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:28.167493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79d1588e-32f5-4b66-a571-5a1aeb6c2161 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:28.168960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79d1588e-32f5-4b66-a571-5a1aeb6c2161 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:28.170085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79d1588e-32f5-4b66-a571-5a1aeb6c2161 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:28.173945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79d1588e-32f5-4b66-a571-5a1aeb6c2161 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:28.580961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-39e91b38-1e7e-4029-adda-90a858ee2eaf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:28.581989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-39e91b38-1e7e-4029-adda-90a858ee2eaf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:28.603847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39e91b38-1e7e-4029-adda-90a858ee2eaf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:28.610372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39e91b38-1e7e-4029-adda-90a858ee2eaf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:28.616022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39e91b38-1e7e-4029-adda-90a858ee2eaf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:28.618109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39e91b38-1e7e-4029-adda-90a858ee2eaf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:28.620109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39e91b38-1e7e-4029-adda-90a858ee2eaf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:28.621694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39e91b38-1e7e-4029-adda-90a858ee2eaf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:28.724398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-79d1588e-32f5-4b66-a571-5a1aeb6c2161 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:28.748540 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-79d1588e-32f5-4b66-a571-5a1aeb6c2161 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1505 microversion: 2.1 time: 0.605807 Oct 27 19:09:28.749161 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2572/4951] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:28 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1505 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:28.779225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fcb998fd-09c0-479c-b872-5cd5fc8967f9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:28.779724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fcb998fd-09c0-479c-b872-5cd5fc8967f9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:28.809533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcb998fd-09c0-479c-b872-5cd5fc8967f9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:28.810165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcb998fd-09c0-479c-b872-5cd5fc8967f9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:28.810656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcb998fd-09c0-479c-b872-5cd5fc8967f9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:28.811288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcb998fd-09c0-479c-b872-5cd5fc8967f9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:28.812472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcb998fd-09c0-479c-b872-5cd5fc8967f9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:28.812741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcb998fd-09c0-479c-b872-5cd5fc8967f9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:28.876052 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-fcb998fd-09c0-479c-b872-5cd5fc8967f9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] HTTP exception thrown: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fcb998fd-09c0-479c-b872-5cd5fc8967f9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Request method failure captured: Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 HTTP/1.1 Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtUUQyB6SOBVl-52U3dSziCl2YsU9ZgNNncrnhwIfxoSAofDzyZtVZEEpgkoaInknyIkrELp2G0Dir7G4OIR7s5DCkQnHvpSlonGokmFZL4OaHeeaiW_SVJEXEEBQj50879mm2-37qYzpjAgmfGPKFeq8vL_BkbLbyi352o1GqN2xk8 Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ab4798756472413683fb46917781e89f Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab4798756472413683fb46917781e89f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab4798756472413683fb46917781e89f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab4798756472413683fb46917781e89f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab4798756472413683fb46917781e89f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ab4798756472413683fb46917781e89f Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeShelveTestJSON-1562836379-project Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 434e7a9a50b340928126550ed66c5590 Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1562836379-project Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '96b128ff-a00c-4607-8088-1988263fbe79'} Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:28.879721 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:28.884977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:28.884977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:28.884977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:28.884977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:28.884977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:28.884977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:28.884977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:28.884977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:28.884977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:28.884977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:28.884977 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:28.893291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fcb998fd-09c0-479c-b872-5cd5fc8967f9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Returning 404 to user: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:28.894491 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fcb998fd-09c0-479c-b872-5cd5fc8967f9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "DELETE /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 404 len: 111 microversion: 2.20 time: 0.124449 Oct 27 19:09:28.900433 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2573/4952] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 19:09:28 2022] DELETE /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 19:09:28.910359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5fb64f4c-e70f-4e46-bf7c-13c72c9faba9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:28.919360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5fb64f4c-e70f-4e46-bf7c-13c72c9faba9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: 96b128ff-a00c-4607-8088-1988263fbe79] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:28.938860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb64f4c-e70f-4e46-bf7c-13c72c9faba9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:28.939375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb64f4c-e70f-4e46-bf7c-13c72c9faba9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:28.939826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb64f4c-e70f-4e46-bf7c-13c72c9faba9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:28.940555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb64f4c-e70f-4e46-bf7c-13c72c9faba9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:28.941134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb64f4c-e70f-4e46-bf7c-13c72c9faba9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:28.941448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb64f4c-e70f-4e46-bf7c-13c72c9faba9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:28.988264 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-5fb64f4c-e70f-4e46-bf7c-13c72c9faba9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] HTTP exception thrown: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5fb64f4c-e70f-4e46-bf7c-13c72c9faba9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Request method failure captured: Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 HTTP/1.1 Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtUUQyB6SOBVl-52U3dSziCl2YsU9ZgNNncrnhwIfxoSAofDzyZtVZEEpgkoaInknyIkrELp2G0Dir7G4OIR7s5DCkQnHvpSlonGokmFZL4OaHeeaiW_SVJEXEEBQj50879mm2-37qYzpjAgmfGPKFeq8vL_BkbLbyi352o1GqN2xk8 Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ab4798756472413683fb46917781e89f Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab4798756472413683fb46917781e89f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab4798756472413683fb46917781e89f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab4798756472413683fb46917781e89f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab4798756472413683fb46917781e89f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ab4798756472413683fb46917781e89f Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeShelveTestJSON-1562836379-project Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 434e7a9a50b340928126550ed66c5590 Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1562836379-project Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '96b128ff-a00c-4607-8088-1988263fbe79'} Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:28.989890 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:28.995457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:28.995457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:28.995457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:28.995457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:28.995457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:28.995457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:28.995457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. Oct 27 19:09:28.995457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:28.995457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5fb64f4c-e70f-4e46-bf7c-13c72c9faba9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Returning 404 to user: Instance 96b128ff-a00c-4607-8088-1988263fbe79 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:28.995457 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5fb64f4c-e70f-4e46-bf7c-13c72c9faba9 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79" status: 404 len: 111 microversion: 2.20 time: 0.085641 Oct 27 19:09:28.995457 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2574/4953] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:28 2022] GET /compute/v2.1/servers/96b128ff-a00c-4607-8088-1988263fbe79 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 19:09:29.020789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-148e6a44-f739-4288-b2d2-2e3b3077638b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:29.021560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-148e6a44-f739-4288-b2d2-2e3b3077638b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:29.029882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-148e6a44-f739-4288-b2d2-2e3b3077638b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:29.030415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-148e6a44-f739-4288-b2d2-2e3b3077638b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:29.032393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-148e6a44-f739-4288-b2d2-2e3b3077638b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:29.039989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-148e6a44-f739-4288-b2d2-2e3b3077638b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:29.040596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-148e6a44-f739-4288-b2d2-2e3b3077638b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:29.041065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-148e6a44-f739-4288-b2d2-2e3b3077638b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:29.128473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-39e91b38-1e7e-4029-adda-90a858ee2eaf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:29.141253 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-39e91b38-1e7e-4029-adda-90a858ee2eaf tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 0.567265 Oct 27 19:09:29.175662 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2380/4954] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:28 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:29.379054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-148e6a44-f739-4288-b2d2-2e3b3077638b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:29.389531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-148e6a44-f739-4288-b2d2-2e3b3077638b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:29.401636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-148e6a44-f739-4288-b2d2-2e3b3077638b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:29.418377 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-148e6a44-f739-4288-b2d2-2e3b3077638b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.401322 Oct 27 19:09:29.422799 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2575/4955] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:29 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:09:29.783662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-49a0b684-ba7e-4172-832e-02873fc8760e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:29.784608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-49a0b684-ba7e-4172-832e-02873fc8760e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:29.794993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49a0b684-ba7e-4172-832e-02873fc8760e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:29.801366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49a0b684-ba7e-4172-832e-02873fc8760e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:29.802106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49a0b684-ba7e-4172-832e-02873fc8760e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:29.811472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49a0b684-ba7e-4172-832e-02873fc8760e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:29.812430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49a0b684-ba7e-4172-832e-02873fc8760e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:29.813115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49a0b684-ba7e-4172-832e-02873fc8760e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:30.190976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8946e535-ce33-4f29-8ef8-8d61650f54c5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:30.191599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8946e535-ce33-4f29-8ef8-8d61650f54c5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:30.209454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8946e535-ce33-4f29-8ef8-8d61650f54c5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:30.209953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8946e535-ce33-4f29-8ef8-8d61650f54c5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:30.210413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8946e535-ce33-4f29-8ef8-8d61650f54c5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:30.218156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8946e535-ce33-4f29-8ef8-8d61650f54c5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:30.218695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8946e535-ce33-4f29-8ef8-8d61650f54c5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:30.219155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8946e535-ce33-4f29-8ef8-8d61650f54c5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:30.247178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-49a0b684-ba7e-4172-832e-02873fc8760e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:30.260664 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-49a0b684-ba7e-4172-832e-02873fc8760e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1485 microversion: 2.1 time: 0.481311 Oct 27 19:09:30.261264 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2381/4956] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:29 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1485 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:30.288514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-83b0abf3-5b15-4c2d-be41-0fbda602cc00 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:30.289017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-83b0abf3-5b15-4c2d-be41-0fbda602cc00 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:30.316922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83b0abf3-5b15-4c2d-be41-0fbda602cc00 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:30.317421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83b0abf3-5b15-4c2d-be41-0fbda602cc00 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:30.317861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83b0abf3-5b15-4c2d-be41-0fbda602cc00 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:30.339793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83b0abf3-5b15-4c2d-be41-0fbda602cc00 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:30.340426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83b0abf3-5b15-4c2d-be41-0fbda602cc00 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:30.340886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83b0abf3-5b15-4c2d-be41-0fbda602cc00 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:30.408047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-83b0abf3-5b15-4c2d-be41-0fbda602cc00 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:09:30.659035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8946e535-ce33-4f29-8ef8-8d61650f54c5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:30.680418 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8946e535-ce33-4f29-8ef8-8d61650f54c5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 0.483758 Oct 27 19:09:30.699032 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2576/4957] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:30 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:30.715096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5ecd44d6-3e32-4e19-9173-436197ee5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:30.716188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5ecd44d6-3e32-4e19-9173-436197ee5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:30.735454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ecd44d6-3e32-4e19-9173-436197ee5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:30.736348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ecd44d6-3e32-4e19-9173-436197ee5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:30.737101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ecd44d6-3e32-4e19-9173-436197ee5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:30.738174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ecd44d6-3e32-4e19-9173-436197ee5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:30.738906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ecd44d6-3e32-4e19-9173-436197ee5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:30.739578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ecd44d6-3e32-4e19-9173-436197ee5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:30.783328 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-83b0abf3-5b15-4c2d-be41-0fbda602cc00 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "DELETE /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 204 len: 0 microversion: 2.1 time: 0.498328 Oct 27 19:09:30.783951 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2382/4958] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:09:30 2022] DELETE /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:09:30.900094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bcfc4d58-32d8-4d91-ae3e-5301ac6e86f9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:30.900094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bcfc4d58-32d8-4d91-ae3e-5301ac6e86f9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:30.906745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcfc4d58-32d8-4d91-ae3e-5301ac6e86f9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:30.912182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcfc4d58-32d8-4d91-ae3e-5301ac6e86f9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:30.916652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcfc4d58-32d8-4d91-ae3e-5301ac6e86f9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:30.919176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcfc4d58-32d8-4d91-ae3e-5301ac6e86f9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:30.925035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcfc4d58-32d8-4d91-ae3e-5301ac6e86f9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:30.926589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcfc4d58-32d8-4d91-ae3e-5301ac6e86f9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:31.109466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5ecd44d6-3e32-4e19-9173-436197ee5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:31.122614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5ecd44d6-3e32-4e19-9173-436197ee5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:31.125715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5ecd44d6-3e32-4e19-9173-436197ee5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:31.138078 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5ecd44d6-3e32-4e19-9173-436197ee5457 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.437469 Oct 27 19:09:31.157548 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2577/4959] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:30 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:31.640555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bcfc4d58-32d8-4d91-ae3e-5301ac6e86f9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:31.651377 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bcfc4d58-32d8-4d91-ae3e-5301ac6e86f9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1491 microversion: 2.1 time: 0.859216 Oct 27 19:09:31.651975 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2383/4960] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:30 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1491 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:31.709912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2d7c6a69-c0ff-408f-b334-81ab420a3731 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:31.711338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2d7c6a69-c0ff-408f-b334-81ab420a3731 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:31.726814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d7c6a69-c0ff-408f-b334-81ab420a3731 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:31.727805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d7c6a69-c0ff-408f-b334-81ab420a3731 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:31.728513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d7c6a69-c0ff-408f-b334-81ab420a3731 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:31.729534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d7c6a69-c0ff-408f-b334-81ab420a3731 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:31.732421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d7c6a69-c0ff-408f-b334-81ab420a3731 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:31.733145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d7c6a69-c0ff-408f-b334-81ab420a3731 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:32.168270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e73803e5-f751-48f1-bfdb-75c346eca094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:32.169179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e73803e5-f751-48f1-bfdb-75c346eca094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:32.180110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e73803e5-f751-48f1-bfdb-75c346eca094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:32.180871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e73803e5-f751-48f1-bfdb-75c346eca094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:32.181056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e73803e5-f751-48f1-bfdb-75c346eca094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:32.193111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e73803e5-f751-48f1-bfdb-75c346eca094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:32.193624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e73803e5-f751-48f1-bfdb-75c346eca094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:32.194091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e73803e5-f751-48f1-bfdb-75c346eca094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:32.264389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2d7c6a69-c0ff-408f-b334-81ab420a3731 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:32.287526 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2d7c6a69-c0ff-408f-b334-81ab420a3731 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1510 microversion: 2.1 time: 0.581254 Oct 27 19:09:32.289117 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2578/4961] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:31 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1510 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:32.624557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e73803e5-f751-48f1-bfdb-75c346eca094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:32.645934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e73803e5-f751-48f1-bfdb-75c346eca094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:32.668221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e73803e5-f751-48f1-bfdb-75c346eca094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:32.683124 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e73803e5-f751-48f1-bfdb-75c346eca094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.519021 Oct 27 19:09:32.690496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ac2ca36e-0831-4219-96ba-e43e0080093d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:32.690776 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2384/4962] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:32 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:09:32.703421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ac2ca36e-0831-4219-96ba-e43e0080093d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:32.705373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac2ca36e-0831-4219-96ba-e43e0080093d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:32.712597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac2ca36e-0831-4219-96ba-e43e0080093d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:32.716386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac2ca36e-0831-4219-96ba-e43e0080093d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:32.721194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac2ca36e-0831-4219-96ba-e43e0080093d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:32.725166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac2ca36e-0831-4219-96ba-e43e0080093d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:32.725971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac2ca36e-0831-4219-96ba-e43e0080093d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:33.320205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-83bc62e1-af79-4481-822f-68b9956aaa1e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:33.323230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-83bc62e1-af79-4481-822f-68b9956aaa1e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:33.350333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83bc62e1-af79-4481-822f-68b9956aaa1e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:33.353757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83bc62e1-af79-4481-822f-68b9956aaa1e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:33.354534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83bc62e1-af79-4481-822f-68b9956aaa1e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:33.356639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83bc62e1-af79-4481-822f-68b9956aaa1e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:33.359069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83bc62e1-af79-4481-822f-68b9956aaa1e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:33.359732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83bc62e1-af79-4481-822f-68b9956aaa1e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:33.474315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ac2ca36e-0831-4219-96ba-e43e0080093d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:33.496189 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ac2ca36e-0831-4219-96ba-e43e0080093d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1491 microversion: 2.1 time: 0.810078 Oct 27 19:09:33.504879 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2579/4963] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:32 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1491 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:33.723562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1532b71e-5c17-4c72-9854-b7700f1382bf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:33.724919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1532b71e-5c17-4c72-9854-b7700f1382bf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:33.748803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1532b71e-5c17-4c72-9854-b7700f1382bf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:33.764365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1532b71e-5c17-4c72-9854-b7700f1382bf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:33.765427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1532b71e-5c17-4c72-9854-b7700f1382bf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:33.766180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1532b71e-5c17-4c72-9854-b7700f1382bf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:33.771415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1532b71e-5c17-4c72-9854-b7700f1382bf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:33.772299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1532b71e-5c17-4c72-9854-b7700f1382bf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:33.779352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:33.962816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-83bc62e1-af79-4481-822f-68b9956aaa1e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:33.979411 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-83bc62e1-af79-4481-822f-68b9956aaa1e tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1487 microversion: 2.1 time: 0.665934 Oct 27 19:09:33.980598 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2385/4964] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:33 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1487 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:34.007290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-59e546e1-6eac-49fa-8130-96d7d1d9ef77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-843928960"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:34.014802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-59e546e1-6eac-49fa-8130-96d7d1d9ef77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:34.034139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59e546e1-6eac-49fa-8130-96d7d1d9ef77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:34.045169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59e546e1-6eac-49fa-8130-96d7d1d9ef77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:34.045655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59e546e1-6eac-49fa-8130-96d7d1d9ef77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:34.055387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59e546e1-6eac-49fa-8130-96d7d1d9ef77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:34.055906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59e546e1-6eac-49fa-8130-96d7d1d9ef77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:34.058263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59e546e1-6eac-49fa-8130-96d7d1d9ef77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:34.204101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1532b71e-5c17-4c72-9854-b7700f1382bf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:34.223799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1532b71e-5c17-4c72-9854-b7700f1382bf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:34.238042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1532b71e-5c17-4c72-9854-b7700f1382bf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:34.259930 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1532b71e-5c17-4c72-9854-b7700f1382bf tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.541229 Oct 27 19:09:34.263289 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2580/4965] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:33 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:34.393863 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-59e546e1-6eac-49fa-8130-96d7d1d9ef77 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "PUT /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1059 microversion: 2.1 time: 0.390755 Oct 27 19:09:34.408184 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2386/4966] 10.222.0.42 () {60 vars in 1256 bytes} [Thu Oct 27 19:09:34 2022] PUT /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1059 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:34.421203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b9f0aef8-a60c-4f12-9f26-e0e72f687f16 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:34.422328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b9f0aef8-a60c-4f12-9f26-e0e72f687f16 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:34.430322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9f0aef8-a60c-4f12-9f26-e0e72f687f16 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:34.441408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9f0aef8-a60c-4f12-9f26-e0e72f687f16 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:34.442245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9f0aef8-a60c-4f12-9f26-e0e72f687f16 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:34.443315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9f0aef8-a60c-4f12-9f26-e0e72f687f16 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:34.456524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9f0aef8-a60c-4f12-9f26-e0e72f687f16 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:34.468528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9f0aef8-a60c-4f12-9f26-e0e72f687f16 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:34.535330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa551331-842b-4428-a8a1-794b5d4c7015 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:34.537703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa551331-842b-4428-a8a1-794b5d4c7015 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:34.554201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa551331-842b-4428-a8a1-794b5d4c7015 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:34.555167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa551331-842b-4428-a8a1-794b5d4c7015 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:34.557382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa551331-842b-4428-a8a1-794b5d4c7015 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:34.558342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa551331-842b-4428-a8a1-794b5d4c7015 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:34.560345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa551331-842b-4428-a8a1-794b5d4c7015 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:34.562321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa551331-842b-4428-a8a1-794b5d4c7015 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:34.669480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:35.000590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fa551331-842b-4428-a8a1-794b5d4c7015 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:35.049500 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fa551331-842b-4428-a8a1-794b5d4c7015 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 200 len: 1284 microversion: 2.1 time: 0.520406 Oct 27 19:09:35.070163 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2387/4967] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:34 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 1284 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:35.070328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b9f0aef8-a60c-4f12-9f26-e0e72f687f16 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:35.084023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-a1e64344-0b05-4dba-833c-4380ce1c5945 req-e69b0c7d-22f8-42fc-9819-196057eb61a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8", "name": "network-vif-deleted", "tag": "dd5f1313-7b8e-4573-a85e-6358373b6e86"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:35.085884 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b9f0aef8-a60c-4f12-9f26-e0e72f687f16 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1486 microversion: 2.1 time: 0.669108 Oct 27 19:09:35.093366 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2581/4968] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:34 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1486 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:35.119419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-751bb0c8-300b-46f8-a4fc-531831de0371 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:35.120039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-751bb0c8-300b-46f8-a4fc-531831de0371 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:35.165927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-751bb0c8-300b-46f8-a4fc-531831de0371 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:35.166447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a1e64344-0b05-4dba-833c-4380ce1c5945 req-e69b0c7d-22f8-42fc-9819-196057eb61a3 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:35.167041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a1e64344-0b05-4dba-833c-4380ce1c5945 req-e69b0c7d-22f8-42fc-9819-196057eb61a3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:35.167486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a1e64344-0b05-4dba-833c-4380ce1c5945 req-e69b0c7d-22f8-42fc-9819-196057eb61a3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:35.170538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-751bb0c8-300b-46f8-a4fc-531831de0371 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:35.172603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-751bb0c8-300b-46f8-a4fc-531831de0371 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:35.179406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-751bb0c8-300b-46f8-a4fc-531831de0371 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:35.180212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-751bb0c8-300b-46f8-a4fc-531831de0371 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:35.180850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-751bb0c8-300b-46f8-a4fc-531831de0371 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:35.223447 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a1e64344-0b05-4dba-833c-4380ce1c5945 req-e69b0c7d-22f8-42fc-9819-196057eb61a3 service nova] Creating event network-vif-deleted:dd5f1313-7b8e-4573-a85e-6358373b6e86 for instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 on n-h1-860687-3 Oct 27 19:09:35.247178 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-a1e64344-0b05-4dba-833c-4380ce1c5945 req-e69b0c7d-22f8-42fc-9819-196057eb61a3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175493 Oct 27 19:09:35.256608 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2388/4969] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:09:35.292189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-06d1fc0f-88da-479c-8ad9-4578dcd53a95 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:35.293139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-06d1fc0f-88da-479c-8ad9-4578dcd53a95 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:35.333750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06d1fc0f-88da-479c-8ad9-4578dcd53a95 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:35.334280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06d1fc0f-88da-479c-8ad9-4578dcd53a95 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:35.334805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06d1fc0f-88da-479c-8ad9-4578dcd53a95 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:35.347031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06d1fc0f-88da-479c-8ad9-4578dcd53a95 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:35.348354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06d1fc0f-88da-479c-8ad9-4578dcd53a95 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:35.348830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06d1fc0f-88da-479c-8ad9-4578dcd53a95 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:35.739509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-751bb0c8-300b-46f8-a4fc-531831de0371 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:35.748025 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-751bb0c8-300b-46f8-a4fc-531831de0371 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1486 microversion: 2.1 time: 0.632679 Oct 27 19:09:35.760983 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2582/4970] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:35 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1486 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:35.775808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2b25a977-b0dd-42cc-9a89-10e79a66297d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:35.776570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2b25a977-b0dd-42cc-9a89-10e79a66297d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:35.792424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b25a977-b0dd-42cc-9a89-10e79a66297d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:35.798971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b25a977-b0dd-42cc-9a89-10e79a66297d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:35.800624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b25a977-b0dd-42cc-9a89-10e79a66297d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:35.801783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b25a977-b0dd-42cc-9a89-10e79a66297d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:35.815194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b25a977-b0dd-42cc-9a89-10e79a66297d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:35.815904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b25a977-b0dd-42cc-9a89-10e79a66297d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:35.859448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-06d1fc0f-88da-479c-8ad9-4578dcd53a95 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:35.872785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-06d1fc0f-88da-479c-8ad9-4578dcd53a95 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:35.875634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-06d1fc0f-88da-479c-8ad9-4578dcd53a95 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:35.884289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2b25a977-b0dd-42cc-9a89-10e79a66297d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:09:35.889213 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-06d1fc0f-88da-479c-8ad9-4578dcd53a95 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.602753 Oct 27 19:09:35.892657 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2389/4971] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:35 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:36.076613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1ac709b5-1a75-478d-9152-1fc66bf68107 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:36.077908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1ac709b5-1a75-478d-9152-1fc66bf68107 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:36.092199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ac709b5-1a75-478d-9152-1fc66bf68107 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:36.097990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ac709b5-1a75-478d-9152-1fc66bf68107 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:36.098627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ac709b5-1a75-478d-9152-1fc66bf68107 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:36.099692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ac709b5-1a75-478d-9152-1fc66bf68107 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:36.101530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ac709b5-1a75-478d-9152-1fc66bf68107 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:36.113206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ac709b5-1a75-478d-9152-1fc66bf68107 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:36.145198 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-1ac709b5-1a75-478d-9152-1fc66bf68107 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:09:36.147484 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2b25a977-b0dd-42cc-9a89-10e79a66297d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 204 len: 0 microversion: 2.1 time: 0.374384 Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1ac709b5-1a75-478d-9152-1fc66bf68107 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 HTTP/1.1 Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8'} Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:36.148904 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:36.157479 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:36.157479 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:36.157479 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:36.157479 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:36.157479 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:36.157479 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:09:36.157479 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:36.158043 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2583/4972] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:09:35 2022] DELETE /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:09:36.158444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1ac709b5-1a75-478d-9152-1fc66bf68107 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:36.158444 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1ac709b5-1a75-478d-9152-1fc66bf68107 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 404 len: 111 microversion: 2.1 time: 0.083019 Oct 27 19:09:36.162171 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2390/4973] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:36 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:09:36.168455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-90ff49a5-5c59-40c2-9940-6fb33667bd35 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:36.173191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-90ff49a5-5c59-40c2-9940-6fb33667bd35 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:36.188894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90ff49a5-5c59-40c2-9940-6fb33667bd35 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:36.189842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90ff49a5-5c59-40c2-9940-6fb33667bd35 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:36.191001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90ff49a5-5c59-40c2-9940-6fb33667bd35 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:36.193161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90ff49a5-5c59-40c2-9940-6fb33667bd35 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:36.194283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90ff49a5-5c59-40c2-9940-6fb33667bd35 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:36.195118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90ff49a5-5c59-40c2-9940-6fb33667bd35 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:36.464101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-974277674", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "e7d83c6b-c0c0-42e5-b094-5dc26599221d"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:36.474010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-90ff49a5-5c59-40c2-9940-6fb33667bd35 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:36.485814 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-90ff49a5-5c59-40c2-9940-6fb33667bd35 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1492 microversion: 2.1 time: 0.331146 Oct 27 19:09:36.492951 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2584/4974] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:36 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1492 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:36.928883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9ee3999d-8afc-47a6-9785-280dda8b74d8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:36.929513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9ee3999d-8afc-47a6-9785-280dda8b74d8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:36.938246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ee3999d-8afc-47a6-9785-280dda8b74d8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:36.950463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ee3999d-8afc-47a6-9785-280dda8b74d8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:36.950947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ee3999d-8afc-47a6-9785-280dda8b74d8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:36.951741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ee3999d-8afc-47a6-9785-280dda8b74d8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:36.952238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ee3999d-8afc-47a6-9785-280dda8b74d8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:36.952702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ee3999d-8afc-47a6-9785-280dda8b74d8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:37.255825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9ee3999d-8afc-47a6-9785-280dda8b74d8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:37.268551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9ee3999d-8afc-47a6-9785-280dda8b74d8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:37.274416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9ee3999d-8afc-47a6-9785-280dda8b74d8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:37.305305 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9ee3999d-8afc-47a6-9785-280dda8b74d8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.381432 Oct 27 19:09:37.309453 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2585/4975] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:36 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:09:37.516222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-54bd4164-6ba2-4233-ae50-a108f3cd4e7d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:37.538793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-54bd4164-6ba2-4233-ae50-a108f3cd4e7d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:37.541419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:37.568712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54bd4164-6ba2-4233-ae50-a108f3cd4e7d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:37.569341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54bd4164-6ba2-4233-ae50-a108f3cd4e7d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:37.569804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54bd4164-6ba2-4233-ae50-a108f3cd4e7d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:37.570616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54bd4164-6ba2-4233-ae50-a108f3cd4e7d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:37.571300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54bd4164-6ba2-4233-ae50-a108f3cd4e7d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:37.571747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54bd4164-6ba2-4233-ae50-a108f3cd4e7d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:39.192809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-54bd4164-6ba2-4233-ae50-a108f3cd4e7d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:39.215616 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-54bd4164-6ba2-4233-ae50-a108f3cd4e7d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1492 microversion: 2.1 time: 1.703872 Oct 27 19:09:39.236589 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2586/4976] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:37 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1492 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:39.243383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9c57a4f-fde9-4576-b3b4-bf941f357b36 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:39.244466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c9c57a4f-fde9-4576-b3b4-bf941f357b36 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:39.257314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c57a4f-fde9-4576-b3b4-bf941f357b36 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:39.294346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c57a4f-fde9-4576-b3b4-bf941f357b36 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:39.295161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c57a4f-fde9-4576-b3b4-bf941f357b36 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:39.300642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c57a4f-fde9-4576-b3b4-bf941f357b36 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:39.303208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c57a4f-fde9-4576-b3b4-bf941f357b36 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:39.305046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c57a4f-fde9-4576-b3b4-bf941f357b36 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:39.648519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c9c57a4f-fde9-4576-b3b4-bf941f357b36 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:39.672312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c9c57a4f-fde9-4576-b3b4-bf941f357b36 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:39.685632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c9c57a4f-fde9-4576-b3b4-bf941f357b36 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:39.699125 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c9c57a4f-fde9-4576-b3b4-bf941f357b36 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.459779 Oct 27 19:09:39.700472 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2587/4977] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:39 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:39.710868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-222541ac-b41f-4a49-825d-2d919f539321 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:39.711757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-222541ac-b41f-4a49-825d-2d919f539321 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:39.742732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-222541ac-b41f-4a49-825d-2d919f539321 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:39.744903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-222541ac-b41f-4a49-825d-2d919f539321 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:39.747742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-222541ac-b41f-4a49-825d-2d919f539321 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:39.750795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-222541ac-b41f-4a49-825d-2d919f539321 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:39.752089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-222541ac-b41f-4a49-825d-2d919f539321 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:39.753103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-222541ac-b41f-4a49-825d-2d919f539321 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:39.780432 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-222541ac-b41f-4a49-825d-2d919f539321 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] HTTP exception thrown: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-222541ac-b41f-4a49-825d-2d919f539321 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Request method failure captured: Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b HTTP/1.1 Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtUUQyB6SOBVl-52U3dSziCl2YsU9ZgNNncrnhwIfxoSAofDzyZtVZEEpgkoaInknyIkrELp2G0Dir7G4OIR7s5DCkQnHvpSlonGokmFZL4OaHeeaiW_SVJEXEEBQj50879mm2-37qYzpjAgmfGPKFeq8vL_BkbLbyi352o1GqN2xk8 Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ab4798756472413683fb46917781e89f Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab4798756472413683fb46917781e89f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab4798756472413683fb46917781e89f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab4798756472413683fb46917781e89f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab4798756472413683fb46917781e89f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ab4798756472413683fb46917781e89f Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeShelveTestJSON-1562836379-project Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 434e7a9a50b340928126550ed66c5590 Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1562836379-project Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'f4a7713a-b78d-425e-a6e8-0e4f5bc8904b'} Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:39.784593 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:39.789601 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:09:39.789601 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:39.789601 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:39.789601 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:39.789601 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:39.789601 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:39.789601 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:39.789601 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:39.789601 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:39.789601 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:09:39.789601 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:39.790922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-222541ac-b41f-4a49-825d-2d919f539321 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Returning 404 to user: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:39.792071 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-222541ac-b41f-4a49-825d-2d919f539321 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 404 len: 111 microversion: 2.20 time: 0.089333 Oct 27 19:09:39.796554 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2588/4978] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 19:09:39 2022] DELETE /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:09:39.801905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-dc952a66-25a8-4530-a07b-e19e66eac6aa req-0d6c5643-fdb4-44b7-b6fe-408dc7336e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2b4bcc-c45c-49b4-af4e-039935fe8285", "name": "network-vif-deleted", "tag": "99a02cc6-b61f-44d5-b04a-d834e2db33e8"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:39.814830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-dc952a66-25a8-4530-a07b-e19e66eac6aa req-0d6c5643-fdb4-44b7-b6fe-408dc7336e6a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:39.816014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-dc952a66-25a8-4530-a07b-e19e66eac6aa req-0d6c5643-fdb4-44b7-b6fe-408dc7336e6a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:39.817125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-dc952a66-25a8-4530-a07b-e19e66eac6aa req-0d6c5643-fdb4-44b7-b6fe-408dc7336e6a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:39.864357 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-dc952a66-25a8-4530-a07b-e19e66eac6aa req-0d6c5643-fdb4-44b7-b6fe-408dc7336e6a service nova] Creating event network-vif-deleted:99a02cc6-b61f-44d5-b04a-d834e2db33e8 for instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 on n-h2-860687-3 Oct 27 19:09:39.895861 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-dc952a66-25a8-4530-a07b-e19e66eac6aa req-0d6c5643-fdb4-44b7-b6fe-408dc7336e6a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094136 Oct 27 19:09:39.898825 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2589/4979] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:09:39.915068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7ccd6f45-5cae-4059-8bd1-c174e1b1fa18 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:39.928251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7ccd6f45-5cae-4059-8bd1-c174e1b1fa18 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] [instance: f4a7713a-b78d-425e-a6e8-0e4f5bc8904b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:39.951551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ccd6f45-5cae-4059-8bd1-c174e1b1fa18 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:39.953034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ccd6f45-5cae-4059-8bd1-c174e1b1fa18 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:39.953831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ccd6f45-5cae-4059-8bd1-c174e1b1fa18 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:39.954757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ccd6f45-5cae-4059-8bd1-c174e1b1fa18 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:39.955387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ccd6f45-5cae-4059-8bd1-c174e1b1fa18 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:39.955993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ccd6f45-5cae-4059-8bd1-c174e1b1fa18 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:40.020960 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-7ccd6f45-5cae-4059-8bd1-c174e1b1fa18 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] HTTP exception thrown: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7ccd6f45-5cae-4059-8bd1-c174e1b1fa18 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Request method failure captured: Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b HTTP/1.1 Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtUUQyB6SOBVl-52U3dSziCl2YsU9ZgNNncrnhwIfxoSAofDzyZtVZEEpgkoaInknyIkrELp2G0Dir7G4OIR7s5DCkQnHvpSlonGokmFZL4OaHeeaiW_SVJEXEEBQj50879mm2-37qYzpjAgmfGPKFeq8vL_BkbLbyi352o1GqN2xk8 Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ab4798756472413683fb46917781e89f Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab4798756472413683fb46917781e89f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab4798756472413683fb46917781e89f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab4798756472413683fb46917781e89f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab4798756472413683fb46917781e89f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ab4798756472413683fb46917781e89f Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1562836379 Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeShelveTestJSON-1562836379-project Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 434e7a9a50b340928126550ed66c5590 Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1562836379-project Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'f4a7713a-b78d-425e-a6e8-0e4f5bc8904b'} Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:40.026254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:40.033487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:40.033487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:40.033487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:40.033487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:40.033487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:40.033487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:40.033487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. Oct 27 19:09:40.033487 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:40.035940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7ccd6f45-5cae-4059-8bd1-c174e1b1fa18 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] Returning 404 to user: Instance f4a7713a-b78d-425e-a6e8-0e4f5bc8904b could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:40.037172 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7ccd6f45-5cae-4059-8bd1-c174e1b1fa18 tempest-AttachVolumeShelveTestJSON-1562836379 tempest-AttachVolumeShelveTestJSON-1562836379-project] 10.222.0.42 "GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b" status: 404 len: 111 microversion: 2.20 time: 0.136610 Oct 27 19:09:40.041853 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2590/4980] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:39 2022] GET /compute/v2.1/servers/f4a7713a-b78d-425e-a6e8-0e4f5bc8904b => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:09:40.246738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6fd0fdb8-04e1-41f8-9b8d-6a12945588ed tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:40.247622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6fd0fdb8-04e1-41f8-9b8d-6a12945588ed tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:40.267773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fd0fdb8-04e1-41f8-9b8d-6a12945588ed tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:40.268397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fd0fdb8-04e1-41f8-9b8d-6a12945588ed tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:40.282670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fd0fdb8-04e1-41f8-9b8d-6a12945588ed tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:40.285419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fd0fdb8-04e1-41f8-9b8d-6a12945588ed tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:40.287367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fd0fdb8-04e1-41f8-9b8d-6a12945588ed tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:40.288419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fd0fdb8-04e1-41f8-9b8d-6a12945588ed tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:40.411598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fd0fdb8-04e1-41f8-9b8d-6a12945588ed tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:40.412406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fd0fdb8-04e1-41f8-9b8d-6a12945588ed tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:40.413059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fd0fdb8-04e1-41f8-9b8d-6a12945588ed tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:40.413849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-6fd0fdb8-04e1-41f8-9b8d-6a12945588ed tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lazy-loading 'fault' on Instance uuid 1b2b4bcc-c45c-49b4-af4e-039935fe8285 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:09:40.665822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6fd0fdb8-04e1-41f8-9b8d-6a12945588ed tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:40.698364 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6fd0fdb8-04e1-41f8-9b8d-6a12945588ed tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 200 len: 1309 microversion: 2.1 time: 0.449295 Oct 27 19:09:40.711695 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2591/4981] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:40 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 1309 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:40.743813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e32f18c6-7f86-4c37-ab32-574d33cd309e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:40.748570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e32f18c6-7f86-4c37-ab32-574d33cd309e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:40.792905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e32f18c6-7f86-4c37-ab32-574d33cd309e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:40.799448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e32f18c6-7f86-4c37-ab32-574d33cd309e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:40.799448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e32f18c6-7f86-4c37-ab32-574d33cd309e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:40.802295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e32f18c6-7f86-4c37-ab32-574d33cd309e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:40.807386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e32f18c6-7f86-4c37-ab32-574d33cd309e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:40.808682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e32f18c6-7f86-4c37-ab32-574d33cd309e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:41.508297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e32f18c6-7f86-4c37-ab32-574d33cd309e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:41.543437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e32f18c6-7f86-4c37-ab32-574d33cd309e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:41.561049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e32f18c6-7f86-4c37-ab32-574d33cd309e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:41.583645 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e32f18c6-7f86-4c37-ab32-574d33cd309e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.850374 Oct 27 19:09:41.586309 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2592/4982] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:40 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:41.737305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f6c171a6-4e4b-4c3d-9154-93a9f1c0390a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:41.738218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f6c171a6-4e4b-4c3d-9154-93a9f1c0390a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:41.746085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6c171a6-4e4b-4c3d-9154-93a9f1c0390a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:41.757030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6c171a6-4e4b-4c3d-9154-93a9f1c0390a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:41.760210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6c171a6-4e4b-4c3d-9154-93a9f1c0390a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:41.764109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6c171a6-4e4b-4c3d-9154-93a9f1c0390a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:41.765503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6c171a6-4e4b-4c3d-9154-93a9f1c0390a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:41.766529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6c171a6-4e4b-4c3d-9154-93a9f1c0390a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:41.821392 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-f6c171a6-4e4b-4c3d-9154-93a9f1c0390a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f6c171a6-4e4b-4c3d-9154-93a9f1c0390a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 HTTP/1.1 Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '1b2b4bcc-c45c-49b4-af4e-039935fe8285'} Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:41.825942 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:41.834661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:41.834661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:41.834661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:41.834661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:41.834661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:41.834661 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:41.834661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f6c171a6-4e4b-4c3d-9154-93a9f1c0390a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:41.834661 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f6c171a6-4e4b-4c3d-9154-93a9f1c0390a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 404 len: 111 microversion: 2.1 time: 0.103877 Oct 27 19:09:41.844872 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2593/4983] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:41 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:09:41.864675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2824186a-d211-4a18-8470-8513717bba0d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:41.866512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2824186a-d211-4a18-8470-8513717bba0d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:41.918767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2824186a-d211-4a18-8470-8513717bba0d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:41.919390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2824186a-d211-4a18-8470-8513717bba0d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:41.919852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2824186a-d211-4a18-8470-8513717bba0d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:41.920585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2824186a-d211-4a18-8470-8513717bba0d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:41.921082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2824186a-d211-4a18-8470-8513717bba0d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:41.925225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2824186a-d211-4a18-8470-8513717bba0d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:41.962335 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-2824186a-d211-4a18-8470-8513717bba0d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2824186a-d211-4a18-8470-8513717bba0d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 HTTP/1.1 Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '1b2b4bcc-c45c-49b4-af4e-039935fe8285'} Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:41.966056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:41.971371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:41.971371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:41.971371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:41.971371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:41.971371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:41.971371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:41.971371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:41.971371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:41.971371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:41.971371 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:41.973001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2824186a-d211-4a18-8470-8513717bba0d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:41.978488 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2824186a-d211-4a18-8470-8513717bba0d tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 404 len: 111 microversion: 2.1 time: 0.118329 Oct 27 19:09:41.979670 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2594/4984] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:09:41 2022] DELETE /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:41.992134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7c970deb-2e3c-43e5-a5f6-59bd887f8293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:41.993025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7c970deb-2e3c-43e5-a5f6-59bd887f8293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 1b2b4bcc-c45c-49b4-af4e-039935fe8285] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:42.009871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c970deb-2e3c-43e5-a5f6-59bd887f8293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:42.010778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c970deb-2e3c-43e5-a5f6-59bd887f8293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:42.011407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c970deb-2e3c-43e5-a5f6-59bd887f8293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:42.015635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c970deb-2e3c-43e5-a5f6-59bd887f8293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:42.016372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c970deb-2e3c-43e5-a5f6-59bd887f8293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:42.017014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c970deb-2e3c-43e5-a5f6-59bd887f8293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:42.050807 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-7c970deb-2e3c-43e5-a5f6-59bd887f8293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7c970deb-2e3c-43e5-a5f6-59bd887f8293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 HTTP/1.1 Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '1b2b4bcc-c45c-49b4-af4e-039935fe8285'} Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.055720 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:42.062908 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:42.062908 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:42.062908 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:42.062908 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:42.062908 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. Oct 27 19:09:42.062908 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.062908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7c970deb-2e3c-43e5-a5f6-59bd887f8293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance 1b2b4bcc-c45c-49b4-af4e-039935fe8285 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:42.064461 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7c970deb-2e3c-43e5-a5f6-59bd887f8293 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285" status: 404 len: 111 microversion: 2.1 time: 0.080708 Oct 27 19:09:42.065625 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2595/4985] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:41 2022] GET /compute/v2.1/servers/1b2b4bcc-c45c-49b4-af4e-039935fe8285 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:42.084158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d24e37a-fe53-43c8-b4c2-f19a2a3fb715 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:42.090573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9d24e37a-fe53-43c8-b4c2-f19a2a3fb715 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:42.133273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d24e37a-fe53-43c8-b4c2-f19a2a3fb715 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:42.134580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d24e37a-fe53-43c8-b4c2-f19a2a3fb715 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:42.136862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d24e37a-fe53-43c8-b4c2-f19a2a3fb715 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:42.138064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d24e37a-fe53-43c8-b4c2-f19a2a3fb715 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:42.139527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d24e37a-fe53-43c8-b4c2-f19a2a3fb715 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:42.140914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d24e37a-fe53-43c8-b4c2-f19a2a3fb715 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:42.179473 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-9d24e37a-fe53-43c8-b4c2-f19a2a3fb715 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d24e37a-fe53-43c8-b4c2-f19a2a3fb715 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 HTTP/1.1 Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '949c81d5-cb44-4624-b4bf-f3a4aab10ba8'} Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:42.181328 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:09:42.187153 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.187153 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:42.187153 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.187153 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:42.187153 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:42.187153 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:42.187153 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:42.187153 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:42.187153 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:09:42.187153 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.191245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d24e37a-fe53-43c8-b4c2-f19a2a3fb715 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:42.193870 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9d24e37a-fe53-43c8-b4c2-f19a2a3fb715 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 404 len: 111 microversion: 2.1 time: 0.122051 Oct 27 19:09:42.195262 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2596/4986] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:09:42 2022] DELETE /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:42.204438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a94ad86-ce89-4ff3-930b-66d3be005919 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:42.205522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1a94ad86-ce89-4ff3-930b-66d3be005919 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 949c81d5-cb44-4624-b4bf-f3a4aab10ba8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:42.213104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a94ad86-ce89-4ff3-930b-66d3be005919 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:42.213841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a94ad86-ce89-4ff3-930b-66d3be005919 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:42.214873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a94ad86-ce89-4ff3-930b-66d3be005919 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:42.219418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a94ad86-ce89-4ff3-930b-66d3be005919 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:42.220277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a94ad86-ce89-4ff3-930b-66d3be005919 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:42.220801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a94ad86-ce89-4ff3-930b-66d3be005919 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:42.266224 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-1a94ad86-ce89-4ff3-930b-66d3be005919 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a94ad86-ce89-4ff3-930b-66d3be005919 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 HTTP/1.1 Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '949c81d5-cb44-4624-b4bf-f3a4aab10ba8'} Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.272381 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:42.278086 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:42.278086 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:42.278086 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:42.278086 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:42.278086 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. Oct 27 19:09:42.278086 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:42.278086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a94ad86-ce89-4ff3-930b-66d3be005919 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance 949c81d5-cb44-4624-b4bf-f3a4aab10ba8 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:42.278086 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1a94ad86-ce89-4ff3-930b-66d3be005919 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8" status: 404 len: 111 microversion: 2.1 time: 0.075100 Oct 27 19:09:42.279479 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2597/4987] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:42 2022] GET /compute/v2.1/servers/949c81d5-cb44-4624-b4bf-f3a4aab10ba8 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:42.303035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-663f3d7a-23f4-4582-8e27-7e80e46598ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:42.305314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-663f3d7a-23f4-4582-8e27-7e80e46598ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:42.334136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-663f3d7a-23f4-4582-8e27-7e80e46598ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:42.334670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-663f3d7a-23f4-4582-8e27-7e80e46598ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:42.335139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-663f3d7a-23f4-4582-8e27-7e80e46598ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:42.335864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-663f3d7a-23f4-4582-8e27-7e80e46598ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:42.336342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-663f3d7a-23f4-4582-8e27-7e80e46598ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:42.336784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-663f3d7a-23f4-4582-8e27-7e80e46598ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:42.361793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] validate_networks() for [('e7d83c6b-c0c0-42e5-b094-5dc26599221d', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:09:42.992660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-663f3d7a-23f4-4582-8e27-7e80e46598ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:43.012887 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-663f3d7a-23f4-4582-8e27-7e80e46598ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.725737 Oct 27 19:09:43.016342 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2598/4988] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:42 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:43.034031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cdf11d8f-7d80-4fa8-a572-3bd65ffc8664 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:43.036136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cdf11d8f-7d80-4fa8-a572-3bd65ffc8664 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:43.057234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdf11d8f-7d80-4fa8-a572-3bd65ffc8664 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.060285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdf11d8f-7d80-4fa8-a572-3bd65ffc8664 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.060813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdf11d8f-7d80-4fa8-a572-3bd65ffc8664 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.064792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdf11d8f-7d80-4fa8-a572-3bd65ffc8664 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.066414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdf11d8f-7d80-4fa8-a572-3bd65ffc8664 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.066907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdf11d8f-7d80-4fa8-a572-3bd65ffc8664 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.126982 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-cdf11d8f-7d80-4fa8-a572-3bd65ffc8664 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cdf11d8f-7d80-4fa8-a572-3bd65ffc8664 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed HTTP/1.1 Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '27b8db6d-ccea-4fb9-bdae-06d0f08708ed'} Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:43.135239 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:09:43.140456 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.140456 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:43.140456 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.140456 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.140456 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:43.140456 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:43.140456 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:43.140456 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:43.140456 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:09:43.140456 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.140456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cdf11d8f-7d80-4fa8-a572-3bd65ffc8664 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:43.144561 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cdf11d8f-7d80-4fa8-a572-3bd65ffc8664 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 404 len: 111 microversion: 2.1 time: 0.121497 Oct 27 19:09:43.144561 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2599/4989] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:09:43 2022] DELETE /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:43.169643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f4d07f24-335a-4549-b74f-5357086437a7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:43.170275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f4d07f24-335a-4549-b74f-5357086437a7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:43.209326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4d07f24-335a-4549-b74f-5357086437a7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.209844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4d07f24-335a-4549-b74f-5357086437a7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.210291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4d07f24-335a-4549-b74f-5357086437a7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.211042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4d07f24-335a-4549-b74f-5357086437a7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.211505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4d07f24-335a-4549-b74f-5357086437a7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.216618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4d07f24-335a-4549-b74f-5357086437a7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.481588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f4d07f24-335a-4549-b74f-5357086437a7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:43.489425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:43.497650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f4d07f24-335a-4549-b74f-5357086437a7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:43.499746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f4d07f24-335a-4549-b74f-5357086437a7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:43.517291 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f4d07f24-335a-4549-b74f-5357086437a7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.374426 Oct 27 19:09:43.518081 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2600/4990] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:43 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:43.531149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1e8935ba-a437-4f7d-b175-c6195be4ced1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:43.532050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1e8935ba-a437-4f7d-b175-c6195be4ced1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 27b8db6d-ccea-4fb9-bdae-06d0f08708ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:43.545711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e8935ba-a437-4f7d-b175-c6195be4ced1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.546533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e8935ba-a437-4f7d-b175-c6195be4ced1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.549146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e8935ba-a437-4f7d-b175-c6195be4ced1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.550158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e8935ba-a437-4f7d-b175-c6195be4ced1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.551423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e8935ba-a437-4f7d-b175-c6195be4ced1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.553403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e8935ba-a437-4f7d-b175-c6195be4ced1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.565755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:09:43.566252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:09:43.567411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:09:43.567839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:09:43.568353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:09:43.596565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.604585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.607488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.609307 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-1e8935ba-a437-4f7d-b175-c6195be4ced1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1e8935ba-a437-4f7d-b175-c6195be4ced1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed HTTP/1.1 Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '27b8db6d-ccea-4fb9-bdae-06d0f08708ed'} Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.611647 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.616992 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:43.616992 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:43.616992 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:43.616992 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:43.616992 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. Oct 27 19:09:43.616992 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.618183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.622318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.623439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1e8935ba-a437-4f7d-b175-c6195be4ced1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance 27b8db6d-ccea-4fb9-bdae-06d0f08708ed could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:43.625189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.626349 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1e8935ba-a437-4f7d-b175-c6195be4ced1 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed" status: 404 len: 111 microversion: 2.1 time: 0.106739 Oct 27 19:09:43.630608 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2601/4991] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:43 2022] GET /compute/v2.1/servers/27b8db6d-ccea-4fb9-bdae-06d0f08708ed => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:43.643048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-70409d7e-a74d-4598-9b5c-ec86741158d2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:43.645146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-70409d7e-a74d-4598-9b5c-ec86741158d2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:43.669084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70409d7e-a74d-4598-9b5c-ec86741158d2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.669591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70409d7e-a74d-4598-9b5c-ec86741158d2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.674909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70409d7e-a74d-4598-9b5c-ec86741158d2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.677311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70409d7e-a74d-4598-9b5c-ec86741158d2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.677976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70409d7e-a74d-4598-9b5c-ec86741158d2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.683576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-70409d7e-a74d-4598-9b5c-ec86741158d2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.684329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Getting quotas for project 1798d878b8344ec69c9ef0699467718a. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:09:43.705430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Getting quotas for user b2237837d17c43e99f4e9961cd27cbb5 and project 1798d878b8344ec69c9ef0699467718a. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:09:43.724052 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-70409d7e-a74d-4598-9b5c-ec86741158d2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-70409d7e-a74d-4598-9b5c-ec86741158d2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb HTTP/1.1 Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'b59682c2-3372-419f-b903-46d5e52dfcbb'} Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:43.725675 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:09:43.734080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.734080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:43.734080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.734080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.734080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:43.734080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:43.734080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:43.734080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:43.734080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:09:43.734080 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.734080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-70409d7e-a74d-4598-9b5c-ec86741158d2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:43.734080 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-70409d7e-a74d-4598-9b5c-ec86741158d2 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 404 len: 111 microversion: 2.1 time: 0.092433 Oct 27 19:09:43.734080 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2602/4992] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:09:43 2022] DELETE /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:09:43.745895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fd5de09e-9770-47de-bad3-fb2ee610a017 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:43.746672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fd5de09e-9770-47de-bad3-fb2ee610a017 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: b59682c2-3372-419f-b903-46d5e52dfcbb] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:43.755441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5de09e-9770-47de-bad3-fb2ee610a017 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.755985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5de09e-9770-47de-bad3-fb2ee610a017 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.760885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5de09e-9770-47de-bad3-fb2ee610a017 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.761542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5de09e-9770-47de-bad3-fb2ee610a017 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.762005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5de09e-9770-47de-bad3-fb2ee610a017 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.762477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:09:43.762633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd5de09e-9770-47de-bad3-fb2ee610a017 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.768901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:09:43.795344 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-fd5de09e-9770-47de-bad3-fb2ee610a017 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fd5de09e-9770-47de-bad3-fb2ee610a017 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb HTTP/1.1 Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'b59682c2-3372-419f-b903-46d5e52dfcbb'} Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.797590 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.806701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:43.806701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:43.806701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:43.806701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:43.806701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. Oct 27 19:09:43.806701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.806701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fd5de09e-9770-47de-bad3-fb2ee610a017 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance b59682c2-3372-419f-b903-46d5e52dfcbb could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:43.806701 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fd5de09e-9770-47de-bad3-fb2ee610a017 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb" status: 404 len: 111 microversion: 2.1 time: 0.057580 Oct 27 19:09:43.806701 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2603/4993] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:43 2022] GET /compute/v2.1/servers/b59682c2-3372-419f-b903-46d5e52dfcbb => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:43.819292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9c7804e-52d5-41bf-b79b-7e0ae3af5eab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:43.819807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c9c7804e-52d5-41bf-b79b-7e0ae3af5eab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:43.844387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c7804e-52d5-41bf-b79b-7e0ae3af5eab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.845319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c7804e-52d5-41bf-b79b-7e0ae3af5eab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.848819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c7804e-52d5-41bf-b79b-7e0ae3af5eab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.850239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c7804e-52d5-41bf-b79b-7e0ae3af5eab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.854639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c7804e-52d5-41bf-b79b-7e0ae3af5eab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.855329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c7804e-52d5-41bf-b79b-7e0ae3af5eab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.900341 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-c9c7804e-52d5-41bf-b79b-7e0ae3af5eab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9c7804e-52d5-41bf-b79b-7e0ae3af5eab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e HTTP/1.1 Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '5917fe3b-b247-4012-8137-7539241f129e'} Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:43.902220 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:09:43.908240 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.908240 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:43.908240 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.908240 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:43.908240 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:43.908240 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:43.908240 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:43.908240 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:43.908240 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:09:43.908240 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:43.910567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9c7804e-52d5-41bf-b79b-7e0ae3af5eab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:43.911654 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c9c7804e-52d5-41bf-b79b-7e0ae3af5eab tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 404 len: 111 microversion: 2.1 time: 0.097744 Oct 27 19:09:43.912701 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2604/4994] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:09:43 2022] DELETE /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:43.932293 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aedb501f-6b87-49de-a4e6-83cfc6fdd8fa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.470460 Oct 27 19:09:43.932969 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2391/4995] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:09:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 7474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 19:09:43.939742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5fe69667-6f98-4935-9857-455dd3bce57b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:43.946361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5fe69667-6f98-4935-9857-455dd3bce57b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 5917fe3b-b247-4012-8137-7539241f129e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:43.949411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf6be71c-84b7-41f0-a989-f81c51fe0e37 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:43.951973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf6be71c-84b7-41f0-a989-f81c51fe0e37 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:43.963648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fe69667-6f98-4935-9857-455dd3bce57b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.963648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fe69667-6f98-4935-9857-455dd3bce57b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.969573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fe69667-6f98-4935-9857-455dd3bce57b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:43.973523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fe69667-6f98-4935-9857-455dd3bce57b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:43.974923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fe69667-6f98-4935-9857-455dd3bce57b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:43.975649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fe69667-6f98-4935-9857-455dd3bce57b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:44.033383 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-5fe69667-6f98-4935-9857-455dd3bce57b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5fe69667-6f98-4935-9857-455dd3bce57b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e HTTP/1.1 Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '5917fe3b-b247-4012-8137-7539241f129e'} Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.037408 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.042626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:44.042626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:44.042626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:44.042626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:44.042626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. Oct 27 19:09:44.042626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.042626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5fe69667-6f98-4935-9857-455dd3bce57b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance 5917fe3b-b247-4012-8137-7539241f129e could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:44.046521 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5fe69667-6f98-4935-9857-455dd3bce57b tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e" status: 404 len: 111 microversion: 2.1 time: 0.120074 Oct 27 19:09:44.050019 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2605/4996] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:43 2022] GET /compute/v2.1/servers/5917fe3b-b247-4012-8137-7539241f129e => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:44.059541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2b294296-3efc-4aa4-82b6-d9ff1437741a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:44.063881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2b294296-3efc-4aa4-82b6-d9ff1437741a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:44.078990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b294296-3efc-4aa4-82b6-d9ff1437741a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:44.082185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b294296-3efc-4aa4-82b6-d9ff1437741a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:44.082768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b294296-3efc-4aa4-82b6-d9ff1437741a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:44.083721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b294296-3efc-4aa4-82b6-d9ff1437741a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:44.084276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b294296-3efc-4aa4-82b6-d9ff1437741a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:44.086602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b294296-3efc-4aa4-82b6-d9ff1437741a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:44.147630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf6be71c-84b7-41f0-a989-f81c51fe0e37 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:44.159457 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf6be71c-84b7-41f0-a989-f81c51fe0e37 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1214 microversion: 2.1 time: 0.217769 Oct 27 19:09:44.160049 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2392/4997] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:43 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1214 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:44.175813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8341b090-feb9-46bd-a690-8e77a22312a5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:44.176338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8341b090-feb9-46bd-a690-8e77a22312a5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:44.194029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8341b090-feb9-46bd-a690-8e77a22312a5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:44.194862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8341b090-feb9-46bd-a690-8e77a22312a5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:44.196508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8341b090-feb9-46bd-a690-8e77a22312a5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:44.197451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8341b090-feb9-46bd-a690-8e77a22312a5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:44.198308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8341b090-feb9-46bd-a690-8e77a22312a5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:44.199007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8341b090-feb9-46bd-a690-8e77a22312a5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:44.236800 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-8341b090-feb9-46bd-a690-8e77a22312a5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8341b090-feb9-46bd-a690-8e77a22312a5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 HTTP/1.1 Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'd0eab732-8c21-49ce-9687-a3fecd1284b4'} Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:44.238750 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:09:44.244068 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.244068 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:44.244068 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.244068 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.244068 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:44.244068 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:44.244068 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:44.244068 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:44.244068 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:09:44.244068 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.248527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8341b090-feb9-46bd-a690-8e77a22312a5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:44.250200 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8341b090-feb9-46bd-a690-8e77a22312a5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 404 len: 111 microversion: 2.1 time: 0.082534 Oct 27 19:09:44.251383 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2393/4998] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:09:44 2022] DELETE /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:44.267775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-271ed829-b0de-4f82-ad7d-c37fb2920be9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:44.268975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-271ed829-b0de-4f82-ad7d-c37fb2920be9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: d0eab732-8c21-49ce-9687-a3fecd1284b4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:44.281172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-271ed829-b0de-4f82-ad7d-c37fb2920be9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:44.284735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-271ed829-b0de-4f82-ad7d-c37fb2920be9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:44.287042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-271ed829-b0de-4f82-ad7d-c37fb2920be9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:44.290124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-271ed829-b0de-4f82-ad7d-c37fb2920be9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:44.291369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-271ed829-b0de-4f82-ad7d-c37fb2920be9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:44.293212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-271ed829-b0de-4f82-ad7d-c37fb2920be9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:44.321329 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-271ed829-b0de-4f82-ad7d-c37fb2920be9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-271ed829-b0de-4f82-ad7d-c37fb2920be9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 HTTP/1.1 Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'd0eab732-8c21-49ce-9687-a3fecd1284b4'} Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.324476 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.332131 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:44.332131 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:44.332131 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:44.332131 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:44.332131 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. Oct 27 19:09:44.332131 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.336115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-271ed829-b0de-4f82-ad7d-c37fb2920be9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance d0eab732-8c21-49ce-9687-a3fecd1284b4 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:44.337253 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-271ed829-b0de-4f82-ad7d-c37fb2920be9 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4" status: 404 len: 111 microversion: 2.1 time: 0.080821 Oct 27 19:09:44.344202 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2394/4999] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:44 2022] GET /compute/v2.1/servers/d0eab732-8c21-49ce-9687-a3fecd1284b4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:44.353500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4d64bd0f-18c4-49ce-a6bb-1cbda80a1dd5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:44.360549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4d64bd0f-18c4-49ce-a6bb-1cbda80a1dd5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: a7f303ec-0462-4187-9eaf-73d0d503bf2c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:44.381318 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-4d64bd0f-18c4-49ce-a6bb-1cbda80a1dd5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4d64bd0f-18c4-49ce-a6bb-1cbda80a1dd5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/a7f303ec-0462-4187-9eaf-73d0d503bf2c HTTP/1.1 Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a7f303ec-0462-4187-9eaf-73d0d503bf2c'} Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:44.387244 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.393344 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.393344 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:44.393344 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:44.393344 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:44.393344 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:44.393344 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:09:44.393344 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.393344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4d64bd0f-18c4-49ce-a6bb-1cbda80a1dd5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:44.393344 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4d64bd0f-18c4-49ce-a6bb-1cbda80a1dd5 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a7f303ec-0462-4187-9eaf-73d0d503bf2c" status: 404 len: 111 microversion: 2.1 time: 0.040468 Oct 27 19:09:44.393344 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2395/5000] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:09:44 2022] DELETE /compute/v2.1/servers/a7f303ec-0462-4187-9eaf-73d0d503bf2c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:44.405100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-12a15947-e033-49c9-a110-368ab82f7133 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:44.405812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-12a15947-e033-49c9-a110-368ab82f7133 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: a7f303ec-0462-4187-9eaf-73d0d503bf2c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:44.426011 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-12a15947-e033-49c9-a110-368ab82f7133 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-12a15947-e033-49c9-a110-368ab82f7133 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/a7f303ec-0462-4187-9eaf-73d0d503bf2c HTTP/1.1 Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a7f303ec-0462-4187-9eaf-73d0d503bf2c'} Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:44.431063 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:44.436119 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:44.436119 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:44.436119 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. Oct 27 19:09:44.436119 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:44.436119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-12a15947-e033-49c9-a110-368ab82f7133 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance a7f303ec-0462-4187-9eaf-73d0d503bf2c could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:44.436119 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-12a15947-e033-49c9-a110-368ab82f7133 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f303ec-0462-4187-9eaf-73d0d503bf2c" status: 404 len: 111 microversion: 2.1 time: 0.038193 Oct 27 19:09:44.436119 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2396/5001] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:44 2022] GET /compute/v2.1/servers/a7f303ec-0462-4187-9eaf-73d0d503bf2c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:09:44.449399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-afaf61e6-ad1d-47f6-92a4-77dbb5c4deba tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:44.450139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-afaf61e6-ad1d-47f6-92a4-77dbb5c4deba tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:44.458001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afaf61e6-ad1d-47f6-92a4-77dbb5c4deba tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:44.458675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afaf61e6-ad1d-47f6-92a4-77dbb5c4deba tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:44.459215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afaf61e6-ad1d-47f6-92a4-77dbb5c4deba tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:44.460092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afaf61e6-ad1d-47f6-92a4-77dbb5c4deba tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:44.460681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afaf61e6-ad1d-47f6-92a4-77dbb5c4deba tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:44.461186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afaf61e6-ad1d-47f6-92a4-77dbb5c4deba tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:44.546711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-afaf61e6-ad1d-47f6-92a4-77dbb5c4deba tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:09:44.772671 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-afaf61e6-ad1d-47f6-92a4-77dbb5c4deba tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "DELETE /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 204 len: 0 microversion: 2.1 time: 0.332047 Oct 27 19:09:44.774869 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2397/5002] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:09:44 2022] DELETE /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:09:44.784751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d1b31f92-b83f-4155-8412-29be9208710e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:44.786723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d1b31f92-b83f-4155-8412-29be9208710e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:44.795493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b31f92-b83f-4155-8412-29be9208710e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:44.797359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b31f92-b83f-4155-8412-29be9208710e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:44.798494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b31f92-b83f-4155-8412-29be9208710e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:44.799949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b31f92-b83f-4155-8412-29be9208710e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:44.800660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b31f92-b83f-4155-8412-29be9208710e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:44.801759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1b31f92-b83f-4155-8412-29be9208710e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:44.932673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d1b31f92-b83f-4155-8412-29be9208710e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:44.948602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d1b31f92-b83f-4155-8412-29be9208710e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:44.950246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d1b31f92-b83f-4155-8412-29be9208710e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:44.979778 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d1b31f92-b83f-4155-8412-29be9208710e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.202495 Oct 27 19:09:45.000311 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2398/5003] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:44 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:45.026528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a5b21d97-bcc1-49b3-879f-448f07f4ff6c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:45.027847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a5b21d97-bcc1-49b3-879f-448f07f4ff6c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:45.045951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5b21d97-bcc1-49b3-879f-448f07f4ff6c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:45.047525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5b21d97-bcc1-49b3-879f-448f07f4ff6c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:45.048591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5b21d97-bcc1-49b3-879f-448f07f4ff6c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:45.049574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5b21d97-bcc1-49b3-879f-448f07f4ff6c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:45.050649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5b21d97-bcc1-49b3-879f-448f07f4ff6c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:45.051252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5b21d97-bcc1-49b3-879f-448f07f4ff6c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:45.406366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a5b21d97-bcc1-49b3-879f-448f07f4ff6c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:45.419371 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a5b21d97-bcc1-49b3-879f-448f07f4ff6c tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1478 microversion: 2.1 time: 0.416829 Oct 27 19:09:45.424532 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2399/5004] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:45 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1478 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:45.436735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc740fb9-d5ec-4180-aa19-251b00bee1fd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:45.437867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fc740fb9-d5ec-4180-aa19-251b00bee1fd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:45.460125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:45.472398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc740fb9-d5ec-4180-aa19-251b00bee1fd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:45.473430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc740fb9-d5ec-4180-aa19-251b00bee1fd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:45.475632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc740fb9-d5ec-4180-aa19-251b00bee1fd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:45.478810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc740fb9-d5ec-4180-aa19-251b00bee1fd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:45.481809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc740fb9-d5ec-4180-aa19-251b00bee1fd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:45.483299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc740fb9-d5ec-4180-aa19-251b00bee1fd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:45.779731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc740fb9-d5ec-4180-aa19-251b00bee1fd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:45.788627 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc740fb9-d5ec-4180-aa19-251b00bee1fd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1266 microversion: 2.1 time: 0.362280 Oct 27 19:09:45.789243 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2400/5005] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:45 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1266 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:46.031544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-79878e98-189a-4abd-aa7f-51200d6ac508 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:46.032258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-79878e98-189a-4abd-aa7f-51200d6ac508 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:46.049431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79878e98-189a-4abd-aa7f-51200d6ac508 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:46.050509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79878e98-189a-4abd-aa7f-51200d6ac508 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:46.054025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79878e98-189a-4abd-aa7f-51200d6ac508 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:46.055198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79878e98-189a-4abd-aa7f-51200d6ac508 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:46.055920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79878e98-189a-4abd-aa7f-51200d6ac508 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:46.058659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79878e98-189a-4abd-aa7f-51200d6ac508 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:46.103996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2b294296-3efc-4aa4-82b6-d9ff1437741a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:46.118333 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2b294296-3efc-4aa4-82b6-d9ff1437741a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 2.067062 Oct 27 19:09:46.125233 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2606/5006] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:44 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 2075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:46.154850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9dcd27b3-e13c-4eb4-a311-5db4a590dd9c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1619233583"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:46.160361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9dcd27b3-e13c-4eb4-a311-5db4a590dd9c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:46.180592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dcd27b3-e13c-4eb4-a311-5db4a590dd9c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:46.185107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dcd27b3-e13c-4eb4-a311-5db4a590dd9c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:46.185926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dcd27b3-e13c-4eb4-a311-5db4a590dd9c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:46.188905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dcd27b3-e13c-4eb4-a311-5db4a590dd9c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:46.190919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dcd27b3-e13c-4eb4-a311-5db4a590dd9c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:46.191924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dcd27b3-e13c-4eb4-a311-5db4a590dd9c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:46.245375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-79878e98-189a-4abd-aa7f-51200d6ac508 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:46.263391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-79878e98-189a-4abd-aa7f-51200d6ac508 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:46.266935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-79878e98-189a-4abd-aa7f-51200d6ac508 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:46.300983 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-79878e98-189a-4abd-aa7f-51200d6ac508 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.275563 Oct 27 19:09:46.308219 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2401/5007] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:46 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:46.455311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0432c3e3-12b1-4f45-989c-56d339b0ac01 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:46.456047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0432c3e3-12b1-4f45-989c-56d339b0ac01 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:46.493473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0432c3e3-12b1-4f45-989c-56d339b0ac01 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:46.495917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0432c3e3-12b1-4f45-989c-56d339b0ac01 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:46.497372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0432c3e3-12b1-4f45-989c-56d339b0ac01 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:46.503344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0432c3e3-12b1-4f45-989c-56d339b0ac01 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:46.506410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0432c3e3-12b1-4f45-989c-56d339b0ac01 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:46.508777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0432c3e3-12b1-4f45-989c-56d339b0ac01 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:46.814191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0432c3e3-12b1-4f45-989c-56d339b0ac01 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:46.824904 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0432c3e3-12b1-4f45-989c-56d339b0ac01 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1478 microversion: 2.1 time: 0.375203 Oct 27 19:09:46.826583 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2402/5008] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:46 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1478 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:46.832791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-9c6982ef-2011-46e0-8ae4-9291db987d07 req-d1d78178-fe8b-44f2-93f5-363c63ff8650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c", "name": "network-vif-unplugged", "status": "completed", "tag": "80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:46.849906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9c6982ef-2011-46e0-8ae4-9291db987d07 req-d1d78178-fe8b-44f2-93f5-363c63ff8650 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:46.850772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9c6982ef-2011-46e0-8ae4-9291db987d07 req-d1d78178-fe8b-44f2-93f5-363c63ff8650 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:46.851457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9c6982ef-2011-46e0-8ae4-9291db987d07 req-d1d78178-fe8b-44f2-93f5-363c63ff8650 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:46.870883 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-9c6982ef-2011-46e0-8ae4-9291db987d07 req-d1d78178-fe8b-44f2-93f5-363c63ff8650 service nova] Creating event network-vif-unplugged:80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4 for instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c on n-h1-860687-3 Oct 27 19:09:46.880057 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-9c6982ef-2011-46e0-8ae4-9291db987d07 req-d1d78178-fe8b-44f2-93f5-363c63ff8650 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049127 Oct 27 19:09:46.881317 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2403/5009] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:09:46.895728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0283d807-bcbd-49a2-921f-c1075bc1952c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:46.905055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0283d807-bcbd-49a2-921f-c1075bc1952c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:46.913599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0283d807-bcbd-49a2-921f-c1075bc1952c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:46.916204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0283d807-bcbd-49a2-921f-c1075bc1952c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:46.916983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0283d807-bcbd-49a2-921f-c1075bc1952c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:46.918242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0283d807-bcbd-49a2-921f-c1075bc1952c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:46.918977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0283d807-bcbd-49a2-921f-c1075bc1952c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:46.920183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0283d807-bcbd-49a2-921f-c1075bc1952c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:47.091510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0283d807-bcbd-49a2-921f-c1075bc1952c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:47.112927 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0283d807-bcbd-49a2-921f-c1075bc1952c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1272 microversion: 2.1 time: 0.229431 Oct 27 19:09:47.114483 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2404/5010] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:46 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1272 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:47.342788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f5043676-7f82-444f-b893-5fd86c54fd52 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:47.345093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f5043676-7f82-444f-b893-5fd86c54fd52 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:47.358038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5043676-7f82-444f-b893-5fd86c54fd52 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:47.377798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5043676-7f82-444f-b893-5fd86c54fd52 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:47.378591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5043676-7f82-444f-b893-5fd86c54fd52 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:47.380715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5043676-7f82-444f-b893-5fd86c54fd52 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:47.382501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5043676-7f82-444f-b893-5fd86c54fd52 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:47.383180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5043676-7f82-444f-b893-5fd86c54fd52 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:47.544124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f5043676-7f82-444f-b893-5fd86c54fd52 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:47.557816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f5043676-7f82-444f-b893-5fd86c54fd52 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:47.561584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f5043676-7f82-444f-b893-5fd86c54fd52 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:47.576668 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f5043676-7f82-444f-b893-5fd86c54fd52 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.239095 Oct 27 19:09:47.579614 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2405/5011] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:47 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:09:47.857216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-58af3594-04eb-4d6a-a410-90b8d967eabb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:47.859197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-58af3594-04eb-4d6a-a410-90b8d967eabb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:47.870407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58af3594-04eb-4d6a-a410-90b8d967eabb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:47.875549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58af3594-04eb-4d6a-a410-90b8d967eabb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:47.879850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58af3594-04eb-4d6a-a410-90b8d967eabb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:47.882312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58af3594-04eb-4d6a-a410-90b8d967eabb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:47.885006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58af3594-04eb-4d6a-a410-90b8d967eabb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:47.887910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58af3594-04eb-4d6a-a410-90b8d967eabb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:48.092859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-58af3594-04eb-4d6a-a410-90b8d967eabb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:48.111156 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-58af3594-04eb-4d6a-a410-90b8d967eabb tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1436 microversion: 2.1 time: 0.257799 Oct 27 19:09:48.122687 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2406/5012] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:47 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1436 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:48.142887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4e8fe888-7472-4f68-90bd-168bde5dc220 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:48.144025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4e8fe888-7472-4f68-90bd-168bde5dc220 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:48.162009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e8fe888-7472-4f68-90bd-168bde5dc220 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:48.163127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e8fe888-7472-4f68-90bd-168bde5dc220 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:48.167191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e8fe888-7472-4f68-90bd-168bde5dc220 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:48.169796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e8fe888-7472-4f68-90bd-168bde5dc220 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:48.172421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e8fe888-7472-4f68-90bd-168bde5dc220 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:48.173157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e8fe888-7472-4f68-90bd-168bde5dc220 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:48.321249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4e8fe888-7472-4f68-90bd-168bde5dc220 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:48.342241 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4e8fe888-7472-4f68-90bd-168bde5dc220 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1272 microversion: 2.1 time: 0.204798 Oct 27 19:09:48.346518 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2407/5013] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:48 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:09:48.353615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d7edb746-c4e5-4bbf-ae8e-403af55f60c4 req-e75c0363-6566-4ba2-85a1-bf6f0746aafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d3abfc-e621-46a7-9e2b-3dad1673ff89", "name": "network-vif-deleted", "tag": "c6f45d77-1900-4222-9094-2324c63a93c7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:48.369878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d7edb746-c4e5-4bbf-ae8e-403af55f60c4 req-e75c0363-6566-4ba2-85a1-bf6f0746aafe service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:48.371679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d7edb746-c4e5-4bbf-ae8e-403af55f60c4 req-e75c0363-6566-4ba2-85a1-bf6f0746aafe service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:48.372415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d7edb746-c4e5-4bbf-ae8e-403af55f60c4 req-e75c0363-6566-4ba2-85a1-bf6f0746aafe service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:48.402143 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d7edb746-c4e5-4bbf-ae8e-403af55f60c4 req-e75c0363-6566-4ba2-85a1-bf6f0746aafe service nova] Creating event network-vif-deleted:c6f45d77-1900-4222-9094-2324c63a93c7 for instance 18d3abfc-e621-46a7-9e2b-3dad1673ff89 on n-h1-860687-3 Oct 27 19:09:48.410078 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d7edb746-c4e5-4bbf-ae8e-403af55f60c4 req-e75c0363-6566-4ba2-85a1-bf6f0746aafe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061671 Oct 27 19:09:48.413308 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2408/5014] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:09:48.619854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf8f49e4-ab07-4aca-8f62-fcab766b84ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:48.625083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf8f49e4-ab07-4aca-8f62-fcab766b84ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:48.690687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf8f49e4-ab07-4aca-8f62-fcab766b84ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:48.692754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf8f49e4-ab07-4aca-8f62-fcab766b84ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:48.695822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf8f49e4-ab07-4aca-8f62-fcab766b84ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:48.697038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf8f49e4-ab07-4aca-8f62-fcab766b84ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:48.717262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf8f49e4-ab07-4aca-8f62-fcab766b84ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:48.719372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf8f49e4-ab07-4aca-8f62-fcab766b84ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:48.950707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf8f49e4-ab07-4aca-8f62-fcab766b84ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:48.973780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf8f49e4-ab07-4aca-8f62-fcab766b84ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:48.975569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf8f49e4-ab07-4aca-8f62-fcab766b84ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:49.019942 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf8f49e4-ab07-4aca-8f62-fcab766b84ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.413600 Oct 27 19:09:49.039023 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2409/5015] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:48 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:49.138415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ed471dd6-0e35-4511-b049-89592c828d3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:49.139055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ed471dd6-0e35-4511-b049-89592c828d3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:49.156339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed471dd6-0e35-4511-b049-89592c828d3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:49.173987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed471dd6-0e35-4511-b049-89592c828d3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:49.174596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed471dd6-0e35-4511-b049-89592c828d3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:49.175374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed471dd6-0e35-4511-b049-89592c828d3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:49.175862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed471dd6-0e35-4511-b049-89592c828d3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:49.176352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed471dd6-0e35-4511-b049-89592c828d3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:49.413094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:49.451472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed471dd6-0e35-4511-b049-89592c828d3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:49.452168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed471dd6-0e35-4511-b049-89592c828d3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:49.456138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed471dd6-0e35-4511-b049-89592c828d3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:49.457748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-ed471dd6-0e35-4511-b049-89592c828d3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lazy-loading 'fault' on Instance uuid 18d3abfc-e621-46a7-9e2b-3dad1673ff89 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:09:49.753291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ed471dd6-0e35-4511-b049-89592c828d3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d5767d1dc249cd8e97097588ee4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5ccdbb2594418aa42c014a1ec60554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:49.769354 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ed471dd6-0e35-4511-b049-89592c828d3a tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 200 len: 1282 microversion: 2.1 time: 0.635986 Oct 27 19:09:49.773105 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2410/5016] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:49 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 1282 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:49.804931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71ef9fdf-4e1c-40ec-9951-7b16aae92373 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:49.813022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-71ef9fdf-4e1c-40ec-9951-7b16aae92373 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:49.828964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71ef9fdf-4e1c-40ec-9951-7b16aae92373 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:49.830299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71ef9fdf-4e1c-40ec-9951-7b16aae92373 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:49.836249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71ef9fdf-4e1c-40ec-9951-7b16aae92373 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:49.838132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71ef9fdf-4e1c-40ec-9951-7b16aae92373 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:49.839402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71ef9fdf-4e1c-40ec-9951-7b16aae92373 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:49.840508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71ef9fdf-4e1c-40ec-9951-7b16aae92373 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:50.897218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-71ef9fdf-4e1c-40ec-9951-7b16aae92373 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:50.911395 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-71ef9fdf-4e1c-40ec-9951-7b16aae92373 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1272 microversion: 2.1 time: 1.136474 Oct 27 19:09:50.916067 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2411/5017] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:49 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1272 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:50.924324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ad7ea85d-950c-4660-8e8b-19e3d8c4f295 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:50.927943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ad7ea85d-950c-4660-8e8b-19e3d8c4f295 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:50.946071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad7ea85d-950c-4660-8e8b-19e3d8c4f295 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:50.947019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad7ea85d-950c-4660-8e8b-19e3d8c4f295 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:50.947755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad7ea85d-950c-4660-8e8b-19e3d8c4f295 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:50.948742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad7ea85d-950c-4660-8e8b-19e3d8c4f295 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:50.949442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad7ea85d-950c-4660-8e8b-19e3d8c4f295 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:50.950128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad7ea85d-950c-4660-8e8b-19e3d8c4f295 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:51.311217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ad7ea85d-950c-4660-8e8b-19e3d8c4f295 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:51.325033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ad7ea85d-950c-4660-8e8b-19e3d8c4f295 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:51.326866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ad7ea85d-950c-4660-8e8b-19e3d8c4f295 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:51.344588 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ad7ea85d-950c-4660-8e8b-19e3d8c4f295 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.426791 Oct 27 19:09:51.347028 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2412/5018] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:50 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:51.359858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-84e580eb-2bda-49f4-b3ae-c4bb02344268 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:51.362475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-84e580eb-2bda-49f4-b3ae-c4bb02344268 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] [instance: 18d3abfc-e621-46a7-9e2b-3dad1673ff89] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:51.391195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84e580eb-2bda-49f4-b3ae-c4bb02344268 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:51.399570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84e580eb-2bda-49f4-b3ae-c4bb02344268 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:51.401307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84e580eb-2bda-49f4-b3ae-c4bb02344268 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:51.404704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84e580eb-2bda-49f4-b3ae-c4bb02344268 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:51.406000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84e580eb-2bda-49f4-b3ae-c4bb02344268 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:51.409604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84e580eb-2bda-49f4-b3ae-c4bb02344268 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:51.492186 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-84e580eb-2bda-49f4-b3ae-c4bb02344268 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] HTTP exception thrown: Instance 18d3abfc-e621-46a7-9e2b-3dad1673ff89 could not be found. Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-84e580eb-2bda-49f4-b3ae-c4bb02344268 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Request method failure captured: Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 HTTP/1.1 Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtZ2bCbDmIF2pJBG-BUWqatCidlAJo0h-dXRlZa0OPFvt_QfGD56YUxAYNkkVPDEdGHRsY2XTirqf_TAugGQl5aDMLljidGL2qzaxWRn_ijqGGdAm_D0Fjj1Mjwm_KNA29U1b4ywGeKYMbx47i-g2wUMZX7vmPV4fYMp5Zdy5Xfl7i8 Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e5ccdbb2594418aa42c014a1ec60554", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e5ccdbb2594418aa42c014a1ec60554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestJSON-753315416 Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 5e5ccdbb2594418aa42c014a1ec60554 Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestJSON-753315416 Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestJSON-753315416-project Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e7d5767d1dc249cd8e97097588ee4728 Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestJSON-753315416-project Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 18d3abfc-e621-46a7-9e2b-3dad1673ff89 could not be found. Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '18d3abfc-e621-46a7-9e2b-3dad1673ff89'} Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d3abfc-e621-46a7-9e2b-3dad1673ff89 could not be found. Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d3abfc-e621-46a7-9e2b-3dad1673ff89 could not be found. Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:51.494010 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:09:51.500793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:09:51.500793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:09:51.500793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:09:51.500793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:09:51.500793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d3abfc-e621-46a7-9e2b-3dad1673ff89 could not be found. Oct 27 19:09:51.500793 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:09:51.500793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-84e580eb-2bda-49f4-b3ae-c4bb02344268 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] Returning 404 to user: Instance 18d3abfc-e621-46a7-9e2b-3dad1673ff89 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:09:51.502607 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-84e580eb-2bda-49f4-b3ae-c4bb02344268 tempest-ServersTestJSON-753315416 tempest-ServersTestJSON-753315416-project] 10.222.0.42 "GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89" status: 404 len: 111 microversion: 2.1 time: 0.150626 Oct 27 19:09:51.506769 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2413/5019] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:51 2022] GET /compute/v2.1/servers/18d3abfc-e621-46a7-9e2b-3dad1673ff89 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:09:51.899803 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9dcd27b3-e13c-4eb4-a311-5db4a590dd9c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 5.751105 Oct 27 19:09:51.902618 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2607/5020] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:09:46 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 5755 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 27 19:09:51.941417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e9c614ad-53c0-4ad0-afec-c21486ce08fc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:51.942870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e9c614ad-53c0-4ad0-afec-c21486ce08fc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:51.949977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9c614ad-53c0-4ad0-afec-c21486ce08fc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:51.961715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9c614ad-53c0-4ad0-afec-c21486ce08fc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:51.966183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9c614ad-53c0-4ad0-afec-c21486ce08fc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:51.969087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9c614ad-53c0-4ad0-afec-c21486ce08fc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:51.970033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9c614ad-53c0-4ad0-afec-c21486ce08fc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:51.973437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9c614ad-53c0-4ad0-afec-c21486ce08fc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:52.380647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9ecf31e8-5015-4eba-bbfe-5da62b6def84 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:52.381885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9ecf31e8-5015-4eba-bbfe-5da62b6def84 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:52.392676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ecf31e8-5015-4eba-bbfe-5da62b6def84 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:52.393722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ecf31e8-5015-4eba-bbfe-5da62b6def84 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:52.395087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ecf31e8-5015-4eba-bbfe-5da62b6def84 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:52.397101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ecf31e8-5015-4eba-bbfe-5da62b6def84 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:52.399283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ecf31e8-5015-4eba-bbfe-5da62b6def84 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:52.400374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ecf31e8-5015-4eba-bbfe-5da62b6def84 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:52.841888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e9c614ad-53c0-4ad0-afec-c21486ce08fc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:52.857859 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e9c614ad-53c0-4ad0-afec-c21486ce08fc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1314 microversion: 2.1 time: 0.920538 Oct 27 19:09:52.858753 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2414/5021] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:51 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1314 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:52.881108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-4ede8eea-b91d-4df0-b7ef-f0ab847d9133 req-1a3bc865-810c-45ed-9d8c-2dd18d6e90fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164658b9-90aa-4fe2-afd7-dbcb65930773", "tag": "07f2b85d-6225-45f3-b627-a56cbcb48883"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:52.910087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4ede8eea-b91d-4df0-b7ef-f0ab847d9133 req-1a3bc865-810c-45ed-9d8c-2dd18d6e90fd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:52.914061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4ede8eea-b91d-4df0-b7ef-f0ab847d9133 req-1a3bc865-810c-45ed-9d8c-2dd18d6e90fd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:52.918643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4ede8eea-b91d-4df0-b7ef-f0ab847d9133 req-1a3bc865-810c-45ed-9d8c-2dd18d6e90fd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:52.961891 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-4ede8eea-b91d-4df0-b7ef-f0ab847d9133 req-1a3bc865-810c-45ed-9d8c-2dd18d6e90fd service nova] Creating event network-changed:07f2b85d-6225-45f3-b627-a56cbcb48883 for instance 164658b9-90aa-4fe2-afd7-dbcb65930773 on n-h2-860687-3 Oct 27 19:09:52.976860 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-4ede8eea-b91d-4df0-b7ef-f0ab847d9133 req-1a3bc865-810c-45ed-9d8c-2dd18d6e90fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102857 Oct 27 19:09:52.981265 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2415/5022] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:09:53.191381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9ecf31e8-5015-4eba-bbfe-5da62b6def84 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:53.205276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9ecf31e8-5015-4eba-bbfe-5da62b6def84 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:53.207279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9ecf31e8-5015-4eba-bbfe-5da62b6def84 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:53.220823 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9ecf31e8-5015-4eba-bbfe-5da62b6def84 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1535 microversion: 2.91 time: 0.847082 Oct 27 19:09:53.244902 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2608/5023] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:52 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1535 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:09:53.883255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:53.892214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-76736d94-616f-43bb-bcad-47a2366dc2e7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:53.893314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-76736d94-616f-43bb-bcad-47a2366dc2e7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:53.913505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76736d94-616f-43bb-bcad-47a2366dc2e7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:53.923666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76736d94-616f-43bb-bcad-47a2366dc2e7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:53.924431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76736d94-616f-43bb-bcad-47a2366dc2e7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:53.925539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76736d94-616f-43bb-bcad-47a2366dc2e7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:53.926165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76736d94-616f-43bb-bcad-47a2366dc2e7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:53.928369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76736d94-616f-43bb-bcad-47a2366dc2e7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:54.152485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:09:54.258175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5d9167c6-b7d4-44d6-972c-72c3119542e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:54.259504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5d9167c6-b7d4-44d6-972c-72c3119542e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:54.271519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9167c6-b7d4-44d6-972c-72c3119542e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:54.272526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9167c6-b7d4-44d6-972c-72c3119542e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:54.273153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9167c6-b7d4-44d6-972c-72c3119542e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:54.287544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9167c6-b7d4-44d6-972c-72c3119542e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:54.288275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9167c6-b7d4-44d6-972c-72c3119542e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:54.289776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9167c6-b7d4-44d6-972c-72c3119542e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:54.648945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-76736d94-616f-43bb-bcad-47a2366dc2e7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:54.658846 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-76736d94-616f-43bb-bcad-47a2366dc2e7 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1314 microversion: 2.1 time: 0.776979 Oct 27 19:09:54.663570 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2416/5024] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:53 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:54.682080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5d9167c6-b7d4-44d6-972c-72c3119542e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:54.700359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5d9167c6-b7d4-44d6-972c-72c3119542e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:54.702001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5d9167c6-b7d4-44d6-972c-72c3119542e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:54.730854 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5d9167c6-b7d4-44d6-972c-72c3119542e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1535 microversion: 2.91 time: 0.483911 Oct 27 19:09:54.750763 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2609/5025] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:54 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1535 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:55.689283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d91e40a7-bdc0-4d5e-a310-d9e9ef78d3ef tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:55.690805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d91e40a7-bdc0-4d5e-a310-d9e9ef78d3ef tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:55.707611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d91e40a7-bdc0-4d5e-a310-d9e9ef78d3ef tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:55.708394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d91e40a7-bdc0-4d5e-a310-d9e9ef78d3ef tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:55.709044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d91e40a7-bdc0-4d5e-a310-d9e9ef78d3ef tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:55.709948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d91e40a7-bdc0-4d5e-a310-d9e9ef78d3ef tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:55.714016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d91e40a7-bdc0-4d5e-a310-d9e9ef78d3ef tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:55.714744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d91e40a7-bdc0-4d5e-a310-d9e9ef78d3ef tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:55.766341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1bd6c535-e02d-4c3b-83d3-5fe0fd3f7f74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:55.767763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1bd6c535-e02d-4c3b-83d3-5fe0fd3f7f74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:55.782563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bd6c535-e02d-4c3b-83d3-5fe0fd3f7f74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:55.791040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bd6c535-e02d-4c3b-83d3-5fe0fd3f7f74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:55.793350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bd6c535-e02d-4c3b-83d3-5fe0fd3f7f74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:55.796712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bd6c535-e02d-4c3b-83d3-5fe0fd3f7f74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:55.807220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bd6c535-e02d-4c3b-83d3-5fe0fd3f7f74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:55.808010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bd6c535-e02d-4c3b-83d3-5fe0fd3f7f74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:56.114133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1bd6c535-e02d-4c3b-83d3-5fe0fd3f7f74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:56.131276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1bd6c535-e02d-4c3b-83d3-5fe0fd3f7f74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:56.132763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1bd6c535-e02d-4c3b-83d3-5fe0fd3f7f74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:56.161830 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1bd6c535-e02d-4c3b-83d3-5fe0fd3f7f74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1478 microversion: 2.91 time: 0.401120 Oct 27 19:09:56.163865 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2610/5026] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:55 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1478 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:56.197107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3375f3de-41ae-47c6-b8e4-57ed88f33c2c tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-860687-3"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:09:56.201129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3375f3de-41ae-47c6-b8e4-57ed88f33c2c tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:56.216814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3375f3de-41ae-47c6-b8e4-57ed88f33c2c tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:56.235285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3375f3de-41ae-47c6-b8e4-57ed88f33c2c tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:56.236117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3375f3de-41ae-47c6-b8e4-57ed88f33c2c tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:56.238287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3375f3de-41ae-47c6-b8e4-57ed88f33c2c tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:56.238978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3375f3de-41ae-47c6-b8e4-57ed88f33c2c tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:56.239720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3375f3de-41ae-47c6-b8e4-57ed88f33c2c tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:56.328943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3375f3de-41ae-47c6-b8e4-57ed88f33c2c tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-860687-3". {{(pid=127029) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 19:09:56.398638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d91e40a7-bdc0-4d5e-a310-d9e9ef78d3ef tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:56.412216 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d91e40a7-bdc0-4d5e-a310-d9e9ef78d3ef tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1314 microversion: 2.1 time: 0.730939 Oct 27 19:09:56.412810 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2417/5027] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:55 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:56.512978 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3375f3de-41ae-47c6-b8e4-57ed88f33c2c tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad/action" status: 202 len: 0 microversion: 2.91 time: 0.321199 Oct 27 19:09:56.513960 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2611/5028] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 19:09:56 2022] POST /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:09:56.523219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a6a738a7-4070-4e8e-bd8a-211edabc3fe5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:56.523841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a6a738a7-4070-4e8e-bd8a-211edabc3fe5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:56.544476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6a738a7-4070-4e8e-bd8a-211edabc3fe5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:56.544963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6a738a7-4070-4e8e-bd8a-211edabc3fe5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:56.545405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6a738a7-4070-4e8e-bd8a-211edabc3fe5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:56.553057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6a738a7-4070-4e8e-bd8a-211edabc3fe5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:56.553522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6a738a7-4070-4e8e-bd8a-211edabc3fe5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:56.554599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6a738a7-4070-4e8e-bd8a-211edabc3fe5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:56.836973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a6a738a7-4070-4e8e-bd8a-211edabc3fe5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:56.855932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a6a738a7-4070-4e8e-bd8a-211edabc3fe5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:56.859418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a6a738a7-4070-4e8e-bd8a-211edabc3fe5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:56.881983 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a6a738a7-4070-4e8e-bd8a-211edabc3fe5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1486 microversion: 2.91 time: 0.361946 Oct 27 19:09:56.884359 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2418/5029] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:56 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1486 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:09:57.442497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2873d7a8-09ff-49ac-a4a7-56d3825de0d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:57.444323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2873d7a8-09ff-49ac-a4a7-56d3825de0d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:57.460700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2873d7a8-09ff-49ac-a4a7-56d3825de0d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:57.463699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2873d7a8-09ff-49ac-a4a7-56d3825de0d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:57.469769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2873d7a8-09ff-49ac-a4a7-56d3825de0d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:57.475917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2873d7a8-09ff-49ac-a4a7-56d3825de0d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:57.476752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2873d7a8-09ff-49ac-a4a7-56d3825de0d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:57.477856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2873d7a8-09ff-49ac-a4a7-56d3825de0d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:57.916721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6757cb40-5125-40e0-8440-d1dea8f97965 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:57.919785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6757cb40-5125-40e0-8440-d1dea8f97965 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:57.959324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6757cb40-5125-40e0-8440-d1dea8f97965 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:57.964690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6757cb40-5125-40e0-8440-d1dea8f97965 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:57.966624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6757cb40-5125-40e0-8440-d1dea8f97965 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:57.969452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6757cb40-5125-40e0-8440-d1dea8f97965 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:57.972014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6757cb40-5125-40e0-8440-d1dea8f97965 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:57.973272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6757cb40-5125-40e0-8440-d1dea8f97965 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:58.066607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2873d7a8-09ff-49ac-a4a7-56d3825de0d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:58.084005 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2873d7a8-09ff-49ac-a4a7-56d3825de0d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1314 microversion: 2.1 time: 0.647347 Oct 27 19:09:58.090252 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2612/5030] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:57 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:09:58.368530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6757cb40-5125-40e0-8440-d1dea8f97965 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:58.390164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6757cb40-5125-40e0-8440-d1dea8f97965 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:58.392149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6757cb40-5125-40e0-8440-d1dea8f97965 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:58.412679 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6757cb40-5125-40e0-8440-d1dea8f97965 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1486 microversion: 2.91 time: 0.501391 Oct 27 19:09:58.419613 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2419/5031] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:57 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1486 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:09:59.116218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-68b6ce20-3f90-4a33-ae93-878734ce4241 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:59.116827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-68b6ce20-3f90-4a33-ae93-878734ce4241 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:59.129849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68b6ce20-3f90-4a33-ae93-878734ce4241 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:59.130362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68b6ce20-3f90-4a33-ae93-878734ce4241 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:59.136257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68b6ce20-3f90-4a33-ae93-878734ce4241 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:59.137053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68b6ce20-3f90-4a33-ae93-878734ce4241 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:59.137519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68b6ce20-3f90-4a33-ae93-878734ce4241 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:59.137967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68b6ce20-3f90-4a33-ae93-878734ce4241 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:59.455185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-746577ba-e5aa-416b-9947-287d57216b22 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:09:59.456411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-746577ba-e5aa-416b-9947-287d57216b22 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:09:59.467277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-746577ba-e5aa-416b-9947-287d57216b22 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:59.468186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-746577ba-e5aa-416b-9947-287d57216b22 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:59.468816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-746577ba-e5aa-416b-9947-287d57216b22 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:59.470521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-746577ba-e5aa-416b-9947-287d57216b22 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:09:59.471738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-746577ba-e5aa-416b-9947-287d57216b22 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:09:59.472346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-746577ba-e5aa-416b-9947-287d57216b22 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:09:59.929255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-746577ba-e5aa-416b-9947-287d57216b22 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:59.946737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-746577ba-e5aa-416b-9947-287d57216b22 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:59.948707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-746577ba-e5aa-416b-9947-287d57216b22 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:09:59.955355 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-746577ba-e5aa-416b-9947-287d57216b22 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1486 microversion: 2.91 time: 0.505516 Oct 27 19:09:59.956499 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2420/5032] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:09:59 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1486 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:00.214342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-68b6ce20-3f90-4a33-ae93-878734ce4241 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:00.227599 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-68b6ce20-3f90-4a33-ae93-878734ce4241 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1314 microversion: 2.1 time: 1.113726 Oct 27 19:10:00.247926 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2613/5033] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:09:59 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1314 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:00.996180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-535b941d-1eed-45ce-9fbf-80720ccba2e4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:00.996911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-535b941d-1eed-45ce-9fbf-80720ccba2e4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:01.017431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-535b941d-1eed-45ce-9fbf-80720ccba2e4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:01.018146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-535b941d-1eed-45ce-9fbf-80720ccba2e4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:01.019524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-535b941d-1eed-45ce-9fbf-80720ccba2e4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:01.021081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-535b941d-1eed-45ce-9fbf-80720ccba2e4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:01.022321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-535b941d-1eed-45ce-9fbf-80720ccba2e4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:01.024539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-535b941d-1eed-45ce-9fbf-80720ccba2e4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:01.252929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9802a04c-dff2-4e2a-9232-37eed8fbebd9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:01.253825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9802a04c-dff2-4e2a-9232-37eed8fbebd9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:01.271634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9802a04c-dff2-4e2a-9232-37eed8fbebd9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:01.272705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9802a04c-dff2-4e2a-9232-37eed8fbebd9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:01.276043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9802a04c-dff2-4e2a-9232-37eed8fbebd9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:01.277486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9802a04c-dff2-4e2a-9232-37eed8fbebd9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:01.281297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9802a04c-dff2-4e2a-9232-37eed8fbebd9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:01.281971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9802a04c-dff2-4e2a-9232-37eed8fbebd9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:01.308051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-535b941d-1eed-45ce-9fbf-80720ccba2e4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:01.329726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-535b941d-1eed-45ce-9fbf-80720ccba2e4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:01.331747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-535b941d-1eed-45ce-9fbf-80720ccba2e4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:01.365793 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-535b941d-1eed-45ce-9fbf-80720ccba2e4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1486 microversion: 2.91 time: 0.372672 Oct 27 19:10:01.379190 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2421/5034] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:00 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1486 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:01.559659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f9242830-66c1-4e8b-90af-ae70da4e7e7c req-06050b0d-8440-4981-95e9-7bec5e12aa1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c", "name": "network-vif-plugged", "status": "completed", "tag": "80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:10:01.581141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f9242830-66c1-4e8b-90af-ae70da4e7e7c req-06050b0d-8440-4981-95e9-7bec5e12aa1a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:01.581985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f9242830-66c1-4e8b-90af-ae70da4e7e7c req-06050b0d-8440-4981-95e9-7bec5e12aa1a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:01.583461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f9242830-66c1-4e8b-90af-ae70da4e7e7c req-06050b0d-8440-4981-95e9-7bec5e12aa1a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:01.621990 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f9242830-66c1-4e8b-90af-ae70da4e7e7c req-06050b0d-8440-4981-95e9-7bec5e12aa1a service nova] Creating event network-vif-plugged:80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4 for instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c on n-h1-860687-3 Oct 27 19:10:01.636713 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f9242830-66c1-4e8b-90af-ae70da4e7e7c req-06050b0d-8440-4981-95e9-7bec5e12aa1a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082289 Oct 27 19:10:01.641766 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2422/5035] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:10:02.268239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9802a04c-dff2-4e2a-9232-37eed8fbebd9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:02.281986 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9802a04c-dff2-4e2a-9232-37eed8fbebd9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1314 microversion: 2.1 time: 1.033621 Oct 27 19:10:02.293334 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2614/5036] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:01 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1314 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:10:02.398801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4afecbc6-86c6-4639-bcb4-69b2e737a042 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:02.400971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4afecbc6-86c6-4639-bcb4-69b2e737a042 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:02.435270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4afecbc6-86c6-4639-bcb4-69b2e737a042 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:02.437534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4afecbc6-86c6-4639-bcb4-69b2e737a042 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:02.438937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4afecbc6-86c6-4639-bcb4-69b2e737a042 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:02.441795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4afecbc6-86c6-4639-bcb4-69b2e737a042 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:02.443663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4afecbc6-86c6-4639-bcb4-69b2e737a042 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:02.444874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4afecbc6-86c6-4639-bcb4-69b2e737a042 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:02.925835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4afecbc6-86c6-4639-bcb4-69b2e737a042 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:02.936002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4afecbc6-86c6-4639-bcb4-69b2e737a042 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:02.938047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4afecbc6-86c6-4639-bcb4-69b2e737a042 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:02.964327 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4afecbc6-86c6-4639-bcb4-69b2e737a042 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1486 microversion: 2.91 time: 0.570571 Oct 27 19:10:02.990093 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2423/5037] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:02 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1486 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:03.322187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-67249d9f-c0d6-4f95-9f43-16ea4b37add0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:03.322187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-67249d9f-c0d6-4f95-9f43-16ea4b37add0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:03.352063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67249d9f-c0d6-4f95-9f43-16ea4b37add0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:03.352432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67249d9f-c0d6-4f95-9f43-16ea4b37add0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:03.353531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67249d9f-c0d6-4f95-9f43-16ea4b37add0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:03.354483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67249d9f-c0d6-4f95-9f43-16ea4b37add0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:03.355439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67249d9f-c0d6-4f95-9f43-16ea4b37add0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:03.356028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67249d9f-c0d6-4f95-9f43-16ea4b37add0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:03.662272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-802e5438-e5bf-4c45-ace3-741d4ea7d4d4 req-10e697dd-cf08-471f-8f34-b09ef164bc4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164658b9-90aa-4fe2-afd7-dbcb65930773", "name": "network-vif-plugged", "status": "completed", "tag": "07f2b85d-6225-45f3-b627-a56cbcb48883"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:10:03.693795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-802e5438-e5bf-4c45-ace3-741d4ea7d4d4 req-10e697dd-cf08-471f-8f34-b09ef164bc4f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:03.697745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-802e5438-e5bf-4c45-ace3-741d4ea7d4d4 req-10e697dd-cf08-471f-8f34-b09ef164bc4f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:03.698217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-802e5438-e5bf-4c45-ace3-741d4ea7d4d4 req-10e697dd-cf08-471f-8f34-b09ef164bc4f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:03.747447 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-802e5438-e5bf-4c45-ace3-741d4ea7d4d4 req-10e697dd-cf08-471f-8f34-b09ef164bc4f service nova] Creating event network-vif-plugged:07f2b85d-6225-45f3-b627-a56cbcb48883 for instance 164658b9-90aa-4fe2-afd7-dbcb65930773 on n-h2-860687-3 Oct 27 19:10:03.763055 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-802e5438-e5bf-4c45-ace3-741d4ea7d4d4 req-10e697dd-cf08-471f-8f34-b09ef164bc4f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101781 Oct 27 19:10:03.765799 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2424/5038] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:10:03.774280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-67249d9f-c0d6-4f95-9f43-16ea4b37add0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:03.817300 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-67249d9f-c0d6-4f95-9f43-16ea4b37add0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1314 microversion: 2.1 time: 0.494298 Oct 27 19:10:03.835050 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2615/5039] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:03 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:04.000030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:04.000818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:04.022522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:04.026688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:04.028536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:04.029806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:04.036930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:04.037410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:04.842053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aded70a4-469a-4378-9851-81da7406a28a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:04.847335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-aded70a4-469a-4378-9851-81da7406a28a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:04.864905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aded70a4-469a-4378-9851-81da7406a28a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:04.866811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aded70a4-469a-4378-9851-81da7406a28a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:04.869331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aded70a4-469a-4378-9851-81da7406a28a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:04.870343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aded70a4-469a-4378-9851-81da7406a28a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:04.873070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aded70a4-469a-4378-9851-81da7406a28a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:04.878002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aded70a4-469a-4378-9851-81da7406a28a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:05.033508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:05.054131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:05.058200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:05.076601 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1486 microversion: 2.91 time: 1.081669 Oct 27 19:10:05.086137 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2425/5040] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:03 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1486 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:05.242747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:05.244096 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001755 Oct 27 19:10:05.245172 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2426/5041] 10.222.0.42 () {56 vars in 886 bytes} [Thu Oct 27 19:10:05 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 19:10:05.253470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:05.254906 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001946 Oct 27 19:10:05.255754 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2427/5042] 10.222.0.42 () {54 vars in 1035 bytes} [Thu Oct 27 19:10:05 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 27 19:10:05.263191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:05.265061 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001802 Oct 27 19:10:05.266005 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2428/5043] 10.222.0.42 () {54 vars in 1041 bytes} [Thu Oct 27 19:10:05 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:10:05.274141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:05.275428 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-47a1d1ff-067c-44ff-ae6a-65c9cdcb235b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001725 Oct 27 19:10:05.288282 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2429/5044] 10.222.0.42 () {56 vars in 886 bytes} [Thu Oct 27 19:10:05 2022] GET /compute/ => generated 377 bytes in 15 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 19:10:05.508934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-aded70a4-469a-4378-9851-81da7406a28a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:05.528223 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aded70a4-469a-4378-9851-81da7406a28a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1314 microversion: 2.1 time: 0.683699 Oct 27 19:10:05.537755 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2616/5045] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:04 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:06.130734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8f610296-d6d4-4511-ba90-c14383c92fcb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:06.132446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8f610296-d6d4-4511-ba90-c14383c92fcb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:06.157423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f610296-d6d4-4511-ba90-c14383c92fcb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:06.163000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f610296-d6d4-4511-ba90-c14383c92fcb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:06.163981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f610296-d6d4-4511-ba90-c14383c92fcb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:06.166542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f610296-d6d4-4511-ba90-c14383c92fcb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:06.167044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f610296-d6d4-4511-ba90-c14383c92fcb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:06.167481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f610296-d6d4-4511-ba90-c14383c92fcb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:06.466161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8f610296-d6d4-4511-ba90-c14383c92fcb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:06.494840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8f610296-d6d4-4511-ba90-c14383c92fcb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:06.496906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8f610296-d6d4-4511-ba90-c14383c92fcb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:06.543108 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8f610296-d6d4-4511-ba90-c14383c92fcb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1486 microversion: 2.91 time: 0.425893 Oct 27 19:10:06.544063 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2430/5046] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:06 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1486 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:06.557947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fa6ba219-2157-4c60-a6db-06177ee6aed6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:06.558622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fa6ba219-2157-4c60-a6db-06177ee6aed6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:06.573577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa6ba219-2157-4c60-a6db-06177ee6aed6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:06.574238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa6ba219-2157-4c60-a6db-06177ee6aed6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:06.587565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa6ba219-2157-4c60-a6db-06177ee6aed6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:06.588446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa6ba219-2157-4c60-a6db-06177ee6aed6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:06.595030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa6ba219-2157-4c60-a6db-06177ee6aed6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:06.596591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa6ba219-2157-4c60-a6db-06177ee6aed6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:07.240592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fa6ba219-2157-4c60-a6db-06177ee6aed6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:07.254158 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fa6ba219-2157-4c60-a6db-06177ee6aed6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1500 microversion: 2.1 time: 0.697919 Oct 27 19:10:07.257671 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2617/5047] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:06 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1500 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:07.289647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bc80c9be-26cd-4891-9e56-4ec5b45d0ae9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:10:07.290952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bc80c9be-26cd-4891-9e56-4ec5b45d0ae9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:07.309451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc80c9be-26cd-4891-9e56-4ec5b45d0ae9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:07.328848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc80c9be-26cd-4891-9e56-4ec5b45d0ae9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:07.329642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc80c9be-26cd-4891-9e56-4ec5b45d0ae9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:07.330643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc80c9be-26cd-4891-9e56-4ec5b45d0ae9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:07.334197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc80c9be-26cd-4891-9e56-4ec5b45d0ae9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:07.334912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc80c9be-26cd-4891-9e56-4ec5b45d0ae9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:07.423315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-bc80c9be-26cd-4891-9e56-4ec5b45d0ae9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lazy-loading 'flavor' on Instance uuid 164658b9-90aa-4fe2-afd7-dbcb65930773 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:10:07.551783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:10:07.596024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c742688b-3843-44ec-8c3c-2f9a1e244503 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:07.600029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c742688b-3843-44ec-8c3c-2f9a1e244503 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:07.611925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:10:07.615073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c742688b-3843-44ec-8c3c-2f9a1e244503 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:07.615891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c742688b-3843-44ec-8c3c-2f9a1e244503 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:07.616553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c742688b-3843-44ec-8c3c-2f9a1e244503 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:07.617846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c742688b-3843-44ec-8c3c-2f9a1e244503 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:07.622355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c742688b-3843-44ec-8c3c-2f9a1e244503 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:07.623964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c742688b-3843-44ec-8c3c-2f9a1e244503 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:07.654342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:10:07.797383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c742688b-3843-44ec-8c3c-2f9a1e244503 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:07.812641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c742688b-3843-44ec-8c3c-2f9a1e244503 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:07.814138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c742688b-3843-44ec-8c3c-2f9a1e244503 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:07.836783 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c742688b-3843-44ec-8c3c-2f9a1e244503 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1486 microversion: 2.91 time: 0.264267 Oct 27 19:10:07.841551 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2618/5048] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:07 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1486 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:10:08.457961 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bc80c9be-26cd-4891-9e56-4ec5b45d0ae9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "POST /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773/action" status: 202 len: 0 microversion: 2.1 time: 1.179928 Oct 27 19:10:08.459240 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2431/5049] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:10:07 2022] POST /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773/action => generated 0 bytes in 1184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:10:08.524890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d135d296-c1a0-4b03-9125-6e89a8139e76 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:08.525683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d135d296-c1a0-4b03-9125-6e89a8139e76 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:08.560103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d135d296-c1a0-4b03-9125-6e89a8139e76 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:08.563489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d135d296-c1a0-4b03-9125-6e89a8139e76 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:08.565347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d135d296-c1a0-4b03-9125-6e89a8139e76 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:08.573823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d135d296-c1a0-4b03-9125-6e89a8139e76 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:08.574316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d135d296-c1a0-4b03-9125-6e89a8139e76 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:08.575537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d135d296-c1a0-4b03-9125-6e89a8139e76 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:08.873602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2594e6b3-0de0-4c68-b56c-8b2639e67094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:08.874550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2594e6b3-0de0-4c68-b56c-8b2639e67094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:08.888117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2594e6b3-0de0-4c68-b56c-8b2639e67094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:08.888626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2594e6b3-0de0-4c68-b56c-8b2639e67094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:08.889309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2594e6b3-0de0-4c68-b56c-8b2639e67094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:08.889896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2594e6b3-0de0-4c68-b56c-8b2639e67094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:08.890353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2594e6b3-0de0-4c68-b56c-8b2639e67094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:08.899080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2594e6b3-0de0-4c68-b56c-8b2639e67094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:09.001638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d135d296-c1a0-4b03-9125-6e89a8139e76 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:09.019020 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d135d296-c1a0-4b03-9125-6e89a8139e76 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 0.551928 Oct 27 19:10:09.031992 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2619/5050] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:08 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:09.109808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2594e6b3-0de0-4c68-b56c-8b2639e67094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:09.121553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2594e6b3-0de0-4c68-b56c-8b2639e67094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:09.126370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2594e6b3-0de0-4c68-b56c-8b2639e67094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:09.154439 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2594e6b3-0de0-4c68-b56c-8b2639e67094 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1486 microversion: 2.91 time: 0.285271 Oct 27 19:10:09.159870 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2432/5051] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:08 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1486 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:10:10.047292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e4162cd2-eeb7-453d-806c-5e15407c318e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:10.048704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e4162cd2-eeb7-453d-806c-5e15407c318e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:10.067277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4162cd2-eeb7-453d-806c-5e15407c318e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:10.069645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4162cd2-eeb7-453d-806c-5e15407c318e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:10.071482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4162cd2-eeb7-453d-806c-5e15407c318e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:10.076784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4162cd2-eeb7-453d-806c-5e15407c318e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:10.078827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4162cd2-eeb7-453d-806c-5e15407c318e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:10.080365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4162cd2-eeb7-453d-806c-5e15407c318e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:10.191657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ea29aec2-3dd7-468d-9e53-4417dddfdff4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:10.193187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ea29aec2-3dd7-468d-9e53-4417dddfdff4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:10.208936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea29aec2-3dd7-468d-9e53-4417dddfdff4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:10.216542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea29aec2-3dd7-468d-9e53-4417dddfdff4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:10.221376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea29aec2-3dd7-468d-9e53-4417dddfdff4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:10.224988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea29aec2-3dd7-468d-9e53-4417dddfdff4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:10.225474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea29aec2-3dd7-468d-9e53-4417dddfdff4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:10.234690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea29aec2-3dd7-468d-9e53-4417dddfdff4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:10.472248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ea29aec2-3dd7-468d-9e53-4417dddfdff4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:10.495025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ea29aec2-3dd7-468d-9e53-4417dddfdff4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:10.502825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ea29aec2-3dd7-468d-9e53-4417dddfdff4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:10.520708 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ea29aec2-3dd7-468d-9e53-4417dddfdff4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1488 microversion: 2.91 time: 0.333126 Oct 27 19:10:10.522050 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2433/5052] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:10 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1488 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:10.912922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e4162cd2-eeb7-453d-806c-5e15407c318e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:10.941253 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e4162cd2-eeb7-453d-806c-5e15407c318e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 0.899200 Oct 27 19:10:10.941876 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2620/5053] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:10 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:11.556999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-579d4c97-30e6-4af8-91e8-2d81e0ddf443 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:11.557611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-579d4c97-30e6-4af8-91e8-2d81e0ddf443 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:11.607426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-579d4c97-30e6-4af8-91e8-2d81e0ddf443 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:11.610606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-579d4c97-30e6-4af8-91e8-2d81e0ddf443 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:11.611708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-579d4c97-30e6-4af8-91e8-2d81e0ddf443 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:11.613218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-579d4c97-30e6-4af8-91e8-2d81e0ddf443 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:11.613699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-579d4c97-30e6-4af8-91e8-2d81e0ddf443 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:11.618918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-579d4c97-30e6-4af8-91e8-2d81e0ddf443 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:11.980954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f13f9c66-fdb0-484b-b1a3-d9f04b279eec tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:11.983833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f13f9c66-fdb0-484b-b1a3-d9f04b279eec tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:11.993374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f13f9c66-fdb0-484b-b1a3-d9f04b279eec tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:11.994311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f13f9c66-fdb0-484b-b1a3-d9f04b279eec tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:11.994990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f13f9c66-fdb0-484b-b1a3-d9f04b279eec tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:11.995980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f13f9c66-fdb0-484b-b1a3-d9f04b279eec tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:11.996673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f13f9c66-fdb0-484b-b1a3-d9f04b279eec tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:11.997306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f13f9c66-fdb0-484b-b1a3-d9f04b279eec tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:12.053804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-579d4c97-30e6-4af8-91e8-2d81e0ddf443 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:12.071397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-579d4c97-30e6-4af8-91e8-2d81e0ddf443 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:12.077660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-579d4c97-30e6-4af8-91e8-2d81e0ddf443 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:12.096819 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-579d4c97-30e6-4af8-91e8-2d81e0ddf443 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.545579 Oct 27 19:10:12.098048 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2434/5054] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:11 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:12.828585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f13f9c66-fdb0-484b-b1a3-d9f04b279eec tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:12.847055 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f13f9c66-fdb0-484b-b1a3-d9f04b279eec tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 0.877496 Oct 27 19:10:12.850170 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2621/5055] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:11 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:13.125609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ed7efd8b-0bdb-458a-ace2-add37490490d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:13.127027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ed7efd8b-0bdb-458a-ace2-add37490490d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:13.137357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed7efd8b-0bdb-458a-ace2-add37490490d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:13.143531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed7efd8b-0bdb-458a-ace2-add37490490d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:13.144311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed7efd8b-0bdb-458a-ace2-add37490490d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:13.145481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed7efd8b-0bdb-458a-ace2-add37490490d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:13.146122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed7efd8b-0bdb-458a-ace2-add37490490d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:13.149545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed7efd8b-0bdb-458a-ace2-add37490490d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:13.531588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ed7efd8b-0bdb-458a-ace2-add37490490d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:13.543506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ed7efd8b-0bdb-458a-ace2-add37490490d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:13.563035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ed7efd8b-0bdb-458a-ace2-add37490490d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:13.604206 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ed7efd8b-0bdb-458a-ace2-add37490490d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.483039 Oct 27 19:10:13.605151 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2435/5056] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:13 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:13.879418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-be0b1832-0914-453f-87d5-1f2867bdd8eb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:13.880101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-be0b1832-0914-453f-87d5-1f2867bdd8eb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:13.896812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be0b1832-0914-453f-87d5-1f2867bdd8eb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:13.897311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be0b1832-0914-453f-87d5-1f2867bdd8eb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:13.897783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be0b1832-0914-453f-87d5-1f2867bdd8eb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:13.898545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be0b1832-0914-453f-87d5-1f2867bdd8eb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:13.899016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be0b1832-0914-453f-87d5-1f2867bdd8eb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:13.904182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-be0b1832-0914-453f-87d5-1f2867bdd8eb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:14.614121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-be0b1832-0914-453f-87d5-1f2867bdd8eb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:14.649845 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-be0b1832-0914-453f-87d5-1f2867bdd8eb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 0.772044 Oct 27 19:10:14.652843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-65ee0efd-6b16-49fa-8199-97ca452df79f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:14.654254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-65ee0efd-6b16-49fa-8199-97ca452df79f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:14.675941 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2622/5057] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:13 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:14.697366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ee0efd-6b16-49fa-8199-97ca452df79f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:14.698140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ee0efd-6b16-49fa-8199-97ca452df79f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:14.698995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ee0efd-6b16-49fa-8199-97ca452df79f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:14.701412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ee0efd-6b16-49fa-8199-97ca452df79f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:14.704971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ee0efd-6b16-49fa-8199-97ca452df79f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:14.705655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ee0efd-6b16-49fa-8199-97ca452df79f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:14.997265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-65ee0efd-6b16-49fa-8199-97ca452df79f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:15.009001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-65ee0efd-6b16-49fa-8199-97ca452df79f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:15.017641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-65ee0efd-6b16-49fa-8199-97ca452df79f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:15.030282 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-65ee0efd-6b16-49fa-8199-97ca452df79f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.396765 Oct 27 19:10:15.041576 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2436/5058] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:14 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:15.418099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2e029e1c-4c60-4687-b4be-9e0cce66ab02 tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] Calling method '.version_select at 0x7fc87325cdc0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:15.552483 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2e029e1c-4c60-4687-b4be-9e0cce66ab02 tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9826b3b5-24ee-43bb-8815-4c52d178def4" status: 200 len: 350 microversion: 2.1 time: 0.141172 Oct 27 19:10:15.554711 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2623/5059] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:10:15 2022] GET /compute/v2.1/os-volumes/9826b3b5-24ee-43bb-8815-4c52d178def4 => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:10:15.706522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a8b8a15e-c60d-4f44-be9a-f910795a7dfa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:15.707385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a8b8a15e-c60d-4f44-be9a-f910795a7dfa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:15.739127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:10:15.748318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8b8a15e-c60d-4f44-be9a-f910795a7dfa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:15.750086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8b8a15e-c60d-4f44-be9a-f910795a7dfa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:15.757602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8b8a15e-c60d-4f44-be9a-f910795a7dfa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:15.758741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8b8a15e-c60d-4f44-be9a-f910795a7dfa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:15.769952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8b8a15e-c60d-4f44-be9a-f910795a7dfa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:15.770688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8b8a15e-c60d-4f44-be9a-f910795a7dfa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:16.065892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-81bbec09-56f1-4477-9b01-2924bb3a1c87 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:16.066794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-81bbec09-56f1-4477-9b01-2924bb3a1c87 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:16.107059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81bbec09-56f1-4477-9b01-2924bb3a1c87 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:16.107640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81bbec09-56f1-4477-9b01-2924bb3a1c87 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:16.108321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81bbec09-56f1-4477-9b01-2924bb3a1c87 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:16.109246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81bbec09-56f1-4477-9b01-2924bb3a1c87 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:16.121201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81bbec09-56f1-4477-9b01-2924bb3a1c87 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:16.129600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81bbec09-56f1-4477-9b01-2924bb3a1c87 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:16.314837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a8b8a15e-c60d-4f44-be9a-f910795a7dfa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:16.324979 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a8b8a15e-c60d-4f44-be9a-f910795a7dfa tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 0.624329 Oct 27 19:10:16.326150 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2437/5060] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:15 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:16.620956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-81bbec09-56f1-4477-9b01-2924bb3a1c87 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:16.635839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-81bbec09-56f1-4477-9b01-2924bb3a1c87 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:16.653561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-81bbec09-56f1-4477-9b01-2924bb3a1c87 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:16.675245 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-81bbec09-56f1-4477-9b01-2924bb3a1c87 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.614958 Oct 27 19:10:16.718174 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2624/5061] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:16 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:17.354062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-98d4ee9c-2d67-4e8a-8a05-e91d794320bd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:17.354736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-98d4ee9c-2d67-4e8a-8a05-e91d794320bd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:17.376227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98d4ee9c-2d67-4e8a-8a05-e91d794320bd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:17.380398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98d4ee9c-2d67-4e8a-8a05-e91d794320bd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:17.381123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98d4ee9c-2d67-4e8a-8a05-e91d794320bd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:17.384904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98d4ee9c-2d67-4e8a-8a05-e91d794320bd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:17.385587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98d4ee9c-2d67-4e8a-8a05-e91d794320bd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:17.386196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98d4ee9c-2d67-4e8a-8a05-e91d794320bd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:17.711548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f1b904a7-f9c5-4430-9e88-fc470db4a6b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:17.712173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f1b904a7-f9c5-4430-9e88-fc470db4a6b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:17.734068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1b904a7-f9c5-4430-9e88-fc470db4a6b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:17.734068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1b904a7-f9c5-4430-9e88-fc470db4a6b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:17.734068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1b904a7-f9c5-4430-9e88-fc470db4a6b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:17.734068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1b904a7-f9c5-4430-9e88-fc470db4a6b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:17.734068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1b904a7-f9c5-4430-9e88-fc470db4a6b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:17.734068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1b904a7-f9c5-4430-9e88-fc470db4a6b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:17.757340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-98d4ee9c-2d67-4e8a-8a05-e91d794320bd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:17.768325 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-98d4ee9c-2d67-4e8a-8a05-e91d794320bd tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 0.418945 Oct 27 19:10:17.788319 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2438/5062] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:17 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:17.972945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f1b904a7-f9c5-4430-9e88-fc470db4a6b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:17.987608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f1b904a7-f9c5-4430-9e88-fc470db4a6b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:17.996504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f1b904a7-f9c5-4430-9e88-fc470db4a6b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:18.009595 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f1b904a7-f9c5-4430-9e88-fc470db4a6b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.302243 Oct 27 19:10:18.013515 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2625/5063] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:17 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:18.796241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cbb28220-a4cd-4108-8e66-209a9351e10d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:18.797063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cbb28220-a4cd-4108-8e66-209a9351e10d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:18.811957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbb28220-a4cd-4108-8e66-209a9351e10d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:18.812479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbb28220-a4cd-4108-8e66-209a9351e10d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:18.812925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbb28220-a4cd-4108-8e66-209a9351e10d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:18.813665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbb28220-a4cd-4108-8e66-209a9351e10d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:18.821636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbb28220-a4cd-4108-8e66-209a9351e10d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:18.822538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cbb28220-a4cd-4108-8e66-209a9351e10d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:18.831972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce5352f5-28d9-45c6-b69a-43629a10ea4d tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] Calling method '.version_select at 0x7fc87325c790>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:18.938254 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce5352f5-28d9-45c6-b69a-43629a10ea4d tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f4214daa-229f-4057-9402-47bb8a847506" status: 200 len: 351 microversion: 2.1 time: 0.110500 Oct 27 19:10:18.949387 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2626/5064] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:10:18 2022] GET /compute/v2.1/os-volumes/f4214daa-229f-4057-9402-47bb8a847506 => generated 351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:10:19.047220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d7855e23-9a54-47f0-9f2f-10b7dd1ff036 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:19.048261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d7855e23-9a54-47f0-9f2f-10b7dd1ff036 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:19.069779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d7855e23-9a54-47f0-9f2f-10b7dd1ff036 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:19.070293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d7855e23-9a54-47f0-9f2f-10b7dd1ff036 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:19.076279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d7855e23-9a54-47f0-9f2f-10b7dd1ff036 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:19.078046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d7855e23-9a54-47f0-9f2f-10b7dd1ff036 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:19.079071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d7855e23-9a54-47f0-9f2f-10b7dd1ff036 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:19.082752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d7855e23-9a54-47f0-9f2f-10b7dd1ff036 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:19.226120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cbb28220-a4cd-4108-8e66-209a9351e10d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:19.241422 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cbb28220-a4cd-4108-8e66-209a9351e10d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 0.448354 Oct 27 19:10:19.247000 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2439/5065] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:18 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:19.286903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d7855e23-9a54-47f0-9f2f-10b7dd1ff036 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:19.304829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d7855e23-9a54-47f0-9f2f-10b7dd1ff036 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:19.313062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d7855e23-9a54-47f0-9f2f-10b7dd1ff036 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:19.338631 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d7855e23-9a54-47f0-9f2f-10b7dd1ff036 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.297158 Oct 27 19:10:19.358994 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2627/5066] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:19 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:10:20.290238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a678b779-a619-4402-8c5d-c9b4e9703ff5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:20.290926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a678b779-a619-4402-8c5d-c9b4e9703ff5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:20.310153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a678b779-a619-4402-8c5d-c9b4e9703ff5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:20.320553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a678b779-a619-4402-8c5d-c9b4e9703ff5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:20.324779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a678b779-a619-4402-8c5d-c9b4e9703ff5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:20.331681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a678b779-a619-4402-8c5d-c9b4e9703ff5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:20.333566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a678b779-a619-4402-8c5d-c9b4e9703ff5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:20.334229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a678b779-a619-4402-8c5d-c9b4e9703ff5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:20.377318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e9a9a163-b509-42b5-8952-8b4367432572 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:20.378105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e9a9a163-b509-42b5-8952-8b4367432572 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:20.405355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9a9a163-b509-42b5-8952-8b4367432572 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:20.406510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9a9a163-b509-42b5-8952-8b4367432572 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:20.407480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9a9a163-b509-42b5-8952-8b4367432572 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:20.412527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9a9a163-b509-42b5-8952-8b4367432572 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:20.427362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9a9a163-b509-42b5-8952-8b4367432572 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:20.428476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e9a9a163-b509-42b5-8952-8b4367432572 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:20.738323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a678b779-a619-4402-8c5d-c9b4e9703ff5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:20.757559 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a678b779-a619-4402-8c5d-c9b4e9703ff5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 0.470762 Oct 27 19:10:20.760173 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2440/5067] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:20 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:20.868498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e9a9a163-b509-42b5-8952-8b4367432572 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:20.893795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e9a9a163-b509-42b5-8952-8b4367432572 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:20.909464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e9a9a163-b509-42b5-8952-8b4367432572 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:20.930514 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e9a9a163-b509-42b5-8952-8b4367432572 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.557644 Oct 27 19:10:20.943192 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2628/5068] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:20 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:21.800384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dfb10c4c-735e-4db8-b70f-c1a6117b3642 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:21.801752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dfb10c4c-735e-4db8-b70f-c1a6117b3642 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:21.863007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfb10c4c-735e-4db8-b70f-c1a6117b3642 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:21.866114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfb10c4c-735e-4db8-b70f-c1a6117b3642 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:21.871894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfb10c4c-735e-4db8-b70f-c1a6117b3642 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:21.872964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfb10c4c-735e-4db8-b70f-c1a6117b3642 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:21.874033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfb10c4c-735e-4db8-b70f-c1a6117b3642 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:21.875193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfb10c4c-735e-4db8-b70f-c1a6117b3642 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:21.977295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-24ad7bc2-c805-43b1-a386-ff2d1c6aaa8e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:21.977933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-24ad7bc2-c805-43b1-a386-ff2d1c6aaa8e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:22.055468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ad7bc2-c805-43b1-a386-ff2d1c6aaa8e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:22.056013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ad7bc2-c805-43b1-a386-ff2d1c6aaa8e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:22.056475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ad7bc2-c805-43b1-a386-ff2d1c6aaa8e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:22.058173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ad7bc2-c805-43b1-a386-ff2d1c6aaa8e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:22.058978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ad7bc2-c805-43b1-a386-ff2d1c6aaa8e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:22.073252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ad7bc2-c805-43b1-a386-ff2d1c6aaa8e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:22.368599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-24ad7bc2-c805-43b1-a386-ff2d1c6aaa8e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:22.378703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-24ad7bc2-c805-43b1-a386-ff2d1c6aaa8e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:22.400325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-24ad7bc2-c805-43b1-a386-ff2d1c6aaa8e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:22.421475 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-24ad7bc2-c805-43b1-a386-ff2d1c6aaa8e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.447598 Oct 27 19:10:22.422492 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2629/5069] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:21 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:10:22.510254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dfb10c4c-735e-4db8-b70f-c1a6117b3642 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:22.541447 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dfb10c4c-735e-4db8-b70f-c1a6117b3642 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 0.746501 Oct 27 19:10:22.546764 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2441/5070] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:21 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:23.252379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7cbfac4d-0760-4a47-9e58-8916be27036f tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] Calling method '.version_select at 0x7fc87325c160>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:23.346013 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7cbfac4d-0760-4a47-9e58-8916be27036f tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/67cdfdfe-c607-4103-b514-c411cc7b0d20" status: 200 len: 351 microversion: 2.1 time: 0.099327 Oct 27 19:10:23.347310 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2630/5071] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:10:23 2022] GET /compute/v2.1/os-volumes/67cdfdfe-c607-4103-b514-c411cc7b0d20 => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:10:23.360598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4a8d6103-5be7-432b-9257-b460db4e8912 tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] Calling method '.version_select at 0x7fc8699a0790>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:23.452602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-927c162b-3737-44d0-b26b-e4c7410ccbec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:23.453700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-927c162b-3737-44d0-b26b-e4c7410ccbec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:23.473043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927c162b-3737-44d0-b26b-e4c7410ccbec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:23.474023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927c162b-3737-44d0-b26b-e4c7410ccbec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:23.477587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927c162b-3737-44d0-b26b-e4c7410ccbec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:23.479692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927c162b-3737-44d0-b26b-e4c7410ccbec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:23.486638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927c162b-3737-44d0-b26b-e4c7410ccbec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:23.487576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927c162b-3737-44d0-b26b-e4c7410ccbec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:23.580534 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4a8d6103-5be7-432b-9257-b460db4e8912 tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.224592 Oct 27 19:10:23.581904 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2442/5072] 10.222.0.42 () {58 vars in 1134 bytes} [Thu Oct 27 19:10:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:23.587549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-63de11e7-70d0-4bdf-abe1-dd19c8d17f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:23.588569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-63de11e7-70d0-4bdf-abe1-dd19c8d17f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:23.608478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63de11e7-70d0-4bdf-abe1-dd19c8d17f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:23.611168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63de11e7-70d0-4bdf-abe1-dd19c8d17f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:23.614734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63de11e7-70d0-4bdf-abe1-dd19c8d17f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:23.615892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63de11e7-70d0-4bdf-abe1-dd19c8d17f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:23.616548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63de11e7-70d0-4bdf-abe1-dd19c8d17f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:23.618608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63de11e7-70d0-4bdf-abe1-dd19c8d17f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:23.830540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-927c162b-3737-44d0-b26b-e4c7410ccbec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:23.849210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-927c162b-3737-44d0-b26b-e4c7410ccbec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:23.854991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-927c162b-3737-44d0-b26b-e4c7410ccbec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:23.870524 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-927c162b-3737-44d0-b26b-e4c7410ccbec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.421725 Oct 27 19:10:23.874574 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2631/5073] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:23 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:10:23.888269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-399cae78-0131-47a1-82e0-28af2db26e88 tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] Calling method '.version_select at 0x7fc869e0e670>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:23.990758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-63de11e7-70d0-4bdf-abe1-dd19c8d17f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:23.999247 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-63de11e7-70d0-4bdf-abe1-dd19c8d17f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 0.415981 Oct 27 19:10:24.010808 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2443/5074] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:23 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:24.160440 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-399cae78-0131-47a1-82e0-28af2db26e88 tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.282299 Oct 27 19:10:24.161615 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2632/5075] 10.222.0.42 () {58 vars in 1149 bytes} [Thu Oct 27 19:10:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:10:24.181226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-68125ee1-1b2d-41b8-a10d-ec8e51bf893d tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] Calling method '.version_select at 0x7fc8699ad280>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:24.484521 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-68125ee1-1b2d-41b8-a10d-ec8e51bf893d tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.307720 Oct 27 19:10:24.485396 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2444/5076] 10.222.0.42 () {58 vars in 1134 bytes} [Thu Oct 27 19:10:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:24.501335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7a04c110-1e91-457b-abee-baf7128a5dcf tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] Calling method '.version_select at 0x7fc87324a280>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:24.740536 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7a04c110-1e91-457b-abee-baf7128a5dcf tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.244902 Oct 27 19:10:24.756430 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2633/5077] 10.222.0.42 () {58 vars in 1167 bytes} [Thu Oct 27 19:10:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:10:24.763655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a596b842-670a-41a9-b829-582aa00a09b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:24.764460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6967aecc-cc79-41fc-b57c-1967b70f73f1 tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] Calling method '.version_select at 0x7fc869949310>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:24.766015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a596b842-670a-41a9-b829-582aa00a09b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:24.791691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a596b842-670a-41a9-b829-582aa00a09b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:24.792221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a596b842-670a-41a9-b829-582aa00a09b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:24.794973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a596b842-670a-41a9-b829-582aa00a09b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:24.798914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a596b842-670a-41a9-b829-582aa00a09b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:24.799422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a596b842-670a-41a9-b829-582aa00a09b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:24.800090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a596b842-670a-41a9-b829-582aa00a09b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:25.094714 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6967aecc-cc79-41fc-b57c-1967b70f73f1 tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.340379 Oct 27 19:10:25.096045 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2445/5078] 10.222.0.42 () {58 vars in 1170 bytes} [Thu Oct 27 19:10:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:10:25.101976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6dfdc28b-3545-446b-97c2-930542f1193f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:25.102875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6dfdc28b-3545-446b-97c2-930542f1193f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:25.128564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dfdc28b-3545-446b-97c2-930542f1193f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:25.136296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dfdc28b-3545-446b-97c2-930542f1193f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:25.145219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dfdc28b-3545-446b-97c2-930542f1193f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:25.149030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dfdc28b-3545-446b-97c2-930542f1193f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:25.151580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dfdc28b-3545-446b-97c2-930542f1193f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:25.156546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dfdc28b-3545-446b-97c2-930542f1193f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:25.204422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a596b842-670a-41a9-b829-582aa00a09b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:25.224095 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a596b842-670a-41a9-b829-582aa00a09b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.464705 Oct 27 19:10:25.227878 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2634/5079] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:24 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:25.252954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-20c3f9c9-2f02-429c-b7b0-5cbc0fa4ba42 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:25.256786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-20c3f9c9-2f02-429c-b7b0-5cbc0fa4ba42 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:25.280973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20c3f9c9-2f02-429c-b7b0-5cbc0fa4ba42 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:25.283167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20c3f9c9-2f02-429c-b7b0-5cbc0fa4ba42 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:25.284792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20c3f9c9-2f02-429c-b7b0-5cbc0fa4ba42 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:25.286121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20c3f9c9-2f02-429c-b7b0-5cbc0fa4ba42 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:25.291296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20c3f9c9-2f02-429c-b7b0-5cbc0fa4ba42 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:25.293757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-20c3f9c9-2f02-429c-b7b0-5cbc0fa4ba42 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:25.387373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6dfdc28b-3545-446b-97c2-930542f1193f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:25.398989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6dfdc28b-3545-446b-97c2-930542f1193f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:25.406682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6dfdc28b-3545-446b-97c2-930542f1193f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:25.423042 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6dfdc28b-3545-446b-97c2-930542f1193f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.323399 Oct 27 19:10:25.425221 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2446/5080] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:25 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:25.438773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3bce41ee-216c-4113-8211-3e09c8db128c tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] Calling method '.version_select at 0x7fc8699494c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:25.728756 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3bce41ee-216c-4113-8211-3e09c8db128c tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.302182 Oct 27 19:10:25.730529 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2447/5081] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 19:10:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:25.744854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-32d2f97f-e5a5-4660-9079-365d30827411 tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] Calling method '.version_select at 0x7fc86ae38af0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:25.887601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-20c3f9c9-2f02-429c-b7b0-5cbc0fa4ba42 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:25.903403 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-20c3f9c9-2f02-429c-b7b0-5cbc0fa4ba42 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 0.671322 Oct 27 19:10:25.908211 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2635/5082] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:25 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:25.969767 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-32d2f97f-e5a5-4660-9079-365d30827411 tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.229805 Oct 27 19:10:25.971022 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2448/5083] 10.222.0.42 () {58 vars in 1188 bytes} [Thu Oct 27 19:10:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:10:25.989177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e12028f6-2f6f-48d9-b230-db6a339efa97 tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] Calling method '.version_select at 0x7fc86b39ef70>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:26.168067 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e12028f6-2f6f-48d9-b230-db6a339efa97 tempest-VolumesTestJSON-1009320852 tempest-VolumesTestJSON-1009320852-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.184025 Oct 27 19:10:26.184267 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2636/5084] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 19:10:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:26.253134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c153a838-6425-4a0f-92d8-29a2323081a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:26.254740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c153a838-6425-4a0f-92d8-29a2323081a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:26.277237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c153a838-6425-4a0f-92d8-29a2323081a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:26.278068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c153a838-6425-4a0f-92d8-29a2323081a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:26.280980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c153a838-6425-4a0f-92d8-29a2323081a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:26.283270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c153a838-6425-4a0f-92d8-29a2323081a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:26.289890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c153a838-6425-4a0f-92d8-29a2323081a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:26.290650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c153a838-6425-4a0f-92d8-29a2323081a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:26.470734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3737d7a3-fb7f-4161-bf50-c630abf8f9fb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:26.471212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3737d7a3-fb7f-4161-bf50-c630abf8f9fb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:26.515330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3737d7a3-fb7f-4161-bf50-c630abf8f9fb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:26.517545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3737d7a3-fb7f-4161-bf50-c630abf8f9fb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:26.519046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3737d7a3-fb7f-4161-bf50-c630abf8f9fb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:26.541092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3737d7a3-fb7f-4161-bf50-c630abf8f9fb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:26.542048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3737d7a3-fb7f-4161-bf50-c630abf8f9fb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:26.545236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3737d7a3-fb7f-4161-bf50-c630abf8f9fb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:26.708498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c153a838-6425-4a0f-92d8-29a2323081a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:26.724927 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c153a838-6425-4a0f-92d8-29a2323081a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.475684 Oct 27 19:10:26.727484 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2449/5085] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:26 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:26.757614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ef63aefd-3008-44a1-a251-06cfd5bc177d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-415027167"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:10:26.766235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ef63aefd-3008-44a1-a251-06cfd5bc177d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:26.783628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef63aefd-3008-44a1-a251-06cfd5bc177d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:26.784853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef63aefd-3008-44a1-a251-06cfd5bc177d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:26.785940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef63aefd-3008-44a1-a251-06cfd5bc177d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:26.788008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef63aefd-3008-44a1-a251-06cfd5bc177d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:26.788973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef63aefd-3008-44a1-a251-06cfd5bc177d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:26.794633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef63aefd-3008-44a1-a251-06cfd5bc177d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:26.917207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3737d7a3-fb7f-4161-bf50-c630abf8f9fb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:26.932332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3737d7a3-fb7f-4161-bf50-c630abf8f9fb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:26.941201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3737d7a3-fb7f-4161-bf50-c630abf8f9fb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:26.975280 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3737d7a3-fb7f-4161-bf50-c630abf8f9fb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.499274 Oct 27 19:10:26.975947 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2637/5086] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:26 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:26.998314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f4a465e-90b3-4ed9-b721-e0c12fb1876b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:26.999843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6f4a465e-90b3-4ed9-b721-e0c12fb1876b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:27.023617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f4a465e-90b3-4ed9-b721-e0c12fb1876b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:27.043365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f4a465e-90b3-4ed9-b721-e0c12fb1876b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:27.043871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f4a465e-90b3-4ed9-b721-e0c12fb1876b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:27.048135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f4a465e-90b3-4ed9-b721-e0c12fb1876b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:27.048641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f4a465e-90b3-4ed9-b721-e0c12fb1876b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:27.049091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f4a465e-90b3-4ed9-b721-e0c12fb1876b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:27.567342 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ef63aefd-3008-44a1-a251-06cfd5bc177d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.818281 Oct 27 19:10:27.570480 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2450/5087] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:10:26 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 27 19:10:27.614894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b6e82b30-f5f2-4947-8dca-1dc10d1391ea tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:27.615779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b6e82b30-f5f2-4947-8dca-1dc10d1391ea tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:27.648936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6f4a465e-90b3-4ed9-b721-e0c12fb1876b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:27.649733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6e82b30-f5f2-4947-8dca-1dc10d1391ea tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:27.650245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6e82b30-f5f2-4947-8dca-1dc10d1391ea tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:27.650742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6e82b30-f5f2-4947-8dca-1dc10d1391ea tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:27.651464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6e82b30-f5f2-4947-8dca-1dc10d1391ea tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:27.651930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6e82b30-f5f2-4947-8dca-1dc10d1391ea tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:27.652359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6e82b30-f5f2-4947-8dca-1dc10d1391ea tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:27.662253 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6f4a465e-90b3-4ed9-b721-e0c12fb1876b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 0.685146 Oct 27 19:10:27.687357 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2638/5088] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:26 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:27.705703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:10:28.012101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7c69ba7c-7ba3-4259-8a18-9a5fca7c5125 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:28.013954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7c69ba7c-7ba3-4259-8a18-9a5fca7c5125 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:28.028349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c69ba7c-7ba3-4259-8a18-9a5fca7c5125 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:28.031583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c69ba7c-7ba3-4259-8a18-9a5fca7c5125 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:28.032699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c69ba7c-7ba3-4259-8a18-9a5fca7c5125 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:28.034700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c69ba7c-7ba3-4259-8a18-9a5fca7c5125 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:28.037474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c69ba7c-7ba3-4259-8a18-9a5fca7c5125 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:28.038704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c69ba7c-7ba3-4259-8a18-9a5fca7c5125 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:28.313232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7c69ba7c-7ba3-4259-8a18-9a5fca7c5125 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:28.336962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7c69ba7c-7ba3-4259-8a18-9a5fca7c5125 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:28.344337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7c69ba7c-7ba3-4259-8a18-9a5fca7c5125 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:28.367732 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7c69ba7c-7ba3-4259-8a18-9a5fca7c5125 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.359806 Oct 27 19:10:28.409622 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2639/5089] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:28 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:28.712973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9144b8a7-0065-40f9-a505-5bbdb7688cb3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:28.713735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9144b8a7-0065-40f9-a505-5bbdb7688cb3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:28.736269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9144b8a7-0065-40f9-a505-5bbdb7688cb3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:28.743964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9144b8a7-0065-40f9-a505-5bbdb7688cb3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:28.747478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9144b8a7-0065-40f9-a505-5bbdb7688cb3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:28.748602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9144b8a7-0065-40f9-a505-5bbdb7688cb3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:28.756747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9144b8a7-0065-40f9-a505-5bbdb7688cb3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:28.759976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9144b8a7-0065-40f9-a505-5bbdb7688cb3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:28.798780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6e82b30-f5f2-4947-8dca-1dc10d1391ea tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:28.815954 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b6e82b30-f5f2-4947-8dca-1dc10d1391ea tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 1.233610 Oct 27 19:10:28.822873 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2451/5090] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:27 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:29.419693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0b6790ab-f845-4aab-90a2-9a1a2454041f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:29.424297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0b6790ab-f845-4aab-90a2-9a1a2454041f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:29.443213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b6790ab-f845-4aab-90a2-9a1a2454041f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:29.444178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b6790ab-f845-4aab-90a2-9a1a2454041f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:29.446095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b6790ab-f845-4aab-90a2-9a1a2454041f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:29.447177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b6790ab-f845-4aab-90a2-9a1a2454041f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:29.448536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b6790ab-f845-4aab-90a2-9a1a2454041f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:29.449755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b6790ab-f845-4aab-90a2-9a1a2454041f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:29.849960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9144b8a7-0065-40f9-a505-5bbdb7688cb3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:29.857268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:10:29.867221 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9144b8a7-0065-40f9-a505-5bbdb7688cb3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 1.159178 Oct 27 19:10:29.867824 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2640/5091] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:28 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:10:29.883475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5af2176a-803b-444e-ae96-b077bce1a2cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:29.896637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0b6790ab-f845-4aab-90a2-9a1a2454041f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:29.912494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5af2176a-803b-444e-ae96-b077bce1a2cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:29.913662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0b6790ab-f845-4aab-90a2-9a1a2454041f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:29.922674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0b6790ab-f845-4aab-90a2-9a1a2454041f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:29.938827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5af2176a-803b-444e-ae96-b077bce1a2cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:29.948129 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0b6790ab-f845-4aab-90a2-9a1a2454041f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.534035 Oct 27 19:10:29.951690 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2452/5092] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:29 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:29.976016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5af2176a-803b-444e-ae96-b077bce1a2cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:29.978628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5af2176a-803b-444e-ae96-b077bce1a2cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:29.979634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5af2176a-803b-444e-ae96-b077bce1a2cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:29.980176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5af2176a-803b-444e-ae96-b077bce1a2cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:29.981963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5af2176a-803b-444e-ae96-b077bce1a2cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:30.586874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5af2176a-803b-444e-ae96-b077bce1a2cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:30.611278 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5af2176a-803b-444e-ae96-b077bce1a2cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1687 microversion: 2.1 time: 0.731247 Oct 27 19:10:30.612139 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2641/5093] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:29 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1687 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:30.896099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-31d750d6-d22d-4b68-a2e8-62eeb2ab4100 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:30.896721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-31d750d6-d22d-4b68-a2e8-62eeb2ab4100 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:30.913152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d750d6-d22d-4b68-a2e8-62eeb2ab4100 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:30.913645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d750d6-d22d-4b68-a2e8-62eeb2ab4100 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:30.914090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d750d6-d22d-4b68-a2e8-62eeb2ab4100 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:30.914841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d750d6-d22d-4b68-a2e8-62eeb2ab4100 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:30.921829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d750d6-d22d-4b68-a2e8-62eeb2ab4100 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:30.922677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d750d6-d22d-4b68-a2e8-62eeb2ab4100 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:30.981268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dc6f8f1c-fba4-433d-ae3c-ceba27bdf6bd tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:30.983936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dc6f8f1c-fba4-433d-ae3c-ceba27bdf6bd tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:31.035613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc6f8f1c-fba4-433d-ae3c-ceba27bdf6bd tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:31.040072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc6f8f1c-fba4-433d-ae3c-ceba27bdf6bd tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:31.043396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc6f8f1c-fba4-433d-ae3c-ceba27bdf6bd tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:31.048330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc6f8f1c-fba4-433d-ae3c-ceba27bdf6bd tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:31.054682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc6f8f1c-fba4-433d-ae3c-ceba27bdf6bd tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:31.058243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc6f8f1c-fba4-433d-ae3c-ceba27bdf6bd tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:31.397517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dc6f8f1c-fba4-433d-ae3c-ceba27bdf6bd tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:31.445959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dc6f8f1c-fba4-433d-ae3c-ceba27bdf6bd tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:31.454015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dc6f8f1c-fba4-433d-ae3c-ceba27bdf6bd tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:31.483722 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dc6f8f1c-fba4-433d-ae3c-ceba27bdf6bd tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.506362 Oct 27 19:10:31.507430 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2642/5094] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:30 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:10:31.646849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e42f2402-811f-4ec5-9254-ef1ae4c5888e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:31.648146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e42f2402-811f-4ec5-9254-ef1ae4c5888e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:31.666735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e42f2402-811f-4ec5-9254-ef1ae4c5888e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:31.666735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e42f2402-811f-4ec5-9254-ef1ae4c5888e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:31.667005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e42f2402-811f-4ec5-9254-ef1ae4c5888e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:31.667592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e42f2402-811f-4ec5-9254-ef1ae4c5888e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:31.668046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e42f2402-811f-4ec5-9254-ef1ae4c5888e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:31.669191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e42f2402-811f-4ec5-9254-ef1ae4c5888e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:32.188749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-31d750d6-d22d-4b68-a2e8-62eeb2ab4100 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:32.204127 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-31d750d6-d22d-4b68-a2e8-62eeb2ab4100 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 1.311818 Oct 27 19:10:32.205395 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2453/5095] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:30 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:32.522794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d1380af7-31e3-42b6-8bea-4c747694fd93 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:32.529106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d1380af7-31e3-42b6-8bea-4c747694fd93 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:32.539221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e42f2402-811f-4ec5-9254-ef1ae4c5888e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:32.560543 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e42f2402-811f-4ec5-9254-ef1ae4c5888e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.920049 Oct 27 19:10:32.562408 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2643/5096] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:31 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:32.607121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1380af7-31e3-42b6-8bea-4c747694fd93 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:32.607121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1380af7-31e3-42b6-8bea-4c747694fd93 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:32.607121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1380af7-31e3-42b6-8bea-4c747694fd93 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:32.607121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1380af7-31e3-42b6-8bea-4c747694fd93 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:32.607121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1380af7-31e3-42b6-8bea-4c747694fd93 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:32.607121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1380af7-31e3-42b6-8bea-4c747694fd93 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:32.958991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d1380af7-31e3-42b6-8bea-4c747694fd93 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:32.978711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d1380af7-31e3-42b6-8bea-4c747694fd93 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:32.982254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d1380af7-31e3-42b6-8bea-4c747694fd93 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:32.996800 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d1380af7-31e3-42b6-8bea-4c747694fd93 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.480907 Oct 27 19:10:33.001972 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2454/5097] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:32 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:10:33.235537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2b5c6be1-759c-4491-82d7-4ec3af1edc57 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:33.236561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2b5c6be1-759c-4491-82d7-4ec3af1edc57 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:33.249790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5c6be1-759c-4491-82d7-4ec3af1edc57 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:33.251862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5c6be1-759c-4491-82d7-4ec3af1edc57 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:33.263582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5c6be1-759c-4491-82d7-4ec3af1edc57 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:33.263582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5c6be1-759c-4491-82d7-4ec3af1edc57 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:33.263582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5c6be1-759c-4491-82d7-4ec3af1edc57 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:33.263582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5c6be1-759c-4491-82d7-4ec3af1edc57 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:33.576944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2b5c6be1-759c-4491-82d7-4ec3af1edc57 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:33.596552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd08d7b9-5dd8-4f9d-bcbd-358c20800142 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:33.597721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bd08d7b9-5dd8-4f9d-bcbd-358c20800142 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:33.630233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd08d7b9-5dd8-4f9d-bcbd-358c20800142 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:33.631087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd08d7b9-5dd8-4f9d-bcbd-358c20800142 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:33.633601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd08d7b9-5dd8-4f9d-bcbd-358c20800142 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:33.634868 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2b5c6be1-759c-4491-82d7-4ec3af1edc57 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 0.403389 Oct 27 19:10:33.636045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd08d7b9-5dd8-4f9d-bcbd-358c20800142 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:33.636871 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2644/5098] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:33 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:33.640486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd08d7b9-5dd8-4f9d-bcbd-358c20800142 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:33.641134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd08d7b9-5dd8-4f9d-bcbd-358c20800142 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:34.043133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2138834d-8cc6-43e6-9e83-ebcf5fd1c470 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:34.044736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2138834d-8cc6-43e6-9e83-ebcf5fd1c470 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:34.074502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2138834d-8cc6-43e6-9e83-ebcf5fd1c470 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:34.074502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2138834d-8cc6-43e6-9e83-ebcf5fd1c470 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:34.074502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2138834d-8cc6-43e6-9e83-ebcf5fd1c470 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:34.074502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2138834d-8cc6-43e6-9e83-ebcf5fd1c470 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:34.074502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2138834d-8cc6-43e6-9e83-ebcf5fd1c470 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:34.074502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2138834d-8cc6-43e6-9e83-ebcf5fd1c470 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:34.178120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bd08d7b9-5dd8-4f9d-bcbd-358c20800142 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:34.193112 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bd08d7b9-5dd8-4f9d-bcbd-358c20800142 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.603498 Oct 27 19:10:34.219021 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2455/5099] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:33 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:34.410109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2138834d-8cc6-43e6-9e83-ebcf5fd1c470 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:34.425248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2138834d-8cc6-43e6-9e83-ebcf5fd1c470 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:34.431339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2138834d-8cc6-43e6-9e83-ebcf5fd1c470 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:34.461700 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2138834d-8cc6-43e6-9e83-ebcf5fd1c470 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.423213 Oct 27 19:10:34.463698 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2645/5100] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:34 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:34.671757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-49414c62-6e7a-4618-a07f-40aa2c69bd6b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:34.673424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-49414c62-6e7a-4618-a07f-40aa2c69bd6b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:34.712571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49414c62-6e7a-4618-a07f-40aa2c69bd6b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:34.717225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49414c62-6e7a-4618-a07f-40aa2c69bd6b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:34.722909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49414c62-6e7a-4618-a07f-40aa2c69bd6b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:34.731306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49414c62-6e7a-4618-a07f-40aa2c69bd6b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:34.733013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49414c62-6e7a-4618-a07f-40aa2c69bd6b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:34.741022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49414c62-6e7a-4618-a07f-40aa2c69bd6b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:35.018568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-88bf71a3-52f4-46dd-a5a3-6f25529660ac req-88aa9b2c-db36-4282-b37b-65abf92c011e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c", "name": "network-vif-plugged", "status": "completed", "tag": "80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:10:35.051901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-88bf71a3-52f4-46dd-a5a3-6f25529660ac req-88aa9b2c-db36-4282-b37b-65abf92c011e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:35.051901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-88bf71a3-52f4-46dd-a5a3-6f25529660ac req-88aa9b2c-db36-4282-b37b-65abf92c011e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:35.051901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-88bf71a3-52f4-46dd-a5a3-6f25529660ac req-88aa9b2c-db36-4282-b37b-65abf92c011e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:35.139431 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-88bf71a3-52f4-46dd-a5a3-6f25529660ac req-88aa9b2c-db36-4282-b37b-65abf92c011e service nova] Creating event network-vif-plugged:80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4 for instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c on n-h1-860687-3 Oct 27 19:10:35.161730 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-88bf71a3-52f4-46dd-a5a3-6f25529660ac req-88aa9b2c-db36-4282-b37b-65abf92c011e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148397 Oct 27 19:10:35.167773 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2646/5101] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:10:35.250582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5465bfe3-3f4c-4922-8050-ec44da870bbc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:35.252029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5465bfe3-3f4c-4922-8050-ec44da870bbc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:35.277527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5465bfe3-3f4c-4922-8050-ec44da870bbc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:35.286020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5465bfe3-3f4c-4922-8050-ec44da870bbc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:35.286795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5465bfe3-3f4c-4922-8050-ec44da870bbc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:35.287995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5465bfe3-3f4c-4922-8050-ec44da870bbc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:35.299239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5465bfe3-3f4c-4922-8050-ec44da870bbc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:35.313372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5465bfe3-3f4c-4922-8050-ec44da870bbc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:35.572615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-49414c62-6e7a-4618-a07f-40aa2c69bd6b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:35.586327 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-49414c62-6e7a-4618-a07f-40aa2c69bd6b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1506 microversion: 2.1 time: 0.922397 Oct 27 19:10:35.603591 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2456/5102] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:34 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1506 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:35.619973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-59eed1ca-4a30-4742-a741-28d26fe1d5ab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:35.624094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-59eed1ca-4a30-4742-a741-28d26fe1d5ab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:35.647660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59eed1ca-4a30-4742-a741-28d26fe1d5ab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:35.648478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59eed1ca-4a30-4742-a741-28d26fe1d5ab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:35.650943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59eed1ca-4a30-4742-a741-28d26fe1d5ab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:35.651988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59eed1ca-4a30-4742-a741-28d26fe1d5ab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:35.652691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59eed1ca-4a30-4742-a741-28d26fe1d5ab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:35.655417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59eed1ca-4a30-4742-a741-28d26fe1d5ab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:35.845331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-59eed1ca-4a30-4742-a741-28d26fe1d5ab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:35.861082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-59eed1ca-4a30-4742-a741-28d26fe1d5ab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:35.866884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-59eed1ca-4a30-4742-a741-28d26fe1d5ab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:35.884056 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-59eed1ca-4a30-4742-a741-28d26fe1d5ab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.273054 Oct 27 19:10:35.886529 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2457/5103] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:35 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:36.616364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d629e60-8789-4084-99f9-d62d150bc3a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:36.617007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d629e60-8789-4084-99f9-d62d150bc3a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:36.643557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d629e60-8789-4084-99f9-d62d150bc3a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:36.650535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d629e60-8789-4084-99f9-d62d150bc3a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:36.656486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d629e60-8789-4084-99f9-d62d150bc3a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:36.662693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d629e60-8789-4084-99f9-d62d150bc3a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:36.663247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d629e60-8789-4084-99f9-d62d150bc3a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:36.668190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d629e60-8789-4084-99f9-d62d150bc3a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:36.963128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d629e60-8789-4084-99f9-d62d150bc3a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:36.972659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5465bfe3-3f4c-4922-8050-ec44da870bbc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:36.976965 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d629e60-8789-4084-99f9-d62d150bc3a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1527 microversion: 2.1 time: 0.364580 Oct 27 19:10:36.979033 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2458/5104] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:36 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1527 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:10:36.984878 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5465bfe3-3f4c-4922-8050-ec44da870bbc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 1.739590 Oct 27 19:10:36.995143 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2647/5105] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:35 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:36.996983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5d0a342a-7e63-4fef-99c7-6a3b18e38b71 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:36.997685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5d0a342a-7e63-4fef-99c7-6a3b18e38b71 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:37.015379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d0a342a-7e63-4fef-99c7-6a3b18e38b71 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:37.016008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d0a342a-7e63-4fef-99c7-6a3b18e38b71 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:37.016530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d0a342a-7e63-4fef-99c7-6a3b18e38b71 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:37.017352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d0a342a-7e63-4fef-99c7-6a3b18e38b71 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:37.017850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d0a342a-7e63-4fef-99c7-6a3b18e38b71 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:37.018360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d0a342a-7e63-4fef-99c7-6a3b18e38b71 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:37.117865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5d0a342a-7e63-4fef-99c7-6a3b18e38b71 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:37.134535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5d0a342a-7e63-4fef-99c7-6a3b18e38b71 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:37.137956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5d0a342a-7e63-4fef-99c7-6a3b18e38b71 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:37.153303 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5d0a342a-7e63-4fef-99c7-6a3b18e38b71 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.167136 Oct 27 19:10:37.154988 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2459/5106] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:36 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:38.026890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-920f22cf-ec30-45fe-bf9c-00e1d5eafc75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:38.027666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-920f22cf-ec30-45fe-bf9c-00e1d5eafc75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:38.028823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dba7a9ec-6ee6-4642-a11f-73ce39250b64 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:38.029784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dba7a9ec-6ee6-4642-a11f-73ce39250b64 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:38.042603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=70 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:10:38.047187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-920f22cf-ec30-45fe-bf9c-00e1d5eafc75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:38.048184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-920f22cf-ec30-45fe-bf9c-00e1d5eafc75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:38.054061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-920f22cf-ec30-45fe-bf9c-00e1d5eafc75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:38.057938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-920f22cf-ec30-45fe-bf9c-00e1d5eafc75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:38.058953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-920f22cf-ec30-45fe-bf9c-00e1d5eafc75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:38.059626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-920f22cf-ec30-45fe-bf9c-00e1d5eafc75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:38.062345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dba7a9ec-6ee6-4642-a11f-73ce39250b64 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:38.064904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dba7a9ec-6ee6-4642-a11f-73ce39250b64 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:38.066364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dba7a9ec-6ee6-4642-a11f-73ce39250b64 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:38.069717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dba7a9ec-6ee6-4642-a11f-73ce39250b64 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:38.073120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dba7a9ec-6ee6-4642-a11f-73ce39250b64 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:38.074094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dba7a9ec-6ee6-4642-a11f-73ce39250b64 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:38.475010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-920f22cf-ec30-45fe-bf9c-00e1d5eafc75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:38.488768 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-920f22cf-ec30-45fe-bf9c-00e1d5eafc75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1527 microversion: 2.1 time: 0.466296 Oct 27 19:10:38.490995 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2648/5107] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:38 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1527 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:38.506472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1fcc863f-aa7a-486d-8bb8-0e96a5515f0e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:38.506472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1fcc863f-aa7a-486d-8bb8-0e96a5515f0e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:38.532142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fcc863f-aa7a-486d-8bb8-0e96a5515f0e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:38.539517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fcc863f-aa7a-486d-8bb8-0e96a5515f0e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:38.540261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fcc863f-aa7a-486d-8bb8-0e96a5515f0e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:38.541365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fcc863f-aa7a-486d-8bb8-0e96a5515f0e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:38.545382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fcc863f-aa7a-486d-8bb8-0e96a5515f0e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:38.546263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fcc863f-aa7a-486d-8bb8-0e96a5515f0e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:38.705676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1fcc863f-aa7a-486d-8bb8-0e96a5515f0e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:38.715446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1fcc863f-aa7a-486d-8bb8-0e96a5515f0e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:38.724785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1fcc863f-aa7a-486d-8bb8-0e96a5515f0e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:38.734229 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1fcc863f-aa7a-486d-8bb8-0e96a5515f0e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.240016 Oct 27 19:10:38.741194 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2649/5108] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:38 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:38.798469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dba7a9ec-6ee6-4642-a11f-73ce39250b64 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:38.815144 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dba7a9ec-6ee6-4642-a11f-73ce39250b64 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.790078 Oct 27 19:10:38.826667 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2460/5109] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:38 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:39.515770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e47b6cff-fa0c-4f2a-8203-42c2590ccadf tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:39.516688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e47b6cff-fa0c-4f2a-8203-42c2590ccadf tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:39.533337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e47b6cff-fa0c-4f2a-8203-42c2590ccadf tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:39.563301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e47b6cff-fa0c-4f2a-8203-42c2590ccadf tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:39.563778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e47b6cff-fa0c-4f2a-8203-42c2590ccadf tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:39.564575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e47b6cff-fa0c-4f2a-8203-42c2590ccadf tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:39.565046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e47b6cff-fa0c-4f2a-8203-42c2590ccadf tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:39.565487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e47b6cff-fa0c-4f2a-8203-42c2590ccadf tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:39.770031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7d5ab27b-6c54-494c-8e39-170437cb6bab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:39.770689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7d5ab27b-6c54-494c-8e39-170437cb6bab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:39.786186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5ab27b-6c54-494c-8e39-170437cb6bab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:39.786648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5ab27b-6c54-494c-8e39-170437cb6bab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:39.787099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5ab27b-6c54-494c-8e39-170437cb6bab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:39.787832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5ab27b-6c54-494c-8e39-170437cb6bab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:39.788304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5ab27b-6c54-494c-8e39-170437cb6bab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:39.788755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5ab27b-6c54-494c-8e39-170437cb6bab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:40.001466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e47b6cff-fa0c-4f2a-8203-42c2590ccadf tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:40.009873 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e47b6cff-fa0c-4f2a-8203-42c2590ccadf tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1527 microversion: 2.1 time: 0.498744 Oct 27 19:10:40.010682 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2650/5110] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:39 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1527 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:40.035139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2050ad2f-923b-4505-9182-b3ea2d4a9272 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:40.035774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2050ad2f-923b-4505-9182-b3ea2d4a9272 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:40.054164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2050ad2f-923b-4505-9182-b3ea2d4a9272 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:40.054965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2050ad2f-923b-4505-9182-b3ea2d4a9272 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:40.055419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2050ad2f-923b-4505-9182-b3ea2d4a9272 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:40.056154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2050ad2f-923b-4505-9182-b3ea2d4a9272 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:40.056619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2050ad2f-923b-4505-9182-b3ea2d4a9272 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:40.057062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2050ad2f-923b-4505-9182-b3ea2d4a9272 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:40.351060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2050ad2f-923b-4505-9182-b3ea2d4a9272 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:40.364002 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2050ad2f-923b-4505-9182-b3ea2d4a9272 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.332762 Oct 27 19:10:40.367417 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2651/5111] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:40 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:40.507574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7d5ab27b-6c54-494c-8e39-170437cb6bab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:40.541595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7d5ab27b-6c54-494c-8e39-170437cb6bab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:40.543378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7d5ab27b-6c54-494c-8e39-170437cb6bab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:40.585848 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7d5ab27b-6c54-494c-8e39-170437cb6bab tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.819882 Oct 27 19:10:40.586476 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2461/5112] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:39 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:10:41.037764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3f30fa07-ba03-4d1a-9174-18de730096e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:41.039306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3f30fa07-ba03-4d1a-9174-18de730096e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:41.048764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f30fa07-ba03-4d1a-9174-18de730096e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:41.052161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f30fa07-ba03-4d1a-9174-18de730096e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:41.055181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f30fa07-ba03-4d1a-9174-18de730096e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:41.057018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f30fa07-ba03-4d1a-9174-18de730096e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:41.058006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f30fa07-ba03-4d1a-9174-18de730096e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:41.061529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f30fa07-ba03-4d1a-9174-18de730096e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:41.393829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ea7f40ac-f26a-4eea-8208-bf8dc0e8ed78 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:41.394962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ea7f40ac-f26a-4eea-8208-bf8dc0e8ed78 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:41.405705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea7f40ac-f26a-4eea-8208-bf8dc0e8ed78 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:41.406199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea7f40ac-f26a-4eea-8208-bf8dc0e8ed78 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:41.406670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea7f40ac-f26a-4eea-8208-bf8dc0e8ed78 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:41.416927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea7f40ac-f26a-4eea-8208-bf8dc0e8ed78 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:41.417444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea7f40ac-f26a-4eea-8208-bf8dc0e8ed78 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:41.417913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea7f40ac-f26a-4eea-8208-bf8dc0e8ed78 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:41.740530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3f30fa07-ba03-4d1a-9174-18de730096e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:41.767726 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3f30fa07-ba03-4d1a-9174-18de730096e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1527 microversion: 2.1 time: 0.734430 Oct 27 19:10:41.783585 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2652/5113] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:41 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1527 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:41.825445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-40ef82c9-d4a3-4640-a764-2f6755d1b3ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:41.826172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-40ef82c9-d4a3-4640-a764-2f6755d1b3ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:41.855128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40ef82c9-d4a3-4640-a764-2f6755d1b3ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:41.866273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40ef82c9-d4a3-4640-a764-2f6755d1b3ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:41.866827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40ef82c9-d4a3-4640-a764-2f6755d1b3ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:41.867599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40ef82c9-d4a3-4640-a764-2f6755d1b3ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:41.868089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40ef82c9-d4a3-4640-a764-2f6755d1b3ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:41.868533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40ef82c9-d4a3-4640-a764-2f6755d1b3ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:41.953288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ea7f40ac-f26a-4eea-8208-bf8dc0e8ed78 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:41.973335 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ea7f40ac-f26a-4eea-8208-bf8dc0e8ed78 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.583423 Oct 27 19:10:41.974675 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2462/5114] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:41 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:42.150839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-40ef82c9-d4a3-4640-a764-2f6755d1b3ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:42.174679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-40ef82c9-d4a3-4640-a764-2f6755d1b3ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:42.182995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-40ef82c9-d4a3-4640-a764-2f6755d1b3ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:42.217971 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-40ef82c9-d4a3-4640-a764-2f6755d1b3ec tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.431296 Oct 27 19:10:42.221479 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2653/5115] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:41 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:42.592865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-a1e36f12-69b9-4e8d-a94b-590ba159a643 req-8bb5fc61-02e5-4031-b35b-30e8125b1e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164658b9-90aa-4fe2-afd7-dbcb65930773", "name": "network-vif-plugged", "status": "completed", "tag": "07f2b85d-6225-45f3-b627-a56cbcb48883"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:10:42.625273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a1e36f12-69b9-4e8d-a94b-590ba159a643 req-8bb5fc61-02e5-4031-b35b-30e8125b1e69 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:42.633459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a1e36f12-69b9-4e8d-a94b-590ba159a643 req-8bb5fc61-02e5-4031-b35b-30e8125b1e69 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:42.637864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a1e36f12-69b9-4e8d-a94b-590ba159a643 req-8bb5fc61-02e5-4031-b35b-30e8125b1e69 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:42.700644 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a1e36f12-69b9-4e8d-a94b-590ba159a643 req-8bb5fc61-02e5-4031-b35b-30e8125b1e69 service nova] Creating event network-vif-plugged:07f2b85d-6225-45f3-b627-a56cbcb48883 for instance 164658b9-90aa-4fe2-afd7-dbcb65930773 on n-h2-860687-3 Oct 27 19:10:42.745150 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-a1e36f12-69b9-4e8d-a94b-590ba159a643 req-8bb5fc61-02e5-4031-b35b-30e8125b1e69 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156499 Oct 27 19:10:42.746374 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2463/5116] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:10:42.797547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3fb9e342-6e9c-4b9a-b1b7-36458c804772 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:42.798116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3fb9e342-6e9c-4b9a-b1b7-36458c804772 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:42.825545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3fb9e342-6e9c-4b9a-b1b7-36458c804772 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:42.827726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3fb9e342-6e9c-4b9a-b1b7-36458c804772 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:42.831160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3fb9e342-6e9c-4b9a-b1b7-36458c804772 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:42.839254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3fb9e342-6e9c-4b9a-b1b7-36458c804772 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:42.844297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3fb9e342-6e9c-4b9a-b1b7-36458c804772 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:42.852818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3fb9e342-6e9c-4b9a-b1b7-36458c804772 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:43.004005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-915166dd-f0fa-46c0-968e-41142c31d955 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:43.005101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-915166dd-f0fa-46c0-968e-41142c31d955 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:43.023294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-915166dd-f0fa-46c0-968e-41142c31d955 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:43.029620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-915166dd-f0fa-46c0-968e-41142c31d955 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:43.030401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-915166dd-f0fa-46c0-968e-41142c31d955 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:43.031497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-915166dd-f0fa-46c0-968e-41142c31d955 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:43.032263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-915166dd-f0fa-46c0-968e-41142c31d955 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:43.032901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-915166dd-f0fa-46c0-968e-41142c31d955 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:43.424061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3fb9e342-6e9c-4b9a-b1b7-36458c804772 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:43.435564 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3fb9e342-6e9c-4b9a-b1b7-36458c804772 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.643448 Oct 27 19:10:43.443849 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2654/5117] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:42 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:10:43.452973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-44c496e6-6f16-4435-a69c-91afca873ae6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:43.454315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-44c496e6-6f16-4435-a69c-91afca873ae6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:43.470322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44c496e6-6f16-4435-a69c-91afca873ae6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:43.471340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44c496e6-6f16-4435-a69c-91afca873ae6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:43.472196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44c496e6-6f16-4435-a69c-91afca873ae6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:43.474338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44c496e6-6f16-4435-a69c-91afca873ae6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:43.475002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44c496e6-6f16-4435-a69c-91afca873ae6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:43.476937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44c496e6-6f16-4435-a69c-91afca873ae6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:43.717363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-44c496e6-6f16-4435-a69c-91afca873ae6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:43.723266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-915166dd-f0fa-46c0-968e-41142c31d955 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:43.742834 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-915166dd-f0fa-46c0-968e-41142c31d955 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.744526 Oct 27 19:10:43.747801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-44c496e6-6f16-4435-a69c-91afca873ae6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:43.748206 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2464/5118] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:42 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:43.757322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-44c496e6-6f16-4435-a69c-91afca873ae6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:43.778114 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-44c496e6-6f16-4435-a69c-91afca873ae6 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.331977 Oct 27 19:10:43.780691 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2655/5119] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:43 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:44.481750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d7bfb96-eed6-4d33-900f-7f5f1d438867 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:44.483639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d7bfb96-eed6-4d33-900f-7f5f1d438867 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:44.510364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d7bfb96-eed6-4d33-900f-7f5f1d438867 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:44.511056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d7bfb96-eed6-4d33-900f-7f5f1d438867 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:44.511450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d7bfb96-eed6-4d33-900f-7f5f1d438867 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:44.520004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d7bfb96-eed6-4d33-900f-7f5f1d438867 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:44.526135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d7bfb96-eed6-4d33-900f-7f5f1d438867 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:44.526940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d7bfb96-eed6-4d33-900f-7f5f1d438867 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:44.771537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0a340107-60c1-4e04-bd34-d1a52510d354 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:44.772242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0a340107-60c1-4e04-bd34-d1a52510d354 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:44.796815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a340107-60c1-4e04-bd34-d1a52510d354 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:44.797428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a340107-60c1-4e04-bd34-d1a52510d354 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:44.798100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a340107-60c1-4e04-bd34-d1a52510d354 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:44.799724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a340107-60c1-4e04-bd34-d1a52510d354 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:44.800450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a340107-60c1-4e04-bd34-d1a52510d354 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:44.807091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a340107-60c1-4e04-bd34-d1a52510d354 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:44.949761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6d7bfb96-eed6-4d33-900f-7f5f1d438867 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:44.960595 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d7bfb96-eed6-4d33-900f-7f5f1d438867 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.491429 Oct 27 19:10:44.969508 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2465/5120] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:44 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:44.984416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d5ca3da2-7bfc-4e9b-b6d1-4e24b6a0fad4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:44.989188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d5ca3da2-7bfc-4e9b-b6d1-4e24b6a0fad4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:45.018228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5ca3da2-7bfc-4e9b-b6d1-4e24b6a0fad4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:45.024693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5ca3da2-7bfc-4e9b-b6d1-4e24b6a0fad4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:45.026106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5ca3da2-7bfc-4e9b-b6d1-4e24b6a0fad4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:45.027563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5ca3da2-7bfc-4e9b-b6d1-4e24b6a0fad4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:45.028327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5ca3da2-7bfc-4e9b-b6d1-4e24b6a0fad4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:45.029899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5ca3da2-7bfc-4e9b-b6d1-4e24b6a0fad4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:45.272921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d5ca3da2-7bfc-4e9b-b6d1-4e24b6a0fad4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:45.282363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d5ca3da2-7bfc-4e9b-b6d1-4e24b6a0fad4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:45.294280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d5ca3da2-7bfc-4e9b-b6d1-4e24b6a0fad4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:45.305687 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d5ca3da2-7bfc-4e9b-b6d1-4e24b6a0fad4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.334690 Oct 27 19:10:45.318480 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2466/5121] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:44 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:45.341175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0a340107-60c1-4e04-bd34-d1a52510d354 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:45.357584 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0a340107-60c1-4e04-bd34-d1a52510d354 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.590021 Oct 27 19:10:45.358841 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2656/5122] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:44 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:45.997179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-962f70f3-b98d-4f5a-adb9-373bcb5c92e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:45.999262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-962f70f3-b98d-4f5a-adb9-373bcb5c92e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:46.003119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=64 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:10:46.026058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-962f70f3-b98d-4f5a-adb9-373bcb5c92e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:46.035196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-962f70f3-b98d-4f5a-adb9-373bcb5c92e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:46.036031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-962f70f3-b98d-4f5a-adb9-373bcb5c92e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:46.036977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-962f70f3-b98d-4f5a-adb9-373bcb5c92e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:46.038719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-962f70f3-b98d-4f5a-adb9-373bcb5c92e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:46.039361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-962f70f3-b98d-4f5a-adb9-373bcb5c92e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:46.349291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4f486358-d20c-435c-96f2-cd217fcc62e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:46.350615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4f486358-d20c-435c-96f2-cd217fcc62e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:46.365186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f486358-d20c-435c-96f2-cd217fcc62e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:46.366151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f486358-d20c-435c-96f2-cd217fcc62e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:46.366855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f486358-d20c-435c-96f2-cd217fcc62e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:46.368498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f486358-d20c-435c-96f2-cd217fcc62e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:46.370622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f486358-d20c-435c-96f2-cd217fcc62e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:46.371737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f486358-d20c-435c-96f2-cd217fcc62e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:46.572074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4f486358-d20c-435c-96f2-cd217fcc62e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:46.585511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4f486358-d20c-435c-96f2-cd217fcc62e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:46.595539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4f486358-d20c-435c-96f2-cd217fcc62e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:46.606318 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4f486358-d20c-435c-96f2-cd217fcc62e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.261151 Oct 27 19:10:46.622170 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2657/5123] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:46 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:10:46.636347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5421cd9e-a5b3-4130-9611-7f38d46d5426 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:46.637316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5421cd9e-a5b3-4130-9611-7f38d46d5426 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:46.645002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5421cd9e-a5b3-4130-9611-7f38d46d5426 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:46.645884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5421cd9e-a5b3-4130-9611-7f38d46d5426 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:46.646613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5421cd9e-a5b3-4130-9611-7f38d46d5426 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:46.647611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5421cd9e-a5b3-4130-9611-7f38d46d5426 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:46.648331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5421cd9e-a5b3-4130-9611-7f38d46d5426 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:46.649013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5421cd9e-a5b3-4130-9611-7f38d46d5426 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:46.674669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:10:46.866599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5421cd9e-a5b3-4130-9611-7f38d46d5426 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:46.881055 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5421cd9e-a5b3-4130-9611-7f38d46d5426 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.253809 Oct 27 19:10:46.882114 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2658/5124] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:46 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:46.975280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-962f70f3-b98d-4f5a-adb9-373bcb5c92e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:46.990530 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-962f70f3-b98d-4f5a-adb9-373bcb5c92e3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.994764 Oct 27 19:10:46.992617 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2467/5125] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:45 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:47.642010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9439ffa3-4d75-4603-9ca2-08341bca9477 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:47.642875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9439ffa3-4d75-4603-9ca2-08341bca9477 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:47.664050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9439ffa3-4d75-4603-9ca2-08341bca9477 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:47.664852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9439ffa3-4d75-4603-9ca2-08341bca9477 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:47.665546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9439ffa3-4d75-4603-9ca2-08341bca9477 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:47.666462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9439ffa3-4d75-4603-9ca2-08341bca9477 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:47.667837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9439ffa3-4d75-4603-9ca2-08341bca9477 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:47.671505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9439ffa3-4d75-4603-9ca2-08341bca9477 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:47.906837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-57f3f1b5-0213-4890-9cda-b488fc05b08d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:47.908084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-57f3f1b5-0213-4890-9cda-b488fc05b08d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:47.940092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57f3f1b5-0213-4890-9cda-b488fc05b08d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:47.943174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57f3f1b5-0213-4890-9cda-b488fc05b08d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:47.943895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57f3f1b5-0213-4890-9cda-b488fc05b08d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:47.952171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57f3f1b5-0213-4890-9cda-b488fc05b08d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:47.958134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57f3f1b5-0213-4890-9cda-b488fc05b08d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:47.960033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57f3f1b5-0213-4890-9cda-b488fc05b08d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:47.985256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9439ffa3-4d75-4603-9ca2-08341bca9477 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:47.997422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9439ffa3-4d75-4603-9ca2-08341bca9477 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:48.009319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9439ffa3-4d75-4603-9ca2-08341bca9477 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:48.036916 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9439ffa3-4d75-4603-9ca2-08341bca9477 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.394582 Oct 27 19:10:48.047326 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2659/5126] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:47 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:48.060030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6a4c7977-d132-4282-b328-236dccbc44ff tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:48.067107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6a4c7977-d132-4282-b328-236dccbc44ff tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:48.091394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a4c7977-d132-4282-b328-236dccbc44ff tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:48.094164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a4c7977-d132-4282-b328-236dccbc44ff tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:48.094834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a4c7977-d132-4282-b328-236dccbc44ff tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:48.097381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a4c7977-d132-4282-b328-236dccbc44ff tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:48.104454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a4c7977-d132-4282-b328-236dccbc44ff tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:48.105167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a4c7977-d132-4282-b328-236dccbc44ff tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:48.684157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-57f3f1b5-0213-4890-9cda-b488fc05b08d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:48.686967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:10:48.707281 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-57f3f1b5-0213-4890-9cda-b488fc05b08d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.804782 Oct 27 19:10:48.712779 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2468/5127] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:47 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:48.797476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6a4c7977-d132-4282-b328-236dccbc44ff tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:48.806423 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6a4c7977-d132-4282-b328-236dccbc44ff tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.757644 Oct 27 19:10:48.807024 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2660/5128] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:48 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:49.081394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-530318a5-e8e1-41f6-9d24-2a0197db36eb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:49.083232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-530318a5-e8e1-41f6-9d24-2a0197db36eb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:49.100624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-530318a5-e8e1-41f6-9d24-2a0197db36eb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:49.101311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-530318a5-e8e1-41f6-9d24-2a0197db36eb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:49.102007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-530318a5-e8e1-41f6-9d24-2a0197db36eb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:49.112497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-530318a5-e8e1-41f6-9d24-2a0197db36eb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:49.114490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-530318a5-e8e1-41f6-9d24-2a0197db36eb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:49.115852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-530318a5-e8e1-41f6-9d24-2a0197db36eb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:49.320917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-530318a5-e8e1-41f6-9d24-2a0197db36eb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:49.334866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-530318a5-e8e1-41f6-9d24-2a0197db36eb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:49.345782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-530318a5-e8e1-41f6-9d24-2a0197db36eb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:49.354694 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-530318a5-e8e1-41f6-9d24-2a0197db36eb tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.280795 Oct 27 19:10:49.396238 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2469/5129] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:49 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:49.739612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fae38e6b-c436-4bed-9240-1c3cff167258 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:49.740508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fae38e6b-c436-4bed-9240-1c3cff167258 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:49.761552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fae38e6b-c436-4bed-9240-1c3cff167258 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:49.766533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fae38e6b-c436-4bed-9240-1c3cff167258 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:49.767258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fae38e6b-c436-4bed-9240-1c3cff167258 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:49.769478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fae38e6b-c436-4bed-9240-1c3cff167258 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:49.776682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fae38e6b-c436-4bed-9240-1c3cff167258 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:49.777518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fae38e6b-c436-4bed-9240-1c3cff167258 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:49.837905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b9833c75-5e9d-4776-8d38-3a1037e2d718 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:49.839150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b9833c75-5e9d-4776-8d38-3a1037e2d718 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:49.852503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9833c75-5e9d-4776-8d38-3a1037e2d718 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:49.863005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9833c75-5e9d-4776-8d38-3a1037e2d718 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:49.863775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9833c75-5e9d-4776-8d38-3a1037e2d718 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:49.869624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9833c75-5e9d-4776-8d38-3a1037e2d718 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:49.870504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9833c75-5e9d-4776-8d38-3a1037e2d718 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:49.872266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9833c75-5e9d-4776-8d38-3a1037e2d718 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:50.184478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fae38e6b-c436-4bed-9240-1c3cff167258 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:50.196496 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fae38e6b-c436-4bed-9240-1c3cff167258 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.461829 Oct 27 19:10:50.212116 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2661/5130] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:49 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:50.328085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b9833c75-5e9d-4776-8d38-3a1037e2d718 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:50.337271 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b9833c75-5e9d-4776-8d38-3a1037e2d718 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.503510 Oct 27 19:10:50.342547 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2470/5131] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:49 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:50.394116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0460c368-ef93-4e5d-b49f-95f51d17a2ff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:50.396741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0460c368-ef93-4e5d-b49f-95f51d17a2ff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:50.408918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0460c368-ef93-4e5d-b49f-95f51d17a2ff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:50.414295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0460c368-ef93-4e5d-b49f-95f51d17a2ff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:50.416947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0460c368-ef93-4e5d-b49f-95f51d17a2ff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:50.418130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0460c368-ef93-4e5d-b49f-95f51d17a2ff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:50.424370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0460c368-ef93-4e5d-b49f-95f51d17a2ff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:50.425762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0460c368-ef93-4e5d-b49f-95f51d17a2ff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:50.651699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0460c368-ef93-4e5d-b49f-95f51d17a2ff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:50.664653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0460c368-ef93-4e5d-b49f-95f51d17a2ff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:50.667450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0460c368-ef93-4e5d-b49f-95f51d17a2ff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:50.675042 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0460c368-ef93-4e5d-b49f-95f51d17a2ff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.285351 Oct 27 19:10:50.676894 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2662/5132] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:50 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:51.228585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7bbfe42-b9fc-4340-8e7a-6f0c079b1f05 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:51.229224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a7bbfe42-b9fc-4340-8e7a-6f0c079b1f05 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:51.240712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7bbfe42-b9fc-4340-8e7a-6f0c079b1f05 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:51.241222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7bbfe42-b9fc-4340-8e7a-6f0c079b1f05 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:51.241676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7bbfe42-b9fc-4340-8e7a-6f0c079b1f05 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:51.242424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7bbfe42-b9fc-4340-8e7a-6f0c079b1f05 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:51.265368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7bbfe42-b9fc-4340-8e7a-6f0c079b1f05 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:51.265522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7bbfe42-b9fc-4340-8e7a-6f0c079b1f05 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:51.412663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7de1d9bf-66ba-448f-acbf-9db167df4c3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:51.413301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7de1d9bf-66ba-448f-acbf-9db167df4c3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:51.473294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7de1d9bf-66ba-448f-acbf-9db167df4c3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:51.478256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7de1d9bf-66ba-448f-acbf-9db167df4c3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:51.492983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7de1d9bf-66ba-448f-acbf-9db167df4c3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:51.499979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7de1d9bf-66ba-448f-acbf-9db167df4c3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:51.505543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7de1d9bf-66ba-448f-acbf-9db167df4c3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:51.511817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7de1d9bf-66ba-448f-acbf-9db167df4c3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:51.810952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a7bbfe42-b9fc-4340-8e7a-6f0c079b1f05 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:51.836131 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7bbfe42-b9fc-4340-8e7a-6f0c079b1f05 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.600051 Oct 27 19:10:51.865928 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2471/5133] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:51 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:51.881495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-257ae10f-c703-48a8-acdf-6286473ced0d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:51.882119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-257ae10f-c703-48a8-acdf-6286473ced0d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:51.902151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-257ae10f-c703-48a8-acdf-6286473ced0d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:51.919078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-257ae10f-c703-48a8-acdf-6286473ced0d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:51.919657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-257ae10f-c703-48a8-acdf-6286473ced0d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:51.920600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-257ae10f-c703-48a8-acdf-6286473ced0d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:51.921078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-257ae10f-c703-48a8-acdf-6286473ced0d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:51.921519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-257ae10f-c703-48a8-acdf-6286473ced0d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:51.933034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7de1d9bf-66ba-448f-acbf-9db167df4c3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:51.952423 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7de1d9bf-66ba-448f-acbf-9db167df4c3b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.577947 Oct 27 19:10:51.971734 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2663/5134] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:51 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:52.203286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-257ae10f-c703-48a8-acdf-6286473ced0d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:52.218730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-257ae10f-c703-48a8-acdf-6286473ced0d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:52.220264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-257ae10f-c703-48a8-acdf-6286473ced0d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:52.252622 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-257ae10f-c703-48a8-acdf-6286473ced0d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.388078 Oct 27 19:10:52.253667 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2472/5135] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:51 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:52.874767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b26678af-a2dc-4360-9f14-e73858c0eba9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:52.877868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b26678af-a2dc-4360-9f14-e73858c0eba9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:52.909343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b26678af-a2dc-4360-9f14-e73858c0eba9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:52.909858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b26678af-a2dc-4360-9f14-e73858c0eba9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:52.910311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b26678af-a2dc-4360-9f14-e73858c0eba9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:52.911067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b26678af-a2dc-4360-9f14-e73858c0eba9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:52.911539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b26678af-a2dc-4360-9f14-e73858c0eba9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:52.911989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b26678af-a2dc-4360-9f14-e73858c0eba9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:52.982944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5cf3a66c-d828-408c-acdb-7a23819e6db0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:52.984429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5cf3a66c-d828-408c-acdb-7a23819e6db0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:52.999298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cf3a66c-d828-408c-acdb-7a23819e6db0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:53.004189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cf3a66c-d828-408c-acdb-7a23819e6db0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:53.005317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cf3a66c-d828-408c-acdb-7a23819e6db0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:53.006492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cf3a66c-d828-408c-acdb-7a23819e6db0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:53.007148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cf3a66c-d828-408c-acdb-7a23819e6db0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:53.009532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cf3a66c-d828-408c-acdb-7a23819e6db0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:53.330726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b26678af-a2dc-4360-9f14-e73858c0eba9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:53.366753 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b26678af-a2dc-4360-9f14-e73858c0eba9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.497325 Oct 27 19:10:53.382454 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2664/5136] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:52 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:53.408615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e3a54e28-4231-4920-93df-bc9182d4bb98 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:53.409773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e3a54e28-4231-4920-93df-bc9182d4bb98 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:53.447926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3a54e28-4231-4920-93df-bc9182d4bb98 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:53.457218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3a54e28-4231-4920-93df-bc9182d4bb98 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:53.461095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3a54e28-4231-4920-93df-bc9182d4bb98 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:53.467701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3a54e28-4231-4920-93df-bc9182d4bb98 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:53.473194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3a54e28-4231-4920-93df-bc9182d4bb98 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:53.473996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3a54e28-4231-4920-93df-bc9182d4bb98 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:53.743252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e3a54e28-4231-4920-93df-bc9182d4bb98 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:53.755868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e3a54e28-4231-4920-93df-bc9182d4bb98 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:53.768132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e3a54e28-4231-4920-93df-bc9182d4bb98 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:53.780376 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e3a54e28-4231-4920-93df-bc9182d4bb98 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.394850 Oct 27 19:10:53.781000 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2665/5137] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:53 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:53.884835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5cf3a66c-d828-408c-acdb-7a23819e6db0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:53.898656 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5cf3a66c-d828-408c-acdb-7a23819e6db0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.923539 Oct 27 19:10:53.899274 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2473/5138] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:52 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:10:54.406302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-50e963a0-2ffb-48bd-ab5e-f46fded713cb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:54.407142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-50e963a0-2ffb-48bd-ab5e-f46fded713cb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:54.417106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50e963a0-2ffb-48bd-ab5e-f46fded713cb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:54.420076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50e963a0-2ffb-48bd-ab5e-f46fded713cb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:54.420849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50e963a0-2ffb-48bd-ab5e-f46fded713cb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:54.421443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50e963a0-2ffb-48bd-ab5e-f46fded713cb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:54.421925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50e963a0-2ffb-48bd-ab5e-f46fded713cb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:54.439456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50e963a0-2ffb-48bd-ab5e-f46fded713cb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:54.815088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-46053926-43a7-4538-8f5b-15f38e20c4fc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:54.815721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-46053926-43a7-4538-8f5b-15f38e20c4fc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:54.836008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46053926-43a7-4538-8f5b-15f38e20c4fc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:54.846980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46053926-43a7-4538-8f5b-15f38e20c4fc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:54.847487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46053926-43a7-4538-8f5b-15f38e20c4fc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:54.850347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46053926-43a7-4538-8f5b-15f38e20c4fc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:54.851000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46053926-43a7-4538-8f5b-15f38e20c4fc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:54.852907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46053926-43a7-4538-8f5b-15f38e20c4fc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:54.985131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-50e963a0-2ffb-48bd-ab5e-f46fded713cb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:54.999706 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-50e963a0-2ffb-48bd-ab5e-f46fded713cb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.596998 Oct 27 19:10:55.023144 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2666/5139] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:54 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:55.049004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-337c9545-672f-4885-ac75-d078db03e49d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:55.052205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-337c9545-672f-4885-ac75-d078db03e49d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:55.064676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-46053926-43a7-4538-8f5b-15f38e20c4fc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:55.073219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-46053926-43a7-4538-8f5b-15f38e20c4fc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:55.073447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-337c9545-672f-4885-ac75-d078db03e49d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:55.074728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-46053926-43a7-4538-8f5b-15f38e20c4fc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:55.074888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-337c9545-672f-4885-ac75-d078db03e49d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:55.075271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-337c9545-672f-4885-ac75-d078db03e49d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:55.077608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-337c9545-672f-4885-ac75-d078db03e49d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:55.079115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-337c9545-672f-4885-ac75-d078db03e49d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:55.079561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-337c9545-672f-4885-ac75-d078db03e49d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:55.109106 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-46053926-43a7-4538-8f5b-15f38e20c4fc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.299307 Oct 27 19:10:55.109981 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2474/5140] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:54 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:55.393206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-337c9545-672f-4885-ac75-d078db03e49d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:55.401712 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-337c9545-672f-4885-ac75-d078db03e49d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.373523 Oct 27 19:10:55.408746 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2667/5141] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:55 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:56.027563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e817ad7-cd4b-4041-81fd-3c953fd0a926 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:56.028278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e817ad7-cd4b-4041-81fd-3c953fd0a926 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:56.045609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e817ad7-cd4b-4041-81fd-3c953fd0a926 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:56.048969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e817ad7-cd4b-4041-81fd-3c953fd0a926 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:56.064682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e817ad7-cd4b-4041-81fd-3c953fd0a926 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:56.070266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e817ad7-cd4b-4041-81fd-3c953fd0a926 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:56.072113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e817ad7-cd4b-4041-81fd-3c953fd0a926 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:56.073687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e817ad7-cd4b-4041-81fd-3c953fd0a926 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:56.141954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b4f33f31-11f4-47a8-ad95-4bbd75389544 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:56.142706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b4f33f31-11f4-47a8-ad95-4bbd75389544 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:56.163147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4f33f31-11f4-47a8-ad95-4bbd75389544 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:56.168760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4f33f31-11f4-47a8-ad95-4bbd75389544 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:56.170161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4f33f31-11f4-47a8-ad95-4bbd75389544 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:56.171211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4f33f31-11f4-47a8-ad95-4bbd75389544 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:56.172596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4f33f31-11f4-47a8-ad95-4bbd75389544 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:56.175994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4f33f31-11f4-47a8-ad95-4bbd75389544 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:56.345418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4f33f31-11f4-47a8-ad95-4bbd75389544 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:56.361473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4f33f31-11f4-47a8-ad95-4bbd75389544 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:56.364415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4f33f31-11f4-47a8-ad95-4bbd75389544 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:56.383386 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b4f33f31-11f4-47a8-ad95-4bbd75389544 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.245495 Oct 27 19:10:56.399263 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2668/5142] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:56 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:10:56.433704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-07c380ec-1fdf-46aa-8016-12873b05a9f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:56.435637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-07c380ec-1fdf-46aa-8016-12873b05a9f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:56.446495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07c380ec-1fdf-46aa-8016-12873b05a9f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:56.452603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07c380ec-1fdf-46aa-8016-12873b05a9f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:56.453770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07c380ec-1fdf-46aa-8016-12873b05a9f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:56.454965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07c380ec-1fdf-46aa-8016-12873b05a9f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:56.458464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07c380ec-1fdf-46aa-8016-12873b05a9f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:56.461014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07c380ec-1fdf-46aa-8016-12873b05a9f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:56.773908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-07c380ec-1fdf-46aa-8016-12873b05a9f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:56.787931 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-07c380ec-1fdf-46aa-8016-12873b05a9f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.359111 Oct 27 19:10:56.789353 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2669/5143] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:56 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:10:57.215277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e817ad7-cd4b-4041-81fd-3c953fd0a926 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:57.226861 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e817ad7-cd4b-4041-81fd-3c953fd0a926 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 1.201714 Oct 27 19:10:57.227507 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2475/5144] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:56 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:57.455785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1c8c8903-8636-4372-83f6-803944937a66 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:57.465773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1c8c8903-8636-4372-83f6-803944937a66 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:57.494073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c8c8903-8636-4372-83f6-803944937a66 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:57.496712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c8c8903-8636-4372-83f6-803944937a66 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:57.500712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c8c8903-8636-4372-83f6-803944937a66 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:57.506733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c8c8903-8636-4372-83f6-803944937a66 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:57.511003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c8c8903-8636-4372-83f6-803944937a66 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:57.513014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c8c8903-8636-4372-83f6-803944937a66 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:57.811472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1c8c8903-8636-4372-83f6-803944937a66 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:57.818622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c1b00c89-fd9e-4672-a02e-ff2caa408bd1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:57.819253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c1b00c89-fd9e-4672-a02e-ff2caa408bd1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:57.828429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1c8c8903-8636-4372-83f6-803944937a66 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:57.834266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1c8c8903-8636-4372-83f6-803944937a66 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:57.835762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1b00c89-fd9e-4672-a02e-ff2caa408bd1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:57.838856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1b00c89-fd9e-4672-a02e-ff2caa408bd1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:57.842125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1b00c89-fd9e-4672-a02e-ff2caa408bd1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:57.843186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1b00c89-fd9e-4672-a02e-ff2caa408bd1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:57.843680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1b00c89-fd9e-4672-a02e-ff2caa408bd1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:57.847983 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1c8c8903-8636-4372-83f6-803944937a66 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.417517 Oct 27 19:10:57.850024 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2670/5145] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:57 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:10:57.857291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1b00c89-fd9e-4672-a02e-ff2caa408bd1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:58.254445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c3e1b15c-5510-4a81-8244-f414eea1f882 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:58.255390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c3e1b15c-5510-4a81-8244-f414eea1f882 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:58.271058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3e1b15c-5510-4a81-8244-f414eea1f882 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:58.271595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3e1b15c-5510-4a81-8244-f414eea1f882 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:58.272048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3e1b15c-5510-4a81-8244-f414eea1f882 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:58.272788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3e1b15c-5510-4a81-8244-f414eea1f882 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:58.273249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3e1b15c-5510-4a81-8244-f414eea1f882 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:58.287173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3e1b15c-5510-4a81-8244-f414eea1f882 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:58.300716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c1b00c89-fd9e-4672-a02e-ff2caa408bd1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:58.322621 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c1b00c89-fd9e-4672-a02e-ff2caa408bd1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.509127 Oct 27 19:10:58.330115 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2476/5146] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:57 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:10:58.884108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c3e1b15c-5510-4a81-8244-f414eea1f882 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:58.885087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aeaa5963-899e-4db7-9fa1-f479a349388c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:58.886725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aeaa5963-899e-4db7-9fa1-f479a349388c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:58.893928 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c3e1b15c-5510-4a81-8244-f414eea1f882 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.643629 Oct 27 19:10:58.900309 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2671/5147] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:58 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:10:58.902263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aeaa5963-899e-4db7-9fa1-f479a349388c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:58.908070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aeaa5963-899e-4db7-9fa1-f479a349388c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:58.908950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aeaa5963-899e-4db7-9fa1-f479a349388c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:58.909805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aeaa5963-899e-4db7-9fa1-f479a349388c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:58.910445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aeaa5963-899e-4db7-9fa1-f479a349388c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:58.910987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aeaa5963-899e-4db7-9fa1-f479a349388c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:59.254781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aeaa5963-899e-4db7-9fa1-f479a349388c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:59.274781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aeaa5963-899e-4db7-9fa1-f479a349388c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:59.277584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aeaa5963-899e-4db7-9fa1-f479a349388c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:59.313963 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aeaa5963-899e-4db7-9fa1-f479a349388c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.415986 Oct 27 19:10:59.315447 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2477/5148] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:10:58 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:10:59.362751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8543f0ab-5e2d-4ff8-9b31-118aab9b7209 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:59.363391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8543f0ab-5e2d-4ff8-9b31-118aab9b7209 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:59.370362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8543f0ab-5e2d-4ff8-9b31-118aab9b7209 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:59.371178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8543f0ab-5e2d-4ff8-9b31-118aab9b7209 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:59.372021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8543f0ab-5e2d-4ff8-9b31-118aab9b7209 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:59.387364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8543f0ab-5e2d-4ff8-9b31-118aab9b7209 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:59.389917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8543f0ab-5e2d-4ff8-9b31-118aab9b7209 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:59.389917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8543f0ab-5e2d-4ff8-9b31-118aab9b7209 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:59.928799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-66203e9c-75a3-4ba7-8a2f-1a468596e0ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:10:59.929958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-66203e9c-75a3-4ba7-8a2f-1a468596e0ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:10:59.948196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66203e9c-75a3-4ba7-8a2f-1a468596e0ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:59.948832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66203e9c-75a3-4ba7-8a2f-1a468596e0ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:59.949290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66203e9c-75a3-4ba7-8a2f-1a468596e0ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:59.952718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8543f0ab-5e2d-4ff8-9b31-118aab9b7209 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:10:59.957078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66203e9c-75a3-4ba7-8a2f-1a468596e0ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:10:59.959366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66203e9c-75a3-4ba7-8a2f-1a468596e0ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:10:59.960828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66203e9c-75a3-4ba7-8a2f-1a468596e0ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:10:59.961698 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8543f0ab-5e2d-4ff8-9b31-118aab9b7209 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.608152 Oct 27 19:10:59.967905 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2672/5149] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:59 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:00.348363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-957baa88-9683-4a80-8c66-4843b77133e3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:00.349950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-957baa88-9683-4a80-8c66-4843b77133e3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:00.360668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-957baa88-9683-4a80-8c66-4843b77133e3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:00.362361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-957baa88-9683-4a80-8c66-4843b77133e3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:00.363676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-957baa88-9683-4a80-8c66-4843b77133e3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:00.367073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-957baa88-9683-4a80-8c66-4843b77133e3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:00.367847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-957baa88-9683-4a80-8c66-4843b77133e3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:00.368537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-957baa88-9683-4a80-8c66-4843b77133e3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:00.571459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-957baa88-9683-4a80-8c66-4843b77133e3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:00.588088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-957baa88-9683-4a80-8c66-4843b77133e3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:00.590005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-957baa88-9683-4a80-8c66-4843b77133e3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:00.601656 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-957baa88-9683-4a80-8c66-4843b77133e3 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.258231 Oct 27 19:11:00.603742 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2673/5150] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:00 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:11:00.695706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-66203e9c-75a3-4ba7-8a2f-1a468596e0ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:00.711818 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-66203e9c-75a3-4ba7-8a2f-1a468596e0ca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.784403 Oct 27 19:11:00.712452 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2478/5151] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:10:59 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:00.996349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3e491b5e-d035-4b93-bb1e-8679348f56d1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:00.998302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3e491b5e-d035-4b93-bb1e-8679348f56d1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:01.012771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e491b5e-d035-4b93-bb1e-8679348f56d1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:01.013733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e491b5e-d035-4b93-bb1e-8679348f56d1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:01.017596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e491b5e-d035-4b93-bb1e-8679348f56d1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:01.031716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e491b5e-d035-4b93-bb1e-8679348f56d1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:01.036490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e491b5e-d035-4b93-bb1e-8679348f56d1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:01.037380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e491b5e-d035-4b93-bb1e-8679348f56d1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:01.490595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3e491b5e-d035-4b93-bb1e-8679348f56d1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:01.493165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:01.507306 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3e491b5e-d035-4b93-bb1e-8679348f56d1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.517640 Oct 27 19:11:01.507933 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2674/5152] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:00 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:01.636279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d2d9414-6cfd-4a9a-9b36-48d2e2ed2bff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:01.636279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d2d9414-6cfd-4a9a-9b36-48d2e2ed2bff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:01.675561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d2d9414-6cfd-4a9a-9b36-48d2e2ed2bff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:01.683379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d2d9414-6cfd-4a9a-9b36-48d2e2ed2bff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:01.684209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d2d9414-6cfd-4a9a-9b36-48d2e2ed2bff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:01.696032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d2d9414-6cfd-4a9a-9b36-48d2e2ed2bff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:01.696607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d2d9414-6cfd-4a9a-9b36-48d2e2ed2bff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:01.697017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d2d9414-6cfd-4a9a-9b36-48d2e2ed2bff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:01.749053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0bcb3d3d-2748-4633-927e-b898430a3a2f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:01.749679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0bcb3d3d-2748-4633-927e-b898430a3a2f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:01.767337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bcb3d3d-2748-4633-927e-b898430a3a2f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:01.767848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bcb3d3d-2748-4633-927e-b898430a3a2f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:01.784905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bcb3d3d-2748-4633-927e-b898430a3a2f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:01.787354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bcb3d3d-2748-4633-927e-b898430a3a2f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:01.788517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bcb3d3d-2748-4633-927e-b898430a3a2f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:01.790925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bcb3d3d-2748-4633-927e-b898430a3a2f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:02.136620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d2d9414-6cfd-4a9a-9b36-48d2e2ed2bff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:02.151161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d2d9414-6cfd-4a9a-9b36-48d2e2ed2bff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:02.168613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d2d9414-6cfd-4a9a-9b36-48d2e2ed2bff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:02.189913 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d2d9414-6cfd-4a9a-9b36-48d2e2ed2bff tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.558296 Oct 27 19:11:02.199062 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2479/5153] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:01 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:02.325611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0bcb3d3d-2748-4633-927e-b898430a3a2f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:02.355142 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0bcb3d3d-2748-4633-927e-b898430a3a2f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.609844 Oct 27 19:11:02.356436 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2675/5154] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:01 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:02.567743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3463f710-6403-4238-ab51-c1f644d3671b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:02.569202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3463f710-6403-4238-ab51-c1f644d3671b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:02.588534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3463f710-6403-4238-ab51-c1f644d3671b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:02.595348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3463f710-6403-4238-ab51-c1f644d3671b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:02.595992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3463f710-6403-4238-ab51-c1f644d3671b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:02.596828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3463f710-6403-4238-ab51-c1f644d3671b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:02.597855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3463f710-6403-4238-ab51-c1f644d3671b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:02.600113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3463f710-6403-4238-ab51-c1f644d3671b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:03.357785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-104225bb-66b7-405f-8836-1e35388ddb61 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:03.357785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-104225bb-66b7-405f-8836-1e35388ddb61 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:03.357785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-104225bb-66b7-405f-8836-1e35388ddb61 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:03.357785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-104225bb-66b7-405f-8836-1e35388ddb61 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:03.357785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-104225bb-66b7-405f-8836-1e35388ddb61 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:03.357785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-104225bb-66b7-405f-8836-1e35388ddb61 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:03.357785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-104225bb-66b7-405f-8836-1e35388ddb61 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:03.357785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-104225bb-66b7-405f-8836-1e35388ddb61 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:03.605737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-104225bb-66b7-405f-8836-1e35388ddb61 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:03.605737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-104225bb-66b7-405f-8836-1e35388ddb61 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:03.605737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-104225bb-66b7-405f-8836-1e35388ddb61 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:03.605737 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-104225bb-66b7-405f-8836-1e35388ddb61 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.285283 Oct 27 19:11:03.605737 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2676/5155] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:03 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:11:03.605737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5cfe95de-2e48-4b01-bdd3-4303ea7f7d31 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:03.605737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5cfe95de-2e48-4b01-bdd3-4303ea7f7d31 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:03.605737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cfe95de-2e48-4b01-bdd3-4303ea7f7d31 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:03.605737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cfe95de-2e48-4b01-bdd3-4303ea7f7d31 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:03.605737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cfe95de-2e48-4b01-bdd3-4303ea7f7d31 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:03.605737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cfe95de-2e48-4b01-bdd3-4303ea7f7d31 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:03.609356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cfe95de-2e48-4b01-bdd3-4303ea7f7d31 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:03.609356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5cfe95de-2e48-4b01-bdd3-4303ea7f7d31 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:03.740576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3463f710-6403-4238-ab51-c1f644d3671b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:03.748649 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3463f710-6403-4238-ab51-c1f644d3671b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 1.192598 Oct 27 19:11:03.759857 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2480/5156] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:02 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:04.039314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5cfe95de-2e48-4b01-bdd3-4303ea7f7d31 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:04.073542 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5cfe95de-2e48-4b01-bdd3-4303ea7f7d31 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.558366 Oct 27 19:11:04.084928 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2677/5157] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:03 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:04.539272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-208e9d96-30bb-435f-822d-96206801f589 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:04.539915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-208e9d96-30bb-435f-822d-96206801f589 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:04.557313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-208e9d96-30bb-435f-822d-96206801f589 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:04.557884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-208e9d96-30bb-435f-822d-96206801f589 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:04.558363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-208e9d96-30bb-435f-822d-96206801f589 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:04.572750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-208e9d96-30bb-435f-822d-96206801f589 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:04.573273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-208e9d96-30bb-435f-822d-96206801f589 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:04.573733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-208e9d96-30bb-435f-822d-96206801f589 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:04.780280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5415ebec-7e93-4429-a4b8-cb215bf1e7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:04.780945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5415ebec-7e93-4429-a4b8-cb215bf1e7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:04.798739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5415ebec-7e93-4429-a4b8-cb215bf1e7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:04.799250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5415ebec-7e93-4429-a4b8-cb215bf1e7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:04.799704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5415ebec-7e93-4429-a4b8-cb215bf1e7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:04.800429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5415ebec-7e93-4429-a4b8-cb215bf1e7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:04.800944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5415ebec-7e93-4429-a4b8-cb215bf1e7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:04.801394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5415ebec-7e93-4429-a4b8-cb215bf1e7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:04.880123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-208e9d96-30bb-435f-822d-96206801f589 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:04.891304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-208e9d96-30bb-435f-822d-96206801f589 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:04.892803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-208e9d96-30bb-435f-822d-96206801f589 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:04.926296 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-208e9d96-30bb-435f-822d-96206801f589 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.391333 Oct 27 19:11:04.929329 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2481/5158] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:04 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:05.112494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e3e0c747-829c-4960-a5ee-aa8204009ca6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:05.112821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e3e0c747-829c-4960-a5ee-aa8204009ca6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:05.131462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e0c747-829c-4960-a5ee-aa8204009ca6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:05.134126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e0c747-829c-4960-a5ee-aa8204009ca6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:05.135162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e0c747-829c-4960-a5ee-aa8204009ca6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:05.137257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e0c747-829c-4960-a5ee-aa8204009ca6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:05.138154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e0c747-829c-4960-a5ee-aa8204009ca6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:05.145417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e0c747-829c-4960-a5ee-aa8204009ca6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:05.539411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5415ebec-7e93-4429-a4b8-cb215bf1e7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:05.559460 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5415ebec-7e93-4429-a4b8-cb215bf1e7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.778718 Oct 27 19:11:05.592514 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2678/5159] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:04 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:05.876047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e3e0c747-829c-4960-a5ee-aa8204009ca6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:05.895435 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e3e0c747-829c-4960-a5ee-aa8204009ca6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 0.787342 Oct 27 19:11:05.916710 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2482/5160] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:05 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:05.968130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-06ea3adf-8363-4a4e-b791-4b26b5289776 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:05.968766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-06ea3adf-8363-4a4e-b791-4b26b5289776 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:06.012149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06ea3adf-8363-4a4e-b791-4b26b5289776 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:06.012665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06ea3adf-8363-4a4e-b791-4b26b5289776 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:06.013121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06ea3adf-8363-4a4e-b791-4b26b5289776 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:06.024042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06ea3adf-8363-4a4e-b791-4b26b5289776 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:06.024812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06ea3adf-8363-4a4e-b791-4b26b5289776 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:06.025421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06ea3adf-8363-4a4e-b791-4b26b5289776 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:06.294850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-06ea3adf-8363-4a4e-b791-4b26b5289776 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:06.303643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-06ea3adf-8363-4a4e-b791-4b26b5289776 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:06.313252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-06ea3adf-8363-4a4e-b791-4b26b5289776 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:06.327805 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-06ea3adf-8363-4a4e-b791-4b26b5289776 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.369182 Oct 27 19:11:06.334845 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2679/5161] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:05 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:06.597230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2a8f7aa7-6a6b-4d5e-9704-c03d3fcdd729 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:06.598972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2a8f7aa7-6a6b-4d5e-9704-c03d3fcdd729 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:06.622198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a8f7aa7-6a6b-4d5e-9704-c03d3fcdd729 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:06.623084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a8f7aa7-6a6b-4d5e-9704-c03d3fcdd729 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:06.624931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a8f7aa7-6a6b-4d5e-9704-c03d3fcdd729 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:06.630135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a8f7aa7-6a6b-4d5e-9704-c03d3fcdd729 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:06.631012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a8f7aa7-6a6b-4d5e-9704-c03d3fcdd729 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:06.639659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a8f7aa7-6a6b-4d5e-9704-c03d3fcdd729 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:06.937564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-73ed8656-9c3e-4888-9eb4-ab15514b07a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:06.938245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-73ed8656-9c3e-4888-9eb4-ab15514b07a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:06.952093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73ed8656-9c3e-4888-9eb4-ab15514b07a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:06.952952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73ed8656-9c3e-4888-9eb4-ab15514b07a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:06.956710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73ed8656-9c3e-4888-9eb4-ab15514b07a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:06.958570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73ed8656-9c3e-4888-9eb4-ab15514b07a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:06.961073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73ed8656-9c3e-4888-9eb4-ab15514b07a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:06.961693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73ed8656-9c3e-4888-9eb4-ab15514b07a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:07.030344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2a8f7aa7-6a6b-4d5e-9704-c03d3fcdd729 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:07.052024 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2a8f7aa7-6a6b-4d5e-9704-c03d3fcdd729 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.460661 Oct 27 19:11:07.062885 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2483/5162] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:06 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:07.362651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8e428592-559d-4812-b56b-a5820300609e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:07.363289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8e428592-559d-4812-b56b-a5820300609e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:07.390106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e428592-559d-4812-b56b-a5820300609e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:07.394457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e428592-559d-4812-b56b-a5820300609e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:07.394942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e428592-559d-4812-b56b-a5820300609e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:07.395714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e428592-559d-4812-b56b-a5820300609e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:07.396206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e428592-559d-4812-b56b-a5820300609e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:07.396645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e428592-559d-4812-b56b-a5820300609e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:07.766621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8e428592-559d-4812-b56b-a5820300609e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:07.798735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8e428592-559d-4812-b56b-a5820300609e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:07.800701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8e428592-559d-4812-b56b-a5820300609e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:07.820580 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8e428592-559d-4812-b56b-a5820300609e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.464679 Oct 27 19:11:07.821827 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2484/5163] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:07 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:11:08.043642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-73ed8656-9c3e-4888-9eb4-ab15514b07a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:08.057401 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-73ed8656-9c3e-4888-9eb4-ab15514b07a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1682 microversion: 2.1 time: 1.125831 Oct 27 19:11:08.071760 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2680/5164] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:06 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1682 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:08.076223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-35dd24d0-7c6f-43bb-84f8-e0d8d2d318ea tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:08.076866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-35dd24d0-7c6f-43bb-84f8-e0d8d2d318ea tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:08.089326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35dd24d0-7c6f-43bb-84f8-e0d8d2d318ea tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:08.089854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35dd24d0-7c6f-43bb-84f8-e0d8d2d318ea tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:08.096679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35dd24d0-7c6f-43bb-84f8-e0d8d2d318ea tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:08.102736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35dd24d0-7c6f-43bb-84f8-e0d8d2d318ea tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:08.103260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35dd24d0-7c6f-43bb-84f8-e0d8d2d318ea tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:08.105309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35dd24d0-7c6f-43bb-84f8-e0d8d2d318ea tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:08.157984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:08.493420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-35dd24d0-7c6f-43bb-84f8-e0d8d2d318ea tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:08.504521 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-35dd24d0-7c6f-43bb-84f8-e0d8d2d318ea tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.432099 Oct 27 19:11:08.523460 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2485/5165] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:08 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:08.873264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7b0ff338-1a49-4b59-a874-497a1bd6077d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:08.874293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7b0ff338-1a49-4b59-a874-497a1bd6077d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:08.898324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=90 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:08.902120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b0ff338-1a49-4b59-a874-497a1bd6077d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:08.908493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b0ff338-1a49-4b59-a874-497a1bd6077d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:08.910650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b0ff338-1a49-4b59-a874-497a1bd6077d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:08.913107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b0ff338-1a49-4b59-a874-497a1bd6077d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:08.913608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b0ff338-1a49-4b59-a874-497a1bd6077d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:08.914062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b0ff338-1a49-4b59-a874-497a1bd6077d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:09.095726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7253e0c7-8d6c-4134-bcf2-007e138ab1b8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:09.096448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7253e0c7-8d6c-4134-bcf2-007e138ab1b8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:09.118102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7253e0c7-8d6c-4134-bcf2-007e138ab1b8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:09.119329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7253e0c7-8d6c-4134-bcf2-007e138ab1b8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:09.120022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7253e0c7-8d6c-4134-bcf2-007e138ab1b8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:09.123216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7253e0c7-8d6c-4134-bcf2-007e138ab1b8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:09.124137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7253e0c7-8d6c-4134-bcf2-007e138ab1b8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:09.124903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7253e0c7-8d6c-4134-bcf2-007e138ab1b8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:09.192475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7b0ff338-1a49-4b59-a874-497a1bd6077d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:09.251681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7b0ff338-1a49-4b59-a874-497a1bd6077d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:09.253484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7b0ff338-1a49-4b59-a874-497a1bd6077d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:09.286970 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7b0ff338-1a49-4b59-a874-497a1bd6077d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1531 microversion: 2.91 time: 0.431307 Oct 27 19:11:09.303809 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2681/5166] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:08 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1531 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:09.319973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-385083bd-5371-44d8-9517-032e6b208ba8 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:09.321069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-385083bd-5371-44d8-9517-032e6b208ba8 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:09.335312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-385083bd-5371-44d8-9517-032e6b208ba8 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:09.335829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-385083bd-5371-44d8-9517-032e6b208ba8 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:09.336289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-385083bd-5371-44d8-9517-032e6b208ba8 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:09.337022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-385083bd-5371-44d8-9517-032e6b208ba8 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:09.347827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-385083bd-5371-44d8-9517-032e6b208ba8 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:09.348902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-385083bd-5371-44d8-9517-032e6b208ba8 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:09.453496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7253e0c7-8d6c-4134-bcf2-007e138ab1b8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:09.465020 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7253e0c7-8d6c-4134-bcf2-007e138ab1b8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.375593 Oct 27 19:11:09.495303 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2486/5167] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:09 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:09.530638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f77beb83-67a1-44d8-9f2a-e86d0a1c89d6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:09.531541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f77beb83-67a1-44d8-9f2a-e86d0a1c89d6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:09.550321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f77beb83-67a1-44d8-9f2a-e86d0a1c89d6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:09.551108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f77beb83-67a1-44d8-9f2a-e86d0a1c89d6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:09.551880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f77beb83-67a1-44d8-9f2a-e86d0a1c89d6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:09.556636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f77beb83-67a1-44d8-9f2a-e86d0a1c89d6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:09.557315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f77beb83-67a1-44d8-9f2a-e86d0a1c89d6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:09.557937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f77beb83-67a1-44d8-9f2a-e86d0a1c89d6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:09.795309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-385083bd-5371-44d8-9517-032e6b208ba8 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lazy-loading 'services' on Instance uuid 29737b20-81b1-443b-9b80-e9ca92bbfdad {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:11:09.852256 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-385083bd-5371-44d8-9517-032e6b208ba8 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1936 microversion: 2.91 time: 0.536779 Oct 27 19:11:09.853375 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2682/5168] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:09 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1936 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:09.869978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f77beb83-67a1-44d8-9f2a-e86d0a1c89d6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:09.884231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-41a5faf5-3f48-49bb-a207-efd6942cd07b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:11:09.884778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-41a5faf5-3f48-49bb-a207-efd6942cd07b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:09.886758 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f77beb83-67a1-44d8-9f2a-e86d0a1c89d6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.361049 Oct 27 19:11:09.888046 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2487/5169] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:09 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:09.892005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41a5faf5-3f48-49bb-a207-efd6942cd07b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:09.892518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41a5faf5-3f48-49bb-a207-efd6942cd07b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:09.892972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41a5faf5-3f48-49bb-a207-efd6942cd07b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:09.893689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41a5faf5-3f48-49bb-a207-efd6942cd07b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:09.894318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41a5faf5-3f48-49bb-a207-efd6942cd07b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:09.894925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41a5faf5-3f48-49bb-a207-efd6942cd07b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:09.933237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-41a5faf5-3f48-49bb-a207-efd6942cd07b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lazy-loading 'flavor' on Instance uuid 29737b20-81b1-443b-9b80-e9ca92bbfdad {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:11:10.690280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-31b6b589-f84d-404e-9808-90b97fda3252 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:10.691852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-31b6b589-f84d-404e-9808-90b97fda3252 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:10.709252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31b6b589-f84d-404e-9808-90b97fda3252 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:10.709768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31b6b589-f84d-404e-9808-90b97fda3252 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:10.710223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31b6b589-f84d-404e-9808-90b97fda3252 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:10.710994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31b6b589-f84d-404e-9808-90b97fda3252 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:10.711462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31b6b589-f84d-404e-9808-90b97fda3252 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:10.711904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31b6b589-f84d-404e-9808-90b97fda3252 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:10.910347 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-41a5faf5-3f48-49bb-a207-efd6942cd07b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "POST /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad/action" status: 202 len: 0 microversion: 2.91 time: 1.029830 Oct 27 19:11:10.911385 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2683/5170] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 19:11:09 2022] POST /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad/action => generated 0 bytes in 1032 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:11:10.970455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-abd1cab3-03a0-4bf4-95fc-59644a8d8fcb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:10.971230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-abd1cab3-03a0-4bf4-95fc-59644a8d8fcb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:10.984612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abd1cab3-03a0-4bf4-95fc-59644a8d8fcb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:10.985118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abd1cab3-03a0-4bf4-95fc-59644a8d8fcb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:10.985565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abd1cab3-03a0-4bf4-95fc-59644a8d8fcb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:10.988983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-31b6b589-f84d-404e-9808-90b97fda3252 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:10.994167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abd1cab3-03a0-4bf4-95fc-59644a8d8fcb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:10.995809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abd1cab3-03a0-4bf4-95fc-59644a8d8fcb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:10.999300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-abd1cab3-03a0-4bf4-95fc-59644a8d8fcb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:11.000191 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-31b6b589-f84d-404e-9808-90b97fda3252 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.313867 Oct 27 19:11:11.002359 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2488/5171] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:10 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:11.025001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae57a0ed-7fcd-456d-81ee-aef3dd31eb9a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:11.026862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ae57a0ed-7fcd-456d-81ee-aef3dd31eb9a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:11.047731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae57a0ed-7fcd-456d-81ee-aef3dd31eb9a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:11.049723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae57a0ed-7fcd-456d-81ee-aef3dd31eb9a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:11.050351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae57a0ed-7fcd-456d-81ee-aef3dd31eb9a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:11.053553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae57a0ed-7fcd-456d-81ee-aef3dd31eb9a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:11.055059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae57a0ed-7fcd-456d-81ee-aef3dd31eb9a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:11.056574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae57a0ed-7fcd-456d-81ee-aef3dd31eb9a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:11.261357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae57a0ed-7fcd-456d-81ee-aef3dd31eb9a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:11.278623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae57a0ed-7fcd-456d-81ee-aef3dd31eb9a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:11.291073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae57a0ed-7fcd-456d-81ee-aef3dd31eb9a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:11.310995 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ae57a0ed-7fcd-456d-81ee-aef3dd31eb9a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.307326 Oct 27 19:11:11.314468 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2489/5172] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:11 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:11.520344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-abd1cab3-03a0-4bf4-95fc-59644a8d8fcb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:11.529091 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-abd1cab3-03a0-4bf4-95fc-59644a8d8fcb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1522 microversion: 2.1 time: 0.601124 Oct 27 19:11:11.530586 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2684/5173] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:10 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1522 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:12.343484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f7cfde78-07e8-48a9-8e81-b86907c8dce5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:12.347363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f7cfde78-07e8-48a9-8e81-b86907c8dce5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:12.356835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7cfde78-07e8-48a9-8e81-b86907c8dce5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:12.357990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7cfde78-07e8-48a9-8e81-b86907c8dce5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:12.366556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7cfde78-07e8-48a9-8e81-b86907c8dce5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:12.367585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7cfde78-07e8-48a9-8e81-b86907c8dce5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:12.368083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7cfde78-07e8-48a9-8e81-b86907c8dce5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:12.368536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7cfde78-07e8-48a9-8e81-b86907c8dce5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:12.567049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9ed5ca61-1f31-4bbf-a743-6b1d3475a77e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:12.569555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9ed5ca61-1f31-4bbf-a743-6b1d3475a77e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:12.579754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ed5ca61-1f31-4bbf-a743-6b1d3475a77e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:12.580408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ed5ca61-1f31-4bbf-a743-6b1d3475a77e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:12.583433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ed5ca61-1f31-4bbf-a743-6b1d3475a77e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:12.602773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ed5ca61-1f31-4bbf-a743-6b1d3475a77e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:12.604361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ed5ca61-1f31-4bbf-a743-6b1d3475a77e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:12.604978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ed5ca61-1f31-4bbf-a743-6b1d3475a77e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:13.085899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9ed5ca61-1f31-4bbf-a743-6b1d3475a77e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:13.096604 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9ed5ca61-1f31-4bbf-a743-6b1d3475a77e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1504 microversion: 2.1 time: 0.542139 Oct 27 19:11:13.103152 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2685/5174] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:12 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:13.443938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f7cfde78-07e8-48a9-8e81-b86907c8dce5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:13.462692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f7cfde78-07e8-48a9-8e81-b86907c8dce5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:13.464880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f7cfde78-07e8-48a9-8e81-b86907c8dce5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:13.474866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-eae08e4d-c3a5-4bd8-b54a-096d73896b70 req-2718fffa-53d5-4bff-a6d8-f41994e896c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c", "name": "network-vif-unplugged", "status": "completed", "tag": "80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:11:13.505965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-eae08e4d-c3a5-4bd8-b54a-096d73896b70 req-2718fffa-53d5-4bff-a6d8-f41994e896c4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:13.506375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-eae08e4d-c3a5-4bd8-b54a-096d73896b70 req-2718fffa-53d5-4bff-a6d8-f41994e896c4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:13.511550 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f7cfde78-07e8-48a9-8e81-b86907c8dce5 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 1.170702 Oct 27 19:11:13.512193 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2490/5175] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:12 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:13.533149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-eae08e4d-c3a5-4bd8-b54a-096d73896b70 req-2718fffa-53d5-4bff-a6d8-f41994e896c4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:13.571963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-63d5610f-8663-4d08-bfde-de069f88f744 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:13.572593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-63d5610f-8663-4d08-bfde-de069f88f744 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:13.599881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d5610f-8663-4d08-bfde-de069f88f744 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:13.605342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d5610f-8663-4d08-bfde-de069f88f744 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:13.613621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d5610f-8663-4d08-bfde-de069f88f744 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:13.614553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d5610f-8663-4d08-bfde-de069f88f744 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:13.615119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d5610f-8663-4d08-bfde-de069f88f744 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:13.615610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d5610f-8663-4d08-bfde-de069f88f744 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:13.626134 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-eae08e4d-c3a5-4bd8-b54a-096d73896b70 req-2718fffa-53d5-4bff-a6d8-f41994e896c4 service nova] Creating event network-vif-unplugged:80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4 for instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c on n-h1-860687-3 Oct 27 19:11:13.657609 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-eae08e4d-c3a5-4bd8-b54a-096d73896b70 req-2718fffa-53d5-4bff-a6d8-f41994e896c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.553034 Oct 27 19:11:13.658246 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2686/5176] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:11:14.130559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3ba5e530-e518-4ded-af8a-c167a0c4e298 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:14.131598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3ba5e530-e518-4ded-af8a-c167a0c4e298 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:14.166971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ba5e530-e518-4ded-af8a-c167a0c4e298 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:14.167871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ba5e530-e518-4ded-af8a-c167a0c4e298 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:14.168482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ba5e530-e518-4ded-af8a-c167a0c4e298 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:14.169990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ba5e530-e518-4ded-af8a-c167a0c4e298 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:14.176096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ba5e530-e518-4ded-af8a-c167a0c4e298 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:14.176527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ba5e530-e518-4ded-af8a-c167a0c4e298 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:14.273877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-63d5610f-8663-4d08-bfde-de069f88f744 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:14.294503 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-63d5610f-8663-4d08-bfde-de069f88f744 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.726984 Oct 27 19:11:14.295695 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2491/5177] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:13 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:14.335999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1a86f9ba-237c-4581-9eb5-279c3c42a910 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:14.337064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1a86f9ba-237c-4581-9eb5-279c3c42a910 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:14.347594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a86f9ba-237c-4581-9eb5-279c3c42a910 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:14.348127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a86f9ba-237c-4581-9eb5-279c3c42a910 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:14.351698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a86f9ba-237c-4581-9eb5-279c3c42a910 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:14.355262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a86f9ba-237c-4581-9eb5-279c3c42a910 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:14.355731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a86f9ba-237c-4581-9eb5-279c3c42a910 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:14.356028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a86f9ba-237c-4581-9eb5-279c3c42a910 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:14.758999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1a86f9ba-237c-4581-9eb5-279c3c42a910 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:14.770856 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1a86f9ba-237c-4581-9eb5-279c3c42a910 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.438754 Oct 27 19:11:14.783940 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2492/5178] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:14 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:14.808616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f0d211c5-85a4-443d-8976-599f9d2d76ad tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:14.810981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f0d211c5-85a4-443d-8976-599f9d2d76ad tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:14.850531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0d211c5-85a4-443d-8976-599f9d2d76ad tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:14.854653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0d211c5-85a4-443d-8976-599f9d2d76ad tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:14.856034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0d211c5-85a4-443d-8976-599f9d2d76ad tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:14.861325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0d211c5-85a4-443d-8976-599f9d2d76ad tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:14.862297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0d211c5-85a4-443d-8976-599f9d2d76ad tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:14.863129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0d211c5-85a4-443d-8976-599f9d2d76ad tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:14.974073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3ba5e530-e518-4ded-af8a-c167a0c4e298 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:15.014126 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3ba5e530-e518-4ded-af8a-c167a0c4e298 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1504 microversion: 2.1 time: 0.890201 Oct 27 19:11:15.024454 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2687/5179] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:14 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1504 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:15.046646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dccd2abf-a9e0-4202-bfae-c155338b5a39 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:15.052258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dccd2abf-a9e0-4202-bfae-c155338b5a39 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:15.102947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dccd2abf-a9e0-4202-bfae-c155338b5a39 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:15.107542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dccd2abf-a9e0-4202-bfae-c155338b5a39 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:15.108123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dccd2abf-a9e0-4202-bfae-c155338b5a39 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:15.121006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dccd2abf-a9e0-4202-bfae-c155338b5a39 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:15.125671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dccd2abf-a9e0-4202-bfae-c155338b5a39 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:15.127398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dccd2abf-a9e0-4202-bfae-c155338b5a39 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:15.202946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f0d211c5-85a4-443d-8976-599f9d2d76ad tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:15.219274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f0d211c5-85a4-443d-8976-599f9d2d76ad tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:15.226983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f0d211c5-85a4-443d-8976-599f9d2d76ad tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:15.236785 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f0d211c5-85a4-443d-8976-599f9d2d76ad tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.450489 Oct 27 19:11:15.251252 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2493/5180] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:14 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:15.721894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dccd2abf-a9e0-4202-bfae-c155338b5a39 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:15.740554 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dccd2abf-a9e0-4202-bfae-c155338b5a39 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.709281 Oct 27 19:11:15.741288 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2688/5181] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:15 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:15.767194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fe09bcf0-7700-40bd-b908-6173466dbb7b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:11:15.774302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6bf1e163-4e2d-4f16-9ccc-25123fcdf91c req-1da8bee1-762b-4196-be96-b99c3130fd99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164658b9-90aa-4fe2-afd7-dbcb65930773", "name": "network-vif-unplugged", "status": "completed", "tag": "07f2b85d-6225-45f3-b627-a56cbcb48883"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:11:15.792474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fe09bcf0-7700-40bd-b908-6173466dbb7b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:15.833182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe09bcf0-7700-40bd-b908-6173466dbb7b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:15.835367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6bf1e163-4e2d-4f16-9ccc-25123fcdf91c req-1da8bee1-762b-4196-be96-b99c3130fd99 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:15.835881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6bf1e163-4e2d-4f16-9ccc-25123fcdf91c req-1da8bee1-762b-4196-be96-b99c3130fd99 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:15.836331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6bf1e163-4e2d-4f16-9ccc-25123fcdf91c req-1da8bee1-762b-4196-be96-b99c3130fd99 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:15.838567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe09bcf0-7700-40bd-b908-6173466dbb7b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:15.839276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe09bcf0-7700-40bd-b908-6173466dbb7b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:15.846001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe09bcf0-7700-40bd-b908-6173466dbb7b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:15.846952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe09bcf0-7700-40bd-b908-6173466dbb7b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:15.848086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe09bcf0-7700-40bd-b908-6173466dbb7b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:15.932844 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6bf1e163-4e2d-4f16-9ccc-25123fcdf91c req-1da8bee1-762b-4196-be96-b99c3130fd99 service nova] Creating event network-vif-unplugged:07f2b85d-6225-45f3-b627-a56cbcb48883 for instance 164658b9-90aa-4fe2-afd7-dbcb65930773 on n-h2-860687-3 Oct 27 19:11:15.955121 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6bf1e163-4e2d-4f16-9ccc-25123fcdf91c req-1da8bee1-762b-4196-be96-b99c3130fd99 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.184177 Oct 27 19:11:15.960713 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2689/5182] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:11:16.048099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f5b8f940-04f6-48b6-a801-b94776b7e592 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:16.049482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f5b8f940-04f6-48b6-a801-b94776b7e592 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:16.073233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5b8f940-04f6-48b6-a801-b94776b7e592 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:16.082226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5b8f940-04f6-48b6-a801-b94776b7e592 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:16.082764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5b8f940-04f6-48b6-a801-b94776b7e592 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:16.083538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5b8f940-04f6-48b6-a801-b94776b7e592 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:16.088852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5b8f940-04f6-48b6-a801-b94776b7e592 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:16.090926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5b8f940-04f6-48b6-a801-b94776b7e592 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:16.178077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:16.301434 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fe09bcf0-7700-40bd-b908-6173466dbb7b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.538138 Oct 27 19:11:16.306942 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2494/5183] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:11:15 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:11:16.339876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-563b5218-068a-4466-bf02-12710f779f8b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:16.341458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-563b5218-068a-4466-bf02-12710f779f8b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:16.378935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=76 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:16.382177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-563b5218-068a-4466-bf02-12710f779f8b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:16.383244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-563b5218-068a-4466-bf02-12710f779f8b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:16.384019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-563b5218-068a-4466-bf02-12710f779f8b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:16.387324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-563b5218-068a-4466-bf02-12710f779f8b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:16.388907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-563b5218-068a-4466-bf02-12710f779f8b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:16.391318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-563b5218-068a-4466-bf02-12710f779f8b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:16.867360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-563b5218-068a-4466-bf02-12710f779f8b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:16.881873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-563b5218-068a-4466-bf02-12710f779f8b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:16.883910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-563b5218-068a-4466-bf02-12710f779f8b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:16.898852 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-563b5218-068a-4466-bf02-12710f779f8b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.587050 Oct 27 19:11:16.912266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f5b8f940-04f6-48b6-a801-b94776b7e592 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:16.916880 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2495/5184] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:16 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:16.942033 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f5b8f940-04f6-48b6-a801-b94776b7e592 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 200 len: 1507 microversion: 2.1 time: 0.893800 Oct 27 19:11:16.947507 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2690/5185] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:16 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 1507 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:16.949948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3df06791-f6af-4ba2-b8fa-682e0e45ac70 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:16.951883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3df06791-f6af-4ba2-b8fa-682e0e45ac70 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:16.965955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3df06791-f6af-4ba2-b8fa-682e0e45ac70 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:16.968457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3df06791-f6af-4ba2-b8fa-682e0e45ac70 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:16.969188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3df06791-f6af-4ba2-b8fa-682e0e45ac70 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:16.970113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3df06791-f6af-4ba2-b8fa-682e0e45ac70 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:16.970793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3df06791-f6af-4ba2-b8fa-682e0e45ac70 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:16.971406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3df06791-f6af-4ba2-b8fa-682e0e45ac70 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:16.999977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:17.001060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:17.058570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:17.060479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:17.061222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:17.062246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:17.063107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:17.063754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:17.101003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:11:17.108838 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.compute.api [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Working on deleting snapshot 32dbab42-f8cd-48a0-8d0f-bab842036add from shelved instance... Oct 27 19:11:17.788369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3df06791-f6af-4ba2-b8fa-682e0e45ac70 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:17.800500 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3df06791-f6af-4ba2-b8fa-682e0e45ac70 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1671 microversion: 2.1 time: 0.881416 Oct 27 19:11:17.801117 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2496/5186] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:16 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1671 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:17.933752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f396cd40-1e0c-42bb-8503-568f5f7932db tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:17.934412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f396cd40-1e0c-42bb-8503-568f5f7932db tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:17.957342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f396cd40-1e0c-42bb-8503-568f5f7932db tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:17.960861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f396cd40-1e0c-42bb-8503-568f5f7932db tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:17.961538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f396cd40-1e0c-42bb-8503-568f5f7932db tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:17.963004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f396cd40-1e0c-42bb-8503-568f5f7932db tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:17.965716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f396cd40-1e0c-42bb-8503-568f5f7932db tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:17.966464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f396cd40-1e0c-42bb-8503-568f5f7932db tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:18.300680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f396cd40-1e0c-42bb-8503-568f5f7932db tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:18.313788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f396cd40-1e0c-42bb-8503-568f5f7932db tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:18.318168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f396cd40-1e0c-42bb-8503-568f5f7932db tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:18.331816 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f396cd40-1e0c-42bb-8503-568f5f7932db tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1558 microversion: 2.91 time: 0.401268 Oct 27 19:11:18.336174 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2497/5187] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:17 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1558 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:11:18.610725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Doing local delete in cell af35862a-071a-430c-affa-82567dc9805c(cell1) {{(pid=127029) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 27 19:11:18.613235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:18.614298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:18.617373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:18.618294 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.compute.api [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 27 19:11:18.623158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] deallocate_for_instance() {{(pid=127029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 27 19:11:18.831658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-74027676-bd57-4335-9c93-30428c567cd4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:18.833413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-74027676-bd57-4335-9c93-30428c567cd4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:18.844931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74027676-bd57-4335-9c93-30428c567cd4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:18.848809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74027676-bd57-4335-9c93-30428c567cd4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:18.849551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74027676-bd57-4335-9c93-30428c567cd4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:18.850573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74027676-bd57-4335-9c93-30428c567cd4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:18.851244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74027676-bd57-4335-9c93-30428c567cd4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:18.852468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74027676-bd57-4335-9c93-30428c567cd4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:19.659785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-74027676-bd57-4335-9c93-30428c567cd4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:19.677586 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-74027676-bd57-4335-9c93-30428c567cd4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1671 microversion: 2.1 time: 0.852288 Oct 27 19:11:19.688753 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2498/5188] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:18 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1671 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:19.698435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-66c7669e-5f53-4fc6-ab77-caa2a98fd556 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:19.709553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-66c7669e-5f53-4fc6-ab77-caa2a98fd556 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:19.734176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66c7669e-5f53-4fc6-ab77-caa2a98fd556 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:19.743125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66c7669e-5f53-4fc6-ab77-caa2a98fd556 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:19.744789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66c7669e-5f53-4fc6-ab77-caa2a98fd556 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:19.748200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66c7669e-5f53-4fc6-ab77-caa2a98fd556 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:19.750472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66c7669e-5f53-4fc6-ab77-caa2a98fd556 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:19.752210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66c7669e-5f53-4fc6-ab77-caa2a98fd556 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:20.240480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-66c7669e-5f53-4fc6-ab77-caa2a98fd556 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:20.264759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-66c7669e-5f53-4fc6-ab77-caa2a98fd556 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:20.271588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-66c7669e-5f53-4fc6-ab77-caa2a98fd556 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:20.295851 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-66c7669e-5f53-4fc6-ab77-caa2a98fd556 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1558 microversion: 2.91 time: 0.605254 Oct 27 19:11:20.296935 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2499/5189] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:19 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1558 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:20.384322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Updating instance_info_cache with network_info: [] {{(pid=127029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 19:11:20.628037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-624f4ff9-8b1b-4193-b7f7-961b5864388d req-cb9e3d0b-8e33-4d3a-a5b1-582488971eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164658b9-90aa-4fe2-afd7-dbcb65930773", "name": "network-vif-deleted", "tag": "07f2b85d-6225-45f3-b627-a56cbcb48883"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:11:20.650200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-624f4ff9-8b1b-4193-b7f7-961b5864388d req-cb9e3d0b-8e33-4d3a-a5b1-582488971eed service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:20.653503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-624f4ff9-8b1b-4193-b7f7-961b5864388d req-cb9e3d0b-8e33-4d3a-a5b1-582488971eed service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:20.655661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-624f4ff9-8b1b-4193-b7f7-961b5864388d req-cb9e3d0b-8e33-4d3a-a5b1-582488971eed service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:20.708703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.compute.server_external_events [req-624f4ff9-8b1b-4193-b7f7-961b5864388d req-cb9e3d0b-8e33-4d3a-a5b1-582488971eed service nova] Unable to find a host for instance 164658b9-90aa-4fe2-afd7-dbcb65930773. Dropping event network-vif-deleted {{(pid=127028) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 19:11:20.712037 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-624f4ff9-8b1b-4193-b7f7-961b5864388d req-cb9e3d0b-8e33-4d3a-a5b1-582488971eed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.332538 Oct 27 19:11:20.721630 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2500/5190] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 343 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 19:11:20.733869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5f56444e-e25d-4271-9ca7-13e2e974dd3d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:20.741993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5f56444e-e25d-4271-9ca7-13e2e974dd3d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:20.763140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f56444e-e25d-4271-9ca7-13e2e974dd3d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:20.764978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f56444e-e25d-4271-9ca7-13e2e974dd3d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:20.766644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f56444e-e25d-4271-9ca7-13e2e974dd3d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:20.770186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f56444e-e25d-4271-9ca7-13e2e974dd3d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:20.772684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f56444e-e25d-4271-9ca7-13e2e974dd3d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:20.773332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f56444e-e25d-4271-9ca7-13e2e974dd3d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:20.840275 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fc534813-a103-438f-9eb4-1712ad84eb70 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "DELETE /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 204 len: 0 microversion: 2.1 time: 3.852167 Oct 27 19:11:20.841322 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2691/5191] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:11:16 2022] DELETE /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 0 bytes in 3854 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:11:20.852562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-caa7f4e7-9e7d-4a38-9544-aa01351f1a4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:20.853947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-caa7f4e7-9e7d-4a38-9544-aa01351f1a4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:20.864040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-caa7f4e7-9e7d-4a38-9544-aa01351f1a4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:20.865742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-caa7f4e7-9e7d-4a38-9544-aa01351f1a4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:20.866464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-caa7f4e7-9e7d-4a38-9544-aa01351f1a4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:20.867479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-caa7f4e7-9e7d-4a38-9544-aa01351f1a4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:20.868110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-caa7f4e7-9e7d-4a38-9544-aa01351f1a4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:20.868863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-caa7f4e7-9e7d-4a38-9544-aa01351f1a4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:20.893998 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-caa7f4e7-9e7d-4a38-9544-aa01351f1a4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-caa7f4e7-9e7d-4a38-9544-aa01351f1a4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 HTTP/1.1 Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '164658b9-90aa-4fe2-afd7-dbcb65930773'} Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:11:20.904982 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:11:20.908893 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:11:20.908893 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:11:20.908893 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:11:20.908893 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:11:20.908893 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:11:20.908893 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:11:20.908893 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:11:20.918531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-caa7f4e7-9e7d-4a38-9544-aa01351f1a4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:11:20.925172 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-caa7f4e7-9e7d-4a38-9544-aa01351f1a4e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 404 len: 111 microversion: 2.1 time: 0.075898 Oct 27 19:11:20.939570 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2692/5192] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:20 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:11:21.253933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-880898142", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "e7d83c6b-c0c0-42e5-b094-5dc26599221d"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:11:21.394861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] validate_networks() for [('e7d83c6b-c0c0-42e5-b094-5dc26599221d', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:11:21.784517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5f56444e-e25d-4271-9ca7-13e2e974dd3d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:21.789999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:21.829863 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5f56444e-e25d-4271-9ca7-13e2e974dd3d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 1.104104 Oct 27 19:11:21.831431 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2501/5193] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:20 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:21.844486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-18da680a-f039-428b-b497-14dbf8ff6db2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:21.849644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-18da680a-f039-428b-b497-14dbf8ff6db2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:21.859218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18da680a-f039-428b-b497-14dbf8ff6db2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:21.859728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18da680a-f039-428b-b497-14dbf8ff6db2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:21.860991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18da680a-f039-428b-b497-14dbf8ff6db2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:21.861892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18da680a-f039-428b-b497-14dbf8ff6db2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:21.862489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18da680a-f039-428b-b497-14dbf8ff6db2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:21.863124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18da680a-f039-428b-b497-14dbf8ff6db2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:21.991856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-18da680a-f039-428b-b497-14dbf8ff6db2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:22.041339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-18da680a-f039-428b-b497-14dbf8ff6db2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:22.046587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-18da680a-f039-428b-b497-14dbf8ff6db2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:22.094588 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-18da680a-f039-428b-b497-14dbf8ff6db2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1558 microversion: 2.91 time: 0.260767 Oct 27 19:11:22.095812 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2502/5194] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:21 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1558 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:22.102144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d1eb0a5c-4a8d-47c8-bc55-385709f763b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:11:22.105501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d1eb0a5c-4a8d-47c8-bc55-385709f763b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:22.118115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1eb0a5c-4a8d-47c8-bc55-385709f763b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:22.119027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1eb0a5c-4a8d-47c8-bc55-385709f763b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:22.119861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1eb0a5c-4a8d-47c8-bc55-385709f763b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:22.120962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1eb0a5c-4a8d-47c8-bc55-385709f763b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:22.121755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1eb0a5c-4a8d-47c8-bc55-385709f763b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:22.122669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1eb0a5c-4a8d-47c8-bc55-385709f763b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:22.202199 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d1eb0a5c-4a8d-47c8-bc55-385709f763b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 200 len: 322 microversion: 2.1 time: 0.104382 Oct 27 19:11:22.211859 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2503/5195] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:11:22 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 322 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:11:22.232552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aaf862ea-d9f9-481a-a164-cea78f71f86b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:22.233407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aaf862ea-d9f9-481a-a164-cea78f71f86b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:22.253390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaf862ea-d9f9-481a-a164-cea78f71f86b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:22.253906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaf862ea-d9f9-481a-a164-cea78f71f86b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:22.254362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaf862ea-d9f9-481a-a164-cea78f71f86b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:22.255108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaf862ea-d9f9-481a-a164-cea78f71f86b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:22.255573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaf862ea-d9f9-481a-a164-cea78f71f86b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:22.256010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaf862ea-d9f9-481a-a164-cea78f71f86b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:22.697414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aaf862ea-d9f9-481a-a164-cea78f71f86b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:22.712883 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aaf862ea-d9f9-481a-a164-cea78f71f86b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.496714 Oct 27 19:11:22.715314 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2504/5196] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:22 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:22.761962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cdf22c56-99e1-4eb5-870a-16ce2ccd6f51 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:22.767223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cdf22c56-99e1-4eb5-870a-16ce2ccd6f51 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:22.786249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdf22c56-99e1-4eb5-870a-16ce2ccd6f51 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:22.786825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdf22c56-99e1-4eb5-870a-16ce2ccd6f51 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:22.787291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdf22c56-99e1-4eb5-870a-16ce2ccd6f51 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:22.789238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdf22c56-99e1-4eb5-870a-16ce2ccd6f51 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:22.793300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdf22c56-99e1-4eb5-870a-16ce2ccd6f51 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:22.793896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cdf22c56-99e1-4eb5-870a-16ce2ccd6f51 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:23.091490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:11:23.092722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:11:23.093380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:11:23.093799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:11:23.094225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:11:23.123572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:23.124085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:23.126243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:23.127321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:23.128840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:23.131860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:23.171676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cdf22c56-99e1-4eb5-870a-16ce2ccd6f51 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:23.190844 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cdf22c56-99e1-4eb5-870a-16ce2ccd6f51 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.439254 Oct 27 19:11:23.191493 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2505/5197] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:22 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:23.198446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Getting quotas for project 1798d878b8344ec69c9ef0699467718a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:11:23.212589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Getting quotas for user b2237837d17c43e99f4e9961cd27cbb5 and project 1798d878b8344ec69c9ef0699467718a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:11:23.230439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-42481fe1-cf72-46d9-9f54-de811a000f24 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:23.231130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-42481fe1-cf72-46d9-9f54-de811a000f24 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:23.252064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42481fe1-cf72-46d9-9f54-de811a000f24 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:23.252568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42481fe1-cf72-46d9-9f54-de811a000f24 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:23.255022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42481fe1-cf72-46d9-9f54-de811a000f24 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:23.255806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42481fe1-cf72-46d9-9f54-de811a000f24 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:23.256904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:11:23.259738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:11:23.262748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42481fe1-cf72-46d9-9f54-de811a000f24 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:23.263818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42481fe1-cf72-46d9-9f54-de811a000f24 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:23.470559 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6c10fdb0-bea9-4fd8-82d3-d089a8b9083a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.218418 Oct 27 19:11:23.474813 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2693/5198] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:11:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:11:23.499378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-293bdf42-9cb4-4b83-aa82-2cc79e4b4669 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:23.501178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-293bdf42-9cb4-4b83-aa82-2cc79e4b4669 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:23.515454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-42481fe1-cf72-46d9-9f54-de811a000f24 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:23.538561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-42481fe1-cf72-46d9-9f54-de811a000f24 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:23.547140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-42481fe1-cf72-46d9-9f54-de811a000f24 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:23.563089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-293bdf42-9cb4-4b83-aa82-2cc79e4b4669 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:23.563872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-293bdf42-9cb4-4b83-aa82-2cc79e4b4669 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:23.568110 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-42481fe1-cf72-46d9-9f54-de811a000f24 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.352530 Oct 27 19:11:23.570419 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2506/5199] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:23 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:23.571156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-293bdf42-9cb4-4b83-aa82-2cc79e4b4669 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:23.579071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-293bdf42-9cb4-4b83-aa82-2cc79e4b4669 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:23.584452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-293bdf42-9cb4-4b83-aa82-2cc79e4b4669 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:23.587809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-293bdf42-9cb4-4b83-aa82-2cc79e4b4669 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:23.589891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-367df3ce-e367-495b-aab0-295b92558cba tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:23.595386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-367df3ce-e367-495b-aab0-295b92558cba tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:23.723084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-367df3ce-e367-495b-aab0-295b92558cba tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:23.731305 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-367df3ce-e367-495b-aab0-295b92558cba tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1214 microversion: 2.1 time: 0.155927 Oct 27 19:11:23.736879 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2507/5200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:23 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:24.254493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-293bdf42-9cb4-4b83-aa82-2cc79e4b4669 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:24.262894 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-293bdf42-9cb4-4b83-aa82-2cc79e4b4669 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.784065 Oct 27 19:11:24.266798 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2694/5201] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:23 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:24.294975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c8ecfd15-4df0-4c2c-b9ab-d5af0269a1f9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:24.297327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c8ecfd15-4df0-4c2c-b9ab-d5af0269a1f9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:24.315130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8ecfd15-4df0-4c2c-b9ab-d5af0269a1f9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:24.316434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8ecfd15-4df0-4c2c-b9ab-d5af0269a1f9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:24.317144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8ecfd15-4df0-4c2c-b9ab-d5af0269a1f9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:24.318253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8ecfd15-4df0-4c2c-b9ab-d5af0269a1f9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:24.319021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8ecfd15-4df0-4c2c-b9ab-d5af0269a1f9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:24.319861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8ecfd15-4df0-4c2c-b9ab-d5af0269a1f9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:24.606228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-04eb56a1-6410-412b-aa67-168ceed7b868 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:24.607381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-04eb56a1-6410-412b-aa67-168ceed7b868 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:24.665660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04eb56a1-6410-412b-aa67-168ceed7b868 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:24.668054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04eb56a1-6410-412b-aa67-168ceed7b868 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:24.682481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04eb56a1-6410-412b-aa67-168ceed7b868 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:24.694205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04eb56a1-6410-412b-aa67-168ceed7b868 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:24.701747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04eb56a1-6410-412b-aa67-168ceed7b868 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:24.708970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-04eb56a1-6410-412b-aa67-168ceed7b868 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:24.779238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c8ecfd15-4df0-4c2c-b9ab-d5af0269a1f9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:24.793191 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c8ecfd15-4df0-4c2c-b9ab-d5af0269a1f9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.504393 Oct 27 19:11:24.803210 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2508/5202] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:24 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:24.846169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-22e1f44b-6a41-4c1e-8281-ec6fcd51ced9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:24.847212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-22e1f44b-6a41-4c1e-8281-ec6fcd51ced9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:24.867637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22e1f44b-6a41-4c1e-8281-ec6fcd51ced9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:24.876097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22e1f44b-6a41-4c1e-8281-ec6fcd51ced9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:24.877601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22e1f44b-6a41-4c1e-8281-ec6fcd51ced9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:24.879763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22e1f44b-6a41-4c1e-8281-ec6fcd51ced9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:24.883033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22e1f44b-6a41-4c1e-8281-ec6fcd51ced9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:24.884212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22e1f44b-6a41-4c1e-8281-ec6fcd51ced9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:25.103233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-22e1f44b-6a41-4c1e-8281-ec6fcd51ced9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:25.113639 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-22e1f44b-6a41-4c1e-8281-ec6fcd51ced9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1218 microversion: 2.1 time: 0.303001 Oct 27 19:11:25.120668 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2509/5203] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:24 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1218 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:25.484446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-04eb56a1-6410-412b-aa67-168ceed7b868 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:25.503545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-04eb56a1-6410-412b-aa67-168ceed7b868 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:25.505496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-04eb56a1-6410-412b-aa67-168ceed7b868 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:25.512329 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-04eb56a1-6410-412b-aa67-168ceed7b868 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.910735 Oct 27 19:11:25.514471 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2695/5204] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:24 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:25.551313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1576587930", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "e58f16a0-9265-4d79-a24b-f3342cfd8059"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:11:25.959504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] validate_networks() for [('e58f16a0-9265-4d79-a24b-f3342cfd8059', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:11:26.147962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1581fc21-27b1-44ff-a740-ad2772ed785d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:26.148597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1581fc21-27b1-44ff-a740-ad2772ed785d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:26.166619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1581fc21-27b1-44ff-a740-ad2772ed785d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:26.172089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1581fc21-27b1-44ff-a740-ad2772ed785d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:26.172810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1581fc21-27b1-44ff-a740-ad2772ed785d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:26.173973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1581fc21-27b1-44ff-a740-ad2772ed785d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:26.179245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1581fc21-27b1-44ff-a740-ad2772ed785d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:26.181504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1581fc21-27b1-44ff-a740-ad2772ed785d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:26.335689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1581fc21-27b1-44ff-a740-ad2772ed785d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:26.356450 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1581fc21-27b1-44ff-a740-ad2772ed785d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1274 microversion: 2.1 time: 0.210547 Oct 27 19:11:26.359016 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2696/5205] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:26 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:26.546166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-238bacc9-47ae-4e7f-ae8f-e24ee1313212 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:26.546969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-238bacc9-47ae-4e7f-ae8f-e24ee1313212 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:26.557645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-238bacc9-47ae-4e7f-ae8f-e24ee1313212 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:26.562169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-238bacc9-47ae-4e7f-ae8f-e24ee1313212 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:26.562710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-238bacc9-47ae-4e7f-ae8f-e24ee1313212 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:26.563478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-238bacc9-47ae-4e7f-ae8f-e24ee1313212 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:26.563940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-238bacc9-47ae-4e7f-ae8f-e24ee1313212 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:26.567473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-238bacc9-47ae-4e7f-ae8f-e24ee1313212 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:26.766671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-238bacc9-47ae-4e7f-ae8f-e24ee1313212 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:26.775631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-238bacc9-47ae-4e7f-ae8f-e24ee1313212 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:26.777110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-238bacc9-47ae-4e7f-ae8f-e24ee1313212 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:26.796744 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-238bacc9-47ae-4e7f-ae8f-e24ee1313212 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.255726 Oct 27 19:11:26.797349 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2697/5206] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:26 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:27.384579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-27d34f47-fef7-4580-80c7-d6183b9578cc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:27.395328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-27d34f47-fef7-4580-80c7-d6183b9578cc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:27.415601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27d34f47-fef7-4580-80c7-d6183b9578cc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:27.418720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27d34f47-fef7-4580-80c7-d6183b9578cc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:27.423992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27d34f47-fef7-4580-80c7-d6183b9578cc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:27.425161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27d34f47-fef7-4580-80c7-d6183b9578cc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:27.429583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27d34f47-fef7-4580-80c7-d6183b9578cc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:27.430511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27d34f47-fef7-4580-80c7-d6183b9578cc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:27.624769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-27d34f47-fef7-4580-80c7-d6183b9578cc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:27.655525 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-27d34f47-fef7-4580-80c7-d6183b9578cc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1272 microversion: 2.1 time: 0.276743 Oct 27 19:11:27.656833 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2698/5207] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:27 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1272 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:27.832737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4f131c55-a125-4051-9b08-acadf5cf14b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:27.833356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4f131c55-a125-4051-9b08-acadf5cf14b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:27.845274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f131c55-a125-4051-9b08-acadf5cf14b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:27.848205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f131c55-a125-4051-9b08-acadf5cf14b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:27.851748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f131c55-a125-4051-9b08-acadf5cf14b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:27.858839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f131c55-a125-4051-9b08-acadf5cf14b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:27.859502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f131c55-a125-4051-9b08-acadf5cf14b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:27.863798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f131c55-a125-4051-9b08-acadf5cf14b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:27.933839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:11:27.935048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:11:27.935707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:11:27.936980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:11:27.937575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:11:27.972118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:27.976596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:27.979071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:27.982207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:27.984087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:27.985709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:28.053788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Getting quotas for project 79c27f02ea6549bea54242ab81741f97. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:11:28.070747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Getting quotas for user 7019e4c367c0470f95bc66e32def747a and project 79c27f02ea6549bea54242ab81741f97. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:11:28.090303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:11:28.095799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:11:28.162358 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4fa8667f-f466-4b78-b02b-59c3dd3483a0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.615613 Oct 27 19:11:28.163600 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2510/5208] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:11:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:11:28.177634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e36c3b0f-1109-497f-afdb-3a64d6935546 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:28.181759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e36c3b0f-1109-497f-afdb-3a64d6935546 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:28.400430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e36c3b0f-1109-497f-afdb-3a64d6935546 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:28.439189 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e36c3b0f-1109-497f-afdb-3a64d6935546 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1215 microversion: 2.1 time: 0.267795 Oct 27 19:11:28.446723 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2511/5209] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:28 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1215 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:28.671834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4f131c55-a125-4051-9b08-acadf5cf14b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:28.683500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7f0ce2bf-d403-4879-9383-1b74cc7c9b2f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:28.684134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7f0ce2bf-d403-4879-9383-1b74cc7c9b2f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:28.692421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4f131c55-a125-4051-9b08-acadf5cf14b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:28.698128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4f131c55-a125-4051-9b08-acadf5cf14b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:28.719602 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4f131c55-a125-4051-9b08-acadf5cf14b4 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.890692 Oct 27 19:11:28.723142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f0ce2bf-d403-4879-9383-1b74cc7c9b2f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:28.727090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f0ce2bf-d403-4879-9383-1b74cc7c9b2f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:28.733032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f0ce2bf-d403-4879-9383-1b74cc7c9b2f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:28.733853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f0ce2bf-d403-4879-9383-1b74cc7c9b2f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:28.734344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f0ce2bf-d403-4879-9383-1b74cc7c9b2f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:28.734810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f0ce2bf-d403-4879-9383-1b74cc7c9b2f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:28.739422 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2699/5210] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:27 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:11:29.471443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f404ee4b-bd35-49d5-9fd8-f1665acb41c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:29.472443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f404ee4b-bd35-49d5-9fd8-f1665acb41c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:29.505033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f404ee4b-bd35-49d5-9fd8-f1665acb41c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:29.510006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f404ee4b-bd35-49d5-9fd8-f1665acb41c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:29.516077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f404ee4b-bd35-49d5-9fd8-f1665acb41c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:29.516999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f404ee4b-bd35-49d5-9fd8-f1665acb41c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:29.521321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f404ee4b-bd35-49d5-9fd8-f1665acb41c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:29.521828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f404ee4b-bd35-49d5-9fd8-f1665acb41c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:29.531999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7f0ce2bf-d403-4879-9383-1b74cc7c9b2f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:29.543516 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7f0ce2bf-d403-4879-9383-1b74cc7c9b2f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1314 microversion: 2.1 time: 0.866011 Oct 27 19:11:29.549964 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2512/5211] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:28 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1314 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:29.758883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-91e4a2ef-4b29-437a-84ce-7dad4ac7a2cc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:29.759416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-91e4a2ef-4b29-437a-84ce-7dad4ac7a2cc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:29.817160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91e4a2ef-4b29-437a-84ce-7dad4ac7a2cc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:29.817925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91e4a2ef-4b29-437a-84ce-7dad4ac7a2cc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:29.818636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91e4a2ef-4b29-437a-84ce-7dad4ac7a2cc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:29.819625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91e4a2ef-4b29-437a-84ce-7dad4ac7a2cc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:29.820326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91e4a2ef-4b29-437a-84ce-7dad4ac7a2cc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:29.820981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91e4a2ef-4b29-437a-84ce-7dad4ac7a2cc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:29.876938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f404ee4b-bd35-49d5-9fd8-f1665acb41c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:29.892641 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f404ee4b-bd35-49d5-9fd8-f1665acb41c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1219 microversion: 2.1 time: 0.426428 Oct 27 19:11:29.918560 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2700/5212] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:29 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1219 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:30.038670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-91e4a2ef-4b29-437a-84ce-7dad4ac7a2cc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:30.048325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-91e4a2ef-4b29-437a-84ce-7dad4ac7a2cc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:30.076416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-91e4a2ef-4b29-437a-84ce-7dad4ac7a2cc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:30.085526 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-91e4a2ef-4b29-437a-84ce-7dad4ac7a2cc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.331957 Oct 27 19:11:30.093086 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2513/5213] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:29 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:30.574039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-58afb952-61ea-40ae-9237-b4d8e1855dbb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:30.575111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-58afb952-61ea-40ae-9237-b4d8e1855dbb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:30.616629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58afb952-61ea-40ae-9237-b4d8e1855dbb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:30.617163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58afb952-61ea-40ae-9237-b4d8e1855dbb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:30.617602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58afb952-61ea-40ae-9237-b4d8e1855dbb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:30.618338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58afb952-61ea-40ae-9237-b4d8e1855dbb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:30.623741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58afb952-61ea-40ae-9237-b4d8e1855dbb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:30.625357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58afb952-61ea-40ae-9237-b4d8e1855dbb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:30.917048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-329163fa-f168-4ae7-acff-dd5006ea1470 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:30.917671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-329163fa-f168-4ae7-acff-dd5006ea1470 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:30.944629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-329163fa-f168-4ae7-acff-dd5006ea1470 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:30.952148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-329163fa-f168-4ae7-acff-dd5006ea1470 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:30.952641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-329163fa-f168-4ae7-acff-dd5006ea1470 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:30.972657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-329163fa-f168-4ae7-acff-dd5006ea1470 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:30.976004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-329163fa-f168-4ae7-acff-dd5006ea1470 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:30.977097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-329163fa-f168-4ae7-acff-dd5006ea1470 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:31.342808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-329163fa-f168-4ae7-acff-dd5006ea1470 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:31.353929 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-329163fa-f168-4ae7-acff-dd5006ea1470 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1275 microversion: 2.1 time: 0.441267 Oct 27 19:11:31.369294 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2514/5214] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:30 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1275 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:31.374470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-52565ae8-4f74-45ee-9296-52d1c219db94 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:31.375387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-52565ae8-4f74-45ee-9296-52d1c219db94 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:31.401731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52565ae8-4f74-45ee-9296-52d1c219db94 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:31.407360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52565ae8-4f74-45ee-9296-52d1c219db94 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:31.413704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52565ae8-4f74-45ee-9296-52d1c219db94 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:31.414927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52565ae8-4f74-45ee-9296-52d1c219db94 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:31.418279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52565ae8-4f74-45ee-9296-52d1c219db94 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:31.436130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52565ae8-4f74-45ee-9296-52d1c219db94 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:31.611471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-58afb952-61ea-40ae-9237-b4d8e1855dbb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:31.624408 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-58afb952-61ea-40ae-9237-b4d8e1855dbb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1314 microversion: 2.1 time: 1.058891 Oct 27 19:11:31.657879 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2701/5215] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:30 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1314 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:31.800822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-52565ae8-4f74-45ee-9296-52d1c219db94 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:31.821351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-52565ae8-4f74-45ee-9296-52d1c219db94 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:31.824642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-52565ae8-4f74-45ee-9296-52d1c219db94 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:31.842270 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-52565ae8-4f74-45ee-9296-52d1c219db94 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.482709 Oct 27 19:11:31.844863 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2515/5216] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:31 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:32.384820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cc3ac4e7-14c6-4a18-8e20-14ee528b245a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:32.385675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cc3ac4e7-14c6-4a18-8e20-14ee528b245a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:32.399865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc3ac4e7-14c6-4a18-8e20-14ee528b245a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:32.406267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc3ac4e7-14c6-4a18-8e20-14ee528b245a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:32.409718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc3ac4e7-14c6-4a18-8e20-14ee528b245a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:32.410598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc3ac4e7-14c6-4a18-8e20-14ee528b245a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:32.415139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc3ac4e7-14c6-4a18-8e20-14ee528b245a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:32.417305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc3ac4e7-14c6-4a18-8e20-14ee528b245a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:32.547368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:33.020867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-867a0912-1ee6-4340-985d-dd14d16a9333 req-a994389c-30e1-446c-90b3-89e3e7af4bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58bbaff-5c5b-4229-9b62-dd5fe437c639", "tag": "ad59e0a2-c388-4afb-a696-bc2dcad59515"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:11:33.078169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-867a0912-1ee6-4340-985d-dd14d16a9333 req-a994389c-30e1-446c-90b3-89e3e7af4bff service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:33.078714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-867a0912-1ee6-4340-985d-dd14d16a9333 req-a994389c-30e1-446c-90b3-89e3e7af4bff service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:33.084132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-867a0912-1ee6-4340-985d-dd14d16a9333 req-a994389c-30e1-446c-90b3-89e3e7af4bff service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:33.135879 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-867a0912-1ee6-4340-985d-dd14d16a9333 req-a994389c-30e1-446c-90b3-89e3e7af4bff service nova] Creating event network-changed:ad59e0a2-c388-4afb-a696-bc2dcad59515 for instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 on n-h2-860687-3 Oct 27 19:11:33.151923 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-867a0912-1ee6-4340-985d-dd14d16a9333 req-a994389c-30e1-446c-90b3-89e3e7af4bff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.633842 Oct 27 19:11:33.157622 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2516/5217] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:11:33.161101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:33.172350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-41573299-a6be-4e1f-9883-0a7cba7b6f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:33.188926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-41573299-a6be-4e1f-9883-0a7cba7b6f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:33.207582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41573299-a6be-4e1f-9883-0a7cba7b6f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:33.215784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41573299-a6be-4e1f-9883-0a7cba7b6f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:33.221754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41573299-a6be-4e1f-9883-0a7cba7b6f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:33.224219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41573299-a6be-4e1f-9883-0a7cba7b6f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:33.230986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41573299-a6be-4e1f-9883-0a7cba7b6f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:33.236053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-41573299-a6be-4e1f-9883-0a7cba7b6f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:33.244667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:33.329988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cc3ac4e7-14c6-4a18-8e20-14ee528b245a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:33.350542 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cc3ac4e7-14c6-4a18-8e20-14ee528b245a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1273 microversion: 2.1 time: 0.957669 Oct 27 19:11:33.351577 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2702/5218] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:32 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1273 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:33.398697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-efb07365-f289-4ac6-beaf-351f065dcd83 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:33.402327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-efb07365-f289-4ac6-beaf-351f065dcd83 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:33.446342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efb07365-f289-4ac6-beaf-351f065dcd83 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:33.447140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efb07365-f289-4ac6-beaf-351f065dcd83 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:33.452617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efb07365-f289-4ac6-beaf-351f065dcd83 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:33.453952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efb07365-f289-4ac6-beaf-351f065dcd83 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:33.464396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efb07365-f289-4ac6-beaf-351f065dcd83 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:33.468662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efb07365-f289-4ac6-beaf-351f065dcd83 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:34.068021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-efb07365-f289-4ac6-beaf-351f065dcd83 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:34.084716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-efb07365-f289-4ac6-beaf-351f065dcd83 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:34.089777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-efb07365-f289-4ac6-beaf-351f065dcd83 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:34.106150 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-efb07365-f289-4ac6-beaf-351f065dcd83 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.747626 Oct 27 19:11:34.138753 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2703/5219] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:33 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:34.378181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6de5412a-47fe-4601-8736-2f1dec99b949 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:34.378989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6de5412a-47fe-4601-8736-2f1dec99b949 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:34.395413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6de5412a-47fe-4601-8736-2f1dec99b949 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:34.407947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6de5412a-47fe-4601-8736-2f1dec99b949 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:34.407947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6de5412a-47fe-4601-8736-2f1dec99b949 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:34.409429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6de5412a-47fe-4601-8736-2f1dec99b949 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:34.410215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6de5412a-47fe-4601-8736-2f1dec99b949 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:34.417275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6de5412a-47fe-4601-8736-2f1dec99b949 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:34.679537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-41573299-a6be-4e1f-9883-0a7cba7b6f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:34.690967 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-41573299-a6be-4e1f-9883-0a7cba7b6f6c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1314 microversion: 2.1 time: 1.531558 Oct 27 19:11:34.718420 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2517/5220] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:33 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1314 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:35.145845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2ce7555b-d135-4921-b57e-997f71691dee tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:35.147277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2ce7555b-d135-4921-b57e-997f71691dee tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:35.158678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ce7555b-d135-4921-b57e-997f71691dee tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:35.175952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ce7555b-d135-4921-b57e-997f71691dee tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:35.176944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ce7555b-d135-4921-b57e-997f71691dee tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:35.177962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ce7555b-d135-4921-b57e-997f71691dee tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:35.178823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ce7555b-d135-4921-b57e-997f71691dee tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:35.179494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ce7555b-d135-4921-b57e-997f71691dee tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:35.332218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6de5412a-47fe-4601-8736-2f1dec99b949 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:35.343833 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6de5412a-47fe-4601-8736-2f1dec99b949 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1315 microversion: 2.1 time: 0.969862 Oct 27 19:11:35.363560 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2704/5221] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:34 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1315 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:35.455270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2ce7555b-d135-4921-b57e-997f71691dee tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:35.471100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2ce7555b-d135-4921-b57e-997f71691dee tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:35.475522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2ce7555b-d135-4921-b57e-997f71691dee tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:35.495076 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2ce7555b-d135-4921-b57e-997f71691dee tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.352962 Oct 27 19:11:35.498816 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2518/5222] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:35 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:35.732670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-012f8334-44d7-46b6-906d-6f6d85e5c2f5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:35.733296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-012f8334-44d7-46b6-906d-6f6d85e5c2f5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:35.757562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-012f8334-44d7-46b6-906d-6f6d85e5c2f5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:35.764126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-012f8334-44d7-46b6-906d-6f6d85e5c2f5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:35.764752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-012f8334-44d7-46b6-906d-6f6d85e5c2f5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:35.765548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-012f8334-44d7-46b6-906d-6f6d85e5c2f5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:35.766039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-012f8334-44d7-46b6-906d-6f6d85e5c2f5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:35.771136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-012f8334-44d7-46b6-906d-6f6d85e5c2f5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:36.373252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-675a840a-2f97-4ff5-89fc-f843d5a8d099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:36.374546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-675a840a-2f97-4ff5-89fc-f843d5a8d099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:36.391418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-675a840a-2f97-4ff5-89fc-f843d5a8d099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:36.392215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-675a840a-2f97-4ff5-89fc-f843d5a8d099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:36.394565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-675a840a-2f97-4ff5-89fc-f843d5a8d099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:36.395635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-675a840a-2f97-4ff5-89fc-f843d5a8d099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:36.396353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-675a840a-2f97-4ff5-89fc-f843d5a8d099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:36.398293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-675a840a-2f97-4ff5-89fc-f843d5a8d099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:36.712256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-012f8334-44d7-46b6-906d-6f6d85e5c2f5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:36.728690 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-012f8334-44d7-46b6-906d-6f6d85e5c2f5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1314 microversion: 2.1 time: 1.000459 Oct 27 19:11:36.730650 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2705/5223] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:35 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1314 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:36.742313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ace6f9f8-e69d-4e65-9932-a7448fb10b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:36.743753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ace6f9f8-e69d-4e65-9932-a7448fb10b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:36.761423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ace6f9f8-e69d-4e65-9932-a7448fb10b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:36.768996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ace6f9f8-e69d-4e65-9932-a7448fb10b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:36.770658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ace6f9f8-e69d-4e65-9932-a7448fb10b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:36.771659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ace6f9f8-e69d-4e65-9932-a7448fb10b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:36.780127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ace6f9f8-e69d-4e65-9932-a7448fb10b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:36.781498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ace6f9f8-e69d-4e65-9932-a7448fb10b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:36.848913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-675a840a-2f97-4ff5-89fc-f843d5a8d099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:36.869422 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-675a840a-2f97-4ff5-89fc-f843d5a8d099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1315 microversion: 2.1 time: 0.497871 Oct 27 19:11:36.870954 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2519/5224] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:36 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:36.999515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ace6f9f8-e69d-4e65-9932-a7448fb10b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:37.029031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ace6f9f8-e69d-4e65-9932-a7448fb10b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:37.033617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ace6f9f8-e69d-4e65-9932-a7448fb10b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:37.079488 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ace6f9f8-e69d-4e65-9932-a7448fb10b7c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.346824 Oct 27 19:11:37.085491 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2706/5225] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:36 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:37.756832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aad4a1a6-1c54-41af-8bb2-15d7cdfc5181 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:37.758332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aad4a1a6-1c54-41af-8bb2-15d7cdfc5181 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:37.780418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aad4a1a6-1c54-41af-8bb2-15d7cdfc5181 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:37.781763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aad4a1a6-1c54-41af-8bb2-15d7cdfc5181 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:37.784355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aad4a1a6-1c54-41af-8bb2-15d7cdfc5181 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:37.787795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aad4a1a6-1c54-41af-8bb2-15d7cdfc5181 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:37.788914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aad4a1a6-1c54-41af-8bb2-15d7cdfc5181 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:37.789748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aad4a1a6-1c54-41af-8bb2-15d7cdfc5181 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:37.899693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6252104-10cb-4085-9981-aeaf18519452 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:37.900913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c6252104-10cb-4085-9981-aeaf18519452 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:37.913224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6252104-10cb-4085-9981-aeaf18519452 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:37.916018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6252104-10cb-4085-9981-aeaf18519452 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:37.916651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6252104-10cb-4085-9981-aeaf18519452 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:37.917582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6252104-10cb-4085-9981-aeaf18519452 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:37.918215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6252104-10cb-4085-9981-aeaf18519452 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:37.918859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6252104-10cb-4085-9981-aeaf18519452 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:38.016281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:38.446811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=10 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:38.711568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c6252104-10cb-4085-9981-aeaf18519452 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:38.725836 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c6252104-10cb-4085-9981-aeaf18519452 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1315 microversion: 2.1 time: 0.830195 Oct 27 19:11:38.737048 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2707/5226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:37 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:38.785567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ebebb168-ba0d-4b47-a9bf-c8af920108e9 req-ed17424d-ad79-4549-99ee-da5785ff35ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86898626-0268-442a-87b6-247e940e384b", "tag": "fb95d35e-1e2e-4043-aed9-63a81ad3e541"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:11:38.849879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ebebb168-ba0d-4b47-a9bf-c8af920108e9 req-ed17424d-ad79-4549-99ee-da5785ff35ec service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:38.855224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ebebb168-ba0d-4b47-a9bf-c8af920108e9 req-ed17424d-ad79-4549-99ee-da5785ff35ec service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:38.856110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ebebb168-ba0d-4b47-a9bf-c8af920108e9 req-ed17424d-ad79-4549-99ee-da5785ff35ec service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:38.879429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aad4a1a6-1c54-41af-8bb2-15d7cdfc5181 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:38.888973 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aad4a1a6-1c54-41af-8bb2-15d7cdfc5181 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1314 microversion: 2.1 time: 1.138620 Oct 27 19:11:38.893383 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2520/5227] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:37 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1314 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:38.911093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-174642e5-756f-4b61-a346-fd2f3312dc1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:38.913210 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ebebb168-ba0d-4b47-a9bf-c8af920108e9 req-ed17424d-ad79-4549-99ee-da5785ff35ec service nova] Creating event network-changed:fb95d35e-1e2e-4043-aed9-63a81ad3e541 for instance 86898626-0268-442a-87b6-247e940e384b on n-h1-860687-3 Oct 27 19:11:38.916019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-174642e5-756f-4b61-a346-fd2f3312dc1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:38.938970 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ebebb168-ba0d-4b47-a9bf-c8af920108e9 req-ed17424d-ad79-4549-99ee-da5785ff35ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200109 Oct 27 19:11:38.945723 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2708/5228] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:11:38.951682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-174642e5-756f-4b61-a346-fd2f3312dc1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:38.952196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-174642e5-756f-4b61-a346-fd2f3312dc1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:38.958672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-174642e5-756f-4b61-a346-fd2f3312dc1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:38.986860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-174642e5-756f-4b61-a346-fd2f3312dc1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:38.986860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-174642e5-756f-4b61-a346-fd2f3312dc1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:38.986860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-174642e5-756f-4b61-a346-fd2f3312dc1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:39.438305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-174642e5-756f-4b61-a346-fd2f3312dc1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:39.453196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-174642e5-756f-4b61-a346-fd2f3312dc1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:39.456881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-174642e5-756f-4b61-a346-fd2f3312dc1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:39.472098 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-174642e5-756f-4b61-a346-fd2f3312dc1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.577279 Oct 27 19:11:39.472986 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2521/5229] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:38 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:39.757261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9de0b7e8-e003-49a9-b213-aeffa3947e56 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:39.758002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9de0b7e8-e003-49a9-b213-aeffa3947e56 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:39.775761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:39.785651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9de0b7e8-e003-49a9-b213-aeffa3947e56 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:39.788873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9de0b7e8-e003-49a9-b213-aeffa3947e56 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:39.789348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9de0b7e8-e003-49a9-b213-aeffa3947e56 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:39.798182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9de0b7e8-e003-49a9-b213-aeffa3947e56 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:39.801800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9de0b7e8-e003-49a9-b213-aeffa3947e56 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:39.803043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9de0b7e8-e003-49a9-b213-aeffa3947e56 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:39.919669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-18b7496b-c9c1-480c-8bd9-92d5adb2eef6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:39.921326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-18b7496b-c9c1-480c-8bd9-92d5adb2eef6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:39.943243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18b7496b-c9c1-480c-8bd9-92d5adb2eef6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:39.944086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18b7496b-c9c1-480c-8bd9-92d5adb2eef6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:39.944758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18b7496b-c9c1-480c-8bd9-92d5adb2eef6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:39.946694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18b7496b-c9c1-480c-8bd9-92d5adb2eef6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:39.951224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18b7496b-c9c1-480c-8bd9-92d5adb2eef6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:39.952527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18b7496b-c9c1-480c-8bd9-92d5adb2eef6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:39.969908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:40.174665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9de0b7e8-e003-49a9-b213-aeffa3947e56 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:40.186009 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9de0b7e8-e003-49a9-b213-aeffa3947e56 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1315 microversion: 2.1 time: 0.434368 Oct 27 19:11:40.189453 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2709/5230] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:39 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:40.512217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a2ce5ace-dec5-4b41-8144-3898e1e2bc7d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:40.515350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a2ce5ace-dec5-4b41-8144-3898e1e2bc7d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:40.531419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2ce5ace-dec5-4b41-8144-3898e1e2bc7d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:40.532225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2ce5ace-dec5-4b41-8144-3898e1e2bc7d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:40.536562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2ce5ace-dec5-4b41-8144-3898e1e2bc7d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:40.537597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2ce5ace-dec5-4b41-8144-3898e1e2bc7d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:40.538242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2ce5ace-dec5-4b41-8144-3898e1e2bc7d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:40.539483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2ce5ace-dec5-4b41-8144-3898e1e2bc7d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:40.877088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-18b7496b-c9c1-480c-8bd9-92d5adb2eef6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:40.886846 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-18b7496b-c9c1-480c-8bd9-92d5adb2eef6 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1314 microversion: 2.1 time: 0.973389 Oct 27 19:11:40.903535 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2522/5231] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:39 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1314 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:40.983503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a2ce5ace-dec5-4b41-8144-3898e1e2bc7d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:40.999422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a2ce5ace-dec5-4b41-8144-3898e1e2bc7d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:41.004253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a2ce5ace-dec5-4b41-8144-3898e1e2bc7d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:41.022827 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a2ce5ace-dec5-4b41-8144-3898e1e2bc7d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.521824 Oct 27 19:11:41.024390 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2710/5232] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:40 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:41.225073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7a94fac3-4cfa-45d6-b5f9-6cb5014055b3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:41.225701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7a94fac3-4cfa-45d6-b5f9-6cb5014055b3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:41.240563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-71612e9e-da26-4031-a859-57d1ef92e13e req-5d546e00-6c0a-4ab4-ae86-740bc74ebe72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58bbaff-5c5b-4229-9b62-dd5fe437c639", "name": "network-vif-plugged", "status": "completed", "tag": "ad59e0a2-c388-4afb-a696-bc2dcad59515"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:11:41.241929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a94fac3-4cfa-45d6-b5f9-6cb5014055b3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:41.242460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a94fac3-4cfa-45d6-b5f9-6cb5014055b3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:41.242916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a94fac3-4cfa-45d6-b5f9-6cb5014055b3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:41.243641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a94fac3-4cfa-45d6-b5f9-6cb5014055b3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:41.244106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a94fac3-4cfa-45d6-b5f9-6cb5014055b3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:41.256327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a94fac3-4cfa-45d6-b5f9-6cb5014055b3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:41.281322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-71612e9e-da26-4031-a859-57d1ef92e13e req-5d546e00-6c0a-4ab4-ae86-740bc74ebe72 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:41.281843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-71612e9e-da26-4031-a859-57d1ef92e13e req-5d546e00-6c0a-4ab4-ae86-740bc74ebe72 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:41.282301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-71612e9e-da26-4031-a859-57d1ef92e13e req-5d546e00-6c0a-4ab4-ae86-740bc74ebe72 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:41.300033 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-71612e9e-da26-4031-a859-57d1ef92e13e req-5d546e00-6c0a-4ab4-ae86-740bc74ebe72 service nova] Creating event network-vif-plugged:ad59e0a2-c388-4afb-a696-bc2dcad59515 for instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 on n-h2-860687-3 Oct 27 19:11:41.314085 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-71612e9e-da26-4031-a859-57d1ef92e13e req-5d546e00-6c0a-4ab4-ae86-740bc74ebe72 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076333 Oct 27 19:11:41.318727 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2711/5233] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:11:41.745561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7a94fac3-4cfa-45d6-b5f9-6cb5014055b3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:41.759275 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7a94fac3-4cfa-45d6-b5f9-6cb5014055b3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1315 microversion: 2.1 time: 0.540850 Oct 27 19:11:41.777420 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2523/5234] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:41 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:41.914243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-942b302c-ed30-4a3b-8333-aa833f0b691d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:41.915428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-942b302c-ed30-4a3b-8333-aa833f0b691d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:41.932080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-942b302c-ed30-4a3b-8333-aa833f0b691d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:41.932580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-942b302c-ed30-4a3b-8333-aa833f0b691d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:41.933028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-942b302c-ed30-4a3b-8333-aa833f0b691d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:41.933752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-942b302c-ed30-4a3b-8333-aa833f0b691d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:41.947740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-942b302c-ed30-4a3b-8333-aa833f0b691d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:41.949123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-942b302c-ed30-4a3b-8333-aa833f0b691d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:42.055836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d7a8e61-1faf-4f0a-b391-286a8ba5cb7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:42.056663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d7a8e61-1faf-4f0a-b391-286a8ba5cb7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:42.072009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d7a8e61-1faf-4f0a-b391-286a8ba5cb7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:42.073004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d7a8e61-1faf-4f0a-b391-286a8ba5cb7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:42.074525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d7a8e61-1faf-4f0a-b391-286a8ba5cb7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:42.077226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d7a8e61-1faf-4f0a-b391-286a8ba5cb7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:42.079773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d7a8e61-1faf-4f0a-b391-286a8ba5cb7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:42.080786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d7a8e61-1faf-4f0a-b391-286a8ba5cb7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:42.171216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d7a8e61-1faf-4f0a-b391-286a8ba5cb7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:42.184008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d7a8e61-1faf-4f0a-b391-286a8ba5cb7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:42.186727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d7a8e61-1faf-4f0a-b391-286a8ba5cb7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:42.194619 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d7a8e61-1faf-4f0a-b391-286a8ba5cb7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.143707 Oct 27 19:11:42.196002 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2524/5235] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:42 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:11:42.784866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-298ee57e-f204-4b0c-8131-766668ced546 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:42.785830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-298ee57e-f204-4b0c-8131-766668ced546 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:42.800526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-298ee57e-f204-4b0c-8131-766668ced546 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:42.800966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-298ee57e-f204-4b0c-8131-766668ced546 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:42.808724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-298ee57e-f204-4b0c-8131-766668ced546 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:42.815230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-298ee57e-f204-4b0c-8131-766668ced546 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:42.819762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-298ee57e-f204-4b0c-8131-766668ced546 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:42.826748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-298ee57e-f204-4b0c-8131-766668ced546 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:42.925457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-942b302c-ed30-4a3b-8333-aa833f0b691d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:42.946378 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-942b302c-ed30-4a3b-8333-aa833f0b691d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1314 microversion: 2.1 time: 1.034233 Oct 27 19:11:42.951167 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2712/5236] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:41 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1314 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:43.223316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b8e002f5-5506-4732-9ee4-e74d6f5eaf7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:43.225195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b8e002f5-5506-4732-9ee4-e74d6f5eaf7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:43.244804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8e002f5-5506-4732-9ee4-e74d6f5eaf7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:43.249116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8e002f5-5506-4732-9ee4-e74d6f5eaf7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:43.249788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8e002f5-5506-4732-9ee4-e74d6f5eaf7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:43.251779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8e002f5-5506-4732-9ee4-e74d6f5eaf7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:43.255648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8e002f5-5506-4732-9ee4-e74d6f5eaf7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:43.256288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8e002f5-5506-4732-9ee4-e74d6f5eaf7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:43.327065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-298ee57e-f204-4b0c-8131-766668ced546 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:43.345708 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-298ee57e-f204-4b0c-8131-766668ced546 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1315 microversion: 2.1 time: 0.564806 Oct 27 19:11:43.346764 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2525/5237] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:42 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:43.404280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b8e002f5-5506-4732-9ee4-e74d6f5eaf7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:43.424547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b8e002f5-5506-4732-9ee4-e74d6f5eaf7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:43.430979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b8e002f5-5506-4732-9ee4-e74d6f5eaf7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:43.445017 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b8e002f5-5506-4732-9ee4-e74d6f5eaf7f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.225978 Oct 27 19:11:43.462884 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2713/5238] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:43 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:11:43.978639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bde801df-d360-4d6e-8563-32592b9fd2a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:43.978639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bde801df-d360-4d6e-8563-32592b9fd2a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:43.987918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:44.009806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde801df-d360-4d6e-8563-32592b9fd2a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:44.010515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde801df-d360-4d6e-8563-32592b9fd2a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:44.010986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde801df-d360-4d6e-8563-32592b9fd2a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:44.011979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde801df-d360-4d6e-8563-32592b9fd2a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:44.012857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde801df-d360-4d6e-8563-32592b9fd2a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:44.025465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde801df-d360-4d6e-8563-32592b9fd2a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:44.374031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-46ec2302-f588-4e37-abf5-f1e1fb2b8678 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:44.375475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-46ec2302-f588-4e37-abf5-f1e1fb2b8678 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:44.426907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46ec2302-f588-4e37-abf5-f1e1fb2b8678 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:44.435872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46ec2302-f588-4e37-abf5-f1e1fb2b8678 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:44.439993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46ec2302-f588-4e37-abf5-f1e1fb2b8678 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:44.443811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46ec2302-f588-4e37-abf5-f1e1fb2b8678 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:44.449967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46ec2302-f588-4e37-abf5-f1e1fb2b8678 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:44.456388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-46ec2302-f588-4e37-abf5-f1e1fb2b8678 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:44.800837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bde801df-d360-4d6e-8563-32592b9fd2a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:44.830673 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bde801df-d360-4d6e-8563-32592b9fd2a3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1500 microversion: 2.1 time: 0.848318 Oct 27 19:11:44.830673 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2526/5239] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:43 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1500 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:44.853384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8dba9e1a-9ba2-4789-a602-0858a68ed1dc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:44.857082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8dba9e1a-9ba2-4789-a602-0858a68ed1dc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:44.873196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dba9e1a-9ba2-4789-a602-0858a68ed1dc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:44.873630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dba9e1a-9ba2-4789-a602-0858a68ed1dc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:44.874070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dba9e1a-9ba2-4789-a602-0858a68ed1dc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:44.879013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dba9e1a-9ba2-4789-a602-0858a68ed1dc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:44.879520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dba9e1a-9ba2-4789-a602-0858a68ed1dc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:44.879978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dba9e1a-9ba2-4789-a602-0858a68ed1dc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:44.982053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8dba9e1a-9ba2-4789-a602-0858a68ed1dc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:44.992476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8dba9e1a-9ba2-4789-a602-0858a68ed1dc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:44.995349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8dba9e1a-9ba2-4789-a602-0858a68ed1dc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:45.003366 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8dba9e1a-9ba2-4789-a602-0858a68ed1dc tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.162087 Oct 27 19:11:45.015675 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2527/5240] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:44 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:45.033210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5b4fe5e4-5cd2-4fb3-babe-c75d04e16032 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:11:45.049165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b4fe5e4-5cd2-4fb3-babe-c75d04e16032 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:45.052996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b4fe5e4-5cd2-4fb3-babe-c75d04e16032 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:45.053760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b4fe5e4-5cd2-4fb3-babe-c75d04e16032 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:45.105081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5b4fe5e4-5cd2-4fb3-babe-c75d04e16032 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Going to try to stop instance {{(pid=127028) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 19:11:45.214884 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5b4fe5e4-5cd2-4fb3-babe-c75d04e16032 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "POST /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639/action" status: 202 len: 0 microversion: 2.1 time: 0.197547 Oct 27 19:11:45.220814 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2528/5241] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:11:45 2022] POST /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:11:45.228006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-202ca46c-5156-4985-ba37-6885f545ca75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:45.229197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-202ca46c-5156-4985-ba37-6885f545ca75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:45.243598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-202ca46c-5156-4985-ba37-6885f545ca75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:45.244413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-202ca46c-5156-4985-ba37-6885f545ca75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:45.245080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-202ca46c-5156-4985-ba37-6885f545ca75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:45.246710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-202ca46c-5156-4985-ba37-6885f545ca75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:45.247553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-202ca46c-5156-4985-ba37-6885f545ca75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:45.248368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-202ca46c-5156-4985-ba37-6885f545ca75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:45.725975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-202ca46c-5156-4985-ba37-6885f545ca75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:45.736748 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-202ca46c-5156-4985-ba37-6885f545ca75 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 0.514103 Oct 27 19:11:45.743146 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2529/5242] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:45 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:45.749617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-2f1a25b1-e8fc-4eb5-8ba3-e17c8933dc6d req-e46fd037-ee5e-4f54-9e2f-031a48814ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86898626-0268-442a-87b6-247e940e384b", "name": "network-vif-plugged", "status": "completed", "tag": "fb95d35e-1e2e-4043-aed9-63a81ad3e541"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:11:45.781348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2f1a25b1-e8fc-4eb5-8ba3-e17c8933dc6d req-e46fd037-ee5e-4f54-9e2f-031a48814ed4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:45.784393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2f1a25b1-e8fc-4eb5-8ba3-e17c8933dc6d req-e46fd037-ee5e-4f54-9e2f-031a48814ed4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:45.785264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2f1a25b1-e8fc-4eb5-8ba3-e17c8933dc6d req-e46fd037-ee5e-4f54-9e2f-031a48814ed4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:45.824090 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-2f1a25b1-e8fc-4eb5-8ba3-e17c8933dc6d req-e46fd037-ee5e-4f54-9e2f-031a48814ed4 service nova] Creating event network-vif-plugged:fb95d35e-1e2e-4043-aed9-63a81ad3e541 for instance 86898626-0268-442a-87b6-247e940e384b on n-h1-860687-3 Oct 27 19:11:45.836500 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-2f1a25b1-e8fc-4eb5-8ba3-e17c8933dc6d req-e46fd037-ee5e-4f54-9e2f-031a48814ed4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090697 Oct 27 19:11:45.838887 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2530/5243] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:11:46.036171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-952bf201-18dc-4fc8-a523-8c85231a3d68 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:46.036933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-952bf201-18dc-4fc8-a523-8c85231a3d68 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:46.056844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-952bf201-18dc-4fc8-a523-8c85231a3d68 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:46.057370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-952bf201-18dc-4fc8-a523-8c85231a3d68 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:46.057834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-952bf201-18dc-4fc8-a523-8c85231a3d68 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:46.058616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-952bf201-18dc-4fc8-a523-8c85231a3d68 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:46.059089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-952bf201-18dc-4fc8-a523-8c85231a3d68 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:46.077665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-952bf201-18dc-4fc8-a523-8c85231a3d68 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:46.259999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-46ec2302-f588-4e37-abf5-f1e1fb2b8678 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:46.282041 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-46ec2302-f588-4e37-abf5-f1e1fb2b8678 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1315 microversion: 2.1 time: 1.913072 Oct 27 19:11:46.282907 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2714/5244] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:44 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1315 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:46.376637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-952bf201-18dc-4fc8-a523-8c85231a3d68 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:46.395031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-952bf201-18dc-4fc8-a523-8c85231a3d68 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:46.401853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-952bf201-18dc-4fc8-a523-8c85231a3d68 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:46.412773 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-952bf201-18dc-4fc8-a523-8c85231a3d68 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.382507 Oct 27 19:11:46.431710 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2531/5245] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:46 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:46.771142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d03f3547-0329-4340-bfcd-303be6c1fdf8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:46.781976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d03f3547-0329-4340-bfcd-303be6c1fdf8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:46.823965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d03f3547-0329-4340-bfcd-303be6c1fdf8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:46.833443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d03f3547-0329-4340-bfcd-303be6c1fdf8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:46.834018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d03f3547-0329-4340-bfcd-303be6c1fdf8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:46.834839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d03f3547-0329-4340-bfcd-303be6c1fdf8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:46.835319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d03f3547-0329-4340-bfcd-303be6c1fdf8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:46.835759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d03f3547-0329-4340-bfcd-303be6c1fdf8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:47.305834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8a952f54-3f50-42c1-9e69-c53ef6189b15 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:47.307283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8a952f54-3f50-42c1-9e69-c53ef6189b15 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:47.319523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a952f54-3f50-42c1-9e69-c53ef6189b15 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:47.323850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a952f54-3f50-42c1-9e69-c53ef6189b15 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:47.324498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a952f54-3f50-42c1-9e69-c53ef6189b15 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:47.326219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a952f54-3f50-42c1-9e69-c53ef6189b15 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:47.327510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a952f54-3f50-42c1-9e69-c53ef6189b15 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:47.332554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8a952f54-3f50-42c1-9e69-c53ef6189b15 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:47.482804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d03f3547-0329-4340-bfcd-303be6c1fdf8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:47.507626 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d03f3547-0329-4340-bfcd-303be6c1fdf8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 0.733695 Oct 27 19:11:47.509815 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2715/5246] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:46 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:47.530967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6894dfb6-0733-4b34-be23-9c60ac0806c8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:47.534066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6894dfb6-0733-4b34-be23-9c60ac0806c8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:47.597205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6894dfb6-0733-4b34-be23-9c60ac0806c8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:47.602850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6894dfb6-0733-4b34-be23-9c60ac0806c8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:47.603508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6894dfb6-0733-4b34-be23-9c60ac0806c8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:47.604435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6894dfb6-0733-4b34-be23-9c60ac0806c8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:47.605037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6894dfb6-0733-4b34-be23-9c60ac0806c8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:47.606937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6894dfb6-0733-4b34-be23-9c60ac0806c8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:47.950005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8a952f54-3f50-42c1-9e69-c53ef6189b15 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:47.962971 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8a952f54-3f50-42c1-9e69-c53ef6189b15 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1315 microversion: 2.1 time: 0.659336 Oct 27 19:11:47.965573 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2532/5247] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:47 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:47.984439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6894dfb6-0733-4b34-be23-9c60ac0806c8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:47.995000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6894dfb6-0733-4b34-be23-9c60ac0806c8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:47.996462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6894dfb6-0733-4b34-be23-9c60ac0806c8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:48.010336 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6894dfb6-0733-4b34-be23-9c60ac0806c8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.498214 Oct 27 19:11:48.010950 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2716/5248] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:47 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:48.559943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13e70daf-81ed-403b-80c1-4bd0974e28bc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:48.579478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-13e70daf-81ed-403b-80c1-4bd0974e28bc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:48.608496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13e70daf-81ed-403b-80c1-4bd0974e28bc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:48.636901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13e70daf-81ed-403b-80c1-4bd0974e28bc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:48.637395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13e70daf-81ed-403b-80c1-4bd0974e28bc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:48.644277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13e70daf-81ed-403b-80c1-4bd0974e28bc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:48.652449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13e70daf-81ed-403b-80c1-4bd0974e28bc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:48.657526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13e70daf-81ed-403b-80c1-4bd0974e28bc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:48.970360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-13e70daf-81ed-403b-80c1-4bd0974e28bc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:48.982286 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-13e70daf-81ed-403b-80c1-4bd0974e28bc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 0.448136 Oct 27 19:11:48.983509 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2533/5249] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:48 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:48.990847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c5633ada-b46f-42f4-9b72-3b67f2c6787a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:48.991476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c5633ada-b46f-42f4-9b72-3b67f2c6787a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:49.009629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5633ada-b46f-42f4-9b72-3b67f2c6787a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:49.010076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5633ada-b46f-42f4-9b72-3b67f2c6787a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:49.010630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5633ada-b46f-42f4-9b72-3b67f2c6787a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:49.011364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5633ada-b46f-42f4-9b72-3b67f2c6787a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:49.011881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5633ada-b46f-42f4-9b72-3b67f2c6787a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:49.012365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5633ada-b46f-42f4-9b72-3b67f2c6787a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:49.047882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-57971c14-c7a3-443d-bee2-3e8c46c55ac8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:49.048659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-57971c14-c7a3-443d-bee2-3e8c46c55ac8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:49.070097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57971c14-c7a3-443d-bee2-3e8c46c55ac8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:49.070804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57971c14-c7a3-443d-bee2-3e8c46c55ac8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:49.071348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57971c14-c7a3-443d-bee2-3e8c46c55ac8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:49.076711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57971c14-c7a3-443d-bee2-3e8c46c55ac8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:49.077525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57971c14-c7a3-443d-bee2-3e8c46c55ac8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:49.084632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57971c14-c7a3-443d-bee2-3e8c46c55ac8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:49.239144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-57971c14-c7a3-443d-bee2-3e8c46c55ac8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:49.249984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-57971c14-c7a3-443d-bee2-3e8c46c55ac8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:49.259375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-57971c14-c7a3-443d-bee2-3e8c46c55ac8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:49.278605 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-57971c14-c7a3-443d-bee2-3e8c46c55ac8 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.235289 Oct 27 19:11:49.284879 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2534/5250] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:49 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:11:49.429505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c5633ada-b46f-42f4-9b72-3b67f2c6787a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:49.440673 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c5633ada-b46f-42f4-9b72-3b67f2c6787a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1502 microversion: 2.1 time: 0.453758 Oct 27 19:11:49.452452 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2717/5251] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:48 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1502 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:49.480435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d55951e-8bdb-4f33-b4fa-22e32ab86ec8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:11:49.493977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d55951e-8bdb-4f33-b4fa-22e32ab86ec8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:49.493977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d55951e-8bdb-4f33-b4fa-22e32ab86ec8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:49.505030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d55951e-8bdb-4f33-b4fa-22e32ab86ec8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:49.618274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0d55951e-8bdb-4f33-b4fa-22e32ab86ec8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Going to try to stop instance {{(pid=127028) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 19:11:49.814015 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d55951e-8bdb-4f33-b4fa-22e32ab86ec8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b/action" status: 202 len: 0 microversion: 2.1 time: 0.337214 Oct 27 19:11:49.818303 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2535/5252] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:11:49 2022] POST /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:11:49.830022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0c24a9b5-9a7f-4623-8175-24e5ee328141 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:49.832255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0c24a9b5-9a7f-4623-8175-24e5ee328141 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:49.862834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c24a9b5-9a7f-4623-8175-24e5ee328141 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:49.863857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c24a9b5-9a7f-4623-8175-24e5ee328141 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:49.864692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c24a9b5-9a7f-4623-8175-24e5ee328141 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:49.865643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c24a9b5-9a7f-4623-8175-24e5ee328141 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:49.868639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c24a9b5-9a7f-4623-8175-24e5ee328141 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:49.874556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c24a9b5-9a7f-4623-8175-24e5ee328141 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:50.012390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-27eb1bc1-57e7-426f-8636-c2fefe005463 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:50.014157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-27eb1bc1-57e7-426f-8636-c2fefe005463 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:50.029103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27eb1bc1-57e7-426f-8636-c2fefe005463 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:50.030459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27eb1bc1-57e7-426f-8636-c2fefe005463 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:50.033773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27eb1bc1-57e7-426f-8636-c2fefe005463 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:50.035072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27eb1bc1-57e7-426f-8636-c2fefe005463 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:50.035755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27eb1bc1-57e7-426f-8636-c2fefe005463 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:50.037889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27eb1bc1-57e7-426f-8636-c2fefe005463 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:50.240695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0c24a9b5-9a7f-4623-8175-24e5ee328141 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:50.255817 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0c24a9b5-9a7f-4623-8175-24e5ee328141 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 0.433847 Oct 27 19:11:50.259194 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2718/5253] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:49 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:50.318340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0e386863-74bf-4de3-8b8a-096cc27ae09e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:50.319195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0e386863-74bf-4de3-8b8a-096cc27ae09e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:50.331842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e386863-74bf-4de3-8b8a-096cc27ae09e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:50.332827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e386863-74bf-4de3-8b8a-096cc27ae09e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:50.337357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e386863-74bf-4de3-8b8a-096cc27ae09e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:50.339592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e386863-74bf-4de3-8b8a-096cc27ae09e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:50.345132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e386863-74bf-4de3-8b8a-096cc27ae09e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:50.345899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e386863-74bf-4de3-8b8a-096cc27ae09e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:50.518938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0e386863-74bf-4de3-8b8a-096cc27ae09e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:50.535381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0e386863-74bf-4de3-8b8a-096cc27ae09e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:50.538358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0e386863-74bf-4de3-8b8a-096cc27ae09e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:50.552648 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0e386863-74bf-4de3-8b8a-096cc27ae09e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.239635 Oct 27 19:11:50.580001 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2719/5254] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:50 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:50.892449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-27eb1bc1-57e7-426f-8636-c2fefe005463 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:50.915199 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-27eb1bc1-57e7-426f-8636-c2fefe005463 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 0.900152 Oct 27 19:11:50.916109 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2536/5255] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:50 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:51.281517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5fd99e84-3b2a-43a3-ae66-882300c12d0f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:51.282137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5fd99e84-3b2a-43a3-ae66-882300c12d0f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:51.304939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fd99e84-3b2a-43a3-ae66-882300c12d0f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:51.306442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fd99e84-3b2a-43a3-ae66-882300c12d0f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:51.315316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fd99e84-3b2a-43a3-ae66-882300c12d0f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:51.321269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fd99e84-3b2a-43a3-ae66-882300c12d0f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:51.322914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fd99e84-3b2a-43a3-ae66-882300c12d0f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:51.324514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fd99e84-3b2a-43a3-ae66-882300c12d0f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:51.330180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:51.585369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-94d862e9-b069-4606-9d59-6c0d175a2810 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:51.586279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-94d862e9-b069-4606-9d59-6c0d175a2810 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:51.601529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94d862e9-b069-4606-9d59-6c0d175a2810 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:51.603456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94d862e9-b069-4606-9d59-6c0d175a2810 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:51.604799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94d862e9-b069-4606-9d59-6c0d175a2810 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:51.607210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94d862e9-b069-4606-9d59-6c0d175a2810 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:51.608057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94d862e9-b069-4606-9d59-6c0d175a2810 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:51.615143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94d862e9-b069-4606-9d59-6c0d175a2810 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:51.656384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5fd99e84-3b2a-43a3-ae66-882300c12d0f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:51.666946 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5fd99e84-3b2a-43a3-ae66-882300c12d0f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 0.389217 Oct 27 19:11:51.672674 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2720/5256] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:51 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:51.685512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:11:51.794776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-94d862e9-b069-4606-9d59-6c0d175a2810 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:51.805644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-94d862e9-b069-4606-9d59-6c0d175a2810 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:51.811952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-94d862e9-b069-4606-9d59-6c0d175a2810 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:51.824851 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-94d862e9-b069-4606-9d59-6c0d175a2810 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.243452 Oct 27 19:11:51.831043 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2537/5257] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:51 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:51.941141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b780345-ac80-4427-857b-86d796e291b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:51.942044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b780345-ac80-4427-857b-86d796e291b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:51.954169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b780345-ac80-4427-857b-86d796e291b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:51.956599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b780345-ac80-4427-857b-86d796e291b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:51.958051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b780345-ac80-4427-857b-86d796e291b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:51.961141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b780345-ac80-4427-857b-86d796e291b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:51.964827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b780345-ac80-4427-857b-86d796e291b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:51.965402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b780345-ac80-4427-857b-86d796e291b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:52.484361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3b780345-ac80-4427-857b-86d796e291b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:52.496006 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b780345-ac80-4427-857b-86d796e291b5 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 0.559033 Oct 27 19:11:52.501183 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2721/5258] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:51 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:52.699862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5319bfe4-cde1-4a22-b29c-96b3237d75e2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:52.701654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5319bfe4-cde1-4a22-b29c-96b3237d75e2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:52.720650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5319bfe4-cde1-4a22-b29c-96b3237d75e2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:52.721444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5319bfe4-cde1-4a22-b29c-96b3237d75e2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:52.723688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5319bfe4-cde1-4a22-b29c-96b3237d75e2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:52.725371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5319bfe4-cde1-4a22-b29c-96b3237d75e2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:52.727232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5319bfe4-cde1-4a22-b29c-96b3237d75e2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:52.729532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5319bfe4-cde1-4a22-b29c-96b3237d75e2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:52.867385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8cb3de4c-85e4-4bc1-b8dd-0a74ac890ea7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:52.868131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8cb3de4c-85e4-4bc1-b8dd-0a74ac890ea7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:52.882882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cb3de4c-85e4-4bc1-b8dd-0a74ac890ea7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:52.886224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cb3de4c-85e4-4bc1-b8dd-0a74ac890ea7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:52.888611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cb3de4c-85e4-4bc1-b8dd-0a74ac890ea7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:52.893714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cb3de4c-85e4-4bc1-b8dd-0a74ac890ea7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:52.894343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cb3de4c-85e4-4bc1-b8dd-0a74ac890ea7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:52.896560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cb3de4c-85e4-4bc1-b8dd-0a74ac890ea7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:53.117234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5319bfe4-cde1-4a22-b29c-96b3237d75e2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:53.132640 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5319bfe4-cde1-4a22-b29c-96b3237d75e2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 0.436794 Oct 27 19:11:53.133805 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2538/5259] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:52 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:53.152040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8cb3de4c-85e4-4bc1-b8dd-0a74ac890ea7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:53.170697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8cb3de4c-85e4-4bc1-b8dd-0a74ac890ea7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:53.172180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8cb3de4c-85e4-4bc1-b8dd-0a74ac890ea7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:53.189659 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8cb3de4c-85e4-4bc1-b8dd-0a74ac890ea7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.326623 Oct 27 19:11:53.190336 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2722/5260] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:52 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:53.526591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-11181e4c-cafa-4a88-b464-a0337d7e6d47 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:53.527838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-11181e4c-cafa-4a88-b464-a0337d7e6d47 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:53.553368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11181e4c-cafa-4a88-b464-a0337d7e6d47 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:53.556098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11181e4c-cafa-4a88-b464-a0337d7e6d47 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:53.556844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11181e4c-cafa-4a88-b464-a0337d7e6d47 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:53.558127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11181e4c-cafa-4a88-b464-a0337d7e6d47 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:53.560984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11181e4c-cafa-4a88-b464-a0337d7e6d47 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:53.561588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11181e4c-cafa-4a88-b464-a0337d7e6d47 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:54.158271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-11181e4c-cafa-4a88-b464-a0337d7e6d47 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:54.158979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-91ad90aa-16f1-4c34-ba2d-418bbfbd9a27 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:54.159361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-91ad90aa-16f1-4c34-ba2d-418bbfbd9a27 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:54.168085 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-11181e4c-cafa-4a88-b464-a0337d7e6d47 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 0.648638 Oct 27 19:11:54.178903 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2539/5261] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:53 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:54.185554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91ad90aa-16f1-4c34-ba2d-418bbfbd9a27 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:54.201254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91ad90aa-16f1-4c34-ba2d-418bbfbd9a27 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:54.208423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91ad90aa-16f1-4c34-ba2d-418bbfbd9a27 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:54.213448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91ad90aa-16f1-4c34-ba2d-418bbfbd9a27 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:54.214756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91ad90aa-16f1-4c34-ba2d-418bbfbd9a27 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:54.215436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91ad90aa-16f1-4c34-ba2d-418bbfbd9a27 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:54.226475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e2a8f3c8-3776-47f9-881d-ff89ccaaca15 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:54.227462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e2a8f3c8-3776-47f9-881d-ff89ccaaca15 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:54.247711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a8f3c8-3776-47f9-881d-ff89ccaaca15 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:54.251851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a8f3c8-3776-47f9-881d-ff89ccaaca15 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:54.253996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a8f3c8-3776-47f9-881d-ff89ccaaca15 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:54.258925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a8f3c8-3776-47f9-881d-ff89ccaaca15 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:54.260747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a8f3c8-3776-47f9-881d-ff89ccaaca15 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:54.264396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a8f3c8-3776-47f9-881d-ff89ccaaca15 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:54.548393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e2a8f3c8-3776-47f9-881d-ff89ccaaca15 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:54.565726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e2a8f3c8-3776-47f9-881d-ff89ccaaca15 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:54.574121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e2a8f3c8-3776-47f9-881d-ff89ccaaca15 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:54.615769 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e2a8f3c8-3776-47f9-881d-ff89ccaaca15 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.395118 Oct 27 19:11:54.625875 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2540/5262] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:54 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:11:54.968977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-91ad90aa-16f1-4c34-ba2d-418bbfbd9a27 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:54.980101 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-91ad90aa-16f1-4c34-ba2d-418bbfbd9a27 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 0.826785 Oct 27 19:11:54.984603 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2723/5263] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:54 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:55.205292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-428987ab-94fd-4abc-b069-3710a8ca204d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:55.205967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-428987ab-94fd-4abc-b069-3710a8ca204d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:55.221300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-428987ab-94fd-4abc-b069-3710a8ca204d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:55.232677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-428987ab-94fd-4abc-b069-3710a8ca204d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:55.233375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-428987ab-94fd-4abc-b069-3710a8ca204d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:55.237153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-428987ab-94fd-4abc-b069-3710a8ca204d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:55.243625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-428987ab-94fd-4abc-b069-3710a8ca204d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:55.244329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-428987ab-94fd-4abc-b069-3710a8ca204d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:55.666266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1c9615cc-7bac-4e79-b364-91a93507c97d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:55.667800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1c9615cc-7bac-4e79-b364-91a93507c97d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:55.669705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-428987ab-94fd-4abc-b069-3710a8ca204d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:55.679848 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-428987ab-94fd-4abc-b069-3710a8ca204d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 0.478504 Oct 27 19:11:55.686202 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2541/5264] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:55 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:55.689772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c9615cc-7bac-4e79-b364-91a93507c97d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:55.704531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c9615cc-7bac-4e79-b364-91a93507c97d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:55.705961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c9615cc-7bac-4e79-b364-91a93507c97d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:55.707256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c9615cc-7bac-4e79-b364-91a93507c97d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:55.711264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c9615cc-7bac-4e79-b364-91a93507c97d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:55.714446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c9615cc-7bac-4e79-b364-91a93507c97d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:56.010949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1fd44731-273b-4f4e-915a-5b3bee29bf67 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:56.011584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1fd44731-273b-4f4e-915a-5b3bee29bf67 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:56.031990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fd44731-273b-4f4e-915a-5b3bee29bf67 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:56.040141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fd44731-273b-4f4e-915a-5b3bee29bf67 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:56.040637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fd44731-273b-4f4e-915a-5b3bee29bf67 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:56.047269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fd44731-273b-4f4e-915a-5b3bee29bf67 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:56.048487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fd44731-273b-4f4e-915a-5b3bee29bf67 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:56.049107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fd44731-273b-4f4e-915a-5b3bee29bf67 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:56.059793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1c9615cc-7bac-4e79-b364-91a93507c97d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:56.095435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1c9615cc-7bac-4e79-b364-91a93507c97d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:56.097299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1c9615cc-7bac-4e79-b364-91a93507c97d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:56.103312 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1c9615cc-7bac-4e79-b364-91a93507c97d tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.442537 Oct 27 19:11:56.123670 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2724/5265] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:55 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:11:56.486486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1fd44731-273b-4f4e-915a-5b3bee29bf67 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:56.500640 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1fd44731-273b-4f4e-915a-5b3bee29bf67 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 0.493196 Oct 27 19:11:56.514921 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2542/5266] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:56 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:11:56.720021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1602ff90-4a4f-4132-8ab6-547acefaca8c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:56.720655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1602ff90-4a4f-4132-8ab6-547acefaca8c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:56.745134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1602ff90-4a4f-4132-8ab6-547acefaca8c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:56.750055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1602ff90-4a4f-4132-8ab6-547acefaca8c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:56.753331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1602ff90-4a4f-4132-8ab6-547acefaca8c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:56.759237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1602ff90-4a4f-4132-8ab6-547acefaca8c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:56.761854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1602ff90-4a4f-4132-8ab6-547acefaca8c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:56.764112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1602ff90-4a4f-4132-8ab6-547acefaca8c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:57.137826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a12a5cf8-a0da-4681-bc65-b35c9be97117 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:57.139127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a12a5cf8-a0da-4681-bc65-b35c9be97117 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:57.151478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a12a5cf8-a0da-4681-bc65-b35c9be97117 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:57.151996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a12a5cf8-a0da-4681-bc65-b35c9be97117 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:57.152454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a12a5cf8-a0da-4681-bc65-b35c9be97117 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:57.157625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a12a5cf8-a0da-4681-bc65-b35c9be97117 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:57.158183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a12a5cf8-a0da-4681-bc65-b35c9be97117 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:57.158674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a12a5cf8-a0da-4681-bc65-b35c9be97117 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:57.202291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1602ff90-4a4f-4132-8ab6-547acefaca8c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:57.225790 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1602ff90-4a4f-4132-8ab6-547acefaca8c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 0.496026 Oct 27 19:11:57.231366 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2725/5267] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:56 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:57.424340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a12a5cf8-a0da-4681-bc65-b35c9be97117 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:57.433793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a12a5cf8-a0da-4681-bc65-b35c9be97117 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:57.452088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a12a5cf8-a0da-4681-bc65-b35c9be97117 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:57.470330 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a12a5cf8-a0da-4681-bc65-b35c9be97117 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.337004 Oct 27 19:11:57.473640 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2543/5268] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:57 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:11:57.529146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0386928e-4a69-492a-b006-915086b341c3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:57.530764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0386928e-4a69-492a-b006-915086b341c3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:57.543178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0386928e-4a69-492a-b006-915086b341c3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:57.547996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0386928e-4a69-492a-b006-915086b341c3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:57.553063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0386928e-4a69-492a-b006-915086b341c3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:57.556403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0386928e-4a69-492a-b006-915086b341c3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:57.563210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0386928e-4a69-492a-b006-915086b341c3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:57.564980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0386928e-4a69-492a-b006-915086b341c3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:58.272149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fce60d7a-571b-4a41-95bb-dec996684dfb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:58.272884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fce60d7a-571b-4a41-95bb-dec996684dfb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:58.291969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fce60d7a-571b-4a41-95bb-dec996684dfb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:58.296683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fce60d7a-571b-4a41-95bb-dec996684dfb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:58.297982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fce60d7a-571b-4a41-95bb-dec996684dfb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:58.299009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fce60d7a-571b-4a41-95bb-dec996684dfb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:58.310314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fce60d7a-571b-4a41-95bb-dec996684dfb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:58.311164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fce60d7a-571b-4a41-95bb-dec996684dfb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:58.563530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0386928e-4a69-492a-b006-915086b341c3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:58.574581 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0386928e-4a69-492a-b006-915086b341c3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 1.050019 Oct 27 19:11:58.576093 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2726/5269] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:57 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:58.604656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0427b264-cc76-4935-9eed-a3b14593c6a9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:58.605274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0427b264-cc76-4935-9eed-a3b14593c6a9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:58.632643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0427b264-cc76-4935-9eed-a3b14593c6a9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:58.633150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0427b264-cc76-4935-9eed-a3b14593c6a9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:58.635596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0427b264-cc76-4935-9eed-a3b14593c6a9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:58.636607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0427b264-cc76-4935-9eed-a3b14593c6a9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:58.639288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0427b264-cc76-4935-9eed-a3b14593c6a9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:58.639995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0427b264-cc76-4935-9eed-a3b14593c6a9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:58.745982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fce60d7a-571b-4a41-95bb-dec996684dfb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:58.761751 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fce60d7a-571b-4a41-95bb-dec996684dfb tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 0.511367 Oct 27 19:11:58.763479 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2544/5270] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:58 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:11:58.895528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0427b264-cc76-4935-9eed-a3b14593c6a9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:58.913773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0427b264-cc76-4935-9eed-a3b14593c6a9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:58.926976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0427b264-cc76-4935-9eed-a3b14593c6a9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:11:58.939367 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0427b264-cc76-4935-9eed-a3b14593c6a9 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1553 microversion: 2.91 time: 0.361965 Oct 27 19:11:58.944271 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2727/5271] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:11:58 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1553 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:11:59.601780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4e681a41-071c-474f-9a30-de6539143f86 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:59.603037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4e681a41-071c-474f-9a30-de6539143f86 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:59.630261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e681a41-071c-474f-9a30-de6539143f86 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:59.662948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e681a41-071c-474f-9a30-de6539143f86 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:59.663491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e681a41-071c-474f-9a30-de6539143f86 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:59.664274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e681a41-071c-474f-9a30-de6539143f86 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:59.667486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e681a41-071c-474f-9a30-de6539143f86 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:59.668056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e681a41-071c-474f-9a30-de6539143f86 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:59.790434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-447a34e5-ceb7-4a35-8684-3da142754539 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:11:59.790986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-447a34e5-ceb7-4a35-8684-3da142754539 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:11:59.814783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-447a34e5-ceb7-4a35-8684-3da142754539 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:59.815420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-447a34e5-ceb7-4a35-8684-3da142754539 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:59.815744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-447a34e5-ceb7-4a35-8684-3da142754539 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:11:59.816440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-447a34e5-ceb7-4a35-8684-3da142754539 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:11:59.816910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-447a34e5-ceb7-4a35-8684-3da142754539 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:11:59.817403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-447a34e5-ceb7-4a35-8684-3da142754539 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:00.264512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4e681a41-071c-474f-9a30-de6539143f86 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:00.277581 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4e681a41-071c-474f-9a30-de6539143f86 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 0.679803 Oct 27 19:12:00.281347 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2545/5272] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:59 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:00.292268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c5862223-6084-43f4-ab7e-0861a795caf7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:00.297463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c5862223-6084-43f4-ab7e-0861a795caf7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:00.312010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5862223-6084-43f4-ab7e-0861a795caf7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:00.312680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5862223-6084-43f4-ab7e-0861a795caf7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:00.314015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5862223-6084-43f4-ab7e-0861a795caf7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:00.315468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5862223-6084-43f4-ab7e-0861a795caf7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:00.317293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5862223-6084-43f4-ab7e-0861a795caf7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:00.318417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c5862223-6084-43f4-ab7e-0861a795caf7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:00.410192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-447a34e5-ceb7-4a35-8684-3da142754539 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:00.423005 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-447a34e5-ceb7-4a35-8684-3da142754539 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 0.633423 Oct 27 19:12:00.437304 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2728/5273] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:11:59 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:00.499012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c5862223-6084-43f4-ab7e-0861a795caf7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:00.519270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c5862223-6084-43f4-ab7e-0861a795caf7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:00.520859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c5862223-6084-43f4-ab7e-0861a795caf7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:00.529071 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c5862223-6084-43f4-ab7e-0861a795caf7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1535 microversion: 2.91 time: 0.245581 Oct 27 19:12:00.529605 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2546/5274] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:00 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1535 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:01.308930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-625a8194-a567-466c-b643-3b35ad140727 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:01.313183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-625a8194-a567-466c-b643-3b35ad140727 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:01.333772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-625a8194-a567-466c-b643-3b35ad140727 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:01.337389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-625a8194-a567-466c-b643-3b35ad140727 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:01.337916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-625a8194-a567-466c-b643-3b35ad140727 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:01.339948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-625a8194-a567-466c-b643-3b35ad140727 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:01.342950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-625a8194-a567-466c-b643-3b35ad140727 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:01.344123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-625a8194-a567-466c-b643-3b35ad140727 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:01.450888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa6164b8-3884-499e-beac-021aa13cc33a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:01.451530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa6164b8-3884-499e-beac-021aa13cc33a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:01.463074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa6164b8-3884-499e-beac-021aa13cc33a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:01.463796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa6164b8-3884-499e-beac-021aa13cc33a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:01.464401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa6164b8-3884-499e-beac-021aa13cc33a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:01.465298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa6164b8-3884-499e-beac-021aa13cc33a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:01.467309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa6164b8-3884-499e-beac-021aa13cc33a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:01.469557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa6164b8-3884-499e-beac-021aa13cc33a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:01.671718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-625a8194-a567-466c-b643-3b35ad140727 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:01.686536 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-625a8194-a567-466c-b643-3b35ad140727 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 0.383058 Oct 27 19:12:01.688359 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2729/5275] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:01 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:01.694260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c02edcea-594d-4448-bb5e-bd4d7b0b0593 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:01.695211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c02edcea-594d-4448-bb5e-bd4d7b0b0593 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:01.704739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c02edcea-594d-4448-bb5e-bd4d7b0b0593 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:01.705667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c02edcea-594d-4448-bb5e-bd4d7b0b0593 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:01.706583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c02edcea-594d-4448-bb5e-bd4d7b0b0593 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:01.708239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c02edcea-594d-4448-bb5e-bd4d7b0b0593 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:01.709129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c02edcea-594d-4448-bb5e-bd4d7b0b0593 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:01.709824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c02edcea-594d-4448-bb5e-bd4d7b0b0593 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:01.798402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c02edcea-594d-4448-bb5e-bd4d7b0b0593 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:01.811175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c02edcea-594d-4448-bb5e-bd4d7b0b0593 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:01.813157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c02edcea-594d-4448-bb5e-bd4d7b0b0593 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:01.820002 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c02edcea-594d-4448-bb5e-bd4d7b0b0593 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1538 microversion: 2.91 time: 0.130099 Oct 27 19:12:01.839225 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2730/5276] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:01 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1538 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:01.850448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2892e6ca-3b71-4277-8985-5b7e6a721fbf tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-860687-3"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:01.853533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2892e6ca-3b71-4277-8985-5b7e6a721fbf tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:01.860664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2892e6ca-3b71-4277-8985-5b7e6a721fbf tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:01.861755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2892e6ca-3b71-4277-8985-5b7e6a721fbf tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:01.862286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2892e6ca-3b71-4277-8985-5b7e6a721fbf tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:01.863416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2892e6ca-3b71-4277-8985-5b7e6a721fbf tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:01.864018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2892e6ca-3b71-4277-8985-5b7e6a721fbf tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:01.864639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2892e6ca-3b71-4277-8985-5b7e6a721fbf tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:01.938332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2892e6ca-3b71-4277-8985-5b7e6a721fbf tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-860687-3". {{(pid=127029) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 19:12:02.062526 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2892e6ca-3b71-4277-8985-5b7e6a721fbf tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad/action" status: 202 len: 0 microversion: 2.91 time: 0.215794 Oct 27 19:12:02.068130 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2731/5277] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 19:12:01 2022] POST /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:12:02.102240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0c8b64aa-a897-455a-a21c-28b29e0137e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:02.102932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0c8b64aa-a897-455a-a21c-28b29e0137e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:02.125310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c8b64aa-a897-455a-a21c-28b29e0137e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:02.129697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c8b64aa-a897-455a-a21c-28b29e0137e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:02.130918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c8b64aa-a897-455a-a21c-28b29e0137e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:02.133457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c8b64aa-a897-455a-a21c-28b29e0137e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:02.139697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c8b64aa-a897-455a-a21c-28b29e0137e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:02.144231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c8b64aa-a897-455a-a21c-28b29e0137e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:02.273230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0c8b64aa-a897-455a-a21c-28b29e0137e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:02.287292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0c8b64aa-a897-455a-a21c-28b29e0137e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:02.290039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0c8b64aa-a897-455a-a21c-28b29e0137e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:02.304330 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0c8b64aa-a897-455a-a21c-28b29e0137e2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1546 microversion: 2.91 time: 0.234572 Oct 27 19:12:02.319540 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2732/5278] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:02 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1546 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:02.713632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-376f72ea-e15c-4177-940a-22f85b59c610 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:02.714072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-376f72ea-e15c-4177-940a-22f85b59c610 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:02.728803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-376f72ea-e15c-4177-940a-22f85b59c610 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:02.732050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-376f72ea-e15c-4177-940a-22f85b59c610 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:02.732528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-376f72ea-e15c-4177-940a-22f85b59c610 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:02.733257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-376f72ea-e15c-4177-940a-22f85b59c610 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:02.740316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-376f72ea-e15c-4177-940a-22f85b59c610 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:02.740863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-376f72ea-e15c-4177-940a-22f85b59c610 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:02.883720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fa6164b8-3884-499e-beac-021aa13cc33a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:02.898024 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fa6164b8-3884-499e-beac-021aa13cc33a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 1.451952 Oct 27 19:12:02.900990 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2547/5279] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:01 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:12:03.110355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-376f72ea-e15c-4177-940a-22f85b59c610 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:03.120897 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-376f72ea-e15c-4177-940a-22f85b59c610 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 0.412332 Oct 27 19:12:03.126736 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2733/5280] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:02 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:03.343392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f560861e-9504-445a-a7ef-a97349094e74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:03.344017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f560861e-9504-445a-a7ef-a97349094e74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:03.357346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f560861e-9504-445a-a7ef-a97349094e74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:03.357868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f560861e-9504-445a-a7ef-a97349094e74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:03.358325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f560861e-9504-445a-a7ef-a97349094e74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:03.361534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f560861e-9504-445a-a7ef-a97349094e74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:03.362212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f560861e-9504-445a-a7ef-a97349094e74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:03.363363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f560861e-9504-445a-a7ef-a97349094e74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:03.860713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f560861e-9504-445a-a7ef-a97349094e74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:03.906319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f560861e-9504-445a-a7ef-a97349094e74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:03.908071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f560861e-9504-445a-a7ef-a97349094e74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:03.927436 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f560861e-9504-445a-a7ef-a97349094e74 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1486 microversion: 2.91 time: 0.588696 Oct 27 19:12:03.937255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5aafea54-c501-49ee-aa6e-cac2aba6c568 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:03.938252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5aafea54-c501-49ee-aa6e-cac2aba6c568 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:03.940457 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2548/5281] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:03 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1486 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:03.967973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5aafea54-c501-49ee-aa6e-cac2aba6c568 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:03.968521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5aafea54-c501-49ee-aa6e-cac2aba6c568 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:03.968986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5aafea54-c501-49ee-aa6e-cac2aba6c568 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:03.969753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5aafea54-c501-49ee-aa6e-cac2aba6c568 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:03.972161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5aafea54-c501-49ee-aa6e-cac2aba6c568 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:03.972645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5aafea54-c501-49ee-aa6e-cac2aba6c568 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:04.147665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2f9fd56a-987d-479d-8dcb-192e87f27632 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:04.148734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2f9fd56a-987d-479d-8dcb-192e87f27632 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:04.169805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f9fd56a-987d-479d-8dcb-192e87f27632 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:04.177466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f9fd56a-987d-479d-8dcb-192e87f27632 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:04.178995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f9fd56a-987d-479d-8dcb-192e87f27632 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:04.181312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f9fd56a-987d-479d-8dcb-192e87f27632 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:04.184277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f9fd56a-987d-479d-8dcb-192e87f27632 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:04.186225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f9fd56a-987d-479d-8dcb-192e87f27632 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:04.681227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2f9fd56a-987d-479d-8dcb-192e87f27632 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:04.690982 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2f9fd56a-987d-479d-8dcb-192e87f27632 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 0.547326 Oct 27 19:12:04.692085 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2549/5282] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:04 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:04.967838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-45f09731-5194-4791-83ae-93ec1514e8a2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:04.968661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-45f09731-5194-4791-83ae-93ec1514e8a2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:04.986524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45f09731-5194-4791-83ae-93ec1514e8a2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:04.989495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45f09731-5194-4791-83ae-93ec1514e8a2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:04.992761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45f09731-5194-4791-83ae-93ec1514e8a2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:04.993544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45f09731-5194-4791-83ae-93ec1514e8a2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:04.994024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45f09731-5194-4791-83ae-93ec1514e8a2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:04.994501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45f09731-5194-4791-83ae-93ec1514e8a2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:05.152601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5aafea54-c501-49ee-aa6e-cac2aba6c568 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:05.163544 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5aafea54-c501-49ee-aa6e-cac2aba6c568 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 1.235351 Oct 27 19:12:05.164138 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2734/5283] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:03 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:12:05.219564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-45f09731-5194-4791-83ae-93ec1514e8a2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:05.236687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-45f09731-5194-4791-83ae-93ec1514e8a2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:05.249908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-45f09731-5194-4791-83ae-93ec1514e8a2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:05.273369 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-45f09731-5194-4791-83ae-93ec1514e8a2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.317107 Oct 27 19:12:05.274728 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2550/5284] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:04 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:05.717095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-707a6f9b-8e84-454f-b16e-5aabc74d6294 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:05.717879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-707a6f9b-8e84-454f-b16e-5aabc74d6294 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:05.727064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-707a6f9b-8e84-454f-b16e-5aabc74d6294 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:05.727496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-707a6f9b-8e84-454f-b16e-5aabc74d6294 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:05.727951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-707a6f9b-8e84-454f-b16e-5aabc74d6294 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:05.728674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-707a6f9b-8e84-454f-b16e-5aabc74d6294 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:05.729143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-707a6f9b-8e84-454f-b16e-5aabc74d6294 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:05.729580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-707a6f9b-8e84-454f-b16e-5aabc74d6294 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:05.767604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:06.192780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5117cb09-397a-4a41-9c24-66449e4f815b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:06.193390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5117cb09-397a-4a41-9c24-66449e4f815b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:06.204929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5117cb09-397a-4a41-9c24-66449e4f815b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:06.215163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5117cb09-397a-4a41-9c24-66449e4f815b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:06.215940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5117cb09-397a-4a41-9c24-66449e4f815b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:06.217025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5117cb09-397a-4a41-9c24-66449e4f815b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:06.219368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5117cb09-397a-4a41-9c24-66449e4f815b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:06.221276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5117cb09-397a-4a41-9c24-66449e4f815b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:06.491976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-707a6f9b-8e84-454f-b16e-5aabc74d6294 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:06.507780 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-707a6f9b-8e84-454f-b16e-5aabc74d6294 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 0.795380 Oct 27 19:12:06.523593 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2735/5285] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:05 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:06.546122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a0ca6aa4-4650-4591-b0cf-f92e2b9b2c3c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:06.549831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a0ca6aa4-4650-4591-b0cf-f92e2b9b2c3c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:06.583210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ca6aa4-4650-4591-b0cf-f92e2b9b2c3c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:06.587060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ca6aa4-4650-4591-b0cf-f92e2b9b2c3c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:06.587782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ca6aa4-4650-4591-b0cf-f92e2b9b2c3c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:06.590138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ca6aa4-4650-4591-b0cf-f92e2b9b2c3c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:06.593172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ca6aa4-4650-4591-b0cf-f92e2b9b2c3c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:06.593870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ca6aa4-4650-4591-b0cf-f92e2b9b2c3c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:07.003335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5117cb09-397a-4a41-9c24-66449e4f815b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:07.044241 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5117cb09-397a-4a41-9c24-66449e4f815b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 0.852108 Oct 27 19:12:07.083287 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2551/5286] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:06 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:07.152828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a0ca6aa4-4650-4591-b0cf-f92e2b9b2c3c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:07.182931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a0ca6aa4-4650-4591-b0cf-f92e2b9b2c3c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:07.192051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a0ca6aa4-4650-4591-b0cf-f92e2b9b2c3c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:07.229695 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a0ca6aa4-4650-4591-b0cf-f92e2b9b2c3c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.697954 Oct 27 19:12:07.231568 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2736/5287] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:06 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:07.540285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-868a1cd7-0182-495d-8988-279b35a8b172 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:07.541760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-868a1cd7-0182-495d-8988-279b35a8b172 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:07.567013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-868a1cd7-0182-495d-8988-279b35a8b172 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:07.575934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-868a1cd7-0182-495d-8988-279b35a8b172 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:07.587223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-868a1cd7-0182-495d-8988-279b35a8b172 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:07.588108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-868a1cd7-0182-495d-8988-279b35a8b172 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:07.591914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-868a1cd7-0182-495d-8988-279b35a8b172 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:07.591914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-868a1cd7-0182-495d-8988-279b35a8b172 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:08.102023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a9b215e-f5cc-4403-a3a2-c7e3b106efcc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:08.104100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1a9b215e-f5cc-4403-a3a2-c7e3b106efcc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:08.122874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a9b215e-f5cc-4403-a3a2-c7e3b106efcc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:08.126289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a9b215e-f5cc-4403-a3a2-c7e3b106efcc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:08.133192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a9b215e-f5cc-4403-a3a2-c7e3b106efcc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:08.136904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a9b215e-f5cc-4403-a3a2-c7e3b106efcc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:08.138587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a9b215e-f5cc-4403-a3a2-c7e3b106efcc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:08.143170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a9b215e-f5cc-4403-a3a2-c7e3b106efcc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:08.438964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-868a1cd7-0182-495d-8988-279b35a8b172 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:08.454220 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-868a1cd7-0182-495d-8988-279b35a8b172 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 0.917839 Oct 27 19:12:08.456431 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2552/5288] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:07 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:08.486124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-06d007c2-988a-4b24-ae47-03bfb0f8e91a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:08.488918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-06d007c2-988a-4b24-ae47-03bfb0f8e91a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:08.514312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06d007c2-988a-4b24-ae47-03bfb0f8e91a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:08.514835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06d007c2-988a-4b24-ae47-03bfb0f8e91a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:08.515288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06d007c2-988a-4b24-ae47-03bfb0f8e91a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:08.516017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06d007c2-988a-4b24-ae47-03bfb0f8e91a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:08.530561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06d007c2-988a-4b24-ae47-03bfb0f8e91a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:08.531938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06d007c2-988a-4b24-ae47-03bfb0f8e91a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:08.567270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1a9b215e-f5cc-4403-a3a2-c7e3b106efcc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:08.580618 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1a9b215e-f5cc-4403-a3a2-c7e3b106efcc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 0.480797 Oct 27 19:12:08.613093 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2737/5289] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:08 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:09.482286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ea4d9ffd-6603-48ec-9dc7-ee2d636093c0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:09.483704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ea4d9ffd-6603-48ec-9dc7-ee2d636093c0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:09.496464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea4d9ffd-6603-48ec-9dc7-ee2d636093c0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:09.503275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea4d9ffd-6603-48ec-9dc7-ee2d636093c0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:09.504424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea4d9ffd-6603-48ec-9dc7-ee2d636093c0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:09.506326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea4d9ffd-6603-48ec-9dc7-ee2d636093c0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:09.508519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea4d9ffd-6603-48ec-9dc7-ee2d636093c0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:09.509960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea4d9ffd-6603-48ec-9dc7-ee2d636093c0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:09.573952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-06d007c2-988a-4b24-ae47-03bfb0f8e91a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:09.604553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-06d007c2-988a-4b24-ae47-03bfb0f8e91a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:09.611186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-06d007c2-988a-4b24-ae47-03bfb0f8e91a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:09.633713 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-06d007c2-988a-4b24-ae47-03bfb0f8e91a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 1.176026 Oct 27 19:12:09.647821 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2553/5290] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:08 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:09.680399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1400e6fd-dfef-4833-8728-b0b53fe7cc18 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:09.685486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1400e6fd-dfef-4833-8728-b0b53fe7cc18 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:09.750548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1400e6fd-dfef-4833-8728-b0b53fe7cc18 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:09.750548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1400e6fd-dfef-4833-8728-b0b53fe7cc18 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:09.750548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1400e6fd-dfef-4833-8728-b0b53fe7cc18 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:09.750548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1400e6fd-dfef-4833-8728-b0b53fe7cc18 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:09.750548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1400e6fd-dfef-4833-8728-b0b53fe7cc18 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:09.750548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1400e6fd-dfef-4833-8728-b0b53fe7cc18 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:09.788171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:10.980700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ea4d9ffd-6603-48ec-9dc7-ee2d636093c0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:11.006551 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ea4d9ffd-6603-48ec-9dc7-ee2d636093c0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 1.522557 Oct 27 19:12:11.007715 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2738/5291] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:09 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:12:11.019020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6634e1a9-de32-41dd-a10e-17fafcfc2a2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:11.023228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6634e1a9-de32-41dd-a10e-17fafcfc2a2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:11.047031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=84 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:11.051534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6634e1a9-de32-41dd-a10e-17fafcfc2a2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:11.055006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6634e1a9-de32-41dd-a10e-17fafcfc2a2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:11.055939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6634e1a9-de32-41dd-a10e-17fafcfc2a2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:11.059319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6634e1a9-de32-41dd-a10e-17fafcfc2a2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:11.059984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6634e1a9-de32-41dd-a10e-17fafcfc2a2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:11.061361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6634e1a9-de32-41dd-a10e-17fafcfc2a2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:11.235041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1400e6fd-dfef-4833-8728-b0b53fe7cc18 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:11.252944 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1400e6fd-dfef-4833-8728-b0b53fe7cc18 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1510 microversion: 2.1 time: 1.598787 Oct 27 19:12:11.284249 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2554/5292] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:09 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1510 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:11.391372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6634e1a9-de32-41dd-a10e-17fafcfc2a2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:11.404236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6634e1a9-de32-41dd-a10e-17fafcfc2a2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:11.406021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6634e1a9-de32-41dd-a10e-17fafcfc2a2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:11.415970 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6634e1a9-de32-41dd-a10e-17fafcfc2a2f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.406960 Oct 27 19:12:11.420157 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2739/5293] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:11 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:12.057874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-629d9c63-f13e-439a-aaea-4ea3a4dff946 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:12.058803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-629d9c63-f13e-439a-aaea-4ea3a4dff946 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:12.065733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-629d9c63-f13e-439a-aaea-4ea3a4dff946 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:12.066616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-629d9c63-f13e-439a-aaea-4ea3a4dff946 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:12.067333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-629d9c63-f13e-439a-aaea-4ea3a4dff946 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:12.068274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-629d9c63-f13e-439a-aaea-4ea3a4dff946 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:12.068951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-629d9c63-f13e-439a-aaea-4ea3a4dff946 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:12.069603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-629d9c63-f13e-439a-aaea-4ea3a4dff946 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:12.289693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-78ae0436-02a5-490e-bc38-b06411b60666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:12.290466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-78ae0436-02a5-490e-bc38-b06411b60666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:12.322419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78ae0436-02a5-490e-bc38-b06411b60666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:12.330610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78ae0436-02a5-490e-bc38-b06411b60666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:12.333496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78ae0436-02a5-490e-bc38-b06411b60666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:12.335670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78ae0436-02a5-490e-bc38-b06411b60666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:12.338927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78ae0436-02a5-490e-bc38-b06411b60666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:12.343737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78ae0436-02a5-490e-bc38-b06411b60666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:12.673377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-629d9c63-f13e-439a-aaea-4ea3a4dff946 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:12.686335 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-629d9c63-f13e-439a-aaea-4ea3a4dff946 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 0.637033 Oct 27 19:12:12.689994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-78ae0436-02a5-490e-bc38-b06411b60666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:12.703852 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2555/5294] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:12 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:12.712742 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-78ae0436-02a5-490e-bc38-b06411b60666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1487 microversion: 2.1 time: 0.420223 Oct 27 19:12:12.712742 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2740/5295] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:12 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1487 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:12.716590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-65944711-66d3-4176-a73f-e7634f3baf1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:12.717456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-65944711-66d3-4176-a73f-e7634f3baf1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:12.724215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65944711-66d3-4176-a73f-e7634f3baf1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:12.725019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65944711-66d3-4176-a73f-e7634f3baf1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:12.725707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65944711-66d3-4176-a73f-e7634f3baf1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:12.726672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65944711-66d3-4176-a73f-e7634f3baf1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:12.727353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65944711-66d3-4176-a73f-e7634f3baf1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:12.728005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65944711-66d3-4176-a73f-e7634f3baf1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:12.739512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f9f5cf47-5abd-479b-b3b5-f48dfaf9fc17 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:12.740758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f9f5cf47-5abd-479b-b3b5-f48dfaf9fc17 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:12.754255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9f5cf47-5abd-479b-b3b5-f48dfaf9fc17 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:12.757041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9f5cf47-5abd-479b-b3b5-f48dfaf9fc17 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:12.759779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9f5cf47-5abd-479b-b3b5-f48dfaf9fc17 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:12.768672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9f5cf47-5abd-479b-b3b5-f48dfaf9fc17 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:12.769197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9f5cf47-5abd-479b-b3b5-f48dfaf9fc17 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:12.769983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9f5cf47-5abd-479b-b3b5-f48dfaf9fc17 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:12.886051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f9f5cf47-5abd-479b-b3b5-f48dfaf9fc17 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:12:13.013760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-65944711-66d3-4176-a73f-e7634f3baf1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:13.016412 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f9f5cf47-5abd-479b-b3b5-f48dfaf9fc17 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 204 len: 0 microversion: 2.1 time: 0.278835 Oct 27 19:12:13.021729 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2741/5296] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:12:12 2022] DELETE /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:12:13.024788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-65944711-66d3-4176-a73f-e7634f3baf1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:13.032742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a6413f32-6c98-4965-b116-c0528837dfb0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:13.047657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-65944711-66d3-4176-a73f-e7634f3baf1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:13.056004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a6413f32-6c98-4965-b116-c0528837dfb0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:13.074183 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-65944711-66d3-4176-a73f-e7634f3baf1f tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.363045 Oct 27 19:12:13.092818 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2556/5297] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:12 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:13.104099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6413f32-6c98-4965-b116-c0528837dfb0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:13.104838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6413f32-6c98-4965-b116-c0528837dfb0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:13.105404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6413f32-6c98-4965-b116-c0528837dfb0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:13.107558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6413f32-6c98-4965-b116-c0528837dfb0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:13.108656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6413f32-6c98-4965-b116-c0528837dfb0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:13.109673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6413f32-6c98-4965-b116-c0528837dfb0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:13.429965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a6413f32-6c98-4965-b116-c0528837dfb0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:13.448530 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a6413f32-6c98-4965-b116-c0528837dfb0 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1493 microversion: 2.1 time: 0.423670 Oct 27 19:12:13.449762 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2742/5298] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:13 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1493 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:13.720730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-80b86fb4-8e62-48d8-88f1-5984adb30105 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:13.721998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-80b86fb4-8e62-48d8-88f1-5984adb30105 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:13.732162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80b86fb4-8e62-48d8-88f1-5984adb30105 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:13.736708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80b86fb4-8e62-48d8-88f1-5984adb30105 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:13.737361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80b86fb4-8e62-48d8-88f1-5984adb30105 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:13.738348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80b86fb4-8e62-48d8-88f1-5984adb30105 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:13.739109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80b86fb4-8e62-48d8-88f1-5984adb30105 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:13.743746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80b86fb4-8e62-48d8-88f1-5984adb30105 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:14.129418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-591d1a30-867b-47ed-b508-c964d07771e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:14.130245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-591d1a30-867b-47ed-b508-c964d07771e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:14.152958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-591d1a30-867b-47ed-b508-c964d07771e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:14.154974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-591d1a30-867b-47ed-b508-c964d07771e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:14.155641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-591d1a30-867b-47ed-b508-c964d07771e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:14.157007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-591d1a30-867b-47ed-b508-c964d07771e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:14.158942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-591d1a30-867b-47ed-b508-c964d07771e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:14.161173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-591d1a30-867b-47ed-b508-c964d07771e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:14.224382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-80b86fb4-8e62-48d8-88f1-5984adb30105 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:14.240617 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-80b86fb4-8e62-48d8-88f1-5984adb30105 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 0.523599 Oct 27 19:12:14.241322 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2557/5299] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:13 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:14.431789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-591d1a30-867b-47ed-b508-c964d07771e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:14.448557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-591d1a30-867b-47ed-b508-c964d07771e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:14.451184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-591d1a30-867b-47ed-b508-c964d07771e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:14.462878 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-591d1a30-867b-47ed-b508-c964d07771e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.337289 Oct 27 19:12:14.467053 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2743/5300] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:14 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:14.498092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1fa88a40-9488-4300-9a95-f3c83e96e95e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:14.499468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1fa88a40-9488-4300-9a95-f3c83e96e95e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:14.522770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=86 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:14.533099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fa88a40-9488-4300-9a95-f3c83e96e95e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:14.536700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fa88a40-9488-4300-9a95-f3c83e96e95e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:14.539297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fa88a40-9488-4300-9a95-f3c83e96e95e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:14.541333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fa88a40-9488-4300-9a95-f3c83e96e95e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:14.543860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fa88a40-9488-4300-9a95-f3c83e96e95e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:14.547179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1fa88a40-9488-4300-9a95-f3c83e96e95e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:15.216840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1fa88a40-9488-4300-9a95-f3c83e96e95e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:15.240840 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1fa88a40-9488-4300-9a95-f3c83e96e95e tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1493 microversion: 2.1 time: 0.748277 Oct 27 19:12:15.244137 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2558/5301] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:14 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1493 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:15.269124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-10301e31-ebd9-44b5-9c18-f0097ff6f4fc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:15.269727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-10301e31-ebd9-44b5-9c18-f0097ff6f4fc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:15.283131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10301e31-ebd9-44b5-9c18-f0097ff6f4fc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:15.293054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10301e31-ebd9-44b5-9c18-f0097ff6f4fc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:15.294483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10301e31-ebd9-44b5-9c18-f0097ff6f4fc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:15.297351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10301e31-ebd9-44b5-9c18-f0097ff6f4fc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:15.298038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10301e31-ebd9-44b5-9c18-f0097ff6f4fc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:15.298680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10301e31-ebd9-44b5-9c18-f0097ff6f4fc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:15.499485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-292d2290-2b0e-4356-b33e-0278529849e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:15.500177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-292d2290-2b0e-4356-b33e-0278529849e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:15.519376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-292d2290-2b0e-4356-b33e-0278529849e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:15.524170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-292d2290-2b0e-4356-b33e-0278529849e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:15.524766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-292d2290-2b0e-4356-b33e-0278529849e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:15.529855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-292d2290-2b0e-4356-b33e-0278529849e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:15.530440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-292d2290-2b0e-4356-b33e-0278529849e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:15.530961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-292d2290-2b0e-4356-b33e-0278529849e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:15.923475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-10301e31-ebd9-44b5-9c18-f0097ff6f4fc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:15.932998 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-10301e31-ebd9-44b5-9c18-f0097ff6f4fc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1512 microversion: 2.1 time: 0.667774 Oct 27 19:12:15.937490 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2744/5302] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:15 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1512 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:16.267325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fc0ea356-3a39-4c38-b8bb-3510103fc01a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:16.285565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fc0ea356-3a39-4c38-b8bb-3510103fc01a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:16.317568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc0ea356-3a39-4c38-b8bb-3510103fc01a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:16.319336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc0ea356-3a39-4c38-b8bb-3510103fc01a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:16.329070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc0ea356-3a39-4c38-b8bb-3510103fc01a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:16.330021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc0ea356-3a39-4c38-b8bb-3510103fc01a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:16.335059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc0ea356-3a39-4c38-b8bb-3510103fc01a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:16.336190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc0ea356-3a39-4c38-b8bb-3510103fc01a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:16.598350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-292d2290-2b0e-4356-b33e-0278529849e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:16.624815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-292d2290-2b0e-4356-b33e-0278529849e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:16.631578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-292d2290-2b0e-4356-b33e-0278529849e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:16.676810 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-292d2290-2b0e-4356-b33e-0278529849e1 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 1.180534 Oct 27 19:12:16.677548 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2559/5303] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:15 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:16.721820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fc0ea356-3a39-4c38-b8bb-3510103fc01a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:16.736144 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fc0ea356-3a39-4c38-b8bb-3510103fc01a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1493 microversion: 2.1 time: 0.469337 Oct 27 19:12:16.736967 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2745/5304] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:16 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1493 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:16.975190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-845b7485-b421-4fbb-bbbd-6e0a4daea8df tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:16.976315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-845b7485-b421-4fbb-bbbd-6e0a4daea8df tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:16.992412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-845b7485-b421-4fbb-bbbd-6e0a4daea8df tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:16.993312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-845b7485-b421-4fbb-bbbd-6e0a4daea8df tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:16.995113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-845b7485-b421-4fbb-bbbd-6e0a4daea8df tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:16.996328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-845b7485-b421-4fbb-bbbd-6e0a4daea8df tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:16.999130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-845b7485-b421-4fbb-bbbd-6e0a4daea8df tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:16.999862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-845b7485-b421-4fbb-bbbd-6e0a4daea8df tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:17.715636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3ee31177-729d-4a7e-97b9-34a7f2ce53c7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:17.716277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3ee31177-729d-4a7e-97b9-34a7f2ce53c7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:17.736481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ee31177-729d-4a7e-97b9-34a7f2ce53c7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:17.738285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ee31177-729d-4a7e-97b9-34a7f2ce53c7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:17.742371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ee31177-729d-4a7e-97b9-34a7f2ce53c7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:17.744355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ee31177-729d-4a7e-97b9-34a7f2ce53c7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:17.745782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ee31177-729d-4a7e-97b9-34a7f2ce53c7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:17.749909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ee31177-729d-4a7e-97b9-34a7f2ce53c7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:17.910518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-845b7485-b421-4fbb-bbbd-6e0a4daea8df tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:17.922664 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-845b7485-b421-4fbb-bbbd-6e0a4daea8df tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1489 microversion: 2.1 time: 0.952949 Oct 27 19:12:17.924714 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2560/5305] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:16 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1489 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:17.938090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9a50ff46-069e-4a48-9fdc-3419dee3fc13 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:17.939449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9a50ff46-069e-4a48-9fdc-3419dee3fc13 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:17.976887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a50ff46-069e-4a48-9fdc-3419dee3fc13 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:17.978691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a50ff46-069e-4a48-9fdc-3419dee3fc13 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:17.982515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a50ff46-069e-4a48-9fdc-3419dee3fc13 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:17.986489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a50ff46-069e-4a48-9fdc-3419dee3fc13 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:17.987282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a50ff46-069e-4a48-9fdc-3419dee3fc13 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:17.989488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a50ff46-069e-4a48-9fdc-3419dee3fc13 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:18.198810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3ee31177-729d-4a7e-97b9-34a7f2ce53c7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:18.221664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3ee31177-729d-4a7e-97b9-34a7f2ce53c7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:18.223673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3ee31177-729d-4a7e-97b9-34a7f2ce53c7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:18.238465 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3ee31177-729d-4a7e-97b9-34a7f2ce53c7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.529766 Oct 27 19:12:18.240541 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2746/5306] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:17 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:18.249648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e8f2a4c8-e0b9-40a9-85fc-41d47a1be12a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:18.265994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e8f2a4c8-e0b9-40a9-85fc-41d47a1be12a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:18.303190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e8f2a4c8-e0b9-40a9-85fc-41d47a1be12a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:18.311836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e8f2a4c8-e0b9-40a9-85fc-41d47a1be12a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:18.312715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e8f2a4c8-e0b9-40a9-85fc-41d47a1be12a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:18.314828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e8f2a4c8-e0b9-40a9-85fc-41d47a1be12a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:18.317603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e8f2a4c8-e0b9-40a9-85fc-41d47a1be12a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:18.318315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e8f2a4c8-e0b9-40a9-85fc-41d47a1be12a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:18.439235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9a50ff46-069e-4a48-9fdc-3419dee3fc13 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:18.457420 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9a50ff46-069e-4a48-9fdc-3419dee3fc13 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 200 len: 1451 microversion: 2.1 time: 0.527245 Oct 27 19:12:18.459140 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e8f2a4c8-e0b9-40a9-85fc-41d47a1be12a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 200 len: 152 microversion: 2.1 time: 0.213733 Oct 27 19:12:18.459715 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2561/5307] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:17 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 1451 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:18.473011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-487cb571-e944-4c85-83b7-ba48cb4b9f5c req-c6e47921-e9a8-45c1-90b1-61f27045d8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58bbaff-5c5b-4229-9b62-dd5fe437c639", "name": "network-vif-deleted", "tag": "ad59e0a2-c388-4afb-a696-bc2dcad59515"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:18.482217 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2747/5308] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:18 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 152 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:12:18.504611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-48c4544c-e51c-4de2-a23c-f346ee014828 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:18.531952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-487cb571-e944-4c85-83b7-ba48cb4b9f5c req-c6e47921-e9a8-45c1-90b1-61f27045d8f0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:18.534783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-487cb571-e944-4c85-83b7-ba48cb4b9f5c req-c6e47921-e9a8-45c1-90b1-61f27045d8f0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:18.536011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-487cb571-e944-4c85-83b7-ba48cb4b9f5c req-c6e47921-e9a8-45c1-90b1-61f27045d8f0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:18.541395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-48c4544c-e51c-4de2-a23c-f346ee014828 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:18.572796 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-487cb571-e944-4c85-83b7-ba48cb4b9f5c req-c6e47921-e9a8-45c1-90b1-61f27045d8f0 service nova] Creating event network-vif-deleted:ad59e0a2-c388-4afb-a696-bc2dcad59515 for instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 on n-h2-860687-3 Oct 27 19:12:18.591130 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-487cb571-e944-4c85-83b7-ba48cb4b9f5c req-c6e47921-e9a8-45c1-90b1-61f27045d8f0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123344 Oct 27 19:12:18.595678 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2562/5309] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:12:18.609064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48c4544c-e51c-4de2-a23c-f346ee014828 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:18.615447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48c4544c-e51c-4de2-a23c-f346ee014828 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:18.616401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48c4544c-e51c-4de2-a23c-f346ee014828 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:18.617972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48c4544c-e51c-4de2-a23c-f346ee014828 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:18.627904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48c4544c-e51c-4de2-a23c-f346ee014828 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:18.639141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48c4544c-e51c-4de2-a23c-f346ee014828 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:19.287222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-775d189c-ba19-46b9-b136-64d501486089 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:19.287953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-775d189c-ba19-46b9-b136-64d501486089 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:19.330487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-775d189c-ba19-46b9-b136-64d501486089 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:19.331275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-775d189c-ba19-46b9-b136-64d501486089 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:19.331909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-775d189c-ba19-46b9-b136-64d501486089 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:19.332841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-775d189c-ba19-46b9-b136-64d501486089 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:19.333481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-775d189c-ba19-46b9-b136-64d501486089 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:19.344373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-775d189c-ba19-46b9-b136-64d501486089 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:19.455412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-48c4544c-e51c-4de2-a23c-f346ee014828 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:19.465371 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-48c4544c-e51c-4de2-a23c-f346ee014828 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.980346 Oct 27 19:12:19.466240 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2748/5310] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:18 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:19.607890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-775d189c-ba19-46b9-b136-64d501486089 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:19.624407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-775d189c-ba19-46b9-b136-64d501486089 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:19.639397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-775d189c-ba19-46b9-b136-64d501486089 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:19.657776 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-775d189c-ba19-46b9-b136-64d501486089 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.386473 Oct 27 19:12:19.660533 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2563/5311] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:19 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:19.670928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6703df6-3870-409f-a650-966edf0d257f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:19.673097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d6703df6-3870-409f-a650-966edf0d257f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:19.694553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6703df6-3870-409f-a650-966edf0d257f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:19.696962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6703df6-3870-409f-a650-966edf0d257f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:19.698440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6703df6-3870-409f-a650-966edf0d257f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:19.703271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6703df6-3870-409f-a650-966edf0d257f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:19.704020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6703df6-3870-409f-a650-966edf0d257f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:19.706313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6703df6-3870-409f-a650-966edf0d257f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:20.068032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d6703df6-3870-409f-a650-966edf0d257f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:20.081378 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d6703df6-3870-409f-a650-966edf0d257f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.417984 Oct 27 19:12:20.082266 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2564/5312] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:19 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:20.125293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1ffbbf71-01d5-46e5-a3cd-f5f9ac551d97 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:20.126822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1ffbbf71-01d5-46e5-a3cd-f5f9ac551d97 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:20.142056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ffbbf71-01d5-46e5-a3cd-f5f9ac551d97 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:20.143113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ffbbf71-01d5-46e5-a3cd-f5f9ac551d97 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:20.146674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ffbbf71-01d5-46e5-a3cd-f5f9ac551d97 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:20.154082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ffbbf71-01d5-46e5-a3cd-f5f9ac551d97 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:20.155230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ffbbf71-01d5-46e5-a3cd-f5f9ac551d97 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:20.156013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ffbbf71-01d5-46e5-a3cd-f5f9ac551d97 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:20.325551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-10999975-c9fd-4b9f-a880-041988e30aa1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:20.327019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-10999975-c9fd-4b9f-a880-041988e30aa1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:20.349530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10999975-c9fd-4b9f-a880-041988e30aa1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:20.350044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10999975-c9fd-4b9f-a880-041988e30aa1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:20.350625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10999975-c9fd-4b9f-a880-041988e30aa1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:20.351376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10999975-c9fd-4b9f-a880-041988e30aa1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:20.351836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10999975-c9fd-4b9f-a880-041988e30aa1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:20.352277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10999975-c9fd-4b9f-a880-041988e30aa1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:20.388977 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-10999975-c9fd-4b9f-a880-041988e30aa1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-10999975-c9fd-4b9f-a880-041988e30aa1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 HTTP/1.1 Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'd58bbaff-5c5b-4229-9b62-dd5fe437c639'} Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:12:20.390737 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:12:20.395232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:12:20.395232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:12:20.395232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:12:20.395232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:12:20.395232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:12:20.395232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:12:20.395232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:12:20.405090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-10999975-c9fd-4b9f-a880-041988e30aa1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:12:20.406160 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-10999975-c9fd-4b9f-a880-041988e30aa1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 404 len: 111 microversion: 2.1 time: 0.926557 Oct 27 19:12:20.407286 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2749/5313] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:19 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 111 bytes in 929 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:12:20.524232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1ffbbf71-01d5-46e5-a3cd-f5f9ac551d97 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:20.527299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-992354213", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "e7d83c6b-c0c0-42e5-b094-5dc26599221d"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:20.539520 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1ffbbf71-01d5-46e5-a3cd-f5f9ac551d97 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.415744 Oct 27 19:12:20.540804 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2565/5314] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:20 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:20.567782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3bd1b7e2-5b40-4d23-8db8-e8d34321b84d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:20.568690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3bd1b7e2-5b40-4d23-8db8-e8d34321b84d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:20.581195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd1b7e2-5b40-4d23-8db8-e8d34321b84d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:20.582168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd1b7e2-5b40-4d23-8db8-e8d34321b84d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:20.582941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd1b7e2-5b40-4d23-8db8-e8d34321b84d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:20.584158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd1b7e2-5b40-4d23-8db8-e8d34321b84d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:20.587990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd1b7e2-5b40-4d23-8db8-e8d34321b84d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:20.595053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd1b7e2-5b40-4d23-8db8-e8d34321b84d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:20.667486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] validate_networks() for [('e7d83c6b-c0c0-42e5-b094-5dc26599221d', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:12:21.008006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3bd1b7e2-5b40-4d23-8db8-e8d34321b84d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:21.024561 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3bd1b7e2-5b40-4d23-8db8-e8d34321b84d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.460543 Oct 27 19:12:21.027050 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2566/5315] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:20 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:12:21.051711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5991cb9d-5a0e-4b37-afe8-9a1712884ff7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:21.052683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5991cb9d-5a0e-4b37-afe8-9a1712884ff7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:21.060769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5991cb9d-5a0e-4b37-afe8-9a1712884ff7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:21.061877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5991cb9d-5a0e-4b37-afe8-9a1712884ff7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:21.062755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5991cb9d-5a0e-4b37-afe8-9a1712884ff7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:21.063795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5991cb9d-5a0e-4b37-afe8-9a1712884ff7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:21.065552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5991cb9d-5a0e-4b37-afe8-9a1712884ff7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:21.066287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5991cb9d-5a0e-4b37-afe8-9a1712884ff7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:21.322440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5991cb9d-5a0e-4b37-afe8-9a1712884ff7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:21.336897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5991cb9d-5a0e-4b37-afe8-9a1712884ff7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:21.358154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5991cb9d-5a0e-4b37-afe8-9a1712884ff7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:21.387716 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5991cb9d-5a0e-4b37-afe8-9a1712884ff7 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.358360 Oct 27 19:12:21.388764 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2567/5316] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:21 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:21.401581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-99033172", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "e58f16a0-9265-4d79-a24b-f3342cfd8059"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:21.514933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] validate_networks() for [('e58f16a0-9265-4d79-a24b-f3342cfd8059', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:12:22.601354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:12:22.603267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:12:22.606488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:12:22.607575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:12:22.608025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:12:22.630574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:22.634765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:22.635581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:22.636694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:22.639692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:22.643516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:22.694883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Getting quotas for project 1798d878b8344ec69c9ef0699467718a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:12:22.711769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Getting quotas for user b2237837d17c43e99f4e9961cd27cbb5 and project 1798d878b8344ec69c9ef0699467718a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:12:22.755849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:12:22.764553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:12:22.844092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:12:22.844528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:12:22.845028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:12:22.845454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:12:22.846459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:12:22.876417 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-91a4db3e-1d0c-45df-a8a2-c2dc35ae348c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.355791 Oct 27 19:12:22.877720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:22.879493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:22.880141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:22.881140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:22.884786 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2750/5317] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:12:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:12:22.886573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:22.887126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:22.906779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a1985e2d-c1b0-49a2-a4d3-a9fd07469479 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:22.907357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a1985e2d-c1b0-49a2-a4d3-a9fd07469479 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:22.936550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1985e2d-c1b0-49a2-a4d3-a9fd07469479 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:22.937050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1985e2d-c1b0-49a2-a4d3-a9fd07469479 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:22.937496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1985e2d-c1b0-49a2-a4d3-a9fd07469479 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:22.938208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1985e2d-c1b0-49a2-a4d3-a9fd07469479 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:22.938690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1985e2d-c1b0-49a2-a4d3-a9fd07469479 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:22.939124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1985e2d-c1b0-49a2-a4d3-a9fd07469479 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:22.981064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Getting quotas for project 79c27f02ea6549bea54242ab81741f97. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:12:23.000930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Getting quotas for user 7019e4c367c0470f95bc66e32def747a and project 79c27f02ea6549bea54242ab81741f97. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:12:23.051593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:12:23.053885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:12:23.178040 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4e305a97-1701-457b-b4ea-0908c402a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.786381 Oct 27 19:12:23.179284 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2568/5318] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:12:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:12:23.185012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1d16ce95-a86d-400f-9207-f3464c0b2675 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:23.185886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1d16ce95-a86d-400f-9207-f3464c0b2675 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:23.193455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1985e2d-c1b0-49a2-a4d3-a9fd07469479 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:23.211673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1985e2d-c1b0-49a2-a4d3-a9fd07469479 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:23.221345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1985e2d-c1b0-49a2-a4d3-a9fd07469479 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:23.242953 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a1985e2d-c1b0-49a2-a4d3-a9fd07469479 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.354557 Oct 27 19:12:23.248096 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2751/5319] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:22 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:23.260968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-88efc7c6-7437-4910-8a23-b8b6f2585524 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:23.264425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-88efc7c6-7437-4910-8a23-b8b6f2585524 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:23.299768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1d16ce95-a86d-400f-9207-f3464c0b2675 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:23.327342 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1d16ce95-a86d-400f-9207-f3464c0b2675 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1214 microversion: 2.1 time: 0.138953 Oct 27 19:12:23.331669 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2569/5320] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:23 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:23.497900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-88efc7c6-7437-4910-8a23-b8b6f2585524 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:23.506283 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-88efc7c6-7437-4910-8a23-b8b6f2585524 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1213 microversion: 2.1 time: 0.256623 Oct 27 19:12:23.516526 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2752/5321] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:23 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1213 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:24.293847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-abaf514b-4515-429e-bc85-3d4ea405c6b2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:24.295606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-abaf514b-4515-429e-bc85-3d4ea405c6b2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:24.323644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abaf514b-4515-429e-bc85-3d4ea405c6b2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:24.325262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abaf514b-4515-429e-bc85-3d4ea405c6b2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:24.326506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abaf514b-4515-429e-bc85-3d4ea405c6b2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:24.327928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abaf514b-4515-429e-bc85-3d4ea405c6b2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:24.330064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abaf514b-4515-429e-bc85-3d4ea405c6b2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:24.331519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abaf514b-4515-429e-bc85-3d4ea405c6b2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:24.353037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-88f3f516-3e25-41c7-8c6e-097d74195053 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:24.353927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-88f3f516-3e25-41c7-8c6e-097d74195053 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:24.380050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88f3f516-3e25-41c7-8c6e-097d74195053 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:24.380917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88f3f516-3e25-41c7-8c6e-097d74195053 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:24.384238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88f3f516-3e25-41c7-8c6e-097d74195053 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:24.387961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88f3f516-3e25-41c7-8c6e-097d74195053 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:24.397399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88f3f516-3e25-41c7-8c6e-097d74195053 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:24.398204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88f3f516-3e25-41c7-8c6e-097d74195053 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:24.405882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:24.535571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-abaf514b-4515-429e-bc85-3d4ea405c6b2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:24.549836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-abaf514b-4515-429e-bc85-3d4ea405c6b2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:24.558002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-abaf514b-4515-429e-bc85-3d4ea405c6b2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:24.574027 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-abaf514b-4515-429e-bc85-3d4ea405c6b2 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.290385 Oct 27 19:12:24.579271 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2570/5322] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:24 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:24.584156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6a320fec-e1de-4703-a74b-28a6473c2c55 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:24.589488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6a320fec-e1de-4703-a74b-28a6473c2c55 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:24.604344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a320fec-e1de-4703-a74b-28a6473c2c55 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:24.609352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a320fec-e1de-4703-a74b-28a6473c2c55 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:24.609966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a320fec-e1de-4703-a74b-28a6473c2c55 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:24.611109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a320fec-e1de-4703-a74b-28a6473c2c55 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:24.611801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a320fec-e1de-4703-a74b-28a6473c2c55 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:24.612525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a320fec-e1de-4703-a74b-28a6473c2c55 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:24.766077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6a320fec-e1de-4703-a74b-28a6473c2c55 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:24.778745 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6a320fec-e1de-4703-a74b-28a6473c2c55 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1209 microversion: 2.1 time: 0.197685 Oct 27 19:12:24.785079 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2571/5323] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:24 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1209 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:24.932523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-88f3f516-3e25-41c7-8c6e-097d74195053 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:24.942880 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-88f3f516-3e25-41c7-8c6e-097d74195053 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1210 microversion: 2.1 time: 0.593671 Oct 27 19:12:24.943462 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2753/5324] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:24 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1210 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:12:25.615099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4523bf52-651f-446d-9241-79e715a7568e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:25.615786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4523bf52-651f-446d-9241-79e715a7568e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:25.664927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4523bf52-651f-446d-9241-79e715a7568e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:25.669722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4523bf52-651f-446d-9241-79e715a7568e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:25.670314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4523bf52-651f-446d-9241-79e715a7568e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:25.675591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4523bf52-651f-446d-9241-79e715a7568e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:25.676105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4523bf52-651f-446d-9241-79e715a7568e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:25.676556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4523bf52-651f-446d-9241-79e715a7568e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:25.809666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d681965e-5c1e-448d-9fa0-825dc67130e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:25.810376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d681965e-5c1e-448d-9fa0-825dc67130e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:25.834416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d681965e-5c1e-448d-9fa0-825dc67130e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:25.842809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d681965e-5c1e-448d-9fa0-825dc67130e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:25.843675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d681965e-5c1e-448d-9fa0-825dc67130e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:25.846094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d681965e-5c1e-448d-9fa0-825dc67130e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:25.848110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d681965e-5c1e-448d-9fa0-825dc67130e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:25.850036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d681965e-5c1e-448d-9fa0-825dc67130e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:25.946435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4523bf52-651f-446d-9241-79e715a7568e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:25.978745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4523bf52-651f-446d-9241-79e715a7568e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:25.983658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4523bf52-651f-446d-9241-79e715a7568e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:26.021030 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4523bf52-651f-446d-9241-79e715a7568e tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.411363 Oct 27 19:12:26.022933 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2572/5325] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:25 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:26.050060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eebbc891-e7f2-40f4-b995-9095905cb000 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:26.056705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eebbc891-e7f2-40f4-b995-9095905cb000 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:26.078873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eebbc891-e7f2-40f4-b995-9095905cb000 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:26.079681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eebbc891-e7f2-40f4-b995-9095905cb000 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:26.080314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eebbc891-e7f2-40f4-b995-9095905cb000 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:26.081426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eebbc891-e7f2-40f4-b995-9095905cb000 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:26.082531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eebbc891-e7f2-40f4-b995-9095905cb000 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:26.083524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eebbc891-e7f2-40f4-b995-9095905cb000 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:26.087722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:26.452343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d681965e-5c1e-448d-9fa0-825dc67130e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:26.471223 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d681965e-5c1e-448d-9fa0-825dc67130e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1271 microversion: 2.1 time: 0.666864 Oct 27 19:12:26.474589 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2754/5326] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:25 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1271 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:26.604245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-eebbc891-e7f2-40f4-b995-9095905cb000 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:26.616559 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eebbc891-e7f2-40f4-b995-9095905cb000 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1274 microversion: 2.1 time: 0.592493 Oct 27 19:12:26.637576 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2573/5327] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:26 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1274 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:27.051876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-28991920-bc95-47e6-ba4f-c05b18744c4a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:27.052575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-28991920-bc95-47e6-ba4f-c05b18744c4a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:27.061265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28991920-bc95-47e6-ba4f-c05b18744c4a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:27.068545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28991920-bc95-47e6-ba4f-c05b18744c4a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:27.075674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28991920-bc95-47e6-ba4f-c05b18744c4a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:27.076737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28991920-bc95-47e6-ba4f-c05b18744c4a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:27.085651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28991920-bc95-47e6-ba4f-c05b18744c4a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:27.086506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-28991920-bc95-47e6-ba4f-c05b18744c4a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:27.366301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-28991920-bc95-47e6-ba4f-c05b18744c4a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:27.384066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-28991920-bc95-47e6-ba4f-c05b18744c4a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:27.385811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-28991920-bc95-47e6-ba4f-c05b18744c4a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:27.394024 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-28991920-bc95-47e6-ba4f-c05b18744c4a tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1544 microversion: 2.91 time: 0.346271 Oct 27 19:12:27.419873 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2755/5328] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:27 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1544 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:27.503699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00e3156e-9cdc-4833-8d3b-b2d73eabaa5f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:27.504657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-00e3156e-9cdc-4833-8d3b-b2d73eabaa5f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:27.517276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00e3156e-9cdc-4833-8d3b-b2d73eabaa5f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:27.519017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00e3156e-9cdc-4833-8d3b-b2d73eabaa5f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:27.519717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00e3156e-9cdc-4833-8d3b-b2d73eabaa5f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:27.525946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00e3156e-9cdc-4833-8d3b-b2d73eabaa5f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:27.526680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00e3156e-9cdc-4833-8d3b-b2d73eabaa5f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:27.528109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00e3156e-9cdc-4833-8d3b-b2d73eabaa5f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:27.644356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-303c88c0-a4e8-4638-beb1-dc77992d0962 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:27.645322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-303c88c0-a4e8-4638-beb1-dc77992d0962 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:27.665322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-303c88c0-a4e8-4638-beb1-dc77992d0962 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:27.666863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-303c88c0-a4e8-4638-beb1-dc77992d0962 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:27.667658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-303c88c0-a4e8-4638-beb1-dc77992d0962 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:27.670286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-303c88c0-a4e8-4638-beb1-dc77992d0962 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:27.672035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-303c88c0-a4e8-4638-beb1-dc77992d0962 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:27.677417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-303c88c0-a4e8-4638-beb1-dc77992d0962 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:27.772489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-00e3156e-9cdc-4833-8d3b-b2d73eabaa5f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:27.798164 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-00e3156e-9cdc-4833-8d3b-b2d73eabaa5f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1271 microversion: 2.1 time: 0.293276 Oct 27 19:12:27.802172 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2574/5329] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:27 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1271 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:28.041743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-303c88c0-a4e8-4638-beb1-dc77992d0962 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:28.068009 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-303c88c0-a4e8-4638-beb1-dc77992d0962 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1272 microversion: 2.1 time: 0.428008 Oct 27 19:12:28.073287 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2756/5330] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:27 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1272 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:28.440324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2c7e3d84-d816-45e0-b68e-39a3fa32d332 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:28.441142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2c7e3d84-d816-45e0-b68e-39a3fa32d332 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:28.461854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c7e3d84-d816-45e0-b68e-39a3fa32d332 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:28.466790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c7e3d84-d816-45e0-b68e-39a3fa32d332 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:28.473766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c7e3d84-d816-45e0-b68e-39a3fa32d332 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:28.477960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c7e3d84-d816-45e0-b68e-39a3fa32d332 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:28.479471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c7e3d84-d816-45e0-b68e-39a3fa32d332 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:28.482247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c7e3d84-d816-45e0-b68e-39a3fa32d332 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:28.845222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d040dd34-2dd5-4f7f-874d-d3c69b819852 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:28.846295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d040dd34-2dd5-4f7f-874d-d3c69b819852 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:28.859188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d040dd34-2dd5-4f7f-874d-d3c69b819852 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:28.859880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d040dd34-2dd5-4f7f-874d-d3c69b819852 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:28.860680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d040dd34-2dd5-4f7f-874d-d3c69b819852 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:28.861545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d040dd34-2dd5-4f7f-874d-d3c69b819852 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:28.862297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d040dd34-2dd5-4f7f-874d-d3c69b819852 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:28.864304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d040dd34-2dd5-4f7f-874d-d3c69b819852 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:29.135751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2c7e3d84-d816-45e0-b68e-39a3fa32d332 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:29.149490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2c7e3d84-d816-45e0-b68e-39a3fa32d332 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:29.157352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2c7e3d84-d816-45e0-b68e-39a3fa32d332 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:29.168658 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2c7e3d84-d816-45e0-b68e-39a3fa32d332 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1531 microversion: 2.91 time: 0.732510 Oct 27 19:12:29.187736 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2575/5331] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:28 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1531 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:29.209647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e5635f71-4480-4329-ae96-20f14f94b022 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:29.213964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e5635f71-4480-4329-ae96-20f14f94b022 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:29.231870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5635f71-4480-4329-ae96-20f14f94b022 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:29.232673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5635f71-4480-4329-ae96-20f14f94b022 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:29.233608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5635f71-4480-4329-ae96-20f14f94b022 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:29.238572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5635f71-4480-4329-ae96-20f14f94b022 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:29.239476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5635f71-4480-4329-ae96-20f14f94b022 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:29.240159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5635f71-4480-4329-ae96-20f14f94b022 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:29.434827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e5635f71-4480-4329-ae96-20f14f94b022 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:29.453736 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e5635f71-4480-4329-ae96-20f14f94b022 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1272 microversion: 2.1 time: 0.264358 Oct 27 19:12:29.458769 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2576/5332] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:29 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:29.478907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a8af4e4c-df90-447f-a695-aeb2466ecc28 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:29.485559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a8af4e4c-df90-447f-a695-aeb2466ecc28 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:29.507959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8af4e4c-df90-447f-a695-aeb2466ecc28 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:29.508476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8af4e4c-df90-447f-a695-aeb2466ecc28 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:29.508932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8af4e4c-df90-447f-a695-aeb2466ecc28 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:29.509666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8af4e4c-df90-447f-a695-aeb2466ecc28 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:29.510122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8af4e4c-df90-447f-a695-aeb2466ecc28 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:29.522146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8af4e4c-df90-447f-a695-aeb2466ecc28 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:30.066367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-a8af4e4c-df90-447f-a695-aeb2466ecc28 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] Lazy-loading 'services' on Instance uuid 29737b20-81b1-443b-9b80-e9ca92bbfdad {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:12:30.112167 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a8af4e4c-df90-447f-a695-aeb2466ecc28 tempest-UnshelveToHostMultiNodesTest-925620359 tempest-UnshelveToHostMultiNodesTest-925620359-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1936 microversion: 2.91 time: 0.651935 Oct 27 19:12:30.113026 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2577/5333] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:29 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1936 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:30.186118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7ad8752-4b03-4fa0-aa05-ad7628e62992 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:30.187479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7ad8752-4b03-4fa0-aa05-ad7628e62992 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:30.196997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d040dd34-2dd5-4f7f-874d-d3c69b819852 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:30.204575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7ad8752-4b03-4fa0-aa05-ad7628e62992 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:30.205492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7ad8752-4b03-4fa0-aa05-ad7628e62992 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:30.207013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7ad8752-4b03-4fa0-aa05-ad7628e62992 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:30.211571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7ad8752-4b03-4fa0-aa05-ad7628e62992 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:30.213195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7ad8752-4b03-4fa0-aa05-ad7628e62992 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:30.213892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7ad8752-4b03-4fa0-aa05-ad7628e62992 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:30.218940 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d040dd34-2dd5-4f7f-874d-d3c69b819852 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1313 microversion: 2.1 time: 1.368442 Oct 27 19:12:30.219644 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2757/5334] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:28 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1313 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:12:30.278252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7ad8752-4b03-4fa0-aa05-ad7628e62992 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:12:30.487255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-57b723db-5500-48f7-bcdd-17afb934d7c8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:30.488262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-57b723db-5500-48f7-bcdd-17afb934d7c8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:30.505202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57b723db-5500-48f7-bcdd-17afb934d7c8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:30.505802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57b723db-5500-48f7-bcdd-17afb934d7c8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:30.509670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57b723db-5500-48f7-bcdd-17afb934d7c8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:30.515112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57b723db-5500-48f7-bcdd-17afb934d7c8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:30.515936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57b723db-5500-48f7-bcdd-17afb934d7c8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:30.516738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57b723db-5500-48f7-bcdd-17afb934d7c8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:30.536856 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7ad8752-4b03-4fa0-aa05-ad7628e62992 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "DELETE /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 204 len: 0 microversion: 2.91 time: 0.351537 Oct 27 19:12:30.538079 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2578/5335] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 19:12:30 2022] DELETE /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:12:30.554218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a636b6a7-6f12-433f-9d8f-03d74fb59769 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:30.568666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a636b6a7-6f12-433f-9d8f-03d74fb59769 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:30.603494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a636b6a7-6f12-433f-9d8f-03d74fb59769 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:30.604107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a636b6a7-6f12-433f-9d8f-03d74fb59769 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:30.604665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a636b6a7-6f12-433f-9d8f-03d74fb59769 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:30.605804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a636b6a7-6f12-433f-9d8f-03d74fb59769 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:30.607144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a636b6a7-6f12-433f-9d8f-03d74fb59769 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:30.610128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a636b6a7-6f12-433f-9d8f-03d74fb59769 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:31.024680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a636b6a7-6f12-433f-9d8f-03d74fb59769 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:31.049235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a636b6a7-6f12-433f-9d8f-03d74fb59769 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:31.058813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a636b6a7-6f12-433f-9d8f-03d74fb59769 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:31.079476 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a636b6a7-6f12-433f-9d8f-03d74fb59769 tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.537069 Oct 27 19:12:31.105987 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2579/5336] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:30 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:12:31.116699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-fbae5efb-e687-4b99-90b7-e95b8272bac8 req-d6a96ebd-6933-44dd-ad0e-ab86d88771cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c66127-ad48-4068-a9c0-24c408a29e70", "tag": "77f82e77-74a2-4c75-943c-33cc366aab68"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:31.155549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fbae5efb-e687-4b99-90b7-e95b8272bac8 req-d6a96ebd-6933-44dd-ad0e-ab86d88771cf service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:31.158965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fbae5efb-e687-4b99-90b7-e95b8272bac8 req-d6a96ebd-6933-44dd-ad0e-ab86d88771cf service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:31.165020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fbae5efb-e687-4b99-90b7-e95b8272bac8 req-d6a96ebd-6933-44dd-ad0e-ab86d88771cf service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:31.190246 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-fbae5efb-e687-4b99-90b7-e95b8272bac8 req-d6a96ebd-6933-44dd-ad0e-ab86d88771cf service nova] Creating event network-changed:77f82e77-74a2-4c75-943c-33cc366aab68 for instance 82c66127-ad48-4068-a9c0-24c408a29e70 on n-h2-860687-3 Oct 27 19:12:31.205813 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-fbae5efb-e687-4b99-90b7-e95b8272bac8 req-d6a96ebd-6933-44dd-ad0e-ab86d88771cf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097864 Oct 27 19:12:31.207326 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2580/5337] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:12:31.259002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70e455ab-2a0f-4e9c-9a7d-2439eaa86c0b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:31.259964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-70e455ab-2a0f-4e9c-9a7d-2439eaa86c0b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:31.271899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70e455ab-2a0f-4e9c-9a7d-2439eaa86c0b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:31.281693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70e455ab-2a0f-4e9c-9a7d-2439eaa86c0b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:31.282474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70e455ab-2a0f-4e9c-9a7d-2439eaa86c0b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:31.283448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70e455ab-2a0f-4e9c-9a7d-2439eaa86c0b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:31.284099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70e455ab-2a0f-4e9c-9a7d-2439eaa86c0b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:31.284725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70e455ab-2a0f-4e9c-9a7d-2439eaa86c0b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:31.567941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-57b723db-5500-48f7-bcdd-17afb934d7c8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:31.586579 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-57b723db-5500-48f7-bcdd-17afb934d7c8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1314 microversion: 2.1 time: 1.102872 Oct 27 19:12:31.587214 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2758/5338] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:30 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1314 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:12:32.112442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8b00379b-f681-41ad-9b67-411d9ac0a42c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:32.113071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8b00379b-f681-41ad-9b67-411d9ac0a42c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:32.125926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b00379b-f681-41ad-9b67-411d9ac0a42c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:32.126472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b00379b-f681-41ad-9b67-411d9ac0a42c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:32.126927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b00379b-f681-41ad-9b67-411d9ac0a42c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:32.127656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b00379b-f681-41ad-9b67-411d9ac0a42c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:32.128133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b00379b-f681-41ad-9b67-411d9ac0a42c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:32.128574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b00379b-f681-41ad-9b67-411d9ac0a42c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:32.282081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-70e455ab-2a0f-4e9c-9a7d-2439eaa86c0b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:32.307359 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70e455ab-2a0f-4e9c-9a7d-2439eaa86c0b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1313 microversion: 2.1 time: 1.055735 Oct 27 19:12:32.307980 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2581/5339] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:31 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1313 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:32.471022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8b00379b-f681-41ad-9b67-411d9ac0a42c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:32.491873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8b00379b-f681-41ad-9b67-411d9ac0a42c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:32.501578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8b00379b-f681-41ad-9b67-411d9ac0a42c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed1b473270d540ba8ae0e27f68e65827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bac9dc6eec4e44abd820c2a8fad0ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:32.516193 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8b00379b-f681-41ad-9b67-411d9ac0a42c tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 200 len: 1537 microversion: 2.91 time: 0.405357 Oct 27 19:12:32.518714 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2759/5340] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:32 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 1537 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:12:32.615967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f3cac844-07bf-4217-8705-1ca40ed53e64 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:32.616784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f3cac844-07bf-4217-8705-1ca40ed53e64 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:32.634365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3cac844-07bf-4217-8705-1ca40ed53e64 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:32.637654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3cac844-07bf-4217-8705-1ca40ed53e64 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:32.639441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3cac844-07bf-4217-8705-1ca40ed53e64 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:32.640432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3cac844-07bf-4217-8705-1ca40ed53e64 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:32.643557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3cac844-07bf-4217-8705-1ca40ed53e64 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:32.647156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3cac844-07bf-4217-8705-1ca40ed53e64 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:32.929415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:33.036645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f3cac844-07bf-4217-8705-1ca40ed53e64 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:33.054163 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f3cac844-07bf-4217-8705-1ca40ed53e64 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1314 microversion: 2.1 time: 0.443111 Oct 27 19:12:33.063988 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2582/5341] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:32 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:33.333976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3022f78b-1241-49b4-a067-9189517b9a4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:33.334835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3022f78b-1241-49b4-a067-9189517b9a4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:33.344554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:33.363526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3022f78b-1241-49b4-a067-9189517b9a4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:33.367784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3022f78b-1241-49b4-a067-9189517b9a4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:33.369319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3022f78b-1241-49b4-a067-9189517b9a4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:33.371810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3022f78b-1241-49b4-a067-9189517b9a4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:33.376918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3022f78b-1241-49b4-a067-9189517b9a4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:33.378276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3022f78b-1241-49b4-a067-9189517b9a4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:33.502272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:33.550018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e69b8018-dc0e-4a47-9d24-abbacab48b7b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:33.551217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e69b8018-dc0e-4a47-9d24-abbacab48b7b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] [instance: 29737b20-81b1-443b-9b80-e9ca92bbfdad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:33.581912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:33.584720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e69b8018-dc0e-4a47-9d24-abbacab48b7b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:33.585484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e69b8018-dc0e-4a47-9d24-abbacab48b7b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:33.586186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e69b8018-dc0e-4a47-9d24-abbacab48b7b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:33.587202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e69b8018-dc0e-4a47-9d24-abbacab48b7b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:33.587873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e69b8018-dc0e-4a47-9d24-abbacab48b7b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:33.588511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e69b8018-dc0e-4a47-9d24-abbacab48b7b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:33.626454 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-e69b8018-dc0e-4a47-9d24-abbacab48b7b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] HTTP exception thrown: Instance 29737b20-81b1-443b-9b80-e9ca92bbfdad could not be found. Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e69b8018-dc0e-4a47-9d24-abbacab48b7b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Request method failure captured: Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad HTTP/1.1 Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtcxmOU36q5Vf1haK5okEIDYJ10TEO6GaBB3VueRDU37pEHywxlEhoRse5YFkfYvTgfaamynGPZqBYJjXBXx4p5AhGMx2kLNr6gvhTJUgfE2r1QZXe0Wo1RFSfyVBFo4wJteAZwBNKbE_q7NadU-f_PqPRdyE7mwVAiK8c2bWNEcfdg Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.91 Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: c5bac9dc6eec4e44abd820c2a8fad0ab Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-2069491548 Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c5bac9dc6eec4e44abd820c2a8fad0ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c5bac9dc6eec4e44abd820c2a8fad0ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c5bac9dc6eec4e44abd820c2a8fad0ab", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c5bac9dc6eec4e44abd820c2a8fad0ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-2069491548 Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: c5bac9dc6eec4e44abd820c2a8fad0ab Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-2069491548 Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-UnshelveToHostMultiNodesTest-2069491548-project Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ed1b473270d540ba8ae0e27f68e65827 Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-2069491548-project Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 29737b20-81b1-443b-9b80-e9ca92bbfdad could not be found. Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '29737b20-81b1-443b-9b80-e9ca92bbfdad'} Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29737b20-81b1-443b-9b80-e9ca92bbfdad could not be found. Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29737b20-81b1-443b-9b80-e9ca92bbfdad could not be found. Oct 27 19:12:33.630862 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:12:33.634320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:12:33.634320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:12:33.634320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:12:33.634320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:12:33.634320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:12:33.634320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:12:33.634320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:12:33.634320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29737b20-81b1-443b-9b80-e9ca92bbfdad could not be found. Oct 27 19:12:33.634320 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:12:33.647309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e69b8018-dc0e-4a47-9d24-abbacab48b7b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] Returning 404 to user: Instance 29737b20-81b1-443b-9b80-e9ca92bbfdad could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:12:33.648625 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e69b8018-dc0e-4a47-9d24-abbacab48b7b tempest-UnshelveToHostMultiNodesTest-2069491548 tempest-UnshelveToHostMultiNodesTest-2069491548-project] 10.222.0.42 "GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad" status: 404 len: 111 microversion: 2.91 time: 0.104873 Oct 27 19:12:33.649433 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2583/5342] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:12:33 2022] GET /compute/v2.1/servers/29737b20-81b1-443b-9b80-e9ca92bbfdad => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 19:12:34.092998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b62b725e-895c-49ac-9ea8-dadb70be52a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:34.093701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b62b725e-895c-49ac-9ea8-dadb70be52a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:34.120282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62b725e-895c-49ac-9ea8-dadb70be52a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:34.120853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62b725e-895c-49ac-9ea8-dadb70be52a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:34.128592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62b725e-895c-49ac-9ea8-dadb70be52a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:34.133984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62b725e-895c-49ac-9ea8-dadb70be52a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:34.134578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62b725e-895c-49ac-9ea8-dadb70be52a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:34.138218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62b725e-895c-49ac-9ea8-dadb70be52a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:34.261920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3022f78b-1241-49b4-a067-9189517b9a4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:34.276784 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3022f78b-1241-49b4-a067-9189517b9a4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1313 microversion: 2.1 time: 0.943859 Oct 27 19:12:34.296891 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2760/5343] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:33 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1313 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:34.548087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b62b725e-895c-49ac-9ea8-dadb70be52a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:34.563195 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b62b725e-895c-49ac-9ea8-dadb70be52a1 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1314 microversion: 2.1 time: 0.475049 Oct 27 19:12:34.569695 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2584/5344] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:34 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:34.987798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d2f14c63-2fca-4550-a34c-632975464cb4 req-2c727a82-5695-4131-932a-19dd70be6fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "723448de-0c5a-41c2-8bd1-c2125d2749f2", "tag": "655fb786-9399-49c3-9418-c018d3781c52"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:35.025540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d2f14c63-2fca-4550-a34c-632975464cb4 req-2c727a82-5695-4131-932a-19dd70be6fe2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:35.027885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d2f14c63-2fca-4550-a34c-632975464cb4 req-2c727a82-5695-4131-932a-19dd70be6fe2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:35.035634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d2f14c63-2fca-4550-a34c-632975464cb4 req-2c727a82-5695-4131-932a-19dd70be6fe2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:35.080431 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d2f14c63-2fca-4550-a34c-632975464cb4 req-2c727a82-5695-4131-932a-19dd70be6fe2 service nova] Creating event network-changed:655fb786-9399-49c3-9418-c018d3781c52 for instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 on n-h2-860687-3 Oct 27 19:12:35.109722 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d2f14c63-2fca-4550-a34c-632975464cb4 req-2c727a82-5695-4131-932a-19dd70be6fe2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125713 Oct 27 19:12:35.110364 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2761/5345] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:12:35.306530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1da6e405-939f-43ec-8083-9fb212fbefb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:35.307537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1da6e405-939f-43ec-8083-9fb212fbefb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:35.322442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1da6e405-939f-43ec-8083-9fb212fbefb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:35.324959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1da6e405-939f-43ec-8083-9fb212fbefb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:35.325676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1da6e405-939f-43ec-8083-9fb212fbefb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:35.326976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1da6e405-939f-43ec-8083-9fb212fbefb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:35.327948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1da6e405-939f-43ec-8083-9fb212fbefb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:35.328604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1da6e405-939f-43ec-8083-9fb212fbefb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:35.603800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-603e324a-adcb-4017-b385-463a6dc2bc55 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:35.609200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-603e324a-adcb-4017-b385-463a6dc2bc55 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:35.633453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-603e324a-adcb-4017-b385-463a6dc2bc55 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:35.639118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-603e324a-adcb-4017-b385-463a6dc2bc55 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:35.643634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-603e324a-adcb-4017-b385-463a6dc2bc55 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:35.644611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-603e324a-adcb-4017-b385-463a6dc2bc55 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:35.645245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-603e324a-adcb-4017-b385-463a6dc2bc55 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:35.645866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-603e324a-adcb-4017-b385-463a6dc2bc55 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:35.744269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1da6e405-939f-43ec-8083-9fb212fbefb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:35.756489 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1da6e405-939f-43ec-8083-9fb212fbefb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1313 microversion: 2.1 time: 0.455632 Oct 27 19:12:35.757624 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2585/5346] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:35 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:36.247065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-603e324a-adcb-4017-b385-463a6dc2bc55 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:36.266700 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-603e324a-adcb-4017-b385-463a6dc2bc55 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1314 microversion: 2.1 time: 0.673964 Oct 27 19:12:36.271805 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2762/5347] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:35 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:36.783327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2a847ec6-9baf-4ef0-88d1-81a6861e54ac tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:36.784142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2a847ec6-9baf-4ef0-88d1-81a6861e54ac tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:36.797103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a847ec6-9baf-4ef0-88d1-81a6861e54ac tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:36.799926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a847ec6-9baf-4ef0-88d1-81a6861e54ac tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:36.804107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a847ec6-9baf-4ef0-88d1-81a6861e54ac tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:36.805172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a847ec6-9baf-4ef0-88d1-81a6861e54ac tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:36.806106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a847ec6-9baf-4ef0-88d1-81a6861e54ac tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:36.806841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a847ec6-9baf-4ef0-88d1-81a6861e54ac tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:37.210105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2a847ec6-9baf-4ef0-88d1-81a6861e54ac tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:37.224597 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2a847ec6-9baf-4ef0-88d1-81a6861e54ac tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1313 microversion: 2.1 time: 0.447078 Oct 27 19:12:37.225198 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2586/5348] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:36 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:37.295709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9fc41bad-4ee4-423a-af39-5b33d759b6ed tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:37.296955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9fc41bad-4ee4-423a-af39-5b33d759b6ed tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:37.327222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fc41bad-4ee4-423a-af39-5b33d759b6ed tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:37.327740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fc41bad-4ee4-423a-af39-5b33d759b6ed tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:37.328166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fc41bad-4ee4-423a-af39-5b33d759b6ed tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:37.328889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fc41bad-4ee4-423a-af39-5b33d759b6ed tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:37.329348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fc41bad-4ee4-423a-af39-5b33d759b6ed tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:37.329785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fc41bad-4ee4-423a-af39-5b33d759b6ed tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:37.547783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-15f03929-0230-45e5-8c37-54fe6e73ce4e req-75b6f520-6837-45db-a7ef-759ec09ee048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c66127-ad48-4068-a9c0-24c408a29e70", "name": "network-vif-plugged", "status": "completed", "tag": "77f82e77-74a2-4c75-943c-33cc366aab68"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:37.576825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-15f03929-0230-45e5-8c37-54fe6e73ce4e req-75b6f520-6837-45db-a7ef-759ec09ee048 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:37.578102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-15f03929-0230-45e5-8c37-54fe6e73ce4e req-75b6f520-6837-45db-a7ef-759ec09ee048 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:37.580634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-15f03929-0230-45e5-8c37-54fe6e73ce4e req-75b6f520-6837-45db-a7ef-759ec09ee048 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:37.622735 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-15f03929-0230-45e5-8c37-54fe6e73ce4e req-75b6f520-6837-45db-a7ef-759ec09ee048 service nova] Creating event network-vif-plugged:77f82e77-74a2-4c75-943c-33cc366aab68 for instance 82c66127-ad48-4068-a9c0-24c408a29e70 on n-h2-860687-3 Oct 27 19:12:37.633491 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-15f03929-0230-45e5-8c37-54fe6e73ce4e req-75b6f520-6837-45db-a7ef-759ec09ee048 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091624 Oct 27 19:12:37.640343 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2587/5349] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:12:38.257929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-32df3c39-3ff2-4a26-9cd9-87d728a7715b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:38.261269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-32df3c39-3ff2-4a26-9cd9-87d728a7715b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:38.277376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32df3c39-3ff2-4a26-9cd9-87d728a7715b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:38.282981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9fc41bad-4ee4-423a-af39-5b33d759b6ed tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:38.294972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32df3c39-3ff2-4a26-9cd9-87d728a7715b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:38.295475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32df3c39-3ff2-4a26-9cd9-87d728a7715b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:38.298131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32df3c39-3ff2-4a26-9cd9-87d728a7715b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:38.298642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32df3c39-3ff2-4a26-9cd9-87d728a7715b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:38.299859 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9fc41bad-4ee4-423a-af39-5b33d759b6ed tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1314 microversion: 2.1 time: 1.010529 Oct 27 19:12:38.301400 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2763/5350] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:37 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1314 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:38.301518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32df3c39-3ff2-4a26-9cd9-87d728a7715b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:39.063648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-32df3c39-3ff2-4a26-9cd9-87d728a7715b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:39.083151 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-32df3c39-3ff2-4a26-9cd9-87d728a7715b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1313 microversion: 2.1 time: 0.835903 Oct 27 19:12:39.084638 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2588/5351] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:38 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1313 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:12:39.324918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c47ec106-3997-46a7-8ec2-0cacd40b8388 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:39.326179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c47ec106-3997-46a7-8ec2-0cacd40b8388 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:39.341457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47ec106-3997-46a7-8ec2-0cacd40b8388 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:39.341992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47ec106-3997-46a7-8ec2-0cacd40b8388 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:39.347543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47ec106-3997-46a7-8ec2-0cacd40b8388 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:39.350137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47ec106-3997-46a7-8ec2-0cacd40b8388 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:39.350697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47ec106-3997-46a7-8ec2-0cacd40b8388 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:39.352426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47ec106-3997-46a7-8ec2-0cacd40b8388 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:40.109841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1a6eea53-4a7e-4945-9c57-b076c24132cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:40.110835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1a6eea53-4a7e-4945-9c57-b076c24132cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:40.122499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:40.130400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a6eea53-4a7e-4945-9c57-b076c24132cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:40.137278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a6eea53-4a7e-4945-9c57-b076c24132cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:40.137938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a6eea53-4a7e-4945-9c57-b076c24132cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:40.138808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a6eea53-4a7e-4945-9c57-b076c24132cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:40.139305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a6eea53-4a7e-4945-9c57-b076c24132cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:40.139751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a6eea53-4a7e-4945-9c57-b076c24132cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:40.554903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c47ec106-3997-46a7-8ec2-0cacd40b8388 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:40.568029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1a6eea53-4a7e-4945-9c57-b076c24132cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:40.570961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:40.588042 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1a6eea53-4a7e-4945-9c57-b076c24132cc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1313 microversion: 2.1 time: 0.481272 Oct 27 19:12:40.593961 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2589/5352] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:40 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:12:40.623988 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c47ec106-3997-46a7-8ec2-0cacd40b8388 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1314 microversion: 2.1 time: 1.303856 Oct 27 19:12:40.635847 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2764/5353] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:39 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1314 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:41.626800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5bd59aea-84ba-4352-ae72-96a39b171540 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:41.627434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5bd59aea-84ba-4352-ae72-96a39b171540 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:41.641975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bd59aea-84ba-4352-ae72-96a39b171540 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:41.642576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bd59aea-84ba-4352-ae72-96a39b171540 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:41.643317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bd59aea-84ba-4352-ae72-96a39b171540 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:41.644064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bd59aea-84ba-4352-ae72-96a39b171540 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:41.645556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bd59aea-84ba-4352-ae72-96a39b171540 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:41.646003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bd59aea-84ba-4352-ae72-96a39b171540 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:41.664483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-26781318-a672-4715-abf0-831f76b88316 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:41.665150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-26781318-a672-4715-abf0-831f76b88316 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:41.685936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:41.702280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26781318-a672-4715-abf0-831f76b88316 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:41.702928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26781318-a672-4715-abf0-831f76b88316 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:41.703389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26781318-a672-4715-abf0-831f76b88316 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:41.711785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26781318-a672-4715-abf0-831f76b88316 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:41.714399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26781318-a672-4715-abf0-831f76b88316 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:41.719778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26781318-a672-4715-abf0-831f76b88316 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:42.421354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-26781318-a672-4715-abf0-831f76b88316 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:42.431485 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-26781318-a672-4715-abf0-831f76b88316 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1314 microversion: 2.1 time: 0.771668 Oct 27 19:12:42.437410 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2765/5354] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:41 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:12:42.833025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5bd59aea-84ba-4352-ae72-96a39b171540 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:42.844479 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5bd59aea-84ba-4352-ae72-96a39b171540 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1499 microversion: 2.1 time: 1.228909 Oct 27 19:12:42.846635 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2590/5355] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:41 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1499 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:42.877159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6305c6cf-06be-4f68-b09a-51344dc179e9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:42.879507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6305c6cf-06be-4f68-b09a-51344dc179e9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:42.894686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6305c6cf-06be-4f68-b09a-51344dc179e9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:42.895623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6305c6cf-06be-4f68-b09a-51344dc179e9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:42.896087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6305c6cf-06be-4f68-b09a-51344dc179e9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:42.896827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6305c6cf-06be-4f68-b09a-51344dc179e9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:42.899610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6305c6cf-06be-4f68-b09a-51344dc179e9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:42.900776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6305c6cf-06be-4f68-b09a-51344dc179e9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:42.991925 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6305c6cf-06be-4f68-b09a-51344dc179e9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action" status: 200 len: 14 microversion: 2.1 time: 0.117782 Oct 27 19:12:42.996441 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2591/5356] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:42 2022] POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 19:12:43.224730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b31f8d24-55b0-4d97-ae59-50fc49663262 tempest-ListImagesTestJSON-2046380320 tempest-ListImagesTestJSON-2046380320-project] Calling method '.version_select at 0x7fc86b409ca0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:43.326971 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b31f8d24-55b0-4d97-ae59-50fc49663262 tempest-ListImagesTestJSON-2046380320 tempest-ListImagesTestJSON-2046380320-project] 10.222.0.42 "GET /compute/v2.1/images/77589569-9b6a-4afc-8af7-7a43ef9ebc00" status: 200 len: 784 microversion: 2.1 time: 0.887260 Oct 27 19:12:43.332037 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2766/5357] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Oct 27 19:12:42 2022] GET /compute/v2.1/images/77589569-9b6a-4afc-8af7-7a43ef9ebc00 => generated 784 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:12:43.350350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-809bc5d7-0c91-47a7-8723-f6f650ee5ae3 tempest-ListImagesTestJSON-2046380320 tempest-ListImagesTestJSON-2046380320-project] Calling method '.version_select at 0x7fc86ae513a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:43.445722 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-809bc5d7-0c91-47a7-8723-f6f650ee5ae3 tempest-ListImagesTestJSON-2046380320 tempest-ListImagesTestJSON-2046380320-project] 10.222.0.42 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.100568 Oct 27 19:12:43.446757 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2592/5358] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Oct 27 19:12:43 2022] GET /compute/v2.1/images => generated 445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:12:43.459227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-10da9815-243d-4f15-84e7-39087bb496f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:43.460220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-10da9815-243d-4f15-84e7-39087bb496f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:43.470932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10da9815-243d-4f15-84e7-39087bb496f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:43.479713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd8ae835-d079-4550-937e-fe626aae501c tempest-ListImagesTestJSON-2046380320 tempest-ListImagesTestJSON-2046380320-project] Calling method '.version_select at 0x7fc873205e50>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:43.480794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10da9815-243d-4f15-84e7-39087bb496f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:43.491504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10da9815-243d-4f15-84e7-39087bb496f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:43.492031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10da9815-243d-4f15-84e7-39087bb496f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:43.495111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10da9815-243d-4f15-84e7-39087bb496f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:43.495849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10da9815-243d-4f15-84e7-39087bb496f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:43.614916 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dd8ae835-d079-4550-937e-fe626aae501c tempest-ListImagesTestJSON-2046380320 tempest-ListImagesTestJSON-2046380320-project] 10.222.0.42 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.149403 Oct 27 19:12:43.616141 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2593/5359] 10.222.0.42 () {58 vars in 1143 bytes} [Thu Oct 27 19:12:43 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:12:44.013659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-87a6357e-4cea-48c4-8d83-04a4f53ed59f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:44.026291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-87a6357e-4cea-48c4-8d83-04a4f53ed59f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:44.075241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87a6357e-4cea-48c4-8d83-04a4f53ed59f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:44.075879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87a6357e-4cea-48c4-8d83-04a4f53ed59f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:44.076342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87a6357e-4cea-48c4-8d83-04a4f53ed59f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:44.083716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87a6357e-4cea-48c4-8d83-04a4f53ed59f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:44.084226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87a6357e-4cea-48c4-8d83-04a4f53ed59f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:44.084688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87a6357e-4cea-48c4-8d83-04a4f53ed59f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:44.163903 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-87a6357e-4cea-48c4-8d83-04a4f53ed59f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action" status: 200 len: 14 microversion: 2.1 time: 0.158592 Oct 27 19:12:44.171394 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2594/5360] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:44 2022] POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 19:12:44.220574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-10da9815-243d-4f15-84e7-39087bb496f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:44.237159 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-10da9815-243d-4f15-84e7-39087bb496f3 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1314 microversion: 2.1 time: 0.781899 Oct 27 19:12:44.241824 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2767/5361] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:43 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:45.184367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6f138753-2231-4e5a-a7ee-9b0258f06ddf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:45.186776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6f138753-2231-4e5a-a7ee-9b0258f06ddf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:45.214573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f138753-2231-4e5a-a7ee-9b0258f06ddf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:45.215727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f138753-2231-4e5a-a7ee-9b0258f06ddf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:45.216203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f138753-2231-4e5a-a7ee-9b0258f06ddf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:45.219193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f138753-2231-4e5a-a7ee-9b0258f06ddf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:45.219741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f138753-2231-4e5a-a7ee-9b0258f06ddf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:45.220198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f138753-2231-4e5a-a7ee-9b0258f06ddf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:45.269972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cab4cdd1-eb61-4bf2-ad14-c9c670fa16b4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:45.270701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cab4cdd1-eb61-4bf2-ad14-c9c670fa16b4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:45.294475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cab4cdd1-eb61-4bf2-ad14-c9c670fa16b4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:45.298211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cab4cdd1-eb61-4bf2-ad14-c9c670fa16b4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:45.298705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cab4cdd1-eb61-4bf2-ad14-c9c670fa16b4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:45.299806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cab4cdd1-eb61-4bf2-ad14-c9c670fa16b4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:45.306908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cab4cdd1-eb61-4bf2-ad14-c9c670fa16b4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:45.311294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cab4cdd1-eb61-4bf2-ad14-c9c670fa16b4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:45.405819 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6f138753-2231-4e5a-a7ee-9b0258f06ddf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action" status: 200 len: 14 microversion: 2.1 time: 0.226537 Oct 27 19:12:45.410714 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2595/5362] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:45 2022] POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action => generated 14 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 19:12:45.858898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-7f160d4c-7bbf-41f0-92f0-8293c78b011f req-0fe9569f-572d-43a6-9472-02313b2b89da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723448de-0c5a-41c2-8bd1-c2125d2749f2", "name": "network-vif-plugged", "status": "completed", "tag": "655fb786-9399-49c3-9418-c018d3781c52"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:45.894482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7f160d4c-7bbf-41f0-92f0-8293c78b011f req-0fe9569f-572d-43a6-9472-02313b2b89da service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:45.895022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7f160d4c-7bbf-41f0-92f0-8293c78b011f req-0fe9569f-572d-43a6-9472-02313b2b89da service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:45.898610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7f160d4c-7bbf-41f0-92f0-8293c78b011f req-0fe9569f-572d-43a6-9472-02313b2b89da service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:45.947692 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-7f160d4c-7bbf-41f0-92f0-8293c78b011f req-0fe9569f-572d-43a6-9472-02313b2b89da service nova] Creating event network-vif-plugged:655fb786-9399-49c3-9418-c018d3781c52 for instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 on n-h2-860687-3 Oct 27 19:12:45.958550 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-7f160d4c-7bbf-41f0-92f0-8293c78b011f req-0fe9569f-572d-43a6-9472-02313b2b89da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102471 Oct 27 19:12:45.961243 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2596/5363] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:12:46.343074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cab4cdd1-eb61-4bf2-ad14-c9c670fa16b4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:46.356951 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cab4cdd1-eb61-4bf2-ad14-c9c670fa16b4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1314 microversion: 2.1 time: 1.091964 Oct 27 19:12:46.364531 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2768/5364] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:45 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1314 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:46.420251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6eb7db6-ffa3-4127-9f13-b7434fc02892 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:46.423673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d6eb7db6-ffa3-4127-9f13-b7434fc02892 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:46.436917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6eb7db6-ffa3-4127-9f13-b7434fc02892 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:46.437437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6eb7db6-ffa3-4127-9f13-b7434fc02892 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:46.438243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6eb7db6-ffa3-4127-9f13-b7434fc02892 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:46.440143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6eb7db6-ffa3-4127-9f13-b7434fc02892 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:46.440938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6eb7db6-ffa3-4127-9f13-b7434fc02892 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:46.441853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6eb7db6-ffa3-4127-9f13-b7434fc02892 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:46.604175 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d6eb7db6-ffa3-4127-9f13-b7434fc02892 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action" status: 200 len: 14 microversion: 2.1 time: 0.189406 Oct 27 19:12:46.609306 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2597/5365] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:46 2022] POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 19:12:47.384373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0f711c98-32d6-4bce-bf66-8bfea4bd118b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:47.385012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0f711c98-32d6-4bce-bf66-8bfea4bd118b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:47.407283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f711c98-32d6-4bce-bf66-8bfea4bd118b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:47.408185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f711c98-32d6-4bce-bf66-8bfea4bd118b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:47.409325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f711c98-32d6-4bce-bf66-8bfea4bd118b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:47.410519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f711c98-32d6-4bce-bf66-8bfea4bd118b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:47.411371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f711c98-32d6-4bce-bf66-8bfea4bd118b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:47.412037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f711c98-32d6-4bce-bf66-8bfea4bd118b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:47.647824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d05fdfce-cd0a-44c9-963a-23237f46abdc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:47.657783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d05fdfce-cd0a-44c9-963a-23237f46abdc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:47.697778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d05fdfce-cd0a-44c9-963a-23237f46abdc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:47.703121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d05fdfce-cd0a-44c9-963a-23237f46abdc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:47.710887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d05fdfce-cd0a-44c9-963a-23237f46abdc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:47.713762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d05fdfce-cd0a-44c9-963a-23237f46abdc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:47.715215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d05fdfce-cd0a-44c9-963a-23237f46abdc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:47.719519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d05fdfce-cd0a-44c9-963a-23237f46abdc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:47.851563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0f711c98-32d6-4bce-bf66-8bfea4bd118b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:47.862907 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0f711c98-32d6-4bce-bf66-8bfea4bd118b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1314 microversion: 2.1 time: 0.481182 Oct 27 19:12:47.886809 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2769/5366] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:47 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:47.893051 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d05fdfce-cd0a-44c9-963a-23237f46abdc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action" status: 200 len: 14 microversion: 2.1 time: 0.260700 Oct 27 19:12:47.894257 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2598/5367] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:47 2022] POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action => generated 14 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 19:12:48.892973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de22eaba-40c1-4a7d-8e88-c1082fd5a7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:48.893723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-de22eaba-40c1-4a7d-8e88-c1082fd5a7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:48.924460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc6e9beb-c947-4d82-bed6-33c3b7505aca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:48.927509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fc6e9beb-c947-4d82-bed6-33c3b7505aca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:48.938033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de22eaba-40c1-4a7d-8e88-c1082fd5a7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:48.940089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de22eaba-40c1-4a7d-8e88-c1082fd5a7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:48.940767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de22eaba-40c1-4a7d-8e88-c1082fd5a7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:48.945157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de22eaba-40c1-4a7d-8e88-c1082fd5a7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:48.947618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de22eaba-40c1-4a7d-8e88-c1082fd5a7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:48.949578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de22eaba-40c1-4a7d-8e88-c1082fd5a7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:48.961983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc6e9beb-c947-4d82-bed6-33c3b7505aca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:48.963204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc6e9beb-c947-4d82-bed6-33c3b7505aca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:48.968685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc6e9beb-c947-4d82-bed6-33c3b7505aca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:48.974274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc6e9beb-c947-4d82-bed6-33c3b7505aca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:48.974894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc6e9beb-c947-4d82-bed6-33c3b7505aca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:48.975454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc6e9beb-c947-4d82-bed6-33c3b7505aca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:49.108121 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc6e9beb-c947-4d82-bed6-33c3b7505aca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action" status: 200 len: 14 microversion: 2.1 time: 0.195561 Oct 27 19:12:49.110817 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2599/5368] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:48 2022] POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 19:12:49.781671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-de22eaba-40c1-4a7d-8e88-c1082fd5a7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:49.812261 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-de22eaba-40c1-4a7d-8e88-c1082fd5a7a8 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1501 microversion: 2.1 time: 0.922545 Oct 27 19:12:49.824755 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2770/5369] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:48 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1501 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:49.839872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-72f351ce-62a9-4e16-bd3f-b9e4f5948882 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:49.840547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-72f351ce-62a9-4e16-bd3f-b9e4f5948882 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:49.855890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72f351ce-62a9-4e16-bd3f-b9e4f5948882 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:49.857623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72f351ce-62a9-4e16-bd3f-b9e4f5948882 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:49.858090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72f351ce-62a9-4e16-bd3f-b9e4f5948882 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:49.858860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72f351ce-62a9-4e16-bd3f-b9e4f5948882 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:49.859335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72f351ce-62a9-4e16-bd3f-b9e4f5948882 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:49.859780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72f351ce-62a9-4e16-bd3f-b9e4f5948882 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:49.934109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-72f351ce-62a9-4e16-bd3f-b9e4f5948882 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lazy-loading 'flavor' on Instance uuid 723448de-0c5a-41c2-8bd1-c2125d2749f2 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:12:50.115039 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-72f351ce-62a9-4e16-bd3f-b9e4f5948882 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "POST /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2/action" status: 202 len: 0 microversion: 2.1 time: 0.281240 Oct 27 19:12:50.116485 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2600/5370] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:49 2022] POST /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:12:50.132074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a210c57c-912f-46e4-bb0c-525849fcc061 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:50.133969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ed5b54ed-a8c1-4dfe-ba95-7dfceb395edc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:50.135064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ed5b54ed-a8c1-4dfe-ba95-7dfceb395edc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:50.143524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a210c57c-912f-46e4-bb0c-525849fcc061 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:50.146105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed5b54ed-a8c1-4dfe-ba95-7dfceb395edc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:50.146901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed5b54ed-a8c1-4dfe-ba95-7dfceb395edc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:50.148018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed5b54ed-a8c1-4dfe-ba95-7dfceb395edc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:50.154421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed5b54ed-a8c1-4dfe-ba95-7dfceb395edc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:50.155208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed5b54ed-a8c1-4dfe-ba95-7dfceb395edc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:50.155864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed5b54ed-a8c1-4dfe-ba95-7dfceb395edc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:50.160330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a210c57c-912f-46e4-bb0c-525849fcc061 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:50.163107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a210c57c-912f-46e4-bb0c-525849fcc061 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:50.163603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a210c57c-912f-46e4-bb0c-525849fcc061 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:50.164333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a210c57c-912f-46e4-bb0c-525849fcc061 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:50.164804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a210c57c-912f-46e4-bb0c-525849fcc061 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:50.166732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a210c57c-912f-46e4-bb0c-525849fcc061 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:50.209257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:50.257961 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a210c57c-912f-46e4-bb0c-525849fcc061 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action" status: 200 len: 14 microversion: 2.1 time: 0.140359 Oct 27 19:12:50.261413 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2771/5371] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:50 2022] POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 19:12:50.632913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ed5b54ed-a8c1-4dfe-ba95-7dfceb395edc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:50.649118 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ed5b54ed-a8c1-4dfe-ba95-7dfceb395edc tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1509 microversion: 2.1 time: 0.528207 Oct 27 19:12:50.663571 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2601/5372] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:50 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1509 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:51.275191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5eae056a-a9f2-43ee-af9e-a95a9ab5c93e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:51.278328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5eae056a-a9f2-43ee-af9e-a95a9ab5c93e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:51.310568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5eae056a-a9f2-43ee-af9e-a95a9ab5c93e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:51.319932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5eae056a-a9f2-43ee-af9e-a95a9ab5c93e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:51.321914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5eae056a-a9f2-43ee-af9e-a95a9ab5c93e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:51.322952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5eae056a-a9f2-43ee-af9e-a95a9ab5c93e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:51.324508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5eae056a-a9f2-43ee-af9e-a95a9ab5c93e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:51.326099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5eae056a-a9f2-43ee-af9e-a95a9ab5c93e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:51.420122 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5eae056a-a9f2-43ee-af9e-a95a9ab5c93e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action" status: 200 len: 14 microversion: 2.1 time: 0.153796 Oct 27 19:12:51.421353 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2772/5373] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:51 2022] POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 19:12:51.690427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c3a17562-366b-4735-9b96-45bf501e0176 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:51.691750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c3a17562-366b-4735-9b96-45bf501e0176 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:51.706942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3a17562-366b-4735-9b96-45bf501e0176 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:51.711205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3a17562-366b-4735-9b96-45bf501e0176 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:51.713003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3a17562-366b-4735-9b96-45bf501e0176 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:51.720215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3a17562-366b-4735-9b96-45bf501e0176 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:51.723196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3a17562-366b-4735-9b96-45bf501e0176 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:51.724107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3a17562-366b-4735-9b96-45bf501e0176 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:51.964123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c3a17562-366b-4735-9b96-45bf501e0176 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:51.983691 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c3a17562-366b-4735-9b96-45bf501e0176 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1492 microversion: 2.1 time: 0.296425 Oct 27 19:12:51.984870 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2602/5374] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:51 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1492 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:52.011309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bad5b1e0-ce83-4fd4-ac9f-b9dbb148ef32 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:52.012972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bad5b1e0-ce83-4fd4-ac9f-b9dbb148ef32 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:52.022356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bad5b1e0-ce83-4fd4-ac9f-b9dbb148ef32 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:52.023232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bad5b1e0-ce83-4fd4-ac9f-b9dbb148ef32 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:52.023911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bad5b1e0-ce83-4fd4-ac9f-b9dbb148ef32 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:52.025596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bad5b1e0-ce83-4fd4-ac9f-b9dbb148ef32 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:52.026843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bad5b1e0-ce83-4fd4-ac9f-b9dbb148ef32 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:52.028667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bad5b1e0-ce83-4fd4-ac9f-b9dbb148ef32 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:52.069223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bad5b1e0-ce83-4fd4-ac9f-b9dbb148ef32 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:12:52.282108 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bad5b1e0-ce83-4fd4-ac9f-b9dbb148ef32 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "DELETE /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 204 len: 0 microversion: 2.1 time: 0.276656 Oct 27 19:12:52.285889 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2773/5375] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:12:52 2022] DELETE /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:12:52.314434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b88d163-ba64-4895-a75d-8d484e15078f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:52.316530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6b88d163-ba64-4895-a75d-8d484e15078f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:52.326058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b88d163-ba64-4895-a75d-8d484e15078f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:52.326834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b88d163-ba64-4895-a75d-8d484e15078f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:52.327295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b88d163-ba64-4895-a75d-8d484e15078f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:52.328013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b88d163-ba64-4895-a75d-8d484e15078f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:52.328634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b88d163-ba64-4895-a75d-8d484e15078f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:52.329225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b88d163-ba64-4895-a75d-8d484e15078f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:52.432287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-873ff0b3-6fcc-41f5-a932-04675f16bf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:52.437166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-873ff0b3-6fcc-41f5-a932-04675f16bf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:52.471300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-873ff0b3-6fcc-41f5-a932-04675f16bf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:52.476320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-873ff0b3-6fcc-41f5-a932-04675f16bf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:52.477233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-873ff0b3-6fcc-41f5-a932-04675f16bf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:52.480335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-873ff0b3-6fcc-41f5-a932-04675f16bf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:52.484144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-873ff0b3-6fcc-41f5-a932-04675f16bf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:52.487649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-873ff0b3-6fcc-41f5-a932-04675f16bf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:52.737630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6b88d163-ba64-4895-a75d-8d484e15078f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:52.759856 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b88d163-ba64-4895-a75d-8d484e15078f tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1498 microversion: 2.1 time: 0.448274 Oct 27 19:12:52.761142 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2603/5376] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:52 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1498 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:53.440621 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-873ff0b3-6fcc-41f5-a932-04675f16bf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action" status: 200 len: 8206 microversion: 2.1 time: 1.012815 Oct 27 19:12:53.441637 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2774/5377] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:52 2022] POST /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70/action => generated 8206 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:12:53.456070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b13b0d95-c4bf-4b24-bce3-09934e7849d8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:53.456720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b13b0d95-c4bf-4b24-bce3-09934e7849d8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:53.490855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b13b0d95-c4bf-4b24-bce3-09934e7849d8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:53.492298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b13b0d95-c4bf-4b24-bce3-09934e7849d8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:53.492681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b13b0d95-c4bf-4b24-bce3-09934e7849d8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:53.500966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b13b0d95-c4bf-4b24-bce3-09934e7849d8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:53.501490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b13b0d95-c4bf-4b24-bce3-09934e7849d8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:53.501954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b13b0d95-c4bf-4b24-bce3-09934e7849d8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:53.790923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-df96e525-b10b-46e6-97cc-abf50b3b8666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:53.791646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-df96e525-b10b-46e6-97cc-abf50b3b8666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:53.820727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df96e525-b10b-46e6-97cc-abf50b3b8666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:53.824939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df96e525-b10b-46e6-97cc-abf50b3b8666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:53.826943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df96e525-b10b-46e6-97cc-abf50b3b8666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:53.830323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df96e525-b10b-46e6-97cc-abf50b3b8666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:53.833179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df96e525-b10b-46e6-97cc-abf50b3b8666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:53.835444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df96e525-b10b-46e6-97cc-abf50b3b8666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:53.912578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b13b0d95-c4bf-4b24-bce3-09934e7849d8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:53.928642 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b13b0d95-c4bf-4b24-bce3-09934e7849d8 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.477781 Oct 27 19:12:53.929562 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2604/5378] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:53 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:53.971394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-61364678-4a5d-4bba-a7f4-52fdf191b251 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:53.973624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-61364678-4a5d-4bba-a7f4-52fdf191b251 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:53.989078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61364678-4a5d-4bba-a7f4-52fdf191b251 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:53.989596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61364678-4a5d-4bba-a7f4-52fdf191b251 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:53.990057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61364678-4a5d-4bba-a7f4-52fdf191b251 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:53.999858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61364678-4a5d-4bba-a7f4-52fdf191b251 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:54.004640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61364678-4a5d-4bba-a7f4-52fdf191b251 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:54.005124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61364678-4a5d-4bba-a7f4-52fdf191b251 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:54.298085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-61364678-4a5d-4bba-a7f4-52fdf191b251 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:54.345849 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-61364678-4a5d-4bba-a7f4-52fdf191b251 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.376519 Oct 27 19:12:54.350826 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2605/5379] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:53 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:54.382859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bdf329e1-a8db-47ca-ae84-d5159a183d87 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:54.383498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bdf329e1-a8db-47ca-ae84-d5159a183d87 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:54.401912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdf329e1-a8db-47ca-ae84-d5159a183d87 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:54.404315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdf329e1-a8db-47ca-ae84-d5159a183d87 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:54.404887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdf329e1-a8db-47ca-ae84-d5159a183d87 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:54.408406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdf329e1-a8db-47ca-ae84-d5159a183d87 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:54.409900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdf329e1-a8db-47ca-ae84-d5159a183d87 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:54.411622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdf329e1-a8db-47ca-ae84-d5159a183d87 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:54.775906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bdf329e1-a8db-47ca-ae84-d5159a183d87 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:54.795729 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bdf329e1-a8db-47ca-ae84-d5159a183d87 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.417104 Oct 27 19:12:54.812691 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2606/5380] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:54 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:54.836775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ce1fe679-7fe2-47cc-b708-76e18ad3dfcc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:54.838254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ce1fe679-7fe2-47cc-b708-76e18ad3dfcc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:54.873415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce1fe679-7fe2-47cc-b708-76e18ad3dfcc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:54.874646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce1fe679-7fe2-47cc-b708-76e18ad3dfcc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:54.875109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce1fe679-7fe2-47cc-b708-76e18ad3dfcc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:54.875852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce1fe679-7fe2-47cc-b708-76e18ad3dfcc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:54.876321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce1fe679-7fe2-47cc-b708-76e18ad3dfcc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:54.876760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce1fe679-7fe2-47cc-b708-76e18ad3dfcc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:55.170995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ce1fe679-7fe2-47cc-b708-76e18ad3dfcc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:55.182278 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ce1fe679-7fe2-47cc-b708-76e18ad3dfcc tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.350911 Oct 27 19:12:55.189880 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2607/5381] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:54 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:55.212454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c73f6ab0-a564-4b9c-af9e-cd502dd0d4fb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:55.213329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c73f6ab0-a564-4b9c-af9e-cd502dd0d4fb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:55.228706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c73f6ab0-a564-4b9c-af9e-cd502dd0d4fb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:55.229240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c73f6ab0-a564-4b9c-af9e-cd502dd0d4fb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:55.229704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c73f6ab0-a564-4b9c-af9e-cd502dd0d4fb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:55.234966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c73f6ab0-a564-4b9c-af9e-cd502dd0d4fb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:55.235666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c73f6ab0-a564-4b9c-af9e-cd502dd0d4fb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:55.236135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c73f6ab0-a564-4b9c-af9e-cd502dd0d4fb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:55.313275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:12:55.342232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c73f6ab0-a564-4b9c-af9e-cd502dd0d4fb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Locking {{(pid=127028) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 27 19:12:55.452885 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c73f6ab0-a564-4b9c-af9e-cd502dd0d4fb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.244845 Oct 27 19:12:55.461560 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2608/5382] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:55 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:12:55.469794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4155df5e-8b8c-4086-98bb-d86b047374a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:55.470594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4155df5e-8b8c-4086-98bb-d86b047374a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:55.482112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4155df5e-8b8c-4086-98bb-d86b047374a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:55.482797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4155df5e-8b8c-4086-98bb-d86b047374a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:55.488183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4155df5e-8b8c-4086-98bb-d86b047374a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:55.489948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4155df5e-8b8c-4086-98bb-d86b047374a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:55.490792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4155df5e-8b8c-4086-98bb-d86b047374a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:55.491832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4155df5e-8b8c-4086-98bb-d86b047374a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:55.554913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-df96e525-b10b-46e6-97cc-abf50b3b8666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:55.570085 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-df96e525-b10b-46e6-97cc-abf50b3b8666 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1498 microversion: 2.1 time: 1.785364 Oct 27 19:12:55.572870 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2775/5383] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:53 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1498 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:55.840344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4155df5e-8b8c-4086-98bb-d86b047374a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:55.853392 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4155df5e-8b8c-4086-98bb-d86b047374a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.385184 Oct 27 19:12:55.875436 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2609/5384] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:55 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:12:55.883354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a30d33d3-f77e-49dc-ad48-698fbdfa0e63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:55.898539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a30d33d3-f77e-49dc-ad48-698fbdfa0e63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:55.899060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a30d33d3-f77e-49dc-ad48-698fbdfa0e63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:55.899519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a30d33d3-f77e-49dc-ad48-698fbdfa0e63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:55.982598 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-a30d33d3-f77e-49dc-ad48-698fbdfa0e63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] HTTP exception thrown: Instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c is locked Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a30d33d3-f77e-49dc-ad48-698fbdfa0e63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Request method failure captured: Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action HTTP/1.1 Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 15 Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtcMgvpB1r3CMhn3lqnafdbRH_q7_2MwBC9YYeuhDoLvj0r3BLn_zRO4y1vPk2UIxFleNSJ40ezxJxF7WpMwNGUDmR2F9Ph7WCoWzLLJSCrOKdUX4jwbabAijBxwiCPW-h7IKMrha35ir4gu1w9PRD3wLqnVKXaKh6jwWiWGTSN6X8g Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 79c27f02ea6549bea54242ab81741f97 Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_79c27f02ea6549bea54242ab81741f97", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 79c27f02ea6549bea54242ab81741f97 Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerActionsTestJSON-1587791858-project Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 7019e4c367c0470f95bc66e32def747a Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerActionsTestJSON-1587791858-project Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: {"os-stop": {}} Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c is locked Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c', 'body': {'os-stop': {}}} Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c is locked Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c is locked Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c is locked Oct 27 19:12:55.984260 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:12:55.991504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a30d33d3-f77e-49dc-ad48-698fbdfa0e63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Returning 409 to user: Instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c is locked {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:12:55.996682 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a30d33d3-f77e-49dc-ad48-698fbdfa0e63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 409 len: 107 microversion: 2.1 time: 0.117712 Oct 27 19:12:56.000279 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2776/5385] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:55 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 107 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 19:12:56.602691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85b3879c-9dfd-4f2a-821b-963e019d76af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:56.604018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-85b3879c-9dfd-4f2a-821b-963e019d76af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:56.622952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b3879c-9dfd-4f2a-821b-963e019d76af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:56.629094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b3879c-9dfd-4f2a-821b-963e019d76af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:56.629752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b3879c-9dfd-4f2a-821b-963e019d76af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:56.632127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b3879c-9dfd-4f2a-821b-963e019d76af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:56.634421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b3879c-9dfd-4f2a-821b-963e019d76af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:56.635378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85b3879c-9dfd-4f2a-821b-963e019d76af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:56.735011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b08ce820-25a7-4466-a07c-f954850497c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:56.735605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b08ce820-25a7-4466-a07c-f954850497c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:56.754372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b08ce820-25a7-4466-a07c-f954850497c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:56.754987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b08ce820-25a7-4466-a07c-f954850497c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:56.757348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b08ce820-25a7-4466-a07c-f954850497c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:56.758132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b08ce820-25a7-4466-a07c-f954850497c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:56.758644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b08ce820-25a7-4466-a07c-f954850497c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:56.760381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b08ce820-25a7-4466-a07c-f954850497c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:56.903079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b08ce820-25a7-4466-a07c-f954850497c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Unlocking {{(pid=127028) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 27 19:12:57.030045 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b08ce820-25a7-4466-a07c-f954850497c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 1.025627 Oct 27 19:12:57.037459 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2610/5386] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:56 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 1032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:12:57.046177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-17a22dca-643d-45b2-9d77-b3cac333274a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:57.061255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17a22dca-643d-45b2-9d77-b3cac333274a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:57.063158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17a22dca-643d-45b2-9d77-b3cac333274a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:57.065363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17a22dca-643d-45b2-9d77-b3cac333274a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:57.144488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-17a22dca-643d-45b2-9d77-b3cac333274a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Going to try to stop instance {{(pid=127028) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 19:12:57.266790 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-17a22dca-643d-45b2-9d77-b3cac333274a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.226834 Oct 27 19:12:57.277263 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2611/5387] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:12:57 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:12:57.303987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e649078c-1bcd-4866-b650-b2a3adc8951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:57.315311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e649078c-1bcd-4866-b650-b2a3adc8951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:57.334276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e649078c-1bcd-4866-b650-b2a3adc8951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:57.334808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e649078c-1bcd-4866-b650-b2a3adc8951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:57.335265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e649078c-1bcd-4866-b650-b2a3adc8951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:57.336000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e649078c-1bcd-4866-b650-b2a3adc8951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:57.336445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e649078c-1bcd-4866-b650-b2a3adc8951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:57.336870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e649078c-1bcd-4866-b650-b2a3adc8951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:57.632159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-85b3879c-9dfd-4f2a-821b-963e019d76af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:57.644168 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-85b3879c-9dfd-4f2a-821b-963e019d76af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1498 microversion: 2.1 time: 1.046999 Oct 27 19:12:57.658845 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2777/5388] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:56 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1498 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:12:57.894508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e649078c-1bcd-4866-b650-b2a3adc8951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:57.911588 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e649078c-1bcd-4866-b650-b2a3adc8951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 0.630943 Oct 27 19:12:57.916540 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2612/5389] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:57 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:12:57.920033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-79dc605b-3037-4f75-8e47-d4aa7b83f902 req-5a966ed8-0841-41c7-81e9-f3192f528f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723448de-0c5a-41c2-8bd1-c2125d2749f2", "name": "network-vif-deleted", "tag": "655fb786-9399-49c3-9418-c018d3781c52"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:12:57.942568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-79dc605b-3037-4f75-8e47-d4aa7b83f902 req-5a966ed8-0841-41c7-81e9-f3192f528f13 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:57.943220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-79dc605b-3037-4f75-8e47-d4aa7b83f902 req-5a966ed8-0841-41c7-81e9-f3192f528f13 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:57.943932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-79dc605b-3037-4f75-8e47-d4aa7b83f902 req-5a966ed8-0841-41c7-81e9-f3192f528f13 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:57.988220 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-79dc605b-3037-4f75-8e47-d4aa7b83f902 req-5a966ed8-0841-41c7-81e9-f3192f528f13 service nova] Creating event network-vif-deleted:655fb786-9399-49c3-9418-c018d3781c52 for instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 on n-h2-860687-3 Oct 27 19:12:58.018095 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-79dc605b-3037-4f75-8e47-d4aa7b83f902 req-5a966ed8-0841-41c7-81e9-f3192f528f13 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103261 Oct 27 19:12:58.021206 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2778/5390] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:12:58.672391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13ba9b52-9df3-4ba1-97e4-58365906c6c9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:58.673214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-13ba9b52-9df3-4ba1-97e4-58365906c6c9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:58.691855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba9b52-9df3-4ba1-97e4-58365906c6c9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:58.693296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba9b52-9df3-4ba1-97e4-58365906c6c9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:58.695328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba9b52-9df3-4ba1-97e4-58365906c6c9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:58.696663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba9b52-9df3-4ba1-97e4-58365906c6c9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:58.697791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba9b52-9df3-4ba1-97e4-58365906c6c9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:58.699794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba9b52-9df3-4ba1-97e4-58365906c6c9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:58.743207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba9b52-9df3-4ba1-97e4-58365906c6c9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:58.744024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba9b52-9df3-4ba1-97e4-58365906c6c9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:58.744671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ba9b52-9df3-4ba1-97e4-58365906c6c9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:58.745333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-13ba9b52-9df3-4ba1-97e4-58365906c6c9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lazy-loading 'fault' on Instance uuid 723448de-0c5a-41c2-8bd1-c2125d2749f2 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:12:58.942949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0952a8c3-4c6f-4197-8245-c9a78233858f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:12:58.944901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0952a8c3-4c6f-4197-8245-c9a78233858f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:12:58.955600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0952a8c3-4c6f-4197-8245-c9a78233858f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:58.956592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0952a8c3-4c6f-4197-8245-c9a78233858f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:58.957243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0952a8c3-4c6f-4197-8245-c9a78233858f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:58.972313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0952a8c3-4c6f-4197-8245-c9a78233858f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:12:58.973751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0952a8c3-4c6f-4197-8245-c9a78233858f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:12:58.974541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0952a8c3-4c6f-4197-8245-c9a78233858f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:12:59.520125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-13ba9b52-9df3-4ba1-97e4-58365906c6c9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2237837d17c43e99f4e9961cd27cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1798d878b8344ec69c9ef0699467718a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:12:59.531017 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-13ba9b52-9df3-4ba1-97e4-58365906c6c9 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 200 len: 1304 microversion: 2.1 time: 0.864903 Oct 27 19:12:59.533761 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2613/5391] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:58 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 1304 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:00.557225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0952a8c3-4c6f-4197-8245-c9a78233858f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:00.570873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-47e2c235-d54c-478f-87f9-b56d1f6d09e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:00.572174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-47e2c235-d54c-478f-87f9-b56d1f6d09e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:00.581470 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0952a8c3-4c6f-4197-8245-c9a78233858f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 1.629967 Oct 27 19:13:00.588206 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2779/5392] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:12:58 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:13:00.606840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47e2c235-d54c-478f-87f9-b56d1f6d09e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:00.609043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47e2c235-d54c-478f-87f9-b56d1f6d09e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:00.610184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47e2c235-d54c-478f-87f9-b56d1f6d09e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:00.612795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47e2c235-d54c-478f-87f9-b56d1f6d09e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:00.614972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47e2c235-d54c-478f-87f9-b56d1f6d09e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:00.617636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47e2c235-d54c-478f-87f9-b56d1f6d09e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:00.685178 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-47e2c235-d54c-478f-87f9-b56d1f6d09e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-47e2c235-d54c-478f-87f9-b56d1f6d09e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 HTTP/1.1 Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '723448de-0c5a-41c2-8bd1-c2125d2749f2'} Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:00.692830 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.696631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:00.696631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:00.696631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:00.696631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:00.696631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:00.696631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.696631 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.696631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-47e2c235-d54c-478f-87f9-b56d1f6d09e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:00.703802 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-47e2c235-d54c-478f-87f9-b56d1f6d09e4 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 404 len: 111 microversion: 2.1 time: 0.143286 Oct 27 19:13:00.706355 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2614/5393] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:00 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:13:00.715351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b84cd3ce-8e45-4479-9c4a-551d87083520 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:00.716010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b84cd3ce-8e45-4479-9c4a-551d87083520 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:00.722819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b84cd3ce-8e45-4479-9c4a-551d87083520 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:00.723714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b84cd3ce-8e45-4479-9c4a-551d87083520 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:00.724390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b84cd3ce-8e45-4479-9c4a-551d87083520 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:00.725996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b84cd3ce-8e45-4479-9c4a-551d87083520 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:00.726743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b84cd3ce-8e45-4479-9c4a-551d87083520 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:00.727411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b84cd3ce-8e45-4479-9c4a-551d87083520 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:00.764941 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-b84cd3ce-8e45-4479-9c4a-551d87083520 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b84cd3ce-8e45-4479-9c4a-551d87083520 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 HTTP/1.1 Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '723448de-0c5a-41c2-8bd1-c2125d2749f2'} Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:00.766818 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:00.771263 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.771263 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.771263 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:00.771263 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.771263 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:00.771263 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:00.771263 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:00.771263 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:00.771263 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:00.771263 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.771263 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.771263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b84cd3ce-8e45-4479-9c4a-551d87083520 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:00.772964 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b84cd3ce-8e45-4479-9c4a-551d87083520 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "DELETE /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 404 len: 111 microversion: 2.1 time: 0.062087 Oct 27 19:13:00.783320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5368b2b4-2944-4c30-8f70-1945664c3b7b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:00.784477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5368b2b4-2944-4c30-8f70-1945664c3b7b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 723448de-0c5a-41c2-8bd1-c2125d2749f2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:00.790268 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2780/5394] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:13:00 2022] DELETE /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:13:00.804522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5368b2b4-2944-4c30-8f70-1945664c3b7b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:00.805625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5368b2b4-2944-4c30-8f70-1945664c3b7b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:00.806620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5368b2b4-2944-4c30-8f70-1945664c3b7b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:00.807669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5368b2b4-2944-4c30-8f70-1945664c3b7b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:00.808460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5368b2b4-2944-4c30-8f70-1945664c3b7b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:00.809555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5368b2b4-2944-4c30-8f70-1945664c3b7b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:00.840259 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-5368b2b4-2944-4c30-8f70-1945664c3b7b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5368b2b4-2944-4c30-8f70-1945664c3b7b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 HTTP/1.1 Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '723448de-0c5a-41c2-8bd1-c2125d2749f2'} Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:00.843571 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.847340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:00.847340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:00.847340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:00.847340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:00.847340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:00.847340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. Oct 27 19:13:00.847340 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.851181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5368b2b4-2944-4c30-8f70-1945664c3b7b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance 723448de-0c5a-41c2-8bd1-c2125d2749f2 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:00.852629 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5368b2b4-2944-4c30-8f70-1945664c3b7b tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2" status: 404 len: 111 microversion: 2.1 time: 0.073412 Oct 27 19:13:00.854220 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2615/5395] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:00 2022] GET /compute/v2.1/servers/723448de-0c5a-41c2-8bd1-c2125d2749f2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:13:00.864287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fbef4f52-fd45-4ae1-9e3d-9310b76e49ac tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:00.865033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fbef4f52-fd45-4ae1-9e3d-9310b76e49ac tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:00.874132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbef4f52-fd45-4ae1-9e3d-9310b76e49ac tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:00.876253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbef4f52-fd45-4ae1-9e3d-9310b76e49ac tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:00.879068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbef4f52-fd45-4ae1-9e3d-9310b76e49ac tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:00.880311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbef4f52-fd45-4ae1-9e3d-9310b76e49ac tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:00.881902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbef4f52-fd45-4ae1-9e3d-9310b76e49ac tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:00.887300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbef4f52-fd45-4ae1-9e3d-9310b76e49ac tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:00.919485 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-fbef4f52-fd45-4ae1-9e3d-9310b76e49ac tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fbef4f52-fd45-4ae1-9e3d-9310b76e49ac tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 HTTP/1.1 Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'd58bbaff-5c5b-4229-9b62-dd5fe437c639'} Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:00.921457 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:00.925117 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:13:00.925117 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.925117 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:00.925117 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.925117 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:00.925117 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:00.925117 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:00.925117 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:00.925117 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:00.925117 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:13:00.925117 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:00.933969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fbef4f52-fd45-4ae1-9e3d-9310b76e49ac tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:00.935232 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fbef4f52-fd45-4ae1-9e3d-9310b76e49ac tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 404 len: 111 microversion: 2.1 time: 0.075811 Oct 27 19:13:00.937206 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2781/5396] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:13:00 2022] DELETE /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:13:00.945112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd7272af-b827-4364-a70c-fa5840c271d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:00.946094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bd7272af-b827-4364-a70c-fa5840c271d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: d58bbaff-5c5b-4229-9b62-dd5fe437c639] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:00.961962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd7272af-b827-4364-a70c-fa5840c271d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:00.962893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd7272af-b827-4364-a70c-fa5840c271d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:00.963573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd7272af-b827-4364-a70c-fa5840c271d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:00.964637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd7272af-b827-4364-a70c-fa5840c271d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:00.965368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd7272af-b827-4364-a70c-fa5840c271d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:00.966103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd7272af-b827-4364-a70c-fa5840c271d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:00.993854 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-bd7272af-b827-4364-a70c-fa5840c271d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd7272af-b827-4364-a70c-fa5840c271d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 HTTP/1.1 Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'd58bbaff-5c5b-4229-9b62-dd5fe437c639'} Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:01.001018 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.004853 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.004853 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:01.004853 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:01.004853 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:01.004853 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:01.004853 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. Oct 27 19:13:01.004853 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.008187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd7272af-b827-4364-a70c-fa5840c271d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance d58bbaff-5c5b-4229-9b62-dd5fe437c639 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:01.009502 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bd7272af-b827-4364-a70c-fa5840c271d2 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639" status: 404 len: 111 microversion: 2.1 time: 0.068218 Oct 27 19:13:01.010311 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2616/5397] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:00 2022] GET /compute/v2.1/servers/d58bbaff-5c5b-4229-9b62-dd5fe437c639 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:13:01.019082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d8ca946-3e36-4483-95e6-887b27036549 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:01.020102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3d8ca946-3e36-4483-95e6-887b27036549 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:01.032509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d8ca946-3e36-4483-95e6-887b27036549 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:01.033372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d8ca946-3e36-4483-95e6-887b27036549 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:01.034047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d8ca946-3e36-4483-95e6-887b27036549 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:01.035051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d8ca946-3e36-4483-95e6-887b27036549 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:01.040590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d8ca946-3e36-4483-95e6-887b27036549 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:01.041343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d8ca946-3e36-4483-95e6-887b27036549 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:01.070331 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-3d8ca946-3e36-4483-95e6-887b27036549 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d8ca946-3e36-4483-95e6-887b27036549 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 HTTP/1.1 Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '164658b9-90aa-4fe2-afd7-dbcb65930773'} Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:01.076168 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:01.081164 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:13:01.081164 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.081164 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:01.081164 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.081164 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.081164 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:01.081164 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:01.081164 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:01.081164 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:01.081164 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:13:01.081164 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.083460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d8ca946-3e36-4483-95e6-887b27036549 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:01.084570 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3d8ca946-3e36-4483-95e6-887b27036549 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "DELETE /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 404 len: 111 microversion: 2.1 time: 0.069353 Oct 27 19:13:01.092497 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2782/5398] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:13:01 2022] DELETE /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:13:01.100428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7eddc8a-2c24-4e59-ae26-f68f69afc399 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:01.101412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a7eddc8a-2c24-4e59-ae26-f68f69afc399 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 164658b9-90aa-4fe2-afd7-dbcb65930773] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:01.112040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7eddc8a-2c24-4e59-ae26-f68f69afc399 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:01.112843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7eddc8a-2c24-4e59-ae26-f68f69afc399 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:01.114454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7eddc8a-2c24-4e59-ae26-f68f69afc399 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:01.118764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7eddc8a-2c24-4e59-ae26-f68f69afc399 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:01.119374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7eddc8a-2c24-4e59-ae26-f68f69afc399 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:01.126650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7eddc8a-2c24-4e59-ae26-f68f69afc399 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:01.152542 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-a7eddc8a-2c24-4e59-ae26-f68f69afc399 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7eddc8a-2c24-4e59-ae26-f68f69afc399 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 HTTP/1.1 Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '164658b9-90aa-4fe2-afd7-dbcb65930773'} Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:01.157525 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.161393 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.161393 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:01.161393 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:01.161393 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:01.161393 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:01.161393 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. Oct 27 19:13:01.161393 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.163615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7eddc8a-2c24-4e59-ae26-f68f69afc399 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance 164658b9-90aa-4fe2-afd7-dbcb65930773 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:01.168110 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7eddc8a-2c24-4e59-ae26-f68f69afc399 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773" status: 404 len: 111 microversion: 2.1 time: 0.071511 Oct 27 19:13:01.168706 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2617/5399] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:01 2022] GET /compute/v2.1/servers/164658b9-90aa-4fe2-afd7-dbcb65930773 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:13:01.176785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6bba9edf-c42f-4a36-b49e-ffe7bf665915 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:01.177298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6bba9edf-c42f-4a36-b49e-ffe7bf665915 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:01.186769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bba9edf-c42f-4a36-b49e-ffe7bf665915 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:01.189433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bba9edf-c42f-4a36-b49e-ffe7bf665915 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:01.190062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bba9edf-c42f-4a36-b49e-ffe7bf665915 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:01.192874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bba9edf-c42f-4a36-b49e-ffe7bf665915 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:01.193892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bba9edf-c42f-4a36-b49e-ffe7bf665915 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:01.194616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bba9edf-c42f-4a36-b49e-ffe7bf665915 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:01.228101 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-6bba9edf-c42f-4a36-b49e-ffe7bf665915 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6bba9edf-c42f-4a36-b49e-ffe7bf665915 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 HTTP/1.1 Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8'} Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:01.233722 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:01.238173 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:13:01.238173 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.238173 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:01.238173 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.238173 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.238173 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:01.238173 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:01.238173 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:01.238173 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:01.238173 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:13:01.238173 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.241499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6bba9edf-c42f-4a36-b49e-ffe7bf665915 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:01.243771 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6bba9edf-c42f-4a36-b49e-ffe7bf665915 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "DELETE /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 404 len: 111 microversion: 2.1 time: 0.070873 Oct 27 19:13:01.247077 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2783/5400] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:13:01 2022] DELETE /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:13:01.257287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c8055c3a-2f15-4af2-b09a-ed11fab4572c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:01.258188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c8055c3a-2f15-4af2-b09a-ed11fab4572c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:01.276589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8055c3a-2f15-4af2-b09a-ed11fab4572c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:01.277642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8055c3a-2f15-4af2-b09a-ed11fab4572c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:01.278102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8055c3a-2f15-4af2-b09a-ed11fab4572c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:01.279024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8055c3a-2f15-4af2-b09a-ed11fab4572c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:01.279547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8055c3a-2f15-4af2-b09a-ed11fab4572c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:01.279991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8055c3a-2f15-4af2-b09a-ed11fab4572c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:01.309995 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-c8055c3a-2f15-4af2-b09a-ed11fab4572c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c8055c3a-2f15-4af2-b09a-ed11fab4572c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 HTTP/1.1 Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8'} Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:01.315874 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.320252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.320252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:01.320252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:01.320252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:01.320252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:01.320252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. Oct 27 19:13:01.320252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.322012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c8055c3a-2f15-4af2-b09a-ed11fab4572c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance 95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:01.323177 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c8055c3a-2f15-4af2-b09a-ed11fab4572c tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8" status: 404 len: 111 microversion: 2.1 time: 0.071786 Oct 27 19:13:01.326802 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2618/5401] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:01 2022] GET /compute/v2.1/servers/95cfaff6-7fae-42a0-9e8d-f91d2ea1faf8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:13:01.334614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7db36f33-3cb3-4288-93a5-84b3edda8142 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:01.335484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7db36f33-3cb3-4288-93a5-84b3edda8142 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:01.345093 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-7db36f33-3cb3-4288-93a5-84b3edda8142 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7db36f33-3cb3-4288-93a5-84b3edda8142 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c HTTP/1.1 Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c'} Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:01.351826 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.355828 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.355828 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:01.355828 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:01.355828 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:01.355828 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:01.355828 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:13:01.355828 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.360365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7db36f33-3cb3-4288-93a5-84b3edda8142 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:01.368162 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7db36f33-3cb3-4288-93a5-84b3edda8142 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c" status: 404 len: 111 microversion: 2.1 time: 0.037351 Oct 27 19:13:01.371349 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2784/5402] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:13:01 2022] DELETE /compute/v2.1/servers/dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:13:01.381360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-93d08ab4-8623-41be-8d3c-d03b56224e1d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:01.382013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-93d08ab4-8623-41be-8d3c-d03b56224e1d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:01.398929 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-93d08ab4-8623-41be-8d3c-d03b56224e1d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-93d08ab4-8623-41be-8d3c-d03b56224e1d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c HTTP/1.1 Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c'} Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:01.411143 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:01.414980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:01.414980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:01.414980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:01.414980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. Oct 27 19:13:01.414980 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:01.414980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-93d08ab4-8623-41be-8d3c-d03b56224e1d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:01.414980 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-93d08ab4-8623-41be-8d3c-d03b56224e1d tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c" status: 404 len: 111 microversion: 2.1 time: 0.037331 Oct 27 19:13:01.418990 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2619/5403] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:01 2022] GET /compute/v2.1/servers/dbdf17cd-0870-4fa2-b1a1-6d4381eccb9c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:13:01.609727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7c7e1d84-0ffe-46e2-8af1-7c0524305078 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:01.610347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7c7e1d84-0ffe-46e2-8af1-7c0524305078 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:01.650617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c7e1d84-0ffe-46e2-8af1-7c0524305078 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:01.660407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c7e1d84-0ffe-46e2-8af1-7c0524305078 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:01.661076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c7e1d84-0ffe-46e2-8af1-7c0524305078 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:01.663566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c7e1d84-0ffe-46e2-8af1-7c0524305078 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:01.664743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c7e1d84-0ffe-46e2-8af1-7c0524305078 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:01.664743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c7e1d84-0ffe-46e2-8af1-7c0524305078 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:02.348448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7c7e1d84-0ffe-46e2-8af1-7c0524305078 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:02.371236 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7c7e1d84-0ffe-46e2-8af1-7c0524305078 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 0.765866 Oct 27 19:13:02.379207 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2785/5404] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:01 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:03.410279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-11c678f3-cc47-47fc-a370-624610f4a847 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:03.411607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-11c678f3-cc47-47fc-a370-624610f4a847 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:03.444622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11c678f3-cc47-47fc-a370-624610f4a847 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:03.445389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11c678f3-cc47-47fc-a370-624610f4a847 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:03.446016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11c678f3-cc47-47fc-a370-624610f4a847 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:03.454058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11c678f3-cc47-47fc-a370-624610f4a847 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:03.454877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11c678f3-cc47-47fc-a370-624610f4a847 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:03.455486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11c678f3-cc47-47fc-a370-624610f4a847 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:04.450301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-11c678f3-cc47-47fc-a370-624610f4a847 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:04.462127 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-11c678f3-cc47-47fc-a370-624610f4a847 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 1.055583 Oct 27 19:13:04.466655 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2620/5405] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:03 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:05.499663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-185d59fe-4681-42d7-80ad-367c68527ccd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:05.502350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-185d59fe-4681-42d7-80ad-367c68527ccd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:05.539219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-185d59fe-4681-42d7-80ad-367c68527ccd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:05.539908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-185d59fe-4681-42d7-80ad-367c68527ccd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:05.540554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-185d59fe-4681-42d7-80ad-367c68527ccd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:05.541451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-185d59fe-4681-42d7-80ad-367c68527ccd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:05.542093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-185d59fe-4681-42d7-80ad-367c68527ccd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:05.543249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-185d59fe-4681-42d7-80ad-367c68527ccd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:05.893383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-185d59fe-4681-42d7-80ad-367c68527ccd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:05.908400 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-185d59fe-4681-42d7-80ad-367c68527ccd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 0.418447 Oct 27 19:13:05.919660 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2786/5406] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:05 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:06.939755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a6301b9f-068a-4003-980c-e617d5a3a41a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:06.941234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a6301b9f-068a-4003-980c-e617d5a3a41a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:06.986915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6301b9f-068a-4003-980c-e617d5a3a41a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:06.994004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6301b9f-068a-4003-980c-e617d5a3a41a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:06.997312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6301b9f-068a-4003-980c-e617d5a3a41a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:07.030602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6301b9f-068a-4003-980c-e617d5a3a41a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:07.032491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6301b9f-068a-4003-980c-e617d5a3a41a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:07.032963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6301b9f-068a-4003-980c-e617d5a3a41a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:08.094270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-142182f1-e8ff-4143-9858-bd30211f64db tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Action: 'create', calling method: .version_select at 0x7fc86bac2ca0>, body: {"keypair": {"name": "tempest-keypair-234220064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoIegOWjp7dvXVJObDg83VDG909raQbUfCAQzbHWpqFkhgm1nWfpq73nZXcFGTW/HKJ2kHxr6K8d4D5afqAqzmELeeEWsI1IzvEVPEFlmzO6bPppnESaisWDV3uYGkHKA=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:13:08.163604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-142182f1-e8ff-4143-9858-bd30211f64db tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Getting quotas for project 18a73e635a584409a5205f3589597f7d. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:13:08.199841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-142182f1-e8ff-4143-9858-bd30211f64db tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Getting quotas for user e4301a5e85d5410b8b460ae711f278ab and project 18a73e635a584409a5205f3589597f7d. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:13:08.301752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a6301b9f-068a-4003-980c-e617d5a3a41a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:08.303090 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-142182f1-e8ff-4143-9858-bd30211f64db tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.209569 Oct 27 19:13:08.317625 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2787/5407] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:13:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:13:08.321837 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a6301b9f-068a-4003-980c-e617d5a3a41a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 1.389878 Oct 27 19:13:08.324711 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2621/5408] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:06 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:09.351059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-708aa575-8431-4ce7-b690-0d99f118fb72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:09.352306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-708aa575-8431-4ce7-b690-0d99f118fb72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:09.361542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708aa575-8431-4ce7-b690-0d99f118fb72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:09.378320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708aa575-8431-4ce7-b690-0d99f118fb72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:09.382670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708aa575-8431-4ce7-b690-0d99f118fb72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:09.395164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708aa575-8431-4ce7-b690-0d99f118fb72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:09.401588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708aa575-8431-4ce7-b690-0d99f118fb72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:09.403432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708aa575-8431-4ce7-b690-0d99f118fb72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:10.269709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-708aa575-8431-4ce7-b690-0d99f118fb72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:10.284854 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-708aa575-8431-4ce7-b690-0d99f118fb72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 0.937207 Oct 27 19:13:10.286837 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2788/5409] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:09 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:10.812844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-946ff0de-e539-44fe-b21c-953034c14811 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:10.815193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-946ff0de-e539-44fe-b21c-953034c14811 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:10.836183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=64 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:13:10.842653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-946ff0de-e539-44fe-b21c-953034c14811 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:10.845320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-946ff0de-e539-44fe-b21c-953034c14811 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:10.847659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-946ff0de-e539-44fe-b21c-953034c14811 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:10.849908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-946ff0de-e539-44fe-b21c-953034c14811 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:10.850544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-946ff0de-e539-44fe-b21c-953034c14811 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:10.851869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-946ff0de-e539-44fe-b21c-953034c14811 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:10.893758 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-946ff0de-e539-44fe-b21c-953034c14811 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-946ff0de-e539-44fe-b21c-953034c14811 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 HTTP/1.1 Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'f1d62a58-bc77-4e6f-bc0c-9fa193005049'} Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:10.895801 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:10.899551 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:13:10.899551 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:10.899551 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:10.899551 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:10.899551 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:10.899551 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:10.899551 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:10.899551 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:10.899551 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:10.899551 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:13:10.899551 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:10.902955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-946ff0de-e539-44fe-b21c-953034c14811 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:10.904565 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-946ff0de-e539-44fe-b21c-953034c14811 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 404 len: 111 microversion: 2.1 time: 0.098198 Oct 27 19:13:10.905673 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2622/5410] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:13:10 2022] DELETE /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:13:10.925673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cbe51310-2a35-407b-a228-a7998b0a2d2a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:10.928089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cbe51310-2a35-407b-a228-a7998b0a2d2a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: f1d62a58-bc77-4e6f-bc0c-9fa193005049] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:10.960519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbe51310-2a35-407b-a228-a7998b0a2d2a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:10.968305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbe51310-2a35-407b-a228-a7998b0a2d2a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:10.971547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbe51310-2a35-407b-a228-a7998b0a2d2a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:10.981721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbe51310-2a35-407b-a228-a7998b0a2d2a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:10.986259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbe51310-2a35-407b-a228-a7998b0a2d2a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:10.988503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbe51310-2a35-407b-a228-a7998b0a2d2a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:11.046802 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-cbe51310-2a35-407b-a228-a7998b0a2d2a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cbe51310-2a35-407b-a228-a7998b0a2d2a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 HTTP/1.1 Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'f1d62a58-bc77-4e6f-bc0c-9fa193005049'} Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:11.048583 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.052998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:11.052998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:11.052998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:11.052998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:11.052998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:11.052998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. Oct 27 19:13:11.052998 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.058603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cbe51310-2a35-407b-a228-a7998b0a2d2a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance f1d62a58-bc77-4e6f-bc0c-9fa193005049 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:11.063345 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cbe51310-2a35-407b-a228-a7998b0a2d2a tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049" status: 404 len: 111 microversion: 2.1 time: 0.151987 Oct 27 19:13:11.064428 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2789/5411] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:10 2022] GET /compute/v2.1/servers/f1d62a58-bc77-4e6f-bc0c-9fa193005049 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:13:11.073799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cec1375b-8d00-431e-9cb1-1995544ff419 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:11.074668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cec1375b-8d00-431e-9cb1-1995544ff419 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:11.089933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec1375b-8d00-431e-9cb1-1995544ff419 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:11.094370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec1375b-8d00-431e-9cb1-1995544ff419 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:11.099239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec1375b-8d00-431e-9cb1-1995544ff419 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:11.101491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec1375b-8d00-431e-9cb1-1995544ff419 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:11.102949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec1375b-8d00-431e-9cb1-1995544ff419 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:11.104553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec1375b-8d00-431e-9cb1-1995544ff419 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:11.154937 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-cec1375b-8d00-431e-9cb1-1995544ff419 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cec1375b-8d00-431e-9cb1-1995544ff419 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 HTTP/1.1 Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '3d0ba883-2279-48c5-a46f-f99d99ad0320'} Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:11.164282 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:11.169454 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:13:11.169454 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.169454 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:11.169454 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.169454 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:11.169454 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:11.169454 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:11.169454 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:11.169454 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:11.169454 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:13:11.169454 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.172354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cec1375b-8d00-431e-9cb1-1995544ff419 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:11.173915 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cec1375b-8d00-431e-9cb1-1995544ff419 tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 404 len: 111 microversion: 2.1 time: 0.105657 Oct 27 19:13:11.178914 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2623/5412] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:13:11 2022] DELETE /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:13:11.188000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-55319e7d-ef2d-4d99-b9cc-c8e0be9ff6af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:11.190627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-55319e7d-ef2d-4d99-b9cc-c8e0be9ff6af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] [instance: 3d0ba883-2279-48c5-a46f-f99d99ad0320] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:11.211028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55319e7d-ef2d-4d99-b9cc-c8e0be9ff6af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:11.212147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55319e7d-ef2d-4d99-b9cc-c8e0be9ff6af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:11.216668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55319e7d-ef2d-4d99-b9cc-c8e0be9ff6af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:11.217927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55319e7d-ef2d-4d99-b9cc-c8e0be9ff6af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:11.220285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55319e7d-ef2d-4d99-b9cc-c8e0be9ff6af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:11.222054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55319e7d-ef2d-4d99-b9cc-c8e0be9ff6af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:11.272005 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-55319e7d-ef2d-4d99-b9cc-c8e0be9ff6af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] HTTP exception thrown: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-55319e7d-ef2d-4d99-b9cc-c8e0be9ff6af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Request method failure captured: Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 HTTP/1.1 Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtblik1iwebrkfk8T3jw2Ml6qImI5D_fFHjuBjJ2rsrLwL4ysYRpeq7sQ8lbNaPc-jYsvuMLofHmcG94PvdJfKcoiEyTF1tr6urjB_P6s-a6FpKaNHwLpGojNQhxjR3uKVypevBNG2uK1sV1Or6_i4vkULw3WsNFtpneZz-aI_gCPAU Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1798d878b8344ec69c9ef0699467718a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1798d878b8344ec69c9ef0699467718a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 1798d878b8344ec69c9ef0699467718a Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-DeleteServersTestJSON-525983392 Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b2237837d17c43e99f4e9961cd27cbb5 Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-DeleteServersTestJSON-525983392-project Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '3d0ba883-2279-48c5-a46f-f99d99ad0320'} Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:13:11.281746 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.286318 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:13:11.286318 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:13:11.286318 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:13:11.286318 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:13:11.286318 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:13:11.286318 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. Oct 27 19:13:11.286318 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:13:11.288215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-55319e7d-ef2d-4d99-b9cc-c8e0be9ff6af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] Returning 404 to user: Instance 3d0ba883-2279-48c5-a46f-f99d99ad0320 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:13:11.289208 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-55319e7d-ef2d-4d99-b9cc-c8e0be9ff6af tempest-DeleteServersTestJSON-525983392 tempest-DeleteServersTestJSON-525983392-project] 10.222.0.42 "GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320" status: 404 len: 111 microversion: 2.1 time: 0.106156 Oct 27 19:13:11.305199 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2790/5413] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:11 2022] GET /compute/v2.1/servers/3d0ba883-2279-48c5-a46f-f99d99ad0320 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:13:11.316542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6417a24e-234e-4381-aef3-18b6d7cb749c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:11.317249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6417a24e-234e-4381-aef3-18b6d7cb749c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:11.329590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6417a24e-234e-4381-aef3-18b6d7cb749c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:11.340829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6417a24e-234e-4381-aef3-18b6d7cb749c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:11.342560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6417a24e-234e-4381-aef3-18b6d7cb749c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:11.344462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6417a24e-234e-4381-aef3-18b6d7cb749c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:11.346309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6417a24e-234e-4381-aef3-18b6d7cb749c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:11.350954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6417a24e-234e-4381-aef3-18b6d7cb749c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:12.354548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6417a24e-234e-4381-aef3-18b6d7cb749c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:12.365376 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6417a24e-234e-4381-aef3-18b6d7cb749c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 1.053430 Oct 27 19:13:12.368792 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2624/5414] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:11 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:13.397524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3ef89ed2-aa01-49a9-aec7-b4fd0493675b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:13.398078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3ef89ed2-aa01-49a9-aec7-b4fd0493675b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:13.401456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:13:13.417260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef89ed2-aa01-49a9-aec7-b4fd0493675b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:13.426809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef89ed2-aa01-49a9-aec7-b4fd0493675b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:13.427360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef89ed2-aa01-49a9-aec7-b4fd0493675b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:13.428129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef89ed2-aa01-49a9-aec7-b4fd0493675b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:13.428608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef89ed2-aa01-49a9-aec7-b4fd0493675b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:13.429044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef89ed2-aa01-49a9-aec7-b4fd0493675b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:14.800807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3ef89ed2-aa01-49a9-aec7-b4fd0493675b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:14.813755 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3ef89ed2-aa01-49a9-aec7-b4fd0493675b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1656 microversion: 2.1 time: 1.419903 Oct 27 19:13:14.815601 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2791/5415] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:13 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1656 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:14.850114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3d5cc0ed-a904-4dd0-9197-70c5628d380c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:13:14.876377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d5cc0ed-a904-4dd0-9197-70c5628d380c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:14.877390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d5cc0ed-a904-4dd0-9197-70c5628d380c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:14.878170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d5cc0ed-a904-4dd0-9197-70c5628d380c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:14.916983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=88,nova_cell1:UPDATE=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:13:14.991084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3d5cc0ed-a904-4dd0-9197-70c5628d380c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Going to try to start instance {{(pid=127028) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 19:13:15.148301 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3d5cc0ed-a904-4dd0-9197-70c5628d380c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.303497 Oct 27 19:13:15.151195 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2625/5416] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:13:14 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:13:15.160094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6123cdb2-a248-41a9-bad3-a28e3c0b5ae3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:15.160663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6123cdb2-a248-41a9-bad3-a28e3c0b5ae3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:15.173469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6123cdb2-a248-41a9-bad3-a28e3c0b5ae3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:15.174014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6123cdb2-a248-41a9-bad3-a28e3c0b5ae3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:15.174576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6123cdb2-a248-41a9-bad3-a28e3c0b5ae3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:15.180446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6123cdb2-a248-41a9-bad3-a28e3c0b5ae3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:15.184046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6123cdb2-a248-41a9-bad3-a28e3c0b5ae3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:15.184571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6123cdb2-a248-41a9-bad3-a28e3c0b5ae3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:16.166848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6123cdb2-a248-41a9-bad3-a28e3c0b5ae3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:16.193081 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6123cdb2-a248-41a9-bad3-a28e3c0b5ae3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1665 microversion: 2.1 time: 1.038141 Oct 27 19:13:16.200316 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2792/5417] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:15 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1665 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:17.249835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c2b193f9-2a61-4803-b8a6-2afe3043a887 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:17.267464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c2b193f9-2a61-4803-b8a6-2afe3043a887 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:17.304948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b193f9-2a61-4803-b8a6-2afe3043a887 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:17.305461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b193f9-2a61-4803-b8a6-2afe3043a887 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:17.314108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b193f9-2a61-4803-b8a6-2afe3043a887 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:17.318070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b193f9-2a61-4803-b8a6-2afe3043a887 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:17.320345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b193f9-2a61-4803-b8a6-2afe3043a887 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:17.321304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2b193f9-2a61-4803-b8a6-2afe3043a887 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:19.003672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2043638347", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f87c359a-91ac-4b18-950e-6a443b7387d5"}], "security_groups": [{"name": "tempest-securitygroup--1317669728"}], "key_name": "tempest-keypair-234220064", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:13:19.085555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:13:19.239283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c2b193f9-2a61-4803-b8a6-2afe3043a887 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:19.259291 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c2b193f9-2a61-4803-b8a6-2afe3043a887 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1665 microversion: 2.1 time: 2.037951 Oct 27 19:13:19.266779 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2626/5418] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:17 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1665 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:19.755081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] validate_networks() for [('f87c359a-91ac-4b18-950e-6a443b7387d5', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:13:20.285174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e2f0701e-0970-4dac-83c2-96dd0ac3a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:20.287079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e2f0701e-0970-4dac-83c2-96dd0ac3a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:20.309048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2f0701e-0970-4dac-83c2-96dd0ac3a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:20.312634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2f0701e-0970-4dac-83c2-96dd0ac3a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:20.317914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2f0701e-0970-4dac-83c2-96dd0ac3a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:20.321700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2f0701e-0970-4dac-83c2-96dd0ac3a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:20.323480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2f0701e-0970-4dac-83c2-96dd0ac3a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:20.324065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2f0701e-0970-4dac-83c2-96dd0ac3a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:21.963629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e2f0701e-0970-4dac-83c2-96dd0ac3a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:21.984799 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e2f0701e-0970-4dac-83c2-96dd0ac3a733 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1665 microversion: 2.1 time: 1.704424 Oct 27 19:13:21.988571 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2627/5419] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:20 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1665 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:22.831683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Getting quotas for project 18a73e635a584409a5205f3589597f7d. Resources: dict_keys(['metadata_items']) {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:13:22.841796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Getting quotas for user e4301a5e85d5410b8b460ae711f278ab and project 18a73e635a584409a5205f3589597f7d. Resources: dict_keys(['metadata_items']) {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:13:22.858574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:13:22.859277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:13:22.859923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:13:22.870148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:13:22.872312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:13:22.885495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:22.886446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:22.887562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:22.888833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:22.889559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:22.890145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:22.906533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:13:22.938317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Getting quotas for project 18a73e635a584409a5205f3589597f7d. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:13:22.954711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Getting quotas for user e4301a5e85d5410b8b460ae711f278ab and project 18a73e635a584409a5205f3589597f7d. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:13:22.977992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:13:22.993459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:13:23.019859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ef712ff6-8f55-4747-80ed-c0700465873e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:23.020544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ef712ff6-8f55-4747-80ed-c0700465873e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:23.033600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef712ff6-8f55-4747-80ed-c0700465873e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:23.034124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef712ff6-8f55-4747-80ed-c0700465873e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:23.038486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef712ff6-8f55-4747-80ed-c0700465873e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:23.039443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef712ff6-8f55-4747-80ed-c0700465873e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:23.043391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef712ff6-8f55-4747-80ed-c0700465873e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:23.044500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef712ff6-8f55-4747-80ed-c0700465873e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:23.097946 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4d76fc88-c288-40c3-b716-0d559ab8fe66 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.114604 Oct 27 19:13:23.098931 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2793/5420] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:13:18 2022] POST /compute/v2.1/servers => generated 407 bytes in 4117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:13:23.112279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dc944683-3c64-403c-b5b9-2f9ab078ac54 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:23.112444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dc944683-3c64-403c-b5b9-2f9ab078ac54 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:23.569300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dc944683-3c64-403c-b5b9-2f9ab078ac54 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:23.606789 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dc944683-3c64-403c-b5b9-2f9ab078ac54 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1269 microversion: 2.1 time: 0.471715 Oct 27 19:13:23.622562 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2794/5421] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:23 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1269 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:24.018811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ef712ff6-8f55-4747-80ed-c0700465873e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:24.029389 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ef712ff6-8f55-4747-80ed-c0700465873e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 1.014810 Oct 27 19:13:24.033745 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2628/5422] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:23 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:13:24.059920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-add5cb8b-f0db-4db7-a749-0553966d301c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:24.060535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-add5cb8b-f0db-4db7-a749-0553966d301c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:24.081430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-add5cb8b-f0db-4db7-a749-0553966d301c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:24.082204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-add5cb8b-f0db-4db7-a749-0553966d301c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:24.105627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-add5cb8b-f0db-4db7-a749-0553966d301c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:24.110375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-add5cb8b-f0db-4db7-a749-0553966d301c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:24.111225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-add5cb8b-f0db-4db7-a749-0553966d301c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:24.113864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-add5cb8b-f0db-4db7-a749-0553966d301c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:24.632382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-abeca43a-2d31-4364-ad1e-d1716208f2a0 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:24.633011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-abeca43a-2d31-4364-ad1e-d1716208f2a0 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:24.664962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abeca43a-2d31-4364-ad1e-d1716208f2a0 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:24.666999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abeca43a-2d31-4364-ad1e-d1716208f2a0 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:24.667700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abeca43a-2d31-4364-ad1e-d1716208f2a0 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:24.668555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abeca43a-2d31-4364-ad1e-d1716208f2a0 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:24.669025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abeca43a-2d31-4364-ad1e-d1716208f2a0 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:24.669569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-abeca43a-2d31-4364-ad1e-d1716208f2a0 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:24.713894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-add5cb8b-f0db-4db7-a749-0553966d301c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:24.725952 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-add5cb8b-f0db-4db7-a749-0553966d301c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.668055 Oct 27 19:13:24.728236 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2795/5423] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:24 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:24.759452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-56d64f84-da1a-42b5-86f3-beb71c06d021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:13:24.760630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-56d64f84-da1a-42b5-86f3-beb71c06d021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:24.779054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56d64f84-da1a-42b5-86f3-beb71c06d021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:24.779745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56d64f84-da1a-42b5-86f3-beb71c06d021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:24.785410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56d64f84-da1a-42b5-86f3-beb71c06d021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:24.787690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56d64f84-da1a-42b5-86f3-beb71c06d021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:24.788749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56d64f84-da1a-42b5-86f3-beb71c06d021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:24.790994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56d64f84-da1a-42b5-86f3-beb71c06d021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:24.940375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-56d64f84-da1a-42b5-86f3-beb71c06d021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Unlocking {{(pid=127029) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 27 19:13:25.076673 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-56d64f84-da1a-42b5-86f3-beb71c06d021 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.322121 Oct 27 19:13:25.078780 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2796/5424] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:13:24 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:13:25.106150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-39df8ede-9efe-40a8-b24d-5380910b4b46 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:25.107235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-39df8ede-9efe-40a8-b24d-5380910b4b46 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:25.149804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39df8ede-9efe-40a8-b24d-5380910b4b46 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:25.154037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39df8ede-9efe-40a8-b24d-5380910b4b46 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:25.155821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39df8ede-9efe-40a8-b24d-5380910b4b46 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:25.157943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39df8ede-9efe-40a8-b24d-5380910b4b46 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:25.160818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39df8ede-9efe-40a8-b24d-5380910b4b46 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:25.161484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39df8ede-9efe-40a8-b24d-5380910b4b46 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:25.529793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-abeca43a-2d31-4364-ad1e-d1716208f2a0 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:25.544421 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-abeca43a-2d31-4364-ad1e-d1716208f2a0 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1273 microversion: 2.1 time: 0.915404 Oct 27 19:13:25.547834 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2629/5425] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:24 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1273 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:26.244090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-39df8ede-9efe-40a8-b24d-5380910b4b46 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:26.266216 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-39df8ede-9efe-40a8-b24d-5380910b4b46 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 1.174231 Oct 27 19:13:26.275242 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2797/5426] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:25 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:26.296976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc84ced7-90b4-4bca-8f8f-af8c5457f9a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:26.297943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fc84ced7-90b4-4bca-8f8f-af8c5457f9a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:26.315516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc84ced7-90b4-4bca-8f8f-af8c5457f9a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:26.319761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc84ced7-90b4-4bca-8f8f-af8c5457f9a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:26.320535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc84ced7-90b4-4bca-8f8f-af8c5457f9a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:26.321780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc84ced7-90b4-4bca-8f8f-af8c5457f9a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:26.322789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc84ced7-90b4-4bca-8f8f-af8c5457f9a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:26.323906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc84ced7-90b4-4bca-8f8f-af8c5457f9a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:26.576765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ad1a50b3-3908-4773-94e9-4004ca72cb42 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:26.577482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ad1a50b3-3908-4773-94e9-4004ca72cb42 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:26.591966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad1a50b3-3908-4773-94e9-4004ca72cb42 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:26.592488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad1a50b3-3908-4773-94e9-4004ca72cb42 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:26.602129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad1a50b3-3908-4773-94e9-4004ca72cb42 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:26.603219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad1a50b3-3908-4773-94e9-4004ca72cb42 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:26.603723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad1a50b3-3908-4773-94e9-4004ca72cb42 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:26.604180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad1a50b3-3908-4773-94e9-4004ca72cb42 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:27.004755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ad1a50b3-3908-4773-94e9-4004ca72cb42 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:27.021275 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ad1a50b3-3908-4773-94e9-4004ca72cb42 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1327 microversion: 2.1 time: 0.447482 Oct 27 19:13:27.022205 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2798/5427] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:26 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1327 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:28.053431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8e7ef92e-d542-48f4-8100-877d72f0b104 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:28.053431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8e7ef92e-d542-48f4-8100-877d72f0b104 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:28.079058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e7ef92e-d542-48f4-8100-877d72f0b104 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:28.084476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e7ef92e-d542-48f4-8100-877d72f0b104 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:28.089733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e7ef92e-d542-48f4-8100-877d72f0b104 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:28.093625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e7ef92e-d542-48f4-8100-877d72f0b104 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:28.093927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e7ef92e-d542-48f4-8100-877d72f0b104 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:28.094491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e7ef92e-d542-48f4-8100-877d72f0b104 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:28.679378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc84ced7-90b4-4bca-8f8f-af8c5457f9a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:28.725262 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc84ced7-90b4-4bca-8f8f-af8c5457f9a2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 2.418622 Oct 27 19:13:28.726961 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2630/5428] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:26 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 2435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:28.753322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-444684cc-564e-41c4-9307-1ee53ffc26c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:28.759913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-444684cc-564e-41c4-9307-1ee53ffc26c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:28.797963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-444684cc-564e-41c4-9307-1ee53ffc26c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:28.800571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-444684cc-564e-41c4-9307-1ee53ffc26c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:28.801072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-444684cc-564e-41c4-9307-1ee53ffc26c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:28.801847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-444684cc-564e-41c4-9307-1ee53ffc26c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:28.802327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-444684cc-564e-41c4-9307-1ee53ffc26c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:28.802792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-444684cc-564e-41c4-9307-1ee53ffc26c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:29.927531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-444684cc-564e-41c4-9307-1ee53ffc26c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:29.943465 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-444684cc-564e-41c4-9307-1ee53ffc26c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 1.194681 Oct 27 19:13:29.947271 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2631/5429] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:28 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:29.968473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7bb62e35-dbdf-4f9d-b225-abb40ab6a703 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:13:29.969334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7bb62e35-dbdf-4f9d-b225-abb40ab6a703 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:29.986989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bb62e35-dbdf-4f9d-b225-abb40ab6a703 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:29.987499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bb62e35-dbdf-4f9d-b225-abb40ab6a703 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:29.987954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bb62e35-dbdf-4f9d-b225-abb40ab6a703 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:29.988687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bb62e35-dbdf-4f9d-b225-abb40ab6a703 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:29.989152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bb62e35-dbdf-4f9d-b225-abb40ab6a703 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:29.989594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bb62e35-dbdf-4f9d-b225-abb40ab6a703 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:30.222861 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7bb62e35-dbdf-4f9d-b225-abb40ab6a703 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.259379 Oct 27 19:13:30.223998 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2632/5430] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:13:29 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:13:30.232987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ff766916-a5ec-4b6c-8329-758d5bc49429 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:30.234003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ff766916-a5ec-4b6c-8329-758d5bc49429 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:30.258695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff766916-a5ec-4b6c-8329-758d5bc49429 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:30.259505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff766916-a5ec-4b6c-8329-758d5bc49429 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:30.260157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff766916-a5ec-4b6c-8329-758d5bc49429 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:30.261340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff766916-a5ec-4b6c-8329-758d5bc49429 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:30.263731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff766916-a5ec-4b6c-8329-758d5bc49429 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:30.265144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff766916-a5ec-4b6c-8329-758d5bc49429 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:30.852862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ff766916-a5ec-4b6c-8329-758d5bc49429 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:30.894088 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ff766916-a5ec-4b6c-8329-758d5bc49429 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1674 microversion: 2.1 time: 0.666054 Oct 27 19:13:30.895949 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2633/5431] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:30 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1674 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:13:31.193677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8e7ef92e-d542-48f4-8100-877d72f0b104 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:31.219462 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8e7ef92e-d542-48f4-8100-877d72f0b104 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1395 microversion: 2.1 time: 3.173535 Oct 27 19:13:31.225840 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2799/5432] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:28 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1395 bytes in 3181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:13:31.930464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-90a4ef92-0799-41f1-9739-acc6b9cd647c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:31.932200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-90a4ef92-0799-41f1-9739-acc6b9cd647c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:31.948618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90a4ef92-0799-41f1-9739-acc6b9cd647c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:31.950317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90a4ef92-0799-41f1-9739-acc6b9cd647c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:31.952360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90a4ef92-0799-41f1-9739-acc6b9cd647c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:31.953269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90a4ef92-0799-41f1-9739-acc6b9cd647c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:31.957775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90a4ef92-0799-41f1-9739-acc6b9cd647c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:31.958444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90a4ef92-0799-41f1-9739-acc6b9cd647c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:32.253058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7bd24f09-6786-4447-bb7d-ebd2f1f8f847 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:32.254598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7bd24f09-6786-4447-bb7d-ebd2f1f8f847 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:32.283130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bd24f09-6786-4447-bb7d-ebd2f1f8f847 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:32.283944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-90a4ef92-0799-41f1-9739-acc6b9cd647c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:32.284537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bd24f09-6786-4447-bb7d-ebd2f1f8f847 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:32.285073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bd24f09-6786-4447-bb7d-ebd2f1f8f847 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:32.286645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bd24f09-6786-4447-bb7d-ebd2f1f8f847 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:32.288934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bd24f09-6786-4447-bb7d-ebd2f1f8f847 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:32.291080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bd24f09-6786-4447-bb7d-ebd2f1f8f847 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:32.299838 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-90a4ef92-0799-41f1-9739-acc6b9cd647c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1654 microversion: 2.1 time: 0.379144 Oct 27 19:13:32.308245 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2634/5433] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:31 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1654 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:32.331523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b0ca96a3-a61a-409d-97cb-4578d22b506d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:13:32.332068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0ca96a3-a61a-409d-97cb-4578d22b506d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:32.354217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0ca96a3-a61a-409d-97cb-4578d22b506d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:32.358265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0ca96a3-a61a-409d-97cb-4578d22b506d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:32.363902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0ca96a3-a61a-409d-97cb-4578d22b506d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:32.368276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0ca96a3-a61a-409d-97cb-4578d22b506d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:32.373968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0ca96a3-a61a-409d-97cb-4578d22b506d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:32.374564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0ca96a3-a61a-409d-97cb-4578d22b506d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:32.612873 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b0ca96a3-a61a-409d-97cb-4578d22b506d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.286817 Oct 27 19:13:32.614828 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2635/5434] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:13:32 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:13:32.655166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-08995662-4ffd-47d8-a9ed-55569aab2827 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:32.673177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-08995662-4ffd-47d8-a9ed-55569aab2827 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:32.694191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08995662-4ffd-47d8-a9ed-55569aab2827 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:32.696406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08995662-4ffd-47d8-a9ed-55569aab2827 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:32.697255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08995662-4ffd-47d8-a9ed-55569aab2827 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:32.699785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08995662-4ffd-47d8-a9ed-55569aab2827 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:32.700637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08995662-4ffd-47d8-a9ed-55569aab2827 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:32.701806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08995662-4ffd-47d8-a9ed-55569aab2827 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:32.907182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:13:33.204732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7bd24f09-6786-4447-bb7d-ebd2f1f8f847 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:33.223924 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7bd24f09-6786-4447-bb7d-ebd2f1f8f847 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1395 microversion: 2.1 time: 0.971895 Oct 27 19:13:33.225698 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2800/5435] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:32 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1395 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:13:33.229406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-08995662-4ffd-47d8-a9ed-55569aab2827 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:33.243188 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-08995662-4ffd-47d8-a9ed-55569aab2827 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1661 microversion: 2.1 time: 0.609038 Oct 27 19:13:33.247167 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2636/5436] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:32 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1661 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:34.251513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e76598a6-6d73-44e9-b602-a88063f85245 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:34.253277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e76598a6-6d73-44e9-b602-a88063f85245 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:34.257581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=12 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:13:34.273375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-78945b70-63f9-4a7b-95cd-73b2da775beb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:34.274606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-78945b70-63f9-4a7b-95cd-73b2da775beb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:34.275894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e76598a6-6d73-44e9-b602-a88063f85245 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:34.278104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e76598a6-6d73-44e9-b602-a88063f85245 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:34.278699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e76598a6-6d73-44e9-b602-a88063f85245 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:34.281350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e76598a6-6d73-44e9-b602-a88063f85245 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:34.288139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78945b70-63f9-4a7b-95cd-73b2da775beb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:34.288887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78945b70-63f9-4a7b-95cd-73b2da775beb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:34.289143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e76598a6-6d73-44e9-b602-a88063f85245 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:34.290225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e76598a6-6d73-44e9-b602-a88063f85245 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:34.290934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78945b70-63f9-4a7b-95cd-73b2da775beb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:34.291870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78945b70-63f9-4a7b-95cd-73b2da775beb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:34.299223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78945b70-63f9-4a7b-95cd-73b2da775beb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:34.299917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78945b70-63f9-4a7b-95cd-73b2da775beb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:35.085370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-78945b70-63f9-4a7b-95cd-73b2da775beb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:35.099831 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-78945b70-63f9-4a7b-95cd-73b2da775beb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.829775 Oct 27 19:13:35.102363 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2637/5437] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:34 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:35.140363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3c7a752b-f890-470d-84dd-507bfbbf95c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:35.141020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3c7a752b-f890-470d-84dd-507bfbbf95c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:35.149607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c7a752b-f890-470d-84dd-507bfbbf95c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:35.150014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c7a752b-f890-470d-84dd-507bfbbf95c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:35.150500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c7a752b-f890-470d-84dd-507bfbbf95c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:35.151848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c7a752b-f890-470d-84dd-507bfbbf95c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:35.152622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c7a752b-f890-470d-84dd-507bfbbf95c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:35.153180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c7a752b-f890-470d-84dd-507bfbbf95c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:35.645610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3c7a752b-f890-470d-84dd-507bfbbf95c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:35.658590 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3c7a752b-f890-470d-84dd-507bfbbf95c5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.530594 Oct 27 19:13:35.661695 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2638/5438] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:35 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:35.701800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-151b30fa-5384-46e9-8cbb-8932040a1824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:35.709127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-151b30fa-5384-46e9-8cbb-8932040a1824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:35.733693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-151b30fa-5384-46e9-8cbb-8932040a1824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:35.734564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-151b30fa-5384-46e9-8cbb-8932040a1824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:35.737340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-151b30fa-5384-46e9-8cbb-8932040a1824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:35.738274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-151b30fa-5384-46e9-8cbb-8932040a1824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:35.742815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-151b30fa-5384-46e9-8cbb-8932040a1824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:35.743843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-151b30fa-5384-46e9-8cbb-8932040a1824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:35.757047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:13:36.081981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e76598a6-6d73-44e9-b602-a88063f85245 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:36.103099 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e76598a6-6d73-44e9-b602-a88063f85245 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1395 microversion: 2.1 time: 1.852910 Oct 27 19:13:36.122914 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2801/5439] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:34 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1395 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:36.249946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-151b30fa-5384-46e9-8cbb-8932040a1824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:36.278689 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-151b30fa-5384-46e9-8cbb-8932040a1824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.589319 Oct 27 19:13:36.283075 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2639/5440] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:35 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:36.317617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f9766674-6515-46d7-9406-f6f92ef0f5a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:36.318774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f9766674-6515-46d7-9406-f6f92ef0f5a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:36.340970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9766674-6515-46d7-9406-f6f92ef0f5a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:36.344768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9766674-6515-46d7-9406-f6f92ef0f5a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:36.347319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9766674-6515-46d7-9406-f6f92ef0f5a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:36.351426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9766674-6515-46d7-9406-f6f92ef0f5a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:36.352802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9766674-6515-46d7-9406-f6f92ef0f5a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:36.354935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9766674-6515-46d7-9406-f6f92ef0f5a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:36.803511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ebe7cc8d-25e3-4ea8-a734-cb78b776e222 req-e976571c-bf90-4653-bb9c-e8b2bc9ea863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4486b6a9-6328-460b-87bf-cd8924dd88ed", "tag": "3a060186-5be2-4385-a9d5-864794d0d603"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:13:36.829811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ebe7cc8d-25e3-4ea8-a734-cb78b776e222 req-e976571c-bf90-4653-bb9c-e8b2bc9ea863 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:36.830705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ebe7cc8d-25e3-4ea8-a734-cb78b776e222 req-e976571c-bf90-4653-bb9c-e8b2bc9ea863 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:36.834565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ebe7cc8d-25e3-4ea8-a734-cb78b776e222 req-e976571c-bf90-4653-bb9c-e8b2bc9ea863 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:36.878911 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ebe7cc8d-25e3-4ea8-a734-cb78b776e222 req-e976571c-bf90-4653-bb9c-e8b2bc9ea863 service nova] Creating event network-changed:3a060186-5be2-4385-a9d5-864794d0d603 for instance 4486b6a9-6328-460b-87bf-cd8924dd88ed on n-h2-860687-3 Oct 27 19:13:36.885322 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ebe7cc8d-25e3-4ea8-a734-cb78b776e222 req-e976571c-bf90-4653-bb9c-e8b2bc9ea863 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102207 Oct 27 19:13:36.886810 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2640/5441] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:13:37.133263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7b4b6ca-2bfd-49e9-9d54-49ce44a5cfb8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:37.134005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7b4b6ca-2bfd-49e9-9d54-49ce44a5cfb8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:37.144919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7b4b6ca-2bfd-49e9-9d54-49ce44a5cfb8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:37.154868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7b4b6ca-2bfd-49e9-9d54-49ce44a5cfb8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:37.155615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7b4b6ca-2bfd-49e9-9d54-49ce44a5cfb8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:37.156544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7b4b6ca-2bfd-49e9-9d54-49ce44a5cfb8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:37.157197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7b4b6ca-2bfd-49e9-9d54-49ce44a5cfb8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:37.157790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7b4b6ca-2bfd-49e9-9d54-49ce44a5cfb8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:37.528292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f9766674-6515-46d7-9406-f6f92ef0f5a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:37.544274 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f9766674-6515-46d7-9406-f6f92ef0f5a3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 1.230514 Oct 27 19:13:37.550494 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2802/5442] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:36 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:37.571415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ed5ce843-1c4c-4284-b7a8-29311b62f7d3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:37.572491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ed5ce843-1c4c-4284-b7a8-29311b62f7d3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:37.582218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed5ce843-1c4c-4284-b7a8-29311b62f7d3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:37.583011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed5ce843-1c4c-4284-b7a8-29311b62f7d3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:37.583695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed5ce843-1c4c-4284-b7a8-29311b62f7d3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:37.584627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed5ce843-1c4c-4284-b7a8-29311b62f7d3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:37.585295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed5ce843-1c4c-4284-b7a8-29311b62f7d3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:37.586175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed5ce843-1c4c-4284-b7a8-29311b62f7d3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:38.067121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7b4b6ca-2bfd-49e9-9d54-49ce44a5cfb8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:38.094636 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7b4b6ca-2bfd-49e9-9d54-49ce44a5cfb8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1395 microversion: 2.1 time: 0.969233 Oct 27 19:13:38.095762 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2641/5443] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:37 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1395 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:39.118634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-56a4275a-583c-4ab0-ab6f-03c05055cab4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:39.120676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-56a4275a-583c-4ab0-ab6f-03c05055cab4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:39.131940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56a4275a-583c-4ab0-ab6f-03c05055cab4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:39.136545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56a4275a-583c-4ab0-ab6f-03c05055cab4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:39.138360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56a4275a-583c-4ab0-ab6f-03c05055cab4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:39.139989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56a4275a-583c-4ab0-ab6f-03c05055cab4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:39.142195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56a4275a-583c-4ab0-ab6f-03c05055cab4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:39.144387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56a4275a-583c-4ab0-ab6f-03c05055cab4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:39.172020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ed5ce843-1c4c-4284-b7a8-29311b62f7d3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:39.188196 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ed5ce843-1c4c-4284-b7a8-29311b62f7d3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 1.618496 Oct 27 19:13:39.188887 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2803/5444] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:37 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:13:39.231013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a77eeea0-d68e-4297-84f6-247b39abdeb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:39.231705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a77eeea0-d68e-4297-84f6-247b39abdeb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:39.244459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a77eeea0-d68e-4297-84f6-247b39abdeb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:39.252559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a77eeea0-d68e-4297-84f6-247b39abdeb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:39.253219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a77eeea0-d68e-4297-84f6-247b39abdeb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:39.258893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a77eeea0-d68e-4297-84f6-247b39abdeb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:39.259631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a77eeea0-d68e-4297-84f6-247b39abdeb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:39.260240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a77eeea0-d68e-4297-84f6-247b39abdeb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:40.280865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-56a4275a-583c-4ab0-ab6f-03c05055cab4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:40.294797 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-56a4275a-583c-4ab0-ab6f-03c05055cab4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1395 microversion: 2.1 time: 1.178015 Oct 27 19:13:40.296713 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2642/5445] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:39 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1395 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:13:40.895899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a77eeea0-d68e-4297-84f6-247b39abdeb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:40.905032 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a77eeea0-d68e-4297-84f6-247b39abdeb7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 1.694865 Oct 27 19:13:40.905635 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2804/5446] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:39 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:41.321403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1e6cefc5-5a50-467b-868e-f8738fb293f5 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:41.322031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1e6cefc5-5a50-467b-868e-f8738fb293f5 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:41.327506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=42 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:13:41.345939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e6cefc5-5a50-467b-868e-f8738fb293f5 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:41.351061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e6cefc5-5a50-467b-868e-f8738fb293f5 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:41.351447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e6cefc5-5a50-467b-868e-f8738fb293f5 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:41.352209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e6cefc5-5a50-467b-868e-f8738fb293f5 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:41.352715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e6cefc5-5a50-467b-868e-f8738fb293f5 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:41.356750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e6cefc5-5a50-467b-868e-f8738fb293f5 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:41.810994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1e6cefc5-5a50-467b-868e-f8738fb293f5 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:41.819857 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1e6cefc5-5a50-467b-868e-f8738fb293f5 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1395 microversion: 2.1 time: 0.502332 Oct 27 19:13:41.820449 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2643/5447] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:41 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1395 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:42.844806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8d6b2e17-8c09-4e01-a358-db24bd1102f6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:42.846526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8d6b2e17-8c09-4e01-a358-db24bd1102f6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:42.858772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d6b2e17-8c09-4e01-a358-db24bd1102f6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:42.859273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d6b2e17-8c09-4e01-a358-db24bd1102f6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:42.862427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d6b2e17-8c09-4e01-a358-db24bd1102f6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:42.866085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d6b2e17-8c09-4e01-a358-db24bd1102f6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:42.868165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d6b2e17-8c09-4e01-a358-db24bd1102f6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:42.869623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d6b2e17-8c09-4e01-a358-db24bd1102f6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:43.929507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8d6b2e17-8c09-4e01-a358-db24bd1102f6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:43.939797 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8d6b2e17-8c09-4e01-a358-db24bd1102f6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1395 microversion: 2.1 time: 1.100118 Oct 27 19:13:43.955443 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2805/5448] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:42 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1395 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:44.979376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-428c482d-5260-4839-a146-ef58fb370e84 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:44.981055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-428c482d-5260-4839-a146-ef58fb370e84 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:45.012199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-428c482d-5260-4839-a146-ef58fb370e84 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:45.012733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-428c482d-5260-4839-a146-ef58fb370e84 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:45.013233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-428c482d-5260-4839-a146-ef58fb370e84 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:45.014210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-428c482d-5260-4839-a146-ef58fb370e84 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:45.014814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-428c482d-5260-4839-a146-ef58fb370e84 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:45.015422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-428c482d-5260-4839-a146-ef58fb370e84 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:46.108835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-428c482d-5260-4839-a146-ef58fb370e84 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:46.121108 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-428c482d-5260-4839-a146-ef58fb370e84 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1395 microversion: 2.1 time: 1.144643 Oct 27 19:13:46.127915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1468808871", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:13:46.136171 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2644/5449] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:44 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1395 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:46.175195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:13:46.253172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:13:47.152060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f1253d55-aee5-4be6-900a-4b76d6b72fe4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:47.152678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f1253d55-aee5-4be6-900a-4b76d6b72fe4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:47.169126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1253d55-aee5-4be6-900a-4b76d6b72fe4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:47.171875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1253d55-aee5-4be6-900a-4b76d6b72fe4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:47.175174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1253d55-aee5-4be6-900a-4b76d6b72fe4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:47.176382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1253d55-aee5-4be6-900a-4b76d6b72fe4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:47.178237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1253d55-aee5-4be6-900a-4b76d6b72fe4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:47.179059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1253d55-aee5-4be6-900a-4b76d6b72fe4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:47.224511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:13:47.225665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:13:47.226449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:13:47.227121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:13:47.227661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:13:47.248470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:47.268056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:47.268056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:47.275413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:47.280316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:47.280978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:47.336336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Getting quotas for project a51b615fa1e545a5a409c09a584d023e. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:13:47.350311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Getting quotas for user 9787835bd8474440ae0d2f9353d46695 and project a51b615fa1e545a5a409c09a584d023e. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:13:47.389815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:13:47.392783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:13:47.496021 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0b3aa71d-7d2d-43bc-a6fe-22bce17823d9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.367299 Oct 27 19:13:47.502130 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2806/5450] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:13:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 19:13:47.529994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e4d90878-08e9-4fe4-bb3f-c864bd1a33a6 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:47.532627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e4d90878-08e9-4fe4-bb3f-c864bd1a33a6 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:47.689841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e4d90878-08e9-4fe4-bb3f-c864bd1a33a6 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:47.709395 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e4d90878-08e9-4fe4-bb3f-c864bd1a33a6 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1215 microversion: 2.1 time: 0.196210 Oct 27 19:13:47.711302 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2807/5451] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:47 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:48.068459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f1253d55-aee5-4be6-900a-4b76d6b72fe4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:48.090709 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f1253d55-aee5-4be6-900a-4b76d6b72fe4 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1395 microversion: 2.1 time: 0.944776 Oct 27 19:13:48.091323 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2645/5452] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:47 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1395 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:48.719484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-27f5400b-9b3c-4c61-b573-0b10576fb7f9 req-d2c4242d-af08-48bd-8987-0d31b7f23fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4486b6a9-6328-460b-87bf-cd8924dd88ed", "name": "network-vif-plugged", "status": "completed", "tag": "3a060186-5be2-4385-a9d5-864794d0d603"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:13:48.737253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-30361251-c62a-43bb-82ac-d18d2754c2b0 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:48.738118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-30361251-c62a-43bb-82ac-d18d2754c2b0 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:48.748590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-27f5400b-9b3c-4c61-b573-0b10576fb7f9 req-d2c4242d-af08-48bd-8987-0d31b7f23fd8 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:48.749112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-27f5400b-9b3c-4c61-b573-0b10576fb7f9 req-d2c4242d-af08-48bd-8987-0d31b7f23fd8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:48.749597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-27f5400b-9b3c-4c61-b573-0b10576fb7f9 req-d2c4242d-af08-48bd-8987-0d31b7f23fd8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:48.762685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30361251-c62a-43bb-82ac-d18d2754c2b0 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:48.763200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30361251-c62a-43bb-82ac-d18d2754c2b0 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:48.763811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30361251-c62a-43bb-82ac-d18d2754c2b0 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:48.764376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30361251-c62a-43bb-82ac-d18d2754c2b0 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:48.764847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30361251-c62a-43bb-82ac-d18d2754c2b0 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:48.765280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30361251-c62a-43bb-82ac-d18d2754c2b0 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:48.828637 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-27f5400b-9b3c-4c61-b573-0b10576fb7f9 req-d2c4242d-af08-48bd-8987-0d31b7f23fd8 service nova] Creating event network-vif-plugged:3a060186-5be2-4385-a9d5-864794d0d603 for instance 4486b6a9-6328-460b-87bf-cd8924dd88ed on n-h2-860687-3 Oct 27 19:13:48.853707 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-27f5400b-9b3c-4c61-b573-0b10576fb7f9 req-d2c4242d-af08-48bd-8987-0d31b7f23fd8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138085 Oct 27 19:13:48.854367 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2808/5453] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:13:49.021816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-30361251-c62a-43bb-82ac-d18d2754c2b0 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:49.039054 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-30361251-c62a-43bb-82ac-d18d2754c2b0 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1211 microversion: 2.1 time: 0.307227 Oct 27 19:13:49.044537 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2646/5454] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:48 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1211 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:49.121892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7c6f7bc1-58b4-4b58-aab0-aa0da68a9be6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:49.123049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7c6f7bc1-58b4-4b58-aab0-aa0da68a9be6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:49.147766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c6f7bc1-58b4-4b58-aab0-aa0da68a9be6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:49.149603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c6f7bc1-58b4-4b58-aab0-aa0da68a9be6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:49.151489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c6f7bc1-58b4-4b58-aab0-aa0da68a9be6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:49.153627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c6f7bc1-58b4-4b58-aab0-aa0da68a9be6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:49.154302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c6f7bc1-58b4-4b58-aab0-aa0da68a9be6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:49.154896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c6f7bc1-58b4-4b58-aab0-aa0da68a9be6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:49.589411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7c6f7bc1-58b4-4b58-aab0-aa0da68a9be6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:49.607306 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7c6f7bc1-58b4-4b58-aab0-aa0da68a9be6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1395 microversion: 2.1 time: 0.490455 Oct 27 19:13:49.607953 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2809/5455] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:49 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1395 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:50.073635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6e4f3429-aa93-4c6b-a42d-6ce93b6450c7 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:50.075080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6e4f3429-aa93-4c6b-a42d-6ce93b6450c7 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:50.112636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e4f3429-aa93-4c6b-a42d-6ce93b6450c7 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:50.114125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e4f3429-aa93-4c6b-a42d-6ce93b6450c7 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:50.121347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e4f3429-aa93-4c6b-a42d-6ce93b6450c7 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:50.122304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e4f3429-aa93-4c6b-a42d-6ce93b6450c7 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:50.123994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e4f3429-aa93-4c6b-a42d-6ce93b6450c7 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:50.126752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e4f3429-aa93-4c6b-a42d-6ce93b6450c7 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:50.490591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6e4f3429-aa93-4c6b-a42d-6ce93b6450c7 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:50.511149 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6e4f3429-aa93-4c6b-a42d-6ce93b6450c7 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1285 microversion: 2.1 time: 0.431189 Oct 27 19:13:50.512151 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2647/5456] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:50 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1285 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:50.636972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c1e36083-cd81-46d0-8450-a02f8f043e20 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:50.637653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c1e36083-cd81-46d0-8450-a02f8f043e20 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:50.659817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1e36083-cd81-46d0-8450-a02f8f043e20 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:50.667755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1e36083-cd81-46d0-8450-a02f8f043e20 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:50.670926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1e36083-cd81-46d0-8450-a02f8f043e20 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:50.672383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1e36083-cd81-46d0-8450-a02f8f043e20 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:50.672383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1e36083-cd81-46d0-8450-a02f8f043e20 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:50.675476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1e36083-cd81-46d0-8450-a02f8f043e20 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:51.315651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c1e36083-cd81-46d0-8450-a02f8f043e20 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:51.332633 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c1e36083-cd81-46d0-8450-a02f8f043e20 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1395 microversion: 2.1 time: 0.700393 Oct 27 19:13:51.336001 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2810/5457] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:50 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1395 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:51.536374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ce0931bd-c64f-4440-8a7d-2bdf1c877853 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:51.537001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ce0931bd-c64f-4440-8a7d-2bdf1c877853 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:51.551310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce0931bd-c64f-4440-8a7d-2bdf1c877853 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:51.551822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce0931bd-c64f-4440-8a7d-2bdf1c877853 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:51.552273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce0931bd-c64f-4440-8a7d-2bdf1c877853 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:51.553006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce0931bd-c64f-4440-8a7d-2bdf1c877853 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:51.553475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce0931bd-c64f-4440-8a7d-2bdf1c877853 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:51.553918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce0931bd-c64f-4440-8a7d-2bdf1c877853 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:51.907341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ce0931bd-c64f-4440-8a7d-2bdf1c877853 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:51.917147 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ce0931bd-c64f-4440-8a7d-2bdf1c877853 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1273 microversion: 2.1 time: 0.384783 Oct 27 19:13:51.928934 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2648/5458] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:51 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1273 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:52.370629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9c926e72-102a-49b7-8595-66f807be89c6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:52.372465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9c926e72-102a-49b7-8595-66f807be89c6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:52.391392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c926e72-102a-49b7-8595-66f807be89c6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:52.392585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c926e72-102a-49b7-8595-66f807be89c6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:52.393579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c926e72-102a-49b7-8595-66f807be89c6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:52.394809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c926e72-102a-49b7-8595-66f807be89c6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:52.395507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c926e72-102a-49b7-8595-66f807be89c6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:52.397358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c926e72-102a-49b7-8595-66f807be89c6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:52.483409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:13:52.956984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ad905a76-ebed-437c-bc64-6f46f917660e tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:52.959635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ad905a76-ebed-437c-bc64-6f46f917660e tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:52.987639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad905a76-ebed-437c-bc64-6f46f917660e tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:52.988249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad905a76-ebed-437c-bc64-6f46f917660e tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:52.994691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad905a76-ebed-437c-bc64-6f46f917660e tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:52.996532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad905a76-ebed-437c-bc64-6f46f917660e tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:52.997193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad905a76-ebed-437c-bc64-6f46f917660e tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:53.005789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad905a76-ebed-437c-bc64-6f46f917660e tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:53.496420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9c926e72-102a-49b7-8595-66f807be89c6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:53.519827 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9c926e72-102a-49b7-8595-66f807be89c6 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1576 microversion: 2.1 time: 1.152786 Oct 27 19:13:53.551189 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2811/5459] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:52 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1576 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:53.589312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-23a75b1d-60db-4631-8126-1f2214e74f56 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:53.593937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-23a75b1d-60db-4631-8126-1f2214e74f56 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:53.609200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23a75b1d-60db-4631-8126-1f2214e74f56 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:53.612841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23a75b1d-60db-4631-8126-1f2214e74f56 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:53.614625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23a75b1d-60db-4631-8126-1f2214e74f56 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:53.615799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23a75b1d-60db-4631-8126-1f2214e74f56 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:53.621610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23a75b1d-60db-4631-8126-1f2214e74f56 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:53.622933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23a75b1d-60db-4631-8126-1f2214e74f56 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:54.087961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ad905a76-ebed-437c-bc64-6f46f917660e tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:54.101734 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ad905a76-ebed-437c-bc64-6f46f917660e tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1273 microversion: 2.1 time: 1.149990 Oct 27 19:13:54.109040 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2649/5460] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:52 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1273 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:13:54.178161 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-23a75b1d-60db-4631-8126-1f2214e74f56 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.609671 Oct 27 19:13:54.179111 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2812/5461] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:13:53 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed/os-interface => generated 284 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:13:55.151808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9cecd437-8e20-4cd9-b597-a89e27055c5d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:55.152625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9cecd437-8e20-4cd9-b597-a89e27055c5d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:55.181777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cecd437-8e20-4cd9-b597-a89e27055c5d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:55.185578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cecd437-8e20-4cd9-b597-a89e27055c5d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:55.190749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cecd437-8e20-4cd9-b597-a89e27055c5d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:55.191834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cecd437-8e20-4cd9-b597-a89e27055c5d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:55.192563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cecd437-8e20-4cd9-b597-a89e27055c5d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:55.193164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9cecd437-8e20-4cd9-b597-a89e27055c5d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:55.698876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9cecd437-8e20-4cd9-b597-a89e27055c5d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:55.720031 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9cecd437-8e20-4cd9-b597-a89e27055c5d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1273 microversion: 2.1 time: 0.578156 Oct 27 19:13:55.720734 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2650/5462] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:55 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1273 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:56.525245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0734a13b-c3b7-4ddd-bc4f-d062951c5274 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:13:56.529020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0734a13b-c3b7-4ddd-bc4f-d062951c5274 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:56.558011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0734a13b-c3b7-4ddd-bc4f-d062951c5274 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:56.560039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0734a13b-c3b7-4ddd-bc4f-d062951c5274 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:56.560654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0734a13b-c3b7-4ddd-bc4f-d062951c5274 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:56.561581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0734a13b-c3b7-4ddd-bc4f-d062951c5274 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:56.562165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0734a13b-c3b7-4ddd-bc4f-d062951c5274 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:56.562738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0734a13b-c3b7-4ddd-bc4f-d062951c5274 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:56.748347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-61219d20-990d-48e9-afbe-d6773fb57fd2 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:56.749104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-61219d20-990d-48e9-afbe-d6773fb57fd2 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:56.766242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61219d20-990d-48e9-afbe-d6773fb57fd2 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:56.766793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61219d20-990d-48e9-afbe-d6773fb57fd2 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:56.767249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61219d20-990d-48e9-afbe-d6773fb57fd2 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:56.767972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61219d20-990d-48e9-afbe-d6773fb57fd2 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:56.768441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61219d20-990d-48e9-afbe-d6773fb57fd2 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:56.768948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61219d20-990d-48e9-afbe-d6773fb57fd2 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:56.997684 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0734a13b-c3b7-4ddd-bc4f-d062951c5274 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.477657 Oct 27 19:13:56.999058 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2813/5463] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:13:56 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:13:57.016311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9e33497-32a4-4104-81bd-dc52d4aeb706 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:57.017278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c9e33497-32a4-4104-81bd-dc52d4aeb706 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:57.025785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9e33497-32a4-4104-81bd-dc52d4aeb706 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:57.029005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9e33497-32a4-4104-81bd-dc52d4aeb706 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:57.029725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9e33497-32a4-4104-81bd-dc52d4aeb706 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:57.031073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9e33497-32a4-4104-81bd-dc52d4aeb706 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:57.031741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9e33497-32a4-4104-81bd-dc52d4aeb706 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:57.032366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9e33497-32a4-4104-81bd-dc52d4aeb706 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:57.301187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:13:57.697690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:13:57.838851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-61219d20-990d-48e9-afbe-d6773fb57fd2 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:57.867359 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-61219d20-990d-48e9-afbe-d6773fb57fd2 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1315 microversion: 2.1 time: 1.123496 Oct 27 19:13:57.868241 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2651/5464] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:56 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1315 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:13:58.288178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-97ccd6c3-fca1-40c7-85b4-fe017322db43 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:58.288722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-97ccd6c3-fca1-40c7-85b4-fe017322db43 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:58.297657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97ccd6c3-fca1-40c7-85b4-fe017322db43 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:58.314617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97ccd6c3-fca1-40c7-85b4-fe017322db43 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:58.315161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97ccd6c3-fca1-40c7-85b4-fe017322db43 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:58.315957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97ccd6c3-fca1-40c7-85b4-fe017322db43 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:58.316439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97ccd6c3-fca1-40c7-85b4-fe017322db43 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:58.316890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97ccd6c3-fca1-40c7-85b4-fe017322db43 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:58.354036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c9e33497-32a4-4104-81bd-dc52d4aeb706 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:58.367275 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c9e33497-32a4-4104-81bd-dc52d4aeb706 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1671 microversion: 2.1 time: 1.362331 Oct 27 19:13:58.376859 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2814/5465] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:57 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1671 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:13:58.392360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6cd950ec-5893-48a3-9496-d15cc670f649 req-6282615f-cab4-4380-a519-f16c4b1470d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4486b6a9-6328-460b-87bf-cd8924dd88ed", "tag": "3a060186-5be2-4385-a9d5-864794d0d603"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:13:58.437235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6cd950ec-5893-48a3-9496-d15cc670f649 req-6282615f-cab4-4380-a519-f16c4b1470d5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:58.438062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6cd950ec-5893-48a3-9496-d15cc670f649 req-6282615f-cab4-4380-a519-f16c4b1470d5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:58.438799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6cd950ec-5893-48a3-9496-d15cc670f649 req-6282615f-cab4-4380-a519-f16c4b1470d5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:58.495899 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6cd950ec-5893-48a3-9496-d15cc670f649 req-6282615f-cab4-4380-a519-f16c4b1470d5 service nova] Creating event network-changed:3a060186-5be2-4385-a9d5-864794d0d603 for instance 4486b6a9-6328-460b-87bf-cd8924dd88ed on n-h2-860687-3 Oct 27 19:13:58.521292 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6cd950ec-5893-48a3-9496-d15cc670f649 req-6282615f-cab4-4380-a519-f16c4b1470d5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142698 Oct 27 19:13:58.521929 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2815/5466] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:13:58.902559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b2dc7ef1-a360-464c-9891-4bb64703def3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:58.903287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b2dc7ef1-a360-464c-9891-4bb64703def3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:58.913257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2dc7ef1-a360-464c-9891-4bb64703def3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:58.913823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2dc7ef1-a360-464c-9891-4bb64703def3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:58.914213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2dc7ef1-a360-464c-9891-4bb64703def3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:58.935639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2dc7ef1-a360-464c-9891-4bb64703def3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:58.936066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2dc7ef1-a360-464c-9891-4bb64703def3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:58.936534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2dc7ef1-a360-464c-9891-4bb64703def3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:59.013975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-97ccd6c3-fca1-40c7-85b4-fe017322db43 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:13:59.035390 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-97ccd6c3-fca1-40c7-85b4-fe017322db43 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1576 microversion: 2.1 time: 0.749089 Oct 27 19:13:59.060880 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2652/5467] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:58 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1576 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:13:59.400571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b84ef8e6-b458-481a-a46e-089afc74a45b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:13:59.400571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b84ef8e6-b458-481a-a46e-089afc74a45b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:13:59.411224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b84ef8e6-b458-481a-a46e-089afc74a45b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:59.411730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b84ef8e6-b458-481a-a46e-089afc74a45b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:59.418120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b84ef8e6-b458-481a-a46e-089afc74a45b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:13:59.420399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b84ef8e6-b458-481a-a46e-089afc74a45b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:13:59.421787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b84ef8e6-b458-481a-a46e-089afc74a45b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:13:59.423787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b84ef8e6-b458-481a-a46e-089afc74a45b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:00.428112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b2dc7ef1-a360-464c-9891-4bb64703def3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:00.449320 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b2dc7ef1-a360-464c-9891-4bb64703def3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1315 microversion: 2.1 time: 1.554310 Oct 27 19:14:00.452302 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2816/5468] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:58 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1315 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:14:00.735883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b84ef8e6-b458-481a-a46e-089afc74a45b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:00.752689 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b84ef8e6-b458-481a-a46e-089afc74a45b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1671 microversion: 2.1 time: 1.356655 Oct 27 19:14:00.780158 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2653/5469] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:13:59 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1671 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:14:01.474497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cbded05f-5c26-4522-abf7-85deef9ee628 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:01.475702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cbded05f-5c26-4522-abf7-85deef9ee628 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:01.487987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbded05f-5c26-4522-abf7-85deef9ee628 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:01.490373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbded05f-5c26-4522-abf7-85deef9ee628 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:01.492950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbded05f-5c26-4522-abf7-85deef9ee628 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:01.493881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbded05f-5c26-4522-abf7-85deef9ee628 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:01.503214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbded05f-5c26-4522-abf7-85deef9ee628 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:01.503690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbded05f-5c26-4522-abf7-85deef9ee628 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:01.783618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-87c7813d-f926-4f57-90b9-7fcb971e0db2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:01.784838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-87c7813d-f926-4f57-90b9-7fcb971e0db2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:01.797586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87c7813d-f926-4f57-90b9-7fcb971e0db2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:01.801391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87c7813d-f926-4f57-90b9-7fcb971e0db2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:01.807420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87c7813d-f926-4f57-90b9-7fcb971e0db2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:01.808494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87c7813d-f926-4f57-90b9-7fcb971e0db2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:01.809148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87c7813d-f926-4f57-90b9-7fcb971e0db2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:01.809760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87c7813d-f926-4f57-90b9-7fcb971e0db2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:02.580890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cbded05f-5c26-4522-abf7-85deef9ee628 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:02.592337 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cbded05f-5c26-4522-abf7-85deef9ee628 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1315 microversion: 2.1 time: 1.122011 Oct 27 19:14:02.602430 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2817/5470] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:01 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1315 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:02.832163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-87c7813d-f926-4f57-90b9-7fcb971e0db2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:02.853459 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-87c7813d-f926-4f57-90b9-7fcb971e0db2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1676 microversion: 2.1 time: 1.074400 Oct 27 19:14:02.854981 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2654/5471] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:01 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1676 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:02.966576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-0016dc80-52e8-41fc-8887-6658bb0978b2 req-95d97ee6-912e-4ff2-b794-e3f4d5eab8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942e53b4-7319-4bf6-b4fb-1839d390e0db", "tag": "b6d61f01-230f-43c4-92a3-5f549277f6e2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:14:03.013495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0016dc80-52e8-41fc-8887-6658bb0978b2 req-95d97ee6-912e-4ff2-b794-e3f4d5eab8b5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:03.016145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0016dc80-52e8-41fc-8887-6658bb0978b2 req-95d97ee6-912e-4ff2-b794-e3f4d5eab8b5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:03.018155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0016dc80-52e8-41fc-8887-6658bb0978b2 req-95d97ee6-912e-4ff2-b794-e3f4d5eab8b5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:03.070983 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-0016dc80-52e8-41fc-8887-6658bb0978b2 req-95d97ee6-912e-4ff2-b794-e3f4d5eab8b5 service nova] Creating event network-changed:b6d61f01-230f-43c4-92a3-5f549277f6e2 for instance 942e53b4-7319-4bf6-b4fb-1839d390e0db on n-h1-860687-3 Oct 27 19:14:03.088311 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-0016dc80-52e8-41fc-8887-6658bb0978b2 req-95d97ee6-912e-4ff2-b794-e3f4d5eab8b5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139999 Oct 27 19:14:03.091888 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2818/5472] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:14:03.621223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-12922567-0f7f-4d31-8f45-059aaaf2c265 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:03.622013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-12922567-0f7f-4d31-8f45-059aaaf2c265 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:03.634270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12922567-0f7f-4d31-8f45-059aaaf2c265 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:03.636040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12922567-0f7f-4d31-8f45-059aaaf2c265 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:03.637812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12922567-0f7f-4d31-8f45-059aaaf2c265 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:03.638741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12922567-0f7f-4d31-8f45-059aaaf2c265 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:03.645835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12922567-0f7f-4d31-8f45-059aaaf2c265 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:03.646523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12922567-0f7f-4d31-8f45-059aaaf2c265 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:03.881905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e757ed5e-53ca-450f-9dd5-78f5912d47f3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:03.882763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e757ed5e-53ca-450f-9dd5-78f5912d47f3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:03.896400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e757ed5e-53ca-450f-9dd5-78f5912d47f3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:03.897070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e757ed5e-53ca-450f-9dd5-78f5912d47f3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:03.897646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e757ed5e-53ca-450f-9dd5-78f5912d47f3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:03.914816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e757ed5e-53ca-450f-9dd5-78f5912d47f3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:03.917492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e757ed5e-53ca-450f-9dd5-78f5912d47f3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:03.920495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e757ed5e-53ca-450f-9dd5-78f5912d47f3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:04.458174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-12922567-0f7f-4d31-8f45-059aaaf2c265 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:04.458865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e757ed5e-53ca-450f-9dd5-78f5912d47f3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:04.495205 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-12922567-0f7f-4d31-8f45-059aaaf2c265 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1315 microversion: 2.1 time: 0.879437 Oct 27 19:14:04.497942 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e757ed5e-53ca-450f-9dd5-78f5912d47f3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.622275 Oct 27 19:14:04.499711 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2655/5473] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:03 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1315 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:04.500317 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2819/5474] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:03 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:05.534841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ce68e566-2177-40ce-bb7a-c0fcb46ff6e3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:05.535587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ce68e566-2177-40ce-bb7a-c0fcb46ff6e3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:05.548111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce68e566-2177-40ce-bb7a-c0fcb46ff6e3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:05.549282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce68e566-2177-40ce-bb7a-c0fcb46ff6e3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:05.550002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce68e566-2177-40ce-bb7a-c0fcb46ff6e3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:05.551931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce68e566-2177-40ce-bb7a-c0fcb46ff6e3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:05.552614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce68e566-2177-40ce-bb7a-c0fcb46ff6e3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:05.562221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce68e566-2177-40ce-bb7a-c0fcb46ff6e3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:05.609387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:14:06.613324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ce68e566-2177-40ce-bb7a-c0fcb46ff6e3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:06.631038 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ce68e566-2177-40ce-bb7a-c0fcb46ff6e3 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1315 microversion: 2.1 time: 1.109923 Oct 27 19:14:06.631641 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2656/5475] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:05 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1315 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:07.658042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1382058e-64d2-4d78-88ef-5030c15ceb4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:07.658765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1382058e-64d2-4d78-88ef-5030c15ceb4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:07.669717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1382058e-64d2-4d78-88ef-5030c15ceb4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:07.670225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1382058e-64d2-4d78-88ef-5030c15ceb4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:07.670702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1382058e-64d2-4d78-88ef-5030c15ceb4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:07.675197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1382058e-64d2-4d78-88ef-5030c15ceb4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:07.679034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1382058e-64d2-4d78-88ef-5030c15ceb4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:07.679795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1382058e-64d2-4d78-88ef-5030c15ceb4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:08.062526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1382058e-64d2-4d78-88ef-5030c15ceb4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:08.090718 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1382058e-64d2-4d78-88ef-5030c15ceb4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1315 microversion: 2.1 time: 0.426344 Oct 27 19:14:08.090718 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2820/5476] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:07 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:08.781020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-341a0ac2-607a-4474-af16-f09e521cbfec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'create', calling method: .version_select at 0x7fc86ae60310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-663006804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLT0DuuN7MNUVqw3/6SAl4l5SqD0zZXIsWGBUgsme51dNSc7Rvfe9McCQd0snwycQa/Qc2XuyhU4CLTnuef/66yKS6WsJ5uJm8ZViBc9RkkLwe1K5tATrxpKepgyyki8A=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:14:08.815298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-341a0ac2-607a-4474-af16-f09e521cbfec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for project 853ac0c6e395469bb90c156aad129c26. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:14:08.826595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-341a0ac2-607a-4474-af16-f09e521cbfec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for user ce7f16b54dda477386daed20f1a2e104 and project 853ac0c6e395469bb90c156aad129c26. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:14:08.894561 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-341a0ac2-607a-4474-af16-f09e521cbfec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.486366 Oct 27 19:14:08.895363 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2657/5477] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:14:08 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:14:09.112581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-600d4a3a-397a-4bd7-a777-80bfa17c91a4 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:09.114039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-600d4a3a-397a-4bd7-a777-80bfa17c91a4 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:09.126928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-600d4a3a-397a-4bd7-a777-80bfa17c91a4 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:09.131614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-600d4a3a-397a-4bd7-a777-80bfa17c91a4 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:09.132444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-600d4a3a-397a-4bd7-a777-80bfa17c91a4 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:09.133461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-600d4a3a-397a-4bd7-a777-80bfa17c91a4 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:09.134785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-600d4a3a-397a-4bd7-a777-80bfa17c91a4 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:09.142183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-600d4a3a-397a-4bd7-a777-80bfa17c91a4 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:10.087645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-600d4a3a-397a-4bd7-a777-80bfa17c91a4 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:10.107084 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-600d4a3a-397a-4bd7-a777-80bfa17c91a4 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1315 microversion: 2.1 time: 0.995386 Oct 27 19:14:10.109984 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2821/5478] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:09 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1315 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:11.134300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b5f68370-a022-4357-af4b-9d7e83f5857a tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:11.135906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b5f68370-a022-4357-af4b-9d7e83f5857a tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:11.143399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5f68370-a022-4357-af4b-9d7e83f5857a tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:11.144145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5f68370-a022-4357-af4b-9d7e83f5857a tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:11.144742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5f68370-a022-4357-af4b-9d7e83f5857a tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:11.145607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5f68370-a022-4357-af4b-9d7e83f5857a tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:11.146219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5f68370-a022-4357-af4b-9d7e83f5857a tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:11.146880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5f68370-a022-4357-af4b-9d7e83f5857a tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:11.475663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b5f68370-a022-4357-af4b-9d7e83f5857a tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:11.489231 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b5f68370-a022-4357-af4b-9d7e83f5857a tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1315 microversion: 2.1 time: 0.359737 Oct 27 19:14:11.489843 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2658/5479] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:11 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:12.519860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-287e1929-aa62-4134-ad1a-21d3b8cfb651 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:12.520483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-287e1929-aa62-4134-ad1a-21d3b8cfb651 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:12.537361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-287e1929-aa62-4134-ad1a-21d3b8cfb651 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:12.538254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-287e1929-aa62-4134-ad1a-21d3b8cfb651 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:12.540837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-287e1929-aa62-4134-ad1a-21d3b8cfb651 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:12.541867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-287e1929-aa62-4134-ad1a-21d3b8cfb651 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:12.544496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-287e1929-aa62-4134-ad1a-21d3b8cfb651 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:12.545128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-287e1929-aa62-4134-ad1a-21d3b8cfb651 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:12.767438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b3110c8d-5614-4aaa-9fdf-466a6ad94226 req-8a0a58f1-506d-4aa7-97b0-122a3ca3df75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942e53b4-7319-4bf6-b4fb-1839d390e0db", "name": "network-vif-plugged", "status": "completed", "tag": "b6d61f01-230f-43c4-92a3-5f549277f6e2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:14:12.785841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:14:12.792624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b3110c8d-5614-4aaa-9fdf-466a6ad94226 req-8a0a58f1-506d-4aa7-97b0-122a3ca3df75 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:12.793518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b3110c8d-5614-4aaa-9fdf-466a6ad94226 req-8a0a58f1-506d-4aa7-97b0-122a3ca3df75 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:12.794274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b3110c8d-5614-4aaa-9fdf-466a6ad94226 req-8a0a58f1-506d-4aa7-97b0-122a3ca3df75 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:12.831679 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b3110c8d-5614-4aaa-9fdf-466a6ad94226 req-8a0a58f1-506d-4aa7-97b0-122a3ca3df75 service nova] Creating event network-vif-plugged:b6d61f01-230f-43c4-92a3-5f549277f6e2 for instance 942e53b4-7319-4bf6-b4fb-1839d390e0db on n-h1-860687-3 Oct 27 19:14:12.843370 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b3110c8d-5614-4aaa-9fdf-466a6ad94226 req-8a0a58f1-506d-4aa7-97b0-122a3ca3df75 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079400 Oct 27 19:14:12.844554 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2659/5480] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:14:13.505692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-287e1929-aa62-4134-ad1a-21d3b8cfb651 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:13.523645 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-287e1929-aa62-4134-ad1a-21d3b8cfb651 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1315 microversion: 2.1 time: 1.007444 Oct 27 19:14:13.525309 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2822/5481] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:12 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1315 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:14.555216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ab7499cd-ec75-4b35-a63b-6b0be537794c tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:14.557474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ab7499cd-ec75-4b35-a63b-6b0be537794c tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:14.574533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab7499cd-ec75-4b35-a63b-6b0be537794c tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:14.589758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab7499cd-ec75-4b35-a63b-6b0be537794c tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:14.590546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab7499cd-ec75-4b35-a63b-6b0be537794c tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:14.591569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab7499cd-ec75-4b35-a63b-6b0be537794c tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:14.592210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab7499cd-ec75-4b35-a63b-6b0be537794c tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:14.593492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab7499cd-ec75-4b35-a63b-6b0be537794c tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:15.023921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ab7499cd-ec75-4b35-a63b-6b0be537794c tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:15.055886 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ab7499cd-ec75-4b35-a63b-6b0be537794c tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1315 microversion: 2.1 time: 0.507091 Oct 27 19:14:15.078798 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2660/5482] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:14 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:16.088674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e2190cd5-bdaf-4c57-915f-568bfeba9c06 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:16.090036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e2190cd5-bdaf-4c57-915f-568bfeba9c06 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:16.114089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2190cd5-bdaf-4c57-915f-568bfeba9c06 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:16.114636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2190cd5-bdaf-4c57-915f-568bfeba9c06 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:16.115084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2190cd5-bdaf-4c57-915f-568bfeba9c06 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:16.115805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2190cd5-bdaf-4c57-915f-568bfeba9c06 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:16.116283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2190cd5-bdaf-4c57-915f-568bfeba9c06 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:16.122415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2190cd5-bdaf-4c57-915f-568bfeba9c06 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:16.963429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e2190cd5-bdaf-4c57-915f-568bfeba9c06 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:16.979517 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e2190cd5-bdaf-4c57-915f-568bfeba9c06 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1465 microversion: 2.1 time: 0.898992 Oct 27 19:14:16.980409 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2823/5483] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:16 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1465 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:17.061318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-af92a8fa-a93b-425a-8808-852e58d7aa78 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:17.061954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-af92a8fa-a93b-425a-8808-852e58d7aa78 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:17.086028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af92a8fa-a93b-425a-8808-852e58d7aa78 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:17.086560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af92a8fa-a93b-425a-8808-852e58d7aa78 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:17.087014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af92a8fa-a93b-425a-8808-852e58d7aa78 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:17.087741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af92a8fa-a93b-425a-8808-852e58d7aa78 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:17.088758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af92a8fa-a93b-425a-8808-852e58d7aa78 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:17.089609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af92a8fa-a93b-425a-8808-852e58d7aa78 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:17.141721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-af92a8fa-a93b-425a-8808-852e58d7aa78 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:14:17.275080 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-af92a8fa-a93b-425a-8808-852e58d7aa78 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 204 len: 0 microversion: 2.1 time: 0.219345 Oct 27 19:14:17.286153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fb637e2c-de43-42b7-a976-21a1eac9bd4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:17.286890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fb637e2c-de43-42b7-a976-21a1eac9bd4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:17.290049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:14:17.292286 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2661/5484] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:14:17 2022] DELETE /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:14:17.297762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb637e2c-de43-42b7-a976-21a1eac9bd4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:17.298526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb637e2c-de43-42b7-a976-21a1eac9bd4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:17.300853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb637e2c-de43-42b7-a976-21a1eac9bd4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:17.301587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb637e2c-de43-42b7-a976-21a1eac9bd4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:17.302052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb637e2c-de43-42b7-a976-21a1eac9bd4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:17.304414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb637e2c-de43-42b7-a976-21a1eac9bd4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:18.372372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fb637e2c-de43-42b7-a976-21a1eac9bd4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:18.404729 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fb637e2c-de43-42b7-a976-21a1eac9bd4d tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1471 microversion: 2.1 time: 1.115786 Oct 27 19:14:18.408001 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2824/5485] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:17 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1471 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:19.439522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6cd125aa-b5e9-4dcc-a59b-08532d2913b6 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:19.440903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6cd125aa-b5e9-4dcc-a59b-08532d2913b6 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:19.449239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:14:19.451741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cd125aa-b5e9-4dcc-a59b-08532d2913b6 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:19.453789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cd125aa-b5e9-4dcc-a59b-08532d2913b6 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:19.453789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cd125aa-b5e9-4dcc-a59b-08532d2913b6 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:19.453789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cd125aa-b5e9-4dcc-a59b-08532d2913b6 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:19.456581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cd125aa-b5e9-4dcc-a59b-08532d2913b6 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:19.457251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cd125aa-b5e9-4dcc-a59b-08532d2913b6 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:20.527157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6cd125aa-b5e9-4dcc-a59b-08532d2913b6 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:20.539329 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6cd125aa-b5e9-4dcc-a59b-08532d2913b6 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1471 microversion: 2.1 time: 1.109272 Oct 27 19:14:20.550959 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2662/5486] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:19 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1471 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:21.565824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-951309cd-a92d-4332-8593-744bc85a25a9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:21.566485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-951309cd-a92d-4332-8593-744bc85a25a9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:21.587394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-951309cd-a92d-4332-8593-744bc85a25a9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:21.588768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-951309cd-a92d-4332-8593-744bc85a25a9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:21.589572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-951309cd-a92d-4332-8593-744bc85a25a9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:21.590601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-951309cd-a92d-4332-8593-744bc85a25a9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:21.591232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-951309cd-a92d-4332-8593-744bc85a25a9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:21.594210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-951309cd-a92d-4332-8593-744bc85a25a9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:22.850722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-951309cd-a92d-4332-8593-744bc85a25a9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:22.857853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:14:22.865050 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-951309cd-a92d-4332-8593-744bc85a25a9 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1429 microversion: 2.1 time: 1.301763 Oct 27 19:14:22.866913 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2825/5487] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:21 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1429 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:23.844181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-3f79d621-4e0d-46a2-a6c5-3ba42df567f0 req-cb5212d1-27d8-479e-a004-50017fe4aad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942e53b4-7319-4bf6-b4fb-1839d390e0db", "name": "network-vif-deleted", "tag": "b6d61f01-230f-43c4-92a3-5f549277f6e2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:14:23.889478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3f79d621-4e0d-46a2-a6c5-3ba42df567f0 req-cb5212d1-27d8-479e-a004-50017fe4aad7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:23.892921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3f79d621-4e0d-46a2-a6c5-3ba42df567f0 req-cb5212d1-27d8-479e-a004-50017fe4aad7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:23.892921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3f79d621-4e0d-46a2-a6c5-3ba42df567f0 req-cb5212d1-27d8-479e-a004-50017fe4aad7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:23.905687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3c0508e5-8734-4289-adaf-fd33e1feddec tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:23.910817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3c0508e5-8734-4289-adaf-fd33e1feddec tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:23.942070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c0508e5-8734-4289-adaf-fd33e1feddec tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:23.946745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c0508e5-8734-4289-adaf-fd33e1feddec tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:23.953035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c0508e5-8734-4289-adaf-fd33e1feddec tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:23.953828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c0508e5-8734-4289-adaf-fd33e1feddec tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:23.958485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c0508e5-8734-4289-adaf-fd33e1feddec tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:23.959081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c0508e5-8734-4289-adaf-fd33e1feddec tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:23.980459 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-3f79d621-4e0d-46a2-a6c5-3ba42df567f0 req-cb5212d1-27d8-479e-a004-50017fe4aad7 service nova] Creating event network-vif-deleted:b6d61f01-230f-43c4-92a3-5f549277f6e2 for instance 942e53b4-7319-4bf6-b4fb-1839d390e0db on n-h1-860687-3 Oct 27 19:14:23.994711 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-3f79d621-4e0d-46a2-a6c5-3ba42df567f0 req-cb5212d1-27d8-479e-a004-50017fe4aad7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156960 Oct 27 19:14:23.997254 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2663/5488] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:14:24.110415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c0508e5-8734-4289-adaf-fd33e1feddec tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:24.111493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c0508e5-8734-4289-adaf-fd33e1feddec tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:24.112896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c0508e5-8734-4289-adaf-fd33e1feddec tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:24.113529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-3c0508e5-8734-4289-adaf-fd33e1feddec tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lazy-loading 'fault' on Instance uuid 942e53b4-7319-4bf6-b4fb-1839d390e0db {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:14:24.410353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3c0508e5-8734-4289-adaf-fd33e1feddec tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9787835bd8474440ae0d2f9353d46695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51b615fa1e545a5a409c09a584d023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:24.428728 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3c0508e5-8734-4289-adaf-fd33e1feddec tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 200 len: 1305 microversion: 2.1 time: 0.531920 Oct 27 19:14:24.430789 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2826/5489] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:23 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 1305 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:14:25.460841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8938cf35-c3e9-4cd8-9081-2bf323383011 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:25.461689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8938cf35-c3e9-4cd8-9081-2bf323383011 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] [instance: 942e53b4-7319-4bf6-b4fb-1839d390e0db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:25.495563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8938cf35-c3e9-4cd8-9081-2bf323383011 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:25.499761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8938cf35-c3e9-4cd8-9081-2bf323383011 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:25.503207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8938cf35-c3e9-4cd8-9081-2bf323383011 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:25.512194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8938cf35-c3e9-4cd8-9081-2bf323383011 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:25.515502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8938cf35-c3e9-4cd8-9081-2bf323383011 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:25.518053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8938cf35-c3e9-4cd8-9081-2bf323383011 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:25.564729 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-8938cf35-c3e9-4cd8-9081-2bf323383011 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] HTTP exception thrown: Instance 942e53b4-7319-4bf6-b4fb-1839d390e0db could not be found. Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8938cf35-c3e9-4cd8-9081-2bf323383011 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Request method failure captured: Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db HTTP/1.1 Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWthmJZwbDpCtyLPt-Sxzw0MFoaNz15Pe_4cPidbzVgnkO55ek8Mfv6_30FOmaJ4n_jaz_OSQ4xJIqfy5y0HfyCdqUO_P2iQUbMyKBcUjnME6z_iskRbdoxZpAjSlOws6Ky017wpu_o30PWXsVBnSyN5xxlDbt603LUMAWa4HQ55cloo Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: a51b615fa1e545a5a409c09a584d023e Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesNegativeTest-729780316 Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a51b615fa1e545a5a409c09a584d023e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a51b615fa1e545a5a409c09a584d023e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a51b615fa1e545a5a409c09a584d023e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a51b615fa1e545a5a409c09a584d023e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-VolumesNegativeTest-729780316 Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: a51b615fa1e545a5a409c09a584d023e Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesNegativeTest-729780316 Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-VolumesNegativeTest-729780316-project Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 9787835bd8474440ae0d2f9353d46695 Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-VolumesNegativeTest-729780316-project Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 942e53b4-7319-4bf6-b4fb-1839d390e0db could not be found. Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '942e53b4-7319-4bf6-b4fb-1839d390e0db'} Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942e53b4-7319-4bf6-b4fb-1839d390e0db could not be found. Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942e53b4-7319-4bf6-b4fb-1839d390e0db could not be found. Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:14:25.567940 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:14:25.573643 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:14:25.573643 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:14:25.573643 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:14:25.573643 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:14:25.573643 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:14:25.573643 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942e53b4-7319-4bf6-b4fb-1839d390e0db could not be found. Oct 27 19:14:25.573643 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:14:25.573643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8938cf35-c3e9-4cd8-9081-2bf323383011 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] Returning 404 to user: Instance 942e53b4-7319-4bf6-b4fb-1839d390e0db could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:14:25.573643 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8938cf35-c3e9-4cd8-9081-2bf323383011 tempest-VolumesNegativeTest-729780316 tempest-VolumesNegativeTest-729780316-project] 10.222.0.42 "GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db" status: 404 len: 111 microversion: 2.1 time: 0.114771 Oct 27 19:14:25.579463 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2664/5490] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:25 2022] GET /compute/v2.1/servers/942e53b4-7319-4bf6-b4fb-1839d390e0db => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:14:26.386192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1658055131", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "3db83563-9d61-4a90-9031-60060d65e36b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-663006804", "security_groups": [{"name": "tempest-secgroup-smoke-902613022"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:14:26.932766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] validate_networks() for [('3db83563-9d61-4a90-9031-60060d65e36b', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:14:30.605387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:14:30.606070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:14:30.606225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:14:30.606700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:14:30.607128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:14:30.629217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:30.629731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:30.630186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:30.631059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:30.631529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:30.631971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:30.679130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for project 853ac0c6e395469bb90c156aad129c26. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:14:30.693423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for user ce7f16b54dda477386daed20f1a2e104 and project 853ac0c6e395469bb90c156aad129c26. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:14:30.724807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:14:30.727438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:14:30.868771 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b99ab35-506a-473f-9273-4255194d3c57 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.489623 Oct 27 19:14:30.870940 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2827/5491] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:14:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 4493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:14:30.883361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-730646ea-5c53-4070-87d9-be676bc24ff3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:30.884430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-730646ea-5c53-4070-87d9-be676bc24ff3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:32.332389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-730646ea-5c53-4070-87d9-be676bc24ff3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:32.387184 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-730646ea-5c53-4070-87d9-be676bc24ff3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1266 microversion: 2.1 time: 1.508437 Oct 27 19:14:32.401707 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2665/5492] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:30 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1266 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:33.420725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-89fa5a61-b2ab-4926-8e08-836be25f01e8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:33.421347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-89fa5a61-b2ab-4926-8e08-836be25f01e8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:33.437234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89fa5a61-b2ab-4926-8e08-836be25f01e8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:33.437655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89fa5a61-b2ab-4926-8e08-836be25f01e8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:33.438102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89fa5a61-b2ab-4926-8e08-836be25f01e8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:33.438862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89fa5a61-b2ab-4926-8e08-836be25f01e8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:33.439327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89fa5a61-b2ab-4926-8e08-836be25f01e8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:33.439766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89fa5a61-b2ab-4926-8e08-836be25f01e8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:33.906817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-89fa5a61-b2ab-4926-8e08-836be25f01e8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:33.918521 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-89fa5a61-b2ab-4926-8e08-836be25f01e8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1336 microversion: 2.1 time: 0.498612 Oct 27 19:14:33.923418 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2828/5493] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:33 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1336 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:34.952566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85525533-5e1e-44e8-b260-9bf924544be5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:34.954941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85525533-5e1e-44e8-b260-9bf924544be5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:35.000433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85525533-5e1e-44e8-b260-9bf924544be5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:35.002433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85525533-5e1e-44e8-b260-9bf924544be5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:35.006215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85525533-5e1e-44e8-b260-9bf924544be5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:35.008769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85525533-5e1e-44e8-b260-9bf924544be5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:35.010744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85525533-5e1e-44e8-b260-9bf924544be5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:35.015094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85525533-5e1e-44e8-b260-9bf924544be5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:35.160294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-85525533-5e1e-44e8-b260-9bf924544be5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:35.197216 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85525533-5e1e-44e8-b260-9bf924544be5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1324 microversion: 2.1 time: 0.252356 Oct 27 19:14:35.201906 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2666/5494] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:34 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1324 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:36.235563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8cedd837-56b6-4e58-afd7-92cacb337c2c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:36.236642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8cedd837-56b6-4e58-afd7-92cacb337c2c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:36.249650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cedd837-56b6-4e58-afd7-92cacb337c2c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:36.250741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cedd837-56b6-4e58-afd7-92cacb337c2c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:36.251473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cedd837-56b6-4e58-afd7-92cacb337c2c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:36.252414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cedd837-56b6-4e58-afd7-92cacb337c2c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:36.257915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cedd837-56b6-4e58-afd7-92cacb337c2c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:36.258685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cedd837-56b6-4e58-afd7-92cacb337c2c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:36.406712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8cedd837-56b6-4e58-afd7-92cacb337c2c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:36.424583 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8cedd837-56b6-4e58-afd7-92cacb337c2c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1324 microversion: 2.1 time: 0.196745 Oct 27 19:14:36.428054 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2829/5495] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:36 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1324 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:36.645358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4c74b935-c9b7-432c-90b0-b1d044f9484c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:36.646144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4c74b935-c9b7-432c-90b0-b1d044f9484c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:36.664795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c74b935-c9b7-432c-90b0-b1d044f9484c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:36.668027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c74b935-c9b7-432c-90b0-b1d044f9484c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:36.671737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c74b935-c9b7-432c-90b0-b1d044f9484c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:36.672811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c74b935-c9b7-432c-90b0-b1d044f9484c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:36.676103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c74b935-c9b7-432c-90b0-b1d044f9484c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:36.677794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c74b935-c9b7-432c-90b0-b1d044f9484c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:36.696543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:14:37.200219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4c74b935-c9b7-432c-90b0-b1d044f9484c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:37.215753 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4c74b935-c9b7-432c-90b0-b1d044f9484c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.572071 Oct 27 19:14:37.217406 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2667/5496] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:36 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:37.247067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0f7b0e03-84e1-4d0b-baa4-337c5c08a651 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:37.248540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0f7b0e03-84e1-4d0b-baa4-337c5c08a651 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:37.266397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f7b0e03-84e1-4d0b-baa4-337c5c08a651 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:37.267856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f7b0e03-84e1-4d0b-baa4-337c5c08a651 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:37.268389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f7b0e03-84e1-4d0b-baa4-337c5c08a651 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:37.269124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f7b0e03-84e1-4d0b-baa4-337c5c08a651 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:37.269588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f7b0e03-84e1-4d0b-baa4-337c5c08a651 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:37.270023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f7b0e03-84e1-4d0b-baa4-337c5c08a651 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:37.457446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-483c1565-027e-4ae2-a8ad-37b32daa4af6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:37.458067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-483c1565-027e-4ae2-a8ad-37b32daa4af6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:37.468718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-483c1565-027e-4ae2-a8ad-37b32daa4af6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:37.470586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-483c1565-027e-4ae2-a8ad-37b32daa4af6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:37.471063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-483c1565-027e-4ae2-a8ad-37b32daa4af6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:37.471805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-483c1565-027e-4ae2-a8ad-37b32daa4af6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:37.472272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-483c1565-027e-4ae2-a8ad-37b32daa4af6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:37.472707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-483c1565-027e-4ae2-a8ad-37b32daa4af6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:37.795310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-483c1565-027e-4ae2-a8ad-37b32daa4af6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:37.820221 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-483c1565-027e-4ae2-a8ad-37b32daa4af6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1391 microversion: 2.1 time: 0.365490 Oct 27 19:14:37.824890 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2668/5497] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:37 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1391 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:37.863129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0f7b0e03-84e1-4d0b-baa4-337c5c08a651 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:37.879332 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0f7b0e03-84e1-4d0b-baa4-337c5c08a651 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.633469 Oct 27 19:14:37.882374 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2830/5498] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:37 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:37.910775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dfa3b4f1-5953-4db2-be59-db057e99e0d2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:37.911701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dfa3b4f1-5953-4db2-be59-db057e99e0d2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:37.919790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa3b4f1-5953-4db2-be59-db057e99e0d2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:37.920538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa3b4f1-5953-4db2-be59-db057e99e0d2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:37.921283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa3b4f1-5953-4db2-be59-db057e99e0d2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:37.923544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa3b4f1-5953-4db2-be59-db057e99e0d2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:37.924493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa3b4f1-5953-4db2-be59-db057e99e0d2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:37.925155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa3b4f1-5953-4db2-be59-db057e99e0d2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:38.178805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dfa3b4f1-5953-4db2-be59-db057e99e0d2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:38.193301 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dfa3b4f1-5953-4db2-be59-db057e99e0d2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.283120 Oct 27 19:14:38.193301 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2669/5499] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:37 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:38.213609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6fa34313-ff2a-4d49-a129-44ab1ed5b2f4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:38.215034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6fa34313-ff2a-4d49-a129-44ab1ed5b2f4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:38.226833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fa34313-ff2a-4d49-a129-44ab1ed5b2f4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:38.227446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fa34313-ff2a-4d49-a129-44ab1ed5b2f4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:38.227967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fa34313-ff2a-4d49-a129-44ab1ed5b2f4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:38.229256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fa34313-ff2a-4d49-a129-44ab1ed5b2f4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:38.232059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fa34313-ff2a-4d49-a129-44ab1ed5b2f4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:38.232601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6fa34313-ff2a-4d49-a129-44ab1ed5b2f4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:38.849587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9a1ef0bd-dc2a-43c2-8e0d-9b465b05ee5f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:38.850515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9a1ef0bd-dc2a-43c2-8e0d-9b465b05ee5f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:38.866796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a1ef0bd-dc2a-43c2-8e0d-9b465b05ee5f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:38.868466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a1ef0bd-dc2a-43c2-8e0d-9b465b05ee5f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:38.868938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a1ef0bd-dc2a-43c2-8e0d-9b465b05ee5f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:38.871010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a1ef0bd-dc2a-43c2-8e0d-9b465b05ee5f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:38.873952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a1ef0bd-dc2a-43c2-8e0d-9b465b05ee5f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:38.874770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a1ef0bd-dc2a-43c2-8e0d-9b465b05ee5f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:39.342116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9a1ef0bd-dc2a-43c2-8e0d-9b465b05ee5f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:39.356897 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9a1ef0bd-dc2a-43c2-8e0d-9b465b05ee5f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1391 microversion: 2.1 time: 0.511913 Oct 27 19:14:39.359581 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2670/5500] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:38 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1391 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:39.503214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6fa34313-ff2a-4d49-a129-44ab1ed5b2f4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:39.513709 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6fa34313-ff2a-4d49-a129-44ab1ed5b2f4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 1.305064 Oct 27 19:14:39.514845 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2831/5501] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:38 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:39.765834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1097480299", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "e58f16a0-9265-4d79-a24b-f3342cfd8059"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:14:39.879761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] validate_networks() for [('e58f16a0-9265-4d79-a24b-f3342cfd8059', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:14:40.386246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-25d26917-d63d-4cf9-a3b1-f9868d978802 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:40.386849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-25d26917-d63d-4cf9-a3b1-f9868d978802 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:40.396567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25d26917-d63d-4cf9-a3b1-f9868d978802 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:40.397061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25d26917-d63d-4cf9-a3b1-f9868d978802 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:40.397812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25d26917-d63d-4cf9-a3b1-f9868d978802 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:40.398200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25d26917-d63d-4cf9-a3b1-f9868d978802 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:40.403359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25d26917-d63d-4cf9-a3b1-f9868d978802 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:40.406711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-25d26917-d63d-4cf9-a3b1-f9868d978802 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:40.659218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:14:40.709546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:14:40.846956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:14:40.848198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:14:40.848928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:14:40.849533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:14:40.850133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:14:40.870801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:40.871527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:40.872164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:40.873088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:40.873756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:40.874959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:40.912832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Getting quotas for project 79c27f02ea6549bea54242ab81741f97. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:14:40.930145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Getting quotas for user 7019e4c367c0470f95bc66e32def747a and project 79c27f02ea6549bea54242ab81741f97. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:14:40.950156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:14:40.952757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:14:41.024445 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a03f7cca-b577-47ec-b28f-a112e34c7599 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.267734 Oct 27 19:14:41.032113 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2671/5502] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:14:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:14:41.037867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-996c232d-4dd0-4822-ba66-6cbe0fe9b424 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:41.038806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-996c232d-4dd0-4822-ba66-6cbe0fe9b424 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:41.150338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-996c232d-4dd0-4822-ba66-6cbe0fe9b424 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:41.159791 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-996c232d-4dd0-4822-ba66-6cbe0fe9b424 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1215 microversion: 2.1 time: 0.124937 Oct 27 19:14:41.161994 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2672/5503] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:41 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:41.989186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-25d26917-d63d-4cf9-a3b1-f9868d978802 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:42.032108 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-25d26917-d63d-4cf9-a3b1-f9868d978802 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1391 microversion: 2.1 time: 1.650648 Oct 27 19:14:42.036260 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2832/5504] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:40 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1391 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:42.184864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d5046ed6-9e6d-4426-9254-1fac85237483 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:42.185500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d5046ed6-9e6d-4426-9254-1fac85237483 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:42.198861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5046ed6-9e6d-4426-9254-1fac85237483 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:42.199482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5046ed6-9e6d-4426-9254-1fac85237483 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:42.199939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5046ed6-9e6d-4426-9254-1fac85237483 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:42.200805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5046ed6-9e6d-4426-9254-1fac85237483 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:42.201326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5046ed6-9e6d-4426-9254-1fac85237483 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:42.201798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5046ed6-9e6d-4426-9254-1fac85237483 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:42.325974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d5046ed6-9e6d-4426-9254-1fac85237483 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:42.340031 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d5046ed6-9e6d-4426-9254-1fac85237483 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1267 microversion: 2.1 time: 0.159861 Oct 27 19:14:42.341197 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2673/5505] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:42 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:42.627047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e91f9901-31bf-4a28-aeba-103f279c7831 req-3524c867-7e6f-49be-bf86-dee32d569d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1263b108-e237-4eee-88af-6e2fda4ed792", "tag": "e01e3433-ca7f-4e03-9286-deabd11d6744"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:14:42.684638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e91f9901-31bf-4a28-aeba-103f279c7831 req-3524c867-7e6f-49be-bf86-dee32d569d02 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:42.685982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e91f9901-31bf-4a28-aeba-103f279c7831 req-3524c867-7e6f-49be-bf86-dee32d569d02 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:42.688484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e91f9901-31bf-4a28-aeba-103f279c7831 req-3524c867-7e6f-49be-bf86-dee32d569d02 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:42.735600 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e91f9901-31bf-4a28-aeba-103f279c7831 req-3524c867-7e6f-49be-bf86-dee32d569d02 service nova] Creating event network-changed:e01e3433-ca7f-4e03-9286-deabd11d6744 for instance 1263b108-e237-4eee-88af-6e2fda4ed792 on n-h1-860687-3 Oct 27 19:14:42.756109 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e91f9901-31bf-4a28-aeba-103f279c7831 req-3524c867-7e6f-49be-bf86-dee32d569d02 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133243 Oct 27 19:14:42.763291 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2833/5506] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:14:43.062653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-913190dc-aa8e-4c6e-9a76-729fe3433355 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:43.063799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-913190dc-aa8e-4c6e-9a76-729fe3433355 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:43.076497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:14:43.082069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-913190dc-aa8e-4c6e-9a76-729fe3433355 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:43.083018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-913190dc-aa8e-4c6e-9a76-729fe3433355 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:43.083664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-913190dc-aa8e-4c6e-9a76-729fe3433355 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:43.087047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-913190dc-aa8e-4c6e-9a76-729fe3433355 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:43.092035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-913190dc-aa8e-4c6e-9a76-729fe3433355 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:43.093167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-913190dc-aa8e-4c6e-9a76-729fe3433355 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:43.369577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-86fff285-66c4-48ad-9a95-ba7d5ad89627 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:43.371369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-86fff285-66c4-48ad-9a95-ba7d5ad89627 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:43.387181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86fff285-66c4-48ad-9a95-ba7d5ad89627 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:43.389220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86fff285-66c4-48ad-9a95-ba7d5ad89627 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:43.389737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86fff285-66c4-48ad-9a95-ba7d5ad89627 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:43.392989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86fff285-66c4-48ad-9a95-ba7d5ad89627 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:43.393443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86fff285-66c4-48ad-9a95-ba7d5ad89627 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:43.397212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-86fff285-66c4-48ad-9a95-ba7d5ad89627 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:43.698816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-86fff285-66c4-48ad-9a95-ba7d5ad89627 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:43.712490 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-86fff285-66c4-48ad-9a95-ba7d5ad89627 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1273 microversion: 2.1 time: 0.347596 Oct 27 19:14:43.718628 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2834/5507] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:43 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1273 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:44.231032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-913190dc-aa8e-4c6e-9a76-729fe3433355 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:44.236518 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-913190dc-aa8e-4c6e-9a76-729fe3433355 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1391 microversion: 2.1 time: 1.178462 Oct 27 19:14:44.253070 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2674/5508] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:43 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1391 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:44.747801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e7225afc-18bf-4cc2-812c-95ef1a22e771 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:44.748547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e7225afc-18bf-4cc2-812c-95ef1a22e771 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:44.771012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e7225afc-18bf-4cc2-812c-95ef1a22e771 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:44.771823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e7225afc-18bf-4cc2-812c-95ef1a22e771 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:44.772503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e7225afc-18bf-4cc2-812c-95ef1a22e771 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:44.773458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e7225afc-18bf-4cc2-812c-95ef1a22e771 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:44.774139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e7225afc-18bf-4cc2-812c-95ef1a22e771 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:44.774882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e7225afc-18bf-4cc2-812c-95ef1a22e771 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:44.926255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e7225afc-18bf-4cc2-812c-95ef1a22e771 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:44.941240 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e7225afc-18bf-4cc2-812c-95ef1a22e771 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1273 microversion: 2.1 time: 0.194743 Oct 27 19:14:44.946052 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2835/5509] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:44 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:14:45.271525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5cde3bfe-b96b-4daf-9357-d501258c240b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:45.272164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5cde3bfe-b96b-4daf-9357-d501258c240b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:45.283565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cde3bfe-b96b-4daf-9357-d501258c240b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:45.284087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cde3bfe-b96b-4daf-9357-d501258c240b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:45.284536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cde3bfe-b96b-4daf-9357-d501258c240b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:45.285271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cde3bfe-b96b-4daf-9357-d501258c240b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:45.285743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cde3bfe-b96b-4daf-9357-d501258c240b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:45.286185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cde3bfe-b96b-4daf-9357-d501258c240b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:45.802411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5cde3bfe-b96b-4daf-9357-d501258c240b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:45.814997 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5cde3bfe-b96b-4daf-9357-d501258c240b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1391 microversion: 2.1 time: 0.547679 Oct 27 19:14:45.829512 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2675/5510] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:45 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1391 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:45.969061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0dd5f161-802a-411b-b3c6-1a03b41a3567 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:45.969961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0dd5f161-802a-411b-b3c6-1a03b41a3567 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:45.980269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dd5f161-802a-411b-b3c6-1a03b41a3567 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:45.981753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dd5f161-802a-411b-b3c6-1a03b41a3567 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:45.983602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dd5f161-802a-411b-b3c6-1a03b41a3567 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:45.986781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dd5f161-802a-411b-b3c6-1a03b41a3567 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:45.988598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dd5f161-802a-411b-b3c6-1a03b41a3567 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:45.989499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dd5f161-802a-411b-b3c6-1a03b41a3567 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:46.152207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0dd5f161-802a-411b-b3c6-1a03b41a3567 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:46.173120 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0dd5f161-802a-411b-b3c6-1a03b41a3567 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1273 microversion: 2.1 time: 0.208004 Oct 27 19:14:46.191220 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2836/5511] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:45 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:46.848550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-802a5694-f864-4d53-922f-d20a58dfcf7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:46.849139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-802a5694-f864-4d53-922f-d20a58dfcf7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:46.867220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-802a5694-f864-4d53-922f-d20a58dfcf7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:46.876885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-802a5694-f864-4d53-922f-d20a58dfcf7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:46.877674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-802a5694-f864-4d53-922f-d20a58dfcf7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:46.880556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-802a5694-f864-4d53-922f-d20a58dfcf7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:46.884171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-802a5694-f864-4d53-922f-d20a58dfcf7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:46.886011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-802a5694-f864-4d53-922f-d20a58dfcf7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:47.198621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f05390f6-b00e-4fe6-a2dd-7748cdc24118 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:47.199259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f05390f6-b00e-4fe6-a2dd-7748cdc24118 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:47.213736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f05390f6-b00e-4fe6-a2dd-7748cdc24118 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:47.214314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f05390f6-b00e-4fe6-a2dd-7748cdc24118 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:47.214788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f05390f6-b00e-4fe6-a2dd-7748cdc24118 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:47.215516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f05390f6-b00e-4fe6-a2dd-7748cdc24118 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:47.215981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f05390f6-b00e-4fe6-a2dd-7748cdc24118 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:47.216422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f05390f6-b00e-4fe6-a2dd-7748cdc24118 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:47.415060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-802a5694-f864-4d53-922f-d20a58dfcf7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:47.423713 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-802a5694-f864-4d53-922f-d20a58dfcf7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1391 microversion: 2.1 time: 0.580572 Oct 27 19:14:47.424328 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2676/5512] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:46 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1391 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:47.782305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f05390f6-b00e-4fe6-a2dd-7748cdc24118 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:47.790285 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f05390f6-b00e-4fe6-a2dd-7748cdc24118 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1315 microversion: 2.1 time: 0.595823 Oct 27 19:14:47.797349 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2837/5513] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:47 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:48.453188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-831b1bfe-48c5-4865-b259-2495986601f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:48.453885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-831b1bfe-48c5-4865-b259-2495986601f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:48.467788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-831b1bfe-48c5-4865-b259-2495986601f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:48.476485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-831b1bfe-48c5-4865-b259-2495986601f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:48.478097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-831b1bfe-48c5-4865-b259-2495986601f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:48.482606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-831b1bfe-48c5-4865-b259-2495986601f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:48.487061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-831b1bfe-48c5-4865-b259-2495986601f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:48.489540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-831b1bfe-48c5-4865-b259-2495986601f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:48.830672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cd879f10-f184-4410-9979-ed0b87c6daba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:48.832100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cd879f10-f184-4410-9979-ed0b87c6daba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:48.846765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:14:48.850119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd879f10-f184-4410-9979-ed0b87c6daba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:48.851051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd879f10-f184-4410-9979-ed0b87c6daba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:48.851941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd879f10-f184-4410-9979-ed0b87c6daba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:48.852911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd879f10-f184-4410-9979-ed0b87c6daba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:48.861365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd879f10-f184-4410-9979-ed0b87c6daba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:48.863091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd879f10-f184-4410-9979-ed0b87c6daba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:48.963472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-831b1bfe-48c5-4865-b259-2495986601f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:48.973194 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-831b1bfe-48c5-4865-b259-2495986601f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1391 microversion: 2.1 time: 0.526163 Oct 27 19:14:48.974171 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2677/5514] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:48 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1391 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:14:49.955498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cd879f10-f184-4410-9979-ed0b87c6daba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:49.970233 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cd879f10-f184-4410-9979-ed0b87c6daba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1315 microversion: 2.1 time: 1.148680 Oct 27 19:14:49.971610 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2838/5515] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:48 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1315 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:50.002616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5a67c139-1812-4e58-abe0-60a7b664097b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:50.003164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5a67c139-1812-4e58-abe0-60a7b664097b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:50.020994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a67c139-1812-4e58-abe0-60a7b664097b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:50.021495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a67c139-1812-4e58-abe0-60a7b664097b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:50.021939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a67c139-1812-4e58-abe0-60a7b664097b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:50.022682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a67c139-1812-4e58-abe0-60a7b664097b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:50.023138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a67c139-1812-4e58-abe0-60a7b664097b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:50.028775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a67c139-1812-4e58-abe0-60a7b664097b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:50.398030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5a67c139-1812-4e58-abe0-60a7b664097b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:50.412726 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5a67c139-1812-4e58-abe0-60a7b664097b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1391 microversion: 2.1 time: 0.415364 Oct 27 19:14:50.413876 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2678/5516] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:49 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1391 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:50.998459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cb8d9c2a-223b-4e65-8755-76025cd3951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:50.999833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cb8d9c2a-223b-4e65-8755-76025cd3951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:51.021539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb8d9c2a-223b-4e65-8755-76025cd3951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:51.022812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb8d9c2a-223b-4e65-8755-76025cd3951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:51.023571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb8d9c2a-223b-4e65-8755-76025cd3951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:51.025322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb8d9c2a-223b-4e65-8755-76025cd3951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:51.026086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb8d9c2a-223b-4e65-8755-76025cd3951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:51.026729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb8d9c2a-223b-4e65-8755-76025cd3951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:51.457112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0fa52617-7ab9-4932-881b-c2ca4e669387 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:51.458254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0fa52617-7ab9-4932-881b-c2ca4e669387 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:51.473107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:14:51.476113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=10 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:14:51.496198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cb8d9c2a-223b-4e65-8755-76025cd3951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:51.510182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fa52617-7ab9-4932-881b-c2ca4e669387 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:51.513497 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cb8d9c2a-223b-4e65-8755-76025cd3951e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1315 microversion: 2.1 time: 0.523162 Oct 27 19:14:51.515118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fa52617-7ab9-4932-881b-c2ca4e669387 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:51.515460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fa52617-7ab9-4932-881b-c2ca4e669387 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:51.518674 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2839/5517] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:50 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:51.543663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fa52617-7ab9-4932-881b-c2ca4e669387 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:51.544446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fa52617-7ab9-4932-881b-c2ca4e669387 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:51.548497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fa52617-7ab9-4932-881b-c2ca4e669387 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:51.608220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-caed0c2c-2b7d-4acc-949c-01d4ebaaf58c req-ca711fa8-7b3b-4d32-ad73-1c6d4675134e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e13bbe-44cd-4122-a906-054244f62fe9", "tag": "9767a035-abf0-4f25-b8e5-1e7c6ce28b2e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:14:51.645246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-caed0c2c-2b7d-4acc-949c-01d4ebaaf58c req-ca711fa8-7b3b-4d32-ad73-1c6d4675134e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:51.646119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-caed0c2c-2b7d-4acc-949c-01d4ebaaf58c req-ca711fa8-7b3b-4d32-ad73-1c6d4675134e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:51.646786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-caed0c2c-2b7d-4acc-949c-01d4ebaaf58c req-ca711fa8-7b3b-4d32-ad73-1c6d4675134e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:51.680552 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-caed0c2c-2b7d-4acc-949c-01d4ebaaf58c req-ca711fa8-7b3b-4d32-ad73-1c6d4675134e service nova] Creating event network-changed:9767a035-abf0-4f25-b8e5-1e7c6ce28b2e for instance a5e13bbe-44cd-4122-a906-054244f62fe9 on n-h2-860687-3 Oct 27 19:14:51.695225 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-caed0c2c-2b7d-4acc-949c-01d4ebaaf58c req-ca711fa8-7b3b-4d32-ad73-1c6d4675134e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104999 Oct 27 19:14:51.695864 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2840/5518] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:14:52.222464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-c9832580-4ec6-4b7d-af04-2abc2ead00b3 req-a3560dd0-aee1-4c65-9965-80ff597a8420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1263b108-e237-4eee-88af-6e2fda4ed792", "name": "network-vif-plugged", "status": "completed", "tag": "e01e3433-ca7f-4e03-9286-deabd11d6744"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:14:52.277409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c9832580-4ec6-4b7d-af04-2abc2ead00b3 req-a3560dd0-aee1-4c65-9965-80ff597a8420 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:52.277907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c9832580-4ec6-4b7d-af04-2abc2ead00b3 req-a3560dd0-aee1-4c65-9965-80ff597a8420 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:52.278444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c9832580-4ec6-4b7d-af04-2abc2ead00b3 req-a3560dd0-aee1-4c65-9965-80ff597a8420 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:52.339506 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-c9832580-4ec6-4b7d-af04-2abc2ead00b3 req-a3560dd0-aee1-4c65-9965-80ff597a8420 service nova] Creating event network-vif-plugged:e01e3433-ca7f-4e03-9286-deabd11d6744 for instance 1263b108-e237-4eee-88af-6e2fda4ed792 on n-h1-860687-3 Oct 27 19:14:52.351958 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-c9832580-4ec6-4b7d-af04-2abc2ead00b3 req-a3560dd0-aee1-4c65-9965-80ff597a8420 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130390 Oct 27 19:14:52.357730 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2841/5519] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:14:52.544948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14db488e-ae67-4dbc-a294-7e42419f4a5c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:52.545739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-14db488e-ae67-4dbc-a294-7e42419f4a5c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:52.554898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14db488e-ae67-4dbc-a294-7e42419f4a5c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:52.555515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14db488e-ae67-4dbc-a294-7e42419f4a5c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:52.555982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14db488e-ae67-4dbc-a294-7e42419f4a5c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:52.556984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14db488e-ae67-4dbc-a294-7e42419f4a5c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:52.593571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14db488e-ae67-4dbc-a294-7e42419f4a5c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:52.594406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14db488e-ae67-4dbc-a294-7e42419f4a5c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:53.083747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0fa52617-7ab9-4932-881b-c2ca4e669387 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:53.100468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-14db488e-ae67-4dbc-a294-7e42419f4a5c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:53.109926 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-14db488e-ae67-4dbc-a294-7e42419f4a5c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1315 microversion: 2.1 time: 0.570514 Oct 27 19:14:53.115224 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0fa52617-7ab9-4932-881b-c2ca4e669387 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1391 microversion: 2.1 time: 1.668071 Oct 27 19:14:53.117585 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2679/5520] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:51 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1391 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:53.117961 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2842/5521] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:52 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:14:54.144286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4bb699e6-4872-4c71-b1a2-30f1df3174f6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:54.145402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eab4748b-22be-4e4b-8700-13f2b934f691 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:54.146141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-eab4748b-22be-4e4b-8700-13f2b934f691 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:54.147570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4bb699e6-4872-4c71-b1a2-30f1df3174f6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:54.161622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bb699e6-4872-4c71-b1a2-30f1df3174f6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:54.166622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eab4748b-22be-4e4b-8700-13f2b934f691 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:54.168261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bb699e6-4872-4c71-b1a2-30f1df3174f6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:54.169067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eab4748b-22be-4e4b-8700-13f2b934f691 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:54.169777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bb699e6-4872-4c71-b1a2-30f1df3174f6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:54.171194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eab4748b-22be-4e4b-8700-13f2b934f691 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:54.171766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bb699e6-4872-4c71-b1a2-30f1df3174f6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:54.173143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bb699e6-4872-4c71-b1a2-30f1df3174f6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:54.173869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eab4748b-22be-4e4b-8700-13f2b934f691 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:54.176000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eab4748b-22be-4e4b-8700-13f2b934f691 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:54.176262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4bb699e6-4872-4c71-b1a2-30f1df3174f6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:54.177570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eab4748b-22be-4e4b-8700-13f2b934f691 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:54.187065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=90 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:14:54.623002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4bb699e6-4872-4c71-b1a2-30f1df3174f6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:54.649591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-eab4748b-22be-4e4b-8700-13f2b934f691 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:54.653958 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4bb699e6-4872-4c71-b1a2-30f1df3174f6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1315 microversion: 2.1 time: 0.519108 Oct 27 19:14:54.657676 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2680/5522] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:54 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:54.674319 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eab4748b-22be-4e4b-8700-13f2b934f691 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1563 microversion: 2.1 time: 0.535342 Oct 27 19:14:54.675420 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2843/5523] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:54 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1563 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:14:54.702892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1eb795f9-8365-498d-8f7c-a7296bad613d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:54.703612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1eb795f9-8365-498d-8f7c-a7296bad613d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:54.725483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1eb795f9-8365-498d-8f7c-a7296bad613d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:54.725483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1eb795f9-8365-498d-8f7c-a7296bad613d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:54.725483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1eb795f9-8365-498d-8f7c-a7296bad613d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:54.726210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1eb795f9-8365-498d-8f7c-a7296bad613d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:54.726689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1eb795f9-8365-498d-8f7c-a7296bad613d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:54.727123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1eb795f9-8365-498d-8f7c-a7296bad613d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:55.264790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1eb795f9-8365-498d-8f7c-a7296bad613d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:55.298518 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1eb795f9-8365-498d-8f7c-a7296bad613d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1563 microversion: 2.1 time: 0.598165 Oct 27 19:14:55.304857 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2681/5524] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:54 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1563 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:55.689385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aec29469-a5e4-4298-854c-4fc47a0e2482 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:55.692466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-aec29469-a5e4-4298-854c-4fc47a0e2482 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:55.714198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aec29469-a5e4-4298-854c-4fc47a0e2482 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:55.715508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aec29469-a5e4-4298-854c-4fc47a0e2482 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:55.716197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aec29469-a5e4-4298-854c-4fc47a0e2482 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:55.717159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aec29469-a5e4-4298-854c-4fc47a0e2482 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:55.718134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aec29469-a5e4-4298-854c-4fc47a0e2482 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:55.719153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aec29469-a5e4-4298-854c-4fc47a0e2482 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:57.307440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-aec29469-a5e4-4298-854c-4fc47a0e2482 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:57.347478 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aec29469-a5e4-4298-854c-4fc47a0e2482 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1315 microversion: 2.1 time: 1.642361 Oct 27 19:14:57.351412 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2844/5525] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:55 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1315 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:58.375095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1f0b5c3c-5825-47e4-b1e0-e6d78c7d2d9a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:58.376556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1f0b5c3c-5825-47e4-b1e0-e6d78c7d2d9a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:58.408276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f0b5c3c-5825-47e4-b1e0-e6d78c7d2d9a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:58.410635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f0b5c3c-5825-47e4-b1e0-e6d78c7d2d9a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:58.411567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f0b5c3c-5825-47e4-b1e0-e6d78c7d2d9a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:58.413441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f0b5c3c-5825-47e4-b1e0-e6d78c7d2d9a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:58.416292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f0b5c3c-5825-47e4-b1e0-e6d78c7d2d9a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:58.416837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f0b5c3c-5825-47e4-b1e0-e6d78c7d2d9a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:58.807243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1f0b5c3c-5825-47e4-b1e0-e6d78c7d2d9a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:14:58.817552 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1f0b5c3c-5825-47e4-b1e0-e6d78c7d2d9a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1315 microversion: 2.1 time: 0.447625 Oct 27 19:14:58.841421 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2682/5526] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:58 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:14:59.200439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d5bcca77-df25-4998-90a9-078b7585538d req-d454799e-4c90-4e34-9e6b-ad34f9e0df18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e13bbe-44cd-4122-a906-054244f62fe9", "name": "network-vif-plugged", "status": "completed", "tag": "9767a035-abf0-4f25-b8e5-1e7c6ce28b2e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:14:59.216564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d5bcca77-df25-4998-90a9-078b7585538d req-d454799e-4c90-4e34-9e6b-ad34f9e0df18 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:59.217059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d5bcca77-df25-4998-90a9-078b7585538d req-d454799e-4c90-4e34-9e6b-ad34f9e0df18 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:59.217500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d5bcca77-df25-4998-90a9-078b7585538d req-d454799e-4c90-4e34-9e6b-ad34f9e0df18 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:59.256047 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d5bcca77-df25-4998-90a9-078b7585538d req-d454799e-4c90-4e34-9e6b-ad34f9e0df18 service nova] Creating event network-vif-plugged:9767a035-abf0-4f25-b8e5-1e7c6ce28b2e for instance a5e13bbe-44cd-4122-a906-054244f62fe9 on n-h2-860687-3 Oct 27 19:14:59.293888 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d5bcca77-df25-4998-90a9-078b7585538d req-d454799e-4c90-4e34-9e6b-ad34f9e0df18 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080161 Oct 27 19:14:59.295619 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2845/5527] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:14:59.845989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c564d490-8b57-429d-a13d-b1d1a01a6594 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:14:59.846654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c564d490-8b57-429d-a13d-b1d1a01a6594 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:14:59.856069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c564d490-8b57-429d-a13d-b1d1a01a6594 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:59.856571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c564d490-8b57-429d-a13d-b1d1a01a6594 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:59.857021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c564d490-8b57-429d-a13d-b1d1a01a6594 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:14:59.866412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c564d490-8b57-429d-a13d-b1d1a01a6594 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:14:59.866938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c564d490-8b57-429d-a13d-b1d1a01a6594 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:14:59.867402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c564d490-8b57-429d-a13d-b1d1a01a6594 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:00.338358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c564d490-8b57-429d-a13d-b1d1a01a6594 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:00.360685 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c564d490-8b57-429d-a13d-b1d1a01a6594 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1315 microversion: 2.1 time: 0.517636 Oct 27 19:15:00.363632 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2683/5528] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:14:59 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:01.390138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b42e3634-14d0-4d5e-aaef-0c5052b9d9f1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:01.392630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b42e3634-14d0-4d5e-aaef-0c5052b9d9f1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:01.412556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42e3634-14d0-4d5e-aaef-0c5052b9d9f1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:01.413483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42e3634-14d0-4d5e-aaef-0c5052b9d9f1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:01.413608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42e3634-14d0-4d5e-aaef-0c5052b9d9f1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:01.414328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42e3634-14d0-4d5e-aaef-0c5052b9d9f1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:01.418460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42e3634-14d0-4d5e-aaef-0c5052b9d9f1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:01.418908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b42e3634-14d0-4d5e-aaef-0c5052b9d9f1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:02.375719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b42e3634-14d0-4d5e-aaef-0c5052b9d9f1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:02.432701 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b42e3634-14d0-4d5e-aaef-0c5052b9d9f1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1315 microversion: 2.1 time: 1.051255 Oct 27 19:15:02.435641 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2846/5529] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:01 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1315 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:02.586044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c49184cf-383d-463a-91fe-b55828f85711 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:02.592989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c49184cf-383d-463a-91fe-b55828f85711 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:02.605433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c49184cf-383d-463a-91fe-b55828f85711 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Searching by: {'deleted': False, 'project_id': '18a73e635a584409a5205f3589597f7d'} {{(pid=127028) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 19:15:02.617364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c49184cf-383d-463a-91fe-b55828f85711 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:02.618542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c49184cf-383d-463a-91fe-b55828f85711 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:02.619865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c49184cf-383d-463a-91fe-b55828f85711 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:02.620865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c49184cf-383d-463a-91fe-b55828f85711 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:02.621568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c49184cf-383d-463a-91fe-b55828f85711 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:02.622227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c49184cf-383d-463a-91fe-b55828f85711 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:02.651661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.multi_cell_list [None req-c49184cf-383d-463a-91fe-b55828f85711 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 19:15:02.709673 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c49184cf-383d-463a-91fe-b55828f85711 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.133073 Oct 27 19:15:02.711514 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2684/5530] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 19:15:02 2022] GET /compute/v2.1/servers => generated 334 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:02.729477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:02.735468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:02.736849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Searching by: {'deleted': False, 'project_id': '18a73e635a584409a5205f3589597f7d'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 19:15:02.744346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:02.744851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:02.745254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:02.746184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:02.746912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:02.747532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:02.786861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 19:15:02.862614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:02.873127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:02.873556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:02.874209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:03.459776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85fcc98f-8a83-4c6e-9dfb-24a06fe27deb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:03.460456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85fcc98f-8a83-4c6e-9dfb-24a06fe27deb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:03.485643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85fcc98f-8a83-4c6e-9dfb-24a06fe27deb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:03.486952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85fcc98f-8a83-4c6e-9dfb-24a06fe27deb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:03.487626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85fcc98f-8a83-4c6e-9dfb-24a06fe27deb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:03.488543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85fcc98f-8a83-4c6e-9dfb-24a06fe27deb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:03.489166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85fcc98f-8a83-4c6e-9dfb-24a06fe27deb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:03.489827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85fcc98f-8a83-4c6e-9dfb-24a06fe27deb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:03.548189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:03.610652 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e4d19e1a-dc85-4e7c-8830-3da188c234ad tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.888126 Oct 27 19:15:03.613561 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2847/5531] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 19:15:02 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:03.643016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e208dd1-91fe-48a4-8b0a-fea34b650cec tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:03.658737 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6e208dd1-91fe-48a4-8b0a-fea34b650cec tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021357 Oct 27 19:15:03.659344 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2848/5532] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 19:15:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:15:03.944741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-85fcc98f-8a83-4c6e-9dfb-24a06fe27deb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:03.958804 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85fcc98f-8a83-4c6e-9dfb-24a06fe27deb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1501 microversion: 2.1 time: 0.504029 Oct 27 19:15:03.959725 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2685/5533] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:03 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1501 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:03.990192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-345c3814-7dec-4258-8036-1a6d87698645 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:03.991032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-345c3814-7dec-4258-8036-1a6d87698645 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:04.005384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-345c3814-7dec-4258-8036-1a6d87698645 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:04.005845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-345c3814-7dec-4258-8036-1a6d87698645 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:04.006324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-345c3814-7dec-4258-8036-1a6d87698645 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:04.007087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-345c3814-7dec-4258-8036-1a6d87698645 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:04.015879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-345c3814-7dec-4258-8036-1a6d87698645 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:04.016556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-345c3814-7dec-4258-8036-1a6d87698645 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:04.029662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1a7a0efe-27f4-4c54-85a9-b3b56d14d377 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:04.030463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1a7a0efe-27f4-4c54-85a9-b3b56d14d377 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:04.048894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a7a0efe-27f4-4c54-85a9-b3b56d14d377 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:04.049620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a7a0efe-27f4-4c54-85a9-b3b56d14d377 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:04.051065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a7a0efe-27f4-4c54-85a9-b3b56d14d377 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:04.052070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a7a0efe-27f4-4c54-85a9-b3b56d14d377 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:04.055095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a7a0efe-27f4-4c54-85a9-b3b56d14d377 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:04.055752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1a7a0efe-27f4-4c54-85a9-b3b56d14d377 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:04.107591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1a7a0efe-27f4-4c54-85a9-b3b56d14d377 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:15:04.334527 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1a7a0efe-27f4-4c54-85a9-b3b56d14d377 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 204 len: 0 microversion: 2.1 time: 0.310095 Oct 27 19:15:04.336409 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2686/5534] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:15:04 2022] DELETE /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:15:04.348276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d1be1926-1f9c-4566-83ef-2040dd2cd9c3 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:04.350712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d1be1926-1f9c-4566-83ef-2040dd2cd9c3 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:04.360212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1be1926-1f9c-4566-83ef-2040dd2cd9c3 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:04.361242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1be1926-1f9c-4566-83ef-2040dd2cd9c3 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:04.362198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1be1926-1f9c-4566-83ef-2040dd2cd9c3 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:04.363826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1be1926-1f9c-4566-83ef-2040dd2cd9c3 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:04.364713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1be1926-1f9c-4566-83ef-2040dd2cd9c3 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:04.365359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1be1926-1f9c-4566-83ef-2040dd2cd9c3 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:05.080029 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.network.security_group_api [None req-345c3814-7dec-4258-8036-1a6d87698645 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Removing security group 72b6c786-6264-4de7-955d-93de5a2519a0 from port 9767a035-abf0-4f25-b8e5-1e7c6ce28b2e Oct 27 19:15:05.657693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d1be1926-1f9c-4566-83ef-2040dd2cd9c3 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:05.698346 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d1be1926-1f9c-4566-83ef-2040dd2cd9c3 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1700 microversion: 2.1 time: 1.354084 Oct 27 19:15:05.701060 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2687/5535] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:04 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1700 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:05.720910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-630837b8-11d3-4cbe-b831-523fa9adc9c6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:05.731158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-630837b8-11d3-4cbe-b831-523fa9adc9c6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:05.748889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-630837b8-11d3-4cbe-b831-523fa9adc9c6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:05.749641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-630837b8-11d3-4cbe-b831-523fa9adc9c6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:05.755311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-630837b8-11d3-4cbe-b831-523fa9adc9c6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:05.757590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-630837b8-11d3-4cbe-b831-523fa9adc9c6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:05.758541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-630837b8-11d3-4cbe-b831-523fa9adc9c6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:05.759168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-630837b8-11d3-4cbe-b831-523fa9adc9c6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:06.554440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-630837b8-11d3-4cbe-b831-523fa9adc9c6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:06.569790 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-630837b8-11d3-4cbe-b831-523fa9adc9c6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1563 microversion: 2.1 time: 0.866424 Oct 27 19:15:06.573022 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2688/5536] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:05 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1563 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:06.585426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-0ade2d8b-44d8-433b-b799-d2e588f128e7 req-48711dc9-f3cb-41d0-92d7-903790e98be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1263b108-e237-4eee-88af-6e2fda4ed792", "tag": "e01e3433-ca7f-4e03-9286-deabd11d6744"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:06.614626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0ade2d8b-44d8-433b-b799-d2e588f128e7 req-48711dc9-f3cb-41d0-92d7-903790e98be6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:06.615393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0ade2d8b-44d8-433b-b799-d2e588f128e7 req-48711dc9-f3cb-41d0-92d7-903790e98be6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:06.616015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0ade2d8b-44d8-433b-b799-d2e588f128e7 req-48711dc9-f3cb-41d0-92d7-903790e98be6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:06.644674 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-0ade2d8b-44d8-433b-b799-d2e588f128e7 req-48711dc9-f3cb-41d0-92d7-903790e98be6 service nova] Creating event network-changed:e01e3433-ca7f-4e03-9286-deabd11d6744 for instance 1263b108-e237-4eee-88af-6e2fda4ed792 on n-h1-860687-3 Oct 27 19:15:06.651058 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-0ade2d8b-44d8-433b-b799-d2e588f128e7 req-48711dc9-f3cb-41d0-92d7-903790e98be6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074768 Oct 27 19:15:06.652705 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2689/5537] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:06.724058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b8f35eb8-76ee-40ef-8344-610c08258a57 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:06.724772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b8f35eb8-76ee-40ef-8344-610c08258a57 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:06.739423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8f35eb8-76ee-40ef-8344-610c08258a57 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:06.744959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8f35eb8-76ee-40ef-8344-610c08258a57 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:06.745807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8f35eb8-76ee-40ef-8344-610c08258a57 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:06.746827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8f35eb8-76ee-40ef-8344-610c08258a57 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:06.747460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8f35eb8-76ee-40ef-8344-610c08258a57 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:06.748089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b8f35eb8-76ee-40ef-8344-610c08258a57 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:07.348386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b8f35eb8-76ee-40ef-8344-610c08258a57 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:07.381366 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b8f35eb8-76ee-40ef-8344-610c08258a57 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1700 microversion: 2.1 time: 0.661591 Oct 27 19:15:07.382868 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2690/5538] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:06 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1700 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:15:07.811092 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-345c3814-7dec-4258-8036-1a6d87698645 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9/action" status: 202 len: 0 microversion: 2.1 time: 3.823984 Oct 27 19:15:07.813042 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2849/5539] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:15:03 2022] POST /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9/action => generated 0 bytes in 3827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:15:07.822759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b69894ba-a108-4194-8615-302eca65974e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:07.823604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b69894ba-a108-4194-8615-302eca65974e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:07.833106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b69894ba-a108-4194-8615-302eca65974e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:07.834049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b69894ba-a108-4194-8615-302eca65974e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:07.834796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b69894ba-a108-4194-8615-302eca65974e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:07.839327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b69894ba-a108-4194-8615-302eca65974e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:07.839752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b69894ba-a108-4194-8615-302eca65974e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:07.840221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b69894ba-a108-4194-8615-302eca65974e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:08.204161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b69894ba-a108-4194-8615-302eca65974e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:08.217794 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b69894ba-a108-4194-8615-302eca65974e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1459 microversion: 2.1 time: 0.400013 Oct 27 19:15:08.219029 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2691/5540] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:07 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1459 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:08.242666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fd4753e2-ff48-4940-9939-0f9a155cf8eb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:08.243707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fd4753e2-ff48-4940-9939-0f9a155cf8eb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:08.252767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd4753e2-ff48-4940-9939-0f9a155cf8eb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:08.253778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd4753e2-ff48-4940-9939-0f9a155cf8eb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:08.255034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd4753e2-ff48-4940-9939-0f9a155cf8eb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:08.256281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd4753e2-ff48-4940-9939-0f9a155cf8eb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:08.257191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd4753e2-ff48-4940-9939-0f9a155cf8eb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:08.258341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fd4753e2-ff48-4940-9939-0f9a155cf8eb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:08.409126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-331e4104-f6c9-4b20-ab54-26bce8dd3cdf tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:08.411049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-331e4104-f6c9-4b20-ab54-26bce8dd3cdf tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:08.425640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-331e4104-f6c9-4b20-ab54-26bce8dd3cdf tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:08.428960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-331e4104-f6c9-4b20-ab54-26bce8dd3cdf tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:08.429795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-331e4104-f6c9-4b20-ab54-26bce8dd3cdf tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:08.431158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-331e4104-f6c9-4b20-ab54-26bce8dd3cdf tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:08.433237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-331e4104-f6c9-4b20-ab54-26bce8dd3cdf tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:08.434105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-331e4104-f6c9-4b20-ab54-26bce8dd3cdf tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:08.685730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-331e4104-f6c9-4b20-ab54-26bce8dd3cdf tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:08.701451 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-331e4104-f6c9-4b20-ab54-26bce8dd3cdf tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1632 microversion: 2.1 time: 0.294692 Oct 27 19:15:08.702091 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2692/5541] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:08 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1632 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:15:08.819970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-cae1ae46-0b05-4e44-bb6e-0fb6fe34b3f0 req-5159572e-90c3-4d6a-b161-e4ab560d3e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e13bbe-44cd-4122-a906-054244f62fe9", "tag": "9767a035-abf0-4f25-b8e5-1e7c6ce28b2e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:08.841815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cae1ae46-0b05-4e44-bb6e-0fb6fe34b3f0 req-5159572e-90c3-4d6a-b161-e4ab560d3e47 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:08.842938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cae1ae46-0b05-4e44-bb6e-0fb6fe34b3f0 req-5159572e-90c3-4d6a-b161-e4ab560d3e47 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:08.843842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cae1ae46-0b05-4e44-bb6e-0fb6fe34b3f0 req-5159572e-90c3-4d6a-b161-e4ab560d3e47 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:08.881597 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-cae1ae46-0b05-4e44-bb6e-0fb6fe34b3f0 req-5159572e-90c3-4d6a-b161-e4ab560d3e47 service nova] Creating event network-changed:9767a035-abf0-4f25-b8e5-1e7c6ce28b2e for instance a5e13bbe-44cd-4122-a906-054244f62fe9 on n-h2-860687-3 Oct 27 19:15:08.888054 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-cae1ae46-0b05-4e44-bb6e-0fb6fe34b3f0 req-5159572e-90c3-4d6a-b161-e4ab560d3e47 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072860 Oct 27 19:15:08.889066 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2693/5542] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:09.141067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fd4753e2-ff48-4940-9939-0f9a155cf8eb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:09.155190 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fd4753e2-ff48-4940-9939-0f9a155cf8eb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.915091 Oct 27 19:15:09.172826 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2850/5543] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:08 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:09.203106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55505515-4e08-42ee-ab18-fce0fd60d2d1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:09.203915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-55505515-4e08-42ee-ab18-fce0fd60d2d1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:09.218776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55505515-4e08-42ee-ab18-fce0fd60d2d1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:09.219351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55505515-4e08-42ee-ab18-fce0fd60d2d1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:09.219887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55505515-4e08-42ee-ab18-fce0fd60d2d1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:09.220751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55505515-4e08-42ee-ab18-fce0fd60d2d1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:09.221404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55505515-4e08-42ee-ab18-fce0fd60d2d1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:09.222989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55505515-4e08-42ee-ab18-fce0fd60d2d1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:09.725268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ffce0174-a462-440d-85ef-53e4e42991c8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:09.725961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ffce0174-a462-440d-85ef-53e4e42991c8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:09.744240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffce0174-a462-440d-85ef-53e4e42991c8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:09.746654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffce0174-a462-440d-85ef-53e4e42991c8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:09.749085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffce0174-a462-440d-85ef-53e4e42991c8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:09.750879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffce0174-a462-440d-85ef-53e4e42991c8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:09.751366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffce0174-a462-440d-85ef-53e4e42991c8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:09.754134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffce0174-a462-440d-85ef-53e4e42991c8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:09.847764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffce0174-a462-440d-85ef-53e4e42991c8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:09.848903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffce0174-a462-440d-85ef-53e4e42991c8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:09.850757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffce0174-a462-440d-85ef-53e4e42991c8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:09.851518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-ffce0174-a462-440d-85ef-53e4e42991c8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lazy-loading 'fault' on Instance uuid 4486b6a9-6328-460b-87bf-cd8924dd88ed {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:15:09.937172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ffce0174-a462-440d-85ef-53e4e42991c8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4301a5e85d5410b8b460ae711f278ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a73e635a584409a5205f3589597f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:09.946179 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ffce0174-a462-440d-85ef-53e4e42991c8 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 200 len: 1359 microversion: 2.1 time: 0.224878 Oct 27 19:15:09.980661 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2851/5544] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:09 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:10.637872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-55505515-4e08-42ee-ab18-fce0fd60d2d1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:10.664365 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-55505515-4e08-42ee-ab18-fce0fd60d2d1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 1.466171 Oct 27 19:15:10.671882 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2694/5545] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:09 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:10.693124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eb2d05e2-6c0c-405a-8307-a3fe733ec00c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:10.694598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-eb2d05e2-6c0c-405a-8307-a3fe733ec00c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:10.706287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb2d05e2-6c0c-405a-8307-a3fe733ec00c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:10.707256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb2d05e2-6c0c-405a-8307-a3fe733ec00c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:10.715942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb2d05e2-6c0c-405a-8307-a3fe733ec00c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:10.717654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-833b81ad-4adc-404e-95af-8d40fe878107 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Action: 'create', calling method: .version_select at 0x7fc86b1fac10>, body: {"keypair": {"name": "tempest-keypair-1192509355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKy7jHIK/XP/rBZ3DKbziCrLiU2UyueSNjHOwiNAS+pwRLC5+SN/KUSJKZ+XWBwZPbXX3i0nF5RRKFAFtQVOCOBlrNSKgFsxy/8FzKhxg0CI+cLtPkkV3unC7q1pzrulA=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:10.718104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb2d05e2-6c0c-405a-8307-a3fe733ec00c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:10.719043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb2d05e2-6c0c-405a-8307-a3fe733ec00c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:10.720361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eb2d05e2-6c0c-405a-8307-a3fe733ec00c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:10.784577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-833b81ad-4adc-404e-95af-8d40fe878107 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Getting quotas for project 771658773bd54631b79ee8b7232be01b. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:15:10.804728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-833b81ad-4adc-404e-95af-8d40fe878107 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Getting quotas for user 056031aaff1848f198445e1039b7b93e and project 771658773bd54631b79ee8b7232be01b. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:15:10.897012 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-833b81ad-4adc-404e-95af-8d40fe878107 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.183171 Oct 27 19:15:10.904326 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2695/5546] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Oct 27 19:15:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 191 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 19:15:10.990185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2f3e0957-859a-4ef8-ab57-6b0a70d4bc99 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:10.990870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2f3e0957-859a-4ef8-ab57-6b0a70d4bc99 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] [instance: 4486b6a9-6328-460b-87bf-cd8924dd88ed] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:11.010230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f3e0957-859a-4ef8-ab57-6b0a70d4bc99 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:11.011088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f3e0957-859a-4ef8-ab57-6b0a70d4bc99 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:11.012599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f3e0957-859a-4ef8-ab57-6b0a70d4bc99 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:11.013960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f3e0957-859a-4ef8-ab57-6b0a70d4bc99 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:11.015868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f3e0957-859a-4ef8-ab57-6b0a70d4bc99 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:11.016732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f3e0957-859a-4ef8-ab57-6b0a70d4bc99 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:11.052347 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-2f3e0957-859a-4ef8-ab57-6b0a70d4bc99 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] HTTP exception thrown: Instance 4486b6a9-6328-460b-87bf-cd8924dd88ed could not be found. Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2f3e0957-859a-4ef8-ab57-6b0a70d4bc99 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Request method failure captured: Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed HTTP/1.1 Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWthC8eU1OiYnHp_LRh2MpvsX8PkEp3esR6tn6P6dCLSkYsfQxzN7xbxxbn2M3woAb8G1-EBB5u5ASWC2-R1YE1BAnFhX-9wcKeCzz7zgL8XrklnFrV82j731EHB87d1EX_Hh6KL2Jas_VcmlgSFDq9Lgaoh4zlHmr2iHPlRq2RfEeoA Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 18a73e635a584409a5205f3589597f7d Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersTestJSON-2136219461 Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/18a73e635a584409a5205f3589597f7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/18a73e635a584409a5205f3589597f7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_18a73e635a584409a5205f3589597f7d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/18a73e635a584409a5205f3589597f7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersTestJSON-2136219461 Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 18a73e635a584409a5205f3589597f7d Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersTestJSON-2136219461 Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersTestJSON-2136219461-project Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: e4301a5e85d5410b8b460ae711f278ab Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersTestJSON-2136219461-project Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 4486b6a9-6328-460b-87bf-cd8924dd88ed could not be found. Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '4486b6a9-6328-460b-87bf-cd8924dd88ed'} Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4486b6a9-6328-460b-87bf-cd8924dd88ed could not be found. Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4486b6a9-6328-460b-87bf-cd8924dd88ed could not be found. Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:15:11.059094 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:15:11.064598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:15:11.064598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:15:11.064598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:15:11.064598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:15:11.064598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:15:11.064598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4486b6a9-6328-460b-87bf-cd8924dd88ed could not be found. Oct 27 19:15:11.064598 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:15:11.066754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2f3e0957-859a-4ef8-ab57-6b0a70d4bc99 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Returning 404 to user: Instance 4486b6a9-6328-460b-87bf-cd8924dd88ed could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:15:11.070244 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2f3e0957-859a-4ef8-ab57-6b0a70d4bc99 tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed" status: 404 len: 111 microversion: 2.1 time: 0.085681 Oct 27 19:15:11.071287 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2696/5547] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:10 2022] GET /compute/v2.1/servers/4486b6a9-6328-460b-87bf-cd8924dd88ed => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:15:11.090115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-67ca904a-2660-4a83-8687-c73dbe04244a tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] Calling method '.version_select at 0x7fc86ae518b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:11.143359 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-67ca904a-2660-4a83-8687-c73dbe04244a tempest-ServersTestJSON-2136219461 tempest-ServersTestJSON-2136219461-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-234220064" status: 202 len: 0 microversion: 2.1 time: 0.063815 Oct 27 19:15:11.146018 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2697/5548] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Oct 27 19:15:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-234220064 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:15:11.331254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-e704007d-bd2a-4b3a-8edd-fa6102e1349a req-84268cc3-3f1c-4cbb-8367-00d5673fb6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4486b6a9-6328-460b-87bf-cd8924dd88ed", "name": "network-vif-deleted", "tag": "3a060186-5be2-4385-a9d5-864794d0d603"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:11.377962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e704007d-bd2a-4b3a-8edd-fa6102e1349a req-84268cc3-3f1c-4cbb-8367-00d5673fb6d2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:11.380798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e704007d-bd2a-4b3a-8edd-fa6102e1349a req-84268cc3-3f1c-4cbb-8367-00d5673fb6d2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:11.385656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e704007d-bd2a-4b3a-8edd-fa6102e1349a req-84268cc3-3f1c-4cbb-8367-00d5673fb6d2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:11.426640 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-e704007d-bd2a-4b3a-8edd-fa6102e1349a req-84268cc3-3f1c-4cbb-8367-00d5673fb6d2 service nova] Creating event network-vif-deleted:3a060186-5be2-4385-a9d5-864794d0d603 for instance 4486b6a9-6328-460b-87bf-cd8924dd88ed on n-h2-860687-3 Oct 27 19:15:11.437191 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-e704007d-bd2a-4b3a-8edd-fa6102e1349a req-84268cc3-3f1c-4cbb-8367-00d5673fb6d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110143 Oct 27 19:15:11.448264 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2698/5549] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:11.867284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-eb2d05e2-6c0c-405a-8307-a3fe733ec00c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:11.876316 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eb2d05e2-6c0c-405a-8307-a3fe733ec00c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 1.188801 Oct 27 19:15:11.876908 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2852/5550] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:10 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:11.913478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-208535c1-4441-40d0-9e76-8b1086ed21b7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:11.914983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-208535c1-4441-40d0-9e76-8b1086ed21b7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:11.933625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-208535c1-4441-40d0-9e76-8b1086ed21b7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:11.952169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-208535c1-4441-40d0-9e76-8b1086ed21b7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:11.954241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-208535c1-4441-40d0-9e76-8b1086ed21b7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:11.955248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-208535c1-4441-40d0-9e76-8b1086ed21b7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:11.959080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-208535c1-4441-40d0-9e76-8b1086ed21b7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:11.963229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-208535c1-4441-40d0-9e76-8b1086ed21b7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:12.628448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-208535c1-4441-40d0-9e76-8b1086ed21b7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:12.635333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:12.644378 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-208535c1-4441-40d0-9e76-8b1086ed21b7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.740968 Oct 27 19:15:12.648597 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2699/5551] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:11 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:12.836626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-384824603", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "e58f16a0-9265-4d79-a24b-f3342cfd8059"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:12.873828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:12.876463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:12.938133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] validate_networks() for [('e58f16a0-9265-4d79-a24b-f3342cfd8059', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:15:14.592185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:15:14.592758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:15:14.593093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:15:14.593512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:15:14.593952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:15:14.610980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:14.611578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:14.612253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:14.613205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:14.613830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:14.614972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:14.640474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Getting quotas for project 79c27f02ea6549bea54242ab81741f97. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:15:14.651058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Getting quotas for user 7019e4c367c0470f95bc66e32def747a and project 79c27f02ea6549bea54242ab81741f97. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:15:14.671457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:15:14.677199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:15:14.779422 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2c851ca7-ee36-4e4f-a53f-d8a588f30a50 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.947244 Oct 27 19:15:14.787133 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2853/5552] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:15:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:15:14.798639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a71ec9e4-f491-457d-9c55-352546cb8561 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:14.800040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a71ec9e4-f491-457d-9c55-352546cb8561 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:14.804624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:15.021085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a71ec9e4-f491-457d-9c55-352546cb8561 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:15.030783 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a71ec9e4-f491-457d-9c55-352546cb8561 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1214 microversion: 2.1 time: 0.235972 Oct 27 19:15:15.031379 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2700/5553] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:14 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1214 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:15.685030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cbcae89d-b65a-4cb9-ad62-450e69bdd66f tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Action: 'create', calling method: .version_select at 0x7fc869ffca60>, body: {"keypair": {"name": "tempest-TestServerBasicOps-718898516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEb4CSnLU5WwOsYJ7tUsABLaAW0HBICZ+cxrCFPj8aK3cnwHN86ufM1//kspzGYeu1beLzHurMkwdA9/VF0o5OkzLYnrSfpF6SnT6TqEKEJ1aeYupyWSyjtbINAvcgTM4Q=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:15.767111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-cbcae89d-b65a-4cb9-ad62-450e69bdd66f tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Getting quotas for project 3bf081fe916049e4825cbbf76ed7d16b. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:15:15.802651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-cbcae89d-b65a-4cb9-ad62-450e69bdd66f tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Getting quotas for user d1bff30b226346f4883faefae2fbb49b and project 3bf081fe916049e4825cbbf76ed7d16b. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:15:15.854769 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cbcae89d-b65a-4cb9-ad62-450e69bdd66f tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.484886 Oct 27 19:15:15.858087 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2854/5554] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:15:15 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:16.055634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f26721d1-a22f-4565-8de8-77c22b190bf7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:16.056544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f26721d1-a22f-4565-8de8-77c22b190bf7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:16.069808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f26721d1-a22f-4565-8de8-77c22b190bf7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:16.070373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f26721d1-a22f-4565-8de8-77c22b190bf7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:16.074406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f26721d1-a22f-4565-8de8-77c22b190bf7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:16.075186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f26721d1-a22f-4565-8de8-77c22b190bf7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:16.075689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f26721d1-a22f-4565-8de8-77c22b190bf7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:16.076120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f26721d1-a22f-4565-8de8-77c22b190bf7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:16.300178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f26721d1-a22f-4565-8de8-77c22b190bf7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:16.310998 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f26721d1-a22f-4565-8de8-77c22b190bf7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1210 microversion: 2.1 time: 0.259478 Oct 27 19:15:16.314947 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2701/5555] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:16 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1210 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:17.340774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1fa36267-8ca0-4615-8986-ce62a82cdf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:17.341406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1fa36267-8ca0-4615-8986-ce62a82cdf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:17.363487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fa36267-8ca0-4615-8986-ce62a82cdf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:17.363487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fa36267-8ca0-4615-8986-ce62a82cdf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:17.363487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fa36267-8ca0-4615-8986-ce62a82cdf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:17.363487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fa36267-8ca0-4615-8986-ce62a82cdf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:17.363487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fa36267-8ca0-4615-8986-ce62a82cdf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:17.363487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fa36267-8ca0-4615-8986-ce62a82cdf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:17.864090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1fa36267-8ca0-4615-8986-ce62a82cdf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:17.913147 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1fa36267-8ca0-4615-8986-ce62a82cdf99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1272 microversion: 2.1 time: 0.568671 Oct 27 19:15:17.917208 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2855/5556] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:17 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1272 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:18.182206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-91373184", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2d7899e1-5633-4123-a46b-0a5df6259d65"}, {"port": "97527b5c-4373-4fee-b901-c12096d23c2c", "tag": "port-1"}, {"port": "2b342788-17c7-4f8c-859c-82ded55435e9", "tag": "port-2"}, {"uuid": "0368590f-6dc3-4076-aa8a-2437c52db4e3", "tag": "net-1"}, {"uuid": "0368590f-6dc3-4076-aa8a-2437c52db4e3"}, {"uuid": "9488f298-bd80-499c-99ed-b988202c3449", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9488f298-bd80-499c-99ed-b988202c3449", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "974f4b96-e2e3-42cd-9443-791018eda923", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "0cab1541-6741-4633-8fd7-e156915dc144", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "65657217-34d8-4ea1-b576-e0d248410325", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--125275987"}], "key_name": "tempest-keypair-1192509355", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:18.577127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] validate_networks() for [('2d7899e1-5633-4123-a46b-0a5df6259d65', None, None, None, None, None), (None, None, '97527b5c-4373-4fee-b901-c12096d23c2c', None, None, None), (None, None, '2b342788-17c7-4f8c-859c-82ded55435e9', None, None, None), ('0368590f-6dc3-4076-aa8a-2437c52db4e3', None, None, None, None, None), ('0368590f-6dc3-4076-aa8a-2437c52db4e3', None, None, None, None, None), ('9488f298-bd80-499c-99ed-b988202c3449', '10.2.2.100', None, None, None, None), ('9488f298-bd80-499c-99ed-b988202c3449', '10.2.2.200', None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:15:18.941087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-407d052d-f3fa-4f67-94ff-3089ed938276 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:18.941924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-407d052d-f3fa-4f67-94ff-3089ed938276 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:18.953651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:18.956906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-407d052d-f3fa-4f67-94ff-3089ed938276 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:18.957519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-407d052d-f3fa-4f67-94ff-3089ed938276 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:18.958012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-407d052d-f3fa-4f67-94ff-3089ed938276 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:18.959114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-407d052d-f3fa-4f67-94ff-3089ed938276 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:18.959821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-407d052d-f3fa-4f67-94ff-3089ed938276 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:18.961378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-407d052d-f3fa-4f67-94ff-3089ed938276 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:19.197251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-407d052d-f3fa-4f67-94ff-3089ed938276 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:19.205436 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-407d052d-f3fa-4f67-94ff-3089ed938276 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1272 microversion: 2.1 time: 0.268579 Oct 27 19:15:19.213497 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2856/5557] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:18 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:15:19.269630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2edc39cb-a3cb-430f-a4f2-86ed7578e0cf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:19.272059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2edc39cb-a3cb-430f-a4f2-86ed7578e0cf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:19.286767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2edc39cb-a3cb-430f-a4f2-86ed7578e0cf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:19.287553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2edc39cb-a3cb-430f-a4f2-86ed7578e0cf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:19.288196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2edc39cb-a3cb-430f-a4f2-86ed7578e0cf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:19.292142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2edc39cb-a3cb-430f-a4f2-86ed7578e0cf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:19.292962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2edc39cb-a3cb-430f-a4f2-86ed7578e0cf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:19.293587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2edc39cb-a3cb-430f-a4f2-86ed7578e0cf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:19.378741 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2edc39cb-a3cb-430f-a4f2-86ed7578e0cf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792/action" status: 200 len: 24567 microversion: 2.1 time: 0.112786 Oct 27 19:15:19.379615 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2857/5558] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:15:19 2022] POST /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792/action => generated 24567 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 19:15:20.247556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fcf591ad-6646-4761-b676-77efd1933931 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:20.249197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fcf591ad-6646-4761-b676-77efd1933931 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:20.268966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf591ad-6646-4761-b676-77efd1933931 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:20.271790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf591ad-6646-4761-b676-77efd1933931 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:20.272472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf591ad-6646-4761-b676-77efd1933931 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:20.276542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf591ad-6646-4761-b676-77efd1933931 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:20.278940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf591ad-6646-4761-b676-77efd1933931 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:20.281149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fcf591ad-6646-4761-b676-77efd1933931 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:21.125079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fcf591ad-6646-4761-b676-77efd1933931 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:21.141657 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fcf591ad-6646-4761-b676-77efd1933931 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1314 microversion: 2.1 time: 0.899126 Oct 27 19:15:21.143085 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2858/5559] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:20 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1314 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:15:21.943607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1363663380", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-718898516", "security_groups": [{"name": "tempest-secgroup-smoke-1274368858"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "09f1769b-cc0e-4836-9693-48b5d5f96788"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:22.364536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] validate_networks() for [('09f1769b-cc0e-4836-9693-48b5d5f96788', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:15:23.530444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Getting quotas for project 3bf081fe916049e4825cbbf76ed7d16b. Resources: dict_keys(['metadata_items']) {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:15:23.543604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Getting quotas for user d1bff30b226346f4883faefae2fbb49b and project 3bf081fe916049e4825cbbf76ed7d16b. Resources: dict_keys(['metadata_items']) {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:15:23.585164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:15:23.585800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:15:23.586820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:15:23.587534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:15:23.588494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:15:23.599387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:23.600105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:23.600759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:23.602168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:23.603195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:23.603864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:23.628382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Getting quotas for project 3bf081fe916049e4825cbbf76ed7d16b. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:15:23.634919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Getting quotas for user d1bff30b226346f4883faefae2fbb49b and project 3bf081fe916049e4825cbbf76ed7d16b. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:15:23.659714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:15:23.663080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:15:23.785405 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4871a706-549b-4d71-b270-9b98c69069f7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.848998 Oct 27 19:15:23.796312 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2859/5560] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:15:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:15:23.826455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d797a00f-b946-42f1-abde-89d3e8fb8663 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:23.828474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d797a00f-b946-42f1-abde-89d3e8fb8663 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:23.843289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d797a00f-b946-42f1-abde-89d3e8fb8663 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:23.844927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d797a00f-b946-42f1-abde-89d3e8fb8663 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:23.845753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d797a00f-b946-42f1-abde-89d3e8fb8663 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:23.846730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d797a00f-b946-42f1-abde-89d3e8fb8663 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:23.847385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d797a00f-b946-42f1-abde-89d3e8fb8663 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:23.848051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d797a00f-b946-42f1-abde-89d3e8fb8663 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:24.491040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d797a00f-b946-42f1-abde-89d3e8fb8663 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:24.498008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=84 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:24.510593 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d797a00f-b946-42f1-abde-89d3e8fb8663 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1314 microversion: 2.1 time: 0.712569 Oct 27 19:15:24.511792 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2860/5561] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:23 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1314 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:24.530110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-da504b31-5d83-4515-859f-9403c8ad5af7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:24.531703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-da504b31-5d83-4515-859f-9403c8ad5af7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:24.714006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-da504b31-5d83-4515-859f-9403c8ad5af7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:24.736068 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-da504b31-5d83-4515-859f-9403c8ad5af7 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1302 microversion: 2.1 time: 0.222783 Oct 27 19:15:24.740660 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2861/5562] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:24 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1302 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:24.754641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d1a24898-c3ef-479b-bbf9-48e8594cc77c req-27bb65da-72b7-4476-a99b-c23c5e895bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0881df85-31d1-4917-9933-0b12f857f996", "tag": "d62cb388-acc9-438a-92c7-c605cd60dca7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:24.799711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d1a24898-c3ef-479b-bbf9-48e8594cc77c req-27bb65da-72b7-4476-a99b-c23c5e895bdc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:24.800216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d1a24898-c3ef-479b-bbf9-48e8594cc77c req-27bb65da-72b7-4476-a99b-c23c5e895bdc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:24.800666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d1a24898-c3ef-479b-bbf9-48e8594cc77c req-27bb65da-72b7-4476-a99b-c23c5e895bdc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:24.824457 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d1a24898-c3ef-479b-bbf9-48e8594cc77c req-27bb65da-72b7-4476-a99b-c23c5e895bdc service nova] Creating event network-changed:d62cb388-acc9-438a-92c7-c605cd60dca7 for instance 0881df85-31d1-4917-9933-0b12f857f996 on n-h1-860687-3 Oct 27 19:15:24.842097 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d1a24898-c3ef-479b-bbf9-48e8594cc77c req-27bb65da-72b7-4476-a99b-c23c5e895bdc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098212 Oct 27 19:15:24.843165 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2862/5563] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:25.012845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:15:25.013329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:15:25.017950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:15:25.018415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:15:25.018877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:15:25.026008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:25.047836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:25.048856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:25.050461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:25.051313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:25.054412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:25.055201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:25.107352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Getting quotas for project 771658773bd54631b79ee8b7232be01b. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:15:25.121988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Getting quotas for user 056031aaff1848f198445e1039b7b93e and project 771658773bd54631b79ee8b7232be01b. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:15:25.500601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:15:25.503953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='974f4b96-e2e3-42cd-9443-791018eda923',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='0cab1541-6741-4633-8fd7-e156915dc144',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='65657217-34d8-4ea1-b576-e0d248410325',volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:15:25.539044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cf9d73ff-3bba-4f69-8a1c-500700301d22 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:25.539762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cf9d73ff-3bba-4f69-8a1c-500700301d22 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:25.566779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf9d73ff-3bba-4f69-8a1c-500700301d22 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:25.572676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf9d73ff-3bba-4f69-8a1c-500700301d22 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:25.573360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf9d73ff-3bba-4f69-8a1c-500700301d22 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:25.574992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf9d73ff-3bba-4f69-8a1c-500700301d22 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:25.577403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf9d73ff-3bba-4f69-8a1c-500700301d22 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:25.579832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf9d73ff-3bba-4f69-8a1c-500700301d22 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:26.204717 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2af593fc-4d1e-402c-b5e0-63a553fcb392 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 8.026524 Oct 27 19:15:26.205540 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2702/5564] 10.222.0.42 () {62 vars in 1189 bytes} [Thu Oct 27 19:15:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 8028 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 19:15:26.210255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b7207ae8-47c0-4be5-8f24-c6ea8377f2bd tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:26.211016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b7207ae8-47c0-4be5-8f24-c6ea8377f2bd tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:26.218529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7207ae8-47c0-4be5-8f24-c6ea8377f2bd tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:26.219460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7207ae8-47c0-4be5-8f24-c6ea8377f2bd tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:26.220142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7207ae8-47c0-4be5-8f24-c6ea8377f2bd tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:26.221128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7207ae8-47c0-4be5-8f24-c6ea8377f2bd tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:26.221854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7207ae8-47c0-4be5-8f24-c6ea8377f2bd tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:26.222549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7207ae8-47c0-4be5-8f24-c6ea8377f2bd tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:26.370694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b7207ae8-47c0-4be5-8f24-c6ea8377f2bd tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:26.382417 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b7207ae8-47c0-4be5-8f24-c6ea8377f2bd tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1360 microversion: 2.1 time: 0.175602 Oct 27 19:15:26.400667 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2703/5565] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:26 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1360 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:26.408915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fbc5229f-727f-431e-b087-8b30d4ed9dff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:26.410649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fbc5229f-727f-431e-b087-8b30d4ed9dff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:26.459880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cf9d73ff-3bba-4f69-8a1c-500700301d22 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:26.472404 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cf9d73ff-3bba-4f69-8a1c-500700301d22 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1314 microversion: 2.1 time: 0.939359 Oct 27 19:15:26.487089 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2863/5566] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:25 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1314 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:15:26.659131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fbc5229f-727f-431e-b087-8b30d4ed9dff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:26.674704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fbc5229f-727f-431e-b087-8b30d4ed9dff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:26.678231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fbc5229f-727f-431e-b087-8b30d4ed9dff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:26.682122 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fbc5229f-727f-431e-b087-8b30d4ed9dff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1284 microversion: 2.32 time: 0.279767 Oct 27 19:15:26.704015 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2704/5567] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:26 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1284 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:15:27.411959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7b73f6ef-721f-4de1-9293-98e535953b62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:27.412644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7b73f6ef-721f-4de1-9293-98e535953b62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:27.427369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b73f6ef-721f-4de1-9293-98e535953b62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:27.428041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b73f6ef-721f-4de1-9293-98e535953b62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:27.428653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b73f6ef-721f-4de1-9293-98e535953b62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:27.429416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b73f6ef-721f-4de1-9293-98e535953b62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:27.429977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b73f6ef-721f-4de1-9293-98e535953b62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:27.430755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b73f6ef-721f-4de1-9293-98e535953b62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:27.499617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0c2e6ed3-53b5-4386-8088-cbc2eac1d300 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:27.501168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0c2e6ed3-53b5-4386-8088-cbc2eac1d300 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:27.527135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ed3-53b5-4386-8088-cbc2eac1d300 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:27.527955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ed3-53b5-4386-8088-cbc2eac1d300 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:27.528429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ed3-53b5-4386-8088-cbc2eac1d300 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:27.529182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ed3-53b5-4386-8088-cbc2eac1d300 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:27.533489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ed3-53b5-4386-8088-cbc2eac1d300 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:27.534082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ed3-53b5-4386-8088-cbc2eac1d300 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:27.724093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7b73f6ef-721f-4de1-9293-98e535953b62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:27.735440 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7b73f6ef-721f-4de1-9293-98e535953b62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1360 microversion: 2.1 time: 0.327793 Oct 27 19:15:27.739460 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2864/5568] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:27 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1360 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:27.754095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cc7b04f3-2197-416b-be7c-43984690486e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:27.754754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cc7b04f3-2197-416b-be7c-43984690486e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:27.787303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc7b04f3-2197-416b-be7c-43984690486e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:27.787814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc7b04f3-2197-416b-be7c-43984690486e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:27.788268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc7b04f3-2197-416b-be7c-43984690486e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:27.788995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc7b04f3-2197-416b-be7c-43984690486e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:27.789462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc7b04f3-2197-416b-be7c-43984690486e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:27.789903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc7b04f3-2197-416b-be7c-43984690486e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:28.137971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cc7b04f3-2197-416b-be7c-43984690486e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:28.144028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0c2e6ed3-53b5-4386-8088-cbc2eac1d300 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:28.160415 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0c2e6ed3-53b5-4386-8088-cbc2eac1d300 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1314 microversion: 2.1 time: 0.667494 Oct 27 19:15:28.161618 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2705/5569] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:27 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:28.179509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cc7b04f3-2197-416b-be7c-43984690486e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:28.181831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cc7b04f3-2197-416b-be7c-43984690486e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:28.183733 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cc7b04f3-2197-416b-be7c-43984690486e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1526 microversion: 2.32 time: 0.442878 Oct 27 19:15:28.185860 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2865/5570] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:27 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1526 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:15:28.623714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2df70333-3bfb-4972-99be-0eb210c4c0ee tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] Action: 'create', calling method: .version_select at 0x7fc869d208b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-481431650", "metadata": {"Type": "work"}}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:28.763412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d1f78b8-d802-40ab-841a-1325893b2b72 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:28.764274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0d1f78b8-d802-40ab-841a-1325893b2b72 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:28.780853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d1f78b8-d802-40ab-841a-1325893b2b72 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:28.784402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d1f78b8-d802-40ab-841a-1325893b2b72 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:28.784967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d1f78b8-d802-40ab-841a-1325893b2b72 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:28.788192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d1f78b8-d802-40ab-841a-1325893b2b72 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:28.790934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d1f78b8-d802-40ab-841a-1325893b2b72 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:28.793222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d1f78b8-d802-40ab-841a-1325893b2b72 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:29.495837 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2df70333-3bfb-4972-99be-0eb210c4c0ee tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.332789 Oct 27 19:15:29.509716 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2706/5571] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Oct 27 19:15:28 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1339 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 19:15:29.529557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ee5ad57c-0d53-46a2-97a6-628904f559f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:29.533008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ee5ad57c-0d53-46a2-97a6-628904f559f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:29.549765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee5ad57c-0d53-46a2-97a6-628904f559f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:29.550556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee5ad57c-0d53-46a2-97a6-628904f559f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:29.554648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee5ad57c-0d53-46a2-97a6-628904f559f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:29.559637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee5ad57c-0d53-46a2-97a6-628904f559f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:29.560337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee5ad57c-0d53-46a2-97a6-628904f559f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:29.561973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee5ad57c-0d53-46a2-97a6-628904f559f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:29.900547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0d1f78b8-d802-40ab-841a-1325893b2b72 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:29.917672 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0d1f78b8-d802-40ab-841a-1325893b2b72 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1428 microversion: 2.1 time: 1.159008 Oct 27 19:15:29.927602 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2866/5572] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:28 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1428 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:15:29.941837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2d01c7f3-6f0a-43fb-ac17-d6a6c83193fe tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:29.947034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2d01c7f3-6f0a-43fb-ac17-d6a6c83193fe tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:29.969016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d01c7f3-6f0a-43fb-ac17-d6a6c83193fe tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:29.970671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d01c7f3-6f0a-43fb-ac17-d6a6c83193fe tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:29.971316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d01c7f3-6f0a-43fb-ac17-d6a6c83193fe tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:29.972216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d01c7f3-6f0a-43fb-ac17-d6a6c83193fe tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:29.975558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d01c7f3-6f0a-43fb-ac17-d6a6c83193fe tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:29.976563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d01c7f3-6f0a-43fb-ac17-d6a6c83193fe tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:30.172573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ee5ad57c-0d53-46a2-97a6-628904f559f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:30.182978 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ee5ad57c-0d53-46a2-97a6-628904f559f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1314 microversion: 2.1 time: 0.671588 Oct 27 19:15:30.198754 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2707/5573] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:29 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:30.205594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6ec6704b-4f4d-4719-9927-e5dde5a9e741 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] Calling method '.version_select at 0x7fc873394f70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:30.312940 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6ec6704b-4f4d-4719-9927-e5dde5a9e741 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110" status: 200 len: 352 microversion: 2.1 time: 0.123661 Oct 27 19:15:30.314500 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2708/5574] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:15:30 2022] GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110 => generated 352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:30.319398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d50410b7-2551-4903-8d6a-b6071751e94a tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:30.320022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d50410b7-2551-4903-8d6a-b6071751e94a tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:30.332280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d50410b7-2551-4903-8d6a-b6071751e94a tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:30.333146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d50410b7-2551-4903-8d6a-b6071751e94a tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:30.333596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d50410b7-2551-4903-8d6a-b6071751e94a tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:30.336826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2d01c7f3-6f0a-43fb-ac17-d6a6c83193fe tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:30.336971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d50410b7-2551-4903-8d6a-b6071751e94a tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:30.337778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d50410b7-2551-4903-8d6a-b6071751e94a tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:30.342336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d50410b7-2551-4903-8d6a-b6071751e94a tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:30.349509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2d01c7f3-6f0a-43fb-ac17-d6a6c83193fe tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:30.358757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2d01c7f3-6f0a-43fb-ac17-d6a6c83193fe tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:30.360273 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2d01c7f3-6f0a-43fb-ac17-d6a6c83193fe tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1592 microversion: 2.32 time: 0.431372 Oct 27 19:15:30.367125 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2867/5575] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:29 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1592 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:15:30.372623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-31f3a1be-3cab-42f5-bde0-6e307a3f639d req-65dc5f00-c2fa-4a7e-8ab7-d633058263dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0881df85-31d1-4917-9933-0b12f857f996", "name": "network-vif-plugged", "status": "completed", "tag": "d62cb388-acc9-438a-92c7-c605cd60dca7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:30.411603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-31f3a1be-3cab-42f5-bde0-6e307a3f639d req-65dc5f00-c2fa-4a7e-8ab7-d633058263dc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:30.412017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-31f3a1be-3cab-42f5-bde0-6e307a3f639d req-65dc5f00-c2fa-4a7e-8ab7-d633058263dc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:30.412462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-31f3a1be-3cab-42f5-bde0-6e307a3f639d req-65dc5f00-c2fa-4a7e-8ab7-d633058263dc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:30.425534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:30.472555 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-31f3a1be-3cab-42f5-bde0-6e307a3f639d req-65dc5f00-c2fa-4a7e-8ab7-d633058263dc service nova] Creating event network-vif-plugged:d62cb388-acc9-438a-92c7-c605cd60dca7 for instance 0881df85-31d1-4917-9933-0b12f857f996 on n-h1-860687-3 Oct 27 19:15:30.492687 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-31f3a1be-3cab-42f5-bde0-6e307a3f639d req-65dc5f00-c2fa-4a7e-8ab7-d633058263dc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124037 Oct 27 19:15:30.498040 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2868/5576] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:30.954027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-34fe4a43-5418-4daf-8e91-1b1f062849ab tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:30.955686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-34fe4a43-5418-4daf-8e91-1b1f062849ab tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:30.968806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34fe4a43-5418-4daf-8e91-1b1f062849ab tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:30.983152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34fe4a43-5418-4daf-8e91-1b1f062849ab tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:30.984305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34fe4a43-5418-4daf-8e91-1b1f062849ab tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:30.985786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34fe4a43-5418-4daf-8e91-1b1f062849ab tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:30.987148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34fe4a43-5418-4daf-8e91-1b1f062849ab tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:30.988590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34fe4a43-5418-4daf-8e91-1b1f062849ab tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:31.413454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-34fe4a43-5418-4daf-8e91-1b1f062849ab tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:31.439885 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-34fe4a43-5418-4daf-8e91-1b1f062849ab tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1428 microversion: 2.1 time: 0.477839 Oct 27 19:15:31.455807 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2869/5577] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:30 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1428 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:15:31.463672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d3bb982c-7e39-4b6a-8f7b-c3dc87b4ac6e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:31.464593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d3bb982c-7e39-4b6a-8f7b-c3dc87b4ac6e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:31.472260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3bb982c-7e39-4b6a-8f7b-c3dc87b4ac6e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:31.473040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3bb982c-7e39-4b6a-8f7b-c3dc87b4ac6e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:31.473735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3bb982c-7e39-4b6a-8f7b-c3dc87b4ac6e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:31.478648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3bb982c-7e39-4b6a-8f7b-c3dc87b4ac6e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:31.479626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3bb982c-7e39-4b6a-8f7b-c3dc87b4ac6e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:31.480631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3bb982c-7e39-4b6a-8f7b-c3dc87b4ac6e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:31.914757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d3bb982c-7e39-4b6a-8f7b-c3dc87b4ac6e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:31.935418 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d3bb982c-7e39-4b6a-8f7b-c3dc87b4ac6e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1314 microversion: 2.1 time: 0.478071 Oct 27 19:15:31.943226 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2870/5578] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:31 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:31.973226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-56721b80-10d6-4a44-9286-b56173e65e4f tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] Calling method '.version_select at 0x7fc86b1a8430>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:32.082587 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-56721b80-10d6-4a44-9286-b56173e65e4f tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110" status: 200 len: 353 microversion: 2.1 time: 0.135420 Oct 27 19:15:32.083574 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2871/5579] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:15:31 2022] GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110 => generated 353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:32.089412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e857d199-2b5f-4c68-9cf5-012fda7c04d7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:32.090290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e857d199-2b5f-4c68-9cf5-012fda7c04d7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:32.105955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e857d199-2b5f-4c68-9cf5-012fda7c04d7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:32.109125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e857d199-2b5f-4c68-9cf5-012fda7c04d7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:32.109887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e857d199-2b5f-4c68-9cf5-012fda7c04d7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:32.110936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e857d199-2b5f-4c68-9cf5-012fda7c04d7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:32.112695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e857d199-2b5f-4c68-9cf5-012fda7c04d7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:32.113568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e857d199-2b5f-4c68-9cf5-012fda7c04d7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:32.864797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e857d199-2b5f-4c68-9cf5-012fda7c04d7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:32.883194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e857d199-2b5f-4c68-9cf5-012fda7c04d7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:32.885742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e857d199-2b5f-4c68-9cf5-012fda7c04d7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:32.887160 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e857d199-2b5f-4c68-9cf5-012fda7c04d7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1659 microversion: 2.32 time: 0.802210 Oct 27 19:15:32.890247 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2872/5580] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:32 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1659 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:15:32.899383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-37040a2c-a72e-4050-aec6-10c6ffa0a8a6 req-4f9d1e72-cc2b-4162-a125-d0e8e185ea0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e91af2-4262-4e21-8b58-a2673e65c6e5", "tag": "a13b8b26-87fa-4d76-a119-0db796ee8f4a"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:32.926102 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d50410b7-2551-4903-8d6a-b6071751e94a tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1832 microversion: 2.1 time: 2.610496 Oct 27 19:15:32.927779 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2709/5581] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:30 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1832 bytes in 2613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:32.928070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-37040a2c-a72e-4050-aec6-10c6ffa0a8a6 req-4f9d1e72-cc2b-4162-a125-d0e8e185ea0f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:32.928630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-37040a2c-a72e-4050-aec6-10c6ffa0a8a6 req-4f9d1e72-cc2b-4162-a125-d0e8e185ea0f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:32.929141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-37040a2c-a72e-4050-aec6-10c6ffa0a8a6 req-4f9d1e72-cc2b-4162-a125-d0e8e185ea0f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:32.936503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9fab9832-df97-466d-a597-99919657e344 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] Calling method '.version_select at 0x7fc869c783a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:32.964303 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-37040a2c-a72e-4050-aec6-10c6ffa0a8a6 req-4f9d1e72-cc2b-4162-a125-d0e8e185ea0f service nova] Creating event network-changed:a13b8b26-87fa-4d76-a119-0db796ee8f4a for instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 on n-h2-860687-3 Oct 27 19:15:32.982139 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-37040a2c-a72e-4050-aec6-10c6ffa0a8a6 req-4f9d1e72-cc2b-4162-a125-d0e8e185ea0f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090379 Oct 27 19:15:32.983520 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2873/5582] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:32.996604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9cd9fbb2-45a4-4821-aa65-219ae5c857a2 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:32.997562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9cd9fbb2-45a4-4821-aa65-219ae5c857a2 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:33.012098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cd9fbb2-45a4-4821-aa65-219ae5c857a2 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:33.018630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cd9fbb2-45a4-4821-aa65-219ae5c857a2 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:33.019321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cd9fbb2-45a4-4821-aa65-219ae5c857a2 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:33.020219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cd9fbb2-45a4-4821-aa65-219ae5c857a2 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:33.022197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cd9fbb2-45a4-4821-aa65-219ae5c857a2 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:33.023843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cd9fbb2-45a4-4821-aa65-219ae5c857a2 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:33.036466 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9fab9832-df97-466d-a597-99919657e344 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110" status: 200 len: 353 microversion: 2.1 time: 0.106940 Oct 27 19:15:33.037128 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2710/5583] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:15:32 2022] GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:33.042894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-75aeac4f-4fd2-4f4f-b45a-dc968b0da329 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:33.043587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-75aeac4f-4fd2-4f4f-b45a-dc968b0da329 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:33.066675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75aeac4f-4fd2-4f4f-b45a-dc968b0da329 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:33.070750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75aeac4f-4fd2-4f4f-b45a-dc968b0da329 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:33.072135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75aeac4f-4fd2-4f4f-b45a-dc968b0da329 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:33.073509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75aeac4f-4fd2-4f4f-b45a-dc968b0da329 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:33.074439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75aeac4f-4fd2-4f4f-b45a-dc968b0da329 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:33.075244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75aeac4f-4fd2-4f4f-b45a-dc968b0da329 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:33.618875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:33.650894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-75aeac4f-4fd2-4f4f-b45a-dc968b0da329 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:33.663655 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-75aeac4f-4fd2-4f4f-b45a-dc968b0da329 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1681 microversion: 2.1 time: 0.625428 Oct 27 19:15:33.666279 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2711/5584] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:33 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1681 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:33.679222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-caec193a-7511-48bd-9eef-b8ec4a69c12e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:33.681664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-caec193a-7511-48bd-9eef-b8ec4a69c12e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:33.699468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-caec193a-7511-48bd-9eef-b8ec4a69c12e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:33.703061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-caec193a-7511-48bd-9eef-b8ec4a69c12e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:33.704321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-caec193a-7511-48bd-9eef-b8ec4a69c12e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:33.707004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-caec193a-7511-48bd-9eef-b8ec4a69c12e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:33.708602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-caec193a-7511-48bd-9eef-b8ec4a69c12e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:33.709605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-caec193a-7511-48bd-9eef-b8ec4a69c12e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:34.097116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9cd9fbb2-45a4-4821-aa65-219ae5c857a2 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:34.106598 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9cd9fbb2-45a4-4821-aa65-219ae5c857a2 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1428 microversion: 2.1 time: 1.121284 Oct 27 19:15:34.107206 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2874/5585] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:32 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1428 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:34.121481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b78d7aa4-aaf9-4e97-94a7-8fc774938fbc tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] Calling method '.version_select at 0x7fc869fbf5e0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:34.246347 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b78d7aa4-aaf9-4e97-94a7-8fc774938fbc tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110" status: 202 len: 0 microversion: 2.1 time: 0.132729 Oct 27 19:15:34.247656 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2875/5586] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 19:15:34 2022] DELETE /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:15:34.255825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3a012a2c-c3c9-42c8-89a2-9b42513ead72 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:34.256794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3a012a2c-c3c9-42c8-89a2-9b42513ead72 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:34.265538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a012a2c-c3c9-42c8-89a2-9b42513ead72 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:34.266716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a012a2c-c3c9-42c8-89a2-9b42513ead72 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:34.267441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a012a2c-c3c9-42c8-89a2-9b42513ead72 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:34.268529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a012a2c-c3c9-42c8-89a2-9b42513ead72 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:34.269302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a012a2c-c3c9-42c8-89a2-9b42513ead72 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:34.269963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a012a2c-c3c9-42c8-89a2-9b42513ead72 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:34.409932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-caec193a-7511-48bd-9eef-b8ec4a69c12e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:34.425219 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-caec193a-7511-48bd-9eef-b8ec4a69c12e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1500 microversion: 2.1 time: 0.756124 Oct 27 19:15:34.428347 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2712/5587] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:33 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1500 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:34.440254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3900ec66-cd5f-4697-a478-f386891a1845 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:34.444921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3900ec66-cd5f-4697-a478-f386891a1845 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:34.455625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3900ec66-cd5f-4697-a478-f386891a1845 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:34.456456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3900ec66-cd5f-4697-a478-f386891a1845 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:34.457121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3900ec66-cd5f-4697-a478-f386891a1845 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:34.458218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3900ec66-cd5f-4697-a478-f386891a1845 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:34.458910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3900ec66-cd5f-4697-a478-f386891a1845 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:34.459689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3900ec66-cd5f-4697-a478-f386891a1845 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:34.533451 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3900ec66-cd5f-4697-a478-f386891a1845 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792/action" status: 200 len: 32639 microversion: 2.1 time: 0.103370 Oct 27 19:15:34.550978 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2713/5588] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:15:34 2022] POST /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792/action => generated 32639 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:15:34.566722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f1c1321e-2e52-492d-90b1-4ed6239ab68b tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] Calling method '.version_select at 0x7fc86a6f39d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:34.677610 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f1c1321e-2e52-492d-90b1-4ed6239ab68b tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110" status: 200 len: 352 microversion: 2.1 time: 0.115960 Oct 27 19:15:34.677610 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2714/5589] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:15:34 2022] GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:34.684029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-653c1dcc-3fbb-46a0-a611-449de5d9f70f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:34.685124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-653c1dcc-3fbb-46a0-a611-449de5d9f70f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:34.698164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653c1dcc-3fbb-46a0-a611-449de5d9f70f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:34.701949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653c1dcc-3fbb-46a0-a611-449de5d9f70f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:34.721315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653c1dcc-3fbb-46a0-a611-449de5d9f70f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:34.725762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653c1dcc-3fbb-46a0-a611-449de5d9f70f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:34.727496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653c1dcc-3fbb-46a0-a611-449de5d9f70f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:34.732959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=22 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:34.734514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653c1dcc-3fbb-46a0-a611-449de5d9f70f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:34.828334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3a012a2c-c3c9-42c8-89a2-9b42513ead72 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:34.842155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3a012a2c-c3c9-42c8-89a2-9b42513ead72 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:34.844200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3a012a2c-c3c9-42c8-89a2-9b42513ead72 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:34.846133 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3a012a2c-c3c9-42c8-89a2-9b42513ead72 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1705 microversion: 2.32 time: 0.596303 Oct 27 19:15:34.847997 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2876/5590] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:34 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1705 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:15:34.871264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b395f353-2d9d-4724-8a9c-59ece4f132ae tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:34.872208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b395f353-2d9d-4724-8a9c-59ece4f132ae tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:34.880119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b395f353-2d9d-4724-8a9c-59ece4f132ae tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:34.880975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b395f353-2d9d-4724-8a9c-59ece4f132ae tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:34.882203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b395f353-2d9d-4724-8a9c-59ece4f132ae tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:34.883484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b395f353-2d9d-4724-8a9c-59ece4f132ae tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:34.884224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b395f353-2d9d-4724-8a9c-59ece4f132ae tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:34.884895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b395f353-2d9d-4724-8a9c-59ece4f132ae tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:34.933915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b395f353-2d9d-4724-8a9c-59ece4f132ae tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5224b07141384791bdfd5a16986d9b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a0529a19b14548882cacde0c56403c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:34.935100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b395f353-2d9d-4724-8a9c-59ece4f132ae tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] flavor_id is None. Assuming migration. {{(pid=127029) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 27 19:15:34.935787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b395f353-2d9d-4724-8a9c-59ece4f132ae tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127029) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 19:15:34.994620 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-653c1dcc-3fbb-46a0-a611-449de5d9f70f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996/action" status: 202 len: 0 microversion: 2.1 time: 0.321642 Oct 27 19:15:34.997379 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2715/5591] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:15:34 2022] POST /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:15:35.017234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0166df16-a79d-4c7f-a0cf-f1ce5e5ca042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:35.021131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0166df16-a79d-4c7f-a0cf-f1ce5e5ca042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:35.052157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0166df16-a79d-4c7f-a0cf-f1ce5e5ca042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:35.052758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0166df16-a79d-4c7f-a0cf-f1ce5e5ca042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:35.053232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0166df16-a79d-4c7f-a0cf-f1ce5e5ca042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:35.053975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0166df16-a79d-4c7f-a0cf-f1ce5e5ca042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:35.054464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0166df16-a79d-4c7f-a0cf-f1ce5e5ca042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:35.054902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0166df16-a79d-4c7f-a0cf-f1ce5e5ca042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:35.090632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:35.507484 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b395f353-2d9d-4724-8a9c-59ece4f132ae tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792/action" status: 202 len: 0 microversion: 2.1 time: 0.658032 Oct 27 19:15:35.514773 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2877/5592] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:15:34 2022] POST /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:15:35.528792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dc38fa5e-ba6f-4e40-b4e3-eb9316bee59a tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:35.529455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dc38fa5e-ba6f-4e40-b4e3-eb9316bee59a tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:35.545966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc38fa5e-ba6f-4e40-b4e3-eb9316bee59a tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:35.547647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc38fa5e-ba6f-4e40-b4e3-eb9316bee59a tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:35.548522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc38fa5e-ba6f-4e40-b4e3-eb9316bee59a tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:35.550629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc38fa5e-ba6f-4e40-b4e3-eb9316bee59a tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:35.551615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc38fa5e-ba6f-4e40-b4e3-eb9316bee59a tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:35.552921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc38fa5e-ba6f-4e40-b4e3-eb9316bee59a tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:35.662226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0166df16-a79d-4c7f-a0cf-f1ce5e5ca042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:35.672734 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0166df16-a79d-4c7f-a0cf-f1ce5e5ca042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1505 microversion: 2.1 time: 0.669293 Oct 27 19:15:35.674996 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2716/5593] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:35 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1505 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:35.683988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1f51ec84-dfee-48d7-82dc-f82fbc3699d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:35.685977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1f51ec84-dfee-48d7-82dc-f82fbc3699d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:35.702133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f51ec84-dfee-48d7-82dc-f82fbc3699d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:35.704789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f51ec84-dfee-48d7-82dc-f82fbc3699d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:35.705407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f51ec84-dfee-48d7-82dc-f82fbc3699d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:35.709246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f51ec84-dfee-48d7-82dc-f82fbc3699d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:35.712567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f51ec84-dfee-48d7-82dc-f82fbc3699d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:35.724939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f51ec84-dfee-48d7-82dc-f82fbc3699d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:36.029042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1f51ec84-dfee-48d7-82dc-f82fbc3699d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:36.038501 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1f51ec84-dfee-48d7-82dc-f82fbc3699d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1690 microversion: 2.1 time: 0.362003 Oct 27 19:15:36.039830 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2717/5594] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:35 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1690 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:36.055366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4d8efaff-b0fe-48fe-9849-e0ce5554d739 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] Calling method '.version_select at 0x7fc86ad55b80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:36.158035 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4d8efaff-b0fe-48fe-9849-e0ce5554d739 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110" status: 200 len: 352 microversion: 2.1 time: 0.116569 Oct 27 19:15:36.159488 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2718/5595] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:15:36 2022] GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:36.169721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2654e1a6-d2a6-4111-88b3-0f5542c4f3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:36.170357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2654e1a6-d2a6-4111-88b3-0f5542c4f3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:36.183820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2654e1a6-d2a6-4111-88b3-0f5542c4f3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:36.194797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2654e1a6-d2a6-4111-88b3-0f5542c4f3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:36.196854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2654e1a6-d2a6-4111-88b3-0f5542c4f3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:36.198180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2654e1a6-d2a6-4111-88b3-0f5542c4f3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:36.205562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2654e1a6-d2a6-4111-88b3-0f5542c4f3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:36.206328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2654e1a6-d2a6-4111-88b3-0f5542c4f3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:36.349628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dc38fa5e-ba6f-4e40-b4e3-eb9316bee59a tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:36.359775 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dc38fa5e-ba6f-4e40-b4e3-eb9316bee59a tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1428 microversion: 2.1 time: 0.842559 Oct 27 19:15:36.369857 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2878/5596] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:35 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1428 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:36.509286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2654e1a6-d2a6-4111-88b3-0f5542c4f3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:36.541542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2654e1a6-d2a6-4111-88b3-0f5542c4f3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:36.547363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2654e1a6-d2a6-4111-88b3-0f5542c4f3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:36.549983 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2654e1a6-d2a6-4111-88b3-0f5542c4f3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1705 microversion: 2.32 time: 0.389270 Oct 27 19:15:36.552869 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2719/5597] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:36 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1705 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:15:36.698153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-539da9b1-e2f3-4929-aec9-58f0680d526b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:36.698821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-539da9b1-e2f3-4929-aec9-58f0680d526b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:36.713681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-539da9b1-e2f3-4929-aec9-58f0680d526b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:36.714173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-539da9b1-e2f3-4929-aec9-58f0680d526b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:36.714660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-539da9b1-e2f3-4929-aec9-58f0680d526b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:36.715856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-539da9b1-e2f3-4929-aec9-58f0680d526b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:36.716309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-539da9b1-e2f3-4929-aec9-58f0680d526b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:36.716737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-539da9b1-e2f3-4929-aec9-58f0680d526b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:37.069456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-541cce59-99cc-4acb-a21a-6c3e083b5724 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:37.070781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-541cce59-99cc-4acb-a21a-6c3e083b5724 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:37.088171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:37.094707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-541cce59-99cc-4acb-a21a-6c3e083b5724 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:37.096040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-541cce59-99cc-4acb-a21a-6c3e083b5724 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:37.096508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-541cce59-99cc-4acb-a21a-6c3e083b5724 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:37.097315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-541cce59-99cc-4acb-a21a-6c3e083b5724 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:37.105037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-541cce59-99cc-4acb-a21a-6c3e083b5724 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:37.105785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-541cce59-99cc-4acb-a21a-6c3e083b5724 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:37.110118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-539da9b1-e2f3-4929-aec9-58f0680d526b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:37.119125 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-539da9b1-e2f3-4929-aec9-58f0680d526b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1485 microversion: 2.1 time: 0.425296 Oct 27 19:15:37.119730 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2879/5598] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:36 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1485 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:37.154209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d53a964d-414a-4d33-b8fc-56ca49f49247 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:37.154802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d53a964d-414a-4d33-b8fc-56ca49f49247 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:37.173526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d53a964d-414a-4d33-b8fc-56ca49f49247 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:37.177359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d53a964d-414a-4d33-b8fc-56ca49f49247 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:37.178588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d53a964d-414a-4d33-b8fc-56ca49f49247 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:37.180184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d53a964d-414a-4d33-b8fc-56ca49f49247 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:37.188348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d53a964d-414a-4d33-b8fc-56ca49f49247 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:37.190927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d53a964d-414a-4d33-b8fc-56ca49f49247 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:37.248363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-d53a964d-414a-4d33-b8fc-56ca49f49247 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lazy-loading 'flavor' on Instance uuid 0881df85-31d1-4917-9933-0b12f857f996 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:15:37.256899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:37.563627 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d53a964d-414a-4d33-b8fc-56ca49f49247 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996/action" status: 202 len: 0 microversion: 2.1 time: 0.419715 Oct 27 19:15:37.565591 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2880/5599] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:15:37 2022] POST /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:15:37.579664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-743dbcf8-82a9-4b84-b1c6-a0bf65670953 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] Calling method '.version_select at 0x7fc86a9ea310>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:37.726066 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-743dbcf8-82a9-4b84-b1c6-a0bf65670953 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110" status: 200 len: 352 microversion: 2.1 time: 0.158897 Oct 27 19:15:37.726981 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2881/5600] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:15:37 2022] GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110 => generated 352 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:37.732458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d4666ad6-d0b8-4fa8-8f4a-7244340f7cbc tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:37.733184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d4666ad6-d0b8-4fa8-8f4a-7244340f7cbc tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:37.775697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4666ad6-d0b8-4fa8-8f4a-7244340f7cbc tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:37.776503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4666ad6-d0b8-4fa8-8f4a-7244340f7cbc tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:37.776977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4666ad6-d0b8-4fa8-8f4a-7244340f7cbc tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:37.777704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4666ad6-d0b8-4fa8-8f4a-7244340f7cbc tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:37.778171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4666ad6-d0b8-4fa8-8f4a-7244340f7cbc tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:37.778630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4666ad6-d0b8-4fa8-8f4a-7244340f7cbc tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:38.160187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-541cce59-99cc-4acb-a21a-6c3e083b5724 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:38.175174 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-541cce59-99cc-4acb-a21a-6c3e083b5724 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1690 microversion: 2.1 time: 1.105086 Oct 27 19:15:38.175863 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2720/5601] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:37 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1690 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:38.183903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf65cec2-8364-4e4f-ae5e-90f471a32bdd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:38.203990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf65cec2-8364-4e4f-ae5e-90f471a32bdd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:38.230155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf65cec2-8364-4e4f-ae5e-90f471a32bdd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:38.230758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf65cec2-8364-4e4f-ae5e-90f471a32bdd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:38.231209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf65cec2-8364-4e4f-ae5e-90f471a32bdd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:38.231970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf65cec2-8364-4e4f-ae5e-90f471a32bdd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:38.232431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf65cec2-8364-4e4f-ae5e-90f471a32bdd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:38.232864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf65cec2-8364-4e4f-ae5e-90f471a32bdd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:38.866198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d4666ad6-d0b8-4fa8-8f4a-7244340f7cbc tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:38.883184 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d4666ad6-d0b8-4fa8-8f4a-7244340f7cbc tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1428 microversion: 2.1 time: 1.155067 Oct 27 19:15:38.891058 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2882/5602] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:37 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1428 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:38.896430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-02f20831-fbd2-4767-ad91-fe86ba39b43a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:38.904564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-02f20831-fbd2-4767-ad91-fe86ba39b43a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:38.925567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02f20831-fbd2-4767-ad91-fe86ba39b43a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:38.933006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02f20831-fbd2-4767-ad91-fe86ba39b43a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:38.936969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02f20831-fbd2-4767-ad91-fe86ba39b43a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:38.938928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02f20831-fbd2-4767-ad91-fe86ba39b43a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:38.940274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02f20831-fbd2-4767-ad91-fe86ba39b43a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:38.943054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-02f20831-fbd2-4767-ad91-fe86ba39b43a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:39.437788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-02f20831-fbd2-4767-ad91-fe86ba39b43a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:39.455230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-02f20831-fbd2-4767-ad91-fe86ba39b43a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:39.467036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-02f20831-fbd2-4767-ad91-fe86ba39b43a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:39.471429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf65cec2-8364-4e4f-ae5e-90f471a32bdd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:39.472438 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-02f20831-fbd2-4767-ad91-fe86ba39b43a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1705 microversion: 2.32 time: 0.576108 Oct 27 19:15:39.473452 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2883/5603] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:38 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1705 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:15:39.482068 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf65cec2-8364-4e4f-ae5e-90f471a32bdd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1512 microversion: 2.1 time: 1.303191 Oct 27 19:15:39.482575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-90d7d688-ab9a-41fe-b13d-4a54f6635930 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] Calling method '.version_select at 0x7fc86a03e550>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:39.488376 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2721/5604] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:38 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1512 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:39.501133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f2385546-6daa-4f02-84ab-f5e769f2579d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:39.501133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f2385546-6daa-4f02-84ab-f5e769f2579d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:39.516715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2385546-6daa-4f02-84ab-f5e769f2579d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:39.527176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2385546-6daa-4f02-84ab-f5e769f2579d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:39.529062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2385546-6daa-4f02-84ab-f5e769f2579d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:39.530005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2385546-6daa-4f02-84ab-f5e769f2579d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:39.530675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2385546-6daa-4f02-84ab-f5e769f2579d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:39.531317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2385546-6daa-4f02-84ab-f5e769f2579d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:39.659079 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-90d7d688-ab9a-41fe-b13d-4a54f6635930 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110" status: 200 len: 352 microversion: 2.1 time: 0.184221 Oct 27 19:15:39.659738 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2884/5605] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:15:39 2022] GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110 => generated 352 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:39.911089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-24ea0e99-ae30-4a3d-9bd4-f0597e9c1f1b tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:39.911789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-24ea0e99-ae30-4a3d-9bd4-f0597e9c1f1b tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:39.932075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ea0e99-ae30-4a3d-9bd4-f0597e9c1f1b tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:39.932673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ea0e99-ae30-4a3d-9bd4-f0597e9c1f1b tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:39.933142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ea0e99-ae30-4a3d-9bd4-f0597e9c1f1b tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:39.937506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ea0e99-ae30-4a3d-9bd4-f0597e9c1f1b tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:39.940309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ea0e99-ae30-4a3d-9bd4-f0597e9c1f1b tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:39.940826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24ea0e99-ae30-4a3d-9bd4-f0597e9c1f1b tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:39.987246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f2385546-6daa-4f02-84ab-f5e769f2579d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:39.996408 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f2385546-6daa-4f02-84ab-f5e769f2579d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1690 microversion: 2.1 time: 0.506964 Oct 27 19:15:39.997829 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2722/5606] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:39 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1690 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:40.503785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bca3fa31-fe57-49c4-b1d1-fb99743ad41d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:40.504657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bca3fa31-fe57-49c4-b1d1-fb99743ad41d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:40.521698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bca3fa31-fe57-49c4-b1d1-fb99743ad41d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:40.527807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bca3fa31-fe57-49c4-b1d1-fb99743ad41d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:40.532092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bca3fa31-fe57-49c4-b1d1-fb99743ad41d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:40.533174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bca3fa31-fe57-49c4-b1d1-fb99743ad41d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:40.534991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bca3fa31-fe57-49c4-b1d1-fb99743ad41d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:40.536629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bca3fa31-fe57-49c4-b1d1-fb99743ad41d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:40.966759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bca3fa31-fe57-49c4-b1d1-fb99743ad41d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:40.981403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bca3fa31-fe57-49c4-b1d1-fb99743ad41d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:40.982920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bca3fa31-fe57-49c4-b1d1-fb99743ad41d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:40.990622 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bca3fa31-fe57-49c4-b1d1-fb99743ad41d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1751 microversion: 2.32 time: 0.491905 Oct 27 19:15:40.992333 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2723/5607] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:40 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1751 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:15:41.011498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0c5e8352-59fd-4255-a941-e520c3b01007 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:41.012339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0c5e8352-59fd-4255-a941-e520c3b01007 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:41.036340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c5e8352-59fd-4255-a941-e520c3b01007 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:41.042990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c5e8352-59fd-4255-a941-e520c3b01007 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:41.044176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c5e8352-59fd-4255-a941-e520c3b01007 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:41.044797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c5e8352-59fd-4255-a941-e520c3b01007 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:41.045278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c5e8352-59fd-4255-a941-e520c3b01007 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:41.045722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c5e8352-59fd-4255-a941-e520c3b01007 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:41.489958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0c5e8352-59fd-4255-a941-e520c3b01007 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:41.501007 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0c5e8352-59fd-4255-a941-e520c3b01007 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 0.507371 Oct 27 19:15:41.505201 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2724/5608] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:40 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:41.522904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55ed05b4-7041-4e18-884b-f96dcc371122 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] Calling method '.version_select at 0x7fc869cdc820>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:41.597499 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-55ed05b4-7041-4e18-884b-f96dcc371122 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] HTTP exception thrown: Volume 7be1e8ad-53d3-440b-925d-30ecfb9dc110 could not be found. Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55ed05b4-7041-4e18-884b-f96dcc371122 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] Request method failure captured: Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110 HTTP/1.1 Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtjPjDNWfQYBRno_Z09XA2ZN0eoCs8lGqblntRW7t-3Sp9DtD8r7cB1apfYd5AYbKVvTEkNLOKRY8wIPopE2Y8U6KXF1VlJwvxxIKNSalv4wiNRe6yrHp7pncKxlkRSvnu6JC64d4j8di4VUM0y8lHeL7TWMiA6C-qKTzuq-Jy9c84A Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: b8e8ca2f291141bc9fbd7424ee18e0d8 Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesGetTestJSON-1390633226 Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8e8ca2f291141bc9fbd7424ee18e0d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8e8ca2f291141bc9fbd7424ee18e0d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8e8ca2f291141bc9fbd7424ee18e0d8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8e8ca2f291141bc9fbd7424ee18e0d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-VolumesGetTestJSON-1390633226 Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: b8e8ca2f291141bc9fbd7424ee18e0d8 Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesGetTestJSON-1390633226 Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-VolumesGetTestJSON-1390633226-project Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 84791ddfd9b149529ddb758ffb45c63c Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-VolumesGetTestJSON-1390633226-project Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: exception: Volume 7be1e8ad-53d3-440b-925d-30ecfb9dc110 could not be found. Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '7be1e8ad-53d3-440b-925d-30ecfb9dc110'} Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7be1e8ad-53d3-440b-925d-30ecfb9dc110 could not be found. (HTTP 404) (Request-ID: req-e178d4da-fa43-40af-803c-78aa9e18061e) Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 19:15:41.600690 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7be1e8ad-53d3-440b-925d-30ecfb9dc110 could not be found. Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7be1e8ad-53d3-440b-925d-30ecfb9dc110 could not be found. Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7be1e8ad-53d3-440b-925d-30ecfb9dc110 could not be found. Oct 27 19:15:41.606490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:15:41.613717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55ed05b4-7041-4e18-884b-f96dcc371122 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] Returning 404 to user: Volume 7be1e8ad-53d3-440b-925d-30ecfb9dc110 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:15:41.613717 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-55ed05b4-7041-4e18-884b-f96dcc371122 tempest-VolumesGetTestJSON-1390633226 tempest-VolumesGetTestJSON-1390633226-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110" status: 404 len: 109 microversion: 2.1 time: 0.105641 Oct 27 19:15:41.613717 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2725/5609] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 19:15:41 2022] GET /compute/v2.1/os-volumes/7be1e8ad-53d3-440b-925d-30ecfb9dc110 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:15:41.623581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85f06a11-4edc-44cb-94c3-9aa9c1491e96 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:41.627272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85f06a11-4edc-44cb-94c3-9aa9c1491e96 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:41.667116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85f06a11-4edc-44cb-94c3-9aa9c1491e96 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:41.670263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85f06a11-4edc-44cb-94c3-9aa9c1491e96 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:41.671144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85f06a11-4edc-44cb-94c3-9aa9c1491e96 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:41.672435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85f06a11-4edc-44cb-94c3-9aa9c1491e96 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:41.674215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85f06a11-4edc-44cb-94c3-9aa9c1491e96 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:41.676112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85f06a11-4edc-44cb-94c3-9aa9c1491e96 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:41.998810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-85f06a11-4edc-44cb-94c3-9aa9c1491e96 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:42.011275 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85f06a11-4edc-44cb-94c3-9aa9c1491e96 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1690 microversion: 2.1 time: 0.396421 Oct 27 19:15:42.012297 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2726/5610] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:41 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1690 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:42.036757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-09f400a3-cfbf-4ed6-a97e-c397603e2368 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:42.042137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-09f400a3-cfbf-4ed6-a97e-c397603e2368 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:42.063431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09f400a3-cfbf-4ed6-a97e-c397603e2368 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:42.063943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09f400a3-cfbf-4ed6-a97e-c397603e2368 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:42.064397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09f400a3-cfbf-4ed6-a97e-c397603e2368 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:42.082035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09f400a3-cfbf-4ed6-a97e-c397603e2368 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:42.082556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09f400a3-cfbf-4ed6-a97e-c397603e2368 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:42.083025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09f400a3-cfbf-4ed6-a97e-c397603e2368 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:42.239930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-24ea0e99-ae30-4a3d-9bd4-f0597e9c1f1b tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:42.251976 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-24ea0e99-ae30-4a3d-9bd4-f0597e9c1f1b tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1428 microversion: 2.1 time: 2.345287 Oct 27 19:15:42.258588 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2885/5611] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:39 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1428 bytes in 2352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:42.326733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-c3197301-8c8c-4629-afd3-66e98ab2737f req-ec8afa50-9c04-421c-bfba-c1784f9fd7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0881df85-31d1-4917-9933-0b12f857f996", "name": "network-vif-plugged", "status": "completed", "tag": "d62cb388-acc9-438a-92c7-c605cd60dca7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:42.369620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c3197301-8c8c-4629-afd3-66e98ab2737f req-ec8afa50-9c04-421c-bfba-c1784f9fd7f6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:42.385430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c3197301-8c8c-4629-afd3-66e98ab2737f req-ec8afa50-9c04-421c-bfba-c1784f9fd7f6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:42.387583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c3197301-8c8c-4629-afd3-66e98ab2737f req-ec8afa50-9c04-421c-bfba-c1784f9fd7f6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:42.431375 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-c3197301-8c8c-4629-afd3-66e98ab2737f req-ec8afa50-9c04-421c-bfba-c1784f9fd7f6 service nova] Creating event network-vif-plugged:d62cb388-acc9-438a-92c7-c605cd60dca7 for instance 0881df85-31d1-4917-9933-0b12f857f996 on n-h1-860687-3 Oct 27 19:15:42.453251 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-c3197301-8c8c-4629-afd3-66e98ab2737f req-ec8afa50-9c04-421c-bfba-c1784f9fd7f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129922 Oct 27 19:15:42.456689 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2886/5612] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:42.534907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dcc62f76-6583-4d38-ac67-7cf98b3f35a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:42.535882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dcc62f76-6583-4d38-ac67-7cf98b3f35a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:42.555094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcc62f76-6583-4d38-ac67-7cf98b3f35a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:42.555970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcc62f76-6583-4d38-ac67-7cf98b3f35a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:42.556162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcc62f76-6583-4d38-ac67-7cf98b3f35a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:42.556807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcc62f76-6583-4d38-ac67-7cf98b3f35a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:42.557275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcc62f76-6583-4d38-ac67-7cf98b3f35a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:42.557716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcc62f76-6583-4d38-ac67-7cf98b3f35a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:42.566033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-09f400a3-cfbf-4ed6-a97e-c397603e2368 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:42.589428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-09f400a3-cfbf-4ed6-a97e-c397603e2368 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:42.593554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-09f400a3-cfbf-4ed6-a97e-c397603e2368 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:42.599914 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-09f400a3-cfbf-4ed6-a97e-c397603e2368 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1751 microversion: 2.32 time: 0.577015 Oct 27 19:15:42.616206 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2727/5613] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:42 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1751 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:15:43.050488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1315d215-bd7c-4098-a037-0bc892d05c7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:43.051535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1315d215-bd7c-4098-a037-0bc892d05c7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:43.077212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1315d215-bd7c-4098-a037-0bc892d05c7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:43.079936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1315d215-bd7c-4098-a037-0bc892d05c7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:43.081021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1315d215-bd7c-4098-a037-0bc892d05c7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:43.082102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1315d215-bd7c-4098-a037-0bc892d05c7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:43.083011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1315d215-bd7c-4098-a037-0bc892d05c7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:43.083663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1315d215-bd7c-4098-a037-0bc892d05c7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:43.191627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dcc62f76-6583-4d38-ac67-7cf98b3f35a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:43.200377 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dcc62f76-6583-4d38-ac67-7cf98b3f35a1 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 0.669770 Oct 27 19:15:43.200965 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2887/5614] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:42 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:15:43.286066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fa31bfea-1ad7-418a-8538-f7d5ae946ee9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:43.286756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fa31bfea-1ad7-418a-8538-f7d5ae946ee9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:43.296141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa31bfea-1ad7-418a-8538-f7d5ae946ee9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:43.296652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa31bfea-1ad7-418a-8538-f7d5ae946ee9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:43.297106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa31bfea-1ad7-418a-8538-f7d5ae946ee9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:43.297834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa31bfea-1ad7-418a-8538-f7d5ae946ee9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:43.298311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa31bfea-1ad7-418a-8538-f7d5ae946ee9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:43.298774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa31bfea-1ad7-418a-8538-f7d5ae946ee9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:43.740620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1315d215-bd7c-4098-a037-0bc892d05c7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:43.751800 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1315d215-bd7c-4098-a037-0bc892d05c7e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1690 microversion: 2.1 time: 0.714501 Oct 27 19:15:43.755210 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2728/5615] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:43 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1690 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:43.764915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4fa14a93-76aa-4338-8f60-6352e3988aec tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:43.768735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4fa14a93-76aa-4338-8f60-6352e3988aec tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:43.783489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fa14a93-76aa-4338-8f60-6352e3988aec tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:43.785652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fa14a93-76aa-4338-8f60-6352e3988aec tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:43.786288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fa14a93-76aa-4338-8f60-6352e3988aec tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:43.788877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fa14a93-76aa-4338-8f60-6352e3988aec tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:43.789554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fa14a93-76aa-4338-8f60-6352e3988aec tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:43.791950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fa14a93-76aa-4338-8f60-6352e3988aec tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:43.846337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:44.154251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4fa14a93-76aa-4338-8f60-6352e3988aec tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:44.185842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4fa14a93-76aa-4338-8f60-6352e3988aec tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:44.187535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4fa14a93-76aa-4338-8f60-6352e3988aec tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:44.190374 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4fa14a93-76aa-4338-8f60-6352e3988aec tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1751 microversion: 2.32 time: 0.433815 Oct 27 19:15:44.190961 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2729/5616] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:43 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1751 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:15:44.226838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f9cab95a-8929-401d-affb-e637f673ba3c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:44.228023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f9cab95a-8929-401d-affb-e637f673ba3c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:44.242921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9cab95a-8929-401d-affb-e637f673ba3c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:44.245377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9cab95a-8929-401d-affb-e637f673ba3c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:44.245823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9cab95a-8929-401d-affb-e637f673ba3c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:44.246815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9cab95a-8929-401d-affb-e637f673ba3c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:44.250738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9cab95a-8929-401d-affb-e637f673ba3c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:44.251404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9cab95a-8929-401d-affb-e637f673ba3c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:44.507230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f9cab95a-8929-401d-affb-e637f673ba3c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:44.529078 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f9cab95a-8929-401d-affb-e637f673ba3c tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 0.305915 Oct 27 19:15:44.534750 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2730/5617] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:44 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:15:44.570176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-dbdb7b4e-ee73-4bb9-942d-12652b57fc44 req-94ff89f8-b799-4739-aa93-646efd34353d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e91af2-4262-4e21-8b58-a2673e65c6e5", "name": "network-vif-plugged", "status": "completed", "tag": "a13b8b26-87fa-4d76-a119-0db796ee8f4a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:44.597989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-dbdb7b4e-ee73-4bb9-942d-12652b57fc44 req-94ff89f8-b799-4739-aa93-646efd34353d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:44.598793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-dbdb7b4e-ee73-4bb9-942d-12652b57fc44 req-94ff89f8-b799-4739-aa93-646efd34353d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:44.599626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-dbdb7b4e-ee73-4bb9-942d-12652b57fc44 req-94ff89f8-b799-4739-aa93-646efd34353d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:44.627781 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-dbdb7b4e-ee73-4bb9-942d-12652b57fc44 req-94ff89f8-b799-4739-aa93-646efd34353d service nova] Creating event network-vif-plugged:a13b8b26-87fa-4d76-a119-0db796ee8f4a for instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 on n-h2-860687-3 Oct 27 19:15:44.635245 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-dbdb7b4e-ee73-4bb9-942d-12652b57fc44 req-94ff89f8-b799-4739-aa93-646efd34353d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067664 Oct 27 19:15:44.636479 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2731/5618] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:44.783265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28131673-f06b-4208-8c2e-33d22aeee71a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:44.785149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-28131673-f06b-4208-8c2e-33d22aeee71a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:44.806607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28131673-f06b-4208-8c2e-33d22aeee71a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:44.818707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28131673-f06b-4208-8c2e-33d22aeee71a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:44.819126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fa31bfea-1ad7-418a-8538-f7d5ae946ee9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:44.825401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28131673-f06b-4208-8c2e-33d22aeee71a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:44.828094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28131673-f06b-4208-8c2e-33d22aeee71a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:44.832526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28131673-f06b-4208-8c2e-33d22aeee71a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:44.832983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28131673-f06b-4208-8c2e-33d22aeee71a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:44.845133 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fa31bfea-1ad7-418a-8538-f7d5ae946ee9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1428 microversion: 2.1 time: 1.559263 Oct 27 19:15:44.866599 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2888/5619] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:43 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1428 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:15:45.220289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-efbf103d-16bf-42b0-b763-6363875cb983 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:45.221157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-efbf103d-16bf-42b0-b763-6363875cb983 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:45.232158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efbf103d-16bf-42b0-b763-6363875cb983 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:45.235897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efbf103d-16bf-42b0-b763-6363875cb983 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:45.236549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efbf103d-16bf-42b0-b763-6363875cb983 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:45.239881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efbf103d-16bf-42b0-b763-6363875cb983 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:45.240559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efbf103d-16bf-42b0-b763-6363875cb983 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:45.244795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efbf103d-16bf-42b0-b763-6363875cb983 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:45.413478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-28131673-f06b-4208-8c2e-33d22aeee71a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:45.425263 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-28131673-f06b-4208-8c2e-33d22aeee71a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1695 microversion: 2.1 time: 0.646459 Oct 27 19:15:45.438420 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2732/5620] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:44 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1695 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:45.558798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-75399023-143e-4758-8a26-a357858f9434 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:45.558798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-75399023-143e-4758-8a26-a357858f9434 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:45.570272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:45.590945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75399023-143e-4758-8a26-a357858f9434 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:45.593385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75399023-143e-4758-8a26-a357858f9434 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:45.596497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75399023-143e-4758-8a26-a357858f9434 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:45.597615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75399023-143e-4758-8a26-a357858f9434 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:45.603604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75399023-143e-4758-8a26-a357858f9434 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:45.604508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75399023-143e-4758-8a26-a357858f9434 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:45.810624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-efbf103d-16bf-42b0-b763-6363875cb983 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:45.820954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-efbf103d-16bf-42b0-b763-6363875cb983 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:45.827063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-efbf103d-16bf-42b0-b763-6363875cb983 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:45.828514 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-efbf103d-16bf-42b0-b763-6363875cb983 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1797 microversion: 2.32 time: 0.612244 Oct 27 19:15:45.844232 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2889/5621] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:45 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1797 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:15:45.872234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d816d093-11de-4289-b966-d23153aba0b9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:45.873400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d816d093-11de-4289-b966-d23153aba0b9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:45.897802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d816d093-11de-4289-b966-d23153aba0b9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:45.907129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d816d093-11de-4289-b966-d23153aba0b9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:45.907821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d816d093-11de-4289-b966-d23153aba0b9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:45.908734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d816d093-11de-4289-b966-d23153aba0b9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:45.909382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d816d093-11de-4289-b966-d23153aba0b9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:45.909970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d816d093-11de-4289-b966-d23153aba0b9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:45.989764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-75399023-143e-4758-8a26-a357858f9434 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:46.004077 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-75399023-143e-4758-8a26-a357858f9434 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 0.450851 Oct 27 19:15:46.009647 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2733/5622] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:45 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:15:46.454688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb6ade1d-c376-49a3-941a-e82ad8134fc1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:46.455484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fb6ade1d-c376-49a3-941a-e82ad8134fc1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:46.467195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb6ade1d-c376-49a3-941a-e82ad8134fc1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:46.468398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb6ade1d-c376-49a3-941a-e82ad8134fc1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:46.471331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb6ade1d-c376-49a3-941a-e82ad8134fc1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:46.473858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb6ade1d-c376-49a3-941a-e82ad8134fc1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:46.475181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb6ade1d-c376-49a3-941a-e82ad8134fc1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:46.478248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb6ade1d-c376-49a3-941a-e82ad8134fc1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:46.752692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d816d093-11de-4289-b966-d23153aba0b9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:46.765232 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d816d093-11de-4289-b966-d23153aba0b9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1428 microversion: 2.1 time: 0.898127 Oct 27 19:15:46.771851 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2890/5623] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:45 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1428 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:46.859871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-598c69e2-a0d6-4868-bcba-727d1fa8f832 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:46.860697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-598c69e2-a0d6-4868-bcba-727d1fa8f832 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:46.881948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-598c69e2-a0d6-4868-bcba-727d1fa8f832 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:46.884438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-598c69e2-a0d6-4868-bcba-727d1fa8f832 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:46.886922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-598c69e2-a0d6-4868-bcba-727d1fa8f832 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:46.888558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-598c69e2-a0d6-4868-bcba-727d1fa8f832 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:46.890825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-598c69e2-a0d6-4868-bcba-727d1fa8f832 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:46.892069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-598c69e2-a0d6-4868-bcba-727d1fa8f832 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:47.172388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fb6ade1d-c376-49a3-941a-e82ad8134fc1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:47.188586 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fb6ade1d-c376-49a3-941a-e82ad8134fc1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1695 microversion: 2.1 time: 0.732720 Oct 27 19:15:47.189427 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2734/5624] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:46 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1695 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:47.223083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ce128ba-c22b-40a3-a19b-52159c8bf2a9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:47.227289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ce128ba-c22b-40a3-a19b-52159c8bf2a9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:47.247349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce128ba-c22b-40a3-a19b-52159c8bf2a9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:47.252746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce128ba-c22b-40a3-a19b-52159c8bf2a9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:47.254113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce128ba-c22b-40a3-a19b-52159c8bf2a9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:47.259507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce128ba-c22b-40a3-a19b-52159c8bf2a9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:47.262904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce128ba-c22b-40a3-a19b-52159c8bf2a9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:47.263578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce128ba-c22b-40a3-a19b-52159c8bf2a9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:47.599234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-598c69e2-a0d6-4868-bcba-727d1fa8f832 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:47.626628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-598c69e2-a0d6-4868-bcba-727d1fa8f832 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:47.632022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-598c69e2-a0d6-4868-bcba-727d1fa8f832 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:47.637997 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-598c69e2-a0d6-4868-bcba-727d1fa8f832 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1797 microversion: 2.32 time: 0.783929 Oct 27 19:15:47.641240 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2891/5625] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:46 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1797 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:15:47.794465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c709edc2-2926-4626-ae4f-a8d60ebb215c tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:47.795124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c709edc2-2926-4626-ae4f-a8d60ebb215c tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:47.804379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c709edc2-2926-4626-ae4f-a8d60ebb215c tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:47.804888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c709edc2-2926-4626-ae4f-a8d60ebb215c tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:47.805336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c709edc2-2926-4626-ae4f-a8d60ebb215c tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:47.806112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c709edc2-2926-4626-ae4f-a8d60ebb215c tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:47.806593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c709edc2-2926-4626-ae4f-a8d60ebb215c tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:47.818326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c709edc2-2926-4626-ae4f-a8d60ebb215c tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:47.851003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ce128ba-c22b-40a3-a19b-52159c8bf2a9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:47.871774 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ce128ba-c22b-40a3-a19b-52159c8bf2a9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 0.659271 Oct 27 19:15:47.872724 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2735/5626] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:47 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:48.221410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5fa5e646-9de2-4e42-898f-96a7ea0c0d53 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:48.222118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5fa5e646-9de2-4e42-898f-96a7ea0c0d53 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:48.234724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fa5e646-9de2-4e42-898f-96a7ea0c0d53 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:48.237566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fa5e646-9de2-4e42-898f-96a7ea0c0d53 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:48.238059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fa5e646-9de2-4e42-898f-96a7ea0c0d53 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:48.240993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fa5e646-9de2-4e42-898f-96a7ea0c0d53 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:48.242844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fa5e646-9de2-4e42-898f-96a7ea0c0d53 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:48.245003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fa5e646-9de2-4e42-898f-96a7ea0c0d53 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:48.411100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c709edc2-2926-4626-ae4f-a8d60ebb215c tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:48.428388 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c709edc2-2926-4626-ae4f-a8d60ebb215c tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1608 microversion: 2.1 time: 0.638698 Oct 27 19:15:48.429927 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2892/5627] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:47 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1608 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:48.490330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2b22697d-f2e5-495c-98a1-7d8e073b0a32 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:48.496653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2b22697d-f2e5-495c-98a1-7d8e073b0a32 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:48.519304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b22697d-f2e5-495c-98a1-7d8e073b0a32 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:48.519945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b22697d-f2e5-495c-98a1-7d8e073b0a32 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:48.521853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b22697d-f2e5-495c-98a1-7d8e073b0a32 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:48.527435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b22697d-f2e5-495c-98a1-7d8e073b0a32 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:48.528351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b22697d-f2e5-495c-98a1-7d8e073b0a32 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:48.529205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b22697d-f2e5-495c-98a1-7d8e073b0a32 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:48.664341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5fa5e646-9de2-4e42-898f-96a7ea0c0d53 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:48.686724 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5fa5e646-9de2-4e42-898f-96a7ea0c0d53 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1695 microversion: 2.1 time: 0.462715 Oct 27 19:15:48.687391 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2736/5628] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:48 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1695 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:15:48.703382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ecc900b9-e2e2-4e25-abf6-5b10a41b2049 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:48.710586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ecc900b9-e2e2-4e25-abf6-5b10a41b2049 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:48.730523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecc900b9-e2e2-4e25-abf6-5b10a41b2049 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:48.735229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecc900b9-e2e2-4e25-abf6-5b10a41b2049 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:48.737479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecc900b9-e2e2-4e25-abf6-5b10a41b2049 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:48.738562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecc900b9-e2e2-4e25-abf6-5b10a41b2049 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:48.740811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecc900b9-e2e2-4e25-abf6-5b10a41b2049 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:48.742657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecc900b9-e2e2-4e25-abf6-5b10a41b2049 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:49.326230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2b22697d-f2e5-495c-98a1-7d8e073b0a32 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:49.348415 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2b22697d-f2e5-495c-98a1-7d8e073b0a32 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1608 microversion: 2.1 time: 0.866378 Oct 27 19:15:49.350229 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2893/5629] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:48 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1608 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:49.370724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7509f767-c58a-4f3a-ab25-4caf8b0d1463 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:49.371376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7509f767-c58a-4f3a-ab25-4caf8b0d1463 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:49.373431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:49.386278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ecc900b9-e2e2-4e25-abf6-5b10a41b2049 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:49.419036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ecc900b9-e2e2-4e25-abf6-5b10a41b2049 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:49.420930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ecc900b9-e2e2-4e25-abf6-5b10a41b2049 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:49.423660 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ecc900b9-e2e2-4e25-abf6-5b10a41b2049 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1843 microversion: 2.32 time: 0.733531 Oct 27 19:15:49.424726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7509f767-c58a-4f3a-ab25-4caf8b0d1463 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:49.425209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7509f767-c58a-4f3a-ab25-4caf8b0d1463 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:49.425666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7509f767-c58a-4f3a-ab25-4caf8b0d1463 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:49.426408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7509f767-c58a-4f3a-ab25-4caf8b0d1463 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:49.426933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7509f767-c58a-4f3a-ab25-4caf8b0d1463 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:49.429813 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2737/5630] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:48 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1843 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:15:49.436838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7509f767-c58a-4f3a-ab25-4caf8b0d1463 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:49.449353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6f5acacf-052a-4e65-b60e-55cca88cf7f3 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:49.451256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6f5acacf-052a-4e65-b60e-55cca88cf7f3 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:49.482129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f5acacf-052a-4e65-b60e-55cca88cf7f3 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:49.491497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f5acacf-052a-4e65-b60e-55cca88cf7f3 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:49.494694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f5acacf-052a-4e65-b60e-55cca88cf7f3 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:49.497294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f5acacf-052a-4e65-b60e-55cca88cf7f3 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:49.498833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f5acacf-052a-4e65-b60e-55cca88cf7f3 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:49.499790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f5acacf-052a-4e65-b60e-55cca88cf7f3 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:49.841983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6f5acacf-052a-4e65-b60e-55cca88cf7f3 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:49.858764 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6f5acacf-052a-4e65-b60e-55cca88cf7f3 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1608 microversion: 2.1 time: 0.420391 Oct 27 19:15:49.883492 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2738/5631] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:49 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1608 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:49.907617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7e83b89c-3b26-4ef4-b034-a52c8e89d23b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:49.908713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7e83b89c-3b26-4ef4-b034-a52c8e89d23b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:49.927407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e83b89c-3b26-4ef4-b034-a52c8e89d23b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:49.930098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e83b89c-3b26-4ef4-b034-a52c8e89d23b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:49.932830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e83b89c-3b26-4ef4-b034-a52c8e89d23b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:49.936037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e83b89c-3b26-4ef4-b034-a52c8e89d23b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:49.947972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e83b89c-3b26-4ef4-b034-a52c8e89d23b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:49.949881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e83b89c-3b26-4ef4-b034-a52c8e89d23b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:50.371027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7e83b89c-3b26-4ef4-b034-a52c8e89d23b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:50.388995 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7e83b89c-3b26-4ef4-b034-a52c8e89d23b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1695 microversion: 2.1 time: 0.501337 Oct 27 19:15:50.389820 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2739/5632] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:49 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1695 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:50.462808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-167c67cf-b74c-401a-84d5-265407c3e188 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:50.463938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-167c67cf-b74c-401a-84d5-265407c3e188 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:50.475637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-167c67cf-b74c-401a-84d5-265407c3e188 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:50.478745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-167c67cf-b74c-401a-84d5-265407c3e188 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:50.479303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-167c67cf-b74c-401a-84d5-265407c3e188 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:50.480216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-167c67cf-b74c-401a-84d5-265407c3e188 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:50.480771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-167c67cf-b74c-401a-84d5-265407c3e188 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:50.482170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-167c67cf-b74c-401a-84d5-265407c3e188 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:50.841086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7509f767-c58a-4f3a-ab25-4caf8b0d1463 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:50.857388 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7509f767-c58a-4f3a-ab25-4caf8b0d1463 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 1.505788 Oct 27 19:15:50.858003 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2894/5633] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:49 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:51.085702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-167c67cf-b74c-401a-84d5-265407c3e188 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:51.105005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-167c67cf-b74c-401a-84d5-265407c3e188 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:51.108995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-167c67cf-b74c-401a-84d5-265407c3e188 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:51.115616 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-167c67cf-b74c-401a-84d5-265407c3e188 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1843 microversion: 2.32 time: 0.657165 Oct 27 19:15:51.133528 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2740/5634] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:50 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1843 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:15:51.426015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-48fa3aef-603f-4646-a0ed-430220bc08bc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:51.431543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-48fa3aef-603f-4646-a0ed-430220bc08bc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:51.468388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48fa3aef-603f-4646-a0ed-430220bc08bc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:51.475047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48fa3aef-603f-4646-a0ed-430220bc08bc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:51.476700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48fa3aef-603f-4646-a0ed-430220bc08bc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:51.479224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48fa3aef-603f-4646-a0ed-430220bc08bc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:51.480150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48fa3aef-603f-4646-a0ed-430220bc08bc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:51.481052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48fa3aef-603f-4646-a0ed-430220bc08bc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:51.888740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-76756286-bb6f-4223-8a74-9258293958f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:51.890870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-76756286-bb6f-4223-8a74-9258293958f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:51.911258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76756286-bb6f-4223-8a74-9258293958f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:51.911844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76756286-bb6f-4223-8a74-9258293958f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:51.912881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76756286-bb6f-4223-8a74-9258293958f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:51.916438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76756286-bb6f-4223-8a74-9258293958f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:51.917228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76756286-bb6f-4223-8a74-9258293958f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:51.919934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76756286-bb6f-4223-8a74-9258293958f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:52.628089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-76756286-bb6f-4223-8a74-9258293958f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:52.643465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-48fa3aef-603f-4646-a0ed-430220bc08bc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:52.660154 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-76756286-bb6f-4223-8a74-9258293958f0 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 0.774577 Oct 27 19:15:52.669589 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-48fa3aef-603f-4646-a0ed-430220bc08bc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1695 microversion: 2.1 time: 1.249180 Oct 27 19:15:52.672850 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2895/5635] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:51 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1695 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:52.700881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6658ad82-2e40-4f86-ba10-d049a99a51aa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:52.703859 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2741/5636] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:51 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:52.704829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6658ad82-2e40-4f86-ba10-d049a99a51aa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:52.710235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-a4affbbf-903e-4efc-af55-3c12f799604b req-8570f06a-2020-40f2-b038-210d7fd367cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "tag": "930eb105-32c0-40a2-a18f-960c696dabb1"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:52.719925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6658ad82-2e40-4f86-ba10-d049a99a51aa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:52.722770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6658ad82-2e40-4f86-ba10-d049a99a51aa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:52.723515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6658ad82-2e40-4f86-ba10-d049a99a51aa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:52.725839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a4affbbf-903e-4efc-af55-3c12f799604b req-8570f06a-2020-40f2-b038-210d7fd367cc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:52.726881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6658ad82-2e40-4f86-ba10-d049a99a51aa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:52.728140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6658ad82-2e40-4f86-ba10-d049a99a51aa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:52.728534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a4affbbf-903e-4efc-af55-3c12f799604b req-8570f06a-2020-40f2-b038-210d7fd367cc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:52.729176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6658ad82-2e40-4f86-ba10-d049a99a51aa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:52.729307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a4affbbf-903e-4efc-af55-3c12f799604b req-8570f06a-2020-40f2-b038-210d7fd367cc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:52.742635 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a4affbbf-903e-4efc-af55-3c12f799604b req-8570f06a-2020-40f2-b038-210d7fd367cc service nova] Creating event network-changed:930eb105-32c0-40a2-a18f-960c696dabb1 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:15:52.748930 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-a4affbbf-903e-4efc-af55-3c12f799604b req-8570f06a-2020-40f2-b038-210d7fd367cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043043 Oct 27 19:15:52.749800 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2742/5637] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:53.725095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00662809-7431-48d5-b789-851d09938db3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:53.726571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-00662809-7431-48d5-b789-851d09938db3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:53.745278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00662809-7431-48d5-b789-851d09938db3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:53.746126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00662809-7431-48d5-b789-851d09938db3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:53.746780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00662809-7431-48d5-b789-851d09938db3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:53.747706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00662809-7431-48d5-b789-851d09938db3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:53.748346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00662809-7431-48d5-b789-851d09938db3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:53.748946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00662809-7431-48d5-b789-851d09938db3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:54.077378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6658ad82-2e40-4f86-ba10-d049a99a51aa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:54.093060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6658ad82-2e40-4f86-ba10-d049a99a51aa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:54.096702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6658ad82-2e40-4f86-ba10-d049a99a51aa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:54.100406 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6658ad82-2e40-4f86-ba10-d049a99a51aa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1843 microversion: 2.32 time: 1.425116 Oct 27 19:15:54.105077 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2896/5638] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:52 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1843 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:15:54.119903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2886b101-5bb7-47cc-ade0-08d4d59723d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:54.120836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2886b101-5bb7-47cc-ade0-08d4d59723d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:54.134327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2886b101-5bb7-47cc-ade0-08d4d59723d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:54.137051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2886b101-5bb7-47cc-ade0-08d4d59723d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:54.137818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2886b101-5bb7-47cc-ade0-08d4d59723d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:54.139779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2886b101-5bb7-47cc-ade0-08d4d59723d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:54.141593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2886b101-5bb7-47cc-ade0-08d4d59723d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:54.143369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2886b101-5bb7-47cc-ade0-08d4d59723d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:54.868991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-00662809-7431-48d5-b789-851d09938db3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:54.885293 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-00662809-7431-48d5-b789-851d09938db3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1695 microversion: 2.1 time: 1.163769 Oct 27 19:15:54.902065 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2743/5639] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:53 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1695 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:55.133059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4ca04696-0ecf-48f9-bfa7-ef9b412b1312 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:55.134661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4ca04696-0ecf-48f9-bfa7-ef9b412b1312 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:55.146816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ca04696-0ecf-48f9-bfa7-ef9b412b1312 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:55.147949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ca04696-0ecf-48f9-bfa7-ef9b412b1312 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:55.148615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ca04696-0ecf-48f9-bfa7-ef9b412b1312 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:55.149851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ca04696-0ecf-48f9-bfa7-ef9b412b1312 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:55.156902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ca04696-0ecf-48f9-bfa7-ef9b412b1312 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:55.157717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ca04696-0ecf-48f9-bfa7-ef9b412b1312 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:55.225120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2886b101-5bb7-47cc-ade0-08d4d59723d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:55.233618 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2886b101-5bb7-47cc-ade0-08d4d59723d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 1.127283 Oct 27 19:15:55.234863 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2897/5640] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:54 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:55.706151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4ca04696-0ecf-48f9-bfa7-ef9b412b1312 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:55.717975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4ca04696-0ecf-48f9-bfa7-ef9b412b1312 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:55.730242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4ca04696-0ecf-48f9-bfa7-ef9b412b1312 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:55.734519 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4ca04696-0ecf-48f9-bfa7-ef9b412b1312 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1843 microversion: 2.32 time: 0.605484 Oct 27 19:15:55.740063 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2744/5641] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:55 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1843 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:15:55.913847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b72564d4-70f2-4b94-b136-954efd83d2e9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:55.914835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b72564d4-70f2-4b94-b136-954efd83d2e9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:55.942064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b72564d4-70f2-4b94-b136-954efd83d2e9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:55.942858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b72564d4-70f2-4b94-b136-954efd83d2e9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:55.943480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b72564d4-70f2-4b94-b136-954efd83d2e9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:55.944760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b72564d4-70f2-4b94-b136-954efd83d2e9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:55.945451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b72564d4-70f2-4b94-b136-954efd83d2e9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:55.946447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b72564d4-70f2-4b94-b136-954efd83d2e9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:55.975478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:15:56.256993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a60d009a-5af2-4f9c-a243-1c4d4cbd6366 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:56.257780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a60d009a-5af2-4f9c-a243-1c4d4cbd6366 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:56.282003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a60d009a-5af2-4f9c-a243-1c4d4cbd6366 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:56.282692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a60d009a-5af2-4f9c-a243-1c4d4cbd6366 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:56.283163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a60d009a-5af2-4f9c-a243-1c4d4cbd6366 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:56.283943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a60d009a-5af2-4f9c-a243-1c4d4cbd6366 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:56.284421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a60d009a-5af2-4f9c-a243-1c4d4cbd6366 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:56.284868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a60d009a-5af2-4f9c-a243-1c4d4cbd6366 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:56.623799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b72564d4-70f2-4b94-b136-954efd83d2e9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:56.636567 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b72564d4-70f2-4b94-b136-954efd83d2e9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1695 microversion: 2.1 time: 0.727243 Oct 27 19:15:56.637992 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2898/5642] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:55 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1695 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:56.644934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-0b47f754-68bd-4e3b-98d3-9a12adba0e3c req-173a5f0a-a6ef-4cd1-a0be-6b88e9b5cdff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e91af2-4262-4e21-8b58-a2673e65c6e5", "tag": "a13b8b26-87fa-4d76-a119-0db796ee8f4a"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:56.669669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0b47f754-68bd-4e3b-98d3-9a12adba0e3c req-173a5f0a-a6ef-4cd1-a0be-6b88e9b5cdff service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:56.673593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0b47f754-68bd-4e3b-98d3-9a12adba0e3c req-173a5f0a-a6ef-4cd1-a0be-6b88e9b5cdff service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:56.674250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0b47f754-68bd-4e3b-98d3-9a12adba0e3c req-173a5f0a-a6ef-4cd1-a0be-6b88e9b5cdff service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:56.704576 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-0b47f754-68bd-4e3b-98d3-9a12adba0e3c req-173a5f0a-a6ef-4cd1-a0be-6b88e9b5cdff service nova] Creating event network-changed:a13b8b26-87fa-4d76-a119-0db796ee8f4a for instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 on n-h2-860687-3 Oct 27 19:15:56.710794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a60d009a-5af2-4f9c-a243-1c4d4cbd6366 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:56.717622 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-0b47f754-68bd-4e3b-98d3-9a12adba0e3c req-173a5f0a-a6ef-4cd1-a0be-6b88e9b5cdff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078109 Oct 27 19:15:56.720666 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2899/5643] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:15:56.724622 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a60d009a-5af2-4f9c-a243-1c4d4cbd6366 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 0.471411 Oct 27 19:15:56.747590 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2745/5644] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:56 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:56.773280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7d82ea62-b5ce-4615-99c1-94f1b9ec8a9a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:56.774002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7d82ea62-b5ce-4615-99c1-94f1b9ec8a9a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:56.796068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d82ea62-b5ce-4615-99c1-94f1b9ec8a9a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:56.796574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d82ea62-b5ce-4615-99c1-94f1b9ec8a9a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:56.805516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d82ea62-b5ce-4615-99c1-94f1b9ec8a9a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:56.806296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d82ea62-b5ce-4615-99c1-94f1b9ec8a9a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:56.817369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d82ea62-b5ce-4615-99c1-94f1b9ec8a9a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:56.835325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d82ea62-b5ce-4615-99c1-94f1b9ec8a9a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:57.440865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-8bf727bd-49bb-457c-b0c8-a7aa0f9630e3 req-9f6277c6-d6ca-49e1-bfc0-2a2ea3005a81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "tag": "97527b5c-4373-4fee-b901-c12096d23c2c"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:15:57.457957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8bf727bd-49bb-457c-b0c8-a7aa0f9630e3 req-9f6277c6-d6ca-49e1-bfc0-2a2ea3005a81 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:57.458470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8bf727bd-49bb-457c-b0c8-a7aa0f9630e3 req-9f6277c6-d6ca-49e1-bfc0-2a2ea3005a81 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:57.464279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8bf727bd-49bb-457c-b0c8-a7aa0f9630e3 req-9f6277c6-d6ca-49e1-bfc0-2a2ea3005a81 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:57.495586 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-8bf727bd-49bb-457c-b0c8-a7aa0f9630e3 req-9f6277c6-d6ca-49e1-bfc0-2a2ea3005a81 service nova] Creating event network-changed:97527b5c-4373-4fee-b901-c12096d23c2c for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:15:57.507939 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-8bf727bd-49bb-457c-b0c8-a7aa0f9630e3 req-9f6277c6-d6ca-49e1-bfc0-2a2ea3005a81 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071725 Oct 27 19:15:57.511568 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2746/5645] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:15:57.668610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e360055-e0f4-408c-a802-9b43aeb220fe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:57.669724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9e360055-e0f4-408c-a802-9b43aeb220fe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:57.687519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e360055-e0f4-408c-a802-9b43aeb220fe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:57.688494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e360055-e0f4-408c-a802-9b43aeb220fe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:57.689250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e360055-e0f4-408c-a802-9b43aeb220fe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:57.691395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e360055-e0f4-408c-a802-9b43aeb220fe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:57.694824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e360055-e0f4-408c-a802-9b43aeb220fe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:57.696254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e360055-e0f4-408c-a802-9b43aeb220fe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:57.981636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7d82ea62-b5ce-4615-99c1-94f1b9ec8a9a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:58.003266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7d82ea62-b5ce-4615-99c1-94f1b9ec8a9a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:58.006654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7d82ea62-b5ce-4615-99c1-94f1b9ec8a9a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:58.011920 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7d82ea62-b5ce-4615-99c1-94f1b9ec8a9a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1864 microversion: 2.32 time: 1.242594 Oct 27 19:15:58.038449 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2900/5646] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:56 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1864 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:15:58.054709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-036ef670-f77e-4a3d-9107-74d13211a677 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:58.057160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-036ef670-f77e-4a3d-9107-74d13211a677 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:58.087212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-036ef670-f77e-4a3d-9107-74d13211a677 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:58.088083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-036ef670-f77e-4a3d-9107-74d13211a677 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:58.089165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-036ef670-f77e-4a3d-9107-74d13211a677 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:58.098122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-036ef670-f77e-4a3d-9107-74d13211a677 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:58.100678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-036ef670-f77e-4a3d-9107-74d13211a677 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:58.103741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-036ef670-f77e-4a3d-9107-74d13211a677 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:59.027333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-036ef670-f77e-4a3d-9107-74d13211a677 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:59.039275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9e360055-e0f4-408c-a802-9b43aeb220fe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:59.041355 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-036ef670-f77e-4a3d-9107-74d13211a677 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 0.999132 Oct 27 19:15:59.046162 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2901/5647] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:58 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:59.058264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-db30c2b0-c931-4867-ba79-a6f009cf64f7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:15:59.072024 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9e360055-e0f4-408c-a802-9b43aeb220fe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1695 microversion: 2.1 time: 1.408796 Oct 27 19:15:59.075270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-db30c2b0-c931-4867-ba79-a6f009cf64f7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:15:59.092704 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2747/5648] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:15:57 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1695 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:15:59.107499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db30c2b0-c931-4867-ba79-a6f009cf64f7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:59.109047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db30c2b0-c931-4867-ba79-a6f009cf64f7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:59.109581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db30c2b0-c931-4867-ba79-a6f009cf64f7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:59.112893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db30c2b0-c931-4867-ba79-a6f009cf64f7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:15:59.116190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db30c2b0-c931-4867-ba79-a6f009cf64f7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:15:59.116794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db30c2b0-c931-4867-ba79-a6f009cf64f7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:15:59.822908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-db30c2b0-c931-4867-ba79-a6f009cf64f7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:59.856107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-db30c2b0-c931-4867-ba79-a6f009cf64f7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:59.861401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-db30c2b0-c931-4867-ba79-a6f009cf64f7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:15:59.864688 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-db30c2b0-c931-4867-ba79-a6f009cf64f7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1885 microversion: 2.32 time: 0.817324 Oct 27 19:15:59.866030 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2902/5649] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:15:59 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1885 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:00.076774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a268479a-dcb5-447f-9202-dd6a779a4a63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:00.079280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a268479a-dcb5-447f-9202-dd6a779a4a63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:00.102301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9eada76a-480c-4db8-ae73-276febb6af6b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:00.103361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9eada76a-480c-4db8-ae73-276febb6af6b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:00.118901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9eada76a-480c-4db8-ae73-276febb6af6b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:00.119408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9eada76a-480c-4db8-ae73-276febb6af6b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:00.119859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9eada76a-480c-4db8-ae73-276febb6af6b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:00.120585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9eada76a-480c-4db8-ae73-276febb6af6b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:00.125211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a268479a-dcb5-447f-9202-dd6a779a4a63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:00.129143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9eada76a-480c-4db8-ae73-276febb6af6b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:00.130169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a268479a-dcb5-447f-9202-dd6a779a4a63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:00.130673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a268479a-dcb5-447f-9202-dd6a779a4a63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:00.132568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9eada76a-480c-4db8-ae73-276febb6af6b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:00.136386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a268479a-dcb5-447f-9202-dd6a779a4a63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:00.161497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a268479a-dcb5-447f-9202-dd6a779a4a63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:00.168878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a268479a-dcb5-447f-9202-dd6a779a4a63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:00.292728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:16:00.958489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9eada76a-480c-4db8-ae73-276febb6af6b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:00.968345 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9eada76a-480c-4db8-ae73-276febb6af6b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1695 microversion: 2.1 time: 0.869979 Oct 27 19:16:00.979664 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2903/5650] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:00 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1695 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:01.001953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-07070dac-b561-4240-ae0b-e90f3bd9df04 req-d9b97658-e0d8-451d-b748-70607eb58ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "tag": "2b342788-17c7-4f8c-859c-82ded55435e9"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:01.071762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-07070dac-b561-4240-ae0b-e90f3bd9df04 req-d9b97658-e0d8-451d-b748-70607eb58ea6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:01.072429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-07070dac-b561-4240-ae0b-e90f3bd9df04 req-d9b97658-e0d8-451d-b748-70607eb58ea6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:01.074455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-07070dac-b561-4240-ae0b-e90f3bd9df04 req-d9b97658-e0d8-451d-b748-70607eb58ea6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:01.099339 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-07070dac-b561-4240-ae0b-e90f3bd9df04 req-d9b97658-e0d8-451d-b748-70607eb58ea6 service nova] Creating event network-changed:2b342788-17c7-4f8c-859c-82ded55435e9 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:16:01.116016 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-07070dac-b561-4240-ae0b-e90f3bd9df04 req-d9b97658-e0d8-451d-b748-70607eb58ea6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133019 Oct 27 19:16:01.118915 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2904/5651] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:16:01.126179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0ae53cd3-ff4f-4ddf-8990-ee2ffd18572b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:01.127166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0ae53cd3-ff4f-4ddf-8990-ee2ffd18572b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:01.139545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ae53cd3-ff4f-4ddf-8990-ee2ffd18572b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:01.140382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ae53cd3-ff4f-4ddf-8990-ee2ffd18572b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:01.142150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ae53cd3-ff4f-4ddf-8990-ee2ffd18572b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:01.143179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ae53cd3-ff4f-4ddf-8990-ee2ffd18572b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:01.144184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ae53cd3-ff4f-4ddf-8990-ee2ffd18572b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:01.144856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ae53cd3-ff4f-4ddf-8990-ee2ffd18572b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:01.419865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a268479a-dcb5-447f-9202-dd6a779a4a63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:01.428642 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a268479a-dcb5-447f-9202-dd6a779a4a63 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 1.361921 Oct 27 19:16:01.429335 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2748/5652] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:00 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:02.007337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d4a941cf-61ce-4538-98b4-5e910d55ea72 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:02.008015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d4a941cf-61ce-4538-98b4-5e910d55ea72 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:02.027030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d4a941cf-61ce-4538-98b4-5e910d55ea72 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:02.027637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d4a941cf-61ce-4538-98b4-5e910d55ea72 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:02.028100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d4a941cf-61ce-4538-98b4-5e910d55ea72 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:02.032367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d4a941cf-61ce-4538-98b4-5e910d55ea72 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:02.034875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d4a941cf-61ce-4538-98b4-5e910d55ea72 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:02.035506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d4a941cf-61ce-4538-98b4-5e910d55ea72 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:02.392710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0ae53cd3-ff4f-4ddf-8990-ee2ffd18572b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:02.420415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0ae53cd3-ff4f-4ddf-8990-ee2ffd18572b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:02.422204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0ae53cd3-ff4f-4ddf-8990-ee2ffd18572b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:02.436755 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0ae53cd3-ff4f-4ddf-8990-ee2ffd18572b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1885 microversion: 2.32 time: 1.316281 Oct 27 19:16:02.445653 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2905/5653] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:01 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1885 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:02.484448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-726cab2b-6218-4eb3-80aa-1e82602545ff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:02.488502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-726cab2b-6218-4eb3-80aa-1e82602545ff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:02.523833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-726cab2b-6218-4eb3-80aa-1e82602545ff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:02.531897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-726cab2b-6218-4eb3-80aa-1e82602545ff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:02.532623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-726cab2b-6218-4eb3-80aa-1e82602545ff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:02.533734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-726cab2b-6218-4eb3-80aa-1e82602545ff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:02.538233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-726cab2b-6218-4eb3-80aa-1e82602545ff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:02.539179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-726cab2b-6218-4eb3-80aa-1e82602545ff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:03.299233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d4a941cf-61ce-4538-98b4-5e910d55ea72 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:03.321532 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d4a941cf-61ce-4538-98b4-5e910d55ea72 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1695 microversion: 2.1 time: 1.314091 Oct 27 19:16:03.322169 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2749/5654] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:02 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1695 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:03.407672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-726cab2b-6218-4eb3-80aa-1e82602545ff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:03.428169 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-726cab2b-6218-4eb3-80aa-1e82602545ff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 0.971118 Oct 27 19:16:03.429195 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2906/5655] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:02 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:16:03.465102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e8d26b21-4f28-46ad-abfe-72e1b299892a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:03.465880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e8d26b21-4f28-46ad-abfe-72e1b299892a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:03.473417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8d26b21-4f28-46ad-abfe-72e1b299892a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:03.474074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8d26b21-4f28-46ad-abfe-72e1b299892a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:03.474653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8d26b21-4f28-46ad-abfe-72e1b299892a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:03.475521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8d26b21-4f28-46ad-abfe-72e1b299892a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:03.476071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8d26b21-4f28-46ad-abfe-72e1b299892a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:03.476756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8d26b21-4f28-46ad-abfe-72e1b299892a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:04.167969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8d26b21-4f28-46ad-abfe-72e1b299892a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:04.186648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8d26b21-4f28-46ad-abfe-72e1b299892a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:04.188946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8d26b21-4f28-46ad-abfe-72e1b299892a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:04.224075 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e8d26b21-4f28-46ad-abfe-72e1b299892a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1885 microversion: 2.32 time: 0.762817 Oct 27 19:16:04.234155 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2750/5656] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:03 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1885 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:04.262074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-0581bd07-1f9b-4da5-8868-4c509c968122 req-94e15423-3d89-47aa-b6ef-7aabc0e0900d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "tag": "4ce86d42-71a2-4e2c-87ec-79cedd1a70d0"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:04.303505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0581bd07-1f9b-4da5-8868-4c509c968122 req-94e15423-3d89-47aa-b6ef-7aabc0e0900d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:04.310901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0581bd07-1f9b-4da5-8868-4c509c968122 req-94e15423-3d89-47aa-b6ef-7aabc0e0900d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:04.311446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0581bd07-1f9b-4da5-8868-4c509c968122 req-94e15423-3d89-47aa-b6ef-7aabc0e0900d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:04.351803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-61769dc9-2e56-4435-be6e-b3b471f24bb8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:04.354145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-61769dc9-2e56-4435-be6e-b3b471f24bb8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:04.368722 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-0581bd07-1f9b-4da5-8868-4c509c968122 req-94e15423-3d89-47aa-b6ef-7aabc0e0900d service nova] Creating event network-changed:4ce86d42-71a2-4e2c-87ec-79cedd1a70d0 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:16:04.370263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61769dc9-2e56-4435-be6e-b3b471f24bb8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:04.371373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61769dc9-2e56-4435-be6e-b3b471f24bb8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:04.372551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61769dc9-2e56-4435-be6e-b3b471f24bb8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:04.373682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61769dc9-2e56-4435-be6e-b3b471f24bb8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:04.374433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61769dc9-2e56-4435-be6e-b3b471f24bb8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:04.375068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61769dc9-2e56-4435-be6e-b3b471f24bb8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:04.385494 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-0581bd07-1f9b-4da5-8868-4c509c968122 req-94e15423-3d89-47aa-b6ef-7aabc0e0900d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153368 Oct 27 19:16:04.388344 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2907/5657] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:16:04.456246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2b3c6ca6-9b8b-4dd2-ae36-9fc0e9ffa824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:04.457752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2b3c6ca6-9b8b-4dd2-ae36-9fc0e9ffa824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:04.473632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b3c6ca6-9b8b-4dd2-ae36-9fc0e9ffa824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:04.480715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b3c6ca6-9b8b-4dd2-ae36-9fc0e9ffa824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:04.483325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b3c6ca6-9b8b-4dd2-ae36-9fc0e9ffa824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:04.484332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b3c6ca6-9b8b-4dd2-ae36-9fc0e9ffa824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:04.484990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b3c6ca6-9b8b-4dd2-ae36-9fc0e9ffa824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:04.487379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b3c6ca6-9b8b-4dd2-ae36-9fc0e9ffa824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:05.091751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2b3c6ca6-9b8b-4dd2-ae36-9fc0e9ffa824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:05.104308 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2b3c6ca6-9b8b-4dd2-ae36-9fc0e9ffa824 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 0.653447 Oct 27 19:16:05.126770 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2908/5658] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:04 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:16:05.265714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e67269a1-1c71-4d58-82e9-2edea4cbc039 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:05.272904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e67269a1-1c71-4d58-82e9-2edea4cbc039 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:05.295556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e67269a1-1c71-4d58-82e9-2edea4cbc039 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:05.297786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e67269a1-1c71-4d58-82e9-2edea4cbc039 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:05.299226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e67269a1-1c71-4d58-82e9-2edea4cbc039 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:05.302557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e67269a1-1c71-4d58-82e9-2edea4cbc039 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:05.307483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e67269a1-1c71-4d58-82e9-2edea4cbc039 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:05.310853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e67269a1-1c71-4d58-82e9-2edea4cbc039 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:06.160606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-61769dc9-2e56-4435-be6e-b3b471f24bb8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:06.167884 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-61769dc9-2e56-4435-be6e-b3b471f24bb8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1695 microversion: 2.1 time: 1.822519 Oct 27 19:16:06.193626 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2751/5659] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:04 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1695 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:16:06.207591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b9deb6bf-76ae-4f86-b773-d4e4b3f164c2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:06.210785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b9deb6bf-76ae-4f86-b773-d4e4b3f164c2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:06.240367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9deb6bf-76ae-4f86-b773-d4e4b3f164c2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:06.241344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9deb6bf-76ae-4f86-b773-d4e4b3f164c2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:06.242020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9deb6bf-76ae-4f86-b773-d4e4b3f164c2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:06.247350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9deb6bf-76ae-4f86-b773-d4e4b3f164c2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:06.248194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9deb6bf-76ae-4f86-b773-d4e4b3f164c2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:06.249823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9deb6bf-76ae-4f86-b773-d4e4b3f164c2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:06.667818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b9deb6bf-76ae-4f86-b773-d4e4b3f164c2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:06.680571 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b9deb6bf-76ae-4f86-b773-d4e4b3f164c2 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 0.480245 Oct 27 19:16:06.681552 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2752/5660] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:06 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:06.787717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e67269a1-1c71-4d58-82e9-2edea4cbc039 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:06.803688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e67269a1-1c71-4d58-82e9-2edea4cbc039 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:06.807547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e67269a1-1c71-4d58-82e9-2edea4cbc039 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:06.817292 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e67269a1-1c71-4d58-82e9-2edea4cbc039 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1885 microversion: 2.32 time: 1.556789 Oct 27 19:16:06.822304 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2909/5661] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:05 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1885 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:07.200720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6297c58a-e532-4b43-acac-9ece91d88ced tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:07.201949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6297c58a-e532-4b43-acac-9ece91d88ced tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:07.220455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6297c58a-e532-4b43-acac-9ece91d88ced tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:07.221296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6297c58a-e532-4b43-acac-9ece91d88ced tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:07.222031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6297c58a-e532-4b43-acac-9ece91d88ced tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:07.225156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6297c58a-e532-4b43-acac-9ece91d88ced tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:07.231591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6297c58a-e532-4b43-acac-9ece91d88ced tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:07.232392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6297c58a-e532-4b43-acac-9ece91d88ced tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:07.708619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b1b4f84-2e33-4a0f-a412-42f2ef77b808 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:07.709357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b1b4f84-2e33-4a0f-a412-42f2ef77b808 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:07.725521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b1b4f84-2e33-4a0f-a412-42f2ef77b808 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:07.731837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b1b4f84-2e33-4a0f-a412-42f2ef77b808 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:07.735437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b1b4f84-2e33-4a0f-a412-42f2ef77b808 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:07.738915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b1b4f84-2e33-4a0f-a412-42f2ef77b808 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:07.740257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b1b4f84-2e33-4a0f-a412-42f2ef77b808 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:07.740945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b1b4f84-2e33-4a0f-a412-42f2ef77b808 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:08.119480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6297c58a-e532-4b43-acac-9ece91d88ced tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:08.150798 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6297c58a-e532-4b43-acac-9ece91d88ced tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1694 microversion: 2.1 time: 0.953766 Oct 27 19:16:08.162181 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2753/5662] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:07 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1694 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:08.172041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-58184d34-3cb0-4076-b88e-ddb13bcd4f17 req-2eeb2236-ab46-4a5a-a46f-17b7353b8b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "tag": "22ff15ff-92e5-4daa-abf0-a7696778e3f7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:08.252839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3b1b4f84-2e33-4a0f-a412-42f2ef77b808 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:08.257733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-58184d34-3cb0-4076-b88e-ddb13bcd4f17 req-2eeb2236-ab46-4a5a-a46f-17b7353b8b13 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:08.258334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-58184d34-3cb0-4076-b88e-ddb13bcd4f17 req-2eeb2236-ab46-4a5a-a46f-17b7353b8b13 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:08.265159 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b1b4f84-2e33-4a0f-a412-42f2ef77b808 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 0.561245 Oct 27 19:16:08.268118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-58184d34-3cb0-4076-b88e-ddb13bcd4f17 req-2eeb2236-ab46-4a5a-a46f-17b7353b8b13 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:08.268560 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2910/5663] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:07 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:08.287203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a724537c-773d-4327-a475-82f37ee2910e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:08.288707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a724537c-773d-4327-a475-82f37ee2910e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:08.314066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a724537c-773d-4327-a475-82f37ee2910e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:08.316887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a724537c-773d-4327-a475-82f37ee2910e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:08.317722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a724537c-773d-4327-a475-82f37ee2910e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:08.319232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a724537c-773d-4327-a475-82f37ee2910e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:08.322686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a724537c-773d-4327-a475-82f37ee2910e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:08.332792 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-58184d34-3cb0-4076-b88e-ddb13bcd4f17 req-2eeb2236-ab46-4a5a-a46f-17b7353b8b13 service nova] Creating event network-changed:22ff15ff-92e5-4daa-abf0-a7696778e3f7 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:16:08.336490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a724537c-773d-4327-a475-82f37ee2910e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:08.364738 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-58184d34-3cb0-4076-b88e-ddb13bcd4f17 req-2eeb2236-ab46-4a5a-a46f-17b7353b8b13 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199095 Oct 27 19:16:08.369133 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2754/5664] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:16:08.895673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a724537c-773d-4327-a475-82f37ee2910e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:08.907916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a724537c-773d-4327-a475-82f37ee2910e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:08.916158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a724537c-773d-4327-a475-82f37ee2910e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:08.919365 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a724537c-773d-4327-a475-82f37ee2910e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1885 microversion: 2.32 time: 0.641730 Oct 27 19:16:08.920573 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2911/5665] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:08 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1885 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:09.179331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e7d2ea14-73f6-4734-9b43-7e96b9e2dfeb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:09.180845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e7d2ea14-73f6-4734-9b43-7e96b9e2dfeb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:09.203534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7d2ea14-73f6-4734-9b43-7e96b9e2dfeb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:09.204034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7d2ea14-73f6-4734-9b43-7e96b9e2dfeb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:09.205357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7d2ea14-73f6-4734-9b43-7e96b9e2dfeb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:09.209415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7d2ea14-73f6-4734-9b43-7e96b9e2dfeb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:09.210723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7d2ea14-73f6-4734-9b43-7e96b9e2dfeb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:09.213457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7d2ea14-73f6-4734-9b43-7e96b9e2dfeb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:09.295939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2c782c35-c03d-4280-a8ba-6d6241830e72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:09.297049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2c782c35-c03d-4280-a8ba-6d6241830e72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:09.310734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c782c35-c03d-4280-a8ba-6d6241830e72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:09.311612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c782c35-c03d-4280-a8ba-6d6241830e72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:09.312553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c782c35-c03d-4280-a8ba-6d6241830e72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:09.313495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c782c35-c03d-4280-a8ba-6d6241830e72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:09.314183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c782c35-c03d-4280-a8ba-6d6241830e72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:09.314883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c782c35-c03d-4280-a8ba-6d6241830e72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:09.886543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2c782c35-c03d-4280-a8ba-6d6241830e72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:09.897998 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2c782c35-c03d-4280-a8ba-6d6241830e72 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 0.606765 Oct 27 19:16:09.900701 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2912/5666] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:09 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:09.950309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5c2cfe99-8de9-4e62-9367-e3b5fe28b16f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:09.951260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5c2cfe99-8de9-4e62-9367-e3b5fe28b16f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:09.968227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c2cfe99-8de9-4e62-9367-e3b5fe28b16f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:09.972031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c2cfe99-8de9-4e62-9367-e3b5fe28b16f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:09.972835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c2cfe99-8de9-4e62-9367-e3b5fe28b16f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:09.976799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c2cfe99-8de9-4e62-9367-e3b5fe28b16f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:09.979469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c2cfe99-8de9-4e62-9367-e3b5fe28b16f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:09.981892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c2cfe99-8de9-4e62-9367-e3b5fe28b16f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:10.016806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e7d2ea14-73f6-4734-9b43-7e96b9e2dfeb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:10.034266 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e7d2ea14-73f6-4734-9b43-7e96b9e2dfeb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1694 microversion: 2.1 time: 0.858725 Oct 27 19:16:10.036887 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2755/5667] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:09 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1694 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:10.606113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-e61b2ca7-0e15-47ed-9c8d-b752ca314304 req-c3bfa1b1-a785-4060-bd9f-8376cba5a278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "tag": "03f458ee-4642-43c5-b1e8-c0561e0c41f5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:10.640056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e61b2ca7-0e15-47ed-9c8d-b752ca314304 req-c3bfa1b1-a785-4060-bd9f-8376cba5a278 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:10.643801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e61b2ca7-0e15-47ed-9c8d-b752ca314304 req-c3bfa1b1-a785-4060-bd9f-8376cba5a278 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:10.645554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e61b2ca7-0e15-47ed-9c8d-b752ca314304 req-c3bfa1b1-a785-4060-bd9f-8376cba5a278 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:10.673547 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-e61b2ca7-0e15-47ed-9c8d-b752ca314304 req-c3bfa1b1-a785-4060-bd9f-8376cba5a278 service nova] Creating event network-changed:03f458ee-4642-43c5-b1e8-c0561e0c41f5 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:16:10.688505 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-e61b2ca7-0e15-47ed-9c8d-b752ca314304 req-c3bfa1b1-a785-4060-bd9f-8376cba5a278 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087716 Oct 27 19:16:10.689408 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2756/5668] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:16:10.833801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5c2cfe99-8de9-4e62-9367-e3b5fe28b16f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:10.849752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5c2cfe99-8de9-4e62-9367-e3b5fe28b16f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:10.879243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5c2cfe99-8de9-4e62-9367-e3b5fe28b16f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:10.879243 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5c2cfe99-8de9-4e62-9367-e3b5fe28b16f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1885 microversion: 2.32 time: 0.933254 Oct 27 19:16:10.892647 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2913/5669] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:09 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1885 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:10.932540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e43ad4d5-e538-48f0-bba0-abe2b94a2b99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:10.933267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e43ad4d5-e538-48f0-bba0-abe2b94a2b99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:10.940448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e43ad4d5-e538-48f0-bba0-abe2b94a2b99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:10.941172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e43ad4d5-e538-48f0-bba0-abe2b94a2b99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:10.941805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e43ad4d5-e538-48f0-bba0-abe2b94a2b99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:10.942837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e43ad4d5-e538-48f0-bba0-abe2b94a2b99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:10.943473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e43ad4d5-e538-48f0-bba0-abe2b94a2b99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:10.944075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e43ad4d5-e538-48f0-bba0-abe2b94a2b99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:11.003280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-2d235509-eb81-4445-9978-3203487ebbe6 req-1f96095c-f044-42bc-9dab-3a0d38eb40c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1263b108-e237-4eee-88af-6e2fda4ed792", "name": "network-vif-unplugged", "status": "completed", "tag": "e01e3433-ca7f-4e03-9286-deabd11d6744"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:11.028230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2d235509-eb81-4445-9978-3203487ebbe6 req-1f96095c-f044-42bc-9dab-3a0d38eb40c3 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:11.028827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2d235509-eb81-4445-9978-3203487ebbe6 req-1f96095c-f044-42bc-9dab-3a0d38eb40c3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:11.030056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2d235509-eb81-4445-9978-3203487ebbe6 req-1f96095c-f044-42bc-9dab-3a0d38eb40c3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:11.071655 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-2d235509-eb81-4445-9978-3203487ebbe6 req-1f96095c-f044-42bc-9dab-3a0d38eb40c3 service nova] Creating event network-vif-unplugged:e01e3433-ca7f-4e03-9286-deabd11d6744 for instance 1263b108-e237-4eee-88af-6e2fda4ed792 on n-h2-860687-3 Oct 27 19:16:11.087306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-2d235509-eb81-4445-9978-3203487ebbe6 req-1f96095c-f044-42bc-9dab-3a0d38eb40c3 service nova] Instance 1263b108-e237-4eee-88af-6e2fda4ed792 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:16:11.112365 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-2d235509-eb81-4445-9978-3203487ebbe6 req-1f96095c-f044-42bc-9dab-3a0d38eb40c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112188 Oct 27 19:16:11.116361 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2914/5670] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:16:11.127704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a2497e3-1205-434c-b0ab-00ef8ed60c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:11.131446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8a2497e3-1205-434c-b0ab-00ef8ed60c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:11.146767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a2497e3-1205-434c-b0ab-00ef8ed60c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:11.149666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a2497e3-1205-434c-b0ab-00ef8ed60c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:11.150412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a2497e3-1205-434c-b0ab-00ef8ed60c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:11.151688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a2497e3-1205-434c-b0ab-00ef8ed60c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:11.152362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a2497e3-1205-434c-b0ab-00ef8ed60c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:11.154068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a2497e3-1205-434c-b0ab-00ef8ed60c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:11.726935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8a2497e3-1205-434c-b0ab-00ef8ed60c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:11.753575 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8a2497e3-1205-434c-b0ab-00ef8ed60c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1694 microversion: 2.1 time: 0.624719 Oct 27 19:16:11.775351 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2915/5671] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:11 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1694 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:11.921246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-43e89c99-b5ce-4311-bc4c-0431282fd37c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:11.921892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-43e89c99-b5ce-4311-bc4c-0431282fd37c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:11.938399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e89c99-b5ce-4311-bc4c-0431282fd37c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:11.938919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e89c99-b5ce-4311-bc4c-0431282fd37c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:11.939374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e89c99-b5ce-4311-bc4c-0431282fd37c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:11.940093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e89c99-b5ce-4311-bc4c-0431282fd37c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:11.940562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e89c99-b5ce-4311-bc4c-0431282fd37c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:11.940996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43e89c99-b5ce-4311-bc4c-0431282fd37c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:12.170498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e43ad4d5-e538-48f0-bba0-abe2b94a2b99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:12.179098 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e43ad4d5-e538-48f0-bba0-abe2b94a2b99 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1507 microversion: 2.1 time: 1.255875 Oct 27 19:16:12.193065 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2757/5672] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:10 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1507 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:12.778991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a5eda325-fa11-454d-bd89-3d038070c257 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:12.779767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a5eda325-fa11-454d-bd89-3d038070c257 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:12.791673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5eda325-fa11-454d-bd89-3d038070c257 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:12.793084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5eda325-fa11-454d-bd89-3d038070c257 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:12.793946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5eda325-fa11-454d-bd89-3d038070c257 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:12.797084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5eda325-fa11-454d-bd89-3d038070c257 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:12.800733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5eda325-fa11-454d-bd89-3d038070c257 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:12.802751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5eda325-fa11-454d-bd89-3d038070c257 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:12.953819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-43e89c99-b5ce-4311-bc4c-0431282fd37c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:12.996885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-43e89c99-b5ce-4311-bc4c-0431282fd37c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:13.002875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-43e89c99-b5ce-4311-bc4c-0431282fd37c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:13.014017 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-43e89c99-b5ce-4311-bc4c-0431282fd37c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1885 microversion: 2.32 time: 1.094474 Oct 27 19:16:13.021582 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2916/5673] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:11 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1885 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:13.208877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-da42680e-acee-431f-9458-7bc843d923ad tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:13.209509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-da42680e-acee-431f-9458-7bc843d923ad tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:13.218658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da42680e-acee-431f-9458-7bc843d923ad tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:13.227812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da42680e-acee-431f-9458-7bc843d923ad tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:13.228482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da42680e-acee-431f-9458-7bc843d923ad tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:13.229397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da42680e-acee-431f-9458-7bc843d923ad tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:13.230053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da42680e-acee-431f-9458-7bc843d923ad tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:13.230741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da42680e-acee-431f-9458-7bc843d923ad tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:13.261236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:16:13.502339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a5eda325-fa11-454d-bd89-3d038070c257 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:13.525830 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a5eda325-fa11-454d-bd89-3d038070c257 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1694 microversion: 2.1 time: 0.750660 Oct 27 19:16:13.526757 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2758/5674] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:12 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1694 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:16:13.539289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-74bb46d8-91ce-4830-9f2a-f21b9c33087a req-9da27653-ad97-4b52-9114-5378e266dc31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "tag": "1f07717a-ae91-4c44-8b27-921e82e3c064"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:13.586232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-74bb46d8-91ce-4830-9f2a-f21b9c33087a req-9da27653-ad97-4b52-9114-5378e266dc31 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:13.589505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-74bb46d8-91ce-4830-9f2a-f21b9c33087a req-9da27653-ad97-4b52-9114-5378e266dc31 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:13.590084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-74bb46d8-91ce-4830-9f2a-f21b9c33087a req-9da27653-ad97-4b52-9114-5378e266dc31 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:13.654306 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-74bb46d8-91ce-4830-9f2a-f21b9c33087a req-9da27653-ad97-4b52-9114-5378e266dc31 service nova] Creating event network-changed:1f07717a-ae91-4c44-8b27-921e82e3c064 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:16:13.669069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-da42680e-acee-431f-9458-7bc843d923ad tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:13.675680 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-74bb46d8-91ce-4830-9f2a-f21b9c33087a req-9da27653-ad97-4b52-9114-5378e266dc31 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147481 Oct 27 19:16:13.677913 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-da42680e-acee-431f-9458-7bc843d923ad tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1504 microversion: 2.1 time: 0.473732 Oct 27 19:16:13.682550 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2917/5675] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:13 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:13.689354 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2759/5676] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:16:14.046449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3182128c-b4cb-4b65-89cb-bc049feaead2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:14.047294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3182128c-b4cb-4b65-89cb-bc049feaead2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:14.062164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3182128c-b4cb-4b65-89cb-bc049feaead2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:14.062969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3182128c-b4cb-4b65-89cb-bc049feaead2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:14.066315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3182128c-b4cb-4b65-89cb-bc049feaead2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:14.068011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3182128c-b4cb-4b65-89cb-bc049feaead2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:14.070273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3182128c-b4cb-4b65-89cb-bc049feaead2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:14.071157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3182128c-b4cb-4b65-89cb-bc049feaead2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:14.553047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c27657bc-069c-4f5b-8ded-c78a5e11a16c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:14.553822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c27657bc-069c-4f5b-8ded-c78a5e11a16c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:14.569054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c27657bc-069c-4f5b-8ded-c78a5e11a16c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:14.585045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c27657bc-069c-4f5b-8ded-c78a5e11a16c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:14.588444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c27657bc-069c-4f5b-8ded-c78a5e11a16c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:14.589331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c27657bc-069c-4f5b-8ded-c78a5e11a16c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:14.589930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c27657bc-069c-4f5b-8ded-c78a5e11a16c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:14.593066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c27657bc-069c-4f5b-8ded-c78a5e11a16c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:14.593536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3182128c-b4cb-4b65-89cb-bc049feaead2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:14.607455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3182128c-b4cb-4b65-89cb-bc049feaead2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:14.611177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3182128c-b4cb-4b65-89cb-bc049feaead2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:14.614693 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3182128c-b4cb-4b65-89cb-bc049feaead2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1885 microversion: 2.32 time: 0.572078 Oct 27 19:16:14.637155 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2918/5677] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:14 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1885 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:14.710572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bcbfe762-47d9-4a22-9895-54ef725ae179 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:14.712078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bcbfe762-47d9-4a22-9895-54ef725ae179 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:14.723356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bcbfe762-47d9-4a22-9895-54ef725ae179 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:14.724021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bcbfe762-47d9-4a22-9895-54ef725ae179 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:14.724620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bcbfe762-47d9-4a22-9895-54ef725ae179 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:14.737864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bcbfe762-47d9-4a22-9895-54ef725ae179 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:14.738704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bcbfe762-47d9-4a22-9895-54ef725ae179 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:14.741129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bcbfe762-47d9-4a22-9895-54ef725ae179 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:15.207572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bcbfe762-47d9-4a22-9895-54ef725ae179 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:15.237927 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bcbfe762-47d9-4a22-9895-54ef725ae179 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1504 microversion: 2.1 time: 0.531376 Oct 27 19:16:15.246499 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2919/5678] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:14 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:15.259400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e37a706a-9a07-4ef5-b81d-294e25f447a9 req-2550d4bd-b45f-46c1-88fc-890b2852226a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1263b108-e237-4eee-88af-6e2fda4ed792", "tag": "e01e3433-ca7f-4e03-9286-deabd11d6744"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:15.282808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e37a706a-9a07-4ef5-b81d-294e25f447a9 req-2550d4bd-b45f-46c1-88fc-890b2852226a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:15.285382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e37a706a-9a07-4ef5-b81d-294e25f447a9 req-2550d4bd-b45f-46c1-88fc-890b2852226a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:15.290741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e37a706a-9a07-4ef5-b81d-294e25f447a9 req-2550d4bd-b45f-46c1-88fc-890b2852226a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:15.324168 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e37a706a-9a07-4ef5-b81d-294e25f447a9 req-2550d4bd-b45f-46c1-88fc-890b2852226a service nova] Creating event network-changed:e01e3433-ca7f-4e03-9286-deabd11d6744 for instance 1263b108-e237-4eee-88af-6e2fda4ed792 on n-h2-860687-3 Oct 27 19:16:15.331266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-e37a706a-9a07-4ef5-b81d-294e25f447a9 req-2550d4bd-b45f-46c1-88fc-890b2852226a service nova] Instance 1263b108-e237-4eee-88af-6e2fda4ed792 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:16:15.372590 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e37a706a-9a07-4ef5-b81d-294e25f447a9 req-2550d4bd-b45f-46c1-88fc-890b2852226a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123575 Oct 27 19:16:15.374115 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2920/5679] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:16:15.648979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b4c3ae3-a8b3-4b41-8dd8-7018dc43d0a3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:15.649748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b4c3ae3-a8b3-4b41-8dd8-7018dc43d0a3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:15.660476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b4c3ae3-a8b3-4b41-8dd8-7018dc43d0a3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:15.660997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b4c3ae3-a8b3-4b41-8dd8-7018dc43d0a3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:15.661450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b4c3ae3-a8b3-4b41-8dd8-7018dc43d0a3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:15.670628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b4c3ae3-a8b3-4b41-8dd8-7018dc43d0a3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:15.671201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b4c3ae3-a8b3-4b41-8dd8-7018dc43d0a3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:15.671664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b4c3ae3-a8b3-4b41-8dd8-7018dc43d0a3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:16.545307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c27657bc-069c-4f5b-8ded-c78a5e11a16c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:16.561177 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c27657bc-069c-4f5b-8ded-c78a5e11a16c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1694 microversion: 2.1 time: 2.012310 Oct 27 19:16:16.574407 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2760/5680] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:14 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1694 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:16:16.581778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b4aeaf08-1585-4974-b5d3-d9bf1f2b292d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:16.581778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b4aeaf08-1585-4974-b5d3-d9bf1f2b292d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:16.588442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=56 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:16:16.592066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4aeaf08-1585-4974-b5d3-d9bf1f2b292d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:16.592613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4aeaf08-1585-4974-b5d3-d9bf1f2b292d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:16.592993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4aeaf08-1585-4974-b5d3-d9bf1f2b292d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:16.593706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4aeaf08-1585-4974-b5d3-d9bf1f2b292d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:16.594259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4aeaf08-1585-4974-b5d3-d9bf1f2b292d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:16.609162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4aeaf08-1585-4974-b5d3-d9bf1f2b292d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:16.814890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3b4c3ae3-a8b3-4b41-8dd8-7018dc43d0a3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:16.830917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3b4c3ae3-a8b3-4b41-8dd8-7018dc43d0a3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:16.838595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3b4c3ae3-a8b3-4b41-8dd8-7018dc43d0a3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:16.840432 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b4c3ae3-a8b3-4b41-8dd8-7018dc43d0a3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 1.195763 Oct 27 19:16:16.843792 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2921/5681] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:15 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:17.068092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-96cdb116-c0d7-4a4c-9919-2b5c23c64ec9 req-e265dae1-360a-4fb9-be94-2124a67cc693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0881df85-31d1-4917-9933-0b12f857f996", "name": "network-vif-unplugged", "status": "completed", "tag": "d62cb388-acc9-438a-92c7-c605cd60dca7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:17.094580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-96cdb116-c0d7-4a4c-9919-2b5c23c64ec9 req-e265dae1-360a-4fb9-be94-2124a67cc693 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:17.095070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-96cdb116-c0d7-4a4c-9919-2b5c23c64ec9 req-e265dae1-360a-4fb9-be94-2124a67cc693 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:17.098185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-96cdb116-c0d7-4a4c-9919-2b5c23c64ec9 req-e265dae1-360a-4fb9-be94-2124a67cc693 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:17.127209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.compute.server_external_events [req-96cdb116-c0d7-4a4c-9919-2b5c23c64ec9 req-e265dae1-360a-4fb9-be94-2124a67cc693 service nova] Unable to find a host for instance 0881df85-31d1-4917-9933-0b12f857f996. Dropping event network-vif-unplugged {{(pid=127029) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 19:16:17.129532 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-96cdb116-c0d7-4a4c-9919-2b5c23c64ec9 req-e265dae1-360a-4fb9-be94-2124a67cc693 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.284483 Oct 27 19:16:17.130465 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2922/5682] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 286 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 19:16:17.348273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b4aeaf08-1585-4974-b5d3-d9bf1f2b292d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:17.360568 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b4aeaf08-1585-4974-b5d3-d9bf1f2b292d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 200 len: 1447 microversion: 2.1 time: 0.796863 Oct 27 19:16:17.363386 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2761/5683] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:16 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 1447 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:17.387796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d04593ff-04fc-40d0-9c18-068ddc50083b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:17.389637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d04593ff-04fc-40d0-9c18-068ddc50083b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:17.402150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d04593ff-04fc-40d0-9c18-068ddc50083b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:17.403179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d04593ff-04fc-40d0-9c18-068ddc50083b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:17.407276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d04593ff-04fc-40d0-9c18-068ddc50083b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:17.408376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d04593ff-04fc-40d0-9c18-068ddc50083b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:17.409190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d04593ff-04fc-40d0-9c18-068ddc50083b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:17.410720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d04593ff-04fc-40d0-9c18-068ddc50083b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:17.589967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ce80136c-7f7c-43c8-8b3d-405ca97e1aa7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:17.591494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ce80136c-7f7c-43c8-8b3d-405ca97e1aa7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:17.610923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce80136c-7f7c-43c8-8b3d-405ca97e1aa7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:17.615028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce80136c-7f7c-43c8-8b3d-405ca97e1aa7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:17.616408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce80136c-7f7c-43c8-8b3d-405ca97e1aa7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:17.618977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce80136c-7f7c-43c8-8b3d-405ca97e1aa7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:17.619621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce80136c-7f7c-43c8-8b3d-405ca97e1aa7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:17.622534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce80136c-7f7c-43c8-8b3d-405ca97e1aa7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:17.833568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d04593ff-04fc-40d0-9c18-068ddc50083b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:17.847457 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d04593ff-04fc-40d0-9c18-068ddc50083b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.465484 Oct 27 19:16:17.862893 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2923/5684] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:17 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:17.872783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4cc3f50c-e04b-44f6-b882-84e3022b0c3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:17.873866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4cc3f50c-e04b-44f6-b882-84e3022b0c3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:17.885042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cc3f50c-e04b-44f6-b882-84e3022b0c3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:17.886016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cc3f50c-e04b-44f6-b882-84e3022b0c3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:17.886699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cc3f50c-e04b-44f6-b882-84e3022b0c3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:17.887630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cc3f50c-e04b-44f6-b882-84e3022b0c3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:17.888286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cc3f50c-e04b-44f6-b882-84e3022b0c3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:17.888941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cc3f50c-e04b-44f6-b882-84e3022b0c3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:18.545689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ce80136c-7f7c-43c8-8b3d-405ca97e1aa7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:18.546100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4cc3f50c-e04b-44f6-b882-84e3022b0c3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:18.576828 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ce80136c-7f7c-43c8-8b3d-405ca97e1aa7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1694 microversion: 2.1 time: 0.987402 Oct 27 19:16:18.577919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4cc3f50c-e04b-44f6-b882-84e3022b0c3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:18.612177 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2762/5685] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:17 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1694 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:18.616135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4cc3f50c-e04b-44f6-b882-84e3022b0c3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:18.638880 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4cc3f50c-e04b-44f6-b882-84e3022b0c3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.772044 Oct 27 19:16:18.646176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ad5a604a-1b9b-4040-8c56-991b04ad6033 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:18.647311 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2924/5686] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:17 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:18.650162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ad5a604a-1b9b-4040-8c56-991b04ad6033 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:18.665880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad5a604a-1b9b-4040-8c56-991b04ad6033 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:18.668873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad5a604a-1b9b-4040-8c56-991b04ad6033 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:18.669776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad5a604a-1b9b-4040-8c56-991b04ad6033 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:18.671651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad5a604a-1b9b-4040-8c56-991b04ad6033 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:18.672477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad5a604a-1b9b-4040-8c56-991b04ad6033 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:18.674560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad5a604a-1b9b-4040-8c56-991b04ad6033 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:19.095533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ad5a604a-1b9b-4040-8c56-991b04ad6033 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:19.126693 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ad5a604a-1b9b-4040-8c56-991b04ad6033 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.511793 Oct 27 19:16:19.132651 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2763/5687] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:18 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:19.150267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-641b38a4-3bff-43c4-a3c4-6fc4cba76619 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:19.150932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-641b38a4-3bff-43c4-a3c4-6fc4cba76619 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:19.160881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-641b38a4-3bff-43c4-a3c4-6fc4cba76619 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:19.161383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-641b38a4-3bff-43c4-a3c4-6fc4cba76619 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:19.161834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-641b38a4-3bff-43c4-a3c4-6fc4cba76619 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:19.162593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-641b38a4-3bff-43c4-a3c4-6fc4cba76619 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:19.166300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-641b38a4-3bff-43c4-a3c4-6fc4cba76619 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:19.166986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-641b38a4-3bff-43c4-a3c4-6fc4cba76619 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:19.606105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a77bb995-68a2-4757-915d-5a1b864434ab tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:19.606918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a77bb995-68a2-4757-915d-5a1b864434ab tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:19.630095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a77bb995-68a2-4757-915d-5a1b864434ab tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:19.638290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a77bb995-68a2-4757-915d-5a1b864434ab tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:19.638984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a77bb995-68a2-4757-915d-5a1b864434ab tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:19.643249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a77bb995-68a2-4757-915d-5a1b864434ab tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:19.645100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a77bb995-68a2-4757-915d-5a1b864434ab tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:19.647876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a77bb995-68a2-4757-915d-5a1b864434ab tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:19.659591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-641b38a4-3bff-43c4-a3c4-6fc4cba76619 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:19.683630 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-641b38a4-3bff-43c4-a3c4-6fc4cba76619 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.537614 Oct 27 19:16:19.686826 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2925/5688] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:19 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:19.701329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7215318c-4d32-4868-afd1-7faba1c49b58 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:19.703198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7215318c-4d32-4868-afd1-7faba1c49b58 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:19.717149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=64 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:16:19.719864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7215318c-4d32-4868-afd1-7faba1c49b58 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:19.723444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7215318c-4d32-4868-afd1-7faba1c49b58 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:19.724227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7215318c-4d32-4868-afd1-7faba1c49b58 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:19.728085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7215318c-4d32-4868-afd1-7faba1c49b58 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:19.728735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7215318c-4d32-4868-afd1-7faba1c49b58 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:19.729375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7215318c-4d32-4868-afd1-7faba1c49b58 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:20.110333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a77bb995-68a2-4757-915d-5a1b864434ab tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:20.119666 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a77bb995-68a2-4757-915d-5a1b864434ab tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1692 microversion: 2.1 time: 0.518602 Oct 27 19:16:20.122167 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2764/5689] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:19 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1692 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:20.129404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b473fc03-12c0-480f-9256-5b5ad355d729 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:20.132313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b473fc03-12c0-480f-9256-5b5ad355d729 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:20.145570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b473fc03-12c0-480f-9256-5b5ad355d729 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:20.147083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b473fc03-12c0-480f-9256-5b5ad355d729 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:20.147775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b473fc03-12c0-480f-9256-5b5ad355d729 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:20.149302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b473fc03-12c0-480f-9256-5b5ad355d729 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:20.150422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b473fc03-12c0-480f-9256-5b5ad355d729 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:20.151102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b473fc03-12c0-480f-9256-5b5ad355d729 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:20.183013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7215318c-4d32-4868-afd1-7faba1c49b58 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:20.193275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7215318c-4d32-4868-afd1-7faba1c49b58 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:20.194874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7215318c-4d32-4868-afd1-7faba1c49b58 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:20.197405 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7215318c-4d32-4868-afd1-7faba1c49b58 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.509332 Oct 27 19:16:20.198244 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2926/5690] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:19 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:20.823419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b473fc03-12c0-480f-9256-5b5ad355d729 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:20.834702 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b473fc03-12c0-480f-9256-5b5ad355d729 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.712956 Oct 27 19:16:20.838364 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2765/5691] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:20 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:20.859452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b8d80877-b90a-4df3-a61f-beb74046b29f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:20.868418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8d80877-b90a-4df3-a61f-beb74046b29f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:20.869222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8d80877-b90a-4df3-a61f-beb74046b29f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:20.869826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8d80877-b90a-4df3-a61f-beb74046b29f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:20.912041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b8d80877-b90a-4df3-a61f-beb74046b29f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Going to try to stop instance {{(pid=127029) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 19:16:20.974839 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b8d80877-b90a-4df3-a61f-beb74046b29f tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.118800 Oct 27 19:16:20.980254 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2927/5692] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:16:20 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:16:21.011496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9c03230a-41d0-40e9-8d83-88f5e909e099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:21.012283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9c03230a-41d0-40e9-8d83-88f5e909e099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:21.037910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c03230a-41d0-40e9-8d83-88f5e909e099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:21.041051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c03230a-41d0-40e9-8d83-88f5e909e099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:21.041517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c03230a-41d0-40e9-8d83-88f5e909e099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:21.042275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c03230a-41d0-40e9-8d83-88f5e909e099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:21.042806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c03230a-41d0-40e9-8d83-88f5e909e099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:21.043250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c03230a-41d0-40e9-8d83-88f5e909e099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:21.148505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2d855e45-511c-421b-b532-8808949f854c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:21.150301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2d855e45-511c-421b-b532-8808949f854c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:21.179783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d855e45-511c-421b-b532-8808949f854c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:21.180762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d855e45-511c-421b-b532-8808949f854c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:21.181419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d855e45-511c-421b-b532-8808949f854c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:21.182353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d855e45-511c-421b-b532-8808949f854c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:21.183052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d855e45-511c-421b-b532-8808949f854c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:21.186072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d855e45-511c-421b-b532-8808949f854c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:21.466567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9c03230a-41d0-40e9-8d83-88f5e909e099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:21.468813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:16:21.475883 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9c03230a-41d0-40e9-8d83-88f5e909e099 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 0.491637 Oct 27 19:16:21.479137 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2766/5693] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:20 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:21.484072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ce7da0f-fa09-4a50-8cb4-e471885a2e12 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:21.491277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3ce7da0f-fa09-4a50-8cb4-e471885a2e12 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:21.511464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce7da0f-fa09-4a50-8cb4-e471885a2e12 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:21.512217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce7da0f-fa09-4a50-8cb4-e471885a2e12 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:21.512840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce7da0f-fa09-4a50-8cb4-e471885a2e12 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:21.513749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce7da0f-fa09-4a50-8cb4-e471885a2e12 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:21.514407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce7da0f-fa09-4a50-8cb4-e471885a2e12 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:21.514996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce7da0f-fa09-4a50-8cb4-e471885a2e12 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:21.935565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2d855e45-511c-421b-b532-8808949f854c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:21.944016 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2d855e45-511c-421b-b532-8808949f854c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1692 microversion: 2.1 time: 0.801501 Oct 27 19:16:21.944637 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2928/5694] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:21 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1692 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:22.093176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ce7da0f-fa09-4a50-8cb4-e471885a2e12 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:22.113306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ce7da0f-fa09-4a50-8cb4-e471885a2e12 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:22.115220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ce7da0f-fa09-4a50-8cb4-e471885a2e12 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:22.117231 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3ce7da0f-fa09-4a50-8cb4-e471885a2e12 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.636702 Oct 27 19:16:22.135958 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2767/5695] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:21 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:22.506953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7aabbfdf-6bf1-49a6-af6e-7739b330ccff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:22.507582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7aabbfdf-6bf1-49a6-af6e-7739b330ccff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:22.519142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7aabbfdf-6bf1-49a6-af6e-7739b330ccff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:22.519846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7aabbfdf-6bf1-49a6-af6e-7739b330ccff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:22.520455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7aabbfdf-6bf1-49a6-af6e-7739b330ccff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:22.522484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7aabbfdf-6bf1-49a6-af6e-7739b330ccff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:22.523339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7aabbfdf-6bf1-49a6-af6e-7739b330ccff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:22.524170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7aabbfdf-6bf1-49a6-af6e-7739b330ccff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:22.973664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb3ef853-30e1-4c15-9cda-890ffd58479c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:22.974286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb3ef853-30e1-4c15-9cda-890ffd58479c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:22.985057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb3ef853-30e1-4c15-9cda-890ffd58479c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:22.985571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb3ef853-30e1-4c15-9cda-890ffd58479c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:22.986015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb3ef853-30e1-4c15-9cda-890ffd58479c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:22.986767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb3ef853-30e1-4c15-9cda-890ffd58479c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:22.987227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb3ef853-30e1-4c15-9cda-890ffd58479c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:22.987658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb3ef853-30e1-4c15-9cda-890ffd58479c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:23.321378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-eb3ef853-30e1-4c15-9cda-890ffd58479c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:23.355720 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb3ef853-30e1-4c15-9cda-890ffd58479c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1689 microversion: 2.1 time: 0.386245 Oct 27 19:16:23.377306 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2768/5696] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:22 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1689 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:16:23.396241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-11aa93f8-7578-4e5c-9c8c-0c2d4a5fb33b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:23.398595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-11aa93f8-7578-4e5c-9c8c-0c2d4a5fb33b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:23.408335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7aabbfdf-6bf1-49a6-af6e-7739b330ccff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:23.425662 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7aabbfdf-6bf1-49a6-af6e-7739b330ccff tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 0.923067 Oct 27 19:16:23.428307 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2929/5697] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:22 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:23.435938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-60c7136f-fbda-411f-b148-df506e8c1546 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:23.436654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11aa93f8-7578-4e5c-9c8c-0c2d4a5fb33b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:23.438358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11aa93f8-7578-4e5c-9c8c-0c2d4a5fb33b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:23.439081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11aa93f8-7578-4e5c-9c8c-0c2d4a5fb33b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:23.451510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11aa93f8-7578-4e5c-9c8c-0c2d4a5fb33b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:23.452431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11aa93f8-7578-4e5c-9c8c-0c2d4a5fb33b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:23.453123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11aa93f8-7578-4e5c-9c8c-0c2d4a5fb33b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:23.458709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-60c7136f-fbda-411f-b148-df506e8c1546 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:23.472379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60c7136f-fbda-411f-b148-df506e8c1546 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:23.473624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60c7136f-fbda-411f-b148-df506e8c1546 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:23.474320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60c7136f-fbda-411f-b148-df506e8c1546 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:23.475583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60c7136f-fbda-411f-b148-df506e8c1546 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:23.477547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60c7136f-fbda-411f-b148-df506e8c1546 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:23.481173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60c7136f-fbda-411f-b148-df506e8c1546 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:23.635432 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-60c7136f-fbda-411f-b148-df506e8c1546 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792/action" status: 204 len: 0 microversion: 2.1 time: 0.202964 Oct 27 19:16:23.642516 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2930/5698] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:16:23 2022] POST /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792/action => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:16:23.663765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e169a85e-b9cc-4eb2-bedd-67847375f227 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:23.664599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e169a85e-b9cc-4eb2-bedd-67847375f227 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:23.685839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e169a85e-b9cc-4eb2-bedd-67847375f227 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:23.686357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e169a85e-b9cc-4eb2-bedd-67847375f227 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:23.691277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e169a85e-b9cc-4eb2-bedd-67847375f227 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:23.692184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e169a85e-b9cc-4eb2-bedd-67847375f227 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:23.694139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e169a85e-b9cc-4eb2-bedd-67847375f227 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:23.694695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e169a85e-b9cc-4eb2-bedd-67847375f227 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:24.053980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-11aa93f8-7578-4e5c-9c8c-0c2d4a5fb33b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:24.069672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-11aa93f8-7578-4e5c-9c8c-0c2d4a5fb33b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:24.078208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-11aa93f8-7578-4e5c-9c8c-0c2d4a5fb33b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:24.079488 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-11aa93f8-7578-4e5c-9c8c-0c2d4a5fb33b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.691262 Oct 27 19:16:24.099510 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2769/5699] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:23 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:24.456215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-602e1d37-f5f5-4ce1-9c48-5eaa4957dd2b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:24.456871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-602e1d37-f5f5-4ce1-9c48-5eaa4957dd2b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:24.482175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-602e1d37-f5f5-4ce1-9c48-5eaa4957dd2b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:24.482826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-602e1d37-f5f5-4ce1-9c48-5eaa4957dd2b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:24.483289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-602e1d37-f5f5-4ce1-9c48-5eaa4957dd2b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:24.484049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-602e1d37-f5f5-4ce1-9c48-5eaa4957dd2b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:24.484518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-602e1d37-f5f5-4ce1-9c48-5eaa4957dd2b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:24.484954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-602e1d37-f5f5-4ce1-9c48-5eaa4957dd2b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:24.699211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e169a85e-b9cc-4eb2-bedd-67847375f227 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:24.709317 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e169a85e-b9cc-4eb2-bedd-67847375f227 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1689 microversion: 2.1 time: 1.065444 Oct 27 19:16:24.731210 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2931/5700] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:23 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1689 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:24.971087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-602e1d37-f5f5-4ce1-9c48-5eaa4957dd2b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:24.993589 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-602e1d37-f5f5-4ce1-9c48-5eaa4957dd2b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 0.541799 Oct 27 19:16:24.994687 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2770/5701] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:24 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:25.105496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b011e069-3e7d-4c9a-a966-3b016ea9a2e7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:25.106033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b011e069-3e7d-4c9a-a966-3b016ea9a2e7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:25.120284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b011e069-3e7d-4c9a-a966-3b016ea9a2e7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:25.120867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b011e069-3e7d-4c9a-a966-3b016ea9a2e7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:25.121314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b011e069-3e7d-4c9a-a966-3b016ea9a2e7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:25.126073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b011e069-3e7d-4c9a-a966-3b016ea9a2e7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:25.126585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b011e069-3e7d-4c9a-a966-3b016ea9a2e7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:25.130416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b011e069-3e7d-4c9a-a966-3b016ea9a2e7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:25.182856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:16:25.409277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b72f81fc-a635-4712-b4ed-23e4f0712909 req-9ad3d829-5d60-4b21-89c8-54fcdac1cbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1263b108-e237-4eee-88af-6e2fda4ed792", "name": "network-vif-plugged", "status": "completed", "tag": "e01e3433-ca7f-4e03-9286-deabd11d6744"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:25.432435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b72f81fc-a635-4712-b4ed-23e4f0712909 req-9ad3d829-5d60-4b21-89c8-54fcdac1cbd6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:25.433375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b72f81fc-a635-4712-b4ed-23e4f0712909 req-9ad3d829-5d60-4b21-89c8-54fcdac1cbd6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:25.437219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b72f81fc-a635-4712-b4ed-23e4f0712909 req-9ad3d829-5d60-4b21-89c8-54fcdac1cbd6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:25.480676 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b72f81fc-a635-4712-b4ed-23e4f0712909 req-9ad3d829-5d60-4b21-89c8-54fcdac1cbd6 service nova] Creating event network-vif-plugged:e01e3433-ca7f-4e03-9286-deabd11d6744 for instance 1263b108-e237-4eee-88af-6e2fda4ed792 on n-h2-860687-3 Oct 27 19:16:25.501821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-b72f81fc-a635-4712-b4ed-23e4f0712909 req-9ad3d829-5d60-4b21-89c8-54fcdac1cbd6 service nova] Instance 1263b108-e237-4eee-88af-6e2fda4ed792 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:16:25.527097 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b72f81fc-a635-4712-b4ed-23e4f0712909 req-9ad3d829-5d60-4b21-89c8-54fcdac1cbd6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121007 Oct 27 19:16:25.539682 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2771/5702] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:16:25.741757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9166be25-4d09-4d4a-a6c1-03178205f26d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:25.743033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9166be25-4d09-4d4a-a6c1-03178205f26d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:25.769771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9166be25-4d09-4d4a-a6c1-03178205f26d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:25.770304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9166be25-4d09-4d4a-a6c1-03178205f26d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:25.770924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9166be25-4d09-4d4a-a6c1-03178205f26d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:25.771874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9166be25-4d09-4d4a-a6c1-03178205f26d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:25.772533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9166be25-4d09-4d4a-a6c1-03178205f26d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:25.779060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9166be25-4d09-4d4a-a6c1-03178205f26d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:26.156975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9166be25-4d09-4d4a-a6c1-03178205f26d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:26.165904 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9166be25-4d09-4d4a-a6c1-03178205f26d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1689 microversion: 2.1 time: 0.430973 Oct 27 19:16:26.170067 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2772/5703] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:25 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1689 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:16:26.197552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd317949-ca98-466b-ae1d-ddb2000553e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:26.199303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dd317949-ca98-466b-ae1d-ddb2000553e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:26.205776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd317949-ca98-466b-ae1d-ddb2000553e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:26.206617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd317949-ca98-466b-ae1d-ddb2000553e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:26.207253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd317949-ca98-466b-ae1d-ddb2000553e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:26.208128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd317949-ca98-466b-ae1d-ddb2000553e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:26.208736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd317949-ca98-466b-ae1d-ddb2000553e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:26.209379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd317949-ca98-466b-ae1d-ddb2000553e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:26.309224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b011e069-3e7d-4c9a-a966-3b016ea9a2e7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:26.324340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b011e069-3e7d-4c9a-a966-3b016ea9a2e7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:26.325865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b011e069-3e7d-4c9a-a966-3b016ea9a2e7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:26.336786 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b011e069-3e7d-4c9a-a966-3b016ea9a2e7 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 1.235086 Oct 27 19:16:26.366227 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2932/5704] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:25 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:27.036856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dd317949-ca98-466b-ae1d-ddb2000553e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:27.054499 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dd317949-ca98-466b-ae1d-ddb2000553e5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 0.879742 Oct 27 19:16:27.055953 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2773/5705] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:26 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:27.201257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3f4800ac-3f4d-4723-9388-6bcc3abcd645 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:27.202880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3f4800ac-3f4d-4723-9388-6bcc3abcd645 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:27.232682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f4800ac-3f4d-4723-9388-6bcc3abcd645 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:27.233437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f4800ac-3f4d-4723-9388-6bcc3abcd645 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:27.233995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f4800ac-3f4d-4723-9388-6bcc3abcd645 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:27.234881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f4800ac-3f4d-4723-9388-6bcc3abcd645 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:27.236502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f4800ac-3f4d-4723-9388-6bcc3abcd645 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:27.237084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f4800ac-3f4d-4723-9388-6bcc3abcd645 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:27.365816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a70d2ff5-68e7-43c0-97f4-2a22769e9aa1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:27.366605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a70d2ff5-68e7-43c0-97f4-2a22769e9aa1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:27.376687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a70d2ff5-68e7-43c0-97f4-2a22769e9aa1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:27.377190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a70d2ff5-68e7-43c0-97f4-2a22769e9aa1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:27.377637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a70d2ff5-68e7-43c0-97f4-2a22769e9aa1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:27.378357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a70d2ff5-68e7-43c0-97f4-2a22769e9aa1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:27.378846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a70d2ff5-68e7-43c0-97f4-2a22769e9aa1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:27.379284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a70d2ff5-68e7-43c0-97f4-2a22769e9aa1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:27.760199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3f4800ac-3f4d-4723-9388-6bcc3abcd645 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:27.772244 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3f4800ac-3f4d-4723-9388-6bcc3abcd645 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1689 microversion: 2.1 time: 0.574398 Oct 27 19:16:27.772945 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2933/5706] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:27 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1689 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:28.079760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af28fa29-fefb-4fa1-b1f5-d73f0fde92a7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:28.080985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-af28fa29-fefb-4fa1-b1f5-d73f0fde92a7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:28.102965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af28fa29-fefb-4fa1-b1f5-d73f0fde92a7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:28.104002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af28fa29-fefb-4fa1-b1f5-d73f0fde92a7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:28.104944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af28fa29-fefb-4fa1-b1f5-d73f0fde92a7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:28.106646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af28fa29-fefb-4fa1-b1f5-d73f0fde92a7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:28.108122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af28fa29-fefb-4fa1-b1f5-d73f0fde92a7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:28.110709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af28fa29-fefb-4fa1-b1f5-d73f0fde92a7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:28.775165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a70d2ff5-68e7-43c0-97f4-2a22769e9aa1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:28.789818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a70d2ff5-68e7-43c0-97f4-2a22769e9aa1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:28.792648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a70d2ff5-68e7-43c0-97f4-2a22769e9aa1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:28.794270 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a70d2ff5-68e7-43c0-97f4-2a22769e9aa1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 1.432966 Oct 27 19:16:28.794875 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2774/5707] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:27 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:16:28.808855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bcec94bc-82f3-441d-abde-ba3d446b116b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:28.815335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bcec94bc-82f3-441d-abde-ba3d446b116b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:28.826746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcec94bc-82f3-441d-abde-ba3d446b116b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:28.827995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcec94bc-82f3-441d-abde-ba3d446b116b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:28.828627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcec94bc-82f3-441d-abde-ba3d446b116b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:28.830344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcec94bc-82f3-441d-abde-ba3d446b116b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:28.831123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcec94bc-82f3-441d-abde-ba3d446b116b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:28.831755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcec94bc-82f3-441d-abde-ba3d446b116b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:28.883168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-af28fa29-fefb-4fa1-b1f5-d73f0fde92a7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:28.896828 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-af28fa29-fefb-4fa1-b1f5-d73f0fde92a7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 0.817856 Oct 27 19:16:28.903494 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2934/5708] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:28 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:29.203704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bcec94bc-82f3-441d-abde-ba3d446b116b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:29.216676 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bcec94bc-82f3-441d-abde-ba3d446b116b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1681 microversion: 2.1 time: 0.411175 Oct 27 19:16:29.218797 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2775/5709] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:28 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1681 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:29.821208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1ab770c4-28a5-4798-92bc-fc463c688bfc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:29.821986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1ab770c4-28a5-4798-92bc-fc463c688bfc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:29.843752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ab770c4-28a5-4798-92bc-fc463c688bfc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:29.844531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ab770c4-28a5-4798-92bc-fc463c688bfc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:29.845159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ab770c4-28a5-4798-92bc-fc463c688bfc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:29.846534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ab770c4-28a5-4798-92bc-fc463c688bfc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:29.847421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ab770c4-28a5-4798-92bc-fc463c688bfc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:29.848019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ab770c4-28a5-4798-92bc-fc463c688bfc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:29.925472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0b287776-9717-4449-89c6-8cc8cfe26d18 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:29.926092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0b287776-9717-4449-89c6-8cc8cfe26d18 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:29.935914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b287776-9717-4449-89c6-8cc8cfe26d18 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:29.937447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b287776-9717-4449-89c6-8cc8cfe26d18 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:29.937888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b287776-9717-4449-89c6-8cc8cfe26d18 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:29.941395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b287776-9717-4449-89c6-8cc8cfe26d18 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:29.943064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b287776-9717-4449-89c6-8cc8cfe26d18 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:29.945260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b287776-9717-4449-89c6-8cc8cfe26d18 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:30.111903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0b287776-9717-4449-89c6-8cc8cfe26d18 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:30.126667 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0b287776-9717-4449-89c6-8cc8cfe26d18 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 0.205031 Oct 27 19:16:30.128121 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2776/5710] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:29 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:16:30.330536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1ab770c4-28a5-4798-92bc-fc463c688bfc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:30.342684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1ab770c4-28a5-4798-92bc-fc463c688bfc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:30.346925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1ab770c4-28a5-4798-92bc-fc463c688bfc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:30.350343 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1ab770c4-28a5-4798-92bc-fc463c688bfc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.532334 Oct 27 19:16:30.353149 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2935/5711] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:29 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:31.153791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-63e240f4-4bda-425c-864e-91e9fb045d3e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:31.155040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-63e240f4-4bda-425c-864e-91e9fb045d3e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:31.164306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63e240f4-4bda-425c-864e-91e9fb045d3e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:31.165146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63e240f4-4bda-425c-864e-91e9fb045d3e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:31.165755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63e240f4-4bda-425c-864e-91e9fb045d3e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:31.167772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63e240f4-4bda-425c-864e-91e9fb045d3e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:31.168330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63e240f4-4bda-425c-864e-91e9fb045d3e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:31.168950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63e240f4-4bda-425c-864e-91e9fb045d3e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:31.379387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fe35a500-9406-4b75-9b64-aa7209b923fa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:31.380648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fe35a500-9406-4b75-9b64-aa7209b923fa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:31.397354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe35a500-9406-4b75-9b64-aa7209b923fa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:31.401428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe35a500-9406-4b75-9b64-aa7209b923fa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:31.402161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe35a500-9406-4b75-9b64-aa7209b923fa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:31.403294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe35a500-9406-4b75-9b64-aa7209b923fa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:31.403841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe35a500-9406-4b75-9b64-aa7209b923fa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:31.405026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe35a500-9406-4b75-9b64-aa7209b923fa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:31.600787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-63e240f4-4bda-425c-864e-91e9fb045d3e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:31.610745 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-63e240f4-4bda-425c-864e-91e9fb045d3e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1679 microversion: 2.1 time: 0.463403 Oct 27 19:16:31.615673 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2777/5712] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:31 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1679 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:31.844340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fe35a500-9406-4b75-9b64-aa7209b923fa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:31.861310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fe35a500-9406-4b75-9b64-aa7209b923fa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:31.863708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fe35a500-9406-4b75-9b64-aa7209b923fa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:31.865561 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fe35a500-9406-4b75-9b64-aa7209b923fa tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.492080 Oct 27 19:16:31.866378 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2936/5713] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:31 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:32.643365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f011a8c4-9c2d-42a3-a3f3-498ebfa62be5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:32.644146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f011a8c4-9c2d-42a3-a3f3-498ebfa62be5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:32.657635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f011a8c4-9c2d-42a3-a3f3-498ebfa62be5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:32.658171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f011a8c4-9c2d-42a3-a3f3-498ebfa62be5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:32.658827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f011a8c4-9c2d-42a3-a3f3-498ebfa62be5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:32.661442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f011a8c4-9c2d-42a3-a3f3-498ebfa62be5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:32.662320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f011a8c4-9c2d-42a3-a3f3-498ebfa62be5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:32.666566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f011a8c4-9c2d-42a3-a3f3-498ebfa62be5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:32.904009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-69c589a7-f1b9-494f-a8b6-199325169a07 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:32.904435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-69c589a7-f1b9-494f-a8b6-199325169a07 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:32.917611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69c589a7-f1b9-494f-a8b6-199325169a07 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:32.920749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69c589a7-f1b9-494f-a8b6-199325169a07 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:32.921622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69c589a7-f1b9-494f-a8b6-199325169a07 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:32.922829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69c589a7-f1b9-494f-a8b6-199325169a07 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:32.924186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69c589a7-f1b9-494f-a8b6-199325169a07 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:32.924799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69c589a7-f1b9-494f-a8b6-199325169a07 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:33.006456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f011a8c4-9c2d-42a3-a3f3-498ebfa62be5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:33.017879 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f011a8c4-9c2d-42a3-a3f3-498ebfa62be5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1656 microversion: 2.1 time: 0.379162 Oct 27 19:16:33.022019 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2778/5714] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:32 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1656 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:33.051670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ac3b2d6-faaa-4653-b6ce-aa478fb2e82b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:33.061823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ac3b2d6-faaa-4653-b6ce-aa478fb2e82b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:33.064746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ac3b2d6-faaa-4653-b6ce-aa478fb2e82b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:33.065403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ac3b2d6-faaa-4653-b6ce-aa478fb2e82b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:33.122120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ac3b2d6-faaa-4653-b6ce-aa478fb2e82b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Going to try to start instance {{(pid=127028) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 19:16:33.252067 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ac3b2d6-faaa-4653-b6ce-aa478fb2e82b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.204615 Oct 27 19:16:33.254122 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2779/5715] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:16:33 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:16:33.284828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b746154f-f40e-4df5-ad50-9424464776af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:33.287076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b746154f-f40e-4df5-ad50-9424464776af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:33.311744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b746154f-f40e-4df5-ad50-9424464776af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:33.314781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b746154f-f40e-4df5-ad50-9424464776af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:33.316171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b746154f-f40e-4df5-ad50-9424464776af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:33.319562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b746154f-f40e-4df5-ad50-9424464776af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:33.321808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b746154f-f40e-4df5-ad50-9424464776af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:33.325715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b746154f-f40e-4df5-ad50-9424464776af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:33.688913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b746154f-f40e-4df5-ad50-9424464776af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:33.710631 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b746154f-f40e-4df5-ad50-9424464776af tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1665 microversion: 2.1 time: 0.424591 Oct 27 19:16:33.721887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-69c589a7-f1b9-494f-a8b6-199325169a07 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:33.727663 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2780/5716] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:33 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1665 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:33.776162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-69c589a7-f1b9-494f-a8b6-199325169a07 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:33.785036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-69c589a7-f1b9-494f-a8b6-199325169a07 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:33.786286 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-69c589a7-f1b9-494f-a8b6-199325169a07 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.887487 Oct 27 19:16:33.798758 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2937/5717] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:32 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:34.736411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5913f803-542a-4e5e-ba9f-a7dcafb64ec9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:34.737045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5913f803-542a-4e5e-ba9f-a7dcafb64ec9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:34.748251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5913f803-542a-4e5e-ba9f-a7dcafb64ec9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:34.749644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5913f803-542a-4e5e-ba9f-a7dcafb64ec9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:34.751105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5913f803-542a-4e5e-ba9f-a7dcafb64ec9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:34.754640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5913f803-542a-4e5e-ba9f-a7dcafb64ec9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:34.755327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5913f803-542a-4e5e-ba9f-a7dcafb64ec9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:34.756042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5913f803-542a-4e5e-ba9f-a7dcafb64ec9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:34.816484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3c985149-7107-4539-8d4f-6f579fc69ec1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:34.817125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3c985149-7107-4539-8d4f-6f579fc69ec1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:34.834944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c985149-7107-4539-8d4f-6f579fc69ec1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:34.835470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c985149-7107-4539-8d4f-6f579fc69ec1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:34.835929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c985149-7107-4539-8d4f-6f579fc69ec1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:34.843050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c985149-7107-4539-8d4f-6f579fc69ec1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:34.843922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c985149-7107-4539-8d4f-6f579fc69ec1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:34.844565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c985149-7107-4539-8d4f-6f579fc69ec1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:35.189625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5913f803-542a-4e5e-ba9f-a7dcafb64ec9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:35.222037 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5913f803-542a-4e5e-ba9f-a7dcafb64ec9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1665 microversion: 2.1 time: 0.489266 Oct 27 19:16:35.225730 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2781/5718] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:34 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1665 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:35.370950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3c985149-7107-4539-8d4f-6f579fc69ec1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:35.387226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3c985149-7107-4539-8d4f-6f579fc69ec1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:35.393345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3c985149-7107-4539-8d4f-6f579fc69ec1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:35.394621 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3c985149-7107-4539-8d4f-6f579fc69ec1 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.582182 Oct 27 19:16:35.419418 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2938/5719] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:34 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:16:36.249378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ac34c6cf-f6bf-4121-a2f7-30662eea31a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:36.250001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ac34c6cf-f6bf-4121-a2f7-30662eea31a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:36.259490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac34c6cf-f6bf-4121-a2f7-30662eea31a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:36.261271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac34c6cf-f6bf-4121-a2f7-30662eea31a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:36.262094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac34c6cf-f6bf-4121-a2f7-30662eea31a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:36.271822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac34c6cf-f6bf-4121-a2f7-30662eea31a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:36.272589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac34c6cf-f6bf-4121-a2f7-30662eea31a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:36.273200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac34c6cf-f6bf-4121-a2f7-30662eea31a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:36.432010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-08dcd27b-7b64-4750-972c-0f09a1993207 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:36.432580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-08dcd27b-7b64-4750-972c-0f09a1993207 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:36.449907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08dcd27b-7b64-4750-972c-0f09a1993207 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:36.453310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08dcd27b-7b64-4750-972c-0f09a1993207 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:36.453788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08dcd27b-7b64-4750-972c-0f09a1993207 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:36.455582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08dcd27b-7b64-4750-972c-0f09a1993207 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:36.457227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08dcd27b-7b64-4750-972c-0f09a1993207 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:36.457693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08dcd27b-7b64-4750-972c-0f09a1993207 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:36.856684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ac34c6cf-f6bf-4121-a2f7-30662eea31a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:36.864770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:16:36.891065 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ac34c6cf-f6bf-4121-a2f7-30662eea31a6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.643164 Oct 27 19:16:36.894084 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2782/5720] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:36 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:36.919382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8b9180e9-d307-4727-a94d-41643cf086c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:36.921901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8b9180e9-d307-4727-a94d-41643cf086c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:36.937848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b9180e9-d307-4727-a94d-41643cf086c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:36.939846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b9180e9-d307-4727-a94d-41643cf086c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:36.940923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b9180e9-d307-4727-a94d-41643cf086c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:36.943423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b9180e9-d307-4727-a94d-41643cf086c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:36.944105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b9180e9-d307-4727-a94d-41643cf086c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:36.947838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b9180e9-d307-4727-a94d-41643cf086c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:37.059815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-08dcd27b-7b64-4750-972c-0f09a1993207 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:37.072818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-08dcd27b-7b64-4750-972c-0f09a1993207 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:37.074815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-08dcd27b-7b64-4750-972c-0f09a1993207 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:37.076912 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-08dcd27b-7b64-4750-972c-0f09a1993207 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.649026 Oct 27 19:16:37.095615 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2939/5721] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:36 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:16:37.262201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8b9180e9-d307-4727-a94d-41643cf086c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:37.276461 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8b9180e9-d307-4727-a94d-41643cf086c4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.363615 Oct 27 19:16:37.277923 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2783/5722] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:36 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:16:37.313158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e7bf57d-ae56-4dd7-a7a1-145a405427ba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:37.313848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6e7bf57d-ae56-4dd7-a7a1-145a405427ba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:37.332357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7bf57d-ae56-4dd7-a7a1-145a405427ba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:37.332916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7bf57d-ae56-4dd7-a7a1-145a405427ba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:37.333377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7bf57d-ae56-4dd7-a7a1-145a405427ba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:37.334394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7bf57d-ae56-4dd7-a7a1-145a405427ba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:37.337077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7bf57d-ae56-4dd7-a7a1-145a405427ba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:37.337539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e7bf57d-ae56-4dd7-a7a1-145a405427ba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:37.687343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6e7bf57d-ae56-4dd7-a7a1-145a405427ba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:37.700752 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6e7bf57d-ae56-4dd7-a7a1-145a405427ba tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.393415 Oct 27 19:16:37.702269 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2940/5723] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:37 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:37.726081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-448fc110-103e-4520-b60e-bfd2c1599127 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:37.726811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-448fc110-103e-4520-b60e-bfd2c1599127 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:37.734151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-448fc110-103e-4520-b60e-bfd2c1599127 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:37.734824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-448fc110-103e-4520-b60e-bfd2c1599127 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:37.735796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-448fc110-103e-4520-b60e-bfd2c1599127 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:37.736623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-448fc110-103e-4520-b60e-bfd2c1599127 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:37.737239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-448fc110-103e-4520-b60e-bfd2c1599127 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:37.737782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-448fc110-103e-4520-b60e-bfd2c1599127 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:38.104909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a1963328-d74b-49d6-9c06-621d3d0596ce tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:38.105542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a1963328-d74b-49d6-9c06-621d3d0596ce tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:38.124686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1963328-d74b-49d6-9c06-621d3d0596ce tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:38.125271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1963328-d74b-49d6-9c06-621d3d0596ce tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:38.125732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1963328-d74b-49d6-9c06-621d3d0596ce tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:38.126509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1963328-d74b-49d6-9c06-621d3d0596ce tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:38.126979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1963328-d74b-49d6-9c06-621d3d0596ce tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:38.135021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1963328-d74b-49d6-9c06-621d3d0596ce tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:38.226501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-448fc110-103e-4520-b60e-bfd2c1599127 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:38.240270 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-448fc110-103e-4520-b60e-bfd2c1599127 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.518152 Oct 27 19:16:38.251754 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2784/5724] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:37 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:38.265880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-860a8e01-d3de-4828-ae68-f1238feba9b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:38.267497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-860a8e01-d3de-4828-ae68-f1238feba9b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:38.295482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-860a8e01-d3de-4828-ae68-f1238feba9b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:38.296366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-860a8e01-d3de-4828-ae68-f1238feba9b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:38.296741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-860a8e01-d3de-4828-ae68-f1238feba9b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:38.297501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-860a8e01-d3de-4828-ae68-f1238feba9b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:38.298420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-860a8e01-d3de-4828-ae68-f1238feba9b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:38.304297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-860a8e01-d3de-4828-ae68-f1238feba9b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:38.587106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1963328-d74b-49d6-9c06-621d3d0596ce tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:38.597080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1963328-d74b-49d6-9c06-621d3d0596ce tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:38.598634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1963328-d74b-49d6-9c06-621d3d0596ce tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:38.607664 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a1963328-d74b-49d6-9c06-621d3d0596ce tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.504357 Oct 27 19:16:38.610281 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2941/5725] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:38 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:38.864243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-860a8e01-d3de-4828-ae68-f1238feba9b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:38.879061 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-860a8e01-d3de-4828-ae68-f1238feba9b9 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.617411 Oct 27 19:16:38.910340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6362394a-fb59-4823-80e3-97b7c30c1131 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:38.912032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6362394a-fb59-4823-80e3-97b7c30c1131 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:38.913276 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2785/5726] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:38 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:38.921964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6362394a-fb59-4823-80e3-97b7c30c1131 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:38.923428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6362394a-fb59-4823-80e3-97b7c30c1131 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:38.924076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6362394a-fb59-4823-80e3-97b7c30c1131 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:38.925006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6362394a-fb59-4823-80e3-97b7c30c1131 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:38.925634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6362394a-fb59-4823-80e3-97b7c30c1131 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:38.926814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6362394a-fb59-4823-80e3-97b7c30c1131 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:38.979930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-6362394a-fb59-4823-80e3-97b7c30c1131 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lazy-loading 'flavor' on Instance uuid eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:16:39.112231 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6362394a-fb59-4823-80e3-97b7c30c1131 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.206669 Oct 27 19:16:39.115905 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2942/5727] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:16:38 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:16:39.129488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ac548f53-acc3-4da8-966c-f40448aa99e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:39.130167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ac548f53-acc3-4da8-966c-f40448aa99e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:39.146992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac548f53-acc3-4da8-966c-f40448aa99e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:39.147518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac548f53-acc3-4da8-966c-f40448aa99e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:39.148201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac548f53-acc3-4da8-966c-f40448aa99e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:39.152616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac548f53-acc3-4da8-966c-f40448aa99e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:39.153545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac548f53-acc3-4da8-966c-f40448aa99e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:39.154248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac548f53-acc3-4da8-966c-f40448aa99e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:39.528835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ac548f53-acc3-4da8-966c-f40448aa99e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:39.543424 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ac548f53-acc3-4da8-966c-f40448aa99e6 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1677 microversion: 2.1 time: 0.422656 Oct 27 19:16:39.546977 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2786/5728] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:39 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1677 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:39.638862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c42e143f-dfae-4a11-a02e-a0b7eca7729e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:39.639966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c42e143f-dfae-4a11-a02e-a0b7eca7729e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:39.670420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c42e143f-dfae-4a11-a02e-a0b7eca7729e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:39.671217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c42e143f-dfae-4a11-a02e-a0b7eca7729e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:39.673507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c42e143f-dfae-4a11-a02e-a0b7eca7729e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:39.674924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c42e143f-dfae-4a11-a02e-a0b7eca7729e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:39.675864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c42e143f-dfae-4a11-a02e-a0b7eca7729e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:39.681860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c42e143f-dfae-4a11-a02e-a0b7eca7729e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:40.146702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c42e143f-dfae-4a11-a02e-a0b7eca7729e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:40.198656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c42e143f-dfae-4a11-a02e-a0b7eca7729e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:40.200307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c42e143f-dfae-4a11-a02e-a0b7eca7729e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:40.210353 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c42e143f-dfae-4a11-a02e-a0b7eca7729e tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.568747 Oct 27 19:16:40.226473 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2943/5729] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:39 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:40.573193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e682a13c-509a-4e56-a79e-4aa09d6d505e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:40.573830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e682a13c-509a-4e56-a79e-4aa09d6d505e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:40.584232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e682a13c-509a-4e56-a79e-4aa09d6d505e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:40.584616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e682a13c-509a-4e56-a79e-4aa09d6d505e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:40.589311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e682a13c-509a-4e56-a79e-4aa09d6d505e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:40.592944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e682a13c-509a-4e56-a79e-4aa09d6d505e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:40.594085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e682a13c-509a-4e56-a79e-4aa09d6d505e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:40.594632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e682a13c-509a-4e56-a79e-4aa09d6d505e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:40.829619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e682a13c-509a-4e56-a79e-4aa09d6d505e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:40.849182 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e682a13c-509a-4e56-a79e-4aa09d6d505e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1660 microversion: 2.1 time: 0.280539 Oct 27 19:16:40.852827 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2787/5730] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:40 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1660 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:40.877150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4df55dda-71c4-4ad8-be25-4703762dbeca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:40.877702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4df55dda-71c4-4ad8-be25-4703762dbeca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:40.890759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4df55dda-71c4-4ad8-be25-4703762dbeca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:40.892906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4df55dda-71c4-4ad8-be25-4703762dbeca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:40.896728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4df55dda-71c4-4ad8-be25-4703762dbeca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:40.897685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4df55dda-71c4-4ad8-be25-4703762dbeca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:40.898331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4df55dda-71c4-4ad8-be25-4703762dbeca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:40.899602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4df55dda-71c4-4ad8-be25-4703762dbeca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:41.096772 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4df55dda-71c4-4ad8-be25-4703762dbeca tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.222913 Oct 27 19:16:41.100765 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2944/5731] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:16:40 2022] POST /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:16:41.112304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d9a19e7-4c29-4713-9418-355b2b0608ab tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:41.112480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0d9a19e7-4c29-4713-9418-355b2b0608ab tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:41.121877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d9a19e7-4c29-4713-9418-355b2b0608ab tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:41.123735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d9a19e7-4c29-4713-9418-355b2b0608ab tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:41.124409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d9a19e7-4c29-4713-9418-355b2b0608ab tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:41.125527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d9a19e7-4c29-4713-9418-355b2b0608ab tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:41.126733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d9a19e7-4c29-4713-9418-355b2b0608ab tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:41.127332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d9a19e7-4c29-4713-9418-355b2b0608ab tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:41.252359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7431f46a-9894-4327-bc85-c9b6f9b5ac35 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:41.254954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7431f46a-9894-4327-bc85-c9b6f9b5ac35 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:41.318265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7431f46a-9894-4327-bc85-c9b6f9b5ac35 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:41.326512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7431f46a-9894-4327-bc85-c9b6f9b5ac35 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:41.327295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7431f46a-9894-4327-bc85-c9b6f9b5ac35 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:41.331916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7431f46a-9894-4327-bc85-c9b6f9b5ac35 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:41.341853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7431f46a-9894-4327-bc85-c9b6f9b5ac35 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:41.344864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7431f46a-9894-4327-bc85-c9b6f9b5ac35 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:42.051208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0d9a19e7-4c29-4713-9418-355b2b0608ab tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:42.059608 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d9a19e7-4c29-4713-9418-355b2b0608ab tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1666 microversion: 2.1 time: 0.954515 Oct 27 19:16:42.060208 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2788/5732] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:41 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1666 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:42.080398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7431f46a-9894-4327-bc85-c9b6f9b5ac35 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:42.106230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7431f46a-9894-4327-bc85-c9b6f9b5ac35 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:42.109094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7431f46a-9894-4327-bc85-c9b6f9b5ac35 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:42.113554 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7431f46a-9894-4327-bc85-c9b6f9b5ac35 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.869572 Oct 27 19:16:42.116169 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2945/5733] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:41 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:16:43.085373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6fe2bc0c-5b2f-46c9-8548-1e6fc43dee1a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:43.087895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6fe2bc0c-5b2f-46c9-8548-1e6fc43dee1a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:43.099847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6fe2bc0c-5b2f-46c9-8548-1e6fc43dee1a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:43.103308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6fe2bc0c-5b2f-46c9-8548-1e6fc43dee1a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:43.105961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6fe2bc0c-5b2f-46c9-8548-1e6fc43dee1a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:43.106888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6fe2bc0c-5b2f-46c9-8548-1e6fc43dee1a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:43.110339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6fe2bc0c-5b2f-46c9-8548-1e6fc43dee1a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:43.110998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6fe2bc0c-5b2f-46c9-8548-1e6fc43dee1a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:43.151733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a98425eb-a472-4e11-a135-d57e6fdedc3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:43.152409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a98425eb-a472-4e11-a135-d57e6fdedc3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:43.160047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a98425eb-a472-4e11-a135-d57e6fdedc3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:43.160811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a98425eb-a472-4e11-a135-d57e6fdedc3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:43.161432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a98425eb-a472-4e11-a135-d57e6fdedc3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:43.162320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a98425eb-a472-4e11-a135-d57e6fdedc3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:43.167371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a98425eb-a472-4e11-a135-d57e6fdedc3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:43.168097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a98425eb-a472-4e11-a135-d57e6fdedc3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:43.206921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:16:43.519425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6fe2bc0c-5b2f-46c9-8548-1e6fc43dee1a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:43.529052 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6fe2bc0c-5b2f-46c9-8548-1e6fc43dee1a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1666 microversion: 2.1 time: 0.447770 Oct 27 19:16:43.530748 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2789/5734] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:43 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1666 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:44.452481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a98425eb-a472-4e11-a135-d57e6fdedc3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:44.476086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a98425eb-a472-4e11-a135-d57e6fdedc3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:44.480789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a98425eb-a472-4e11-a135-d57e6fdedc3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:44.483443 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a98425eb-a472-4e11-a135-d57e6fdedc3c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 1.341214 Oct 27 19:16:44.484705 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2946/5735] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:43 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:44.553970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e21efa5b-05bb-4a3d-9be9-d97217213330 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:44.555208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e21efa5b-05bb-4a3d-9be9-d97217213330 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:44.569348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e21efa5b-05bb-4a3d-9be9-d97217213330 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:44.570160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e21efa5b-05bb-4a3d-9be9-d97217213330 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:44.570933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e21efa5b-05bb-4a3d-9be9-d97217213330 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:44.571840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e21efa5b-05bb-4a3d-9be9-d97217213330 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:44.579934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e21efa5b-05bb-4a3d-9be9-d97217213330 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:44.580578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e21efa5b-05bb-4a3d-9be9-d97217213330 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:45.002006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e21efa5b-05bb-4a3d-9be9-d97217213330 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:45.017655 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e21efa5b-05bb-4a3d-9be9-d97217213330 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.467571 Oct 27 19:16:45.018269 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2790/5736] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:44 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:16:45.042112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1eeda1b6-8255-4ba4-9008-4f0958cda3bf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:45.042768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1eeda1b6-8255-4ba4-9008-4f0958cda3bf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:45.056760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1eeda1b6-8255-4ba4-9008-4f0958cda3bf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:45.057274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1eeda1b6-8255-4ba4-9008-4f0958cda3bf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:45.057729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1eeda1b6-8255-4ba4-9008-4f0958cda3bf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:45.058497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1eeda1b6-8255-4ba4-9008-4f0958cda3bf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:45.058974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1eeda1b6-8255-4ba4-9008-4f0958cda3bf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:45.059670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1eeda1b6-8255-4ba4-9008-4f0958cda3bf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:45.486790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1eeda1b6-8255-4ba4-9008-4f0958cda3bf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:45.501895 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1eeda1b6-8255-4ba4-9008-4f0958cda3bf tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1669 microversion: 2.1 time: 0.464550 Oct 27 19:16:45.502761 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2947/5737] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:45 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1669 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:45.514483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-36b7d2db-ef49-4068-b359-16b8aaf20238 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:45.515938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-36b7d2db-ef49-4068-b359-16b8aaf20238 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:45.529838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36b7d2db-ef49-4068-b359-16b8aaf20238 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:45.530348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36b7d2db-ef49-4068-b359-16b8aaf20238 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:45.531045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36b7d2db-ef49-4068-b359-16b8aaf20238 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:45.532322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36b7d2db-ef49-4068-b359-16b8aaf20238 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:45.532800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:45.533188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36b7d2db-ef49-4068-b359-16b8aaf20238 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:45.533452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:45.534626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36b7d2db-ef49-4068-b359-16b8aaf20238 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:45.541843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:45.542525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:45.542966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:45.543718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:45.544417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:45.545048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:45.632618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:16:45.656898 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.compute.api [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Working on deleting snapshot 5b04b29e-9583-4755-8e42-20b1de8fe4de from shelved instance... Oct 27 19:16:46.044507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-36b7d2db-ef49-4068-b359-16b8aaf20238 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:46.059769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-36b7d2db-ef49-4068-b359-16b8aaf20238 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:46.064838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-36b7d2db-ef49-4068-b359-16b8aaf20238 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:46.068821 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-36b7d2db-ef49-4068-b359-16b8aaf20238 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.558188 Oct 27 19:16:46.072152 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2791/5738] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:45 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:47.101194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e506e129-c533-45d7-a2bf-23627278b6bc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:47.103573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e506e129-c533-45d7-a2bf-23627278b6bc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:47.112016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=62 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:16:47.116752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e506e129-c533-45d7-a2bf-23627278b6bc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:47.119867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e506e129-c533-45d7-a2bf-23627278b6bc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:47.120980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e506e129-c533-45d7-a2bf-23627278b6bc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:47.126985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e506e129-c533-45d7-a2bf-23627278b6bc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:47.130917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e506e129-c533-45d7-a2bf-23627278b6bc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:47.133913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e506e129-c533-45d7-a2bf-23627278b6bc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:47.288597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Doing local delete in cell af35862a-071a-430c-affa-82567dc9805c(cell1) {{(pid=127029) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 27 19:16:47.291166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:47.293009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:47.295298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:47.296225 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.compute.api [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 27 19:16:47.307604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] deallocate_for_instance() {{(pid=127029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 27 19:16:47.637370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e506e129-c533-45d7-a2bf-23627278b6bc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:47.661256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e506e129-c533-45d7-a2bf-23627278b6bc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:47.665649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e506e129-c533-45d7-a2bf-23627278b6bc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:47.673178 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e506e129-c533-45d7-a2bf-23627278b6bc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.571547 Oct 27 19:16:47.673847 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2792/5739] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:47 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:16:48.729468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9eeede6-ad5f-4412-a362-d1c83bedbcb4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:48.731252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c9eeede6-ad5f-4412-a362-d1c83bedbcb4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:48.748174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9eeede6-ad5f-4412-a362-d1c83bedbcb4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:48.748722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9eeede6-ad5f-4412-a362-d1c83bedbcb4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:48.749188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9eeede6-ad5f-4412-a362-d1c83bedbcb4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:48.749939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9eeede6-ad5f-4412-a362-d1c83bedbcb4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:48.750435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9eeede6-ad5f-4412-a362-d1c83bedbcb4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:48.753645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9eeede6-ad5f-4412-a362-d1c83bedbcb4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:48.948690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Updating instance_info_cache with network_info: [] {{(pid=127029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 19:16:49.145245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c9eeede6-ad5f-4412-a362-d1c83bedbcb4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:49.169196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c9eeede6-ad5f-4412-a362-d1c83bedbcb4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:49.174269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c9eeede6-ad5f-4412-a362-d1c83bedbcb4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:49.181667 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c9eeede6-ad5f-4412-a362-d1c83bedbcb4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.477344 Oct 27 19:16:49.186874 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2793/5740] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:48 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:49.272001 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-11d12d21-ad29-44be-b525-f7dbb1579042 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 204 len: 0 microversion: 2.1 time: 3.744456 Oct 27 19:16:49.273380 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2948/5741] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:16:45 2022] DELETE /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 0 bytes in 3746 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:16:49.291434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6a5ffaa9-49f3-47bd-8557-11f9ec5049f7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:49.293361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6a5ffaa9-49f3-47bd-8557-11f9ec5049f7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 0881df85-31d1-4917-9933-0b12f857f996] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:49.311247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a5ffaa9-49f3-47bd-8557-11f9ec5049f7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:49.311890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a5ffaa9-49f3-47bd-8557-11f9ec5049f7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:49.319950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a5ffaa9-49f3-47bd-8557-11f9ec5049f7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:49.321741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a5ffaa9-49f3-47bd-8557-11f9ec5049f7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:49.322335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a5ffaa9-49f3-47bd-8557-11f9ec5049f7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:49.322909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a5ffaa9-49f3-47bd-8557-11f9ec5049f7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:49.349045 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-6a5ffaa9-49f3-47bd-8557-11f9ec5049f7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] HTTP exception thrown: Instance 0881df85-31d1-4917-9933-0b12f857f996 could not be found. Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6a5ffaa9-49f3-47bd-8557-11f9ec5049f7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Request method failure captured: Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 HTTP/1.1 Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtcMgvpB1r3CMhn3lqnafdbRH_q7_2MwBC9YYeuhDoLvj0r3BLn_zRO4y1vPk2UIxFleNSJ40ezxJxF7WpMwNGUDmR2F9Ph7WCoWzLLJSCrOKdUX4jwbabAijBxwiCPW-h7IKMrha35ir4gu1w9PRD3wLqnVKXaKh6jwWiWGTSN6X8g Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 79c27f02ea6549bea54242ab81741f97 Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_79c27f02ea6549bea54242ab81741f97", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 79c27f02ea6549bea54242ab81741f97 Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerActionsTestJSON-1587791858-project Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 7019e4c367c0470f95bc66e32def747a Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerActionsTestJSON-1587791858-project Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 0881df85-31d1-4917-9933-0b12f857f996 could not be found. Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '0881df85-31d1-4917-9933-0b12f857f996'} Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0881df85-31d1-4917-9933-0b12f857f996 could not be found. Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0881df85-31d1-4917-9933-0b12f857f996 could not be found. Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:16:49.353559 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:16:49.359246 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:16:49.359246 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:16:49.359246 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:16:49.359246 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:16:49.359246 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:16:49.359246 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0881df85-31d1-4917-9933-0b12f857f996 could not be found. Oct 27 19:16:49.359246 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:16:49.359246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6a5ffaa9-49f3-47bd-8557-11f9ec5049f7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Returning 404 to user: Instance 0881df85-31d1-4917-9933-0b12f857f996 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:16:49.360305 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6a5ffaa9-49f3-47bd-8557-11f9ec5049f7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996" status: 404 len: 111 microversion: 2.1 time: 0.074064 Oct 27 19:16:49.361818 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2949/5742] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:49 2022] GET /compute/v2.1/servers/0881df85-31d1-4917-9933-0b12f857f996 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:16:49.373555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f67a3818-036f-4c74-9924-d6451bd50988 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:49.374115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f67a3818-036f-4c74-9924-d6451bd50988 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:49.381946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f67a3818-036f-4c74-9924-d6451bd50988 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:49.382477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f67a3818-036f-4c74-9924-d6451bd50988 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:49.384030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f67a3818-036f-4c74-9924-d6451bd50988 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:49.384766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f67a3818-036f-4c74-9924-d6451bd50988 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:49.385235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f67a3818-036f-4c74-9924-d6451bd50988 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:49.385673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f67a3818-036f-4c74-9924-d6451bd50988 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:49.426589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f67a3818-036f-4c74-9924-d6451bd50988 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:16:49.673978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-63446cfc-a1fa-48df-95dd-36c04c1b1f72 req-e292514e-2913-4cd0-92cf-bd39187ae732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0881df85-31d1-4917-9933-0b12f857f996", "name": "network-vif-deleted", "tag": "d62cb388-acc9-438a-92c7-c605cd60dca7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:49.740987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-63446cfc-a1fa-48df-95dd-36c04c1b1f72 req-e292514e-2913-4cd0-92cf-bd39187ae732 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:49.741497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-63446cfc-a1fa-48df-95dd-36c04c1b1f72 req-e292514e-2913-4cd0-92cf-bd39187ae732 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:49.743704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-63446cfc-a1fa-48df-95dd-36c04c1b1f72 req-e292514e-2913-4cd0-92cf-bd39187ae732 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:49.748423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:16:49.758847 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f67a3818-036f-4c74-9924-d6451bd50988 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 204 len: 0 microversion: 2.1 time: 0.389582 Oct 27 19:16:49.760280 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2950/5743] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:16:49 2022] DELETE /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:16:49.780738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.compute.server_external_events [req-63446cfc-a1fa-48df-95dd-36c04c1b1f72 req-e292514e-2913-4cd0-92cf-bd39187ae732 service nova] Unable to find a host for instance 0881df85-31d1-4917-9933-0b12f857f996. Dropping event network-vif-deleted {{(pid=127028) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 19:16:49.783054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f1e28a6a-4b45-429a-9026-dc6d1b540019 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:49.784116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f1e28a6a-4b45-429a-9026-dc6d1b540019 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:49.784793 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-63446cfc-a1fa-48df-95dd-36c04c1b1f72 req-e292514e-2913-4cd0-92cf-bd39187ae732 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.595610 Oct 27 19:16:49.787511 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2794/5744] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 598 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 19:16:49.813227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1e28a6a-4b45-429a-9026-dc6d1b540019 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:49.814301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1e28a6a-4b45-429a-9026-dc6d1b540019 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:49.815267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1e28a6a-4b45-429a-9026-dc6d1b540019 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:49.816665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1e28a6a-4b45-429a-9026-dc6d1b540019 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:49.817516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1e28a6a-4b45-429a-9026-dc6d1b540019 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:49.818354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1e28a6a-4b45-429a-9026-dc6d1b540019 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:50.110235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f1e28a6a-4b45-429a-9026-dc6d1b540019 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:50.132838 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f1e28a6a-4b45-429a-9026-dc6d1b540019 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1465 microversion: 2.1 time: 0.366386 Oct 27 19:16:50.133966 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2951/5745] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:49 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1465 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:50.218484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-931e9a97-c2c5-46b5-9035-5a01e3455046 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:50.219242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-931e9a97-c2c5-46b5-9035-5a01e3455046 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:50.237682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-931e9a97-c2c5-46b5-9035-5a01e3455046 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:50.242230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-931e9a97-c2c5-46b5-9035-5a01e3455046 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:50.243153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-931e9a97-c2c5-46b5-9035-5a01e3455046 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:50.244097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-931e9a97-c2c5-46b5-9035-5a01e3455046 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:50.245048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-931e9a97-c2c5-46b5-9035-5a01e3455046 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:50.247333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-931e9a97-c2c5-46b5-9035-5a01e3455046 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:50.567525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-931e9a97-c2c5-46b5-9035-5a01e3455046 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:50.580914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-931e9a97-c2c5-46b5-9035-5a01e3455046 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:50.582807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-931e9a97-c2c5-46b5-9035-5a01e3455046 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:50.588505 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-931e9a97-c2c5-46b5-9035-5a01e3455046 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.370948 Oct 27 19:16:50.589794 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2795/5746] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:50 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:51.172748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6c17141e-3a80-4e5e-9f18-dcf334a490d4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:51.173444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6c17141e-3a80-4e5e-9f18-dcf334a490d4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:51.198735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c17141e-3a80-4e5e-9f18-dcf334a490d4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:51.199452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c17141e-3a80-4e5e-9f18-dcf334a490d4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:51.204267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c17141e-3a80-4e5e-9f18-dcf334a490d4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:51.205612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c17141e-3a80-4e5e-9f18-dcf334a490d4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:51.207598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c17141e-3a80-4e5e-9f18-dcf334a490d4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:51.208201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c17141e-3a80-4e5e-9f18-dcf334a490d4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:51.384776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6c17141e-3a80-4e5e-9f18-dcf334a490d4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:51.397122 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6c17141e-3a80-4e5e-9f18-dcf334a490d4 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1465 microversion: 2.1 time: 0.231461 Oct 27 19:16:51.399370 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2952/5747] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:51 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1465 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:51.617655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5950d137-9866-4648-87c1-b28ece338fa2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:51.618289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5950d137-9866-4648-87c1-b28ece338fa2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:51.631058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5950d137-9866-4648-87c1-b28ece338fa2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:51.631802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5950d137-9866-4648-87c1-b28ece338fa2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:51.633970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5950d137-9866-4648-87c1-b28ece338fa2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:51.634960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5950d137-9866-4648-87c1-b28ece338fa2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:51.635607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5950d137-9866-4648-87c1-b28ece338fa2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:51.636211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5950d137-9866-4648-87c1-b28ece338fa2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:52.213239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5950d137-9866-4648-87c1-b28ece338fa2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:52.228579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5950d137-9866-4648-87c1-b28ece338fa2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:52.243929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5950d137-9866-4648-87c1-b28ece338fa2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:52.245169 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5950d137-9866-4648-87c1-b28ece338fa2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.632315 Oct 27 19:16:52.262478 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2796/5748] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:51 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:52.426056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6713546e-5b1f-4ec5-971a-a9379fdfdc5a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:52.426697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6713546e-5b1f-4ec5-971a-a9379fdfdc5a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:52.446768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6713546e-5b1f-4ec5-971a-a9379fdfdc5a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:52.447499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6713546e-5b1f-4ec5-971a-a9379fdfdc5a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:52.448174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6713546e-5b1f-4ec5-971a-a9379fdfdc5a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:52.449102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6713546e-5b1f-4ec5-971a-a9379fdfdc5a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:52.449764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6713546e-5b1f-4ec5-971a-a9379fdfdc5a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:52.450409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6713546e-5b1f-4ec5-971a-a9379fdfdc5a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:52.667663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6713546e-5b1f-4ec5-971a-a9379fdfdc5a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:52.675598 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6713546e-5b1f-4ec5-971a-a9379fdfdc5a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1465 microversion: 2.1 time: 0.253443 Oct 27 19:16:52.679034 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2953/5749] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:52 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1465 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:53.157983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-51583475-3f1e-4cf0-ba71-8f673aed699d req-114c4cd2-ffb9-44c7-bd05-3b84d42c8bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e13bbe-44cd-4122-a906-054244f62fe9", "name": "network-vif-deleted", "tag": "9767a035-abf0-4f25-b8e5-1e7c6ce28b2e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:53.185145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-51583475-3f1e-4cf0-ba71-8f673aed699d req-114c4cd2-ffb9-44c7-bd05-3b84d42c8bfb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:53.186608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-51583475-3f1e-4cf0-ba71-8f673aed699d req-114c4cd2-ffb9-44c7-bd05-3b84d42c8bfb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:53.187372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-51583475-3f1e-4cf0-ba71-8f673aed699d req-114c4cd2-ffb9-44c7-bd05-3b84d42c8bfb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:53.273775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5e06730a-d933-4ca4-ac8c-008905767bd3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:53.281486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5e06730a-d933-4ca4-ac8c-008905767bd3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:53.285053 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-51583475-3f1e-4cf0-ba71-8f673aed699d req-114c4cd2-ffb9-44c7-bd05-3b84d42c8bfb service nova] Creating event network-vif-deleted:9767a035-abf0-4f25-b8e5-1e7c6ce28b2e for instance a5e13bbe-44cd-4122-a906-054244f62fe9 on n-h2-860687-3 Oct 27 19:16:53.299016 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-51583475-3f1e-4cf0-ba71-8f673aed699d req-114c4cd2-ffb9-44c7-bd05-3b84d42c8bfb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144323 Oct 27 19:16:53.301798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e06730a-d933-4ca4-ac8c-008905767bd3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:53.302314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e06730a-d933-4ca4-ac8c-008905767bd3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:53.302483 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2797/5750] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:16:53.309785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e06730a-d933-4ca4-ac8c-008905767bd3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:53.310811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e06730a-d933-4ca4-ac8c-008905767bd3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:53.311118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e06730a-d933-4ca4-ac8c-008905767bd3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:53.311692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e06730a-d933-4ca4-ac8c-008905767bd3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:53.710600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-299ab6ab-67d8-4a86-be43-416c16c8aecb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:53.712610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-299ab6ab-67d8-4a86-be43-416c16c8aecb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:53.732323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-299ab6ab-67d8-4a86-be43-416c16c8aecb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:53.732862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-299ab6ab-67d8-4a86-be43-416c16c8aecb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:53.733290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-299ab6ab-67d8-4a86-be43-416c16c8aecb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:53.734005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-299ab6ab-67d8-4a86-be43-416c16c8aecb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:53.734496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-299ab6ab-67d8-4a86-be43-416c16c8aecb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:53.734931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-299ab6ab-67d8-4a86-be43-416c16c8aecb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:53.811740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-299ab6ab-67d8-4a86-be43-416c16c8aecb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:53.812144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-299ab6ab-67d8-4a86-be43-416c16c8aecb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:53.812586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-299ab6ab-67d8-4a86-be43-416c16c8aecb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:53.813042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-299ab6ab-67d8-4a86-be43-416c16c8aecb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lazy-loading 'fault' on Instance uuid a5e13bbe-44cd-4122-a906-054244f62fe9 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:16:53.827675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5e06730a-d933-4ca4-ac8c-008905767bd3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:53.841405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5e06730a-d933-4ca4-ac8c-008905767bd3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:53.843132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5e06730a-d933-4ca4-ac8c-008905767bd3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:53.844967 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5e06730a-d933-4ca4-ac8c-008905767bd3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.575488 Oct 27 19:16:53.846459 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2954/5751] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:53 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:53.919113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-299ab6ab-67d8-4a86-be43-416c16c8aecb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:53.927029 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-299ab6ab-67d8-4a86-be43-416c16c8aecb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 200 len: 1305 microversion: 2.1 time: 0.221656 Oct 27 19:16:53.938809 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2798/5752] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:53 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 1305 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:54.875021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-653f0d74-bac8-4e25-9154-5f8d13974e26 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:54.875544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-653f0d74-bac8-4e25-9154-5f8d13974e26 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:54.888979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-653f0d74-bac8-4e25-9154-5f8d13974e26 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:54.889479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-653f0d74-bac8-4e25-9154-5f8d13974e26 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:54.889929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-653f0d74-bac8-4e25-9154-5f8d13974e26 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:54.890671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-653f0d74-bac8-4e25-9154-5f8d13974e26 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:54.891131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-653f0d74-bac8-4e25-9154-5f8d13974e26 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:54.891566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-653f0d74-bac8-4e25-9154-5f8d13974e26 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:54.954130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f3ff3a2f-a7b3-41ef-a0cc-1d030e047dcb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:54.954838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f3ff3a2f-a7b3-41ef-a0cc-1d030e047dcb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: a5e13bbe-44cd-4122-a906-054244f62fe9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:54.965175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3ff3a2f-a7b3-41ef-a0cc-1d030e047dcb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:54.965685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3ff3a2f-a7b3-41ef-a0cc-1d030e047dcb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:54.966136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3ff3a2f-a7b3-41ef-a0cc-1d030e047dcb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:54.971122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3ff3a2f-a7b3-41ef-a0cc-1d030e047dcb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:54.971685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3ff3a2f-a7b3-41ef-a0cc-1d030e047dcb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:54.972166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3ff3a2f-a7b3-41ef-a0cc-1d030e047dcb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:55.009740 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-f3ff3a2f-a7b3-41ef-a0cc-1d030e047dcb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] HTTP exception thrown: Instance a5e13bbe-44cd-4122-a906-054244f62fe9 could not be found. Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f3ff3a2f-a7b3-41ef-a0cc-1d030e047dcb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Request method failure captured: Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 HTTP/1.1 Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtcMgvpB1r3CMhn3lqnafdbRH_q7_2MwBC9YYeuhDoLvj0r3BLn_zRO4y1vPk2UIxFleNSJ40ezxJxF7WpMwNGUDmR2F9Ph7WCoWzLLJSCrOKdUX4jwbabAijBxwiCPW-h7IKMrha35ir4gu1w9PRD3wLqnVKXaKh6jwWiWGTSN6X8g Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 79c27f02ea6549bea54242ab81741f97 Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_79c27f02ea6549bea54242ab81741f97", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 79c27f02ea6549bea54242ab81741f97 Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerActionsTestJSON-1587791858-project Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 7019e4c367c0470f95bc66e32def747a Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerActionsTestJSON-1587791858-project Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance a5e13bbe-44cd-4122-a906-054244f62fe9 could not be found. Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a5e13bbe-44cd-4122-a906-054244f62fe9'} Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e13bbe-44cd-4122-a906-054244f62fe9 could not be found. Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e13bbe-44cd-4122-a906-054244f62fe9 could not be found. Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:16:55.011497 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:16:55.016633 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:16:55.016633 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:16:55.016633 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:16:55.016633 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:16:55.016633 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:16:55.016633 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e13bbe-44cd-4122-a906-054244f62fe9 could not be found. Oct 27 19:16:55.016633 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:16:55.020594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f3ff3a2f-a7b3-41ef-a0cc-1d030e047dcb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Returning 404 to user: Instance a5e13bbe-44cd-4122-a906-054244f62fe9 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:16:55.021698 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f3ff3a2f-a7b3-41ef-a0cc-1d030e047dcb tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9" status: 404 len: 111 microversion: 2.1 time: 0.071395 Oct 27 19:16:55.029114 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2799/5753] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:54 2022] GET /compute/v2.1/servers/a5e13bbe-44cd-4122-a906-054244f62fe9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:16:55.034725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0a8d4ed4-6b51-4c8f-bb22-0b779df94b75 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:55.045536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0a8d4ed4-6b51-4c8f-bb22-0b779df94b75 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:55.061212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a8d4ed4-6b51-4c8f-bb22-0b779df94b75 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:55.063479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a8d4ed4-6b51-4c8f-bb22-0b779df94b75 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:55.064920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a8d4ed4-6b51-4c8f-bb22-0b779df94b75 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:55.065830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a8d4ed4-6b51-4c8f-bb22-0b779df94b75 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:55.070735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a8d4ed4-6b51-4c8f-bb22-0b779df94b75 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:55.071506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a8d4ed4-6b51-4c8f-bb22-0b779df94b75 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:55.134198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0a8d4ed4-6b51-4c8f-bb22-0b779df94b75 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:16:55.183849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:16:55.347570 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0a8d4ed4-6b51-4c8f-bb22-0b779df94b75 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "DELETE /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 204 len: 0 microversion: 2.1 time: 0.316325 Oct 27 19:16:55.348544 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2800/5754] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:16:55 2022] DELETE /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:16:55.374720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b064016e-1b82-4b8a-bddf-ccc7adb5d382 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:55.376402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b064016e-1b82-4b8a-bddf-ccc7adb5d382 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:55.393721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b064016e-1b82-4b8a-bddf-ccc7adb5d382 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:55.395947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b064016e-1b82-4b8a-bddf-ccc7adb5d382 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:55.396907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b064016e-1b82-4b8a-bddf-ccc7adb5d382 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:55.400736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b064016e-1b82-4b8a-bddf-ccc7adb5d382 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:55.402509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b064016e-1b82-4b8a-bddf-ccc7adb5d382 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:55.403358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b064016e-1b82-4b8a-bddf-ccc7adb5d382 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:55.838273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b064016e-1b82-4b8a-bddf-ccc7adb5d382 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:55.850130 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b064016e-1b82-4b8a-bddf-ccc7adb5d382 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1505 microversion: 2.1 time: 0.485163 Oct 27 19:16:55.857410 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2801/5755] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:55 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:55.895541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-653f0d74-bac8-4e25-9154-5f8d13974e26 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:55.909292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:16:55.922551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-653f0d74-bac8-4e25-9154-5f8d13974e26 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:55.927009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-653f0d74-bac8-4e25-9154-5f8d13974e26 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:55.934220 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-653f0d74-bac8-4e25-9154-5f8d13974e26 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 1.062357 Oct 27 19:16:55.941065 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2955/5756] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:54 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:56.879452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e62c3c8-67e7-40b9-9ffc-a9b3957636d5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:56.880069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9e62c3c8-67e7-40b9-9ffc-a9b3957636d5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:56.892343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e62c3c8-67e7-40b9-9ffc-a9b3957636d5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:56.895589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e62c3c8-67e7-40b9-9ffc-a9b3957636d5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:56.896903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e62c3c8-67e7-40b9-9ffc-a9b3957636d5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:56.904429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e62c3c8-67e7-40b9-9ffc-a9b3957636d5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:56.904980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e62c3c8-67e7-40b9-9ffc-a9b3957636d5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:56.905441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e62c3c8-67e7-40b9-9ffc-a9b3957636d5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:56.970731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-24a5e778-8905-4347-ba3f-65e10d000cc0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:56.971357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-24a5e778-8905-4347-ba3f-65e10d000cc0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:56.987004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24a5e778-8905-4347-ba3f-65e10d000cc0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:56.987505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24a5e778-8905-4347-ba3f-65e10d000cc0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:56.987951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24a5e778-8905-4347-ba3f-65e10d000cc0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:56.988685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24a5e778-8905-4347-ba3f-65e10d000cc0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:56.989147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24a5e778-8905-4347-ba3f-65e10d000cc0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:56.989583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24a5e778-8905-4347-ba3f-65e10d000cc0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:57.293032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9e62c3c8-67e7-40b9-9ffc-a9b3957636d5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:57.301044 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9e62c3c8-67e7-40b9-9ffc-a9b3957636d5 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1505 microversion: 2.1 time: 0.425305 Oct 27 19:16:57.301484 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2802/5757] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:56 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:57.536699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd28ea4a-3783-4e2d-9767-41d013312b40 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:57.541686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bd28ea4a-3783-4e2d-9767-41d013312b40 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:57.551281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd28ea4a-3783-4e2d-9767-41d013312b40 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:57.551926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd28ea4a-3783-4e2d-9767-41d013312b40 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:57.552485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd28ea4a-3783-4e2d-9767-41d013312b40 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:57.553345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd28ea4a-3783-4e2d-9767-41d013312b40 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:57.554164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd28ea4a-3783-4e2d-9767-41d013312b40 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:57.555316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd28ea4a-3783-4e2d-9767-41d013312b40 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:57.559895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-24a5e778-8905-4347-ba3f-65e10d000cc0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:57.571950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-24a5e778-8905-4347-ba3f-65e10d000cc0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:57.578525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-24a5e778-8905-4347-ba3f-65e10d000cc0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:57.579792 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-24a5e778-8905-4347-ba3f-65e10d000cc0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.614621 Oct 27 19:16:57.606275 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2956/5758] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:56 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:16:57.656922 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bd28ea4a-3783-4e2d-9767-41d013312b40 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792/action" status: 200 len: 24579 microversion: 2.1 time: 0.125956 Oct 27 19:16:57.658312 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2803/5759] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:16:57 2022] POST /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792/action => generated 24579 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 19:16:58.254892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-96857e3c-476a-4b25-bac9-74fb9c08bc96 req-f8278c91-4313-49b3-8525-f963b28b6237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c66127-ad48-4068-a9c0-24c408a29e70", "name": "network-vif-deleted", "tag": "77f82e77-74a2-4c75-943c-33cc366aab68"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:16:58.281259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-96857e3c-476a-4b25-bac9-74fb9c08bc96 req-f8278c91-4313-49b3-8525-f963b28b6237 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:58.282737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-96857e3c-476a-4b25-bac9-74fb9c08bc96 req-f8278c91-4313-49b3-8525-f963b28b6237 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:58.283455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-96857e3c-476a-4b25-bac9-74fb9c08bc96 req-f8278c91-4313-49b3-8525-f963b28b6237 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:58.304043 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-96857e3c-476a-4b25-bac9-74fb9c08bc96 req-f8278c91-4313-49b3-8525-f963b28b6237 service nova] Creating event network-vif-deleted:77f82e77-74a2-4c75-943c-33cc366aab68 for instance 82c66127-ad48-4068-a9c0-24c408a29e70 on n-h2-860687-3 Oct 27 19:16:58.315018 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-96857e3c-476a-4b25-bac9-74fb9c08bc96 req-f8278c91-4313-49b3-8525-f963b28b6237 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075201 Oct 27 19:16:58.317422 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2957/5760] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:16:58.331059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9c7a1fbb-5394-4a27-ad81-d60ef401cc0a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:58.331927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9c7a1fbb-5394-4a27-ad81-d60ef401cc0a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:58.342086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c7a1fbb-5394-4a27-ad81-d60ef401cc0a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:58.343088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c7a1fbb-5394-4a27-ad81-d60ef401cc0a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:58.344175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c7a1fbb-5394-4a27-ad81-d60ef401cc0a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:58.345201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c7a1fbb-5394-4a27-ad81-d60ef401cc0a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:58.345906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c7a1fbb-5394-4a27-ad81-d60ef401cc0a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:58.346612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c7a1fbb-5394-4a27-ad81-d60ef401cc0a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:58.494966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9c7a1fbb-5394-4a27-ad81-d60ef401cc0a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:58.505644 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9c7a1fbb-5394-4a27-ad81-d60ef401cc0a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 200 len: 1298 microversion: 2.1 time: 0.180314 Oct 27 19:16:58.506431 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2804/5761] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:58 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 1298 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:16:58.615979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-547ce030-ea30-4ed2-b83d-de44b117003a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:58.617418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-547ce030-ea30-4ed2-b83d-de44b117003a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:58.628482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-547ce030-ea30-4ed2-b83d-de44b117003a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:58.629347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-547ce030-ea30-4ed2-b83d-de44b117003a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:58.630000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-547ce030-ea30-4ed2-b83d-de44b117003a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:58.630932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-547ce030-ea30-4ed2-b83d-de44b117003a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:58.631561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-547ce030-ea30-4ed2-b83d-de44b117003a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:58.632171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-547ce030-ea30-4ed2-b83d-de44b117003a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:58.908589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-547ce030-ea30-4ed2-b83d-de44b117003a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:58.935120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-547ce030-ea30-4ed2-b83d-de44b117003a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:58.940002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-547ce030-ea30-4ed2-b83d-de44b117003a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:16:58.947437 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-547ce030-ea30-4ed2-b83d-de44b117003a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.334322 Oct 27 19:16:58.949848 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2958/5762] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:58 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:16:59.534622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-da895c9b-1f71-4163-88b2-dc51df41edd3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:59.536878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-da895c9b-1f71-4163-88b2-dc51df41edd3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 82c66127-ad48-4068-a9c0-24c408a29e70] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:59.552989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da895c9b-1f71-4163-88b2-dc51df41edd3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:59.553625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da895c9b-1f71-4163-88b2-dc51df41edd3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:59.554290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da895c9b-1f71-4163-88b2-dc51df41edd3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:59.556007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da895c9b-1f71-4163-88b2-dc51df41edd3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:59.556935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da895c9b-1f71-4163-88b2-dc51df41edd3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:59.557503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da895c9b-1f71-4163-88b2-dc51df41edd3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:59.588073 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-da895c9b-1f71-4163-88b2-dc51df41edd3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] HTTP exception thrown: Instance 82c66127-ad48-4068-a9c0-24c408a29e70 could not be found. Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-da895c9b-1f71-4163-88b2-dc51df41edd3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Request method failure captured: Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 HTTP/1.1 Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtcMgvpB1r3CMhn3lqnafdbRH_q7_2MwBC9YYeuhDoLvj0r3BLn_zRO4y1vPk2UIxFleNSJ40ezxJxF7WpMwNGUDmR2F9Ph7WCoWzLLJSCrOKdUX4jwbabAijBxwiCPW-h7IKMrha35ir4gu1w9PRD3wLqnVKXaKh6jwWiWGTSN6X8g Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 79c27f02ea6549bea54242ab81741f97 Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_79c27f02ea6549bea54242ab81741f97", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 79c27f02ea6549bea54242ab81741f97 Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerActionsTestJSON-1587791858-project Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 7019e4c367c0470f95bc66e32def747a Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerActionsTestJSON-1587791858-project Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 82c66127-ad48-4068-a9c0-24c408a29e70 could not be found. Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '82c66127-ad48-4068-a9c0-24c408a29e70'} Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82c66127-ad48-4068-a9c0-24c408a29e70 could not be found. Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82c66127-ad48-4068-a9c0-24c408a29e70 could not be found. Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:16:59.592132 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:16:59.597252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:16:59.597252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:16:59.597252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:16:59.597252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:16:59.597252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:16:59.597252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82c66127-ad48-4068-a9c0-24c408a29e70 could not be found. Oct 27 19:16:59.597252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:16:59.600040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-da895c9b-1f71-4163-88b2-dc51df41edd3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Returning 404 to user: Instance 82c66127-ad48-4068-a9c0-24c408a29e70 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:16:59.603024 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-da895c9b-1f71-4163-88b2-dc51df41edd3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70" status: 404 len: 111 microversion: 2.1 time: 0.072922 Oct 27 19:16:59.604324 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2805/5763] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:59 2022] GET /compute/v2.1/servers/82c66127-ad48-4068-a9c0-24c408a29e70 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:16:59.613999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b9d68c0a-4fd6-4312-8556-d4d87f5de053 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:59.614628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b9d68c0a-4fd6-4312-8556-d4d87f5de053 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:59.627668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9d68c0a-4fd6-4312-8556-d4d87f5de053 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:59.631024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9d68c0a-4fd6-4312-8556-d4d87f5de053 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:59.633900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9d68c0a-4fd6-4312-8556-d4d87f5de053 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:59.636086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9d68c0a-4fd6-4312-8556-d4d87f5de053 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:59.641251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9d68c0a-4fd6-4312-8556-d4d87f5de053 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:59.664553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9d68c0a-4fd6-4312-8556-d4d87f5de053 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:59.737237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b9d68c0a-4fd6-4312-8556-d4d87f5de053 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:16:59.888868 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b9d68c0a-4fd6-4312-8556-d4d87f5de053 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "DELETE /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 204 len: 0 microversion: 2.1 time: 0.279181 Oct 27 19:16:59.892803 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2959/5764] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:16:59 2022] DELETE /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:16:59.898077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-17a350f0-b754-4a56-9c71-e1c59902277d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:59.899272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-17a350f0-b754-4a56-9c71-e1c59902277d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:59.911327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17a350f0-b754-4a56-9c71-e1c59902277d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:59.912141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17a350f0-b754-4a56-9c71-e1c59902277d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:59.913887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17a350f0-b754-4a56-9c71-e1c59902277d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:59.914689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17a350f0-b754-4a56-9c71-e1c59902277d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:59.915169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17a350f0-b754-4a56-9c71-e1c59902277d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:59.915606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17a350f0-b754-4a56-9c71-e1c59902277d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:59.977900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-db5869a3-f8cd-4d59-ade6-77ebfa3ec632 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:16:59.978645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-db5869a3-f8cd-4d59-ade6-77ebfa3ec632 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:16:59.984844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db5869a3-f8cd-4d59-ade6-77ebfa3ec632 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:59.990793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db5869a3-f8cd-4d59-ade6-77ebfa3ec632 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:59.991112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db5869a3-f8cd-4d59-ade6-77ebfa3ec632 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:16:59.991910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db5869a3-f8cd-4d59-ade6-77ebfa3ec632 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:16:59.992386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db5869a3-f8cd-4d59-ade6-77ebfa3ec632 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:16:59.992823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db5869a3-f8cd-4d59-ade6-77ebfa3ec632 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:00.217844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-17a350f0-b754-4a56-9c71-e1c59902277d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:00.233432 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-17a350f0-b754-4a56-9c71-e1c59902277d tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1495 microversion: 2.1 time: 0.339231 Oct 27 19:17:00.234054 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2806/5765] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:16:59 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1495 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:00.433985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-db5869a3-f8cd-4d59-ade6-77ebfa3ec632 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:00.459437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-db5869a3-f8cd-4d59-ade6-77ebfa3ec632 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:00.463378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-db5869a3-f8cd-4d59-ade6-77ebfa3ec632 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:00.470284 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-db5869a3-f8cd-4d59-ade6-77ebfa3ec632 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.495017 Oct 27 19:17:00.472060 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2960/5766] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:16:59 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:17:01.257686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e227a548-c8e4-417c-ae24-77a9f7556779 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:01.258922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e227a548-c8e4-417c-ae24-77a9f7556779 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:01.261714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-10787793-c82f-49c4-81e2-007413efabcf req-5810ea07-fad0-4007-9a90-83c6e5697b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86898626-0268-442a-87b6-247e940e384b", "name": "network-vif-deleted", "tag": "fb95d35e-1e2e-4043-aed9-63a81ad3e541"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:01.272594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e227a548-c8e4-417c-ae24-77a9f7556779 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:01.281187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e227a548-c8e4-417c-ae24-77a9f7556779 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:01.282919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e227a548-c8e4-417c-ae24-77a9f7556779 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:01.283612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e227a548-c8e4-417c-ae24-77a9f7556779 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:01.284207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e227a548-c8e4-417c-ae24-77a9f7556779 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:01.284750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e227a548-c8e4-417c-ae24-77a9f7556779 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:01.323877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-10787793-c82f-49c4-81e2-007413efabcf req-5810ea07-fad0-4007-9a90-83c6e5697b20 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:01.324352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-10787793-c82f-49c4-81e2-007413efabcf req-5810ea07-fad0-4007-9a90-83c6e5697b20 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:01.324813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-10787793-c82f-49c4-81e2-007413efabcf req-5810ea07-fad0-4007-9a90-83c6e5697b20 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:01.381675 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-10787793-c82f-49c4-81e2-007413efabcf req-5810ea07-fad0-4007-9a90-83c6e5697b20 service nova] Creating event network-vif-deleted:fb95d35e-1e2e-4043-aed9-63a81ad3e541 for instance 86898626-0268-442a-87b6-247e940e384b on n-h1-860687-3 Oct 27 19:17:01.425842 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-10787793-c82f-49c4-81e2-007413efabcf req-5810ea07-fad0-4007-9a90-83c6e5697b20 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167396 Oct 27 19:17:01.430541 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2961/5767] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:17:01.443213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5e48f9e4-eb6e-4522-8e5c-b56c2ff009c5 req-0a762ff2-b0d5-4a77-b77d-a9e37f611137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-plugged", "status": "completed", "tag": "4ce86d42-71a2-4e2c-87ec-79cedd1a70d0"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:01.450062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e227a548-c8e4-417c-ae24-77a9f7556779 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:01.462740 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e227a548-c8e4-417c-ae24-77a9f7556779 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 200 len: 1453 microversion: 2.1 time: 0.208965 Oct 27 19:17:01.467497 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2807/5768] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:01 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 1453 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:01.487434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5e48f9e4-eb6e-4522-8e5c-b56c2ff009c5 req-0a762ff2-b0d5-4a77-b77d-a9e37f611137 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:01.488255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5e48f9e4-eb6e-4522-8e5c-b56c2ff009c5 req-0a762ff2-b0d5-4a77-b77d-a9e37f611137 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:01.489796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5e48f9e4-eb6e-4522-8e5c-b56c2ff009c5 req-0a762ff2-b0d5-4a77-b77d-a9e37f611137 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:01.500467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f4f2f202-5963-4203-8a99-e275c306e1e5 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:01.501456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f4f2f202-5963-4203-8a99-e275c306e1e5 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:01.518172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4f2f202-5963-4203-8a99-e275c306e1e5 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:01.519408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4f2f202-5963-4203-8a99-e275c306e1e5 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:01.520178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4f2f202-5963-4203-8a99-e275c306e1e5 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:01.521088 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5e48f9e4-eb6e-4522-8e5c-b56c2ff009c5 req-0a762ff2-b0d5-4a77-b77d-a9e37f611137 service nova] Creating event network-vif-plugged:4ce86d42-71a2-4e2c-87ec-79cedd1a70d0 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:17:01.521313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4f2f202-5963-4203-8a99-e275c306e1e5 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:01.521793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4f2f202-5963-4203-8a99-e275c306e1e5 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:01.522712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4f2f202-5963-4203-8a99-e275c306e1e5 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:01.530677 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5e48f9e4-eb6e-4522-8e5c-b56c2ff009c5 req-0a762ff2-b0d5-4a77-b77d-a9e37f611137 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093338 Oct 27 19:17:01.531587 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2962/5769] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:01.965355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f4f2f202-5963-4203-8a99-e275c306e1e5 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:01.982063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f4f2f202-5963-4203-8a99-e275c306e1e5 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:01.984141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f4f2f202-5963-4203-8a99-e275c306e1e5 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:01.985600 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f4f2f202-5963-4203-8a99-e275c306e1e5 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.490520 Oct 27 19:17:01.987292 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2808/5770] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:17:01 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:17:02.493647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4186d678-c631-4bb6-9faa-9f8c2440f052 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:02.496401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4186d678-c631-4bb6-9faa-9f8c2440f052 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: 86898626-0268-442a-87b6-247e940e384b] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:02.529300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4186d678-c631-4bb6-9faa-9f8c2440f052 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:02.531038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4186d678-c631-4bb6-9faa-9f8c2440f052 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:02.533319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4186d678-c631-4bb6-9faa-9f8c2440f052 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:02.534730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4186d678-c631-4bb6-9faa-9f8c2440f052 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:02.537451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4186d678-c631-4bb6-9faa-9f8c2440f052 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:02.538135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4186d678-c631-4bb6-9faa-9f8c2440f052 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:02.608871 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-4186d678-c631-4bb6-9faa-9f8c2440f052 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] HTTP exception thrown: Instance 86898626-0268-442a-87b6-247e940e384b could not be found. Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4186d678-c631-4bb6-9faa-9f8c2440f052 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Request method failure captured: Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b HTTP/1.1 Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtcMgvpB1r3CMhn3lqnafdbRH_q7_2MwBC9YYeuhDoLvj0r3BLn_zRO4y1vPk2UIxFleNSJ40ezxJxF7WpMwNGUDmR2F9Ph7WCoWzLLJSCrOKdUX4jwbabAijBxwiCPW-h7IKMrha35ir4gu1w9PRD3wLqnVKXaKh6jwWiWGTSN6X8g Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 79c27f02ea6549bea54242ab81741f97 Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_79c27f02ea6549bea54242ab81741f97", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 79c27f02ea6549bea54242ab81741f97 Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerActionsTestJSON-1587791858-project Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 7019e4c367c0470f95bc66e32def747a Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerActionsTestJSON-1587791858-project Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 86898626-0268-442a-87b6-247e940e384b could not be found. Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '86898626-0268-442a-87b6-247e940e384b'} Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86898626-0268-442a-87b6-247e940e384b could not be found. Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86898626-0268-442a-87b6-247e940e384b could not be found. Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:17:02.613812 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:02.619710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:17:02.619710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:17:02.619710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:17:02.619710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:17:02.619710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:17:02.619710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86898626-0268-442a-87b6-247e940e384b could not be found. Oct 27 19:17:02.619710 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:02.619710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4186d678-c631-4bb6-9faa-9f8c2440f052 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Returning 404 to user: Instance 86898626-0268-442a-87b6-247e940e384b could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:17:02.619710 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4186d678-c631-4bb6-9faa-9f8c2440f052 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b" status: 404 len: 111 microversion: 2.1 time: 0.127139 Oct 27 19:17:02.623856 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2963/5771] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:02 2022] GET /compute/v2.1/servers/86898626-0268-442a-87b6-247e940e384b => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:17:02.626755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-99fe3f55-d15d-4d05-bf8c-ab0ff6d81dbd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:02.627386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-99fe3f55-d15d-4d05-bf8c-ab0ff6d81dbd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:02.637210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-99fe3f55-d15d-4d05-bf8c-ab0ff6d81dbd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:02.639886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-99fe3f55-d15d-4d05-bf8c-ab0ff6d81dbd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:02.643995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-99fe3f55-d15d-4d05-bf8c-ab0ff6d81dbd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:02.645075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-99fe3f55-d15d-4d05-bf8c-ab0ff6d81dbd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:02.645754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-99fe3f55-d15d-4d05-bf8c-ab0ff6d81dbd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:02.646428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-99fe3f55-d15d-4d05-bf8c-ab0ff6d81dbd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:02.707213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-99fe3f55-d15d-4d05-bf8c-ab0ff6d81dbd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:17:02.913211 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-99fe3f55-d15d-4d05-bf8c-ab0ff6d81dbd tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 204 len: 0 microversion: 2.1 time: 0.281389 Oct 27 19:17:02.919459 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2809/5772] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:17:02 2022] DELETE /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:17:02.928792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dc1e4378-05fb-4f71-9924-cfe88de267d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:02.929604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dc1e4378-05fb-4f71-9924-cfe88de267d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:02.947566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc1e4378-05fb-4f71-9924-cfe88de267d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:02.948554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc1e4378-05fb-4f71-9924-cfe88de267d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:02.950491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc1e4378-05fb-4f71-9924-cfe88de267d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:02.953468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc1e4378-05fb-4f71-9924-cfe88de267d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:02.954332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc1e4378-05fb-4f71-9924-cfe88de267d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:02.954969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc1e4378-05fb-4f71-9924-cfe88de267d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:03.020101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-80b37956-185b-4762-9f95-777a4ff2bd2b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:03.023511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-80b37956-185b-4762-9f95-777a4ff2bd2b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:03.038553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80b37956-185b-4762-9f95-777a4ff2bd2b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:03.040209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80b37956-185b-4762-9f95-777a4ff2bd2b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:03.041510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80b37956-185b-4762-9f95-777a4ff2bd2b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:03.045422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80b37956-185b-4762-9f95-777a4ff2bd2b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:03.047639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80b37956-185b-4762-9f95-777a4ff2bd2b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:03.048845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80b37956-185b-4762-9f95-777a4ff2bd2b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:03.616077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-80b37956-185b-4762-9f95-777a4ff2bd2b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:03.633506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-80b37956-185b-4762-9f95-777a4ff2bd2b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:03.635079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-80b37956-185b-4762-9f95-777a4ff2bd2b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:03.636303 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-80b37956-185b-4762-9f95-777a4ff2bd2b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.621805 Oct 27 19:17:03.645342 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2810/5773] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:17:03 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:17:03.671397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-3ab37cfd-99f9-4498-8ada-90f655b7301e req-c3f8217a-e7c9-4b41-a931-08135dad9939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-plugged", "status": "completed", "tag": "03f458ee-4642-43c5-b1e8-c0561e0c41f5"}, {"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-plugged", "status": "completed", "tag": "97527b5c-4373-4fee-b901-c12096d23c2c"}, {"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-plugged", "status": "completed", "tag": "2b342788-17c7-4f8c-859c-82ded55435e9"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:03.680810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dc1e4378-05fb-4f71-9924-cfe88de267d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:03.700231 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dc1e4378-05fb-4f71-9924-cfe88de267d7 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1675 microversion: 2.1 time: 0.777214 Oct 27 19:17:03.701177 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2964/5774] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:02 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1675 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:03.701864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3ab37cfd-99f9-4498-8ada-90f655b7301e req-c3f8217a-e7c9-4b41-a931-08135dad9939 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:03.702356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3ab37cfd-99f9-4498-8ada-90f655b7301e req-c3f8217a-e7c9-4b41-a931-08135dad9939 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:03.702824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3ab37cfd-99f9-4498-8ada-90f655b7301e req-c3f8217a-e7c9-4b41-a931-08135dad9939 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:03.733727 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-3ab37cfd-99f9-4498-8ada-90f655b7301e req-c3f8217a-e7c9-4b41-a931-08135dad9939 service nova] Creating event network-vif-plugged:03f458ee-4642-43c5-b1e8-c0561e0c41f5 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:17:03.734743 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-3ab37cfd-99f9-4498-8ada-90f655b7301e req-c3f8217a-e7c9-4b41-a931-08135dad9939 service nova] Creating event network-vif-plugged:97527b5c-4373-4fee-b901-c12096d23c2c for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:17:03.736036 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-3ab37cfd-99f9-4498-8ada-90f655b7301e req-c3f8217a-e7c9-4b41-a931-08135dad9939 service nova] Creating event network-vif-plugged:2b342788-17c7-4f8c-859c-82ded55435e9 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:17:03.743527 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-3ab37cfd-99f9-4498-8ada-90f655b7301e req-c3f8217a-e7c9-4b41-a931-08135dad9939 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.095860 Oct 27 19:17:03.744524 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2811/5775] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:04.503345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2e230cb3-059e-4811-b7f2-c4e0c3a8f230 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:04.503851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2e230cb3-059e-4811-b7f2-c4e0c3a8f230 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:04.511481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e230cb3-059e-4811-b7f2-c4e0c3a8f230 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:04.511984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e230cb3-059e-4811-b7f2-c4e0c3a8f230 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:04.512630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e230cb3-059e-4811-b7f2-c4e0c3a8f230 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:04.514421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e230cb3-059e-4811-b7f2-c4e0c3a8f230 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:04.514421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e230cb3-059e-4811-b7f2-c4e0c3a8f230 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:04.514421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e230cb3-059e-4811-b7f2-c4e0c3a8f230 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:04.543357 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2e230cb3-059e-4811-b7f2-c4e0c3a8f230 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.044321 Oct 27 19:17:04.544251 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2965/5776] 10.222.0.42 () {58 vars in 1293 bytes} [Thu Oct 27 19:17:04 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5/os-server-password => generated 116 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:04.683123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aaab3eb4-1d81-4913-945b-5d6a2be833dd tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:04.684798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aaab3eb4-1d81-4913-945b-5d6a2be833dd tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:04.696894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaab3eb4-1d81-4913-945b-5d6a2be833dd tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:04.698240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaab3eb4-1d81-4913-945b-5d6a2be833dd tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:04.699013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaab3eb4-1d81-4913-945b-5d6a2be833dd tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:04.700696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaab3eb4-1d81-4913-945b-5d6a2be833dd tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:04.701405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaab3eb4-1d81-4913-945b-5d6a2be833dd tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:04.702069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aaab3eb4-1d81-4913-945b-5d6a2be833dd tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:04.728150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6b78d62b-aafe-4000-8048-52589c7a4d4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:04.728914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6b78d62b-aafe-4000-8048-52589c7a4d4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:04.740849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b78d62b-aafe-4000-8048-52589c7a4d4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:04.741379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b78d62b-aafe-4000-8048-52589c7a4d4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:04.743306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b78d62b-aafe-4000-8048-52589c7a4d4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:04.744061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b78d62b-aafe-4000-8048-52589c7a4d4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:04.744544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b78d62b-aafe-4000-8048-52589c7a4d4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:04.744991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b78d62b-aafe-4000-8048-52589c7a4d4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:04.951562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aaab3eb4-1d81-4913-945b-5d6a2be833dd tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:04.961843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aaab3eb4-1d81-4913-945b-5d6a2be833dd tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:04.963395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aaab3eb4-1d81-4913-945b-5d6a2be833dd tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:04.964879 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aaab3eb4-1d81-4913-945b-5d6a2be833dd tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.286133 Oct 27 19:17:04.965481 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2812/5777] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:17:04 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:17:05.349329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6b78d62b-aafe-4000-8048-52589c7a4d4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:05.373399 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6b78d62b-aafe-4000-8048-52589c7a4d4a tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1675 microversion: 2.1 time: 0.650254 Oct 27 19:17:05.375362 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2966/5778] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:04 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1675 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:17:05.764788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-82e92aa5-e683-49db-8018-c47b2949f3c7 req-940cce4a-4d17-48a8-8a17-03738f2e61ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-plugged", "status": "completed", "tag": "930eb105-32c0-40a2-a18f-960c696dabb1"}, {"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-plugged", "status": "completed", "tag": "22ff15ff-92e5-4daa-abf0-a7696778e3f7"}, {"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-plugged", "status": "completed", "tag": "1f07717a-ae91-4c44-8b27-921e82e3c064"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:05.805734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-82e92aa5-e683-49db-8018-c47b2949f3c7 req-940cce4a-4d17-48a8-8a17-03738f2e61ad service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:05.806240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-82e92aa5-e683-49db-8018-c47b2949f3c7 req-940cce4a-4d17-48a8-8a17-03738f2e61ad service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:05.810942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-82e92aa5-e683-49db-8018-c47b2949f3c7 req-940cce4a-4d17-48a8-8a17-03738f2e61ad service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:05.877626 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-82e92aa5-e683-49db-8018-c47b2949f3c7 req-940cce4a-4d17-48a8-8a17-03738f2e61ad service nova] Creating event network-vif-plugged:930eb105-32c0-40a2-a18f-960c696dabb1 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:17:05.879196 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-82e92aa5-e683-49db-8018-c47b2949f3c7 req-940cce4a-4d17-48a8-8a17-03738f2e61ad service nova] Creating event network-vif-plugged:22ff15ff-92e5-4daa-abf0-a7696778e3f7 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:17:05.884872 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-82e92aa5-e683-49db-8018-c47b2949f3c7 req-940cce4a-4d17-48a8-8a17-03738f2e61ad service nova] Creating event network-vif-plugged:1f07717a-ae91-4c44-8b27-921e82e3c064 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:17:05.906576 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-82e92aa5-e683-49db-8018-c47b2949f3c7 req-940cce4a-4d17-48a8-8a17-03738f2e61ad service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.145028 Oct 27 19:17:05.908502 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2813/5779] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:05.994718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1c9623c0-3c08-4c73-bb11-2e9e3920d8ef tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:05.996019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1c9623c0-3c08-4c73-bb11-2e9e3920d8ef tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:06.007087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c9623c0-3c08-4c73-bb11-2e9e3920d8ef tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:06.010260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c9623c0-3c08-4c73-bb11-2e9e3920d8ef tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:06.010965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c9623c0-3c08-4c73-bb11-2e9e3920d8ef tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:06.011916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c9623c0-3c08-4c73-bb11-2e9e3920d8ef tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:06.013151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c9623c0-3c08-4c73-bb11-2e9e3920d8ef tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:06.014729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c9623c0-3c08-4c73-bb11-2e9e3920d8ef tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:06.403807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fcbdd042-d39b-4d92-b667-631c40be216b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:06.404672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fcbdd042-d39b-4d92-b667-631c40be216b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:06.422765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcbdd042-d39b-4d92-b667-631c40be216b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:06.423707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcbdd042-d39b-4d92-b667-631c40be216b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:06.424374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcbdd042-d39b-4d92-b667-631c40be216b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:06.425888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcbdd042-d39b-4d92-b667-631c40be216b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:06.427306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcbdd042-d39b-4d92-b667-631c40be216b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:06.428820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcbdd042-d39b-4d92-b667-631c40be216b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:06.547567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fcbdd042-d39b-4d92-b667-631c40be216b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:06.556921 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fcbdd042-d39b-4d92-b667-631c40be216b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1608 microversion: 2.1 time: 0.162718 Oct 27 19:17:06.565944 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2814/5780] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:06 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1608 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:17:06.572557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1c9623c0-3c08-4c73-bb11-2e9e3920d8ef tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:06.592178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1c9623c0-3c08-4c73-bb11-2e9e3920d8ef tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:06.593530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1c9623c0-3c08-4c73-bb11-2e9e3920d8ef tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:06.595440 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1c9623c0-3c08-4c73-bb11-2e9e3920d8ef tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.606956 Oct 27 19:17:06.606299 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2967/5781] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:17:05 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:17:07.530161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-1e9ff49a-818c-417c-9416-387993b649f9 req-ca3e940d-2e04-4ee3-87a6-db8254b259a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c", "name": "network-vif-deleted", "tag": "80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:07.559136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1e9ff49a-818c-417c-9416-387993b649f9 req-ca3e940d-2e04-4ee3-87a6-db8254b259a7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:07.559866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1e9ff49a-818c-417c-9416-387993b649f9 req-ca3e940d-2e04-4ee3-87a6-db8254b259a7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:07.564542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1e9ff49a-818c-417c-9416-387993b649f9 req-ca3e940d-2e04-4ee3-87a6-db8254b259a7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:07.585015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42986a35-3e44-48f5-b864-a4664bd79b7e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:07.586662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-42986a35-3e44-48f5-b864-a4664bd79b7e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:07.622118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42986a35-3e44-48f5-b864-a4664bd79b7e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:07.622969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42986a35-3e44-48f5-b864-a4664bd79b7e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:07.623592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42986a35-3e44-48f5-b864-a4664bd79b7e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:07.627155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42986a35-3e44-48f5-b864-a4664bd79b7e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:07.628516 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-1e9ff49a-818c-417c-9416-387993b649f9 req-ca3e940d-2e04-4ee3-87a6-db8254b259a7 service nova] Creating event network-vif-deleted:80dc05d4-2cc5-43d5-b6a7-0d39ce24cbf4 for instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c on n-h1-860687-3 Oct 27 19:17:07.629231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42986a35-3e44-48f5-b864-a4664bd79b7e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:07.630055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42986a35-3e44-48f5-b864-a4664bd79b7e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:07.649323 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-1e9ff49a-818c-417c-9416-387993b649f9 req-ca3e940d-2e04-4ee3-87a6-db8254b259a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123530 Oct 27 19:17:07.655481 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2815/5782] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:07.687108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-943218a5-c140-4769-adf3-c0e2e8a81fdc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:07.689432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-943218a5-c140-4769-adf3-c0e2e8a81fdc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:07.704530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-943218a5-c140-4769-adf3-c0e2e8a81fdc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:07.718147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-943218a5-c140-4769-adf3-c0e2e8a81fdc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:07.718600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-943218a5-c140-4769-adf3-c0e2e8a81fdc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:07.721724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-943218a5-c140-4769-adf3-c0e2e8a81fdc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:07.723766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-943218a5-c140-4769-adf3-c0e2e8a81fdc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:07.726536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-943218a5-c140-4769-adf3-c0e2e8a81fdc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:07.891495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-42986a35-3e44-48f5-b864-a4664bd79b7e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7019e4c367c0470f95bc66e32def747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c27f02ea6549bea54242ab81741f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:07.904681 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-42986a35-3e44-48f5-b864-a4664bd79b7e tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 200 len: 1324 microversion: 2.1 time: 0.321329 Oct 27 19:17:07.905810 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2968/5783] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:07 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 1324 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:17:08.334590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-943218a5-c140-4769-adf3-c0e2e8a81fdc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:08.367492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-943218a5-c140-4769-adf3-c0e2e8a81fdc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:08.379874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-943218a5-c140-4769-adf3-c0e2e8a81fdc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:08.387211 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-943218a5-c140-4769-adf3-c0e2e8a81fdc tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1873 microversion: 2.32 time: 0.713064 Oct 27 19:17:08.389714 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2816/5784] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:17:07 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1873 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:17:08.931056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-07f2531d-8fc5-4552-a839-369689e4ec9b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:08.932696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-07f2531d-8fc5-4552-a839-369689e4ec9b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] [instance: eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:08.941606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07f2531d-8fc5-4552-a839-369689e4ec9b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:08.942412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07f2531d-8fc5-4552-a839-369689e4ec9b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:08.943110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07f2531d-8fc5-4552-a839-369689e4ec9b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:08.944158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07f2531d-8fc5-4552-a839-369689e4ec9b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:08.945242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07f2531d-8fc5-4552-a839-369689e4ec9b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:08.945977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07f2531d-8fc5-4552-a839-369689e4ec9b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:08.964494 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-07f2531d-8fc5-4552-a839-369689e4ec9b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] HTTP exception thrown: Instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c could not be found. Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-07f2531d-8fc5-4552-a839-369689e4ec9b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Request method failure captured: Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c HTTP/1.1 Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtcMgvpB1r3CMhn3lqnafdbRH_q7_2MwBC9YYeuhDoLvj0r3BLn_zRO4y1vPk2UIxFleNSJ40ezxJxF7WpMwNGUDmR2F9Ph7WCoWzLLJSCrOKdUX4jwbabAijBxwiCPW-h7IKMrha35ir4gu1w9PRD3wLqnVKXaKh6jwWiWGTSN6X8g Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 79c27f02ea6549bea54242ab81741f97 Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_79c27f02ea6549bea54242ab81741f97", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79c27f02ea6549bea54242ab81741f97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 79c27f02ea6549bea54242ab81741f97 Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerActionsTestJSON-1587791858 Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerActionsTestJSON-1587791858-project Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 7019e4c367c0470f95bc66e32def747a Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerActionsTestJSON-1587791858-project Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c could not be found. Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c'} Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c could not be found. Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c could not be found. Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:17:08.966412 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:08.972657 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:17:08.972657 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:17:08.972657 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:17:08.972657 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:17:08.972657 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:17:08.972657 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c could not be found. Oct 27 19:17:08.972657 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:08.975696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-07f2531d-8fc5-4552-a839-369689e4ec9b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Returning 404 to user: Instance eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:17:08.977170 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-07f2531d-8fc5-4552-a839-369689e4ec9b tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c" status: 404 len: 111 microversion: 2.1 time: 0.052655 Oct 27 19:17:08.981954 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2969/5785] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:08 2022] GET /compute/v2.1/servers/eecc3cb1-ff29-40ef-97fc-ec7cd4632c1c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:17:08.993231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4f1e4d41-5bbc-4879-85fe-a5faae5b57d3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] Calling method '.version_select at 0x7fc86ae38310>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:09.054682 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4f1e4d41-5bbc-4879-85fe-a5faae5b57d3 tempest-ServerActionsTestJSON-1587791858 tempest-ServerActionsTestJSON-1587791858-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1261240092" status: 202 len: 0 microversion: 2.1 time: 0.071471 Oct 27 19:17:09.055402 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2817/5786] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 19:17:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1261240092 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:17:09.424586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0945b39a-5413-44f3-b2f7-84582d8b356b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:09.425627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0945b39a-5413-44f3-b2f7-84582d8b356b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:09.439344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0945b39a-5413-44f3-b2f7-84582d8b356b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:09.441384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0945b39a-5413-44f3-b2f7-84582d8b356b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:09.442658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0945b39a-5413-44f3-b2f7-84582d8b356b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:09.445597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0945b39a-5413-44f3-b2f7-84582d8b356b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:09.448190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0945b39a-5413-44f3-b2f7-84582d8b356b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:09.448905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0945b39a-5413-44f3-b2f7-84582d8b356b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:10.012708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0945b39a-5413-44f3-b2f7-84582d8b356b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:10.031293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0945b39a-5413-44f3-b2f7-84582d8b356b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:10.033989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0945b39a-5413-44f3-b2f7-84582d8b356b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:10.040620 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0945b39a-5413-44f3-b2f7-84582d8b356b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 2826 microversion: 2.32 time: 0.624746 Oct 27 19:17:10.042782 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2970/5787] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:17:09 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 2826 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:17:10.070801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ecea142b-f26e-4c63-9d30-db6708e472a4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:10.071808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ecea142b-f26e-4c63-9d30-db6708e472a4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:10.094413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecea142b-f26e-4c63-9d30-db6708e472a4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:10.095055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecea142b-f26e-4c63-9d30-db6708e472a4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:10.095504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecea142b-f26e-4c63-9d30-db6708e472a4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:10.096230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecea142b-f26e-4c63-9d30-db6708e472a4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:10.096688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecea142b-f26e-4c63-9d30-db6708e472a4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:10.097120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecea142b-f26e-4c63-9d30-db6708e472a4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:10.140631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:17:10.416159 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ecea142b-f26e-4c63-9d30-db6708e472a4 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.349922 Oct 27 19:17:10.417214 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2818/5788] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Oct 27 19:17:10 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927/os-interface => generated 1831 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:17:14.291252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-1380b3b5-f8e5-404d-82f7-6767a9e78063 req-cf2db9e7-2d6b-4bfa-9f6d-b3fe5fd80b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "tag": "930eb105-32c0-40a2-a18f-960c696dabb1"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:14.326498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1380b3b5-f8e5-404d-82f7-6767a9e78063 req-cf2db9e7-2d6b-4bfa-9f6d-b3fe5fd80b3c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:14.327406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1380b3b5-f8e5-404d-82f7-6767a9e78063 req-cf2db9e7-2d6b-4bfa-9f6d-b3fe5fd80b3c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:14.329265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1380b3b5-f8e5-404d-82f7-6767a9e78063 req-cf2db9e7-2d6b-4bfa-9f6d-b3fe5fd80b3c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:14.365064 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-1380b3b5-f8e5-404d-82f7-6767a9e78063 req-cf2db9e7-2d6b-4bfa-9f6d-b3fe5fd80b3c service nova] Creating event network-changed:930eb105-32c0-40a2-a18f-960c696dabb1 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:17:14.373098 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-1380b3b5-f8e5-404d-82f7-6767a9e78063 req-cf2db9e7-2d6b-4bfa-9f6d-b3fe5fd80b3c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.763933 Oct 27 19:17:14.374361 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2971/5789] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:20.366670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ca77b0e-7505-4daa-92eb-b20b350e5e80 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:20.368207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ca77b0e-7505-4daa-92eb-b20b350e5e80 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:20.374368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:17:20.378759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:17:20.386032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ca77b0e-7505-4daa-92eb-b20b350e5e80 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:20.386709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ca77b0e-7505-4daa-92eb-b20b350e5e80 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:20.387400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ca77b0e-7505-4daa-92eb-b20b350e5e80 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:20.387933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ca77b0e-7505-4daa-92eb-b20b350e5e80 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:20.388410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ca77b0e-7505-4daa-92eb-b20b350e5e80 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:20.388949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ca77b0e-7505-4daa-92eb-b20b350e5e80 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:20.744118 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ca77b0e-7505-4daa-92eb-b20b350e5e80 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1832 microversion: 2.1 time: 0.380956 Oct 27 19:17:20.744836 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2819/5790] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:20 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1832 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:23.162314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-942e366e-101b-4353-8694-dba806b71e26 req-c879ccf6-1ff5-48fa-aae8-fbf8e6acb21c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1263b108-e237-4eee-88af-6e2fda4ed792", "tag": "e01e3433-ca7f-4e03-9286-deabd11d6744"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:23.163733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-233a7518-37cc-413d-85a7-05336fdc374c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:23.164558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-233a7518-37cc-413d-85a7-05336fdc374c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:23.167891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=49 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:17:23.196017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-942e366e-101b-4353-8694-dba806b71e26 req-c879ccf6-1ff5-48fa-aae8-fbf8e6acb21c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:23.196587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-942e366e-101b-4353-8694-dba806b71e26 req-c879ccf6-1ff5-48fa-aae8-fbf8e6acb21c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:23.197034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-942e366e-101b-4353-8694-dba806b71e26 req-c879ccf6-1ff5-48fa-aae8-fbf8e6acb21c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:23.199874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-233a7518-37cc-413d-85a7-05336fdc374c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:23.200385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-233a7518-37cc-413d-85a7-05336fdc374c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:23.200833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-233a7518-37cc-413d-85a7-05336fdc374c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:23.208199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-233a7518-37cc-413d-85a7-05336fdc374c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:23.210661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-233a7518-37cc-413d-85a7-05336fdc374c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:23.211761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-233a7518-37cc-413d-85a7-05336fdc374c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:23.224446 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-942e366e-101b-4353-8694-dba806b71e26 req-c879ccf6-1ff5-48fa-aae8-fbf8e6acb21c service nova] Creating event network-changed:e01e3433-ca7f-4e03-9286-deabd11d6744 for instance 1263b108-e237-4eee-88af-6e2fda4ed792 on n-h2-860687-3 Oct 27 19:17:23.249361 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-942e366e-101b-4353-8694-dba806b71e26 req-c879ccf6-1ff5-48fa-aae8-fbf8e6acb21c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090607 Oct 27 19:17:23.255279 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2820/5791] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:17:23.361063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-233a7518-37cc-413d-85a7-05336fdc374c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:17:23.615299 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-233a7518-37cc-413d-85a7-05336fdc374c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 204 len: 0 microversion: 2.1 time: 0.461021 Oct 27 19:17:23.615908 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2972/5792] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:17:23 2022] DELETE /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:17:23.626863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f4c51b8d-c7f0-47d1-a0e4-6c1544bd300d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:23.627693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f4c51b8d-c7f0-47d1-a0e4-6c1544bd300d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:23.643575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4c51b8d-c7f0-47d1-a0e4-6c1544bd300d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:23.647461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4c51b8d-c7f0-47d1-a0e4-6c1544bd300d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:23.649179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4c51b8d-c7f0-47d1-a0e4-6c1544bd300d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:23.650915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4c51b8d-c7f0-47d1-a0e4-6c1544bd300d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:23.656586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4c51b8d-c7f0-47d1-a0e4-6c1544bd300d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:23.657314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4c51b8d-c7f0-47d1-a0e4-6c1544bd300d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:24.181941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f4c51b8d-c7f0-47d1-a0e4-6c1544bd300d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:24.195538 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f4c51b8d-c7f0-47d1-a0e4-6c1544bd300d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1687 microversion: 2.1 time: 0.573675 Oct 27 19:17:24.199498 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2821/5793] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:23 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1687 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:25.228510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6df0fa7-a8c6-43c1-a234-d1958d93ba66 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:25.229236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d6df0fa7-a8c6-43c1-a234-d1958d93ba66 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:25.245902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6df0fa7-a8c6-43c1-a234-d1958d93ba66 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:25.246976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6df0fa7-a8c6-43c1-a234-d1958d93ba66 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:25.249702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6df0fa7-a8c6-43c1-a234-d1958d93ba66 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:25.250824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6df0fa7-a8c6-43c1-a234-d1958d93ba66 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:25.253056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6df0fa7-a8c6-43c1-a234-d1958d93ba66 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:25.254454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6df0fa7-a8c6-43c1-a234-d1958d93ba66 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:25.302235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:17:25.900583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d6df0fa7-a8c6-43c1-a234-d1958d93ba66 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:25.914900 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d6df0fa7-a8c6-43c1-a234-d1958d93ba66 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1687 microversion: 2.1 time: 0.692424 Oct 27 19:17:25.920308 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2973/5794] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:25 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1687 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:26.946905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f6fe702c-075a-4671-9e7e-3d18c1bde08a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:26.948562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f6fe702c-075a-4671-9e7e-3d18c1bde08a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:26.978586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6fe702c-075a-4671-9e7e-3d18c1bde08a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:26.979195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6fe702c-075a-4671-9e7e-3d18c1bde08a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:26.979661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6fe702c-075a-4671-9e7e-3d18c1bde08a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:26.984459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6fe702c-075a-4671-9e7e-3d18c1bde08a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:26.986956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6fe702c-075a-4671-9e7e-3d18c1bde08a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:26.987427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6fe702c-075a-4671-9e7e-3d18c1bde08a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:27.489643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6fe702c-075a-4671-9e7e-3d18c1bde08a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:27.507407 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f6fe702c-075a-4671-9e7e-3d18c1bde08a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1620 microversion: 2.1 time: 0.562855 Oct 27 19:17:27.509093 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2822/5795] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:26 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1620 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:27.737092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-16ac125d-9e71-4c72-8ea6-0708ac6c4824 req-e2f79704-3200-46ad-8dac-a53f20eaea13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1263b108-e237-4eee-88af-6e2fda4ed792", "name": "network-vif-deleted", "tag": "e01e3433-ca7f-4e03-9286-deabd11d6744"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:27.778412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-16ac125d-9e71-4c72-8ea6-0708ac6c4824 req-e2f79704-3200-46ad-8dac-a53f20eaea13 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:27.779915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-16ac125d-9e71-4c72-8ea6-0708ac6c4824 req-e2f79704-3200-46ad-8dac-a53f20eaea13 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:27.781911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-16ac125d-9e71-4c72-8ea6-0708ac6c4824 req-e2f79704-3200-46ad-8dac-a53f20eaea13 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:27.821319 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-16ac125d-9e71-4c72-8ea6-0708ac6c4824 req-e2f79704-3200-46ad-8dac-a53f20eaea13 service nova] Creating event network-vif-deleted:e01e3433-ca7f-4e03-9286-deabd11d6744 for instance 1263b108-e237-4eee-88af-6e2fda4ed792 on n-h2-860687-3 Oct 27 19:17:27.844968 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-16ac125d-9e71-4c72-8ea6-0708ac6c4824 req-e2f79704-3200-46ad-8dac-a53f20eaea13 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113012 Oct 27 19:17:27.845487 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2974/5796] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:17:28.539745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-24d4cdd9-bc9a-407b-88ae-5c09bfc2cf84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:28.543550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-24d4cdd9-bc9a-407b-88ae-5c09bfc2cf84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:28.571164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d4cdd9-bc9a-407b-88ae-5c09bfc2cf84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:28.572915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d4cdd9-bc9a-407b-88ae-5c09bfc2cf84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:28.573404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d4cdd9-bc9a-407b-88ae-5c09bfc2cf84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:28.577302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d4cdd9-bc9a-407b-88ae-5c09bfc2cf84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:28.588081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d4cdd9-bc9a-407b-88ae-5c09bfc2cf84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:28.588612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d4cdd9-bc9a-407b-88ae-5c09bfc2cf84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:28.630451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d4cdd9-bc9a-407b-88ae-5c09bfc2cf84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:28.631168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d4cdd9-bc9a-407b-88ae-5c09bfc2cf84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:28.633579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d4cdd9-bc9a-407b-88ae-5c09bfc2cf84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:28.634365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-24d4cdd9-bc9a-407b-88ae-5c09bfc2cf84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lazy-loading 'fault' on Instance uuid 1263b108-e237-4eee-88af-6e2fda4ed792 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:17:28.783255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-24d4cdd9-bc9a-407b-88ae-5c09bfc2cf84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:28.817301 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-24d4cdd9-bc9a-407b-88ae-5c09bfc2cf84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 200 len: 1356 microversion: 2.1 time: 0.281734 Oct 27 19:17:28.817968 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2823/5797] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:28 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 1356 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:29.852558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-00bc600a-d851-41ea-8b58-3ed09e6cb0c1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:29.853331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-00bc600a-d851-41ea-8b58-3ed09e6cb0c1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 1263b108-e237-4eee-88af-6e2fda4ed792] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:29.885736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00bc600a-d851-41ea-8b58-3ed09e6cb0c1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:29.891183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00bc600a-d851-41ea-8b58-3ed09e6cb0c1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:29.892031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00bc600a-d851-41ea-8b58-3ed09e6cb0c1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:29.892815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00bc600a-d851-41ea-8b58-3ed09e6cb0c1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:29.893297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00bc600a-d851-41ea-8b58-3ed09e6cb0c1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:29.904387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00bc600a-d851-41ea-8b58-3ed09e6cb0c1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:29.954806 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-00bc600a-d851-41ea-8b58-3ed09e6cb0c1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] HTTP exception thrown: Instance 1263b108-e237-4eee-88af-6e2fda4ed792 could not be found. Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-00bc600a-d851-41ea-8b58-3ed09e6cb0c1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Request method failure captured: Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 HTTP/1.1 Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWth-uE-L5hrFUr9RYtFBa20-n3WoCw93LoQ3rmxc3wuGw2wOUyFGeVumHG6CitxW2BQ_gI4upL36DmkN08Y2Y2Dzqu0geZsGjCkVWRBeHN3me4ZMtxNaaWwrBfsY64smWMRc2jLIbCc3BUZOyHtIp4Z7RZX-687YOz7etGENRciRsd4 Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 853ac0c6e395469bb90c156aad129c26 Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-969980032 Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/853ac0c6e395469bb90c156aad129c26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/853ac0c6e395469bb90c156aad129c26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_853ac0c6e395469bb90c156aad129c26", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/853ac0c6e395469bb90c156aad129c26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestNetworkAdvancedServerOps-969980032 Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 853ac0c6e395469bb90c156aad129c26 Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-969980032 Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestNetworkAdvancedServerOps-969980032-project Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ce7f16b54dda477386daed20f1a2e104 Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestNetworkAdvancedServerOps-969980032-project Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 1263b108-e237-4eee-88af-6e2fda4ed792 could not be found. Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '1263b108-e237-4eee-88af-6e2fda4ed792'} Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1263b108-e237-4eee-88af-6e2fda4ed792 could not be found. Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1263b108-e237-4eee-88af-6e2fda4ed792 could not be found. Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:29.997232 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:17:30.003195 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:30.003195 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:17:30.003195 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:17:30.003195 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:17:30.003195 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:17:30.003195 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:17:30.003195 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1263b108-e237-4eee-88af-6e2fda4ed792 could not be found. Oct 27 19:17:30.003195 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:17:30.003195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-00bc600a-d851-41ea-8b58-3ed09e6cb0c1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Returning 404 to user: Instance 1263b108-e237-4eee-88af-6e2fda4ed792 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:17:30.003195 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-00bc600a-d851-41ea-8b58-3ed09e6cb0c1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792" status: 404 len: 111 microversion: 2.1 time: 0.154451 Oct 27 19:17:30.006474 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2975/5798] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:29 2022] GET /compute/v2.1/servers/1263b108-e237-4eee-88af-6e2fda4ed792 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:17:35.482009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eeb3602d-f05d-4025-a709-ff08db4233e4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Action: 'create', calling method: .version_select at 0x7fc869975e50>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1949990239", "policies": ["affinity"]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:35.549730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-eeb3602d-f05d-4025-a709-ff08db4233e4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:35.575480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-eeb3602d-f05d-4025-a709-ff08db4233e4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for user 28aeedbc41084478840a48d05c9fdceb and project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:35.703805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-eeb3602d-f05d-4025-a709-ff08db4233e4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:35.720043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-eeb3602d-f05d-4025-a709-ff08db4233e4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for user 28aeedbc41084478840a48d05c9fdceb and project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:35.795770 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eeb3602d-f05d-4025-a709-ff08db4233e4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.993657 Oct 27 19:17:35.802462 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2824/5799] 10.222.0.42 () {60 vars in 1174 bytes} [Thu Oct 27 19:17:34 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:35.808681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fb1de0f9-387d-4a8e-848f-d365a341fd9b tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Action: 'create', calling method: .version_select at 0x7fc86ab5c550>, body: {"server_group": {"name": "tempest-server-group-894514678", "policies": ["affinity"]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:35.898748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-fb1de0f9-387d-4a8e-848f-d365a341fd9b tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:35.935206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-fb1de0f9-387d-4a8e-848f-d365a341fd9b tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for user 28aeedbc41084478840a48d05c9fdceb and project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:36.083134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-fb1de0f9-387d-4a8e-848f-d365a341fd9b tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:36.092256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-fb1de0f9-387d-4a8e-848f-d365a341fd9b tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for user 28aeedbc41084478840a48d05c9fdceb and project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:36.125063 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fb1de0f9-387d-4a8e-848f-d365a341fd9b tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.321178 Oct 27 19:17:36.130543 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2976/5800] 10.222.0.42 () {60 vars in 1173 bytes} [Thu Oct 27 19:17:35 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:17:36.145927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8d8ad39b-8581-478c-9561-d0845fa79950 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Action: 'create', calling method: .version_select at 0x7fc8699758b0>, body: {"server_group": {"name": "tempest-server-group-894514678", "policies": ["affinity"]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:36.183716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-8d8ad39b-8581-478c-9561-d0845fa79950 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:36.192873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-8d8ad39b-8581-478c-9561-d0845fa79950 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for user 28aeedbc41084478840a48d05c9fdceb and project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:36.329320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-8d8ad39b-8581-478c-9561-d0845fa79950 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:36.346914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-8d8ad39b-8581-478c-9561-d0845fa79950 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for user 28aeedbc41084478840a48d05c9fdceb and project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:36.386855 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8d8ad39b-8581-478c-9561-d0845fa79950 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.248112 Oct 27 19:17:36.389620 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2825/5801] 10.222.0.42 () {60 vars in 1173 bytes} [Thu Oct 27 19:17:36 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:36.405328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b503b6c0-e78d-40c2-81a5-2e582351e144 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:36.455336 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b503b6c0-e78d-40c2-81a5-2e582351e144 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/b9f66c62-084c-4ce1-a30c-5550deb99ac6" status: 204 len: 0 microversion: 2.1 time: 0.058959 Oct 27 19:17:36.458524 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2977/5802] 10.222.0.42 () {58 vars in 1266 bytes} [Thu Oct 27 19:17:36 2022] DELETE /compute/v2.1/os-server-groups/b9f66c62-084c-4ce1-a30c-5550deb99ac6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:17:36.473910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0b8237cb-f017-47d2-bb63-cc7c6278afc5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:36.502778 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0b8237cb-f017-47d2-bb63-cc7c6278afc5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.039202 Oct 27 19:17:36.504957 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2826/5803] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 19:17:36 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:36.526733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e1026cad-9699-4138-853c-54cb63ca5680 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:36.564462 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e1026cad-9699-4138-853c-54cb63ca5680 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/11dc6f79-7a1c-444c-915b-97dd169b696f" status: 204 len: 0 microversion: 2.1 time: 0.051932 Oct 27 19:17:36.568493 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2978/5804] 10.222.0.42 () {58 vars in 1266 bytes} [Thu Oct 27 19:17:36 2022] DELETE /compute/v2.1/os-server-groups/11dc6f79-7a1c-444c-915b-97dd169b696f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:17:36.589130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3c88cf0a-9771-4970-b86b-d94aabf535c2 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:36.602024 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3c88cf0a-9771-4970-b86b-d94aabf535c2 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.031613 Oct 27 19:17:36.609760 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2827/5805] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 19:17:36 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:36.617383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e0a81774-dac1-4e86-a22f-54bf11f64ae3 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Action: 'create', calling method: .version_select at 0x7fc869e2ee50>, body: {"server_group": {"name": "tempest-server-group-1829541755", "policies": ["affinity"]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:36.648598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-e0a81774-dac1-4e86-a22f-54bf11f64ae3 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:36.680920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-e0a81774-dac1-4e86-a22f-54bf11f64ae3 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for user 28aeedbc41084478840a48d05c9fdceb and project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:36.847831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-e0a81774-dac1-4e86-a22f-54bf11f64ae3 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:36.866464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-e0a81774-dac1-4e86-a22f-54bf11f64ae3 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for user 28aeedbc41084478840a48d05c9fdceb and project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:36.901809 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e0a81774-dac1-4e86-a22f-54bf11f64ae3 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.288765 Oct 27 19:17:36.915148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-08972532-c4d5-4113-9ef4-6bdc99237d4f tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:36.920010 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2979/5806] 10.222.0.42 () {60 vars in 1173 bytes} [Thu Oct 27 19:17:36 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:37.003727 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-08972532-c4d5-4113-9ef4-6bdc99237d4f tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/29222fb1-3d1f-46d7-b769-c375d31bcba4" status: 204 len: 0 microversion: 2.1 time: 0.091823 Oct 27 19:17:37.017910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ea0a4c60-0ca4-4986-bdae-d091e430f47f tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:37.024507 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2828/5807] 10.222.0.42 () {58 vars in 1266 bytes} [Thu Oct 27 19:17:36 2022] DELETE /compute/v2.1/os-server-groups/29222fb1-3d1f-46d7-b769-c375d31bcba4 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:17:37.034087 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ea0a4c60-0ca4-4986-bdae-d091e430f47f tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.022982 Oct 27 19:17:37.050586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-146b4233-0c36-4e70-9921-ba597afe0d1a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Action: 'create', calling method: .version_select at 0x7fc86ae02dc0>, body: {"server_group": {"name": "tempest-server-group-1210711144", "policies": ["anti-affinity"]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:37.054643 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2980/5808] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 19:17:37 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:37.074311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-146b4233-0c36-4e70-9921-ba597afe0d1a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:37.081090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-146b4233-0c36-4e70-9921-ba597afe0d1a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for user 28aeedbc41084478840a48d05c9fdceb and project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:37.176252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-146b4233-0c36-4e70-9921-ba597afe0d1a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:37.193123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:17:37.197758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-146b4233-0c36-4e70-9921-ba597afe0d1a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for user 28aeedbc41084478840a48d05c9fdceb and project 92306d31919643638bffed62403c1036. Resources: {'server_groups'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:37.251457 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-146b4233-0c36-4e70-9921-ba597afe0d1a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.206211 Oct 27 19:17:37.265262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-43019d15-4f95-44a9-84fd-1c16acd8d242 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:37.273162 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2829/5809] 10.222.0.42 () {60 vars in 1173 bytes} [Thu Oct 27 19:17:37 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:37.325098 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-43019d15-4f95-44a9-84fd-1c16acd8d242 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/63880afc-1c0e-4da1-b560-e8d0b574e2b3" status: 204 len: 0 microversion: 2.1 time: 0.064178 Oct 27 19:17:37.328762 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2981/5810] 10.222.0.42 () {58 vars in 1266 bytes} [Thu Oct 27 19:17:37 2022] DELETE /compute/v2.1/os-server-groups/63880afc-1c0e-4da1-b560-e8d0b574e2b3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:17:37.337778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-353d52d8-4562-4ff7-ba73-314478881438 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:37.372317 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-353d52d8-4562-4ff7-ba73-314478881438 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.038381 Oct 27 19:17:37.392298 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2830/5811] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 19:17:37 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:37.635918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-916954846", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "246df6d2-3fb7-42f3-af79-06db9b28eacf"}]}, "os:scheduler_hints": {"group": "a8f3201d-241e-447d-8790-12f29aca5f0e"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:37.799411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] validate_networks() for [('246df6d2-3fb7-42f3-af79-06db9b28eacf', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:17:39.043251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:17:39.044679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:17:39.044679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:17:39.044904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:17:39.045173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:17:39.077987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:39.078921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:39.079448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:39.080286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:39.082989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:39.091843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:39.119295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:17:39.142089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for project 92306d31919643638bffed62403c1036. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:39.152511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for user 28aeedbc41084478840a48d05c9fdceb and project 92306d31919643638bffed62403c1036. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:39.191003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:17:39.198709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:17:39.313284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for project 92306d31919643638bffed62403c1036. Resources: {'server_group_members'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:39.323283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for user 28aeedbc41084478840a48d05c9fdceb and project 92306d31919643638bffed62403c1036. Resources: {'server_group_members'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:39.443320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for project 92306d31919643638bffed62403c1036. Resources: {'server_group_members'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:39.467567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Getting quotas for user 28aeedbc41084478840a48d05c9fdceb and project 92306d31919643638bffed62403c1036. Resources: {'server_group_members'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:39.546829 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bacbcd0d-d7ab-42e3-9fae-2e10a3d52aaf tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.915545 Oct 27 19:17:39.547502 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2982/5812] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:17:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:17:39.562079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-29c56eab-894e-4bd9-b211-545b55b1d3fc tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:39.563534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-29c56eab-894e-4bd9-b211-545b55b1d3fc tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:39.568142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=28 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:17:39.749331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-29c56eab-894e-4bd9-b211-545b55b1d3fc tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:39.764125 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-29c56eab-894e-4bd9-b211-545b55b1d3fc tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1212 microversion: 2.1 time: 0.206940 Oct 27 19:17:39.767296 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2831/5813] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:39 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1212 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:40.794163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5f0f97ee-b5fc-438d-bbad-12cc4a4e195d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:40.794829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5f0f97ee-b5fc-438d-bbad-12cc4a4e195d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:41.225561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5f0f97ee-b5fc-438d-bbad-12cc4a4e195d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:41.236076 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5f0f97ee-b5fc-438d-bbad-12cc4a4e195d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1212 microversion: 2.1 time: 0.446141 Oct 27 19:17:41.238871 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2983/5814] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:40 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1212 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:17:42.273304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a0ad53b9-144f-4173-87c6-b48502c0b021 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:42.274542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a0ad53b9-144f-4173-87c6-b48502c0b021 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:42.282846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ad53b9-144f-4173-87c6-b48502c0b021 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:42.283893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ad53b9-144f-4173-87c6-b48502c0b021 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:42.284573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ad53b9-144f-4173-87c6-b48502c0b021 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:42.285828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ad53b9-144f-4173-87c6-b48502c0b021 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:42.286704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ad53b9-144f-4173-87c6-b48502c0b021 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:42.287523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0ad53b9-144f-4173-87c6-b48502c0b021 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:42.332172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c474610e-c22b-4822-a1b6-140f4082a8a6 tempest-PortsAdminExtendedAttrsTestJSON-1179982241 tempest-PortsAdminExtendedAttrsTestJSON-1179982241-project-admin] Calling method '.version_select at 0x7fc8699a0ee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:42.335029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c474610e-c22b-4822-a1b6-140f4082a8a6 tempest-PortsAdminExtendedAttrsTestJSON-1179982241 tempest-PortsAdminExtendedAttrsTestJSON-1179982241-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:42.336358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c474610e-c22b-4822-a1b6-140f4082a8a6 tempest-PortsAdminExtendedAttrsTestJSON-1179982241 tempest-PortsAdminExtendedAttrsTestJSON-1179982241-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:42.336995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c474610e-c22b-4822-a1b6-140f4082a8a6 tempest-PortsAdminExtendedAttrsTestJSON-1179982241 tempest-PortsAdminExtendedAttrsTestJSON-1179982241-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:42.388096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c474610e-c22b-4822-a1b6-140f4082a8a6 tempest-PortsAdminExtendedAttrsTestJSON-1179982241 tempest-PortsAdminExtendedAttrsTestJSON-1179982241-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:42.390027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c474610e-c22b-4822-a1b6-140f4082a8a6 tempest-PortsAdminExtendedAttrsTestJSON-1179982241 tempest-PortsAdminExtendedAttrsTestJSON-1179982241-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:42.392412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c474610e-c22b-4822-a1b6-140f4082a8a6 tempest-PortsAdminExtendedAttrsTestJSON-1179982241 tempest-PortsAdminExtendedAttrsTestJSON-1179982241-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:42.428333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c474610e-c22b-4822-a1b6-140f4082a8a6 tempest-PortsAdminExtendedAttrsTestJSON-1179982241 tempest-PortsAdminExtendedAttrsTestJSON-1179982241-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:42.429675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c474610e-c22b-4822-a1b6-140f4082a8a6 tempest-PortsAdminExtendedAttrsTestJSON-1179982241 tempest-PortsAdminExtendedAttrsTestJSON-1179982241-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:42.430651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c474610e-c22b-4822-a1b6-140f4082a8a6 tempest-PortsAdminExtendedAttrsTestJSON-1179982241 tempest-PortsAdminExtendedAttrsTestJSON-1179982241-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:42.442991 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c474610e-c22b-4822-a1b6-140f4082a8a6 tempest-PortsAdminExtendedAttrsTestJSON-1179982241 tempest-PortsAdminExtendedAttrsTestJSON-1179982241-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.674177 Oct 27 19:17:42.444220 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2832/5815] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 19:17:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:42.618240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a0ad53b9-144f-4173-87c6-b48502c0b021 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:42.638950 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a0ad53b9-144f-4173-87c6-b48502c0b021 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1282 microversion: 2.1 time: 0.370373 Oct 27 19:17:42.639574 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2984/5816] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:42 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1282 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:43.082220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0ab96b66-352d-4f42-8a9b-728a68cfa7ca tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '.version_select at 0x7fc86ae025e0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:43.118650 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0ab96b66-352d-4f42-8a9b-728a68cfa7ca tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-663006804" status: 202 len: 0 microversion: 2.1 time: 0.040925 Oct 27 19:17:43.121961 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2833/5817] 10.222.0.42 () {58 vars in 1281 bytes} [Thu Oct 27 19:17:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-663006804 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:17:43.159738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9ca28d34-aca6-486d-8c6d-05a15df15d37 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'create', calling method: .version_select at 0x7fc86aaf7700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1616345280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZwcrp7Hg+KTPbNe5hBHGNvWfPE47Qnfj+lfKrIdIADWoSCT/MUb/jJj5oR+T1loM6j0VqWzBLjlxe3/TkvVlY3t38otvpeDrUKiEudOlphA7uh3xv22TK/y5sD+fMKjQ=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:43.180368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-9ca28d34-aca6-486d-8c6d-05a15df15d37 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for project 853ac0c6e395469bb90c156aad129c26. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:43.188770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-9ca28d34-aca6-486d-8c6d-05a15df15d37 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for user ce7f16b54dda477386daed20f1a2e104 and project 853ac0c6e395469bb90c156aad129c26. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:43.220787 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9ca28d34-aca6-486d-8c6d-05a15df15d37 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.067347 Oct 27 19:17:43.221391 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2985/5818] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:17:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:43.672014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f30c4441-e3b7-430b-bb02-707d4748577a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:43.672773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f30c4441-e3b7-430b-bb02-707d4748577a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:43.683186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f30c4441-e3b7-430b-bb02-707d4748577a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:43.684028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f30c4441-e3b7-430b-bb02-707d4748577a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:43.685034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f30c4441-e3b7-430b-bb02-707d4748577a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:43.686800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f30c4441-e3b7-430b-bb02-707d4748577a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:43.687575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f30c4441-e3b7-430b-bb02-707d4748577a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:43.688165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f30c4441-e3b7-430b-bb02-707d4748577a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:43.950903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f30c4441-e3b7-430b-bb02-707d4748577a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:43.962059 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f30c4441-e3b7-430b-bb02-707d4748577a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1270 microversion: 2.1 time: 0.295870 Oct 27 19:17:43.966790 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2834/5819] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:43 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1270 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:44.988314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2bfe6334-64da-46d6-a13d-ecbd7d8d4cd4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:44.989120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2bfe6334-64da-46d6-a13d-ecbd7d8d4cd4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:45.010488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bfe6334-64da-46d6-a13d-ecbd7d8d4cd4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:45.010715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bfe6334-64da-46d6-a13d-ecbd7d8d4cd4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:45.011131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bfe6334-64da-46d6-a13d-ecbd7d8d4cd4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:45.012610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bfe6334-64da-46d6-a13d-ecbd7d8d4cd4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:45.013546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bfe6334-64da-46d6-a13d-ecbd7d8d4cd4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:45.015008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bfe6334-64da-46d6-a13d-ecbd7d8d4cd4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:45.640296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2bfe6334-64da-46d6-a13d-ecbd7d8d4cd4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:45.650534 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2bfe6334-64da-46d6-a13d-ecbd7d8d4cd4 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1312 microversion: 2.1 time: 0.667166 Oct 27 19:17:45.651862 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2986/5820] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:44 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1312 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:46.679536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b70b34d-e582-4a67-b81e-ad21852de01e tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:46.680259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6b70b34d-e582-4a67-b81e-ad21852de01e tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:46.697147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b70b34d-e582-4a67-b81e-ad21852de01e tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:46.699942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b70b34d-e582-4a67-b81e-ad21852de01e tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:46.700716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b70b34d-e582-4a67-b81e-ad21852de01e tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:46.703300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b70b34d-e582-4a67-b81e-ad21852de01e tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:46.705220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b70b34d-e582-4a67-b81e-ad21852de01e tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:46.707002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b70b34d-e582-4a67-b81e-ad21852de01e tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:47.240565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6b70b34d-e582-4a67-b81e-ad21852de01e tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:47.264825 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b70b34d-e582-4a67-b81e-ad21852de01e tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1312 microversion: 2.1 time: 0.590810 Oct 27 19:17:47.287958 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2835/5821] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:46 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1312 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:48.140183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6f29332a-b9eb-4c45-8124-89fd24ad8f38 req-0ff7a7a8-2719-45e0-ab86-d8bd193c5682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33260ead-2cd8-4102-a73b-bcda48c80f91", "tag": "47f4d4d5-3726-4224-952f-f89aa8533d90"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:48.168416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6f29332a-b9eb-4c45-8124-89fd24ad8f38 req-0ff7a7a8-2719-45e0-ab86-d8bd193c5682 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:48.169061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6f29332a-b9eb-4c45-8124-89fd24ad8f38 req-0ff7a7a8-2719-45e0-ab86-d8bd193c5682 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:48.170407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6f29332a-b9eb-4c45-8124-89fd24ad8f38 req-0ff7a7a8-2719-45e0-ab86-d8bd193c5682 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:48.200715 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6f29332a-b9eb-4c45-8124-89fd24ad8f38 req-0ff7a7a8-2719-45e0-ab86-d8bd193c5682 service nova] Creating event network-changed:47f4d4d5-3726-4224-952f-f89aa8533d90 for instance 33260ead-2cd8-4102-a73b-bcda48c80f91 on n-h1-860687-3 Oct 27 19:17:48.211729 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6f29332a-b9eb-4c45-8124-89fd24ad8f38 req-0ff7a7a8-2719-45e0-ab86-d8bd193c5682 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075426 Oct 27 19:17:48.214196 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2987/5822] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:17:48.295564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f51d1121-8fa4-4d75-af4a-3350fdaf05d2 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:48.297517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f51d1121-8fa4-4d75-af4a-3350fdaf05d2 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:48.311742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f51d1121-8fa4-4d75-af4a-3350fdaf05d2 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:48.313134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f51d1121-8fa4-4d75-af4a-3350fdaf05d2 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:48.314630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f51d1121-8fa4-4d75-af4a-3350fdaf05d2 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:48.316930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f51d1121-8fa4-4d75-af4a-3350fdaf05d2 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:48.320059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f51d1121-8fa4-4d75-af4a-3350fdaf05d2 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:48.322355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f51d1121-8fa4-4d75-af4a-3350fdaf05d2 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:48.918244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f51d1121-8fa4-4d75-af4a-3350fdaf05d2 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:48.940127 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f51d1121-8fa4-4d75-af4a-3350fdaf05d2 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1312 microversion: 2.1 time: 0.644221 Oct 27 19:17:48.943945 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2836/5823] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:48 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1312 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:49.969772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:17:49.975075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-69c3e915-c081-44cd-bac8-df55b37a9dac tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:49.976097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-69c3e915-c081-44cd-bac8-df55b37a9dac tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:49.993157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69c3e915-c081-44cd-bac8-df55b37a9dac tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:49.993662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69c3e915-c081-44cd-bac8-df55b37a9dac tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:49.994108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69c3e915-c081-44cd-bac8-df55b37a9dac tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:49.994885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69c3e915-c081-44cd-bac8-df55b37a9dac tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:49.995457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69c3e915-c081-44cd-bac8-df55b37a9dac tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:49.995828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69c3e915-c081-44cd-bac8-df55b37a9dac tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:50.571742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-69c3e915-c081-44cd-bac8-df55b37a9dac tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:50.595681 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-69c3e915-c081-44cd-bac8-df55b37a9dac tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1312 microversion: 2.1 time: 0.625890 Oct 27 19:17:50.610430 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2988/5824] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:49 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1312 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:51.623665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a6a10034-2d6c-44c5-b15e-b7df74dbb58c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:51.624350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a6a10034-2d6c-44c5-b15e-b7df74dbb58c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:51.627216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=26 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:17:51.646735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6a10034-2d6c-44c5-b15e-b7df74dbb58c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:51.648057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6a10034-2d6c-44c5-b15e-b7df74dbb58c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:51.651170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6a10034-2d6c-44c5-b15e-b7df74dbb58c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:51.656628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6a10034-2d6c-44c5-b15e-b7df74dbb58c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:51.657365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6a10034-2d6c-44c5-b15e-b7df74dbb58c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:51.657829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6a10034-2d6c-44c5-b15e-b7df74dbb58c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:52.132492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a6a10034-2d6c-44c5-b15e-b7df74dbb58c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:52.144919 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a6a10034-2d6c-44c5-b15e-b7df74dbb58c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1312 microversion: 2.1 time: 0.527222 Oct 27 19:17:52.151457 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2837/5825] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:51 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1312 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:53.171790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d65f182f-8811-4cab-8054-bf435514cf24 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:53.173644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d65f182f-8811-4cab-8054-bf435514cf24 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:53.188273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65f182f-8811-4cab-8054-bf435514cf24 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:53.190592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65f182f-8811-4cab-8054-bf435514cf24 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:53.192431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65f182f-8811-4cab-8054-bf435514cf24 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:53.193409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65f182f-8811-4cab-8054-bf435514cf24 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:53.195457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65f182f-8811-4cab-8054-bf435514cf24 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:53.197620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65f182f-8811-4cab-8054-bf435514cf24 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:53.198519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=36 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:17:53.661127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d65f182f-8811-4cab-8054-bf435514cf24 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:53.671955 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d65f182f-8811-4cab-8054-bf435514cf24 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1312 microversion: 2.1 time: 0.506741 Oct 27 19:17:53.677099 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2989/5826] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:53 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1312 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:54.715286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f8d5f27-a140-4d1b-a7c8-6bc03c3afc7a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:54.717016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0f8d5f27-a140-4d1b-a7c8-6bc03c3afc7a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:54.770403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f8d5f27-a140-4d1b-a7c8-6bc03c3afc7a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:54.775905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f8d5f27-a140-4d1b-a7c8-6bc03c3afc7a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:54.785547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f8d5f27-a140-4d1b-a7c8-6bc03c3afc7a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:54.786955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f8d5f27-a140-4d1b-a7c8-6bc03c3afc7a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:54.789543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f8d5f27-a140-4d1b-a7c8-6bc03c3afc7a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:54.791661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f8d5f27-a140-4d1b-a7c8-6bc03c3afc7a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:55.639019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0f8d5f27-a140-4d1b-a7c8-6bc03c3afc7a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:55.649242 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0f8d5f27-a140-4d1b-a7c8-6bc03c3afc7a tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1312 microversion: 2.1 time: 0.955555 Oct 27 19:17:55.652889 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2838/5827] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:54 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1312 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:56.676057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eff72917-54b7-4ae9-a097-dd389053ffaa tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:56.677137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-eff72917-54b7-4ae9-a097-dd389053ffaa tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:56.692527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eff72917-54b7-4ae9-a097-dd389053ffaa tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:56.699932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eff72917-54b7-4ae9-a097-dd389053ffaa tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:56.700395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eff72917-54b7-4ae9-a097-dd389053ffaa tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:56.701184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eff72917-54b7-4ae9-a097-dd389053ffaa tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:56.701663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eff72917-54b7-4ae9-a097-dd389053ffaa tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:56.708606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eff72917-54b7-4ae9-a097-dd389053ffaa tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:56.785471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=35 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:17:57.044240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-7094c0c8-7e76-45ee-873b-985a231a18f9 req-3e211aff-03c8-4540-bfad-e6bed9e6e5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33260ead-2cd8-4102-a73b-bcda48c80f91", "name": "network-vif-plugged", "status": "completed", "tag": "47f4d4d5-3726-4224-952f-f89aa8533d90"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:57.065055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7094c0c8-7e76-45ee-873b-985a231a18f9 req-3e211aff-03c8-4540-bfad-e6bed9e6e5d4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:57.065742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7094c0c8-7e76-45ee-873b-985a231a18f9 req-3e211aff-03c8-4540-bfad-e6bed9e6e5d4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:57.066350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7094c0c8-7e76-45ee-873b-985a231a18f9 req-3e211aff-03c8-4540-bfad-e6bed9e6e5d4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:57.088588 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-7094c0c8-7e76-45ee-873b-985a231a18f9 req-3e211aff-03c8-4540-bfad-e6bed9e6e5d4 service nova] Creating event network-vif-plugged:47f4d4d5-3726-4224-952f-f89aa8533d90 for instance 33260ead-2cd8-4102-a73b-bcda48c80f91 on n-h1-860687-3 Oct 27 19:17:57.095026 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-7094c0c8-7e76-45ee-873b-985a231a18f9 req-3e211aff-03c8-4540-bfad-e6bed9e6e5d4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056263 Oct 27 19:17:57.096227 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2839/5828] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:17:57.792118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-eff72917-54b7-4ae9-a097-dd389053ffaa tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:57.814853 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eff72917-54b7-4ae9-a097-dd389053ffaa tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1312 microversion: 2.1 time: 1.142429 Oct 27 19:17:57.819989 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2990/5829] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:56 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1312 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:17:57.953523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4ada708a-48d0-4943-8923-fc7119a75eff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:57.954322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4ada708a-48d0-4943-8923-fc7119a75eff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:57.973474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ada708a-48d0-4943-8923-fc7119a75eff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:57.973971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ada708a-48d0-4943-8923-fc7119a75eff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:57.976630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ada708a-48d0-4943-8923-fc7119a75eff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:57.977646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ada708a-48d0-4943-8923-fc7119a75eff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:57.980322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ada708a-48d0-4943-8923-fc7119a75eff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:57.983084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ada708a-48d0-4943-8923-fc7119a75eff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:58.182880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1983776037", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "7e6ce986-6ca9-43b8-a0e4-d39059f4c925"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1616345280", "security_groups": [{"name": "tempest-secgroup-smoke-2130770004"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:17:58.564861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] validate_networks() for [('7e6ce986-6ca9-43b8-a0e4-d39059f4c925', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:17:58.610079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4ada708a-48d0-4943-8923-fc7119a75eff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:58.638268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4ada708a-48d0-4943-8923-fc7119a75eff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:58.649205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4ada708a-48d0-4943-8923-fc7119a75eff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:17:58.653780 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4ada708a-48d0-4943-8923-fc7119a75eff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 2944 microversion: 2.32 time: 0.702878 Oct 27 19:17:58.657971 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2840/5830] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:17:57 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 2944 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:17:58.695826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-15e992ff-4b6c-4936-a520-7d1a59573175 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:58.696509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-15e992ff-4b6c-4936-a520-7d1a59573175 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:58.712321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e992ff-4b6c-4936-a520-7d1a59573175 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:58.713164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e992ff-4b6c-4936-a520-7d1a59573175 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:58.714985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e992ff-4b6c-4936-a520-7d1a59573175 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:58.721340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e992ff-4b6c-4936-a520-7d1a59573175 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:58.724053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e992ff-4b6c-4936-a520-7d1a59573175 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:58.724802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15e992ff-4b6c-4936-a520-7d1a59573175 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:59.203768 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-15e992ff-4b6c-4936-a520-7d1a59573175 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.513436 Oct 27 19:17:59.204826 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2841/5831] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Oct 27 19:17:58 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927/os-interface => generated 1831 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:17:59.211606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-44c27caa-875b-4ab6-86b6-160617d4c232 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:59.212511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-44c27caa-875b-4ab6-86b6-160617d4c232 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:17:59.230565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44c27caa-875b-4ab6-86b6-160617d4c232 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:59.233716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44c27caa-875b-4ab6-86b6-160617d4c232 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:59.234318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44c27caa-875b-4ab6-86b6-160617d4c232 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:59.235283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44c27caa-875b-4ab6-86b6-160617d4c232 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:59.243144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44c27caa-875b-4ab6-86b6-160617d4c232 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:59.243850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44c27caa-875b-4ab6-86b6-160617d4c232 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:59.532003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:17:59.533031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:17:59.533688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:17:59.534625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:17:59.535495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:17:59.577649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:59.581074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:59.581811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:59.590511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:17:59.592327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:17:59.592953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:17:59.687375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for project 853ac0c6e395469bb90c156aad129c26. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:17:59.708446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for user ce7f16b54dda477386daed20f1a2e104 and project 853ac0c6e395469bb90c156aad129c26. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:17:59.760937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:17:59.764784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:17:59.875986 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aebe418e-afae-41f1-8e3b-b1ba4a1b13f2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.698051 Oct 27 19:17:59.884729 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2991/5832] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:17:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:17:59.890179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cfde6b83-97ac-43d8-be78-3274ea891209 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:17:59.891112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cfde6b83-97ac-43d8-be78-3274ea891209 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:00.000904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cfde6b83-97ac-43d8-be78-3274ea891209 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:00.014209 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cfde6b83-97ac-43d8-be78-3274ea891209 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1267 microversion: 2.1 time: 0.127854 Oct 27 19:18:00.032288 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2992/5833] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:59 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:00.129108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-44c27caa-875b-4ab6-86b6-160617d4c232 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:00.184643 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-44c27caa-875b-4ab6-86b6-160617d4c232 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1497 microversion: 2.1 time: 0.978513 Oct 27 19:18:00.204139 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2842/5834] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:17:59 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1497 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:00.229214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6562e174-a55b-4e36-b734-85894d1b496c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:00.248674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.compute.server_groups [None req-6562e174-a55b-4e36-b734-85894d1b496c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Querying cell af35862a-071a-430c-affa-82567dc9805c(cell1) for 1 instances {{(pid=127029) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 19:18:00.249680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6562e174-a55b-4e36-b734-85894d1b496c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:00.250462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6562e174-a55b-4e36-b734-85894d1b496c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:00.251381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6562e174-a55b-4e36-b734-85894d1b496c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:00.281604 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6562e174-a55b-4e36-b734-85894d1b496c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/a8f3201d-241e-447d-8790-12f29aca5f0e" status: 200 len: 222 microversion: 2.1 time: 0.057675 Oct 27 19:18:00.286538 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2993/5835] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 19:18:00 2022] GET /compute/v2.1/os-server-groups/a8f3201d-241e-447d-8790-12f29aca5f0e => generated 222 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:18:00.295576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf2f7a69-6aba-4c7a-ab9c-9f0f95dd1be5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:00.296135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cf2f7a69-6aba-4c7a-ab9c-9f0f95dd1be5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:00.311587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf2f7a69-6aba-4c7a-ab9c-9f0f95dd1be5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:00.312116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf2f7a69-6aba-4c7a-ab9c-9f0f95dd1be5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:00.328099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf2f7a69-6aba-4c7a-ab9c-9f0f95dd1be5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:00.329117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf2f7a69-6aba-4c7a-ab9c-9f0f95dd1be5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:00.331896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf2f7a69-6aba-4c7a-ab9c-9f0f95dd1be5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:00.332368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf2f7a69-6aba-4c7a-ab9c-9f0f95dd1be5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:00.415061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cf2f7a69-6aba-4c7a-ab9c-9f0f95dd1be5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:18:00.567654 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cf2f7a69-6aba-4c7a-ab9c-9f0f95dd1be5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "DELETE /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 204 len: 0 microversion: 2.1 time: 0.276003 Oct 27 19:18:00.572241 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2843/5836] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:18:00 2022] DELETE /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:18:00.578447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0b549eac-06a9-493a-a422-9568773907bc tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:00.579711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0b549eac-06a9-493a-a422-9568773907bc tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:00.587564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b549eac-06a9-493a-a422-9568773907bc tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:00.588591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b549eac-06a9-493a-a422-9568773907bc tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:00.589548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b549eac-06a9-493a-a422-9568773907bc tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:00.590702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b549eac-06a9-493a-a422-9568773907bc tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:00.591425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b549eac-06a9-493a-a422-9568773907bc tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:00.592039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b549eac-06a9-493a-a422-9568773907bc tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:00.987302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0b549eac-06a9-493a-a422-9568773907bc tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:01.002811 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0b549eac-06a9-493a-a422-9568773907bc tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1503 microversion: 2.1 time: 0.427047 Oct 27 19:18:01.005304 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2994/5837] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:00 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1503 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:01.044658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d58320aa-2699-41c7-9d1f-38c011e0a1d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:01.045722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d58320aa-2699-41c7-9d1f-38c011e0a1d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:01.070177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d58320aa-2699-41c7-9d1f-38c011e0a1d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:01.071262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d58320aa-2699-41c7-9d1f-38c011e0a1d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:01.072173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d58320aa-2699-41c7-9d1f-38c011e0a1d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:01.074121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d58320aa-2699-41c7-9d1f-38c011e0a1d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:01.078596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d58320aa-2699-41c7-9d1f-38c011e0a1d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:01.079420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d58320aa-2699-41c7-9d1f-38c011e0a1d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:01.405242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d58320aa-2699-41c7-9d1f-38c011e0a1d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:01.419332 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d58320aa-2699-41c7-9d1f-38c011e0a1d2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1263 microversion: 2.1 time: 0.375439 Oct 27 19:18:01.421716 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2844/5838] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:01 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1263 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:02.030825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-41706a85-b64e-4bf0-bbc2-9f513032dc31 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:02.031559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-41706a85-b64e-4bf0-bbc2-9f513032dc31 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:02.050946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41706a85-b64e-4bf0-bbc2-9f513032dc31 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:02.052742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41706a85-b64e-4bf0-bbc2-9f513032dc31 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:02.056748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41706a85-b64e-4bf0-bbc2-9f513032dc31 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:02.057844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41706a85-b64e-4bf0-bbc2-9f513032dc31 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:02.058992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41706a85-b64e-4bf0-bbc2-9f513032dc31 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:02.061001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-41706a85-b64e-4bf0-bbc2-9f513032dc31 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:02.372778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-41706a85-b64e-4bf0-bbc2-9f513032dc31 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:02.389030 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-41706a85-b64e-4bf0-bbc2-9f513032dc31 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1503 microversion: 2.1 time: 0.362262 Oct 27 19:18:02.392906 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2995/5839] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:02 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1503 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:02.448766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6a5bce13-6749-4ceb-911b-d4c012b61c0c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:02.450178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6a5bce13-6749-4ceb-911b-d4c012b61c0c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:02.470807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a5bce13-6749-4ceb-911b-d4c012b61c0c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:02.471583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a5bce13-6749-4ceb-911b-d4c012b61c0c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:02.473929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a5bce13-6749-4ceb-911b-d4c012b61c0c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:02.474937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a5bce13-6749-4ceb-911b-d4c012b61c0c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:02.479025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a5bce13-6749-4ceb-911b-d4c012b61c0c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:02.479736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a5bce13-6749-4ceb-911b-d4c012b61c0c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:02.697244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6a5bce13-6749-4ceb-911b-d4c012b61c0c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:02.713018 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6a5bce13-6749-4ceb-911b-d4c012b61c0c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1325 microversion: 2.1 time: 0.266853 Oct 27 19:18:02.716736 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2845/5840] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:02 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:03.140523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-285eff6d-e7c9-4bdb-8f42-e5b6625c79ed req-a9f29db0-245e-407b-b2dd-070c1a1961fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33260ead-2cd8-4102-a73b-bcda48c80f91", "name": "network-vif-deleted", "tag": "47f4d4d5-3726-4224-952f-f89aa8533d90"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:18:03.194230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-285eff6d-e7c9-4bdb-8f42-e5b6625c79ed req-a9f29db0-245e-407b-b2dd-070c1a1961fd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:03.199136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-285eff6d-e7c9-4bdb-8f42-e5b6625c79ed req-a9f29db0-245e-407b-b2dd-070c1a1961fd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:03.199318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-285eff6d-e7c9-4bdb-8f42-e5b6625c79ed req-a9f29db0-245e-407b-b2dd-070c1a1961fd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:03.234922 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-285eff6d-e7c9-4bdb-8f42-e5b6625c79ed req-a9f29db0-245e-407b-b2dd-070c1a1961fd service nova] Creating event network-vif-deleted:47f4d4d5-3726-4224-952f-f89aa8533d90 for instance 33260ead-2cd8-4102-a73b-bcda48c80f91 on n-h1-860687-3 Oct 27 19:18:03.247689 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-285eff6d-e7c9-4bdb-8f42-e5b6625c79ed req-a9f29db0-245e-407b-b2dd-070c1a1961fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111021 Oct 27 19:18:03.256163 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2996/5841] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:18:03.437767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d2ff756f-edc5-42f5-a689-5ec147ce344d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:03.439659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d2ff756f-edc5-42f5-a689-5ec147ce344d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:03.467595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ff756f-edc5-42f5-a689-5ec147ce344d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:03.468289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ff756f-edc5-42f5-a689-5ec147ce344d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:03.469745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ff756f-edc5-42f5-a689-5ec147ce344d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:03.470810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ff756f-edc5-42f5-a689-5ec147ce344d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:03.474915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ff756f-edc5-42f5-a689-5ec147ce344d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:03.477205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ff756f-edc5-42f5-a689-5ec147ce344d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:03.579950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ff756f-edc5-42f5-a689-5ec147ce344d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:03.583032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ff756f-edc5-42f5-a689-5ec147ce344d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:03.585370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ff756f-edc5-42f5-a689-5ec147ce344d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:03.587569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-d2ff756f-edc5-42f5-a689-5ec147ce344d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lazy-loading 'fault' on Instance uuid 33260ead-2cd8-4102-a73b-bcda48c80f91 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:18:03.747304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-51f84d89-7891-4c9d-bf41-82e9d04b8a9d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:03.748165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-51f84d89-7891-4c9d-bf41-82e9d04b8a9d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:03.766268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51f84d89-7891-4c9d-bf41-82e9d04b8a9d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:03.769986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d2ff756f-edc5-42f5-a689-5ec147ce344d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aeedbc41084478840a48d05c9fdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92306d31919643638bffed62403c1036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:03.781329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51f84d89-7891-4c9d-bf41-82e9d04b8a9d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:03.782143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51f84d89-7891-4c9d-bf41-82e9d04b8a9d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:03.784464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51f84d89-7891-4c9d-bf41-82e9d04b8a9d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:03.785158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51f84d89-7891-4c9d-bf41-82e9d04b8a9d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:03.789954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51f84d89-7891-4c9d-bf41-82e9d04b8a9d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:03.790638 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d2ff756f-edc5-42f5-a689-5ec147ce344d tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 200 len: 1302 microversion: 2.1 time: 0.363015 Oct 27 19:18:03.791269 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2846/5842] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:03 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 1302 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:03.961519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-51f84d89-7891-4c9d-bf41-82e9d04b8a9d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:03.975916 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-51f84d89-7891-4c9d-bf41-82e9d04b8a9d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1325 microversion: 2.1 time: 0.234002 Oct 27 19:18:03.990414 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2997/5843] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:03 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1325 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:18:04.832424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ac3cfa7e-ec83-4e8f-90e2-313256ef627c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:04.833041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ac3cfa7e-ec83-4e8f-90e2-313256ef627c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:04.852834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa7e-ec83-4e8f-90e2-313256ef627c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:04.859035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa7e-ec83-4e8f-90e2-313256ef627c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:04.859734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa7e-ec83-4e8f-90e2-313256ef627c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:04.864021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa7e-ec83-4e8f-90e2-313256ef627c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:04.866580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa7e-ec83-4e8f-90e2-313256ef627c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:04.870163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa7e-ec83-4e8f-90e2-313256ef627c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:04.929671 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-ac3cfa7e-ec83-4e8f-90e2-313256ef627c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] HTTP exception thrown: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ac3cfa7e-ec83-4e8f-90e2-313256ef627c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Request method failure captured: Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 HTTP/1.1 Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtlOmPSeKnhcEul1jmK7IywxVD9ljxfnVOcHm18k-nWdBvNmyUkGtXrv12SdyZi3-x97BOt8Gumeb0V-76g1gFIn8KBI2qy_yxf6oJKRwfv6LmlRqTM2Md4g_jxx_yuSuI5SZUvQkaiMzJ7NVvJRZfCBwTYgfVSBDyi8PUo0jWTegbs Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 92306d31919643638bffed62403c1036 Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92306d31919643638bffed62403c1036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92306d31919643638bffed62403c1036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92306d31919643638bffed62403c1036", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92306d31919643638bffed62403c1036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 92306d31919643638bffed62403c1036 Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerGroupTestJSON-1851639144-project Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 28aeedbc41084478840a48d05c9fdceb Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerGroupTestJSON-1851639144-project Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '33260ead-2cd8-4102-a73b-bcda48c80f91'} Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:04.936654 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:18:04.943662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:04.943662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:04.943662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:04.943662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:18:04.943662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:18:04.943662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:04.943662 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:18:04.943662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ac3cfa7e-ec83-4e8f-90e2-313256ef627c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Returning 404 to user: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:18:04.943662 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ac3cfa7e-ec83-4e8f-90e2-313256ef627c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 404 len: 111 microversion: 2.1 time: 0.109579 Oct 27 19:18:04.955480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-df78e170-eb2e-440e-a957-d785f987ad50 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:04.960173 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2847/5844] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:04 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:18:04.998973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:18:05.003161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.compute.server_groups [None req-df78e170-eb2e-440e-a957-d785f987ad50 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Querying cell af35862a-071a-430c-affa-82567dc9805c(cell1) for 1 instances {{(pid=127029) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 19:18:05.005148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9c625447-e23a-4827-bb0d-43ae843ae313 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:05.005775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9c625447-e23a-4827-bb0d-43ae843ae313 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:05.008118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df78e170-eb2e-440e-a957-d785f987ad50 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:05.010419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df78e170-eb2e-440e-a957-d785f987ad50 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:05.012255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-df78e170-eb2e-440e-a957-d785f987ad50 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:05.020238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c625447-e23a-4827-bb0d-43ae843ae313 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:05.022039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c625447-e23a-4827-bb0d-43ae843ae313 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:05.023506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c625447-e23a-4827-bb0d-43ae843ae313 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:05.024616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c625447-e23a-4827-bb0d-43ae843ae313 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:05.038752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c625447-e23a-4827-bb0d-43ae843ae313 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:05.039826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c625447-e23a-4827-bb0d-43ae843ae313 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:05.053131 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-df78e170-eb2e-440e-a957-d785f987ad50 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.100133 Oct 27 19:18:05.055740 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2998/5845] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 19:18:04 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:18:05.073619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3919609c-bd29-4e10-b2a4-27b0985be7be tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:05.137240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.compute.server_groups [None req-3919609c-bd29-4e10-b2a4-27b0985be7be tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Querying cell af35862a-071a-430c-affa-82567dc9805c(cell1) for 1 instances {{(pid=127029) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 19:18:05.138358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3919609c-bd29-4e10-b2a4-27b0985be7be tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:05.139149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3919609c-bd29-4e10-b2a4-27b0985be7be tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:05.139761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3919609c-bd29-4e10-b2a4-27b0985be7be tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:05.166761 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3919609c-bd29-4e10-b2a4-27b0985be7be tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/a8f3201d-241e-447d-8790-12f29aca5f0e" status: 200 len: 184 microversion: 2.1 time: 0.100824 Oct 27 19:18:05.168017 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 2999/5846] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 19:18:05 2022] GET /compute/v2.1/os-server-groups/a8f3201d-241e-447d-8790-12f29aca5f0e => generated 184 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:18:05.182887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f9fe589a-2ca8-4c1a-95f5-21ddd4026d1c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:05.183611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f9fe589a-2ca8-4c1a-95f5-21ddd4026d1c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:05.200369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9fe589a-2ca8-4c1a-95f5-21ddd4026d1c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:05.201623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9fe589a-2ca8-4c1a-95f5-21ddd4026d1c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:05.202361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9fe589a-2ca8-4c1a-95f5-21ddd4026d1c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:05.204426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9fe589a-2ca8-4c1a-95f5-21ddd4026d1c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:05.207185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9fe589a-2ca8-4c1a-95f5-21ddd4026d1c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:05.207822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9fe589a-2ca8-4c1a-95f5-21ddd4026d1c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:05.247068 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-f9fe589a-2ca8-4c1a-95f5-21ddd4026d1c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] HTTP exception thrown: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f9fe589a-2ca8-4c1a-95f5-21ddd4026d1c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Request method failure captured: Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 HTTP/1.1 Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtlOmPSeKnhcEul1jmK7IywxVD9ljxfnVOcHm18k-nWdBvNmyUkGtXrv12SdyZi3-x97BOt8Gumeb0V-76g1gFIn8KBI2qy_yxf6oJKRwfv6LmlRqTM2Md4g_jxx_yuSuI5SZUvQkaiMzJ7NVvJRZfCBwTYgfVSBDyi8PUo0jWTegbs Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 92306d31919643638bffed62403c1036 Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92306d31919643638bffed62403c1036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92306d31919643638bffed62403c1036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92306d31919643638bffed62403c1036", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92306d31919643638bffed62403c1036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 92306d31919643638bffed62403c1036 Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerGroupTestJSON-1851639144-project Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 28aeedbc41084478840a48d05c9fdceb Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerGroupTestJSON-1851639144-project Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '33260ead-2cd8-4102-a73b-bcda48c80f91'} Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:18:05.250363 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:18:05.255717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:05.255717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.255717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:05.255717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.255717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.255717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:05.255717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:05.255717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:18:05.255717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:18:05.255717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:05.255717 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.255717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f9fe589a-2ca8-4c1a-95f5-21ddd4026d1c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Returning 404 to user: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:18:05.255717 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f9fe589a-2ca8-4c1a-95f5-21ddd4026d1c tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "DELETE /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 404 len: 111 microversion: 2.1 time: 0.078364 Oct 27 19:18:05.261303 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3000/5847] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:18:05 2022] DELETE /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:18:05.270431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85ed29e1-af40-4f0e-bf39-57ef3cf116c6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:05.274875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-85ed29e1-af40-4f0e-bf39-57ef3cf116c6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] [instance: 33260ead-2cd8-4102-a73b-bcda48c80f91] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:05.292803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85ed29e1-af40-4f0e-bf39-57ef3cf116c6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:05.293324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85ed29e1-af40-4f0e-bf39-57ef3cf116c6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:05.293772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85ed29e1-af40-4f0e-bf39-57ef3cf116c6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:05.294527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85ed29e1-af40-4f0e-bf39-57ef3cf116c6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:05.294988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85ed29e1-af40-4f0e-bf39-57ef3cf116c6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:05.295418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85ed29e1-af40-4f0e-bf39-57ef3cf116c6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:05.379262 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-85ed29e1-af40-4f0e-bf39-57ef3cf116c6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] HTTP exception thrown: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85ed29e1-af40-4f0e-bf39-57ef3cf116c6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Request method failure captured: Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 HTTP/1.1 Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtlOmPSeKnhcEul1jmK7IywxVD9ljxfnVOcHm18k-nWdBvNmyUkGtXrv12SdyZi3-x97BOt8Gumeb0V-76g1gFIn8KBI2qy_yxf6oJKRwfv6LmlRqTM2Md4g_jxx_yuSuI5SZUvQkaiMzJ7NVvJRZfCBwTYgfVSBDyi8PUo0jWTegbs Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 92306d31919643638bffed62403c1036 Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92306d31919643638bffed62403c1036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92306d31919643638bffed62403c1036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92306d31919643638bffed62403c1036", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92306d31919643638bffed62403c1036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 92306d31919643638bffed62403c1036 Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerGroupTestJSON-1851639144-project Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 28aeedbc41084478840a48d05c9fdceb Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerGroupTestJSON-1851639144-project Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '33260ead-2cd8-4102-a73b-bcda48c80f91'} Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:05.385022 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.390563 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.390563 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:05.390563 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:05.390563 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:18:05.390563 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:18:05.390563 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. Oct 27 19:18:05.390563 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.390563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85ed29e1-af40-4f0e-bf39-57ef3cf116c6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Returning 404 to user: Instance 33260ead-2cd8-4102-a73b-bcda48c80f91 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:18:05.390563 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-85ed29e1-af40-4f0e-bf39-57ef3cf116c6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91" status: 404 len: 111 microversion: 2.1 time: 0.123850 Oct 27 19:18:05.390563 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3001/5848] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:05 2022] GET /compute/v2.1/servers/33260ead-2cd8-4102-a73b-bcda48c80f91 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:18:05.407627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ed7a0e79-558c-4fbb-940c-891b053234d3 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:05.436648 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-ed7a0e79-558c-4fbb-940c-891b053234d3 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] HTTP exception thrown: Instance group 63880afc-1c0e-4da1-b560-e8d0b574e2b3 could not be found. Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ed7a0e79-558c-4fbb-940c-891b053234d3 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Request method failure captured: Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-server-groups/63880afc-1c0e-4da1-b560-e8d0b574e2b3 HTTP/1.1 Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtlOmPSeKnhcEul1jmK7IywxVD9ljxfnVOcHm18k-nWdBvNmyUkGtXrv12SdyZi3-x97BOt8Gumeb0V-76g1gFIn8KBI2qy_yxf6oJKRwfv6LmlRqTM2Md4g_jxx_yuSuI5SZUvQkaiMzJ7NVvJRZfCBwTYgfVSBDyi8PUo0jWTegbs Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 92306d31919643638bffed62403c1036 Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92306d31919643638bffed62403c1036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92306d31919643638bffed62403c1036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92306d31919643638bffed62403c1036", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92306d31919643638bffed62403c1036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 92306d31919643638bffed62403c1036 Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerGroupTestJSON-1851639144-project Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 28aeedbc41084478840a48d05c9fdceb Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerGroupTestJSON-1851639144-project Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance group 63880afc-1c0e-4da1-b560-e8d0b574e2b3 could not be found. Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '63880afc-1c0e-4da1-b560-e8d0b574e2b3'} Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 63880afc-1c0e-4da1-b560-e8d0b574e2b3 could not be found. Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 63880afc-1c0e-4da1-b560-e8d0b574e2b3 could not be found. Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.478639 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.484476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:05.484476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:05.484476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:18:05.484476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:18:05.484476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 63880afc-1c0e-4da1-b560-e8d0b574e2b3 could not be found. Oct 27 19:18:05.484476 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.486200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ed7a0e79-558c-4fbb-940c-891b053234d3 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Returning 404 to user: Instance group 63880afc-1c0e-4da1-b560-e8d0b574e2b3 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:18:05.487304 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ed7a0e79-558c-4fbb-940c-891b053234d3 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/63880afc-1c0e-4da1-b560-e8d0b574e2b3" status: 404 len: 117 microversion: 2.1 time: 0.090118 Oct 27 19:18:05.488402 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3002/5849] 10.222.0.42 () {58 vars in 1266 bytes} [Thu Oct 27 19:18:05 2022] DELETE /compute/v2.1/os-server-groups/63880afc-1c0e-4da1-b560-e8d0b574e2b3 => generated 117 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:18:05.496950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-203b0e5c-337c-42ad-a602-93f71be45df5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:05.521770 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-203b0e5c-337c-42ad-a602-93f71be45df5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] HTTP exception thrown: Instance group 29222fb1-3d1f-46d7-b769-c375d31bcba4 could not be found. Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-203b0e5c-337c-42ad-a602-93f71be45df5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Request method failure captured: Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-server-groups/29222fb1-3d1f-46d7-b769-c375d31bcba4 HTTP/1.1 Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtlOmPSeKnhcEul1jmK7IywxVD9ljxfnVOcHm18k-nWdBvNmyUkGtXrv12SdyZi3-x97BOt8Gumeb0V-76g1gFIn8KBI2qy_yxf6oJKRwfv6LmlRqTM2Md4g_jxx_yuSuI5SZUvQkaiMzJ7NVvJRZfCBwTYgfVSBDyi8PUo0jWTegbs Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 92306d31919643638bffed62403c1036 Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92306d31919643638bffed62403c1036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92306d31919643638bffed62403c1036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92306d31919643638bffed62403c1036", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92306d31919643638bffed62403c1036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 92306d31919643638bffed62403c1036 Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerGroupTestJSON-1851639144-project Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 28aeedbc41084478840a48d05c9fdceb Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerGroupTestJSON-1851639144-project Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance group 29222fb1-3d1f-46d7-b769-c375d31bcba4 could not be found. Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '29222fb1-3d1f-46d7-b769-c375d31bcba4'} Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 29222fb1-3d1f-46d7-b769-c375d31bcba4 could not be found. Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 29222fb1-3d1f-46d7-b769-c375d31bcba4 could not be found. Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.525406 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.531219 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:05.531219 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:05.531219 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:18:05.531219 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:18:05.531219 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 29222fb1-3d1f-46d7-b769-c375d31bcba4 could not be found. Oct 27 19:18:05.531219 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.538802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-203b0e5c-337c-42ad-a602-93f71be45df5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Returning 404 to user: Instance group 29222fb1-3d1f-46d7-b769-c375d31bcba4 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:18:05.541449 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-203b0e5c-337c-42ad-a602-93f71be45df5 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/29222fb1-3d1f-46d7-b769-c375d31bcba4" status: 404 len: 117 microversion: 2.1 time: 0.048687 Oct 27 19:18:05.543685 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3003/5850] 10.222.0.42 () {58 vars in 1266 bytes} [Thu Oct 27 19:18:05 2022] DELETE /compute/v2.1/os-server-groups/29222fb1-3d1f-46d7-b769-c375d31bcba4 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:18:05.555467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ed8adaeb-445f-41fa-9ff3-89f35ad060a7 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:05.585888 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-ed8adaeb-445f-41fa-9ff3-89f35ad060a7 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] HTTP exception thrown: Instance group 11dc6f79-7a1c-444c-915b-97dd169b696f could not be found. Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ed8adaeb-445f-41fa-9ff3-89f35ad060a7 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Request method failure captured: Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-server-groups/11dc6f79-7a1c-444c-915b-97dd169b696f HTTP/1.1 Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtlOmPSeKnhcEul1jmK7IywxVD9ljxfnVOcHm18k-nWdBvNmyUkGtXrv12SdyZi3-x97BOt8Gumeb0V-76g1gFIn8KBI2qy_yxf6oJKRwfv6LmlRqTM2Md4g_jxx_yuSuI5SZUvQkaiMzJ7NVvJRZfCBwTYgfVSBDyi8PUo0jWTegbs Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 92306d31919643638bffed62403c1036 Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92306d31919643638bffed62403c1036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92306d31919643638bffed62403c1036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92306d31919643638bffed62403c1036", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92306d31919643638bffed62403c1036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 92306d31919643638bffed62403c1036 Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerGroupTestJSON-1851639144-project Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 28aeedbc41084478840a48d05c9fdceb Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerGroupTestJSON-1851639144-project Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance group 11dc6f79-7a1c-444c-915b-97dd169b696f could not be found. Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '11dc6f79-7a1c-444c-915b-97dd169b696f'} Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 11dc6f79-7a1c-444c-915b-97dd169b696f could not be found. Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 11dc6f79-7a1c-444c-915b-97dd169b696f could not be found. Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.593627 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.599301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:05.599301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:05.599301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:18:05.599301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:18:05.599301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 11dc6f79-7a1c-444c-915b-97dd169b696f could not be found. Oct 27 19:18:05.599301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.599301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ed8adaeb-445f-41fa-9ff3-89f35ad060a7 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Returning 404 to user: Instance group 11dc6f79-7a1c-444c-915b-97dd169b696f could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:18:05.599301 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ed8adaeb-445f-41fa-9ff3-89f35ad060a7 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/11dc6f79-7a1c-444c-915b-97dd169b696f" status: 404 len: 117 microversion: 2.1 time: 0.049390 Oct 27 19:18:05.599301 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3004/5851] 10.222.0.42 () {58 vars in 1266 bytes} [Thu Oct 27 19:18:05 2022] DELETE /compute/v2.1/os-server-groups/11dc6f79-7a1c-444c-915b-97dd169b696f => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:18:05.616541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b04045e6-f5b9-4cfd-ab31-04c8659f3ae6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:05.636091 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-b04045e6-f5b9-4cfd-ab31-04c8659f3ae6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] HTTP exception thrown: Instance group b9f66c62-084c-4ce1-a30c-5550deb99ac6 could not be found. Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b04045e6-f5b9-4cfd-ab31-04c8659f3ae6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Request method failure captured: Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/os-server-groups/b9f66c62-084c-4ce1-a30c-5550deb99ac6 HTTP/1.1 Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtlOmPSeKnhcEul1jmK7IywxVD9ljxfnVOcHm18k-nWdBvNmyUkGtXrv12SdyZi3-x97BOt8Gumeb0V-76g1gFIn8KBI2qy_yxf6oJKRwfv6LmlRqTM2Md4g_jxx_yuSuI5SZUvQkaiMzJ7NVvJRZfCBwTYgfVSBDyi8PUo0jWTegbs Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 92306d31919643638bffed62403c1036 Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92306d31919643638bffed62403c1036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92306d31919643638bffed62403c1036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92306d31919643638bffed62403c1036", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92306d31919643638bffed62403c1036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 92306d31919643638bffed62403c1036 Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerGroupTestJSON-1851639144 Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerGroupTestJSON-1851639144-project Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 28aeedbc41084478840a48d05c9fdceb Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerGroupTestJSON-1851639144-project Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance group b9f66c62-084c-4ce1-a30c-5550deb99ac6 could not be found. Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'b9f66c62-084c-4ce1-a30c-5550deb99ac6'} Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b9f66c62-084c-4ce1-a30c-5550deb99ac6 could not be found. Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b9f66c62-084c-4ce1-a30c-5550deb99ac6 could not be found. Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.651518 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:05.657625 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:05.657625 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:05.657625 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:18:05.657625 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:18:05.657625 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b9f66c62-084c-4ce1-a30c-5550deb99ac6 could not be found. Oct 27 19:18:05.657625 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:05.666201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b04045e6-f5b9-4cfd-ab31-04c8659f3ae6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Returning 404 to user: Instance group b9f66c62-084c-4ce1-a30c-5550deb99ac6 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:18:05.667424 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b04045e6-f5b9-4cfd-ab31-04c8659f3ae6 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/b9f66c62-084c-4ce1-a30c-5550deb99ac6" status: 404 len: 117 microversion: 2.1 time: 0.057616 Oct 27 19:18:05.671724 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3005/5852] 10.222.0.42 () {58 vars in 1266 bytes} [Thu Oct 27 19:18:05 2022] DELETE /compute/v2.1/os-server-groups/b9f66c62-084c-4ce1-a30c-5550deb99ac6 => generated 117 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:18:05.680841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9914a608-4a73-4b47-8036-163b249b4684 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:05.742125 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9914a608-4a73-4b47-8036-163b249b4684 tempest-ServerGroupTestJSON-1851639144 tempest-ServerGroupTestJSON-1851639144-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/a8f3201d-241e-447d-8790-12f29aca5f0e" status: 204 len: 0 microversion: 2.1 time: 0.068914 Oct 27 19:18:05.748699 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3006/5853] 10.222.0.42 () {58 vars in 1266 bytes} [Thu Oct 27 19:18:05 2022] DELETE /compute/v2.1/os-server-groups/a8f3201d-241e-447d-8790-12f29aca5f0e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:18:06.548107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9c625447-e23a-4827-bb0d-43ae843ae313 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:06.585451 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9c625447-e23a-4827-bb0d-43ae843ae313 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1393 microversion: 2.1 time: 1.565069 Oct 27 19:18:06.587820 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2848/5854] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:05 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1393 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:07.614085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae3dd2d7-7c71-4b22-8a0f-c822f65f1c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:07.614734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ae3dd2d7-7c71-4b22-8a0f-c822f65f1c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:07.653274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae3dd2d7-7c71-4b22-8a0f-c822f65f1c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:07.654111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae3dd2d7-7c71-4b22-8a0f-c822f65f1c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:07.654267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae3dd2d7-7c71-4b22-8a0f-c822f65f1c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:07.655040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae3dd2d7-7c71-4b22-8a0f-c822f65f1c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:07.655507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae3dd2d7-7c71-4b22-8a0f-c822f65f1c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:07.656049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae3dd2d7-7c71-4b22-8a0f-c822f65f1c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:08.139285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-61e11fa5-6185-41ea-92a3-6625d4fccd01 req-0a371b4d-a615-4d75-a7bf-31924a8ecfec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bbf8d5b-8288-4bd2-91dd-d67825cb8007", "tag": "51f53b33-b1cf-4efb-b7b4-8ec80712f964"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:18:08.159107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:18:08.166599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-61e11fa5-6185-41ea-92a3-6625d4fccd01 req-0a371b4d-a615-4d75-a7bf-31924a8ecfec service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:08.168929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-61e11fa5-6185-41ea-92a3-6625d4fccd01 req-0a371b4d-a615-4d75-a7bf-31924a8ecfec service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:08.170339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-61e11fa5-6185-41ea-92a3-6625d4fccd01 req-0a371b4d-a615-4d75-a7bf-31924a8ecfec service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:08.181652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:18:08.204636 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-61e11fa5-6185-41ea-92a3-6625d4fccd01 req-0a371b4d-a615-4d75-a7bf-31924a8ecfec service nova] Creating event network-changed:51f53b33-b1cf-4efb-b7b4-8ec80712f964 for instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 on n-h2-860687-3 Oct 27 19:18:08.222046 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-61e11fa5-6185-41ea-92a3-6625d4fccd01 req-0a371b4d-a615-4d75-a7bf-31924a8ecfec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086277 Oct 27 19:18:08.223126 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2849/5855] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:18:08.346808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ae3dd2d7-7c71-4b22-8a0f-c822f65f1c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:08.376429 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ae3dd2d7-7c71-4b22-8a0f-c822f65f1c51 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1393 microversion: 2.1 time: 0.764299 Oct 27 19:18:08.377415 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3007/5856] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:07 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1393 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:09.407960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d8f5f50-c42e-4160-b3fb-1440665047cb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:09.409600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d8f5f50-c42e-4160-b3fb-1440665047cb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:09.439899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d8f5f50-c42e-4160-b3fb-1440665047cb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:09.449441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d8f5f50-c42e-4160-b3fb-1440665047cb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:09.466369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d8f5f50-c42e-4160-b3fb-1440665047cb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:09.469374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d8f5f50-c42e-4160-b3fb-1440665047cb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:09.472057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d8f5f50-c42e-4160-b3fb-1440665047cb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:09.472681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d8f5f50-c42e-4160-b3fb-1440665047cb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:10.169350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d8f5f50-c42e-4160-b3fb-1440665047cb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:10.217841 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d8f5f50-c42e-4160-b3fb-1440665047cb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1393 microversion: 2.1 time: 0.813260 Oct 27 19:18:10.219034 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2850/5857] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:09 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1393 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:11.243526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-229dda60-bdca-43b3-93d9-044a732b3307 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:11.243978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-229dda60-bdca-43b3-93d9-044a732b3307 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:11.248187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:18:11.250118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:18:11.262069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-229dda60-bdca-43b3-93d9-044a732b3307 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:11.263272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-229dda60-bdca-43b3-93d9-044a732b3307 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:11.264274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-229dda60-bdca-43b3-93d9-044a732b3307 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:11.265434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-229dda60-bdca-43b3-93d9-044a732b3307 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:11.266169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-229dda60-bdca-43b3-93d9-044a732b3307 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:11.266897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-229dda60-bdca-43b3-93d9-044a732b3307 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:11.784609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-229dda60-bdca-43b3-93d9-044a732b3307 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:11.801662 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-229dda60-bdca-43b3-93d9-044a732b3307 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1393 microversion: 2.1 time: 0.563570 Oct 27 19:18:11.815108 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3008/5858] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:11 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1393 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:12.829131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f30ee732-8906-4662-8da0-8a36e8de7698 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:12.830961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f30ee732-8906-4662-8da0-8a36e8de7698 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:12.845992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f30ee732-8906-4662-8da0-8a36e8de7698 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:12.853974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f30ee732-8906-4662-8da0-8a36e8de7698 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:12.856762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f30ee732-8906-4662-8da0-8a36e8de7698 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:12.858460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f30ee732-8906-4662-8da0-8a36e8de7698 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:12.861683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f30ee732-8906-4662-8da0-8a36e8de7698 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:12.864957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f30ee732-8906-4662-8da0-8a36e8de7698 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:13.795453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f30ee732-8906-4662-8da0-8a36e8de7698 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:13.806134 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f30ee732-8906-4662-8da0-8a36e8de7698 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1393 microversion: 2.1 time: 0.978799 Oct 27 19:18:13.809386 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2851/5859] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:12 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1393 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:14.835587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-52d1f37a-db91-4f0d-814b-1553df611dd5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:14.836421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-52d1f37a-db91-4f0d-814b-1553df611dd5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:14.866599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52d1f37a-db91-4f0d-814b-1553df611dd5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:14.867336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52d1f37a-db91-4f0d-814b-1553df611dd5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:14.867898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52d1f37a-db91-4f0d-814b-1553df611dd5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:14.868958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52d1f37a-db91-4f0d-814b-1553df611dd5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:14.869530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52d1f37a-db91-4f0d-814b-1553df611dd5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:14.870162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52d1f37a-db91-4f0d-814b-1553df611dd5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:15.431112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-52d1f37a-db91-4f0d-814b-1553df611dd5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:15.446497 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-52d1f37a-db91-4f0d-814b-1553df611dd5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1393 microversion: 2.1 time: 0.615302 Oct 27 19:18:15.488572 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3009/5860] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:14 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1393 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:16.471126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00d2f3cb-acc0-41b4-86b2-1d0b58d989a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:16.472088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-00d2f3cb-acc0-41b4-86b2-1d0b58d989a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:16.489836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00d2f3cb-acc0-41b4-86b2-1d0b58d989a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:16.493574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00d2f3cb-acc0-41b4-86b2-1d0b58d989a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:16.503369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00d2f3cb-acc0-41b4-86b2-1d0b58d989a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:16.504570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00d2f3cb-acc0-41b4-86b2-1d0b58d989a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:16.505346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00d2f3cb-acc0-41b4-86b2-1d0b58d989a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:16.506146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00d2f3cb-acc0-41b4-86b2-1d0b58d989a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:17.320710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-00d2f3cb-acc0-41b4-86b2-1d0b58d989a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:17.330192 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-00d2f3cb-acc0-41b4-86b2-1d0b58d989a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1393 microversion: 2.1 time: 0.862703 Oct 27 19:18:17.343600 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2852/5861] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:16 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1393 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:18.358432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ed6a5200-9029-4b34-859e-fa3e166e7541 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:18.359327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ed6a5200-9029-4b34-859e-fa3e166e7541 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:18.375592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed6a5200-9029-4b34-859e-fa3e166e7541 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:18.376569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed6a5200-9029-4b34-859e-fa3e166e7541 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:18.378157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed6a5200-9029-4b34-859e-fa3e166e7541 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:18.380117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed6a5200-9029-4b34-859e-fa3e166e7541 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:18.382924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed6a5200-9029-4b34-859e-fa3e166e7541 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:18.385495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed6a5200-9029-4b34-859e-fa3e166e7541 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:18.765711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ed6a5200-9029-4b34-859e-fa3e166e7541 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:18.775475 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ed6a5200-9029-4b34-859e-fa3e166e7541 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1393 microversion: 2.1 time: 0.422199 Oct 27 19:18:18.776100 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3010/5862] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:18 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1393 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:19.266776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-e57d4094-40ba-44b0-85fd-1e52b92afef9 req-1d4778a5-36d9-4552-915c-3df67929e929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbf8d5b-8288-4bd2-91dd-d67825cb8007", "name": "network-vif-plugged", "status": "completed", "tag": "51f53b33-b1cf-4efb-b7b4-8ec80712f964"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:18:19.304600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e57d4094-40ba-44b0-85fd-1e52b92afef9 req-1d4778a5-36d9-4552-915c-3df67929e929 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:19.305039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e57d4094-40ba-44b0-85fd-1e52b92afef9 req-1d4778a5-36d9-4552-915c-3df67929e929 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:19.305495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e57d4094-40ba-44b0-85fd-1e52b92afef9 req-1d4778a5-36d9-4552-915c-3df67929e929 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:19.345043 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-e57d4094-40ba-44b0-85fd-1e52b92afef9 req-1d4778a5-36d9-4552-915c-3df67929e929 service nova] Creating event network-vif-plugged:51f53b33-b1cf-4efb-b7b4-8ec80712f964 for instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 on n-h2-860687-3 Oct 27 19:18:19.360802 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-e57d4094-40ba-44b0-85fd-1e52b92afef9 req-1d4778a5-36d9-4552-915c-3df67929e929 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097928 Oct 27 19:18:19.364494 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2853/5863] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:18:19.800782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-932a7973-b8d4-4350-92ed-2545e47661f6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:19.801818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-932a7973-b8d4-4350-92ed-2545e47661f6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:19.827210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-932a7973-b8d4-4350-92ed-2545e47661f6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:19.827984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-932a7973-b8d4-4350-92ed-2545e47661f6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:19.828362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-932a7973-b8d4-4350-92ed-2545e47661f6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:19.834192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-932a7973-b8d4-4350-92ed-2545e47661f6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:19.837004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-932a7973-b8d4-4350-92ed-2545e47661f6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:19.837597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-932a7973-b8d4-4350-92ed-2545e47661f6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:20.420086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-932a7973-b8d4-4350-92ed-2545e47661f6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:20.436626 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-932a7973-b8d4-4350-92ed-2545e47661f6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1393 microversion: 2.1 time: 0.639953 Oct 27 19:18:20.437839 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3011/5864] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:19 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1393 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:21.466572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-afab9b9b-8467-4825-a6b8-c826c2441380 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:21.467966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-afab9b9b-8467-4825-a6b8-c826c2441380 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:21.485901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afab9b9b-8467-4825-a6b8-c826c2441380 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:21.487245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afab9b9b-8467-4825-a6b8-c826c2441380 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:21.489906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afab9b9b-8467-4825-a6b8-c826c2441380 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:21.492264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afab9b9b-8467-4825-a6b8-c826c2441380 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:21.494044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afab9b9b-8467-4825-a6b8-c826c2441380 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:21.495151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afab9b9b-8467-4825-a6b8-c826c2441380 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:21.830895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-afab9b9b-8467-4825-a6b8-c826c2441380 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:21.845288 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-afab9b9b-8467-4825-a6b8-c826c2441380 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1564 microversion: 2.1 time: 0.385650 Oct 27 19:18:21.846706 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2854/5865] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:21 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1564 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:21.870729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae1035d7-c3c7-4231-b299-93f27d1367c7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:21.871444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ae1035d7-c3c7-4231-b299-93f27d1367c7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:21.881855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae1035d7-c3c7-4231-b299-93f27d1367c7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:21.882764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae1035d7-c3c7-4231-b299-93f27d1367c7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:21.883236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae1035d7-c3c7-4231-b299-93f27d1367c7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:21.883972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae1035d7-c3c7-4231-b299-93f27d1367c7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:21.884438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae1035d7-c3c7-4231-b299-93f27d1367c7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:21.884872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae1035d7-c3c7-4231-b299-93f27d1367c7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:22.548178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ae1035d7-c3c7-4231-b299-93f27d1367c7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:22.571586 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ae1035d7-c3c7-4231-b299-93f27d1367c7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1564 microversion: 2.1 time: 0.705840 Oct 27 19:18:22.591157 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3012/5866] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:21 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1564 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:28.574555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9b3cc22-fb8f-4fae-9852-3bf7d6633455 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:28.575305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d9b3cc22-fb8f-4fae-9852-3bf7d6633455 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:28.580274 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 19:18:28.583399 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 19:18:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 (ip 10.222.0.42) !!! Oct 27 19:18:28.598900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ebdb9bf3-9e6a-4801-bc24-bf236c69aa37 req-499b9ac1-5c5b-4814-9f9c-06e1c47379c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bbf8d5b-8288-4bd2-91dd-d67825cb8007", "tag": "51f53b33-b1cf-4efb-b7b4-8ec80712f964"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:18:28.609508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9b3cc22-fb8f-4fae-9852-3bf7d6633455 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:28.610513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9b3cc22-fb8f-4fae-9852-3bf7d6633455 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:28.611241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9b3cc22-fb8f-4fae-9852-3bf7d6633455 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:28.612463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9b3cc22-fb8f-4fae-9852-3bf7d6633455 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:28.613163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9b3cc22-fb8f-4fae-9852-3bf7d6633455 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:28.614027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9b3cc22-fb8f-4fae-9852-3bf7d6633455 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:28.620208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ebdb9bf3-9e6a-4801-bc24-bf236c69aa37 req-499b9ac1-5c5b-4814-9f9c-06e1c47379c8 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:28.622878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ebdb9bf3-9e6a-4801-bc24-bf236c69aa37 req-499b9ac1-5c5b-4814-9f9c-06e1c47379c8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:28.623471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ebdb9bf3-9e6a-4801-bc24-bf236c69aa37 req-499b9ac1-5c5b-4814-9f9c-06e1c47379c8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:28.666584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=76 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:18:28.668982 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ebdb9bf3-9e6a-4801-bc24-bf236c69aa37 req-499b9ac1-5c5b-4814-9f9c-06e1c47379c8 service nova] Creating event network-changed:51f53b33-b1cf-4efb-b7b4-8ec80712f964 for instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 on n-h2-860687-3 Oct 27 19:18:28.682229 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ebdb9bf3-9e6a-4801-bc24-bf236c69aa37 req-499b9ac1-5c5b-4814-9f9c-06e1c47379c8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086823 Oct 27 19:18:28.685438 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3013/5867] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:18:29.197286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d9b3cc22-fb8f-4fae-9852-3bf7d6633455 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:29.208354 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d9b3cc22-fb8f-4fae-9852-3bf7d6633455 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1564 microversion: 2.1 time: 0.638180 Oct 27 19:18:29.217971 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2855/5868] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:18:28 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1564 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:32.538600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-892137404", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "7f12fc0c-f8e1-4a87-90ef-0f38fb1cf715"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:18:32.658185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] validate_networks() for [('7f12fc0c-f8e1-4a87-90ef-0f38fb1cf715', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:18:33.501033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:18:33.501575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:18:33.502169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:18:33.502743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:18:33.503261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:18:33.520417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:33.522961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:33.523565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:33.524485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:33.528281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:33.529165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:33.571934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Getting quotas for project fc6e155425334a5ba8773186e4f6db6a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:18:33.586574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Getting quotas for user bc7445fdce4f43d69c5d93c921621830 and project fc6e155425334a5ba8773186e4f6db6a. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:18:33.616787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:18:33.623802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:18:33.705241 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3ddb3567-3f74-462e-a714-8fd8282295ce tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.398752 Oct 27 19:18:33.706502 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3014/5869] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 19:18:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 19:18:33.724988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5d69ab7a-3d63-4b6f-a479-df2be608aa7e tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:33.725969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5d69ab7a-3d63-4b6f-a479-df2be608aa7e tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:33.901616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5d69ab7a-3d63-4b6f-a479-df2be608aa7e tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:33.916709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5d69ab7a-3d63-4b6f-a479-df2be608aa7e tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:33.919801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5d69ab7a-3d63-4b6f-a479-df2be608aa7e tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:33.921021 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5d69ab7a-3d63-4b6f-a479-df2be608aa7e tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1261 microversion: 2.26 time: 0.206908 Oct 27 19:18:33.926581 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2856/5870] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:33 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1261 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:18:34.960979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a246c20-4771-4fee-ba35-334de2539dba tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:34.961829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1a246c20-4771-4fee-ba35-334de2539dba tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:34.996220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a246c20-4771-4fee-ba35-334de2539dba tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:34.997347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a246c20-4771-4fee-ba35-334de2539dba tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:35.001035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a246c20-4771-4fee-ba35-334de2539dba tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:35.006015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a246c20-4771-4fee-ba35-334de2539dba tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:35.010420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a246c20-4771-4fee-ba35-334de2539dba tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:35.011894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a246c20-4771-4fee-ba35-334de2539dba tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:35.256602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1a246c20-4771-4fee-ba35-334de2539dba tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:35.269588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1a246c20-4771-4fee-ba35-334de2539dba tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:35.281987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1a246c20-4771-4fee-ba35-334de2539dba tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:35.286364 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1a246c20-4771-4fee-ba35-334de2539dba tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1257 microversion: 2.26 time: 0.331644 Oct 27 19:18:35.287043 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3015/5871] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:34 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1257 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:18:36.320175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-32c158ac-1e6e-48e9-8706-78ff021da116 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:36.322736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-32c158ac-1e6e-48e9-8706-78ff021da116 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:36.352181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32c158ac-1e6e-48e9-8706-78ff021da116 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:36.359341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32c158ac-1e6e-48e9-8706-78ff021da116 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:36.360030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32c158ac-1e6e-48e9-8706-78ff021da116 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:36.361228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32c158ac-1e6e-48e9-8706-78ff021da116 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:36.362084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32c158ac-1e6e-48e9-8706-78ff021da116 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:36.362819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32c158ac-1e6e-48e9-8706-78ff021da116 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:36.676164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-32c158ac-1e6e-48e9-8706-78ff021da116 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:36.685626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-32c158ac-1e6e-48e9-8706-78ff021da116 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:36.700514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-32c158ac-1e6e-48e9-8706-78ff021da116 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:36.702047 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-32c158ac-1e6e-48e9-8706-78ff021da116 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1319 microversion: 2.26 time: 0.389338 Oct 27 19:18:36.722759 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2857/5872] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:36 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:18:37.731569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b8bd1170-a60f-4689-8f18-513661bdd986 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:37.733653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b8bd1170-a60f-4689-8f18-513661bdd986 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:37.743425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:18:37.746335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8bd1170-a60f-4689-8f18-513661bdd986 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:37.747591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8bd1170-a60f-4689-8f18-513661bdd986 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:37.748285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8bd1170-a60f-4689-8f18-513661bdd986 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:37.749270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8bd1170-a60f-4689-8f18-513661bdd986 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:37.750116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8bd1170-a60f-4689-8f18-513661bdd986 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:37.750712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8bd1170-a60f-4689-8f18-513661bdd986 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:38.015989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b8bd1170-a60f-4689-8f18-513661bdd986 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:38.027369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b8bd1170-a60f-4689-8f18-513661bdd986 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:38.030909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b8bd1170-a60f-4689-8f18-513661bdd986 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:38.033405 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b8bd1170-a60f-4689-8f18-513661bdd986 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1319 microversion: 2.26 time: 0.306891 Oct 27 19:18:38.035913 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3016/5873] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:37 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:18:39.072939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5119a880-bf8d-4351-9e6f-fbb3cd0a83d6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:39.073701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5119a880-bf8d-4351-9e6f-fbb3cd0a83d6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:39.080442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5119a880-bf8d-4351-9e6f-fbb3cd0a83d6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:39.097043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5119a880-bf8d-4351-9e6f-fbb3cd0a83d6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:39.097660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5119a880-bf8d-4351-9e6f-fbb3cd0a83d6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:39.098814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5119a880-bf8d-4351-9e6f-fbb3cd0a83d6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:39.099386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5119a880-bf8d-4351-9e6f-fbb3cd0a83d6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:39.100439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5119a880-bf8d-4351-9e6f-fbb3cd0a83d6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:39.887106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5119a880-bf8d-4351-9e6f-fbb3cd0a83d6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:39.893953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=43 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:18:39.899432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5119a880-bf8d-4351-9e6f-fbb3cd0a83d6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:39.901644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5119a880-bf8d-4351-9e6f-fbb3cd0a83d6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:39.903054 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5119a880-bf8d-4351-9e6f-fbb3cd0a83d6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1361 microversion: 2.26 time: 0.835299 Oct 27 19:18:39.904235 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2858/5874] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:39 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1361 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:18:40.929993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a59cad01-4a16-40d4-9321-617e73313758 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:40.930651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a59cad01-4a16-40d4-9321-617e73313758 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:40.943073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a59cad01-4a16-40d4-9321-617e73313758 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:40.943715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a59cad01-4a16-40d4-9321-617e73313758 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:40.944169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a59cad01-4a16-40d4-9321-617e73313758 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:40.947980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a59cad01-4a16-40d4-9321-617e73313758 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:40.948486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a59cad01-4a16-40d4-9321-617e73313758 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:40.949738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a59cad01-4a16-40d4-9321-617e73313758 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:41.420383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c5268bb9-37ef-4a6c-9edf-2573cf209891 req-8de42fd1-640e-4d7d-a0c8-9cd0c067f0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77e1e481-e4bd-4319-84df-7d29eb468496", "tag": "ef765d9d-f8e8-45db-86e5-1d6164b75b1c"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:18:41.430546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=22 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:18:41.447979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c5268bb9-37ef-4a6c-9edf-2573cf209891 req-8de42fd1-640e-4d7d-a0c8-9cd0c067f0c1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:41.452528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c5268bb9-37ef-4a6c-9edf-2573cf209891 req-8de42fd1-640e-4d7d-a0c8-9cd0c067f0c1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:41.453046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c5268bb9-37ef-4a6c-9edf-2573cf209891 req-8de42fd1-640e-4d7d-a0c8-9cd0c067f0c1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:41.475638 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c5268bb9-37ef-4a6c-9edf-2573cf209891 req-8de42fd1-640e-4d7d-a0c8-9cd0c067f0c1 service nova] Creating event network-changed:ef765d9d-f8e8-45db-86e5-1d6164b75b1c for instance 77e1e481-e4bd-4319-84df-7d29eb468496 on n-h1-860687-3 Oct 27 19:18:41.485255 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c5268bb9-37ef-4a6c-9edf-2573cf209891 req-8de42fd1-640e-4d7d-a0c8-9cd0c067f0c1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068995 Oct 27 19:18:41.487338 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2859/5875] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:18:41.667399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a59cad01-4a16-40d4-9321-617e73313758 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:41.686596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a59cad01-4a16-40d4-9321-617e73313758 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:41.693662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a59cad01-4a16-40d4-9321-617e73313758 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:41.695462 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a59cad01-4a16-40d4-9321-617e73313758 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1361 microversion: 2.26 time: 0.770121 Oct 27 19:18:41.697657 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3017/5876] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:40 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1361 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:18:42.733580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d2ba798f-6f56-443b-9f68-94be8aab8e87 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:42.734368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d2ba798f-6f56-443b-9f68-94be8aab8e87 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:42.749891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ba798f-6f56-443b-9f68-94be8aab8e87 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:42.750505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ba798f-6f56-443b-9f68-94be8aab8e87 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:42.750867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ba798f-6f56-443b-9f68-94be8aab8e87 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:42.751583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ba798f-6f56-443b-9f68-94be8aab8e87 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:42.752047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ba798f-6f56-443b-9f68-94be8aab8e87 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:42.752479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ba798f-6f56-443b-9f68-94be8aab8e87 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:43.256001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d2ba798f-6f56-443b-9f68-94be8aab8e87 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:43.265967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d2ba798f-6f56-443b-9f68-94be8aab8e87 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:43.274259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d2ba798f-6f56-443b-9f68-94be8aab8e87 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:43.275732 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d2ba798f-6f56-443b-9f68-94be8aab8e87 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1361 microversion: 2.26 time: 0.552783 Oct 27 19:18:43.277152 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2860/5877] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:42 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1361 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:18:44.312584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7ddf7685-0335-4a68-a6de-d4215190b0b6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:44.314314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7ddf7685-0335-4a68-a6de-d4215190b0b6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:44.323398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:18:44.324969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:18:44.341059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ddf7685-0335-4a68-a6de-d4215190b0b6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:44.360074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ddf7685-0335-4a68-a6de-d4215190b0b6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:44.360550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ddf7685-0335-4a68-a6de-d4215190b0b6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:44.361313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ddf7685-0335-4a68-a6de-d4215190b0b6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:44.366927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ddf7685-0335-4a68-a6de-d4215190b0b6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:44.367396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ddf7685-0335-4a68-a6de-d4215190b0b6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:44.775252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7ddf7685-0335-4a68-a6de-d4215190b0b6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:44.787741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7ddf7685-0335-4a68-a6de-d4215190b0b6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:44.789429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7ddf7685-0335-4a68-a6de-d4215190b0b6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:44.795016 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7ddf7685-0335-4a68-a6de-d4215190b0b6 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1361 microversion: 2.26 time: 0.492491 Oct 27 19:18:44.817919 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3018/5878] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:44 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1361 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:18:45.828879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6092c27a-c464-4df2-b92c-038fec8e62c7 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:45.829685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6092c27a-c464-4df2-b92c-038fec8e62c7 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:45.832911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:18:45.849571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6092c27a-c464-4df2-b92c-038fec8e62c7 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:45.850789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6092c27a-c464-4df2-b92c-038fec8e62c7 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:45.851479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6092c27a-c464-4df2-b92c-038fec8e62c7 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:45.853862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6092c27a-c464-4df2-b92c-038fec8e62c7 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:45.856237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6092c27a-c464-4df2-b92c-038fec8e62c7 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:45.857041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6092c27a-c464-4df2-b92c-038fec8e62c7 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:46.260665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6092c27a-c464-4df2-b92c-038fec8e62c7 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:46.278151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6092c27a-c464-4df2-b92c-038fec8e62c7 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:46.279924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6092c27a-c464-4df2-b92c-038fec8e62c7 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:46.281323 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6092c27a-c464-4df2-b92c-038fec8e62c7 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1361 microversion: 2.26 time: 0.457362 Oct 27 19:18:46.281894 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2861/5879] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:45 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1361 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:18:47.311876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9b2b4870-ea5a-4d59-89d2-82fd9c55d7c0 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:47.312545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9b2b4870-ea5a-4d59-89d2-82fd9c55d7c0 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:47.324469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2b4870-ea5a-4d59-89d2-82fd9c55d7c0 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:47.331772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2b4870-ea5a-4d59-89d2-82fd9c55d7c0 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:47.332415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2b4870-ea5a-4d59-89d2-82fd9c55d7c0 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:47.333346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2b4870-ea5a-4d59-89d2-82fd9c55d7c0 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:47.338646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2b4870-ea5a-4d59-89d2-82fd9c55d7c0 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:47.339053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2b4870-ea5a-4d59-89d2-82fd9c55d7c0 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:47.774495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9b2b4870-ea5a-4d59-89d2-82fd9c55d7c0 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:47.800877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9b2b4870-ea5a-4d59-89d2-82fd9c55d7c0 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:47.804319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9b2b4870-ea5a-4d59-89d2-82fd9c55d7c0 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:47.819057 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9b2b4870-ea5a-4d59-89d2-82fd9c55d7c0 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1361 microversion: 2.26 time: 0.498796 Oct 27 19:18:47.822235 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3019/5880] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:47 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1361 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:18:48.591458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-0ce3d866-cfbe-4e64-8e45-dc242ddc57e3 req-2bae8f76-f00f-4abb-a33f-761135b0656d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e1e481-e4bd-4319-84df-7d29eb468496", "name": "network-vif-plugged", "status": "completed", "tag": "ef765d9d-f8e8-45db-86e5-1d6164b75b1c"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:18:48.641250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0ce3d866-cfbe-4e64-8e45-dc242ddc57e3 req-2bae8f76-f00f-4abb-a33f-761135b0656d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:48.641816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0ce3d866-cfbe-4e64-8e45-dc242ddc57e3 req-2bae8f76-f00f-4abb-a33f-761135b0656d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:48.642275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0ce3d866-cfbe-4e64-8e45-dc242ddc57e3 req-2bae8f76-f00f-4abb-a33f-761135b0656d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:48.696923 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-0ce3d866-cfbe-4e64-8e45-dc242ddc57e3 req-2bae8f76-f00f-4abb-a33f-761135b0656d service nova] Creating event network-vif-plugged:ef765d9d-f8e8-45db-86e5-1d6164b75b1c for instance 77e1e481-e4bd-4319-84df-7d29eb468496 on n-h1-860687-3 Oct 27 19:18:48.712483 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-0ce3d866-cfbe-4e64-8e45-dc242ddc57e3 req-2bae8f76-f00f-4abb-a33f-761135b0656d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124704 Oct 27 19:18:48.716213 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2862/5881] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:18:48.864757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-85326ec9-34d5-4a90-bda4-83ee53ce2b37 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:48.865984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-85326ec9-34d5-4a90-bda4-83ee53ce2b37 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:48.882330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85326ec9-34d5-4a90-bda4-83ee53ce2b37 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:48.883011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85326ec9-34d5-4a90-bda4-83ee53ce2b37 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:48.883429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85326ec9-34d5-4a90-bda4-83ee53ce2b37 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:48.884149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85326ec9-34d5-4a90-bda4-83ee53ce2b37 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:48.884606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85326ec9-34d5-4a90-bda4-83ee53ce2b37 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:48.885034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-85326ec9-34d5-4a90-bda4-83ee53ce2b37 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:49.321255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-85326ec9-34d5-4a90-bda4-83ee53ce2b37 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:49.341445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-85326ec9-34d5-4a90-bda4-83ee53ce2b37 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:49.354293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-85326ec9-34d5-4a90-bda4-83ee53ce2b37 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:49.365611 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-85326ec9-34d5-4a90-bda4-83ee53ce2b37 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1361 microversion: 2.26 time: 0.500374 Oct 27 19:18:49.370238 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3020/5882] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:48 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1361 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:18:50.394337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-155976ee-03f9-4039-977d-6cf34a0aadb2 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:50.396045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-155976ee-03f9-4039-977d-6cf34a0aadb2 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:50.412184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-155976ee-03f9-4039-977d-6cf34a0aadb2 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:50.413263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-155976ee-03f9-4039-977d-6cf34a0aadb2 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:50.419248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-155976ee-03f9-4039-977d-6cf34a0aadb2 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:50.420171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-155976ee-03f9-4039-977d-6cf34a0aadb2 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:50.420658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-155976ee-03f9-4039-977d-6cf34a0aadb2 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:50.421110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-155976ee-03f9-4039-977d-6cf34a0aadb2 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.245767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-155976ee-03f9-4039-977d-6cf34a0aadb2 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:51.265052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-155976ee-03f9-4039-977d-6cf34a0aadb2 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:51.267621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-155976ee-03f9-4039-977d-6cf34a0aadb2 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:51.271638 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-155976ee-03f9-4039-977d-6cf34a0aadb2 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1546 microversion: 2.26 time: 0.882561 Oct 27 19:18:51.272822 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2863/5883] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:50 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1546 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:18:51.299952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc869daa550>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:51.315016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.315715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.316309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.316943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:51.323706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.324436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.325036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.325900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.326543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.327124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.357272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.358091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.358752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.375210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.376132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.376730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.410439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lazy-loading 'flavor' on Instance uuid 77e1e481-e4bd-4319-84df-7d29eb468496 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:18:51.432373 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5ed3314f-f838-4bbd-ae0b-5e16adf79536 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "PUT /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-2054905441" status: 201 len: 0 microversion: 2.26 time: 0.137390 Oct 27 19:18:51.433715 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3021/5884] 10.222.0.42 () {62 vars in 1380 bytes} [Thu Oct 27 19:18:51 2022] PUT /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-2054905441 => generated 0 bytes in 139 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 27 19:18:51.444452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-53355b71-c4f9-4040-bb0b-c4dde361be2e tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc869babf70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:51.455354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53355b71-c4f9-4040-bb0b-c4dde361be2e tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.456430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53355b71-c4f9-4040-bb0b-c4dde361be2e tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.457080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53355b71-c4f9-4040-bb0b-c4dde361be2e tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.482968 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-53355b71-c4f9-4040-bb0b-c4dde361be2e tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-2054905441" status: 204 len: 0 microversion: 2.26 time: 0.042857 Oct 27 19:18:51.487928 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2864/5885] 10.222.0.42 () {60 vars in 1361 bytes} [Thu Oct 27 19:18:51 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-2054905441 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:18:51.494592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc86a6d39d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:51.504310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.505102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.505831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.506862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:51.513852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.514679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.515332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.516250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.516913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.517593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.566487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.567086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.567638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.608061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lazy-loading 'flavor' on Instance uuid 77e1e481-e4bd-4319-84df-7d29eb468496 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:18:51.630644 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-95b2b664-cf6f-4d69-bf1d-3af859ed993c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags" status: 204 len: 0 microversion: 2.26 time: 0.140256 Oct 27 19:18:51.643731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb49d42a-1251-4f41-8b57-06636150af9c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc869b234c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:51.647872 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3022/5886] 10.222.0.42 () {60 vars in 1295 bytes} [Thu Oct 27 19:18:51 2022] DELETE /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:18:51.655173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb49d42a-1251-4f41-8b57-06636150af9c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.655836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb49d42a-1251-4f41-8b57-06636150af9c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.656654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb49d42a-1251-4f41-8b57-06636150af9c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.670305 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cb49d42a-1251-4f41-8b57-06636150af9c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags" status: 200 len: 12 microversion: 2.26 time: 0.031920 Oct 27 19:18:51.671231 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2865/5887] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Oct 27 19:18:51 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags => generated 12 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:51.682218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc869dbc430>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:51.694533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.695038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.695492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.695992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:51.702301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.703163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.703787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.704646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.705253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.705832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.739175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.739676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.740153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.749165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.749897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.750528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.780860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lazy-loading 'flavor' on Instance uuid 77e1e481-e4bd-4319-84df-7d29eb468496 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:18:51.798547 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-22e421af-dbe8-4ee3-9fe9-19fa2144f4e5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "PUT /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-591565945" status: 201 len: 0 microversion: 2.26 time: 0.120786 Oct 27 19:18:51.809609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fac91990-bd28-4eea-9ad6-b975eac9c5dc tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc8699758b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:51.815534 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3023/5888] 10.222.0.42 () {62 vars in 1377 bytes} [Thu Oct 27 19:18:51 2022] PUT /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-591565945 => generated 0 bytes in 138 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 27 19:18:51.820007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fac91990-bd28-4eea-9ad6-b975eac9c5dc tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.820740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fac91990-bd28-4eea-9ad6-b975eac9c5dc tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.821342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fac91990-bd28-4eea-9ad6-b975eac9c5dc tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.831525 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fac91990-bd28-4eea-9ad6-b975eac9c5dc tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags" status: 200 len: 35 microversion: 2.26 time: 0.025860 Oct 27 19:18:51.843849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc869dbc040>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:51.850227 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2866/5889] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Oct 27 19:18:51 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags => generated 35 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:51.853805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.854512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.855223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.855889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:51.862718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.863218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.863671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.864381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.865005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.865615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.899959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.902630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.903813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:51.938506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lazy-loading 'flavor' on Instance uuid 77e1e481-e4bd-4319-84df-7d29eb468496 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:18:51.956992 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-08bc494b-5237-42e0-9b8c-014982b657c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-591565945" status: 204 len: 0 microversion: 2.26 time: 0.117056 Oct 27 19:18:51.957991 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3024/5890] 10.222.0.42 () {60 vars in 1361 bytes} [Thu Oct 27 19:18:51 2022] DELETE /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-591565945 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:18:51.967286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd7943ec-18cf-4372-be93-a272ec25ec58 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc869bab310>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:51.975394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd7943ec-18cf-4372-be93-a272ec25ec58 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:51.979082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd7943ec-18cf-4372-be93-a272ec25ec58 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:51.979709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd7943ec-18cf-4372-be93-a272ec25ec58 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.014710 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bd7943ec-18cf-4372-be93-a272ec25ec58 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags" status: 200 len: 12 microversion: 2.26 time: 0.051325 Oct 27 19:18:52.022347 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2867/5891] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Oct 27 19:18:51 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags => generated 12 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:52.027654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc869dbc310>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:52.045313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.046199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.048891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.049509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:52.060285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.061294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.061989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.062958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.063625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.064263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.092765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.093633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.094289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.103805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:18:52.108725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lazy-loading 'flavor' on Instance uuid 77e1e481-e4bd-4319-84df-7d29eb468496 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:18:52.131634 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cafc4cc0-6ea4-4085-be31-39bc0d417aeb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags" status: 204 len: 0 microversion: 2.26 time: 0.107721 Oct 27 19:18:52.132998 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3025/5892] 10.222.0.42 () {60 vars in 1295 bytes} [Thu Oct 27 19:18:52 2022] DELETE /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 19:18:52.142344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc86bff33a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:52.159018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.164284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.164911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.165550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:52.177571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.180334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.180984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.183106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.187088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.187706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.235005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.235785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.236437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.262444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.263217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.266098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.315998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lazy-loading 'flavor' on Instance uuid 77e1e481-e4bd-4319-84df-7d29eb468496 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:18:52.346703 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-acd40fb4-264b-4333-a154-3528197924c8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "PUT /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-1410792816" status: 201 len: 0 microversion: 2.26 time: 0.208309 Oct 27 19:18:52.347395 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2868/5893] 10.222.0.42 () {62 vars in 1380 bytes} [Thu Oct 27 19:18:52 2022] PUT /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-1410792816 => generated 0 bytes in 210 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 27 19:18:52.371979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc869d7d8b0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:52.399025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.399751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.400327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.400944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:52.408097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.408875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.409491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.410358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.411163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.411723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.449789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.451153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.451752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.463334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.464040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.464651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.492771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lazy-loading 'flavor' on Instance uuid 77e1e481-e4bd-4319-84df-7d29eb468496 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:18:52.510613 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3e41ae98-5e89-4780-bb63-c74f972fe46b tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "PUT /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-1941406914" status: 201 len: 0 microversion: 2.26 time: 0.156034 Oct 27 19:18:52.511832 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3026/5894] 10.222.0.42 () {62 vars in 1380 bytes} [Thu Oct 27 19:18:52 2022] PUT /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-1941406914 => generated 0 bytes in 158 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 27 19:18:52.524374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc86ae38af0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:52.541004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.541523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.541972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.542492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:52.562103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.563377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.564002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.572746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.574897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.575362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.631648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.632339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.633089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.670573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lazy-loading 'flavor' on Instance uuid 77e1e481-e4bd-4319-84df-7d29eb468496 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:18:52.756910 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e8e3bcc2-c029-4dee-b4cb-614bf6f86422 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags" status: 204 len: 0 microversion: 2.26 time: 0.228191 Oct 27 19:18:52.781974 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2869/5895] 10.222.0.42 () {60 vars in 1295 bytes} [Thu Oct 27 19:18:52 2022] DELETE /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:18:52.790014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2f92d211-d7c6-4b5e-830f-0d2b9e5ccca3 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc869d60b80>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:52.805202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f92d211-d7c6-4b5e-830f-0d2b9e5ccca3 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.805717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f92d211-d7c6-4b5e-830f-0d2b9e5ccca3 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.806170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f92d211-d7c6-4b5e-830f-0d2b9e5ccca3 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.845998 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2f92d211-d7c6-4b5e-830f-0d2b9e5ccca3 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags" status: 200 len: 12 microversion: 2.26 time: 0.056109 Oct 27 19:18:52.852293 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3027/5896] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Oct 27 19:18:52 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags => generated 12 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:52.886824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc86992b940>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:52.914203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.915078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.918699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.920282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:52.952857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.970841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.971894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:52.972917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:52.973539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:52.974109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.037594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.038686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.039649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.060334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lazy-loading 'flavor' on Instance uuid 77e1e481-e4bd-4319-84df-7d29eb468496 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:18:53.097701 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3cfdf829-b34a-4c87-8f4c-2a397a4706f8 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags" status: 204 len: 0 microversion: 2.26 time: 0.243752 Oct 27 19:18:53.107405 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2870/5897] 10.222.0.42 () {60 vars in 1295 bytes} [Thu Oct 27 19:18:52 2022] DELETE /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:18:53.115039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc869da3af0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:53.154067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.154643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.155102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.155606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:53.174930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.175434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.175884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.176852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.177471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.178017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.228624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.229500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.230268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.250116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.250922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.251329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.286097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lazy-loading 'flavor' on Instance uuid 77e1e481-e4bd-4319-84df-7d29eb468496 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:18:53.343335 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ced99db8-5a88-4317-a8f5-8906d04ce5f5 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "PUT /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-1244309453" status: 201 len: 0 microversion: 2.26 time: 0.235116 Oct 27 19:18:53.344468 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3028/5898] 10.222.0.42 () {62 vars in 1380 bytes} [Thu Oct 27 19:18:53 2022] PUT /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-1244309453 => generated 0 bytes in 237 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 27 19:18:53.356638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc869b23430>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:53.371914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.372667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.373124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.373623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:53.381381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.381889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.382342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.383222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.383690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.384444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.423984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.423984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.423984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.433283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.435139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.435139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.476738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lazy-loading 'flavor' on Instance uuid 77e1e481-e4bd-4319-84df-7d29eb468496 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:18:53.500547 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d494fbfb-2a44-4f90-b77b-60546d33e281 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "PUT /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-704633165" status: 201 len: 0 microversion: 2.26 time: 0.147890 Oct 27 19:18:53.506411 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2871/5899] 10.222.0.42 () {62 vars in 1377 bytes} [Thu Oct 27 19:18:53 2022] PUT /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags/tempest-tag-704633165 => generated 0 bytes in 150 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 27 19:18:53.514733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Action: 'update_all', calling method: .version_select at 0x7fc86a984700>, body: {"tags": ["tempest-tag-131321010", "tempest-tag-39274661"]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:18:53.529570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.530246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.530722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.531340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:53.539940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.540696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.541315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.542166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.542795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.543551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.574981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.575770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.576477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.601983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lazy-loading 'flavor' on Instance uuid 77e1e481-e4bd-4319-84df-7d29eb468496 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:18:53.626960 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b57433c-3aa7-4a40-9451-a266c6e3d756 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "PUT /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags" status: 200 len: 59 microversion: 2.26 time: 0.118863 Oct 27 19:18:53.628267 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3029/5900] 10.222.0.42 () {62 vars in 1312 bytes} [Thu Oct 27 19:18:53 2022] PUT /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags => generated 59 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:18:53.640572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bcf2ed3a-c50c-4a93-9c2a-c5ab7600b90f tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc86a38f280>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:53.649791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcf2ed3a-c50c-4a93-9c2a-c5ab7600b90f tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.650301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcf2ed3a-c50c-4a93-9c2a-c5ab7600b90f tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.650794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bcf2ed3a-c50c-4a93-9c2a-c5ab7600b90f tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.662358 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bcf2ed3a-c50c-4a93-9c2a-c5ab7600b90f tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags" status: 200 len: 59 microversion: 2.26 time: 0.026396 Oct 27 19:18:53.663767 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2872/5901] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Oct 27 19:18:53 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags => generated 59 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:18:53.674743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '.version_select at 0x7fc86a6d39d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:53.683602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.684091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.684532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.685010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:53.691086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.691574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.692012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.692711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.693172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.694354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.721470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.721964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.722493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.743639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lazy-loading 'flavor' on Instance uuid 77e1e481-e4bd-4319-84df-7d29eb468496 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:18:53.765086 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bf9d3410-95dc-4fc2-a048-7347cdb608fa tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags" status: 204 len: 0 microversion: 2.26 time: 0.094370 Oct 27 19:18:53.772490 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3030/5902] 10.222.0.42 () {60 vars in 1295 bytes} [Thu Oct 27 19:18:53 2022] DELETE /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496/tags => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 19:18:53.799239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-82125eec-2954-496c-8df6-d95f81eee54c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:53.800191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-82125eec-2954-496c-8df6-d95f81eee54c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:53.810506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82125eec-2954-496c-8df6-d95f81eee54c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.811729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82125eec-2954-496c-8df6-d95f81eee54c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.812522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82125eec-2954-496c-8df6-d95f81eee54c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.813876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82125eec-2954-496c-8df6-d95f81eee54c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:53.814742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82125eec-2954-496c-8df6-d95f81eee54c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:53.815895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82125eec-2954-496c-8df6-d95f81eee54c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:53.855472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-82125eec-2954-496c-8df6-d95f81eee54c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:18:53.900784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:18:53.976664 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-82125eec-2954-496c-8df6-d95f81eee54c tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 204 len: 0 microversion: 2.26 time: 0.198532 Oct 27 19:18:53.978053 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2873/5903] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 19:18:53 2022] DELETE /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:18:53.986672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d51d8008-ec2d-457e-92e9-7811d59e3ceb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:53.987621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d51d8008-ec2d-457e-92e9-7811d59e3ceb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:54.002839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d51d8008-ec2d-457e-92e9-7811d59e3ceb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:54.005081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d51d8008-ec2d-457e-92e9-7811d59e3ceb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:54.015110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d51d8008-ec2d-457e-92e9-7811d59e3ceb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:54.016090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d51d8008-ec2d-457e-92e9-7811d59e3ceb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:54.016656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d51d8008-ec2d-457e-92e9-7811d59e3ceb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:54.017315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d51d8008-ec2d-457e-92e9-7811d59e3ceb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:54.245356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d51d8008-ec2d-457e-92e9-7811d59e3ceb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:54.260950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d51d8008-ec2d-457e-92e9-7811d59e3ceb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:54.262436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d51d8008-ec2d-457e-92e9-7811d59e3ceb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:54.263664 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d51d8008-ec2d-457e-92e9-7811d59e3ceb tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1552 microversion: 2.26 time: 0.281596 Oct 27 19:18:54.264213 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3031/5904] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:53 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1552 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:18:55.296505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7ffe7941-dcdb-4563-9d4e-cbf67addff2d tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:55.301012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7ffe7941-dcdb-4563-9d4e-cbf67addff2d tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:55.316161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ffe7941-dcdb-4563-9d4e-cbf67addff2d tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:55.316954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ffe7941-dcdb-4563-9d4e-cbf67addff2d tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:55.317821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ffe7941-dcdb-4563-9d4e-cbf67addff2d tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:55.320358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ffe7941-dcdb-4563-9d4e-cbf67addff2d tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:55.320906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ffe7941-dcdb-4563-9d4e-cbf67addff2d tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:55.321397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7ffe7941-dcdb-4563-9d4e-cbf67addff2d tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:55.572886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7ffe7941-dcdb-4563-9d4e-cbf67addff2d tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:55.586335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7ffe7941-dcdb-4563-9d4e-cbf67addff2d tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:55.589184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7ffe7941-dcdb-4563-9d4e-cbf67addff2d tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:55.592403 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7ffe7941-dcdb-4563-9d4e-cbf67addff2d tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1552 microversion: 2.26 time: 0.302308 Oct 27 19:18:55.602436 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2874/5905] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:55 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1552 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:18:56.238044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0931b537-796a-463d-b1d4-d1f688e5d77a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:18:56.242499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0931b537-796a-463d-b1d4-d1f688e5d77a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:56.255078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0931b537-796a-463d-b1d4-d1f688e5d77a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:56.256980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0931b537-796a-463d-b1d4-d1f688e5d77a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:56.258137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0931b537-796a-463d-b1d4-d1f688e5d77a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:56.260296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0931b537-796a-463d-b1d4-d1f688e5d77a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:56.262349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0931b537-796a-463d-b1d4-d1f688e5d77a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:56.264298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0931b537-796a-463d-b1d4-d1f688e5d77a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:56.354483 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0931b537-796a-463d-b1d4-d1f688e5d77a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007/action" status: 200 len: 24570 microversion: 2.1 time: 0.121973 Oct 27 19:18:56.355892 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3032/5906] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:18:56 2022] POST /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007/action => generated 24570 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:18:56.622590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e202499f-89fc-487f-8578-7c984b949146 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:56.623217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e202499f-89fc-487f-8578-7c984b949146 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:56.631312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e202499f-89fc-487f-8578-7c984b949146 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:56.631817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e202499f-89fc-487f-8578-7c984b949146 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:56.632263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e202499f-89fc-487f-8578-7c984b949146 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:56.632976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e202499f-89fc-487f-8578-7c984b949146 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:56.633440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e202499f-89fc-487f-8578-7c984b949146 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:56.633876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e202499f-89fc-487f-8578-7c984b949146 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:56.728002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-aae807e9-5cb2-4182-95bd-048e7f35b6fd req-be79ab81-6587-4f52-8013-ef34da34661a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e1e481-e4bd-4319-84df-7d29eb468496", "name": "network-vif-deleted", "tag": "ef765d9d-f8e8-45db-86e5-1d6164b75b1c"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:18:56.759718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-aae807e9-5cb2-4182-95bd-048e7f35b6fd req-be79ab81-6587-4f52-8013-ef34da34661a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:56.761820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-aae807e9-5cb2-4182-95bd-048e7f35b6fd req-be79ab81-6587-4f52-8013-ef34da34661a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:56.762903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-aae807e9-5cb2-4182-95bd-048e7f35b6fd req-be79ab81-6587-4f52-8013-ef34da34661a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:56.783434 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-aae807e9-5cb2-4182-95bd-048e7f35b6fd req-be79ab81-6587-4f52-8013-ef34da34661a service nova] Creating event network-vif-deleted:ef765d9d-f8e8-45db-86e5-1d6164b75b1c for instance 77e1e481-e4bd-4319-84df-7d29eb468496 on n-h1-860687-3 Oct 27 19:18:56.789041 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-aae807e9-5cb2-4182-95bd-048e7f35b6fd req-be79ab81-6587-4f52-8013-ef34da34661a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068461 Oct 27 19:18:56.790736 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3033/5907] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:18:56.912084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e202499f-89fc-487f-8578-7c984b949146 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:56.945441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e202499f-89fc-487f-8578-7c984b949146 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:56.947451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e202499f-89fc-487f-8578-7c984b949146 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc7445fdce4f43d69c5d93c921621830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6e155425334a5ba8773186e4f6db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:18:56.953257 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e202499f-89fc-487f-8578-7c984b949146 tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 200 len: 1510 microversion: 2.26 time: 0.334332 Oct 27 19:18:56.954713 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2875/5908] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:56 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 1510 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:18:57.985391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9792687b-c14d-482a-909f-c1beb9b96abf tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:18:57.987042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9792687b-c14d-482a-909f-c1beb9b96abf tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] [instance: 77e1e481-e4bd-4319-84df-7d29eb468496] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:18:58.003652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9792687b-c14d-482a-909f-c1beb9b96abf tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:58.004313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9792687b-c14d-482a-909f-c1beb9b96abf tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:58.004778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9792687b-c14d-482a-909f-c1beb9b96abf tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:58.005514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9792687b-c14d-482a-909f-c1beb9b96abf tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:18:58.006021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9792687b-c14d-482a-909f-c1beb9b96abf tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:18:58.006493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9792687b-c14d-482a-909f-c1beb9b96abf tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:18:58.043415 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-9792687b-c14d-482a-909f-c1beb9b96abf tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] HTTP exception thrown: Instance 77e1e481-e4bd-4319-84df-7d29eb468496 could not be found. Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9792687b-c14d-482a-909f-c1beb9b96abf tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Request method failure captured: Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 HTTP/1.1 Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtmIlz01p41GxYsiCKtdeKvnjU-Lt6Ypv_IIYK6ciJlfTq3dpVii33CL1oH15HJpvJsOz58UpKRAB6oXzS-atn5h2tgDA6SKdWZ9swWQrW4UaLxJXQNLcSQ1E3n_y5UmBrDwh8ipU2UF57JKi8xRos3FK0klsu5FSx1Oy6aNCtaYVKw Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.26 Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: fc6e155425334a5ba8773186e4f6db6a Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerTagsTestJSON-1737963284 Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fc6e155425334a5ba8773186e4f6db6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fc6e155425334a5ba8773186e4f6db6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fc6e155425334a5ba8773186e4f6db6a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fc6e155425334a5ba8773186e4f6db6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerTagsTestJSON-1737963284 Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: fc6e155425334a5ba8773186e4f6db6a Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerTagsTestJSON-1737963284 Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerTagsTestJSON-1737963284-project Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: bc7445fdce4f43d69c5d93c921621830 Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerTagsTestJSON-1737963284-project Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 77e1e481-e4bd-4319-84df-7d29eb468496 could not be found. Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '77e1e481-e4bd-4319-84df-7d29eb468496'} Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e1e481-e4bd-4319-84df-7d29eb468496 could not be found. Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e1e481-e4bd-4319-84df-7d29eb468496 could not be found. Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:18:58.047842 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:58.051024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:18:58.051024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:18:58.051024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:18:58.051024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:18:58.051024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:18:58.051024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e1e481-e4bd-4319-84df-7d29eb468496 could not be found. Oct 27 19:18:58.051024 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:18:58.051024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9792687b-c14d-482a-909f-c1beb9b96abf tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] Returning 404 to user: Instance 77e1e481-e4bd-4319-84df-7d29eb468496 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:18:58.051024 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9792687b-c14d-482a-909f-c1beb9b96abf tempest-ServerTagsTestJSON-1737963284 tempest-ServerTagsTestJSON-1737963284-project] 10.222.0.42 "GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496" status: 404 len: 111 microversion: 2.26 time: 0.070806 Oct 27 19:18:58.051024 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3034/5909] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:18:57 2022] GET /compute/v2.1/servers/77e1e481-e4bd-4319-84df-7d29eb468496 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:19:07.332549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:19:07.334284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=16,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:19:07.468465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-430797082", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": "none"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:19:07.565350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:19:07.566155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:19:07.566672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:19:07.567204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:19:07.569594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:19:07.591353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:07.591897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:07.593694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:07.594489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:07.594964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:07.595403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:07.620352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Getting quotas for project 6531d08e10024a3fbf4704fb80ceb01a. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:19:07.627291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Getting quotas for user c84decd0d8c24c10961c0d70aab00426 and project 6531d08e10024a3fbf4704fb80ceb01a. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:19:07.653129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:19:07.657040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:19:07.768029 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f88e026d-3653-4ba6-bb43-a4ed9d7c7a5f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.441567 Oct 27 19:19:07.768691 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2876/5910] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 19:19:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 19:19:07.780306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f14e2e9e-10f1-4bf4-a676-7b937f857c4e tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:07.780974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f14e2e9e-10f1-4bf4-a676-7b937f857c4e tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:07.901419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f14e2e9e-10f1-4bf4-a676-7b937f857c4e tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:07.903104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f14e2e9e-10f1-4bf4-a676-7b937f857c4e tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:07.904901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f14e2e9e-10f1-4bf4-a676-7b937f857c4e tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:07.906103 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f14e2e9e-10f1-4bf4-a676-7b937f857c4e tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1277 microversion: 2.54 time: 0.129816 Oct 27 19:19:07.907161 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3035/5911] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:07 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:08.940885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-58e50f45-7ea7-4514-b9c4-ac1c2db94154 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:08.941517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-58e50f45-7ea7-4514-b9c4-ac1c2db94154 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:08.960663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58e50f45-7ea7-4514-b9c4-ac1c2db94154 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:08.961341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58e50f45-7ea7-4514-b9c4-ac1c2db94154 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:08.961937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58e50f45-7ea7-4514-b9c4-ac1c2db94154 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:08.963026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58e50f45-7ea7-4514-b9c4-ac1c2db94154 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:08.963724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58e50f45-7ea7-4514-b9c4-ac1c2db94154 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:08.964376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58e50f45-7ea7-4514-b9c4-ac1c2db94154 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:09.169331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-58e50f45-7ea7-4514-b9c4-ac1c2db94154 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:09.184189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-58e50f45-7ea7-4514-b9c4-ac1c2db94154 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:09.187275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-58e50f45-7ea7-4514-b9c4-ac1c2db94154 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:09.188819 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-58e50f45-7ea7-4514-b9c4-ac1c2db94154 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1329 microversion: 2.54 time: 0.253203 Oct 27 19:19:09.189935 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2877/5912] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:08 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1329 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:10.221097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dea235de-337f-4865-80dd-16985adc79a5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:10.223445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dea235de-337f-4865-80dd-16985adc79a5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:10.227199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:DELETE=3,nova_cell1:SELECT=65,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:19:10.228619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=60 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:19:10.237412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dea235de-337f-4865-80dd-16985adc79a5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:10.238135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dea235de-337f-4865-80dd-16985adc79a5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:10.239560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dea235de-337f-4865-80dd-16985adc79a5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:10.243060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dea235de-337f-4865-80dd-16985adc79a5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:10.243833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dea235de-337f-4865-80dd-16985adc79a5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:10.244393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dea235de-337f-4865-80dd-16985adc79a5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:10.377164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dea235de-337f-4865-80dd-16985adc79a5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:10.389420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dea235de-337f-4865-80dd-16985adc79a5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:10.392321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dea235de-337f-4865-80dd-16985adc79a5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:10.394252 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dea235de-337f-4865-80dd-16985adc79a5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1335 microversion: 2.54 time: 0.177615 Oct 27 19:19:10.397787 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3036/5913] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:10 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1335 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:11.425133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3f0b2cc4-7591-402a-85b3-c6af27b60d07 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:11.426468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3f0b2cc4-7591-402a-85b3-c6af27b60d07 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:11.439405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f0b2cc4-7591-402a-85b3-c6af27b60d07 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:11.440602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f0b2cc4-7591-402a-85b3-c6af27b60d07 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:11.441887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f0b2cc4-7591-402a-85b3-c6af27b60d07 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:11.443015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f0b2cc4-7591-402a-85b3-c6af27b60d07 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:11.444074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f0b2cc4-7591-402a-85b3-c6af27b60d07 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:11.445019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f0b2cc4-7591-402a-85b3-c6af27b60d07 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:11.577111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3f0b2cc4-7591-402a-85b3-c6af27b60d07 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:11.591214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3f0b2cc4-7591-402a-85b3-c6af27b60d07 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:11.593116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3f0b2cc4-7591-402a-85b3-c6af27b60d07 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:11.594274 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3f0b2cc4-7591-402a-85b3-c6af27b60d07 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1335 microversion: 2.54 time: 0.173488 Oct 27 19:19:11.594964 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2878/5914] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:11 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1335 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:12.627222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d373b3f1-79e6-4e3c-aa8e-8cb7326ae3a0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:12.628537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d373b3f1-79e6-4e3c-aa8e-8cb7326ae3a0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:12.643944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d373b3f1-79e6-4e3c-aa8e-8cb7326ae3a0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:12.644798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d373b3f1-79e6-4e3c-aa8e-8cb7326ae3a0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:12.645453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d373b3f1-79e6-4e3c-aa8e-8cb7326ae3a0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:12.646983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d373b3f1-79e6-4e3c-aa8e-8cb7326ae3a0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:12.647672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d373b3f1-79e6-4e3c-aa8e-8cb7326ae3a0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:12.648319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d373b3f1-79e6-4e3c-aa8e-8cb7326ae3a0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:12.780225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d373b3f1-79e6-4e3c-aa8e-8cb7326ae3a0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:12.815814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d373b3f1-79e6-4e3c-aa8e-8cb7326ae3a0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:12.822656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d373b3f1-79e6-4e3c-aa8e-8cb7326ae3a0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:12.828828 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d373b3f1-79e6-4e3c-aa8e-8cb7326ae3a0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1356 microversion: 2.54 time: 0.205441 Oct 27 19:19:12.829592 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3037/5915] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:12 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1356 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:12.858701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5227dd71-632b-4d6a-8cb5-ad4c5d8d2d25 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Action: 'create', calling method: .version_select at 0x7fc8698dfca0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-116059674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrpPNx0r6p7y2Mt7OU/kjY9cYLD89mi7Ckf7F0PvPUPADrUu5Sto83cumT+nkIJTUXqvZRjknB0ZA+N/2VjoOgpSPLkgcpxxRAwOk0mbULU1pfyh7upIAzThvT5qNEyXg=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:19:12.880125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-5227dd71-632b-4d6a-8cb5-ad4c5d8d2d25 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Getting quotas for project 6531d08e10024a3fbf4704fb80ceb01a. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:19:12.887263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-5227dd71-632b-4d6a-8cb5-ad4c5d8d2d25 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Getting quotas for user c84decd0d8c24c10961c0d70aab00426 and project 6531d08e10024a3fbf4704fb80ceb01a. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:19:12.939994 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5227dd71-632b-4d6a-8cb5-ad4c5d8d2d25 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.082516 Oct 27 19:19:12.967799 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2879/5916] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Oct 27 19:19:12 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 19:19:12.973788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-116059674", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:19:12.977496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:12.993649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:13.002310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:13.002850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:13.003622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:13.005582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:13.006107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:13.201908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:19:13.202685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:19:13.203546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:19:13.204443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:19:13.205106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:19:13.372156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:13.398019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:13.398918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:13.399590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:13.402801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:13.404377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:13.405051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:13.478528 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cbf81a30-6118-44ca-b1b8-c1466ac83b33 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "POST /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c/action" status: 202 len: 1138 microversion: 2.54 time: 0.508828 Oct 27 19:19:13.481883 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3038/5917] 10.222.0.42 () {62 vars in 1320 bytes} [Thu Oct 27 19:19:12 2022] POST /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c/action => generated 1138 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 19:19:13.503663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2e66c23f-0c5c-4bf1-bf46-646c7b7de870 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:13.504300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2e66c23f-0c5c-4bf1-bf46-646c7b7de870 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:13.528378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e66c23f-0c5c-4bf1-bf46-646c7b7de870 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:13.528894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e66c23f-0c5c-4bf1-bf46-646c7b7de870 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:13.529470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e66c23f-0c5c-4bf1-bf46-646c7b7de870 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:13.530205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e66c23f-0c5c-4bf1-bf46-646c7b7de870 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:13.530703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e66c23f-0c5c-4bf1-bf46-646c7b7de870 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:13.531194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e66c23f-0c5c-4bf1-bf46-646c7b7de870 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:13.649611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2e66c23f-0c5c-4bf1-bf46-646c7b7de870 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:13.659534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2e66c23f-0c5c-4bf1-bf46-646c7b7de870 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:13.661654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2e66c23f-0c5c-4bf1-bf46-646c7b7de870 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:13.663227 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2e66c23f-0c5c-4bf1-bf46-646c7b7de870 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.164055 Oct 27 19:19:13.664438 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2880/5918] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:13 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:14.692240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-482aab4b-8350-4081-8a94-006fcb071f88 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:14.692861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-482aab4b-8350-4081-8a94-006fcb071f88 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:14.702760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-482aab4b-8350-4081-8a94-006fcb071f88 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:14.703262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-482aab4b-8350-4081-8a94-006fcb071f88 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:14.703710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-482aab4b-8350-4081-8a94-006fcb071f88 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:14.704428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-482aab4b-8350-4081-8a94-006fcb071f88 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:14.704889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-482aab4b-8350-4081-8a94-006fcb071f88 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:14.710427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-482aab4b-8350-4081-8a94-006fcb071f88 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:14.837300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-482aab4b-8350-4081-8a94-006fcb071f88 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:14.846182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-482aab4b-8350-4081-8a94-006fcb071f88 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:14.851432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-482aab4b-8350-4081-8a94-006fcb071f88 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:14.857255 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-482aab4b-8350-4081-8a94-006fcb071f88 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.168941 Oct 27 19:19:14.860050 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3039/5919] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:14 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:15.894008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-086b448b-a890-4cee-917d-1bf7eddc6320 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:15.895202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-086b448b-a890-4cee-917d-1bf7eddc6320 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:15.905685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-086b448b-a890-4cee-917d-1bf7eddc6320 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:15.906362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-086b448b-a890-4cee-917d-1bf7eddc6320 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:15.906971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-086b448b-a890-4cee-917d-1bf7eddc6320 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:15.909161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-086b448b-a890-4cee-917d-1bf7eddc6320 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:15.909783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-086b448b-a890-4cee-917d-1bf7eddc6320 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:15.910910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-086b448b-a890-4cee-917d-1bf7eddc6320 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:16.058678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-086b448b-a890-4cee-917d-1bf7eddc6320 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:16.083460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-086b448b-a890-4cee-917d-1bf7eddc6320 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:16.090576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-086b448b-a890-4cee-917d-1bf7eddc6320 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:16.092024 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-086b448b-a890-4cee-917d-1bf7eddc6320 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.202893 Oct 27 19:19:16.094431 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2881/5920] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:15 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:17.141924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-48d4b71c-e68f-4d83-9700-a383ffb83536 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:17.142637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-48d4b71c-e68f-4d83-9700-a383ffb83536 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:17.153935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48d4b71c-e68f-4d83-9700-a383ffb83536 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:17.154765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48d4b71c-e68f-4d83-9700-a383ffb83536 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:17.155377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48d4b71c-e68f-4d83-9700-a383ffb83536 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:17.156257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48d4b71c-e68f-4d83-9700-a383ffb83536 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:17.158999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48d4b71c-e68f-4d83-9700-a383ffb83536 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:17.159655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48d4b71c-e68f-4d83-9700-a383ffb83536 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:17.281575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-48d4b71c-e68f-4d83-9700-a383ffb83536 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:17.291289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-48d4b71c-e68f-4d83-9700-a383ffb83536 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:17.292997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-48d4b71c-e68f-4d83-9700-a383ffb83536 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:17.294846 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-48d4b71c-e68f-4d83-9700-a383ffb83536 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.157738 Oct 27 19:19:17.307481 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3040/5921] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:17 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:18.324553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-73c64d5a-48e0-4b98-90bd-952d78d82444 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:18.325178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-73c64d5a-48e0-4b98-90bd-952d78d82444 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:18.340431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:19:18.342087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73c64d5a-48e0-4b98-90bd-952d78d82444 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:18.342650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73c64d5a-48e0-4b98-90bd-952d78d82444 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:18.343070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73c64d5a-48e0-4b98-90bd-952d78d82444 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:18.343793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73c64d5a-48e0-4b98-90bd-952d78d82444 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:18.344257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73c64d5a-48e0-4b98-90bd-952d78d82444 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:18.344699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73c64d5a-48e0-4b98-90bd-952d78d82444 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:18.596202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-73c64d5a-48e0-4b98-90bd-952d78d82444 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:18.615265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-73c64d5a-48e0-4b98-90bd-952d78d82444 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:18.616929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-73c64d5a-48e0-4b98-90bd-952d78d82444 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:18.642874 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-73c64d5a-48e0-4b98-90bd-952d78d82444 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.322110 Oct 27 19:19:18.644575 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2882/5922] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:18 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:19.669520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:19:19.676532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af5d418b-1a80-49fc-8fd3-821929294c53 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:19.677115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-af5d418b-1a80-49fc-8fd3-821929294c53 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:19.691461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af5d418b-1a80-49fc-8fd3-821929294c53 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:19.692215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af5d418b-1a80-49fc-8fd3-821929294c53 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:19.694074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af5d418b-1a80-49fc-8fd3-821929294c53 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:19.697447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af5d418b-1a80-49fc-8fd3-821929294c53 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:19.698403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af5d418b-1a80-49fc-8fd3-821929294c53 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:19.699238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af5d418b-1a80-49fc-8fd3-821929294c53 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:19.875297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-af5d418b-1a80-49fc-8fd3-821929294c53 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:19.888134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-af5d418b-1a80-49fc-8fd3-821929294c53 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:19.898094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-af5d418b-1a80-49fc-8fd3-821929294c53 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:19.903470 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-af5d418b-1a80-49fc-8fd3-821929294c53 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.233297 Oct 27 19:19:19.905190 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3041/5923] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:19 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:20.935666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f305522c-70af-4cf4-a843-a75e1302464f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:20.937095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f305522c-70af-4cf4-a843-a75e1302464f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:20.948212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f305522c-70af-4cf4-a843-a75e1302464f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:20.950114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f305522c-70af-4cf4-a843-a75e1302464f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:20.962049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f305522c-70af-4cf4-a843-a75e1302464f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:20.962857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f305522c-70af-4cf4-a843-a75e1302464f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:20.963530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f305522c-70af-4cf4-a843-a75e1302464f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:20.964086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f305522c-70af-4cf4-a843-a75e1302464f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:21.116263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f305522c-70af-4cf4-a843-a75e1302464f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:21.127716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f305522c-70af-4cf4-a843-a75e1302464f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:21.129193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f305522c-70af-4cf4-a843-a75e1302464f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:21.138587 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f305522c-70af-4cf4-a843-a75e1302464f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.198745 Oct 27 19:19:21.154781 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2883/5924] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:20 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:22.164393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b6287ac5-d5a6-4e6a-b8ca-41765bd664e1 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:22.165909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b6287ac5-d5a6-4e6a-b8ca-41765bd664e1 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:22.173923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6287ac5-d5a6-4e6a-b8ca-41765bd664e1 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:22.174737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6287ac5-d5a6-4e6a-b8ca-41765bd664e1 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:22.175353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6287ac5-d5a6-4e6a-b8ca-41765bd664e1 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:22.176229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6287ac5-d5a6-4e6a-b8ca-41765bd664e1 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:22.176838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6287ac5-d5a6-4e6a-b8ca-41765bd664e1 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:22.178009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6287ac5-d5a6-4e6a-b8ca-41765bd664e1 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:22.733222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b6287ac5-d5a6-4e6a-b8ca-41765bd664e1 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:22.749288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b6287ac5-d5a6-4e6a-b8ca-41765bd664e1 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:22.752248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b6287ac5-d5a6-4e6a-b8ca-41765bd664e1 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:22.754452 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b6287ac5-d5a6-4e6a-b8ca-41765bd664e1 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.593813 Oct 27 19:19:22.770374 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3042/5925] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:22 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:23.782680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dcbed96c-ffeb-48c5-bc4a-abce8f2f5fe6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:23.785416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dcbed96c-ffeb-48c5-bc4a-abce8f2f5fe6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:23.792202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=10 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:19:23.819381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcbed96c-ffeb-48c5-bc4a-abce8f2f5fe6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:23.820789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcbed96c-ffeb-48c5-bc4a-abce8f2f5fe6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:23.824858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcbed96c-ffeb-48c5-bc4a-abce8f2f5fe6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:23.825806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcbed96c-ffeb-48c5-bc4a-abce8f2f5fe6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:23.828175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcbed96c-ffeb-48c5-bc4a-abce8f2f5fe6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:23.829083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcbed96c-ffeb-48c5-bc4a-abce8f2f5fe6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:23.984807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dcbed96c-ffeb-48c5-bc4a-abce8f2f5fe6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:24.000848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dcbed96c-ffeb-48c5-bc4a-abce8f2f5fe6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:24.008008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dcbed96c-ffeb-48c5-bc4a-abce8f2f5fe6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:24.013340 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dcbed96c-ffeb-48c5-bc4a-abce8f2f5fe6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.235805 Oct 27 19:19:24.031524 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2884/5926] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:23 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:19:25.047645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7f315055-7b3a-495a-ba7d-a7f56a56b0e6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:25.048797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7f315055-7b3a-495a-ba7d-a7f56a56b0e6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:25.062223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f315055-7b3a-495a-ba7d-a7f56a56b0e6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:25.065969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f315055-7b3a-495a-ba7d-a7f56a56b0e6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:25.067020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f315055-7b3a-495a-ba7d-a7f56a56b0e6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:25.068510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f315055-7b3a-495a-ba7d-a7f56a56b0e6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:25.069230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f315055-7b3a-495a-ba7d-a7f56a56b0e6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:25.070034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f315055-7b3a-495a-ba7d-a7f56a56b0e6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:25.257017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7f315055-7b3a-495a-ba7d-a7f56a56b0e6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:25.270463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7f315055-7b3a-495a-ba7d-a7f56a56b0e6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:25.272501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7f315055-7b3a-495a-ba7d-a7f56a56b0e6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:25.273700 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7f315055-7b3a-495a-ba7d-a7f56a56b0e6 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.230937 Oct 27 19:19:25.288151 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3043/5927] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:25 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:26.308239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-adc00c43-60d7-42f3-af53-ddbc21dc3a7b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:26.309114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-adc00c43-60d7-42f3-af53-ddbc21dc3a7b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:26.329775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adc00c43-60d7-42f3-af53-ddbc21dc3a7b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:26.330297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adc00c43-60d7-42f3-af53-ddbc21dc3a7b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:26.330829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adc00c43-60d7-42f3-af53-ddbc21dc3a7b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:26.331552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adc00c43-60d7-42f3-af53-ddbc21dc3a7b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:26.332179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adc00c43-60d7-42f3-af53-ddbc21dc3a7b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:26.339211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adc00c43-60d7-42f3-af53-ddbc21dc3a7b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:26.591574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-adc00c43-60d7-42f3-af53-ddbc21dc3a7b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:26.603487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-adc00c43-60d7-42f3-af53-ddbc21dc3a7b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:26.611590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-adc00c43-60d7-42f3-af53-ddbc21dc3a7b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:26.619368 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-adc00c43-60d7-42f3-af53-ddbc21dc3a7b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.320798 Oct 27 19:19:26.621528 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2885/5928] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:26 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:27.096318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9b8d8642-ad0c-4ae2-a6dd-da44b4692e63 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:27.096952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9b8d8642-ad0c-4ae2-a6dd-da44b4692e63 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:27.103890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b8d8642-ad0c-4ae2-a6dd-da44b4692e63 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:27.105266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b8d8642-ad0c-4ae2-a6dd-da44b4692e63 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:27.105878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b8d8642-ad0c-4ae2-a6dd-da44b4692e63 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:27.106943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b8d8642-ad0c-4ae2-a6dd-da44b4692e63 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:27.115685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b8d8642-ad0c-4ae2-a6dd-da44b4692e63 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:27.116423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b8d8642-ad0c-4ae2-a6dd-da44b4692e63 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:27.649780 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9b8d8642-ad0c-4ae2-a6dd-da44b4692e63 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1833 microversion: 2.1 time: 1.089815 Oct 27 19:19:27.652259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1cc30c09-aa0b-42a4-afb9-d82d7a7707eb tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:27.658083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1cc30c09-aa0b-42a4-afb9-d82d7a7707eb tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:27.663781 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3044/5929] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:26 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1833 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:27.684704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1cc30c09-aa0b-42a4-afb9-d82d7a7707eb tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:27.685206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1cc30c09-aa0b-42a4-afb9-d82d7a7707eb tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:27.689177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1cc30c09-aa0b-42a4-afb9-d82d7a7707eb tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:27.690159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1cc30c09-aa0b-42a4-afb9-d82d7a7707eb tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:27.695102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1cc30c09-aa0b-42a4-afb9-d82d7a7707eb tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:27.695597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1cc30c09-aa0b-42a4-afb9-d82d7a7707eb tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:27.887669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1cc30c09-aa0b-42a4-afb9-d82d7a7707eb tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:27.917016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1cc30c09-aa0b-42a4-afb9-d82d7a7707eb tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:27.925241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1cc30c09-aa0b-42a4-afb9-d82d7a7707eb tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:27.932193 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1cc30c09-aa0b-42a4-afb9-d82d7a7707eb tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.285445 Oct 27 19:19:27.934236 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2886/5930] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:27 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:27.982082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42c97937-f5d2-4379-a750-3381e0773fb3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:27.982736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-42c97937-f5d2-4379-a750-3381e0773fb3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:27.994802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c97937-f5d2-4379-a750-3381e0773fb3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:27.995308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c97937-f5d2-4379-a750-3381e0773fb3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:27.995753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c97937-f5d2-4379-a750-3381e0773fb3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:27.996472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c97937-f5d2-4379-a750-3381e0773fb3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:27.996934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c97937-f5d2-4379-a750-3381e0773fb3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:27.997365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c97937-f5d2-4379-a750-3381e0773fb3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:28.339731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-42c97937-f5d2-4379-a750-3381e0773fb3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:28.351819 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-42c97937-f5d2-4379-a750-3381e0773fb3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1682 microversion: 2.1 time: 0.677636 Oct 27 19:19:28.352761 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3045/5931] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:27 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1682 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:28.547594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55bace95-6e92-4b50-809e-a608c109695a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:19:28.555144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-55bace95-6e92-4b50-809e-a608c109695a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:28.585714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55bace95-6e92-4b50-809e-a608c109695a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:28.586453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55bace95-6e92-4b50-809e-a608c109695a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:28.587087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55bace95-6e92-4b50-809e-a608c109695a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:28.587993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55bace95-6e92-4b50-809e-a608c109695a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:28.588616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55bace95-6e92-4b50-809e-a608c109695a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:28.589885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55bace95-6e92-4b50-809e-a608c109695a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:28.689356 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-55bace95-6e92-4b50-809e-a608c109695a tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007/action" status: 200 len: 32645 microversion: 2.1 time: 0.149477 Oct 27 19:19:28.700278 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2887/5932] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:19:28 2022] POST /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007/action => generated 32645 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:19:28.835574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c06d038d-202d-41a8-844e-9477643d2c3e tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:19:28.836467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c06d038d-202d-41a8-844e-9477643d2c3e tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:28.843925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c06d038d-202d-41a8-844e-9477643d2c3e tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:28.844656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c06d038d-202d-41a8-844e-9477643d2c3e tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:28.845279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c06d038d-202d-41a8-844e-9477643d2c3e tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:28.846162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c06d038d-202d-41a8-844e-9477643d2c3e tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:28.846821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c06d038d-202d-41a8-844e-9477643d2c3e tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:28.847401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c06d038d-202d-41a8-844e-9477643d2c3e tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:28.907552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c06d038d-202d-41a8-844e-9477643d2c3e tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5224b07141384791bdfd5a16986d9b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a0529a19b14548882cacde0c56403c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:28.908432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c06d038d-202d-41a8-844e-9477643d2c3e tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] flavor_id is None. Assuming migration. {{(pid=127029) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 27 19:19:28.908803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c06d038d-202d-41a8-844e-9477643d2c3e tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127029) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 19:19:28.967747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c4f48d5f-ae77-49e9-a30e-4c31d9054d66 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:28.968794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c4f48d5f-ae77-49e9-a30e-4c31d9054d66 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:28.984518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4f48d5f-ae77-49e9-a30e-4c31d9054d66 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:28.990306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4f48d5f-ae77-49e9-a30e-4c31d9054d66 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:28.990870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4f48d5f-ae77-49e9-a30e-4c31d9054d66 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:28.991618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4f48d5f-ae77-49e9-a30e-4c31d9054d66 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:28.992182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4f48d5f-ae77-49e9-a30e-4c31d9054d66 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:28.993597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4f48d5f-ae77-49e9-a30e-4c31d9054d66 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:29.161478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c4f48d5f-ae77-49e9-a30e-4c31d9054d66 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:29.184116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c4f48d5f-ae77-49e9-a30e-4c31d9054d66 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:29.188001 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c06d038d-202d-41a8-844e-9477643d2c3e tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007/action" status: 202 len: 0 microversion: 2.1 time: 0.356214 Oct 27 19:19:29.188741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c4f48d5f-ae77-49e9-a30e-4c31d9054d66 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:29.190740 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c4f48d5f-ae77-49e9-a30e-4c31d9054d66 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.228638 Oct 27 19:19:29.197107 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2888/5934] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:28 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:19:29.198429 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3046/5933] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:19:28 2022] POST /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:19:29.217504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5607f64e-2a25-48e5-a44f-01e5fe07cefe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:29.221190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5607f64e-2a25-48e5-a44f-01e5fe07cefe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:29.241872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5607f64e-2a25-48e5-a44f-01e5fe07cefe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:29.242758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5607f64e-2a25-48e5-a44f-01e5fe07cefe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:29.245486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5607f64e-2a25-48e5-a44f-01e5fe07cefe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:29.249967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5607f64e-2a25-48e5-a44f-01e5fe07cefe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:29.250487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5607f64e-2a25-48e5-a44f-01e5fe07cefe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:29.256134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5607f64e-2a25-48e5-a44f-01e5fe07cefe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:29.666299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5607f64e-2a25-48e5-a44f-01e5fe07cefe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:29.675592 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5607f64e-2a25-48e5-a44f-01e5fe07cefe tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1691 microversion: 2.1 time: 0.477400 Oct 27 19:19:29.676185 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2889/5935] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:29 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1691 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:30.237815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8be5a5cb-6533-4a7b-aec4-16b354e1feba tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:30.241221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8be5a5cb-6533-4a7b-aec4-16b354e1feba tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:30.252300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8be5a5cb-6533-4a7b-aec4-16b354e1feba tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:30.253210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8be5a5cb-6533-4a7b-aec4-16b354e1feba tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:30.253210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8be5a5cb-6533-4a7b-aec4-16b354e1feba tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:30.253909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8be5a5cb-6533-4a7b-aec4-16b354e1feba tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:30.254453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8be5a5cb-6533-4a7b-aec4-16b354e1feba tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:30.256242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8be5a5cb-6533-4a7b-aec4-16b354e1feba tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:30.346743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8be5a5cb-6533-4a7b-aec4-16b354e1feba tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:30.369595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8be5a5cb-6533-4a7b-aec4-16b354e1feba tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:30.371977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8be5a5cb-6533-4a7b-aec4-16b354e1feba tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:30.374670 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8be5a5cb-6533-4a7b-aec4-16b354e1feba tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.153341 Oct 27 19:19:30.379299 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3047/5936] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:30 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:30.704913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0ad784c6-00af-4e8e-8fc9-537282780f4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:30.705544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0ad784c6-00af-4e8e-8fc9-537282780f4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:30.721842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ad784c6-00af-4e8e-8fc9-537282780f4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:30.727339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ad784c6-00af-4e8e-8fc9-537282780f4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:30.728690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ad784c6-00af-4e8e-8fc9-537282780f4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:30.731370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ad784c6-00af-4e8e-8fc9-537282780f4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:30.748520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ad784c6-00af-4e8e-8fc9-537282780f4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:30.751833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ad784c6-00af-4e8e-8fc9-537282780f4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:31.405665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b479e896-f129-4f69-b366-c4ea108a8714 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:31.407244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b479e896-f129-4f69-b366-c4ea108a8714 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:31.415194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b479e896-f129-4f69-b366-c4ea108a8714 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:31.416041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b479e896-f129-4f69-b366-c4ea108a8714 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:31.416789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b479e896-f129-4f69-b366-c4ea108a8714 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:31.417721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b479e896-f129-4f69-b366-c4ea108a8714 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:31.418467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b479e896-f129-4f69-b366-c4ea108a8714 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:31.419114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b479e896-f129-4f69-b366-c4ea108a8714 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:31.449262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:19:31.518514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0ad784c6-00af-4e8e-8fc9-537282780f4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:31.534001 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0ad784c6-00af-4e8e-8fc9-537282780f4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1691 microversion: 2.1 time: 0.831998 Oct 27 19:19:31.554848 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2890/5937] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:30 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1691 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:31.581931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b479e896-f129-4f69-b366-c4ea108a8714 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:31.607138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b479e896-f129-4f69-b366-c4ea108a8714 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:31.612004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b479e896-f129-4f69-b366-c4ea108a8714 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:31.617196 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b479e896-f129-4f69-b366-c4ea108a8714 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.214268 Oct 27 19:19:31.618950 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3048/5938] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:31 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:32.569335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-818508f4-8965-48a2-bdf6-b2a9a48083ca tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:32.571656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-818508f4-8965-48a2-bdf6-b2a9a48083ca tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:32.588162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818508f4-8965-48a2-bdf6-b2a9a48083ca tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:32.588679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818508f4-8965-48a2-bdf6-b2a9a48083ca tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:32.592595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818508f4-8965-48a2-bdf6-b2a9a48083ca tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:32.606318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818508f4-8965-48a2-bdf6-b2a9a48083ca tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:32.607022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818508f4-8965-48a2-bdf6-b2a9a48083ca tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:32.607484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-818508f4-8965-48a2-bdf6-b2a9a48083ca tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:32.650575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7dd2d8f7-287e-4d0e-90cd-a7b23fd05037 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:32.651790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7dd2d8f7-287e-4d0e-90cd-a7b23fd05037 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:32.680903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dd2d8f7-287e-4d0e-90cd-a7b23fd05037 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:32.681712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dd2d8f7-287e-4d0e-90cd-a7b23fd05037 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:32.682967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dd2d8f7-287e-4d0e-90cd-a7b23fd05037 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:32.685918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dd2d8f7-287e-4d0e-90cd-a7b23fd05037 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:32.689062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dd2d8f7-287e-4d0e-90cd-a7b23fd05037 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:32.691837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dd2d8f7-287e-4d0e-90cd-a7b23fd05037 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:32.870603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7dd2d8f7-287e-4d0e-90cd-a7b23fd05037 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:32.889052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7dd2d8f7-287e-4d0e-90cd-a7b23fd05037 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:32.894323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7dd2d8f7-287e-4d0e-90cd-a7b23fd05037 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:32.898525 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7dd2d8f7-287e-4d0e-90cd-a7b23fd05037 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.254119 Oct 27 19:19:32.901653 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3049/5939] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:32 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:33.172060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-818508f4-8965-48a2-bdf6-b2a9a48083ca tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:33.188058 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-818508f4-8965-48a2-bdf6-b2a9a48083ca tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1691 microversion: 2.1 time: 0.629390 Oct 27 19:19:33.189974 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2891/5940] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:32 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1691 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:33.932192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-05e5573c-bccf-4d3d-84af-a940213edff9 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:33.937855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-05e5573c-bccf-4d3d-84af-a940213edff9 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:33.965006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05e5573c-bccf-4d3d-84af-a940213edff9 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:33.966160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05e5573c-bccf-4d3d-84af-a940213edff9 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:33.968694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05e5573c-bccf-4d3d-84af-a940213edff9 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:33.970535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05e5573c-bccf-4d3d-84af-a940213edff9 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:33.972138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05e5573c-bccf-4d3d-84af-a940213edff9 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:33.974503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-05e5573c-bccf-4d3d-84af-a940213edff9 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:34.139745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-05e5573c-bccf-4d3d-84af-a940213edff9 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:34.154758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-05e5573c-bccf-4d3d-84af-a940213edff9 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:34.158654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-05e5573c-bccf-4d3d-84af-a940213edff9 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:34.160285 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-05e5573c-bccf-4d3d-84af-a940213edff9 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.233308 Oct 27 19:19:34.162089 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3050/5941] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:33 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:34.216063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd39067a-e838-4401-b32a-dbb7d44ec012 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:34.217237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dd39067a-e838-4401-b32a-dbb7d44ec012 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:34.228450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd39067a-e838-4401-b32a-dbb7d44ec012 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:34.232137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd39067a-e838-4401-b32a-dbb7d44ec012 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:34.232769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd39067a-e838-4401-b32a-dbb7d44ec012 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:34.234359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd39067a-e838-4401-b32a-dbb7d44ec012 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:34.235145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd39067a-e838-4401-b32a-dbb7d44ec012 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:34.235796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd39067a-e838-4401-b32a-dbb7d44ec012 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:34.465211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dd39067a-e838-4401-b32a-dbb7d44ec012 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:34.478608 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dd39067a-e838-4401-b32a-dbb7d44ec012 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1696 microversion: 2.1 time: 0.266614 Oct 27 19:19:34.491490 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2892/5942] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:34 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1696 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:35.192986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9e2006c0-b105-483d-9633-ea13a08aedc5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:35.193925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9e2006c0-b105-483d-9633-ea13a08aedc5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:35.212149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e2006c0-b105-483d-9633-ea13a08aedc5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:35.212656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e2006c0-b105-483d-9633-ea13a08aedc5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:35.213125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e2006c0-b105-483d-9633-ea13a08aedc5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:35.213851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e2006c0-b105-483d-9633-ea13a08aedc5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:35.214317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e2006c0-b105-483d-9633-ea13a08aedc5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:35.216164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e2006c0-b105-483d-9633-ea13a08aedc5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:35.349632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9e2006c0-b105-483d-9633-ea13a08aedc5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:35.372441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9e2006c0-b105-483d-9633-ea13a08aedc5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:35.374764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9e2006c0-b105-483d-9633-ea13a08aedc5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:35.376535 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9e2006c0-b105-483d-9633-ea13a08aedc5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.188307 Oct 27 19:19:35.377643 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3051/5943] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:35 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:35.511030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1b5b228e-d568-47b9-af25-98edf76f4e70 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:35.512272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1b5b228e-d568-47b9-af25-98edf76f4e70 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:35.522000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b5b228e-d568-47b9-af25-98edf76f4e70 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:35.522539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b5b228e-d568-47b9-af25-98edf76f4e70 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:35.523190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b5b228e-d568-47b9-af25-98edf76f4e70 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:35.524077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b5b228e-d568-47b9-af25-98edf76f4e70 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:35.524553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b5b228e-d568-47b9-af25-98edf76f4e70 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:35.524992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b5b228e-d568-47b9-af25-98edf76f4e70 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:35.706714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1b5b228e-d568-47b9-af25-98edf76f4e70 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:35.716645 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1b5b228e-d568-47b9-af25-98edf76f4e70 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1696 microversion: 2.1 time: 0.214260 Oct 27 19:19:35.737574 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2893/5944] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:35 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1696 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:36.408340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f2f56af8-08bd-4093-b34c-8274dbbedf61 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:36.409428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f2f56af8-08bd-4093-b34c-8274dbbedf61 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:36.426883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2f56af8-08bd-4093-b34c-8274dbbedf61 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:36.432431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2f56af8-08bd-4093-b34c-8274dbbedf61 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:36.432927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2f56af8-08bd-4093-b34c-8274dbbedf61 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:36.433696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2f56af8-08bd-4093-b34c-8274dbbedf61 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:36.434182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2f56af8-08bd-4093-b34c-8274dbbedf61 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:36.434664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2f56af8-08bd-4093-b34c-8274dbbedf61 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:36.570309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f2f56af8-08bd-4093-b34c-8274dbbedf61 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:36.585870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f2f56af8-08bd-4093-b34c-8274dbbedf61 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:36.590204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f2f56af8-08bd-4093-b34c-8274dbbedf61 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:36.594161 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f2f56af8-08bd-4093-b34c-8274dbbedf61 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.192467 Oct 27 19:19:36.610447 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3052/5945] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:36 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:36.745271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2402f618-7ce7-4915-b0cb-2e373e190a5e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:36.746444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2402f618-7ce7-4915-b0cb-2e373e190a5e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:36.754481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2402f618-7ce7-4915-b0cb-2e373e190a5e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:36.757020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2402f618-7ce7-4915-b0cb-2e373e190a5e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:36.757723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2402f618-7ce7-4915-b0cb-2e373e190a5e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:36.758741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2402f618-7ce7-4915-b0cb-2e373e190a5e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:36.759284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2402f618-7ce7-4915-b0cb-2e373e190a5e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:36.759926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2402f618-7ce7-4915-b0cb-2e373e190a5e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:36.795245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:19:36.971505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2402f618-7ce7-4915-b0cb-2e373e190a5e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:36.985418 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2402f618-7ce7-4915-b0cb-2e373e190a5e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1696 microversion: 2.1 time: 0.246135 Oct 27 19:19:36.987069 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2894/5946] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:36 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1696 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:37.622290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a7bd6eae-21b1-4978-829a-d72475fd1e68 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:37.623399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a7bd6eae-21b1-4978-829a-d72475fd1e68 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:37.634628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7bd6eae-21b1-4978-829a-d72475fd1e68 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:37.637898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7bd6eae-21b1-4978-829a-d72475fd1e68 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:37.642877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7bd6eae-21b1-4978-829a-d72475fd1e68 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:37.644011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7bd6eae-21b1-4978-829a-d72475fd1e68 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:37.645280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7bd6eae-21b1-4978-829a-d72475fd1e68 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:37.645943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a7bd6eae-21b1-4978-829a-d72475fd1e68 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:37.805955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a7bd6eae-21b1-4978-829a-d72475fd1e68 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:37.821426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a7bd6eae-21b1-4978-829a-d72475fd1e68 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:37.830138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a7bd6eae-21b1-4978-829a-d72475fd1e68 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:37.831436 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a7bd6eae-21b1-4978-829a-d72475fd1e68 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.213249 Oct 27 19:19:37.832015 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3053/5947] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:37 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:38.010634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-95fae923-ea83-48a0-ad48-34fc3382fc03 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:38.011839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-95fae923-ea83-48a0-ad48-34fc3382fc03 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:38.014925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:19:38.022281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95fae923-ea83-48a0-ad48-34fc3382fc03 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:38.023077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95fae923-ea83-48a0-ad48-34fc3382fc03 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:38.024621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95fae923-ea83-48a0-ad48-34fc3382fc03 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:38.025586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95fae923-ea83-48a0-ad48-34fc3382fc03 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:38.026957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95fae923-ea83-48a0-ad48-34fc3382fc03 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:38.027403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95fae923-ea83-48a0-ad48-34fc3382fc03 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:38.714962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-95fae923-ea83-48a0-ad48-34fc3382fc03 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:38.742450 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-95fae923-ea83-48a0-ad48-34fc3382fc03 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1696 microversion: 2.1 time: 0.735342 Oct 27 19:19:38.744282 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2895/5948] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:38 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1696 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:38.862265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f9fb456-1030-4092-9ab5-28df98cd75d0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:38.863668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6f9fb456-1030-4092-9ab5-28df98cd75d0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:38.875258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f9fb456-1030-4092-9ab5-28df98cd75d0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:38.876175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f9fb456-1030-4092-9ab5-28df98cd75d0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:38.876701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f9fb456-1030-4092-9ab5-28df98cd75d0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:38.877636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f9fb456-1030-4092-9ab5-28df98cd75d0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:38.878378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f9fb456-1030-4092-9ab5-28df98cd75d0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:38.879342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f9fb456-1030-4092-9ab5-28df98cd75d0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:38.993842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6f9fb456-1030-4092-9ab5-28df98cd75d0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:39.003937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6f9fb456-1030-4092-9ab5-28df98cd75d0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:39.006507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6f9fb456-1030-4092-9ab5-28df98cd75d0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:39.007915 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6f9fb456-1030-4092-9ab5-28df98cd75d0 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.152303 Oct 27 19:19:39.009230 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3054/5949] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:38 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:39.769882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f1e1ffe4-5091-4870-a853-f3b98b7bcfec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:39.772017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f1e1ffe4-5091-4870-a853-f3b98b7bcfec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:39.779855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1e1ffe4-5091-4870-a853-f3b98b7bcfec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:39.780611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1e1ffe4-5091-4870-a853-f3b98b7bcfec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:39.781738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1e1ffe4-5091-4870-a853-f3b98b7bcfec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:39.782707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1e1ffe4-5091-4870-a853-f3b98b7bcfec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:39.783641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1e1ffe4-5091-4870-a853-f3b98b7bcfec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:39.784585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1e1ffe4-5091-4870-a853-f3b98b7bcfec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:40.039649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a1ed25a5-e23f-4daf-b740-1c8a0b56275f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:40.041120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a1ed25a5-e23f-4daf-b740-1c8a0b56275f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:40.051629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1ed25a5-e23f-4daf-b740-1c8a0b56275f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:40.054131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1ed25a5-e23f-4daf-b740-1c8a0b56275f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:40.054681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1ed25a5-e23f-4daf-b740-1c8a0b56275f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:40.055522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1ed25a5-e23f-4daf-b740-1c8a0b56275f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:40.056232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1ed25a5-e23f-4daf-b740-1c8a0b56275f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:40.056848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f1e1ffe4-5091-4870-a853-f3b98b7bcfec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:40.056981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1ed25a5-e23f-4daf-b740-1c8a0b56275f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:40.072349 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f1e1ffe4-5091-4870-a853-f3b98b7bcfec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1696 microversion: 2.1 time: 0.306301 Oct 27 19:19:40.073651 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2896/5950] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:39 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1696 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:40.156573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1ed25a5-e23f-4daf-b740-1c8a0b56275f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:40.166440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1ed25a5-e23f-4daf-b740-1c8a0b56275f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:40.168141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1ed25a5-e23f-4daf-b740-1c8a0b56275f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:40.169683 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a1ed25a5-e23f-4daf-b740-1c8a0b56275f tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1407 microversion: 2.54 time: 0.137181 Oct 27 19:19:40.170232 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3055/5951] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:40 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1407 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:41.100778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-67199e95-d9e2-48f0-b19f-4ab7c1d96421 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:41.101981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-67199e95-d9e2-48f0-b19f-4ab7c1d96421 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:41.111778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67199e95-d9e2-48f0-b19f-4ab7c1d96421 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:41.113472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67199e95-d9e2-48f0-b19f-4ab7c1d96421 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:41.115517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67199e95-d9e2-48f0-b19f-4ab7c1d96421 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:41.116728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67199e95-d9e2-48f0-b19f-4ab7c1d96421 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:41.118054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67199e95-d9e2-48f0-b19f-4ab7c1d96421 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:41.120026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67199e95-d9e2-48f0-b19f-4ab7c1d96421 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:41.198156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-969e491f-6fe4-4e94-8a98-3b8e9dfe7b34 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:41.199028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-969e491f-6fe4-4e94-8a98-3b8e9dfe7b34 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:41.213526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=48 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:19:41.216917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969e491f-6fe4-4e94-8a98-3b8e9dfe7b34 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:41.219614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969e491f-6fe4-4e94-8a98-3b8e9dfe7b34 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:41.222677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969e491f-6fe4-4e94-8a98-3b8e9dfe7b34 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:41.223561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969e491f-6fe4-4e94-8a98-3b8e9dfe7b34 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:41.225969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969e491f-6fe4-4e94-8a98-3b8e9dfe7b34 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:41.226599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969e491f-6fe4-4e94-8a98-3b8e9dfe7b34 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:41.353659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-969e491f-6fe4-4e94-8a98-3b8e9dfe7b34 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:41.367115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-969e491f-6fe4-4e94-8a98-3b8e9dfe7b34 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:41.371901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-969e491f-6fe4-4e94-8a98-3b8e9dfe7b34 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:41.373587 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-969e491f-6fe4-4e94-8a98-3b8e9dfe7b34 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1413 microversion: 2.54 time: 0.179692 Oct 27 19:19:41.393256 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3056/5952] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:41 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1413 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:19:41.608591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-67199e95-d9e2-48f0-b19f-4ab7c1d96421 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:41.635430 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-67199e95-d9e2-48f0-b19f-4ab7c1d96421 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1696 microversion: 2.1 time: 0.539294 Oct 27 19:19:41.647062 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2897/5953] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:41 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1696 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:42.404992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8dd979d2-00fb-4026-afd4-8bc9334c2a49 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:42.404992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8dd979d2-00fb-4026-afd4-8bc9334c2a49 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:42.422079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8dd979d2-00fb-4026-afd4-8bc9334c2a49 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:42.422934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8dd979d2-00fb-4026-afd4-8bc9334c2a49 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:42.423561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8dd979d2-00fb-4026-afd4-8bc9334c2a49 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:42.427528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8dd979d2-00fb-4026-afd4-8bc9334c2a49 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:42.430996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8dd979d2-00fb-4026-afd4-8bc9334c2a49 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:42.431660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8dd979d2-00fb-4026-afd4-8bc9334c2a49 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:42.560168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8dd979d2-00fb-4026-afd4-8bc9334c2a49 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:42.581025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8dd979d2-00fb-4026-afd4-8bc9334c2a49 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:42.585072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8dd979d2-00fb-4026-afd4-8bc9334c2a49 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:42.588423 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8dd979d2-00fb-4026-afd4-8bc9334c2a49 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1413 microversion: 2.54 time: 0.191344 Oct 27 19:19:42.611388 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3057/5954] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:42 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1413 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:19:42.675208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1d66e2df-42c1-4cf4-976d-56989d3c15b1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:42.675891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1d66e2df-42c1-4cf4-976d-56989d3c15b1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:42.692417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d66e2df-42c1-4cf4-976d-56989d3c15b1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:42.694283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d66e2df-42c1-4cf4-976d-56989d3c15b1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:42.695883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d66e2df-42c1-4cf4-976d-56989d3c15b1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:42.697505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d66e2df-42c1-4cf4-976d-56989d3c15b1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:42.712623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d66e2df-42c1-4cf4-976d-56989d3c15b1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:42.714575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d66e2df-42c1-4cf4-976d-56989d3c15b1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:43.242531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1d66e2df-42c1-4cf4-976d-56989d3c15b1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:43.278482 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1d66e2df-42c1-4cf4-976d-56989d3c15b1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1696 microversion: 2.1 time: 0.608345 Oct 27 19:19:43.294423 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2898/5955] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:42 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1696 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:43.617393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-24160c7e-f8ac-45b0-97aa-a9cd7dbfc7dc tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:43.618681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-24160c7e-f8ac-45b0-97aa-a9cd7dbfc7dc tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:43.626138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24160c7e-f8ac-45b0-97aa-a9cd7dbfc7dc tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:43.626978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24160c7e-f8ac-45b0-97aa-a9cd7dbfc7dc tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:43.627584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24160c7e-f8ac-45b0-97aa-a9cd7dbfc7dc tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:43.628536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24160c7e-f8ac-45b0-97aa-a9cd7dbfc7dc tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:43.629246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24160c7e-f8ac-45b0-97aa-a9cd7dbfc7dc tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:43.629836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24160c7e-f8ac-45b0-97aa-a9cd7dbfc7dc tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:43.706346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-24160c7e-f8ac-45b0-97aa-a9cd7dbfc7dc tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:43.717629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-24160c7e-f8ac-45b0-97aa-a9cd7dbfc7dc tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:43.719341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-24160c7e-f8ac-45b0-97aa-a9cd7dbfc7dc tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:43.720728 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-24160c7e-f8ac-45b0-97aa-a9cd7dbfc7dc tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1398 microversion: 2.54 time: 0.108058 Oct 27 19:19:43.721798 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3058/5956] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:43 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1398 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:43.752585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0c01c70a-7584-44b8-9c12-a2353eb5e8a1 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '.version_select at 0x7fc869897f70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:43.796587 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0c01c70a-7584-44b8-9c12-a2353eb5e8a1 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-116059674" status: 204 len: 0 microversion: 2.54 time: 0.050175 Oct 27 19:19:43.798422 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2899/5957] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Oct 27 19:19:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-116059674 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:19:43.811300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a2627fb-e62f-44f8-b773-4ac84f51e1e8 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:43.812075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8a2627fb-e62f-44f8-b773-4ac84f51e1e8 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:43.819038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a2627fb-e62f-44f8-b773-4ac84f51e1e8 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:43.819554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a2627fb-e62f-44f8-b773-4ac84f51e1e8 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:43.820127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a2627fb-e62f-44f8-b773-4ac84f51e1e8 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:43.821077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a2627fb-e62f-44f8-b773-4ac84f51e1e8 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:43.821759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a2627fb-e62f-44f8-b773-4ac84f51e1e8 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:43.822436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a2627fb-e62f-44f8-b773-4ac84f51e1e8 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:43.855740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8a2627fb-e62f-44f8-b773-4ac84f51e1e8 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:19:44.022734 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8a2627fb-e62f-44f8-b773-4ac84f51e1e8 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 204 len: 0 microversion: 2.54 time: 0.216256 Oct 27 19:19:44.023847 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3059/5958] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 19:19:43 2022] DELETE /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:19:44.033547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e4a9a574-b1e3-4f0d-ae87-db52065cd8e5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:44.034272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e4a9a574-b1e3-4f0d-ae87-db52065cd8e5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:44.044835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4a9a574-b1e3-4f0d-ae87-db52065cd8e5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:44.045429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4a9a574-b1e3-4f0d-ae87-db52065cd8e5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:44.045955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4a9a574-b1e3-4f0d-ae87-db52065cd8e5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:44.046814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4a9a574-b1e3-4f0d-ae87-db52065cd8e5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:44.047463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4a9a574-b1e3-4f0d-ae87-db52065cd8e5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:44.048059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4a9a574-b1e3-4f0d-ae87-db52065cd8e5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:44.125889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e4a9a574-b1e3-4f0d-ae87-db52065cd8e5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:44.171026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e4a9a574-b1e3-4f0d-ae87-db52065cd8e5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:44.179721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e4a9a574-b1e3-4f0d-ae87-db52065cd8e5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:44.184600 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e4a9a574-b1e3-4f0d-ae87-db52065cd8e5 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1404 microversion: 2.54 time: 0.156458 Oct 27 19:19:44.187799 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2900/5959] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:44 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:44.309621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9240033d-b949-4f3f-9476-d6f947040462 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:44.310347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9240033d-b949-4f3f-9476-d6f947040462 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:44.317338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9240033d-b949-4f3f-9476-d6f947040462 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:44.319061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9240033d-b949-4f3f-9476-d6f947040462 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:44.320182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9240033d-b949-4f3f-9476-d6f947040462 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:44.321171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9240033d-b949-4f3f-9476-d6f947040462 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:44.321647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9240033d-b949-4f3f-9476-d6f947040462 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:44.322089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9240033d-b949-4f3f-9476-d6f947040462 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:44.498525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9240033d-b949-4f3f-9476-d6f947040462 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:44.510647 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9240033d-b949-4f3f-9476-d6f947040462 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1696 microversion: 2.1 time: 0.204446 Oct 27 19:19:44.512700 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3060/5960] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:44 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1696 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:45.218536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a9cf06d3-cffe-4f22-939b-d11a51017a8b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:45.222638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a9cf06d3-cffe-4f22-939b-d11a51017a8b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:45.259885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9cf06d3-cffe-4f22-939b-d11a51017a8b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:45.261094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9cf06d3-cffe-4f22-939b-d11a51017a8b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:45.263795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9cf06d3-cffe-4f22-939b-d11a51017a8b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:45.265041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9cf06d3-cffe-4f22-939b-d11a51017a8b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:45.267055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9cf06d3-cffe-4f22-939b-d11a51017a8b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:45.268777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a9cf06d3-cffe-4f22-939b-d11a51017a8b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:45.405101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a9cf06d3-cffe-4f22-939b-d11a51017a8b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:45.415754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a9cf06d3-cffe-4f22-939b-d11a51017a8b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:45.418343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a9cf06d3-cffe-4f22-939b-d11a51017a8b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:45.419703 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a9cf06d3-cffe-4f22-939b-d11a51017a8b tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1404 microversion: 2.54 time: 0.206977 Oct 27 19:19:45.420834 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2901/5961] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:45 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1404 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:45.560696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-369d87ee-a008-4c49-809d-3b113af3de22 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:45.562244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-369d87ee-a008-4c49-809d-3b113af3de22 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:45.582728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-369d87ee-a008-4c49-809d-3b113af3de22 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:45.583681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-369d87ee-a008-4c49-809d-3b113af3de22 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:45.590995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-369d87ee-a008-4c49-809d-3b113af3de22 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:45.591974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-369d87ee-a008-4c49-809d-3b113af3de22 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:45.592612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-369d87ee-a008-4c49-809d-3b113af3de22 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:45.593224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-369d87ee-a008-4c49-809d-3b113af3de22 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:46.060444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-369d87ee-a008-4c49-809d-3b113af3de22 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:46.082871 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-369d87ee-a008-4c49-809d-3b113af3de22 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1696 microversion: 2.1 time: 0.549467 Oct 27 19:19:46.088834 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3061/5962] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:45 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1696 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:46.448099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:46.449539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:46.456596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:46.457080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:46.457545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:46.462067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:46.462756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:46.470333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:46.557699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:46.558512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:46.559145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:46.562636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lazy-loading 'fault' on Instance uuid 5ee605af-1e67-4608-a2b5-09818c39585c {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:19:46.668819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:46.683168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:46.687273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c84decd0d8c24c10961c0d70aab00426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6531d08e10024a3fbf4704fb80ceb01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:46.688897 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ef6c09f2-4a78-46c5-abce-c8d935c389ce tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 200 len: 1409 microversion: 2.54 time: 0.245364 Oct 27 19:19:46.690959 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2902/5963] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:46 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 1409 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:19:47.112771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b3cc19fd-c847-4b17-ac10-651ea10a65c8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:47.116384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b3cc19fd-c847-4b17-ac10-651ea10a65c8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:47.123957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3cc19fd-c847-4b17-ac10-651ea10a65c8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:47.124739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3cc19fd-c847-4b17-ac10-651ea10a65c8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:47.125263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3cc19fd-c847-4b17-ac10-651ea10a65c8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:47.126594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3cc19fd-c847-4b17-ac10-651ea10a65c8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:47.127251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3cc19fd-c847-4b17-ac10-651ea10a65c8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:47.127766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3cc19fd-c847-4b17-ac10-651ea10a65c8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:47.427899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b3cc19fd-c847-4b17-ac10-651ea10a65c8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:47.453533 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b3cc19fd-c847-4b17-ac10-651ea10a65c8 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1696 microversion: 2.1 time: 0.346308 Oct 27 19:19:47.457279 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3062/5964] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:47 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1696 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:47.717951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-071bb146-c791-438c-a34f-ab7a246cf3e2 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:47.719734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-071bb146-c791-438c-a34f-ab7a246cf3e2 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] [instance: 5ee605af-1e67-4608-a2b5-09818c39585c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:47.729427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-071bb146-c791-438c-a34f-ab7a246cf3e2 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:47.731738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-071bb146-c791-438c-a34f-ab7a246cf3e2 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:47.732553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-071bb146-c791-438c-a34f-ab7a246cf3e2 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:47.733594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-071bb146-c791-438c-a34f-ab7a246cf3e2 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:47.734563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-071bb146-c791-438c-a34f-ab7a246cf3e2 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:47.735311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-071bb146-c791-438c-a34f-ab7a246cf3e2 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:47.765425 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-071bb146-c791-438c-a34f-ab7a246cf3e2 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] HTTP exception thrown: Instance 5ee605af-1e67-4608-a2b5-09818c39585c could not be found. Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-071bb146-c791-438c-a34f-ab7a246cf3e2 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Request method failure captured: Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c HTTP/1.1 Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtmrpQsRNvlOJT0noFmEWKrvnUelka36q-eYwG24dluXhmJICn5NyoGLAc3ck9iP0tqAF2Z6x68sJf1Kvm1g4LJ4wD_JZLmXyZ5UW7lMDSdGdanX52eM7ZGX8mAoTixI2eDEq048uFh2_fZO51PWfwfLSxoZSVurJY420lFvl0oX45E Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.54 Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 6531d08e10024a3fbf4704fb80ceb01a Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerShowV254Test-1375630929 Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6531d08e10024a3fbf4704fb80ceb01a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6531d08e10024a3fbf4704fb80ceb01a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6531d08e10024a3fbf4704fb80ceb01a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6531d08e10024a3fbf4704fb80ceb01a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerShowV254Test-1375630929 Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 6531d08e10024a3fbf4704fb80ceb01a Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerShowV254Test-1375630929 Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerShowV254Test-1375630929-project Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c84decd0d8c24c10961c0d70aab00426 Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerShowV254Test-1375630929-project Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 5ee605af-1e67-4608-a2b5-09818c39585c could not be found. Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '5ee605af-1e67-4608-a2b5-09818c39585c'} Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ee605af-1e67-4608-a2b5-09818c39585c could not be found. Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ee605af-1e67-4608-a2b5-09818c39585c could not be found. Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:19:47.768343 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:19:47.773066 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:19:47.773066 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:19:47.773066 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:19:47.773066 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:19:47.773066 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:19:47.773066 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ee605af-1e67-4608-a2b5-09818c39585c could not be found. Oct 27 19:19:47.773066 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:19:47.773066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-071bb146-c791-438c-a34f-ab7a246cf3e2 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] Returning 404 to user: Instance 5ee605af-1e67-4608-a2b5-09818c39585c could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:19:47.774224 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-071bb146-c791-438c-a34f-ab7a246cf3e2 tempest-ServerShowV254Test-1375630929 tempest-ServerShowV254Test-1375630929-project] 10.222.0.42 "GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c" status: 404 len: 111 microversion: 2.54 time: 0.059779 Oct 27 19:19:47.778032 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2903/5965] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:19:47 2022] GET /compute/v2.1/servers/5ee605af-1e67-4608-a2b5-09818c39585c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:19:48.485291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9fa480e0-976f-4fb6-a8f8-e88fcdc3ee7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:48.485913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9fa480e0-976f-4fb6-a8f8-e88fcdc3ee7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:48.505930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fa480e0-976f-4fb6-a8f8-e88fcdc3ee7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:48.506470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fa480e0-976f-4fb6-a8f8-e88fcdc3ee7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:48.507009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fa480e0-976f-4fb6-a8f8-e88fcdc3ee7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:48.507732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fa480e0-976f-4fb6-a8f8-e88fcdc3ee7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:48.508448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fa480e0-976f-4fb6-a8f8-e88fcdc3ee7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:48.509046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fa480e0-976f-4fb6-a8f8-e88fcdc3ee7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:48.555031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:19:48.750228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9fa480e0-976f-4fb6-a8f8-e88fcdc3ee7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:48.763172 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9fa480e0-976f-4fb6-a8f8-e88fcdc3ee7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1696 microversion: 2.1 time: 0.281379 Oct 27 19:19:48.764960 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3063/5966] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:48 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1696 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:49.789644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d76f29ea-1495-408b-abc9-06b231b78eba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:49.790949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d76f29ea-1495-408b-abc9-06b231b78eba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:49.806572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d76f29ea-1495-408b-abc9-06b231b78eba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:49.807846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d76f29ea-1495-408b-abc9-06b231b78eba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:49.808764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d76f29ea-1495-408b-abc9-06b231b78eba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:49.809706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d76f29ea-1495-408b-abc9-06b231b78eba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:49.810956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d76f29ea-1495-408b-abc9-06b231b78eba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:49.815107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d76f29ea-1495-408b-abc9-06b231b78eba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:50.087432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d76f29ea-1495-408b-abc9-06b231b78eba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:50.101824 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d76f29ea-1495-408b-abc9-06b231b78eba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1696 microversion: 2.1 time: 0.313711 Oct 27 19:19:50.102896 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2904/5967] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:49 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1696 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:51.133175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7ccebcbc-215f-487c-ad19-e34e3d84de85 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:51.133826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7ccebcbc-215f-487c-ad19-e34e3d84de85 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:51.151047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ccebcbc-215f-487c-ad19-e34e3d84de85 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:51.151651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ccebcbc-215f-487c-ad19-e34e3d84de85 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:51.152113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ccebcbc-215f-487c-ad19-e34e3d84de85 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:51.152934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ccebcbc-215f-487c-ad19-e34e3d84de85 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:51.153408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ccebcbc-215f-487c-ad19-e34e3d84de85 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:51.153857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7ccebcbc-215f-487c-ad19-e34e3d84de85 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:51.699149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2061664860", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "a0280def-2591-46c8-bef4-f3e07a581540"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:19:51.794727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] validate_networks() for [('a0280def-2591-46c8-bef4-f3e07a581540', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:19:51.807178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7ccebcbc-215f-487c-ad19-e34e3d84de85 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:51.857818 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7ccebcbc-215f-487c-ad19-e34e3d84de85 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1695 microversion: 2.1 time: 0.718078 Oct 27 19:19:51.869264 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3064/5968] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:51 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1695 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:52.155511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6249c941-7f7f-434d-acf4-e166d4869bc8 req-34ef29b6-c725-4ae2-841f-4aa19dd6a895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbf8d5b-8288-4bd2-91dd-d67825cb8007", "name": "network-vif-unplugged", "status": "completed", "tag": "51f53b33-b1cf-4efb-b7b4-8ec80712f964"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:19:52.176673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6249c941-7f7f-434d-acf4-e166d4869bc8 req-34ef29b6-c725-4ae2-841f-4aa19dd6a895 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:52.178997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6249c941-7f7f-434d-acf4-e166d4869bc8 req-34ef29b6-c725-4ae2-841f-4aa19dd6a895 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:52.182763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6249c941-7f7f-434d-acf4-e166d4869bc8 req-34ef29b6-c725-4ae2-841f-4aa19dd6a895 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:52.196611 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6249c941-7f7f-434d-acf4-e166d4869bc8 req-34ef29b6-c725-4ae2-841f-4aa19dd6a895 service nova] Creating event network-vif-unplugged:51f53b33-b1cf-4efb-b7b4-8ec80712f964 for instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 on n-h1-860687-3 Oct 27 19:19:52.205408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-6249c941-7f7f-434d-acf4-e166d4869bc8 req-34ef29b6-c725-4ae2-841f-4aa19dd6a895 service nova] Instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:19:52.218845 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6249c941-7f7f-434d-acf4-e166d4869bc8 req-34ef29b6-c725-4ae2-841f-4aa19dd6a895 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067212 Oct 27 19:19:52.219823 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3065/5969] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:19:52.898377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3dfce1a1-363f-4dc3-8881-76753edef2b9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:52.899696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3dfce1a1-363f-4dc3-8881-76753edef2b9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:52.906086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dfce1a1-363f-4dc3-8881-76753edef2b9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:52.906830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dfce1a1-363f-4dc3-8881-76753edef2b9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:52.907459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dfce1a1-363f-4dc3-8881-76753edef2b9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:52.908257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dfce1a1-363f-4dc3-8881-76753edef2b9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:52.908796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dfce1a1-363f-4dc3-8881-76753edef2b9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:52.909444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dfce1a1-363f-4dc3-8881-76753edef2b9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:53.083545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:19:53.084189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:19:53.084302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:19:53.084679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:19:53.085108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:19:53.094520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:53.095614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:53.096296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:53.097676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:53.098500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:53.099266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:53.120914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Getting quotas for project 2d96bce18a094463a4636e5b386bb6e5. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:19:53.127634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Getting quotas for user 6caba9bb6fd24203a64fa598d35ec45f and project 2d96bce18a094463a4636e5b386bb6e5. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:19:53.142655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:19:53.146074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:19:53.201697 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ddae84a7-b43c-4805-8e6e-effa9ce9d144 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.697312 Oct 27 19:19:53.203650 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2905/5970] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:19:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 19:19:53.221146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-725f8a7a-4c65-4d7d-b4c5-4948b8747353 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:53.222842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-725f8a7a-4c65-4d7d-b4c5-4948b8747353 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:53.406012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-725f8a7a-4c65-4d7d-b4c5-4948b8747353 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:53.418844 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-725f8a7a-4c65-4d7d-b4c5-4948b8747353 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1214 microversion: 2.1 time: 0.207012 Oct 27 19:19:53.419445 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2906/5971] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:53 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1214 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:19:53.474134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3dfce1a1-363f-4dc3-8881-76753edef2b9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:53.496920 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3dfce1a1-363f-4dc3-8881-76753edef2b9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1695 microversion: 2.1 time: 0.603318 Oct 27 19:19:53.511194 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3066/5972] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:52 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1695 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:19:54.447053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb3cee5f-5c5a-455a-a618-27142e587851 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:54.448368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cb3cee5f-5c5a-455a-a618-27142e587851 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:54.467378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb3cee5f-5c5a-455a-a618-27142e587851 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:54.468147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb3cee5f-5c5a-455a-a618-27142e587851 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:54.468790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb3cee5f-5c5a-455a-a618-27142e587851 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:54.469792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb3cee5f-5c5a-455a-a618-27142e587851 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:54.471841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb3cee5f-5c5a-455a-a618-27142e587851 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:54.472630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb3cee5f-5c5a-455a-a618-27142e587851 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:54.528084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2fe55ef7-164f-4106-aed0-80e92afbd8ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:54.528717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2fe55ef7-164f-4106-aed0-80e92afbd8ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:54.545820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fe55ef7-164f-4106-aed0-80e92afbd8ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:54.546449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fe55ef7-164f-4106-aed0-80e92afbd8ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:54.546848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fe55ef7-164f-4106-aed0-80e92afbd8ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:54.547663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fe55ef7-164f-4106-aed0-80e92afbd8ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:54.548138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fe55ef7-164f-4106-aed0-80e92afbd8ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:54.548578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fe55ef7-164f-4106-aed0-80e92afbd8ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:54.759791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cb3cee5f-5c5a-455a-a618-27142e587851 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:54.775124 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cb3cee5f-5c5a-455a-a618-27142e587851 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1210 microversion: 2.1 time: 0.331312 Oct 27 19:19:54.775778 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2907/5973] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:54 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1210 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:54.799422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d1c307b6-d7e2-455a-b48d-5edebea0bf3d req-d150199c-10b0-430c-bb28-a87f011dff77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bbf8d5b-8288-4bd2-91dd-d67825cb8007", "tag": "51f53b33-b1cf-4efb-b7b4-8ec80712f964"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:19:54.827039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d1c307b6-d7e2-455a-b48d-5edebea0bf3d req-d150199c-10b0-430c-bb28-a87f011dff77 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:54.828486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d1c307b6-d7e2-455a-b48d-5edebea0bf3d req-d150199c-10b0-430c-bb28-a87f011dff77 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:54.828945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d1c307b6-d7e2-455a-b48d-5edebea0bf3d req-d150199c-10b0-430c-bb28-a87f011dff77 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:54.855593 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d1c307b6-d7e2-455a-b48d-5edebea0bf3d req-d150199c-10b0-430c-bb28-a87f011dff77 service nova] Creating event network-changed:51f53b33-b1cf-4efb-b7b4-8ec80712f964 for instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 on n-h1-860687-3 Oct 27 19:19:54.874221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-d1c307b6-d7e2-455a-b48d-5edebea0bf3d req-d150199c-10b0-430c-bb28-a87f011dff77 service nova] Instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:19:54.892372 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d1c307b6-d7e2-455a-b48d-5edebea0bf3d req-d150199c-10b0-430c-bb28-a87f011dff77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096017 Oct 27 19:19:54.893315 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2908/5974] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:19:54.984673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2fe55ef7-164f-4106-aed0-80e92afbd8ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:54.995096 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2fe55ef7-164f-4106-aed0-80e92afbd8ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1695 microversion: 2.1 time: 0.470889 Oct 27 19:19:54.995936 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3067/5975] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:54 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1695 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:19:55.803652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28d2e44a-7951-4673-bf16-76f479cd3623 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:55.804957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-28d2e44a-7951-4673-bf16-76f479cd3623 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:55.811676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28d2e44a-7951-4673-bf16-76f479cd3623 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:55.812523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28d2e44a-7951-4673-bf16-76f479cd3623 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:55.813146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28d2e44a-7951-4673-bf16-76f479cd3623 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:55.813953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28d2e44a-7951-4673-bf16-76f479cd3623 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:55.814594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28d2e44a-7951-4673-bf16-76f479cd3623 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:55.815196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28d2e44a-7951-4673-bf16-76f479cd3623 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:55.968771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-28d2e44a-7951-4673-bf16-76f479cd3623 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:55.979751 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-28d2e44a-7951-4673-bf16-76f479cd3623 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1272 microversion: 2.1 time: 0.182231 Oct 27 19:19:55.996494 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2909/5976] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:55 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:56.026555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ad5197a3-d47f-4b3d-b08a-4adcafdde636 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:56.028214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ad5197a3-d47f-4b3d-b08a-4adcafdde636 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:56.039641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad5197a3-d47f-4b3d-b08a-4adcafdde636 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:56.040509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad5197a3-d47f-4b3d-b08a-4adcafdde636 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:56.041224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad5197a3-d47f-4b3d-b08a-4adcafdde636 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:56.043155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad5197a3-d47f-4b3d-b08a-4adcafdde636 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:56.043693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad5197a3-d47f-4b3d-b08a-4adcafdde636 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:56.044143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad5197a3-d47f-4b3d-b08a-4adcafdde636 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:56.445374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ad5197a3-d47f-4b3d-b08a-4adcafdde636 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:56.458033 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ad5197a3-d47f-4b3d-b08a-4adcafdde636 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1695 microversion: 2.1 time: 0.440392 Oct 27 19:19:56.460765 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3068/5977] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:56 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1695 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:57.007130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-782f28c0-6eb3-4bc9-9465-e9337ac20052 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:57.008506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-782f28c0-6eb3-4bc9-9465-e9337ac20052 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:57.022944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-782f28c0-6eb3-4bc9-9465-e9337ac20052 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:57.023640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-782f28c0-6eb3-4bc9-9465-e9337ac20052 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:57.024368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-782f28c0-6eb3-4bc9-9465-e9337ac20052 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:57.026886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-782f28c0-6eb3-4bc9-9465-e9337ac20052 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:57.027602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-782f28c0-6eb3-4bc9-9465-e9337ac20052 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:57.028790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-782f28c0-6eb3-4bc9-9465-e9337ac20052 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:57.188106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-782f28c0-6eb3-4bc9-9465-e9337ac20052 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:57.200315 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-782f28c0-6eb3-4bc9-9465-e9337ac20052 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1272 microversion: 2.1 time: 0.198716 Oct 27 19:19:57.202212 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2910/5978] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:56 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:57.488646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a8cce178-1048-49c5-a0b8-0b82dcba926f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:57.490236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a8cce178-1048-49c5-a0b8-0b82dcba926f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:57.508451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8cce178-1048-49c5-a0b8-0b82dcba926f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:57.510640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8cce178-1048-49c5-a0b8-0b82dcba926f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:57.513702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8cce178-1048-49c5-a0b8-0b82dcba926f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:57.518491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8cce178-1048-49c5-a0b8-0b82dcba926f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:57.521581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8cce178-1048-49c5-a0b8-0b82dcba926f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:57.522768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a8cce178-1048-49c5-a0b8-0b82dcba926f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:58.229452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5d6e2ac4-e732-4320-8be0-4820e9dc7228 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:58.231193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5d6e2ac4-e732-4320-8be0-4820e9dc7228 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:58.248498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d6e2ac4-e732-4320-8be0-4820e9dc7228 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:58.249439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d6e2ac4-e732-4320-8be0-4820e9dc7228 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:58.251624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d6e2ac4-e732-4320-8be0-4820e9dc7228 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:58.252939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d6e2ac4-e732-4320-8be0-4820e9dc7228 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:58.253636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d6e2ac4-e732-4320-8be0-4820e9dc7228 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:58.254289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d6e2ac4-e732-4320-8be0-4820e9dc7228 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:58.435481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a8cce178-1048-49c5-a0b8-0b82dcba926f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:58.455932 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a8cce178-1048-49c5-a0b8-0b82dcba926f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1693 microversion: 2.1 time: 0.972592 Oct 27 19:19:58.457025 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3069/5979] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:57 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1693 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:19:59.377387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5d6e2ac4-e732-4320-8be0-4820e9dc7228 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:19:59.391764 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5d6e2ac4-e732-4320-8be0-4820e9dc7228 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1314 microversion: 2.1 time: 1.167533 Oct 27 19:19:59.394622 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2911/5980] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:58 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1314 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:19:59.485191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b3f9d56d-3c6c-4f39-a2a9-0772ce5fb0cd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:19:59.486810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b3f9d56d-3c6c-4f39-a2a9-0772ce5fb0cd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:19:59.499422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3f9d56d-3c6c-4f39-a2a9-0772ce5fb0cd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:59.501984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3f9d56d-3c6c-4f39-a2a9-0772ce5fb0cd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:59.505933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3f9d56d-3c6c-4f39-a2a9-0772ce5fb0cd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:59.510057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3f9d56d-3c6c-4f39-a2a9-0772ce5fb0cd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:59.511465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3f9d56d-3c6c-4f39-a2a9-0772ce5fb0cd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:59.512201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3f9d56d-3c6c-4f39-a2a9-0772ce5fb0cd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:59.855531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c28e87c4-b80b-4887-9a8c-481a4ee49b5c req-00f6f3a8-c9d0-44a0-a7ca-f123eb80391e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca69bee-c613-4be0-8d24-2280e0768f94", "tag": "6adf6e5d-706e-4a99-8dcd-07ff1cd301b0"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:19:59.881794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c28e87c4-b80b-4887-9a8c-481a4ee49b5c req-00f6f3a8-c9d0-44a0-a7ca-f123eb80391e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:19:59.891589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c28e87c4-b80b-4887-9a8c-481a4ee49b5c req-00f6f3a8-c9d0-44a0-a7ca-f123eb80391e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:19:59.892285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c28e87c4-b80b-4887-9a8c-481a4ee49b5c req-00f6f3a8-c9d0-44a0-a7ca-f123eb80391e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:19:59.924823 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c28e87c4-b80b-4887-9a8c-481a4ee49b5c req-00f6f3a8-c9d0-44a0-a7ca-f123eb80391e service nova] Creating event network-changed:6adf6e5d-706e-4a99-8dcd-07ff1cd301b0 for instance dca69bee-c613-4be0-8d24-2280e0768f94 on n-h1-860687-3 Oct 27 19:19:59.930782 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c28e87c4-b80b-4887-9a8c-481a4ee49b5c req-00f6f3a8-c9d0-44a0-a7ca-f123eb80391e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082616 Oct 27 19:19:59.932284 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2912/5981] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:00.378225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b3f9d56d-3c6c-4f39-a2a9-0772ce5fb0cd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:00.389314 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b3f9d56d-3c6c-4f39-a2a9-0772ce5fb0cd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1690 microversion: 2.1 time: 0.908138 Oct 27 19:20:00.394829 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3070/5982] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:19:59 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1690 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:00.422626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a999236f-770f-4942-b222-05ec068d1b7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:00.423088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1f53085f-cf76-4c2b-9dce-c62d0a92a426 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:00.423279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a999236f-770f-4942-b222-05ec068d1b7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:00.423561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1f53085f-cf76-4c2b-9dce-c62d0a92a426 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:00.432743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f53085f-cf76-4c2b-9dce-c62d0a92a426 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:00.433257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f53085f-cf76-4c2b-9dce-c62d0a92a426 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:00.433713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f53085f-cf76-4c2b-9dce-c62d0a92a426 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:00.434460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f53085f-cf76-4c2b-9dce-c62d0a92a426 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:00.434935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f53085f-cf76-4c2b-9dce-c62d0a92a426 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:00.439437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a999236f-770f-4942-b222-05ec068d1b7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:00.439955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a999236f-770f-4942-b222-05ec068d1b7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:00.440414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a999236f-770f-4942-b222-05ec068d1b7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:00.441931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a999236f-770f-4942-b222-05ec068d1b7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:00.447636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a999236f-770f-4942-b222-05ec068d1b7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:00.448168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a999236f-770f-4942-b222-05ec068d1b7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:00.449082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f53085f-cf76-4c2b-9dce-c62d0a92a426 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:00.692902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:00.764962 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a999236f-770f-4942-b222-05ec068d1b7c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007/action" status: 202 len: 0 microversion: 2.1 time: 0.347275 Oct 27 19:20:00.766160 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2913/5983] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:20:00 2022] POST /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:20:00.797704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-633432b5-480e-4073-b7b7-60e50dc1677e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:00.802839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-633432b5-480e-4073-b7b7-60e50dc1677e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:00.819202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-633432b5-480e-4073-b7b7-60e50dc1677e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:00.819716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-633432b5-480e-4073-b7b7-60e50dc1677e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:00.824632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-633432b5-480e-4073-b7b7-60e50dc1677e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:00.826830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-633432b5-480e-4073-b7b7-60e50dc1677e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:00.827421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-633432b5-480e-4073-b7b7-60e50dc1677e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:00.830491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-633432b5-480e-4073-b7b7-60e50dc1677e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:01.310598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-633432b5-480e-4073-b7b7-60e50dc1677e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:01.320919 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-633432b5-480e-4073-b7b7-60e50dc1677e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1689 microversion: 2.1 time: 0.538118 Oct 27 19:20:01.321677 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2914/5984] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:00 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1689 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:01.833472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1f53085f-cf76-4c2b-9dce-c62d0a92a426 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:01.849146 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1f53085f-cf76-4c2b-9dce-c62d0a92a426 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1314 microversion: 2.1 time: 1.429374 Oct 27 19:20:01.868150 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3071/5985] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:00 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1314 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:20:02.347038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2eddd1ee-d47a-4de7-adf3-49770f770880 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:02.347670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2eddd1ee-d47a-4de7-adf3-49770f770880 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:02.357270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eddd1ee-d47a-4de7-adf3-49770f770880 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:02.360569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eddd1ee-d47a-4de7-adf3-49770f770880 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:02.365306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eddd1ee-d47a-4de7-adf3-49770f770880 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:02.366496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eddd1ee-d47a-4de7-adf3-49770f770880 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:02.367137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eddd1ee-d47a-4de7-adf3-49770f770880 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:02.367834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eddd1ee-d47a-4de7-adf3-49770f770880 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:02.877478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4e827bc0-4c42-431b-bb67-43c204c19327 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:02.878108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4e827bc0-4c42-431b-bb67-43c204c19327 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:02.894983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e827bc0-4c42-431b-bb67-43c204c19327 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:02.896690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e827bc0-4c42-431b-bb67-43c204c19327 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:02.902257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e827bc0-4c42-431b-bb67-43c204c19327 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:02.903247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e827bc0-4c42-431b-bb67-43c204c19327 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:02.906923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e827bc0-4c42-431b-bb67-43c204c19327 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:02.908365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e827bc0-4c42-431b-bb67-43c204c19327 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:03.109280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:03.310516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2eddd1ee-d47a-4de7-adf3-49770f770880 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:03.322124 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2eddd1ee-d47a-4de7-adf3-49770f770880 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1689 microversion: 2.1 time: 0.979716 Oct 27 19:20:03.344061 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2915/5986] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:02 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1689 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:03.410602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:03.488878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e31fb4dc-c34f-4c6f-a983-13f84bf4a243 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Action: 'create', calling method: .version_select at 0x7fc8698af3a0>, body: {"keypair": {"name": "tempest-keypair-689434955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuqGylTZ3iVDEZLEwQIVYKzlI7GY+s7D+vaAbCC8kNa9+pGOCqusAY38ZaHf+hQcsdExGBUn9TIknLaNgg1L2wASaJjqf7MlzoiMEU+8JYL8o73TJHYC0KwaE+U03wHMQ=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:03.550477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e31fb4dc-c34f-4c6f-a983-13f84bf4a243 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Getting quotas for project 9e8019adc2594ba4970d50028c4b79db. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:20:03.588900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e31fb4dc-c34f-4c6f-a983-13f84bf4a243 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Getting quotas for user ac513a8932e4435e88fcd8a023b31c5c and project 9e8019adc2594ba4970d50028c4b79db. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:20:03.669355 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e31fb4dc-c34f-4c6f-a983-13f84bf4a243 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.323781 Oct 27 19:20:03.671749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4e827bc0-4c42-431b-bb67-43c204c19327 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:03.677220 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2916/5987] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:20:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:03.684785 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4e827bc0-4c42-431b-bb67-43c204c19327 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1314 microversion: 2.1 time: 0.813278 Oct 27 19:20:03.687681 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3072/5988] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:02 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1314 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:04.010433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-099cea23-233d-4e4b-9c59-a25f4f451b2d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:04.010944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-099cea23-233d-4e4b-9c59-a25f4f451b2d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:04.025698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-099cea23-233d-4e4b-9c59-a25f4f451b2d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:04.026206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-099cea23-233d-4e4b-9c59-a25f4f451b2d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:04.026675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-099cea23-233d-4e4b-9c59-a25f4f451b2d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:04.027402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-099cea23-233d-4e4b-9c59-a25f4f451b2d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:04.027863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-099cea23-233d-4e4b-9c59-a25f4f451b2d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:04.028312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-099cea23-233d-4e4b-9c59-a25f4f451b2d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:04.093425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-099cea23-233d-4e4b-9c59-a25f4f451b2d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:20:04.277904 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-099cea23-233d-4e4b-9c59-a25f4f451b2d tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "DELETE /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 204 len: 0 microversion: 2.32 time: 0.596443 Oct 27 19:20:04.278566 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2917/5989] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 19:20:03 2022] DELETE /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:20:04.331229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4098e4ee-2996-48e4-9dc0-eafd5908b651 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:04.340704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4098e4ee-2996-48e4-9dc0-eafd5908b651 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:04.355433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-64c6a06a-7745-4647-b7a0-5323151837fd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:04.356669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-64c6a06a-7745-4647-b7a0-5323151837fd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:04.380818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64c6a06a-7745-4647-b7a0-5323151837fd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:04.381720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64c6a06a-7745-4647-b7a0-5323151837fd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:04.388279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64c6a06a-7745-4647-b7a0-5323151837fd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:04.388472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4098e4ee-2996-48e4-9dc0-eafd5908b651 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:04.389537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64c6a06a-7745-4647-b7a0-5323151837fd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:04.390332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4098e4ee-2996-48e4-9dc0-eafd5908b651 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:04.390666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64c6a06a-7745-4647-b7a0-5323151837fd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:04.391464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4098e4ee-2996-48e4-9dc0-eafd5908b651 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:04.391667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64c6a06a-7745-4647-b7a0-5323151837fd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:04.397251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4098e4ee-2996-48e4-9dc0-eafd5908b651 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:04.401153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4098e4ee-2996-48e4-9dc0-eafd5908b651 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:04.401789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4098e4ee-2996-48e4-9dc0-eafd5908b651 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:05.198414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4098e4ee-2996-48e4-9dc0-eafd5908b651 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:05.316483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4098e4ee-2996-48e4-9dc0-eafd5908b651 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:05.331330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4098e4ee-2996-48e4-9dc0-eafd5908b651 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:05.344150 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4098e4ee-2996-48e4-9dc0-eafd5908b651 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 2950 microversion: 2.32 time: 1.055004 Oct 27 19:20:05.351898 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3073/5990] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:04 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 2950 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:05.362132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0a4c7001-5130-46fe-b515-d60f9d60c481 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:05.362796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0a4c7001-5130-46fe-b515-d60f9d60c481 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:05.392058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a4c7001-5130-46fe-b515-d60f9d60c481 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:05.393857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a4c7001-5130-46fe-b515-d60f9d60c481 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:05.395008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a4c7001-5130-46fe-b515-d60f9d60c481 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:05.396582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a4c7001-5130-46fe-b515-d60f9d60c481 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:05.399247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a4c7001-5130-46fe-b515-d60f9d60c481 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:05.399770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a4c7001-5130-46fe-b515-d60f9d60c481 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:06.103056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0a4c7001-5130-46fe-b515-d60f9d60c481 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:06.112810 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0a4c7001-5130-46fe-b515-d60f9d60c481 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1314 microversion: 2.1 time: 0.759627 Oct 27 19:20:06.115081 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3074/5991] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:05 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:06.346901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-64c6a06a-7745-4647-b7a0-5323151837fd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:06.360941 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-64c6a06a-7745-4647-b7a0-5323151837fd tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1689 microversion: 2.1 time: 2.010337 Oct 27 19:20:06.360941 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2918/5992] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:04 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1689 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:06.384904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-29d7349b-ef7c-4df1-afd5-e5bd5ade2932 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:06.386219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-29d7349b-ef7c-4df1-afd5-e5bd5ade2932 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:06.401691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29d7349b-ef7c-4df1-afd5-e5bd5ade2932 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:06.402488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29d7349b-ef7c-4df1-afd5-e5bd5ade2932 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:06.403180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29d7349b-ef7c-4df1-afd5-e5bd5ade2932 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:06.404192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29d7349b-ef7c-4df1-afd5-e5bd5ade2932 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:06.405570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29d7349b-ef7c-4df1-afd5-e5bd5ade2932 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:06.407777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29d7349b-ef7c-4df1-afd5-e5bd5ade2932 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:06.924251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-29d7349b-ef7c-4df1-afd5-e5bd5ade2932 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:06.937817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-29d7349b-ef7c-4df1-afd5-e5bd5ade2932 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:06.939708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-29d7349b-ef7c-4df1-afd5-e5bd5ade2932 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:06.941546 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-29d7349b-ef7c-4df1-afd5-e5bd5ade2932 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 2950 microversion: 2.32 time: 0.561193 Oct 27 19:20:06.943643 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3075/5993] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:06 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 2950 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:07.142232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6701d078-6181-46b8-8e98-3f0905d43704 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:07.143302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6701d078-6181-46b8-8e98-3f0905d43704 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:07.157607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6701d078-6181-46b8-8e98-3f0905d43704 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:07.158108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6701d078-6181-46b8-8e98-3f0905d43704 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:07.158589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6701d078-6181-46b8-8e98-3f0905d43704 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:07.159311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6701d078-6181-46b8-8e98-3f0905d43704 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:07.159771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6701d078-6181-46b8-8e98-3f0905d43704 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:07.160203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6701d078-6181-46b8-8e98-3f0905d43704 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:07.386161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bf548b9f-0b3a-4dd9-82d3-599085e5163f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:07.418202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bf548b9f-0b3a-4dd9-82d3-599085e5163f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:07.471302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf548b9f-0b3a-4dd9-82d3-599085e5163f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:07.473750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf548b9f-0b3a-4dd9-82d3-599085e5163f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:07.485446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf548b9f-0b3a-4dd9-82d3-599085e5163f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:07.488374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf548b9f-0b3a-4dd9-82d3-599085e5163f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:07.492079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf548b9f-0b3a-4dd9-82d3-599085e5163f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:07.496471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf548b9f-0b3a-4dd9-82d3-599085e5163f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:08.057875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bf548b9f-0b3a-4dd9-82d3-599085e5163f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:08.074938 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bf548b9f-0b3a-4dd9-82d3-599085e5163f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1689 microversion: 2.1 time: 0.690782 Oct 27 19:20:08.077232 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3076/5994] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:07 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1689 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:08.090483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-95434899-7678-40fb-b6e6-7e996b02725f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:08.091384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-95434899-7678-40fb-b6e6-7e996b02725f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:08.105892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95434899-7678-40fb-b6e6-7e996b02725f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:08.107624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95434899-7678-40fb-b6e6-7e996b02725f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:08.109355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95434899-7678-40fb-b6e6-7e996b02725f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:08.111798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95434899-7678-40fb-b6e6-7e996b02725f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:08.113383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95434899-7678-40fb-b6e6-7e996b02725f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:08.115041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95434899-7678-40fb-b6e6-7e996b02725f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:08.215646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6701d078-6181-46b8-8e98-3f0905d43704 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:08.225498 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6701d078-6181-46b8-8e98-3f0905d43704 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1314 microversion: 2.1 time: 1.087058 Oct 27 19:20:08.236325 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2919/5995] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:07 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1314 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:08.549193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-67539f4d-3271-460e-b596-f3c0e8136625 req-4c65351e-93b7-495a-acc2-b9a198dbabae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbf8d5b-8288-4bd2-91dd-d67825cb8007", "name": "network-vif-plugged", "status": "completed", "tag": "51f53b33-b1cf-4efb-b7b4-8ec80712f964"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:08.579498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:08.581809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-67539f4d-3271-460e-b596-f3c0e8136625 req-4c65351e-93b7-495a-acc2-b9a198dbabae service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:08.589446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-67539f4d-3271-460e-b596-f3c0e8136625 req-4c65351e-93b7-495a-acc2-b9a198dbabae service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:08.599287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-67539f4d-3271-460e-b596-f3c0e8136625 req-4c65351e-93b7-495a-acc2-b9a198dbabae service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:08.676316 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-67539f4d-3271-460e-b596-f3c0e8136625 req-4c65351e-93b7-495a-acc2-b9a198dbabae service nova] Creating event network-vif-plugged:51f53b33-b1cf-4efb-b7b4-8ec80712f964 for instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 on n-h2-860687-3 Oct 27 19:20:08.698925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-67539f4d-3271-460e-b596-f3c0e8136625 req-4c65351e-93b7-495a-acc2-b9a198dbabae service nova] Instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:20:08.756456 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-67539f4d-3271-460e-b596-f3c0e8136625 req-4c65351e-93b7-495a-acc2-b9a198dbabae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212062 Oct 27 19:20:08.762278 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2920/5996] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:09.027584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-95434899-7678-40fb-b6e6-7e996b02725f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:09.039508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-95434899-7678-40fb-b6e6-7e996b02725f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:09.064455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-95434899-7678-40fb-b6e6-7e996b02725f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:09.072397 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-95434899-7678-40fb-b6e6-7e996b02725f tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 2950 microversion: 2.32 time: 0.993765 Oct 27 19:20:09.087296 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3077/5997] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:08 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 2950 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:09.105817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-20eb9e4f-5c31-45cc-8765-df82bd9a495d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:09.106585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-20eb9e4f-5c31-45cc-8765-df82bd9a495d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:09.114997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20eb9e4f-5c31-45cc-8765-df82bd9a495d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:09.119260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20eb9e4f-5c31-45cc-8765-df82bd9a495d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:09.119832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20eb9e4f-5c31-45cc-8765-df82bd9a495d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:09.121007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20eb9e4f-5c31-45cc-8765-df82bd9a495d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:09.124523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20eb9e4f-5c31-45cc-8765-df82bd9a495d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:09.126184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20eb9e4f-5c31-45cc-8765-df82bd9a495d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:09.249569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-39a8f178-1c41-493d-858d-73deddef4c47 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:09.250745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-39a8f178-1c41-493d-858d-73deddef4c47 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:09.275766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39a8f178-1c41-493d-858d-73deddef4c47 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:09.277522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39a8f178-1c41-493d-858d-73deddef4c47 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:09.278319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39a8f178-1c41-493d-858d-73deddef4c47 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:09.279549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39a8f178-1c41-493d-858d-73deddef4c47 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:09.288187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39a8f178-1c41-493d-858d-73deddef4c47 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:09.294527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39a8f178-1c41-493d-858d-73deddef4c47 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:09.904637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-39a8f178-1c41-493d-858d-73deddef4c47 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:09.923107 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-39a8f178-1c41-493d-858d-73deddef4c47 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1314 microversion: 2.1 time: 0.677222 Oct 27 19:20:09.936760 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3078/5998] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:09 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1314 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:09.963532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-20eb9e4f-5c31-45cc-8765-df82bd9a495d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:09.983273 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-20eb9e4f-5c31-45cc-8765-df82bd9a495d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1689 microversion: 2.1 time: 0.881913 Oct 27 19:20:09.983819 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2921/5999] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:09 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1689 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:10.116793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-927e2478-3239-4dc1-b055-5e0cc82b753c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:10.119014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-927e2478-3239-4dc1-b055-5e0cc82b753c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:10.138184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927e2478-3239-4dc1-b055-5e0cc82b753c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:10.140062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927e2478-3239-4dc1-b055-5e0cc82b753c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:10.142102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927e2478-3239-4dc1-b055-5e0cc82b753c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:10.148454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927e2478-3239-4dc1-b055-5e0cc82b753c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:10.150460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927e2478-3239-4dc1-b055-5e0cc82b753c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:10.154888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-927e2478-3239-4dc1-b055-5e0cc82b753c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:10.547023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-927e2478-3239-4dc1-b055-5e0cc82b753c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:10.562097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-927e2478-3239-4dc1-b055-5e0cc82b753c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:10.574239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-927e2478-3239-4dc1-b055-5e0cc82b753c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:10.577568 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-927e2478-3239-4dc1-b055-5e0cc82b753c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 2929 microversion: 2.32 time: 0.472702 Oct 27 19:20:10.578922 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3079/6000] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:10 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 2929 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:10.825851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ace73b80-6007-4340-84b9-ab078f5dc363 req-3460c56f-b4ea-4fe9-a1ca-bc704974163e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbf8d5b-8288-4bd2-91dd-d67825cb8007", "name": "network-vif-unplugged", "status": "completed", "tag": "51f53b33-b1cf-4efb-b7b4-8ec80712f964"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:10.848225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ace73b80-6007-4340-84b9-ab078f5dc363 req-3460c56f-b4ea-4fe9-a1ca-bc704974163e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:10.848949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ace73b80-6007-4340-84b9-ab078f5dc363 req-3460c56f-b4ea-4fe9-a1ca-bc704974163e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:10.849456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ace73b80-6007-4340-84b9-ab078f5dc363 req-3460c56f-b4ea-4fe9-a1ca-bc704974163e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:10.883414 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ace73b80-6007-4340-84b9-ab078f5dc363 req-3460c56f-b4ea-4fe9-a1ca-bc704974163e service nova] Creating event network-vif-unplugged:51f53b33-b1cf-4efb-b7b4-8ec80712f964 for instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 on n-h2-860687-3 Oct 27 19:20:10.904707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-ace73b80-6007-4340-84b9-ab078f5dc363 req-3460c56f-b4ea-4fe9-a1ca-bc704974163e service nova] Instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:20:10.922558 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ace73b80-6007-4340-84b9-ab078f5dc363 req-3460c56f-b4ea-4fe9-a1ca-bc704974163e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101066 Oct 27 19:20:10.933223 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2922/6001] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:10.950258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f95cd3d2-d939-4a2d-b704-ed09026795ca tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:10.950932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f95cd3d2-d939-4a2d-b704-ed09026795ca tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:10.960544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f95cd3d2-d939-4a2d-b704-ed09026795ca tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:10.960926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f95cd3d2-d939-4a2d-b704-ed09026795ca tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:10.961968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f95cd3d2-d939-4a2d-b704-ed09026795ca tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:10.963985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f95cd3d2-d939-4a2d-b704-ed09026795ca tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:10.964738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f95cd3d2-d939-4a2d-b704-ed09026795ca tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:10.965511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f95cd3d2-d939-4a2d-b704-ed09026795ca tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:10.992614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-a11c82ef-f463-47c7-af1f-1fcbf22b2dde req-db1e631e-426e-44ed-bfec-ad7035989f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca69bee-c613-4be0-8d24-2280e0768f94", "name": "network-vif-plugged", "status": "completed", "tag": "6adf6e5d-706e-4a99-8dcd-07ff1cd301b0"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:11.011301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:11.016535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a11c82ef-f463-47c7-af1f-1fcbf22b2dde req-db1e631e-426e-44ed-bfec-ad7035989f14 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:11.017047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a11c82ef-f463-47c7-af1f-1fcbf22b2dde req-db1e631e-426e-44ed-bfec-ad7035989f14 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:11.022737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a11c82ef-f463-47c7-af1f-1fcbf22b2dde req-db1e631e-426e-44ed-bfec-ad7035989f14 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:11.052044 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a11c82ef-f463-47c7-af1f-1fcbf22b2dde req-db1e631e-426e-44ed-bfec-ad7035989f14 service nova] Creating event network-vif-plugged:6adf6e5d-706e-4a99-8dcd-07ff1cd301b0 for instance dca69bee-c613-4be0-8d24-2280e0768f94 on n-h1-860687-3 Oct 27 19:20:11.063526 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-a11c82ef-f463-47c7-af1f-1fcbf22b2dde req-db1e631e-426e-44ed-bfec-ad7035989f14 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075665 Oct 27 19:20:11.067634 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2923/6002] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:20:11.094330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-09ffb728-7a8c-4495-9ce8-cbbe000eb573 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:11.095316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-09ffb728-7a8c-4495-9ce8-cbbe000eb573 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:11.111305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09ffb728-7a8c-4495-9ce8-cbbe000eb573 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:11.111959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09ffb728-7a8c-4495-9ce8-cbbe000eb573 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:11.114531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09ffb728-7a8c-4495-9ce8-cbbe000eb573 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:11.122486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09ffb728-7a8c-4495-9ce8-cbbe000eb573 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:11.123226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09ffb728-7a8c-4495-9ce8-cbbe000eb573 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:11.123724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09ffb728-7a8c-4495-9ce8-cbbe000eb573 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:11.449485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f95cd3d2-d939-4a2d-b704-ed09026795ca tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:11.466332 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f95cd3d2-d939-4a2d-b704-ed09026795ca tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1314 microversion: 2.1 time: 0.517611 Oct 27 19:20:11.467182 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3080/6003] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:10 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:11.611622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b40e9833-8e7d-4eca-861e-82cded2d9258 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:11.612256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b40e9833-8e7d-4eca-861e-82cded2d9258 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:11.623576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:11.627744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b40e9833-8e7d-4eca-861e-82cded2d9258 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:11.628612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b40e9833-8e7d-4eca-861e-82cded2d9258 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:11.629087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b40e9833-8e7d-4eca-861e-82cded2d9258 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:11.630173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b40e9833-8e7d-4eca-861e-82cded2d9258 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:11.630794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b40e9833-8e7d-4eca-861e-82cded2d9258 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:11.631148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b40e9833-8e7d-4eca-861e-82cded2d9258 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:12.044870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-09ffb728-7a8c-4495-9ce8-cbbe000eb573 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:12.058305 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-09ffb728-7a8c-4495-9ce8-cbbe000eb573 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1689 microversion: 2.1 time: 0.989190 Oct 27 19:20:12.071778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b40e9833-8e7d-4eca-861e-82cded2d9258 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:12.085627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b40e9833-8e7d-4eca-861e-82cded2d9258 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:12.089940 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2924/6004] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:11 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1689 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:12.091629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b40e9833-8e7d-4eca-861e-82cded2d9258 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:12.092963 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b40e9833-8e7d-4eca-861e-82cded2d9258 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 2929 microversion: 2.32 time: 0.485527 Oct 27 19:20:12.102842 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3081/6005] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:11 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 2929 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:20:12.498574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f8e6b9b0-a3e5-419b-b2d9-31857337c443 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:12.499580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f8e6b9b0-a3e5-419b-b2d9-31857337c443 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:12.515036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8e6b9b0-a3e5-419b-b2d9-31857337c443 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:12.518116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8e6b9b0-a3e5-419b-b2d9-31857337c443 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:12.518791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8e6b9b0-a3e5-419b-b2d9-31857337c443 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:12.521715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8e6b9b0-a3e5-419b-b2d9-31857337c443 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:12.522402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8e6b9b0-a3e5-419b-b2d9-31857337c443 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:12.523741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f8e6b9b0-a3e5-419b-b2d9-31857337c443 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:12.764087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-369109731", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6d718db-ca0d-4b82-a31b-0c93aa3d04f6"}], "security_groups": [{"name": "tempest-securitygroup--1967689969"}], "key_name": "tempest-keypair-689434955", "user_data": "}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:13.163825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] validate_networks() for [('e6d718db-ca0d-4b82-a31b-0c93aa3d04f6', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:20:13.622929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:13.804539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f8e6b9b0-a3e5-419b-b2d9-31857337c443 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:13.816066 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f8e6b9b0-a3e5-419b-b2d9-31857337c443 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1314 microversion: 2.1 time: 1.325845 Oct 27 19:20:13.819133 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2925/6006] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:12 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1314 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:13.827792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d671df4c-35f2-4d4d-8763-5ef222933b7d req-11db7c4a-4120-434a-bd49-be691abf5afa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bbf8d5b-8288-4bd2-91dd-d67825cb8007", "tag": "51f53b33-b1cf-4efb-b7b4-8ec80712f964"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:13.849874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d671df4c-35f2-4d4d-8763-5ef222933b7d req-11db7c4a-4120-434a-bd49-be691abf5afa service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:13.850366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d671df4c-35f2-4d4d-8763-5ef222933b7d req-11db7c4a-4120-434a-bd49-be691abf5afa service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:13.853814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d671df4c-35f2-4d4d-8763-5ef222933b7d req-11db7c4a-4120-434a-bd49-be691abf5afa service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:13.902910 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d671df4c-35f2-4d4d-8763-5ef222933b7d req-11db7c4a-4120-434a-bd49-be691abf5afa service nova] Creating event network-changed:51f53b33-b1cf-4efb-b7b4-8ec80712f964 for instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 on n-h2-860687-3 Oct 27 19:20:13.915418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-d671df4c-35f2-4d4d-8763-5ef222933b7d req-11db7c4a-4120-434a-bd49-be691abf5afa service nova] Instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:20:13.952083 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d671df4c-35f2-4d4d-8763-5ef222933b7d req-11db7c4a-4120-434a-bd49-be691abf5afa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131493 Oct 27 19:20:13.952968 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2926/6007] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:13.964658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ce82811d-7db3-400b-8d66-9fc9bf09180f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:13.970688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ce82811d-7db3-400b-8d66-9fc9bf09180f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:13.990414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce82811d-7db3-400b-8d66-9fc9bf09180f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:13.993177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce82811d-7db3-400b-8d66-9fc9bf09180f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:13.999569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce82811d-7db3-400b-8d66-9fc9bf09180f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:14.000604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce82811d-7db3-400b-8d66-9fc9bf09180f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:14.003525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce82811d-7db3-400b-8d66-9fc9bf09180f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:14.004222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce82811d-7db3-400b-8d66-9fc9bf09180f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:14.519807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ce82811d-7db3-400b-8d66-9fc9bf09180f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:14.528662 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ce82811d-7db3-400b-8d66-9fc9bf09180f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1689 microversion: 2.1 time: 0.572851 Oct 27 19:20:14.540996 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2927/6008] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:13 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1689 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:14.546332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ca973783-d0ea-46fa-ad57-7ae414e435f2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:14.547004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ca973783-d0ea-46fa-ad57-7ae414e435f2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:14.562130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca973783-d0ea-46fa-ad57-7ae414e435f2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:14.563538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca973783-d0ea-46fa-ad57-7ae414e435f2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:14.564134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca973783-d0ea-46fa-ad57-7ae414e435f2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:14.564993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca973783-d0ea-46fa-ad57-7ae414e435f2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:14.565619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca973783-d0ea-46fa-ad57-7ae414e435f2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:14.566358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca973783-d0ea-46fa-ad57-7ae414e435f2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:14.977286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:20:14.978338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:20:14.979009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:20:14.979585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:20:14.980160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:20:15.005749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:15.012868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:15.013583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:15.014619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:15.015241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:15.028355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:15.040705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ca973783-d0ea-46fa-ad57-7ae414e435f2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:15.055363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ca973783-d0ea-46fa-ad57-7ae414e435f2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:15.065731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ca973783-d0ea-46fa-ad57-7ae414e435f2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:15.069823 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ca973783-d0ea-46fa-ad57-7ae414e435f2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 2908 microversion: 2.32 time: 0.527693 Oct 27 19:20:15.071026 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2928/6009] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:14 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 2908 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:15.075826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b996e9f2-3f61-4891-9506-66b87a67b458 req-29e491bd-fad2-4418-9233-4de4f8c1e60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-unplugged", "status": "completed", "tag": "4ce86d42-71a2-4e2c-87ec-79cedd1a70d0"}, {"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-unplugged", "status": "completed", "tag": "03f458ee-4642-43c5-b1e8-c0561e0c41f5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:15.103784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Getting quotas for project 9e8019adc2594ba4970d50028c4b79db. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:20:15.117213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b996e9f2-3f61-4891-9506-66b87a67b458 req-29e491bd-fad2-4418-9233-4de4f8c1e60b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:15.118151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b996e9f2-3f61-4891-9506-66b87a67b458 req-29e491bd-fad2-4418-9233-4de4f8c1e60b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:15.122915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b996e9f2-3f61-4891-9506-66b87a67b458 req-29e491bd-fad2-4418-9233-4de4f8c1e60b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:15.127543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Getting quotas for user ac513a8932e4435e88fcd8a023b31c5c and project 9e8019adc2594ba4970d50028c4b79db. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:20:15.163087 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b996e9f2-3f61-4891-9506-66b87a67b458 req-29e491bd-fad2-4418-9233-4de4f8c1e60b service nova] Creating event network-vif-unplugged:4ce86d42-71a2-4e2c-87ec-79cedd1a70d0 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:20:15.163884 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b996e9f2-3f61-4891-9506-66b87a67b458 req-29e491bd-fad2-4418-9233-4de4f8c1e60b service nova] Creating event network-vif-unplugged:03f458ee-4642-43c5-b1e8-c0561e0c41f5 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:20:15.172808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:20:15.177389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:20:15.181046 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b996e9f2-3f61-4891-9506-66b87a67b458 req-29e491bd-fad2-4418-9233-4de4f8c1e60b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.108603 Oct 27 19:20:15.183927 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2929/6010] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:15.190519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-20ab9003-239a-49c7-95a0-5c768bc458e4 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:15.206625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-20ab9003-239a-49c7-95a0-5c768bc458e4 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:15.222973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20ab9003-239a-49c7-95a0-5c768bc458e4 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:15.224108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20ab9003-239a-49c7-95a0-5c768bc458e4 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:15.224555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20ab9003-239a-49c7-95a0-5c768bc458e4 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:15.234762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20ab9003-239a-49c7-95a0-5c768bc458e4 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:15.235033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20ab9003-239a-49c7-95a0-5c768bc458e4 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:15.239761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20ab9003-239a-49c7-95a0-5c768bc458e4 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:15.362170 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dc2da861-432a-42ad-8739-13a446c6c31d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.603469 Oct 27 19:20:15.372221 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3082/6011] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:20:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 19:20:15.381633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b0204b41-2f14-4b2d-a989-be475ec70bc1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:15.388682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b0204b41-2f14-4b2d-a989-be475ec70bc1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:15.632339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b0204b41-2f14-4b2d-a989-be475ec70bc1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:15.659943 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b0204b41-2f14-4b2d-a989-be475ec70bc1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1236 microversion: 2.1 time: 0.286032 Oct 27 19:20:15.668483 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3083/6012] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:15 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1236 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:15.682831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2435cba2-f588-414f-81c3-8f2fc05f669b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:15.685483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2435cba2-f588-414f-81c3-8f2fc05f669b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:15.701635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2435cba2-f588-414f-81c3-8f2fc05f669b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:15.702494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2435cba2-f588-414f-81c3-8f2fc05f669b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:15.704868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2435cba2-f588-414f-81c3-8f2fc05f669b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:15.706607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2435cba2-f588-414f-81c3-8f2fc05f669b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:15.710419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2435cba2-f588-414f-81c3-8f2fc05f669b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:15.711148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2435cba2-f588-414f-81c3-8f2fc05f669b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:15.827587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-20ab9003-239a-49c7-95a0-5c768bc458e4 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:15.836900 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-20ab9003-239a-49c7-95a0-5c768bc458e4 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1497 microversion: 2.1 time: 0.650629 Oct 27 19:20:15.844865 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2930/6013] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:15 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1497 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:16.107139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-469e4d3a-83e9-437f-a765-41003965894b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:16.108478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-469e4d3a-83e9-437f-a765-41003965894b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:16.134929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-469e4d3a-83e9-437f-a765-41003965894b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:16.135499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-469e4d3a-83e9-437f-a765-41003965894b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:16.135960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-469e4d3a-83e9-437f-a765-41003965894b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:16.136718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-469e4d3a-83e9-437f-a765-41003965894b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:16.137186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-469e4d3a-83e9-437f-a765-41003965894b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:16.137623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-469e4d3a-83e9-437f-a765-41003965894b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:16.945611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-469e4d3a-83e9-437f-a765-41003965894b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:16.948637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:16.967197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2435cba2-f588-414f-81c3-8f2fc05f669b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:16.972285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-469e4d3a-83e9-437f-a765-41003965894b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:16.979041 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2435cba2-f588-414f-81c3-8f2fc05f669b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1689 microversion: 2.1 time: 1.309118 Oct 27 19:20:16.982191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-469e4d3a-83e9-437f-a765-41003965894b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:16.988306 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3084/6014] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:15 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1689 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:16.994960 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-469e4d3a-83e9-437f-a765-41003965894b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 2908 microversion: 2.32 time: 0.887625 Oct 27 19:20:17.009679 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2931/6015] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:16 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 2908 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:20:17.021001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7af2bfba-5803-4ca3-834c-fbe767b1e6b6 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:17.023447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7af2bfba-5803-4ca3-834c-fbe767b1e6b6 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:17.038849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7af2bfba-5803-4ca3-834c-fbe767b1e6b6 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:17.039552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7af2bfba-5803-4ca3-834c-fbe767b1e6b6 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:17.041306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7af2bfba-5803-4ca3-834c-fbe767b1e6b6 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:17.042223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7af2bfba-5803-4ca3-834c-fbe767b1e6b6 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:17.045451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7af2bfba-5803-4ca3-834c-fbe767b1e6b6 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:17.046114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7af2bfba-5803-4ca3-834c-fbe767b1e6b6 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:17.285195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7af2bfba-5803-4ca3-834c-fbe767b1e6b6 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:17.298416 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7af2bfba-5803-4ca3-834c-fbe767b1e6b6 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1232 microversion: 2.1 time: 0.306809 Oct 27 19:20:17.299529 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3085/6016] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:16 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1232 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:17.351872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c7f8acd3-7b55-4d8b-9a41-507a24b08d83 req-b7741901-9979-438d-a7b0-09cc3367257c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-unplugged", "status": "completed", "tag": "930eb105-32c0-40a2-a18f-960c696dabb1"}, {"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-unplugged", "status": "completed", "tag": "22ff15ff-92e5-4daa-abf0-a7696778e3f7"}, {"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-unplugged", "status": "completed", "tag": "1f07717a-ae91-4c44-8b27-921e82e3c064"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:17.378086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c7f8acd3-7b55-4d8b-9a41-507a24b08d83 req-b7741901-9979-438d-a7b0-09cc3367257c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:17.380496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c7f8acd3-7b55-4d8b-9a41-507a24b08d83 req-b7741901-9979-438d-a7b0-09cc3367257c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:17.381074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c7f8acd3-7b55-4d8b-9a41-507a24b08d83 req-b7741901-9979-438d-a7b0-09cc3367257c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:17.415215 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c7f8acd3-7b55-4d8b-9a41-507a24b08d83 req-b7741901-9979-438d-a7b0-09cc3367257c service nova] Creating event network-vif-unplugged:930eb105-32c0-40a2-a18f-960c696dabb1 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:20:17.415746 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c7f8acd3-7b55-4d8b-9a41-507a24b08d83 req-b7741901-9979-438d-a7b0-09cc3367257c service nova] Creating event network-vif-unplugged:22ff15ff-92e5-4daa-abf0-a7696778e3f7 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:20:17.419555 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c7f8acd3-7b55-4d8b-9a41-507a24b08d83 req-b7741901-9979-438d-a7b0-09cc3367257c service nova] Creating event network-vif-unplugged:1f07717a-ae91-4c44-8b27-921e82e3c064 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:20:17.432556 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c7f8acd3-7b55-4d8b-9a41-507a24b08d83 req-b7741901-9979-438d-a7b0-09cc3367257c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.088321 Oct 27 19:20:17.433749 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2932/6017] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:18.016953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0dfa3cc7-6b9b-4808-b6e8-bfde3c66db73 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:18.017891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0dfa3cc7-6b9b-4808-b6e8-bfde3c66db73 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:18.031665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7bd6ecc-f18b-468c-aff0-b06e9185beff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:18.032559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7bd6ecc-f18b-468c-aff0-b06e9185beff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:18.038704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dfa3cc7-6b9b-4808-b6e8-bfde3c66db73 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:18.039342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dfa3cc7-6b9b-4808-b6e8-bfde3c66db73 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:18.040051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dfa3cc7-6b9b-4808-b6e8-bfde3c66db73 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:18.041024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dfa3cc7-6b9b-4808-b6e8-bfde3c66db73 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:18.041574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dfa3cc7-6b9b-4808-b6e8-bfde3c66db73 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:18.042094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0dfa3cc7-6b9b-4808-b6e8-bfde3c66db73 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:18.064848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7bd6ecc-f18b-468c-aff0-b06e9185beff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:18.065619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7bd6ecc-f18b-468c-aff0-b06e9185beff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:18.071116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7bd6ecc-f18b-468c-aff0-b06e9185beff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:18.072113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7bd6ecc-f18b-468c-aff0-b06e9185beff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:18.080633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7bd6ecc-f18b-468c-aff0-b06e9185beff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:18.081616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7bd6ecc-f18b-468c-aff0-b06e9185beff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:18.725856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0dfa3cc7-6b9b-4808-b6e8-bfde3c66db73 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:18.743894 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0dfa3cc7-6b9b-4808-b6e8-bfde3c66db73 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1682 microversion: 2.1 time: 0.730748 Oct 27 19:20:18.745101 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3086/6018] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:18 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1682 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:18.750086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a24d8f5f-b26a-4561-b4e6-b86733863a93 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:18.750949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a24d8f5f-b26a-4561-b4e6-b86733863a93 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:18.766833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a24d8f5f-b26a-4561-b4e6-b86733863a93 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:18.767688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a24d8f5f-b26a-4561-b4e6-b86733863a93 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:18.768330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a24d8f5f-b26a-4561-b4e6-b86733863a93 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:18.769250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a24d8f5f-b26a-4561-b4e6-b86733863a93 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:18.771486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a24d8f5f-b26a-4561-b4e6-b86733863a93 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:18.772336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a24d8f5f-b26a-4561-b4e6-b86733863a93 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:18.866035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7bd6ecc-f18b-468c-aff0-b06e9185beff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:18.882607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7bd6ecc-f18b-468c-aff0-b06e9185beff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:18.889392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7bd6ecc-f18b-468c-aff0-b06e9185beff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:18.892348 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7bd6ecc-f18b-468c-aff0-b06e9185beff tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 2908 microversion: 2.32 time: 0.866648 Oct 27 19:20:18.894854 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2933/6019] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:18 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 2908 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:18.988266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a24d8f5f-b26a-4561-b4e6-b86733863a93 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:19.001085 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a24d8f5f-b26a-4561-b4e6-b86733863a93 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1294 microversion: 2.1 time: 0.254544 Oct 27 19:20:19.008824 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3087/6020] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:18 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1294 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:19.664466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-807b9780-3018-48d9-87bf-7d77cb37d69a req-a2c4d923-34b9-47fc-92c2-b5dc1966d4bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-deleted", "tag": "930eb105-32c0-40a2-a18f-960c696dabb1"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:19.698115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-807b9780-3018-48d9-87bf-7d77cb37d69a req-a2c4d923-34b9-47fc-92c2-b5dc1966d4bb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:19.704763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-807b9780-3018-48d9-87bf-7d77cb37d69a req-a2c4d923-34b9-47fc-92c2-b5dc1966d4bb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:19.705409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-807b9780-3018-48d9-87bf-7d77cb37d69a req-a2c4d923-34b9-47fc-92c2-b5dc1966d4bb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:19.726799 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-807b9780-3018-48d9-87bf-7d77cb37d69a req-a2c4d923-34b9-47fc-92c2-b5dc1966d4bb service nova] Creating event network-vif-deleted:930eb105-32c0-40a2-a18f-960c696dabb1 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:20:19.742871 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-807b9780-3018-48d9-87bf-7d77cb37d69a req-a2c4d923-34b9-47fc-92c2-b5dc1966d4bb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083494 Oct 27 19:20:19.745271 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2934/6021] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:19.933166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b748617a-0dbf-4097-b8db-d8b67e966ac3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:19.933905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b748617a-0dbf-4097-b8db-d8b67e966ac3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:19.946085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b748617a-0dbf-4097-b8db-d8b67e966ac3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:19.949186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b748617a-0dbf-4097-b8db-d8b67e966ac3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:19.949764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b748617a-0dbf-4097-b8db-d8b67e966ac3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:19.950655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b748617a-0dbf-4097-b8db-d8b67e966ac3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:19.952545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b748617a-0dbf-4097-b8db-d8b67e966ac3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:19.953097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b748617a-0dbf-4097-b8db-d8b67e966ac3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:20.051243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-233f83c4-3312-4753-b3b9-81ee94fb018e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:20.052949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-233f83c4-3312-4753-b3b9-81ee94fb018e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:20.060362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-233f83c4-3312-4753-b3b9-81ee94fb018e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:20.063243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-233f83c4-3312-4753-b3b9-81ee94fb018e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:20.063986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-233f83c4-3312-4753-b3b9-81ee94fb018e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:20.064941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-233f83c4-3312-4753-b3b9-81ee94fb018e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:20.067879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-233f83c4-3312-4753-b3b9-81ee94fb018e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:20.069064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-233f83c4-3312-4753-b3b9-81ee94fb018e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:20.270810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-233f83c4-3312-4753-b3b9-81ee94fb018e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:20.291354 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-233f83c4-3312-4753-b3b9-81ee94fb018e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1294 microversion: 2.1 time: 0.262439 Oct 27 19:20:20.303230 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2935/6022] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:20 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1294 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:20:21.257184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b748617a-0dbf-4097-b8db-d8b67e966ac3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:21.283851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b748617a-0dbf-4097-b8db-d8b67e966ac3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:21.297616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b748617a-0dbf-4097-b8db-d8b67e966ac3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:21.319579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-efdef147-8d2b-402e-98a1-91f61aaf09e4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:21.320143 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b748617a-0dbf-4097-b8db-d8b67e966ac3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 2576 microversion: 2.32 time: 1.393349 Oct 27 19:20:21.320249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-efdef147-8d2b-402e-98a1-91f61aaf09e4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:21.321138 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3088/6023] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:19 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 2576 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:21.327036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-efdef147-8d2b-402e-98a1-91f61aaf09e4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:21.346734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-efdef147-8d2b-402e-98a1-91f61aaf09e4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:21.347498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-efdef147-8d2b-402e-98a1-91f61aaf09e4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:21.349009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-efdef147-8d2b-402e-98a1-91f61aaf09e4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:21.349708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-efdef147-8d2b-402e-98a1-91f61aaf09e4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:21.350306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-efdef147-8d2b-402e-98a1-91f61aaf09e4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:21.668533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-efdef147-8d2b-402e-98a1-91f61aaf09e4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:21.683963 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-efdef147-8d2b-402e-98a1-91f61aaf09e4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1294 microversion: 2.1 time: 0.365199 Oct 27 19:20:21.685382 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2936/6024] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:21 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1294 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:20:21.966693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-fc2d74b7-d6ad-4bfd-b2e7-0de8e3825f07 req-315d422c-a281-43fc-9a82-f096619aa475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-deleted", "tag": "4ce86d42-71a2-4e2c-87ec-79cedd1a70d0"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:22.017951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fc2d74b7-d6ad-4bfd-b2e7-0de8e3825f07 req-315d422c-a281-43fc-9a82-f096619aa475 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:22.018626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fc2d74b7-d6ad-4bfd-b2e7-0de8e3825f07 req-315d422c-a281-43fc-9a82-f096619aa475 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:22.019102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fc2d74b7-d6ad-4bfd-b2e7-0de8e3825f07 req-315d422c-a281-43fc-9a82-f096619aa475 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:22.083826 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-fc2d74b7-d6ad-4bfd-b2e7-0de8e3825f07 req-315d422c-a281-43fc-9a82-f096619aa475 service nova] Creating event network-vif-deleted:4ce86d42-71a2-4e2c-87ec-79cedd1a70d0 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:20:22.099971 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-fc2d74b7-d6ad-4bfd-b2e7-0de8e3825f07 req-315d422c-a281-43fc-9a82-f096619aa475 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134008 Oct 27 19:20:22.102129 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3089/6025] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:22.131972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1b716a36-764c-4639-b930-0f8ead2b0a24 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:22.132753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1b716a36-764c-4639-b930-0f8ead2b0a24 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:22.143504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b716a36-764c-4639-b930-0f8ead2b0a24 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:22.144508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b716a36-764c-4639-b930-0f8ead2b0a24 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:22.145195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b716a36-764c-4639-b930-0f8ead2b0a24 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:22.146554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b716a36-764c-4639-b930-0f8ead2b0a24 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:22.148463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b716a36-764c-4639-b930-0f8ead2b0a24 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:22.149119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b716a36-764c-4639-b930-0f8ead2b0a24 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:22.213412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1b716a36-764c-4639-b930-0f8ead2b0a24 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:20:22.354297 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1b716a36-764c-4639-b930-0f8ead2b0a24 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 204 len: 0 microversion: 2.1 time: 0.228617 Oct 27 19:20:22.355929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f8069d79-6caa-48fc-a85b-fcd33a1ce79b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:22.356748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f8069d79-6caa-48fc-a85b-fcd33a1ce79b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:22.358279 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2937/6026] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:20:22 2022] DELETE /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:20:22.371680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cd7e0afe-f1fd-43db-bab9-937294ba4674 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:22.373274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cd7e0afe-f1fd-43db-bab9-937294ba4674 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:22.376081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8069d79-6caa-48fc-a85b-fcd33a1ce79b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:22.376719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8069d79-6caa-48fc-a85b-fcd33a1ce79b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:22.377188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8069d79-6caa-48fc-a85b-fcd33a1ce79b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:22.379153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8069d79-6caa-48fc-a85b-fcd33a1ce79b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:22.381135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8069d79-6caa-48fc-a85b-fcd33a1ce79b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:22.381707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd7e0afe-f1fd-43db-bab9-937294ba4674 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:22.381890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f8069d79-6caa-48fc-a85b-fcd33a1ce79b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:22.382570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd7e0afe-f1fd-43db-bab9-937294ba4674 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:22.383181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd7e0afe-f1fd-43db-bab9-937294ba4674 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:22.385685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd7e0afe-f1fd-43db-bab9-937294ba4674 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:22.386544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd7e0afe-f1fd-43db-bab9-937294ba4674 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:22.387423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd7e0afe-f1fd-43db-bab9-937294ba4674 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:22.714690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f8069d79-6caa-48fc-a85b-fcd33a1ce79b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:22.736781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f8069d79-6caa-48fc-a85b-fcd33a1ce79b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:22.738957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f8069d79-6caa-48fc-a85b-fcd33a1ce79b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:22.740922 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f8069d79-6caa-48fc-a85b-fcd33a1ce79b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 2417 microversion: 2.32 time: 0.390639 Oct 27 19:20:22.768917 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3090/6027] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:22 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 2417 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:20:22.786928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5ea5ef1e-fa2c-4a3c-ac63-52561432b541 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:22.788109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5ea5ef1e-fa2c-4a3c-ac63-52561432b541 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:22.798095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ea5ef1e-fa2c-4a3c-ac63-52561432b541 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:22.798567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ea5ef1e-fa2c-4a3c-ac63-52561432b541 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:22.799035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ea5ef1e-fa2c-4a3c-ac63-52561432b541 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:22.804694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ea5ef1e-fa2c-4a3c-ac63-52561432b541 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:22.804694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ea5ef1e-fa2c-4a3c-ac63-52561432b541 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:22.804694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ea5ef1e-fa2c-4a3c-ac63-52561432b541 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:23.116014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cd7e0afe-f1fd-43db-bab9-937294ba4674 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:23.135374 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cd7e0afe-f1fd-43db-bab9-937294ba4674 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1503 microversion: 2.1 time: 0.771884 Oct 27 19:20:23.144133 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2938/6028] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:22 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1503 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:23.293389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5ea5ef1e-fa2c-4a3c-ac63-52561432b541 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:23.302202 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5ea5ef1e-fa2c-4a3c-ac63-52561432b541 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1362 microversion: 2.1 time: 0.530616 Oct 27 19:20:23.307339 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3091/6029] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:22 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:23.778889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1c0ededa-f3f7-499b-af80-a7543d8339d2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:23.779533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1c0ededa-f3f7-499b-af80-a7543d8339d2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:23.817476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c0ededa-f3f7-499b-af80-a7543d8339d2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:23.817867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c0ededa-f3f7-499b-af80-a7543d8339d2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:23.824570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c0ededa-f3f7-499b-af80-a7543d8339d2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:23.825348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c0ededa-f3f7-499b-af80-a7543d8339d2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:23.825822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c0ededa-f3f7-499b-af80-a7543d8339d2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:23.826253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c0ededa-f3f7-499b-af80-a7543d8339d2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:24.167777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d1e55ddd-3037-44c4-a883-a49aeab01500 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:24.168414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d1e55ddd-3037-44c4-a883-a49aeab01500 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:24.184068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1e55ddd-3037-44c4-a883-a49aeab01500 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:24.184648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1e55ddd-3037-44c4-a883-a49aeab01500 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:24.185033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1e55ddd-3037-44c4-a883-a49aeab01500 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:24.185771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1e55ddd-3037-44c4-a883-a49aeab01500 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:24.186654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1e55ddd-3037-44c4-a883-a49aeab01500 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:24.187126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d1e55ddd-3037-44c4-a883-a49aeab01500 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:24.589186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1c0ededa-f3f7-499b-af80-a7543d8339d2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:24.604901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1c0ededa-f3f7-499b-af80-a7543d8339d2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:24.609895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1c0ededa-f3f7-499b-af80-a7543d8339d2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:24.611404 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1c0ededa-f3f7-499b-af80-a7543d8339d2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 2371 microversion: 2.32 time: 0.840037 Oct 27 19:20:24.617788 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2939/6030] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:23 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 2371 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:24.627632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-283b68a8-7e20-4744-874a-63395fa333a4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:24.628275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-283b68a8-7e20-4744-874a-63395fa333a4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:24.644859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-283b68a8-7e20-4744-874a-63395fa333a4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:24.645965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-283b68a8-7e20-4744-874a-63395fa333a4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:24.646675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-283b68a8-7e20-4744-874a-63395fa333a4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:24.647927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-283b68a8-7e20-4744-874a-63395fa333a4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:24.651079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-283b68a8-7e20-4744-874a-63395fa333a4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:24.653278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-283b68a8-7e20-4744-874a-63395fa333a4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:25.085076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:25.313536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-283b68a8-7e20-4744-874a-63395fa333a4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:25.327005 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-283b68a8-7e20-4744-874a-63395fa333a4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1362 microversion: 2.1 time: 0.707848 Oct 27 19:20:25.343595 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2940/6031] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:24 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1362 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:25.343595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-6938795f-dfb0-426d-9048-29aa4eaf2f98 req-8a2968e7-aa31-4d41-912a-6d290d0436b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-deleted", "tag": "03f458ee-4642-43c5-b1e8-c0561e0c41f5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:25.372821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6938795f-dfb0-426d-9048-29aa4eaf2f98 req-8a2968e7-aa31-4d41-912a-6d290d0436b2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:25.373324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6938795f-dfb0-426d-9048-29aa4eaf2f98 req-8a2968e7-aa31-4d41-912a-6d290d0436b2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:25.373766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6938795f-dfb0-426d-9048-29aa4eaf2f98 req-8a2968e7-aa31-4d41-912a-6d290d0436b2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:25.425530 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-6938795f-dfb0-426d-9048-29aa4eaf2f98 req-8a2968e7-aa31-4d41-912a-6d290d0436b2 service nova] Creating event network-vif-deleted:03f458ee-4642-43c5-b1e8-c0561e0c41f5 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:20:25.434972 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-6938795f-dfb0-426d-9048-29aa4eaf2f98 req-8a2968e7-aa31-4d41-912a-6d290d0436b2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096152 Oct 27 19:20:25.435861 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2941/6032] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:25.448332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-82c0f9ba-becb-4212-8ff5-24d0537997f8 req-a6d0b9b1-90c9-4fd6-bb58-d085bd569306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbf8d5b-8288-4bd2-91dd-d67825cb8007", "name": "network-vif-plugged", "status": "completed", "tag": "51f53b33-b1cf-4efb-b7b4-8ec80712f964"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:25.496460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-82c0f9ba-becb-4212-8ff5-24d0537997f8 req-a6d0b9b1-90c9-4fd6-bb58-d085bd569306 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:25.499985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-82c0f9ba-becb-4212-8ff5-24d0537997f8 req-a6d0b9b1-90c9-4fd6-bb58-d085bd569306 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:25.500795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-82c0f9ba-becb-4212-8ff5-24d0537997f8 req-a6d0b9b1-90c9-4fd6-bb58-d085bd569306 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:25.532539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d1e55ddd-3037-44c4-a883-a49aeab01500 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:25.534220 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-82c0f9ba-becb-4212-8ff5-24d0537997f8 req-a6d0b9b1-90c9-4fd6-bb58-d085bd569306 service nova] Creating event network-vif-plugged:51f53b33-b1cf-4efb-b7b4-8ec80712f964 for instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 on n-h2-860687-3 Oct 27 19:20:25.547073 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-82c0f9ba-becb-4212-8ff5-24d0537997f8 req-a6d0b9b1-90c9-4fd6-bb58-d085bd569306 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105578 Oct 27 19:20:25.548133 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d1e55ddd-3037-44c4-a883-a49aeab01500 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1503 microversion: 2.1 time: 1.384349 Oct 27 19:20:25.548334 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2942/6033] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:25.561930 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3092/6034] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:24 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1503 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:25.646575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7edeb242-539e-4110-8aca-8ddc3d690fab tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:25.647391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7edeb242-539e-4110-8aca-8ddc3d690fab tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:25.660163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edeb242-539e-4110-8aca-8ddc3d690fab tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:25.661446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edeb242-539e-4110-8aca-8ddc3d690fab tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:25.662262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edeb242-539e-4110-8aca-8ddc3d690fab tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:25.664475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edeb242-539e-4110-8aca-8ddc3d690fab tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:25.664970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edeb242-539e-4110-8aca-8ddc3d690fab tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:25.674562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7edeb242-539e-4110-8aca-8ddc3d690fab tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:26.087713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7edeb242-539e-4110-8aca-8ddc3d690fab tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:26.113483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7edeb242-539e-4110-8aca-8ddc3d690fab tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:26.118273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7edeb242-539e-4110-8aca-8ddc3d690fab tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:26.122964 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7edeb242-539e-4110-8aca-8ddc3d690fab tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 2211 microversion: 2.32 time: 0.482231 Oct 27 19:20:26.159605 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2943/6035] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:25 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 2211 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:26.351435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b1a74d3-750f-492a-8d89-e768e305034c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:26.352116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b1a74d3-750f-492a-8d89-e768e305034c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:26.355590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:26.381878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b1a74d3-750f-492a-8d89-e768e305034c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:26.382812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b1a74d3-750f-492a-8d89-e768e305034c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:26.383607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b1a74d3-750f-492a-8d89-e768e305034c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:26.385597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b1a74d3-750f-492a-8d89-e768e305034c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:26.391621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b1a74d3-750f-492a-8d89-e768e305034c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:26.392977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b1a74d3-750f-492a-8d89-e768e305034c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:26.589227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e805b8c6-3d71-452d-a133-d97039a4c686 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:26.590018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e805b8c6-3d71-452d-a133-d97039a4c686 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:26.602411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e805b8c6-3d71-452d-a133-d97039a4c686 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:26.602930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e805b8c6-3d71-452d-a133-d97039a4c686 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:26.603384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e805b8c6-3d71-452d-a133-d97039a4c686 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:26.607976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e805b8c6-3d71-452d-a133-d97039a4c686 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:26.610181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e805b8c6-3d71-452d-a133-d97039a4c686 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:26.610711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e805b8c6-3d71-452d-a133-d97039a4c686 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:27.454816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3b1a74d3-750f-492a-8d89-e768e305034c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:27.465724 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b1a74d3-750f-492a-8d89-e768e305034c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1362 microversion: 2.1 time: 1.120149 Oct 27 19:20:27.478783 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3093/6036] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:26 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1362 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:27.484789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2100cfcf-9a7c-41c4-bf8a-c564f5032298 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:27.486254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2100cfcf-9a7c-41c4-bf8a-c564f5032298 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:27.500487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2100cfcf-9a7c-41c4-bf8a-c564f5032298 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:27.502800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2100cfcf-9a7c-41c4-bf8a-c564f5032298 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:27.507528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2100cfcf-9a7c-41c4-bf8a-c564f5032298 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:27.511552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2100cfcf-9a7c-41c4-bf8a-c564f5032298 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:27.513241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2100cfcf-9a7c-41c4-bf8a-c564f5032298 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:27.513902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2100cfcf-9a7c-41c4-bf8a-c564f5032298 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:27.609222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e805b8c6-3d71-452d-a133-d97039a4c686 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caba9bb6fd24203a64fa598d35ec45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d96bce18a094463a4636e5b386bb6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:27.620382 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e805b8c6-3d71-452d-a133-d97039a4c686 tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 200 len: 1461 microversion: 2.1 time: 1.049580 Oct 27 19:20:27.621567 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2944/6037] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:26 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 1461 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:27.626808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f3022ca2-0493-4115-be47-11173e41632d req-7265167c-c421-4e67-b9fe-0174248a262f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca69bee-c613-4be0-8d24-2280e0768f94", "name": "network-vif-deleted", "tag": "6adf6e5d-706e-4a99-8dcd-07ff1cd301b0"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:27.638428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f3022ca2-0493-4115-be47-11173e41632d req-7265167c-c421-4e67-b9fe-0174248a262f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:27.639394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f3022ca2-0493-4115-be47-11173e41632d req-7265167c-c421-4e67-b9fe-0174248a262f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:27.640045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f3022ca2-0493-4115-be47-11173e41632d req-7265167c-c421-4e67-b9fe-0174248a262f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:27.655858 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f3022ca2-0493-4115-be47-11173e41632d req-7265167c-c421-4e67-b9fe-0174248a262f service nova] Creating event network-vif-deleted:6adf6e5d-706e-4a99-8dcd-07ff1cd301b0 for instance dca69bee-c613-4be0-8d24-2280e0768f94 on n-h1-860687-3 Oct 27 19:20:27.661748 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f3022ca2-0493-4115-be47-11173e41632d req-7265167c-c421-4e67-b9fe-0174248a262f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038771 Oct 27 19:20:27.662711 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2945/6038] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:27.668695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-7f51a0de-2e0e-4818-8a1c-4fff75fb7035 req-ae0cd791-1c65-4633-8a4b-62f5712e19e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-deleted", "tag": "1f07717a-ae91-4c44-8b27-921e82e3c064"}, {"server_uuid": "46702c4b-fab5-4783-a45a-b828d8f40927", "name": "network-vif-deleted", "tag": "22ff15ff-92e5-4daa-abf0-a7696778e3f7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:27.691055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7f51a0de-2e0e-4818-8a1c-4fff75fb7035 req-ae0cd791-1c65-4633-8a4b-62f5712e19e5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:27.695935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7f51a0de-2e0e-4818-8a1c-4fff75fb7035 req-ae0cd791-1c65-4633-8a4b-62f5712e19e5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:27.696636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7f51a0de-2e0e-4818-8a1c-4fff75fb7035 req-ae0cd791-1c65-4633-8a4b-62f5712e19e5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:27.724193 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-7f51a0de-2e0e-4818-8a1c-4fff75fb7035 req-ae0cd791-1c65-4633-8a4b-62f5712e19e5 service nova] Creating event network-vif-deleted:1f07717a-ae91-4c44-8b27-921e82e3c064 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:20:27.724740 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-7f51a0de-2e0e-4818-8a1c-4fff75fb7035 req-ae0cd791-1c65-4633-8a4b-62f5712e19e5 service nova] Creating event network-vif-deleted:22ff15ff-92e5-4daa-abf0-a7696778e3f7 for instance 46702c4b-fab5-4783-a45a-b828d8f40927 on n-h2-860687-3 Oct 27 19:20:27.749692 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-7f51a0de-2e0e-4818-8a1c-4fff75fb7035 req-ae0cd791-1c65-4633-8a4b-62f5712e19e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.084509 Oct 27 19:20:27.752855 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2946/6039] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:27.922748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2100cfcf-9a7c-41c4-bf8a-c564f5032298 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:27.951716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2100cfcf-9a7c-41c4-bf8a-c564f5032298 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:27.963651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2100cfcf-9a7c-41c4-bf8a-c564f5032298 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:27.965927 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2100cfcf-9a7c-41c4-bf8a-c564f5032298 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.485123 Oct 27 19:20:27.982434 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3094/6040] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:27 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:28.498187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d2de9806-c1ab-4177-b342-1089e15b6218 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:28.499299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d2de9806-c1ab-4177-b342-1089e15b6218 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:28.515628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2de9806-c1ab-4177-b342-1089e15b6218 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:28.516380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2de9806-c1ab-4177-b342-1089e15b6218 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:28.517527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2de9806-c1ab-4177-b342-1089e15b6218 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:28.519915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2de9806-c1ab-4177-b342-1089e15b6218 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:28.520654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2de9806-c1ab-4177-b342-1089e15b6218 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:28.521676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2de9806-c1ab-4177-b342-1089e15b6218 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:28.654020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-75aee03c-6de2-4689-94a1-5dfc6137f3ab tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:28.657065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-75aee03c-6de2-4689-94a1-5dfc6137f3ab tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] [instance: dca69bee-c613-4be0-8d24-2280e0768f94] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:28.679382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75aee03c-6de2-4689-94a1-5dfc6137f3ab tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:28.680258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75aee03c-6de2-4689-94a1-5dfc6137f3ab tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:28.680962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75aee03c-6de2-4689-94a1-5dfc6137f3ab tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:28.681929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75aee03c-6de2-4689-94a1-5dfc6137f3ab tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:28.682950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75aee03c-6de2-4689-94a1-5dfc6137f3ab tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:28.684710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-75aee03c-6de2-4689-94a1-5dfc6137f3ab tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:28.727094 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-75aee03c-6de2-4689-94a1-5dfc6137f3ab tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] HTTP exception thrown: Instance dca69bee-c613-4be0-8d24-2280e0768f94 could not be found. Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-75aee03c-6de2-4689-94a1-5dfc6137f3ab tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Request method failure captured: Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 HTTP/1.1 Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtnUd2k2HkiklNSZL54mK7PKXwDv-b2L2Zp4-5TRFZ2mHRg-8LTvC7VRO9UJ5f9a3qXjFop5kU3PJ7L4CI6tBBus02iNNuNkIfsQa-rskfY4o5BV8A1q-YiYfURXYXysOu2jWUnS_fISZhor3yU_a1znA5sSFOAv4b59I8j3C-zx63g Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 2d96bce18a094463a4636e5b386bb6e5 Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-VolumesActionsTest-355457349 Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2d96bce18a094463a4636e5b386bb6e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d96bce18a094463a4636e5b386bb6e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2d96bce18a094463a4636e5b386bb6e5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d96bce18a094463a4636e5b386bb6e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-VolumesActionsTest-355457349 Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 2d96bce18a094463a4636e5b386bb6e5 Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-VolumesActionsTest-355457349 Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-VolumesActionsTest-355457349-project Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 6caba9bb6fd24203a64fa598d35ec45f Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-VolumesActionsTest-355457349-project Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance dca69bee-c613-4be0-8d24-2280e0768f94 could not be found. Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'dca69bee-c613-4be0-8d24-2280e0768f94'} Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca69bee-c613-4be0-8d24-2280e0768f94 could not be found. Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca69bee-c613-4be0-8d24-2280e0768f94 could not be found. Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:20:28.729662 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:20:28.733574 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:20:28.733574 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:20:28.733574 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:20:28.733574 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:20:28.733574 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:20:28.733574 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca69bee-c613-4be0-8d24-2280e0768f94 could not be found. Oct 27 19:20:28.733574 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:20:28.735631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-75aee03c-6de2-4689-94a1-5dfc6137f3ab tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] Returning 404 to user: Instance dca69bee-c613-4be0-8d24-2280e0768f94 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:20:28.736660 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-75aee03c-6de2-4689-94a1-5dfc6137f3ab tempest-VolumesActionsTest-355457349 tempest-VolumesActionsTest-355457349-project] 10.222.0.42 "GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94" status: 404 len: 111 microversion: 2.1 time: 0.090805 Oct 27 19:20:28.737285 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3095/6041] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:28 2022] GET /compute/v2.1/servers/dca69bee-c613-4be0-8d24-2280e0768f94 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:20:28.999252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-570647b9-415a-4b06-8fe7-7589f581c366 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:28.999799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-570647b9-415a-4b06-8fe7-7589f581c366 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:29.014715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-570647b9-415a-4b06-8fe7-7589f581c366 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:29.015218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-570647b9-415a-4b06-8fe7-7589f581c366 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:29.015856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-570647b9-415a-4b06-8fe7-7589f581c366 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:29.016743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-570647b9-415a-4b06-8fe7-7589f581c366 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:29.017410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-570647b9-415a-4b06-8fe7-7589f581c366 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:29.018041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-570647b9-415a-4b06-8fe7-7589f581c366 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:29.199787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-570647b9-415a-4b06-8fe7-7589f581c366 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:29.216001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-570647b9-415a-4b06-8fe7-7589f581c366 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:29.220871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-570647b9-415a-4b06-8fe7-7589f581c366 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:29.223440 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-570647b9-415a-4b06-8fe7-7589f581c366 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.227844 Oct 27 19:20:29.225616 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3096/6042] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:28 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:20:29.335515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d2de9806-c1ab-4177-b342-1089e15b6218 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:29.369327 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d2de9806-c1ab-4177-b342-1089e15b6218 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1362 microversion: 2.1 time: 0.854816 Oct 27 19:20:29.385603 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2947/6043] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:28 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1362 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:29.786411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-836b9b77-e49f-4251-9728-7bd9c935282f req-3300a137-d901-4ae7-8fca-29d556aca388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db56aa8c-7a19-4910-8226-c70ac28faf8d", "tag": "7f955ef2-2fab-4400-923d-9b32e09953a9"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:29.806176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-836b9b77-e49f-4251-9728-7bd9c935282f req-3300a137-d901-4ae7-8fca-29d556aca388 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:29.810554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-836b9b77-e49f-4251-9728-7bd9c935282f req-3300a137-d901-4ae7-8fca-29d556aca388 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:29.811212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-836b9b77-e49f-4251-9728-7bd9c935282f req-3300a137-d901-4ae7-8fca-29d556aca388 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:29.840940 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-836b9b77-e49f-4251-9728-7bd9c935282f req-3300a137-d901-4ae7-8fca-29d556aca388 service nova] Creating event network-changed:7f955ef2-2fab-4400-923d-9b32e09953a9 for instance db56aa8c-7a19-4910-8226-c70ac28faf8d on n-h1-860687-3 Oct 27 19:20:29.888246 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-836b9b77-e49f-4251-9728-7bd9c935282f req-3300a137-d901-4ae7-8fca-29d556aca388 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105868 Oct 27 19:20:29.902015 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3097/6044] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:30.254614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1594f71b-cff2-41fd-83c4-4ef8f1164ed2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:30.255468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1594f71b-cff2-41fd-83c4-4ef8f1164ed2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:30.272672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1594f71b-cff2-41fd-83c4-4ef8f1164ed2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:30.273195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1594f71b-cff2-41fd-83c4-4ef8f1164ed2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:30.275282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1594f71b-cff2-41fd-83c4-4ef8f1164ed2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:30.276124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1594f71b-cff2-41fd-83c4-4ef8f1164ed2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:30.276611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1594f71b-cff2-41fd-83c4-4ef8f1164ed2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:30.277107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1594f71b-cff2-41fd-83c4-4ef8f1164ed2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:30.414491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ba36d015-5dea-4076-b19c-b0163eedc917 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:30.415222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ba36d015-5dea-4076-b19c-b0163eedc917 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:30.438758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba36d015-5dea-4076-b19c-b0163eedc917 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:30.439668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba36d015-5dea-4076-b19c-b0163eedc917 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:30.440430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba36d015-5dea-4076-b19c-b0163eedc917 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:30.441331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba36d015-5dea-4076-b19c-b0163eedc917 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:30.442166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba36d015-5dea-4076-b19c-b0163eedc917 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:30.443343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba36d015-5dea-4076-b19c-b0163eedc917 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:30.523025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1594f71b-cff2-41fd-83c4-4ef8f1164ed2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:30.543770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1594f71b-cff2-41fd-83c4-4ef8f1164ed2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:30.552517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1594f71b-cff2-41fd-83c4-4ef8f1164ed2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:30.554173 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1594f71b-cff2-41fd-83c4-4ef8f1164ed2 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.304046 Oct 27 19:20:30.560848 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2948/6045] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:30 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:31.095748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ba36d015-5dea-4076-b19c-b0163eedc917 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:31.106961 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ba36d015-5dea-4076-b19c-b0163eedc917 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1362 microversion: 2.1 time: 0.698157 Oct 27 19:20:31.107556 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3098/6046] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:30 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1362 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:31.587124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6051294-71ac-41f5-be68-427370934c4b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:31.588015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d6051294-71ac-41f5-be68-427370934c4b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:31.605241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6051294-71ac-41f5-be68-427370934c4b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:31.605753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6051294-71ac-41f5-be68-427370934c4b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:31.606672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6051294-71ac-41f5-be68-427370934c4b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:31.606955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6051294-71ac-41f5-be68-427370934c4b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:31.607421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6051294-71ac-41f5-be68-427370934c4b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:31.607856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6051294-71ac-41f5-be68-427370934c4b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:31.848826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d6051294-71ac-41f5-be68-427370934c4b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:31.867062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d6051294-71ac-41f5-be68-427370934c4b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:31.868614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d6051294-71ac-41f5-be68-427370934c4b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:31.869870 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d6051294-71ac-41f5-be68-427370934c4b tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.286741 Oct 27 19:20:31.870459 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2949/6047] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:31 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:32.134889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b0dd6c5d-163a-4fbb-9fd8-d2da94a4b018 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:32.136914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b0dd6c5d-163a-4fbb-9fd8-d2da94a4b018 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:32.146871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0dd6c5d-163a-4fbb-9fd8-d2da94a4b018 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:32.148261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0dd6c5d-163a-4fbb-9fd8-d2da94a4b018 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:32.148943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0dd6c5d-163a-4fbb-9fd8-d2da94a4b018 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:32.151986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0dd6c5d-163a-4fbb-9fd8-d2da94a4b018 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:32.152742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0dd6c5d-163a-4fbb-9fd8-d2da94a4b018 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:32.153562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0dd6c5d-163a-4fbb-9fd8-d2da94a4b018 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:32.831132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b0dd6c5d-163a-4fbb-9fd8-d2da94a4b018 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:32.846486 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b0dd6c5d-163a-4fbb-9fd8-d2da94a4b018 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1362 microversion: 2.1 time: 0.712173 Oct 27 19:20:32.859235 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3099/6048] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:32 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1362 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:32.903850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f0959f01-339e-49d1-bf0b-c96d8075f1e3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:32.905136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f0959f01-339e-49d1-bf0b-c96d8075f1e3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:32.915311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0959f01-339e-49d1-bf0b-c96d8075f1e3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:32.916139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0959f01-339e-49d1-bf0b-c96d8075f1e3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:32.916985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0959f01-339e-49d1-bf0b-c96d8075f1e3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:32.917915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0959f01-339e-49d1-bf0b-c96d8075f1e3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:32.919077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0959f01-339e-49d1-bf0b-c96d8075f1e3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:32.919752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0959f01-339e-49d1-bf0b-c96d8075f1e3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:33.102122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f0959f01-339e-49d1-bf0b-c96d8075f1e3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:33.105602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:33.126401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f0959f01-339e-49d1-bf0b-c96d8075f1e3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:33.138147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f0959f01-339e-49d1-bf0b-c96d8075f1e3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:33.139378 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f0959f01-339e-49d1-bf0b-c96d8075f1e3 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.242031 Oct 27 19:20:33.141223 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2950/6049] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:32 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:33.876118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b5fe0011-5a57-4363-af10-3e8691223a3c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:33.878436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b5fe0011-5a57-4363-af10-3e8691223a3c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:33.888252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5fe0011-5a57-4363-af10-3e8691223a3c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:33.889054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5fe0011-5a57-4363-af10-3e8691223a3c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:33.889871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5fe0011-5a57-4363-af10-3e8691223a3c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:33.891088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5fe0011-5a57-4363-af10-3e8691223a3c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:33.891789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5fe0011-5a57-4363-af10-3e8691223a3c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:33.892449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5fe0011-5a57-4363-af10-3e8691223a3c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:34.169743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-78ece99c-6a71-4d27-b64a-f32ecfb9a291 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:34.171122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-78ece99c-6a71-4d27-b64a-f32ecfb9a291 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:34.184626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78ece99c-6a71-4d27-b64a-f32ecfb9a291 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:34.189508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78ece99c-6a71-4d27-b64a-f32ecfb9a291 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:34.190311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78ece99c-6a71-4d27-b64a-f32ecfb9a291 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:34.191408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78ece99c-6a71-4d27-b64a-f32ecfb9a291 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:34.192301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78ece99c-6a71-4d27-b64a-f32ecfb9a291 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:34.194670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78ece99c-6a71-4d27-b64a-f32ecfb9a291 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:34.388205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b5fe0011-5a57-4363-af10-3e8691223a3c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:34.391990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:34.401033 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b5fe0011-5a57-4363-af10-3e8691223a3c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1362 microversion: 2.1 time: 0.529985 Oct 27 19:20:34.403169 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3100/6050] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:33 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1362 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:34.438463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-78ece99c-6a71-4d27-b64a-f32ecfb9a291 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:34.449008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-78ece99c-6a71-4d27-b64a-f32ecfb9a291 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:34.466767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-78ece99c-6a71-4d27-b64a-f32ecfb9a291 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:34.468194 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-78ece99c-6a71-4d27-b64a-f32ecfb9a291 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.302990 Oct 27 19:20:34.468929 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2951/6051] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:34 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:20:35.110251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1430401089", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0a46616e-9bdb-4ff2-a307-cbf21cce8a7b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:35.231240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] validate_networks() for [('0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:20:35.424505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fcfe3b8c-2eee-48ac-b4d1-680696db191f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:35.427756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fcfe3b8c-2eee-48ac-b4d1-680696db191f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:35.445186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcfe3b8c-2eee-48ac-b4d1-680696db191f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:35.457822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcfe3b8c-2eee-48ac-b4d1-680696db191f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:35.461982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcfe3b8c-2eee-48ac-b4d1-680696db191f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:35.467221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcfe3b8c-2eee-48ac-b4d1-680696db191f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:35.468598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcfe3b8c-2eee-48ac-b4d1-680696db191f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:35.472410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcfe3b8c-2eee-48ac-b4d1-680696db191f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:36.031949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fcfe3b8c-2eee-48ac-b4d1-680696db191f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:36.040819 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fcfe3b8c-2eee-48ac-b4d1-680696db191f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1362 microversion: 2.1 time: 0.620119 Oct 27 19:20:36.044984 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2952/6052] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:35 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1362 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:36.050103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a579e5bb-307f-4786-be23-9cd6954a3164 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:36.053271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a579e5bb-307f-4786-be23-9cd6954a3164 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:36.068358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a579e5bb-307f-4786-be23-9cd6954a3164 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:36.073258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a579e5bb-307f-4786-be23-9cd6954a3164 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:36.073842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a579e5bb-307f-4786-be23-9cd6954a3164 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:36.077730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a579e5bb-307f-4786-be23-9cd6954a3164 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:36.078420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a579e5bb-307f-4786-be23-9cd6954a3164 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:36.079502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a579e5bb-307f-4786-be23-9cd6954a3164 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:36.131721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:20:36.132173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:20:36.132601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:20:36.133186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:20:36.134056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:20:36.144472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:36.161925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:36.162428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:36.163263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:36.163740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:36.164191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:36.199614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a579e5bb-307f-4786-be23-9cd6954a3164 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:36.210077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a579e5bb-307f-4786-be23-9cd6954a3164 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:36.212092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a579e5bb-307f-4786-be23-9cd6954a3164 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:36.213716 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a579e5bb-307f-4786-be23-9cd6954a3164 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.167496 Oct 27 19:20:36.214543 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2953/6053] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:36 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:36.219350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c287bf5d-a972-4674-9f8e-ae7fa215e96e req-cf5cce19-0f04-4b42-945e-3f9324183d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db56aa8c-7a19-4910-8226-c70ac28faf8d", "name": "network-vif-plugged", "status": "completed", "tag": "7f955ef2-2fab-4400-923d-9b32e09953a9"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:36.227231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:20:36.244644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c287bf5d-a972-4674-9f8e-ae7fa215e96e req-cf5cce19-0f04-4b42-945e-3f9324183d09 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:36.247110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c287bf5d-a972-4674-9f8e-ae7fa215e96e req-cf5cce19-0f04-4b42-945e-3f9324183d09 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:36.248171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c287bf5d-a972-4674-9f8e-ae7fa215e96e req-cf5cce19-0f04-4b42-945e-3f9324183d09 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:36.253956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for user c8e60ff9ab0d45628195f314f1cac791 and project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:20:36.276386 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c287bf5d-a972-4674-9f8e-ae7fa215e96e req-cf5cce19-0f04-4b42-945e-3f9324183d09 service nova] Creating event network-vif-plugged:7f955ef2-2fab-4400-923d-9b32e09953a9 for instance db56aa8c-7a19-4910-8226-c70ac28faf8d on n-h1-860687-3 Oct 27 19:20:36.286514 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c287bf5d-a972-4674-9f8e-ae7fa215e96e req-cf5cce19-0f04-4b42-945e-3f9324183d09 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069888 Oct 27 19:20:36.288596 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2954/6054] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:36.402032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:20:36.405203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a46616e-9bdb-4ff2-a307-cbf21cce8a7b',volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:20:36.819486 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-71e89d43-1fc3-4dd6-ad89-1a7078ec8aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.713054 Oct 27 19:20:36.826654 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3101/6055] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:20:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:20:36.832669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-25fa616e-d9af-4b1d-9a83-c57e393bd516 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:36.833968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-25fa616e-d9af-4b1d-9a83-c57e393bd516 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:37.077351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a95a663-933b-4402-a3a2-3d79a964de03 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:37.078571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1a95a663-933b-4402-a3a2-3d79a964de03 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:37.088187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a95a663-933b-4402-a3a2-3d79a964de03 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:37.089004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a95a663-933b-4402-a3a2-3d79a964de03 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:37.089700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a95a663-933b-4402-a3a2-3d79a964de03 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:37.090974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a95a663-933b-4402-a3a2-3d79a964de03 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:37.091712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a95a663-933b-4402-a3a2-3d79a964de03 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:37.092718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a95a663-933b-4402-a3a2-3d79a964de03 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:37.151540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-25fa616e-d9af-4b1d-9a83-c57e393bd516 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:37.159972 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-25fa616e-d9af-4b1d-9a83-c57e393bd516 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1057 microversion: 2.1 time: 0.331533 Oct 27 19:20:37.164942 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2955/6056] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:36 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1057 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:20:37.248200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6596882c-7b3e-47b5-b8b5-f8edacc2a3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:37.250348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6596882c-7b3e-47b5-b8b5-f8edacc2a3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:37.266677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6596882c-7b3e-47b5-b8b5-f8edacc2a3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:37.286282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6596882c-7b3e-47b5-b8b5-f8edacc2a3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:37.286799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6596882c-7b3e-47b5-b8b5-f8edacc2a3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:37.287678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6596882c-7b3e-47b5-b8b5-f8edacc2a3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:37.288237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6596882c-7b3e-47b5-b8b5-f8edacc2a3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:37.300105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6596882c-7b3e-47b5-b8b5-f8edacc2a3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:37.305752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1a95a663-933b-4402-a3a2-3d79a964de03 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:37.324050 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1a95a663-933b-4402-a3a2-3d79a964de03 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1362 microversion: 2.1 time: 0.254824 Oct 27 19:20:37.325292 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3102/6057] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:37 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:37.737292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6596882c-7b3e-47b5-b8b5-f8edacc2a3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:37.762978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6596882c-7b3e-47b5-b8b5-f8edacc2a3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:37.781756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6596882c-7b3e-47b5-b8b5-f8edacc2a3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:37.792830 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6596882c-7b3e-47b5-b8b5-f8edacc2a3f6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.549473 Oct 27 19:20:37.794592 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2956/6058] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:37 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:38.191776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5f8cfbff-1012-4cb4-8f4b-430e7449be5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:38.192836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5f8cfbff-1012-4cb4-8f4b-430e7449be5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:38.210052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f8cfbff-1012-4cb4-8f4b-430e7449be5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:38.217830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f8cfbff-1012-4cb4-8f4b-430e7449be5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:38.221770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f8cfbff-1012-4cb4-8f4b-430e7449be5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:38.224916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f8cfbff-1012-4cb4-8f4b-430e7449be5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:38.225667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f8cfbff-1012-4cb4-8f4b-430e7449be5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:38.241159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5f8cfbff-1012-4cb4-8f4b-430e7449be5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:38.355994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-24250600-6989-4278-9fff-902cd4aadfc8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:38.358453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-24250600-6989-4278-9fff-902cd4aadfc8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:38.396459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24250600-6989-4278-9fff-902cd4aadfc8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:38.398175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24250600-6989-4278-9fff-902cd4aadfc8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:38.400981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24250600-6989-4278-9fff-902cd4aadfc8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:38.405641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24250600-6989-4278-9fff-902cd4aadfc8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:38.406409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24250600-6989-4278-9fff-902cd4aadfc8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:38.407100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24250600-6989-4278-9fff-902cd4aadfc8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:38.426896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5f8cfbff-1012-4cb4-8f4b-430e7449be5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:38.435458 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5f8cfbff-1012-4cb4-8f4b-430e7449be5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1099 microversion: 2.1 time: 0.247995 Oct 27 19:20:38.459412 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3103/6059] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:38 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1099 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:38.822718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-72fc5b45-9de0-4c7a-ba19-4fc393f26270 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:38.823569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-72fc5b45-9de0-4c7a-ba19-4fc393f26270 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:38.846485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72fc5b45-9de0-4c7a-ba19-4fc393f26270 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:38.852449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72fc5b45-9de0-4c7a-ba19-4fc393f26270 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:38.855941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72fc5b45-9de0-4c7a-ba19-4fc393f26270 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:38.862281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72fc5b45-9de0-4c7a-ba19-4fc393f26270 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:38.862885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72fc5b45-9de0-4c7a-ba19-4fc393f26270 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:38.863348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72fc5b45-9de0-4c7a-ba19-4fc393f26270 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:39.122750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-72fc5b45-9de0-4c7a-ba19-4fc393f26270 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:39.135151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-72fc5b45-9de0-4c7a-ba19-4fc393f26270 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:39.136631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-72fc5b45-9de0-4c7a-ba19-4fc393f26270 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:39.137872 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-72fc5b45-9de0-4c7a-ba19-4fc393f26270 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.320251 Oct 27 19:20:39.155748 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3104/6060] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:38 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:20:39.473244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-355aab22-c083-4ccc-aee9-e02da0763d17 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:39.475489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-355aab22-c083-4ccc-aee9-e02da0763d17 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:39.506260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-355aab22-c083-4ccc-aee9-e02da0763d17 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:39.511344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-355aab22-c083-4ccc-aee9-e02da0763d17 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:39.513915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-355aab22-c083-4ccc-aee9-e02da0763d17 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:39.519191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-355aab22-c083-4ccc-aee9-e02da0763d17 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:39.520382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-355aab22-c083-4ccc-aee9-e02da0763d17 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:39.522465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-355aab22-c083-4ccc-aee9-e02da0763d17 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:39.714994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-355aab22-c083-4ccc-aee9-e02da0763d17 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:39.727889 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-355aab22-c083-4ccc-aee9-e02da0763d17 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1173 microversion: 2.1 time: 0.258458 Oct 27 19:20:39.738288 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3105/6061] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:39 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1173 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:39.820079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-24250600-6989-4278-9fff-902cd4aadfc8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:39.839812 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-24250600-6989-4278-9fff-902cd4aadfc8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1548 microversion: 2.1 time: 1.479512 Oct 27 19:20:39.856777 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2957/6062] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:38 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1548 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:39.869386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6255f55c-f780-4f15-9f1c-8c90490cdf49 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:39.869892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6255f55c-f780-4f15-9f1c-8c90490cdf49 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:39.892754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6255f55c-f780-4f15-9f1c-8c90490cdf49 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:39.893337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6255f55c-f780-4f15-9f1c-8c90490cdf49 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:39.896414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6255f55c-f780-4f15-9f1c-8c90490cdf49 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:39.897216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6255f55c-f780-4f15-9f1c-8c90490cdf49 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:39.897693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6255f55c-f780-4f15-9f1c-8c90490cdf49 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:39.898860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6255f55c-f780-4f15-9f1c-8c90490cdf49 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:40.165817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ebb4dc44-c447-44f1-afc7-8423deca8603 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:40.166073 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6255f55c-f780-4f15-9f1c-8c90490cdf49 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.300587 Oct 27 19:20:40.166698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ebb4dc44-c447-44f1-afc7-8423deca8603 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:40.174974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:40.175966 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3106/6063] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:20:39 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/os-interface => generated 284 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:40.186140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ebb4dc44-c447-44f1-afc7-8423deca8603 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:40.190835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ebb4dc44-c447-44f1-afc7-8423deca8603 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:40.190835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ebb4dc44-c447-44f1-afc7-8423deca8603 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:40.199300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ebb4dc44-c447-44f1-afc7-8423deca8603 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:40.202204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ebb4dc44-c447-44f1-afc7-8423deca8603 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:40.202835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ebb4dc44-c447-44f1-afc7-8423deca8603 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:40.432592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ebb4dc44-c447-44f1-afc7-8423deca8603 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:40.446861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ebb4dc44-c447-44f1-afc7-8423deca8603 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:40.455940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ebb4dc44-c447-44f1-afc7-8423deca8603 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:40.461281 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ebb4dc44-c447-44f1-afc7-8423deca8603 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.298204 Oct 27 19:20:40.466624 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2958/6064] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:40 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:20:40.754990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-500339a7-2914-494c-8c13-5c33dd035d8f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:40.760252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-500339a7-2914-494c-8c13-5c33dd035d8f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:40.782222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-500339a7-2914-494c-8c13-5c33dd035d8f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:40.782763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-500339a7-2914-494c-8c13-5c33dd035d8f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:40.790604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-500339a7-2914-494c-8c13-5c33dd035d8f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:40.791548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-500339a7-2914-494c-8c13-5c33dd035d8f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:40.792055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-500339a7-2914-494c-8c13-5c33dd035d8f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:40.792523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-500339a7-2914-494c-8c13-5c33dd035d8f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:41.397989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-500339a7-2914-494c-8c13-5c33dd035d8f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:41.407612 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-500339a7-2914-494c-8c13-5c33dd035d8f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1215 microversion: 2.1 time: 0.658146 Oct 27 19:20:41.408864 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3107/6065] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:40 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1215 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:41.513714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4676c85d-ee40-48d9-8df2-27d47b0074a0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:41.515031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4676c85d-ee40-48d9-8df2-27d47b0074a0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:41.542266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4676c85d-ee40-48d9-8df2-27d47b0074a0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:41.542976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4676c85d-ee40-48d9-8df2-27d47b0074a0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:41.550238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4676c85d-ee40-48d9-8df2-27d47b0074a0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:41.551698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4676c85d-ee40-48d9-8df2-27d47b0074a0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:41.552453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4676c85d-ee40-48d9-8df2-27d47b0074a0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:41.553052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4676c85d-ee40-48d9-8df2-27d47b0074a0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:41.868265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4676c85d-ee40-48d9-8df2-27d47b0074a0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:41.885496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4676c85d-ee40-48d9-8df2-27d47b0074a0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:41.887353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4676c85d-ee40-48d9-8df2-27d47b0074a0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:41.888909 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4676c85d-ee40-48d9-8df2-27d47b0074a0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.379438 Oct 27 19:20:41.904936 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2959/6066] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:41 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:42.436512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1158240f-b083-4a24-9611-2c39b97e8eb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:42.438049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1158240f-b083-4a24-9611-2c39b97e8eb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:42.443774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:42.448678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1158240f-b083-4a24-9611-2c39b97e8eb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:42.449408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1158240f-b083-4a24-9611-2c39b97e8eb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:42.450026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1158240f-b083-4a24-9611-2c39b97e8eb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:42.450957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1158240f-b083-4a24-9611-2c39b97e8eb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:42.451588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1158240f-b083-4a24-9611-2c39b97e8eb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:42.452189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1158240f-b083-4a24-9611-2c39b97e8eb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:42.765108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1158240f-b083-4a24-9611-2c39b97e8eb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:42.783728 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1158240f-b083-4a24-9611-2c39b97e8eb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1215 microversion: 2.1 time: 0.351238 Oct 27 19:20:42.784644 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3108/6067] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:42 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1215 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:42.824272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-07289ba2-f9b7-4c65-8175-7664a76a9c28 req-2c4e0f56-df29-4f33-9be5-c70dada1d7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3502cb-e4d5-43d0-80eb-749093317b4a", "tag": "d30f2edf-86cd-4077-a1d0-f8bb0188d464"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:42.841693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-07289ba2-f9b7-4c65-8175-7664a76a9c28 req-2c4e0f56-df29-4f33-9be5-c70dada1d7a8 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:42.846500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-07289ba2-f9b7-4c65-8175-7664a76a9c28 req-2c4e0f56-df29-4f33-9be5-c70dada1d7a8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:42.847077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-07289ba2-f9b7-4c65-8175-7664a76a9c28 req-2c4e0f56-df29-4f33-9be5-c70dada1d7a8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:42.870996 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-07289ba2-f9b7-4c65-8175-7664a76a9c28 req-2c4e0f56-df29-4f33-9be5-c70dada1d7a8 service nova] Creating event network-changed:d30f2edf-86cd-4077-a1d0-f8bb0188d464 for instance 1f3502cb-e4d5-43d0-80eb-749093317b4a on n-h2-860687-3 Oct 27 19:20:42.877858 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-07289ba2-f9b7-4c65-8175-7664a76a9c28 req-2c4e0f56-df29-4f33-9be5-c70dada1d7a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057394 Oct 27 19:20:42.878645 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2960/6068] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:20:42.917179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e0afa6a9-2146-4acf-8a59-ff1453003345 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:42.917945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e0afa6a9-2146-4acf-8a59-ff1453003345 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:42.927845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0afa6a9-2146-4acf-8a59-ff1453003345 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:42.933994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0afa6a9-2146-4acf-8a59-ff1453003345 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:42.934869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0afa6a9-2146-4acf-8a59-ff1453003345 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:42.935848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0afa6a9-2146-4acf-8a59-ff1453003345 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:42.936568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0afa6a9-2146-4acf-8a59-ff1453003345 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:42.937236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0afa6a9-2146-4acf-8a59-ff1453003345 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:42.983985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-cc3b35b8-eab7-44d7-9ce8-55c145980861 req-d2dca2c9-57c4-49eb-987b-cf3b7b1827ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db56aa8c-7a19-4910-8226-c70ac28faf8d", "tag": "7f955ef2-2fab-4400-923d-9b32e09953a9"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:43.007035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cc3b35b8-eab7-44d7-9ce8-55c145980861 req-d2dca2c9-57c4-49eb-987b-cf3b7b1827ec service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:43.007538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cc3b35b8-eab7-44d7-9ce8-55c145980861 req-d2dca2c9-57c4-49eb-987b-cf3b7b1827ec service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:43.007990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cc3b35b8-eab7-44d7-9ce8-55c145980861 req-d2dca2c9-57c4-49eb-987b-cf3b7b1827ec service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:43.034840 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-cc3b35b8-eab7-44d7-9ce8-55c145980861 req-d2dca2c9-57c4-49eb-987b-cf3b7b1827ec service nova] Creating event network-changed:7f955ef2-2fab-4400-923d-9b32e09953a9 for instance db56aa8c-7a19-4910-8226-c70ac28faf8d on n-h1-860687-3 Oct 27 19:20:43.052974 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-cc3b35b8-eab7-44d7-9ce8-55c145980861 req-d2dca2c9-57c4-49eb-987b-cf3b7b1827ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073104 Oct 27 19:20:43.054215 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2961/6069] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:20:43.142897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e0afa6a9-2146-4acf-8a59-ff1453003345 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:43.154782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e0afa6a9-2146-4acf-8a59-ff1453003345 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:43.166271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e0afa6a9-2146-4acf-8a59-ff1453003345 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:43.176623 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e0afa6a9-2146-4acf-8a59-ff1453003345 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.263124 Oct 27 19:20:43.183682 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3109/6070] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:42 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:43.809184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-674f1336-5df0-4c6b-aa43-e0333e2aa2e3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:43.811106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-674f1336-5df0-4c6b-aa43-e0333e2aa2e3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:43.821077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-674f1336-5df0-4c6b-aa43-e0333e2aa2e3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:43.822010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-674f1336-5df0-4c6b-aa43-e0333e2aa2e3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:43.822707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-674f1336-5df0-4c6b-aa43-e0333e2aa2e3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:43.823681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-674f1336-5df0-4c6b-aa43-e0333e2aa2e3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:43.824579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-674f1336-5df0-4c6b-aa43-e0333e2aa2e3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:43.825672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-674f1336-5df0-4c6b-aa43-e0333e2aa2e3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:44.209901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-00ab968d-161c-446b-8a0a-94cc06643112 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:44.211153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-00ab968d-161c-446b-8a0a-94cc06643112 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:44.228250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00ab968d-161c-446b-8a0a-94cc06643112 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:44.228967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00ab968d-161c-446b-8a0a-94cc06643112 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:44.229603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00ab968d-161c-446b-8a0a-94cc06643112 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:44.230690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00ab968d-161c-446b-8a0a-94cc06643112 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:44.231288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00ab968d-161c-446b-8a0a-94cc06643112 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:44.231760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00ab968d-161c-446b-8a0a-94cc06643112 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:44.272176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-674f1336-5df0-4c6b-aa43-e0333e2aa2e3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:44.289153 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-674f1336-5df0-4c6b-aa43-e0333e2aa2e3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1215 microversion: 2.1 time: 0.485275 Oct 27 19:20:44.298639 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2962/6071] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:43 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1215 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:44.366299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-00ab968d-161c-446b-8a0a-94cc06643112 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:44.381474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-00ab968d-161c-446b-8a0a-94cc06643112 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:44.396500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-00ab968d-161c-446b-8a0a-94cc06643112 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:44.398023 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-00ab968d-161c-446b-8a0a-94cc06643112 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.192313 Oct 27 19:20:44.399098 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3110/6072] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:44 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:45.321308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cacbe20f-b3ae-4a01-bcad-2579fe442da7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:45.321945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cacbe20f-b3ae-4a01-bcad-2579fe442da7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:45.340350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cacbe20f-b3ae-4a01-bcad-2579fe442da7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:45.340860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cacbe20f-b3ae-4a01-bcad-2579fe442da7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:45.341334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cacbe20f-b3ae-4a01-bcad-2579fe442da7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:45.342056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cacbe20f-b3ae-4a01-bcad-2579fe442da7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:45.343378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cacbe20f-b3ae-4a01-bcad-2579fe442da7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:45.343817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cacbe20f-b3ae-4a01-bcad-2579fe442da7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:45.430634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6dc9e1fa-9ea1-40c6-8514-15433db5516c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:45.431426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6dc9e1fa-9ea1-40c6-8514-15433db5516c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:45.442632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6dc9e1fa-9ea1-40c6-8514-15433db5516c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:45.443377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6dc9e1fa-9ea1-40c6-8514-15433db5516c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:45.443681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6dc9e1fa-9ea1-40c6-8514-15433db5516c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:45.444331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6dc9e1fa-9ea1-40c6-8514-15433db5516c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:45.444801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6dc9e1fa-9ea1-40c6-8514-15433db5516c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:45.445599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6dc9e1fa-9ea1-40c6-8514-15433db5516c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:45.506231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cacbe20f-b3ae-4a01-bcad-2579fe442da7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:45.531883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6dc9e1fa-9ea1-40c6-8514-15433db5516c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:45.537038 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cacbe20f-b3ae-4a01-bcad-2579fe442da7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1215 microversion: 2.1 time: 0.220680 Oct 27 19:20:45.537638 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2963/6073] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:45 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:45.543722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6dc9e1fa-9ea1-40c6-8514-15433db5516c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:45.545245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6dc9e1fa-9ea1-40c6-8514-15433db5516c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:45.546697 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6dc9e1fa-9ea1-40c6-8514-15433db5516c tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.122339 Oct 27 19:20:45.547427 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3111/6074] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:45 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:46.573562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-524127ef-507d-4961-bdb0-6ddd6c201dae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:46.574529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-56182c32-6de0-4d46-9946-577bbf28b612 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:46.575244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-56182c32-6de0-4d46-9946-577bbf28b612 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:46.575753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-524127ef-507d-4961-bdb0-6ddd6c201dae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:46.584932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-524127ef-507d-4961-bdb0-6ddd6c201dae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:46.585718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-524127ef-507d-4961-bdb0-6ddd6c201dae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:46.587060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-524127ef-507d-4961-bdb0-6ddd6c201dae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:46.588033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-524127ef-507d-4961-bdb0-6ddd6c201dae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:46.588709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-524127ef-507d-4961-bdb0-6ddd6c201dae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:46.589361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-524127ef-507d-4961-bdb0-6ddd6c201dae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:46.591111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:46.591829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:46.594697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56182c32-6de0-4d46-9946-577bbf28b612 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:46.596271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56182c32-6de0-4d46-9946-577bbf28b612 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:46.598774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56182c32-6de0-4d46-9946-577bbf28b612 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:46.599721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56182c32-6de0-4d46-9946-577bbf28b612 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:46.600217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56182c32-6de0-4d46-9946-577bbf28b612 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:46.600670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56182c32-6de0-4d46-9946-577bbf28b612 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:46.712234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-56182c32-6de0-4d46-9946-577bbf28b612 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:46.722374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-56182c32-6de0-4d46-9946-577bbf28b612 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:46.724908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-56182c32-6de0-4d46-9946-577bbf28b612 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:46.726469 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-56182c32-6de0-4d46-9946-577bbf28b612 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.155910 Oct 27 19:20:46.739459 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3112/6075] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:46 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:20:46.769947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-524127ef-507d-4961-bdb0-6ddd6c201dae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:46.778136 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-524127ef-507d-4961-bdb0-6ddd6c201dae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1215 microversion: 2.1 time: 0.221176 Oct 27 19:20:46.779414 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2964/6076] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:46 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1215 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:47.753853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bab58ce5-6929-46c7-aefb-421a27d24852 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:47.755337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bab58ce5-6929-46c7-aefb-421a27d24852 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:47.774168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bab58ce5-6929-46c7-aefb-421a27d24852 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:47.774717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bab58ce5-6929-46c7-aefb-421a27d24852 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:47.775243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bab58ce5-6929-46c7-aefb-421a27d24852 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:47.776047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bab58ce5-6929-46c7-aefb-421a27d24852 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:47.776591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bab58ce5-6929-46c7-aefb-421a27d24852 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:47.777123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bab58ce5-6929-46c7-aefb-421a27d24852 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:47.804520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ce6a3c4-9145-4c82-9e25-5aefb1718239 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:47.805908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ce6a3c4-9145-4c82-9e25-5aefb1718239 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:47.809139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:47.819554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6a3c4-9145-4c82-9e25-5aefb1718239 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:47.820338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6a3c4-9145-4c82-9e25-5aefb1718239 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:47.821025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6a3c4-9145-4c82-9e25-5aefb1718239 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:47.822307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6a3c4-9145-4c82-9e25-5aefb1718239 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:47.823478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6a3c4-9145-4c82-9e25-5aefb1718239 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:47.824132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6a3c4-9145-4c82-9e25-5aefb1718239 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:47.848579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bab58ce5-6929-46c7-aefb-421a27d24852 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:47.859321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bab58ce5-6929-46c7-aefb-421a27d24852 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:47.861005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bab58ce5-6929-46c7-aefb-421a27d24852 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:47.862430 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bab58ce5-6929-46c7-aefb-421a27d24852 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.113091 Oct 27 19:20:47.878425 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3113/6077] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:47 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:47.993405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ce6a3c4-9145-4c82-9e25-5aefb1718239 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:48.002256 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ce6a3c4-9145-4c82-9e25-5aefb1718239 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1215 microversion: 2.1 time: 0.204985 Oct 27 19:20:48.002939 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2965/6078] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:47 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1215 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:20:48.890299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a21e2146-a007-4b52-aa26-6f759eb5c881 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:48.891692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a21e2146-a007-4b52-aa26-6f759eb5c881 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:48.905488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a21e2146-a007-4b52-aa26-6f759eb5c881 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:48.906080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a21e2146-a007-4b52-aa26-6f759eb5c881 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:48.906639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a21e2146-a007-4b52-aa26-6f759eb5c881 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:48.907598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a21e2146-a007-4b52-aa26-6f759eb5c881 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:48.908138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a21e2146-a007-4b52-aa26-6f759eb5c881 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:48.908669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a21e2146-a007-4b52-aa26-6f759eb5c881 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:48.979243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a21e2146-a007-4b52-aa26-6f759eb5c881 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:48.990784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a21e2146-a007-4b52-aa26-6f759eb5c881 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:48.992533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a21e2146-a007-4b52-aa26-6f759eb5c881 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:48.993751 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a21e2146-a007-4b52-aa26-6f759eb5c881 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.108044 Oct 27 19:20:48.994639 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3114/6079] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:48 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:49.026139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b574331-00bd-475e-bd6d-6fbe005e081c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:49.027005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6b574331-00bd-475e-bd6d-6fbe005e081c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:49.034656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b574331-00bd-475e-bd6d-6fbe005e081c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:49.035789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b574331-00bd-475e-bd6d-6fbe005e081c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:49.036756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b574331-00bd-475e-bd6d-6fbe005e081c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:49.037404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b574331-00bd-475e-bd6d-6fbe005e081c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:49.038075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b574331-00bd-475e-bd6d-6fbe005e081c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:49.038805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b574331-00bd-475e-bd6d-6fbe005e081c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:49.191879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6b574331-00bd-475e-bd6d-6fbe005e081c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:49.200467 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b574331-00bd-475e-bd6d-6fbe005e081c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1215 microversion: 2.1 time: 0.178858 Oct 27 19:20:49.201391 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2966/6080] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:49 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1215 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:49.388913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cea611b5-fb02-48f6-800f-bc382d6870fc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:20:49.391401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cea611b5-fb02-48f6-800f-bc382d6870fc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:49.399530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cea611b5-fb02-48f6-800f-bc382d6870fc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:49.400181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cea611b5-fb02-48f6-800f-bc382d6870fc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:49.400728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cea611b5-fb02-48f6-800f-bc382d6870fc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:49.401534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cea611b5-fb02-48f6-800f-bc382d6870fc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:49.402097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cea611b5-fb02-48f6-800f-bc382d6870fc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:49.402667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cea611b5-fb02-48f6-800f-bc382d6870fc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:49.465269 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cea611b5-fb02-48f6-800f-bc382d6870fc tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007/action" status: 200 len: 63204 microversion: 2.1 time: 0.080239 Oct 27 19:20:49.467341 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3115/6081] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:20:49 2022] POST /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007/action => generated 63204 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:20:50.020969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-df5d568d-3d6b-4239-ab69-50fa0675da1a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:50.021607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-df5d568d-3d6b-4239-ab69-50fa0675da1a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:50.027697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df5d568d-3d6b-4239-ab69-50fa0675da1a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:50.028274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df5d568d-3d6b-4239-ab69-50fa0675da1a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:50.028645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df5d568d-3d6b-4239-ab69-50fa0675da1a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:50.029361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df5d568d-3d6b-4239-ab69-50fa0675da1a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:50.029830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df5d568d-3d6b-4239-ab69-50fa0675da1a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:50.030307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df5d568d-3d6b-4239-ab69-50fa0675da1a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:50.116489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-df5d568d-3d6b-4239-ab69-50fa0675da1a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:50.126531 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-df5d568d-3d6b-4239-ab69-50fa0675da1a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:50.128053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-df5d568d-3d6b-4239-ab69-50fa0675da1a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:50.129864 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-df5d568d-3d6b-4239-ab69-50fa0675da1a tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.113559 Oct 27 19:20:50.131218 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2967/6082] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:50 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:50.226103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5eee6d26-6a04-4caa-85e4-5b261919c063 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:50.226911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5eee6d26-6a04-4caa-85e4-5b261919c063 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:50.234970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5eee6d26-6a04-4caa-85e4-5b261919c063 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:50.235479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5eee6d26-6a04-4caa-85e4-5b261919c063 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:50.235932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5eee6d26-6a04-4caa-85e4-5b261919c063 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:50.236658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5eee6d26-6a04-4caa-85e4-5b261919c063 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:50.237167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5eee6d26-6a04-4caa-85e4-5b261919c063 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:50.237611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5eee6d26-6a04-4caa-85e4-5b261919c063 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:50.381315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5eee6d26-6a04-4caa-85e4-5b261919c063 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:50.390426 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5eee6d26-6a04-4caa-85e4-5b261919c063 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1215 microversion: 2.1 time: 0.169870 Oct 27 19:20:50.391198 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3116/6083] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:50 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:51.162158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-be72ba6e-72ed-4117-b57f-8af174235704 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:51.162884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-be72ba6e-72ed-4117-b57f-8af174235704 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:51.169805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be72ba6e-72ed-4117-b57f-8af174235704 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:51.170298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be72ba6e-72ed-4117-b57f-8af174235704 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:51.170845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be72ba6e-72ed-4117-b57f-8af174235704 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:51.171461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be72ba6e-72ed-4117-b57f-8af174235704 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:51.171917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be72ba6e-72ed-4117-b57f-8af174235704 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:51.172377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be72ba6e-72ed-4117-b57f-8af174235704 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:51.247452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-be72ba6e-72ed-4117-b57f-8af174235704 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:51.259922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-be72ba6e-72ed-4117-b57f-8af174235704 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:51.262036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-be72ba6e-72ed-4117-b57f-8af174235704 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '056031aaff1848f198445e1039b7b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771658773bd54631b79ee8b7232be01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:51.263664 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-be72ba6e-72ed-4117-b57f-8af174235704 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 200 len: 1603 microversion: 2.32 time: 0.109771 Oct 27 19:20:51.278418 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2968/6084] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:51 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 1603 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:20:51.414060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3ba57ca3-b094-4e94-9e08-c385689e9f98 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:51.415345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3ba57ca3-b094-4e94-9e08-c385689e9f98 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:51.459117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ba57ca3-b094-4e94-9e08-c385689e9f98 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:51.459533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ba57ca3-b094-4e94-9e08-c385689e9f98 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:51.475693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ba57ca3-b094-4e94-9e08-c385689e9f98 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:51.477492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ba57ca3-b094-4e94-9e08-c385689e9f98 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:51.478216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ba57ca3-b094-4e94-9e08-c385689e9f98 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:51.479522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ba57ca3-b094-4e94-9e08-c385689e9f98 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:51.657628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3ba57ca3-b094-4e94-9e08-c385689e9f98 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:51.666351 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3ba57ca3-b094-4e94-9e08-c385689e9f98 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1215 microversion: 2.1 time: 0.256320 Oct 27 19:20:51.666979 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3117/6085] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:51 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1215 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:52.294014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c2e068ac-408e-4fc1-8e3c-8d85539189c6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:52.297504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c2e068ac-408e-4fc1-8e3c-8d85539189c6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:52.314713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2e068ac-408e-4fc1-8e3c-8d85539189c6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:52.315507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2e068ac-408e-4fc1-8e3c-8d85539189c6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:52.316378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2e068ac-408e-4fc1-8e3c-8d85539189c6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:52.319520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2e068ac-408e-4fc1-8e3c-8d85539189c6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:52.320387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2e068ac-408e-4fc1-8e3c-8d85539189c6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:52.320986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c2e068ac-408e-4fc1-8e3c-8d85539189c6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:52.355346 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-c2e068ac-408e-4fc1-8e3c-8d85539189c6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] HTTP exception thrown: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c2e068ac-408e-4fc1-8e3c-8d85539189c6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Request method failure captured: Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 HTTP/1.1 Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWth25UVGMsjKIyufLfu0KD1ZHCeJRDB3WV5iW4blCxAvL0LPJUsmdzc6gOX0Xi54ZKe2hcGAvre0GL0LOmvIaCgvjpX-sqogPzbOL0zvnEO-WivMTbvAFiIwCPSDz8tcUQoR-GdLGq9LJG7pys9edcJKusx3I_mLOCGKZ2xz4V1pdp0 Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.32 Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 771658773bd54631b79ee8b7232be01b Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TaggedBootDevicesTest-1098620770 Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/771658773bd54631b79ee8b7232be01b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/771658773bd54631b79ee8b7232be01b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_771658773bd54631b79ee8b7232be01b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/771658773bd54631b79ee8b7232be01b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TaggedBootDevicesTest-1098620770 Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 771658773bd54631b79ee8b7232be01b Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1098620770 Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TaggedBootDevicesTest-1098620770-project Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 056031aaff1848f198445e1039b7b93e Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TaggedBootDevicesTest-1098620770-project Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '46702c4b-fab5-4783-a45a-b828d8f40927'} Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:20:52.357638 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:20:52.361822 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:20:52.361822 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:20:52.361822 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:20:52.361822 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:20:52.361822 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:20:52.361822 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:20:52.361822 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:52.361822 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:20:52.361822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c2e068ac-408e-4fc1-8e3c-8d85539189c6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Returning 404 to user: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:20:52.361822 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c2e068ac-408e-4fc1-8e3c-8d85539189c6 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 404 len: 111 microversion: 2.32 time: 0.071908 Oct 27 19:20:52.361822 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2969/6086] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:52 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:20:52.369529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-162bb63b-5e9a-4984-99e8-b4aa0fb5c7bd tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '.version_select at 0x7fc869e2e5e0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:52.397639 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-162bb63b-5e9a-4984-99e8-b4aa0fb5c7bd tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192509355" status: 204 len: 0 microversion: 2.32 time: 0.032289 Oct 27 19:20:52.403503 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3118/6087] 10.222.0.42 () {60 vars in 1262 bytes} [Thu Oct 27 19:20:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192509355 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 19:20:52.692190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-14fc370c-429c-46b5-b881-89f979532097 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:52.707258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-14fc370c-429c-46b5-b881-89f979532097 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:52.721225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14fc370c-429c-46b5-b881-89f979532097 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:52.722340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14fc370c-429c-46b5-b881-89f979532097 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:52.723361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14fc370c-429c-46b5-b881-89f979532097 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:52.726825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14fc370c-429c-46b5-b881-89f979532097 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:52.728546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14fc370c-429c-46b5-b881-89f979532097 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:52.729002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14fc370c-429c-46b5-b881-89f979532097 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:52.956485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-14fc370c-429c-46b5-b881-89f979532097 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:52.969660 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-14fc370c-429c-46b5-b881-89f979532097 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1215 microversion: 2.1 time: 0.284311 Oct 27 19:20:52.971152 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2970/6088] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:52 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1215 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:53.994263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8da176ef-4555-4ede-a377-8a3fde7cb2f1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:53.995648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8da176ef-4555-4ede-a377-8a3fde7cb2f1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:54.011025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8da176ef-4555-4ede-a377-8a3fde7cb2f1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:54.011570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8da176ef-4555-4ede-a377-8a3fde7cb2f1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:54.012005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8da176ef-4555-4ede-a377-8a3fde7cb2f1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:54.012738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8da176ef-4555-4ede-a377-8a3fde7cb2f1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:54.013218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8da176ef-4555-4ede-a377-8a3fde7cb2f1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:54.013664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8da176ef-4555-4ede-a377-8a3fde7cb2f1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:54.248241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8da176ef-4555-4ede-a377-8a3fde7cb2f1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:54.256302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:54.258823 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8da176ef-4555-4ede-a377-8a3fde7cb2f1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1203 microversion: 2.1 time: 0.269290 Oct 27 19:20:54.259649 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3119/6089] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:53 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1203 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:55.288254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-995d0f7a-5411-43ff-8224-ba7fcf8e5b58 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:55.289514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-995d0f7a-5411-43ff-8224-ba7fcf8e5b58 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:55.304841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-995d0f7a-5411-43ff-8224-ba7fcf8e5b58 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:55.306863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-995d0f7a-5411-43ff-8224-ba7fcf8e5b58 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:55.307562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-995d0f7a-5411-43ff-8224-ba7fcf8e5b58 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:55.309036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-995d0f7a-5411-43ff-8224-ba7fcf8e5b58 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:55.311039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-995d0f7a-5411-43ff-8224-ba7fcf8e5b58 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:55.313064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-995d0f7a-5411-43ff-8224-ba7fcf8e5b58 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:55.320350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:20:55.658365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-995d0f7a-5411-43ff-8224-ba7fcf8e5b58 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:55.666885 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-995d0f7a-5411-43ff-8224-ba7fcf8e5b58 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1203 microversion: 2.1 time: 0.384892 Oct 27 19:20:55.667491 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2971/6090] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:55 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1203 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:56.697636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9dd936d7-d9dc-40e1-9710-766351d10658 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:56.700643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9dd936d7-d9dc-40e1-9710-766351d10658 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:56.732590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd936d7-d9dc-40e1-9710-766351d10658 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:56.734071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd936d7-d9dc-40e1-9710-766351d10658 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:56.735571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd936d7-d9dc-40e1-9710-766351d10658 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:56.763493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd936d7-d9dc-40e1-9710-766351d10658 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:56.776882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd936d7-d9dc-40e1-9710-766351d10658 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:56.821815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9dd936d7-d9dc-40e1-9710-766351d10658 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.058s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:57.152734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9dd936d7-d9dc-40e1-9710-766351d10658 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:57.163329 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9dd936d7-d9dc-40e1-9710-766351d10658 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1203 microversion: 2.1 time: 0.477841 Oct 27 19:20:57.163921 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3120/6091] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:56 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1203 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:57.797273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-53f9a6bd-1e48-4a51-aa34-b9a5ce336652 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:57.798375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-53f9a6bd-1e48-4a51-aa34-b9a5ce336652 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:57.807436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53f9a6bd-1e48-4a51-aa34-b9a5ce336652 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:57.808129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53f9a6bd-1e48-4a51-aa34-b9a5ce336652 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:57.808812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53f9a6bd-1e48-4a51-aa34-b9a5ce336652 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:57.809793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53f9a6bd-1e48-4a51-aa34-b9a5ce336652 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:57.810624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53f9a6bd-1e48-4a51-aa34-b9a5ce336652 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:57.811206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53f9a6bd-1e48-4a51-aa34-b9a5ce336652 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:57.826861 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-53f9a6bd-1e48-4a51-aa34-b9a5ce336652 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] HTTP exception thrown: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-53f9a6bd-1e48-4a51-aa34-b9a5ce336652 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Request method failure captured: Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 HTTP/1.1 Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWth25UVGMsjKIyufLfu0KD1ZHCeJRDB3WV5iW4blCxAvL0LPJUsmdzc6gOX0Xi54ZKe2hcGAvre0GL0LOmvIaCgvjpX-sqogPzbOL0zvnEO-WivMTbvAFiIwCPSDz8tcUQoR-GdLGq9LJG7pys9edcJKusx3I_mLOCGKZ2xz4V1pdp0 Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.32 Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 771658773bd54631b79ee8b7232be01b Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TaggedBootDevicesTest-1098620770 Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/771658773bd54631b79ee8b7232be01b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/771658773bd54631b79ee8b7232be01b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_771658773bd54631b79ee8b7232be01b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/771658773bd54631b79ee8b7232be01b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TaggedBootDevicesTest-1098620770 Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 771658773bd54631b79ee8b7232be01b Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1098620770 Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TaggedBootDevicesTest-1098620770-project Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 056031aaff1848f198445e1039b7b93e Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TaggedBootDevicesTest-1098620770-project Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '46702c4b-fab5-4783-a45a-b828d8f40927'} Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:20:57.828403 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:20:57.833516 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:57.833516 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:20:57.833516 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:20:57.833516 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:20:57.833516 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:20:57.833516 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:20:57.833516 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:20:57.833516 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:20:57.833516 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:20:57.833516 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:57.833516 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:20:57.833516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-53f9a6bd-1e48-4a51-aa34-b9a5ce336652 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Returning 404 to user: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:20:57.833516 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-53f9a6bd-1e48-4a51-aa34-b9a5ce336652 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "DELETE /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 404 len: 111 microversion: 2.32 time: 0.039331 Oct 27 19:20:57.833516 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2972/6092] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 19:20:57 2022] DELETE /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 19:20:57.839847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2af00f13-64f4-4c9c-9e88-ce960d0056c0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:57.841010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2af00f13-64f4-4c9c-9e88-ce960d0056c0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] [instance: 46702c4b-fab5-4783-a45a-b828d8f40927] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:57.848827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2af00f13-64f4-4c9c-9e88-ce960d0056c0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:57.849540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2af00f13-64f4-4c9c-9e88-ce960d0056c0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:57.850154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2af00f13-64f4-4c9c-9e88-ce960d0056c0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:57.851130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2af00f13-64f4-4c9c-9e88-ce960d0056c0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:57.851598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2af00f13-64f4-4c9c-9e88-ce960d0056c0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:57.852036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2af00f13-64f4-4c9c-9e88-ce960d0056c0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:57.867386 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-2af00f13-64f4-4c9c-9e88-ce960d0056c0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] HTTP exception thrown: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2af00f13-64f4-4c9c-9e88-ce960d0056c0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Request method failure captured: Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 HTTP/1.1 Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWth25UVGMsjKIyufLfu0KD1ZHCeJRDB3WV5iW4blCxAvL0LPJUsmdzc6gOX0Xi54ZKe2hcGAvre0GL0LOmvIaCgvjpX-sqogPzbOL0zvnEO-WivMTbvAFiIwCPSDz8tcUQoR-GdLGq9LJG7pys9edcJKusx3I_mLOCGKZ2xz4V1pdp0 Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Openstack-Nova-Api-Version: 2.32 Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 771658773bd54631b79ee8b7232be01b Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TaggedBootDevicesTest-1098620770 Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/771658773bd54631b79ee8b7232be01b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/771658773bd54631b79ee8b7232be01b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_771658773bd54631b79ee8b7232be01b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/771658773bd54631b79ee8b7232be01b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TaggedBootDevicesTest-1098620770 Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 771658773bd54631b79ee8b7232be01b Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1098620770 Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TaggedBootDevicesTest-1098620770-project Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 056031aaff1848f198445e1039b7b93e Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TaggedBootDevicesTest-1098620770-project Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '46702c4b-fab5-4783-a45a-b828d8f40927'} Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:20:57.869079 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:20:57.873072 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:20:57.873072 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:20:57.873072 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:20:57.873072 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:20:57.873072 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:20:57.873072 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:20:57.873072 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. Oct 27 19:20:57.873072 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:20:57.873072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2af00f13-64f4-4c9c-9e88-ce960d0056c0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] Returning 404 to user: Instance 46702c4b-fab5-4783-a45a-b828d8f40927 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:20:57.873072 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2af00f13-64f4-4c9c-9e88-ce960d0056c0 tempest-TaggedBootDevicesTest-1098620770 tempest-TaggedBootDevicesTest-1098620770-project] 10.222.0.42 "GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927" status: 404 len: 111 microversion: 2.32 time: 0.034627 Oct 27 19:20:57.873072 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3121/6093] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:20:57 2022] GET /compute/v2.1/servers/46702c4b-fab5-4783-a45a-b828d8f40927 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:20:58.189448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aedf51ee-c43b-4453-a7b3-c93bc29a07d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:58.190318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aedf51ee-c43b-4453-a7b3-c93bc29a07d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:58.199371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aedf51ee-c43b-4453-a7b3-c93bc29a07d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:58.201975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aedf51ee-c43b-4453-a7b3-c93bc29a07d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:58.202735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aedf51ee-c43b-4453-a7b3-c93bc29a07d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:58.204013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aedf51ee-c43b-4453-a7b3-c93bc29a07d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:58.204639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aedf51ee-c43b-4453-a7b3-c93bc29a07d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:58.205234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aedf51ee-c43b-4453-a7b3-c93bc29a07d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:58.397839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aedf51ee-c43b-4453-a7b3-c93bc29a07d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:58.411711 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aedf51ee-c43b-4453-a7b3-c93bc29a07d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1203 microversion: 2.1 time: 0.226265 Oct 27 19:20:58.419821 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2973/6094] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:58 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1203 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:20:59.445512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eaa3bf76-1e20-41d8-aae7-0e9855ef2a2d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:20:59.446086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-eaa3bf76-1e20-41d8-aae7-0e9855ef2a2d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:20:59.461114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaa3bf76-1e20-41d8-aae7-0e9855ef2a2d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:59.461833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaa3bf76-1e20-41d8-aae7-0e9855ef2a2d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:59.462527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaa3bf76-1e20-41d8-aae7-0e9855ef2a2d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:59.463403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaa3bf76-1e20-41d8-aae7-0e9855ef2a2d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:20:59.464025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaa3bf76-1e20-41d8-aae7-0e9855ef2a2d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:20:59.464636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaa3bf76-1e20-41d8-aae7-0e9855ef2a2d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:20:59.824949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-eaa3bf76-1e20-41d8-aae7-0e9855ef2a2d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:20:59.839270 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eaa3bf76-1e20-41d8-aae7-0e9855ef2a2d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1203 microversion: 2.1 time: 0.398023 Oct 27 19:20:59.839854 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3122/6095] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:20:59 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1203 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:00.863052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-728eeada-d72c-4aa3-83f6-dd27eebeb1a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:00.864100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-728eeada-d72c-4aa3-83f6-dd27eebeb1a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:00.882778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-728eeada-d72c-4aa3-83f6-dd27eebeb1a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:00.883564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-728eeada-d72c-4aa3-83f6-dd27eebeb1a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:00.884190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-728eeada-d72c-4aa3-83f6-dd27eebeb1a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:00.885230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-728eeada-d72c-4aa3-83f6-dd27eebeb1a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:00.885845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-728eeada-d72c-4aa3-83f6-dd27eebeb1a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:00.886662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-728eeada-d72c-4aa3-83f6-dd27eebeb1a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:01.155858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-728eeada-d72c-4aa3-83f6-dd27eebeb1a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:01.164861 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-728eeada-d72c-4aa3-83f6-dd27eebeb1a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1203 microversion: 2.1 time: 0.305552 Oct 27 19:21:01.165454 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2974/6096] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:00 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1203 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:02.196132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-03d536c0-9796-40d3-9a4f-7e6952133874 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:02.199338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-03d536c0-9796-40d3-9a4f-7e6952133874 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:02.213801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03d536c0-9796-40d3-9a4f-7e6952133874 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:02.217371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03d536c0-9796-40d3-9a4f-7e6952133874 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:02.218214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03d536c0-9796-40d3-9a4f-7e6952133874 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:02.219216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03d536c0-9796-40d3-9a4f-7e6952133874 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:02.220677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03d536c0-9796-40d3-9a4f-7e6952133874 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:02.221391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03d536c0-9796-40d3-9a4f-7e6952133874 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:02.441237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-03d536c0-9796-40d3-9a4f-7e6952133874 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:02.455830 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-03d536c0-9796-40d3-9a4f-7e6952133874 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1203 microversion: 2.1 time: 0.267950 Oct 27 19:21:02.461115 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3123/6097] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:02 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1203 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:03.491723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0b0ea242-fcd4-4ba9-8fa2-87d6f7615950 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:03.492581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0b0ea242-fcd4-4ba9-8fa2-87d6f7615950 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:03.509564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b0ea242-fcd4-4ba9-8fa2-87d6f7615950 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:03.511402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b0ea242-fcd4-4ba9-8fa2-87d6f7615950 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:03.511790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b0ea242-fcd4-4ba9-8fa2-87d6f7615950 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:03.512829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b0ea242-fcd4-4ba9-8fa2-87d6f7615950 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:03.514720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b0ea242-fcd4-4ba9-8fa2-87d6f7615950 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:03.515950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b0ea242-fcd4-4ba9-8fa2-87d6f7615950 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:03.858763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0b0ea242-fcd4-4ba9-8fa2-87d6f7615950 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:03.870179 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0b0ea242-fcd4-4ba9-8fa2-87d6f7615950 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1203 microversion: 2.1 time: 0.384161 Oct 27 19:21:03.873534 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2975/6098] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:03 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1203 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:04.909125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0fe33feb-158b-4a59-9455-cd0ee9832649 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:04.910586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0fe33feb-158b-4a59-9455-cd0ee9832649 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:04.921979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fe33feb-158b-4a59-9455-cd0ee9832649 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:04.922654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fe33feb-158b-4a59-9455-cd0ee9832649 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:04.922969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fe33feb-158b-4a59-9455-cd0ee9832649 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:04.923702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fe33feb-158b-4a59-9455-cd0ee9832649 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:04.924176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fe33feb-158b-4a59-9455-cd0ee9832649 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:04.924623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0fe33feb-158b-4a59-9455-cd0ee9832649 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:05.134055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0fe33feb-158b-4a59-9455-cd0ee9832649 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:05.143415 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0fe33feb-158b-4a59-9455-cd0ee9832649 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1203 microversion: 2.1 time: 0.242755 Oct 27 19:21:05.144015 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3124/6099] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:04 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1203 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:05.818190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-72492e98-118c-4dfd-a859-0640bffb1622 req-3e89c8a6-eedc-4407-b0f1-f0afc11fd3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3502cb-e4d5-43d0-80eb-749093317b4a", "name": "network-vif-plugged", "status": "completed", "tag": "d30f2edf-86cd-4077-a1d0-f8bb0188d464"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:21:05.833721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7c8f42fc-4a84-4848-92b2-afd7343f7ffa tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:05.834795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7c8f42fc-4a84-4848-92b2-afd7343f7ffa tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:05.847259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c8f42fc-4a84-4848-92b2-afd7343f7ffa tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:05.866890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c8f42fc-4a84-4848-92b2-afd7343f7ffa tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:05.867455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c8f42fc-4a84-4848-92b2-afd7343f7ffa tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:05.868232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c8f42fc-4a84-4848-92b2-afd7343f7ffa tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:05.875440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-72492e98-118c-4dfd-a859-0640bffb1622 req-3e89c8a6-eedc-4407-b0f1-f0afc11fd3b0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:05.875970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-72492e98-118c-4dfd-a859-0640bffb1622 req-3e89c8a6-eedc-4407-b0f1-f0afc11fd3b0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:05.877000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c8f42fc-4a84-4848-92b2-afd7343f7ffa tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:05.877535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c8f42fc-4a84-4848-92b2-afd7343f7ffa tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:05.879523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-72492e98-118c-4dfd-a859-0640bffb1622 req-3e89c8a6-eedc-4407-b0f1-f0afc11fd3b0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:05.912918 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-72492e98-118c-4dfd-a859-0640bffb1622 req-3e89c8a6-eedc-4407-b0f1-f0afc11fd3b0 service nova] Creating event network-vif-plugged:d30f2edf-86cd-4077-a1d0-f8bb0188d464 for instance 1f3502cb-e4d5-43d0-80eb-749093317b4a on n-h2-860687-3 Oct 27 19:21:05.921384 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-72492e98-118c-4dfd-a859-0640bffb1622 req-3e89c8a6-eedc-4407-b0f1-f0afc11fd3b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111383 Oct 27 19:21:05.926760 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2976/6100] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:21:06.169351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a25f715f-acbe-4a2b-bf4d-10786b83dc49 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:06.170473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a25f715f-acbe-4a2b-bf4d-10786b83dc49 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:06.177358 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7c8f42fc-4a84-4848-92b2-afd7343f7ffa tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1833 microversion: 2.1 time: 0.347460 Oct 27 19:21:06.196456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a25f715f-acbe-4a2b-bf4d-10786b83dc49 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:06.196970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a25f715f-acbe-4a2b-bf4d-10786b83dc49 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:06.197422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a25f715f-acbe-4a2b-bf4d-10786b83dc49 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:06.198157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a25f715f-acbe-4a2b-bf4d-10786b83dc49 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:06.205183 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3125/6101] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:05 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1833 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:06.205560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a25f715f-acbe-4a2b-bf4d-10786b83dc49 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:06.206125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a25f715f-acbe-4a2b-bf4d-10786b83dc49 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:06.928414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a25f715f-acbe-4a2b-bf4d-10786b83dc49 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:06.945083 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a25f715f-acbe-4a2b-bf4d-10786b83dc49 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1203 microversion: 2.1 time: 0.780491 Oct 27 19:21:06.946193 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2977/6102] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:06 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1203 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:21:07.974187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-66125e52-c763-48da-9224-1d6eaf604d77 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:07.975441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-66125e52-c763-48da-9224-1d6eaf604d77 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:07.999095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66125e52-c763-48da-9224-1d6eaf604d77 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:08.001801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66125e52-c763-48da-9224-1d6eaf604d77 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:08.002964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66125e52-c763-48da-9224-1d6eaf604d77 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:08.008859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66125e52-c763-48da-9224-1d6eaf604d77 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:08.009721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66125e52-c763-48da-9224-1d6eaf604d77 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:08.010423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-66125e52-c763-48da-9224-1d6eaf604d77 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:08.460040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-66125e52-c763-48da-9224-1d6eaf604d77 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:08.471581 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-66125e52-c763-48da-9224-1d6eaf604d77 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1389 microversion: 2.1 time: 0.500053 Oct 27 19:21:08.472172 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3126/6103] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:07 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1389 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:08.495093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0b10b65a-22d7-4a72-8a5f-1b079bec4754 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:08.495093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0b10b65a-22d7-4a72-8a5f-1b079bec4754 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:08.497896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f932bc6b-3c11-4329-b7e2-f79188134109 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:08.498711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f932bc6b-3c11-4329-b7e2-f79188134109 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:08.500064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b10b65a-22d7-4a72-8a5f-1b079bec4754 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:08.500788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b10b65a-22d7-4a72-8a5f-1b079bec4754 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:08.501374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b10b65a-22d7-4a72-8a5f-1b079bec4754 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:08.502714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b10b65a-22d7-4a72-8a5f-1b079bec4754 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:08.503195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b10b65a-22d7-4a72-8a5f-1b079bec4754 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:08.505305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b10b65a-22d7-4a72-8a5f-1b079bec4754 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:08.520842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f932bc6b-3c11-4329-b7e2-f79188134109 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:08.521573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f932bc6b-3c11-4329-b7e2-f79188134109 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:08.522029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f932bc6b-3c11-4329-b7e2-f79188134109 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:08.522791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f932bc6b-3c11-4329-b7e2-f79188134109 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:08.523251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f932bc6b-3c11-4329-b7e2-f79188134109 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:08.523687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f932bc6b-3c11-4329-b7e2-f79188134109 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:08.594750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f932bc6b-3c11-4329-b7e2-f79188134109 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:21:08.597270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0b10b65a-22d7-4a72-8a5f-1b079bec4754 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:21:08.766301 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f932bc6b-3c11-4329-b7e2-f79188134109 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 204 len: 0 microversion: 2.1 time: 0.760683 Oct 27 19:21:08.771773 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2978/6104] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:21:08 2022] DELETE /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:21:08.784258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-50d58d3b-7cc5-4c5d-856c-9b855459e77d req-3de92e8d-71ef-4dc6-8a57-e47f55b1c0af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bbf8d5b-8288-4bd2-91dd-d67825cb8007", "tag": "51f53b33-b1cf-4efb-b7b4-8ec80712f964"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:21:08.806926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-50d58d3b-7cc5-4c5d-856c-9b855459e77d req-3de92e8d-71ef-4dc6-8a57-e47f55b1c0af service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:08.809812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-50d58d3b-7cc5-4c5d-856c-9b855459e77d req-3de92e8d-71ef-4dc6-8a57-e47f55b1c0af service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:08.810912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-50d58d3b-7cc5-4c5d-856c-9b855459e77d req-3de92e8d-71ef-4dc6-8a57-e47f55b1c0af service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:08.817331 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0b10b65a-22d7-4a72-8a5f-1b079bec4754 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 204 len: 0 microversion: 2.1 time: 0.334210 Oct 27 19:21:08.825814 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3127/6105] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:21:08 2022] DELETE /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:21:08.838721 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-50d58d3b-7cc5-4c5d-856c-9b855459e77d req-3de92e8d-71ef-4dc6-8a57-e47f55b1c0af service nova] Creating event network-changed:51f53b33-b1cf-4efb-b7b4-8ec80712f964 for instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 on n-h2-860687-3 Oct 27 19:21:08.845425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14e00731-17ac-4e19-aea1-08cb43a371f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:08.846175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-14e00731-17ac-4e19-aea1-08cb43a371f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:08.858535 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-50d58d3b-7cc5-4c5d-856c-9b855459e77d req-3de92e8d-71ef-4dc6-8a57-e47f55b1c0af service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084569 Oct 27 19:21:08.863918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14e00731-17ac-4e19-aea1-08cb43a371f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:08.864401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14e00731-17ac-4e19-aea1-08cb43a371f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:08.864787 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2979/6106] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:21:08.866716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14e00731-17ac-4e19-aea1-08cb43a371f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:08.868424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14e00731-17ac-4e19-aea1-08cb43a371f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:08.868912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14e00731-17ac-4e19-aea1-08cb43a371f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:08.869368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14e00731-17ac-4e19-aea1-08cb43a371f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:08.873375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f1b3f7f1-1235-4953-8ffa-d16dc4eb8d02 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:08.877800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f1b3f7f1-1235-4953-8ffa-d16dc4eb8d02 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:08.893060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1b3f7f1-1235-4953-8ffa-d16dc4eb8d02 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:08.893832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1b3f7f1-1235-4953-8ffa-d16dc4eb8d02 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:08.894528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1b3f7f1-1235-4953-8ffa-d16dc4eb8d02 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:08.895497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1b3f7f1-1235-4953-8ffa-d16dc4eb8d02 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:08.899051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1b3f7f1-1235-4953-8ffa-d16dc4eb8d02 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:08.899819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1b3f7f1-1235-4953-8ffa-d16dc4eb8d02 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:09.087577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-14e00731-17ac-4e19-aea1-08cb43a371f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:09.099658 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-14e00731-17ac-4e19-aea1-08cb43a371f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1389 microversion: 2.1 time: 0.270850 Oct 27 19:21:09.100276 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3128/6107] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:08 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1389 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:09.115570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e6455226-9bc8-411b-b4e0-813e5edaac3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:09.116211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e6455226-9bc8-411b-b4e0-813e5edaac3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:09.131975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6455226-9bc8-411b-b4e0-813e5edaac3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:09.132515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6455226-9bc8-411b-b4e0-813e5edaac3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:09.132958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6455226-9bc8-411b-b4e0-813e5edaac3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:09.133722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6455226-9bc8-411b-b4e0-813e5edaac3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:09.134478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6455226-9bc8-411b-b4e0-813e5edaac3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:09.135157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6455226-9bc8-411b-b4e0-813e5edaac3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:09.172065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f1b3f7f1-1235-4953-8ffa-d16dc4eb8d02 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:09.184488 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f1b3f7f1-1235-4953-8ffa-d16dc4eb8d02 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1732 microversion: 2.1 time: 0.317020 Oct 27 19:21:09.196486 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2980/6108] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:08 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1732 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:09.206098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9444ece3-42f1-4e69-860c-53de1148c5dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:09.207760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9444ece3-42f1-4e69-860c-53de1148c5dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:09.218313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9444ece3-42f1-4e69-860c-53de1148c5dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:09.219311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9444ece3-42f1-4e69-860c-53de1148c5dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:09.219960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9444ece3-42f1-4e69-860c-53de1148c5dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:09.220888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9444ece3-42f1-4e69-860c-53de1148c5dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:09.223724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9444ece3-42f1-4e69-860c-53de1148c5dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:09.224788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9444ece3-42f1-4e69-860c-53de1148c5dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:09.361258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e6455226-9bc8-411b-b4e0-813e5edaac3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:09.373794 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e6455226-9bc8-411b-b4e0-813e5edaac3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1688 microversion: 2.1 time: 0.272379 Oct 27 19:21:09.374961 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3129/6109] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:09 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1688 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:09.469734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9444ece3-42f1-4e69-860c-53de1148c5dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:09.485268 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9444ece3-42f1-4e69-860c-53de1148c5dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1389 microversion: 2.1 time: 0.286785 Oct 27 19:21:09.489345 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2981/6110] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:09 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1389 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:09.512075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1dd4f09b-6ea1-429c-86e4-00fefbd302c5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:09.512598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1dd4f09b-6ea1-429c-86e4-00fefbd302c5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:09.526663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dd4f09b-6ea1-429c-86e4-00fefbd302c5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:09.527178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dd4f09b-6ea1-429c-86e4-00fefbd302c5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:09.527635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dd4f09b-6ea1-429c-86e4-00fefbd302c5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:09.528370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dd4f09b-6ea1-429c-86e4-00fefbd302c5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:09.528841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dd4f09b-6ea1-429c-86e4-00fefbd302c5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:09.529278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1dd4f09b-6ea1-429c-86e4-00fefbd302c5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:09.579288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1dd4f09b-6ea1-429c-86e4-00fefbd302c5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:21:09.762061 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1dd4f09b-6ea1-429c-86e4-00fefbd302c5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 204 len: 0 microversion: 2.1 time: 0.254016 Oct 27 19:21:09.763084 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3130/6111] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:21:09 2022] DELETE /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:21:09.771201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-980f0ba3-b3f3-4407-9803-eeb580488095 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:09.771815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-980f0ba3-b3f3-4407-9803-eeb580488095 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:09.784335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980f0ba3-b3f3-4407-9803-eeb580488095 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:09.784862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980f0ba3-b3f3-4407-9803-eeb580488095 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:09.785874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980f0ba3-b3f3-4407-9803-eeb580488095 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:09.786664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980f0ba3-b3f3-4407-9803-eeb580488095 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:09.787128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980f0ba3-b3f3-4407-9803-eeb580488095 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:09.787556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-980f0ba3-b3f3-4407-9803-eeb580488095 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:10.111583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-980f0ba3-b3f3-4407-9803-eeb580488095 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:10.121875 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-980f0ba3-b3f3-4407-9803-eeb580488095 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1395 microversion: 2.1 time: 0.354535 Oct 27 19:21:10.123296 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2982/6112] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:09 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1395 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:10.215058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f40235b6-6e37-4520-a106-686de5ce3896 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:10.215876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f40235b6-6e37-4520-a106-686de5ce3896 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:10.231834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f40235b6-6e37-4520-a106-686de5ce3896 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:10.232413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f40235b6-6e37-4520-a106-686de5ce3896 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:10.233001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f40235b6-6e37-4520-a106-686de5ce3896 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:10.233854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f40235b6-6e37-4520-a106-686de5ce3896 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:10.242986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f40235b6-6e37-4520-a106-686de5ce3896 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:10.243531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f40235b6-6e37-4520-a106-686de5ce3896 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:10.407342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-be6a1b63-5998-405d-8d6b-8d440e352805 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:10.407969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-be6a1b63-5998-405d-8d6b-8d440e352805 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:10.415571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:21:10.427516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be6a1b63-5998-405d-8d6b-8d440e352805 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:10.428757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be6a1b63-5998-405d-8d6b-8d440e352805 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:10.431019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be6a1b63-5998-405d-8d6b-8d440e352805 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:10.432166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be6a1b63-5998-405d-8d6b-8d440e352805 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:10.434041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be6a1b63-5998-405d-8d6b-8d440e352805 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:10.434799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be6a1b63-5998-405d-8d6b-8d440e352805 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:10.457529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f40235b6-6e37-4520-a106-686de5ce3896 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:10.469217 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f40235b6-6e37-4520-a106-686de5ce3896 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1732 microversion: 2.1 time: 0.259394 Oct 27 19:21:10.484598 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3131/6113] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:10 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1732 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:10.769744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-be6a1b63-5998-405d-8d6b-8d440e352805 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:10.779584 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-be6a1b63-5998-405d-8d6b-8d440e352805 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1688 microversion: 2.1 time: 0.376867 Oct 27 19:21:10.781514 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2983/6114] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:10 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1688 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:21:11.148814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42a00860-ce68-4b1a-8a2b-2ffa30201508 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:11.149571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-42a00860-ce68-4b1a-8a2b-2ffa30201508 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:11.161741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42a00860-ce68-4b1a-8a2b-2ffa30201508 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:11.175067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42a00860-ce68-4b1a-8a2b-2ffa30201508 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:11.176084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42a00860-ce68-4b1a-8a2b-2ffa30201508 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:11.177202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42a00860-ce68-4b1a-8a2b-2ffa30201508 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:11.177673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42a00860-ce68-4b1a-8a2b-2ffa30201508 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:11.178123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42a00860-ce68-4b1a-8a2b-2ffa30201508 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:11.455439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-42a00860-ce68-4b1a-8a2b-2ffa30201508 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:11.467883 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-42a00860-ce68-4b1a-8a2b-2ffa30201508 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1395 microversion: 2.1 time: 0.323207 Oct 27 19:21:11.469182 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3132/6115] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:11 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1395 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:11.498127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b0a86ad-85a7-4ae5-ba98-20f1a8e8bf58 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:11.498873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7b0a86ad-85a7-4ae5-ba98-20f1a8e8bf58 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:11.510262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b0a86ad-85a7-4ae5-ba98-20f1a8e8bf58 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:11.512203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b0a86ad-85a7-4ae5-ba98-20f1a8e8bf58 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:11.512717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b0a86ad-85a7-4ae5-ba98-20f1a8e8bf58 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:11.513393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b0a86ad-85a7-4ae5-ba98-20f1a8e8bf58 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:11.513860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b0a86ad-85a7-4ae5-ba98-20f1a8e8bf58 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:11.514294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b0a86ad-85a7-4ae5-ba98-20f1a8e8bf58 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:11.808015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c93bf9ab-597e-43b5-a97a-21c810053eaf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:11.808918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c93bf9ab-597e-43b5-a97a-21c810053eaf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:11.821220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c93bf9ab-597e-43b5-a97a-21c810053eaf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:11.822307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c93bf9ab-597e-43b5-a97a-21c810053eaf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:11.824152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c93bf9ab-597e-43b5-a97a-21c810053eaf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:11.825101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c93bf9ab-597e-43b5-a97a-21c810053eaf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:11.826926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c93bf9ab-597e-43b5-a97a-21c810053eaf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:11.831114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c93bf9ab-597e-43b5-a97a-21c810053eaf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:12.273350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7b0a86ad-85a7-4ae5-ba98-20f1a8e8bf58 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:12.289592 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7b0a86ad-85a7-4ae5-ba98-20f1a8e8bf58 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1732 microversion: 2.1 time: 0.796949 Oct 27 19:21:12.305902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c93bf9ab-597e-43b5-a97a-21c810053eaf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:12.310942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:21:12.315938 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c93bf9ab-597e-43b5-a97a-21c810053eaf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1688 microversion: 2.1 time: 0.514222 Oct 27 19:21:12.317815 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2984/6116] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:11 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1732 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:12.323687 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3133/6117] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:11 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1688 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:12.494017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d19b8a40-5eb0-4659-bb4e-064f715c841a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:12.494680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d19b8a40-5eb0-4659-bb4e-064f715c841a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:12.502133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d19b8a40-5eb0-4659-bb4e-064f715c841a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:12.505845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d19b8a40-5eb0-4659-bb4e-064f715c841a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:12.506309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d19b8a40-5eb0-4659-bb4e-064f715c841a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:12.507082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d19b8a40-5eb0-4659-bb4e-064f715c841a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:12.507550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d19b8a40-5eb0-4659-bb4e-064f715c841a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:12.507987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d19b8a40-5eb0-4659-bb4e-064f715c841a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:13.153020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d19b8a40-5eb0-4659-bb4e-064f715c841a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:13.198601 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d19b8a40-5eb0-4659-bb4e-064f715c841a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1395 microversion: 2.1 time: 0.706661 Oct 27 19:21:13.202606 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2985/6118] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:12 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1395 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:13.322484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6415630f-d3f5-4dea-9963-ba498effaaf9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:13.323796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6415630f-d3f5-4dea-9963-ba498effaaf9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:13.339065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:21:13.362123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5af1c0a3-9ed5-4c0e-84b4-b6bf127e4032 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:13.364508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5af1c0a3-9ed5-4c0e-84b4-b6bf127e4032 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:13.381141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5af1c0a3-9ed5-4c0e-84b4-b6bf127e4032 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:13.381659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5af1c0a3-9ed5-4c0e-84b4-b6bf127e4032 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:13.382115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5af1c0a3-9ed5-4c0e-84b4-b6bf127e4032 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:13.385738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5af1c0a3-9ed5-4c0e-84b4-b6bf127e4032 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:13.389729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5af1c0a3-9ed5-4c0e-84b4-b6bf127e4032 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:13.391381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5af1c0a3-9ed5-4c0e-84b4-b6bf127e4032 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:13.396377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6415630f-d3f5-4dea-9963-ba498effaaf9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:13.398810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6415630f-d3f5-4dea-9963-ba498effaaf9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:13.402095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6415630f-d3f5-4dea-9963-ba498effaaf9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:13.403508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6415630f-d3f5-4dea-9963-ba498effaaf9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:13.407187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6415630f-d3f5-4dea-9963-ba498effaaf9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:13.408169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6415630f-d3f5-4dea-9963-ba498effaaf9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:13.729561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6415630f-d3f5-4dea-9963-ba498effaaf9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:13.745990 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6415630f-d3f5-4dea-9963-ba498effaaf9 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1732 microversion: 2.1 time: 0.432678 Oct 27 19:21:13.746642 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3134/6119] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:13 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1732 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:13.757304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a069ed1b-ae43-4dd7-a03b-57b9c455fe6d req-484056c3-2a4a-485a-97ce-9bf8952a5d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3502cb-e4d5-43d0-80eb-749093317b4a", "name": "network-vif-deleted", "tag": "d30f2edf-86cd-4077-a1d0-f8bb0188d464"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:21:13.790051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a069ed1b-ae43-4dd7-a03b-57b9c455fe6d req-484056c3-2a4a-485a-97ce-9bf8952a5d50 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:13.790576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a069ed1b-ae43-4dd7-a03b-57b9c455fe6d req-484056c3-2a4a-485a-97ce-9bf8952a5d50 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:13.791014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a069ed1b-ae43-4dd7-a03b-57b9c455fe6d req-484056c3-2a4a-485a-97ce-9bf8952a5d50 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:13.836659 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a069ed1b-ae43-4dd7-a03b-57b9c455fe6d req-484056c3-2a4a-485a-97ce-9bf8952a5d50 service nova] Creating event network-vif-deleted:d30f2edf-86cd-4077-a1d0-f8bb0188d464 for instance 1f3502cb-e4d5-43d0-80eb-749093317b4a on n-h2-860687-3 Oct 27 19:21:13.850316 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a069ed1b-ae43-4dd7-a03b-57b9c455fe6d req-484056c3-2a4a-485a-97ce-9bf8952a5d50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097720 Oct 27 19:21:13.873874 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3135/6120] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:21:13.998928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-25788304-a33b-4cc5-a3b2-2a9076ff70a2 req-142a44c5-b9a8-4a31-bd67-9daac23836aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbf8d5b-8288-4bd2-91dd-d67825cb8007", "name": "network-vif-deleted", "tag": "51f53b33-b1cf-4efb-b7b4-8ec80712f964"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:21:14.017524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-25788304-a33b-4cc5-a3b2-2a9076ff70a2 req-142a44c5-b9a8-4a31-bd67-9daac23836aa service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:14.018013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-25788304-a33b-4cc5-a3b2-2a9076ff70a2 req-142a44c5-b9a8-4a31-bd67-9daac23836aa service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:14.018524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-25788304-a33b-4cc5-a3b2-2a9076ff70a2 req-142a44c5-b9a8-4a31-bd67-9daac23836aa service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:14.046415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5af1c0a3-9ed5-4c0e-84b4-b6bf127e4032 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:14.054041 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-25788304-a33b-4cc5-a3b2-2a9076ff70a2 req-142a44c5-b9a8-4a31-bd67-9daac23836aa service nova] Creating event network-vif-deleted:51f53b33-b1cf-4efb-b7b4-8ec80712f964 for instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 on n-h2-860687-3 Oct 27 19:21:14.059189 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5af1c0a3-9ed5-4c0e-84b4-b6bf127e4032 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 200 len: 1620 microversion: 2.1 time: 0.707594 Oct 27 19:21:14.075763 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-25788304-a33b-4cc5-a3b2-2a9076ff70a2 req-142a44c5-b9a8-4a31-bd67-9daac23836aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091590 Oct 27 19:21:14.076684 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3136/6121] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:21:14.076939 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2986/6122] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:13 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 1620 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:21:14.226891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2409001b-0cd0-4895-b712-4029139fd7f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:14.227616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2409001b-0cd0-4895-b712-4029139fd7f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:14.242141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2409001b-0cd0-4895-b712-4029139fd7f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:14.242690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2409001b-0cd0-4895-b712-4029139fd7f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:14.243140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2409001b-0cd0-4895-b712-4029139fd7f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:14.243855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2409001b-0cd0-4895-b712-4029139fd7f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:14.244319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2409001b-0cd0-4895-b712-4029139fd7f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:14.244753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2409001b-0cd0-4895-b712-4029139fd7f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:14.509743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2409001b-0cd0-4895-b712-4029139fd7f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:14.532142 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2409001b-0cd0-4895-b712-4029139fd7f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1188 microversion: 2.1 time: 0.299438 Oct 27 19:21:14.532972 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3137/6123] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:14 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:14.558775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-29632d34-f789-4802-bc36-5d0e2431fdd5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:14.559355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-29632d34-f789-4802-bc36-5d0e2431fdd5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:14.571894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29632d34-f789-4802-bc36-5d0e2431fdd5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:14.572407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29632d34-f789-4802-bc36-5d0e2431fdd5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:14.572863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29632d34-f789-4802-bc36-5d0e2431fdd5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:14.573593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29632d34-f789-4802-bc36-5d0e2431fdd5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:14.574064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29632d34-f789-4802-bc36-5d0e2431fdd5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:14.574539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29632d34-f789-4802-bc36-5d0e2431fdd5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:14.672580 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-29632d34-f789-4802-bc36-5d0e2431fdd5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/ips" status: 200 len: 146 microversion: 2.1 time: 0.119583 Oct 27 19:21:14.673205 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2987/6124] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 19:21:14 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/ips => generated 146 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:21:14.774356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2c35472e-7cd3-46a4-bf7a-7e37324aed39 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:14.775076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2c35472e-7cd3-46a4-bf7a-7e37324aed39 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:14.788327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c35472e-7cd3-46a4-bf7a-7e37324aed39 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:14.788827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c35472e-7cd3-46a4-bf7a-7e37324aed39 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:14.789668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c35472e-7cd3-46a4-bf7a-7e37324aed39 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:14.793012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c35472e-7cd3-46a4-bf7a-7e37324aed39 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:14.793690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c35472e-7cd3-46a4-bf7a-7e37324aed39 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:14.797855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c35472e-7cd3-46a4-bf7a-7e37324aed39 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:14.878321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c35472e-7cd3-46a4-bf7a-7e37324aed39 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:14.880082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c35472e-7cd3-46a4-bf7a-7e37324aed39 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:14.880736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c35472e-7cd3-46a4-bf7a-7e37324aed39 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:14.881380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-2c35472e-7cd3-46a4-bf7a-7e37324aed39 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lazy-loading 'fault' on Instance uuid c5e91af2-4262-4e21-8b58-a2673e65c6e5 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:21:14.959802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2c35472e-7cd3-46a4-bf7a-7e37324aed39 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bff30b226346f4883faefae2fbb49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf081fe916049e4825cbbf76ed7d16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:14.974136 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2c35472e-7cd3-46a4-bf7a-7e37324aed39 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 200 len: 1388 microversion: 2.1 time: 0.204200 Oct 27 19:21:14.975086 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3138/6125] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:14 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 1388 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:15.089013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d64ac384-2ea8-44ac-a00b-3432b90752ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:15.089821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d64ac384-2ea8-44ac-a00b-3432b90752ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 2bbf8d5b-8288-4bd2-91dd-d67825cb8007] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:15.101899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d64ac384-2ea8-44ac-a00b-3432b90752ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:15.105786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d64ac384-2ea8-44ac-a00b-3432b90752ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:15.106842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d64ac384-2ea8-44ac-a00b-3432b90752ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:15.109568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d64ac384-2ea8-44ac-a00b-3432b90752ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:15.110336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d64ac384-2ea8-44ac-a00b-3432b90752ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:15.111115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d64ac384-2ea8-44ac-a00b-3432b90752ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:15.146882 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d64ac384-2ea8-44ac-a00b-3432b90752ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] HTTP exception thrown: Instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 could not be found. Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d64ac384-2ea8-44ac-a00b-3432b90752ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Request method failure captured: Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 HTTP/1.1 Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWth-uE-L5hrFUr9RYtFBa20-n3WoCw93LoQ3rmxc3wuGw2wOUyFGeVumHG6CitxW2BQ_gI4upL36DmkN08Y2Y2Dzqu0geZsGjCkVWRBeHN3me4ZMtxNaaWwrBfsY64smWMRc2jLIbCc3BUZOyHtIp4Z7RZX-687YOz7etGENRciRsd4 Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 853ac0c6e395469bb90c156aad129c26 Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-969980032 Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/853ac0c6e395469bb90c156aad129c26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/853ac0c6e395469bb90c156aad129c26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_853ac0c6e395469bb90c156aad129c26", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/853ac0c6e395469bb90c156aad129c26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestNetworkAdvancedServerOps-969980032 Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 853ac0c6e395469bb90c156aad129c26 Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-969980032 Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestNetworkAdvancedServerOps-969980032-project Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ce7f16b54dda477386daed20f1a2e104 Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestNetworkAdvancedServerOps-969980032-project Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 could not be found. Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '2bbf8d5b-8288-4bd2-91dd-d67825cb8007'} Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 could not be found. Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 could not be found. Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:15.157494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:21:15.163970 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:15.163970 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:15.163970 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:21:15.163970 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:21:15.163970 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:21:15.163970 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:21:15.163970 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 could not be found. Oct 27 19:21:15.163970 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:15.163970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d64ac384-2ea8-44ac-a00b-3432b90752ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Returning 404 to user: Instance 2bbf8d5b-8288-4bd2-91dd-d67825cb8007 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:21:15.165546 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d64ac384-2ea8-44ac-a00b-3432b90752ff tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007" status: 404 len: 111 microversion: 2.1 time: 0.079802 Oct 27 19:21:15.171622 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2988/6126] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:15 2022] GET /compute/v2.1/servers/2bbf8d5b-8288-4bd2-91dd-d67825cb8007 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:21:15.563575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2b5c282a-9fac-45fa-aab4-cdefaa4479ad tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:15.569499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2b5c282a-9fac-45fa-aab4-cdefaa4479ad tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:15.584045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5c282a-9fac-45fa-aab4-cdefaa4479ad tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:15.585825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5c282a-9fac-45fa-aab4-cdefaa4479ad tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:15.587783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5c282a-9fac-45fa-aab4-cdefaa4479ad tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:15.588837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5c282a-9fac-45fa-aab4-cdefaa4479ad tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:15.589489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5c282a-9fac-45fa-aab4-cdefaa4479ad tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:15.590106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5c282a-9fac-45fa-aab4-cdefaa4479ad tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:15.687207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2b5c282a-9fac-45fa-aab4-cdefaa4479ad tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:15.703051 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2b5c282a-9fac-45fa-aab4-cdefaa4479ad tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1188 microversion: 2.1 time: 0.143157 Oct 27 19:21:15.713500 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3139/6127] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:15 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1188 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:15.999643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-968f5529-231f-454c-8266-889eeeae88fa req-49b716b5-8872-4386-ab4e-92ce2495dd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e91af2-4262-4e21-8b58-a2673e65c6e5", "name": "network-vif-deleted", "tag": "a13b8b26-87fa-4d76-a119-0db796ee8f4a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:21:16.014089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-34dfaa4c-e7f1-47b0-b297-1c2d90c20f62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:16.019020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-34dfaa4c-e7f1-47b0-b297-1c2d90c20f62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:16.056965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34dfaa4c-e7f1-47b0-b297-1c2d90c20f62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:16.058134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34dfaa4c-e7f1-47b0-b297-1c2d90c20f62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:16.060501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34dfaa4c-e7f1-47b0-b297-1c2d90c20f62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:16.060911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-968f5529-231f-454c-8266-889eeeae88fa req-49b716b5-8872-4386-ab4e-92ce2495dd39 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:16.079030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-968f5529-231f-454c-8266-889eeeae88fa req-49b716b5-8872-4386-ab4e-92ce2495dd39 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:16.079772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34dfaa4c-e7f1-47b0-b297-1c2d90c20f62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:16.080323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-968f5529-231f-454c-8266-889eeeae88fa req-49b716b5-8872-4386-ab4e-92ce2495dd39 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:16.081447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34dfaa4c-e7f1-47b0-b297-1c2d90c20f62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:16.095524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:21:16.096157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34dfaa4c-e7f1-47b0-b297-1c2d90c20f62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:16.128399 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-968f5529-231f-454c-8266-889eeeae88fa req-49b716b5-8872-4386-ab4e-92ce2495dd39 service nova] Creating event network-vif-deleted:a13b8b26-87fa-4d76-a119-0db796ee8f4a for instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 on n-h2-860687-3 Oct 27 19:21:16.137018 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-34dfaa4c-e7f1-47b0-b297-1c2d90c20f62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] HTTP exception thrown: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-34dfaa4c-e7f1-47b0-b297-1c2d90c20f62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Request method failure captured: Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 HTTP/1.1 Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtitihLztOrOISVi86fn-EBa_s_Jd_1BahkDusQBqy7K6wia39O3muw1ytVnv7QzUL07C-sFZXDyafdct6XFntAmzNOFPG9dF0DbyWi8k-PDQwoeTigDbdDUFgImvKMARyC_8QtOO1bHx9Iemzc5pHDI92OFdpBu0nM1SR8ZU9-YYsI Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 3bf081fe916049e4825cbbf76ed7d16b Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestServerBasicOps-1168140679 Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3bf081fe916049e4825cbbf76ed7d16b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bf081fe916049e4825cbbf76ed7d16b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3bf081fe916049e4825cbbf76ed7d16b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bf081fe916049e4825cbbf76ed7d16b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestServerBasicOps-1168140679 Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 3bf081fe916049e4825cbbf76ed7d16b Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestServerBasicOps-1168140679 Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestServerBasicOps-1168140679-project Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: d1bff30b226346f4883faefae2fbb49b Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestServerBasicOps-1168140679-project Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'c5e91af2-4262-4e21-8b58-a2673e65c6e5'} Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:21:16.146678 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:21:16.150464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:16.150464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:21:16.150464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:21:16.150464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:21:16.150464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:21:16.150464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:16.150464 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:21:16.158891 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-968f5529-231f-454c-8266-889eeeae88fa req-49b716b5-8872-4386-ab4e-92ce2495dd39 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166012 Oct 27 19:21:16.160045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-34dfaa4c-e7f1-47b0-b297-1c2d90c20f62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Returning 404 to user: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:21:16.161859 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2989/6128] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:21:16.164256 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-34dfaa4c-e7f1-47b0-b297-1c2d90c20f62 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 404 len: 111 microversion: 2.1 time: 0.157686 Oct 27 19:21:16.169997 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3140/6129] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:16 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:21:16.734854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7cbab25-edbc-48fa-8281-20d5afb5db9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:16.735946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a7cbab25-edbc-48fa-8281-20d5afb5db9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:16.752497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7cbab25-edbc-48fa-8281-20d5afb5db9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:16.754909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7cbab25-edbc-48fa-8281-20d5afb5db9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:16.755700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7cbab25-edbc-48fa-8281-20d5afb5db9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:16.759636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7cbab25-edbc-48fa-8281-20d5afb5db9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:16.761617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7cbab25-edbc-48fa-8281-20d5afb5db9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:16.762795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7cbab25-edbc-48fa-8281-20d5afb5db9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:17.161016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a7cbab25-edbc-48fa-8281-20d5afb5db9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:17.175012 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7cbab25-edbc-48fa-8281-20d5afb5db9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1188 microversion: 2.1 time: 0.445565 Oct 27 19:21:17.183487 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2990/6130] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:16 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1188 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:17.658313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-44571454-99e0-4be7-9002-a86f4cf3db7d tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:17.659049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-44571454-99e0-4be7-9002-a86f4cf3db7d tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:17.672279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44571454-99e0-4be7-9002-a86f4cf3db7d tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:17.672791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44571454-99e0-4be7-9002-a86f4cf3db7d tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:17.673224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44571454-99e0-4be7-9002-a86f4cf3db7d tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:17.673957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44571454-99e0-4be7-9002-a86f4cf3db7d tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:17.674446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44571454-99e0-4be7-9002-a86f4cf3db7d tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:17.677806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44571454-99e0-4be7-9002-a86f4cf3db7d tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:17.712550 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-44571454-99e0-4be7-9002-a86f4cf3db7d tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] HTTP exception thrown: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-44571454-99e0-4be7-9002-a86f4cf3db7d tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Request method failure captured: Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 HTTP/1.1 Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtitihLztOrOISVi86fn-EBa_s_Jd_1BahkDusQBqy7K6wia39O3muw1ytVnv7QzUL07C-sFZXDyafdct6XFntAmzNOFPG9dF0DbyWi8k-PDQwoeTigDbdDUFgImvKMARyC_8QtOO1bHx9Iemzc5pHDI92OFdpBu0nM1SR8ZU9-YYsI Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 3bf081fe916049e4825cbbf76ed7d16b Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestServerBasicOps-1168140679 Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3bf081fe916049e4825cbbf76ed7d16b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bf081fe916049e4825cbbf76ed7d16b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3bf081fe916049e4825cbbf76ed7d16b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bf081fe916049e4825cbbf76ed7d16b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestServerBasicOps-1168140679 Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 3bf081fe916049e4825cbbf76ed7d16b Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestServerBasicOps-1168140679 Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestServerBasicOps-1168140679-project Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: d1bff30b226346f4883faefae2fbb49b Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestServerBasicOps-1168140679-project Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'c5e91af2-4262-4e21-8b58-a2673e65c6e5'} Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:21:17.714321 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:21:17.717924 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:17.717924 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:21:17.717924 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:21:17.717924 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:21:17.717924 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:17.717924 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:21:17.717924 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:21:17.717924 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:21:17.717924 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:21:17.717924 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:17.717924 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:21:17.726321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-44571454-99e0-4be7-9002-a86f4cf3db7d tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Returning 404 to user: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:21:17.727502 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-44571454-99e0-4be7-9002-a86f4cf3db7d tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 404 len: 111 microversion: 2.1 time: 0.073632 Oct 27 19:21:17.728610 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3141/6131] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:21:17 2022] DELETE /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:21:17.736904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fff7089f-e365-49f7-9c05-5a105ac377a8 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:17.737869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fff7089f-e365-49f7-9c05-5a105ac377a8 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] [instance: c5e91af2-4262-4e21-8b58-a2673e65c6e5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:17.747464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fff7089f-e365-49f7-9c05-5a105ac377a8 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:17.751598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fff7089f-e365-49f7-9c05-5a105ac377a8 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:17.752252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fff7089f-e365-49f7-9c05-5a105ac377a8 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:17.753586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fff7089f-e365-49f7-9c05-5a105ac377a8 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:17.754252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fff7089f-e365-49f7-9c05-5a105ac377a8 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:17.756007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fff7089f-e365-49f7-9c05-5a105ac377a8 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:17.794464 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-fff7089f-e365-49f7-9c05-5a105ac377a8 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] HTTP exception thrown: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fff7089f-e365-49f7-9c05-5a105ac377a8 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Request method failure captured: Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 HTTP/1.1 Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtitihLztOrOISVi86fn-EBa_s_Jd_1BahkDusQBqy7K6wia39O3muw1ytVnv7QzUL07C-sFZXDyafdct6XFntAmzNOFPG9dF0DbyWi8k-PDQwoeTigDbdDUFgImvKMARyC_8QtOO1bHx9Iemzc5pHDI92OFdpBu0nM1SR8ZU9-YYsI Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 3bf081fe916049e4825cbbf76ed7d16b Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestServerBasicOps-1168140679 Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3bf081fe916049e4825cbbf76ed7d16b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bf081fe916049e4825cbbf76ed7d16b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3bf081fe916049e4825cbbf76ed7d16b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bf081fe916049e4825cbbf76ed7d16b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestServerBasicOps-1168140679 Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 3bf081fe916049e4825cbbf76ed7d16b Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestServerBasicOps-1168140679 Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestServerBasicOps-1168140679-project Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: d1bff30b226346f4883faefae2fbb49b Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestServerBasicOps-1168140679-project Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'c5e91af2-4262-4e21-8b58-a2673e65c6e5'} Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:21:17.796362 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:17.802119 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:17.802119 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:21:17.802119 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:21:17.802119 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:21:17.802119 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:21:17.802119 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. Oct 27 19:21:17.802119 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:17.804081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fff7089f-e365-49f7-9c05-5a105ac377a8 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Returning 404 to user: Instance c5e91af2-4262-4e21-8b58-a2673e65c6e5 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:21:17.806457 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fff7089f-e365-49f7-9c05-5a105ac377a8 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5" status: 404 len: 111 microversion: 2.1 time: 0.071352 Oct 27 19:21:17.807182 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2991/6132] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:17 2022] GET /compute/v2.1/servers/c5e91af2-4262-4e21-8b58-a2673e65c6e5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:21:18.187349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f1e0662-8bb6-4f13-bfe8-b0c38f719b08 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] Calling method '.version_select at 0x7fc869cd9d30>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:18.214918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7fc02d07-cc8d-46bf-ba73-0d07a6f1c671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:18.216323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7fc02d07-cc8d-46bf-ba73-0d07a6f1c671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:18.233815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc02d07-cc8d-46bf-ba73-0d07a6f1c671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:18.239320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc02d07-cc8d-46bf-ba73-0d07a6f1c671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:18.241803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc02d07-cc8d-46bf-ba73-0d07a6f1c671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:18.242942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc02d07-cc8d-46bf-ba73-0d07a6f1c671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:18.243720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc02d07-cc8d-46bf-ba73-0d07a6f1c671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:18.244602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc02d07-cc8d-46bf-ba73-0d07a6f1c671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:18.253969 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6f1e0662-8bb6-4f13-bfe8-b0c38f719b08 tempest-TestServerBasicOps-1168140679 tempest-TestServerBasicOps-1168140679-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-718898516" status: 202 len: 0 microversion: 2.1 time: 0.070934 Oct 27 19:21:18.279301 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3142/6133] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 19:21:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-718898516 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:21:18.538671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7fc02d07-cc8d-46bf-ba73-0d07a6f1c671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:18.549244 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7fc02d07-cc8d-46bf-ba73-0d07a6f1c671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1188 microversion: 2.1 time: 0.338301 Oct 27 19:21:18.550557 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2992/6134] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:18 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1188 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:18.743085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-52276fe3-5335-495a-9e02-bf35f8d454d1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa0496a8-fb90-4b17-b6ee-b6b2cf116305"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:21:18.745927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-52276fe3-5335-495a-9e02-bf35f8d454d1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:18.754321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52276fe3-5335-495a-9e02-bf35f8d454d1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:18.755156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52276fe3-5335-495a-9e02-bf35f8d454d1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:18.755681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52276fe3-5335-495a-9e02-bf35f8d454d1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:18.756714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52276fe3-5335-495a-9e02-bf35f8d454d1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:18.757296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52276fe3-5335-495a-9e02-bf35f8d454d1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:18.758031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52276fe3-5335-495a-9e02-bf35f8d454d1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:19.246852 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-52276fe3-5335-495a-9e02-bf35f8d454d1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "POST /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.502194 Oct 27 19:21:19.250172 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3143/6135] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:21:18 2022] POST /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/os-volume_attachments => generated 194 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:21:19.577963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d419503-cde1-42ab-81c3-bffa684aa264 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:19.579239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9d419503-cde1-42ab-81c3-bffa684aa264 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:19.604623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d419503-cde1-42ab-81c3-bffa684aa264 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:19.605154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d419503-cde1-42ab-81c3-bffa684aa264 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:19.605618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d419503-cde1-42ab-81c3-bffa684aa264 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:19.606353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d419503-cde1-42ab-81c3-bffa684aa264 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:19.614634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d419503-cde1-42ab-81c3-bffa684aa264 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:19.615097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d419503-cde1-42ab-81c3-bffa684aa264 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:19.966346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d419503-cde1-42ab-81c3-bffa684aa264 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:19.976703 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9d419503-cde1-42ab-81c3-bffa684aa264 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1188 microversion: 2.1 time: 0.402754 Oct 27 19:21:19.987102 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2993/6136] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:19 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1188 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:21.006838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-49765c8b-24a1-43c8-9cf3-952d303bb039 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:21.007716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-49765c8b-24a1-43c8-9cf3-952d303bb039 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:21.025757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49765c8b-24a1-43c8-9cf3-952d303bb039 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:21.029294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49765c8b-24a1-43c8-9cf3-952d303bb039 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:21.029866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49765c8b-24a1-43c8-9cf3-952d303bb039 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:21.033958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49765c8b-24a1-43c8-9cf3-952d303bb039 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:21.035540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49765c8b-24a1-43c8-9cf3-952d303bb039 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:21.036809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49765c8b-24a1-43c8-9cf3-952d303bb039 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:21.189576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-49765c8b-24a1-43c8-9cf3-952d303bb039 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:21.203578 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-49765c8b-24a1-43c8-9cf3-952d303bb039 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1188 microversion: 2.1 time: 0.202017 Oct 27 19:21:21.205823 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3144/6137] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:21 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1188 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:22.233341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dbaaf83c-9330-4acd-9c63-acb416ff9a5d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:22.234106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dbaaf83c-9330-4acd-9c63-acb416ff9a5d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:22.249265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbaaf83c-9330-4acd-9c63-acb416ff9a5d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:22.260734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbaaf83c-9330-4acd-9c63-acb416ff9a5d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:22.263306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbaaf83c-9330-4acd-9c63-acb416ff9a5d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:22.264230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbaaf83c-9330-4acd-9c63-acb416ff9a5d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:22.268649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbaaf83c-9330-4acd-9c63-acb416ff9a5d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:22.271294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbaaf83c-9330-4acd-9c63-acb416ff9a5d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:22.683097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dbaaf83c-9330-4acd-9c63-acb416ff9a5d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:22.694522 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dbaaf83c-9330-4acd-9c63-acb416ff9a5d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1188 microversion: 2.1 time: 0.465667 Oct 27 19:21:22.697358 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2994/6138] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:22 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1188 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:23.721381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7fadb93b-f01a-4017-b58e-b27a05f5867f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:23.722010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7fadb93b-f01a-4017-b58e-b27a05f5867f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:23.733604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fadb93b-f01a-4017-b58e-b27a05f5867f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:23.735149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fadb93b-f01a-4017-b58e-b27a05f5867f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:23.739006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fadb93b-f01a-4017-b58e-b27a05f5867f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:23.740234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fadb93b-f01a-4017-b58e-b27a05f5867f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:23.740899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fadb93b-f01a-4017-b58e-b27a05f5867f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:23.741515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7fadb93b-f01a-4017-b58e-b27a05f5867f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:23.909698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7fadb93b-f01a-4017-b58e-b27a05f5867f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:23.919396 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7fadb93b-f01a-4017-b58e-b27a05f5867f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1188 microversion: 2.1 time: 0.201967 Oct 27 19:21:23.924508 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3145/6139] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:23 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1188 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:24.957484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1f3b0af0-76de-4700-95e9-ef30dd0c8743 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:24.958192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1f3b0af0-76de-4700-95e9-ef30dd0c8743 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:24.976927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f3b0af0-76de-4700-95e9-ef30dd0c8743 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:24.983045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f3b0af0-76de-4700-95e9-ef30dd0c8743 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:24.985302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f3b0af0-76de-4700-95e9-ef30dd0c8743 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:24.988177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f3b0af0-76de-4700-95e9-ef30dd0c8743 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:24.988878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f3b0af0-76de-4700-95e9-ef30dd0c8743 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:24.989555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f3b0af0-76de-4700-95e9-ef30dd0c8743 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:25.603680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1f3b0af0-76de-4700-95e9-ef30dd0c8743 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:25.620227 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1f3b0af0-76de-4700-95e9-ef30dd0c8743 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 200 len: 1188 microversion: 2.1 time: 0.672575 Oct 27 19:21:25.622903 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2995/6140] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:24 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 1188 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:26.162089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-29627176", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "a14a6484-4993-4bbf-9fd6-3902fa29ac2a"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:21:26.302924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] validate_networks() for [('a14a6484-4993-4bbf-9fd6-3902fa29ac2a', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:21:26.646848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d1d772e7-1390-44be-9c98-3e8871065dab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:26.647490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d1d772e7-1390-44be-9c98-3e8871065dab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 1f3502cb-e4d5-43d0-80eb-749093317b4a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:26.655263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1d772e7-1390-44be-9c98-3e8871065dab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:26.656804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1d772e7-1390-44be-9c98-3e8871065dab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:26.659030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1d772e7-1390-44be-9c98-3e8871065dab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:26.663056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1d772e7-1390-44be-9c98-3e8871065dab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:26.663814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1d772e7-1390-44be-9c98-3e8871065dab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:26.664467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1d772e7-1390-44be-9c98-3e8871065dab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:26.704721 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d1d772e7-1390-44be-9c98-3e8871065dab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance 1f3502cb-e4d5-43d0-80eb-749093317b4a could not be found. Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d1d772e7-1390-44be-9c98-3e8871065dab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a HTTP/1.1 Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 1f3502cb-e4d5-43d0-80eb-749093317b4a could not be found. Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '1f3502cb-e4d5-43d0-80eb-749093317b4a'} Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3502cb-e4d5-43d0-80eb-749093317b4a could not be found. Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3502cb-e4d5-43d0-80eb-749093317b4a could not be found. Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:21:26.707324 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:26.711366 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:21:26.711366 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:21:26.711366 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:21:26.711366 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:21:26.711366 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:21:26.711366 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3502cb-e4d5-43d0-80eb-749093317b4a could not be found. Oct 27 19:21:26.711366 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:21:26.713810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d1d772e7-1390-44be-9c98-3e8871065dab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance 1f3502cb-e4d5-43d0-80eb-749093317b4a could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:21:26.714934 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d1d772e7-1390-44be-9c98-3e8871065dab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a" status: 404 len: 111 microversion: 2.1 time: 0.073610 Oct 27 19:21:26.716023 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2996/6141] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:26 2022] GET /compute/v2.1/servers/1f3502cb-e4d5-43d0-80eb-749093317b4a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:21:28.998558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:21:28.999673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:21:29.002807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:21:29.003550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:21:29.004156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:21:29.024808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:29.025500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:29.025931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:29.032214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:29.033576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:29.035256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:29.109895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Getting quotas for project 94b7b6844fa84531a9582f1440d2e6ff. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:21:29.125197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Getting quotas for user 37142c6d57024d46a6bc92afecda69a2 and project 94b7b6844fa84531a9582f1440d2e6ff. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:21:29.158863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:21:29.167157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:21:29.296959 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-64937426-900e-4007-9940-a641f88b2ded tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.139097 Oct 27 19:21:29.305667 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3146/6142] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:21:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:21:29.310908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0e80eb37-23df-4b91-b460-432ed0c132aa tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:29.311625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0e80eb37-23df-4b91-b460-432ed0c132aa tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:29.547152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0e80eb37-23df-4b91-b460-432ed0c132aa tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:29.560537 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0e80eb37-23df-4b91-b460-432ed0c132aa tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1217 microversion: 2.1 time: 0.253894 Oct 27 19:21:29.571177 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2997/6143] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:29 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1217 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:30.597083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aeb31f55-9591-479f-9443-c942db7d6897 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:30.598537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-aeb31f55-9591-479f-9443-c942db7d6897 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:30.618419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aeb31f55-9591-479f-9443-c942db7d6897 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:30.618973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aeb31f55-9591-479f-9443-c942db7d6897 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:30.619424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aeb31f55-9591-479f-9443-c942db7d6897 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:30.620163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aeb31f55-9591-479f-9443-c942db7d6897 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:30.620630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aeb31f55-9591-479f-9443-c942db7d6897 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:30.621066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aeb31f55-9591-479f-9443-c942db7d6897 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:30.654896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2f75629c-fb8d-423b-8624-eb221bbcab4e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '.version_select at 0x7fc869bde310>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:30.699129 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2f75629c-fb8d-423b-8624-eb221bbcab4e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1616345280" status: 202 len: 0 microversion: 2.1 time: 0.050115 Oct 27 19:21:30.699905 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2998/6144] 10.222.0.42 () {58 vars in 1284 bytes} [Thu Oct 27 19:21:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1616345280 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:21:30.750196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-36228b0b-ffa5-4406-a354-6c0b061d2bc2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'create', calling method: .version_select at 0x7fc86992baf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-763761231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiB+6E3aOxZfHs0Vqaa8iM5Emc99gSMsgUZaXwTkqTL+qb39LWRstG/qeZ0EuLRX9V2trZHfk4r5g362A2GxRdyZFaQev52P2K/cdObkJDhEvLYKLL8vx/CCaDi7mNrEg=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:21:30.803210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-36228b0b-ffa5-4406-a354-6c0b061d2bc2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for project 853ac0c6e395469bb90c156aad129c26. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:21:30.816393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-36228b0b-ffa5-4406-a354-6c0b061d2bc2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for user ce7f16b54dda477386daed20f1a2e104 and project 853ac0c6e395469bb90c156aad129c26. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:21:30.824639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-aeb31f55-9591-479f-9443-c942db7d6897 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:30.833072 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aeb31f55-9591-479f-9443-c942db7d6897 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1213 microversion: 2.1 time: 0.243111 Oct 27 19:21:30.849125 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-36228b0b-ffa5-4406-a354-6c0b061d2bc2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.103032 Oct 27 19:21:30.850021 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2999/6145] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:21:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:21:30.856205 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3147/6146] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:30 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1213 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:31.863601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cee1c80d-65ca-4a16-9b6b-0e25b8633165 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:31.864289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cee1c80d-65ca-4a16-9b6b-0e25b8633165 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:31.878477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cee1c80d-65ca-4a16-9b6b-0e25b8633165 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:31.880644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cee1c80d-65ca-4a16-9b6b-0e25b8633165 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:31.881985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cee1c80d-65ca-4a16-9b6b-0e25b8633165 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:31.883026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cee1c80d-65ca-4a16-9b6b-0e25b8633165 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:31.884224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cee1c80d-65ca-4a16-9b6b-0e25b8633165 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:31.884930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cee1c80d-65ca-4a16-9b6b-0e25b8633165 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:32.069426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cee1c80d-65ca-4a16-9b6b-0e25b8633165 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:32.078174 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cee1c80d-65ca-4a16-9b6b-0e25b8633165 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1275 microversion: 2.1 time: 0.219722 Oct 27 19:21:32.082458 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3000/6147] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:31 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:33.108862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cb457a7b-a55a-4b4d-aa8a-7e4fe6fa09d9 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:33.110255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cb457a7b-a55a-4b4d-aa8a-7e4fe6fa09d9 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:33.124032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb457a7b-a55a-4b4d-aa8a-7e4fe6fa09d9 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:33.125776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb457a7b-a55a-4b4d-aa8a-7e4fe6fa09d9 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:33.126418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb457a7b-a55a-4b4d-aa8a-7e4fe6fa09d9 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:33.127321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb457a7b-a55a-4b4d-aa8a-7e4fe6fa09d9 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:33.127944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb457a7b-a55a-4b4d-aa8a-7e4fe6fa09d9 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:33.129116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb457a7b-a55a-4b4d-aa8a-7e4fe6fa09d9 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:33.373216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cb457a7b-a55a-4b4d-aa8a-7e4fe6fa09d9 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:33.386928 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cb457a7b-a55a-4b4d-aa8a-7e4fe6fa09d9 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1275 microversion: 2.1 time: 0.282291 Oct 27 19:21:33.387523 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3148/6148] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:33 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1275 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:34.414115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a13810ff-ab7f-46b1-b1a2-882b23d32969 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:34.415903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a13810ff-ab7f-46b1-b1a2-882b23d32969 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:34.432599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a13810ff-ab7f-46b1-b1a2-882b23d32969 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:34.433108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a13810ff-ab7f-46b1-b1a2-882b23d32969 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:34.434741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a13810ff-ab7f-46b1-b1a2-882b23d32969 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:34.435495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a13810ff-ab7f-46b1-b1a2-882b23d32969 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:34.435977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a13810ff-ab7f-46b1-b1a2-882b23d32969 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:34.436423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a13810ff-ab7f-46b1-b1a2-882b23d32969 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:35.620804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a13810ff-ab7f-46b1-b1a2-882b23d32969 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:35.632299 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a13810ff-ab7f-46b1-b1a2-882b23d32969 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1317 microversion: 2.1 time: 1.225237 Oct 27 19:21:35.634676 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3001/6149] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:34 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1317 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:36.658429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c563da9e-5a7d-46e6-8696-17011999ac0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:36.659068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c563da9e-5a7d-46e6-8696-17011999ac0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:36.673239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c563da9e-5a7d-46e6-8696-17011999ac0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:36.674707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c563da9e-5a7d-46e6-8696-17011999ac0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:36.677355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c563da9e-5a7d-46e6-8696-17011999ac0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:36.678329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c563da9e-5a7d-46e6-8696-17011999ac0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:36.682191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c563da9e-5a7d-46e6-8696-17011999ac0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:36.692793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c563da9e-5a7d-46e6-8696-17011999ac0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:37.994576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c563da9e-5a7d-46e6-8696-17011999ac0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:38.005428 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c563da9e-5a7d-46e6-8696-17011999ac0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1317 microversion: 2.1 time: 1.351986 Oct 27 19:21:38.008552 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3149/6150] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:36 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1317 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:38.376575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-212d9928-38ff-422d-b2c4-6f05ac9809e4 req-e99dbf5d-0e0b-4c1e-9c9d-67438c76bd38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78b83c2e-1b97-42e2-9839-ba55eb15eae4", "tag": "293159bd-f64d-48ab-9d7d-8baf96fdb24d"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:21:38.424403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-212d9928-38ff-422d-b2c4-6f05ac9809e4 req-e99dbf5d-0e0b-4c1e-9c9d-67438c76bd38 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:38.426651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-212d9928-38ff-422d-b2c4-6f05ac9809e4 req-e99dbf5d-0e0b-4c1e-9c9d-67438c76bd38 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:38.428344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-212d9928-38ff-422d-b2c4-6f05ac9809e4 req-e99dbf5d-0e0b-4c1e-9c9d-67438c76bd38 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:38.483387 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-212d9928-38ff-422d-b2c4-6f05ac9809e4 req-e99dbf5d-0e0b-4c1e-9c9d-67438c76bd38 service nova] Creating event network-changed:293159bd-f64d-48ab-9d7d-8baf96fdb24d for instance 78b83c2e-1b97-42e2-9839-ba55eb15eae4 on n-h2-860687-3 Oct 27 19:21:38.505204 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-212d9928-38ff-422d-b2c4-6f05ac9809e4 req-e99dbf5d-0e0b-4c1e-9c9d-67438c76bd38 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138804 Oct 27 19:21:38.506245 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3002/6151] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:21:39.039368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-634e4bb8-2a2d-46b4-af1c-51111bfddfc2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:39.040146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-634e4bb8-2a2d-46b4-af1c-51111bfddfc2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:39.056745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-634e4bb8-2a2d-46b4-af1c-51111bfddfc2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:39.057941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-634e4bb8-2a2d-46b4-af1c-51111bfddfc2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:39.059264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-634e4bb8-2a2d-46b4-af1c-51111bfddfc2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:39.065234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-634e4bb8-2a2d-46b4-af1c-51111bfddfc2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:39.066842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-634e4bb8-2a2d-46b4-af1c-51111bfddfc2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:39.067952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-634e4bb8-2a2d-46b4-af1c-51111bfddfc2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:39.068987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:21:39.141115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:21:39.472439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-634e4bb8-2a2d-46b4-af1c-51111bfddfc2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:39.485789 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-634e4bb8-2a2d-46b4-af1c-51111bfddfc2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1317 microversion: 2.1 time: 0.458408 Oct 27 19:21:39.488366 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3150/6152] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:39 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:40.516064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e5787336-80cb-479e-a013-25538ecf4ef5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:40.517311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e5787336-80cb-479e-a013-25538ecf4ef5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:40.520739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:21:40.535712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5787336-80cb-479e-a013-25538ecf4ef5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:40.536223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5787336-80cb-479e-a013-25538ecf4ef5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:40.536668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5787336-80cb-479e-a013-25538ecf4ef5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:40.545050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5787336-80cb-479e-a013-25538ecf4ef5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:40.546677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5787336-80cb-479e-a013-25538ecf4ef5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:40.547659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5787336-80cb-479e-a013-25538ecf4ef5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:40.829901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:21:40.949347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e5787336-80cb-479e-a013-25538ecf4ef5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:40.960996 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e5787336-80cb-479e-a013-25538ecf4ef5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1317 microversion: 2.1 time: 0.453908 Oct 27 19:21:40.961590 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3003/6153] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:40 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:41.985221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8041a7e8-0ea9-4ac2-b208-40b341236f82 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:41.986558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8041a7e8-0ea9-4ac2-b208-40b341236f82 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:41.998133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8041a7e8-0ea9-4ac2-b208-40b341236f82 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:42.007678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8041a7e8-0ea9-4ac2-b208-40b341236f82 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:42.008499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8041a7e8-0ea9-4ac2-b208-40b341236f82 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:42.009507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8041a7e8-0ea9-4ac2-b208-40b341236f82 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:42.010196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8041a7e8-0ea9-4ac2-b208-40b341236f82 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:42.010897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8041a7e8-0ea9-4ac2-b208-40b341236f82 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:42.460743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8041a7e8-0ea9-4ac2-b208-40b341236f82 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:42.469570 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8041a7e8-0ea9-4ac2-b208-40b341236f82 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1317 microversion: 2.1 time: 0.488556 Oct 27 19:21:42.484990 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3151/6154] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:41 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:43.321589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1462048958", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b34e58d7-3ddc-4bcb-9a40-3e8df75bf076", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:21:43.494232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8db5ebd9-3908-4faa-bd76-1697a905c86b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:43.495589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8db5ebd9-3908-4faa-bd76-1697a905c86b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:43.504069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:21:43.516211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8db5ebd9-3908-4faa-bd76-1697a905c86b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:43.517477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8db5ebd9-3908-4faa-bd76-1697a905c86b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:43.518690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8db5ebd9-3908-4faa-bd76-1697a905c86b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:43.520209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8db5ebd9-3908-4faa-bd76-1697a905c86b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:43.520889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8db5ebd9-3908-4faa-bd76-1697a905c86b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:43.521756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8db5ebd9-3908-4faa-bd76-1697a905c86b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:43.528981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:21:43.991396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8db5ebd9-3908-4faa-bd76-1697a905c86b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:44.009363 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8db5ebd9-3908-4faa-bd76-1697a905c86b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1317 microversion: 2.1 time: 0.516390 Oct 27 19:21:44.010012 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3152/6155] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:43 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:44.041865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] validate_networks() for [('0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:21:44.423695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c287c8de-458d-4b61-ba88-3e7947fae6a1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:21:44.431218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c287c8de-458d-4b61-ba88-3e7947fae6a1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:44.432667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c287c8de-458d-4b61-ba88-3e7947fae6a1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:44.433326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c287c8de-458d-4b61-ba88-3e7947fae6a1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:44.461026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c287c8de-458d-4b61-ba88-3e7947fae6a1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Going to try to stop instance {{(pid=127029) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 19:21:44.555315 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c287c8de-458d-4b61-ba88-3e7947fae6a1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "POST /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/action" status: 202 len: 0 microversion: 2.1 time: 0.136160 Oct 27 19:21:44.574847 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3153/6156] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:21:44 2022] POST /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:21:44.602359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fb2d2edc-61ed-4640-b721-43da738860a5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:44.603412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fb2d2edc-61ed-4640-b721-43da738860a5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:44.624071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb2d2edc-61ed-4640-b721-43da738860a5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:44.624976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb2d2edc-61ed-4640-b721-43da738860a5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:44.626759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb2d2edc-61ed-4640-b721-43da738860a5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:44.629461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb2d2edc-61ed-4640-b721-43da738860a5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:44.637427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb2d2edc-61ed-4640-b721-43da738860a5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:44.638218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb2d2edc-61ed-4640-b721-43da738860a5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:45.290523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fb2d2edc-61ed-4640-b721-43da738860a5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:45.305099 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fb2d2edc-61ed-4640-b721-43da738860a5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1723 microversion: 2.1 time: 0.728578 Oct 27 19:21:45.307051 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3154/6157] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:44 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1723 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:45.339448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6a8cecd-603a-4e10-ae02-ffe895f3283b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:45.343042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c6a8cecd-603a-4e10-ae02-ffe895f3283b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:45.357136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6a8cecd-603a-4e10-ae02-ffe895f3283b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:45.358990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6a8cecd-603a-4e10-ae02-ffe895f3283b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:45.360034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6a8cecd-603a-4e10-ae02-ffe895f3283b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:45.361709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6a8cecd-603a-4e10-ae02-ffe895f3283b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:45.364695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6a8cecd-603a-4e10-ae02-ffe895f3283b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:45.366511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6a8cecd-603a-4e10-ae02-ffe895f3283b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:46.064851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c6a8cecd-603a-4e10-ae02-ffe895f3283b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:46.087369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:21:46.088964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:21:46.089823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:21:46.090490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:21:46.091418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:21:46.095827 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c6a8cecd-603a-4e10-ae02-ffe895f3283b tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1317 microversion: 2.1 time: 0.764765 Oct 27 19:21:46.096524 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3155/6158] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:45 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1317 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:46.120771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:46.123386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:46.127660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:46.130127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:46.130943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:46.131784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:46.193518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:21:46.207774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for user c8e60ff9ab0d45628195f314f1cac791 and project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:21:46.330132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:21:46.332570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b34e58d7-3ddc-4bcb-9a40-3e8df75bf076',volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:21:46.332935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-33c4fcb1-4d5b-4ab0-a59b-99e2f9a9b9cc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:46.333566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-33c4fcb1-4d5b-4ab0-a59b-99e2f9a9b9cc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:46.345854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33c4fcb1-4d5b-4ab0-a59b-99e2f9a9b9cc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:46.346367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33c4fcb1-4d5b-4ab0-a59b-99e2f9a9b9cc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:46.346843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33c4fcb1-4d5b-4ab0-a59b-99e2f9a9b9cc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:46.357246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33c4fcb1-4d5b-4ab0-a59b-99e2f9a9b9cc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:46.359157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33c4fcb1-4d5b-4ab0-a59b-99e2f9a9b9cc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:46.360442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33c4fcb1-4d5b-4ab0-a59b-99e2f9a9b9cc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:46.611120 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3eec3bc8-a6b8-4cfd-a3e1-d932e3c40be7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.298509 Oct 27 19:21:46.611863 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3004/6159] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:21:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:21:46.624737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0db19bcc-9ba2-4f02-962a-6757862bbbab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:46.625651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0db19bcc-9ba2-4f02-962a-6757862bbbab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:46.794041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0db19bcc-9ba2-4f02-962a-6757862bbbab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:46.809750 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0db19bcc-9ba2-4f02-962a-6757862bbbab tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1057 microversion: 2.1 time: 0.189555 Oct 27 19:21:46.813370 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3005/6160] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:46 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1057 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:47.124364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d8816f7-e2c1-4b87-9e13-c213399b78bb tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:47.125001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d8816f7-e2c1-4b87-9e13-c213399b78bb tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:47.138902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d8816f7-e2c1-4b87-9e13-c213399b78bb tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:47.143098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d8816f7-e2c1-4b87-9e13-c213399b78bb tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:47.144323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d8816f7-e2c1-4b87-9e13-c213399b78bb tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:47.147282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d8816f7-e2c1-4b87-9e13-c213399b78bb tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:47.151925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d8816f7-e2c1-4b87-9e13-c213399b78bb tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:47.152646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d8816f7-e2c1-4b87-9e13-c213399b78bb tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:47.177195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=58 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:21:47.362973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-33c4fcb1-4d5b-4ab0-a59b-99e2f9a9b9cc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:47.377473 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-33c4fcb1-4d5b-4ab0-a59b-99e2f9a9b9cc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1723 microversion: 2.1 time: 1.048598 Oct 27 19:21:47.380952 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3156/6161] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:46 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1723 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:21:47.777353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d8816f7-e2c1-4b87-9e13-c213399b78bb tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:47.792686 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d8816f7-e2c1-4b87-9e13-c213399b78bb tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1317 microversion: 2.1 time: 0.670719 Oct 27 19:21:47.795840 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3006/6162] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:47 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:47.839508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0ea383c-a490-4b87-8d68-11ac2be8c105 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:47.840421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f0ea383c-a490-4b87-8d68-11ac2be8c105 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:47.857299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0ea383c-a490-4b87-8d68-11ac2be8c105 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:47.858120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0ea383c-a490-4b87-8d68-11ac2be8c105 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:47.858827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0ea383c-a490-4b87-8d68-11ac2be8c105 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:47.859821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0ea383c-a490-4b87-8d68-11ac2be8c105 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:47.863164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0ea383c-a490-4b87-8d68-11ac2be8c105 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:47.871632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0ea383c-a490-4b87-8d68-11ac2be8c105 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:48.154533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f0ea383c-a490-4b87-8d68-11ac2be8c105 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:48.173169 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f0ea383c-a490-4b87-8d68-11ac2be8c105 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1099 microversion: 2.1 time: 0.337851 Oct 27 19:21:48.186845 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3157/6163] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:47 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1099 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:48.407106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6f46aa05-eeae-43ed-b51b-62aec8145a13 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:48.408088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6f46aa05-eeae-43ed-b51b-62aec8145a13 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:48.435369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f46aa05-eeae-43ed-b51b-62aec8145a13 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:48.442621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f46aa05-eeae-43ed-b51b-62aec8145a13 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:48.443494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f46aa05-eeae-43ed-b51b-62aec8145a13 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:48.444494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f46aa05-eeae-43ed-b51b-62aec8145a13 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:48.445203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f46aa05-eeae-43ed-b51b-62aec8145a13 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:48.446540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f46aa05-eeae-43ed-b51b-62aec8145a13 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:48.823495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c4640c23-634b-46a9-95d1-6ec411e155c1 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:48.824130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c4640c23-634b-46a9-95d1-6ec411e155c1 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:48.837671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4640c23-634b-46a9-95d1-6ec411e155c1 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:48.844022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4640c23-634b-46a9-95d1-6ec411e155c1 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:48.844764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4640c23-634b-46a9-95d1-6ec411e155c1 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:48.849345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4640c23-634b-46a9-95d1-6ec411e155c1 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:48.850159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4640c23-634b-46a9-95d1-6ec411e155c1 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:48.852713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4640c23-634b-46a9-95d1-6ec411e155c1 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:49.233685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6f46aa05-eeae-43ed-b51b-62aec8145a13 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:49.252395 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6f46aa05-eeae-43ed-b51b-62aec8145a13 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1723 microversion: 2.1 time: 0.849786 Oct 27 19:21:49.257640 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3007/6164] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:48 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1723 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:49.774561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d6ac9368-4204-4fb1-9d98-824df9c4b98c req-0f853a4d-c49b-42dc-b0d6-811c92bc98d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b83c2e-1b97-42e2-9839-ba55eb15eae4", "name": "network-vif-plugged", "status": "completed", "tag": "293159bd-f64d-48ab-9d7d-8baf96fdb24d"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:21:49.805137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d6ac9368-4204-4fb1-9d98-824df9c4b98c req-0f853a4d-c49b-42dc-b0d6-811c92bc98d6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:49.805637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d6ac9368-4204-4fb1-9d98-824df9c4b98c req-0f853a4d-c49b-42dc-b0d6-811c92bc98d6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:49.806091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d6ac9368-4204-4fb1-9d98-824df9c4b98c req-0f853a4d-c49b-42dc-b0d6-811c92bc98d6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:49.858937 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d6ac9368-4204-4fb1-9d98-824df9c4b98c req-0f853a4d-c49b-42dc-b0d6-811c92bc98d6 service nova] Creating event network-vif-plugged:293159bd-f64d-48ab-9d7d-8baf96fdb24d for instance 78b83c2e-1b97-42e2-9839-ba55eb15eae4 on n-h2-860687-3 Oct 27 19:21:49.870934 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d6ac9368-4204-4fb1-9d98-824df9c4b98c req-0f853a4d-c49b-42dc-b0d6-811c92bc98d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.609875 Oct 27 19:21:49.872135 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3008/6165] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:21:49.887434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb7465f3-4031-4f1b-9e81-179ad62e1337 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:49.890721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cb7465f3-4031-4f1b-9e81-179ad62e1337 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:49.906878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb7465f3-4031-4f1b-9e81-179ad62e1337 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:49.908382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb7465f3-4031-4f1b-9e81-179ad62e1337 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:49.912051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb7465f3-4031-4f1b-9e81-179ad62e1337 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:49.913236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb7465f3-4031-4f1b-9e81-179ad62e1337 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:49.913910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb7465f3-4031-4f1b-9e81-179ad62e1337 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:49.916102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb7465f3-4031-4f1b-9e81-179ad62e1337 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:50.185557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c4640c23-634b-46a9-95d1-6ec411e155c1 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:50.201498 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c4640c23-634b-46a9-95d1-6ec411e155c1 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1317 microversion: 2.1 time: 1.382776 Oct 27 19:21:50.202116 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3158/6166] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:48 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1317 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:50.231867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cb7465f3-4031-4f1b-9e81-179ad62e1337 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:50.243643 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cb7465f3-4031-4f1b-9e81-179ad62e1337 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1173 microversion: 2.1 time: 0.366936 Oct 27 19:21:50.246849 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3009/6167] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:49 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1173 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:50.286452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f3844c3a-4d1a-4c9b-8bdc-30f9e630faf8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:50.289870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f3844c3a-4d1a-4c9b-8bdc-30f9e630faf8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:50.302325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3844c3a-4d1a-4c9b-8bdc-30f9e630faf8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:50.313525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3844c3a-4d1a-4c9b-8bdc-30f9e630faf8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:50.316872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3844c3a-4d1a-4c9b-8bdc-30f9e630faf8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:50.319065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3844c3a-4d1a-4c9b-8bdc-30f9e630faf8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:50.319769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3844c3a-4d1a-4c9b-8bdc-30f9e630faf8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:50.320434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3844c3a-4d1a-4c9b-8bdc-30f9e630faf8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:51.229667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b0e0d3c8-8a69-4cb1-9717-7a8d910e304e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:51.230948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0e0d3c8-8a69-4cb1-9717-7a8d910e304e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:51.255324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0e0d3c8-8a69-4cb1-9717-7a8d910e304e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:51.282136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0e0d3c8-8a69-4cb1-9717-7a8d910e304e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:51.282648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0e0d3c8-8a69-4cb1-9717-7a8d910e304e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:51.283423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0e0d3c8-8a69-4cb1-9717-7a8d910e304e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:51.286272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0e0d3c8-8a69-4cb1-9717-7a8d910e304e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:51.286849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0e0d3c8-8a69-4cb1-9717-7a8d910e304e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:51.796976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0e0d3c8-8a69-4cb1-9717-7a8d910e304e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:51.810595 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b0e0d3c8-8a69-4cb1-9717-7a8d910e304e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1317 microversion: 2.1 time: 0.584175 Oct 27 19:21:51.819868 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3010/6168] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:51 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:51.824976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e926f19e-08ee-4568-86d5-174a90316fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:51.825611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e926f19e-08ee-4568-86d5-174a90316fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:51.845602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e926f19e-08ee-4568-86d5-174a90316fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:51.846333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e926f19e-08ee-4568-86d5-174a90316fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:51.848254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e926f19e-08ee-4568-86d5-174a90316fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:51.849488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e926f19e-08ee-4568-86d5-174a90316fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:51.850102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e926f19e-08ee-4568-86d5-174a90316fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:51.850757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e926f19e-08ee-4568-86d5-174a90316fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:51.906204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f3844c3a-4d1a-4c9b-8bdc-30f9e630faf8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:51.918629 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f3844c3a-4d1a-4c9b-8bdc-30f9e630faf8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1723 microversion: 2.1 time: 1.642881 Oct 27 19:21:51.919551 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3159/6169] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:50 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1723 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:52.169066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e926f19e-08ee-4568-86d5-174a90316fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:52.185045 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e926f19e-08ee-4568-86d5-174a90316fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1173 microversion: 2.1 time: 0.361929 Oct 27 19:21:52.188174 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3011/6170] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:51 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1173 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:52.847168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c53b69e5-9353-4e04-aff8-19a035ab9543 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:52.849615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c53b69e5-9353-4e04-aff8-19a035ab9543 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:52.856840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c53b69e5-9353-4e04-aff8-19a035ab9543 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:52.859895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c53b69e5-9353-4e04-aff8-19a035ab9543 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:52.860591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c53b69e5-9353-4e04-aff8-19a035ab9543 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:52.863816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c53b69e5-9353-4e04-aff8-19a035ab9543 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:52.866598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c53b69e5-9353-4e04-aff8-19a035ab9543 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:52.867275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c53b69e5-9353-4e04-aff8-19a035ab9543 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:52.948152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c4dcbf4f-9999-4d99-94ef-10fed60a0488 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:52.948768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c4dcbf4f-9999-4d99-94ef-10fed60a0488 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:52.964004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4dcbf4f-9999-4d99-94ef-10fed60a0488 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:52.964545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4dcbf4f-9999-4d99-94ef-10fed60a0488 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:52.965002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4dcbf4f-9999-4d99-94ef-10fed60a0488 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:52.969626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4dcbf4f-9999-4d99-94ef-10fed60a0488 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:52.970121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4dcbf4f-9999-4d99-94ef-10fed60a0488 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:52.974673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4dcbf4f-9999-4d99-94ef-10fed60a0488 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:53.427682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c53b69e5-9353-4e04-aff8-19a035ab9543 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:53.440314 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c53b69e5-9353-4e04-aff8-19a035ab9543 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1506 microversion: 2.1 time: 0.608049 Oct 27 19:21:53.449580 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3160/6171] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:52 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:53.459090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-81469559-c7bf-4baa-a756-f959c5c93092 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:53.459735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-81469559-c7bf-4baa-a756-f959c5c93092 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:53.489547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81469559-c7bf-4baa-a756-f959c5c93092 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:53.490063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81469559-c7bf-4baa-a756-f959c5c93092 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:53.490549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81469559-c7bf-4baa-a756-f959c5c93092 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:53.491365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81469559-c7bf-4baa-a756-f959c5c93092 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:53.504823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81469559-c7bf-4baa-a756-f959c5c93092 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:53.506332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81469559-c7bf-4baa-a756-f959c5c93092 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:53.578893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c4dcbf4f-9999-4d99-94ef-10fed60a0488 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:53.590657 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c4dcbf4f-9999-4d99-94ef-10fed60a0488 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1723 microversion: 2.1 time: 0.646709 Oct 27 19:21:53.600203 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3012/6172] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:52 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1723 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:21:53.760220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-970941218", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "f484444e-9caa-4a4c-bdeb-3088db22ffb5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-763761231", "security_groups": [{"name": "tempest-secgroup-smoke-1857717480"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:21:54.107382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] validate_networks() for [('f484444e-9caa-4a4c-bdeb-3088db22ffb5', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:21:54.910184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-81469559-c7bf-4baa-a756-f959c5c93092 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:54.919661 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-81469559-c7bf-4baa-a756-f959c5c93092 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1215 microversion: 2.1 time: 1.468898 Oct 27 19:21:54.935630 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3161/6173] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:53 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1215 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:54.943101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8902d525-b2a9-4bff-b72d-195381fb8d02 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:54.944028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8902d525-b2a9-4bff-b72d-195381fb8d02 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:54.952057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8902d525-b2a9-4bff-b72d-195381fb8d02 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:54.952800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8902d525-b2a9-4bff-b72d-195381fb8d02 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:54.953397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8902d525-b2a9-4bff-b72d-195381fb8d02 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:54.954283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8902d525-b2a9-4bff-b72d-195381fb8d02 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:54.954969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8902d525-b2a9-4bff-b72d-195381fb8d02 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:54.955990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8902d525-b2a9-4bff-b72d-195381fb8d02 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:55.478850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:21:55.480225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:21:55.480977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:21:55.481709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:21:55.482598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:21:55.503786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:55.504769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:55.508539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:55.509829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:55.518205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:55.526098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:55.572880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for project 853ac0c6e395469bb90c156aad129c26. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:21:55.596439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for user ce7f16b54dda477386daed20f1a2e104 and project 853ac0c6e395469bb90c156aad129c26. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:21:55.628925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:21:55.633829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:21:55.719979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8902d525-b2a9-4bff-b72d-195381fb8d02 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:55.741076 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-09ec0177-0e0a-48b9-b434-205936e2ba07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.984643 Oct 27 19:21:55.743040 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3013/6174] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:21:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:21:55.744839 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8902d525-b2a9-4bff-b72d-195381fb8d02 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1723 microversion: 2.1 time: 0.803152 Oct 27 19:21:55.751920 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3162/6175] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:54 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1723 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:55.759651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1cbae377-06a9-4d65-bbc2-cd7e16a961df tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:55.760791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1cbae377-06a9-4d65-bbc2-cd7e16a961df tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:55.891283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1cbae377-06a9-4d65-bbc2-cd7e16a961df tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:55.903544 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1cbae377-06a9-4d65-bbc2-cd7e16a961df tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1265 microversion: 2.1 time: 0.152893 Oct 27 19:21:55.904550 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3014/6176] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:55 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:55.951121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae9d957d-2e72-4cef-84b3-05a765066321 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:55.952512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ae9d957d-2e72-4cef-84b3-05a765066321 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:55.967853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae9d957d-2e72-4cef-84b3-05a765066321 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:55.971329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae9d957d-2e72-4cef-84b3-05a765066321 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:55.974082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae9d957d-2e72-4cef-84b3-05a765066321 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:55.977224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae9d957d-2e72-4cef-84b3-05a765066321 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:55.979334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae9d957d-2e72-4cef-84b3-05a765066321 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:55.980418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae9d957d-2e72-4cef-84b3-05a765066321 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:56.781890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-891fcb7a-ec5b-4a41-958a-28053b013c78 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:56.784463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-891fcb7a-ec5b-4a41-958a-28053b013c78 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:56.796061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ae9d957d-2e72-4cef-84b3-05a765066321 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:56.805636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-891fcb7a-ec5b-4a41-958a-28053b013c78 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:56.809361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-891fcb7a-ec5b-4a41-958a-28053b013c78 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:56.811577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-891fcb7a-ec5b-4a41-958a-28053b013c78 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:56.814268 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ae9d957d-2e72-4cef-84b3-05a765066321 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1215 microversion: 2.1 time: 0.868389 Oct 27 19:21:56.814588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-891fcb7a-ec5b-4a41-958a-28053b013c78 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:56.814925 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3163/6177] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:55 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1215 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:56.819858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-891fcb7a-ec5b-4a41-958a-28053b013c78 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:56.821024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-891fcb7a-ec5b-4a41-958a-28053b013c78 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:56.928666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9e2f6a6c-4e42-4929-a4a9-b2159ef4cd75 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:56.930796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9e2f6a6c-4e42-4929-a4a9-b2159ef4cd75 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:56.977791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e2f6a6c-4e42-4929-a4a9-b2159ef4cd75 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:56.978646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e2f6a6c-4e42-4929-a4a9-b2159ef4cd75 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:56.978856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e2f6a6c-4e42-4929-a4a9-b2159ef4cd75 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:56.994050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e2f6a6c-4e42-4929-a4a9-b2159ef4cd75 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:56.994646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e2f6a6c-4e42-4929-a4a9-b2159ef4cd75 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:56.996444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e2f6a6c-4e42-4929-a4a9-b2159ef4cd75 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:57.273090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-891fcb7a-ec5b-4a41-958a-28053b013c78 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:57.310505 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-891fcb7a-ec5b-4a41-958a-28053b013c78 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1723 microversion: 2.1 time: 0.539320 Oct 27 19:21:57.311288 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3015/6178] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:56 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1723 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:57.443194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9e2f6a6c-4e42-4929-a4a9-b2159ef4cd75 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:57.453313 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9e2f6a6c-4e42-4929-a4a9-b2159ef4cd75 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1261 microversion: 2.1 time: 0.529357 Oct 27 19:21:57.456283 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3164/6179] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:56 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1261 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:57.846295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-049db660-a0d2-4c44-9e3b-f2605264a671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:57.848483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-049db660-a0d2-4c44-9e3b-f2605264a671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:57.872754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-049db660-a0d2-4c44-9e3b-f2605264a671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:57.880381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-049db660-a0d2-4c44-9e3b-f2605264a671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:57.881161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-049db660-a0d2-4c44-9e3b-f2605264a671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:57.885312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-049db660-a0d2-4c44-9e3b-f2605264a671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:57.886054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-049db660-a0d2-4c44-9e3b-f2605264a671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:57.886722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-049db660-a0d2-4c44-9e3b-f2605264a671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:58.339051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6c4f7a8e-30dd-43fb-ae13-9effc50ca86d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:58.339801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6c4f7a8e-30dd-43fb-ae13-9effc50ca86d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:58.344813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-049db660-a0d2-4c44-9e3b-f2605264a671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:58.365871 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-049db660-a0d2-4c44-9e3b-f2605264a671 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1215 microversion: 2.1 time: 0.516711 Oct 27 19:21:58.366687 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3016/6180] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:57 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1215 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:58.369757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c4f7a8e-30dd-43fb-ae13-9effc50ca86d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:58.370563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c4f7a8e-30dd-43fb-ae13-9effc50ca86d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:58.372465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c4f7a8e-30dd-43fb-ae13-9effc50ca86d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:58.380040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c4f7a8e-30dd-43fb-ae13-9effc50ca86d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:58.380859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c4f7a8e-30dd-43fb-ae13-9effc50ca86d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:58.381542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c4f7a8e-30dd-43fb-ae13-9effc50ca86d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:58.481111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e8ac8c81-e104-4010-861c-85fc560fda9c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:58.485351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e8ac8c81-e104-4010-861c-85fc560fda9c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:58.499657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8ac8c81-e104-4010-861c-85fc560fda9c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:58.512554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8ac8c81-e104-4010-861c-85fc560fda9c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:58.514721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8ac8c81-e104-4010-861c-85fc560fda9c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:58.515751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8ac8c81-e104-4010-861c-85fc560fda9c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:58.521300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8ac8c81-e104-4010-861c-85fc560fda9c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:58.522246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8ac8c81-e104-4010-861c-85fc560fda9c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:58.702182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8ac8c81-e104-4010-861c-85fc560fda9c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:58.714139 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e8ac8c81-e104-4010-861c-85fc560fda9c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1323 microversion: 2.1 time: 0.235830 Oct 27 19:21:58.718975 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3017/6181] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:58 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1323 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:21:59.390454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8c0b4775-20b6-4995-a474-7b504a827a5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:59.391268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8c0b4775-20b6-4995-a474-7b504a827a5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:59.405397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c0b4775-20b6-4995-a474-7b504a827a5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:59.413039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c0b4775-20b6-4995-a474-7b504a827a5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:59.415994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c0b4775-20b6-4995-a474-7b504a827a5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:59.416800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c0b4775-20b6-4995-a474-7b504a827a5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:59.417292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c0b4775-20b6-4995-a474-7b504a827a5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:59.417745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c0b4775-20b6-4995-a474-7b504a827a5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:59.769399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8c0b4775-20b6-4995-a474-7b504a827a5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:59.782748 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8c0b4775-20b6-4995-a474-7b504a827a5f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1215 microversion: 2.1 time: 0.396991 Oct 27 19:21:59.784579 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3018/6182] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:59 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1215 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:59.794045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb5b6fd3-8134-4b1c-9951-07e07f09fd77 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:21:59.796325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb5b6fd3-8134-4b1c-9951-07e07f09fd77 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:21:59.805544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5b6fd3-8134-4b1c-9951-07e07f09fd77 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:59.806937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5b6fd3-8134-4b1c-9951-07e07f09fd77 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:59.807585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5b6fd3-8134-4b1c-9951-07e07f09fd77 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:59.808603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5b6fd3-8134-4b1c-9951-07e07f09fd77 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:21:59.809232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5b6fd3-8134-4b1c-9951-07e07f09fd77 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:21:59.809827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5b6fd3-8134-4b1c-9951-07e07f09fd77 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:21:59.871611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6c4f7a8e-30dd-43fb-ae13-9effc50ca86d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:59.891440 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6c4f7a8e-30dd-43fb-ae13-9effc50ca86d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1723 microversion: 2.1 time: 1.559562 Oct 27 19:21:59.894652 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3165/6183] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:58 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1723 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:21:59.908896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-eb5b6fd3-8134-4b1c-9951-07e07f09fd77 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:21:59.922915 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb5b6fd3-8134-4b1c-9951-07e07f09fd77 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1323 microversion: 2.1 time: 0.136584 Oct 27 19:21:59.924180 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3019/6184] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:21:59 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1323 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:00.733609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a0f88f71-9933-4fc8-ab1c-aecfed4ab740 req-7d89c86d-65e8-4161-b26c-3309ece1c3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5103dc-c8a2-4a38-b9e6-d632bb6d597e", "tag": "33726ecf-3dc8-44d6-85e7-58726bb698f2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:00.755786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a0f88f71-9933-4fc8-ab1c-aecfed4ab740 req-7d89c86d-65e8-4161-b26c-3309ece1c3d6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:00.756757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a0f88f71-9933-4fc8-ab1c-aecfed4ab740 req-7d89c86d-65e8-4161-b26c-3309ece1c3d6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:00.757400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a0f88f71-9933-4fc8-ab1c-aecfed4ab740 req-7d89c86d-65e8-4161-b26c-3309ece1c3d6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:00.771306 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a0f88f71-9933-4fc8-ab1c-aecfed4ab740 req-7d89c86d-65e8-4161-b26c-3309ece1c3d6 service nova] Creating event network-changed:33726ecf-3dc8-44d6-85e7-58726bb698f2 for instance 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e on n-h1-860687-3 Oct 27 19:22:00.777688 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a0f88f71-9933-4fc8-ab1c-aecfed4ab740 req-7d89c86d-65e8-4161-b26c-3309ece1c3d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.386798 Oct 27 19:22:00.779184 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3166/6185] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:22:00.809420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6e7a2882-6c21-4af5-aa93-de135ffbe036 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:00.810933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6e7a2882-6c21-4af5-aa93-de135ffbe036 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:00.822989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e7a2882-6c21-4af5-aa93-de135ffbe036 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:00.823938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e7a2882-6c21-4af5-aa93-de135ffbe036 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:00.825695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e7a2882-6c21-4af5-aa93-de135ffbe036 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:00.829218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e7a2882-6c21-4af5-aa93-de135ffbe036 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:00.830959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e7a2882-6c21-4af5-aa93-de135ffbe036 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:00.832463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e7a2882-6c21-4af5-aa93-de135ffbe036 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:00.924614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-415c8e71-5cf7-4744-872e-91447c4d4c3f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:00.927979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-415c8e71-5cf7-4744-872e-91447c4d4c3f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:00.943919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-415c8e71-5cf7-4744-872e-91447c4d4c3f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:00.954363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-415c8e71-5cf7-4744-872e-91447c4d4c3f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:00.958403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-415c8e71-5cf7-4744-872e-91447c4d4c3f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:00.959448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-415c8e71-5cf7-4744-872e-91447c4d4c3f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:00.962085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-415c8e71-5cf7-4744-872e-91447c4d4c3f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:00.962782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-415c8e71-5cf7-4744-872e-91447c4d4c3f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:01.107604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6e7a2882-6c21-4af5-aa93-de135ffbe036 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:01.120881 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6e7a2882-6c21-4af5-aa93-de135ffbe036 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1215 microversion: 2.1 time: 0.315714 Oct 27 19:22:01.121703 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3020/6186] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:00 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:01.128418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e40e465d-ee44-493f-969c-794f1b5cefd6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:01.129378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e40e465d-ee44-493f-969c-794f1b5cefd6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:01.136493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e40e465d-ee44-493f-969c-794f1b5cefd6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:01.137865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e40e465d-ee44-493f-969c-794f1b5cefd6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:01.138731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e40e465d-ee44-493f-969c-794f1b5cefd6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:01.139692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e40e465d-ee44-493f-969c-794f1b5cefd6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:01.140471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e40e465d-ee44-493f-969c-794f1b5cefd6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:01.141026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e40e465d-ee44-493f-969c-794f1b5cefd6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:01.279747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e40e465d-ee44-493f-969c-794f1b5cefd6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:01.288110 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e40e465d-ee44-493f-969c-794f1b5cefd6 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1323 microversion: 2.1 time: 0.164940 Oct 27 19:22:01.288590 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3021/6187] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:01 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1323 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:01.758747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-415c8e71-5cf7-4744-872e-91447c4d4c3f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:01.773423 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-415c8e71-5cf7-4744-872e-91447c4d4c3f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1700 microversion: 2.1 time: 0.858447 Oct 27 19:22:01.773931 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3167/6188] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:00 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1700 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:01.805755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4260b44a-ac24-457d-8a98-688f41023846 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:01.845965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4260b44a-ac24-457d-8a98-688f41023846 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:01.846614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4260b44a-ac24-457d-8a98-688f41023846 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:01.847133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4260b44a-ac24-457d-8a98-688f41023846 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:01.927773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4260b44a-ac24-457d-8a98-688f41023846 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Going to try to start instance {{(pid=127028) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 19:22:02.012055 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4260b44a-ac24-457d-8a98-688f41023846 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "POST /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/action" status: 202 len: 0 microversion: 2.1 time: 0.205239 Oct 27 19:22:02.012706 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3022/6189] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:22:01 2022] POST /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:22:02.021755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b983b201-2694-4dec-8d04-5ef185789ce4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:02.026546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b983b201-2694-4dec-8d04-5ef185789ce4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:02.035464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b983b201-2694-4dec-8d04-5ef185789ce4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:02.036648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b983b201-2694-4dec-8d04-5ef185789ce4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:02.037873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b983b201-2694-4dec-8d04-5ef185789ce4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:02.038939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b983b201-2694-4dec-8d04-5ef185789ce4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:02.039707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b983b201-2694-4dec-8d04-5ef185789ce4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:02.040423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b983b201-2694-4dec-8d04-5ef185789ce4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:02.099699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:02.146035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-75499c0a-a054-4f06-977c-44e4cf0396bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:02.147216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-75499c0a-a054-4f06-977c-44e4cf0396bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:02.155070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75499c0a-a054-4f06-977c-44e4cf0396bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:02.156695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75499c0a-a054-4f06-977c-44e4cf0396bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:02.157554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75499c0a-a054-4f06-977c-44e4cf0396bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:02.158486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75499c0a-a054-4f06-977c-44e4cf0396bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:02.159297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75499c0a-a054-4f06-977c-44e4cf0396bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:02.160165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75499c0a-a054-4f06-977c-44e4cf0396bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:02.398991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-75499c0a-a054-4f06-977c-44e4cf0396bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:02.407347 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-75499c0a-a054-4f06-977c-44e4cf0396bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1203 microversion: 2.1 time: 0.266260 Oct 27 19:22:02.407955 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3023/6190] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:02 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1203 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:02.419913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d789ab85-dba1-4ecf-80cd-29a93a920b3c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:02.420673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d789ab85-dba1-4ecf-80cd-29a93a920b3c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:02.428079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d789ab85-dba1-4ecf-80cd-29a93a920b3c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:02.428596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d789ab85-dba1-4ecf-80cd-29a93a920b3c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:02.429054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d789ab85-dba1-4ecf-80cd-29a93a920b3c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:02.429806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d789ab85-dba1-4ecf-80cd-29a93a920b3c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:02.430278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d789ab85-dba1-4ecf-80cd-29a93a920b3c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:02.430743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d789ab85-dba1-4ecf-80cd-29a93a920b3c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:02.435378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:02.638289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d789ab85-dba1-4ecf-80cd-29a93a920b3c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:02.652255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b983b201-2694-4dec-8d04-5ef185789ce4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:02.666580 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b983b201-2694-4dec-8d04-5ef185789ce4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1709 microversion: 2.1 time: 0.649221 Oct 27 19:22:02.668223 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d789ab85-dba1-4ecf-80cd-29a93a920b3c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1391 microversion: 2.1 time: 0.259201 Oct 27 19:22:02.669528 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3024/6191] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:02 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1391 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:02.686717 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3168/6192] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:02 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1709 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:02.944432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-849538702", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "3f5385dc-5c9d-4149-b5d9-173147d42c59"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:03.437432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6c5d3430-7018-4677-a176-cbaebab7fcdf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:03.438068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6c5d3430-7018-4677-a176-cbaebab7fcdf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:03.454999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c5d3430-7018-4677-a176-cbaebab7fcdf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:03.455607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c5d3430-7018-4677-a176-cbaebab7fcdf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:03.456676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c5d3430-7018-4677-a176-cbaebab7fcdf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:03.457638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c5d3430-7018-4677-a176-cbaebab7fcdf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:03.460326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c5d3430-7018-4677-a176-cbaebab7fcdf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:03.460816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c5d3430-7018-4677-a176-cbaebab7fcdf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:04.377188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6c5d3430-7018-4677-a176-cbaebab7fcdf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:04.387202 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6c5d3430-7018-4677-a176-cbaebab7fcdf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1203 microversion: 2.1 time: 0.958899 Oct 27 19:22:04.399027 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3169/6193] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:03 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1203 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:04.405439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cc147afa-2447-4c25-83d1-5a9cf317a8bf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:04.406073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cc147afa-2447-4c25-83d1-5a9cf317a8bf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:04.418835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc147afa-2447-4c25-83d1-5a9cf317a8bf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:04.419341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc147afa-2447-4c25-83d1-5a9cf317a8bf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:04.419830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc147afa-2447-4c25-83d1-5a9cf317a8bf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:04.420502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc147afa-2447-4c25-83d1-5a9cf317a8bf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:04.420967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc147afa-2447-4c25-83d1-5a9cf317a8bf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:04.421401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc147afa-2447-4c25-83d1-5a9cf317a8bf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:04.961589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cc147afa-2447-4c25-83d1-5a9cf317a8bf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:04.977646 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cc147afa-2447-4c25-83d1-5a9cf317a8bf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1391 microversion: 2.1 time: 0.577080 Oct 27 19:22:04.978789 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3170/6194] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:04 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1391 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:04.986136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e83bd41c-44f3-4a09-b116-94ddb9e83d0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:04.987052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e83bd41c-44f3-4a09-b116-94ddb9e83d0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:04.998418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e83bd41c-44f3-4a09-b116-94ddb9e83d0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:04.999281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e83bd41c-44f3-4a09-b116-94ddb9e83d0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:05.000580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e83bd41c-44f3-4a09-b116-94ddb9e83d0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:05.001468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e83bd41c-44f3-4a09-b116-94ddb9e83d0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:05.002109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e83bd41c-44f3-4a09-b116-94ddb9e83d0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:05.002745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e83bd41c-44f3-4a09-b116-94ddb9e83d0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:05.486742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e83bd41c-44f3-4a09-b116-94ddb9e83d0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:05.504200 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e83bd41c-44f3-4a09-b116-94ddb9e83d0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1709 microversion: 2.1 time: 0.522140 Oct 27 19:22:05.527031 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3171/6195] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:04 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1709 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:05.543513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-49bd2fc0-4079-4131-9aea-6a0a8c8d3360 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:05.546278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:05.548032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-49bd2fc0-4079-4131-9aea-6a0a8c8d3360 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:05.573191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49bd2fc0-4079-4131-9aea-6a0a8c8d3360 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:05.574989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49bd2fc0-4079-4131-9aea-6a0a8c8d3360 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:05.577825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49bd2fc0-4079-4131-9aea-6a0a8c8d3360 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:05.579808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49bd2fc0-4079-4131-9aea-6a0a8c8d3360 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:05.580621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49bd2fc0-4079-4131-9aea-6a0a8c8d3360 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:05.583168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-49bd2fc0-4079-4131-9aea-6a0a8c8d3360 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:05.901374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=16 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:06.055330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-49bd2fc0-4079-4131-9aea-6a0a8c8d3360 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:06.067352 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-49bd2fc0-4079-4131-9aea-6a0a8c8d3360 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1203 microversion: 2.1 time: 0.531840 Oct 27 19:22:06.067957 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3172/6196] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:05 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1203 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:06.082854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6c4a04ee-1697-448b-9bfa-fffdd9527ae7 req-4957b989-887e-477f-aea0-991fbceafdf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41df1a5-196c-454a-b18d-3229ee0b41ef", "tag": "5a8f0d22-cfd5-44d4-8a29-8256b2e1df22"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:06.103680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6c4a04ee-1697-448b-9bfa-fffdd9527ae7 req-4957b989-887e-477f-aea0-991fbceafdf1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:06.106964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6c4a04ee-1697-448b-9bfa-fffdd9527ae7 req-4957b989-887e-477f-aea0-991fbceafdf1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:06.107752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6c4a04ee-1697-448b-9bfa-fffdd9527ae7 req-4957b989-887e-477f-aea0-991fbceafdf1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:06.126326 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6c4a04ee-1697-448b-9bfa-fffdd9527ae7 req-4957b989-887e-477f-aea0-991fbceafdf1 service nova] Creating event network-changed:5a8f0d22-cfd5-44d4-8a29-8256b2e1df22 for instance f41df1a5-196c-454a-b18d-3229ee0b41ef on n-h2-860687-3 Oct 27 19:22:06.144193 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6c4a04ee-1697-448b-9bfa-fffdd9527ae7 req-4957b989-887e-477f-aea0-991fbceafdf1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074645 Oct 27 19:22:06.145044 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3173/6197] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:22:06.162133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0137cd55-f591-4803-97d4-b5207a1601e3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:06.163251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0137cd55-f591-4803-97d4-b5207a1601e3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:06.178869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0137cd55-f591-4803-97d4-b5207a1601e3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:06.179632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0137cd55-f591-4803-97d4-b5207a1601e3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:06.180626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0137cd55-f591-4803-97d4-b5207a1601e3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:06.181548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0137cd55-f591-4803-97d4-b5207a1601e3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:06.182186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0137cd55-f591-4803-97d4-b5207a1601e3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:06.182816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0137cd55-f591-4803-97d4-b5207a1601e3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:06.477683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0137cd55-f591-4803-97d4-b5207a1601e3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:06.494130 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0137cd55-f591-4803-97d4-b5207a1601e3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1391 microversion: 2.1 time: 0.345948 Oct 27 19:22:06.495142 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3174/6198] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:06 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1391 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:06.533691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-742ee4d5-88fa-4fd4-9bac-06bdd296d3ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:06.534801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-742ee4d5-88fa-4fd4-9bac-06bdd296d3ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:06.541944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-742ee4d5-88fa-4fd4-9bac-06bdd296d3ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:06.542924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-742ee4d5-88fa-4fd4-9bac-06bdd296d3ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:06.543561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-742ee4d5-88fa-4fd4-9bac-06bdd296d3ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:06.544477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-742ee4d5-88fa-4fd4-9bac-06bdd296d3ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:06.545106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-742ee4d5-88fa-4fd4-9bac-06bdd296d3ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:06.545697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-742ee4d5-88fa-4fd4-9bac-06bdd296d3ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:06.792580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-742ee4d5-88fa-4fd4-9bac-06bdd296d3ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:06.803066 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-742ee4d5-88fa-4fd4-9bac-06bdd296d3ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1713 microversion: 2.1 time: 0.273757 Oct 27 19:22:06.804612 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3175/6199] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:06 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1713 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:07.096910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-72eb050e-584a-4294-a525-867efafe1a3e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:07.098681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-72eb050e-584a-4294-a525-867efafe1a3e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:07.110812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72eb050e-584a-4294-a525-867efafe1a3e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:07.112242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72eb050e-584a-4294-a525-867efafe1a3e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:07.113618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72eb050e-584a-4294-a525-867efafe1a3e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:07.114876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72eb050e-584a-4294-a525-867efafe1a3e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:07.115519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72eb050e-584a-4294-a525-867efafe1a3e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:07.115969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72eb050e-584a-4294-a525-867efafe1a3e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:07.265900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-72eb050e-584a-4294-a525-867efafe1a3e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:07.277211 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-72eb050e-584a-4294-a525-867efafe1a3e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1203 microversion: 2.1 time: 0.187323 Oct 27 19:22:07.277831 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3176/6200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:07 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1203 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:07.521611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4e156cd8-2792-4a06-bfca-50aea5264537 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:07.522260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4e156cd8-2792-4a06-bfca-50aea5264537 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:07.545911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e156cd8-2792-4a06-bfca-50aea5264537 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:07.546830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e156cd8-2792-4a06-bfca-50aea5264537 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:07.548142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e156cd8-2792-4a06-bfca-50aea5264537 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:07.549538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e156cd8-2792-4a06-bfca-50aea5264537 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:07.553669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e156cd8-2792-4a06-bfca-50aea5264537 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:07.554573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e156cd8-2792-4a06-bfca-50aea5264537 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:07.758424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4e156cd8-2792-4a06-bfca-50aea5264537 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:07.767079 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4e156cd8-2792-4a06-bfca-50aea5264537 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1391 microversion: 2.1 time: 0.253058 Oct 27 19:22:07.770949 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3177/6201] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:07 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1391 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:08.302086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1e690fab-94e1-4f3f-aa48-8ce7cca9e16c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:08.303456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1e690fab-94e1-4f3f-aa48-8ce7cca9e16c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:08.310934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e690fab-94e1-4f3f-aa48-8ce7cca9e16c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:08.311441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e690fab-94e1-4f3f-aa48-8ce7cca9e16c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:08.311891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e690fab-94e1-4f3f-aa48-8ce7cca9e16c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:08.312612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e690fab-94e1-4f3f-aa48-8ce7cca9e16c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:08.313080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e690fab-94e1-4f3f-aa48-8ce7cca9e16c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:08.313519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e690fab-94e1-4f3f-aa48-8ce7cca9e16c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:08.470297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1e690fab-94e1-4f3f-aa48-8ce7cca9e16c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:08.482666 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1e690fab-94e1-4f3f-aa48-8ce7cca9e16c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1203 microversion: 2.1 time: 0.185048 Oct 27 19:22:08.486437 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3178/6202] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:08 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1203 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:08.791948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a1e2073a-10da-4894-ba5e-4a3d48c05558 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:08.792818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a1e2073a-10da-4894-ba5e-4a3d48c05558 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:08.801248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1e2073a-10da-4894-ba5e-4a3d48c05558 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:08.801971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1e2073a-10da-4894-ba5e-4a3d48c05558 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:08.802611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1e2073a-10da-4894-ba5e-4a3d48c05558 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:08.803487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1e2073a-10da-4894-ba5e-4a3d48c05558 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:08.804103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1e2073a-10da-4894-ba5e-4a3d48c05558 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:08.804720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1e2073a-10da-4894-ba5e-4a3d48c05558 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:09.068749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1e2073a-10da-4894-ba5e-4a3d48c05558 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:09.081878 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a1e2073a-10da-4894-ba5e-4a3d48c05558 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1391 microversion: 2.1 time: 0.293690 Oct 27 19:22:09.083388 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3179/6203] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:08 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:09.265508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] validate_networks() for [('3f5385dc-5c9d-4149-b5d9-173147d42c59', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:22:09.507179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce7ed3a8-96c4-49b8-87fa-c3b33434f9f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:09.508688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ce7ed3a8-96c4-49b8-87fa-c3b33434f9f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:09.521774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce7ed3a8-96c4-49b8-87fa-c3b33434f9f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:09.522306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce7ed3a8-96c4-49b8-87fa-c3b33434f9f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:09.522802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce7ed3a8-96c4-49b8-87fa-c3b33434f9f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:09.523810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce7ed3a8-96c4-49b8-87fa-c3b33434f9f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:09.524293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce7ed3a8-96c4-49b8-87fa-c3b33434f9f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:09.524742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce7ed3a8-96c4-49b8-87fa-c3b33434f9f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:09.740812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ce7ed3a8-96c4-49b8-87fa-c3b33434f9f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:09.749840 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce7ed3a8-96c4-49b8-87fa-c3b33434f9f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1203 microversion: 2.1 time: 0.246621 Oct 27 19:22:09.758529 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3180/6204] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:09 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1203 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:22:09.811114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:22:09.811882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:22:09.812456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:22:09.812851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:22:09.813335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:22:09.826879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:09.827383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:09.827836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:09.828652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:09.829325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:09.830548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:09.871788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Getting quotas for project 8d005b1c681c4c01b3e893500a43e7c6. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:22:09.880002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Getting quotas for user d255b0c693a24849ad2a7b3bc2bcd7f0 and project 8d005b1c681c4c01b3e893500a43e7c6. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:22:09.894623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:22:09.898726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:22:09.963071 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d3f42e9-0443-4504-953a-eea5c3e9a48b tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.134959 Oct 27 19:22:09.973556 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3025/6205] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:22:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 7147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:22:09.977774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-08b0dcbf-dd4e-4902-99e3-b63873d0d141 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:09.978610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-08b0dcbf-dd4e-4902-99e3-b63873d0d141 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:10.085747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-08b0dcbf-dd4e-4902-99e3-b63873d0d141 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd255b0c693a24849ad2a7b3bc2bcd7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d005b1c681c4c01b3e893500a43e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:10.094650 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-08b0dcbf-dd4e-4902-99e3-b63873d0d141 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 200 len: 1224 microversion: 2.1 time: 0.121650 Oct 27 19:22:10.100678 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3181/6206] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:09 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 1224 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:10.116725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bce2e744-646e-47e9-a047-3bf2a2413af2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:10.117357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bce2e744-646e-47e9-a047-3bf2a2413af2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:10.125765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bce2e744-646e-47e9-a047-3bf2a2413af2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:10.127030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bce2e744-646e-47e9-a047-3bf2a2413af2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:10.128347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bce2e744-646e-47e9-a047-3bf2a2413af2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:10.129386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bce2e744-646e-47e9-a047-3bf2a2413af2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:10.130003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bce2e744-646e-47e9-a047-3bf2a2413af2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:10.130867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bce2e744-646e-47e9-a047-3bf2a2413af2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:10.328225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bce2e744-646e-47e9-a047-3bf2a2413af2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:10.344916 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bce2e744-646e-47e9-a047-3bf2a2413af2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1391 microversion: 2.1 time: 0.232623 Oct 27 19:22:10.347117 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3026/6207] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:10 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1391 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:10.775326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-81526fc2-f911-469c-9bf6-99b3c24f5e03 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:10.776543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-81526fc2-f911-469c-9bf6-99b3c24f5e03 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:10.795248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81526fc2-f911-469c-9bf6-99b3c24f5e03 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:10.796063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81526fc2-f911-469c-9bf6-99b3c24f5e03 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:10.796528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81526fc2-f911-469c-9bf6-99b3c24f5e03 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:10.797298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81526fc2-f911-469c-9bf6-99b3c24f5e03 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:10.802055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81526fc2-f911-469c-9bf6-99b3c24f5e03 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:10.802635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81526fc2-f911-469c-9bf6-99b3c24f5e03 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:11.007802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-81526fc2-f911-469c-9bf6-99b3c24f5e03 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:11.016723 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-81526fc2-f911-469c-9bf6-99b3c24f5e03 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1203 microversion: 2.1 time: 0.246548 Oct 27 19:22:11.018137 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3182/6208] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:10 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1203 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:11.128261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa461e43-8db9-4641-93fa-8bce13c94f1c tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:11.129215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa461e43-8db9-4641-93fa-8bce13c94f1c tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:11.132963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:11.149244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa461e43-8db9-4641-93fa-8bce13c94f1c tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:11.150196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa461e43-8db9-4641-93fa-8bce13c94f1c tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:11.150898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa461e43-8db9-4641-93fa-8bce13c94f1c tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:11.151853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa461e43-8db9-4641-93fa-8bce13c94f1c tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:11.153155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa461e43-8db9-4641-93fa-8bce13c94f1c tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:11.153838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa461e43-8db9-4641-93fa-8bce13c94f1c tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:11.270975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fa461e43-8db9-4641-93fa-8bce13c94f1c tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd255b0c693a24849ad2a7b3bc2bcd7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d005b1c681c4c01b3e893500a43e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:11.311393 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fa461e43-8db9-4641-93fa-8bce13c94f1c tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 200 len: 1276 microversion: 2.1 time: 0.179600 Oct 27 19:22:11.313434 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3027/6209] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:11 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:11.371502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a6f9d81a-f22c-47f0-8e46-0157eaefcba5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:11.376482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a6f9d81a-f22c-47f0-8e46-0157eaefcba5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:11.393635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6f9d81a-f22c-47f0-8e46-0157eaefcba5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:11.395863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6f9d81a-f22c-47f0-8e46-0157eaefcba5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:11.396440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6f9d81a-f22c-47f0-8e46-0157eaefcba5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:11.397516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6f9d81a-f22c-47f0-8e46-0157eaefcba5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:11.399147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6f9d81a-f22c-47f0-8e46-0157eaefcba5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:11.401127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a6f9d81a-f22c-47f0-8e46-0157eaefcba5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:11.579952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a6f9d81a-f22c-47f0-8e46-0157eaefcba5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:11.589081 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a6f9d81a-f22c-47f0-8e46-0157eaefcba5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1391 microversion: 2.1 time: 0.223344 Oct 27 19:22:11.589672 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3183/6210] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:11 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1391 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:22:12.044394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-552dae27-8b9c-46b7-938c-d6a73bf6304b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:12.045030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-552dae27-8b9c-46b7-938c-d6a73bf6304b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:12.062460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-552dae27-8b9c-46b7-938c-d6a73bf6304b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:12.063872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-552dae27-8b9c-46b7-938c-d6a73bf6304b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:12.064610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-552dae27-8b9c-46b7-938c-d6a73bf6304b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:12.065414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-552dae27-8b9c-46b7-938c-d6a73bf6304b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:12.071378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-552dae27-8b9c-46b7-938c-d6a73bf6304b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:12.072468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-552dae27-8b9c-46b7-938c-d6a73bf6304b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:12.341228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2c4a40e6-5d84-4b85-82ca-9a9feb47e7fa tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:12.342661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2c4a40e6-5d84-4b85-82ca-9a9feb47e7fa tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:12.359846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c4a40e6-5d84-4b85-82ca-9a9feb47e7fa tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:12.360730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c4a40e6-5d84-4b85-82ca-9a9feb47e7fa tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:12.361416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c4a40e6-5d84-4b85-82ca-9a9feb47e7fa tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:12.369682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c4a40e6-5d84-4b85-82ca-9a9feb47e7fa tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:12.370496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c4a40e6-5d84-4b85-82ca-9a9feb47e7fa tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:12.373665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c4a40e6-5d84-4b85-82ca-9a9feb47e7fa tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:12.501300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-552dae27-8b9c-46b7-938c-d6a73bf6304b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:12.521980 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-552dae27-8b9c-46b7-938c-d6a73bf6304b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1203 microversion: 2.1 time: 0.481630 Oct 27 19:22:12.526825 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3028/6211] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:12 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1203 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:12.617604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2c4a40e6-5d84-4b85-82ca-9a9feb47e7fa tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd255b0c693a24849ad2a7b3bc2bcd7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d005b1c681c4c01b3e893500a43e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:12.622213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-05ff44b2-1ce0-4481-96f0-bcbcac65c2ea tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:12.623457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-05ff44b2-1ce0-4481-96f0-bcbcac65c2ea tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:12.637481 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2c4a40e6-5d84-4b85-82ca-9a9feb47e7fa tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 200 len: 1282 microversion: 2.1 time: 0.299917 Oct 27 19:22:12.651188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05ff44b2-1ce0-4481-96f0-bcbcac65c2ea tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:12.651441 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3184/6212] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:12 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 1282 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:22:12.651539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05ff44b2-1ce0-4481-96f0-bcbcac65c2ea tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:12.651539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05ff44b2-1ce0-4481-96f0-bcbcac65c2ea tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:12.651539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05ff44b2-1ce0-4481-96f0-bcbcac65c2ea tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:12.651539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05ff44b2-1ce0-4481-96f0-bcbcac65c2ea tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:12.651539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05ff44b2-1ce0-4481-96f0-bcbcac65c2ea tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:12.695663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-caf26806-d002-42e0-b22b-7cb717023dfb req-aa6216ba-d3ac-4664-b77a-d3c56458e119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41df1a5-196c-454a-b18d-3229ee0b41ef", "name": "network-vif-plugged", "status": "completed", "tag": "5a8f0d22-cfd5-44d4-8a29-8256b2e1df22"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:12.727703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-caf26806-d002-42e0-b22b-7cb717023dfb req-aa6216ba-d3ac-4664-b77a-d3c56458e119 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:12.728220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-caf26806-d002-42e0-b22b-7cb717023dfb req-aa6216ba-d3ac-4664-b77a-d3c56458e119 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:12.728678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-caf26806-d002-42e0-b22b-7cb717023dfb req-aa6216ba-d3ac-4664-b77a-d3c56458e119 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:12.763459 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-caf26806-d002-42e0-b22b-7cb717023dfb req-aa6216ba-d3ac-4664-b77a-d3c56458e119 service nova] Creating event network-vif-plugged:5a8f0d22-cfd5-44d4-8a29-8256b2e1df22 for instance f41df1a5-196c-454a-b18d-3229ee0b41ef on n-h2-860687-3 Oct 27 19:22:12.781298 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-caf26806-d002-42e0-b22b-7cb717023dfb req-aa6216ba-d3ac-4664-b77a-d3c56458e119 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089688 Oct 27 19:22:12.784132 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3185/6213] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:22:12.999168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-05ff44b2-1ce0-4481-96f0-bcbcac65c2ea tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:13.010743 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-05ff44b2-1ce0-4481-96f0-bcbcac65c2ea tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1391 microversion: 2.1 time: 0.402194 Oct 27 19:22:13.012213 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3029/6214] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:12 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1391 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:22:13.553164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13de9e23-e7ac-41bd-9afc-4084f0c5e02b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:13.554483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-13de9e23-e7ac-41bd-9afc-4084f0c5e02b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:13.558276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=70 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:13.584536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13de9e23-e7ac-41bd-9afc-4084f0c5e02b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:13.585097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13de9e23-e7ac-41bd-9afc-4084f0c5e02b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:13.585566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13de9e23-e7ac-41bd-9afc-4084f0c5e02b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:13.599179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13de9e23-e7ac-41bd-9afc-4084f0c5e02b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:13.599742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13de9e23-e7ac-41bd-9afc-4084f0c5e02b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:13.600215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13de9e23-e7ac-41bd-9afc-4084f0c5e02b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:13.670254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dcac9b92-d0a8-4058-8cfb-e4607409c8e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:13.670869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dcac9b92-d0a8-4058-8cfb-e4607409c8e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:13.691299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcac9b92-d0a8-4058-8cfb-e4607409c8e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:13.694039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcac9b92-d0a8-4058-8cfb-e4607409c8e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:13.696005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcac9b92-d0a8-4058-8cfb-e4607409c8e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:13.698852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcac9b92-d0a8-4058-8cfb-e4607409c8e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:13.702055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcac9b92-d0a8-4058-8cfb-e4607409c8e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:13.702571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcac9b92-d0a8-4058-8cfb-e4607409c8e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:13.960124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dcac9b92-d0a8-4058-8cfb-e4607409c8e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd255b0c693a24849ad2a7b3bc2bcd7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d005b1c681c4c01b3e893500a43e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:13.973677 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dcac9b92-d0a8-4058-8cfb-e4607409c8e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 200 len: 1324 microversion: 2.1 time: 0.309848 Oct 27 19:22:13.976273 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3030/6215] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:13 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 1324 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:14.038667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b9a40a12-c9ed-4cd9-832d-1e7682ee1ed0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:14.040113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b9a40a12-c9ed-4cd9-832d-1e7682ee1ed0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:14.053776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9a40a12-c9ed-4cd9-832d-1e7682ee1ed0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:14.054816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9a40a12-c9ed-4cd9-832d-1e7682ee1ed0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:14.055454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9a40a12-c9ed-4cd9-832d-1e7682ee1ed0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:14.056422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9a40a12-c9ed-4cd9-832d-1e7682ee1ed0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:14.057046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9a40a12-c9ed-4cd9-832d-1e7682ee1ed0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:14.058071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9a40a12-c9ed-4cd9-832d-1e7682ee1ed0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:14.225164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-13de9e23-e7ac-41bd-9afc-4084f0c5e02b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:14.230532 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13de9e23-e7ac-41bd-9afc-4084f0c5e02b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1203 microversion: 2.1 time: 0.681418 Oct 27 19:22:14.236142 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3186/6216] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:13 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1203 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:14.347611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b9a40a12-c9ed-4cd9-832d-1e7682ee1ed0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:14.361473 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b9a40a12-c9ed-4cd9-832d-1e7682ee1ed0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1391 microversion: 2.1 time: 0.328834 Oct 27 19:22:14.366765 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3031/6217] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:14 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1391 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:14.848436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6fd9baa7-136b-40d0-b823-e96b64b315ab req-ef424442-d502-4423-9ce4-1576e81c4b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5103dc-c8a2-4a38-b9e6-d632bb6d597e", "name": "network-vif-plugged", "status": "completed", "tag": "33726ecf-3dc8-44d6-85e7-58726bb698f2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:14.872193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6fd9baa7-136b-40d0-b823-e96b64b315ab req-ef424442-d502-4423-9ce4-1576e81c4b42 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:14.872799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6fd9baa7-136b-40d0-b823-e96b64b315ab req-ef424442-d502-4423-9ce4-1576e81c4b42 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:14.873137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6fd9baa7-136b-40d0-b823-e96b64b315ab req-ef424442-d502-4423-9ce4-1576e81c4b42 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:14.889813 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6fd9baa7-136b-40d0-b823-e96b64b315ab req-ef424442-d502-4423-9ce4-1576e81c4b42 service nova] Creating event network-vif-plugged:33726ecf-3dc8-44d6-85e7-58726bb698f2 for instance 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e on n-h1-860687-3 Oct 27 19:22:14.897044 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6fd9baa7-136b-40d0-b823-e96b64b315ab req-ef424442-d502-4423-9ce4-1576e81c4b42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053025 Oct 27 19:22:14.898245 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3187/6218] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:22:14.999971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8d8a9e47-c5c1-464f-859b-521a0dabdf77 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:15.001564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8d8a9e47-c5c1-464f-859b-521a0dabdf77 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:15.015962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d8a9e47-c5c1-464f-859b-521a0dabdf77 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:15.016544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d8a9e47-c5c1-464f-859b-521a0dabdf77 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:15.017043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d8a9e47-c5c1-464f-859b-521a0dabdf77 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:15.017805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d8a9e47-c5c1-464f-859b-521a0dabdf77 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:15.018281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d8a9e47-c5c1-464f-859b-521a0dabdf77 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:15.021179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d8a9e47-c5c1-464f-859b-521a0dabdf77 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:15.205828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-161bbd65-fec9-4464-ace7-3f054680e188 req-f6ced31f-fb33-428b-8789-db78ebc1e7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e31182f0-fd88-4018-b5cc-42763c094a39", "tag": "3983bcb1-077f-4a91-9251-db0e42c25438"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:15.225855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-161bbd65-fec9-4464-ace7-3f054680e188 req-f6ced31f-fb33-428b-8789-db78ebc1e7ff service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:15.230647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-161bbd65-fec9-4464-ace7-3f054680e188 req-f6ced31f-fb33-428b-8789-db78ebc1e7ff service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:15.232493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-161bbd65-fec9-4464-ace7-3f054680e188 req-f6ced31f-fb33-428b-8789-db78ebc1e7ff service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:15.241371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:15.265595 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-161bbd65-fec9-4464-ace7-3f054680e188 req-f6ced31f-fb33-428b-8789-db78ebc1e7ff service nova] Creating event network-changed:3983bcb1-077f-4a91-9251-db0e42c25438 for instance e31182f0-fd88-4018-b5cc-42763c094a39 on n-h1-860687-3 Oct 27 19:22:15.277524 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-161bbd65-fec9-4464-ace7-3f054680e188 req-f6ced31f-fb33-428b-8789-db78ebc1e7ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078201 Oct 27 19:22:15.281024 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3188/6219] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:22:15.301584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-44073405-ed73-40b4-b75a-36cacb7f8d61 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:15.304215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-44073405-ed73-40b4-b75a-36cacb7f8d61 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:15.328421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44073405-ed73-40b4-b75a-36cacb7f8d61 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:15.328972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44073405-ed73-40b4-b75a-36cacb7f8d61 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:15.332015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44073405-ed73-40b4-b75a-36cacb7f8d61 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:15.332751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44073405-ed73-40b4-b75a-36cacb7f8d61 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:15.334346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44073405-ed73-40b4-b75a-36cacb7f8d61 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:15.335284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44073405-ed73-40b4-b75a-36cacb7f8d61 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:15.365720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8d8a9e47-c5c1-464f-859b-521a0dabdf77 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd255b0c693a24849ad2a7b3bc2bcd7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d005b1c681c4c01b3e893500a43e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:15.377176 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8d8a9e47-c5c1-464f-859b-521a0dabdf77 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 200 len: 1324 microversion: 2.1 time: 0.381663 Oct 27 19:22:15.382426 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3032/6220] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:14 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 1324 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:15.398354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb12c207-a706-45b7-be00-24a7ed95d2eb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:15.401022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb12c207-a706-45b7-be00-24a7ed95d2eb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:15.420870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb12c207-a706-45b7-be00-24a7ed95d2eb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:15.421879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb12c207-a706-45b7-be00-24a7ed95d2eb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:15.422340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb12c207-a706-45b7-be00-24a7ed95d2eb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:15.423340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb12c207-a706-45b7-be00-24a7ed95d2eb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:15.423877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb12c207-a706-45b7-be00-24a7ed95d2eb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:15.424323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb12c207-a706-45b7-be00-24a7ed95d2eb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:15.661597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-eb12c207-a706-45b7-be00-24a7ed95d2eb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:15.672565 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb12c207-a706-45b7-be00-24a7ed95d2eb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1564 microversion: 2.1 time: 0.284241 Oct 27 19:22:15.673423 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3033/6221] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:15 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1564 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:15.703884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2c4f19fc-83d3-45e9-9709-58694bae2f09 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:15.705778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2c4f19fc-83d3-45e9-9709-58694bae2f09 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:15.718306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c4f19fc-83d3-45e9-9709-58694bae2f09 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:15.719448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c4f19fc-83d3-45e9-9709-58694bae2f09 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:15.720190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c4f19fc-83d3-45e9-9709-58694bae2f09 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:15.723226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c4f19fc-83d3-45e9-9709-58694bae2f09 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:15.724379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c4f19fc-83d3-45e9-9709-58694bae2f09 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:15.725338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c4f19fc-83d3-45e9-9709-58694bae2f09 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:15.741784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-44073405-ed73-40b4-b75a-36cacb7f8d61 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:15.759402 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-44073405-ed73-40b4-b75a-36cacb7f8d61 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1203 microversion: 2.1 time: 0.475016 Oct 27 19:22:15.761467 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3189/6222] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:15 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1203 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:15.961776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2c4f19fc-83d3-45e9-9709-58694bae2f09 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:15.978789 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2c4f19fc-83d3-45e9-9709-58694bae2f09 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1564 microversion: 2.1 time: 0.278698 Oct 27 19:22:15.982451 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3034/6223] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:15 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1564 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:16.401193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-83f32779-b072-42a6-81ca-ee73769775e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:16.401974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-83f32779-b072-42a6-81ca-ee73769775e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:16.415720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83f32779-b072-42a6-81ca-ee73769775e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:16.416200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83f32779-b072-42a6-81ca-ee73769775e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:16.416676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83f32779-b072-42a6-81ca-ee73769775e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:16.420472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83f32779-b072-42a6-81ca-ee73769775e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:16.421419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83f32779-b072-42a6-81ca-ee73769775e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:16.421875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83f32779-b072-42a6-81ca-ee73769775e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:16.796037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d5e83b7-cc1b-4b71-a3d7-68122c06c0e5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:16.796746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0d5e83b7-cc1b-4b71-a3d7-68122c06c0e5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:16.811360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d5e83b7-cc1b-4b71-a3d7-68122c06c0e5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:16.813217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d5e83b7-cc1b-4b71-a3d7-68122c06c0e5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:16.814694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d5e83b7-cc1b-4b71-a3d7-68122c06c0e5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:16.817309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d5e83b7-cc1b-4b71-a3d7-68122c06c0e5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:16.819748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d5e83b7-cc1b-4b71-a3d7-68122c06c0e5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:16.820213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d5e83b7-cc1b-4b71-a3d7-68122c06c0e5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:17.081732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0d5e83b7-cc1b-4b71-a3d7-68122c06c0e5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:17.094675 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d5e83b7-cc1b-4b71-a3d7-68122c06c0e5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1389 microversion: 2.1 time: 0.303190 Oct 27 19:22:17.097872 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3035/6224] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:16 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1389 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:17.123460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-95806e99-5a0a-4594-8ef5-ecd818662735 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:17.124308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-95806e99-5a0a-4594-8ef5-ecd818662735 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:17.135781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95806e99-5a0a-4594-8ef5-ecd818662735 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:17.136379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95806e99-5a0a-4594-8ef5-ecd818662735 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:17.136852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95806e99-5a0a-4594-8ef5-ecd818662735 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:17.140056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95806e99-5a0a-4594-8ef5-ecd818662735 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:17.140788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95806e99-5a0a-4594-8ef5-ecd818662735 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:17.142966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95806e99-5a0a-4594-8ef5-ecd818662735 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:17.418669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-83f32779-b072-42a6-81ca-ee73769775e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd255b0c693a24849ad2a7b3bc2bcd7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d005b1c681c4c01b3e893500a43e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:17.432845 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-83f32779-b072-42a6-81ca-ee73769775e6 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 200 len: 1324 microversion: 2.1 time: 1.035478 Oct 27 19:22:17.433786 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3190/6225] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:16 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 1324 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:18.051844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-95806e99-5a0a-4594-8ef5-ecd818662735 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:18.061237 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-95806e99-5a0a-4594-8ef5-ecd818662735 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1389 microversion: 2.1 time: 0.941807 Oct 27 19:22:18.067110 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3036/6226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:17 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1389 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:18.088755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3628df40-be82-4747-9edf-1fd1be635355 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:18.089385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3628df40-be82-4747-9edf-1fd1be635355 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:18.099199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3628df40-be82-4747-9edf-1fd1be635355 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:18.099561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3628df40-be82-4747-9edf-1fd1be635355 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:18.100019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3628df40-be82-4747-9edf-1fd1be635355 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:18.100756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3628df40-be82-4747-9edf-1fd1be635355 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:18.101228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3628df40-be82-4747-9edf-1fd1be635355 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:18.101669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3628df40-be82-4747-9edf-1fd1be635355 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:18.301859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3628df40-be82-4747-9edf-1fd1be635355 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:18.311408 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3628df40-be82-4747-9edf-1fd1be635355 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1389 microversion: 2.1 time: 0.227289 Oct 27 19:22:18.312375 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3191/6227] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:18 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1389 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:18.337095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-31d59727-c7d8-4678-8fd3-17668ebc1614 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:18.337603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-31d59727-c7d8-4678-8fd3-17668ebc1614 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:18.345551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d59727-c7d8-4678-8fd3-17668ebc1614 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:18.346325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d59727-c7d8-4678-8fd3-17668ebc1614 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:18.347540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d59727-c7d8-4678-8fd3-17668ebc1614 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:18.348466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d59727-c7d8-4678-8fd3-17668ebc1614 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:18.349157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d59727-c7d8-4678-8fd3-17668ebc1614 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:18.349598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31d59727-c7d8-4678-8fd3-17668ebc1614 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:18.391425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-31d59727-c7d8-4678-8fd3-17668ebc1614 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:22:18.462297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-90d2c10e-0239-4ebd-94be-6b83c80fa6dd tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:18.462998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-90d2c10e-0239-4ebd-94be-6b83c80fa6dd tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:18.485859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90d2c10e-0239-4ebd-94be-6b83c80fa6dd tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:18.486726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90d2c10e-0239-4ebd-94be-6b83c80fa6dd tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:18.488876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90d2c10e-0239-4ebd-94be-6b83c80fa6dd tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:18.491195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90d2c10e-0239-4ebd-94be-6b83c80fa6dd tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:18.491900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90d2c10e-0239-4ebd-94be-6b83c80fa6dd tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:18.494069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90d2c10e-0239-4ebd-94be-6b83c80fa6dd tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:18.534724 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-31d59727-c7d8-4678-8fd3-17668ebc1614 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 204 len: 0 microversion: 2.1 time: 0.201345 Oct 27 19:22:18.535812 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3037/6228] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:22:18 2022] DELETE /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:22:18.544413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-78d3d59d-7dbf-441a-acd8-1093b8d9fb4b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:18.545448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-78d3d59d-7dbf-441a-acd8-1093b8d9fb4b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:18.574037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78d3d59d-7dbf-441a-acd8-1093b8d9fb4b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:18.574665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78d3d59d-7dbf-441a-acd8-1093b8d9fb4b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:18.577521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78d3d59d-7dbf-441a-acd8-1093b8d9fb4b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:18.583215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78d3d59d-7dbf-441a-acd8-1093b8d9fb4b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:18.586208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78d3d59d-7dbf-441a-acd8-1093b8d9fb4b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:18.586970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78d3d59d-7dbf-441a-acd8-1093b8d9fb4b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:18.788157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-90d2c10e-0239-4ebd-94be-6b83c80fa6dd tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd255b0c693a24849ad2a7b3bc2bcd7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d005b1c681c4c01b3e893500a43e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:18.801258 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-90d2c10e-0239-4ebd-94be-6b83c80fa6dd tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 200 len: 1324 microversion: 2.1 time: 0.345472 Oct 27 19:22:18.817466 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3192/6229] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:18 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 1324 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:18.976480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-78d3d59d-7dbf-441a-acd8-1093b8d9fb4b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:18.990507 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-78d3d59d-7dbf-441a-acd8-1093b8d9fb4b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1395 microversion: 2.1 time: 0.449760 Oct 27 19:22:19.007720 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3038/6230] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:18 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1395 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:22:19.373942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0630a0f6-4192-44f3-8c2a-056e14e2936e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:19.380378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0630a0f6-4192-44f3-8c2a-056e14e2936e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:19.400211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0630a0f6-4192-44f3-8c2a-056e14e2936e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:19.400821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0630a0f6-4192-44f3-8c2a-056e14e2936e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:19.401365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0630a0f6-4192-44f3-8c2a-056e14e2936e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:19.402558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0630a0f6-4192-44f3-8c2a-056e14e2936e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:19.404294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0630a0f6-4192-44f3-8c2a-056e14e2936e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:19.405256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0630a0f6-4192-44f3-8c2a-056e14e2936e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:19.591642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0630a0f6-4192-44f3-8c2a-056e14e2936e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:19.610296 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0630a0f6-4192-44f3-8c2a-056e14e2936e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1564 microversion: 2.1 time: 0.240665 Oct 27 19:22:19.611243 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3193/6231] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:19 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1564 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:19.646121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-0a867fae-34f4-4816-b4df-a3f7d307856b req-3d494cd8-e1ed-47f5-8bd7-c024804588e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41df1a5-196c-454a-b18d-3229ee0b41ef", "tag": "5a8f0d22-cfd5-44d4-8a29-8256b2e1df22"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:19.686146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0a867fae-34f4-4816-b4df-a3f7d307856b req-3d494cd8-e1ed-47f5-8bd7-c024804588e5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:19.686693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0a867fae-34f4-4816-b4df-a3f7d307856b req-3d494cd8-e1ed-47f5-8bd7-c024804588e5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:19.687166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0a867fae-34f4-4816-b4df-a3f7d307856b req-3d494cd8-e1ed-47f5-8bd7-c024804588e5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:19.717811 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-0a867fae-34f4-4816-b4df-a3f7d307856b req-3d494cd8-e1ed-47f5-8bd7-c024804588e5 service nova] Creating event network-changed:5a8f0d22-cfd5-44d4-8a29-8256b2e1df22 for instance f41df1a5-196c-454a-b18d-3229ee0b41ef on n-h2-860687-3 Oct 27 19:22:19.732729 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-0a867fae-34f4-4816-b4df-a3f7d307856b req-3d494cd8-e1ed-47f5-8bd7-c024804588e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.354828 Oct 27 19:22:19.736965 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3039/6232] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:22:19.834958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-630ea6a8-7ff7-477b-9e2e-3559d702b6cb tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:19.839261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-630ea6a8-7ff7-477b-9e2e-3559d702b6cb tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:19.855430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-630ea6a8-7ff7-477b-9e2e-3559d702b6cb tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:19.856379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-630ea6a8-7ff7-477b-9e2e-3559d702b6cb tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:19.859620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-630ea6a8-7ff7-477b-9e2e-3559d702b6cb tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:19.863150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-630ea6a8-7ff7-477b-9e2e-3559d702b6cb tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:19.863941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-630ea6a8-7ff7-477b-9e2e-3559d702b6cb tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:19.865157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-630ea6a8-7ff7-477b-9e2e-3559d702b6cb tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:20.016865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb7c51b0-9850-4251-af85-55beb0a0c1f0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:20.017712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fb7c51b0-9850-4251-af85-55beb0a0c1f0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:20.022101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:20.025742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:20.040802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7c51b0-9850-4251-af85-55beb0a0c1f0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:20.043384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7c51b0-9850-4251-af85-55beb0a0c1f0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:20.043932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7c51b0-9850-4251-af85-55beb0a0c1f0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:20.044912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7c51b0-9850-4251-af85-55beb0a0c1f0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:20.050226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7c51b0-9850-4251-af85-55beb0a0c1f0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:20.052749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7c51b0-9850-4251-af85-55beb0a0c1f0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:20.091691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:20.122196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:20.469749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fb7c51b0-9850-4251-af85-55beb0a0c1f0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:20.486097 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fb7c51b0-9850-4251-af85-55beb0a0c1f0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1395 microversion: 2.1 time: 0.473657 Oct 27 19:22:20.490293 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3040/6233] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:20 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1395 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:22:21.046415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-630ea6a8-7ff7-477b-9e2e-3559d702b6cb tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd255b0c693a24849ad2a7b3bc2bcd7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d005b1c681c4c01b3e893500a43e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:21.067997 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-630ea6a8-7ff7-477b-9e2e-3559d702b6cb tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 200 len: 1324 microversion: 2.1 time: 1.235484 Oct 27 19:22:21.069881 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3194/6234] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:19 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 1324 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:22:21.524022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-129bd37b-acae-4b97-912d-cf65b59d39d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:21.527215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-129bd37b-acae-4b97-912d-cf65b59d39d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:21.548015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-129bd37b-acae-4b97-912d-cf65b59d39d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:21.551956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-129bd37b-acae-4b97-912d-cf65b59d39d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:21.553600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-129bd37b-acae-4b97-912d-cf65b59d39d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:21.555704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-129bd37b-acae-4b97-912d-cf65b59d39d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:21.558871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-129bd37b-acae-4b97-912d-cf65b59d39d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:21.559997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-129bd37b-acae-4b97-912d-cf65b59d39d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:21.849138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-129bd37b-acae-4b97-912d-cf65b59d39d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:21.860251 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-129bd37b-acae-4b97-912d-cf65b59d39d5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1395 microversion: 2.1 time: 0.347364 Oct 27 19:22:21.861467 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3041/6235] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:21 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1395 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:22.093841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42e8c66f-096f-4c55-8aab-1900dfdcba3d tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:22.094701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-42e8c66f-096f-4c55-8aab-1900dfdcba3d tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:22.106833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42e8c66f-096f-4c55-8aab-1900dfdcba3d tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:22.107338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42e8c66f-096f-4c55-8aab-1900dfdcba3d tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:22.107788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42e8c66f-096f-4c55-8aab-1900dfdcba3d tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:22.108509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42e8c66f-096f-4c55-8aab-1900dfdcba3d tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:22.110970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42e8c66f-096f-4c55-8aab-1900dfdcba3d tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:22.110970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42e8c66f-096f-4c55-8aab-1900dfdcba3d tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:22.165436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-e9b1de4a-7171-4c9a-8da7-8a6340f74db6 req-fc1d6e88-160f-4da8-833d-7dc45ba3e927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31182f0-fd88-4018-b5cc-42763c094a39", "name": "network-vif-plugged", "status": "completed", "tag": "3983bcb1-077f-4a91-9251-db0e42c25438"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:22.183024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e9b1de4a-7171-4c9a-8da7-8a6340f74db6 req-fc1d6e88-160f-4da8-833d-7dc45ba3e927 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:22.183646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e9b1de4a-7171-4c9a-8da7-8a6340f74db6 req-fc1d6e88-160f-4da8-833d-7dc45ba3e927 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:22.184184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e9b1de4a-7171-4c9a-8da7-8a6340f74db6 req-fc1d6e88-160f-4da8-833d-7dc45ba3e927 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:22.242130 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-e9b1de4a-7171-4c9a-8da7-8a6340f74db6 req-fc1d6e88-160f-4da8-833d-7dc45ba3e927 service nova] Creating event network-vif-plugged:3983bcb1-077f-4a91-9251-db0e42c25438 for instance e31182f0-fd88-4018-b5cc-42763c094a39 on n-h1-860687-3 Oct 27 19:22:22.258157 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-e9b1de4a-7171-4c9a-8da7-8a6340f74db6 req-fc1d6e88-160f-4da8-833d-7dc45ba3e927 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099931 Oct 27 19:22:22.258816 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3042/6236] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:22:22.283456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-6d8e5a95-2d4a-4264-8b4d-dd8135393c88 req-fd4f36b7-18bf-48b1-9a58-a6fa3ce9bc90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5103dc-c8a2-4a38-b9e6-d632bb6d597e", "name": "network-vif-deleted", "tag": "33726ecf-3dc8-44d6-85e7-58726bb698f2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:22.308557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6d8e5a95-2d4a-4264-8b4d-dd8135393c88 req-fd4f36b7-18bf-48b1-9a58-a6fa3ce9bc90 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:22.314333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6d8e5a95-2d4a-4264-8b4d-dd8135393c88 req-fd4f36b7-18bf-48b1-9a58-a6fa3ce9bc90 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:22.315083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6d8e5a95-2d4a-4264-8b4d-dd8135393c88 req-fd4f36b7-18bf-48b1-9a58-a6fa3ce9bc90 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:22.351443 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-6d8e5a95-2d4a-4264-8b4d-dd8135393c88 req-fd4f36b7-18bf-48b1-9a58-a6fa3ce9bc90 service nova] Creating event network-vif-deleted:33726ecf-3dc8-44d6-85e7-58726bb698f2 for instance 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e on n-h1-860687-3 Oct 27 19:22:22.366193 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-6d8e5a95-2d4a-4264-8b4d-dd8135393c88 req-fd4f36b7-18bf-48b1-9a58-a6fa3ce9bc90 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094086 Oct 27 19:22:22.367299 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3043/6237] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:22:22.542358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-42e8c66f-096f-4c55-8aab-1900dfdcba3d tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd255b0c693a24849ad2a7b3bc2bcd7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d005b1c681c4c01b3e893500a43e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:22.559656 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-42e8c66f-096f-4c55-8aab-1900dfdcba3d tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 200 len: 1324 microversion: 2.1 time: 0.469619 Oct 27 19:22:22.577533 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3195/6238] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:22 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 1324 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:22.889346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6072c151-92f7-4817-8635-e0324fd4b000 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:22.890194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6072c151-92f7-4817-8635-e0324fd4b000 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:22.898460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6072c151-92f7-4817-8635-e0324fd4b000 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:22.905533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6072c151-92f7-4817-8635-e0324fd4b000 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:22.906099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6072c151-92f7-4817-8635-e0324fd4b000 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:22.907010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6072c151-92f7-4817-8635-e0324fd4b000 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:22.907595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6072c151-92f7-4817-8635-e0324fd4b000 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:22.908123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6072c151-92f7-4817-8635-e0324fd4b000 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:23.017951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6072c151-92f7-4817-8635-e0324fd4b000 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:23.028709 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6072c151-92f7-4817-8635-e0324fd4b000 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1188 microversion: 2.1 time: 0.143352 Oct 27 19:22:23.030079 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3044/6239] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:22 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1188 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:23.589982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dd68e7cb-780b-46aa-93bc-91b62eb0c1b0 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:23.596814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dd68e7cb-780b-46aa-93bc-91b62eb0c1b0 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:23.615642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd68e7cb-780b-46aa-93bc-91b62eb0c1b0 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:23.617681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd68e7cb-780b-46aa-93bc-91b62eb0c1b0 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:23.618309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd68e7cb-780b-46aa-93bc-91b62eb0c1b0 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:23.619281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd68e7cb-780b-46aa-93bc-91b62eb0c1b0 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:23.619904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd68e7cb-780b-46aa-93bc-91b62eb0c1b0 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:23.620515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dd68e7cb-780b-46aa-93bc-91b62eb0c1b0 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:23.831473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dd68e7cb-780b-46aa-93bc-91b62eb0c1b0 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd255b0c693a24849ad2a7b3bc2bcd7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d005b1c681c4c01b3e893500a43e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:23.841606 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dd68e7cb-780b-46aa-93bc-91b62eb0c1b0 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 200 len: 1324 microversion: 2.1 time: 0.255338 Oct 27 19:22:23.843099 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3196/6240] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:23 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 1324 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:24.052776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-473783f6-757d-4765-9d6a-4bf3a52250f6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:24.053412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-473783f6-757d-4765-9d6a-4bf3a52250f6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:24.068298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-473783f6-757d-4765-9d6a-4bf3a52250f6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:24.068820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-473783f6-757d-4765-9d6a-4bf3a52250f6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:24.069276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-473783f6-757d-4765-9d6a-4bf3a52250f6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:24.070023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-473783f6-757d-4765-9d6a-4bf3a52250f6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:24.070606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-473783f6-757d-4765-9d6a-4bf3a52250f6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:24.071053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-473783f6-757d-4765-9d6a-4bf3a52250f6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:24.192140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-473783f6-757d-4765-9d6a-4bf3a52250f6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:24.209300 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-473783f6-757d-4765-9d6a-4bf3a52250f6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1188 microversion: 2.1 time: 0.161093 Oct 27 19:22:24.209908 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3045/6241] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:24 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1188 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:24.878858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-433276d3-6da5-4fed-8a71-d1d036499fa3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:24.887027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-433276d3-6da5-4fed-8a71-d1d036499fa3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:24.895512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-433276d3-6da5-4fed-8a71-d1d036499fa3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:24.896098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-433276d3-6da5-4fed-8a71-d1d036499fa3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:24.896616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-433276d3-6da5-4fed-8a71-d1d036499fa3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:24.897404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-433276d3-6da5-4fed-8a71-d1d036499fa3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:24.897956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-433276d3-6da5-4fed-8a71-d1d036499fa3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:24.898485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-433276d3-6da5-4fed-8a71-d1d036499fa3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:25.157893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-433276d3-6da5-4fed-8a71-d1d036499fa3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd255b0c693a24849ad2a7b3bc2bcd7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d005b1c681c4c01b3e893500a43e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:25.171799 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-433276d3-6da5-4fed-8a71-d1d036499fa3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 200 len: 1522 microversion: 2.1 time: 0.303862 Oct 27 19:22:25.192594 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3197/6242] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:24 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:25.199358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eebcdf0a-d6f3-4c74-a61c-644b8a3fa4c7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:25.199906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eebcdf0a-d6f3-4c74-a61c-644b8a3fa4c7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:25.210928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eebcdf0a-d6f3-4c74-a61c-644b8a3fa4c7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:25.215186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eebcdf0a-d6f3-4c74-a61c-644b8a3fa4c7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:25.215880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eebcdf0a-d6f3-4c74-a61c-644b8a3fa4c7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:25.217443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eebcdf0a-d6f3-4c74-a61c-644b8a3fa4c7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:25.218512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eebcdf0a-d6f3-4c74-a61c-644b8a3fa4c7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:25.220025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eebcdf0a-d6f3-4c74-a61c-644b8a3fa4c7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:25.238829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-60f63df3-88c7-40b3-850f-7a7a82323610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:25.239568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-60f63df3-88c7-40b3-850f-7a7a82323610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:25.249180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60f63df3-88c7-40b3-850f-7a7a82323610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:25.251421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60f63df3-88c7-40b3-850f-7a7a82323610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:25.252326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60f63df3-88c7-40b3-850f-7a7a82323610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:25.255082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60f63df3-88c7-40b3-850f-7a7a82323610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:25.256670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60f63df3-88c7-40b3-850f-7a7a82323610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:25.257327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60f63df3-88c7-40b3-850f-7a7a82323610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:25.297064 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-eebcdf0a-d6f3-4c74-a61c-644b8a3fa4c7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] HTTP exception thrown: Action 999 not found Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eebcdf0a-d6f3-4c74-a61c-644b8a3fa4c7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Request method failure captured: Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39/os-instance-actions/999 HTTP/1.1 Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtpaCBtSBlu9nlO88gYbKoeNAf6lMUjzJvckJVxgonRrkSW7kZdJTmLGOrhj5RFBXLAYMu9LumuUxEFgfp6JZu0FfKJdTovtvKIEXCsu0R9pkZwbtiFaAVKwtcoxQi35jJwcpYCXA7dvSnLbCQnKlhNgGP2elWGEpmgjMmpETP3zK_0 Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 8d005b1c681c4c01b3e893500a43e7c6 Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1348250336 Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d005b1c681c4c01b3e893500a43e7c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d005b1c681c4c01b3e893500a43e7c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d005b1c681c4c01b3e893500a43e7c6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d005b1c681c4c01b3e893500a43e7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1348250336 Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 8d005b1c681c4c01b3e893500a43e7c6 Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1348250336 Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-InstanceActionsNegativeTestJSON-1348250336-project Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: d255b0c693a24849ad2a7b3bc2bcd7f0 Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1348250336-project Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: exception: Action 999 not found Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'server_id': 'e31182f0-fd88-4018-b5cc-42763c094a39', 'id': '999'} Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 27 19:22:25.311361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:25.324035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eebcdf0a-d6f3-4c74-a61c-644b8a3fa4c7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Returning 404 to user: Action 999 not found {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:22:25.325134 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eebcdf0a-d6f3-4c74-a61c-644b8a3fa4c7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.129832 Oct 27 19:22:25.326295 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3046/6243] 10.222.0.42 () {58 vars in 1308 bytes} [Thu Oct 27 19:22:25 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39/os-instance-actions/999 => generated 66 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 19:22:25.336241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-af05e70e-744a-4fb9-b1bd-599fd7f661d3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '.version_select at 0x7fc8698b6f70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:25.344624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-af05e70e-744a-4fb9-b1bd-599fd7f661d3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: 5d6d5f11-d994-46e2-9654-0009f77d0a01] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:25.351519 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-af05e70e-744a-4fb9-b1bd-599fd7f661d3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] HTTP exception thrown: Instance 5d6d5f11-d994-46e2-9654-0009f77d0a01 could not be found. Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-af05e70e-744a-4fb9-b1bd-599fd7f661d3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Request method failure captured: Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/5d6d5f11-d994-46e2-9654-0009f77d0a01/os-instance-actions HTTP/1.1 Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtpaCBtSBlu9nlO88gYbKoeNAf6lMUjzJvckJVxgonRrkSW7kZdJTmLGOrhj5RFBXLAYMu9LumuUxEFgfp6JZu0FfKJdTovtvKIEXCsu0R9pkZwbtiFaAVKwtcoxQi35jJwcpYCXA7dvSnLbCQnKlhNgGP2elWGEpmgjMmpETP3zK_0 Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 8d005b1c681c4c01b3e893500a43e7c6 Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1348250336 Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d005b1c681c4c01b3e893500a43e7c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d005b1c681c4c01b3e893500a43e7c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d005b1c681c4c01b3e893500a43e7c6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d005b1c681c4c01b3e893500a43e7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1348250336 Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 8d005b1c681c4c01b3e893500a43e7c6 Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1348250336 Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-InstanceActionsNegativeTestJSON-1348250336-project Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: d255b0c693a24849ad2a7b3bc2bcd7f0 Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1348250336-project Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: method: Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 5d6d5f11-d994-46e2-9654-0009f77d0a01 could not be found. Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'server_id': '5d6d5f11-d994-46e2-9654-0009f77d0a01'} Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6d5f11-d994-46e2-9654-0009f77d0a01 could not be found. Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:22:25.353602 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:22:25.357536 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6d5f11-d994-46e2-9654-0009f77d0a01 could not be found. Oct 27 19:22:25.357536 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:25.357536 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:22:25.357536 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:25.357536 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:22:25.357536 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:22:25.357536 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:22:25.357536 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:22:25.357536 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:22:25.357536 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6d5f11-d994-46e2-9654-0009f77d0a01 could not be found. Oct 27 19:22:25.357536 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:25.364028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-af05e70e-744a-4fb9-b1bd-599fd7f661d3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Returning 404 to user: Instance 5d6d5f11-d994-46e2-9654-0009f77d0a01 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:22:25.365121 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-af05e70e-744a-4fb9-b1bd-599fd7f661d3 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6d5f11-d994-46e2-9654-0009f77d0a01/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.034011 Oct 27 19:22:25.368511 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3047/6244] 10.222.0.42 () {58 vars in 1296 bytes} [Thu Oct 27 19:22:25 2022] GET /compute/v2.1/servers/5d6d5f11-d994-46e2-9654-0009f77d0a01/os-instance-actions => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:22:25.381051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a2b0c312-ec06-49b9-9f68-31216b31ea97 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:25.381559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a2b0c312-ec06-49b9-9f68-31216b31ea97 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:25.383485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-60f63df3-88c7-40b3-850f-7a7a82323610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:25.408517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2b0c312-ec06-49b9-9f68-31216b31ea97 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:25.409841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2b0c312-ec06-49b9-9f68-31216b31ea97 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:25.410584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2b0c312-ec06-49b9-9f68-31216b31ea97 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:25.411502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2b0c312-ec06-49b9-9f68-31216b31ea97 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:25.412137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2b0c312-ec06-49b9-9f68-31216b31ea97 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:25.412738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2b0c312-ec06-49b9-9f68-31216b31ea97 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:25.432192 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-60f63df3-88c7-40b3-850f-7a7a82323610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1188 microversion: 2.1 time: 0.196021 Oct 27 19:22:25.434449 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3198/6245] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:25 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1188 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:22:25.490588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a2b0c312-ec06-49b9-9f68-31216b31ea97 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:22:25.659595 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a2b0c312-ec06-49b9-9f68-31216b31ea97 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 204 len: 0 microversion: 2.1 time: 0.285618 Oct 27 19:22:25.661331 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3048/6246] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:22:25 2022] DELETE /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:22:25.670132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9b2818fe-307d-4d69-bed5-171f4a45d6d7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:25.670865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9b2818fe-307d-4d69-bed5-171f4a45d6d7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:25.679147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2818fe-307d-4d69-bed5-171f4a45d6d7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:25.679658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2818fe-307d-4d69-bed5-171f4a45d6d7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:25.680110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2818fe-307d-4d69-bed5-171f4a45d6d7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:25.680834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2818fe-307d-4d69-bed5-171f4a45d6d7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:25.681304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2818fe-307d-4d69-bed5-171f4a45d6d7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:25.681752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b2818fe-307d-4d69-bed5-171f4a45d6d7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:25.983966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9b2818fe-307d-4d69-bed5-171f4a45d6d7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd255b0c693a24849ad2a7b3bc2bcd7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d005b1c681c4c01b3e893500a43e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:25.998036 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9b2818fe-307d-4d69-bed5-171f4a45d6d7 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 200 len: 1528 microversion: 2.1 time: 0.332541 Oct 27 19:22:25.999321 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3199/6247] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:25 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 1528 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:26.463047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c0961d5f-b39c-4509-8c76-b7d47cb8c85e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:26.464338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c0961d5f-b39c-4509-8c76-b7d47cb8c85e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:26.474636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0961d5f-b39c-4509-8c76-b7d47cb8c85e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:26.475383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0961d5f-b39c-4509-8c76-b7d47cb8c85e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:26.476009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0961d5f-b39c-4509-8c76-b7d47cb8c85e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:26.477455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0961d5f-b39c-4509-8c76-b7d47cb8c85e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:26.478659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0961d5f-b39c-4509-8c76-b7d47cb8c85e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:26.479262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0961d5f-b39c-4509-8c76-b7d47cb8c85e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:26.595161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c0961d5f-b39c-4509-8c76-b7d47cb8c85e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:26.609023 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c0961d5f-b39c-4509-8c76-b7d47cb8c85e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1188 microversion: 2.1 time: 0.151836 Oct 27 19:22:26.624197 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3049/6248] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:26 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1188 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:27.043296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6ebcddc6-a0c8-4449-9c6c-c0556266b5ac tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:27.046192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6ebcddc6-a0c8-4449-9c6c-c0556266b5ac tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:27.058855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ebcddc6-a0c8-4449-9c6c-c0556266b5ac tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:27.059471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ebcddc6-a0c8-4449-9c6c-c0556266b5ac tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:27.060003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ebcddc6-a0c8-4449-9c6c-c0556266b5ac tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:27.060858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ebcddc6-a0c8-4449-9c6c-c0556266b5ac tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:27.061422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ebcddc6-a0c8-4449-9c6c-c0556266b5ac tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:27.061937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ebcddc6-a0c8-4449-9c6c-c0556266b5ac tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:27.400822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6ebcddc6-a0c8-4449-9c6c-c0556266b5ac tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd255b0c693a24849ad2a7b3bc2bcd7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d005b1c681c4c01b3e893500a43e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:27.415407 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6ebcddc6-a0c8-4449-9c6c-c0556266b5ac tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 200 len: 1528 microversion: 2.1 time: 0.389502 Oct 27 19:22:27.416024 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3200/6249] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:27 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 1528 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:27.636028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-42dcb6bb-e18d-4462-bc70-39772165a339 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:27.636684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-42dcb6bb-e18d-4462-bc70-39772165a339 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:27.652775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42dcb6bb-e18d-4462-bc70-39772165a339 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:27.653550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42dcb6bb-e18d-4462-bc70-39772165a339 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:27.654219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42dcb6bb-e18d-4462-bc70-39772165a339 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:27.657214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42dcb6bb-e18d-4462-bc70-39772165a339 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:27.657715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42dcb6bb-e18d-4462-bc70-39772165a339 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:27.658251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42dcb6bb-e18d-4462-bc70-39772165a339 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:27.810735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-42dcb6bb-e18d-4462-bc70-39772165a339 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:27.822499 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-42dcb6bb-e18d-4462-bc70-39772165a339 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1188 microversion: 2.1 time: 0.190802 Oct 27 19:22:27.836041 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3050/6250] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:27 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1188 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:28.353241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-75e09350-4f43-4bc4-b76e-273ea71e5420 req-d5f54c33-b791-4842-ae6d-a1ebbb041ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31182f0-fd88-4018-b5cc-42763c094a39", "name": "network-vif-deleted", "tag": "3983bcb1-077f-4a91-9251-db0e42c25438"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:28.404574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-75e09350-4f43-4bc4-b76e-273ea71e5420 req-d5f54c33-b791-4842-ae6d-a1ebbb041ba0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:28.405492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-75e09350-4f43-4bc4-b76e-273ea71e5420 req-d5f54c33-b791-4842-ae6d-a1ebbb041ba0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:28.406314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-75e09350-4f43-4bc4-b76e-273ea71e5420 req-d5f54c33-b791-4842-ae6d-a1ebbb041ba0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:28.450336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0a169930-87f0-48dd-8144-9d0e0804a20f tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:28.451409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0a169930-87f0-48dd-8144-9d0e0804a20f tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:28.460064 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-75e09350-4f43-4bc4-b76e-273ea71e5420 req-d5f54c33-b791-4842-ae6d-a1ebbb041ba0 service nova] Creating event network-vif-deleted:3983bcb1-077f-4a91-9251-db0e42c25438 for instance e31182f0-fd88-4018-b5cc-42763c094a39 on n-h1-860687-3 Oct 27 19:22:28.482918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a169930-87f0-48dd-8144-9d0e0804a20f tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:28.483746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a169930-87f0-48dd-8144-9d0e0804a20f tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:28.484426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a169930-87f0-48dd-8144-9d0e0804a20f tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:28.492743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a169930-87f0-48dd-8144-9d0e0804a20f tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:28.497997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a169930-87f0-48dd-8144-9d0e0804a20f tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:28.498666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a169930-87f0-48dd-8144-9d0e0804a20f tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:28.510262 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-75e09350-4f43-4bc4-b76e-273ea71e5420 req-d5f54c33-b791-4842-ae6d-a1ebbb041ba0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147130 Oct 27 19:22:28.511069 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3201/6251] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:22:28.601819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a169930-87f0-48dd-8144-9d0e0804a20f tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:28.602875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a169930-87f0-48dd-8144-9d0e0804a20f tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:28.603544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a169930-87f0-48dd-8144-9d0e0804a20f tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:28.604227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-0a169930-87f0-48dd-8144-9d0e0804a20f tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lazy-loading 'fault' on Instance uuid e31182f0-fd88-4018-b5cc-42763c094a39 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:22:28.655190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0a169930-87f0-48dd-8144-9d0e0804a20f tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd255b0c693a24849ad2a7b3bc2bcd7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d005b1c681c4c01b3e893500a43e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:28.665715 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0a169930-87f0-48dd-8144-9d0e0804a20f tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 200 len: 1314 microversion: 2.1 time: 0.223689 Oct 27 19:22:28.667475 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3051/6252] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:28 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:22:28.851124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-033ed6f5-5b72-42e0-895e-d289d25e5586 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:28.852274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-033ed6f5-5b72-42e0-895e-d289d25e5586 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:28.860073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-033ed6f5-5b72-42e0-895e-d289d25e5586 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:28.860862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-033ed6f5-5b72-42e0-895e-d289d25e5586 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:28.861480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-033ed6f5-5b72-42e0-895e-d289d25e5586 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:28.863405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-033ed6f5-5b72-42e0-895e-d289d25e5586 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:28.864071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-033ed6f5-5b72-42e0-895e-d289d25e5586 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:28.864683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-033ed6f5-5b72-42e0-895e-d289d25e5586 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:28.947495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-033ed6f5-5b72-42e0-895e-d289d25e5586 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:28.957222 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-033ed6f5-5b72-42e0-895e-d289d25e5586 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 200 len: 1188 microversion: 2.1 time: 0.110282 Oct 27 19:22:28.958739 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3202/6253] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:28 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 1188 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:29.695056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7273d13-dc41-4b3f-baf0-4f5dd0434030 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:29.696427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7273d13-dc41-4b3f-baf0-4f5dd0434030 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] [instance: e31182f0-fd88-4018-b5cc-42763c094a39] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:29.707132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7273d13-dc41-4b3f-baf0-4f5dd0434030 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:29.707942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7273d13-dc41-4b3f-baf0-4f5dd0434030 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:29.708955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7273d13-dc41-4b3f-baf0-4f5dd0434030 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:29.709756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7273d13-dc41-4b3f-baf0-4f5dd0434030 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:29.710302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7273d13-dc41-4b3f-baf0-4f5dd0434030 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:29.710986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7273d13-dc41-4b3f-baf0-4f5dd0434030 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:29.734370 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d7273d13-dc41-4b3f-baf0-4f5dd0434030 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] HTTP exception thrown: Instance e31182f0-fd88-4018-b5cc-42763c094a39 could not be found. Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7273d13-dc41-4b3f-baf0-4f5dd0434030 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Request method failure captured: Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 HTTP/1.1 Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtpaCBtSBlu9nlO88gYbKoeNAf6lMUjzJvckJVxgonRrkSW7kZdJTmLGOrhj5RFBXLAYMu9LumuUxEFgfp6JZu0FfKJdTovtvKIEXCsu0R9pkZwbtiFaAVKwtcoxQi35jJwcpYCXA7dvSnLbCQnKlhNgGP2elWGEpmgjMmpETP3zK_0 Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 8d005b1c681c4c01b3e893500a43e7c6 Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1348250336 Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d005b1c681c4c01b3e893500a43e7c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d005b1c681c4c01b3e893500a43e7c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d005b1c681c4c01b3e893500a43e7c6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d005b1c681c4c01b3e893500a43e7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1348250336 Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 8d005b1c681c4c01b3e893500a43e7c6 Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1348250336 Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-InstanceActionsNegativeTestJSON-1348250336-project Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: d255b0c693a24849ad2a7b3bc2bcd7f0 Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1348250336-project Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance e31182f0-fd88-4018-b5cc-42763c094a39 could not be found. Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'e31182f0-fd88-4018-b5cc-42763c094a39'} Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31182f0-fd88-4018-b5cc-42763c094a39 could not be found. Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31182f0-fd88-4018-b5cc-42763c094a39 could not be found. Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:29.736098 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:22:29.744798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:29.744798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:22:29.744798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:22:29.744798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:22:29.744798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:22:29.744798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:22:29.744798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31182f0-fd88-4018-b5cc-42763c094a39 could not be found. Oct 27 19:22:29.744798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:29.744798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7273d13-dc41-4b3f-baf0-4f5dd0434030 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] Returning 404 to user: Instance e31182f0-fd88-4018-b5cc-42763c094a39 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:22:29.744798 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7273d13-dc41-4b3f-baf0-4f5dd0434030 tempest-InstanceActionsNegativeTestJSON-1348250336 tempest-InstanceActionsNegativeTestJSON-1348250336-project] 10.222.0.42 "GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39" status: 404 len: 111 microversion: 2.1 time: 0.048217 Oct 27 19:22:29.746683 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3052/6254] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:29 2022] GET /compute/v2.1/servers/e31182f0-fd88-4018-b5cc-42763c094a39 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:22:29.905616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ea70109d-6a8b-41c0-8442-3cf50a660e73 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c9e885c-2420-40f5-a12f-9776e4b3f958", "device": "/dev/sdb"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:29.912056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ea70109d-6a8b-41c0-8442-3cf50a660e73 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:29.920852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea70109d-6a8b-41c0-8442-3cf50a660e73 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:29.921591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea70109d-6a8b-41c0-8442-3cf50a660e73 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:29.922140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea70109d-6a8b-41c0-8442-3cf50a660e73 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:29.923349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea70109d-6a8b-41c0-8442-3cf50a660e73 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:29.923943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea70109d-6a8b-41c0-8442-3cf50a660e73 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:29.925303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea70109d-6a8b-41c0-8442-3cf50a660e73 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:29.981030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1c2be248-39a9-4efc-9637-20fcccdd1aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:29.981809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1c2be248-39a9-4efc-9637-20fcccdd1aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:29.994976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c2be248-39a9-4efc-9637-20fcccdd1aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:29.995571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c2be248-39a9-4efc-9637-20fcccdd1aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:29.996064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c2be248-39a9-4efc-9637-20fcccdd1aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:29.996952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c2be248-39a9-4efc-9637-20fcccdd1aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:29.997424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c2be248-39a9-4efc-9637-20fcccdd1aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:29.999405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c2be248-39a9-4efc-9637-20fcccdd1aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:30.053505 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-1c2be248-39a9-4efc-9637-20fcccdd1aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e could not be found. Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1c2be248-39a9-4efc-9637-20fcccdd1aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e HTTP/1.1 Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e could not be found. Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '3d5103dc-c8a2-4a38-b9e6-d632bb6d597e'} Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e could not be found. Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e could not be found. Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:22:30.056334 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:30.061326 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:22:30.061326 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:22:30.061326 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:22:30.061326 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:22:30.061326 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:22:30.061326 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e could not be found. Oct 27 19:22:30.061326 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:22:30.063616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1c2be248-39a9-4efc-9637-20fcccdd1aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance 3d5103dc-c8a2-4a38-b9e6-d632bb6d597e could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:22:30.065899 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1c2be248-39a9-4efc-9637-20fcccdd1aae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e" status: 404 len: 111 microversion: 2.1 time: 0.089495 Oct 27 19:22:30.070446 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3053/6255] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:29 2022] GET /compute/v2.1/servers/3d5103dc-c8a2-4a38-b9e6-d632bb6d597e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:22:30.512735 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ea70109d-6a8b-41c0-8442-3cf50a660e73 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "POST /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.621686 Oct 27 19:22:30.513531 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3203/6256] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:22:29 2022] POST /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4/os-volume_attachments => generated 194 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:22:38.332041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-782180381", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": "none"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:38.425969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:22:38.426935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:22:38.428262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:22:38.430050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:22:38.430856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:22:38.459360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:38.460198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:38.462752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:38.464884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:38.465785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:38.467127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:38.490254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Getting quotas for project d89273d0089c41bbaf211fed675f938c. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:22:38.496660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Getting quotas for user 5cebf31f9fcf40b0adc759b87907d191 and project d89273d0089c41bbaf211fed675f938c. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:22:38.514597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:22:38.517206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:22:38.575376 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e80ad43c-5b72-412b-94cc-fd0213ef1f86 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.499022 Oct 27 19:22:38.576496 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3054/6257] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 19:22:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 19:22:38.590229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e34b924f-e622-4f10-bf9a-92270d5419d2 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:38.592202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e34b924f-e622-4f10-bf9a-92270d5419d2 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:38.769680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e34b924f-e622-4f10-bf9a-92270d5419d2 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:38.778185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e34b924f-e622-4f10-bf9a-92270d5419d2 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:38.779768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e34b924f-e622-4f10-bf9a-92270d5419d2 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:38.780958 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e34b924f-e622-4f10-bf9a-92270d5419d2 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1277 microversion: 2.57 time: 0.196853 Oct 27 19:22:38.799092 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3204/6258] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:38 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:22:39.696723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1b314b78-dca6-4514-89b5-04b18f759df9 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:39.699165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1b314b78-dca6-4514-89b5-04b18f759df9 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:39.710759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b314b78-dca6-4514-89b5-04b18f759df9 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:39.711473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b314b78-dca6-4514-89b5-04b18f759df9 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:39.712100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b314b78-dca6-4514-89b5-04b18f759df9 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:39.713193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b314b78-dca6-4514-89b5-04b18f759df9 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:39.713852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b314b78-dca6-4514-89b5-04b18f759df9 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:39.714727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b314b78-dca6-4514-89b5-04b18f759df9 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:39.820915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1f04f143-a40f-4de8-a574-6552cde787e4 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:39.822406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1f04f143-a40f-4de8-a574-6552cde787e4 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:39.853906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f04f143-a40f-4de8-a574-6552cde787e4 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:39.854664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f04f143-a40f-4de8-a574-6552cde787e4 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:39.855144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f04f143-a40f-4de8-a574-6552cde787e4 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:39.863038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f04f143-a40f-4de8-a574-6552cde787e4 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:39.864187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f04f143-a40f-4de8-a574-6552cde787e4 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:39.864812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f04f143-a40f-4de8-a574-6552cde787e4 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:39.964952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1f04f143-a40f-4de8-a574-6552cde787e4 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:39.983427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:39.989774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1f04f143-a40f-4de8-a574-6552cde787e4 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:39.992283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1f04f143-a40f-4de8-a574-6552cde787e4 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:39.993958 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1f04f143-a40f-4de8-a574-6552cde787e4 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1273 microversion: 2.57 time: 0.177936 Oct 27 19:22:39.995294 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3205/6259] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:39 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:22:40.128408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-1b314b78-dca6-4514-89b5-04b18f759df9 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lazy-loading 'services' on Instance uuid db56aa8c-7a19-4910-8226-c70ac28faf8d {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:22:40.249304 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1b314b78-dca6-4514-89b5-04b18f759df9 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "DELETE /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/os-volume_attachments/fa0496a8-fb90-4b17-b6ee-b6b2cf116305" status: 202 len: 0 microversion: 2.1 time: 0.566543 Oct 27 19:22:40.251046 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3055/6260] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:22:39 2022] DELETE /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/os-volume_attachments/fa0496a8-fb90-4b17-b6ee-b6b2cf116305 => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:22:41.022320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0840c850-30eb-43f0-a93b-9a15585fe738 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:41.023357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0840c850-30eb-43f0-a93b-9a15585fe738 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:41.031520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0840c850-30eb-43f0-a93b-9a15585fe738 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:41.032403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0840c850-30eb-43f0-a93b-9a15585fe738 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:41.033062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0840c850-30eb-43f0-a93b-9a15585fe738 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:41.034259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0840c850-30eb-43f0-a93b-9a15585fe738 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:41.035055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0840c850-30eb-43f0-a93b-9a15585fe738 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:41.035593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0840c850-30eb-43f0-a93b-9a15585fe738 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:41.110342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0840c850-30eb-43f0-a93b-9a15585fe738 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:41.122584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0840c850-30eb-43f0-a93b-9a15585fe738 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:41.124631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0840c850-30eb-43f0-a93b-9a15585fe738 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:41.125996 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0840c850-30eb-43f0-a93b-9a15585fe738 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1335 microversion: 2.57 time: 0.109218 Oct 27 19:22:41.134659 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3206/6261] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:41 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1335 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:22:42.155649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-16fd901f-a066-48a5-9fb5-c6c4900e2110 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:42.157021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-16fd901f-a066-48a5-9fb5-c6c4900e2110 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:42.161384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:42.167701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16fd901f-a066-48a5-9fb5-c6c4900e2110 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:42.168208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16fd901f-a066-48a5-9fb5-c6c4900e2110 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:42.168644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16fd901f-a066-48a5-9fb5-c6c4900e2110 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:42.169425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16fd901f-a066-48a5-9fb5-c6c4900e2110 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:42.169889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16fd901f-a066-48a5-9fb5-c6c4900e2110 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:42.170602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16fd901f-a066-48a5-9fb5-c6c4900e2110 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:42.263366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-16fd901f-a066-48a5-9fb5-c6c4900e2110 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:42.274416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-16fd901f-a066-48a5-9fb5-c6c4900e2110 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:42.276379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-16fd901f-a066-48a5-9fb5-c6c4900e2110 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:42.277742 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-16fd901f-a066-48a5-9fb5-c6c4900e2110 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1335 microversion: 2.57 time: 0.128305 Oct 27 19:22:42.279066 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3056/6262] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:42 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1335 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:22:43.308398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7caa4ed9-7533-4aae-b978-84ae8166884d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:43.308954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7caa4ed9-7533-4aae-b978-84ae8166884d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:43.329556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7caa4ed9-7533-4aae-b978-84ae8166884d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:43.329556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7caa4ed9-7533-4aae-b978-84ae8166884d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:43.329556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7caa4ed9-7533-4aae-b978-84ae8166884d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:43.329951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7caa4ed9-7533-4aae-b978-84ae8166884d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:43.331389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7caa4ed9-7533-4aae-b978-84ae8166884d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:43.332007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7caa4ed9-7533-4aae-b978-84ae8166884d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:43.407058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7caa4ed9-7533-4aae-b978-84ae8166884d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:43.416642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7caa4ed9-7533-4aae-b978-84ae8166884d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:43.423516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7caa4ed9-7533-4aae-b978-84ae8166884d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:43.425813 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7caa4ed9-7533-4aae-b978-84ae8166884d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1356 microversion: 2.57 time: 0.123771 Oct 27 19:22:43.427066 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3207/6263] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:43 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1356 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:22:43.466657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:43.466657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:43.473048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:43.473772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:43.474457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:43.475464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:43.476097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:43.476688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:43.629293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:22:43.629979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:22:43.630642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:22:43.631241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:22:43.631826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:22:43.684154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:43.745216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:43.758473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:43.759134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:43.759598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:43.760322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:43.760794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:43.761235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:43.846577 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-536843ea-ab9b-49e8-8185-08879cf66423 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "POST /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d/action" status: 202 len: 1137 microversion: 2.57 time: 0.395546 Oct 27 19:22:43.855192 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3057/6264] 10.222.0.42 () {62 vars in 1320 bytes} [Thu Oct 27 19:22:43 2022] POST /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d/action => generated 1137 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 19:22:43.873874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7f6a470e-05da-4465-a8c8-bbb60979c427 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:43.875105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7f6a470e-05da-4465-a8c8-bbb60979c427 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:43.878439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=46 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:43.891708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f6a470e-05da-4465-a8c8-bbb60979c427 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:43.892325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f6a470e-05da-4465-a8c8-bbb60979c427 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:43.894683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f6a470e-05da-4465-a8c8-bbb60979c427 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:43.895694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f6a470e-05da-4465-a8c8-bbb60979c427 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:43.897037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f6a470e-05da-4465-a8c8-bbb60979c427 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:43.898457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f6a470e-05da-4465-a8c8-bbb60979c427 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:44.020660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7f6a470e-05da-4465-a8c8-bbb60979c427 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:44.043250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7f6a470e-05da-4465-a8c8-bbb60979c427 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:44.052169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7f6a470e-05da-4465-a8c8-bbb60979c427 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:44.057181 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7f6a470e-05da-4465-a8c8-bbb60979c427 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.187949 Oct 27 19:22:44.059338 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3208/6265] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:43 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:22:45.087393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f6d46feb-c335-48a7-a773-dfb135295cc5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:45.088016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f6d46feb-c335-48a7-a773-dfb135295cc5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:45.096374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d46feb-c335-48a7-a773-dfb135295cc5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:45.096888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d46feb-c335-48a7-a773-dfb135295cc5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:45.097426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d46feb-c335-48a7-a773-dfb135295cc5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:45.098153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d46feb-c335-48a7-a773-dfb135295cc5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:45.098810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d46feb-c335-48a7-a773-dfb135295cc5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:45.099408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d46feb-c335-48a7-a773-dfb135295cc5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:45.201101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6d46feb-c335-48a7-a773-dfb135295cc5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:45.211607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6d46feb-c335-48a7-a773-dfb135295cc5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:45.213275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6d46feb-c335-48a7-a773-dfb135295cc5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:45.215151 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f6d46feb-c335-48a7-a773-dfb135295cc5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.131625 Oct 27 19:22:45.216214 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3058/6266] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:45 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:22:46.246768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-973270c5-169b-4191-973b-70ea81d08b65 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:46.247424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-973270c5-169b-4191-973b-70ea81d08b65 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:46.271255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973270c5-169b-4191-973b-70ea81d08b65 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:46.271255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973270c5-169b-4191-973b-70ea81d08b65 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:46.271255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973270c5-169b-4191-973b-70ea81d08b65 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:46.271641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973270c5-169b-4191-973b-70ea81d08b65 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:46.280762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973270c5-169b-4191-973b-70ea81d08b65 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:46.287314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973270c5-169b-4191-973b-70ea81d08b65 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:46.484704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-973270c5-169b-4191-973b-70ea81d08b65 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:46.510335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-973270c5-169b-4191-973b-70ea81d08b65 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:46.521564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-973270c5-169b-4191-973b-70ea81d08b65 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:46.524300 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-973270c5-169b-4191-973b-70ea81d08b65 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.281662 Oct 27 19:22:46.525015 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3209/6267] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:46 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:22:47.187536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-172bbc02-1c9f-4612-a8cb-ccbc8e89b4a8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:47.199288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-172bbc02-1c9f-4612-a8cb-ccbc8e89b4a8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:47.200424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-172bbc02-1c9f-4612-a8cb-ccbc8e89b4a8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:47.200885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-172bbc02-1c9f-4612-a8cb-ccbc8e89b4a8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:47.252162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-172bbc02-1c9f-4612-a8cb-ccbc8e89b4a8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Going to try to stop instance {{(pid=127028) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 19:22:47.363247 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-172bbc02-1c9f-4612-a8cb-ccbc8e89b4a8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "POST /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/action" status: 202 len: 0 microversion: 2.1 time: 0.175562 Oct 27 19:22:47.364971 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3059/6268] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:22:47 2022] POST /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:22:47.371873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a3e5640-12eb-4c32-9cb3-48501eb728fb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:47.372737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1a3e5640-12eb-4c32-9cb3-48501eb728fb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:47.382176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a3e5640-12eb-4c32-9cb3-48501eb728fb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:47.397919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a3e5640-12eb-4c32-9cb3-48501eb728fb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:47.398574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a3e5640-12eb-4c32-9cb3-48501eb728fb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:47.399396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a3e5640-12eb-4c32-9cb3-48501eb728fb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:47.399879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a3e5640-12eb-4c32-9cb3-48501eb728fb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:47.400319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a3e5640-12eb-4c32-9cb3-48501eb728fb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:47.559206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-badae09d-7315-46d2-89a9-2c585f82a9a8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:47.560533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-badae09d-7315-46d2-89a9-2c585f82a9a8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:47.569709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-badae09d-7315-46d2-89a9-2c585f82a9a8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:47.572314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-badae09d-7315-46d2-89a9-2c585f82a9a8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:47.573331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-badae09d-7315-46d2-89a9-2c585f82a9a8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:47.576571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-badae09d-7315-46d2-89a9-2c585f82a9a8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:47.577673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-badae09d-7315-46d2-89a9-2c585f82a9a8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:47.578264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-badae09d-7315-46d2-89a9-2c585f82a9a8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:47.617579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1a3e5640-12eb-4c32-9cb3-48501eb728fb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:47.628777 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1a3e5640-12eb-4c32-9cb3-48501eb728fb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1677 microversion: 2.1 time: 0.257781 Oct 27 19:22:47.628777 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3210/6269] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:47 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1677 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:47.690695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-badae09d-7315-46d2-89a9-2c585f82a9a8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:47.705287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-badae09d-7315-46d2-89a9-2c585f82a9a8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:47.711767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-badae09d-7315-46d2-89a9-2c585f82a9a8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:47.713631 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-badae09d-7315-46d2-89a9-2c585f82a9a8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.158740 Oct 27 19:22:47.714732 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3060/6270] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:47 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:22:48.676053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-68067cc5-510e-4f03-939e-1111e96f57ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:48.676692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-68067cc5-510e-4f03-939e-1111e96f57ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:48.714789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68067cc5-510e-4f03-939e-1111e96f57ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:48.715308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68067cc5-510e-4f03-939e-1111e96f57ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:48.715800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68067cc5-510e-4f03-939e-1111e96f57ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:48.716552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68067cc5-510e-4f03-939e-1111e96f57ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:48.717144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68067cc5-510e-4f03-939e-1111e96f57ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:48.727441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68067cc5-510e-4f03-939e-1111e96f57ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:48.746424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e8c216e3-5540-4362-9039-91199a25b040 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:48.747942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e8c216e3-5540-4362-9039-91199a25b040 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:48.751737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:48.753207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:48.767351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8c216e3-5540-4362-9039-91199a25b040 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:48.768906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8c216e3-5540-4362-9039-91199a25b040 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:48.769639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8c216e3-5540-4362-9039-91199a25b040 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:48.770863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8c216e3-5540-4362-9039-91199a25b040 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:48.771732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8c216e3-5540-4362-9039-91199a25b040 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:48.773025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8c216e3-5540-4362-9039-91199a25b040 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:48.788598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:22:48.960462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8c216e3-5540-4362-9039-91199a25b040 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:48.971838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8c216e3-5540-4362-9039-91199a25b040 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:48.992719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8c216e3-5540-4362-9039-91199a25b040 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:48.994097 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e8c216e3-5540-4362-9039-91199a25b040 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.254903 Oct 27 19:22:48.997725 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3061/6271] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:48 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:22:49.017607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-68067cc5-510e-4f03-939e-1111e96f57ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:49.028892 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-68067cc5-510e-4f03-939e-1111e96f57ad tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1677 microversion: 2.1 time: 0.371208 Oct 27 19:22:49.030057 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3211/6272] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:48 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1677 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:50.030659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f6d5f90c-7928-43e8-a3c2-435077f3cb97 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:50.031443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f6d5f90c-7928-43e8-a3c2-435077f3cb97 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:50.039749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d5f90c-7928-43e8-a3c2-435077f3cb97 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:50.040477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d5f90c-7928-43e8-a3c2-435077f3cb97 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:50.041476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d5f90c-7928-43e8-a3c2-435077f3cb97 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:50.042638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d5f90c-7928-43e8-a3c2-435077f3cb97 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:50.043855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d5f90c-7928-43e8-a3c2-435077f3cb97 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:50.044777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d5f90c-7928-43e8-a3c2-435077f3cb97 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:50.064962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-677bf728-e865-46e2-b668-3492f63e06d8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:50.068799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-677bf728-e865-46e2-b668-3492f63e06d8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:50.095677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-677bf728-e865-46e2-b668-3492f63e06d8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:50.096263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-677bf728-e865-46e2-b668-3492f63e06d8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:50.096728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-677bf728-e865-46e2-b668-3492f63e06d8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:50.098884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-677bf728-e865-46e2-b668-3492f63e06d8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:50.101294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-677bf728-e865-46e2-b668-3492f63e06d8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:50.101977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-677bf728-e865-46e2-b668-3492f63e06d8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:50.245367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6d5f90c-7928-43e8-a3c2-435077f3cb97 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:50.261871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6d5f90c-7928-43e8-a3c2-435077f3cb97 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:50.266322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6d5f90c-7928-43e8-a3c2-435077f3cb97 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:50.269835 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f6d5f90c-7928-43e8-a3c2-435077f3cb97 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.245227 Oct 27 19:22:50.287232 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3062/6273] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:50 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:22:50.317257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-677bf728-e865-46e2-b668-3492f63e06d8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:50.327105 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-677bf728-e865-46e2-b668-3492f63e06d8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1677 microversion: 2.1 time: 0.278201 Oct 27 19:22:50.328006 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3212/6274] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:50 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1677 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:51.303551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9a27d2c-e9b1-44de-9520-85a1cbbf3a39 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:51.304220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c9a27d2c-e9b1-44de-9520-85a1cbbf3a39 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:51.313632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9a27d2c-e9b1-44de-9520-85a1cbbf3a39 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:51.314143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9a27d2c-e9b1-44de-9520-85a1cbbf3a39 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:51.318763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9a27d2c-e9b1-44de-9520-85a1cbbf3a39 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:51.319566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9a27d2c-e9b1-44de-9520-85a1cbbf3a39 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:51.320055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9a27d2c-e9b1-44de-9520-85a1cbbf3a39 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:51.320508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9a27d2c-e9b1-44de-9520-85a1cbbf3a39 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:51.354105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9315430b-3b17-4ea2-be59-2f25b240c7c8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:51.355354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9315430b-3b17-4ea2-be59-2f25b240c7c8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:51.365906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9315430b-3b17-4ea2-be59-2f25b240c7c8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:51.366802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9315430b-3b17-4ea2-be59-2f25b240c7c8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:51.371562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9315430b-3b17-4ea2-be59-2f25b240c7c8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:51.382032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9315430b-3b17-4ea2-be59-2f25b240c7c8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:51.382842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9315430b-3b17-4ea2-be59-2f25b240c7c8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:51.383496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9315430b-3b17-4ea2-be59-2f25b240c7c8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:51.463523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c9a27d2c-e9b1-44de-9520-85a1cbbf3a39 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:51.472828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c9a27d2c-e9b1-44de-9520-85a1cbbf3a39 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:51.474647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c9a27d2c-e9b1-44de-9520-85a1cbbf3a39 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:51.476051 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c9a27d2c-e9b1-44de-9520-85a1cbbf3a39 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.177630 Oct 27 19:22:51.477105 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3063/6275] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:51 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:22:51.762952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9315430b-3b17-4ea2-be59-2f25b240c7c8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:51.804909 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9315430b-3b17-4ea2-be59-2f25b240c7c8 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1677 microversion: 2.1 time: 0.432360 Oct 27 19:22:51.824506 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3213/6276] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:51 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1677 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:52.199904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5d225cec-f957-441c-b667-9564ec66e91b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:52.202780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5d225cec-f957-441c-b667-9564ec66e91b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:52.236024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d225cec-f957-441c-b667-9564ec66e91b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:52.236024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d225cec-f957-441c-b667-9564ec66e91b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:52.236024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d225cec-f957-441c-b667-9564ec66e91b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:52.236024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d225cec-f957-441c-b667-9564ec66e91b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:52.236024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d225cec-f957-441c-b667-9564ec66e91b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:52.236024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d225cec-f957-441c-b667-9564ec66e91b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:52.313394 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5d225cec-f957-441c-b667-9564ec66e91b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef/action" status: 200 len: 24569 microversion: 2.1 time: 0.117664 Oct 27 19:22:52.316190 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3064/6277] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:22:52 2022] POST /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef/action => generated 24569 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:22:52.510474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-341f1b6c-96dc-4d58-904d-e6069a9dc0ee tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:52.511100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-341f1b6c-96dc-4d58-904d-e6069a9dc0ee tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:52.520651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-341f1b6c-96dc-4d58-904d-e6069a9dc0ee tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:52.521705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-341f1b6c-96dc-4d58-904d-e6069a9dc0ee tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:52.522453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-341f1b6c-96dc-4d58-904d-e6069a9dc0ee tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:52.523348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-341f1b6c-96dc-4d58-904d-e6069a9dc0ee tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:52.523967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-341f1b6c-96dc-4d58-904d-e6069a9dc0ee tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:52.524746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-341f1b6c-96dc-4d58-904d-e6069a9dc0ee tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:52.683691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-341f1b6c-96dc-4d58-904d-e6069a9dc0ee tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:52.694347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-341f1b6c-96dc-4d58-904d-e6069a9dc0ee tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:52.696150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-341f1b6c-96dc-4d58-904d-e6069a9dc0ee tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:52.697826 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-341f1b6c-96dc-4d58-904d-e6069a9dc0ee tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.193542 Oct 27 19:22:52.699550 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3214/6278] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:52 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:22:52.837414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-34635fb6-9ebb-4196-9361-ef7207a70fc7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:52.838049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-34635fb6-9ebb-4196-9361-ef7207a70fc7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:52.850819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34635fb6-9ebb-4196-9361-ef7207a70fc7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:52.853093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34635fb6-9ebb-4196-9361-ef7207a70fc7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:52.853738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34635fb6-9ebb-4196-9361-ef7207a70fc7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:52.854687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34635fb6-9ebb-4196-9361-ef7207a70fc7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:52.856795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34635fb6-9ebb-4196-9361-ef7207a70fc7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:52.857419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34635fb6-9ebb-4196-9361-ef7207a70fc7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:53.171720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-34635fb6-9ebb-4196-9361-ef7207a70fc7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:53.180574 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-34635fb6-9ebb-4196-9361-ef7207a70fc7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1677 microversion: 2.1 time: 0.348829 Oct 27 19:22:53.183214 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3065/6279] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:52 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1677 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:53.733769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b01ddb50-f9ab-44b7-a3a0-fe16c4a3fe21 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:53.735863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b01ddb50-f9ab-44b7-a3a0-fe16c4a3fe21 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:53.752910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b01ddb50-f9ab-44b7-a3a0-fe16c4a3fe21 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:53.754118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b01ddb50-f9ab-44b7-a3a0-fe16c4a3fe21 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:53.755106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b01ddb50-f9ab-44b7-a3a0-fe16c4a3fe21 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:53.756096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b01ddb50-f9ab-44b7-a3a0-fe16c4a3fe21 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:53.757234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b01ddb50-f9ab-44b7-a3a0-fe16c4a3fe21 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:53.757686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b01ddb50-f9ab-44b7-a3a0-fe16c4a3fe21 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:53.893195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b01ddb50-f9ab-44b7-a3a0-fe16c4a3fe21 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:53.911419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b01ddb50-f9ab-44b7-a3a0-fe16c4a3fe21 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:53.915551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b01ddb50-f9ab-44b7-a3a0-fe16c4a3fe21 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:53.918131 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b01ddb50-f9ab-44b7-a3a0-fe16c4a3fe21 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.193974 Oct 27 19:22:53.938291 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3215/6280] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:53 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:22:54.206724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2ebdee84-e199-4dc2-b23b-32b254ae0b0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:54.207345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2ebdee84-e199-4dc2-b23b-32b254ae0b0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:54.216216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ebdee84-e199-4dc2-b23b-32b254ae0b0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:54.220211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ebdee84-e199-4dc2-b23b-32b254ae0b0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:54.224237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ebdee84-e199-4dc2-b23b-32b254ae0b0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:54.225218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ebdee84-e199-4dc2-b23b-32b254ae0b0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:54.226127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ebdee84-e199-4dc2-b23b-32b254ae0b0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:54.226783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ebdee84-e199-4dc2-b23b-32b254ae0b0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:54.522343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2ebdee84-e199-4dc2-b23b-32b254ae0b0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:54.538904 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2ebdee84-e199-4dc2-b23b-32b254ae0b0b tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1677 microversion: 2.1 time: 0.336452 Oct 27 19:22:54.539698 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3066/6281] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:54 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1677 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:54.945705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f99d94d8-cc03-45bd-8908-5ed4428a8c12 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:54.951453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f99d94d8-cc03-45bd-8908-5ed4428a8c12 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:54.966054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f99d94d8-cc03-45bd-8908-5ed4428a8c12 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:54.969145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f99d94d8-cc03-45bd-8908-5ed4428a8c12 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:54.975747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f99d94d8-cc03-45bd-8908-5ed4428a8c12 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:54.977045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f99d94d8-cc03-45bd-8908-5ed4428a8c12 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:54.977740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f99d94d8-cc03-45bd-8908-5ed4428a8c12 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:54.978824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f99d94d8-cc03-45bd-8908-5ed4428a8c12 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:55.123803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f99d94d8-cc03-45bd-8908-5ed4428a8c12 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:55.141872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f99d94d8-cc03-45bd-8908-5ed4428a8c12 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:55.144545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f99d94d8-cc03-45bd-8908-5ed4428a8c12 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:55.145913 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f99d94d8-cc03-45bd-8908-5ed4428a8c12 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.204317 Oct 27 19:22:55.146909 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3216/6282] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:54 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:22:55.571113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-008a6044-396b-4de5-8ab9-51e3cb035a6a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:55.571734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-008a6044-396b-4de5-8ab9-51e3cb035a6a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:55.592817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-008a6044-396b-4de5-8ab9-51e3cb035a6a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:55.593519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-008a6044-396b-4de5-8ab9-51e3cb035a6a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:55.594135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-008a6044-396b-4de5-8ab9-51e3cb035a6a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:55.595054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-008a6044-396b-4de5-8ab9-51e3cb035a6a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:55.595670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-008a6044-396b-4de5-8ab9-51e3cb035a6a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:55.607158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-008a6044-396b-4de5-8ab9-51e3cb035a6a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:55.871553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-008a6044-396b-4de5-8ab9-51e3cb035a6a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:55.884560 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-008a6044-396b-4de5-8ab9-51e3cb035a6a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1677 microversion: 2.1 time: 0.315394 Oct 27 19:22:55.886052 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3067/6283] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:55 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1677 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:56.199317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-477956a9-272a-4f22-be7b-90706f71944c tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:56.199949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-477956a9-272a-4f22-be7b-90706f71944c tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:56.216745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-477956a9-272a-4f22-be7b-90706f71944c tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:56.217525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-477956a9-272a-4f22-be7b-90706f71944c tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:56.218203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-477956a9-272a-4f22-be7b-90706f71944c tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:56.232685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-477956a9-272a-4f22-be7b-90706f71944c tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:56.233292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-477956a9-272a-4f22-be7b-90706f71944c tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:56.234183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-477956a9-272a-4f22-be7b-90706f71944c tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:56.350302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-477956a9-272a-4f22-be7b-90706f71944c tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:56.385802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-477956a9-272a-4f22-be7b-90706f71944c tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:56.394019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-477956a9-272a-4f22-be7b-90706f71944c tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:56.410493 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-477956a9-272a-4f22-be7b-90706f71944c tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.225915 Oct 27 19:22:56.444588 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3217/6284] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:56 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:22:56.911715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8cde3b8f-ed08-4fcc-8a36-61e5eedee9fd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:56.913116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8cde3b8f-ed08-4fcc-8a36-61e5eedee9fd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:56.938029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cde3b8f-ed08-4fcc-8a36-61e5eedee9fd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:56.938953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cde3b8f-ed08-4fcc-8a36-61e5eedee9fd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:56.943564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cde3b8f-ed08-4fcc-8a36-61e5eedee9fd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:56.946841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cde3b8f-ed08-4fcc-8a36-61e5eedee9fd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:56.950536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cde3b8f-ed08-4fcc-8a36-61e5eedee9fd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:56.952329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8cde3b8f-ed08-4fcc-8a36-61e5eedee9fd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:57.227234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8cde3b8f-ed08-4fcc-8a36-61e5eedee9fd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:57.239408 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8cde3b8f-ed08-4fcc-8a36-61e5eedee9fd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1677 microversion: 2.1 time: 0.334043 Oct 27 19:22:57.240271 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3068/6285] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:56 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1677 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:57.445067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-88150118-689f-4081-a7d5-8dbbe7203faf tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:57.445820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-88150118-689f-4081-a7d5-8dbbe7203faf tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:57.463854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88150118-689f-4081-a7d5-8dbbe7203faf tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:57.464572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88150118-689f-4081-a7d5-8dbbe7203faf tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:57.465145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88150118-689f-4081-a7d5-8dbbe7203faf tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:57.467151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88150118-689f-4081-a7d5-8dbbe7203faf tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:57.467748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88150118-689f-4081-a7d5-8dbbe7203faf tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:57.474210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-88150118-689f-4081-a7d5-8dbbe7203faf tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:57.653104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-88150118-689f-4081-a7d5-8dbbe7203faf tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:57.669021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-88150118-689f-4081-a7d5-8dbbe7203faf tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:57.676014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-88150118-689f-4081-a7d5-8dbbe7203faf tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:57.680124 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-88150118-689f-4081-a7d5-8dbbe7203faf tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.238958 Oct 27 19:22:57.683617 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3218/6286] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:57 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:22:58.268482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0a12709d-6192-4370-a531-9daa71feea9a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:58.270659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0a12709d-6192-4370-a531-9daa71feea9a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:58.293397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a12709d-6192-4370-a531-9daa71feea9a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:58.295077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a12709d-6192-4370-a531-9daa71feea9a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:58.299672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a12709d-6192-4370-a531-9daa71feea9a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:58.303647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a12709d-6192-4370-a531-9daa71feea9a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:58.309177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a12709d-6192-4370-a531-9daa71feea9a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:58.310717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a12709d-6192-4370-a531-9daa71feea9a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:58.577203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0a12709d-6192-4370-a531-9daa71feea9a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:58.588244 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0a12709d-6192-4370-a531-9daa71feea9a tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1654 microversion: 2.1 time: 0.324574 Oct 27 19:22:58.589214 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3069/6287] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:58 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1654 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:58.618759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f343cca9-8426-421f-8038-24dc859efee4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:22:58.637550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f343cca9-8426-421f-8038-24dc859efee4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:58.638144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f343cca9-8426-421f-8038-24dc859efee4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:58.638662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f343cca9-8426-421f-8038-24dc859efee4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:58.715312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-585e1437-8cfc-4b16-a9e0-a99d33d93a2e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:58.716722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-585e1437-8cfc-4b16-a9e0-a99d33d93a2e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:58.726652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f343cca9-8426-421f-8038-24dc859efee4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Going to try to start instance {{(pid=127029) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 19:22:58.741202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-585e1437-8cfc-4b16-a9e0-a99d33d93a2e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:58.741202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-585e1437-8cfc-4b16-a9e0-a99d33d93a2e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:58.741202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-585e1437-8cfc-4b16-a9e0-a99d33d93a2e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:58.741202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-585e1437-8cfc-4b16-a9e0-a99d33d93a2e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:58.741202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-585e1437-8cfc-4b16-a9e0-a99d33d93a2e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:58.741202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-585e1437-8cfc-4b16-a9e0-a99d33d93a2e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:58.809022 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f343cca9-8426-421f-8038-24dc859efee4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "POST /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/action" status: 202 len: 0 microversion: 2.1 time: 0.197305 Oct 27 19:22:58.812093 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3219/6288] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:22:58 2022] POST /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:22:58.855702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b4d9a6b3-398b-4a3c-a0e6-5cc0a353ce71 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:58.865585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b4d9a6b3-398b-4a3c-a0e6-5cc0a353ce71 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:58.886117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-585e1437-8cfc-4b16-a9e0-a99d33d93a2e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:58.902454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4d9a6b3-398b-4a3c-a0e6-5cc0a353ce71 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:58.902834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4d9a6b3-398b-4a3c-a0e6-5cc0a353ce71 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:58.903292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4d9a6b3-398b-4a3c-a0e6-5cc0a353ce71 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:58.904028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4d9a6b3-398b-4a3c-a0e6-5cc0a353ce71 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:58.904498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4d9a6b3-398b-4a3c-a0e6-5cc0a353ce71 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:58.904939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-585e1437-8cfc-4b16-a9e0-a99d33d93a2e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:58.905067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4d9a6b3-398b-4a3c-a0e6-5cc0a353ce71 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:58.910824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-585e1437-8cfc-4b16-a9e0-a99d33d93a2e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:58.913527 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-585e1437-8cfc-4b16-a9e0-a99d33d93a2e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.204396 Oct 27 19:22:58.919077 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3070/6289] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:58 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:22:59.877405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4d9a6b3-398b-4a3c-a0e6-5cc0a353ce71 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:22:59.888662 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b4d9a6b3-398b-4a3c-a0e6-5cc0a353ce71 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1663 microversion: 2.1 time: 1.062874 Oct 27 19:22:59.891155 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3220/6290] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:22:58 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1663 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:22:59.951337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ef1d4906-83d6-4387-81ea-39eb56b0466f tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:22:59.952204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ef1d4906-83d6-4387-81ea-39eb56b0466f tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:22:59.960435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef1d4906-83d6-4387-81ea-39eb56b0466f tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:59.961862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef1d4906-83d6-4387-81ea-39eb56b0466f tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:59.962480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef1d4906-83d6-4387-81ea-39eb56b0466f tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:22:59.964570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef1d4906-83d6-4387-81ea-39eb56b0466f tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:22:59.965212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef1d4906-83d6-4387-81ea-39eb56b0466f tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:22:59.965986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef1d4906-83d6-4387-81ea-39eb56b0466f tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:00.058951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ef1d4906-83d6-4387-81ea-39eb56b0466f tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:00.069282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ef1d4906-83d6-4387-81ea-39eb56b0466f tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:00.074334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ef1d4906-83d6-4387-81ea-39eb56b0466f tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:00.077340 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ef1d4906-83d6-4387-81ea-39eb56b0466f tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.130743 Oct 27 19:23:00.081678 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3071/6291] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:22:59 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:23:00.916083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-786baed2-14d4-44ff-b686-86df08bd9674 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:00.916875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-786baed2-14d4-44ff-b686-86df08bd9674 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:00.927804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-786baed2-14d4-44ff-b686-86df08bd9674 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:00.935130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-786baed2-14d4-44ff-b686-86df08bd9674 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:00.935969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-786baed2-14d4-44ff-b686-86df08bd9674 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:00.936997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-786baed2-14d4-44ff-b686-86df08bd9674 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:00.937690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-786baed2-14d4-44ff-b686-86df08bd9674 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:00.938369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-786baed2-14d4-44ff-b686-86df08bd9674 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:00.966449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:01.109186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-65820929-5107-44a9-b5ab-581fae0e1a3b tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:01.110487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-65820929-5107-44a9-b5ab-581fae0e1a3b tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:01.123558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65820929-5107-44a9-b5ab-581fae0e1a3b tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:01.135289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65820929-5107-44a9-b5ab-581fae0e1a3b tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:01.135975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65820929-5107-44a9-b5ab-581fae0e1a3b tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:01.136911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65820929-5107-44a9-b5ab-581fae0e1a3b tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:01.137561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65820929-5107-44a9-b5ab-581fae0e1a3b tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:01.138161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65820929-5107-44a9-b5ab-581fae0e1a3b tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:01.282932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-65820929-5107-44a9-b5ab-581fae0e1a3b tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:01.286200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:01.300319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-65820929-5107-44a9-b5ab-581fae0e1a3b tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:01.304051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-65820929-5107-44a9-b5ab-581fae0e1a3b tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:01.305384 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-65820929-5107-44a9-b5ab-581fae0e1a3b tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.200060 Oct 27 19:23:01.313608 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3072/6292] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:01 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:23:01.337975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-786baed2-14d4-44ff-b686-86df08bd9674 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:01.352866 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-786baed2-14d4-44ff-b686-86df08bd9674 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1667 microversion: 2.1 time: 0.439003 Oct 27 19:23:01.366874 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3221/6293] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:00 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1667 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:23:02.336414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d95b3d19-37d0-41e4-8012-7e8c87b8fced tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:02.337032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d95b3d19-37d0-41e4-8012-7e8c87b8fced tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:02.358004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d95b3d19-37d0-41e4-8012-7e8c87b8fced tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:02.359063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d95b3d19-37d0-41e4-8012-7e8c87b8fced tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:02.359769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d95b3d19-37d0-41e4-8012-7e8c87b8fced tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:02.363505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d95b3d19-37d0-41e4-8012-7e8c87b8fced tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:02.364230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d95b3d19-37d0-41e4-8012-7e8c87b8fced tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:02.364864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d95b3d19-37d0-41e4-8012-7e8c87b8fced tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:02.727588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d95b3d19-37d0-41e4-8012-7e8c87b8fced tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:02.737299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d95b3d19-37d0-41e4-8012-7e8c87b8fced tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:02.747672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d95b3d19-37d0-41e4-8012-7e8c87b8fced tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:02.750594 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d95b3d19-37d0-41e4-8012-7e8c87b8fced tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.418039 Oct 27 19:23:02.751207 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3073/6294] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:02 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:23:03.778939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-57ffaeac-14cb-473b-bfcd-9d116f2bdbe1 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:03.787788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-57ffaeac-14cb-473b-bfcd-9d116f2bdbe1 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:03.812874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57ffaeac-14cb-473b-bfcd-9d116f2bdbe1 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:03.813493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57ffaeac-14cb-473b-bfcd-9d116f2bdbe1 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:03.813953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57ffaeac-14cb-473b-bfcd-9d116f2bdbe1 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:03.821015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57ffaeac-14cb-473b-bfcd-9d116f2bdbe1 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:03.821613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57ffaeac-14cb-473b-bfcd-9d116f2bdbe1 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:03.822081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-57ffaeac-14cb-473b-bfcd-9d116f2bdbe1 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:04.019593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-57ffaeac-14cb-473b-bfcd-9d116f2bdbe1 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:04.039983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-57ffaeac-14cb-473b-bfcd-9d116f2bdbe1 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:04.044632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-57ffaeac-14cb-473b-bfcd-9d116f2bdbe1 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:04.051034 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-57ffaeac-14cb-473b-bfcd-9d116f2bdbe1 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.272957 Oct 27 19:23:04.062843 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3222/6295] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:03 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:23:05.101208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5bbe5f18-bf93-45e7-8af1-50acf1e1bbbd tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:05.102446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5bbe5f18-bf93-45e7-8af1-50acf1e1bbbd tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:05.116175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bbe5f18-bf93-45e7-8af1-50acf1e1bbbd tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:05.117051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bbe5f18-bf93-45e7-8af1-50acf1e1bbbd tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:05.118875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bbe5f18-bf93-45e7-8af1-50acf1e1bbbd tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:05.119796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bbe5f18-bf93-45e7-8af1-50acf1e1bbbd tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:05.120977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bbe5f18-bf93-45e7-8af1-50acf1e1bbbd tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:05.122899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bbe5f18-bf93-45e7-8af1-50acf1e1bbbd tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:05.294968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5bbe5f18-bf93-45e7-8af1-50acf1e1bbbd tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:05.314276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5bbe5f18-bf93-45e7-8af1-50acf1e1bbbd tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:05.320100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5bbe5f18-bf93-45e7-8af1-50acf1e1bbbd tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:05.324531 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5bbe5f18-bf93-45e7-8af1-50acf1e1bbbd tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.248810 Oct 27 19:23:05.326341 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3074/6296] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:05 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:23:06.355558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7c72d40a-cbb3-4648-a48a-30e5237ae336 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:06.356137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7c72d40a-cbb3-4648-a48a-30e5237ae336 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:06.382593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c72d40a-cbb3-4648-a48a-30e5237ae336 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:06.385364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c72d40a-cbb3-4648-a48a-30e5237ae336 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:06.385868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c72d40a-cbb3-4648-a48a-30e5237ae336 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:06.386666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c72d40a-cbb3-4648-a48a-30e5237ae336 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:06.387156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c72d40a-cbb3-4648-a48a-30e5237ae336 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:06.387604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7c72d40a-cbb3-4648-a48a-30e5237ae336 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:06.624079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7c72d40a-cbb3-4648-a48a-30e5237ae336 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:06.638245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7c72d40a-cbb3-4648-a48a-30e5237ae336 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:06.639761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7c72d40a-cbb3-4648-a48a-30e5237ae336 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:06.643560 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7c72d40a-cbb3-4648-a48a-30e5237ae336 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.289628 Oct 27 19:23:06.646685 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3223/6297] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:06 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:23:07.265074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-07c681d6-8be4-4906-910b-92107d46fe91 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:07.273745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-07c681d6-8be4-4906-910b-92107d46fe91 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:07.301574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07c681d6-8be4-4906-910b-92107d46fe91 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:07.302682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07c681d6-8be4-4906-910b-92107d46fe91 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:07.303356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07c681d6-8be4-4906-910b-92107d46fe91 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:07.304373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07c681d6-8be4-4906-910b-92107d46fe91 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:07.306822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07c681d6-8be4-4906-910b-92107d46fe91 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:07.310641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07c681d6-8be4-4906-910b-92107d46fe91 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:07.559780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-07c681d6-8be4-4906-910b-92107d46fe91 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lazy-loading 'services' on Instance uuid 78b83c2e-1b97-42e2-9839-ba55eb15eae4 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:23:07.687951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-58aa7635-1c8f-40ad-945f-35ccf722022d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:07.698310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-58aa7635-1c8f-40ad-945f-35ccf722022d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:07.740131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58aa7635-1c8f-40ad-945f-35ccf722022d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:07.740991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58aa7635-1c8f-40ad-945f-35ccf722022d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:07.756484 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-07c681d6-8be4-4906-910b-92107d46fe91 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "DELETE /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4/os-volume_attachments/1c9e885c-2420-40f5-a12f-9776e4b3f958" status: 202 len: 0 microversion: 2.1 time: 0.516380 Oct 27 19:23:07.756831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58aa7635-1c8f-40ad-945f-35ccf722022d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:07.759420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58aa7635-1c8f-40ad-945f-35ccf722022d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:07.761200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58aa7635-1c8f-40ad-945f-35ccf722022d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:07.762484 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3075/6298] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:23:07 2022] DELETE /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4/os-volume_attachments/1c9e885c-2420-40f5-a12f-9776e4b3f958 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:23:07.777012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58aa7635-1c8f-40ad-945f-35ccf722022d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:07.947184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-58aa7635-1c8f-40ad-945f-35ccf722022d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:07.965161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-58aa7635-1c8f-40ad-945f-35ccf722022d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:07.976824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-58aa7635-1c8f-40ad-945f-35ccf722022d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:07.983717 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-58aa7635-1c8f-40ad-945f-35ccf722022d tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.312539 Oct 27 19:23:07.985469 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3224/6299] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:07 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:23:09.025356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1e4ff49c-c3de-4d25-be3b-5de6648587ba tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:09.027375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1e4ff49c-c3de-4d25-be3b-5de6648587ba tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:09.039831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e4ff49c-c3de-4d25-be3b-5de6648587ba tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:09.041289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e4ff49c-c3de-4d25-be3b-5de6648587ba tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:09.041909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e4ff49c-c3de-4d25-be3b-5de6648587ba tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:09.043114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e4ff49c-c3de-4d25-be3b-5de6648587ba tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:09.043871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e4ff49c-c3de-4d25-be3b-5de6648587ba tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:09.044467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e4ff49c-c3de-4d25-be3b-5de6648587ba tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:09.194843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1e4ff49c-c3de-4d25-be3b-5de6648587ba tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:09.221632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1e4ff49c-c3de-4d25-be3b-5de6648587ba tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:09.223469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1e4ff49c-c3de-4d25-be3b-5de6648587ba tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:09.224893 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1e4ff49c-c3de-4d25-be3b-5de6648587ba tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.204967 Oct 27 19:23:09.227371 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3076/6300] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:09 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:23:09.436971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5394d21c-587c-4f8a-afb1-1df01dfd664d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:09.440480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5394d21c-587c-4f8a-afb1-1df01dfd664d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:09.441079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5394d21c-587c-4f8a-afb1-1df01dfd664d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:09.444458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5394d21c-587c-4f8a-afb1-1df01dfd664d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:09.445367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5394d21c-587c-4f8a-afb1-1df01dfd664d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:09.446925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5394d21c-587c-4f8a-afb1-1df01dfd664d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:09.449421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5394d21c-587c-4f8a-afb1-1df01dfd664d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:09.496721 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5394d21c-587c-4f8a-afb1-1df01dfd664d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.299967 Oct 27 19:23:09.497931 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3225/6301] 10.222.0.42 () {58 vars in 1185 bytes} [Thu Oct 27 19:23:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:23:09.706167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1871796874", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "availability_zone": "nova:n-h1-860687-3", "networks": [{"uuid": "8a88ecad-f8a8-4fdc-ae87-8423c3543303"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:09.821734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] validate_networks() for [('8a88ecad-f8a8-4fdc-ae87-8423c3543303', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:23:10.253460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5c4129d2-cc43-4651-a952-d98c1f602c4e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:10.254257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5c4129d2-cc43-4651-a952-d98c1f602c4e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:10.267179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c4129d2-cc43-4651-a952-d98c1f602c4e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:10.269816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c4129d2-cc43-4651-a952-d98c1f602c4e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:10.270459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c4129d2-cc43-4651-a952-d98c1f602c4e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:10.271366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c4129d2-cc43-4651-a952-d98c1f602c4e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:10.276147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c4129d2-cc43-4651-a952-d98c1f602c4e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:10.276839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5c4129d2-cc43-4651-a952-d98c1f602c4e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:10.428026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5c4129d2-cc43-4651-a952-d98c1f602c4e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:10.438275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5c4129d2-cc43-4651-a952-d98c1f602c4e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:10.451490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5c4129d2-cc43-4651-a952-d98c1f602c4e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:10.455957 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5c4129d2-cc43-4651-a952-d98c1f602c4e tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1365 microversion: 2.57 time: 0.206639 Oct 27 19:23:10.456750 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3226/6302] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:10 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:23:10.478634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:23:10.479106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:23:10.479542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:23:10.479962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:23:10.480389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:23:10.497862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:10.499783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:10.500794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:10.501730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:10.503651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:10.504273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:10.559350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Getting quotas for project 2b11c73f7fb04ae9b898a278a8b9ccdc. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:23:10.571996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Getting quotas for user 7b5fa0bd00e34b40a79b6d11693e7881 and project 2b11c73f7fb04ae9b898a278a8b9ccdc. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:23:10.591409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:23:10.595644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:23:10.694515 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-04d2ef3e-5b84-46bc-b5c7-798aa599bb32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.993186 Oct 27 19:23:10.703597 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3077/6303] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:23:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:23:10.708751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0dc86d49-829d-444a-bed5-6f22cd96eb80 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:10.709617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0dc86d49-829d-444a-bed5-6f22cd96eb80 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:10.852481 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0dc86d49-829d-444a-bed5-6f22cd96eb80 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1329 microversion: 2.1 time: 0.148355 Oct 27 19:23:10.853089 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3227/6304] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:10 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1329 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:23:11.486001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2bd88d3c-19c8-48cb-8927-af2b64868c51 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:11.486784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2bd88d3c-19c8-48cb-8927-af2b64868c51 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:11.501813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bd88d3c-19c8-48cb-8927-af2b64868c51 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:11.504047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bd88d3c-19c8-48cb-8927-af2b64868c51 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:11.504513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bd88d3c-19c8-48cb-8927-af2b64868c51 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:11.507633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bd88d3c-19c8-48cb-8927-af2b64868c51 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:11.510562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bd88d3c-19c8-48cb-8927-af2b64868c51 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:11.511519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bd88d3c-19c8-48cb-8927-af2b64868c51 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:11.679150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2bd88d3c-19c8-48cb-8927-af2b64868c51 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:11.691525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2bd88d3c-19c8-48cb-8927-af2b64868c51 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:11.697410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2bd88d3c-19c8-48cb-8927-af2b64868c51 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:11.698912 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2bd88d3c-19c8-48cb-8927-af2b64868c51 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1371 microversion: 2.57 time: 0.217866 Oct 27 19:23:11.706954 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3078/6305] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:11 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:23:11.881164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5c7f5c0f-503b-46a7-852c-652cb734bfac tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:11.881791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5c7f5c0f-503b-46a7-852c-652cb734bfac tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:12.019867 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5c7f5c0f-503b-46a7-852c-652cb734bfac tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1329 microversion: 2.1 time: 0.139149 Oct 27 19:23:12.022146 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3228/6306] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:11 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1329 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:12.743486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9a318f56-7f13-48a4-9b67-94db89c44706 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:12.744377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9a318f56-7f13-48a4-9b67-94db89c44706 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:12.748800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:12.758583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a318f56-7f13-48a4-9b67-94db89c44706 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:12.760347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a318f56-7f13-48a4-9b67-94db89c44706 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:12.761458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a318f56-7f13-48a4-9b67-94db89c44706 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:12.762366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a318f56-7f13-48a4-9b67-94db89c44706 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:12.762948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a318f56-7f13-48a4-9b67-94db89c44706 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:12.763412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a318f56-7f13-48a4-9b67-94db89c44706 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:12.854482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9a318f56-7f13-48a4-9b67-94db89c44706 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:12.863396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9a318f56-7f13-48a4-9b67-94db89c44706 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:12.865002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9a318f56-7f13-48a4-9b67-94db89c44706 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:12.866289 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9a318f56-7f13-48a4-9b67-94db89c44706 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1371 microversion: 2.57 time: 0.127563 Oct 27 19:23:12.867023 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3079/6307] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:12 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:23:13.045028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c76b13d3-6014-4391-a27d-6b25307d7e2a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:13.045576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c76b13d3-6014-4391-a27d-6b25307d7e2a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:13.052706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c76b13d3-6014-4391-a27d-6b25307d7e2a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:13.053215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c76b13d3-6014-4391-a27d-6b25307d7e2a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:13.053664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c76b13d3-6014-4391-a27d-6b25307d7e2a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:13.059221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c76b13d3-6014-4391-a27d-6b25307d7e2a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:13.060127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c76b13d3-6014-4391-a27d-6b25307d7e2a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:13.060609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c76b13d3-6014-4391-a27d-6b25307d7e2a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:13.147187 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c76b13d3-6014-4391-a27d-6b25307d7e2a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1416 microversion: 2.1 time: 0.105978 Oct 27 19:23:13.159349 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3229/6308] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:13 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1416 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:13.895656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c91e4377-e252-4aaf-ae36-a1ee083d3888 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:13.896280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c91e4377-e252-4aaf-ae36-a1ee083d3888 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:13.907494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c91e4377-e252-4aaf-ae36-a1ee083d3888 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:13.910250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c91e4377-e252-4aaf-ae36-a1ee083d3888 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:13.910919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c91e4377-e252-4aaf-ae36-a1ee083d3888 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:13.915893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c91e4377-e252-4aaf-ae36-a1ee083d3888 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:13.916616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c91e4377-e252-4aaf-ae36-a1ee083d3888 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:13.917425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c91e4377-e252-4aaf-ae36-a1ee083d3888 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:13.926702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-47226995", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c54fdb52-c6a6-4b02-a4d0-b3ddbc58ebc0", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:13.981310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=50 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:14.008379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c91e4377-e252-4aaf-ae36-a1ee083d3888 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:14.019977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c91e4377-e252-4aaf-ae36-a1ee083d3888 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:14.022279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c91e4377-e252-4aaf-ae36-a1ee083d3888 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:14.023756 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c91e4377-e252-4aaf-ae36-a1ee083d3888 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1356 microversion: 2.57 time: 0.133251 Oct 27 19:23:14.024491 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3080/6309] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:13 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1356 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:23:14.062668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-554aeb46-9818-4c64-9900-e88b51aeba2a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:14.063447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-554aeb46-9818-4c64-9900-e88b51aeba2a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:14.079149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-554aeb46-9818-4c64-9900-e88b51aeba2a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:14.082240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-554aeb46-9818-4c64-9900-e88b51aeba2a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:14.083167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-554aeb46-9818-4c64-9900-e88b51aeba2a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:14.091395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-554aeb46-9818-4c64-9900-e88b51aeba2a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:14.094959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-554aeb46-9818-4c64-9900-e88b51aeba2a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:14.099836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-554aeb46-9818-4c64-9900-e88b51aeba2a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:14.131322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] validate_networks() for [('0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:23:14.180128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-554aeb46-9818-4c64-9900-e88b51aeba2a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:23:14.387924 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-554aeb46-9818-4c64-9900-e88b51aeba2a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 204 len: 0 microversion: 2.57 time: 0.329637 Oct 27 19:23:14.391896 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3081/6310] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 19:23:14 2022] DELETE /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 19:23:14.397772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-803646b0-44dd-456b-b2a3-8c35cf1dbb69 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:14.398548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-803646b0-44dd-456b-b2a3-8c35cf1dbb69 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:14.416754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-803646b0-44dd-456b-b2a3-8c35cf1dbb69 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:14.417637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-803646b0-44dd-456b-b2a3-8c35cf1dbb69 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:14.418439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-803646b0-44dd-456b-b2a3-8c35cf1dbb69 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:14.422815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-803646b0-44dd-456b-b2a3-8c35cf1dbb69 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:14.423587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-803646b0-44dd-456b-b2a3-8c35cf1dbb69 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:14.424908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-803646b0-44dd-456b-b2a3-8c35cf1dbb69 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:14.584732 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-803646b0-44dd-456b-b2a3-8c35cf1dbb69 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1422 microversion: 2.1 time: 0.191707 Oct 27 19:23:14.585618 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3082/6311] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:14 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1422 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:14.592852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-73a611a7-c1ae-455c-9c0d-bb0e7e26ef98 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:14.593672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-73a611a7-c1ae-455c-9c0d-bb0e7e26ef98 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:14.608430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73a611a7-c1ae-455c-9c0d-bb0e7e26ef98 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:14.609905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73a611a7-c1ae-455c-9c0d-bb0e7e26ef98 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:14.609905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73a611a7-c1ae-455c-9c0d-bb0e7e26ef98 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:14.617307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73a611a7-c1ae-455c-9c0d-bb0e7e26ef98 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:14.618025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73a611a7-c1ae-455c-9c0d-bb0e7e26ef98 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:14.618682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73a611a7-c1ae-455c-9c0d-bb0e7e26ef98 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:14.710225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-73a611a7-c1ae-455c-9c0d-bb0e7e26ef98 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:14.721751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-73a611a7-c1ae-455c-9c0d-bb0e7e26ef98 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:14.723632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-73a611a7-c1ae-455c-9c0d-bb0e7e26ef98 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:14.725094 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-73a611a7-c1ae-455c-9c0d-bb0e7e26ef98 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1362 microversion: 2.57 time: 0.138168 Oct 27 19:23:14.726632 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3083/6312] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:14 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1362 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:23:15.249452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:23:15.251119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:23:15.252394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:23:15.253689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:23:15.254366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:23:15.270985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:15.271769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:15.272401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:15.273160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:15.273633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:15.274071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:15.308100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:23:15.316797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for user c8e60ff9ab0d45628195f314f1cac791 and project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:23:15.334160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:23:15.336513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c54fdb52-c6a6-4b02-a4d0-b3ddbc58ebc0',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:23:15.421940 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4a5b008e-b334-4b26-b9c0-51f4d45b2adc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.499717 Oct 27 19:23:15.429996 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3230/6313] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:23:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:23:15.435748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-95710cad-29fd-4a30-8b63-ac7148757765 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:15.436377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-95710cad-29fd-4a30-8b63-ac7148757765 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:15.508463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-95710cad-29fd-4a30-8b63-ac7148757765 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:15.516553 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-95710cad-29fd-4a30-8b63-ac7148757765 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1055 microversion: 2.1 time: 0.084941 Oct 27 19:23:15.518344 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3084/6314] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:15 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1055 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:15.613892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5ba2d2d6-1ba3-4a25-b271-08c0f383dae6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:15.615479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5ba2d2d6-1ba3-4a25-b271-08c0f383dae6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:15.625663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ba2d2d6-1ba3-4a25-b271-08c0f383dae6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:15.626294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ba2d2d6-1ba3-4a25-b271-08c0f383dae6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:15.626788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ba2d2d6-1ba3-4a25-b271-08c0f383dae6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:15.627627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ba2d2d6-1ba3-4a25-b271-08c0f383dae6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:15.628099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ba2d2d6-1ba3-4a25-b271-08c0f383dae6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:15.628701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ba2d2d6-1ba3-4a25-b271-08c0f383dae6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:15.753226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-82a20915-7cc9-4a78-bc8c-95652929eac5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:15.754031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-82a20915-7cc9-4a78-bc8c-95652929eac5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:15.767122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82a20915-7cc9-4a78-bc8c-95652929eac5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:15.776493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82a20915-7cc9-4a78-bc8c-95652929eac5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:15.777316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82a20915-7cc9-4a78-bc8c-95652929eac5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:15.778922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82a20915-7cc9-4a78-bc8c-95652929eac5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:15.779608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82a20915-7cc9-4a78-bc8c-95652929eac5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:15.780266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82a20915-7cc9-4a78-bc8c-95652929eac5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:15.876645 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5ba2d2d6-1ba3-4a25-b271-08c0f383dae6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1464 microversion: 2.1 time: 0.267543 Oct 27 19:23:15.877909 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3231/6315] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:15 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1464 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:15.886105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d57955c-7564-4a5b-a4bf-2857799fcd30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:15.886655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0d57955c-7564-4a5b-a4bf-2857799fcd30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:15.891128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-82a20915-7cc9-4a78-bc8c-95652929eac5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:15.901632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-82a20915-7cc9-4a78-bc8c-95652929eac5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:15.903384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-82a20915-7cc9-4a78-bc8c-95652929eac5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:15.904581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d57955c-7564-4a5b-a4bf-2857799fcd30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:15.906200 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-82a20915-7cc9-4a78-bc8c-95652929eac5 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1362 microversion: 2.57 time: 0.158468 Oct 27 19:23:15.907013 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3085/6316] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:15 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 19:23:15.910596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d57955c-7564-4a5b-a4bf-2857799fcd30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:15.911205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d57955c-7564-4a5b-a4bf-2857799fcd30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:15.912034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d57955c-7564-4a5b-a4bf-2857799fcd30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:15.912712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d57955c-7564-4a5b-a4bf-2857799fcd30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:15.913241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d57955c-7564-4a5b-a4bf-2857799fcd30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:15.940943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0d57955c-7564-4a5b-a4bf-2857799fcd30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:23:16.046056 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0d57955c-7564-4a5b-a4bf-2857799fcd30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "DELETE /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 204 len: 0 microversion: 2.1 time: 0.163314 Oct 27 19:23:16.047030 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3232/6317] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:23:15 2022] DELETE /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:23:16.056133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-60eadbfd-7179-4a0a-9dcb-1084d04bfbd5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:16.057068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-60eadbfd-7179-4a0a-9dcb-1084d04bfbd5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:16.063809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60eadbfd-7179-4a0a-9dcb-1084d04bfbd5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:16.065471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60eadbfd-7179-4a0a-9dcb-1084d04bfbd5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:16.066119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60eadbfd-7179-4a0a-9dcb-1084d04bfbd5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:16.067214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60eadbfd-7179-4a0a-9dcb-1084d04bfbd5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:16.067900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60eadbfd-7179-4a0a-9dcb-1084d04bfbd5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:16.068533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60eadbfd-7179-4a0a-9dcb-1084d04bfbd5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:16.241443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-60eadbfd-7179-4a0a-9dcb-1084d04bfbd5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:16.249831 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-60eadbfd-7179-4a0a-9dcb-1084d04bfbd5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1512 microversion: 2.1 time: 0.198283 Oct 27 19:23:16.253337 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3086/6318] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:16 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1512 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:23:16.541877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e65541ef-b4e5-4a63-bbad-a9ec5347e666 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:16.542730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e65541ef-b4e5-4a63-bbad-a9ec5347e666 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:16.550116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e65541ef-b4e5-4a63-bbad-a9ec5347e666 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:16.550981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e65541ef-b4e5-4a63-bbad-a9ec5347e666 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:16.551799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e65541ef-b4e5-4a63-bbad-a9ec5347e666 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:16.553334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e65541ef-b4e5-4a63-bbad-a9ec5347e666 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:16.555110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e65541ef-b4e5-4a63-bbad-a9ec5347e666 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:16.555820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e65541ef-b4e5-4a63-bbad-a9ec5347e666 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:16.666753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e65541ef-b4e5-4a63-bbad-a9ec5347e666 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:16.679814 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e65541ef-b4e5-4a63-bbad-a9ec5347e666 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1059 microversion: 2.1 time: 0.142044 Oct 27 19:23:16.680712 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3233/6319] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:16 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1059 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:16.900441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-9f1027ba-6466-49cb-804e-131105a608e2 req-497e6d73-81db-4b5c-b37a-2cab408da8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f58800b1-fe99-427a-93bf-f5f7eac3315a", "tag": "d69d22d3-1b9e-41c7-b3d6-0842dfa43b60"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:16.905966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d3f5c503-ebc0-4838-803b-8a0745b03c49 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:16.906623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d3f5c503-ebc0-4838-803b-8a0745b03c49 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:16.921999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3f5c503-ebc0-4838-803b-8a0745b03c49 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:16.922528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3f5c503-ebc0-4838-803b-8a0745b03c49 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:16.922976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3f5c503-ebc0-4838-803b-8a0745b03c49 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:16.923731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3f5c503-ebc0-4838-803b-8a0745b03c49 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:16.924189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3f5c503-ebc0-4838-803b-8a0745b03c49 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:16.924624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3f5c503-ebc0-4838-803b-8a0745b03c49 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:16.925807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9f1027ba-6466-49cb-804e-131105a608e2 req-497e6d73-81db-4b5c-b37a-2cab408da8d6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:16.926302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9f1027ba-6466-49cb-804e-131105a608e2 req-497e6d73-81db-4b5c-b37a-2cab408da8d6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:16.926794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9f1027ba-6466-49cb-804e-131105a608e2 req-497e6d73-81db-4b5c-b37a-2cab408da8d6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:16.945796 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-9f1027ba-6466-49cb-804e-131105a608e2 req-497e6d73-81db-4b5c-b37a-2cab408da8d6 service nova] Creating event network-changed:d69d22d3-1b9e-41c7-b3d6-0842dfa43b60 for instance f58800b1-fe99-427a-93bf-f5f7eac3315a on n-h1-860687-3 Oct 27 19:23:16.951515 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-9f1027ba-6466-49cb-804e-131105a608e2 req-497e6d73-81db-4b5c-b37a-2cab408da8d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057614 Oct 27 19:23:16.952861 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3087/6320] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:23:16.960894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:16.962044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:16.971057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:16.972023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:16.972829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:16.973910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:16.974924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:16.976429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:17.026280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:17.027157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:17.027850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:17.028500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lazy-loading 'fault' on Instance uuid 4bdf43eb-d903-4244-821b-084a08e1a28d {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:23:17.083175 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d3f5c503-ebc0-4838-803b-8a0745b03c49 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1464 microversion: 2.1 time: 0.180952 Oct 27 19:23:17.085625 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3234/6321] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:16 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1464 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:17.085812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:17.096336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:17.098343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cebf31f9fcf40b0adc759b87907d191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89273d0089c41bbaf211fed675f938c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:17.100972 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f6bded16-0bef-44b6-9be2-f72f3bfdd1c8 tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 200 len: 1367 microversion: 2.57 time: 0.146852 Oct 27 19:23:17.101735 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3088/6322] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:16 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 19:23:17.278607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-adbad354-f047-4ac7-86c0-81f281781d0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:17.279868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-adbad354-f047-4ac7-86c0-81f281781d0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:17.288443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adbad354-f047-4ac7-86c0-81f281781d0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:17.289240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adbad354-f047-4ac7-86c0-81f281781d0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:17.291296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adbad354-f047-4ac7-86c0-81f281781d0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:17.292091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adbad354-f047-4ac7-86c0-81f281781d0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:17.292589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adbad354-f047-4ac7-86c0-81f281781d0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:17.293047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adbad354-f047-4ac7-86c0-81f281781d0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:17.619501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-adbad354-f047-4ac7-86c0-81f281781d0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:17.628603 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-adbad354-f047-4ac7-86c0-81f281781d0e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1512 microversion: 2.1 time: 0.355151 Oct 27 19:23:17.629354 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3235/6323] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:17 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:23:17.703458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b6ddda19-3ecf-492f-882d-013d1ce45fe8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:17.704120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b6ddda19-3ecf-492f-882d-013d1ce45fe8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:17.711004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6ddda19-3ecf-492f-882d-013d1ce45fe8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:17.711596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6ddda19-3ecf-492f-882d-013d1ce45fe8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:17.712120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6ddda19-3ecf-492f-882d-013d1ce45fe8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:17.712840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6ddda19-3ecf-492f-882d-013d1ce45fe8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:17.713306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6ddda19-3ecf-492f-882d-013d1ce45fe8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:17.713747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6ddda19-3ecf-492f-882d-013d1ce45fe8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:17.718908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:17.802015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6ddda19-3ecf-492f-882d-013d1ce45fe8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:17.820827 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b6ddda19-3ecf-492f-882d-013d1ce45fe8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1107 microversion: 2.1 time: 0.121171 Oct 27 19:23:17.821605 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3089/6324] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:17 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1107 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:18.110613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-402ad713-28ef-432c-a0e8-15392585311d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:18.113344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-402ad713-28ef-432c-a0e8-15392585311d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:18.123119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-402ad713-28ef-432c-a0e8-15392585311d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:18.124095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-402ad713-28ef-432c-a0e8-15392585311d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:18.125656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-402ad713-28ef-432c-a0e8-15392585311d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:18.126825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-402ad713-28ef-432c-a0e8-15392585311d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:18.129046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-402ad713-28ef-432c-a0e8-15392585311d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:18.129594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c4ae8584-c712-4328-a455-67ba0465e65a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:18.130396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c4ae8584-c712-4328-a455-67ba0465e65a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] [instance: 4bdf43eb-d903-4244-821b-084a08e1a28d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:18.130637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-402ad713-28ef-432c-a0e8-15392585311d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:18.148201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ae8584-c712-4328-a455-67ba0465e65a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:18.153189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ae8584-c712-4328-a455-67ba0465e65a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:18.153658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ae8584-c712-4328-a455-67ba0465e65a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:18.154527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ae8584-c712-4328-a455-67ba0465e65a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:18.155006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ae8584-c712-4328-a455-67ba0465e65a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:18.155438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4ae8584-c712-4328-a455-67ba0465e65a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:18.193994 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-c4ae8584-c712-4328-a455-67ba0465e65a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] HTTP exception thrown: Instance 4bdf43eb-d903-4244-821b-084a08e1a28d could not be found. Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c4ae8584-c712-4328-a455-67ba0465e65a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Request method failure captured: Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d HTTP/1.1 Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtp97K9iSycL7wD2gA1XrRgkF8f_d_QGZHlDq0Fls5iDYjf0jwoRrxMmrb6S6eQtG6m3sASKPxIPk7h6_b4XFE06StiG3ifOSk770KSLUcx-3ddQQ7_IM7amhQtEHWkgeiLvfQkx3PZqZad5YvWcnWfeB-vjVRsxdL_sUifaV86h2Qw Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.57 Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: d89273d0089c41bbaf211fed675f938c Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerShowV257Test-1016568464 Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d89273d0089c41bbaf211fed675f938c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d89273d0089c41bbaf211fed675f938c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d89273d0089c41bbaf211fed675f938c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d89273d0089c41bbaf211fed675f938c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerShowV257Test-1016568464 Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: d89273d0089c41bbaf211fed675f938c Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerShowV257Test-1016568464 Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerShowV257Test-1016568464-project Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 5cebf31f9fcf40b0adc759b87907d191 Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerShowV257Test-1016568464-project Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 4bdf43eb-d903-4244-821b-084a08e1a28d could not be found. Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '4bdf43eb-d903-4244-821b-084a08e1a28d'} Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bdf43eb-d903-4244-821b-084a08e1a28d could not be found. Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bdf43eb-d903-4244-821b-084a08e1a28d could not be found. Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:23:18.201165 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:23:18.208275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:23:18.208275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:23:18.208275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:23:18.208275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:23:18.208275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:23:18.208275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bdf43eb-d903-4244-821b-084a08e1a28d could not be found. Oct 27 19:23:18.208275 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:23:18.208275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c4ae8584-c712-4328-a455-67ba0465e65a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] Returning 404 to user: Instance 4bdf43eb-d903-4244-821b-084a08e1a28d could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:23:18.208275 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c4ae8584-c712-4328-a455-67ba0465e65a tempest-ServerShowV257Test-1016568464 tempest-ServerShowV257Test-1016568464-project] 10.222.0.42 "GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d" status: 404 len: 111 microversion: 2.57 time: 0.078537 Oct 27 19:23:18.208275 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3090/6325] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 19:23:18 2022] GET /compute/v2.1/servers/4bdf43eb-d903-4244-821b-084a08e1a28d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 19:23:18.422699 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-402ad713-28ef-432c-a0e8-15392585311d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1464 microversion: 2.1 time: 0.318949 Oct 27 19:23:18.423292 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3236/6326] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:18 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1464 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:18.654629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b62c9ac8-c323-433c-a393-8e123d6da4a5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:18.655271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b62c9ac8-c323-433c-a393-8e123d6da4a5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:18.694137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62c9ac8-c323-433c-a393-8e123d6da4a5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:18.694670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62c9ac8-c323-433c-a393-8e123d6da4a5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:18.695318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62c9ac8-c323-433c-a393-8e123d6da4a5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:18.696209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62c9ac8-c323-433c-a393-8e123d6da4a5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:18.698652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62c9ac8-c323-433c-a393-8e123d6da4a5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:18.699453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62c9ac8-c323-433c-a393-8e123d6da4a5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:18.778109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62c9ac8-c323-433c-a393-8e123d6da4a5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:18.778643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62c9ac8-c323-433c-a393-8e123d6da4a5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:18.779098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b62c9ac8-c323-433c-a393-8e123d6da4a5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:18.780950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-b62c9ac8-c323-433c-a393-8e123d6da4a5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lazy-loading 'fault' on Instance uuid 78b83c2e-1b97-42e2-9839-ba55eb15eae4 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:23:18.848345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-69354fe8-ff0a-467e-a6c6-dff7f3734923 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:18.849084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-69354fe8-ff0a-467e-a6c6-dff7f3734923 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:18.864404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69354fe8-ff0a-467e-a6c6-dff7f3734923 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:18.864928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69354fe8-ff0a-467e-a6c6-dff7f3734923 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:18.865389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69354fe8-ff0a-467e-a6c6-dff7f3734923 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:18.866111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69354fe8-ff0a-467e-a6c6-dff7f3734923 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:18.866611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69354fe8-ff0a-467e-a6c6-dff7f3734923 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:18.867064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69354fe8-ff0a-467e-a6c6-dff7f3734923 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:18.907362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b62c9ac8-c323-433c-a393-8e123d6da4a5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:18.919692 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b62c9ac8-c323-433c-a393-8e123d6da4a5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 200 len: 1307 microversion: 2.1 time: 0.270200 Oct 27 19:23:18.922416 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3091/6327] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:18 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 1307 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:18.969408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-942c5e8a-ab4f-45a0-8665-846aa787f8ee req-b5e5a737-cbeb-4832-9b88-99e5a23bd317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b83c2e-1b97-42e2-9839-ba55eb15eae4", "name": "network-vif-deleted", "tag": "293159bd-f64d-48ab-9d7d-8baf96fdb24d"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:18.986508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-942c5e8a-ab4f-45a0-8665-846aa787f8ee req-b5e5a737-cbeb-4832-9b88-99e5a23bd317 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:18.997619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-69354fe8-ff0a-467e-a6c6-dff7f3734923 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:19.003568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-942c5e8a-ab4f-45a0-8665-846aa787f8ee req-b5e5a737-cbeb-4832-9b88-99e5a23bd317 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:19.010413 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-69354fe8-ff0a-467e-a6c6-dff7f3734923 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1125 microversion: 2.1 time: 0.165542 Oct 27 19:23:19.011151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-942c5e8a-ab4f-45a0-8665-846aa787f8ee req-b5e5a737-cbeb-4832-9b88-99e5a23bd317 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:19.012014 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3237/6328] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:18 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1125 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:19.040433 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-942c5e8a-ab4f-45a0-8665-846aa787f8ee req-b5e5a737-cbeb-4832-9b88-99e5a23bd317 service nova] Creating event network-vif-deleted:293159bd-f64d-48ab-9d7d-8baf96fdb24d for instance 78b83c2e-1b97-42e2-9839-ba55eb15eae4 on n-h2-860687-3 Oct 27 19:23:19.055725 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-942c5e8a-ab4f-45a0-8665-846aa787f8ee req-b5e5a737-cbeb-4832-9b88-99e5a23bd317 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089975 Oct 27 19:23:19.056423 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3092/6329] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:23:19.448722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b8c9ee03-238e-42d6-a4b7-623def9d3313 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:19.449428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b8c9ee03-238e-42d6-a4b7-623def9d3313 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:19.457745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8c9ee03-238e-42d6-a4b7-623def9d3313 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:19.458573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8c9ee03-238e-42d6-a4b7-623def9d3313 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:19.459264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8c9ee03-238e-42d6-a4b7-623def9d3313 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:19.460165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8c9ee03-238e-42d6-a4b7-623def9d3313 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:19.460791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8c9ee03-238e-42d6-a4b7-623def9d3313 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:19.461546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8c9ee03-238e-42d6-a4b7-623def9d3313 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:19.950958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70755cc3-9a40-4bd2-a8ec-a40de6509305 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:19.952546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-70755cc3-9a40-4bd2-a8ec-a40de6509305 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 78b83c2e-1b97-42e2-9839-ba55eb15eae4] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:19.965869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70755cc3-9a40-4bd2-a8ec-a40de6509305 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:19.974307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70755cc3-9a40-4bd2-a8ec-a40de6509305 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:19.974799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70755cc3-9a40-4bd2-a8ec-a40de6509305 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:19.975782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70755cc3-9a40-4bd2-a8ec-a40de6509305 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:19.976423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70755cc3-9a40-4bd2-a8ec-a40de6509305 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:19.977032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70755cc3-9a40-4bd2-a8ec-a40de6509305 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:20.009234 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-70755cc3-9a40-4bd2-a8ec-a40de6509305 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] HTTP exception thrown: Instance 78b83c2e-1b97-42e2-9839-ba55eb15eae4 could not be found. Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70755cc3-9a40-4bd2-a8ec-a40de6509305 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Request method failure captured: Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 HTTP/1.1 Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtnVOxnc1I2SqR9YCi570_uG3vVqs9kuZmPJR98K4oSHpkmku4MlXpufY6BfRo63cu6E6X0SOObcJ9lCBHpFG6Q5m2CrlUzjqAe9zpHRH7NSdd-st4WF8c1P15TGe4bwBnIH92rxZ3MSngHCVq9wSu8lwcIIBs3jfB3wZtUynn5FiAQ Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 94b7b6844fa84531a9582f1440d2e6ff Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesSnapshotTestJSON-406354450 Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/94b7b6844fa84531a9582f1440d2e6ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94b7b6844fa84531a9582f1440d2e6ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_94b7b6844fa84531a9582f1440d2e6ff", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94b7b6844fa84531a9582f1440d2e6ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-VolumesSnapshotTestJSON-406354450 Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 94b7b6844fa84531a9582f1440d2e6ff Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-406354450 Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-VolumesSnapshotTestJSON-406354450-project Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 37142c6d57024d46a6bc92afecda69a2 Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-VolumesSnapshotTestJSON-406354450-project Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 78b83c2e-1b97-42e2-9839-ba55eb15eae4 could not be found. Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '78b83c2e-1b97-42e2-9839-ba55eb15eae4'} Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78b83c2e-1b97-42e2-9839-ba55eb15eae4 could not be found. Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b83c2e-1b97-42e2-9839-ba55eb15eae4 could not be found. Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:23:20.016718 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:23:20.022113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:23:20.022113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:23:20.022113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:23:20.022113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:23:20.022113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:23:20.022113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b83c2e-1b97-42e2-9839-ba55eb15eae4 could not be found. Oct 27 19:23:20.022113 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:23:20.023610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70755cc3-9a40-4bd2-a8ec-a40de6509305 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Returning 404 to user: Instance 78b83c2e-1b97-42e2-9839-ba55eb15eae4 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:23:20.024706 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70755cc3-9a40-4bd2-a8ec-a40de6509305 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4" status: 404 len: 111 microversion: 2.1 time: 0.079263 Oct 27 19:23:20.028335 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3093/6330] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:19 2022] GET /compute/v2.1/servers/78b83c2e-1b97-42e2-9839-ba55eb15eae4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:23:20.053493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6337e7e1-37a4-4522-88e1-c8989f4f634a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:20.056675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6337e7e1-37a4-4522-88e1-c8989f4f634a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:20.067943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6337e7e1-37a4-4522-88e1-c8989f4f634a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:20.071088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6337e7e1-37a4-4522-88e1-c8989f4f634a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:20.071741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6337e7e1-37a4-4522-88e1-c8989f4f634a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:20.074124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6337e7e1-37a4-4522-88e1-c8989f4f634a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:20.076925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6337e7e1-37a4-4522-88e1-c8989f4f634a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:20.077570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6337e7e1-37a4-4522-88e1-c8989f4f634a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:20.204412 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b8c9ee03-238e-42d6-a4b7-623def9d3313 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1464 microversion: 2.1 time: 0.759310 Oct 27 19:23:20.209133 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3238/6331] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:19 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1464 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:20.388324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6337e7e1-37a4-4522-88e1-c8989f4f634a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:20.402778 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6337e7e1-37a4-4522-88e1-c8989f4f634a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1167 microversion: 2.1 time: 0.363789 Oct 27 19:23:20.406095 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3094/6332] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:20 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1167 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:21.234132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dee6ae55-17a3-4887-9f7c-76bd2a65ff91 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:21.234797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dee6ae55-17a3-4887-9f7c-76bd2a65ff91 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:21.245349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dee6ae55-17a3-4887-9f7c-76bd2a65ff91 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:21.250480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dee6ae55-17a3-4887-9f7c-76bd2a65ff91 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:21.250949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dee6ae55-17a3-4887-9f7c-76bd2a65ff91 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:21.251711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dee6ae55-17a3-4887-9f7c-76bd2a65ff91 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:21.252207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dee6ae55-17a3-4887-9f7c-76bd2a65ff91 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:21.252650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dee6ae55-17a3-4887-9f7c-76bd2a65ff91 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:21.431157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-38e60f93-2289-4125-852a-65c144c3c46a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:21.442846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-38e60f93-2289-4125-852a-65c144c3c46a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:21.476342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:21.476342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38e60f93-2289-4125-852a-65c144c3c46a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:21.476342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38e60f93-2289-4125-852a-65c144c3c46a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:21.476342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38e60f93-2289-4125-852a-65c144c3c46a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:21.487862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38e60f93-2289-4125-852a-65c144c3c46a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:21.488481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38e60f93-2289-4125-852a-65c144c3c46a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:21.488948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38e60f93-2289-4125-852a-65c144c3c46a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:21.537670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:21.556562 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dee6ae55-17a3-4887-9f7c-76bd2a65ff91 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1464 microversion: 2.1 time: 0.326670 Oct 27 19:23:21.557723 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3239/6333] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:21 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1464 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:21.575498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-729b9dc8-55ce-42d6-9a76-4efc875f04c3 req-1be9b0bc-420d-4bf6-a111-e4dc4c87c548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06284f8-17bf-4148-ad5c-ecbeb49826a1", "tag": "0443cd1d-de02-4505-9092-085d9ce7b1b3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:21.608718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-729b9dc8-55ce-42d6-9a76-4efc875f04c3 req-1be9b0bc-420d-4bf6-a111-e4dc4c87c548 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:21.609245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-729b9dc8-55ce-42d6-9a76-4efc875f04c3 req-1be9b0bc-420d-4bf6-a111-e4dc4c87c548 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:21.609704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-729b9dc8-55ce-42d6-9a76-4efc875f04c3 req-1be9b0bc-420d-4bf6-a111-e4dc4c87c548 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:21.650484 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-729b9dc8-55ce-42d6-9a76-4efc875f04c3 req-1be9b0bc-420d-4bf6-a111-e4dc4c87c548 service nova] Creating event network-changed:0443cd1d-de02-4505-9092-085d9ce7b1b3 for instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 on n-h2-860687-3 Oct 27 19:23:21.662107 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-729b9dc8-55ce-42d6-9a76-4efc875f04c3 req-1be9b0bc-420d-4bf6-a111-e4dc4c87c548 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102605 Oct 27 19:23:21.670047 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3240/6334] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:23:22.017808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-38e60f93-2289-4125-852a-65c144c3c46a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:22.026888 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-38e60f93-2289-4125-852a-65c144c3c46a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1167 microversion: 2.1 time: 0.599560 Oct 27 19:23:22.027698 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3095/6335] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:21 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1167 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:22.598250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-691899de-fa86-4b64-9ce4-95459f338383 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:22.599667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-691899de-fa86-4b64-9ce4-95459f338383 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:22.618340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-691899de-fa86-4b64-9ce4-95459f338383 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:22.619059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-691899de-fa86-4b64-9ce4-95459f338383 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:22.620579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-691899de-fa86-4b64-9ce4-95459f338383 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:22.621548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-691899de-fa86-4b64-9ce4-95459f338383 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:22.622215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-691899de-fa86-4b64-9ce4-95459f338383 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:22.622983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-691899de-fa86-4b64-9ce4-95459f338383 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:22.949027 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-691899de-fa86-4b64-9ce4-95459f338383 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1464 microversion: 2.1 time: 0.357104 Oct 27 19:23:22.952477 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3241/6336] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:22 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1464 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:23.056677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6b31914-4033-446b-8fda-0dec064d6901 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:23.059105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d6b31914-4033-446b-8fda-0dec064d6901 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:23.073210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6b31914-4033-446b-8fda-0dec064d6901 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:23.087222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6b31914-4033-446b-8fda-0dec064d6901 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:23.088052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6b31914-4033-446b-8fda-0dec064d6901 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:23.089056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6b31914-4033-446b-8fda-0dec064d6901 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:23.089748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6b31914-4033-446b-8fda-0dec064d6901 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:23.090427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6b31914-4033-446b-8fda-0dec064d6901 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:23.535570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d6b31914-4033-446b-8fda-0dec064d6901 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:23.547626 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d6b31914-4033-446b-8fda-0dec064d6901 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1167 microversion: 2.1 time: 0.494929 Oct 27 19:23:23.550032 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3096/6337] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:23 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1167 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:23.982330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-63ed5536-530b-4267-831a-1ad05b2a07e0 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:23.983274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-63ed5536-530b-4267-831a-1ad05b2a07e0 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:24.002993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63ed5536-530b-4267-831a-1ad05b2a07e0 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:24.003625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63ed5536-530b-4267-831a-1ad05b2a07e0 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:24.004315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63ed5536-530b-4267-831a-1ad05b2a07e0 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:24.005779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63ed5536-530b-4267-831a-1ad05b2a07e0 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:24.007531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63ed5536-530b-4267-831a-1ad05b2a07e0 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:24.010600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-63ed5536-530b-4267-831a-1ad05b2a07e0 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:24.331039 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-63ed5536-530b-4267-831a-1ad05b2a07e0 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1464 microversion: 2.1 time: 0.353123 Oct 27 19:23:24.333523 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3242/6338] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:23 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:24.576517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ce673c6-e631-4402-af2b-830880b77f88 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:24.577055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3ce673c6-e631-4402-af2b-830880b77f88 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:24.597013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce673c6-e631-4402-af2b-830880b77f88 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:24.601878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce673c6-e631-4402-af2b-830880b77f88 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:24.602673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce673c6-e631-4402-af2b-830880b77f88 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:24.608805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce673c6-e631-4402-af2b-830880b77f88 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:24.609742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce673c6-e631-4402-af2b-830880b77f88 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:24.610422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ce673c6-e631-4402-af2b-830880b77f88 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:25.248693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ce673c6-e631-4402-af2b-830880b77f88 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:25.271403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-1a21c18b-a5ae-433e-9e90-ac419bc3142c req-a79baff0-e1e2-444c-b5c1-87622c0e41f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58800b1-fe99-427a-93bf-f5f7eac3315a", "name": "network-vif-plugged", "status": "completed", "tag": "d69d22d3-1b9e-41c7-b3d6-0842dfa43b60"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:25.281925 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3ce673c6-e631-4402-af2b-830880b77f88 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1167 microversion: 2.1 time: 0.709794 Oct 27 19:23:25.282566 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3097/6339] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:24 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1167 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:25.290889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:25.298350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1a21c18b-a5ae-433e-9e90-ac419bc3142c req-a79baff0-e1e2-444c-b5c1-87622c0e41f4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:25.299469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1a21c18b-a5ae-433e-9e90-ac419bc3142c req-a79baff0-e1e2-444c-b5c1-87622c0e41f4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:25.300874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1a21c18b-a5ae-433e-9e90-ac419bc3142c req-a79baff0-e1e2-444c-b5c1-87622c0e41f4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:25.330663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=10 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:25.345461 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-1a21c18b-a5ae-433e-9e90-ac419bc3142c req-a79baff0-e1e2-444c-b5c1-87622c0e41f4 service nova] Creating event network-vif-plugged:d69d22d3-1b9e-41c7-b3d6-0842dfa43b60 for instance f58800b1-fe99-427a-93bf-f5f7eac3315a on n-h1-860687-3 Oct 27 19:23:25.365661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9b9c13b-4ade-4f8e-8b4b-86bbfdc4ba2d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:25.366455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c9b9c13b-4ade-4f8e-8b4b-86bbfdc4ba2d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:25.368025 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-1a21c18b-a5ae-433e-9e90-ac419bc3142c req-a79baff0-e1e2-444c-b5c1-87622c0e41f4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102404 Oct 27 19:23:25.371886 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3243/6340] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:23:25.387737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9b9c13b-4ade-4f8e-8b4b-86bbfdc4ba2d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:25.395627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9b9c13b-4ade-4f8e-8b4b-86bbfdc4ba2d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:25.398175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9b9c13b-4ade-4f8e-8b4b-86bbfdc4ba2d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:25.399214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9b9c13b-4ade-4f8e-8b4b-86bbfdc4ba2d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:25.399973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9b9c13b-4ade-4f8e-8b4b-86bbfdc4ba2d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:25.400509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9b9c13b-4ade-4f8e-8b4b-86bbfdc4ba2d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:25.517102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:25.892106 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c9b9c13b-4ade-4f8e-8b4b-86bbfdc4ba2d tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1464 microversion: 2.1 time: 0.536157 Oct 27 19:23:25.907078 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3098/6341] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:25 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1464 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:26.312333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b266d73-c1f8-48aa-b461-70cb38f2e18e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:26.313638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b266d73-c1f8-48aa-b461-70cb38f2e18e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:26.339922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b266d73-c1f8-48aa-b461-70cb38f2e18e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:26.341037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b266d73-c1f8-48aa-b461-70cb38f2e18e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:26.341938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b266d73-c1f8-48aa-b461-70cb38f2e18e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:26.342927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b266d73-c1f8-48aa-b461-70cb38f2e18e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:26.366264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b266d73-c1f8-48aa-b461-70cb38f2e18e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:26.367419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b266d73-c1f8-48aa-b461-70cb38f2e18e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:26.577796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3b266d73-c1f8-48aa-b461-70cb38f2e18e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:26.595227 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b266d73-c1f8-48aa-b461-70cb38f2e18e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1167 microversion: 2.1 time: 0.289392 Oct 27 19:23:26.600437 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3244/6342] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:26 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1167 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:26.948485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ac2b76c7-c3c2-4dc9-97d6-c258c921aaf6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:26.949100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ac2b76c7-c3c2-4dc9-97d6-c258c921aaf6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:26.968014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac2b76c7-c3c2-4dc9-97d6-c258c921aaf6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:26.980827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac2b76c7-c3c2-4dc9-97d6-c258c921aaf6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:26.981475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac2b76c7-c3c2-4dc9-97d6-c258c921aaf6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:26.982368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac2b76c7-c3c2-4dc9-97d6-c258c921aaf6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:26.990574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac2b76c7-c3c2-4dc9-97d6-c258c921aaf6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:26.998827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac2b76c7-c3c2-4dc9-97d6-c258c921aaf6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:27.574455 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ac2b76c7-c3c2-4dc9-97d6-c258c921aaf6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1464 microversion: 2.1 time: 0.629996 Oct 27 19:23:27.576191 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3099/6343] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:26 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1464 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:27.650810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8ec4c849-0fc7-467e-8b5d-4d862ba08959 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:27.655097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8ec4c849-0fc7-467e-8b5d-4d862ba08959 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:27.676856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ec4c849-0fc7-467e-8b5d-4d862ba08959 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:27.677999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ec4c849-0fc7-467e-8b5d-4d862ba08959 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:27.678646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ec4c849-0fc7-467e-8b5d-4d862ba08959 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:27.682632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ec4c849-0fc7-467e-8b5d-4d862ba08959 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:27.683434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ec4c849-0fc7-467e-8b5d-4d862ba08959 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:27.684205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ec4c849-0fc7-467e-8b5d-4d862ba08959 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:28.365020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8ec4c849-0fc7-467e-8b5d-4d862ba08959 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:28.381399 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8ec4c849-0fc7-467e-8b5d-4d862ba08959 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1167 microversion: 2.1 time: 0.742070 Oct 27 19:23:28.382334 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3245/6344] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:27 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1167 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:28.604746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b950539e-2e83-4812-88c8-5c2d1ff34bce tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:28.605997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b950539e-2e83-4812-88c8-5c2d1ff34bce tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:28.621532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b950539e-2e83-4812-88c8-5c2d1ff34bce tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:28.622520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b950539e-2e83-4812-88c8-5c2d1ff34bce tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:28.623544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b950539e-2e83-4812-88c8-5c2d1ff34bce tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:28.633388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b950539e-2e83-4812-88c8-5c2d1ff34bce tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:28.634161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b950539e-2e83-4812-88c8-5c2d1ff34bce tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:28.634662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b950539e-2e83-4812-88c8-5c2d1ff34bce tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:28.945091 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b950539e-2e83-4812-88c8-5c2d1ff34bce tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1650 microversion: 2.1 time: 0.337779 Oct 27 19:23:28.945806 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3100/6345] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:28 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1650 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:28.974559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-587bb0e8-8eb1-49c5-b5e5-affc25a324f2 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:28.975086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-587bb0e8-8eb1-49c5-b5e5-affc25a324f2 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:28.991236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-587bb0e8-8eb1-49c5-b5e5-affc25a324f2 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:28.991744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-587bb0e8-8eb1-49c5-b5e5-affc25a324f2 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:28.992194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-587bb0e8-8eb1-49c5-b5e5-affc25a324f2 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:28.993324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-587bb0e8-8eb1-49c5-b5e5-affc25a324f2 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:28.993441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-587bb0e8-8eb1-49c5-b5e5-affc25a324f2 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:28.993806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-587bb0e8-8eb1-49c5-b5e5-affc25a324f2 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:29.412624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7fc9de87-337f-4376-a20d-e22812a95ffb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:29.417702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7fc9de87-337f-4376-a20d-e22812a95ffb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:29.449246 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-587bb0e8-8eb1-49c5-b5e5-affc25a324f2 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1650 microversion: 2.1 time: 0.480720 Oct 27 19:23:29.450461 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3246/6346] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:28 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1650 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:29.455906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc9de87-337f-4376-a20d-e22812a95ffb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:29.456586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc9de87-337f-4376-a20d-e22812a95ffb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:29.457040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc9de87-337f-4376-a20d-e22812a95ffb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:29.471880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc9de87-337f-4376-a20d-e22812a95ffb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:29.473342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc9de87-337f-4376-a20d-e22812a95ffb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:29.476189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fc9de87-337f-4376-a20d-e22812a95ffb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:29.477236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5df656ab-7946-4796-bd37-eb1c15d29922 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:29.478051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5df656ab-7946-4796-bd37-eb1c15d29922 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:29.494110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5df656ab-7946-4796-bd37-eb1c15d29922 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:29.494902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5df656ab-7946-4796-bd37-eb1c15d29922 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:29.495506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5df656ab-7946-4796-bd37-eb1c15d29922 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:29.496374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5df656ab-7946-4796-bd37-eb1c15d29922 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:29.496991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5df656ab-7946-4796-bd37-eb1c15d29922 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:29.497592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5df656ab-7946-4796-bd37-eb1c15d29922 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:29.732002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7fc9de87-337f-4376-a20d-e22812a95ffb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:29.757049 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7fc9de87-337f-4376-a20d-e22812a95ffb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1167 microversion: 2.1 time: 0.354896 Oct 27 19:23:29.778231 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3101/6347] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:29 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1167 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:30.078571 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5df656ab-7946-4796-bd37-eb1c15d29922 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1650 microversion: 2.1 time: 0.607359 Oct 27 19:23:30.083897 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3247/6348] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:29 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1650 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:30.345780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2129439251", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "availability_zone": "nova:n-h2-860687-3", "networks": [{"uuid": "8a88ecad-f8a8-4fdc-ae87-8423c3543303"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:30.491981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] validate_networks() for [('8a88ecad-f8a8-4fdc-ae87-8423c3543303', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:23:30.783518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-521c6fea-f14a-4ff2-8972-bf3cb1bacec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:30.784275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-521c6fea-f14a-4ff2-8972-bf3cb1bacec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:30.800827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-521c6fea-f14a-4ff2-8972-bf3cb1bacec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:30.801348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-521c6fea-f14a-4ff2-8972-bf3cb1bacec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:30.801804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-521c6fea-f14a-4ff2-8972-bf3cb1bacec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:30.802582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-521c6fea-f14a-4ff2-8972-bf3cb1bacec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:30.803058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-521c6fea-f14a-4ff2-8972-bf3cb1bacec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:30.803506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-521c6fea-f14a-4ff2-8972-bf3cb1bacec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:31.672347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:23:31.672900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:23:31.673801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:23:31.674419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:23:31.675275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:23:31.709068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:31.710548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:31.717655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:31.730576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:31.731519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:31.732004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:31.768446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Getting quotas for project 2b11c73f7fb04ae9b898a278a8b9ccdc. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:23:31.801415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Getting quotas for user 7b5fa0bd00e34b40a79b6d11693e7881 and project 2b11c73f7fb04ae9b898a278a8b9ccdc. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:23:31.848441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:23:31.851941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-521c6fea-f14a-4ff2-8972-bf3cb1bacec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:31.857160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:23:31.873230 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-521c6fea-f14a-4ff2-8972-bf3cb1bacec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1167 microversion: 2.1 time: 1.088516 Oct 27 19:23:31.874692 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3248/6349] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:30 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1167 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:31.886104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b51b2532-b1ba-42dd-a2f8-5fb6e29d4e39 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:31.886771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b51b2532-b1ba-42dd-a2f8-5fb6e29d4e39 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:31.896851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b51b2532-b1ba-42dd-a2f8-5fb6e29d4e39 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:31.897614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b51b2532-b1ba-42dd-a2f8-5fb6e29d4e39 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:31.898675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b51b2532-b1ba-42dd-a2f8-5fb6e29d4e39 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:31.899741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b51b2532-b1ba-42dd-a2f8-5fb6e29d4e39 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:31.900503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b51b2532-b1ba-42dd-a2f8-5fb6e29d4e39 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:31.901211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b51b2532-b1ba-42dd-a2f8-5fb6e29d4e39 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:31.950000 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5b65da6f-1b18-4d89-ab6f-01d47c57ea16 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.608397 Oct 27 19:23:31.951253 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3102/6350] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:23:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:23:31.965642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b3a99352-2a1c-4f9c-becf-e247853ce872 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:31.971445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b3a99352-2a1c-4f9c-becf-e247853ce872 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:32.155829 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b3a99352-2a1c-4f9c-becf-e247853ce872 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1329 microversion: 2.1 time: 0.196103 Oct 27 19:23:32.168258 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3103/6351] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:31 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1329 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:32.286262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-436457549", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "a14a6484-4993-4bbf-9fd6-3902fa29ac2a"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:32.369057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] validate_networks() for [('a14a6484-4993-4bbf-9fd6-3902fa29ac2a', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:23:32.428852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b51b2532-b1ba-42dd-a2f8-5fb6e29d4e39 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:32.437918 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b51b2532-b1ba-42dd-a2f8-5fb6e29d4e39 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1683 microversion: 2.1 time: 0.560024 Oct 27 19:23:32.438529 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3249/6352] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:31 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1683 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:32.685968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6ba906de-807e-447b-8a04-c1a0ef380cc4 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:32.689972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6ba906de-807e-447b-8a04-c1a0ef380cc4 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:32.724848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ba906de-807e-447b-8a04-c1a0ef380cc4 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:32.731302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ba906de-807e-447b-8a04-c1a0ef380cc4 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:32.732207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ba906de-807e-447b-8a04-c1a0ef380cc4 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:32.733197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ba906de-807e-447b-8a04-c1a0ef380cc4 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:32.739444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ba906de-807e-447b-8a04-c1a0ef380cc4 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:32.744445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6ba906de-807e-447b-8a04-c1a0ef380cc4 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:32.857395 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6ba906de-807e-447b-8a04-c1a0ef380cc4 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef/action" status: 200 len: 32637 microversion: 2.1 time: 0.178434 Oct 27 19:23:32.866796 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3250/6353] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:23:32 2022] POST /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef/action => generated 32637 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:23:32.900380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-efe52acd-0177-4685-b289-911c45554fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:32.901085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-efe52acd-0177-4685-b289-911c45554fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:32.922216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efe52acd-0177-4685-b289-911c45554fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:32.923038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efe52acd-0177-4685-b289-911c45554fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:32.924940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efe52acd-0177-4685-b289-911c45554fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:32.932970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efe52acd-0177-4685-b289-911c45554fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:32.936245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efe52acd-0177-4685-b289-911c45554fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:32.936928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-efe52acd-0177-4685-b289-911c45554fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:33.228604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:23:33.229034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:23:33.229410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:23:33.229838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:23:33.230471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:23:33.256665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:33.257792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:33.258877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:33.260162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:33.260810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:33.261404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:33.308125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Getting quotas for project 94b7b6844fa84531a9582f1440d2e6ff. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:23:33.320154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Getting quotas for user 37142c6d57024d46a6bc92afecda69a2 and project 94b7b6844fa84531a9582f1440d2e6ff. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:23:33.361951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:23:33.367046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:23:33.467776 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-574d6b60-c222-44c0-aa91-285ba70a2577 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.213318 Oct 27 19:23:33.468413 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3104/6354] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:23:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:23:33.474169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5aefe344-a263-4977-ac66-811bdc20fb82 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:33.476296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5aefe344-a263-4977-ac66-811bdc20fb82 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:33.493070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aefe344-a263-4977-ac66-811bdc20fb82 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:33.493308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aefe344-a263-4977-ac66-811bdc20fb82 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:33.493941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aefe344-a263-4977-ac66-811bdc20fb82 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:33.494858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aefe344-a263-4977-ac66-811bdc20fb82 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:33.495323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aefe344-a263-4977-ac66-811bdc20fb82 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:33.495757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5aefe344-a263-4977-ac66-811bdc20fb82 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:33.512170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-efe52acd-0177-4685-b289-911c45554fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:33.551253 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-efe52acd-0177-4685-b289-911c45554fdc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1167 microversion: 2.1 time: 0.658539 Oct 27 19:23:33.563167 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3251/6355] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:32 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1167 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:23:33.589467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f3cc54bb-468b-46ff-9e48-44bd703658d8 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:33.596165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f3cc54bb-468b-46ff-9e48-44bd703658d8 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:33.617021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3cc54bb-468b-46ff-9e48-44bd703658d8 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:33.617544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3cc54bb-468b-46ff-9e48-44bd703658d8 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:33.618531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3cc54bb-468b-46ff-9e48-44bd703658d8 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:33.618753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3cc54bb-468b-46ff-9e48-44bd703658d8 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:33.619221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3cc54bb-468b-46ff-9e48-44bd703658d8 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:33.619662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f3cc54bb-468b-46ff-9e48-44bd703658d8 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:33.759018 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5aefe344-a263-4977-ac66-811bdc20fb82 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1834 microversion: 2.1 time: 0.288346 Oct 27 19:23:33.771092 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3105/6356] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:33 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1834 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:33.800369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5b109fdf-296a-43da-b884-b1a7463da859 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:33.802371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5b109fdf-296a-43da-b884-b1a7463da859 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:33.840207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:33.843265 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f3cc54bb-468b-46ff-9e48-44bd703658d8 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1338 microversion: 2.1 time: 0.273202 Oct 27 19:23:33.844367 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3252/6357] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:33 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1338 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:33.871502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c7d4d394-44b6-4cc9-b480-e46786257055 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:33.874082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c7d4d394-44b6-4cc9-b480-e46786257055 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:33.914859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7d4d394-44b6-4cc9-b480-e46786257055 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:33.916891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7d4d394-44b6-4cc9-b480-e46786257055 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:33.918622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7d4d394-44b6-4cc9-b480-e46786257055 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:33.921126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7d4d394-44b6-4cc9-b480-e46786257055 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:33.922287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7d4d394-44b6-4cc9-b480-e46786257055 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:33.923886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7d4d394-44b6-4cc9-b480-e46786257055 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:33.972229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5b109fdf-296a-43da-b884-b1a7463da859 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:33.980303 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5b109fdf-296a-43da-b884-b1a7463da859 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1218 microversion: 2.1 time: 0.207814 Oct 27 19:23:33.981985 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3106/6358] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:33 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:34.012378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-c7d4d394-44b6-4cc9-b480-e46786257055 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lazy-loading 'flavor' on Instance uuid f41df1a5-196c-454a-b18d-3229ee0b41ef {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:23:34.031734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c7d4d394-44b6-4cc9-b480-e46786257055 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Going to try to live migrate instance to another host {{(pid=127029) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 19:23:34.441941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e4f9bf65-98e3-4299-972d-dddb83014f56 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:34.446579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e4f9bf65-98e3-4299-972d-dddb83014f56 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:34.463427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4f9bf65-98e3-4299-972d-dddb83014f56 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:34.466995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4f9bf65-98e3-4299-972d-dddb83014f56 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:34.466995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4f9bf65-98e3-4299-972d-dddb83014f56 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:34.468066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4f9bf65-98e3-4299-972d-dddb83014f56 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:34.469313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4f9bf65-98e3-4299-972d-dddb83014f56 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:34.474090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4f9bf65-98e3-4299-972d-dddb83014f56 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:34.588804 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e4f9bf65-98e3-4299-972d-dddb83014f56 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.147885 Oct 27 19:23:34.591500 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3107/6359] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:23:34 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 19:23:34.607283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a97ad7bd-6a86-481d-a1d0-df88942a8607 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:34.615976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a97ad7bd-6a86-481d-a1d0-df88942a8607 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:34.634041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a97ad7bd-6a86-481d-a1d0-df88942a8607 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:34.634597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a97ad7bd-6a86-481d-a1d0-df88942a8607 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:34.635056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a97ad7bd-6a86-481d-a1d0-df88942a8607 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:34.635784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a97ad7bd-6a86-481d-a1d0-df88942a8607 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:34.636261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a97ad7bd-6a86-481d-a1d0-df88942a8607 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:34.636703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a97ad7bd-6a86-481d-a1d0-df88942a8607 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:34.915597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a97ad7bd-6a86-481d-a1d0-df88942a8607 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:34.942271 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a97ad7bd-6a86-481d-a1d0-df88942a8607 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1167 microversion: 2.1 time: 0.344218 Oct 27 19:23:34.944685 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3108/6360] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:34 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1167 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:34.965550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6910f3d4-d570-482c-836a-721d4da906b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:34.968626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6910f3d4-d570-482c-836a-721d4da906b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:35.005872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6910f3d4-d570-482c-836a-721d4da906b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:35.006944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6910f3d4-d570-482c-836a-721d4da906b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:35.011059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6910f3d4-d570-482c-836a-721d4da906b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:35.011884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6910f3d4-d570-482c-836a-721d4da906b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:35.012302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6910f3d4-d570-482c-836a-721d4da906b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:35.013379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6910f3d4-d570-482c-836a-721d4da906b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:35.064456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6910f3d4-d570-482c-836a-721d4da906b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:23:35.121673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:35.290645 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6910f3d4-d570-482c-836a-721d4da906b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "DELETE /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 204 len: 0 microversion: 2.1 time: 0.342963 Oct 27 19:23:35.293569 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3109/6361] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:23:34 2022] DELETE /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:23:35.320534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-921a74e4-2759-40f5-88b7-0e0544838216 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:35.323077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-921a74e4-2759-40f5-88b7-0e0544838216 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:35.341838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-921a74e4-2759-40f5-88b7-0e0544838216 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:35.346222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-921a74e4-2759-40f5-88b7-0e0544838216 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:35.346931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-921a74e4-2759-40f5-88b7-0e0544838216 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:35.350242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-921a74e4-2759-40f5-88b7-0e0544838216 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:35.351170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-921a74e4-2759-40f5-88b7-0e0544838216 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:35.353162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-921a74e4-2759-40f5-88b7-0e0544838216 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:35.600818 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-921a74e4-2759-40f5-88b7-0e0544838216 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1434 microversion: 2.1 time: 0.302619 Oct 27 19:23:35.603302 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3110/6362] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:35 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1434 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:35.624365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e7518b3f-6146-444e-95ca-58711e730c2c tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:35.625008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e7518b3f-6146-444e-95ca-58711e730c2c tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:35.634686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7518b3f-6146-444e-95ca-58711e730c2c tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:35.635456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7518b3f-6146-444e-95ca-58711e730c2c tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:35.636061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7518b3f-6146-444e-95ca-58711e730c2c tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:35.637118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7518b3f-6146-444e-95ca-58711e730c2c tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:35.637756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7518b3f-6146-444e-95ca-58711e730c2c tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:35.638587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7518b3f-6146-444e-95ca-58711e730c2c tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:35.737183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e7518b3f-6146-444e-95ca-58711e730c2c tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:35.747967 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e7518b3f-6146-444e-95ca-58711e730c2c tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1278 microversion: 2.1 time: 0.127505 Oct 27 19:23:35.748569 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3111/6363] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:35 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1278 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:35.763272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-30faf704-d8d2-4f98-8d8b-baf6071d5230 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:35.764847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-30faf704-d8d2-4f98-8d8b-baf6071d5230 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:35.773164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30faf704-d8d2-4f98-8d8b-baf6071d5230 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:35.773687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30faf704-d8d2-4f98-8d8b-baf6071d5230 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:35.774180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30faf704-d8d2-4f98-8d8b-baf6071d5230 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:35.774950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30faf704-d8d2-4f98-8d8b-baf6071d5230 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:35.775418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30faf704-d8d2-4f98-8d8b-baf6071d5230 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:35.776152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30faf704-d8d2-4f98-8d8b-baf6071d5230 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:36.148451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-30faf704-d8d2-4f98-8d8b-baf6071d5230 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:36.178461 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-30faf704-d8d2-4f98-8d8b-baf6071d5230 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1673 microversion: 2.1 time: 0.428774 Oct 27 19:23:36.183069 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3112/6364] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:35 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1673 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:36.204508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-146a3007-0559-4517-89ec-8b5fb7274758 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:36.205988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-146a3007-0559-4517-89ec-8b5fb7274758 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:36.219390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-146a3007-0559-4517-89ec-8b5fb7274758 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:36.225252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-146a3007-0559-4517-89ec-8b5fb7274758 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:36.226689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-146a3007-0559-4517-89ec-8b5fb7274758 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:36.229974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-146a3007-0559-4517-89ec-8b5fb7274758 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:36.231936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-146a3007-0559-4517-89ec-8b5fb7274758 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:36.233983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-146a3007-0559-4517-89ec-8b5fb7274758 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:36.557131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-146a3007-0559-4517-89ec-8b5fb7274758 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:36.588741 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-146a3007-0559-4517-89ec-8b5fb7274758 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1167 microversion: 2.1 time: 0.392652 Oct 27 19:23:36.590543 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3113/6365] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:36 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1167 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:36.628596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f778b72f-ee1d-4c30-8a22-c9f935086242 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:36.630236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f778b72f-ee1d-4c30-8a22-c9f935086242 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:36.639477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f778b72f-ee1d-4c30-8a22-c9f935086242 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:36.641117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f778b72f-ee1d-4c30-8a22-c9f935086242 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:36.643125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f778b72f-ee1d-4c30-8a22-c9f935086242 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:36.644821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f778b72f-ee1d-4c30-8a22-c9f935086242 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:36.646189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f778b72f-ee1d-4c30-8a22-c9f935086242 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:36.646882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f778b72f-ee1d-4c30-8a22-c9f935086242 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:36.950059 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f778b72f-ee1d-4c30-8a22-c9f935086242 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1464 microversion: 2.1 time: 0.327180 Oct 27 19:23:36.954320 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3114/6366] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:36 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1464 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:36.961773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ca90be21-59e6-44cf-971d-600df7c7b0b5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:36.974673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ca90be21-59e6-44cf-971d-600df7c7b0b5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:37.022841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca90be21-59e6-44cf-971d-600df7c7b0b5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:37.027098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca90be21-59e6-44cf-971d-600df7c7b0b5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:37.027816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca90be21-59e6-44cf-971d-600df7c7b0b5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:37.030371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca90be21-59e6-44cf-971d-600df7c7b0b5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:37.034827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca90be21-59e6-44cf-971d-600df7c7b0b5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:37.044928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca90be21-59e6-44cf-971d-600df7c7b0b5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:37.536096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ca90be21-59e6-44cf-971d-600df7c7b0b5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:37.548833 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ca90be21-59e6-44cf-971d-600df7c7b0b5 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1278 microversion: 2.1 time: 0.590701 Oct 27 19:23:37.551146 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3115/6367] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:36 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1278 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:37.579313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c4999cf0-2c0b-4fe4-bcde-91c8075c2db0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:37.582181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c4999cf0-2c0b-4fe4-bcde-91c8075c2db0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:37.604548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4999cf0-2c0b-4fe4-bcde-91c8075c2db0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:37.605139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4999cf0-2c0b-4fe4-bcde-91c8075c2db0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:37.605784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4999cf0-2c0b-4fe4-bcde-91c8075c2db0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:37.606732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4999cf0-2c0b-4fe4-bcde-91c8075c2db0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:37.607356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4999cf0-2c0b-4fe4-bcde-91c8075c2db0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:37.607952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4999cf0-2c0b-4fe4-bcde-91c8075c2db0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:38.805831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c4999cf0-2c0b-4fe4-bcde-91c8075c2db0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:38.817437 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c4999cf0-2c0b-4fe4-bcde-91c8075c2db0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1673 microversion: 2.1 time: 1.262733 Oct 27 19:23:38.820112 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3116/6368] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:37 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1673 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:38.832318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-796420d9-903f-4e8f-b82a-e2caa5fbe2b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:38.833094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-796420d9-903f-4e8f-b82a-e2caa5fbe2b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:38.846876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-796420d9-903f-4e8f-b82a-e2caa5fbe2b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:38.847391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-796420d9-903f-4e8f-b82a-e2caa5fbe2b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:38.847845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-796420d9-903f-4e8f-b82a-e2caa5fbe2b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:38.848583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-796420d9-903f-4e8f-b82a-e2caa5fbe2b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:38.856747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-796420d9-903f-4e8f-b82a-e2caa5fbe2b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:38.857305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-796420d9-903f-4e8f-b82a-e2caa5fbe2b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:39.964718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-796420d9-903f-4e8f-b82a-e2caa5fbe2b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:39.985504 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-796420d9-903f-4e8f-b82a-e2caa5fbe2b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1167 microversion: 2.1 time: 1.164269 Oct 27 19:23:39.990673 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3117/6369] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:38 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1167 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:40.010104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b36c68fe-1235-4e28-bc7c-ab6f341e4192 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:40.011189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b36c68fe-1235-4e28-bc7c-ab6f341e4192 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:40.024358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b36c68fe-1235-4e28-bc7c-ab6f341e4192 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:40.026317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b36c68fe-1235-4e28-bc7c-ab6f341e4192 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:40.027632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b36c68fe-1235-4e28-bc7c-ab6f341e4192 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:40.030249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b36c68fe-1235-4e28-bc7c-ab6f341e4192 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:40.033679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b36c68fe-1235-4e28-bc7c-ab6f341e4192 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:40.036955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b36c68fe-1235-4e28-bc7c-ab6f341e4192 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:40.412054 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b36c68fe-1235-4e28-bc7c-ab6f341e4192 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1464 microversion: 2.1 time: 0.419787 Oct 27 19:23:40.412692 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3118/6370] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:39 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1464 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:40.426835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-653b4373-eba8-4a9b-b569-3b8fbf468203 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:40.427466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-653b4373-eba8-4a9b-b569-3b8fbf468203 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:40.458015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653b4373-eba8-4a9b-b569-3b8fbf468203 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:40.459198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653b4373-eba8-4a9b-b569-3b8fbf468203 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:40.462785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653b4373-eba8-4a9b-b569-3b8fbf468203 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:40.465993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653b4373-eba8-4a9b-b569-3b8fbf468203 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:40.468208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653b4373-eba8-4a9b-b569-3b8fbf468203 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:40.469033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653b4373-eba8-4a9b-b569-3b8fbf468203 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:40.702252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-653b4373-eba8-4a9b-b569-3b8fbf468203 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:40.718148 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-653b4373-eba8-4a9b-b569-3b8fbf468203 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1276 microversion: 2.1 time: 0.295636 Oct 27 19:23:40.721641 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3119/6371] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:40 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1276 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:40.741091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb1024b6-18fe-4338-bc6a-bf9e65a1f79f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:40.744428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cb1024b6-18fe-4338-bc6a-bf9e65a1f79f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:40.772697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb1024b6-18fe-4338-bc6a-bf9e65a1f79f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:40.775115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb1024b6-18fe-4338-bc6a-bf9e65a1f79f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:40.775881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb1024b6-18fe-4338-bc6a-bf9e65a1f79f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:40.777550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb1024b6-18fe-4338-bc6a-bf9e65a1f79f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:40.781517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb1024b6-18fe-4338-bc6a-bf9e65a1f79f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:40.787006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb1024b6-18fe-4338-bc6a-bf9e65a1f79f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:40.792269 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c7d4d394-44b6-4cc9-b480-e46786257055 tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef/action" status: 202 len: 0 microversion: 2.1 time: 6.941766 Oct 27 19:23:40.793339 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3253/6372] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:23:33 2022] POST /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef/action => generated 0 bytes in 6948 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:23:40.802479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7caf9336-b3cf-495e-8ec9-aa1d8d0aafba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:40.803205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7caf9336-b3cf-495e-8ec9-aa1d8d0aafba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:40.821053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7caf9336-b3cf-495e-8ec9-aa1d8d0aafba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:40.824110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7caf9336-b3cf-495e-8ec9-aa1d8d0aafba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:40.824637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7caf9336-b3cf-495e-8ec9-aa1d8d0aafba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:40.825401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7caf9336-b3cf-495e-8ec9-aa1d8d0aafba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:40.835964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7caf9336-b3cf-495e-8ec9-aa1d8d0aafba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:40.836745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7caf9336-b3cf-495e-8ec9-aa1d8d0aafba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:41.354560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cb1024b6-18fe-4338-bc6a-bf9e65a1f79f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:41.408032 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cb1024b6-18fe-4338-bc6a-bf9e65a1f79f tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1673 microversion: 2.1 time: 0.684819 Oct 27 19:23:41.429939 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3120/6373] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:40 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1673 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:41.461476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-29f167b0-4730-4c84-adf2-0b6238ef8157 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:41.462164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-29f167b0-4730-4c84-adf2-0b6238ef8157 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:41.480166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29f167b0-4730-4c84-adf2-0b6238ef8157 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:41.481586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29f167b0-4730-4c84-adf2-0b6238ef8157 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:41.482291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29f167b0-4730-4c84-adf2-0b6238ef8157 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:41.483263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29f167b0-4730-4c84-adf2-0b6238ef8157 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:41.483937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29f167b0-4730-4c84-adf2-0b6238ef8157 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:41.484745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29f167b0-4730-4c84-adf2-0b6238ef8157 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:41.535890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7caf9336-b3cf-495e-8ec9-aa1d8d0aafba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:41.546119 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7caf9336-b3cf-495e-8ec9-aa1d8d0aafba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1693 microversion: 2.1 time: 0.747946 Oct 27 19:23:41.570095 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3254/6374] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:40 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1693 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:41.590563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ad33a746-2ad1-4987-ac1c-e1df471c2c39 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:41.591379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ad33a746-2ad1-4987-ac1c-e1df471c2c39 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:41.604990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad33a746-2ad1-4987-ac1c-e1df471c2c39 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:41.609106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad33a746-2ad1-4987-ac1c-e1df471c2c39 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:41.609771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad33a746-2ad1-4987-ac1c-e1df471c2c39 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:41.610720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad33a746-2ad1-4987-ac1c-e1df471c2c39 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:41.614781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad33a746-2ad1-4987-ac1c-e1df471c2c39 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:41.615342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad33a746-2ad1-4987-ac1c-e1df471c2c39 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:41.952770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-29f167b0-4730-4c84-adf2-0b6238ef8157 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:41.968885 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-29f167b0-4730-4c84-adf2-0b6238ef8157 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1167 microversion: 2.1 time: 0.534500 Oct 27 19:23:41.970607 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3121/6375] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:41 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1167 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:41.984357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc16e1c3-9e30-49a7-979a-d411abf1c0c6 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:41.985543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fc16e1c3-9e30-49a7-979a-d411abf1c0c6 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:41.997945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc16e1c3-9e30-49a7-979a-d411abf1c0c6 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:42.000911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc16e1c3-9e30-49a7-979a-d411abf1c0c6 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:42.002642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc16e1c3-9e30-49a7-979a-d411abf1c0c6 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:42.003665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc16e1c3-9e30-49a7-979a-d411abf1c0c6 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:42.007119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc16e1c3-9e30-49a7-979a-d411abf1c0c6 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:42.007869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc16e1c3-9e30-49a7-979a-d411abf1c0c6 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:42.427102 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ad33a746-2ad1-4987-ac1c-e1df471c2c39 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1464 microversion: 2.1 time: 0.855290 Oct 27 19:23:42.430062 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3255/6376] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:41 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1464 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:42.444054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d204a790-d6d8-49c9-9031-8058737d0e41 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:42.444857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d204a790-d6d8-49c9-9031-8058737d0e41 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:42.456296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d204a790-d6d8-49c9-9031-8058737d0e41 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:42.460401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d204a790-d6d8-49c9-9031-8058737d0e41 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:42.461619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d204a790-d6d8-49c9-9031-8058737d0e41 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:42.463966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d204a790-d6d8-49c9-9031-8058737d0e41 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:42.466072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d204a790-d6d8-49c9-9031-8058737d0e41 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:42.466704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d204a790-d6d8-49c9-9031-8058737d0e41 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:42.521469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:42.838661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc16e1c3-9e30-49a7-979a-d411abf1c0c6 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:42.855625 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc16e1c3-9e30-49a7-979a-d411abf1c0c6 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1318 microversion: 2.1 time: 0.883182 Oct 27 19:23:42.856873 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3122/6377] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:41 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1318 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:42.878321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-6eee77e3-f481-425e-8c70-fbf61dd3510a req-85702d4c-7d11-4420-9d6f-3d6f1db608dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db56aa8c-7a19-4910-8226-c70ac28faf8d", "name": "network-vif-deleted", "tag": "7f955ef2-2fab-4400-923d-9b32e09953a9"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:42.893208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6eee77e3-f481-425e-8c70-fbf61dd3510a req-85702d4c-7d11-4420-9d6f-3d6f1db608dc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:42.894699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6eee77e3-f481-425e-8c70-fbf61dd3510a req-85702d4c-7d11-4420-9d6f-3d6f1db608dc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:42.895310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6eee77e3-f481-425e-8c70-fbf61dd3510a req-85702d4c-7d11-4420-9d6f-3d6f1db608dc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:42.913404 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-6eee77e3-f481-425e-8c70-fbf61dd3510a req-85702d4c-7d11-4420-9d6f-3d6f1db608dc service nova] Creating event network-vif-deleted:7f955ef2-2fab-4400-923d-9b32e09953a9 for instance db56aa8c-7a19-4910-8226-c70ac28faf8d on n-h1-860687-3 Oct 27 19:23:42.921377 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-6eee77e3-f481-425e-8c70-fbf61dd3510a req-85702d4c-7d11-4420-9d6f-3d6f1db608dc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061985 Oct 27 19:23:42.922356 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3123/6378] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:23:42.931100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6807601b-bcbd-4cb5-9ca8-6dcee00b2e98 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:42.933355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6807601b-bcbd-4cb5-9ca8-6dcee00b2e98 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:42.943359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6807601b-bcbd-4cb5-9ca8-6dcee00b2e98 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:42.945946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6807601b-bcbd-4cb5-9ca8-6dcee00b2e98 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:42.946704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6807601b-bcbd-4cb5-9ca8-6dcee00b2e98 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:42.947635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6807601b-bcbd-4cb5-9ca8-6dcee00b2e98 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:42.948907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6807601b-bcbd-4cb5-9ca8-6dcee00b2e98 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:42.949536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6807601b-bcbd-4cb5-9ca8-6dcee00b2e98 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:43.056413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d204a790-d6d8-49c9-9031-8058737d0e41 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:43.080571 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d204a790-d6d8-49c9-9031-8058737d0e41 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 200 len: 1605 microversion: 2.1 time: 0.641311 Oct 27 19:23:43.081168 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3256/6379] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:42 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 1605 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:43.102034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-60f4e7d9-eeac-4282-8a73-a991c39aa322 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:43.115288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-60f4e7d9-eeac-4282-8a73-a991c39aa322 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:43.135773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60f4e7d9-eeac-4282-8a73-a991c39aa322 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:43.135948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60f4e7d9-eeac-4282-8a73-a991c39aa322 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:43.137375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60f4e7d9-eeac-4282-8a73-a991c39aa322 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:43.140595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60f4e7d9-eeac-4282-8a73-a991c39aa322 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:43.142834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60f4e7d9-eeac-4282-8a73-a991c39aa322 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:43.143811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60f4e7d9-eeac-4282-8a73-a991c39aa322 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:43.287653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:43.756416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6807601b-bcbd-4cb5-9ca8-6dcee00b2e98 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:43.764963 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6807601b-bcbd-4cb5-9ca8-6dcee00b2e98 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1693 microversion: 2.1 time: 0.840665 Oct 27 19:23:43.782492 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3124/6380] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:42 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1693 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:43.788609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-60f4e7d9-eeac-4282-8a73-a991c39aa322 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:43.791756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7968a0c3-e523-439e-bbd9-241f991eab4b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:43.792495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7968a0c3-e523-439e-bbd9-241f991eab4b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:43.799911 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-60f4e7d9-eeac-4282-8a73-a991c39aa322 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1167 microversion: 2.1 time: 0.710882 Oct 27 19:23:43.804087 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3257/6381] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:43 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1167 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:43.823650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7968a0c3-e523-439e-bbd9-241f991eab4b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:43.824490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7968a0c3-e523-439e-bbd9-241f991eab4b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:43.825123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7968a0c3-e523-439e-bbd9-241f991eab4b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:43.829108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7968a0c3-e523-439e-bbd9-241f991eab4b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:43.830371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7968a0c3-e523-439e-bbd9-241f991eab4b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:43.833067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7968a0c3-e523-439e-bbd9-241f991eab4b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:43.885663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d772e622-2e84-4fa7-86ba-700384a7f491 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:43.886298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d772e622-2e84-4fa7-86ba-700384a7f491 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:43.899988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d772e622-2e84-4fa7-86ba-700384a7f491 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:43.900495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d772e622-2e84-4fa7-86ba-700384a7f491 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:43.901326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d772e622-2e84-4fa7-86ba-700384a7f491 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:43.902227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d772e622-2e84-4fa7-86ba-700384a7f491 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:43.902881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d772e622-2e84-4fa7-86ba-700384a7f491 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:43.903488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d772e622-2e84-4fa7-86ba-700384a7f491 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:43.979412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=16 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:44.318718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d772e622-2e84-4fa7-86ba-700384a7f491 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:44.328834 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d772e622-2e84-4fa7-86ba-700384a7f491 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1318 microversion: 2.1 time: 0.446958 Oct 27 19:23:44.329441 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3258/6382] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:43 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:23:44.346160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a266d752-b810-464d-95d6-e3536cf6e239 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:44.347025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a266d752-b810-464d-95d6-e3536cf6e239 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:44.349480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:44.365189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a266d752-b810-464d-95d6-e3536cf6e239 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:44.365879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a266d752-b810-464d-95d6-e3536cf6e239 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:44.371208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a266d752-b810-464d-95d6-e3536cf6e239 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:44.376511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a266d752-b810-464d-95d6-e3536cf6e239 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:44.377463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a266d752-b810-464d-95d6-e3536cf6e239 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:44.378085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a266d752-b810-464d-95d6-e3536cf6e239 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:44.443232 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-a266d752-b810-464d-95d6-e3536cf6e239 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] HTTP exception thrown: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a266d752-b810-464d-95d6-e3536cf6e239 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Request method failure captured: Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d HTTP/1.1 Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtniMUDAuq4e1BIAZFAz2ZDdAogZhtvGa-gKyBzlZpZDATzQQ-s8JCfDVHsGT1FzSuAymzSSTJNTx7A5iyoQKJPO5DyL4Fc5rthR-PlctrSP9W5KgK-13fHiZQToHLxzGno8SauVbxyrlY-Gz-m_X0ADACErB59XqBBhL_4TS9Y6ca8 Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 9e8019adc2594ba4970d50028c4b79db Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9e8019adc2594ba4970d50028c4b79db", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 9e8019adc2594ba4970d50028c4b79db Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeTestJSON-1366128523-project Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ac513a8932e4435e88fcd8a023b31c5c Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeTestJSON-1366128523-project Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'db56aa8c-7a19-4910-8226-c70ac28faf8d'} Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:23:44.445370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:23:44.451199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:23:44.451199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:23:44.451199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:23:44.451199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:23:44.451199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:23:44.451199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:23:44.451199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:23:44.452991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a266d752-b810-464d-95d6-e3536cf6e239 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Returning 404 to user: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:23:44.457363 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a266d752-b810-464d-95d6-e3536cf6e239 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 404 len: 111 microversion: 2.1 time: 0.122768 Oct 27 19:23:44.458265 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3259/6383] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:44 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:23:44.467015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8f8f423c-ba48-4df8-9dca-4db28558b9b1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '.version_select at 0x7fc86ad35670>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:44.513431 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8f8f423c-ba48-4df8-9dca-4db28558b9b1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-689434955" status: 202 len: 0 microversion: 2.1 time: 0.050251 Oct 27 19:23:44.514549 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3260/6384] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Oct 27 19:23:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-689434955 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:23:44.796482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9a7516f5-6b8c-4a59-b139-379d837bcf71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:44.797962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9a7516f5-6b8c-4a59-b139-379d837bcf71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:44.810647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a7516f5-6b8c-4a59-b139-379d837bcf71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:44.815778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a7516f5-6b8c-4a59-b139-379d837bcf71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:44.816600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a7516f5-6b8c-4a59-b139-379d837bcf71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:44.818687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a7516f5-6b8c-4a59-b139-379d837bcf71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:44.821413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a7516f5-6b8c-4a59-b139-379d837bcf71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:44.822192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a7516f5-6b8c-4a59-b139-379d837bcf71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:45.155753 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7968a0c3-e523-439e-bbd9-241f991eab4b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1464 microversion: 2.1 time: 1.381200 Oct 27 19:23:45.160605 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3125/6385] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:43 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1464 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:45.165947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-88fa2c1c-4339-4917-846c-f793ed730e09 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:45.169161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-88fa2c1c-4339-4917-846c-f793ed730e09 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:45.200796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88fa2c1c-4339-4917-846c-f793ed730e09 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:45.201691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88fa2c1c-4339-4917-846c-f793ed730e09 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:45.203023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88fa2c1c-4339-4917-846c-f793ed730e09 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:45.205362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88fa2c1c-4339-4917-846c-f793ed730e09 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:45.206098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88fa2c1c-4339-4917-846c-f793ed730e09 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:45.208984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88fa2c1c-4339-4917-846c-f793ed730e09 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:45.236449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:45.682994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-88fa2c1c-4339-4917-846c-f793ed730e09 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:45.693538 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-88fa2c1c-4339-4917-846c-f793ed730e09 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1213 microversion: 2.1 time: 0.531234 Oct 27 19:23:45.694509 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3126/6386] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:45 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1213 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:45.699507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-754599cc-b52f-4439-8b87-6243d385f9f1 req-5e5ab5e2-413b-43a8-ae63-de22e9c731fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ab5a511-76ec-4f79-bb0a-84428873cc69", "tag": "176d5b78-d0ac-4136-a0bd-e28c03b5401c"}, {"name": "network-changed", "server_uuid": "397b574b-2b3c-42be-89a3-bebfebe7db23", "tag": "8e4105b4-cccb-4e81-9b27-f1f947b812f4"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:45.716656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-754599cc-b52f-4439-8b87-6243d385f9f1 req-5e5ab5e2-413b-43a8-ae63-de22e9c731fd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:45.717326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-754599cc-b52f-4439-8b87-6243d385f9f1 req-5e5ab5e2-413b-43a8-ae63-de22e9c731fd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:45.717696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-754599cc-b52f-4439-8b87-6243d385f9f1 req-5e5ab5e2-413b-43a8-ae63-de22e9c731fd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:45.733102 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-754599cc-b52f-4439-8b87-6243d385f9f1 req-5e5ab5e2-413b-43a8-ae63-de22e9c731fd service nova] Creating event network-changed:176d5b78-d0ac-4136-a0bd-e28c03b5401c for instance 5ab5a511-76ec-4f79-bb0a-84428873cc69 on n-h2-860687-3 Oct 27 19:23:45.735601 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-754599cc-b52f-4439-8b87-6243d385f9f1 req-5e5ab5e2-413b-43a8-ae63-de22e9c731fd service nova] Creating event network-changed:8e4105b4-cccb-4e81-9b27-f1f947b812f4 for instance 397b574b-2b3c-42be-89a3-bebfebe7db23 on n-h1-860687-3 Oct 27 19:23:45.749673 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-754599cc-b52f-4439-8b87-6243d385f9f1 req-5e5ab5e2-413b-43a8-ae63-de22e9c731fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053620 Oct 27 19:23:45.752278 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3127/6387] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:23:45.763498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-911ec3cb-2b95-420b-aedb-5d2d5418c173 req-041567da-d271-419b-8e27-e92b1f7d5789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41df1a5-196c-454a-b18d-3229ee0b41ef", "name": "network-vif-unplugged", "status": "completed", "tag": "5a8f0d22-cfd5-44d4-8a29-8256b2e1df22"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:45.779466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-911ec3cb-2b95-420b-aedb-5d2d5418c173 req-041567da-d271-419b-8e27-e92b1f7d5789 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:45.779968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-911ec3cb-2b95-420b-aedb-5d2d5418c173 req-041567da-d271-419b-8e27-e92b1f7d5789 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:45.780467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-911ec3cb-2b95-420b-aedb-5d2d5418c173 req-041567da-d271-419b-8e27-e92b1f7d5789 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:45.801081 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-911ec3cb-2b95-420b-aedb-5d2d5418c173 req-041567da-d271-419b-8e27-e92b1f7d5789 service nova] Creating event network-vif-unplugged:5a8f0d22-cfd5-44d4-8a29-8256b2e1df22 for instance f41df1a5-196c-454a-b18d-3229ee0b41ef on n-h2-860687-3 Oct 27 19:23:45.807066 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-911ec3cb-2b95-420b-aedb-5d2d5418c173 req-041567da-d271-419b-8e27-e92b1f7d5789 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053042 Oct 27 19:23:45.808960 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3128/6388] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:23:45.818495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4b2509be-8220-4688-a8c3-7482afe4d766 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:45.821394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4b2509be-8220-4688-a8c3-7482afe4d766 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:45.834099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b2509be-8220-4688-a8c3-7482afe4d766 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:45.834941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b2509be-8220-4688-a8c3-7482afe4d766 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:45.835721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b2509be-8220-4688-a8c3-7482afe4d766 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:45.837327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b2509be-8220-4688-a8c3-7482afe4d766 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:45.838154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b2509be-8220-4688-a8c3-7482afe4d766 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:45.841075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b2509be-8220-4688-a8c3-7482afe4d766 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:45.907451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9a7516f5-6b8c-4a59-b139-379d837bcf71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:45.923120 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9a7516f5-6b8c-4a59-b139-379d837bcf71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1693 microversion: 2.1 time: 1.130499 Oct 27 19:23:45.925232 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3261/6389] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:44 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1693 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:23:46.186846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5b452596-10a5-48a1-809b-a80fde3bcd6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:46.187295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5b452596-10a5-48a1-809b-a80fde3bcd6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:46.197398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b452596-10a5-48a1-809b-a80fde3bcd6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:46.197805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b452596-10a5-48a1-809b-a80fde3bcd6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:46.198257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b452596-10a5-48a1-809b-a80fde3bcd6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:46.199015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b452596-10a5-48a1-809b-a80fde3bcd6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:46.199589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b452596-10a5-48a1-809b-a80fde3bcd6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:46.199969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b452596-10a5-48a1-809b-a80fde3bcd6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:46.267621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4b2509be-8220-4688-a8c3-7482afe4d766 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:46.275759 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4b2509be-8220-4688-a8c3-7482afe4d766 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1318 microversion: 2.1 time: 0.465551 Oct 27 19:23:46.276976 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3129/6390] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:45 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:46.718932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ccd801e-6115-4b9a-90b2-1c5acb68a2a5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:46.721347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ccd801e-6115-4b9a-90b2-1c5acb68a2a5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:46.729962 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5b452596-10a5-48a1-809b-a80fde3bcd6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1464 microversion: 2.1 time: 0.547015 Oct 27 19:23:46.740498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ccd801e-6115-4b9a-90b2-1c5acb68a2a5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:46.743135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ccd801e-6115-4b9a-90b2-1c5acb68a2a5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:46.744442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ccd801e-6115-4b9a-90b2-1c5acb68a2a5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:46.745703 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3262/6391] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:46 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1464 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:23:46.745853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ccd801e-6115-4b9a-90b2-1c5acb68a2a5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:46.748499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ccd801e-6115-4b9a-90b2-1c5acb68a2a5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:46.751017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ccd801e-6115-4b9a-90b2-1c5acb68a2a5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:46.951912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-23d3857c-a24c-4793-9708-e46323b67dac tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:46.959626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-23d3857c-a24c-4793-9708-e46323b67dac tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:46.969733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23d3857c-a24c-4793-9708-e46323b67dac tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:46.973385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23d3857c-a24c-4793-9708-e46323b67dac tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:46.974104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23d3857c-a24c-4793-9708-e46323b67dac tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:46.975246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23d3857c-a24c-4793-9708-e46323b67dac tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:46.975909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23d3857c-a24c-4793-9708-e46323b67dac tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:46.976636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23d3857c-a24c-4793-9708-e46323b67dac tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:47.048698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9ccd801e-6115-4b9a-90b2-1c5acb68a2a5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:47.058404 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ccd801e-6115-4b9a-90b2-1c5acb68a2a5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1201 microversion: 2.1 time: 0.344824 Oct 27 19:23:47.059002 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3130/6392] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:46 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1201 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:47.228169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-23d3857c-a24c-4793-9708-e46323b67dac tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:47.238434 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-23d3857c-a24c-4793-9708-e46323b67dac tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1693 microversion: 2.1 time: 0.290919 Oct 27 19:23:47.253971 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3263/6393] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:46 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1693 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:47.303595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-80aabd4a-aba8-4fe3-8839-20ac61c948ca tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:47.304827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-80aabd4a-aba8-4fe3-8839-20ac61c948ca tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:47.311732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80aabd4a-aba8-4fe3-8839-20ac61c948ca tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:47.312407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80aabd4a-aba8-4fe3-8839-20ac61c948ca tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:47.313004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80aabd4a-aba8-4fe3-8839-20ac61c948ca tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:47.314514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80aabd4a-aba8-4fe3-8839-20ac61c948ca tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:47.316075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80aabd4a-aba8-4fe3-8839-20ac61c948ca tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:47.316679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80aabd4a-aba8-4fe3-8839-20ac61c948ca tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:47.420927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-78906d8a-b514-4c7c-9d16-c27928f3e238 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Action: 'create', calling method: .version_select at 0x7fc86ab475e0>, body: {"keypair": {"name": "tempest-keypair-1293199183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQam6FooFz88KxY9tw5gjj2I+nkwgrZLiBH3j6cl5QNDaH4NuLzAlyzC1lsbgpoBExpfPXn5Cpj5D0jKoLs/+a7Jnf7QyA7W0J2ZEFU9M1qmspYVzJLtUACqcJYwUtQOA=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:47.448570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-78906d8a-b514-4c7c-9d16-c27928f3e238 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Getting quotas for project 9e8019adc2594ba4970d50028c4b79db. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:23:47.459880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-78906d8a-b514-4c7c-9d16-c27928f3e238 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Getting quotas for user ac513a8932e4435e88fcd8a023b31c5c and project 9e8019adc2594ba4970d50028c4b79db. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:23:47.493032 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-78906d8a-b514-4c7c-9d16-c27928f3e238 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.084882 Oct 27 19:23:47.494164 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3264/6394] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:23:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:23:47.760899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6eaaf111-f90f-4fa0-b138-b67699f30043 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:47.762560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6eaaf111-f90f-4fa0-b138-b67699f30043 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:47.769709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6eaaf111-f90f-4fa0-b138-b67699f30043 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:47.771536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6eaaf111-f90f-4fa0-b138-b67699f30043 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:47.772336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6eaaf111-f90f-4fa0-b138-b67699f30043 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:47.773946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6eaaf111-f90f-4fa0-b138-b67699f30043 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:47.774911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6eaaf111-f90f-4fa0-b138-b67699f30043 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:47.775794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6eaaf111-f90f-4fa0-b138-b67699f30043 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:47.983355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-80aabd4a-aba8-4fe3-8839-20ac61c948ca tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:47.994564 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-80aabd4a-aba8-4fe3-8839-20ac61c948ca tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1318 microversion: 2.1 time: 0.694921 Oct 27 19:23:48.006918 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3131/6395] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:47 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1318 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:48.015859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-1286d77e-1247-425b-8dd4-853c39940f02 req-b5b79aa9-107d-43c3-9465-1173e0014e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41df1a5-196c-454a-b18d-3229ee0b41ef", "tag": "5a8f0d22-cfd5-44d4-8a29-8256b2e1df22"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:48.027255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1286d77e-1247-425b-8dd4-853c39940f02 req-b5b79aa9-107d-43c3-9465-1173e0014e1a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:48.027862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1286d77e-1247-425b-8dd4-853c39940f02 req-b5b79aa9-107d-43c3-9465-1173e0014e1a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:48.028404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-1286d77e-1247-425b-8dd4-853c39940f02 req-b5b79aa9-107d-43c3-9465-1173e0014e1a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:48.042220 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-1286d77e-1247-425b-8dd4-853c39940f02 req-b5b79aa9-107d-43c3-9465-1173e0014e1a service nova] Creating event network-changed:5a8f0d22-cfd5-44d4-8a29-8256b2e1df22 for instance f41df1a5-196c-454a-b18d-3229ee0b41ef on n-h2-860687-3 Oct 27 19:23:48.047753 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-1286d77e-1247-425b-8dd4-853c39940f02 req-b5b79aa9-107d-43c3-9465-1173e0014e1a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038109 Oct 27 19:23:48.048515 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3132/6396] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:23:48.084817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c4a89ece-6282-417e-a6a4-248dfc0a159c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:48.085644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c4a89ece-6282-417e-a6a4-248dfc0a159c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:48.092414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4a89ece-6282-417e-a6a4-248dfc0a159c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:48.093221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4a89ece-6282-417e-a6a4-248dfc0a159c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:48.093887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4a89ece-6282-417e-a6a4-248dfc0a159c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:48.094732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4a89ece-6282-417e-a6a4-248dfc0a159c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:48.095892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4a89ece-6282-417e-a6a4-248dfc0a159c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:48.096418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4a89ece-6282-417e-a6a4-248dfc0a159c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:48.143401 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6eaaf111-f90f-4fa0-b138-b67699f30043 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1464 microversion: 2.1 time: 0.386409 Oct 27 19:23:48.148014 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3265/6397] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:47 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1464 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:23:48.263810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0221750d-3e2d-4888-86f6-ef216bd78304 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:48.264988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0221750d-3e2d-4888-86f6-ef216bd78304 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:48.275325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0221750d-3e2d-4888-86f6-ef216bd78304 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:48.276309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0221750d-3e2d-4888-86f6-ef216bd78304 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:48.277006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0221750d-3e2d-4888-86f6-ef216bd78304 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:48.278053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0221750d-3e2d-4888-86f6-ef216bd78304 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:48.278789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0221750d-3e2d-4888-86f6-ef216bd78304 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:48.279484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0221750d-3e2d-4888-86f6-ef216bd78304 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:48.471529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c4a89ece-6282-417e-a6a4-248dfc0a159c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:48.482341 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c4a89ece-6282-417e-a6a4-248dfc0a159c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1201 microversion: 2.1 time: 0.402723 Oct 27 19:23:48.494666 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3133/6398] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:48 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1201 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:23:48.601751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0221750d-3e2d-4888-86f6-ef216bd78304 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:48.622864 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0221750d-3e2d-4888-86f6-ef216bd78304 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1693 microversion: 2.1 time: 0.364443 Oct 27 19:23:48.624572 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3266/6399] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:48 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1693 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:49.018817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8c0136db-0f14-420d-b881-4842913dfa6a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:49.019504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8c0136db-0f14-420d-b881-4842913dfa6a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:49.033629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c0136db-0f14-420d-b881-4842913dfa6a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:49.034230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c0136db-0f14-420d-b881-4842913dfa6a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:49.034719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c0136db-0f14-420d-b881-4842913dfa6a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:49.035512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c0136db-0f14-420d-b881-4842913dfa6a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:49.035985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c0136db-0f14-420d-b881-4842913dfa6a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:49.036419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8c0136db-0f14-420d-b881-4842913dfa6a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:49.233743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-456870663", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "b9af74a8-c346-4e81-b338-c4c3bc148b5f"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:49.335633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] validate_networks() for [('b9af74a8-c346-4e81-b338-c4c3bc148b5f', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:23:49.428374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8c0136db-0f14-420d-b881-4842913dfa6a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:49.441928 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8c0136db-0f14-420d-b881-4842913dfa6a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1318 microversion: 2.1 time: 0.425735 Oct 27 19:23:49.442832 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3267/6400] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:49 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:49.447855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2935e8bb-03bc-4455-97bb-6fc4dffc6e32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:49.450731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2935e8bb-03bc-4455-97bb-6fc4dffc6e32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:49.475234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2935e8bb-03bc-4455-97bb-6fc4dffc6e32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:49.476002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2935e8bb-03bc-4455-97bb-6fc4dffc6e32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:49.476708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2935e8bb-03bc-4455-97bb-6fc4dffc6e32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:49.477644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2935e8bb-03bc-4455-97bb-6fc4dffc6e32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:49.478310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2935e8bb-03bc-4455-97bb-6fc4dffc6e32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:49.479225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2935e8bb-03bc-4455-97bb-6fc4dffc6e32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:49.961764 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2935e8bb-03bc-4455-97bb-6fc4dffc6e32 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1464 microversion: 2.1 time: 0.516634 Oct 27 19:23:49.962735 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3268/6401] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:49 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1464 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:49.983208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-673d91e2-1d8e-49ad-94fa-eadebcc48b74 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:49.984140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-673d91e2-1d8e-49ad-94fa-eadebcc48b74 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:49.992986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673d91e2-1d8e-49ad-94fa-eadebcc48b74 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:49.993504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673d91e2-1d8e-49ad-94fa-eadebcc48b74 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:49.993960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673d91e2-1d8e-49ad-94fa-eadebcc48b74 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:49.994735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673d91e2-1d8e-49ad-94fa-eadebcc48b74 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:49.995211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673d91e2-1d8e-49ad-94fa-eadebcc48b74 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:49.995650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-673d91e2-1d8e-49ad-94fa-eadebcc48b74 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:50.205884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-673d91e2-1d8e-49ad-94fa-eadebcc48b74 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:50.237942 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-673d91e2-1d8e-49ad-94fa-eadebcc48b74 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1201 microversion: 2.1 time: 0.263465 Oct 27 19:23:50.241965 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3269/6402] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:49 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1201 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:50.264630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-77613d01-ba27-4d90-905a-33bdc0222813 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:50.268138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-77613d01-ba27-4d90-905a-33bdc0222813 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:50.282071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77613d01-ba27-4d90-905a-33bdc0222813 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:50.286105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77613d01-ba27-4d90-905a-33bdc0222813 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:50.287223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77613d01-ba27-4d90-905a-33bdc0222813 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:50.289455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77613d01-ba27-4d90-905a-33bdc0222813 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:50.290249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77613d01-ba27-4d90-905a-33bdc0222813 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:50.291056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77613d01-ba27-4d90-905a-33bdc0222813 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:50.539023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:23:50.540085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:23:50.540848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:23:50.541605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:23:50.542254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:23:50.578438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:50.580117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:50.580807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:50.581845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:50.586360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:50.586509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:50.645285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Getting quotas for project 44e42816d5124368ab95885148c3f002. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:23:50.658627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Getting quotas for user 48076b3f9d4c4f58a542ae11c37ebeee and project 44e42816d5124368ab95885148c3f002. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:23:50.693459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:23:50.696289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:23:50.769425 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bc69aecf-e8a8-4b91-a2f4-36b320da5e42 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.765190 Oct 27 19:23:50.770466 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3134/6403] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:23:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:23:50.786595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a4f64e37-4f17-408c-be76-e9235d097e7d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:50.790735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a4f64e37-4f17-408c-be76-e9235d097e7d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:50.798654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-77613d01-ba27-4d90-905a-33bdc0222813 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:50.810521 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-77613d01-ba27-4d90-905a-33bdc0222813 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1693 microversion: 2.1 time: 0.565607 Oct 27 19:23:50.811950 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3270/6404] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:50 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1693 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:50.817222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4364632c-f112-4f3d-b360-11c02c070cd3 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:50.818996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4f64e37-4f17-408c-be76-e9235d097e7d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:50.819664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4f64e37-4f17-408c-be76-e9235d097e7d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:50.820310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4f64e37-4f17-408c-be76-e9235d097e7d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:50.821732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4f64e37-4f17-408c-be76-e9235d097e7d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:50.822665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4f64e37-4f17-408c-be76-e9235d097e7d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:50.823360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4f64e37-4f17-408c-be76-e9235d097e7d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:50.828407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4364632c-f112-4f3d-b360-11c02c070cd3 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:51.122968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a4f64e37-4f17-408c-be76-e9235d097e7d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:51.135755 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a4f64e37-4f17-408c-be76-e9235d097e7d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1318 microversion: 2.1 time: 0.364192 Oct 27 19:23:51.136169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4364632c-f112-4f3d-b360-11c02c070cd3 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:51.136683 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3135/6405] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:50 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:51.142824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-650547980", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6d718db-ca0d-4b82-a31b-0c93aa3d04f6"}], "security_groups": [{"name": "tempest-securitygroup--1649245387"}], "key_name": "tempest-keypair-1293199183", "user_data": "}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:51.144698 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4364632c-f112-4f3d-b360-11c02c070cd3 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1227 microversion: 2.1 time: 0.331532 Oct 27 19:23:51.162681 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3271/6406] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:50 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1227 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:51.168311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b4deb4ec-3330-4363-9a3b-d9baa5277a54 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:51.169091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b4deb4ec-3330-4363-9a3b-d9baa5277a54 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:51.182913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4deb4ec-3330-4363-9a3b-d9baa5277a54 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:51.183740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4deb4ec-3330-4363-9a3b-d9baa5277a54 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:51.184454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4deb4ec-3330-4363-9a3b-d9baa5277a54 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:51.185453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4deb4ec-3330-4363-9a3b-d9baa5277a54 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:51.186166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4deb4ec-3330-4363-9a3b-d9baa5277a54 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:51.186874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4deb4ec-3330-4363-9a3b-d9baa5277a54 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:51.421643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] validate_networks() for [('e6d718db-ca0d-4b82-a31b-0c93aa3d04f6', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:23:51.771100 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b4deb4ec-3330-4363-9a3b-d9baa5277a54 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1464 microversion: 2.1 time: 0.607096 Oct 27 19:23:51.773607 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3272/6407] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:51 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1464 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:51.802479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3ef6d95d-a9fd-4a02-8e8e-59c86b47f63f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:51.803852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3ef6d95d-a9fd-4a02-8e8e-59c86b47f63f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:51.821547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6d95d-a9fd-4a02-8e8e-59c86b47f63f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:51.822624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6d95d-a9fd-4a02-8e8e-59c86b47f63f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:51.823258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6d95d-a9fd-4a02-8e8e-59c86b47f63f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:51.824160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6d95d-a9fd-4a02-8e8e-59c86b47f63f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:51.824796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6d95d-a9fd-4a02-8e8e-59c86b47f63f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:51.825403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6d95d-a9fd-4a02-8e8e-59c86b47f63f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:52.138222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:23:52.140971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:23:52.141628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:23:52.142746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:23:52.143347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:23:52.151570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3ef6d95d-a9fd-4a02-8e8e-59c86b47f63f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:52.153936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:52.165564 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3ef6d95d-a9fd-4a02-8e8e-59c86b47f63f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1201 microversion: 2.1 time: 0.371393 Oct 27 19:23:52.166163 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3273/6408] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:51 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1201 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:52.168978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:52.171569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:52.172437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:52.173077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:52.174557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-07687f8b-8fcf-4e80-ac9d-96f2cfedcd4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:52.175364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-07687f8b-8fcf-4e80-ac9d-96f2cfedcd4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:52.186789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:52.197390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07687f8b-8fcf-4e80-ac9d-96f2cfedcd4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:52.197908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07687f8b-8fcf-4e80-ac9d-96f2cfedcd4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:52.198358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07687f8b-8fcf-4e80-ac9d-96f2cfedcd4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:52.199113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07687f8b-8fcf-4e80-ac9d-96f2cfedcd4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:52.199583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07687f8b-8fcf-4e80-ac9d-96f2cfedcd4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:52.200024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07687f8b-8fcf-4e80-ac9d-96f2cfedcd4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:52.213304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Getting quotas for project 9e8019adc2594ba4970d50028c4b79db. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:23:52.221759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Getting quotas for user ac513a8932e4435e88fcd8a023b31c5c and project 9e8019adc2594ba4970d50028c4b79db. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:23:52.244988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:23:52.247685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:23:52.328592 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d53a53a4-e545-4425-8b0c-608a2df463e2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.190197 Oct 27 19:23:52.329259 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3136/6409] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:23:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:23:52.346790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-730c7139-80ad-4fe0-8e56-1699b1804b7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:52.348110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-730c7139-80ad-4fe0-8e56-1699b1804b7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:52.357635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-730c7139-80ad-4fe0-8e56-1699b1804b7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:52.358903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-730c7139-80ad-4fe0-8e56-1699b1804b7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:52.359903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-730c7139-80ad-4fe0-8e56-1699b1804b7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:52.361549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-730c7139-80ad-4fe0-8e56-1699b1804b7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:52.362397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-730c7139-80ad-4fe0-8e56-1699b1804b7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:52.363045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-730c7139-80ad-4fe0-8e56-1699b1804b7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:52.574082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-730c7139-80ad-4fe0-8e56-1699b1804b7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:52.582817 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-730c7139-80ad-4fe0-8e56-1699b1804b7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1318 microversion: 2.1 time: 0.248459 Oct 27 19:23:52.583761 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3137/6410] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:52 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:52.606041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-74dc56c0-adaf-4aed-8b02-489864d588e6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:52.606886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-74dc56c0-adaf-4aed-8b02-489864d588e6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:52.609011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:52.617129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74dc56c0-adaf-4aed-8b02-489864d588e6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:52.618349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74dc56c0-adaf-4aed-8b02-489864d588e6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:52.618826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74dc56c0-adaf-4aed-8b02-489864d588e6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:52.619868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74dc56c0-adaf-4aed-8b02-489864d588e6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:52.620410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74dc56c0-adaf-4aed-8b02-489864d588e6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:52.620929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74dc56c0-adaf-4aed-8b02-489864d588e6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:52.686979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-07687f8b-8fcf-4e80-ac9d-96f2cfedcd4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:52.726792 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-07687f8b-8fcf-4e80-ac9d-96f2cfedcd4b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1693 microversion: 2.1 time: 0.556067 Oct 27 19:23:52.728737 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3274/6411] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:52 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1693 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:52.740087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-23fb04af-20c2-4427-8817-13d27f6baab2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:52.750348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-23fb04af-20c2-4427-8817-13d27f6baab2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:52.761763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-74dc56c0-adaf-4aed-8b02-489864d588e6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:52.784583 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-74dc56c0-adaf-4aed-8b02-489864d588e6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1279 microversion: 2.1 time: 0.198759 Oct 27 19:23:52.785622 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3138/6412] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:52 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1279 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:52.820806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-32f7bfdf-7b4f-420c-909c-6587873cb7fe tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:52.821756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-32f7bfdf-7b4f-420c-909c-6587873cb7fe tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:52.835540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32f7bfdf-7b4f-420c-909c-6587873cb7fe tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:52.836409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32f7bfdf-7b4f-420c-909c-6587873cb7fe tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:52.836883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32f7bfdf-7b4f-420c-909c-6587873cb7fe tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:52.837628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32f7bfdf-7b4f-420c-909c-6587873cb7fe tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:52.838104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32f7bfdf-7b4f-420c-909c-6587873cb7fe tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:52.838599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32f7bfdf-7b4f-420c-909c-6587873cb7fe tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:52.936216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-23fb04af-20c2-4427-8817-13d27f6baab2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:52.950201 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-23fb04af-20c2-4427-8817-13d27f6baab2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1237 microversion: 2.1 time: 0.218409 Oct 27 19:23:52.953438 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3275/6413] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:52 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1237 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:53.189807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a0abff29-07f8-4f32-8b31-24ede1701ad7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:53.190748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a0abff29-07f8-4f32-8b31-24ede1701ad7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:53.200998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0abff29-07f8-4f32-8b31-24ede1701ad7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:53.206953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0abff29-07f8-4f32-8b31-24ede1701ad7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:53.207696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0abff29-07f8-4f32-8b31-24ede1701ad7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:53.208654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0abff29-07f8-4f32-8b31-24ede1701ad7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:53.209537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0abff29-07f8-4f32-8b31-24ede1701ad7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:53.210140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0abff29-07f8-4f32-8b31-24ede1701ad7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:53.455887 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-32f7bfdf-7b4f-420c-909c-6587873cb7fe tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1464 microversion: 2.1 time: 0.650328 Oct 27 19:23:53.457796 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3139/6414] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:52 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1464 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:53.526894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a0abff29-07f8-4f32-8b31-24ede1701ad7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:53.542149 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a0abff29-07f8-4f32-8b31-24ede1701ad7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1201 microversion: 2.1 time: 0.356785 Oct 27 19:23:53.543188 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3276/6415] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:53 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1201 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:53.608433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b0b35abb-74e1-4939-85ce-6c595ada6120 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:53.609237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0b35abb-74e1-4939-85ce-6c595ada6120 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:53.618689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0b35abb-74e1-4939-85ce-6c595ada6120 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:53.627080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0b35abb-74e1-4939-85ce-6c595ada6120 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:53.627998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0b35abb-74e1-4939-85ce-6c595ada6120 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:53.629661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0b35abb-74e1-4939-85ce-6c595ada6120 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:53.630434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0b35abb-74e1-4939-85ce-6c595ada6120 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:53.631143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0b35abb-74e1-4939-85ce-6c595ada6120 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:53.757738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8e696ae8-9f55-4ce9-b75b-0158ec1e666f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:53.758933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8e696ae8-9f55-4ce9-b75b-0158ec1e666f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:53.769288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e696ae8-9f55-4ce9-b75b-0158ec1e666f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:53.770130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e696ae8-9f55-4ce9-b75b-0158ec1e666f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:53.771098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e696ae8-9f55-4ce9-b75b-0158ec1e666f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:53.775952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e696ae8-9f55-4ce9-b75b-0158ec1e666f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:53.778089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e696ae8-9f55-4ce9-b75b-0158ec1e666f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:53.779284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e696ae8-9f55-4ce9-b75b-0158ec1e666f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:53.940256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0b35abb-74e1-4939-85ce-6c595ada6120 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:53.956941 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b0b35abb-74e1-4939-85ce-6c595ada6120 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1318 microversion: 2.1 time: 0.352953 Oct 27 19:23:53.958285 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3140/6416] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:53 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:53.979564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ce98d455-e2ba-4aaf-aa61-182ae62004f6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:53.981314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ce98d455-e2ba-4aaf-aa61-182ae62004f6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:53.992673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce98d455-e2ba-4aaf-aa61-182ae62004f6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:53.994678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce98d455-e2ba-4aaf-aa61-182ae62004f6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:53.995445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce98d455-e2ba-4aaf-aa61-182ae62004f6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:53.998941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce98d455-e2ba-4aaf-aa61-182ae62004f6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:53.999450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce98d455-e2ba-4aaf-aa61-182ae62004f6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:54.000181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce98d455-e2ba-4aaf-aa61-182ae62004f6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:54.064473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8e696ae8-9f55-4ce9-b75b-0158ec1e666f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:54.067805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:54.075065 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8e696ae8-9f55-4ce9-b75b-0158ec1e666f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1693 microversion: 2.1 time: 0.325302 Oct 27 19:23:54.076303 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3277/6417] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:53 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1693 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:54.082239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0ff6346d-8aba-429e-a4c7-0381ee60f00d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:54.083053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0ff6346d-8aba-429e-a4c7-0381ee60f00d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:54.091631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ff6346d-8aba-429e-a4c7-0381ee60f00d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:54.092509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ff6346d-8aba-429e-a4c7-0381ee60f00d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:54.093139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ff6346d-8aba-429e-a4c7-0381ee60f00d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:54.094079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ff6346d-8aba-429e-a4c7-0381ee60f00d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:54.094821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ff6346d-8aba-429e-a4c7-0381ee60f00d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:54.096034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ff6346d-8aba-429e-a4c7-0381ee60f00d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:54.149638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ce98d455-e2ba-4aaf-aa61-182ae62004f6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:54.158292 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ce98d455-e2ba-4aaf-aa61-182ae62004f6 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1285 microversion: 2.1 time: 0.190989 Oct 27 19:23:54.159542 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3141/6418] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:53 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:54.178084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0ff6346d-8aba-429e-a4c7-0381ee60f00d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:54.186315 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0ff6346d-8aba-429e-a4c7-0381ee60f00d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1289 microversion: 2.1 time: 0.108743 Oct 27 19:23:54.187161 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3278/6419] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:54 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:54.482372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0de532ab-0ab9-4fef-b95a-9abfa9f17f63 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:54.486465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0de532ab-0ab9-4fef-b95a-9abfa9f17f63 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:54.496573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0de532ab-0ab9-4fef-b95a-9abfa9f17f63 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:54.497211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0de532ab-0ab9-4fef-b95a-9abfa9f17f63 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:54.498027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0de532ab-0ab9-4fef-b95a-9abfa9f17f63 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:54.498952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0de532ab-0ab9-4fef-b95a-9abfa9f17f63 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:54.499552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0de532ab-0ab9-4fef-b95a-9abfa9f17f63 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:54.500213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0de532ab-0ab9-4fef-b95a-9abfa9f17f63 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:54.574339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e302acde-c5c6-4104-9e1c-1b6b3ed0f9fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:54.575278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e302acde-c5c6-4104-9e1c-1b6b3ed0f9fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:54.586620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e302acde-c5c6-4104-9e1c-1b6b3ed0f9fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:54.587905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e302acde-c5c6-4104-9e1c-1b6b3ed0f9fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:54.588475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e302acde-c5c6-4104-9e1c-1b6b3ed0f9fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:54.589353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e302acde-c5c6-4104-9e1c-1b6b3ed0f9fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:54.589962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e302acde-c5c6-4104-9e1c-1b6b3ed0f9fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:54.590775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e302acde-c5c6-4104-9e1c-1b6b3ed0f9fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:54.828937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e302acde-c5c6-4104-9e1c-1b6b3ed0f9fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:54.843964 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e302acde-c5c6-4104-9e1c-1b6b3ed0f9fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1201 microversion: 2.1 time: 0.279351 Oct 27 19:23:54.851995 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3279/6420] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:54 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1201 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:54.987701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f2ba37f2-c40b-4717-9f19-7b402f826122 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:54.988349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f2ba37f2-c40b-4717-9f19-7b402f826122 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:55.007642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2ba37f2-c40b-4717-9f19-7b402f826122 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:55.008745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2ba37f2-c40b-4717-9f19-7b402f826122 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:55.019765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2ba37f2-c40b-4717-9f19-7b402f826122 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:55.021003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2ba37f2-c40b-4717-9f19-7b402f826122 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:55.023108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2ba37f2-c40b-4717-9f19-7b402f826122 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:55.024422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f2ba37f2-c40b-4717-9f19-7b402f826122 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:55.449676 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0de532ab-0ab9-4fef-b95a-9abfa9f17f63 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1464 microversion: 2.1 time: 0.964594 Oct 27 19:23:55.451601 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3142/6421] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:54 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1464 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:55.475212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-538e230e-6b8d-4b22-95fe-408650772bf6 req-6c7b55b7-8d3c-4ecd-9743-1294ea5627fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab5a511-76ec-4f79-bb0a-84428873cc69", "name": "network-vif-plugged", "status": "completed", "tag": "176d5b78-d0ac-4136-a0bd-e28c03b5401c"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:55.499549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-538e230e-6b8d-4b22-95fe-408650772bf6 req-6c7b55b7-8d3c-4ecd-9743-1294ea5627fc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:55.500856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-538e230e-6b8d-4b22-95fe-408650772bf6 req-6c7b55b7-8d3c-4ecd-9743-1294ea5627fc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:55.502108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-538e230e-6b8d-4b22-95fe-408650772bf6 req-6c7b55b7-8d3c-4ecd-9743-1294ea5627fc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:55.541632 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-538e230e-6b8d-4b22-95fe-408650772bf6 req-6c7b55b7-8d3c-4ecd-9743-1294ea5627fc service nova] Creating event network-vif-plugged:176d5b78-d0ac-4136-a0bd-e28c03b5401c for instance 5ab5a511-76ec-4f79-bb0a-84428873cc69 on n-h2-860687-3 Oct 27 19:23:55.557597 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-538e230e-6b8d-4b22-95fe-408650772bf6 req-6c7b55b7-8d3c-4ecd-9743-1294ea5627fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094389 Oct 27 19:23:55.559924 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3143/6422] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:23:55.569433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f2a18356-edbf-4176-aca3-f6c5c660920e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:55.570151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f2a18356-edbf-4176-aca3-f6c5c660920e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:55.599563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2a18356-edbf-4176-aca3-f6c5c660920e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:55.600061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2a18356-edbf-4176-aca3-f6c5c660920e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:55.600843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2a18356-edbf-4176-aca3-f6c5c660920e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:55.601926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2a18356-edbf-4176-aca3-f6c5c660920e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:55.602929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2a18356-edbf-4176-aca3-f6c5c660920e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:55.603546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2a18356-edbf-4176-aca3-f6c5c660920e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:55.729998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f2ba37f2-c40b-4717-9f19-7b402f826122 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:55.745098 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f2ba37f2-c40b-4717-9f19-7b402f826122 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1318 microversion: 2.1 time: 0.766059 Oct 27 19:23:55.746338 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3280/6423] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:54 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1318 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:55.753688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c27db911-fca5-4dd7-8286-a5471c896801 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:55.755061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c27db911-fca5-4dd7-8286-a5471c896801 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:55.778261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c27db911-fca5-4dd7-8286-a5471c896801 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:55.779209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c27db911-fca5-4dd7-8286-a5471c896801 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:55.779836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c27db911-fca5-4dd7-8286-a5471c896801 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:55.780793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c27db911-fca5-4dd7-8286-a5471c896801 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:55.781481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c27db911-fca5-4dd7-8286-a5471c896801 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:55.782089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c27db911-fca5-4dd7-8286-a5471c896801 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:56.218482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c27db911-fca5-4dd7-8286-a5471c896801 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:56.231670 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c27db911-fca5-4dd7-8286-a5471c896801 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1327 microversion: 2.1 time: 0.483996 Oct 27 19:23:56.232954 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3281/6424] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:55 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1327 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:56.247050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-938ca414-11d3-41fd-8fd0-2452bc9dd524 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:56.247642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-938ca414-11d3-41fd-8fd0-2452bc9dd524 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:56.262369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-938ca414-11d3-41fd-8fd0-2452bc9dd524 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:56.267770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-938ca414-11d3-41fd-8fd0-2452bc9dd524 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:56.268524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-938ca414-11d3-41fd-8fd0-2452bc9dd524 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:56.271023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-938ca414-11d3-41fd-8fd0-2452bc9dd524 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:56.273910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-938ca414-11d3-41fd-8fd0-2452bc9dd524 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:56.275530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-938ca414-11d3-41fd-8fd0-2452bc9dd524 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:56.391862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f2a18356-edbf-4176-aca3-f6c5c660920e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:56.401769 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f2a18356-edbf-4176-aca3-f6c5c660920e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1693 microversion: 2.1 time: 0.840070 Oct 27 19:23:56.403037 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3144/6425] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:55 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1693 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:56.417839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-94d1813d-4a86-4aa3-a1dd-eca88c33a7e7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:56.418919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-94d1813d-4a86-4aa3-a1dd-eca88c33a7e7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:56.427523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94d1813d-4a86-4aa3-a1dd-eca88c33a7e7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:56.428254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94d1813d-4a86-4aa3-a1dd-eca88c33a7e7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:56.428993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94d1813d-4a86-4aa3-a1dd-eca88c33a7e7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:56.429940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94d1813d-4a86-4aa3-a1dd-eca88c33a7e7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:56.431249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94d1813d-4a86-4aa3-a1dd-eca88c33a7e7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:56.432033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94d1813d-4a86-4aa3-a1dd-eca88c33a7e7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:56.559334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-938ca414-11d3-41fd-8fd0-2452bc9dd524 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:56.571103 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-938ca414-11d3-41fd-8fd0-2452bc9dd524 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1295 microversion: 2.1 time: 0.335773 Oct 27 19:23:56.577351 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3282/6426] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:56 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1295 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:56.586710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-dcf64e12-45fa-4380-b3bf-05544aaa1dd8 req-570e94b1-e881-42cc-9e96-02d36ca931b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d5a034-eb5f-4fbf-b37a-f63766bc394d", "tag": "bf09d0ba-05a4-48ce-9c3e-a9929077346e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:56.610185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-dcf64e12-45fa-4380-b3bf-05544aaa1dd8 req-570e94b1-e881-42cc-9e96-02d36ca931b6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:56.611517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-dcf64e12-45fa-4380-b3bf-05544aaa1dd8 req-570e94b1-e881-42cc-9e96-02d36ca931b6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:56.615408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-dcf64e12-45fa-4380-b3bf-05544aaa1dd8 req-570e94b1-e881-42cc-9e96-02d36ca931b6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:56.639048 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-dcf64e12-45fa-4380-b3bf-05544aaa1dd8 req-570e94b1-e881-42cc-9e96-02d36ca931b6 service nova] Creating event network-changed:bf09d0ba-05a4-48ce-9c3e-a9929077346e for instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d on n-h1-860687-3 Oct 27 19:23:56.661116 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-dcf64e12-45fa-4380-b3bf-05544aaa1dd8 req-570e94b1-e881-42cc-9e96-02d36ca931b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067725 Oct 27 19:23:56.662021 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3283/6427] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:23:56.667504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-27865e81-a8d3-45b5-a088-cc630373d4e4 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:56.675521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-27865e81-a8d3-45b5-a088-cc630373d4e4 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:56.684776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-94d1813d-4a86-4aa3-a1dd-eca88c33a7e7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:56.688120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27865e81-a8d3-45b5-a088-cc630373d4e4 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:56.689623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27865e81-a8d3-45b5-a088-cc630373d4e4 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:56.692330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27865e81-a8d3-45b5-a088-cc630373d4e4 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:56.693369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27865e81-a8d3-45b5-a088-cc630373d4e4 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:56.694320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27865e81-a8d3-45b5-a088-cc630373d4e4 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:56.695270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27865e81-a8d3-45b5-a088-cc630373d4e4 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:56.695390 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-94d1813d-4a86-4aa3-a1dd-eca88c33a7e7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1201 microversion: 2.1 time: 0.291036 Oct 27 19:23:56.698984 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3145/6428] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:56 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1201 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:56.771903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ccb340b7-853d-4037-85be-be88fd87d872 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:56.772683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ccb340b7-853d-4037-85be-be88fd87d872 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:56.781663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccb340b7-853d-4037-85be-be88fd87d872 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:56.784850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccb340b7-853d-4037-85be-be88fd87d872 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:56.785507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccb340b7-853d-4037-85be-be88fd87d872 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:56.788057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccb340b7-853d-4037-85be-be88fd87d872 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:56.788774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccb340b7-853d-4037-85be-be88fd87d872 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:56.789942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccb340b7-853d-4037-85be-be88fd87d872 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:57.102584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ccb340b7-853d-4037-85be-be88fd87d872 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:57.119082 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ccb340b7-853d-4037-85be-be88fd87d872 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1318 microversion: 2.1 time: 0.351828 Oct 27 19:23:57.120066 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3146/6429] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:56 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:23:57.130968 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-27865e81-a8d3-45b5-a088-cc630373d4e4 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1464 microversion: 2.1 time: 0.457017 Oct 27 19:23:57.142415 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3284/6430] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:56 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1464 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:57.262855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e297c841-8dcf-45b7-add7-723f82993d1d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:57.263564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e297c841-8dcf-45b7-add7-723f82993d1d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:57.278592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e297c841-8dcf-45b7-add7-723f82993d1d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:57.279345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e297c841-8dcf-45b7-add7-723f82993d1d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:57.279909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e297c841-8dcf-45b7-add7-723f82993d1d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:57.285181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e297c841-8dcf-45b7-add7-723f82993d1d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:57.285850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e297c841-8dcf-45b7-add7-723f82993d1d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:57.287756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e297c841-8dcf-45b7-add7-723f82993d1d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:57.298437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:23:57.431317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-deee5616-1851-4b9b-a10d-26b5eec783bb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:57.432292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-deee5616-1851-4b9b-a10d-26b5eec783bb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:57.452912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-deee5616-1851-4b9b-a10d-26b5eec783bb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:57.455525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-deee5616-1851-4b9b-a10d-26b5eec783bb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:57.458839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-deee5616-1851-4b9b-a10d-26b5eec783bb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:57.459865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-deee5616-1851-4b9b-a10d-26b5eec783bb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:57.460520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-deee5616-1851-4b9b-a10d-26b5eec783bb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:57.462250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-deee5616-1851-4b9b-a10d-26b5eec783bb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:57.973853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e297c841-8dcf-45b7-add7-723f82993d1d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:58.003399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-deee5616-1851-4b9b-a10d-26b5eec783bb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:58.003636 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e297c841-8dcf-45b7-add7-723f82993d1d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1327 microversion: 2.1 time: 0.736827 Oct 27 19:23:58.004923 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3147/6431] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:57 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1327 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:58.017196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f88ac583-0127-44ed-8b94-c72814d7f5d0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:58.019646 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-deee5616-1851-4b9b-a10d-26b5eec783bb tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1693 microversion: 2.1 time: 0.593162 Oct 27 19:23:58.020251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f88ac583-0127-44ed-8b94-c72814d7f5d0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:58.032280 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3285/6432] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:57 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1693 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:23:58.037546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f88ac583-0127-44ed-8b94-c72814d7f5d0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:58.040097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ca59b691-550c-44ea-ab84-59903d1ccf1e req-e626ed9a-d3a7-40d8-a4f6-6ea4fbe25e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397b574b-2b3c-42be-89a3-bebfebe7db23", "name": "network-vif-plugged", "status": "completed", "tag": "8e4105b4-cccb-4e81-9b27-f1f947b812f4"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:23:58.040906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f88ac583-0127-44ed-8b94-c72814d7f5d0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:58.041551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f88ac583-0127-44ed-8b94-c72814d7f5d0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:58.043804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f88ac583-0127-44ed-8b94-c72814d7f5d0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:58.046139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f88ac583-0127-44ed-8b94-c72814d7f5d0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:58.049941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f88ac583-0127-44ed-8b94-c72814d7f5d0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:58.067336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ca59b691-550c-44ea-ab84-59903d1ccf1e req-e626ed9a-d3a7-40d8-a4f6-6ea4fbe25e34 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:58.069428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ca59b691-550c-44ea-ab84-59903d1ccf1e req-e626ed9a-d3a7-40d8-a4f6-6ea4fbe25e34 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:58.070020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ca59b691-550c-44ea-ab84-59903d1ccf1e req-e626ed9a-d3a7-40d8-a4f6-6ea4fbe25e34 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:58.120653 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ca59b691-550c-44ea-ab84-59903d1ccf1e req-e626ed9a-d3a7-40d8-a4f6-6ea4fbe25e34 service nova] Creating event network-vif-plugged:8e4105b4-cccb-4e81-9b27-f1f947b812f4 for instance 397b574b-2b3c-42be-89a3-bebfebe7db23 on n-h1-860687-3 Oct 27 19:23:58.127131 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ca59b691-550c-44ea-ab84-59903d1ccf1e req-e626ed9a-d3a7-40d8-a4f6-6ea4fbe25e34 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100821 Oct 27 19:23:58.133487 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3286/6433] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:23:58.139753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-141af39f-6502-448a-b2c7-605d681e7cb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:58.145471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-141af39f-6502-448a-b2c7-605d681e7cb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:58.165109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-141af39f-6502-448a-b2c7-605d681e7cb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:58.167347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-141af39f-6502-448a-b2c7-605d681e7cb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:58.167826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-141af39f-6502-448a-b2c7-605d681e7cb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:58.170792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-141af39f-6502-448a-b2c7-605d681e7cb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:58.174525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-141af39f-6502-448a-b2c7-605d681e7cb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:58.175217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-141af39f-6502-448a-b2c7-605d681e7cb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:59.092826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f88ac583-0127-44ed-8b94-c72814d7f5d0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:59.107047 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f88ac583-0127-44ed-8b94-c72814d7f5d0 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1363 microversion: 2.1 time: 1.098707 Oct 27 19:23:59.108037 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3148/6434] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:58 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1363 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:59.121645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-63d6b791-d7c6-4c5e-8c43-00b87104b9a2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:59.123465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-63d6b791-d7c6-4c5e-8c43-00b87104b9a2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:59.146016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d6b791-d7c6-4c5e-8c43-00b87104b9a2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:59.146868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d6b791-d7c6-4c5e-8c43-00b87104b9a2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:59.149247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d6b791-d7c6-4c5e-8c43-00b87104b9a2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:59.150543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d6b791-d7c6-4c5e-8c43-00b87104b9a2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:59.151037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d6b791-d7c6-4c5e-8c43-00b87104b9a2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:59.151490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63d6b791-d7c6-4c5e-8c43-00b87104b9a2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:59.595054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-63d6b791-d7c6-4c5e-8c43-00b87104b9a2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:59.605491 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-63d6b791-d7c6-4c5e-8c43-00b87104b9a2 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1318 microversion: 2.1 time: 0.492982 Oct 27 19:23:59.607485 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3149/6435] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:59 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:59.612683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-10e2d1b9-89b6-4739-bab2-31fb7a26980a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:59.613659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-10e2d1b9-89b6-4739-bab2-31fb7a26980a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:59.626210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-141af39f-6502-448a-b2c7-605d681e7cb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:23:59.630836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10e2d1b9-89b6-4739-bab2-31fb7a26980a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:59.631778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10e2d1b9-89b6-4739-bab2-31fb7a26980a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:59.632417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10e2d1b9-89b6-4739-bab2-31fb7a26980a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:59.633400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10e2d1b9-89b6-4739-bab2-31fb7a26980a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:59.634187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10e2d1b9-89b6-4739-bab2-31fb7a26980a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:59.635230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10e2d1b9-89b6-4739-bab2-31fb7a26980a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:59.639401 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-141af39f-6502-448a-b2c7-605d681e7cb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1201 microversion: 2.1 time: 1.503767 Oct 27 19:23:59.655253 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3287/6436] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:58 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1201 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:59.662407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-54f1f7c5-9a71-424f-a51f-c7cd4173862e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:59.663317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-54f1f7c5-9a71-424f-a51f-c7cd4173862e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:59.672257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54f1f7c5-9a71-424f-a51f-c7cd4173862e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:59.673641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54f1f7c5-9a71-424f-a51f-c7cd4173862e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:59.674284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54f1f7c5-9a71-424f-a51f-c7cd4173862e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:59.675224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54f1f7c5-9a71-424f-a51f-c7cd4173862e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:59.675704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54f1f7c5-9a71-424f-a51f-c7cd4173862e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:59.676154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-54f1f7c5-9a71-424f-a51f-c7cd4173862e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:59.796792 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-10e2d1b9-89b6-4739-bab2-31fb7a26980a tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1649 microversion: 2.1 time: 0.187575 Oct 27 19:23:59.814373 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3150/6437] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:59 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1649 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:23:59.824457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d723c49-ea0f-494b-acdd-d4c14a4f7e71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:23:59.825689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9d723c49-ea0f-494b-acdd-d4c14a4f7e71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:23:59.833816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d723c49-ea0f-494b-acdd-d4c14a4f7e71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:59.834806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d723c49-ea0f-494b-acdd-d4c14a4f7e71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:59.835342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d723c49-ea0f-494b-acdd-d4c14a4f7e71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:23:59.836304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d723c49-ea0f-494b-acdd-d4c14a4f7e71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:23:59.836761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d723c49-ea0f-494b-acdd-d4c14a4f7e71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:23:59.837259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d723c49-ea0f-494b-acdd-d4c14a4f7e71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:00.065023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-54f1f7c5-9a71-424f-a51f-c7cd4173862e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:00.073881 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-54f1f7c5-9a71-424f-a51f-c7cd4173862e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1327 microversion: 2.1 time: 0.417403 Oct 27 19:24:00.074794 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3288/6438] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:59 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1327 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:00.080017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c078f1a6-960a-4097-8574-0fb2d80981e9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Action: 'create', calling method: .version_select at 0x7fc86b292040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-987145061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ18fadji8KQ3jNGzxzNVJVQBcMNaMf+jT/7HXy8AKiFS8/ANly4mM2gmNtkKqGCbQ48h3jFaG6n99TtZ4+KSR31NfqsrlRSFKHRIFhFv0N0TUyQtgiLzbdVrehFGoR1GQ=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:00.097730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-c078f1a6-960a-4097-8574-0fb2d80981e9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Getting quotas for project e2ecef554af04d36a8c61e2b30d8f9e8. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:24:00.104347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d723c49-ea0f-494b-acdd-d4c14a4f7e71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:00.107814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-c078f1a6-960a-4097-8574-0fb2d80981e9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Getting quotas for user c460e1808e4a4788b1fc3984eb4ab43b and project e2ecef554af04d36a8c61e2b30d8f9e8. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:24:00.114234 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9d723c49-ea0f-494b-acdd-d4c14a4f7e71 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1693 microversion: 2.1 time: 0.298303 Oct 27 19:24:00.115907 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3151/6439] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:23:59 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1693 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:00.120575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4c31be02-f1e2-49b5-b308-f3eecac99161 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:00.121467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4c31be02-f1e2-49b5-b308-f3eecac99161 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:00.129534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c31be02-f1e2-49b5-b308-f3eecac99161 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:00.130377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c31be02-f1e2-49b5-b308-f3eecac99161 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:00.131097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c31be02-f1e2-49b5-b308-f3eecac99161 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:00.132049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c31be02-f1e2-49b5-b308-f3eecac99161 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:00.132721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c31be02-f1e2-49b5-b308-f3eecac99161 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:00.133365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c31be02-f1e2-49b5-b308-f3eecac99161 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:00.142513 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c078f1a6-960a-4097-8574-0fb2d80981e9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.066242 Oct 27 19:24:00.143411 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3289/6440] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:24:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:00.148554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-c08fc824-d719-4231-a69c-61bec8fc7f70 req-a688bc0c-62cc-4aad-97ec-58f43bb5dbea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0719014-1b89-4535-8418-f4fb85165af7", "tag": "57fddc88-bdab-4281-89b1-edd171f702af"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:00.164399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c08fc824-d719-4231-a69c-61bec8fc7f70 req-a688bc0c-62cc-4aad-97ec-58f43bb5dbea service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:00.165351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c08fc824-d719-4231-a69c-61bec8fc7f70 req-a688bc0c-62cc-4aad-97ec-58f43bb5dbea service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:00.165974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c08fc824-d719-4231-a69c-61bec8fc7f70 req-a688bc0c-62cc-4aad-97ec-58f43bb5dbea service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:00.181310 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-c08fc824-d719-4231-a69c-61bec8fc7f70 req-a688bc0c-62cc-4aad-97ec-58f43bb5dbea service nova] Creating event network-changed:57fddc88-bdab-4281-89b1-edd171f702af for instance c0719014-1b89-4535-8418-f4fb85165af7 on n-h2-860687-3 Oct 27 19:24:00.191171 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-c08fc824-d719-4231-a69c-61bec8fc7f70 req-a688bc0c-62cc-4aad-97ec-58f43bb5dbea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044871 Oct 27 19:24:00.192300 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3290/6441] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:00.199562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-81171878-ef53-42b8-bb2d-a8b1d0d68a21 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:00.200268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-81171878-ef53-42b8-bb2d-a8b1d0d68a21 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:00.208601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81171878-ef53-42b8-bb2d-a8b1d0d68a21 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:00.209107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81171878-ef53-42b8-bb2d-a8b1d0d68a21 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:00.209564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81171878-ef53-42b8-bb2d-a8b1d0d68a21 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:00.210290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81171878-ef53-42b8-bb2d-a8b1d0d68a21 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:00.211134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81171878-ef53-42b8-bb2d-a8b1d0d68a21 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:00.211564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81171878-ef53-42b8-bb2d-a8b1d0d68a21 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:00.452275 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4c31be02-f1e2-49b5-b308-f3eecac99161 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1649 microversion: 2.1 time: 0.335032 Oct 27 19:24:00.471746 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3152/6442] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:00 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1649 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:00.478986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-32511535-1ce0-412b-8a3e-245051aaedda req-782e547f-183f-45e9-ad4f-156d6de6a665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06284f8-17bf-4148-ad5c-ecbeb49826a1", "name": "network-vif-plugged", "status": "completed", "tag": "0443cd1d-de02-4505-9092-085d9ce7b1b3"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:00.491622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-32511535-1ce0-412b-8a3e-245051aaedda req-782e547f-183f-45e9-ad4f-156d6de6a665 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:00.492690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-32511535-1ce0-412b-8a3e-245051aaedda req-782e547f-183f-45e9-ad4f-156d6de6a665 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:00.493428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-32511535-1ce0-412b-8a3e-245051aaedda req-782e547f-183f-45e9-ad4f-156d6de6a665 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:00.508187 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-32511535-1ce0-412b-8a3e-245051aaedda req-782e547f-183f-45e9-ad4f-156d6de6a665 service nova] Creating event network-vif-plugged:0443cd1d-de02-4505-9092-085d9ce7b1b3 for instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 on n-h2-860687-3 Oct 27 19:24:00.514324 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-32511535-1ce0-412b-8a3e-245051aaedda req-782e547f-183f-45e9-ad4f-156d6de6a665 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041004 Oct 27 19:24:00.515818 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3153/6443] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:00.522364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d597c62f-ca19-4c1d-8151-4a89fc9f827b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:00.524307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d597c62f-ca19-4c1d-8151-4a89fc9f827b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:00.531710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d597c62f-ca19-4c1d-8151-4a89fc9f827b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:00.533123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d597c62f-ca19-4c1d-8151-4a89fc9f827b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:00.533868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d597c62f-ca19-4c1d-8151-4a89fc9f827b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:00.535586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d597c62f-ca19-4c1d-8151-4a89fc9f827b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:00.536974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d597c62f-ca19-4c1d-8151-4a89fc9f827b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:00.537639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d597c62f-ca19-4c1d-8151-4a89fc9f827b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:00.692874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-81171878-ef53-42b8-bb2d-a8b1d0d68a21 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:00.706710 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-81171878-ef53-42b8-bb2d-a8b1d0d68a21 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1363 microversion: 2.1 time: 0.512580 Oct 27 19:24:00.719823 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3291/6444] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:00 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1363 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:00.740610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d3e7b31b-4602-48aa-9ae8-5f277f31cf5e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:00.741732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d3e7b31b-4602-48aa-9ae8-5f277f31cf5e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:00.758762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3e7b31b-4602-48aa-9ae8-5f277f31cf5e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:00.761493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3e7b31b-4602-48aa-9ae8-5f277f31cf5e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:00.767767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3e7b31b-4602-48aa-9ae8-5f277f31cf5e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:00.769324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3e7b31b-4602-48aa-9ae8-5f277f31cf5e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:00.774144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3e7b31b-4602-48aa-9ae8-5f277f31cf5e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:00.774994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3e7b31b-4602-48aa-9ae8-5f277f31cf5e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:01.023439 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d597c62f-ca19-4c1d-8151-4a89fc9f827b tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1649 microversion: 2.1 time: 0.505607 Oct 27 19:24:01.025975 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3154/6445] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:00 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1649 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:01.042203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00c3fae6-08c2-4c16-923f-3ff49261bb35 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:01.043779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-00c3fae6-08c2-4c16-923f-3ff49261bb35 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:01.051399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00c3fae6-08c2-4c16-923f-3ff49261bb35 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:01.057218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00c3fae6-08c2-4c16-923f-3ff49261bb35 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:01.057793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00c3fae6-08c2-4c16-923f-3ff49261bb35 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:01.058616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00c3fae6-08c2-4c16-923f-3ff49261bb35 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:01.059196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00c3fae6-08c2-4c16-923f-3ff49261bb35 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:01.059555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00c3fae6-08c2-4c16-923f-3ff49261bb35 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:01.112363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d3e7b31b-4602-48aa-9ae8-5f277f31cf5e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:01.127392 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d3e7b31b-4602-48aa-9ae8-5f277f31cf5e tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1506 microversion: 2.1 time: 0.405155 Oct 27 19:24:01.127990 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3292/6446] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:00 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:01.132912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ac9fa7bc-42fa-4458-90f2-64e0d935d7e9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:01.133636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ac9fa7bc-42fa-4458-90f2-64e0d935d7e9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:01.142662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac9fa7bc-42fa-4458-90f2-64e0d935d7e9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:01.143377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac9fa7bc-42fa-4458-90f2-64e0d935d7e9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:01.144004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac9fa7bc-42fa-4458-90f2-64e0d935d7e9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:01.145025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac9fa7bc-42fa-4458-90f2-64e0d935d7e9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:01.145666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac9fa7bc-42fa-4458-90f2-64e0d935d7e9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:01.146261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ac9fa7bc-42fa-4458-90f2-64e0d935d7e9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:01.178566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ac9fa7bc-42fa-4458-90f2-64e0d935d7e9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:24:01.300706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:01.307198 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ac9fa7bc-42fa-4458-90f2-64e0d935d7e9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "DELETE /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 204 len: 0 microversion: 2.1 time: 0.177711 Oct 27 19:24:01.307821 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3293/6447] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:24:01 2022] DELETE /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:24:01.313571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7f74836b-760f-43f8-ad4a-9460dec1c15f tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:01.315811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7f74836b-760f-43f8-ad4a-9460dec1c15f tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:01.327905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f74836b-760f-43f8-ad4a-9460dec1c15f tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:01.328781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f74836b-760f-43f8-ad4a-9460dec1c15f tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:01.330302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f74836b-760f-43f8-ad4a-9460dec1c15f tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:01.331998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f74836b-760f-43f8-ad4a-9460dec1c15f tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:01.332825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f74836b-760f-43f8-ad4a-9460dec1c15f tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:01.333619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f74836b-760f-43f8-ad4a-9460dec1c15f tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:01.432774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-00c3fae6-08c2-4c16-923f-3ff49261bb35 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:01.442111 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-00c3fae6-08c2-4c16-923f-3ff49261bb35 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1201 microversion: 2.1 time: 0.414980 Oct 27 19:24:01.443382 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3155/6448] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:01 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1201 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:01.450424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d4aceee-1478-4e82-bdfa-80f59fb3e837 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:01.451402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d4aceee-1478-4e82-bdfa-80f59fb3e837 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:01.462543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d4aceee-1478-4e82-bdfa-80f59fb3e837 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:01.463746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d4aceee-1478-4e82-bdfa-80f59fb3e837 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:01.464578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d4aceee-1478-4e82-bdfa-80f59fb3e837 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:01.465543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d4aceee-1478-4e82-bdfa-80f59fb3e837 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:01.466229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d4aceee-1478-4e82-bdfa-80f59fb3e837 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:01.466961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d4aceee-1478-4e82-bdfa-80f59fb3e837 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:01.652654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7f74836b-760f-43f8-ad4a-9460dec1c15f tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:01.667888 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7f74836b-760f-43f8-ad4a-9460dec1c15f tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1327 microversion: 2.1 time: 0.358265 Oct 27 19:24:01.670914 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3294/6449] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:01 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1327 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:01.675962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6d4aceee-1478-4e82-bdfa-80f59fb3e837 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:01.688067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d15a4805-e059-4174-a7de-4b8a02e35c7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1ba57d5-bb3a-4637-9b1d-ebed47fc9ae6", "device": "/dev/sdb"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:01.693047 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d4aceee-1478-4e82-bdfa-80f59fb3e837 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1693 microversion: 2.1 time: 0.248082 Oct 27 19:24:01.694413 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3156/6450] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:01 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1693 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:01.699037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5cb5ec74-2c14-4d7c-a4a9-e515331e87d6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:01.702133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d15a4805-e059-4174-a7de-4b8a02e35c7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:01.705180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5cb5ec74-2c14-4d7c-a4a9-e515331e87d6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:01.715347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d15a4805-e059-4174-a7de-4b8a02e35c7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:01.716170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d15a4805-e059-4174-a7de-4b8a02e35c7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:01.716925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d15a4805-e059-4174-a7de-4b8a02e35c7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:01.717100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cb5ec74-2c14-4d7c-a4a9-e515331e87d6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:01.717992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cb5ec74-2c14-4d7c-a4a9-e515331e87d6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:01.718161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d15a4805-e059-4174-a7de-4b8a02e35c7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:01.718577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cb5ec74-2c14-4d7c-a4a9-e515331e87d6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:01.719210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d15a4805-e059-4174-a7de-4b8a02e35c7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:01.719711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cb5ec74-2c14-4d7c-a4a9-e515331e87d6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:01.720257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d15a4805-e059-4174-a7de-4b8a02e35c7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:01.720714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cb5ec74-2c14-4d7c-a4a9-e515331e87d6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:01.721263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5cb5ec74-2c14-4d7c-a4a9-e515331e87d6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:01.821787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:02.069993 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d15a4805-e059-4174-a7de-4b8a02e35c7a tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "POST /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397389 Oct 27 19:24:02.070872 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3295/6451] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:24:01 2022] POST /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:02.077458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6848ccb5-0844-4fca-ae0e-8bff9a150cb1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:02.077966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6848ccb5-0844-4fca-ae0e-8bff9a150cb1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:02.087906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6848ccb5-0844-4fca-ae0e-8bff9a150cb1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:02.088487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6848ccb5-0844-4fca-ae0e-8bff9a150cb1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:02.088941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6848ccb5-0844-4fca-ae0e-8bff9a150cb1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:02.089853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6848ccb5-0844-4fca-ae0e-8bff9a150cb1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:02.090409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6848ccb5-0844-4fca-ae0e-8bff9a150cb1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:02.090861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6848ccb5-0844-4fca-ae0e-8bff9a150cb1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:02.211264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:02.233245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=12 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:02.328868 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5cb5ec74-2c14-4d7c-a4a9-e515331e87d6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1655 microversion: 2.1 time: 0.629572 Oct 27 19:24:02.331185 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3157/6452] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:01 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1655 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:02.336367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6848ccb5-0844-4fca-ae0e-8bff9a150cb1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:02.347058 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6848ccb5-0844-4fca-ae0e-8bff9a150cb1 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1363 microversion: 2.1 time: 0.275056 Oct 27 19:24:02.347660 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3296/6453] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:02 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:02.488800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-035e371e-c605-48b6-b200-09bebdcb7ce7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:02.489524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-035e371e-c605-48b6-b200-09bebdcb7ce7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:02.508411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-035e371e-c605-48b6-b200-09bebdcb7ce7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:02.509743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-035e371e-c605-48b6-b200-09bebdcb7ce7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:02.510471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-035e371e-c605-48b6-b200-09bebdcb7ce7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:02.511361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-035e371e-c605-48b6-b200-09bebdcb7ce7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:02.512734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-035e371e-c605-48b6-b200-09bebdcb7ce7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:02.513543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-035e371e-c605-48b6-b200-09bebdcb7ce7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:02.559155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-64dc116c-ec9a-4869-af34-7533d8869dd1 req-ba907b8d-c68c-48a1-8c32-699a44e3af79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d5a034-eb5f-4fbf-b37a-f63766bc394d", "name": "network-vif-plugged", "status": "completed", "tag": "bf09d0ba-05a4-48ce-9c3e-a9929077346e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:02.594076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-64dc116c-ec9a-4869-af34-7533d8869dd1 req-ba907b8d-c68c-48a1-8c32-699a44e3af79 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:02.596837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-64dc116c-ec9a-4869-af34-7533d8869dd1 req-ba907b8d-c68c-48a1-8c32-699a44e3af79 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:02.599974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-64dc116c-ec9a-4869-af34-7533d8869dd1 req-ba907b8d-c68c-48a1-8c32-699a44e3af79 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:02.623431 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-64dc116c-ec9a-4869-af34-7533d8869dd1 req-ba907b8d-c68c-48a1-8c32-699a44e3af79 service nova] Creating event network-vif-plugged:bf09d0ba-05a4-48ce-9c3e-a9929077346e for instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d on n-h1-860687-3 Oct 27 19:24:02.635704 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-64dc116c-ec9a-4869-af34-7533d8869dd1 req-ba907b8d-c68c-48a1-8c32-699a44e3af79 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081294 Oct 27 19:24:02.637047 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3297/6454] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:24:02.697071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3744488d-691f-4f9a-a6a6-e44144584634 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:02.698888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3744488d-691f-4f9a-a6a6-e44144584634 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:02.708136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3744488d-691f-4f9a-a6a6-e44144584634 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:02.708719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3744488d-691f-4f9a-a6a6-e44144584634 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:02.709086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3744488d-691f-4f9a-a6a6-e44144584634 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:02.709810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3744488d-691f-4f9a-a6a6-e44144584634 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:02.710282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3744488d-691f-4f9a-a6a6-e44144584634 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:02.710813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3744488d-691f-4f9a-a6a6-e44144584634 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:02.829071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-035e371e-c605-48b6-b200-09bebdcb7ce7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:02.845033 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-035e371e-c605-48b6-b200-09bebdcb7ce7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1201 microversion: 2.1 time: 0.356450 Oct 27 19:24:02.851898 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3158/6455] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:02 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1201 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:02.857530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-da78568f-9ec7-44c6-bb0a-c677d3540857 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:02.864476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-da78568f-9ec7-44c6-bb0a-c677d3540857 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:02.874473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da78568f-9ec7-44c6-bb0a-c677d3540857 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:02.874993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da78568f-9ec7-44c6-bb0a-c677d3540857 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:02.875210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da78568f-9ec7-44c6-bb0a-c677d3540857 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:02.875947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da78568f-9ec7-44c6-bb0a-c677d3540857 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:02.878866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da78568f-9ec7-44c6-bb0a-c677d3540857 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:02.879341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da78568f-9ec7-44c6-bb0a-c677d3540857 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:02.989253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3744488d-691f-4f9a-a6a6-e44144584634 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:02.999269 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3744488d-691f-4f9a-a6a6-e44144584634 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1327 microversion: 2.1 time: 0.307760 Oct 27 19:24:03.000863 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3298/6456] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:02 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1327 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:03.011593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-35505675", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "e8c0c937-2168-417d-aaef-3f0a864cee0c"}], "key_name": "tempest-TestNetworkBasicOps-987145061", "security_groups": [{"name": "tempest-secgroup-smoke-763586239"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:03.049709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-da78568f-9ec7-44c6-bb0a-c677d3540857 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:03.059014 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-da78568f-9ec7-44c6-bb0a-c677d3540857 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1683 microversion: 2.1 time: 0.205986 Oct 27 19:24:03.060228 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3159/6457] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:02 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1683 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:03.086637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-233a6d92-d623-4a14-bef1-7848b99a27da tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:03.087562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-233a6d92-d623-4a14-bef1-7848b99a27da tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:03.094410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-233a6d92-d623-4a14-bef1-7848b99a27da tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:03.095506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-233a6d92-d623-4a14-bef1-7848b99a27da tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:03.096107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-233a6d92-d623-4a14-bef1-7848b99a27da tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:03.096831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-233a6d92-d623-4a14-bef1-7848b99a27da tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:03.097329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-233a6d92-d623-4a14-bef1-7848b99a27da tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:03.097874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-233a6d92-d623-4a14-bef1-7848b99a27da tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:03.141497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] validate_networks() for [('e8c0c937-2168-417d-aaef-3f0a864cee0c', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:24:03.299309 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-233a6d92-d623-4a14-bef1-7848b99a27da tempest-TestNetworkAdvancedServerOps-1056620225 tempest-TestNetworkAdvancedServerOps-1056620225-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1834 microversion: 2.1 time: 0.216691 Oct 27 19:24:03.299920 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3160/6458] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:03 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1834 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:03.324569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9c0ce551-f359-44cb-9f06-d5615e63d97b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:03.326587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9c0ce551-f359-44cb-9f06-d5615e63d97b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:03.333509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c0ce551-f359-44cb-9f06-d5615e63d97b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:03.334276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c0ce551-f359-44cb-9f06-d5615e63d97b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:03.334937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c0ce551-f359-44cb-9f06-d5615e63d97b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:03.340530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c0ce551-f359-44cb-9f06-d5615e63d97b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:03.341725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c0ce551-f359-44cb-9f06-d5615e63d97b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:03.342434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c0ce551-f359-44cb-9f06-d5615e63d97b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:03.524247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9c0ce551-f359-44cb-9f06-d5615e63d97b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:03.532146 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9c0ce551-f359-44cb-9f06-d5615e63d97b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1683 microversion: 2.1 time: 0.211475 Oct 27 19:24:03.532781 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3161/6459] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:03 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1683 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:03.549619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-88a295ca-d50e-44fa-ab6d-ef79405380ba tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:03.557199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-88a295ca-d50e-44fa-ab6d-ef79405380ba tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:03.580209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88a295ca-d50e-44fa-ab6d-ef79405380ba tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:03.583106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88a295ca-d50e-44fa-ab6d-ef79405380ba tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:03.583811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88a295ca-d50e-44fa-ab6d-ef79405380ba tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:03.586036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88a295ca-d50e-44fa-ab6d-ef79405380ba tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:03.586877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88a295ca-d50e-44fa-ab6d-ef79405380ba tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:03.587542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88a295ca-d50e-44fa-ab6d-ef79405380ba tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:03.612131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:24:03.612841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:24:03.613579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:24:03.614238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:24:03.615192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:24:03.625915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:03.626619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:03.627296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:03.628278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:03.628877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:03.629426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:03.648236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Getting quotas for project e2ecef554af04d36a8c61e2b30d8f9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:24:03.654003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Getting quotas for user c460e1808e4a4788b1fc3984eb4ab43b and project e2ecef554af04d36a8c61e2b30d8f9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:24:03.667610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:24:03.670933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:24:03.723508 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8024f1f6-c0b0-4af0-982a-503188ee425f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.716024 Oct 27 19:24:03.724610 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3299/6460] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:24:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:24:03.729273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c7a00583-7d1f-48c9-9906-301a8bb223cb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:03.729962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c7a00583-7d1f-48c9-9906-301a8bb223cb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:03.736923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7a00583-7d1f-48c9-9906-301a8bb223cb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:03.737431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7a00583-7d1f-48c9-9906-301a8bb223cb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:03.737891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7a00583-7d1f-48c9-9906-301a8bb223cb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:03.738648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7a00583-7d1f-48c9-9906-301a8bb223cb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:03.739119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7a00583-7d1f-48c9-9906-301a8bb223cb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:03.739749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c7a00583-7d1f-48c9-9906-301a8bb223cb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:03.775750 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-88a295ca-d50e-44fa-ab6d-ef79405380ba tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1655 microversion: 2.1 time: 0.230021 Oct 27 19:24:03.776791 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3162/6461] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:03 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1655 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:03.797180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2ed37496-b9cf-437a-b2e9-986ca1a90858 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:03.801692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2ed37496-b9cf-437a-b2e9-986ca1a90858 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:03.811962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ed37496-b9cf-437a-b2e9-986ca1a90858 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:03.812713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ed37496-b9cf-437a-b2e9-986ca1a90858 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:03.813339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ed37496-b9cf-437a-b2e9-986ca1a90858 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:03.816744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ed37496-b9cf-437a-b2e9-986ca1a90858 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:03.817429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ed37496-b9cf-437a-b2e9-986ca1a90858 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:03.818041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ed37496-b9cf-437a-b2e9-986ca1a90858 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:03.902905 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2ed37496-b9cf-437a-b2e9-986ca1a90858 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef/action" status: 200 len: 38366 microversion: 2.1 time: 0.124526 Oct 27 19:24:03.911086 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3163/6462] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:24:03 2022] POST /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef/action => generated 38366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:24:03.911905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-54915e1f-ab68-4918-9ddc-3e5dcc87f814 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:03.913096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-54915e1f-ab68-4918-9ddc-3e5dcc87f814 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:03.927434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c7a00583-7d1f-48c9-9906-301a8bb223cb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:03.938453 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c7a00583-7d1f-48c9-9906-301a8bb223cb tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1363 microversion: 2.1 time: 0.211751 Oct 27 19:24:03.939396 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3300/6463] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:03 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:03.945542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ab8dcbb6-4775-415e-9dde-f2f97a6aad60 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:03.946352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ab8dcbb6-4775-415e-9dde-f2f97a6aad60 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:03.952537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab8dcbb6-4775-415e-9dde-f2f97a6aad60 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:03.965308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab8dcbb6-4775-415e-9dde-f2f97a6aad60 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:03.965767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab8dcbb6-4775-415e-9dde-f2f97a6aad60 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:03.966947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab8dcbb6-4775-415e-9dde-f2f97a6aad60 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:03.967802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab8dcbb6-4775-415e-9dde-f2f97a6aad60 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:03.968412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab8dcbb6-4775-415e-9dde-f2f97a6aad60 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:03.990201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-54915e1f-ab68-4918-9ddc-3e5dcc87f814 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:04.003317 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-54915e1f-ab68-4918-9ddc-3e5dcc87f814 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1246 microversion: 2.1 time: 0.097164 Oct 27 19:24:04.003917 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3164/6464] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:03 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:04.027695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-93dbf0d8-84ec-4b74-ad0d-73273c614fc1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:04.028830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-93dbf0d8-84ec-4b74-ad0d-73273c614fc1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:04.039105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93dbf0d8-84ec-4b74-ad0d-73273c614fc1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:04.039945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93dbf0d8-84ec-4b74-ad0d-73273c614fc1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:04.040753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93dbf0d8-84ec-4b74-ad0d-73273c614fc1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:04.041865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93dbf0d8-84ec-4b74-ad0d-73273c614fc1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:04.042699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93dbf0d8-84ec-4b74-ad0d-73273c614fc1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:04.043348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93dbf0d8-84ec-4b74-ad0d-73273c614fc1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:04.196694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ab8dcbb6-4775-415e-9dde-f2f97a6aad60 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:04.208217 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ab8dcbb6-4775-415e-9dde-f2f97a6aad60 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1201 microversion: 2.1 time: 0.267526 Oct 27 19:24:04.212989 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3301/6465] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:03 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1201 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:04.336837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-93dbf0d8-84ec-4b74-ad0d-73273c614fc1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:04.342510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:04.356988 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-93dbf0d8-84ec-4b74-ad0d-73273c614fc1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1327 microversion: 2.1 time: 0.332519 Oct 27 19:24:04.359991 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3165/6466] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:04 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1327 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:24:04.827589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-313e131b-1c93-409a-a731-13dc34ce1690 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:04.829800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-313e131b-1c93-409a-a731-13dc34ce1690 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:04.841500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-313e131b-1c93-409a-a731-13dc34ce1690 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:04.842523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-313e131b-1c93-409a-a731-13dc34ce1690 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:04.843211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-313e131b-1c93-409a-a731-13dc34ce1690 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:04.844790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-313e131b-1c93-409a-a731-13dc34ce1690 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:04.845668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-313e131b-1c93-409a-a731-13dc34ce1690 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:04.846378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-313e131b-1c93-409a-a731-13dc34ce1690 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:04.966422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e300979f-0175-4e30-9c25-53861b588ac4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:04.967114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e300979f-0175-4e30-9c25-53861b588ac4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:04.976890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e300979f-0175-4e30-9c25-53861b588ac4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:04.978116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e300979f-0175-4e30-9c25-53861b588ac4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:04.978733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e300979f-0175-4e30-9c25-53861b588ac4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:04.979593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e300979f-0175-4e30-9c25-53861b588ac4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:04.980306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e300979f-0175-4e30-9c25-53861b588ac4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:04.980971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e300979f-0175-4e30-9c25-53861b588ac4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:05.026616 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-313e131b-1c93-409a-a731-13dc34ce1690 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1655 microversion: 2.1 time: 0.225825 Oct 27 19:24:05.027322 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3302/6467] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:04 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1655 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:05.032054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fb8383cd-a402-43d3-9339-c315a19728d6 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:05.033321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fb8383cd-a402-43d3-9339-c315a19728d6 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:05.039896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb8383cd-a402-43d3-9339-c315a19728d6 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:05.040706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb8383cd-a402-43d3-9339-c315a19728d6 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:05.041388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb8383cd-a402-43d3-9339-c315a19728d6 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:05.042194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb8383cd-a402-43d3-9339-c315a19728d6 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:05.042785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb8383cd-a402-43d3-9339-c315a19728d6 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:05.043372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb8383cd-a402-43d3-9339-c315a19728d6 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:05.118871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fb8383cd-a402-43d3-9339-c315a19728d6 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:05.130164 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fb8383cd-a402-43d3-9339-c315a19728d6 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1298 microversion: 2.1 time: 0.101374 Oct 27 19:24:05.131324 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3303/6468] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:05 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:05.233091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-50db12de-8e99-48eb-b8ab-528fc14aafc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:05.233730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-50db12de-8e99-48eb-b8ab-528fc14aafc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:05.245014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50db12de-8e99-48eb-b8ab-528fc14aafc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:05.246534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50db12de-8e99-48eb-b8ab-528fc14aafc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:05.247277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50db12de-8e99-48eb-b8ab-528fc14aafc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:05.249134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50db12de-8e99-48eb-b8ab-528fc14aafc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:05.252802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50db12de-8e99-48eb-b8ab-528fc14aafc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:05.254207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50db12de-8e99-48eb-b8ab-528fc14aafc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:05.599488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e300979f-0175-4e30-9c25-53861b588ac4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:05.608601 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e300979f-0175-4e30-9c25-53861b588ac4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1363 microversion: 2.1 time: 0.646049 Oct 27 19:24:05.612283 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3166/6469] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:04 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1363 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:05.621387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7f74f418-930c-4f4c-8d2c-787d15e8cbeb tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:05.622107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7f74f418-930c-4f4c-8d2c-787d15e8cbeb tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:05.662240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f74f418-930c-4f4c-8d2c-787d15e8cbeb tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:05.663164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f74f418-930c-4f4c-8d2c-787d15e8cbeb tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:05.668728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f74f418-930c-4f4c-8d2c-787d15e8cbeb tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:05.669597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f74f418-930c-4f4c-8d2c-787d15e8cbeb tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:05.676677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f74f418-930c-4f4c-8d2c-787d15e8cbeb tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:05.677427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f74f418-930c-4f4c-8d2c-787d15e8cbeb tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:05.714442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-50db12de-8e99-48eb-b8ab-528fc14aafc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:05.727365 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-50db12de-8e99-48eb-b8ab-528fc14aafc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1201 microversion: 2.1 time: 0.498898 Oct 27 19:24:05.729411 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3304/6470] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:05 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1201 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:06.050134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c2f4e2c2-6aa2-4068-9aac-4a5f9056fe28 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:06.050939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c2f4e2c2-6aa2-4068-9aac-4a5f9056fe28 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:06.070845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2f4e2c2-6aa2-4068-9aac-4a5f9056fe28 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.071519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2f4e2c2-6aa2-4068-9aac-4a5f9056fe28 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.073696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2f4e2c2-6aa2-4068-9aac-4a5f9056fe28 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.075366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2f4e2c2-6aa2-4068-9aac-4a5f9056fe28 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.094182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2f4e2c2-6aa2-4068-9aac-4a5f9056fe28 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.095935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2f4e2c2-6aa2-4068-9aac-4a5f9056fe28 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.130950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7f74f418-930c-4f4c-8d2c-787d15e8cbeb tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:06.141479 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7f74f418-930c-4f4c-8d2c-787d15e8cbeb tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1526 microversion: 2.1 time: 0.527894 Oct 27 19:24:06.148733 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3167/6471] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:05 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1526 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:06.160872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c24b781c-e36a-4ef4-9524-69021d4885bb req-44cb02cb-43e6-4283-80b1-de2a8aac4425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab5a511-76ec-4f79-bb0a-84428873cc69", "name": "network-vif-deleted", "tag": "176d5b78-d0ac-4136-a0bd-e28c03b5401c"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:06.196769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c24b781c-e36a-4ef4-9524-69021d4885bb req-44cb02cb-43e6-4283-80b1-de2a8aac4425 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.197022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c24b781c-e36a-4ef4-9524-69021d4885bb req-44cb02cb-43e6-4283-80b1-de2a8aac4425 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.197327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c24b781c-e36a-4ef4-9524-69021d4885bb req-44cb02cb-43e6-4283-80b1-de2a8aac4425 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.252396 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c24b781c-e36a-4ef4-9524-69021d4885bb req-44cb02cb-43e6-4283-80b1-de2a8aac4425 service nova] Creating event network-vif-deleted:176d5b78-d0ac-4136-a0bd-e28c03b5401c for instance 5ab5a511-76ec-4f79-bb0a-84428873cc69 on n-h2-860687-3 Oct 27 19:24:06.271601 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c24b781c-e36a-4ef4-9524-69021d4885bb req-44cb02cb-43e6-4283-80b1-de2a8aac4425 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118935 Oct 27 19:24:06.275473 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3168/6472] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:06.283838 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c2f4e2c2-6aa2-4068-9aac-4a5f9056fe28 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 200 len: 1449 microversion: 2.1 time: 0.237298 Oct 27 19:24:06.290270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-74884b23-2989-4dde-ae88-e05461e82fb2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:06.292043 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3305/6473] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:06 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 1449 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:24:06.292899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-74884b23-2989-4dde-ae88-e05461e82fb2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:06.301336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7012b13f-136b-4c41-a2d0-ca7d2a6471f1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:06.302173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7012b13f-136b-4c41-a2d0-ca7d2a6471f1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:06.308591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7012b13f-136b-4c41-a2d0-ca7d2a6471f1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.309505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7012b13f-136b-4c41-a2d0-ca7d2a6471f1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.310158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7012b13f-136b-4c41-a2d0-ca7d2a6471f1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.310448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74884b23-2989-4dde-ae88-e05461e82fb2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.310969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74884b23-2989-4dde-ae88-e05461e82fb2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.311419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74884b23-2989-4dde-ae88-e05461e82fb2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.311708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7012b13f-136b-4c41-a2d0-ca7d2a6471f1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.312408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74884b23-2989-4dde-ae88-e05461e82fb2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.312609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7012b13f-136b-4c41-a2d0-ca7d2a6471f1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.312878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74884b23-2989-4dde-ae88-e05461e82fb2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.313324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74884b23-2989-4dde-ae88-e05461e82fb2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.314102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7012b13f-136b-4c41-a2d0-ca7d2a6471f1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.522435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-74884b23-2989-4dde-ae88-e05461e82fb2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:06.526835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7012b13f-136b-4c41-a2d0-ca7d2a6471f1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:06.534165 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-74884b23-2989-4dde-ae88-e05461e82fb2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1304 microversion: 2.1 time: 0.253885 Oct 27 19:24:06.537887 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7012b13f-136b-4c41-a2d0-ca7d2a6471f1 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1526 microversion: 2.1 time: 0.244683 Oct 27 19:24:06.551010 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3306/6474] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:06 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1526 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:06.551351 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3169/6475] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:06 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1304 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:06.557524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2d2cc4e3-09fe-4bc9-925e-42058e3b8a54 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:06.563479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ae5e33bc-65ff-4405-b1b1-a52c0230abaf req-cfd809ca-c4cd-44dc-9286-b1237fa71d71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41df1a5-196c-454a-b18d-3229ee0b41ef", "tag": "5a8f0d22-cfd5-44d4-8a29-8256b2e1df22"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:06.564932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2d2cc4e3-09fe-4bc9-925e-42058e3b8a54 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:06.576394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ae5e33bc-65ff-4405-b1b1-a52c0230abaf req-cfd809ca-c4cd-44dc-9286-b1237fa71d71 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.576893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ae5e33bc-65ff-4405-b1b1-a52c0230abaf req-cfd809ca-c4cd-44dc-9286-b1237fa71d71 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.577340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ae5e33bc-65ff-4405-b1b1-a52c0230abaf req-cfd809ca-c4cd-44dc-9286-b1237fa71d71 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.577768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d2cc4e3-09fe-4bc9-925e-42058e3b8a54 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.578631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d2cc4e3-09fe-4bc9-925e-42058e3b8a54 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.579855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d2cc4e3-09fe-4bc9-925e-42058e3b8a54 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.582133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d2cc4e3-09fe-4bc9-925e-42058e3b8a54 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.584465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d2cc4e3-09fe-4bc9-925e-42058e3b8a54 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.585355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d2cc4e3-09fe-4bc9-925e-42058e3b8a54 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.616389 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ae5e33bc-65ff-4405-b1b1-a52c0230abaf req-cfd809ca-c4cd-44dc-9286-b1237fa71d71 service nova] Creating event network-changed:5a8f0d22-cfd5-44d4-8a29-8256b2e1df22 for instance f41df1a5-196c-454a-b18d-3229ee0b41ef on n-h1-860687-3 Oct 27 19:24:06.625468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2d2cc4e3-09fe-4bc9-925e-42058e3b8a54 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:24:06.632671 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ae5e33bc-65ff-4405-b1b1-a52c0230abaf req-cfd809ca-c4cd-44dc-9286-b1237fa71d71 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079793 Oct 27 19:24:06.633771 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3170/6476] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:06.741713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-135e6bc1-b451-4f9a-8c81-d809d22a5655 tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:06.742526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-135e6bc1-b451-4f9a-8c81-d809d22a5655 tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:06.754743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-135e6bc1-b451-4f9a-8c81-d809d22a5655 tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.755248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-135e6bc1-b451-4f9a-8c81-d809d22a5655 tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.783502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-135e6bc1-b451-4f9a-8c81-d809d22a5655 tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.785367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-135e6bc1-b451-4f9a-8c81-d809d22a5655 tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.787237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-135e6bc1-b451-4f9a-8c81-d809d22a5655 tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.789451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-135e6bc1-b451-4f9a-8c81-d809d22a5655 tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.793452 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2d2cc4e3-09fe-4bc9-925e-42058e3b8a54 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 204 len: 0 microversion: 2.1 time: 0.247813 Oct 27 19:24:06.794062 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3307/6477] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:24:06 2022] DELETE /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:24:06.800007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dff061e7-558e-47ea-83af-cc4139b42ca7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:06.806963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dff061e7-558e-47ea-83af-cc4139b42ca7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:06.817070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dff061e7-558e-47ea-83af-cc4139b42ca7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.819068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dff061e7-558e-47ea-83af-cc4139b42ca7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.819710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dff061e7-558e-47ea-83af-cc4139b42ca7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.822196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dff061e7-558e-47ea-83af-cc4139b42ca7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.822897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dff061e7-558e-47ea-83af-cc4139b42ca7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.826154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dff061e7-558e-47ea-83af-cc4139b42ca7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.831309 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-135e6bc1-b451-4f9a-8c81-d809d22a5655 tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] HTTP exception thrown: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-135e6bc1-b451-4f9a-8c81-d809d22a5655 tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Request method failure captured: Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d HTTP/1.1 Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtrEWitsKiuGItdWaaFjyZFe6Gq-jDZ9EC2F9IyNj2-u9IDM5VLYXchnUHedo27WbO0fjM_zETPBmKED9bL9iEQHVF6vKsFnAX10_W_yfUzCSKJJJF5qJafEUnrImPP-QF-xp6Ckw1YwPUbwa74OlE6SVRvCdvEeqOcDZ1818Bk3-OA Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: d9499d5157a24707857aa087e5aad07d Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1369338370 Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d9499d5157a24707857aa087e5aad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d9499d5157a24707857aa087e5aad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d9499d5157a24707857aa087e5aad07d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d9499d5157a24707857aa087e5aad07d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1369338370 Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: d9499d5157a24707857aa087e5aad07d Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1369338370 Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1369338370-project Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 9f057dead90b48cba55bb8c18ecba594 Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1369338370-project Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'c9d5a034-eb5f-4fbf-b37a-f63766bc394d'} Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:24:06.840746 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:24:06.845797 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:06.845797 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:06.845797 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:06.845797 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:06.845797 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:06.845797 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:06.845797 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:06.845797 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:24:06.845797 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:24:06.845797 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:06.845797 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:06.845797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-135e6bc1-b451-4f9a-8c81-d809d22a5655 tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Returning 404 to user: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:24:06.845797 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-135e6bc1-b451-4f9a-8c81-d809d22a5655 tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 404 len: 111 microversion: 2.1 time: 0.207594 Oct 27 19:24:06.854883 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3171/6478] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:24:06 2022] DELETE /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 111 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:24:06.878781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8e8c8739-157c-49b0-8d26-ec75720b87bd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:06.879417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8e8c8739-157c-49b0-8d26-ec75720b87bd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:06.898103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e8c8739-157c-49b0-8d26-ec75720b87bd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.898629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e8c8739-157c-49b0-8d26-ec75720b87bd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.899089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e8c8739-157c-49b0-8d26-ec75720b87bd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:06.899821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e8c8739-157c-49b0-8d26-ec75720b87bd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:06.900283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e8c8739-157c-49b0-8d26-ec75720b87bd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:06.900724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e8c8739-157c-49b0-8d26-ec75720b87bd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:07.166183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dff061e7-558e-47ea-83af-cc4139b42ca7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:07.179074 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dff061e7-558e-47ea-83af-cc4139b42ca7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1363 microversion: 2.1 time: 0.383718 Oct 27 19:24:07.181411 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3308/6479] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:06 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1363 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:07.187680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-754d11d6-0c58-45b8-b647-db00879dc3a1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:07.188994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-754d11d6-0c58-45b8-b647-db00879dc3a1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:07.197734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-754d11d6-0c58-45b8-b647-db00879dc3a1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:07.198818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-754d11d6-0c58-45b8-b647-db00879dc3a1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:07.199521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-754d11d6-0c58-45b8-b647-db00879dc3a1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:07.200697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-754d11d6-0c58-45b8-b647-db00879dc3a1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:07.201422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-754d11d6-0c58-45b8-b647-db00879dc3a1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:07.202993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-754d11d6-0c58-45b8-b647-db00879dc3a1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:07.649864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-754d11d6-0c58-45b8-b647-db00879dc3a1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:07.661368 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-754d11d6-0c58-45b8-b647-db00879dc3a1 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1689 microversion: 2.1 time: 0.478031 Oct 27 19:24:07.662884 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3309/6480] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:07 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1689 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:07.676313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2c302f11-8189-4a4e-a868-6fa6e239817d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:07.677491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2c302f11-8189-4a4e-a868-6fa6e239817d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:07.687978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c302f11-8189-4a4e-a868-6fa6e239817d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:07.691246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c302f11-8189-4a4e-a868-6fa6e239817d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:07.692038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c302f11-8189-4a4e-a868-6fa6e239817d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:07.693067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c302f11-8189-4a4e-a868-6fa6e239817d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:07.694998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c302f11-8189-4a4e-a868-6fa6e239817d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:07.695702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c302f11-8189-4a4e-a868-6fa6e239817d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:07.803003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8e8c8739-157c-49b0-8d26-ec75720b87bd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:07.816395 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8e8c8739-157c-49b0-8d26-ec75720b87bd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1387 microversion: 2.1 time: 0.960136 Oct 27 19:24:07.831113 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3172/6481] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:06 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1387 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:07.845303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-69ba185b-970b-4001-a1f5-8554e2b77caa tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:07.846628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-69ba185b-970b-4001-a1f5-8554e2b77caa tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: 5ab5a511-76ec-4f79-bb0a-84428873cc69] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:07.853280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69ba185b-970b-4001-a1f5-8554e2b77caa tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:07.854071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69ba185b-970b-4001-a1f5-8554e2b77caa tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:07.857698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69ba185b-970b-4001-a1f5-8554e2b77caa tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:07.858585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69ba185b-970b-4001-a1f5-8554e2b77caa tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:07.859200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69ba185b-970b-4001-a1f5-8554e2b77caa tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:07.859952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69ba185b-970b-4001-a1f5-8554e2b77caa tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:07.888879 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-69ba185b-970b-4001-a1f5-8554e2b77caa tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] HTTP exception thrown: Instance 5ab5a511-76ec-4f79-bb0a-84428873cc69 could not be found. Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-69ba185b-970b-4001-a1f5-8554e2b77caa tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Request method failure captured: Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 HTTP/1.1 Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtqc1BGQcZSbJuPYdvk_e4owJDWIvHgkDFrlFLCZ2XgufZgbMk5p-RAjQnWsD3kbQVmZx9UDB9aUn3CINMc4Tpps2dVh_KThd1LxcUnq9Ug7AD2aQO2u3n3NoVDYCAOzkeAInlVQyI7Ne14GcQ0jaXhCA-CDX0Cz3lZ7IjfhRvkMqfU Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 2b11c73f7fb04ae9b898a278a8b9ccdc Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestServerMultinode-715929352 Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2b11c73f7fb04ae9b898a278a8b9ccdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2b11c73f7fb04ae9b898a278a8b9ccdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2b11c73f7fb04ae9b898a278a8b9ccdc", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2b11c73f7fb04ae9b898a278a8b9ccdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestServerMultinode-715929352 Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 2b11c73f7fb04ae9b898a278a8b9ccdc Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestServerMultinode-715929352 Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestServerMultinode-715929352-project-admin Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 7b5fa0bd00e34b40a79b6d11693e7881 Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestServerMultinode-715929352-project-admin Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 5ab5a511-76ec-4f79-bb0a-84428873cc69 could not be found. Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '5ab5a511-76ec-4f79-bb0a-84428873cc69'} Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ab5a511-76ec-4f79-bb0a-84428873cc69 could not be found. Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ab5a511-76ec-4f79-bb0a-84428873cc69 could not be found. Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:07.891604 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:07.895961 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:07.895961 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:07.895961 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:07.895961 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:24:07.895961 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:24:07.895961 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ab5a511-76ec-4f79-bb0a-84428873cc69 could not be found. Oct 27 19:24:07.895961 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:07.898256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-69ba185b-970b-4001-a1f5-8554e2b77caa tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Returning 404 to user: Instance 5ab5a511-76ec-4f79-bb0a-84428873cc69 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:24:07.899402 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-69ba185b-970b-4001-a1f5-8554e2b77caa tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69" status: 404 len: 111 microversion: 2.1 time: 0.064910 Oct 27 19:24:07.900571 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3173/6482] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:07 2022] GET /compute/v2.1/servers/5ab5a511-76ec-4f79-bb0a-84428873cc69 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:24:07.906088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f36a3828-29b8-468d-8be0-a320283b857f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:07.907082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f36a3828-29b8-468d-8be0-a320283b857f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:07.914205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f36a3828-29b8-468d-8be0-a320283b857f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:07.915043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f36a3828-29b8-468d-8be0-a320283b857f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:07.915395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f36a3828-29b8-468d-8be0-a320283b857f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:07.916188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f36a3828-29b8-468d-8be0-a320283b857f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:07.916962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f36a3828-29b8-468d-8be0-a320283b857f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:07.917235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f36a3828-29b8-468d-8be0-a320283b857f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:08.250139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f36a3828-29b8-468d-8be0-a320283b857f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:08.264368 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f36a3828-29b8-468d-8be0-a320283b857f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1371 microversion: 2.1 time: 0.362283 Oct 27 19:24:08.267671 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3174/6483] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:07 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:08.277545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b50aad31-a5af-4f7e-942c-e8834f4fb5eb req-407461e2-39bb-4a9a-a376-f72deaf7abac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0719014-1b89-4535-8418-f4fb85165af7", "name": "network-vif-plugged", "status": "completed", "tag": "57fddc88-bdab-4281-89b1-edd171f702af"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:08.303331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b50aad31-a5af-4f7e-942c-e8834f4fb5eb req-407461e2-39bb-4a9a-a376-f72deaf7abac service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:08.303829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b50aad31-a5af-4f7e-942c-e8834f4fb5eb req-407461e2-39bb-4a9a-a376-f72deaf7abac service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:08.304273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b50aad31-a5af-4f7e-942c-e8834f4fb5eb req-407461e2-39bb-4a9a-a376-f72deaf7abac service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:08.310713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2c302f11-8189-4a4e-a868-6fa6e239817d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:08.320108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:08.327568 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2c302f11-8189-4a4e-a868-6fa6e239817d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1526 microversion: 2.1 time: 0.660207 Oct 27 19:24:08.329064 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3310/6484] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:07 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1526 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:08.333689 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b50aad31-a5af-4f7e-942c-e8834f4fb5eb req-407461e2-39bb-4a9a-a376-f72deaf7abac service nova] Creating event network-vif-plugged:57fddc88-bdab-4281-89b1-edd171f702af for instance c0719014-1b89-4535-8418-f4fb85165af7 on n-h2-860687-3 Oct 27 19:24:08.341224 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b50aad31-a5af-4f7e-942c-e8834f4fb5eb req-407461e2-39bb-4a9a-a376-f72deaf7abac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069452 Oct 27 19:24:08.352805 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3175/6485] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:08.360043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c47d56e5-09f5-4111-8fa1-79c83fc2162f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:08.363569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c47d56e5-09f5-4111-8fa1-79c83fc2162f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:08.366996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b82fbb6-c946-4a55-a6ab-d4aa037623a6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:08.368501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7b82fbb6-c946-4a55-a6ab-d4aa037623a6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:08.381790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47d56e5-09f5-4111-8fa1-79c83fc2162f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:08.383446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47d56e5-09f5-4111-8fa1-79c83fc2162f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:08.383903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47d56e5-09f5-4111-8fa1-79c83fc2162f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:08.386290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47d56e5-09f5-4111-8fa1-79c83fc2162f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:08.386791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47d56e5-09f5-4111-8fa1-79c83fc2162f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:08.387236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47d56e5-09f5-4111-8fa1-79c83fc2162f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:08.390010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b82fbb6-c946-4a55-a6ab-d4aa037623a6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:08.391067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b82fbb6-c946-4a55-a6ab-d4aa037623a6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:08.391521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b82fbb6-c946-4a55-a6ab-d4aa037623a6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:08.396018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b82fbb6-c946-4a55-a6ab-d4aa037623a6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:08.398529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b82fbb6-c946-4a55-a6ab-d4aa037623a6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:08.398998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b82fbb6-c946-4a55-a6ab-d4aa037623a6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:08.456268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7b82fbb6-c946-4a55-a6ab-d4aa037623a6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:24:08.659758 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7b82fbb6-c946-4a55-a6ab-d4aa037623a6 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "DELETE /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 204 len: 0 microversion: 2.1 time: 0.302789 Oct 27 19:24:08.660739 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3176/6486] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:24:08 2022] DELETE /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:24:08.669626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e3d47422-e7c5-4c08-bbb3-4cee420f09b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:08.670778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e3d47422-e7c5-4c08-bbb3-4cee420f09b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:08.682788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3d47422-e7c5-4c08-bbb3-4cee420f09b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:08.683484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3d47422-e7c5-4c08-bbb3-4cee420f09b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:08.684123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3d47422-e7c5-4c08-bbb3-4cee420f09b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:08.685102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3d47422-e7c5-4c08-bbb3-4cee420f09b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:08.685938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3d47422-e7c5-4c08-bbb3-4cee420f09b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:08.686567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3d47422-e7c5-4c08-bbb3-4cee420f09b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:08.740204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c47d56e5-09f5-4111-8fa1-79c83fc2162f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:08.748659 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c47d56e5-09f5-4111-8fa1-79c83fc2162f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1387 microversion: 2.1 time: 0.417635 Oct 27 19:24:08.749417 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3311/6487] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:08 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1387 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:08.780149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f113b79-1e76-4890-a786-c9e5b0af743d tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Action: 'update', calling method: >, body: {"server": {"name": "c9d5a034-eb5f-4fbf-b37a-f63766bc394d_new"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:08.783973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6f113b79-1e76-4890-a786-c9e5b0af743d tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:08.790930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f113b79-1e76-4890-a786-c9e5b0af743d tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:08.791661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f113b79-1e76-4890-a786-c9e5b0af743d tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:08.792354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f113b79-1e76-4890-a786-c9e5b0af743d tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:08.793164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f113b79-1e76-4890-a786-c9e5b0af743d tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:08.793725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f113b79-1e76-4890-a786-c9e5b0af743d tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:08.794278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f113b79-1e76-4890-a786-c9e5b0af743d tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:08.810690 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-6f113b79-1e76-4890-a786-c9e5b0af743d tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] HTTP exception thrown: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f113b79-1e76-4890-a786-c9e5b0af743d tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Request method failure captured: Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: request: PUT /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d HTTP/1.1 Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 64 Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtrEWitsKiuGItdWaaFjyZFe6Gq-jDZ9EC2F9IyNj2-u9IDM5VLYXchnUHedo27WbO0fjM_zETPBmKED9bL9iEQHVF6vKsFnAX10_W_yfUzCSKJJJF5qJafEUnrImPP-QF-xp6Ckw1YwPUbwa74OlE6SVRvCdvEeqOcDZ1818Bk3-OA Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: d9499d5157a24707857aa087e5aad07d Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1369338370 Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d9499d5157a24707857aa087e5aad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d9499d5157a24707857aa087e5aad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d9499d5157a24707857aa087e5aad07d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d9499d5157a24707857aa087e5aad07d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1369338370 Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: d9499d5157a24707857aa087e5aad07d Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1369338370 Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1369338370-project Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 9f057dead90b48cba55bb8c18ecba594 Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1369338370-project Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: {"server": {"name": "c9d5a034-eb5f-4fbf-b37a-f63766bc394d_new"}} Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'c9d5a034-eb5f-4fbf-b37a-f63766bc394d', 'body': {'server': {'name': 'c9d5a034-eb5f-4fbf-b37a-f63766bc394d_new'}}} Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:24:08.812534 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:08.818014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f113b79-1e76-4890-a786-c9e5b0af743d tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] Returning 404 to user: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:24:08.819261 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6f113b79-1e76-4890-a786-c9e5b0af743d tempest-ServersNegativeTestMultiTenantJSON-1369338370 tempest-ServersNegativeTestMultiTenantJSON-1369338370-project] 10.222.0.42 "PUT /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 404 len: 111 microversion: 2.1 time: 0.053462 Oct 27 19:24:08.819953 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3312/6488] 10.222.0.42 () {60 vars in 1256 bytes} [Thu Oct 27 19:24:08 2022] PUT /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:24:08.825645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-17520d16-bc0f-4ba8-95bb-cd77e4230638 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:08.826398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-17520d16-bc0f-4ba8-95bb-cd77e4230638 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:08.833448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17520d16-bc0f-4ba8-95bb-cd77e4230638 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:08.834193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17520d16-bc0f-4ba8-95bb-cd77e4230638 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:08.834764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17520d16-bc0f-4ba8-95bb-cd77e4230638 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:08.835569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17520d16-bc0f-4ba8-95bb-cd77e4230638 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:08.836128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17520d16-bc0f-4ba8-95bb-cd77e4230638 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:08.836686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-17520d16-bc0f-4ba8-95bb-cd77e4230638 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.004046 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-17520d16-bc0f-4ba8-95bb-cd77e4230638 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1656 microversion: 2.1 time: 0.182999 Oct 27 19:24:09.005126 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3313/6489] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:08 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1656 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:09.010928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-973bc95b-6919-4e77-ab21-60c6c4145729 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:09.011673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-973bc95b-6919-4e77-ab21-60c6c4145729 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:09.026147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973bc95b-6919-4e77-ab21-60c6c4145729 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.026970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973bc95b-6919-4e77-ab21-60c6c4145729 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.027603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973bc95b-6919-4e77-ab21-60c6c4145729 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.028425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973bc95b-6919-4e77-ab21-60c6c4145729 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.029008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973bc95b-6919-4e77-ab21-60c6c4145729 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.029546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-973bc95b-6919-4e77-ab21-60c6c4145729 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.030882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e3d47422-e7c5-4c08-bbb3-4cee420f09b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:09.041192 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e3d47422-e7c5-4c08-bbb3-4cee420f09b2 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1363 microversion: 2.1 time: 0.378309 Oct 27 19:24:09.062202 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3177/6490] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:08 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:09.069324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-e695697b-aeaf-4d85-bdbb-68caf9f83831 req-1a87aa9f-be00-4ee4-abaa-9dee4ad96705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41df1a5-196c-454a-b18d-3229ee0b41ef", "name": "network-vif-deleted", "tag": "5a8f0d22-cfd5-44d4-8a29-8256b2e1df22"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:09.085154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e695697b-aeaf-4d85-bdbb-68caf9f83831 req-1a87aa9f-be00-4ee4-abaa-9dee4ad96705 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.085902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e695697b-aeaf-4d85-bdbb-68caf9f83831 req-1a87aa9f-be00-4ee4-abaa-9dee4ad96705 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.086943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e695697b-aeaf-4d85-bdbb-68caf9f83831 req-1a87aa9f-be00-4ee4-abaa-9dee4ad96705 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.105009 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-e695697b-aeaf-4d85-bdbb-68caf9f83831 req-1a87aa9f-be00-4ee4-abaa-9dee4ad96705 service nova] Creating event network-vif-deleted:5a8f0d22-cfd5-44d4-8a29-8256b2e1df22 for instance f41df1a5-196c-454a-b18d-3229ee0b41ef on n-h1-860687-3 Oct 27 19:24:09.112413 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-e695697b-aeaf-4d85-bdbb-68caf9f83831 req-1a87aa9f-be00-4ee4-abaa-9dee4ad96705 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048481 Oct 27 19:24:09.113643 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3178/6491] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:09.125684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-351fb7de-d5be-4fc7-98cf-0ed01dc0666a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:09.127159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-351fb7de-d5be-4fc7-98cf-0ed01dc0666a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:09.134271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-351fb7de-d5be-4fc7-98cf-0ed01dc0666a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.141460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-351fb7de-d5be-4fc7-98cf-0ed01dc0666a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.142719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-351fb7de-d5be-4fc7-98cf-0ed01dc0666a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.143737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-351fb7de-d5be-4fc7-98cf-0ed01dc0666a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.144392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-351fb7de-d5be-4fc7-98cf-0ed01dc0666a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.146469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-973bc95b-6919-4e77-ab21-60c6c4145729 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:09.146712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-351fb7de-d5be-4fc7-98cf-0ed01dc0666a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.158612 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-973bc95b-6919-4e77-ab21-60c6c4145729 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1502 microversion: 2.1 time: 0.151599 Oct 27 19:24:09.171401 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3314/6492] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:09 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:09.180317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-714c9cb2-8499-4d8d-bea6-abc5ea64d24d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:09.180840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-714c9cb2-8499-4d8d-bea6-abc5ea64d24d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:09.192720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-714c9cb2-8499-4d8d-bea6-abc5ea64d24d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.193568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-714c9cb2-8499-4d8d-bea6-abc5ea64d24d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.194549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-714c9cb2-8499-4d8d-bea6-abc5ea64d24d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.195686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-714c9cb2-8499-4d8d-bea6-abc5ea64d24d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.196341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-714c9cb2-8499-4d8d-bea6-abc5ea64d24d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.196856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-714c9cb2-8499-4d8d-bea6-abc5ea64d24d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.228089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-714c9cb2-8499-4d8d-bea6-abc5ea64d24d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:24:09.311790 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-714c9cb2-8499-4d8d-bea6-abc5ea64d24d tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 204 len: 0 microversion: 2.1 time: 0.138832 Oct 27 19:24:09.312741 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3315/6493] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:24:09 2022] DELETE /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:24:09.319128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e61dbc54-2b8b-4c2c-af80-2827f6ddaac0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:09.319849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e61dbc54-2b8b-4c2c-af80-2827f6ddaac0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:09.325805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e61dbc54-2b8b-4c2c-af80-2827f6ddaac0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.326298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e61dbc54-2b8b-4c2c-af80-2827f6ddaac0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.326785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e61dbc54-2b8b-4c2c-af80-2827f6ddaac0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.327499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e61dbc54-2b8b-4c2c-af80-2827f6ddaac0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.327961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e61dbc54-2b8b-4c2c-af80-2827f6ddaac0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.328400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e61dbc54-2b8b-4c2c-af80-2827f6ddaac0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.382577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-351fb7de-d5be-4fc7-98cf-0ed01dc0666a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:09.390978 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-351fb7de-d5be-4fc7-98cf-0ed01dc0666a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1387 microversion: 2.1 time: 0.275712 Oct 27 19:24:09.392364 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3179/6494] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:09 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1387 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:09.397500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f1fcdc06-b40f-4284-a8e7-1711b9cff87c tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:09.398128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f1fcdc06-b40f-4284-a8e7-1711b9cff87c tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:09.404420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1fcdc06-b40f-4284-a8e7-1711b9cff87c tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.404927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1fcdc06-b40f-4284-a8e7-1711b9cff87c tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.405365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1fcdc06-b40f-4284-a8e7-1711b9cff87c tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.406245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1fcdc06-b40f-4284-a8e7-1711b9cff87c tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.406748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1fcdc06-b40f-4284-a8e7-1711b9cff87c tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.407176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1fcdc06-b40f-4284-a8e7-1711b9cff87c tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.495819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e61dbc54-2b8b-4c2c-af80-2827f6ddaac0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:09.503954 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e61dbc54-2b8b-4c2c-af80-2827f6ddaac0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1371 microversion: 2.1 time: 0.189890 Oct 27 19:24:09.504469 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3316/6495] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:09 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:09.510571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-59eef847-cdfa-465e-b562-11e9a90da3f0 req-485d7f74-1405-4e5f-bddc-fda26979a586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795dc456-a993-489c-918a-8f29bb1403b9", "tag": "1f160966-2e84-4766-bc8a-e388539da466"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:09.520383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-59eef847-cdfa-465e-b562-11e9a90da3f0 req-485d7f74-1405-4e5f-bddc-fda26979a586 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.520874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-59eef847-cdfa-465e-b562-11e9a90da3f0 req-485d7f74-1405-4e5f-bddc-fda26979a586 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.521318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-59eef847-cdfa-465e-b562-11e9a90da3f0 req-485d7f74-1405-4e5f-bddc-fda26979a586 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.533078 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-59eef847-cdfa-465e-b562-11e9a90da3f0 req-485d7f74-1405-4e5f-bddc-fda26979a586 service nova] Creating event network-changed:1f160966-2e84-4766-bc8a-e388539da466 for instance 795dc456-a993-489c-918a-8f29bb1403b9 on n-h1-860687-3 Oct 27 19:24:09.538206 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-59eef847-cdfa-465e-b562-11e9a90da3f0 req-485d7f74-1405-4e5f-bddc-fda26979a586 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032515 Oct 27 19:24:09.538845 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3317/6496] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:09.544132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1ce4cfc0-1159-4bd7-b430-5d571e920c13 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:09.544713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1ce4cfc0-1159-4bd7-b430-5d571e920c13 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:09.552185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ce4cfc0-1159-4bd7-b430-5d571e920c13 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.552552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ce4cfc0-1159-4bd7-b430-5d571e920c13 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.553192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ce4cfc0-1159-4bd7-b430-5d571e920c13 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.553782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ce4cfc0-1159-4bd7-b430-5d571e920c13 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.554253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ce4cfc0-1159-4bd7-b430-5d571e920c13 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.554743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1ce4cfc0-1159-4bd7-b430-5d571e920c13 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.583472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1ce4cfc0-1159-4bd7-b430-5d571e920c13 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:24:09.610378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f1fcdc06-b40f-4284-a8e7-1711b9cff87c tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:09.618916 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f1fcdc06-b40f-4284-a8e7-1711b9cff87c tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1532 microversion: 2.1 time: 0.224950 Oct 27 19:24:09.619502 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3180/6497] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:09 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1532 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:09.661078 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1ce4cfc0-1159-4bd7-b430-5d571e920c13 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 204 len: 0 microversion: 2.1 time: 0.120465 Oct 27 19:24:09.661797 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3318/6498] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:24:09 2022] DELETE /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:24:09.670414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ee507003-b437-4a39-b93e-7b58fcd475fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:09.671045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ee507003-b437-4a39-b93e-7b58fcd475fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:09.678326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee507003-b437-4a39-b93e-7b58fcd475fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.678852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee507003-b437-4a39-b93e-7b58fcd475fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.679295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee507003-b437-4a39-b93e-7b58fcd475fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.679999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee507003-b437-4a39-b93e-7b58fcd475fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:09.680456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee507003-b437-4a39-b93e-7b58fcd475fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:09.681062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee507003-b437-4a39-b93e-7b58fcd475fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:09.831790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ee507003-b437-4a39-b93e-7b58fcd475fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:09.841365 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ee507003-b437-4a39-b93e-7b58fcd475fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1393 microversion: 2.1 time: 0.175096 Oct 27 19:24:09.842562 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3181/6499] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:09 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:24:10.031103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-77edb301-465e-40cd-8a65-3dd5eed31b6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:10.031830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-77edb301-465e-40cd-8a65-3dd5eed31b6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:10.038363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77edb301-465e-40cd-8a65-3dd5eed31b6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:10.038887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77edb301-465e-40cd-8a65-3dd5eed31b6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:10.039337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77edb301-465e-40cd-8a65-3dd5eed31b6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:10.040040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77edb301-465e-40cd-8a65-3dd5eed31b6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:10.040506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77edb301-465e-40cd-8a65-3dd5eed31b6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:10.040944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77edb301-465e-40cd-8a65-3dd5eed31b6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:10.070125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-154aacc2-8b29-4f52-8f7a-78ed6997a8f5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:10.070784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-154aacc2-8b29-4f52-8f7a-78ed6997a8f5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:10.076873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154aacc2-8b29-4f52-8f7a-78ed6997a8f5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:10.077370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154aacc2-8b29-4f52-8f7a-78ed6997a8f5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:10.077819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154aacc2-8b29-4f52-8f7a-78ed6997a8f5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:10.078557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154aacc2-8b29-4f52-8f7a-78ed6997a8f5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:10.079022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154aacc2-8b29-4f52-8f7a-78ed6997a8f5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:10.079988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154aacc2-8b29-4f52-8f7a-78ed6997a8f5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:10.179026 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-77edb301-465e-40cd-8a65-3dd5eed31b6f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1656 microversion: 2.1 time: 0.151254 Oct 27 19:24:10.179624 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3319/6500] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:10 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:10.184300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-71bf1c99-f5bf-4350-b481-7f04bf483f30 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:10.184936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-71bf1c99-f5bf-4350-b481-7f04bf483f30 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:10.192821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71bf1c99-f5bf-4350-b481-7f04bf483f30 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:10.193430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71bf1c99-f5bf-4350-b481-7f04bf483f30 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:10.194012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71bf1c99-f5bf-4350-b481-7f04bf483f30 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:10.194841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71bf1c99-f5bf-4350-b481-7f04bf483f30 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:10.195413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71bf1c99-f5bf-4350-b481-7f04bf483f30 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:10.195907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71bf1c99-f5bf-4350-b481-7f04bf483f30 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:10.216520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-154aacc2-8b29-4f52-8f7a-78ed6997a8f5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:10.226983 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-154aacc2-8b29-4f52-8f7a-78ed6997a8f5 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1363 microversion: 2.1 time: 0.161680 Oct 27 19:24:10.233356 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3182/6501] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:10 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:24:10.233526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71bf1c99-f5bf-4350-b481-7f04bf483f30 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:10.233526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71bf1c99-f5bf-4350-b481-7f04bf483f30 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:10.233526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71bf1c99-f5bf-4350-b481-7f04bf483f30 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:10.233526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-71bf1c99-f5bf-4350-b481-7f04bf483f30 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lazy-loading 'fault' on Instance uuid f41df1a5-196c-454a-b18d-3229ee0b41ef {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:24:10.286083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-71bf1c99-f5bf-4350-b481-7f04bf483f30 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:10.294097 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-71bf1c99-f5bf-4350-b481-7f04bf483f30 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1355 microversion: 2.1 time: 0.113492 Oct 27 19:24:10.294703 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3320/6502] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:10 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1355 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:10.528579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4e5895a3-d259-4a40-b3a3-9597c3e019fc tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:10.529238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4e5895a3-d259-4a40-b3a3-9597c3e019fc tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:10.536014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5895a3-d259-4a40-b3a3-9597c3e019fc tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:10.536514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5895a3-d259-4a40-b3a3-9597c3e019fc tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:10.536990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5895a3-d259-4a40-b3a3-9597c3e019fc tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:10.537688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5895a3-d259-4a40-b3a3-9597c3e019fc tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:10.538145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5895a3-d259-4a40-b3a3-9597c3e019fc tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:10.538605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5895a3-d259-4a40-b3a3-9597c3e019fc tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:10.644485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a604549a-9ee5-45dd-adfd-fbb72d57d5a0 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:10.645108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a604549a-9ee5-45dd-adfd-fbb72d57d5a0 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:10.651215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a604549a-9ee5-45dd-adfd-fbb72d57d5a0 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:10.651706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a604549a-9ee5-45dd-adfd-fbb72d57d5a0 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:10.652150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a604549a-9ee5-45dd-adfd-fbb72d57d5a0 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:10.652850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a604549a-9ee5-45dd-adfd-fbb72d57d5a0 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:10.653313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a604549a-9ee5-45dd-adfd-fbb72d57d5a0 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:10.653744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a604549a-9ee5-45dd-adfd-fbb72d57d5a0 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:10.670637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4e5895a3-d259-4a40-b3a3-9597c3e019fc tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:10.680128 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4e5895a3-d259-4a40-b3a3-9597c3e019fc tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1371 microversion: 2.1 time: 0.156253 Oct 27 19:24:10.680714 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3183/6503] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:10 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:10.789381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a604549a-9ee5-45dd-adfd-fbb72d57d5a0 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:10.797771 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a604549a-9ee5-45dd-adfd-fbb72d57d5a0 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1532 microversion: 2.1 time: 0.157765 Oct 27 19:24:10.799406 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3321/6504] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:10 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1532 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:24:10.867907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5bb8b8ea-cf7e-418c-b598-e669b3f37a80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:10.868751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5bb8b8ea-cf7e-418c-b598-e669b3f37a80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:10.870770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:10.881387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bb8b8ea-cf7e-418c-b598-e669b3f37a80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:10.881743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bb8b8ea-cf7e-418c-b598-e669b3f37a80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:10.882569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bb8b8ea-cf7e-418c-b598-e669b3f37a80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:10.883494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bb8b8ea-cf7e-418c-b598-e669b3f37a80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:10.884109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bb8b8ea-cf7e-418c-b598-e669b3f37a80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:10.884689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5bb8b8ea-cf7e-418c-b598-e669b3f37a80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:11.023811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5bb8b8ea-cf7e-418c-b598-e669b3f37a80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:11.026005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:11.033504 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5bb8b8ea-cf7e-418c-b598-e669b3f37a80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1393 microversion: 2.1 time: 0.169896 Oct 27 19:24:11.034103 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3184/6505] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:10 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:24:11.202856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bc6d65c9-a970-4537-9cfc-cd4fe810d70f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:11.203373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bc6d65c9-a970-4537-9cfc-cd4fe810d70f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:11.210341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc6d65c9-a970-4537-9cfc-cd4fe810d70f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:11.210870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc6d65c9-a970-4537-9cfc-cd4fe810d70f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:11.211319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc6d65c9-a970-4537-9cfc-cd4fe810d70f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:11.212024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc6d65c9-a970-4537-9cfc-cd4fe810d70f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:11.212528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc6d65c9-a970-4537-9cfc-cd4fe810d70f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:11.212914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc6d65c9-a970-4537-9cfc-cd4fe810d70f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:11.251302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4ae4e20f-8ef8-4d17-b013-9584d7028e55 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:11.251935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4ae4e20f-8ef8-4d17-b013-9584d7028e55 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:11.260414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ae4e20f-8ef8-4d17-b013-9584d7028e55 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:11.260968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ae4e20f-8ef8-4d17-b013-9584d7028e55 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:11.261416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ae4e20f-8ef8-4d17-b013-9584d7028e55 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:11.262127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ae4e20f-8ef8-4d17-b013-9584d7028e55 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:11.262619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ae4e20f-8ef8-4d17-b013-9584d7028e55 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:11.263056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ae4e20f-8ef8-4d17-b013-9584d7028e55 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:11.363528 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bc6d65c9-a970-4537-9cfc-cd4fe810d70f tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1656 microversion: 2.1 time: 0.164539 Oct 27 19:24:11.375174 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3322/6506] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:11 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1656 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:11.380609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2bab49af-a9a9-4c4d-8712-5a92af0c78a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:11.381235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2bab49af-a9a9-4c4d-8712-5a92af0c78a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:11.412445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bab49af-a9a9-4c4d-8712-5a92af0c78a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:11.417638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bab49af-a9a9-4c4d-8712-5a92af0c78a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:11.418214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bab49af-a9a9-4c4d-8712-5a92af0c78a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:11.419085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bab49af-a9a9-4c4d-8712-5a92af0c78a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:11.419876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bab49af-a9a9-4c4d-8712-5a92af0c78a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:11.421730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bab49af-a9a9-4c4d-8712-5a92af0c78a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:11.462767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bab49af-a9a9-4c4d-8712-5a92af0c78a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:11.463264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bab49af-a9a9-4c4d-8712-5a92af0c78a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:11.463708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2bab49af-a9a9-4c4d-8712-5a92af0c78a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:11.464167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-2bab49af-a9a9-4c4d-8712-5a92af0c78a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lazy-loading 'fault' on Instance uuid f41df1a5-196c-454a-b18d-3229ee0b41ef {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:24:11.509394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2bab49af-a9a9-4c4d-8712-5a92af0c78a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:11.516842 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2bab49af-a9a9-4c4d-8712-5a92af0c78a5 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 200 len: 1355 microversion: 2.1 time: 0.140446 Oct 27 19:24:11.518352 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3323/6507] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:11 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 1355 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:11.704013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-381a54ab-02fa-482d-ba4f-6904742b27f0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:11.705645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-381a54ab-02fa-482d-ba4f-6904742b27f0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:11.707801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:11.713212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-381a54ab-02fa-482d-ba4f-6904742b27f0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:11.713719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-381a54ab-02fa-482d-ba4f-6904742b27f0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:11.714167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-381a54ab-02fa-482d-ba4f-6904742b27f0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:11.714930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-381a54ab-02fa-482d-ba4f-6904742b27f0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:11.715581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-381a54ab-02fa-482d-ba4f-6904742b27f0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:11.716184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-381a54ab-02fa-482d-ba4f-6904742b27f0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:11.761979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4ae4e20f-8ef8-4d17-b013-9584d7028e55 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:11.771464 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4ae4e20f-8ef8-4d17-b013-9584d7028e55 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1550 microversion: 2.1 time: 0.524263 Oct 27 19:24:11.772928 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3185/6508] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:11 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1550 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:24:11.796789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-07b0ebe7-86e9-4671-8b8e-9cdee11f9275 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:11.797387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-07b0ebe7-86e9-4671-8b8e-9cdee11f9275 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:11.805199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07b0ebe7-86e9-4671-8b8e-9cdee11f9275 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:11.805871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07b0ebe7-86e9-4671-8b8e-9cdee11f9275 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:11.806511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07b0ebe7-86e9-4671-8b8e-9cdee11f9275 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:11.807532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07b0ebe7-86e9-4671-8b8e-9cdee11f9275 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:11.808219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07b0ebe7-86e9-4671-8b8e-9cdee11f9275 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:11.808773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07b0ebe7-86e9-4671-8b8e-9cdee11f9275 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:12.027805 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-07b0ebe7-86e9-4671-8b8e-9cdee11f9275 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.236148 Oct 27 19:24:12.038687 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3186/6509] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:24:11 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-interface => generated 285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:24:12.040215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-739bad8b-a45a-4a66-865b-8737e46e975e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:12.040851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-739bad8b-a45a-4a66-865b-8737e46e975e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:12.047754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-739bad8b-a45a-4a66-865b-8737e46e975e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:12.048869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-739bad8b-a45a-4a66-865b-8737e46e975e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:12.049344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-739bad8b-a45a-4a66-865b-8737e46e975e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:12.050066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-739bad8b-a45a-4a66-865b-8737e46e975e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:12.050574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-739bad8b-a45a-4a66-865b-8737e46e975e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:12.051016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-739bad8b-a45a-4a66-865b-8737e46e975e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:12.234578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-381a54ab-02fa-482d-ba4f-6904742b27f0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:12.237155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:12.253822 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-381a54ab-02fa-482d-ba4f-6904742b27f0 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1371 microversion: 2.1 time: 0.553619 Oct 27 19:24:12.254964 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3324/6510] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:11 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1371 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:24:12.260094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af51f264-19e8-4bc9-9abe-856535d41914 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:12.260926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-af51f264-19e8-4bc9-9abe-856535d41914 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:12.271882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af51f264-19e8-4bc9-9abe-856535d41914 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:12.273284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af51f264-19e8-4bc9-9abe-856535d41914 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:12.273912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af51f264-19e8-4bc9-9abe-856535d41914 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:12.274829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af51f264-19e8-4bc9-9abe-856535d41914 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:12.275912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af51f264-19e8-4bc9-9abe-856535d41914 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:12.276517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af51f264-19e8-4bc9-9abe-856535d41914 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:12.608851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-af51f264-19e8-4bc9-9abe-856535d41914 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:12.626291 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-af51f264-19e8-4bc9-9abe-856535d41914 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1393 microversion: 2.1 time: 0.369523 Oct 27 19:24:12.630143 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3325/6511] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:12 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1393 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:12.646669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c2ac96ff-6f22-47b6-9031-091ed8cf7634 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:12.648023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c2ac96ff-6f22-47b6-9031-091ed8cf7634 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:12.678838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2ac96ff-6f22-47b6-9031-091ed8cf7634 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:12.679560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2ac96ff-6f22-47b6-9031-091ed8cf7634 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:12.680109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2ac96ff-6f22-47b6-9031-091ed8cf7634 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:12.681456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2ac96ff-6f22-47b6-9031-091ed8cf7634 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:12.682094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2ac96ff-6f22-47b6-9031-091ed8cf7634 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:12.682718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c2ac96ff-6f22-47b6-9031-091ed8cf7634 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:12.808901 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c2ac96ff-6f22-47b6-9031-091ed8cf7634 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 200 len: 1614 microversion: 2.1 time: 0.176088 Oct 27 19:24:12.812242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-739bad8b-a45a-4a66-865b-8737e46e975e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:12.816445 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3326/6512] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:12 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 1614 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:12.825906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e903d4ad-9757-4078-b8f5-9c87b2477939 req-8f3bfa9c-d359-407a-a04b-cd8534e66f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58800b1-fe99-427a-93bf-f5f7eac3315a", "name": "network-vif-unplugged", "status": "completed", "tag": "d69d22d3-1b9e-41c7-b3d6-0842dfa43b60"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:12.857688 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-739bad8b-a45a-4a66-865b-8737e46e975e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1532 microversion: 2.1 time: 0.821424 Oct 27 19:24:12.858342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e903d4ad-9757-4078-b8f5-9c87b2477939 req-8f3bfa9c-d359-407a-a04b-cd8534e66f5f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:12.858897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e903d4ad-9757-4078-b8f5-9c87b2477939 req-8f3bfa9c-d359-407a-a04b-cd8534e66f5f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:12.859338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e903d4ad-9757-4078-b8f5-9c87b2477939 req-8f3bfa9c-d359-407a-a04b-cd8534e66f5f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:12.860639 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3187/6513] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:12 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1532 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:12.867610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cc1015d3-e6c1-4f58-a660-761afd858556 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:12.868977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cc1015d3-e6c1-4f58-a660-761afd858556 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: f41df1a5-196c-454a-b18d-3229ee0b41ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:12.878874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc1015d3-e6c1-4f58-a660-761afd858556 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:12.886235 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e903d4ad-9757-4078-b8f5-9c87b2477939 req-8f3bfa9c-d359-407a-a04b-cd8534e66f5f service nova] Creating event network-vif-unplugged:d69d22d3-1b9e-41c7-b3d6-0842dfa43b60 for instance f58800b1-fe99-427a-93bf-f5f7eac3315a on n-h1-860687-3 Oct 27 19:24:12.891118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc1015d3-e6c1-4f58-a660-761afd858556 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:12.892583 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e903d4ad-9757-4078-b8f5-9c87b2477939 req-8f3bfa9c-d359-407a-a04b-cd8534e66f5f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073946 Oct 27 19:24:12.893155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc1015d3-e6c1-4f58-a660-761afd858556 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:12.894282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc1015d3-e6c1-4f58-a660-761afd858556 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:12.896594 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3327/6514] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:12.897088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc1015d3-e6c1-4f58-a660-761afd858556 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:12.897888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc1015d3-e6c1-4f58-a660-761afd858556 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:12.926080 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-cc1015d3-e6c1-4f58-a660-761afd858556 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] HTTP exception thrown: Instance f41df1a5-196c-454a-b18d-3229ee0b41ef could not be found. Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cc1015d3-e6c1-4f58-a660-761afd858556 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Request method failure captured: Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef HTTP/1.1 Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWth-uE-L5hrFUr9RYtFBa20-n3WoCw93LoQ3rmxc3wuGw2wOUyFGeVumHG6CitxW2BQ_gI4upL36DmkN08Y2Y2Dzqu0geZsGjCkVWRBeHN3me4ZMtxNaaWwrBfsY64smWMRc2jLIbCc3BUZOyHtIp4Z7RZX-687YOz7etGENRciRsd4 Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 853ac0c6e395469bb90c156aad129c26 Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-969980032 Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/853ac0c6e395469bb90c156aad129c26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/853ac0c6e395469bb90c156aad129c26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_853ac0c6e395469bb90c156aad129c26", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/853ac0c6e395469bb90c156aad129c26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestNetworkAdvancedServerOps-969980032 Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 853ac0c6e395469bb90c156aad129c26 Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-969980032 Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestNetworkAdvancedServerOps-969980032-project Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ce7f16b54dda477386daed20f1a2e104 Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestNetworkAdvancedServerOps-969980032-project Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance f41df1a5-196c-454a-b18d-3229ee0b41ef could not be found. Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'f41df1a5-196c-454a-b18d-3229ee0b41ef'} Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f41df1a5-196c-454a-b18d-3229ee0b41ef could not be found. Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f41df1a5-196c-454a-b18d-3229ee0b41ef could not be found. Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:12.928103 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:12.932378 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:12.932378 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:12.932378 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:12.932378 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:12.932378 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:24:12.932378 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:24:12.932378 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f41df1a5-196c-454a-b18d-3229ee0b41ef could not be found. Oct 27 19:24:12.932378 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:12.932378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cc1015d3-e6c1-4f58-a660-761afd858556 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Returning 404 to user: Instance f41df1a5-196c-454a-b18d-3229ee0b41ef could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:24:12.932378 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cc1015d3-e6c1-4f58-a660-761afd858556 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef" status: 404 len: 111 microversion: 2.1 time: 0.067678 Oct 27 19:24:12.932378 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3188/6515] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:12 2022] GET /compute/v2.1/servers/f41df1a5-196c-454a-b18d-3229ee0b41ef => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:24:12.984682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-2d259ea1-0caa-42f4-b7c0-204707515d43 req-94cf7b48-1f76-449a-b552-8ab1a58e5e9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58800b1-fe99-427a-93bf-f5f7eac3315a", "name": "network-vif-deleted", "tag": "d69d22d3-1b9e-41c7-b3d6-0842dfa43b60"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:12.996488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2d259ea1-0caa-42f4-b7c0-204707515d43 req-94cf7b48-1f76-449a-b552-8ab1a58e5e9d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:12.997115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2d259ea1-0caa-42f4-b7c0-204707515d43 req-94cf7b48-1f76-449a-b552-8ab1a58e5e9d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:12.997674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2d259ea1-0caa-42f4-b7c0-204707515d43 req-94cf7b48-1f76-449a-b552-8ab1a58e5e9d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:13.011520 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-2d259ea1-0caa-42f4-b7c0-204707515d43 req-94cf7b48-1f76-449a-b552-8ab1a58e5e9d service nova] Creating event network-vif-deleted:d69d22d3-1b9e-41c7-b3d6-0842dfa43b60 for instance f58800b1-fe99-427a-93bf-f5f7eac3315a on n-h1-860687-3 Oct 27 19:24:13.016513 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-2d259ea1-0caa-42f4-b7c0-204707515d43 req-94cf7b48-1f76-449a-b552-8ab1a58e5e9d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037807 Oct 27 19:24:13.030030 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3328/6516] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:13.285430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-388756f7-6084-42c1-a920-7698d673ae1f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:13.286707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-388756f7-6084-42c1-a920-7698d673ae1f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:13.316029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-388756f7-6084-42c1-a920-7698d673ae1f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:13.317282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-388756f7-6084-42c1-a920-7698d673ae1f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:13.318042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-388756f7-6084-42c1-a920-7698d673ae1f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:13.332505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-388756f7-6084-42c1-a920-7698d673ae1f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:13.333897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-388756f7-6084-42c1-a920-7698d673ae1f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:13.335428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-388756f7-6084-42c1-a920-7698d673ae1f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:13.655395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a809f6cc-f842-4e0d-ab9c-eb1f4c597ba8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:13.656416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a809f6cc-f842-4e0d-ab9c-eb1f4c597ba8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:13.664389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:13.665625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=18 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:13.672003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a809f6cc-f842-4e0d-ab9c-eb1f4c597ba8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:13.686503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a809f6cc-f842-4e0d-ab9c-eb1f4c597ba8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:13.689365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a809f6cc-f842-4e0d-ab9c-eb1f4c597ba8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:13.690455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a809f6cc-f842-4e0d-ab9c-eb1f4c597ba8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:13.691475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a809f6cc-f842-4e0d-ab9c-eb1f4c597ba8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:13.692146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a809f6cc-f842-4e0d-ab9c-eb1f4c597ba8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:13.994632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:14.024500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a809f6cc-f842-4e0d-ab9c-eb1f4c597ba8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:14.036758 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a809f6cc-f842-4e0d-ab9c-eb1f4c597ba8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1393 microversion: 2.1 time: 0.386634 Oct 27 19:24:14.037357 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3329/6517] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:13 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1393 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:14.047555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-665c179d-a305-48f0-8219-3aa199c340a9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:14.053569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-665c179d-a305-48f0-8219-3aa199c340a9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] [instance: f58800b1-fe99-427a-93bf-f5f7eac3315a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:14.089878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-665c179d-a305-48f0-8219-3aa199c340a9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:14.094411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-665c179d-a305-48f0-8219-3aa199c340a9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:14.094411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-665c179d-a305-48f0-8219-3aa199c340a9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:14.094411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-665c179d-a305-48f0-8219-3aa199c340a9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:14.094411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-665c179d-a305-48f0-8219-3aa199c340a9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:14.094411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-665c179d-a305-48f0-8219-3aa199c340a9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:14.133070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-388756f7-6084-42c1-a920-7698d673ae1f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:14.156794 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-665c179d-a305-48f0-8219-3aa199c340a9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] HTTP exception thrown: Instance f58800b1-fe99-427a-93bf-f5f7eac3315a could not be found. Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-665c179d-a305-48f0-8219-3aa199c340a9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Request method failure captured: Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a HTTP/1.1 Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtqc1BGQcZSbJuPYdvk_e4owJDWIvHgkDFrlFLCZ2XgufZgbMk5p-RAjQnWsD3kbQVmZx9UDB9aUn3CINMc4Tpps2dVh_KThd1LxcUnq9Ug7AD2aQO2u3n3NoVDYCAOzkeAInlVQyI7Ne14GcQ0jaXhCA-CDX0Cz3lZ7IjfhRvkMqfU Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 2b11c73f7fb04ae9b898a278a8b9ccdc Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestServerMultinode-715929352 Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2b11c73f7fb04ae9b898a278a8b9ccdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2b11c73f7fb04ae9b898a278a8b9ccdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2b11c73f7fb04ae9b898a278a8b9ccdc", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2b11c73f7fb04ae9b898a278a8b9ccdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestServerMultinode-715929352 Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 2b11c73f7fb04ae9b898a278a8b9ccdc Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestServerMultinode-715929352 Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestServerMultinode-715929352-project-admin Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 7b5fa0bd00e34b40a79b6d11693e7881 Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestServerMultinode-715929352-project-admin Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance f58800b1-fe99-427a-93bf-f5f7eac3315a could not be found. Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'f58800b1-fe99-427a-93bf-f5f7eac3315a'} Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f58800b1-fe99-427a-93bf-f5f7eac3315a could not be found. Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f58800b1-fe99-427a-93bf-f5f7eac3315a could not be found. Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:14.168489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:14.173840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:14.173840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:14.173840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:14.173840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:24:14.173840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:24:14.173840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f58800b1-fe99-427a-93bf-f5f7eac3315a could not be found. Oct 27 19:24:14.173840 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:14.173840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-665c179d-a305-48f0-8219-3aa199c340a9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] Returning 404 to user: Instance f58800b1-fe99-427a-93bf-f5f7eac3315a could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:24:14.181930 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-388756f7-6084-42c1-a920-7698d673ae1f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1371 microversion: 2.1 time: 0.900628 Oct 27 19:24:14.188017 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-665c179d-a305-48f0-8219-3aa199c340a9 tempest-TestServerMultinode-715929352 tempest-TestServerMultinode-715929352-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a" status: 404 len: 111 microversion: 2.1 time: 0.132353 Oct 27 19:24:14.188544 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3189/6518] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:13 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1371 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:14.190028 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3330/6519] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:14 2022] GET /compute/v2.1/servers/f58800b1-fe99-427a-93bf-f5f7eac3315a => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:24:14.213896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d0bc1f7-044e-437c-b1ac-a781ea22e06e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:14.223849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d0bc1f7-044e-437c-b1ac-a781ea22e06e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:14.249284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d0bc1f7-044e-437c-b1ac-a781ea22e06e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:14.252365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d0bc1f7-044e-437c-b1ac-a781ea22e06e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:14.253650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d0bc1f7-044e-437c-b1ac-a781ea22e06e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:14.258546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d0bc1f7-044e-437c-b1ac-a781ea22e06e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:14.264020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d0bc1f7-044e-437c-b1ac-a781ea22e06e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:14.266521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d0bc1f7-044e-437c-b1ac-a781ea22e06e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:14.363512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d0bc1f7-044e-437c-b1ac-a781ea22e06e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:14.364719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d0bc1f7-044e-437c-b1ac-a781ea22e06e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:14.365180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d0bc1f7-044e-437c-b1ac-a781ea22e06e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:14.365681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-6d0bc1f7-044e-437c-b1ac-a781ea22e06e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lazy-loading 'fault' on Instance uuid c9d5a034-eb5f-4fbf-b37a-f63766bc394d {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:24:14.496739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-536dbfff-09be-4965-9418-884b7402db7d req-61612aea-00a0-46e5-a9c1-f9e2ab49cb5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06284f8-17bf-4148-ad5c-ecbeb49826a1", "name": "network-vif-deleted", "tag": "0443cd1d-de02-4505-9092-085d9ce7b1b3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:14.519909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-536dbfff-09be-4965-9418-884b7402db7d req-61612aea-00a0-46e5-a9c1-f9e2ab49cb5a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:14.529073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-536dbfff-09be-4965-9418-884b7402db7d req-61612aea-00a0-46e5-a9c1-f9e2ab49cb5a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:14.530243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-536dbfff-09be-4965-9418-884b7402db7d req-61612aea-00a0-46e5-a9c1-f9e2ab49cb5a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:14.548987 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-536dbfff-09be-4965-9418-884b7402db7d req-61612aea-00a0-46e5-a9c1-f9e2ab49cb5a service nova] Creating event network-vif-deleted:0443cd1d-de02-4505-9092-085d9ce7b1b3 for instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 on n-h2-860687-3 Oct 27 19:24:14.559099 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-536dbfff-09be-4965-9418-884b7402db7d req-61612aea-00a0-46e5-a9c1-f9e2ab49cb5a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067004 Oct 27 19:24:14.560236 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3331/6520] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:24:14.582335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6d0bc1f7-044e-437c-b1ac-a781ea22e06e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48076b3f9d4c4f58a542ae11c37ebeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e42816d5124368ab95885148c3f002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:14.598926 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d0bc1f7-044e-437c-b1ac-a781ea22e06e tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 200 len: 1317 microversion: 2.1 time: 0.401722 Oct 27 19:24:14.600331 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3190/6521] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:14 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:15.062951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de5c049c-bf79-4190-b988-1f43d82ab1ae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:15.064945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-de5c049c-bf79-4190-b988-1f43d82ab1ae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:15.082719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de5c049c-bf79-4190-b988-1f43d82ab1ae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:15.083700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de5c049c-bf79-4190-b988-1f43d82ab1ae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:15.084396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de5c049c-bf79-4190-b988-1f43d82ab1ae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:15.085447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de5c049c-bf79-4190-b988-1f43d82ab1ae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:15.086071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de5c049c-bf79-4190-b988-1f43d82ab1ae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:15.086692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de5c049c-bf79-4190-b988-1f43d82ab1ae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:15.115431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-fdb9c30b-2f51-4baa-8542-6ae1db429197 req-90ee0e27-2b99-4bea-b190-0d5166c90bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d5a034-eb5f-4fbf-b37a-f63766bc394d", "name": "network-vif-deleted", "tag": "bf09d0ba-05a4-48ce-9c3e-a9929077346e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:15.140081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fdb9c30b-2f51-4baa-8542-6ae1db429197 req-90ee0e27-2b99-4bea-b190-0d5166c90bb0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:15.140412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fdb9c30b-2f51-4baa-8542-6ae1db429197 req-90ee0e27-2b99-4bea-b190-0d5166c90bb0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:15.140811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fdb9c30b-2f51-4baa-8542-6ae1db429197 req-90ee0e27-2b99-4bea-b190-0d5166c90bb0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:15.170917 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-fdb9c30b-2f51-4baa-8542-6ae1db429197 req-90ee0e27-2b99-4bea-b190-0d5166c90bb0 service nova] Creating event network-vif-deleted:bf09d0ba-05a4-48ce-9c3e-a9929077346e for instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d on n-h1-860687-3 Oct 27 19:24:15.180865 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-fdb9c30b-2f51-4baa-8542-6ae1db429197 req-90ee0e27-2b99-4bea-b190-0d5166c90bb0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068781 Oct 27 19:24:15.185782 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3191/6522] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:24:15.218895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-42d6e67a-2003-4add-801f-691718c5698c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:15.220652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-42d6e67a-2003-4add-801f-691718c5698c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:15.235803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42d6e67a-2003-4add-801f-691718c5698c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:15.237294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42d6e67a-2003-4add-801f-691718c5698c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:15.239299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42d6e67a-2003-4add-801f-691718c5698c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:15.240271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42d6e67a-2003-4add-801f-691718c5698c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:15.245469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42d6e67a-2003-4add-801f-691718c5698c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:15.245980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42d6e67a-2003-4add-801f-691718c5698c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:15.422875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-de5c049c-bf79-4190-b988-1f43d82ab1ae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:15.442951 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-de5c049c-bf79-4190-b988-1f43d82ab1ae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1186 microversion: 2.1 time: 0.385365 Oct 27 19:24:15.445575 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3332/6523] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:15 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1186 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:15.506922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-42d6e67a-2003-4add-801f-691718c5698c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:15.519976 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-42d6e67a-2003-4add-801f-691718c5698c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1371 microversion: 2.1 time: 0.308238 Oct 27 19:24:15.539053 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3192/6524] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:15 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1371 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:15.624316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-39317c4d-bf0c-41ce-aca2-77e2b8023d21 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:15.626055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-39317c4d-bf0c-41ce-aca2-77e2b8023d21 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] [instance: c9d5a034-eb5f-4fbf-b37a-f63766bc394d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:15.636336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39317c4d-bf0c-41ce-aca2-77e2b8023d21 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:15.639766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39317c4d-bf0c-41ce-aca2-77e2b8023d21 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:15.641040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39317c4d-bf0c-41ce-aca2-77e2b8023d21 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:15.648096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39317c4d-bf0c-41ce-aca2-77e2b8023d21 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:15.650269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39317c4d-bf0c-41ce-aca2-77e2b8023d21 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:15.651924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39317c4d-bf0c-41ce-aca2-77e2b8023d21 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:15.691794 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-39317c4d-bf0c-41ce-aca2-77e2b8023d21 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] HTTP exception thrown: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-39317c4d-bf0c-41ce-aca2-77e2b8023d21 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Request method failure captured: Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d HTTP/1.1 Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtq1Ca2hBZqYpJeOGbxs9y6WfjybGr87VDWAVRUJzaX2rVvdpBfVmY7B0mJtvkl4yWy-fLJZp8gwXJNzUqevUvzOkJfXCNZ6NZRnMriHxHcslluIF5IM2WJ8KbDzkSpXRl4mZ9KeoiO1RTyR-Z2pEYbSB29H8hwbhGB6SYVo4X1Bi0Y Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 44e42816d5124368ab95885148c3f002 Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2024790275 Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/44e42816d5124368ab95885148c3f002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/44e42816d5124368ab95885148c3f002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_44e42816d5124368ab95885148c3f002", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/44e42816d5124368ab95885148c3f002"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2024790275 Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 44e42816d5124368ab95885148c3f002 Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2024790275 Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2024790275-project Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 48076b3f9d4c4f58a542ae11c37ebeee Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2024790275-project Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'c9d5a034-eb5f-4fbf-b37a-f63766bc394d'} Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:15.693530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:15.697489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:15.697489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:15.697489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:15.697489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:15.697489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:15.697489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:24:15.697489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:24:15.697489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. Oct 27 19:24:15.697489 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:15.697489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-39317c4d-bf0c-41ce-aca2-77e2b8023d21 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] Returning 404 to user: Instance c9d5a034-eb5f-4fbf-b37a-f63766bc394d could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:24:15.697489 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-39317c4d-bf0c-41ce-aca2-77e2b8023d21 tempest-ServersNegativeTestMultiTenantJSON-2024790275 tempest-ServersNegativeTestMultiTenantJSON-2024790275-project] 10.222.0.42 "GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d" status: 404 len: 111 microversion: 2.1 time: 0.075585 Oct 27 19:24:15.697489 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3333/6525] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:15 2022] GET /compute/v2.1/servers/c9d5a034-eb5f-4fbf-b37a-f63766bc394d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:24:16.469391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0810be39-58f6-4ff9-82c2-9dbe8dc2e13e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:16.471342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0810be39-58f6-4ff9-82c2-9dbe8dc2e13e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:16.482764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0810be39-58f6-4ff9-82c2-9dbe8dc2e13e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:16.484013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0810be39-58f6-4ff9-82c2-9dbe8dc2e13e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:16.484676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0810be39-58f6-4ff9-82c2-9dbe8dc2e13e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:16.485893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0810be39-58f6-4ff9-82c2-9dbe8dc2e13e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:16.486883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0810be39-58f6-4ff9-82c2-9dbe8dc2e13e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:16.487552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0810be39-58f6-4ff9-82c2-9dbe8dc2e13e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:16.551428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-35882df4-4d67-4992-9bef-41fccb5f596f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:16.552745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-35882df4-4d67-4992-9bef-41fccb5f596f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:16.588498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35882df4-4d67-4992-9bef-41fccb5f596f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:16.590307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35882df4-4d67-4992-9bef-41fccb5f596f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:16.591049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35882df4-4d67-4992-9bef-41fccb5f596f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:16.594296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35882df4-4d67-4992-9bef-41fccb5f596f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:16.602988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35882df4-4d67-4992-9bef-41fccb5f596f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:16.603748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35882df4-4d67-4992-9bef-41fccb5f596f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:16.659209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0810be39-58f6-4ff9-82c2-9dbe8dc2e13e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:16.669923 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0810be39-58f6-4ff9-82c2-9dbe8dc2e13e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1186 microversion: 2.1 time: 0.204342 Oct 27 19:24:16.675741 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3193/6526] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:16 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1186 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:16.691512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-16ea1f7e-8489-43b9-84d7-2770fca2aa97 req-833b9430-03ce-4988-a71c-c2423ad7a00d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0719014-1b89-4535-8418-f4fb85165af7", "tag": "57fddc88-bdab-4281-89b1-edd171f702af"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:16.732310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-16ea1f7e-8489-43b9-84d7-2770fca2aa97 req-833b9430-03ce-4988-a71c-c2423ad7a00d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:16.741098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-16ea1f7e-8489-43b9-84d7-2770fca2aa97 req-833b9430-03ce-4988-a71c-c2423ad7a00d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:16.741591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-16ea1f7e-8489-43b9-84d7-2770fca2aa97 req-833b9430-03ce-4988-a71c-c2423ad7a00d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:16.779795 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-16ea1f7e-8489-43b9-84d7-2770fca2aa97 req-833b9430-03ce-4988-a71c-c2423ad7a00d service nova] Creating event network-changed:57fddc88-bdab-4281-89b1-edd171f702af for instance c0719014-1b89-4535-8418-f4fb85165af7 on n-h2-860687-3 Oct 27 19:24:16.812356 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-16ea1f7e-8489-43b9-84d7-2770fca2aa97 req-833b9430-03ce-4988-a71c-c2423ad7a00d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126524 Oct 27 19:24:16.814300 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3194/6527] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:17.085984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-35882df4-4d67-4992-9bef-41fccb5f596f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:17.100160 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-35882df4-4d67-4992-9bef-41fccb5f596f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1371 microversion: 2.1 time: 0.555978 Oct 27 19:24:17.114838 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3334/6528] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:16 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1371 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:24:17.701067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d77ef429-6ee9-4a73-a767-dd651eb94f31 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:17.701926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d77ef429-6ee9-4a73-a767-dd651eb94f31 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:17.727136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d77ef429-6ee9-4a73-a767-dd651eb94f31 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:17.730342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d77ef429-6ee9-4a73-a767-dd651eb94f31 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:17.733766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d77ef429-6ee9-4a73-a767-dd651eb94f31 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:17.733766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d77ef429-6ee9-4a73-a767-dd651eb94f31 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:17.738263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d77ef429-6ee9-4a73-a767-dd651eb94f31 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:17.739813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d77ef429-6ee9-4a73-a767-dd651eb94f31 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:18.152912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d3f7ca6a-13ce-426c-bc16-adb447392111 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:18.166315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d3f7ca6a-13ce-426c-bc16-adb447392111 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:18.198195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3f7ca6a-13ce-426c-bc16-adb447392111 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:18.199283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3f7ca6a-13ce-426c-bc16-adb447392111 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:18.199928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3f7ca6a-13ce-426c-bc16-adb447392111 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:18.200848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3f7ca6a-13ce-426c-bc16-adb447392111 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:18.201606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3f7ca6a-13ce-426c-bc16-adb447392111 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:18.202204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3f7ca6a-13ce-426c-bc16-adb447392111 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:18.517400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d3f7ca6a-13ce-426c-bc16-adb447392111 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:18.533665 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d3f7ca6a-13ce-426c-bc16-adb447392111 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1371 microversion: 2.1 time: 0.407843 Oct 27 19:24:18.550698 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3335/6529] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:18 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1371 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:18.782434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d77ef429-6ee9-4a73-a767-dd651eb94f31 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:18.822331 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d77ef429-6ee9-4a73-a767-dd651eb94f31 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1186 microversion: 2.1 time: 1.122270 Oct 27 19:24:18.829180 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3195/6530] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:17 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1186 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:19.569456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-185d38cd-ec19-4404-b00a-00b788fc801e tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:19.570725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-185d38cd-ec19-4404-b00a-00b788fc801e tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:19.607637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-185d38cd-ec19-4404-b00a-00b788fc801e tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:19.608407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-185d38cd-ec19-4404-b00a-00b788fc801e tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:19.609044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-185d38cd-ec19-4404-b00a-00b788fc801e tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:19.610073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-185d38cd-ec19-4404-b00a-00b788fc801e tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:19.611251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-185d38cd-ec19-4404-b00a-00b788fc801e tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:19.611760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-185d38cd-ec19-4404-b00a-00b788fc801e tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:19.858175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e3e5854d-9d2c-485e-9551-67a10899116c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:19.858914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e3e5854d-9d2c-485e-9551-67a10899116c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:19.880411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e5854d-9d2c-485e-9551-67a10899116c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:19.883433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e5854d-9d2c-485e-9551-67a10899116c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:19.884126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e5854d-9d2c-485e-9551-67a10899116c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:19.886007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e5854d-9d2c-485e-9551-67a10899116c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:19.888835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e5854d-9d2c-485e-9551-67a10899116c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:19.890108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3e5854d-9d2c-485e-9551-67a10899116c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:20.018200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-185d38cd-ec19-4404-b00a-00b788fc801e tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:20.038604 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-185d38cd-ec19-4404-b00a-00b788fc801e tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1371 microversion: 2.1 time: 0.485241 Oct 27 19:24:20.047263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e3e5854d-9d2c-485e-9551-67a10899116c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:20.059128 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e3e5854d-9d2c-485e-9551-67a10899116c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1186 microversion: 2.1 time: 0.207388 Oct 27 19:24:20.062565 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3336/6531] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:19 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1371 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:20.063510 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3196/6532] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:19 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1186 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:21.073223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-001e1bee-bcd3-4ea0-a796-1e2165ffdeb8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:21.074467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-001e1bee-bcd3-4ea0-a796-1e2165ffdeb8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:21.086520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5eaf83a4-98e4-4761-b008-2c546c343630 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:21.087573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5eaf83a4-98e4-4761-b008-2c546c343630 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:21.091678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-001e1bee-bcd3-4ea0-a796-1e2165ffdeb8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:21.098903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-001e1bee-bcd3-4ea0-a796-1e2165ffdeb8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:21.099796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-001e1bee-bcd3-4ea0-a796-1e2165ffdeb8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:21.101954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-001e1bee-bcd3-4ea0-a796-1e2165ffdeb8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:21.105814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5eaf83a4-98e4-4761-b008-2c546c343630 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:21.106705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-001e1bee-bcd3-4ea0-a796-1e2165ffdeb8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:21.107403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-001e1bee-bcd3-4ea0-a796-1e2165ffdeb8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:21.111767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5eaf83a4-98e4-4761-b008-2c546c343630 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:21.112653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5eaf83a4-98e4-4761-b008-2c546c343630 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:21.119455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5eaf83a4-98e4-4761-b008-2c546c343630 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:21.122859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5eaf83a4-98e4-4761-b008-2c546c343630 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:21.131038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5eaf83a4-98e4-4761-b008-2c546c343630 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:21.335857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5eaf83a4-98e4-4761-b008-2c546c343630 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:21.357303 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5eaf83a4-98e4-4761-b008-2c546c343630 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1186 microversion: 2.1 time: 0.272725 Oct 27 19:24:21.379584 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3197/6533] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:21 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1186 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:21.405215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-9506621d-2407-401e-a9f4-692477e49f61 req-a60e2456-1f8c-4a13-b669-12cf022fca24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795dc456-a993-489c-918a-8f29bb1403b9", "name": "network-vif-plugged", "status": "completed", "tag": "1f160966-2e84-4766-bc8a-e388539da466"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:21.436542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9506621d-2407-401e-a9f4-692477e49f61 req-a60e2456-1f8c-4a13-b669-12cf022fca24 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:21.437033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9506621d-2407-401e-a9f4-692477e49f61 req-a60e2456-1f8c-4a13-b669-12cf022fca24 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:21.437479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9506621d-2407-401e-a9f4-692477e49f61 req-a60e2456-1f8c-4a13-b669-12cf022fca24 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:21.487802 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-9506621d-2407-401e-a9f4-692477e49f61 req-a60e2456-1f8c-4a13-b669-12cf022fca24 service nova] Creating event network-vif-plugged:1f160966-2e84-4766-bc8a-e388539da466 for instance 795dc456-a993-489c-918a-8f29bb1403b9 on n-h1-860687-3 Oct 27 19:24:21.528067 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-9506621d-2407-401e-a9f4-692477e49f61 req-a60e2456-1f8c-4a13-b669-12cf022fca24 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124171 Oct 27 19:24:21.533592 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3198/6534] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:21.970530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-001e1bee-bcd3-4ea0-a796-1e2165ffdeb8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:21.988152 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-001e1bee-bcd3-4ea0-a796-1e2165ffdeb8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1371 microversion: 2.1 time: 0.916566 Oct 27 19:24:22.003689 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3337/6535] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:21 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1371 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:22.390664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-232efedf-3d20-4815-be70-e30424f30b44 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:22.392659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-232efedf-3d20-4815-be70-e30424f30b44 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:22.404490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-232efedf-3d20-4815-be70-e30424f30b44 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:22.407886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-232efedf-3d20-4815-be70-e30424f30b44 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:22.412236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-232efedf-3d20-4815-be70-e30424f30b44 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:22.414323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-232efedf-3d20-4815-be70-e30424f30b44 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:22.414854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-232efedf-3d20-4815-be70-e30424f30b44 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:22.415306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-232efedf-3d20-4815-be70-e30424f30b44 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:22.658236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-232efedf-3d20-4815-be70-e30424f30b44 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:22.668351 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-232efedf-3d20-4815-be70-e30424f30b44 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1186 microversion: 2.1 time: 0.282597 Oct 27 19:24:22.669368 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3199/6536] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:22 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1186 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:23.018593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-32bce8d9-b573-4d15-a6f6-14e182a14598 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:23.019707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-32bce8d9-b573-4d15-a6f6-14e182a14598 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:23.066835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32bce8d9-b573-4d15-a6f6-14e182a14598 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:23.071259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32bce8d9-b573-4d15-a6f6-14e182a14598 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:23.072467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32bce8d9-b573-4d15-a6f6-14e182a14598 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:23.078105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32bce8d9-b573-4d15-a6f6-14e182a14598 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:23.086359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32bce8d9-b573-4d15-a6f6-14e182a14598 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:23.090515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-32bce8d9-b573-4d15-a6f6-14e182a14598 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:23.694080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-50114362-c645-4584-8465-d4d5578b03a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:23.696999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-50114362-c645-4584-8465-d4d5578b03a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:23.718889 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50114362-c645-4584-8465-d4d5578b03a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:23.728024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50114362-c645-4584-8465-d4d5578b03a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:23.728725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50114362-c645-4584-8465-d4d5578b03a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:23.731942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50114362-c645-4584-8465-d4d5578b03a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:23.732523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50114362-c645-4584-8465-d4d5578b03a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:23.734118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50114362-c645-4584-8465-d4d5578b03a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:23.772073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-32bce8d9-b573-4d15-a6f6-14e182a14598 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:23.785359 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-32bce8d9-b573-4d15-a6f6-14e182a14598 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1371 microversion: 2.1 time: 0.775034 Oct 27 19:24:23.787084 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3338/6537] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:23 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1371 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:23.869686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50114362-c645-4584-8465-d4d5578b03a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:23.870196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50114362-c645-4584-8465-d4d5578b03a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:23.870667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50114362-c645-4584-8465-d4d5578b03a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:23.882654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-50114362-c645-4584-8465-d4d5578b03a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lazy-loading 'fault' on Instance uuid b06284f8-17bf-4148-ad5c-ecbeb49826a1 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:24:23.935993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1db4659b-a1c1-4eb3-bd0c-3b48455883bf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '.version_select at 0x7fc87330dee0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:24.011667 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1db4659b-a1c1-4eb3-bd0c-3b48455883bf tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-763761231" status: 202 len: 0 microversion: 2.1 time: 0.080661 Oct 27 19:24:24.024028 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3339/6538] 10.222.0.42 () {58 vars in 1281 bytes} [Thu Oct 27 19:24:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-763761231 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:24:24.042887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-50114362-c645-4584-8465-d4d5578b03a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:24.053737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-696cb2ae-d421-4759-9525-c937e137136f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'create', calling method: .version_select at 0x7fc8732cf3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-110704288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI31yYomxsL2bNJS2+bbtaCQWyC+C5XjrVoWVZAt3CubjGxghwugJfbQTNUpCGXiy8sWENMevsW2hFO4Rwu4OouGbiegCz4rni9EGyI0RFlOoUaUuzxUiCe5ii1519lNMA=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:24.076587 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-50114362-c645-4584-8465-d4d5578b03a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 200 len: 1191 microversion: 2.1 time: 0.388847 Oct 27 19:24:24.077205 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3200/6539] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:23 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 1191 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:24.139034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-696cb2ae-d421-4759-9525-c937e137136f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for project 853ac0c6e395469bb90c156aad129c26. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:24:24.186545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-696cb2ae-d421-4759-9525-c937e137136f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for user ce7f16b54dda477386daed20f1a2e104 and project 853ac0c6e395469bb90c156aad129c26. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:24:24.260868 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-696cb2ae-d421-4759-9525-c937e137136f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.214011 Oct 27 19:24:24.262102 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3340/6540] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:24:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:24:24.815263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3a20e9f3-4851-4849-bbd5-9bf8d80e61c3 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:24.815898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3a20e9f3-4851-4849-bbd5-9bf8d80e61c3 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:24.838093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a20e9f3-4851-4849-bbd5-9bf8d80e61c3 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:24.839322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a20e9f3-4851-4849-bbd5-9bf8d80e61c3 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:24.840603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a20e9f3-4851-4849-bbd5-9bf8d80e61c3 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:24.842904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a20e9f3-4851-4849-bbd5-9bf8d80e61c3 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:24.843453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a20e9f3-4851-4849-bbd5-9bf8d80e61c3 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:24.843898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a20e9f3-4851-4849-bbd5-9bf8d80e61c3 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:25.113191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1f46a1b0-703a-4e27-aada-f22ac56d7cca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:25.113840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1f46a1b0-703a-4e27-aada-f22ac56d7cca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:25.138476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f46a1b0-703a-4e27-aada-f22ac56d7cca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:25.139188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f46a1b0-703a-4e27-aada-f22ac56d7cca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:25.140876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f46a1b0-703a-4e27-aada-f22ac56d7cca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:25.142954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f46a1b0-703a-4e27-aada-f22ac56d7cca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:25.149253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f46a1b0-703a-4e27-aada-f22ac56d7cca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:25.150009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f46a1b0-703a-4e27-aada-f22ac56d7cca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:25.183492 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-1f46a1b0-703a-4e27-aada-f22ac56d7cca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1f46a1b0-703a-4e27-aada-f22ac56d7cca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 HTTP/1.1 Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'b06284f8-17bf-4148-ad5c-ecbeb49826a1'} Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:25.203225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:25.209027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:25.209027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:25.209027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:25.209027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:24:25.209027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:24:25.209027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:25.209027 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:25.228090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1f46a1b0-703a-4e27-aada-f22ac56d7cca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:24:25.238351 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1f46a1b0-703a-4e27-aada-f22ac56d7cca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 404 len: 111 microversion: 2.1 time: 0.124205 Oct 27 19:24:25.240634 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3341/6541] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:25 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:24:25.994818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3a20e9f3-4851-4849-bbd5-9bf8d80e61c3 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:26.005479 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3a20e9f3-4851-4849-bbd5-9bf8d80e61c3 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1544 microversion: 2.1 time: 1.195832 Oct 27 19:24:26.008453 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3201/6542] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:24 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1544 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:26.033253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-00c189b2-e023-46fb-9512-f5a8fbd22f17 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:26.034250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-00c189b2-e023-46fb-9512-f5a8fbd22f17 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:26.041352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00c189b2-e023-46fb-9512-f5a8fbd22f17 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:26.042539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00c189b2-e023-46fb-9512-f5a8fbd22f17 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:26.043348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00c189b2-e023-46fb-9512-f5a8fbd22f17 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:26.044781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00c189b2-e023-46fb-9512-f5a8fbd22f17 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:26.045789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00c189b2-e023-46fb-9512-f5a8fbd22f17 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:26.059456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00c189b2-e023-46fb-9512-f5a8fbd22f17 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:26.508419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-00c189b2-e023-46fb-9512-f5a8fbd22f17 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:26.524411 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-00c189b2-e023-46fb-9512-f5a8fbd22f17 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1544 microversion: 2.1 time: 0.495690 Oct 27 19:24:26.530284 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3342/6543] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:26 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1544 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:28.643706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ff5bf9d-18d5-4e01-ba1c-12e71b4cfb59 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:28.644336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ff5bf9d-18d5-4e01-ba1c-12e71b4cfb59 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:28.667215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ff5bf9d-18d5-4e01-ba1c-12e71b4cfb59 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:28.670765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ff5bf9d-18d5-4e01-ba1c-12e71b4cfb59 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:28.671936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ff5bf9d-18d5-4e01-ba1c-12e71b4cfb59 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:28.680869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ff5bf9d-18d5-4e01-ba1c-12e71b4cfb59 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:28.681492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ff5bf9d-18d5-4e01-ba1c-12e71b4cfb59 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:28.681955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ff5bf9d-18d5-4e01-ba1c-12e71b4cfb59 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:28.728915 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-9ff5bf9d-18d5-4e01-ba1c-12e71b4cfb59 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ff5bf9d-18d5-4e01-ba1c-12e71b4cfb59 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 HTTP/1.1 Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'b06284f8-17bf-4148-ad5c-ecbeb49826a1'} Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:24:28.730951 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:24:28.736474 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:28.736474 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:28.736474 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:28.736474 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:28.736474 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:28.736474 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:28.736474 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:28.736474 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:24:28.736474 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:24:28.736474 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:28.736474 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:24:28.748312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ff5bf9d-18d5-4e01-ba1c-12e71b4cfb59 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:24:28.749486 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ff5bf9d-18d5-4e01-ba1c-12e71b4cfb59 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 404 len: 111 microversion: 2.1 time: 0.118051 Oct 27 19:24:28.760650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2db5cae8-9184-4cab-9bf8-70a17e05bbf2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:28.761906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2db5cae8-9184-4cab-9bf8-70a17e05bbf2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: b06284f8-17bf-4148-ad5c-ecbeb49826a1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:28.765676 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3202/6544] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:24:28 2022] DELETE /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:24:28.769998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2db5cae8-9184-4cab-9bf8-70a17e05bbf2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:28.770744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2db5cae8-9184-4cab-9bf8-70a17e05bbf2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:28.771376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2db5cae8-9184-4cab-9bf8-70a17e05bbf2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:28.772260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2db5cae8-9184-4cab-9bf8-70a17e05bbf2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:28.773345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2db5cae8-9184-4cab-9bf8-70a17e05bbf2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:28.773945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2db5cae8-9184-4cab-9bf8-70a17e05bbf2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:28.795356 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-2db5cae8-9184-4cab-9bf8-70a17e05bbf2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2db5cae8-9184-4cab-9bf8-70a17e05bbf2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 HTTP/1.1 Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'b06284f8-17bf-4148-ad5c-ecbeb49826a1'} Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:28.797139 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:28.802626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:28.802626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:28.802626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:28.802626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:24:28.802626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:24:28.802626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. Oct 27 19:24:28.802626 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:28.804166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2db5cae8-9184-4cab-9bf8-70a17e05bbf2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance b06284f8-17bf-4148-ad5c-ecbeb49826a1 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:24:28.805423 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2db5cae8-9184-4cab-9bf8-70a17e05bbf2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1" status: 404 len: 111 microversion: 2.1 time: 0.049173 Oct 27 19:24:28.810570 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3343/6545] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:28 2022] GET /compute/v2.1/servers/b06284f8-17bf-4148-ad5c-ecbeb49826a1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:24:30.094046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85f6dc28-4c63-4e39-a65b-70e2bcc6cb30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:30.095212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85f6dc28-4c63-4e39-a65b-70e2bcc6cb30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:30.120065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85f6dc28-4c63-4e39-a65b-70e2bcc6cb30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:30.125653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85f6dc28-4c63-4e39-a65b-70e2bcc6cb30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:30.127172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85f6dc28-4c63-4e39-a65b-70e2bcc6cb30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:30.127941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85f6dc28-4c63-4e39-a65b-70e2bcc6cb30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:30.128408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85f6dc28-4c63-4e39-a65b-70e2bcc6cb30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:30.128847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85f6dc28-4c63-4e39-a65b-70e2bcc6cb30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:30.358724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-85f6dc28-4c63-4e39-a65b-70e2bcc6cb30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lazy-loading 'services' on Instance uuid 397b574b-2b3c-42be-89a3-bebfebe7db23 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:24:30.479571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:30.503577 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85f6dc28-4c63-4e39-a65b-70e2bcc6cb30 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "DELETE /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23/os-volume_attachments/d1ba57d5-bb3a-4637-9b1d-ebed47fc9ae6" status: 202 len: 0 microversion: 2.1 time: 0.413313 Oct 27 19:24:30.511185 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3203/6546] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:24:30 2022] DELETE /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23/os-volume_attachments/d1ba57d5-bb3a-4637-9b1d-ebed47fc9ae6 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:24:31.701562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-9a01bba0-1598-4530-9c2d-71e4a49c5f7e req-321dc6e3-892a-470c-a950-e8fe3e27d395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795dc456-a993-489c-918a-8f29bb1403b9", "tag": "1f160966-2e84-4766-bc8a-e388539da466"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:31.718484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9a01bba0-1598-4530-9c2d-71e4a49c5f7e req-321dc6e3-892a-470c-a950-e8fe3e27d395 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:31.721629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9a01bba0-1598-4530-9c2d-71e4a49c5f7e req-321dc6e3-892a-470c-a950-e8fe3e27d395 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:31.722580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9a01bba0-1598-4530-9c2d-71e4a49c5f7e req-321dc6e3-892a-470c-a950-e8fe3e27d395 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:31.742173 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-9a01bba0-1598-4530-9c2d-71e4a49c5f7e req-321dc6e3-892a-470c-a950-e8fe3e27d395 service nova] Creating event network-changed:1f160966-2e84-4766-bc8a-e388539da466 for instance 795dc456-a993-489c-918a-8f29bb1403b9 on n-h1-860687-3 Oct 27 19:24:31.779538 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-9a01bba0-1598-4530-9c2d-71e4a49c5f7e req-321dc6e3-892a-470c-a950-e8fe3e27d395 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081290 Oct 27 19:24:31.780715 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3344/6547] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:39.066495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8aea0ef9-3eb8-4c71-8bef-559caa95db94 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:39.069833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8aea0ef9-3eb8-4c71-8bef-559caa95db94 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:39.093564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aea0ef9-3eb8-4c71-8bef-559caa95db94 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:39.094065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aea0ef9-3eb8-4c71-8bef-559caa95db94 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:39.096635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aea0ef9-3eb8-4c71-8bef-559caa95db94 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:39.099941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aea0ef9-3eb8-4c71-8bef-559caa95db94 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:39.101405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aea0ef9-3eb8-4c71-8bef-559caa95db94 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:39.101857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aea0ef9-3eb8-4c71-8bef-559caa95db94 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:39.153909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8aea0ef9-3eb8-4c71-8bef-559caa95db94 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:24:39.421731 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8aea0ef9-3eb8-4c71-8bef-559caa95db94 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "DELETE /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 204 len: 0 microversion: 2.1 time: 0.366806 Oct 27 19:24:39.424867 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3204/6548] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:24:39 2022] DELETE /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:24:39.434713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e0919eee-55da-414e-bcee-d5792d19661d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:39.435443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e0919eee-55da-414e-bcee-d5792d19661d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:39.440493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:39.458911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0919eee-55da-414e-bcee-d5792d19661d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:39.459426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0919eee-55da-414e-bcee-d5792d19661d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:39.460191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0919eee-55da-414e-bcee-d5792d19661d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:39.461108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0919eee-55da-414e-bcee-d5792d19661d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:39.461827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0919eee-55da-414e-bcee-d5792d19661d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:39.462639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0919eee-55da-414e-bcee-d5792d19661d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:40.397048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e0919eee-55da-414e-bcee-d5792d19661d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:40.405404 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e0919eee-55da-414e-bcee-d5792d19661d tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1512 microversion: 2.1 time: 0.976172 Oct 27 19:24:40.405997 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3345/6549] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:39 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1512 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:41.437696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f6f1f271-1582-4304-895f-14414565665f tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:41.439443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f6f1f271-1582-4304-895f-14414565665f tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:41.448613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:41.450719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f1f271-1582-4304-895f-14414565665f tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:41.451637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f1f271-1582-4304-895f-14414565665f tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:41.452391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f1f271-1582-4304-895f-14414565665f tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:41.453347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f1f271-1582-4304-895f-14414565665f tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:41.454661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f1f271-1582-4304-895f-14414565665f tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:41.455162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6f1f271-1582-4304-895f-14414565665f tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:41.760982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6f1f271-1582-4304-895f-14414565665f tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37142c6d57024d46a6bc92afecda69a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b7b6844fa84531a9582f1440d2e6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:41.776528 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f6f1f271-1582-4304-895f-14414565665f tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 200 len: 1512 microversion: 2.1 time: 0.347876 Oct 27 19:24:41.777807 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3205/6550] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:41 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:41.952517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-18e4458a-3799-4cdd-afe5-0235a52d6fc3 req-138d8cff-b54b-4b7f-9cbc-2e34d202f0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397b574b-2b3c-42be-89a3-bebfebe7db23", "name": "network-vif-deleted", "tag": "8e4105b4-cccb-4e81-9b27-f1f947b812f4"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:41.965353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:41.972091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-18e4458a-3799-4cdd-afe5-0235a52d6fc3 req-138d8cff-b54b-4b7f-9cbc-2e34d202f0e6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:41.972861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-18e4458a-3799-4cdd-afe5-0235a52d6fc3 req-138d8cff-b54b-4b7f-9cbc-2e34d202f0e6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:41.973548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-18e4458a-3799-4cdd-afe5-0235a52d6fc3 req-138d8cff-b54b-4b7f-9cbc-2e34d202f0e6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:41.992539 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-18e4458a-3799-4cdd-afe5-0235a52d6fc3 req-138d8cff-b54b-4b7f-9cbc-2e34d202f0e6 service nova] Creating event network-vif-deleted:8e4105b4-cccb-4e81-9b27-f1f947b812f4 for instance 397b574b-2b3c-42be-89a3-bebfebe7db23 on n-h1-860687-3 Oct 27 19:24:41.999001 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-18e4458a-3799-4cdd-afe5-0235a52d6fc3 req-138d8cff-b54b-4b7f-9cbc-2e34d202f0e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052708 Oct 27 19:24:41.999867 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3346/6551] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:42.670049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1742629158", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "a8be008c-fc99-4ac0-bd21-26060a5edd27"}], "key_name": "tempest-TestNetworkAdvancedServerOps-110704288", "security_groups": [{"name": "tempest-secgroup-smoke-27990810"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:42.948854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] validate_networks() for [('a8be008c-fc99-4ac0-bd21-26060a5edd27', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:24:42.956678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13a9c610-4ccb-410f-92a9-b62595c44234 tempest-ComputeTenantNetworksTest-2057616277 tempest-ComputeTenantNetworksTest-2057616277-project] Calling method '.version_select at 0x7fc873365670>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:43.169862 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13a9c610-4ccb-410f-92a9-b62595c44234 tempest-ComputeTenantNetworksTest-2057616277 tempest-ComputeTenantNetworksTest-2057616277-project] 10.222.0.42 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.477091 Oct 27 19:24:43.176768 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3347/6552] 10.222.0.42 () {58 vars in 1158 bytes} [Thu Oct 27 19:24:42 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:24:43.179127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bdefbaa2-e04c-4c5f-b5cd-add6ecfbbb62 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:43.179882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bdefbaa2-e04c-4c5f-b5cd-add6ecfbbb62 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] [instance: 397b574b-2b3c-42be-89a3-bebfebe7db23] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:43.199953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdefbaa2-e04c-4c5f-b5cd-add6ecfbbb62 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:43.200469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdefbaa2-e04c-4c5f-b5cd-add6ecfbbb62 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:43.200917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdefbaa2-e04c-4c5f-b5cd-add6ecfbbb62 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:43.209267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdefbaa2-e04c-4c5f-b5cd-add6ecfbbb62 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:43.209790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdefbaa2-e04c-4c5f-b5cd-add6ecfbbb62 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:43.210240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdefbaa2-e04c-4c5f-b5cd-add6ecfbbb62 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:43.214963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=86 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:43.248031 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-bdefbaa2-e04c-4c5f-b5cd-add6ecfbbb62 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] HTTP exception thrown: Instance 397b574b-2b3c-42be-89a3-bebfebe7db23 could not be found. Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bdefbaa2-e04c-4c5f-b5cd-add6ecfbbb62 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Request method failure captured: Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 HTTP/1.1 Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtnVOxnc1I2SqR9YCi570_uG3vVqs9kuZmPJR98K4oSHpkmku4MlXpufY6BfRo63cu6E6X0SOObcJ9lCBHpFG6Q5m2CrlUzjqAe9zpHRH7NSdd-st4WF8c1P15TGe4bwBnIH92rxZ3MSngHCVq9wSu8lwcIIBs3jfB3wZtUynn5FiAQ Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 94b7b6844fa84531a9582f1440d2e6ff Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-VolumesSnapshotTestJSON-406354450 Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/94b7b6844fa84531a9582f1440d2e6ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94b7b6844fa84531a9582f1440d2e6ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_94b7b6844fa84531a9582f1440d2e6ff", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94b7b6844fa84531a9582f1440d2e6ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-VolumesSnapshotTestJSON-406354450 Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 94b7b6844fa84531a9582f1440d2e6ff Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-406354450 Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-VolumesSnapshotTestJSON-406354450-project Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 37142c6d57024d46a6bc92afecda69a2 Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-VolumesSnapshotTestJSON-406354450-project Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 397b574b-2b3c-42be-89a3-bebfebe7db23 could not be found. Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '397b574b-2b3c-42be-89a3-bebfebe7db23'} Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397b574b-2b3c-42be-89a3-bebfebe7db23 could not be found. Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397b574b-2b3c-42be-89a3-bebfebe7db23 could not be found. Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:24:43.252938 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:43.257670 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:24:43.257670 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:24:43.257670 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:24:43.257670 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:24:43.257670 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:24:43.257670 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397b574b-2b3c-42be-89a3-bebfebe7db23 could not be found. Oct 27 19:24:43.257670 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:24:43.257670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bdefbaa2-e04c-4c5f-b5cd-add6ecfbbb62 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] Returning 404 to user: Instance 397b574b-2b3c-42be-89a3-bebfebe7db23 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:24:43.257670 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bdefbaa2-e04c-4c5f-b5cd-add6ecfbbb62 tempest-VolumesSnapshotTestJSON-406354450 tempest-VolumesSnapshotTestJSON-406354450-project] 10.222.0.42 "GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23" status: 404 len: 111 microversion: 2.1 time: 0.083352 Oct 27 19:24:43.274163 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3348/6553] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:43 2022] GET /compute/v2.1/servers/397b574b-2b3c-42be-89a3-bebfebe7db23 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:24:43.283620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce8a81ec-8e4c-4dc4-90c6-aecc508ee7d6 tempest-ComputeTenantNetworksTest-2057616277 tempest-ComputeTenantNetworksTest-2057616277-project] Calling method '.version_select at 0x7fc873365670>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:43.573718 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce8a81ec-8e4c-4dc4-90c6-aecc508ee7d6 tempest-ComputeTenantNetworksTest-2057616277 tempest-ComputeTenantNetworksTest-2057616277-project] 10.222.0.42 "GET /compute/v2.1/os-tenant-networks/64ed21b5-6224-43af-bbd2-a5d04e15955d" status: 200 len: 139 microversion: 2.1 time: 0.297663 Oct 27 19:24:43.574319 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3349/6554] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 19:24:43 2022] GET /compute/v2.1/os-tenant-networks/64ed21b5-6224-43af-bbd2-a5d04e15955d => generated 139 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:43.603433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:24:43.603893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:24:43.607363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:24:43.608626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:24:43.609074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:24:43.633570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:43.634834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:43.635301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:43.637692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:43.638871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:43.639728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:43.683037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for project 853ac0c6e395469bb90c156aad129c26. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:24:43.715326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Getting quotas for user ce7f16b54dda477386daed20f1a2e104 and project 853ac0c6e395469bb90c156aad129c26. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:24:43.734346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:24:43.738118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:24:43.823667 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e91c0f7d-05d0-43cf-b9a4-377d5cbd2529 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.157366 Oct 27 19:24:43.824792 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3206/6555] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:24:42 2022] POST /compute/v2.1/servers => generated 404 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:24:43.838199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5cbfba41-dc9a-4144-bd11-9283e0950659 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:43.840321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5cbfba41-dc9a-4144-bd11-9283e0950659 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:43.972356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5cbfba41-dc9a-4144-bd11-9283e0950659 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:43.983676 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5cbfba41-dc9a-4144-bd11-9283e0950659 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1266 microversion: 2.1 time: 0.151164 Oct 27 19:24:43.984442 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3350/6556] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:43 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:45.008523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b6dfa54d-04ed-413b-b279-51fda540ac23 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:45.009273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b6dfa54d-04ed-413b-b279-51fda540ac23 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:45.023024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6dfa54d-04ed-413b-b279-51fda540ac23 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:45.024882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6dfa54d-04ed-413b-b279-51fda540ac23 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:45.025762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6dfa54d-04ed-413b-b279-51fda540ac23 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:45.027573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6dfa54d-04ed-413b-b279-51fda540ac23 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:45.028588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6dfa54d-04ed-413b-b279-51fda540ac23 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:45.029224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6dfa54d-04ed-413b-b279-51fda540ac23 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:45.117728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6dfa54d-04ed-413b-b279-51fda540ac23 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:45.158588 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b6dfa54d-04ed-413b-b279-51fda540ac23 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1318 microversion: 2.1 time: 0.153037 Oct 27 19:24:45.159432 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3207/6557] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:45 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:24:46.185466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e53165c2-db6a-4e93-9313-4b6810fc7509 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:46.186096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e53165c2-db6a-4e93-9313-4b6810fc7509 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:46.201516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e53165c2-db6a-4e93-9313-4b6810fc7509 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:46.203073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e53165c2-db6a-4e93-9313-4b6810fc7509 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:46.205084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e53165c2-db6a-4e93-9313-4b6810fc7509 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:46.206718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e53165c2-db6a-4e93-9313-4b6810fc7509 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:46.208904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e53165c2-db6a-4e93-9313-4b6810fc7509 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:46.209538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e53165c2-db6a-4e93-9313-4b6810fc7509 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:46.352665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e53165c2-db6a-4e93-9313-4b6810fc7509 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:46.368593 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e53165c2-db6a-4e93-9313-4b6810fc7509 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1324 microversion: 2.1 time: 0.187258 Oct 27 19:24:46.390717 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3351/6558] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:46 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1324 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:47.396424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6ee28002-087d-4b5b-b1de-cd8b91c5be84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:47.398370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6ee28002-087d-4b5b-b1de-cd8b91c5be84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:47.418197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ee28002-087d-4b5b-b1de-cd8b91c5be84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:47.419421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ee28002-087d-4b5b-b1de-cd8b91c5be84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:47.420206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ee28002-087d-4b5b-b1de-cd8b91c5be84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:47.421212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ee28002-087d-4b5b-b1de-cd8b91c5be84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:47.424581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ee28002-087d-4b5b-b1de-cd8b91c5be84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:47.426116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ee28002-087d-4b5b-b1de-cd8b91c5be84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:47.806584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6ee28002-087d-4b5b-b1de-cd8b91c5be84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:47.825878 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6ee28002-087d-4b5b-b1de-cd8b91c5be84 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1390 microversion: 2.1 time: 0.433171 Oct 27 19:24:47.827948 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3208/6559] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:47 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1390 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:48.086703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-0d17bab9-0c17-4833-97ed-22cee1d2bdf9 req-e4923807-eaf8-421e-aedf-c75b7fac1e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e2ca13-a2f2-4aac-9018-ef436b487e00", "tag": "f1ad43c0-31ac-45b2-a0ad-01368857adb2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:48.113756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0d17bab9-0c17-4833-97ed-22cee1d2bdf9 req-e4923807-eaf8-421e-aedf-c75b7fac1e22 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:48.118638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0d17bab9-0c17-4833-97ed-22cee1d2bdf9 req-e4923807-eaf8-421e-aedf-c75b7fac1e22 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:48.123450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0d17bab9-0c17-4833-97ed-22cee1d2bdf9 req-e4923807-eaf8-421e-aedf-c75b7fac1e22 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:48.170937 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-0d17bab9-0c17-4833-97ed-22cee1d2bdf9 req-e4923807-eaf8-421e-aedf-c75b7fac1e22 service nova] Creating event network-changed:f1ad43c0-31ac-45b2-a0ad-01368857adb2 for instance 24e2ca13-a2f2-4aac-9018-ef436b487e00 on n-h2-860687-3 Oct 27 19:24:48.192869 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-0d17bab9-0c17-4833-97ed-22cee1d2bdf9 req-e4923807-eaf8-421e-aedf-c75b7fac1e22 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109808 Oct 27 19:24:48.193756 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3352/6560] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:48.854698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4d931270-c08a-4f65-ac5f-1fd4c1f26fe9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:48.855759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4d931270-c08a-4f65-ac5f-1fd4c1f26fe9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:48.864745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d931270-c08a-4f65-ac5f-1fd4c1f26fe9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:48.865470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d931270-c08a-4f65-ac5f-1fd4c1f26fe9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:48.866130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d931270-c08a-4f65-ac5f-1fd4c1f26fe9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:48.867153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d931270-c08a-4f65-ac5f-1fd4c1f26fe9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:48.867621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d931270-c08a-4f65-ac5f-1fd4c1f26fe9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:48.868750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d931270-c08a-4f65-ac5f-1fd4c1f26fe9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:49.026133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4d931270-c08a-4f65-ac5f-1fd4c1f26fe9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:49.039118 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4d931270-c08a-4f65-ac5f-1fd4c1f26fe9 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1390 microversion: 2.1 time: 0.190842 Oct 27 19:24:49.046720 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3209/6561] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:48 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1390 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:50.069022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cd086a53-969b-43dd-8ecd-2391c9800dec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:50.070682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cd086a53-969b-43dd-8ecd-2391c9800dec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:50.079662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd086a53-969b-43dd-8ecd-2391c9800dec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:50.080650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd086a53-969b-43dd-8ecd-2391c9800dec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:50.081539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd086a53-969b-43dd-8ecd-2391c9800dec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:50.082509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd086a53-969b-43dd-8ecd-2391c9800dec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:50.083780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd086a53-969b-43dd-8ecd-2391c9800dec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:50.084836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd086a53-969b-43dd-8ecd-2391c9800dec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:50.252486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cd086a53-969b-43dd-8ecd-2391c9800dec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:50.262234 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cd086a53-969b-43dd-8ecd-2391c9800dec tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1390 microversion: 2.1 time: 0.198861 Oct 27 19:24:50.263126 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3353/6562] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:50 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1390 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:50.310793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5d2e264e-19ed-4b1e-9a76-04d5dfc55c49 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:50.314198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5d2e264e-19ed-4b1e-9a76-04d5dfc55c49 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:50.330936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d2e264e-19ed-4b1e-9a76-04d5dfc55c49 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:50.332373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d2e264e-19ed-4b1e-9a76-04d5dfc55c49 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:50.333297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d2e264e-19ed-4b1e-9a76-04d5dfc55c49 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:50.335799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d2e264e-19ed-4b1e-9a76-04d5dfc55c49 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:50.339058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d2e264e-19ed-4b1e-9a76-04d5dfc55c49 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:50.340221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d2e264e-19ed-4b1e-9a76-04d5dfc55c49 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:50.410093 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5d2e264e-19ed-4b1e-9a76-04d5dfc55c49 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "POST /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9/action" status: 200 len: 24553 microversion: 2.1 time: 0.103429 Oct 27 19:24:50.411289 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3210/6563] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:24:50 2022] POST /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9/action => generated 24553 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:24:51.293476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6400e0f-d392-4def-9bc5-c74ef34ee665 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:51.294832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c6400e0f-d392-4def-9bc5-c74ef34ee665 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:51.306075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6400e0f-d392-4def-9bc5-c74ef34ee665 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:51.307086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6400e0f-d392-4def-9bc5-c74ef34ee665 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:51.307959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6400e0f-d392-4def-9bc5-c74ef34ee665 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:51.309288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6400e0f-d392-4def-9bc5-c74ef34ee665 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:51.310273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6400e0f-d392-4def-9bc5-c74ef34ee665 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:51.311136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6400e0f-d392-4def-9bc5-c74ef34ee665 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:51.550894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c6400e0f-d392-4def-9bc5-c74ef34ee665 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:51.567053 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c6400e0f-d392-4def-9bc5-c74ef34ee665 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1390 microversion: 2.1 time: 0.279699 Oct 27 19:24:51.571895 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3354/6564] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:51 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1390 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:52.594840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4e887afb-5c2e-47c0-a678-ba8b32a37477 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:52.596546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4e887afb-5c2e-47c0-a678-ba8b32a37477 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:52.606061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e887afb-5c2e-47c0-a678-ba8b32a37477 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:52.606869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e887afb-5c2e-47c0-a678-ba8b32a37477 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:52.608003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e887afb-5c2e-47c0-a678-ba8b32a37477 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:52.608996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e887afb-5c2e-47c0-a678-ba8b32a37477 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:52.609726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e887afb-5c2e-47c0-a678-ba8b32a37477 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:52.610504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e887afb-5c2e-47c0-a678-ba8b32a37477 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:53.424744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4e887afb-5c2e-47c0-a678-ba8b32a37477 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:53.442208 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4e887afb-5c2e-47c0-a678-ba8b32a37477 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1390 microversion: 2.1 time: 0.852237 Oct 27 19:24:53.456759 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3211/6565] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:52 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1390 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:54.467336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-684f597d-ca6f-4c7f-8998-1986396c41ee tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:54.468744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-684f597d-ca6f-4c7f-8998-1986396c41ee tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:54.476994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:54.478994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-684f597d-ca6f-4c7f-8998-1986396c41ee tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:54.479978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-684f597d-ca6f-4c7f-8998-1986396c41ee tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:54.480774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-684f597d-ca6f-4c7f-8998-1986396c41ee tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:54.482703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-684f597d-ca6f-4c7f-8998-1986396c41ee tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:54.483325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-684f597d-ca6f-4c7f-8998-1986396c41ee tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:54.484089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-684f597d-ca6f-4c7f-8998-1986396c41ee tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:54.662632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-684f597d-ca6f-4c7f-8998-1986396c41ee tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:54.671816 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-684f597d-ca6f-4c7f-8998-1986396c41ee tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1390 microversion: 2.1 time: 0.208457 Oct 27 19:24:54.672185 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3355/6566] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:54 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1390 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:55.127279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-3665174e-5599-405b-8e19-aaebd092b562 req-532727c9-a932-4ff5-ac2e-fe0fb414dbc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e2ca13-a2f2-4aac-9018-ef436b487e00", "name": "network-vif-plugged", "status": "completed", "tag": "f1ad43c0-31ac-45b2-a0ad-01368857adb2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:24:55.145573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:55.146777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:24:55.148986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3665174e-5599-405b-8e19-aaebd092b562 req-532727c9-a932-4ff5-ac2e-fe0fb414dbc1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:55.151436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3665174e-5599-405b-8e19-aaebd092b562 req-532727c9-a932-4ff5-ac2e-fe0fb414dbc1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:55.160074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3665174e-5599-405b-8e19-aaebd092b562 req-532727c9-a932-4ff5-ac2e-fe0fb414dbc1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:55.180760 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-3665174e-5599-405b-8e19-aaebd092b562 req-532727c9-a932-4ff5-ac2e-fe0fb414dbc1 service nova] Creating event network-vif-plugged:f1ad43c0-31ac-45b2-a0ad-01368857adb2 for instance 24e2ca13-a2f2-4aac-9018-ef436b487e00 on n-h2-860687-3 Oct 27 19:24:55.185597 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-3665174e-5599-405b-8e19-aaebd092b562 req-532727c9-a932-4ff5-ac2e-fe0fb414dbc1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062704 Oct 27 19:24:55.186833 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3212/6567] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:24:55.701032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c805638c-fcc8-47fb-aa82-8b60587a78b3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:55.702279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c805638c-fcc8-47fb-aa82-8b60587a78b3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:55.710254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c805638c-fcc8-47fb-aa82-8b60587a78b3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:55.711114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c805638c-fcc8-47fb-aa82-8b60587a78b3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:55.711634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c805638c-fcc8-47fb-aa82-8b60587a78b3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:55.712715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c805638c-fcc8-47fb-aa82-8b60587a78b3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:55.713288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c805638c-fcc8-47fb-aa82-8b60587a78b3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:55.713993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c805638c-fcc8-47fb-aa82-8b60587a78b3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:55.966201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c805638c-fcc8-47fb-aa82-8b60587a78b3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:55.977051 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c805638c-fcc8-47fb-aa82-8b60587a78b3 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1390 microversion: 2.1 time: 0.283622 Oct 27 19:24:55.978983 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3356/6568] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:55 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1390 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:57.000898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a6fda3e0-68d1-4daa-a98a-1d6a88faba0d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:57.002375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a6fda3e0-68d1-4daa-a98a-1d6a88faba0d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:57.021260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6fda3e0-68d1-4daa-a98a-1d6a88faba0d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:57.021972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6fda3e0-68d1-4daa-a98a-1d6a88faba0d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:57.022654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6fda3e0-68d1-4daa-a98a-1d6a88faba0d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:57.023608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6fda3e0-68d1-4daa-a98a-1d6a88faba0d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:57.024268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6fda3e0-68d1-4daa-a98a-1d6a88faba0d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:57.024897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6fda3e0-68d1-4daa-a98a-1d6a88faba0d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:57.209816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a6fda3e0-68d1-4daa-a98a-1d6a88faba0d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:57.218898 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a6fda3e0-68d1-4daa-a98a-1d6a88faba0d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1562 microversion: 2.1 time: 0.222302 Oct 27 19:24:57.220710 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3213/6569] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:56 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:24:57.248359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a2ffccbb-0116-4ccc-8b58-25a4ad92ef43 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:24:57.249608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a2ffccbb-0116-4ccc-8b58-25a4ad92ef43 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:24:57.258455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2ffccbb-0116-4ccc-8b58-25a4ad92ef43 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:57.259247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2ffccbb-0116-4ccc-8b58-25a4ad92ef43 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:57.259926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2ffccbb-0116-4ccc-8b58-25a4ad92ef43 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:57.260895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2ffccbb-0116-4ccc-8b58-25a4ad92ef43 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:24:57.262351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2ffccbb-0116-4ccc-8b58-25a4ad92ef43 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:24:57.263303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a2ffccbb-0116-4ccc-8b58-25a4ad92ef43 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:24:57.464245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a2ffccbb-0116-4ccc-8b58-25a4ad92ef43 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:24:57.476210 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a2ffccbb-0116-4ccc-8b58-25a4ad92ef43 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1562 microversion: 2.1 time: 0.232112 Oct 27 19:24:57.477296 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3357/6570] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:24:57 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:00.458750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a349cf0c-2f6e-462f-a719-67b2b44b4b64 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:00.459425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a349cf0c-2f6e-462f-a719-67b2b44b4b64 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:00.471475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-f850b77f-d9a3-43d9-82ad-8e50075d11bd req-369d7510-39b3-46ea-a093-d10d7bf4b5ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e2ca13-a2f2-4aac-9018-ef436b487e00", "tag": "f1ad43c0-31ac-45b2-a0ad-01368857adb2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:25:00.479095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a349cf0c-2f6e-462f-a719-67b2b44b4b64 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:00.479630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a349cf0c-2f6e-462f-a719-67b2b44b4b64 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:00.480084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a349cf0c-2f6e-462f-a719-67b2b44b4b64 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:00.480832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a349cf0c-2f6e-462f-a719-67b2b44b4b64 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:00.481301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a349cf0c-2f6e-462f-a719-67b2b44b4b64 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:00.481741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a349cf0c-2f6e-462f-a719-67b2b44b4b64 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:00.497365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f850b77f-d9a3-43d9-82ad-8e50075d11bd req-369d7510-39b3-46ea-a093-d10d7bf4b5ec service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:00.497854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f850b77f-d9a3-43d9-82ad-8e50075d11bd req-369d7510-39b3-46ea-a093-d10d7bf4b5ec service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:00.498557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f850b77f-d9a3-43d9-82ad-8e50075d11bd req-369d7510-39b3-46ea-a093-d10d7bf4b5ec service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:00.519065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=61,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:00.529882 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-f850b77f-d9a3-43d9-82ad-8e50075d11bd req-369d7510-39b3-46ea-a093-d10d7bf4b5ec service nova] Creating event network-changed:f1ad43c0-31ac-45b2-a0ad-01368857adb2 for instance 24e2ca13-a2f2-4aac-9018-ef436b487e00 on n-h2-860687-3 Oct 27 19:25:00.554983 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-f850b77f-d9a3-43d9-82ad-8e50075d11bd req-369d7510-39b3-46ea-a093-d10d7bf4b5ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091949 Oct 27 19:25:00.560303 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3358/6571] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:25:00.947959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a349cf0c-2f6e-462f-a719-67b2b44b4b64 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:00.957487 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a349cf0c-2f6e-462f-a719-67b2b44b4b64 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1562 microversion: 2.1 time: 0.504893 Oct 27 19:25:00.958295 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3214/6572] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:00 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1562 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:02.325810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-14380950", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b99aafc6-19f2-42ac-ad30-34fa015ee3a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:25:02.409654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] validate_networks() for [('0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:25:02.823230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:25:02.823948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:25:02.824470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:25:02.824886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:25:02.825302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:25:02.836752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:02.837256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:02.837689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:02.838506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:02.838917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:02.839353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:02.857983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:25:02.863100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for user c8e60ff9ab0d45628195f314f1cac791 and project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:25:03.149154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:25:03.151444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b99aafc6-19f2-42ac-ad30-34fa015ee3a4',volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:25:03.331135 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c8e7a119-0126-4982-8a44-27f700dd85fe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.011096 Oct 27 19:25:03.331791 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3359/6573] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:25:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:25:03.343063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7ecea6e9-d12d-42d7-a247-448ae87b0ad0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:03.344391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7ecea6e9-d12d-42d7-a247-448ae87b0ad0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:03.425830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7ecea6e9-d12d-42d7-a247-448ae87b0ad0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:03.433213 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7ecea6e9-d12d-42d7-a247-448ae87b0ad0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1069 microversion: 2.1 time: 0.093913 Oct 27 19:25:03.446412 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3215/6574] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:03 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1069 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:04.460226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-566ea33a-d724-41d4-a01e-a9941813a61d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:04.460870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-566ea33a-d724-41d4-a01e-a9941813a61d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:04.485888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-566ea33a-d724-41d4-a01e-a9941813a61d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:04.486446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-566ea33a-d724-41d4-a01e-a9941813a61d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:04.486911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-566ea33a-d724-41d4-a01e-a9941813a61d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:04.487654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-566ea33a-d724-41d4-a01e-a9941813a61d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:04.488129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-566ea33a-d724-41d4-a01e-a9941813a61d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:04.488593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-566ea33a-d724-41d4-a01e-a9941813a61d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:04.635180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-566ea33a-d724-41d4-a01e-a9941813a61d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:04.659847 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-566ea33a-d724-41d4-a01e-a9941813a61d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1167 microversion: 2.1 time: 0.205596 Oct 27 19:25:04.662988 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3360/6575] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:04 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1167 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:05.686875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e727a845-fae6-41d0-837f-10b544abb609 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:05.687510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e727a845-fae6-41d0-837f-10b544abb609 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:05.697661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e727a845-fae6-41d0-837f-10b544abb609 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:05.698191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e727a845-fae6-41d0-837f-10b544abb609 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:05.698873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e727a845-fae6-41d0-837f-10b544abb609 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:05.699797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e727a845-fae6-41d0-837f-10b544abb609 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:05.700444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e727a845-fae6-41d0-837f-10b544abb609 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:05.701050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e727a845-fae6-41d0-837f-10b544abb609 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:05.744891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7b541444-3dca-4c77-a375-e58256a71409 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Action: 'create', calling method: .version_select at 0x7fc87326c160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-495340004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjDsMjs2Fu348NBD6Gz4IqBkNTfBAzdHGQ0FhhC8vPH9O4ZqxiKPPjmqFv0p2clofGbxtgqBWohIYZlDwNkqRZbhm940ZisLti9Z5CotPYohEVwpl/9sHy8TiaZkAMp1Q=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:25:05.765043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-7b541444-3dca-4c77-a375-e58256a71409 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Getting quotas for project e2ecef554af04d36a8c61e2b30d8f9e8. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:25:05.773227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-7b541444-3dca-4c77-a375-e58256a71409 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Getting quotas for user c460e1808e4a4788b1fc3984eb4ab43b and project e2ecef554af04d36a8c61e2b30d8f9e8. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:25:05.807373 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7b541444-3dca-4c77-a375-e58256a71409 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.066789 Oct 27 19:25:05.814727 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3361/6576] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:25:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:25:06.643427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e727a845-fae6-41d0-837f-10b544abb609 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:06.655008 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e727a845-fae6-41d0-837f-10b544abb609 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1227 microversion: 2.1 time: 0.972938 Oct 27 19:25:06.656222 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3216/6577] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:05 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1227 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:07.605220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-52564b19-6d3d-4b5a-a1af-accc7e13bbfc req-fdd6d06b-54d5-48d8-836d-9a35e5c6f8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44eb19d0-1788-4dcc-b9ac-02518bcec8b1", "tag": "d6457658-3c90-408b-a700-ec8fc8a47e7f"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:25:07.631494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-52564b19-6d3d-4b5a-a1af-accc7e13bbfc req-fdd6d06b-54d5-48d8-836d-9a35e5c6f8f8 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:07.632820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-52564b19-6d3d-4b5a-a1af-accc7e13bbfc req-fdd6d06b-54d5-48d8-836d-9a35e5c6f8f8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:07.633987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-52564b19-6d3d-4b5a-a1af-accc7e13bbfc req-fdd6d06b-54d5-48d8-836d-9a35e5c6f8f8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:07.654681 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-52564b19-6d3d-4b5a-a1af-accc7e13bbfc req-fdd6d06b-54d5-48d8-836d-9a35e5c6f8f8 service nova] Creating event network-changed:d6457658-3c90-408b-a700-ec8fc8a47e7f for instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 on n-h1-860687-3 Oct 27 19:25:07.662722 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-52564b19-6d3d-4b5a-a1af-accc7e13bbfc req-fdd6d06b-54d5-48d8-836d-9a35e5c6f8f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066825 Oct 27 19:25:07.663619 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3362/6578] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:25:07.680525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-24b6b8c0-714c-41ec-b6ff-bde3b025217b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:07.681086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-24b6b8c0-714c-41ec-b6ff-bde3b025217b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:07.706284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24b6b8c0-714c-41ec-b6ff-bde3b025217b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:07.707409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24b6b8c0-714c-41ec-b6ff-bde3b025217b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:07.708159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24b6b8c0-714c-41ec-b6ff-bde3b025217b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:07.708899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24b6b8c0-714c-41ec-b6ff-bde3b025217b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:07.709374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24b6b8c0-714c-41ec-b6ff-bde3b025217b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:07.709814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24b6b8c0-714c-41ec-b6ff-bde3b025217b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:08.083287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1361626765", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "68d48d09-7ae1-430e-94d9-083e6b16820f"}], "key_name": "tempest-TestNetworkBasicOps-495340004", "security_groups": [{"name": "tempest-secgroup-smoke-1044919529"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:25:08.117639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-24b6b8c0-714c-41ec-b6ff-bde3b025217b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:08.125945 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-24b6b8c0-714c-41ec-b6ff-bde3b025217b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1227 microversion: 2.1 time: 0.449375 Oct 27 19:25:08.132756 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3217/6579] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:07 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1227 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:08.306896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] validate_networks() for [('68d48d09-7ae1-430e-94d9-083e6b16820f', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:25:09.029942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:25:09.030549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:25:09.030889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:25:09.031302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:25:09.032171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:25:09.043877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:09.044372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:09.044811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:09.045579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:09.046036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:09.046504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:09.072620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Getting quotas for project e2ecef554af04d36a8c61e2b30d8f9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:25:09.079949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Getting quotas for user c460e1808e4a4788b1fc3984eb4ab43b and project e2ecef554af04d36a8c61e2b30d8f9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:25:09.095830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:25:09.099004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:25:09.158467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf351c04-1feb-42ef-882c-ff873cc08610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:09.159266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf351c04-1feb-42ef-882c-ff873cc08610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:09.171612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf351c04-1feb-42ef-882c-ff873cc08610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:09.175902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf351c04-1feb-42ef-882c-ff873cc08610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:09.177498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf351c04-1feb-42ef-882c-ff873cc08610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:09.179050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf351c04-1feb-42ef-882c-ff873cc08610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:09.183225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf351c04-1feb-42ef-882c-ff873cc08610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:09.183939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf351c04-1feb-42ef-882c-ff873cc08610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:09.195004 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e883631a-17ba-4be2-a722-549b2b9337b1 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.117364 Oct 27 19:25:09.199817 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3363/6580] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:25:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 19:25:09.221316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0185b71f-6e14-4ae3-a694-ea56673414fd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:09.222041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0185b71f-6e14-4ae3-a694-ea56673414fd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:09.419920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0185b71f-6e14-4ae3-a694-ea56673414fd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:09.433189 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0185b71f-6e14-4ae3-a694-ea56673414fd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1248 microversion: 2.1 time: 0.224127 Oct 27 19:25:09.448087 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3364/6581] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:09 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1248 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:09.561413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf351c04-1feb-42ef-882c-ff873cc08610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:09.571074 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf351c04-1feb-42ef-882c-ff873cc08610 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1227 microversion: 2.1 time: 0.417659 Oct 27 19:25:09.575587 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3218/6582] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:09 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1227 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:25:10.460387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d118b191-70a4-47e3-9a11-fd5302860efe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:10.461022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d118b191-70a4-47e3-9a11-fd5302860efe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:10.469105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d118b191-70a4-47e3-9a11-fd5302860efe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:10.469886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d118b191-70a4-47e3-9a11-fd5302860efe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:10.470564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d118b191-70a4-47e3-9a11-fd5302860efe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:10.471476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d118b191-70a4-47e3-9a11-fd5302860efe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:10.472111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d118b191-70a4-47e3-9a11-fd5302860efe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:10.472716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d118b191-70a4-47e3-9a11-fd5302860efe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:10.597229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d118b191-70a4-47e3-9a11-fd5302860efe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:10.599874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ccc15603-2fed-43ea-8c90-77459ef9cced tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:10.600553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ccc15603-2fed-43ea-8c90-77459ef9cced tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:10.608958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccc15603-2fed-43ea-8c90-77459ef9cced tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:10.609462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccc15603-2fed-43ea-8c90-77459ef9cced tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:10.614129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccc15603-2fed-43ea-8c90-77459ef9cced tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:10.614953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccc15603-2fed-43ea-8c90-77459ef9cced tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:10.615445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccc15603-2fed-43ea-8c90-77459ef9cced tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:10.615900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccc15603-2fed-43ea-8c90-77459ef9cced tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:10.616253 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d118b191-70a4-47e3-9a11-fd5302860efe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1300 microversion: 2.1 time: 0.159901 Oct 27 19:25:10.616955 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3365/6583] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:10 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1300 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:10.853145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ccc15603-2fed-43ea-8c90-77459ef9cced tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:10.867217 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ccc15603-2fed-43ea-8c90-77459ef9cced tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1227 microversion: 2.1 time: 0.271060 Oct 27 19:25:10.867943 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3219/6584] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:10 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1227 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:25:11.644613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b41209d1-539a-486e-a571-4c62680d706c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:11.645231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b41209d1-539a-486e-a571-4c62680d706c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:11.659149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b41209d1-539a-486e-a571-4c62680d706c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:11.663734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b41209d1-539a-486e-a571-4c62680d706c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:11.664279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b41209d1-539a-486e-a571-4c62680d706c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:11.665045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b41209d1-539a-486e-a571-4c62680d706c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:11.665522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b41209d1-539a-486e-a571-4c62680d706c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:11.670212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b41209d1-539a-486e-a571-4c62680d706c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:11.816470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b41209d1-539a-486e-a571-4c62680d706c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:11.832441 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b41209d1-539a-486e-a571-4c62680d706c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1306 microversion: 2.1 time: 0.192857 Oct 27 19:25:11.834668 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3366/6585] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:11 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1306 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:11.893656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-37dd8d51-6d21-4a74-a3ae-f1c041e04c78 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:11.895001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-37dd8d51-6d21-4a74-a3ae-f1c041e04c78 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:11.899446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:11.918776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37dd8d51-6d21-4a74-a3ae-f1c041e04c78 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:11.919598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37dd8d51-6d21-4a74-a3ae-f1c041e04c78 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:11.920326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37dd8d51-6d21-4a74-a3ae-f1c041e04c78 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:11.921632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37dd8d51-6d21-4a74-a3ae-f1c041e04c78 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:11.924036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37dd8d51-6d21-4a74-a3ae-f1c041e04c78 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:11.926801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37dd8d51-6d21-4a74-a3ae-f1c041e04c78 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:12.296086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-37dd8d51-6d21-4a74-a3ae-f1c041e04c78 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:12.311600 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-37dd8d51-6d21-4a74-a3ae-f1c041e04c78 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1227 microversion: 2.1 time: 0.423689 Oct 27 19:25:12.312557 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3220/6586] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:11 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1227 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:12.862324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14edf5b0-40e2-4a9f-ab6f-b0ab022887e2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:12.863814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-14edf5b0-40e2-4a9f-ab6f-b0ab022887e2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:12.868724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:12.872358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14edf5b0-40e2-4a9f-ab6f-b0ab022887e2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:12.872884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14edf5b0-40e2-4a9f-ab6f-b0ab022887e2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:12.873325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14edf5b0-40e2-4a9f-ab6f-b0ab022887e2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:12.874032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14edf5b0-40e2-4a9f-ab6f-b0ab022887e2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:12.874523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14edf5b0-40e2-4a9f-ab6f-b0ab022887e2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:12.875016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14edf5b0-40e2-4a9f-ab6f-b0ab022887e2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:13.095491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-14edf5b0-40e2-4a9f-ab6f-b0ab022887e2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:13.124225 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-14edf5b0-40e2-4a9f-ab6f-b0ab022887e2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1374 microversion: 2.1 time: 0.270311 Oct 27 19:25:13.124842 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3367/6587] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:12 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1374 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:13.337892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-804e4bf1-f9b2-4939-9a38-0da53942f6db tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:13.338494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-804e4bf1-f9b2-4939-9a38-0da53942f6db tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:13.348896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-804e4bf1-f9b2-4939-9a38-0da53942f6db tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:13.350002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-804e4bf1-f9b2-4939-9a38-0da53942f6db tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:13.351677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-804e4bf1-f9b2-4939-9a38-0da53942f6db tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:13.352950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-804e4bf1-f9b2-4939-9a38-0da53942f6db tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:13.353807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-804e4bf1-f9b2-4939-9a38-0da53942f6db tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:13.355378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-804e4bf1-f9b2-4939-9a38-0da53942f6db tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:13.434700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:13.634274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-804e4bf1-f9b2-4939-9a38-0da53942f6db tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:13.645918 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-804e4bf1-f9b2-4939-9a38-0da53942f6db tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1215 microversion: 2.1 time: 0.311956 Oct 27 19:25:13.664821 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3221/6588] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:13 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1215 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:13.762040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-fefc0d34-9427-4351-aa1c-90706c936833 req-daa5a053-1fbc-45a0-b2c7-631c1e697e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc686a1d-7d40-4c55-b36b-9bd142d4b1b0", "tag": "35db2154-741c-4646-a9ae-3a54761c2184"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:25:13.773537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fefc0d34-9427-4351-aa1c-90706c936833 req-daa5a053-1fbc-45a0-b2c7-631c1e697e01 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:13.774309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fefc0d34-9427-4351-aa1c-90706c936833 req-daa5a053-1fbc-45a0-b2c7-631c1e697e01 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:13.774991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fefc0d34-9427-4351-aa1c-90706c936833 req-daa5a053-1fbc-45a0-b2c7-631c1e697e01 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:13.779454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=72 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:13.789303 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-fefc0d34-9427-4351-aa1c-90706c936833 req-daa5a053-1fbc-45a0-b2c7-631c1e697e01 service nova] Creating event network-changed:35db2154-741c-4646-a9ae-3a54761c2184 for instance cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 on n-h2-860687-3 Oct 27 19:25:13.795002 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-fefc0d34-9427-4351-aa1c-90706c936833 req-daa5a053-1fbc-45a0-b2c7-631c1e697e01 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037372 Oct 27 19:25:13.796299 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3368/6589] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:25:14.149057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d613e54a-104f-4d83-92fe-4fac58452ea4 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:14.150704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d613e54a-104f-4d83-92fe-4fac58452ea4 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:14.159864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d613e54a-104f-4d83-92fe-4fac58452ea4 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:14.160583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d613e54a-104f-4d83-92fe-4fac58452ea4 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:14.161604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d613e54a-104f-4d83-92fe-4fac58452ea4 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:14.162555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d613e54a-104f-4d83-92fe-4fac58452ea4 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:14.164266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d613e54a-104f-4d83-92fe-4fac58452ea4 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:14.164903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d613e54a-104f-4d83-92fe-4fac58452ea4 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:14.339247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d613e54a-104f-4d83-92fe-4fac58452ea4 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:14.349407 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d613e54a-104f-4d83-92fe-4fac58452ea4 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1374 microversion: 2.1 time: 0.204201 Oct 27 19:25:14.350564 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3222/6590] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:14 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1374 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:14.672926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7dd62277-a370-4c69-9c28-cef176987cce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:14.673511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7dd62277-a370-4c69-9c28-cef176987cce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:14.691365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dd62277-a370-4c69-9c28-cef176987cce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:14.692185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dd62277-a370-4c69-9c28-cef176987cce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:14.692644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dd62277-a370-4c69-9c28-cef176987cce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:14.693376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dd62277-a370-4c69-9c28-cef176987cce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:14.693845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dd62277-a370-4c69-9c28-cef176987cce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:14.698954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dd62277-a370-4c69-9c28-cef176987cce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:14.912424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7dd62277-a370-4c69-9c28-cef176987cce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:14.920509 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7dd62277-a370-4c69-9c28-cef176987cce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1215 microversion: 2.1 time: 0.252359 Oct 27 19:25:14.921299 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3369/6591] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:14 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1215 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:15.376571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ade95ac2-2f69-4c71-9123-881e57374ebd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:15.377953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ade95ac2-2f69-4c71-9123-881e57374ebd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:15.385924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ade95ac2-2f69-4c71-9123-881e57374ebd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:15.386740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ade95ac2-2f69-4c71-9123-881e57374ebd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:15.387466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ade95ac2-2f69-4c71-9123-881e57374ebd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:15.388606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ade95ac2-2f69-4c71-9123-881e57374ebd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:15.389237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ade95ac2-2f69-4c71-9123-881e57374ebd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:15.389994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ade95ac2-2f69-4c71-9123-881e57374ebd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:15.597406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ade95ac2-2f69-4c71-9123-881e57374ebd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:15.613710 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ade95ac2-2f69-4c71-9123-881e57374ebd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1374 microversion: 2.1 time: 0.242548 Oct 27 19:25:15.624548 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3223/6592] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:15 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1374 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:15.954408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6527cf7-29fc-4212-9f95-f6f26640c0cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:15.960191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d6527cf7-29fc-4212-9f95-f6f26640c0cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:15.978183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6527cf7-29fc-4212-9f95-f6f26640c0cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:15.979021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6527cf7-29fc-4212-9f95-f6f26640c0cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:15.979703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6527cf7-29fc-4212-9f95-f6f26640c0cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:15.980672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6527cf7-29fc-4212-9f95-f6f26640c0cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:15.981275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6527cf7-29fc-4212-9f95-f6f26640c0cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:15.981783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6527cf7-29fc-4212-9f95-f6f26640c0cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:16.143034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d6527cf7-29fc-4212-9f95-f6f26640c0cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:16.170131 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d6527cf7-29fc-4212-9f95-f6f26640c0cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1215 microversion: 2.1 time: 0.215622 Oct 27 19:25:16.170131 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3370/6593] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:15 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1215 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:16.649508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f73f829f-68a4-4223-809c-93a5971202ca tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:16.652376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f73f829f-68a4-4223-809c-93a5971202ca tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:16.661402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f73f829f-68a4-4223-809c-93a5971202ca tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:16.662160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f73f829f-68a4-4223-809c-93a5971202ca tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:16.662818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f73f829f-68a4-4223-809c-93a5971202ca tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:16.663526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f73f829f-68a4-4223-809c-93a5971202ca tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:16.664269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f73f829f-68a4-4223-809c-93a5971202ca tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:16.664847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f73f829f-68a4-4223-809c-93a5971202ca tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:16.993773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d99d8eb1-8c14-4200-9013-fafb873c6946 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:16.994877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d99d8eb1-8c14-4200-9013-fafb873c6946 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:17.007610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d99d8eb1-8c14-4200-9013-fafb873c6946 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:17.008423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d99d8eb1-8c14-4200-9013-fafb873c6946 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:17.009046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d99d8eb1-8c14-4200-9013-fafb873c6946 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:17.009926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d99d8eb1-8c14-4200-9013-fafb873c6946 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:17.010734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d99d8eb1-8c14-4200-9013-fafb873c6946 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:17.011610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d99d8eb1-8c14-4200-9013-fafb873c6946 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:17.042912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f73f829f-68a4-4223-809c-93a5971202ca tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:17.053733 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f73f829f-68a4-4223-809c-93a5971202ca tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1374 microversion: 2.1 time: 0.414911 Oct 27 19:25:17.058182 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d99d8eb1-8c14-4200-9013-fafb873c6946 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/ips" status: 200 len: 146 microversion: 2.1 time: 0.417199 Oct 27 19:25:17.067272 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3371/6594] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 19:25:16 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/ips => generated 146 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:25:17.071885 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3224/6595] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:16 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1374 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:17.184564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b57fe458-b281-40c4-a7be-f9f9085267ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:17.185174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b57fe458-b281-40c4-a7be-f9f9085267ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:17.193277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b57fe458-b281-40c4-a7be-f9f9085267ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:17.194259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b57fe458-b281-40c4-a7be-f9f9085267ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:17.196640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b57fe458-b281-40c4-a7be-f9f9085267ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:17.197676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b57fe458-b281-40c4-a7be-f9f9085267ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:17.199221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b57fe458-b281-40c4-a7be-f9f9085267ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:17.199917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b57fe458-b281-40c4-a7be-f9f9085267ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:17.434927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b57fe458-b281-40c4-a7be-f9f9085267ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:17.448412 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b57fe458-b281-40c4-a7be-f9f9085267ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1215 microversion: 2.1 time: 0.266967 Oct 27 19:25:17.450477 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3372/6596] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:17 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1215 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:18.085477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc08d095-8690-40d2-ab46-1c8e64141bab tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:18.087866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fc08d095-8690-40d2-ab46-1c8e64141bab tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:18.103046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc08d095-8690-40d2-ab46-1c8e64141bab tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:18.103548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc08d095-8690-40d2-ab46-1c8e64141bab tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:18.105863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc08d095-8690-40d2-ab46-1c8e64141bab tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:18.109071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc08d095-8690-40d2-ab46-1c8e64141bab tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:18.110941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc08d095-8690-40d2-ab46-1c8e64141bab tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:18.114039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc08d095-8690-40d2-ab46-1c8e64141bab tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:18.347462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc08d095-8690-40d2-ab46-1c8e64141bab tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:18.355487 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc08d095-8690-40d2-ab46-1c8e64141bab tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1374 microversion: 2.1 time: 0.274042 Oct 27 19:25:18.370970 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3225/6597] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:18 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1374 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:18.473584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5b4543f3-2479-434e-af9d-be207b85a2cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:18.475398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5b4543f3-2479-434e-af9d-be207b85a2cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:18.486562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b4543f3-2479-434e-af9d-be207b85a2cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:18.489059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b4543f3-2479-434e-af9d-be207b85a2cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:18.490124 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b4543f3-2479-434e-af9d-be207b85a2cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:18.492029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b4543f3-2479-434e-af9d-be207b85a2cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:18.492907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b4543f3-2479-434e-af9d-be207b85a2cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:18.494415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5b4543f3-2479-434e-af9d-be207b85a2cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:18.752143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5b4543f3-2479-434e-af9d-be207b85a2cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:18.761786 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5b4543f3-2479-434e-af9d-be207b85a2cb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1215 microversion: 2.1 time: 0.292347 Oct 27 19:25:18.763501 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3373/6598] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:18 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1215 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:19.171389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-3eb67cda-2bfa-46f2-8a0e-e14d7a88880c req-866e998e-260b-4a16-ac0e-dd50a1015f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc686a1d-7d40-4c55-b36b-9bd142d4b1b0", "name": "network-vif-plugged", "status": "completed", "tag": "35db2154-741c-4646-a9ae-3a54761c2184"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:25:19.189453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3eb67cda-2bfa-46f2-8a0e-e14d7a88880c req-866e998e-260b-4a16-ac0e-dd50a1015f68 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:19.192389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3eb67cda-2bfa-46f2-8a0e-e14d7a88880c req-866e998e-260b-4a16-ac0e-dd50a1015f68 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:19.193047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3eb67cda-2bfa-46f2-8a0e-e14d7a88880c req-866e998e-260b-4a16-ac0e-dd50a1015f68 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:19.216571 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-3eb67cda-2bfa-46f2-8a0e-e14d7a88880c req-866e998e-260b-4a16-ac0e-dd50a1015f68 service nova] Creating event network-vif-plugged:35db2154-741c-4646-a9ae-3a54761c2184 for instance cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 on n-h2-860687-3 Oct 27 19:25:19.222399 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-3eb67cda-2bfa-46f2-8a0e-e14d7a88880c req-866e998e-260b-4a16-ac0e-dd50a1015f68 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054983 Oct 27 19:25:19.223822 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3226/6599] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:25:19.383407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3c002758-e4ce-49f0-9aef-0b512e68ea72 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:19.384285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3c002758-e4ce-49f0-9aef-0b512e68ea72 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:19.387034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:19.402575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c002758-e4ce-49f0-9aef-0b512e68ea72 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:19.408243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c002758-e4ce-49f0-9aef-0b512e68ea72 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:19.408927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c002758-e4ce-49f0-9aef-0b512e68ea72 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:19.409682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c002758-e4ce-49f0-9aef-0b512e68ea72 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:19.410152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c002758-e4ce-49f0-9aef-0b512e68ea72 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:19.410636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c002758-e4ce-49f0-9aef-0b512e68ea72 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:19.437414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=18 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:19.597716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3c002758-e4ce-49f0-9aef-0b512e68ea72 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:19.608391 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3c002758-e4ce-49f0-9aef-0b512e68ea72 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1374 microversion: 2.1 time: 0.229521 Oct 27 19:25:19.610034 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3374/6600] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:19 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1374 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:19.761790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-249130f0-cb36-4a4c-a069-7a8f6b9998c7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d744da9-8690-4dc4-86ee-b48c8c3ab48f"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:25:19.764363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-249130f0-cb36-4a4c-a069-7a8f6b9998c7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:19.770974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-249130f0-cb36-4a4c-a069-7a8f6b9998c7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:19.771475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-249130f0-cb36-4a4c-a069-7a8f6b9998c7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:19.772116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-249130f0-cb36-4a4c-a069-7a8f6b9998c7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:19.772841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-249130f0-cb36-4a4c-a069-7a8f6b9998c7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:19.773306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-249130f0-cb36-4a4c-a069-7a8f6b9998c7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:19.773921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-249130f0-cb36-4a4c-a069-7a8f6b9998c7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:19.787642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-299a4a00-b885-4819-b02e-6f16416cae9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:19.788259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-299a4a00-b885-4819-b02e-6f16416cae9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:19.794293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-299a4a00-b885-4819-b02e-6f16416cae9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:19.794848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-299a4a00-b885-4819-b02e-6f16416cae9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:19.795476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-299a4a00-b885-4819-b02e-6f16416cae9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:19.796190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-299a4a00-b885-4819-b02e-6f16416cae9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:19.796651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-299a4a00-b885-4819-b02e-6f16416cae9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:19.797540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-299a4a00-b885-4819-b02e-6f16416cae9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:19.969897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-299a4a00-b885-4819-b02e-6f16416cae9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:19.978014 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-299a4a00-b885-4819-b02e-6f16416cae9d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1215 microversion: 2.1 time: 0.194227 Oct 27 19:25:19.978930 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3375/6601] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:19 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:20.473731 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-249130f0-cb36-4a4c-a069-7a8f6b9998c7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "POST /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.716106 Oct 27 19:25:20.478667 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3227/6602] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:25:19 2022] POST /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments => generated 194 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:25:20.632552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6d397d82-8e20-4ea1-91d6-f317a0bc539c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:20.633170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6d397d82-8e20-4ea1-91d6-f317a0bc539c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:20.640223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d397d82-8e20-4ea1-91d6-f317a0bc539c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:20.641764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d397d82-8e20-4ea1-91d6-f317a0bc539c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:20.642314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d397d82-8e20-4ea1-91d6-f317a0bc539c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:20.643064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d397d82-8e20-4ea1-91d6-f317a0bc539c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:20.643526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d397d82-8e20-4ea1-91d6-f317a0bc539c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:20.644189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d397d82-8e20-4ea1-91d6-f317a0bc539c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:20.810801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6d397d82-8e20-4ea1-91d6-f317a0bc539c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:20.824375 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6d397d82-8e20-4ea1-91d6-f317a0bc539c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1374 microversion: 2.1 time: 0.195714 Oct 27 19:25:20.840578 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3376/6603] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:20 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1374 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:21.003449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-562057f1-02d0-493d-97e6-05bdaed2b443 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:21.004249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-562057f1-02d0-493d-97e6-05bdaed2b443 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:21.020504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-562057f1-02d0-493d-97e6-05bdaed2b443 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:21.021076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-562057f1-02d0-493d-97e6-05bdaed2b443 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:21.021594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-562057f1-02d0-493d-97e6-05bdaed2b443 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:21.022412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-562057f1-02d0-493d-97e6-05bdaed2b443 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:21.022941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-562057f1-02d0-493d-97e6-05bdaed2b443 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:21.023439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-562057f1-02d0-493d-97e6-05bdaed2b443 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:21.220042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-562057f1-02d0-493d-97e6-05bdaed2b443 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:21.234401 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-562057f1-02d0-493d-97e6-05bdaed2b443 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1215 microversion: 2.1 time: 0.235993 Oct 27 19:25:21.236850 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3228/6604] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:20 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:21.852410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e743238a-1d49-4a15-ba93-f81e4d7cb751 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:21.853785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e743238a-1d49-4a15-ba93-f81e4d7cb751 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:21.862659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e743238a-1d49-4a15-ba93-f81e4d7cb751 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:21.863605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e743238a-1d49-4a15-ba93-f81e4d7cb751 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:21.864225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e743238a-1d49-4a15-ba93-f81e4d7cb751 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:21.865414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e743238a-1d49-4a15-ba93-f81e4d7cb751 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:21.866073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e743238a-1d49-4a15-ba93-f81e4d7cb751 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:21.867633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e743238a-1d49-4a15-ba93-f81e4d7cb751 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:22.031531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e743238a-1d49-4a15-ba93-f81e4d7cb751 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:22.039972 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e743238a-1d49-4a15-ba93-f81e4d7cb751 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1546 microversion: 2.1 time: 0.195938 Oct 27 19:25:22.041970 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3377/6605] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:21 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1546 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:22.067555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4cbef59b-4ac1-4e8f-acc8-d8729a41a5c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:22.068926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4cbef59b-4ac1-4e8f-acc8-d8729a41a5c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:22.078035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4cbef59b-4ac1-4e8f-acc8-d8729a41a5c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:22.078979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4cbef59b-4ac1-4e8f-acc8-d8729a41a5c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:22.079601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4cbef59b-4ac1-4e8f-acc8-d8729a41a5c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:22.080710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4cbef59b-4ac1-4e8f-acc8-d8729a41a5c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:22.081398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4cbef59b-4ac1-4e8f-acc8-d8729a41a5c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:22.082108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4cbef59b-4ac1-4e8f-acc8-d8729a41a5c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:22.246533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4cbef59b-4ac1-4e8f-acc8-d8729a41a5c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:22.261649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a9ab0d2-293b-4ac8-b8f8-f93fdc6969d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:22.264973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8a9ab0d2-293b-4ac8-b8f8-f93fdc6969d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:22.286322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a9ab0d2-293b-4ac8-b8f8-f93fdc6969d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:22.287326 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4cbef59b-4ac1-4e8f-acc8-d8729a41a5c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1546 microversion: 2.1 time: 0.225147 Oct 27 19:25:22.307412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a9ab0d2-293b-4ac8-b8f8-f93fdc6969d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:22.307942 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3229/6606] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:22 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1546 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:22.308682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a9ab0d2-293b-4ac8-b8f8-f93fdc6969d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:22.309646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a9ab0d2-293b-4ac8-b8f8-f93fdc6969d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:22.314687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a9ab0d2-293b-4ac8-b8f8-f93fdc6969d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:22.315464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a9ab0d2-293b-4ac8-b8f8-f93fdc6969d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:22.653374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8a9ab0d2-293b-4ac8-b8f8-f93fdc6969d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:22.672150 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8a9ab0d2-293b-4ac8-b8f8-f93fdc6969d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1215 microversion: 2.1 time: 0.414415 Oct 27 19:25:22.676541 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3378/6607] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:22 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1215 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:25:23.403445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-e35cf08c-580d-4c2d-8dad-9ddd43a7bd15 req-fc50a15d-043f-43a8-8d0a-0abe576d6865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44eb19d0-1788-4dcc-b9ac-02518bcec8b1", "name": "network-vif-plugged", "status": "completed", "tag": "d6457658-3c90-408b-a700-ec8fc8a47e7f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:25:23.421295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e35cf08c-580d-4c2d-8dad-9ddd43a7bd15 req-fc50a15d-043f-43a8-8d0a-0abe576d6865 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:23.421856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e35cf08c-580d-4c2d-8dad-9ddd43a7bd15 req-fc50a15d-043f-43a8-8d0a-0abe576d6865 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:23.424050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e35cf08c-580d-4c2d-8dad-9ddd43a7bd15 req-fc50a15d-043f-43a8-8d0a-0abe576d6865 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:23.450771 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-e35cf08c-580d-4c2d-8dad-9ddd43a7bd15 req-fc50a15d-043f-43a8-8d0a-0abe576d6865 service nova] Creating event network-vif-plugged:d6457658-3c90-408b-a700-ec8fc8a47e7f for instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 on n-h1-860687-3 Oct 27 19:25:23.462079 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-e35cf08c-580d-4c2d-8dad-9ddd43a7bd15 req-fc50a15d-043f-43a8-8d0a-0abe576d6865 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062556 Oct 27 19:25:23.469296 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3230/6608] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:25:23.704358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-006b51a9-fae1-4903-bc70-89689108fe40 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:23.704977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-006b51a9-fae1-4903-bc70-89689108fe40 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:23.717164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-006b51a9-fae1-4903-bc70-89689108fe40 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:23.717667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-006b51a9-fae1-4903-bc70-89689108fe40 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:23.718114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-006b51a9-fae1-4903-bc70-89689108fe40 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:23.724994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-006b51a9-fae1-4903-bc70-89689108fe40 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:23.726993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-006b51a9-fae1-4903-bc70-89689108fe40 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:23.727474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-006b51a9-fae1-4903-bc70-89689108fe40 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:24.354786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-006b51a9-fae1-4903-bc70-89689108fe40 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:24.369135 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-006b51a9-fae1-4903-bc70-89689108fe40 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1215 microversion: 2.1 time: 0.669021 Oct 27 19:25:24.369741 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3379/6609] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:23 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1215 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:25.399784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00222d45-6fa7-4882-9612-33a8285c0329 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:25.401250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-00222d45-6fa7-4882-9612-33a8285c0329 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:25.417735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00222d45-6fa7-4882-9612-33a8285c0329 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:25.418631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00222d45-6fa7-4882-9612-33a8285c0329 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:25.419091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00222d45-6fa7-4882-9612-33a8285c0329 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:25.419986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00222d45-6fa7-4882-9612-33a8285c0329 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:25.420455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00222d45-6fa7-4882-9612-33a8285c0329 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:25.421251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00222d45-6fa7-4882-9612-33a8285c0329 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:25.801050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-00222d45-6fa7-4882-9612-33a8285c0329 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:25.815197 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-00222d45-6fa7-4882-9612-33a8285c0329 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1401 microversion: 2.1 time: 0.422782 Oct 27 19:25:25.816165 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3231/6610] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:25 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1401 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:25.852765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-274169ba-628f-428f-b84a-fd0f36bbafc6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:25.853399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-274169ba-628f-428f-b84a-fd0f36bbafc6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:25.867103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-274169ba-628f-428f-b84a-fd0f36bbafc6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:25.867606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-274169ba-628f-428f-b84a-fd0f36bbafc6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:25.868062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-274169ba-628f-428f-b84a-fd0f36bbafc6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:25.868787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-274169ba-628f-428f-b84a-fd0f36bbafc6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:25.869252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-274169ba-628f-428f-b84a-fd0f36bbafc6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:25.869688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-274169ba-628f-428f-b84a-fd0f36bbafc6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:26.479247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-274169ba-628f-428f-b84a-fd0f36bbafc6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:26.492774 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-274169ba-628f-428f-b84a-fd0f36bbafc6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1401 microversion: 2.1 time: 0.649138 Oct 27 19:25:26.493406 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3380/6611] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:25 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1401 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:26.518928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-45b543f6-ed40-4257-a5dd-bd0e88b6ef29 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-472858343"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:25:26.522033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-45b543f6-ed40-4257-a5dd-bd0e88b6ef29 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:26.529891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45b543f6-ed40-4257-a5dd-bd0e88b6ef29 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:26.530427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45b543f6-ed40-4257-a5dd-bd0e88b6ef29 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:26.531335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45b543f6-ed40-4257-a5dd-bd0e88b6ef29 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:26.531787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45b543f6-ed40-4257-a5dd-bd0e88b6ef29 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:26.532107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45b543f6-ed40-4257-a5dd-bd0e88b6ef29 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:26.532541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45b543f6-ed40-4257-a5dd-bd0e88b6ef29 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:26.538402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:26.661521 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.compute.api [None req-45b543f6-ed40-4257-a5dd-bd0e88b6ef29 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Attempting to quiesce instance before volume snapshot. Oct 27 19:25:26.724569 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.compute.api [None req-45b543f6-ed40-4257-a5dd-bd0e88b6ef29 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 27 19:25:26.847205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-45b543f6-ed40-4257-a5dd-bd0e88b6ef29 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Creating snapshot from volume b99aafc6-19f2-42ac-ad30-34fa015ee3a4. {{(pid=127028) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 27 19:25:28.693898 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-45b543f6-ed40-4257-a5dd-bd0e88b6ef29 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "POST /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1/action" status: 202 len: 0 microversion: 2.1 time: 2.180859 Oct 27 19:25:28.695737 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3232/6612] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:25:26 2022] POST /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1/action => generated 0 bytes in 2183 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 19:25:31.302782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1020207578", "imageRef": "7129dfcc-c291-4768-b3c2-be5ce39ecb07", "flavorRef": "452", "networks": [{"uuid": "0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:25:31.438257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] validate_networks() for [('0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:25:32.126636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:25:32.127263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:25:32.127745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:25:32.128160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:25:32.128577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:25:32.138844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:32.139334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:32.139774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:32.141879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:32.142339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:32.142811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:32.167118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:25:32.176321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for user c8e60ff9ab0d45628195f314f1cac791 and project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:25:32.196117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:25:32.200407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='096ce154-db43-49fe-9a48-578471989b42',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:25:32.313002 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-969d81cc-5697-468b-8ae6-1e142aca7fef tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.193823 Oct 27 19:25:32.322486 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3381/6613] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:25:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:25:32.331529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4bfa59c5-e841-4da2-b2df-9db428c5b2bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:32.332281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4bfa59c5-e841-4da2-b2df-9db428c5b2bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:32.440751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4bfa59c5-e841-4da2-b2df-9db428c5b2bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:32.451659 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4bfa59c5-e841-4da2-b2df-9db428c5b2bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1230 microversion: 2.1 time: 0.125761 Oct 27 19:25:32.454321 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3233/6614] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:32 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1230 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:25:33.476950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-338424ac-065d-412c-a55f-348a53665fb7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:25:33.479414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-338424ac-065d-412c-a55f-348a53665fb7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:33.480634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b1b0b568-a33d-4acc-825c-2edc5d64e7e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:33.481513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b1b0b568-a33d-4acc-825c-2edc5d64e7e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:33.488137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-338424ac-065d-412c-a55f-348a53665fb7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:33.489009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-338424ac-065d-412c-a55f-348a53665fb7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:33.489632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-338424ac-065d-412c-a55f-348a53665fb7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:33.490563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-338424ac-065d-412c-a55f-348a53665fb7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:33.491853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-338424ac-065d-412c-a55f-348a53665fb7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:33.492556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-338424ac-065d-412c-a55f-348a53665fb7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:33.496072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1b0b568-a33d-4acc-825c-2edc5d64e7e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:33.497161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1b0b568-a33d-4acc-825c-2edc5d64e7e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:33.498821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1b0b568-a33d-4acc-825c-2edc5d64e7e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:33.500711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1b0b568-a33d-4acc-825c-2edc5d64e7e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:33.503802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1b0b568-a33d-4acc-825c-2edc5d64e7e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:33.504402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1b0b568-a33d-4acc-825c-2edc5d64e7e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:33.613912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b1b0b568-a33d-4acc-825c-2edc5d64e7e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:33.626488 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b1b0b568-a33d-4acc-825c-2edc5d64e7e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1282 microversion: 2.1 time: 0.151122 Oct 27 19:25:33.635535 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3234/6615] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:33 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:25:33.666152 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-338424ac-065d-412c-a55f-348a53665fb7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00/action" status: 200 len: 24570 microversion: 2.1 time: 0.195993 Oct 27 19:25:33.669634 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3382/6616] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:25:33 2022] POST /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00/action => generated 24570 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:25:34.651908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2fce3eb0-6adc-4843-bb58-3b7801f4d9bf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:34.652579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2fce3eb0-6adc-4843-bb58-3b7801f4d9bf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:34.660999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fce3eb0-6adc-4843-bb58-3b7801f4d9bf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:34.661771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fce3eb0-6adc-4843-bb58-3b7801f4d9bf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:34.662526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fce3eb0-6adc-4843-bb58-3b7801f4d9bf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:34.663457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fce3eb0-6adc-4843-bb58-3b7801f4d9bf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:34.664599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fce3eb0-6adc-4843-bb58-3b7801f4d9bf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:34.665227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fce3eb0-6adc-4843-bb58-3b7801f4d9bf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:34.792406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2fce3eb0-6adc-4843-bb58-3b7801f4d9bf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:34.804443 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2fce3eb0-6adc-4843-bb58-3b7801f4d9bf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1300 microversion: 2.1 time: 0.156783 Oct 27 19:25:34.806403 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3235/6617] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:34 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1300 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:35.257163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8ae5a2ed-b984-4115-bb87-b59e8d4b3734 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:35.268251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8ae5a2ed-b984-4115-bb87-b59e8d4b3734 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:35.316728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ae5a2ed-b984-4115-bb87-b59e8d4b3734 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:35.317500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ae5a2ed-b984-4115-bb87-b59e8d4b3734 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:35.320562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ae5a2ed-b984-4115-bb87-b59e8d4b3734 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:35.323557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ae5a2ed-b984-4115-bb87-b59e8d4b3734 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:35.324249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ae5a2ed-b984-4115-bb87-b59e8d4b3734 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:35.326976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ae5a2ed-b984-4115-bb87-b59e8d4b3734 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:35.483572 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8ae5a2ed-b984-4115-bb87-b59e8d4b3734 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.232756 Oct 27 19:25:35.487669 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3383/6618] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:25:35 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:25:35.498750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c1427efe-07f5-4e6c-8172-7827046bd75d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:35.499280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c1427efe-07f5-4e6c-8172-7827046bd75d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:35.514372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1427efe-07f5-4e6c-8172-7827046bd75d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:35.515283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1427efe-07f5-4e6c-8172-7827046bd75d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:35.516739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1427efe-07f5-4e6c-8172-7827046bd75d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:35.517857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1427efe-07f5-4e6c-8172-7827046bd75d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:35.518805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1427efe-07f5-4e6c-8172-7827046bd75d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:35.519615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1427efe-07f5-4e6c-8172-7827046bd75d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:35.576955 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c1427efe-07f5-4e6c-8172-7827046bd75d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments/0d744da9-8690-4dc4-86ee-b48c8c3ab48f" status: 200 len: 194 microversion: 2.1 time: 0.082288 Oct 27 19:25:35.578694 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3236/6619] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Oct 27 19:25:35 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments/0d744da9-8690-4dc4-86ee-b48c8c3ab48f => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:25:35.831160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-534de061-f176-4428-bebc-9083d65686b7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:35.831930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-534de061-f176-4428-bebc-9083d65686b7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:35.849911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-534de061-f176-4428-bebc-9083d65686b7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:35.850440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-534de061-f176-4428-bebc-9083d65686b7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:35.851138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-534de061-f176-4428-bebc-9083d65686b7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:35.852016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-534de061-f176-4428-bebc-9083d65686b7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:35.852487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-534de061-f176-4428-bebc-9083d65686b7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:35.852927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-534de061-f176-4428-bebc-9083d65686b7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:36.103451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-534de061-f176-4428-bebc-9083d65686b7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:36.113901 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-534de061-f176-4428-bebc-9083d65686b7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.289195 Oct 27 19:25:36.127024 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3384/6620] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:35 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:25:37.153905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b1315d2-8ab4-49eb-8079-86f8f31ad926 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:37.156983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6b1315d2-8ab4-49eb-8079-86f8f31ad926 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:37.167773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b1315d2-8ab4-49eb-8079-86f8f31ad926 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:37.169016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b1315d2-8ab4-49eb-8079-86f8f31ad926 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:37.169782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b1315d2-8ab4-49eb-8079-86f8f31ad926 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:37.170923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b1315d2-8ab4-49eb-8079-86f8f31ad926 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:37.172140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b1315d2-8ab4-49eb-8079-86f8f31ad926 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:37.173074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b1315d2-8ab4-49eb-8079-86f8f31ad926 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:37.472799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a6c836de-7250-4fee-9f34-ecb9603c9dda req-2aa56cad-ff63-41fd-b364-8c8ef12d1e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ca3740-89f4-4fd9-a97a-fa87c89dce3e", "tag": "aea52e03-dd66-4be9-aa3e-1d6ec5c74cf7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:25:37.494857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a6c836de-7250-4fee-9f34-ecb9603c9dda req-2aa56cad-ff63-41fd-b364-8c8ef12d1e83 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:37.495631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a6c836de-7250-4fee-9f34-ecb9603c9dda req-2aa56cad-ff63-41fd-b364-8c8ef12d1e83 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:37.496274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a6c836de-7250-4fee-9f34-ecb9603c9dda req-2aa56cad-ff63-41fd-b364-8c8ef12d1e83 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:37.534026 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a6c836de-7250-4fee-9f34-ecb9603c9dda req-2aa56cad-ff63-41fd-b364-8c8ef12d1e83 service nova] Creating event network-changed:aea52e03-dd66-4be9-aa3e-1d6ec5c74cf7 for instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e on n-h1-860687-3 Oct 27 19:25:37.555681 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a6c836de-7250-4fee-9f34-ecb9603c9dda req-2aa56cad-ff63-41fd-b364-8c8ef12d1e83 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086751 Oct 27 19:25:37.559301 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3385/6621] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:25:37.615008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6b1315d2-8ab4-49eb-8079-86f8f31ad926 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:37.628698 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b1315d2-8ab4-49eb-8079-86f8f31ad926 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.484869 Oct 27 19:25:37.631569 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3237/6622] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:37 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:38.239564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9f6b5744-a99e-4753-b100-21494ff60271 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a5b65a5-0286-4466-b851-8ac9c7a291c8"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:25:38.242048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9f6b5744-a99e-4753-b100-21494ff60271 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:38.261597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f6b5744-a99e-4753-b100-21494ff60271 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:38.262105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f6b5744-a99e-4753-b100-21494ff60271 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:38.262587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f6b5744-a99e-4753-b100-21494ff60271 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:38.263318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f6b5744-a99e-4753-b100-21494ff60271 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:38.263784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f6b5744-a99e-4753-b100-21494ff60271 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:38.264226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9f6b5744-a99e-4753-b100-21494ff60271 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:38.493850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:38.654478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f71b96f9-b7a9-45fd-944a-727084750931 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:38.655896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f71b96f9-b7a9-45fd-944a-727084750931 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:38.672508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f71b96f9-b7a9-45fd-944a-727084750931 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:38.675609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f71b96f9-b7a9-45fd-944a-727084750931 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:38.677577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f71b96f9-b7a9-45fd-944a-727084750931 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:38.678572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f71b96f9-b7a9-45fd-944a-727084750931 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:38.680008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f71b96f9-b7a9-45fd-944a-727084750931 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:38.681651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f71b96f9-b7a9-45fd-944a-727084750931 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:38.795656 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9f6b5744-a99e-4753-b100-21494ff60271 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "POST /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.552423 Oct 27 19:25:38.796385 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3386/6623] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:25:38 2022] POST /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments => generated 194 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:25:39.178007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f71b96f9-b7a9-45fd-944a-727084750931 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:39.188798 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f71b96f9-b7a9-45fd-944a-727084750931 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.538367 Oct 27 19:25:39.192653 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3238/6624] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:38 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:25:40.220508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b1e5cc41-5daf-4a10-8de6-9c8dd9e75bac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:40.221242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b1e5cc41-5daf-4a10-8de6-9c8dd9e75bac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:40.236597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1e5cc41-5daf-4a10-8de6-9c8dd9e75bac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:40.237233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1e5cc41-5daf-4a10-8de6-9c8dd9e75bac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:40.237691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1e5cc41-5daf-4a10-8de6-9c8dd9e75bac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:40.238447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1e5cc41-5daf-4a10-8de6-9c8dd9e75bac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:40.238924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1e5cc41-5daf-4a10-8de6-9c8dd9e75bac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:40.239366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1e5cc41-5daf-4a10-8de6-9c8dd9e75bac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:40.788545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b1e5cc41-5daf-4a10-8de6-9c8dd9e75bac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:40.810803 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b1e5cc41-5daf-4a10-8de6-9c8dd9e75bac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.595906 Oct 27 19:25:40.811954 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3387/6625] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:40 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:41.859571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ac0a3fde-c6e2-43e1-894c-3b1a6e78523e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:41.861399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ac0a3fde-c6e2-43e1-894c-3b1a6e78523e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:41.878452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0a3fde-c6e2-43e1-894c-3b1a6e78523e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:41.880411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0a3fde-c6e2-43e1-894c-3b1a6e78523e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:41.880411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0a3fde-c6e2-43e1-894c-3b1a6e78523e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:41.880930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0a3fde-c6e2-43e1-894c-3b1a6e78523e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:41.881637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0a3fde-c6e2-43e1-894c-3b1a6e78523e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:41.882316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0a3fde-c6e2-43e1-894c-3b1a6e78523e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:42.204321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ac0a3fde-c6e2-43e1-894c-3b1a6e78523e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:42.223539 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ac0a3fde-c6e2-43e1-894c-3b1a6e78523e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.369102 Oct 27 19:25:42.224590 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3239/6626] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:41 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:43.255706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8ed19f4e-acd4-4b3d-a3e3-c29a4669cdc0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:43.256501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8ed19f4e-acd4-4b3d-a3e3-c29a4669cdc0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:43.266935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:43.269918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:43.272740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:43.276733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed19f4e-acd4-4b3d-a3e3-c29a4669cdc0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:43.277442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed19f4e-acd4-4b3d-a3e3-c29a4669cdc0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:43.279708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed19f4e-acd4-4b3d-a3e3-c29a4669cdc0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:43.295953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed19f4e-acd4-4b3d-a3e3-c29a4669cdc0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:43.301840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed19f4e-acd4-4b3d-a3e3-c29a4669cdc0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:43.303417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed19f4e-acd4-4b3d-a3e3-c29a4669cdc0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:43.677569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8ed19f4e-acd4-4b3d-a3e3-c29a4669cdc0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:43.688202 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8ed19f4e-acd4-4b3d-a3e3-c29a4669cdc0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.436106 Oct 27 19:25:43.689510 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3388/6627] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:43 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:44.713822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-11bee116-f10e-4c2a-9722-21a85593cb69 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:44.714372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-11bee116-f10e-4c2a-9722-21a85593cb69 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:44.723607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:44.725804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=42 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:44.727646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11bee116-f10e-4c2a-9722-21a85593cb69 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:44.728392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11bee116-f10e-4c2a-9722-21a85593cb69 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:44.729016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11bee116-f10e-4c2a-9722-21a85593cb69 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:44.730045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11bee116-f10e-4c2a-9722-21a85593cb69 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:44.730770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11bee116-f10e-4c2a-9722-21a85593cb69 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:44.731377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11bee116-f10e-4c2a-9722-21a85593cb69 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:45.042095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-11bee116-f10e-4c2a-9722-21a85593cb69 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:45.057447 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-11bee116-f10e-4c2a-9722-21a85593cb69 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.347724 Oct 27 19:25:45.071349 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3240/6628] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:44 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:46.087427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3110859d-b93e-4d59-a7e4-6ac920da1796 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:46.089004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3110859d-b93e-4d59-a7e4-6ac920da1796 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:46.108228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3110859d-b93e-4d59-a7e4-6ac920da1796 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:46.108984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3110859d-b93e-4d59-a7e4-6ac920da1796 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:46.110343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3110859d-b93e-4d59-a7e4-6ac920da1796 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:46.113791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3110859d-b93e-4d59-a7e4-6ac920da1796 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:46.114574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3110859d-b93e-4d59-a7e4-6ac920da1796 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:46.116356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3110859d-b93e-4d59-a7e4-6ac920da1796 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:46.429365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3110859d-b93e-4d59-a7e4-6ac920da1796 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:46.439169 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3110859d-b93e-4d59-a7e4-6ac920da1796 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.357468 Oct 27 19:25:46.459039 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3389/6629] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:46 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:47.465038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-89cbd9d7-e36e-46ce-94a5-bc977f772d1d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:47.465667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-89cbd9d7-e36e-46ce-94a5-bc977f772d1d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:47.474131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89cbd9d7-e36e-46ce-94a5-bc977f772d1d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:47.474896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89cbd9d7-e36e-46ce-94a5-bc977f772d1d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:47.475606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89cbd9d7-e36e-46ce-94a5-bc977f772d1d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:47.476518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89cbd9d7-e36e-46ce-94a5-bc977f772d1d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:47.477156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89cbd9d7-e36e-46ce-94a5-bc977f772d1d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:47.477755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89cbd9d7-e36e-46ce-94a5-bc977f772d1d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:47.635777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-89cbd9d7-e36e-46ce-94a5-bc977f772d1d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:47.645315 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-89cbd9d7-e36e-46ce-94a5-bc977f772d1d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.184318 Oct 27 19:25:47.646005 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3241/6630] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:47 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:48.671064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d855cd4a-1a44-4b2a-9313-15c8cd49d07b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:48.675887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d855cd4a-1a44-4b2a-9313-15c8cd49d07b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:48.686407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d855cd4a-1a44-4b2a-9313-15c8cd49d07b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:48.687070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d855cd4a-1a44-4b2a-9313-15c8cd49d07b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:48.688152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d855cd4a-1a44-4b2a-9313-15c8cd49d07b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:48.688989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d855cd4a-1a44-4b2a-9313-15c8cd49d07b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:48.689932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d855cd4a-1a44-4b2a-9313-15c8cd49d07b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:48.690688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d855cd4a-1a44-4b2a-9313-15c8cd49d07b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:48.899740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d855cd4a-1a44-4b2a-9313-15c8cd49d07b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:48.909203 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d855cd4a-1a44-4b2a-9313-15c8cd49d07b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.243750 Oct 27 19:25:48.919225 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3390/6631] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:48 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:49.939563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e4ebe72e-427d-4a17-95c5-d4b61980cdbe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:49.940903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e4ebe72e-427d-4a17-95c5-d4b61980cdbe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:49.954434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4ebe72e-427d-4a17-95c5-d4b61980cdbe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:49.954984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4ebe72e-427d-4a17-95c5-d4b61980cdbe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:49.955654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4ebe72e-427d-4a17-95c5-d4b61980cdbe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:49.961642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4ebe72e-427d-4a17-95c5-d4b61980cdbe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:49.966169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4ebe72e-427d-4a17-95c5-d4b61980cdbe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:49.969149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e4ebe72e-427d-4a17-95c5-d4b61980cdbe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:50.376331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e4ebe72e-427d-4a17-95c5-d4b61980cdbe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:50.416475 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e4ebe72e-427d-4a17-95c5-d4b61980cdbe tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.482567 Oct 27 19:25:50.417838 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3242/6632] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:49 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:51.447144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-56602332-74e0-4f94-b3db-79854ef7a8cc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:51.449087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-56602332-74e0-4f94-b3db-79854ef7a8cc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:51.479675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56602332-74e0-4f94-b3db-79854ef7a8cc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:51.491727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56602332-74e0-4f94-b3db-79854ef7a8cc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:51.492616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56602332-74e0-4f94-b3db-79854ef7a8cc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:51.493613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56602332-74e0-4f94-b3db-79854ef7a8cc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:51.494329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56602332-74e0-4f94-b3db-79854ef7a8cc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:51.495278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-56602332-74e0-4f94-b3db-79854ef7a8cc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:52.111274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-56602332-74e0-4f94-b3db-79854ef7a8cc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:52.130236 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-56602332-74e0-4f94-b3db-79854ef7a8cc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.690600 Oct 27 19:25:52.153303 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3391/6633] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:51 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:53.161498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a372cf91-8d26-43f6-a36a-bbb32087b5c6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:53.163024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a372cf91-8d26-43f6-a36a-bbb32087b5c6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:53.179625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a372cf91-8d26-43f6-a36a-bbb32087b5c6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:53.180180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a372cf91-8d26-43f6-a36a-bbb32087b5c6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:53.180649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a372cf91-8d26-43f6-a36a-bbb32087b5c6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:53.191256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a372cf91-8d26-43f6-a36a-bbb32087b5c6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:53.191786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a372cf91-8d26-43f6-a36a-bbb32087b5c6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:53.192522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a372cf91-8d26-43f6-a36a-bbb32087b5c6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:53.496472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a372cf91-8d26-43f6-a36a-bbb32087b5c6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:53.506484 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a372cf91-8d26-43f6-a36a-bbb32087b5c6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.350111 Oct 27 19:25:53.506484 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3243/6634] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:53 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:53.629786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9b6177a1-280d-4210-9671-b8406c8e0417 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:53.632512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9b6177a1-280d-4210-9671-b8406c8e0417 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:53.660668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b6177a1-280d-4210-9671-b8406c8e0417 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:53.661438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b6177a1-280d-4210-9671-b8406c8e0417 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:53.662159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b6177a1-280d-4210-9671-b8406c8e0417 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:53.663164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b6177a1-280d-4210-9671-b8406c8e0417 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:53.663827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b6177a1-280d-4210-9671-b8406c8e0417 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:53.664480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9b6177a1-280d-4210-9671-b8406c8e0417 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:53.757394 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9b6177a1-280d-4210-9671-b8406c8e0417 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.131715 Oct 27 19:25:53.762787 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3392/6635] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:25:53 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments => generated 371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:25:53.900873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c1a3a306-a4a3-4f5b-a861-e67a33e3871e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:53.901456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c1a3a306-a4a3-4f5b-a861-e67a33e3871e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:53.916181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1a3a306-a4a3-4f5b-a861-e67a33e3871e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:53.916808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1a3a306-a4a3-4f5b-a861-e67a33e3871e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:53.917204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1a3a306-a4a3-4f5b-a861-e67a33e3871e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:53.917959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1a3a306-a4a3-4f5b-a861-e67a33e3871e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:53.918474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1a3a306-a4a3-4f5b-a861-e67a33e3871e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:53.918981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1a3a306-a4a3-4f5b-a861-e67a33e3871e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:53.989387 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c1a3a306-a4a3-4f5b-a861-e67a33e3871e tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments/0d744da9-8690-4dc4-86ee-b48c8c3ab48f" status: 200 len: 194 microversion: 2.1 time: 0.093395 Oct 27 19:25:53.991018 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3244/6636] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Oct 27 19:25:53 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments/0d744da9-8690-4dc4-86ee-b48c8c3ab48f => generated 194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:25:54.003751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5d9ab001-b788-4403-8950-be9feb628e23 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:54.004734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5d9ab001-b788-4403-8950-be9feb628e23 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:54.014515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9ab001-b788-4403-8950-be9feb628e23 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:54.015787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9ab001-b788-4403-8950-be9feb628e23 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:54.017973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9ab001-b788-4403-8950-be9feb628e23 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:54.019200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9ab001-b788-4403-8950-be9feb628e23 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:54.019926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9ab001-b788-4403-8950-be9feb628e23 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:54.020726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9ab001-b788-4403-8950-be9feb628e23 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:54.167160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-5d9ab001-b788-4403-8950-be9feb628e23 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lazy-loading 'services' on Instance uuid c0719014-1b89-4535-8418-f4fb85165af7 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:25:54.309124 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5d9ab001-b788-4403-8950-be9feb628e23 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments/0d744da9-8690-4dc4-86ee-b48c8c3ab48f" status: 202 len: 0 microversion: 2.1 time: 0.310856 Oct 27 19:25:54.310080 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3393/6637] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:25:53 2022] DELETE /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments/0d744da9-8690-4dc4-86ee-b48c8c3ab48f => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:25:54.544732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-23428d86-824a-4c42-8230-d69422ed4582 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:54.545667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-23428d86-824a-4c42-8230-d69422ed4582 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:54.566092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23428d86-824a-4c42-8230-d69422ed4582 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:54.567559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23428d86-824a-4c42-8230-d69422ed4582 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:54.570215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23428d86-824a-4c42-8230-d69422ed4582 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:54.571741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23428d86-824a-4c42-8230-d69422ed4582 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:54.573036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23428d86-824a-4c42-8230-d69422ed4582 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:54.575074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23428d86-824a-4c42-8230-d69422ed4582 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:54.913394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-23428d86-824a-4c42-8230-d69422ed4582 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:54.946656 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-23428d86-824a-4c42-8230-d69422ed4582 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.419308 Oct 27 19:25:54.949621 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3245/6638] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:54 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:55.980491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f6ada50-4557-4f12-840e-6c9a1a52cbac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:55.981230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6f6ada50-4557-4f12-840e-6c9a1a52cbac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:55.989860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f6ada50-4557-4f12-840e-6c9a1a52cbac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:55.990401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f6ada50-4557-4f12-840e-6c9a1a52cbac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:55.990861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f6ada50-4557-4f12-840e-6c9a1a52cbac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:55.991596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f6ada50-4557-4f12-840e-6c9a1a52cbac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:55.992750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f6ada50-4557-4f12-840e-6c9a1a52cbac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:55.993207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f6ada50-4557-4f12-840e-6c9a1a52cbac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:56.706776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6f6ada50-4557-4f12-840e-6c9a1a52cbac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:56.724198 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6f6ada50-4557-4f12-840e-6c9a1a52cbac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.750907 Oct 27 19:25:56.724944 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3394/6639] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:55 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:57.754772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d980b27-102b-4fec-8690-a5725685d4a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:57.755472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d980b27-102b-4fec-8690-a5725685d4a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:57.762947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d980b27-102b-4fec-8690-a5725685d4a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:57.763851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d980b27-102b-4fec-8690-a5725685d4a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:57.764558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d980b27-102b-4fec-8690-a5725685d4a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:57.765577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d980b27-102b-4fec-8690-a5725685d4a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:57.766439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d980b27-102b-4fec-8690-a5725685d4a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:57.767145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d980b27-102b-4fec-8690-a5725685d4a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:57.772018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:25:58.197296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6d980b27-102b-4fec-8690-a5725685d4a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:58.208425 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d980b27-102b-4fec-8690-a5725685d4a0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.457221 Oct 27 19:25:58.212054 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3246/6640] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:57 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:25:59.241016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2638dcc5-bdf3-4e8e-93ca-e3bb35393dc2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:25:59.244197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2638dcc5-bdf3-4e8e-93ca-e3bb35393dc2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:25:59.265209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2638dcc5-bdf3-4e8e-93ca-e3bb35393dc2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:59.268911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2638dcc5-bdf3-4e8e-93ca-e3bb35393dc2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:59.269604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2638dcc5-bdf3-4e8e-93ca-e3bb35393dc2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:59.271476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2638dcc5-bdf3-4e8e-93ca-e3bb35393dc2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:25:59.273742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2638dcc5-bdf3-4e8e-93ca-e3bb35393dc2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:25:59.275757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2638dcc5-bdf3-4e8e-93ca-e3bb35393dc2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:25:59.684529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2638dcc5-bdf3-4e8e-93ca-e3bb35393dc2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:25:59.723747 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2638dcc5-bdf3-4e8e-93ca-e3bb35393dc2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.492013 Oct 27 19:25:59.725365 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3395/6641] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:25:59 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:00.067577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-33d0ff50-e6c7-4779-821d-4a86f0bd3055 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:00.068995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-33d0ff50-e6c7-4779-821d-4a86f0bd3055 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:00.087897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33d0ff50-e6c7-4779-821d-4a86f0bd3055 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:00.088927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33d0ff50-e6c7-4779-821d-4a86f0bd3055 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:00.089641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33d0ff50-e6c7-4779-821d-4a86f0bd3055 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:00.091749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33d0ff50-e6c7-4779-821d-4a86f0bd3055 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:00.092480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33d0ff50-e6c7-4779-821d-4a86f0bd3055 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:00.093325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33d0ff50-e6c7-4779-821d-4a86f0bd3055 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:00.131403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-33d0ff50-e6c7-4779-821d-4a86f0bd3055 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:26:00.317910 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-33d0ff50-e6c7-4779-821d-4a86f0bd3055 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 204 len: 0 microversion: 2.1 time: 0.254436 Oct 27 19:26:00.332610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1cf78752-de02-4257-b6af-07bbd75257e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:00.334025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1cf78752-de02-4257-b6af-07bbd75257e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:00.336467 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3247/6642] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:26:00 2022] DELETE /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:26:00.353282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cf78752-de02-4257-b6af-07bbd75257e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:00.355755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cf78752-de02-4257-b6af-07bbd75257e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:00.356547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cf78752-de02-4257-b6af-07bbd75257e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:00.358719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cf78752-de02-4257-b6af-07bbd75257e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:00.360497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cf78752-de02-4257-b6af-07bbd75257e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:00.362460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1cf78752-de02-4257-b6af-07bbd75257e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:00.751072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a8ebec9f-6958-467d-a1d0-f9e727aede62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:00.752011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a8ebec9f-6958-467d-a1d0-f9e727aede62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:00.764416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8ebec9f-6958-467d-a1d0-f9e727aede62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:00.767135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8ebec9f-6958-467d-a1d0-f9e727aede62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:00.767829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8ebec9f-6958-467d-a1d0-f9e727aede62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:00.768920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8ebec9f-6958-467d-a1d0-f9e727aede62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:00.771240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8ebec9f-6958-467d-a1d0-f9e727aede62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:00.771907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8ebec9f-6958-467d-a1d0-f9e727aede62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:00.867450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1cf78752-de02-4257-b6af-07bbd75257e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:00.879181 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1cf78752-de02-4257-b6af-07bbd75257e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1552 microversion: 2.1 time: 0.551453 Oct 27 19:26:00.881520 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3396/6643] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:00 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1552 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:01.212664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a8ebec9f-6958-467d-a1d0-f9e727aede62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:01.228986 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a8ebec9f-6958-467d-a1d0-f9e727aede62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.483293 Oct 27 19:26:01.231548 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3248/6644] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:00 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:01.904948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b3644ebe-00fc-401f-bc4a-392f14adcfe7 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:01.905570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b3644ebe-00fc-401f-bc4a-392f14adcfe7 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:01.928843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3644ebe-00fc-401f-bc4a-392f14adcfe7 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:01.929351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3644ebe-00fc-401f-bc4a-392f14adcfe7 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:01.931581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3644ebe-00fc-401f-bc4a-392f14adcfe7 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:01.935763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3644ebe-00fc-401f-bc4a-392f14adcfe7 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:01.936545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3644ebe-00fc-401f-bc4a-392f14adcfe7 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:01.937325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b3644ebe-00fc-401f-bc4a-392f14adcfe7 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:02.261030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-38cab025-93b6-46b3-a7b3-a7f11ba827e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:02.261688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-38cab025-93b6-46b3-a7b3-a7f11ba827e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:02.284592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38cab025-93b6-46b3-a7b3-a7f11ba827e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:02.285199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38cab025-93b6-46b3-a7b3-a7f11ba827e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:02.297843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38cab025-93b6-46b3-a7b3-a7f11ba827e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:02.304618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38cab025-93b6-46b3-a7b3-a7f11ba827e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:02.311165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38cab025-93b6-46b3-a7b3-a7f11ba827e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:02.313133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38cab025-93b6-46b3-a7b3-a7f11ba827e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:02.657361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b3644ebe-00fc-401f-bc4a-392f14adcfe7 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:02.672247 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b3644ebe-00fc-401f-bc4a-392f14adcfe7 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1552 microversion: 2.1 time: 0.770665 Oct 27 19:26:02.679740 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3397/6645] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:01 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1552 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:02.696686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-536afb80-1126-4036-b834-b995f996cffa tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:02.697402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-536afb80-1126-4036-b834-b995f996cffa tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:02.712449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-536afb80-1126-4036-b834-b995f996cffa tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:02.714176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-536afb80-1126-4036-b834-b995f996cffa tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:02.714988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-536afb80-1126-4036-b834-b995f996cffa tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:02.717215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-536afb80-1126-4036-b834-b995f996cffa tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:02.719507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-536afb80-1126-4036-b834-b995f996cffa tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:02.720162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-536afb80-1126-4036-b834-b995f996cffa tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:02.805165 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-536afb80-1126-4036-b834-b995f996cffa tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments/9a5b65a5-0286-4466-b851-8ac9c7a291c8" status: 200 len: 194 microversion: 2.1 time: 0.121208 Oct 27 19:26:02.807535 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3398/6646] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Oct 27 19:26:02 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments/9a5b65a5-0286-4466-b851-8ac9c7a291c8 => generated 194 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:26:02.829517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a146e6f6-6f3c-4707-997d-56e979796730 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:02.831161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a146e6f6-6f3c-4707-997d-56e979796730 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:02.845932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a146e6f6-6f3c-4707-997d-56e979796730 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:02.847079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a146e6f6-6f3c-4707-997d-56e979796730 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:02.848857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a146e6f6-6f3c-4707-997d-56e979796730 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:02.852322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a146e6f6-6f3c-4707-997d-56e979796730 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:02.854907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a146e6f6-6f3c-4707-997d-56e979796730 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:02.855418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a146e6f6-6f3c-4707-997d-56e979796730 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:03.044797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-a146e6f6-6f3c-4707-997d-56e979796730 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lazy-loading 'services' on Instance uuid c0719014-1b89-4535-8418-f4fb85165af7 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:26:03.157440 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a146e6f6-6f3c-4707-997d-56e979796730 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments/9a5b65a5-0286-4466-b851-8ac9c7a291c8" status: 202 len: 0 microversion: 2.1 time: 0.338582 Oct 27 19:26:03.158096 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3399/6647] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:26:02 2022] DELETE /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments/9a5b65a5-0286-4466-b851-8ac9c7a291c8 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:26:03.371774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-38cab025-93b6-46b3-a7b3-a7f11ba827e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:03.392809 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-38cab025-93b6-46b3-a7b3-a7f11ba827e4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 1.135894 Oct 27 19:26:03.418060 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3249/6648] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:02 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:03.710234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9c54f6bb-9578-47fa-94b2-a0e78335e958 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:03.712347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9c54f6bb-9578-47fa-94b2-a0e78335e958 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:03.750658 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c54f6bb-9578-47fa-94b2-a0e78335e958 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:03.751725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c54f6bb-9578-47fa-94b2-a0e78335e958 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:03.753492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c54f6bb-9578-47fa-94b2-a0e78335e958 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:03.754689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c54f6bb-9578-47fa-94b2-a0e78335e958 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:03.759040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c54f6bb-9578-47fa-94b2-a0e78335e958 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:03.759911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9c54f6bb-9578-47fa-94b2-a0e78335e958 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:04.075378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:04.079303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:04.102164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:04.102744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:04.103217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:04.103980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:04.104464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:04.104982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:04.146264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9c54f6bb-9578-47fa-94b2-a0e78335e958 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:04.161988 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9c54f6bb-9578-47fa-94b2-a0e78335e958 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1552 microversion: 2.1 time: 0.459252 Oct 27 19:26:04.183061 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3400/6649] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:03 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1552 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:04.298669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:26:04.299126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:26:04.299623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:26:04.300059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:26:04.300495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:26:04.423587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13670c52-abad-4d7f-bc28-c37acec447e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:04.439549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-13670c52-abad-4d7f-bc28-c37acec447e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:04.455742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:04.476689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13670c52-abad-4d7f-bc28-c37acec447e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:04.477546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13670c52-abad-4d7f-bc28-c37acec447e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:04.479829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13670c52-abad-4d7f-bc28-c37acec447e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:04.481188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:04.482673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13670c52-abad-4d7f-bc28-c37acec447e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:04.482903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:04.483383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:04.484205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:04.486209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13670c52-abad-4d7f-bc28-c37acec447e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:04.487002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13670c52-abad-4d7f-bc28-c37acec447e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:04.491215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:04.491702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:04.521450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:26:04.595456 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf1b81ca-a326-4417-8925-19c0153b5dd2 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00/action" status: 202 len: 1138 microversion: 2.1 time: 0.523912 Oct 27 19:26:04.599165 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3250/6650] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:26:04 2022] POST /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00/action => generated 1138 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 27 19:26:04.622424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b17fe640-ec37-4d1c-b385-b683927ba29d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:04.623131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b17fe640-ec37-4d1c-b385-b683927ba29d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:04.632959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b17fe640-ec37-4d1c-b385-b683927ba29d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:04.643131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b17fe640-ec37-4d1c-b385-b683927ba29d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:04.643817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b17fe640-ec37-4d1c-b385-b683927ba29d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:04.645616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b17fe640-ec37-4d1c-b385-b683927ba29d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:04.646321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b17fe640-ec37-4d1c-b385-b683927ba29d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:04.650097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b17fe640-ec37-4d1c-b385-b683927ba29d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:05.019047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b17fe640-ec37-4d1c-b385-b683927ba29d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:05.043332 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b17fe640-ec37-4d1c-b385-b683927ba29d tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1690 microversion: 2.1 time: 0.416734 Oct 27 19:26:05.047774 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3251/6651] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:04 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1690 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:05.194685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-89a43470-f594-4aba-a08b-7b564d35f4ee tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:05.195732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-89a43470-f594-4aba-a08b-7b564d35f4ee tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:05.209906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a43470-f594-4aba-a08b-7b564d35f4ee tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:05.211106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a43470-f594-4aba-a08b-7b564d35f4ee tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:05.211747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a43470-f594-4aba-a08b-7b564d35f4ee tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:05.212674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a43470-f594-4aba-a08b-7b564d35f4ee tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:05.217283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a43470-f594-4aba-a08b-7b564d35f4ee tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:05.218119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89a43470-f594-4aba-a08b-7b564d35f4ee tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:05.241096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-13670c52-abad-4d7f-bc28-c37acec447e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:05.253503 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13670c52-abad-4d7f-bc28-c37acec447e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1342 microversion: 2.1 time: 0.840442 Oct 27 19:26:05.254546 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3401/6652] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:04 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1342 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:05.447431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-89a43470-f594-4aba-a08b-7b564d35f4ee tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:05.463009 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-89a43470-f594-4aba-a08b-7b564d35f4ee tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 200 len: 1484 microversion: 2.1 time: 0.272635 Oct 27 19:26:05.463724 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3252/6653] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:05 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 1484 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:05.538197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-726533d6-7b5f-4925-8f4b-b750cbda2018 req-4c359b45-1edb-4de0-99ed-873634a54ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc686a1d-7d40-4c55-b36b-9bd142d4b1b0", "name": "network-vif-deleted", "tag": "35db2154-741c-4646-a9ae-3a54761c2184"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:05.564375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-726533d6-7b5f-4925-8f4b-b750cbda2018 req-4c359b45-1edb-4de0-99ed-873634a54ded service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:05.564890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-726533d6-7b5f-4925-8f4b-b750cbda2018 req-4c359b45-1edb-4de0-99ed-873634a54ded service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:05.565324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-726533d6-7b5f-4925-8f4b-b750cbda2018 req-4c359b45-1edb-4de0-99ed-873634a54ded service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:05.606745 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-726533d6-7b5f-4925-8f4b-b750cbda2018 req-4c359b45-1edb-4de0-99ed-873634a54ded service nova] Creating event network-vif-deleted:35db2154-741c-4646-a9ae-3a54761c2184 for instance cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 on n-h2-860687-3 Oct 27 19:26:05.635783 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-726533d6-7b5f-4925-8f4b-b750cbda2018 req-4c359b45-1edb-4de0-99ed-873634a54ded service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101845 Oct 27 19:26:05.636425 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3402/6654] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:26:06.085829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a3336987-cb0b-40fb-a7c0-9106e250ccef tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:06.088331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a3336987-cb0b-40fb-a7c0-9106e250ccef tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:06.110912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3336987-cb0b-40fb-a7c0-9106e250ccef tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:06.113983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3336987-cb0b-40fb-a7c0-9106e250ccef tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:06.115628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3336987-cb0b-40fb-a7c0-9106e250ccef tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:06.118620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3336987-cb0b-40fb-a7c0-9106e250ccef tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:06.120595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3336987-cb0b-40fb-a7c0-9106e250ccef tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:06.124218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3336987-cb0b-40fb-a7c0-9106e250ccef tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:06.284237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1bb3dc3a-aae4-429e-88ce-e8d0a5d5c44b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:06.285156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1bb3dc3a-aae4-429e-88ce-e8d0a5d5c44b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:06.298820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bb3dc3a-aae4-429e-88ce-e8d0a5d5c44b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:06.301674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bb3dc3a-aae4-429e-88ce-e8d0a5d5c44b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:06.302772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bb3dc3a-aae4-429e-88ce-e8d0a5d5c44b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:06.303807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bb3dc3a-aae4-429e-88ce-e8d0a5d5c44b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:06.308802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bb3dc3a-aae4-429e-88ce-e8d0a5d5c44b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:06.309536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1bb3dc3a-aae4-429e-88ce-e8d0a5d5c44b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:06.517734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a3336987-cb0b-40fb-a7c0-9106e250ccef tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:06.529931 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a3336987-cb0b-40fb-a7c0-9106e250ccef tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1690 microversion: 2.1 time: 0.461118 Oct 27 19:26:06.532759 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3253/6655] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:06 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1690 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:06.538826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7afe4b62-4b20-4a9a-b4d9-c935a143bcec tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:06.539672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7afe4b62-4b20-4a9a-b4d9-c935a143bcec tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: cc686a1d-7d40-4c55-b36b-9bd142d4b1b0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:06.551708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7afe4b62-4b20-4a9a-b4d9-c935a143bcec tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:06.552507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7afe4b62-4b20-4a9a-b4d9-c935a143bcec tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:06.553406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7afe4b62-4b20-4a9a-b4d9-c935a143bcec tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:06.554597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7afe4b62-4b20-4a9a-b4d9-c935a143bcec tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:06.555500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7afe4b62-4b20-4a9a-b4d9-c935a143bcec tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:06.569161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7afe4b62-4b20-4a9a-b4d9-c935a143bcec tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:06.613255 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-7afe4b62-4b20-4a9a-b4d9-c935a143bcec tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] HTTP exception thrown: Instance cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 could not be found. Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7afe4b62-4b20-4a9a-b4d9-c935a143bcec tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Request method failure captured: Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 HTTP/1.1 Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtq_8gJvgEp4VLwuycEe_R5NX8I-OfFiLuieg3_64JL-AobuIrLvvQBeXRLGz2hDfifq0mADDOlljKPHvmvYayORz_0VgKK9HTckdF7Jtfg-5uA-6RSz8Wm-jjvYuQGM3ONqY2zVl7SVDvXXvKz58liFZH9D8ZRrakUfPnT1BJZh27Q Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: e2ecef554af04d36a8c61e2b30d8f9e8 Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestNetworkBasicOps-2070918579 Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ecef554af04d36a8c61e2b30d8f9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ecef554af04d36a8c61e2b30d8f9e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ecef554af04d36a8c61e2b30d8f9e8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ecef554af04d36a8c61e2b30d8f9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestNetworkBasicOps-2070918579 Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: e2ecef554af04d36a8c61e2b30d8f9e8 Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestNetworkBasicOps-2070918579 Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestNetworkBasicOps-2070918579-project Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c460e1808e4a4788b1fc3984eb4ab43b Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestNetworkBasicOps-2070918579-project Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 could not be found. Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'cc686a1d-7d40-4c55-b36b-9bd142d4b1b0'} Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 could not be found. Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 could not be found. Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:06.615305 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:06.620616 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:06.620616 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:06.620616 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:06.620616 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:26:06.620616 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:26:06.620616 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 could not be found. Oct 27 19:26:06.620616 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:06.623972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7afe4b62-4b20-4a9a-b4d9-c935a143bcec tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Returning 404 to user: Instance cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:26:06.629948 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7afe4b62-4b20-4a9a-b4d9-c935a143bcec tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0" status: 404 len: 111 microversion: 2.1 time: 0.095569 Oct 27 19:26:06.630891 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3254/6656] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:06 2022] GET /compute/v2.1/servers/cc686a1d-7d40-4c55-b36b-9bd142d4b1b0 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:26:06.708651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1bb3dc3a-aae4-429e-88ce-e8d0a5d5c44b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:06.721475 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1bb3dc3a-aae4-429e-88ce-e8d0a5d5c44b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1376 microversion: 2.1 time: 0.444684 Oct 27 19:26:06.722360 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3403/6657] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:06 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1376 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:07.220322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ca9e080a-0f81-4f1e-b8d6-798df4a0ebad tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '.version_select at 0x7fc86ac5dc10>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:07.260871 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ca9e080a-0f81-4f1e-b8d6-798df4a0ebad tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-495340004" status: 202 len: 0 microversion: 2.1 time: 0.047091 Oct 27 19:26:07.266704 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3255/6658] 10.222.0.42 () {58 vars in 1254 bytes} [Thu Oct 27 19:26:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-495340004 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:26:07.557372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d827d667-2c30-484e-a4c7-7b7428c738f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:07.558261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d827d667-2c30-484e-a4c7-7b7428c738f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:07.573919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d827d667-2c30-484e-a4c7-7b7428c738f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:07.574668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d827d667-2c30-484e-a4c7-7b7428c738f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:07.576217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d827d667-2c30-484e-a4c7-7b7428c738f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:07.577317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d827d667-2c30-484e-a4c7-7b7428c738f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:07.583238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d827d667-2c30-484e-a4c7-7b7428c738f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:07.584139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d827d667-2c30-484e-a4c7-7b7428c738f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:07.752343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-210c2556-82bc-4a24-800b-7d48d96e651f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:07.753843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-210c2556-82bc-4a24-800b-7d48d96e651f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:07.768651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-210c2556-82bc-4a24-800b-7d48d96e651f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:07.771843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-210c2556-82bc-4a24-800b-7d48d96e651f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:07.772798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-210c2556-82bc-4a24-800b-7d48d96e651f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:07.773638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-210c2556-82bc-4a24-800b-7d48d96e651f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:07.775153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-210c2556-82bc-4a24-800b-7d48d96e651f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:07.775923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-210c2556-82bc-4a24-800b-7d48d96e651f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:08.016300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d827d667-2c30-484e-a4c7-7b7428c738f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:08.033213 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d827d667-2c30-484e-a4c7-7b7428c738f7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1690 microversion: 2.1 time: 0.479842 Oct 27 19:26:08.049601 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3404/6659] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:07 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1690 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:08.230833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-210c2556-82bc-4a24-800b-7d48d96e651f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:08.242713 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-210c2556-82bc-4a24-800b-7d48d96e651f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1376 microversion: 2.1 time: 0.495671 Oct 27 19:26:08.249036 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3256/6660] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:07 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1376 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:09.058473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f47142e8-32da-48e0-8c35-a719c16c882c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:09.059358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f47142e8-32da-48e0-8c35-a719c16c882c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:09.074804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f47142e8-32da-48e0-8c35-a719c16c882c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:09.075314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f47142e8-32da-48e0-8c35-a719c16c882c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:09.077983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f47142e8-32da-48e0-8c35-a719c16c882c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:09.079182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f47142e8-32da-48e0-8c35-a719c16c882c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:09.080980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f47142e8-32da-48e0-8c35-a719c16c882c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:09.081908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f47142e8-32da-48e0-8c35-a719c16c882c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:09.276628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-522a5dc6-2cac-452a-87ac-f4d96641febf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:09.278155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-522a5dc6-2cac-452a-87ac-f4d96641febf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:09.289110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-522a5dc6-2cac-452a-87ac-f4d96641febf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:09.290297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-522a5dc6-2cac-452a-87ac-f4d96641febf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:09.290992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-522a5dc6-2cac-452a-87ac-f4d96641febf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:09.292606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-522a5dc6-2cac-452a-87ac-f4d96641febf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:09.293383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-522a5dc6-2cac-452a-87ac-f4d96641febf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:09.294009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-522a5dc6-2cac-452a-87ac-f4d96641febf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:09.580997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-522a5dc6-2cac-452a-87ac-f4d96641febf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:09.599505 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-522a5dc6-2cac-452a-87ac-f4d96641febf tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1376 microversion: 2.1 time: 0.327535 Oct 27 19:26:09.604386 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3257/6661] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:09 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1376 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:09.826640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f47142e8-32da-48e0-8c35-a719c16c882c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:09.839188 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f47142e8-32da-48e0-8c35-a719c16c882c tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1690 microversion: 2.1 time: 0.785176 Oct 27 19:26:09.840401 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3405/6662] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:09 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1690 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:10.629399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-564af6dd-1408-4720-a85d-8d35d6a9bf15 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:10.630756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-564af6dd-1408-4720-a85d-8d35d6a9bf15 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:10.645446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-564af6dd-1408-4720-a85d-8d35d6a9bf15 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:10.647329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-564af6dd-1408-4720-a85d-8d35d6a9bf15 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:10.649272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-564af6dd-1408-4720-a85d-8d35d6a9bf15 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:10.650333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-564af6dd-1408-4720-a85d-8d35d6a9bf15 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:10.651084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-564af6dd-1408-4720-a85d-8d35d6a9bf15 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:10.655071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-564af6dd-1408-4720-a85d-8d35d6a9bf15 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:10.865958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d0f476ef-0198-429d-8bb3-3fe620b53566 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:10.867767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d0f476ef-0198-429d-8bb3-3fe620b53566 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:10.912355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d0f476ef-0198-429d-8bb3-3fe620b53566 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:10.913242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d0f476ef-0198-429d-8bb3-3fe620b53566 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:10.915260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d0f476ef-0198-429d-8bb3-3fe620b53566 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:10.917992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d0f476ef-0198-429d-8bb3-3fe620b53566 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:10.923212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d0f476ef-0198-429d-8bb3-3fe620b53566 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:10.925450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d0f476ef-0198-429d-8bb3-3fe620b53566 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:10.988271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-564af6dd-1408-4720-a85d-8d35d6a9bf15 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:10.998558 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-564af6dd-1408-4720-a85d-8d35d6a9bf15 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1376 microversion: 2.1 time: 0.373383 Oct 27 19:26:11.016047 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3258/6663] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:10 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1376 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:11.448554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d0f476ef-0198-429d-8bb3-3fe620b53566 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:11.462249 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d0f476ef-0198-429d-8bb3-3fe620b53566 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1690 microversion: 2.1 time: 0.602517 Oct 27 19:26:11.466973 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3406/6664] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:10 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1690 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:12.034368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-98b5765e-ce80-423b-9fe1-1c116a1c3e8d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:12.035793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-98b5765e-ce80-423b-9fe1-1c116a1c3e8d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:12.065184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98b5765e-ce80-423b-9fe1-1c116a1c3e8d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:12.069000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98b5765e-ce80-423b-9fe1-1c116a1c3e8d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:12.071978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98b5765e-ce80-423b-9fe1-1c116a1c3e8d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:12.074703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98b5765e-ce80-423b-9fe1-1c116a1c3e8d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:12.077322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98b5765e-ce80-423b-9fe1-1c116a1c3e8d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:12.081748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98b5765e-ce80-423b-9fe1-1c116a1c3e8d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:12.350064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13c8cd07-2dd7-4cb9-859c-dda3b951f7c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:12.350671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-13c8cd07-2dd7-4cb9-859c-dda3b951f7c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:12.372815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13c8cd07-2dd7-4cb9-859c-dda3b951f7c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:12.373345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13c8cd07-2dd7-4cb9-859c-dda3b951f7c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:12.373785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13c8cd07-2dd7-4cb9-859c-dda3b951f7c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:12.375356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13c8cd07-2dd7-4cb9-859c-dda3b951f7c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:12.375822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13c8cd07-2dd7-4cb9-859c-dda3b951f7c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:12.376317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13c8cd07-2dd7-4cb9-859c-dda3b951f7c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:12.435968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-13c8cd07-2dd7-4cb9-859c-dda3b951f7c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:26:12.554958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-98b5765e-ce80-423b-9fe1-1c116a1c3e8d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:12.576929 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-98b5765e-ce80-423b-9fe1-1c116a1c3e8d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1376 microversion: 2.1 time: 0.548918 Oct 27 19:26:12.578890 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3259/6665] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:12 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1376 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:12.595079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-fc29f9fa-e42f-4863-a961-068073aec957 req-9cea1f45-c261-4a62-942d-c14bdf0d252c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795dc456-a993-489c-918a-8f29bb1403b9", "tag": "1f160966-2e84-4766-bc8a-e388539da466"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:12.605074 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13c8cd07-2dd7-4cb9-859c-dda3b951f7c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "DELETE /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 204 len: 0 microversion: 2.1 time: 0.266502 Oct 27 19:26:12.606488 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3407/6666] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:26:12 2022] DELETE /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:26:12.615034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-65f7a36d-2021-446f-89aa-496a62e1fa07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:12.616352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-65f7a36d-2021-446f-89aa-496a62e1fa07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:12.620247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fc29f9fa-e42f-4863-a961-068073aec957 req-9cea1f45-c261-4a62-942d-c14bdf0d252c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:12.620576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fc29f9fa-e42f-4863-a961-068073aec957 req-9cea1f45-c261-4a62-942d-c14bdf0d252c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:12.621073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fc29f9fa-e42f-4863-a961-068073aec957 req-9cea1f45-c261-4a62-942d-c14bdf0d252c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:12.626005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65f7a36d-2021-446f-89aa-496a62e1fa07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:12.626765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65f7a36d-2021-446f-89aa-496a62e1fa07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:12.629276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65f7a36d-2021-446f-89aa-496a62e1fa07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:12.630302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65f7a36d-2021-446f-89aa-496a62e1fa07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:12.634574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65f7a36d-2021-446f-89aa-496a62e1fa07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:12.635320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65f7a36d-2021-446f-89aa-496a62e1fa07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:12.648572 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-fc29f9fa-e42f-4863-a961-068073aec957 req-9cea1f45-c261-4a62-942d-c14bdf0d252c service nova] Creating event network-changed:1f160966-2e84-4766-bc8a-e388539da466 for instance 795dc456-a993-489c-918a-8f29bb1403b9 on n-h1-860687-3 Oct 27 19:26:12.664068 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-fc29f9fa-e42f-4863-a961-068073aec957 req-9cea1f45-c261-4a62-942d-c14bdf0d252c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082407 Oct 27 19:26:12.664935 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3260/6667] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:26:12.672904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-33ffe1c5-125b-4e61-8385-ebc0b4df3fcd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:12.673638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-33ffe1c5-125b-4e61-8385-ebc0b4df3fcd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:12.680968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33ffe1c5-125b-4e61-8385-ebc0b4df3fcd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:12.681745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33ffe1c5-125b-4e61-8385-ebc0b4df3fcd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:12.682374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33ffe1c5-125b-4e61-8385-ebc0b4df3fcd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:12.683314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33ffe1c5-125b-4e61-8385-ebc0b4df3fcd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:12.684673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33ffe1c5-125b-4e61-8385-ebc0b4df3fcd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:12.685305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-33ffe1c5-125b-4e61-8385-ebc0b4df3fcd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:12.714675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:26:12.904814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-65f7a36d-2021-446f-89aa-496a62e1fa07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:12.915101 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-65f7a36d-2021-446f-89aa-496a62e1fa07 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1690 microversion: 2.1 time: 0.307077 Oct 27 19:26:12.915705 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3408/6668] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:12 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1690 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:13.302322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-33ffe1c5-125b-4e61-8385-ebc0b4df3fcd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:13.315627 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-33ffe1c5-125b-4e61-8385-ebc0b4df3fcd tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1668 microversion: 2.1 time: 0.649267 Oct 27 19:26:13.316294 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3261/6669] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:12 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1668 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:13.603132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9c571c3-cfb8-404c-b274-f0ef70cf13b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:13.605831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c9c571c3-cfb8-404c-b274-f0ef70cf13b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:13.614629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:26:13.635145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c571c3-cfb8-404c-b274-f0ef70cf13b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:13.637903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c571c3-cfb8-404c-b274-f0ef70cf13b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:13.638779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c571c3-cfb8-404c-b274-f0ef70cf13b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:13.640766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c571c3-cfb8-404c-b274-f0ef70cf13b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:13.641697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c571c3-cfb8-404c-b274-f0ef70cf13b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:13.642558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9c571c3-cfb8-404c-b274-f0ef70cf13b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:13.926960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f40f797d-b9d6-4ba8-aa0e-b76779379afc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:13.929604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f40f797d-b9d6-4ba8-aa0e-b76779379afc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:13.942515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f40f797d-b9d6-4ba8-aa0e-b76779379afc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:13.944995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f40f797d-b9d6-4ba8-aa0e-b76779379afc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:13.946057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f40f797d-b9d6-4ba8-aa0e-b76779379afc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:13.946886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f40f797d-b9d6-4ba8-aa0e-b76779379afc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:13.947580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f40f797d-b9d6-4ba8-aa0e-b76779379afc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:13.948899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f40f797d-b9d6-4ba8-aa0e-b76779379afc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:14.028429 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f40f797d-b9d6-4ba8-aa0e-b76779379afc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105530 Oct 27 19:26:14.053419 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3262/6670] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:26:13 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 19:26:14.067323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7bfaef3-c541-4a67-891b-4c57533eaa19 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:14.069235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a7bfaef3-c541-4a67-891b-4c57533eaa19 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:14.097725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7bfaef3-c541-4a67-891b-4c57533eaa19 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:14.098242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7bfaef3-c541-4a67-891b-4c57533eaa19 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:14.098735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7bfaef3-c541-4a67-891b-4c57533eaa19 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:14.105767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7bfaef3-c541-4a67-891b-4c57533eaa19 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:14.108458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7bfaef3-c541-4a67-891b-4c57533eaa19 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:14.109699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7bfaef3-c541-4a67-891b-4c57533eaa19 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:14.117791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c9c571c3-cfb8-404c-b274-f0ef70cf13b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:14.130172 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c9c571c3-cfb8-404c-b274-f0ef70cf13b2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1376 microversion: 2.1 time: 0.532553 Oct 27 19:26:14.132068 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3409/6671] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:13 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1376 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:14.256804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2e934aa6-2e3d-4020-95f8-90f480cbcea7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:14.259716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2e934aa6-2e3d-4020-95f8-90f480cbcea7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:14.271221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e934aa6-2e3d-4020-95f8-90f480cbcea7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:14.272000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e934aa6-2e3d-4020-95f8-90f480cbcea7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:14.272671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e934aa6-2e3d-4020-95f8-90f480cbcea7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:14.273653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e934aa6-2e3d-4020-95f8-90f480cbcea7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:14.274827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e934aa6-2e3d-4020-95f8-90f480cbcea7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:14.275613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e934aa6-2e3d-4020-95f8-90f480cbcea7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:14.317057 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2e934aa6-2e3d-4020-95f8-90f480cbcea7 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064332 Oct 27 19:26:14.324039 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3410/6672] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:26:14 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 19:26:14.355200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d29f024c-1390-4192-9f3d-edf53bcd068f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:14.356937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d29f024c-1390-4192-9f3d-edf53bcd068f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:14.373250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d29f024c-1390-4192-9f3d-edf53bcd068f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:14.379170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d29f024c-1390-4192-9f3d-edf53bcd068f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:14.380029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d29f024c-1390-4192-9f3d-edf53bcd068f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:14.381004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d29f024c-1390-4192-9f3d-edf53bcd068f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:14.381661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d29f024c-1390-4192-9f3d-edf53bcd068f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:14.382273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d29f024c-1390-4192-9f3d-edf53bcd068f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:14.912719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a7bfaef3-c541-4a67-891b-4c57533eaa19 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:14.922671 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7bfaef3-c541-4a67-891b-4c57533eaa19 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1690 microversion: 2.1 time: 0.866940 Oct 27 19:26:14.923354 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3263/6673] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:14 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1690 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:14.928241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ac3ca2ad-b4ee-4680-9e18-cbdf83e1ee39 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:14.928923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ac3ca2ad-b4ee-4680-9e18-cbdf83e1ee39 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:14.939724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:26:14.944894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac3ca2ad-b4ee-4680-9e18-cbdf83e1ee39 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:14.945781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac3ca2ad-b4ee-4680-9e18-cbdf83e1ee39 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:14.946378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac3ca2ad-b4ee-4680-9e18-cbdf83e1ee39 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:14.947408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac3ca2ad-b4ee-4680-9e18-cbdf83e1ee39 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:14.948181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac3ca2ad-b4ee-4680-9e18-cbdf83e1ee39 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:14.948864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac3ca2ad-b4ee-4680-9e18-cbdf83e1ee39 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:14.985518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ac3ca2ad-b4ee-4680-9e18-cbdf83e1ee39 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:26:15.037850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d29f024c-1390-4192-9f3d-edf53bcd068f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:15.051164 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d29f024c-1390-4192-9f3d-edf53bcd068f tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1668 microversion: 2.1 time: 0.711932 Oct 27 19:26:15.052446 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3411/6674] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:14 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1668 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:15.087779 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ac3ca2ad-b4ee-4680-9e18-cbdf83e1ee39 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 204 len: 0 microversion: 2.1 time: 0.162741 Oct 27 19:26:15.088691 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3264/6675] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:26:14 2022] DELETE /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:26:15.097830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8040985e-3c2d-4ec0-9307-835b7a97fccd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:15.098647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8040985e-3c2d-4ec0-9307-835b7a97fccd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:15.107491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8040985e-3c2d-4ec0-9307-835b7a97fccd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:15.111311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8040985e-3c2d-4ec0-9307-835b7a97fccd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:15.112093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8040985e-3c2d-4ec0-9307-835b7a97fccd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:15.113267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8040985e-3c2d-4ec0-9307-835b7a97fccd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:15.113974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8040985e-3c2d-4ec0-9307-835b7a97fccd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:15.114716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8040985e-3c2d-4ec0-9307-835b7a97fccd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:15.162594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-469f8957-cb6f-414a-8384-cf65e26c8211 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:15.163341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-469f8957-cb6f-414a-8384-cf65e26c8211 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:15.179039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-469f8957-cb6f-414a-8384-cf65e26c8211 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:15.179558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-469f8957-cb6f-414a-8384-cf65e26c8211 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:15.180014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-469f8957-cb6f-414a-8384-cf65e26c8211 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:15.180970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-469f8957-cb6f-414a-8384-cf65e26c8211 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:15.181625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-469f8957-cb6f-414a-8384-cf65e26c8211 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:15.182414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-469f8957-cb6f-414a-8384-cf65e26c8211 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:15.459666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8040985e-3c2d-4ec0-9307-835b7a97fccd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:15.475330 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8040985e-3c2d-4ec0-9307-835b7a97fccd tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1674 microversion: 2.1 time: 0.382463 Oct 27 19:26:15.477154 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3412/6676] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:15 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1674 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:15.481871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-f6f3ecde-821d-48bf-bb8f-7c5676af717d req-18d4971f-04ec-42bb-988e-baa837704188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795dc456-a993-489c-918a-8f29bb1403b9", "name": "network-vif-deleted", "tag": "1f160966-2e84-4766-bc8a-e388539da466"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:15.493876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f6f3ecde-821d-48bf-bb8f-7c5676af717d req-18d4971f-04ec-42bb-988e-baa837704188 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:15.494705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f6f3ecde-821d-48bf-bb8f-7c5676af717d req-18d4971f-04ec-42bb-988e-baa837704188 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:15.495363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f6f3ecde-821d-48bf-bb8f-7c5676af717d req-18d4971f-04ec-42bb-988e-baa837704188 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:15.526838 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-f6f3ecde-821d-48bf-bb8f-7c5676af717d req-18d4971f-04ec-42bb-988e-baa837704188 service nova] Creating event network-vif-deleted:1f160966-2e84-4766-bc8a-e388539da466 for instance 795dc456-a993-489c-918a-8f29bb1403b9 on n-h1-860687-3 Oct 27 19:26:15.544066 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-f6f3ecde-821d-48bf-bb8f-7c5676af717d req-18d4971f-04ec-42bb-988e-baa837704188 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065638 Oct 27 19:26:15.548291 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3413/6677] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:26:15.651967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-469f8957-cb6f-414a-8384-cf65e26c8211 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:15.671637 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-469f8957-cb6f-414a-8384-cf65e26c8211 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1376 microversion: 2.1 time: 0.515637 Oct 27 19:26:15.672449 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3265/6678] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:15 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1376 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:15.951696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ece6148e-c0a0-4308-b107-f492f27021e7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:15.963808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ece6148e-c0a0-4308-b107-f492f27021e7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:15.978528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ece6148e-c0a0-4308-b107-f492f27021e7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:15.979674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ece6148e-c0a0-4308-b107-f492f27021e7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:15.980341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ece6148e-c0a0-4308-b107-f492f27021e7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:15.982526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ece6148e-c0a0-4308-b107-f492f27021e7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:15.982526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ece6148e-c0a0-4308-b107-f492f27021e7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:15.982768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ece6148e-c0a0-4308-b107-f492f27021e7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:16.077283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb7a79c0-c94b-4982-b285-1c20841187fe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:16.078505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fb7a79c0-c94b-4982-b285-1c20841187fe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:16.108148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7a79c0-c94b-4982-b285-1c20841187fe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:16.112353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7a79c0-c94b-4982-b285-1c20841187fe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:16.116761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7a79c0-c94b-4982-b285-1c20841187fe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:16.117923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7a79c0-c94b-4982-b285-1c20841187fe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:16.118681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7a79c0-c94b-4982-b285-1c20841187fe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:16.119518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7a79c0-c94b-4982-b285-1c20841187fe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:16.237964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7a79c0-c94b-4982-b285-1c20841187fe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:16.240361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7a79c0-c94b-4982-b285-1c20841187fe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:16.241422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb7a79c0-c94b-4982-b285-1c20841187fe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:16.245186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-fb7a79c0-c94b-4982-b285-1c20841187fe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lazy-loading 'fault' on Instance uuid 795dc456-a993-489c-918a-8f29bb1403b9 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:26:16.358254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fb7a79c0-c94b-4982-b285-1c20841187fe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:16.373976 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fb7a79c0-c94b-4982-b285-1c20841187fe tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 200 len: 1488 microversion: 2.1 time: 0.301130 Oct 27 19:26:16.374968 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3266/6679] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:16 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 1488 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:16.381150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ece6148e-c0a0-4308-b107-f492f27021e7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:16.397414 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ece6148e-c0a0-4308-b107-f492f27021e7 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1690 microversion: 2.1 time: 0.451478 Oct 27 19:26:16.398761 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3414/6680] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:15 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1690 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:16.500587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7a46b7bb-53e6-4683-9ad5-5f7553e9fedc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:16.501406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7a46b7bb-53e6-4683-9ad5-5f7553e9fedc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:16.513122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a46b7bb-53e6-4683-9ad5-5f7553e9fedc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:16.513900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a46b7bb-53e6-4683-9ad5-5f7553e9fedc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:16.516141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a46b7bb-53e6-4683-9ad5-5f7553e9fedc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:16.517882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a46b7bb-53e6-4683-9ad5-5f7553e9fedc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:16.519192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a46b7bb-53e6-4683-9ad5-5f7553e9fedc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:16.519885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a46b7bb-53e6-4683-9ad5-5f7553e9fedc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:16.698544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-22405e80-0e5b-4022-a0ea-8055975c49c8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:16.699552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-22405e80-0e5b-4022-a0ea-8055975c49c8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:16.707172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22405e80-0e5b-4022-a0ea-8055975c49c8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:16.709200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22405e80-0e5b-4022-a0ea-8055975c49c8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:16.710105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22405e80-0e5b-4022-a0ea-8055975c49c8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:16.711643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22405e80-0e5b-4022-a0ea-8055975c49c8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:16.712433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22405e80-0e5b-4022-a0ea-8055975c49c8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:16.713191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-22405e80-0e5b-4022-a0ea-8055975c49c8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:16.813964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7a46b7bb-53e6-4683-9ad5-5f7553e9fedc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:16.829816 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7a46b7bb-53e6-4683-9ad5-5f7553e9fedc tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1674 microversion: 2.1 time: 0.333623 Oct 27 19:26:16.831639 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3267/6681] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:16 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1674 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:16.923217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-22405e80-0e5b-4022-a0ea-8055975c49c8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:16.932937 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-22405e80-0e5b-4022-a0ea-8055975c49c8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1376 microversion: 2.1 time: 0.239213 Oct 27 19:26:16.934075 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3415/6682] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:16 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1376 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:17.407556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28b953c9-3b3a-47f5-9130-8879f0700c23 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:17.409054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-28b953c9-3b3a-47f5-9130-8879f0700c23 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 795dc456-a993-489c-918a-8f29bb1403b9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:17.418042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28b953c9-3b3a-47f5-9130-8879f0700c23 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:17.419575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28b953c9-3b3a-47f5-9130-8879f0700c23 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:17.420137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28b953c9-3b3a-47f5-9130-8879f0700c23 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:17.420960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28b953c9-3b3a-47f5-9130-8879f0700c23 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:17.423180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28b953c9-3b3a-47f5-9130-8879f0700c23 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:17.423762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28b953c9-3b3a-47f5-9130-8879f0700c23 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:17.427766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1d718c04-e3a2-4d32-86c2-071044721a3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:17.430371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1d718c04-e3a2-4d32-86c2-071044721a3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:17.441738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d718c04-e3a2-4d32-86c2-071044721a3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:17.442308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d718c04-e3a2-4d32-86c2-071044721a3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:17.443324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d718c04-e3a2-4d32-86c2-071044721a3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:17.444257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d718c04-e3a2-4d32-86c2-071044721a3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:17.444885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d718c04-e3a2-4d32-86c2-071044721a3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:17.445530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d718c04-e3a2-4d32-86c2-071044721a3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:17.451572 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-28b953c9-3b3a-47f5-9130-8879f0700c23 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] HTTP exception thrown: Instance 795dc456-a993-489c-918a-8f29bb1403b9 could not be found. Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28b953c9-3b3a-47f5-9130-8879f0700c23 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Request method failure captured: Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 HTTP/1.1 Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtq_8gJvgEp4VLwuycEe_R5NX8I-OfFiLuieg3_64JL-AobuIrLvvQBeXRLGz2hDfifq0mADDOlljKPHvmvYayORz_0VgKK9HTckdF7Jtfg-5uA-6RSz8Wm-jjvYuQGM3ONqY2zVl7SVDvXXvKz58liFZH9D8ZRrakUfPnT1BJZh27Q Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: e2ecef554af04d36a8c61e2b30d8f9e8 Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestNetworkBasicOps-2070918579 Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ecef554af04d36a8c61e2b30d8f9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ecef554af04d36a8c61e2b30d8f9e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ecef554af04d36a8c61e2b30d8f9e8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ecef554af04d36a8c61e2b30d8f9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestNetworkBasicOps-2070918579 Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: e2ecef554af04d36a8c61e2b30d8f9e8 Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestNetworkBasicOps-2070918579 Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestNetworkBasicOps-2070918579-project Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c460e1808e4a4788b1fc3984eb4ab43b Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestNetworkBasicOps-2070918579-project Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 795dc456-a993-489c-918a-8f29bb1403b9 could not be found. Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '795dc456-a993-489c-918a-8f29bb1403b9'} Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795dc456-a993-489c-918a-8f29bb1403b9 could not be found. Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795dc456-a993-489c-918a-8f29bb1403b9 could not be found. Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:17.454545 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:17.460086 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:17.460086 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:17.460086 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:17.460086 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:26:17.460086 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:26:17.460086 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795dc456-a993-489c-918a-8f29bb1403b9 could not be found. Oct 27 19:26:17.460086 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:17.460086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28b953c9-3b3a-47f5-9130-8879f0700c23 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Returning 404 to user: Instance 795dc456-a993-489c-918a-8f29bb1403b9 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:26:17.461593 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-28b953c9-3b3a-47f5-9130-8879f0700c23 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9" status: 404 len: 111 microversion: 2.1 time: 0.062803 Oct 27 19:26:17.462569 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3268/6683] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:17 2022] GET /compute/v2.1/servers/795dc456-a993-489c-918a-8f29bb1403b9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:26:17.775028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e52584e0-ccc6-4d78-b0bc-60f968985a70 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '.version_select at 0x7fc86ac5d040>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:17.855634 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e52584e0-ccc6-4d78-b0bc-60f968985a70 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-987145061" status: 202 len: 0 microversion: 2.1 time: 0.106522 Oct 27 19:26:17.864340 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3269/6684] 10.222.0.42 () {58 vars in 1254 bytes} [Thu Oct 27 19:26:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-987145061 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:26:17.880315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-48c14ff4-f100-4395-89c8-74556b3a9c01 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:17.882292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-48c14ff4-f100-4395-89c8-74556b3a9c01 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:17.896693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48c14ff4-f100-4395-89c8-74556b3a9c01 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:17.898221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48c14ff4-f100-4395-89c8-74556b3a9c01 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:17.899062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48c14ff4-f100-4395-89c8-74556b3a9c01 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:17.900717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48c14ff4-f100-4395-89c8-74556b3a9c01 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:17.901507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48c14ff4-f100-4395-89c8-74556b3a9c01 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:17.904386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48c14ff4-f100-4395-89c8-74556b3a9c01 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:18.063711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1d718c04-e3a2-4d32-86c2-071044721a3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:18.076865 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1d718c04-e3a2-4d32-86c2-071044721a3b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1690 microversion: 2.1 time: 0.653237 Oct 27 19:26:18.077619 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3416/6685] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:17 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1690 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:18.089052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-049210db-77bc-42e1-8802-97c06f532495 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:18.099427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-049210db-77bc-42e1-8802-97c06f532495 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:18.108070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-049210db-77bc-42e1-8802-97c06f532495 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:18.116984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-049210db-77bc-42e1-8802-97c06f532495 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:18.117810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-049210db-77bc-42e1-8802-97c06f532495 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:18.118931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-049210db-77bc-42e1-8802-97c06f532495 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:18.119584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-049210db-77bc-42e1-8802-97c06f532495 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:18.120313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-049210db-77bc-42e1-8802-97c06f532495 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:18.462083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-049210db-77bc-42e1-8802-97c06f532495 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:18.464500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:26:18.473001 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-049210db-77bc-42e1-8802-97c06f532495 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1376 microversion: 2.1 time: 0.394278 Oct 27 19:26:18.482489 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3417/6686] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:18 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1376 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:18.482489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-2f50ab5e-e4ee-4cc5-acad-29d48cc800a3 req-b6be46c9-25ee-4781-bf66-6116925fc4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ca3740-89f4-4fd9-a97a-fa87c89dce3e", "name": "network-vif-plugged", "status": "completed", "tag": "aea52e03-dd66-4be9-aa3e-1d6ec5c74cf7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:18.492542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2f50ab5e-e4ee-4cc5-acad-29d48cc800a3 req-b6be46c9-25ee-4781-bf66-6116925fc4f1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:18.493108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2f50ab5e-e4ee-4cc5-acad-29d48cc800a3 req-b6be46c9-25ee-4781-bf66-6116925fc4f1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:18.493644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2f50ab5e-e4ee-4cc5-acad-29d48cc800a3 req-b6be46c9-25ee-4781-bf66-6116925fc4f1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:18.511996 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-2f50ab5e-e4ee-4cc5-acad-29d48cc800a3 req-b6be46c9-25ee-4781-bf66-6116925fc4f1 service nova] Creating event network-vif-plugged:aea52e03-dd66-4be9-aa3e-1d6ec5c74cf7 for instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e on n-h1-860687-3 Oct 27 19:26:18.517445 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-2f50ab5e-e4ee-4cc5-acad-29d48cc800a3 req-b6be46c9-25ee-4781-bf66-6116925fc4f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041767 Oct 27 19:26:18.518376 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3418/6687] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:26:18.791167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-48c14ff4-f100-4395-89c8-74556b3a9c01 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:18.801127 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-48c14ff4-f100-4395-89c8-74556b3a9c01 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1674 microversion: 2.1 time: 0.934866 Oct 27 19:26:18.816728 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3270/6688] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:17 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1674 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:19.118246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c0843fdc-f0b9-4249-ab8d-8136a55fa62b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:19.119264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c0843fdc-f0b9-4249-ab8d-8136a55fa62b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:19.127039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0843fdc-f0b9-4249-ab8d-8136a55fa62b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:19.127914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0843fdc-f0b9-4249-ab8d-8136a55fa62b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:19.128770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0843fdc-f0b9-4249-ab8d-8136a55fa62b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:19.129796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0843fdc-f0b9-4249-ab8d-8136a55fa62b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:19.134338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0843fdc-f0b9-4249-ab8d-8136a55fa62b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:19.136449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0843fdc-f0b9-4249-ab8d-8136a55fa62b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:19.488456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c0843fdc-f0b9-4249-ab8d-8136a55fa62b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:19.501542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9ec74e3-328d-479f-99ee-671221ffda7f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:19.503040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d9ec74e3-328d-479f-99ee-671221ffda7f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:19.507029 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c0843fdc-f0b9-4249-ab8d-8136a55fa62b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1696 microversion: 2.1 time: 0.397977 Oct 27 19:26:19.508003 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3419/6689] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:19 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1696 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:19.531942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9ec74e3-328d-479f-99ee-671221ffda7f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:19.532929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9ec74e3-328d-479f-99ee-671221ffda7f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:19.533586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9ec74e3-328d-479f-99ee-671221ffda7f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:19.534883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9ec74e3-328d-479f-99ee-671221ffda7f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:19.536232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9ec74e3-328d-479f-99ee-671221ffda7f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:19.536933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9ec74e3-328d-479f-99ee-671221ffda7f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:19.829400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-09d8bf03-08dc-47d3-9e71-2892068df530 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:19.830030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-09d8bf03-08dc-47d3-9e71-2892068df530 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:19.839866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09d8bf03-08dc-47d3-9e71-2892068df530 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:19.845158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09d8bf03-08dc-47d3-9e71-2892068df530 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:19.845709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09d8bf03-08dc-47d3-9e71-2892068df530 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:19.846591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09d8bf03-08dc-47d3-9e71-2892068df530 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:19.847344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09d8bf03-08dc-47d3-9e71-2892068df530 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:19.848017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09d8bf03-08dc-47d3-9e71-2892068df530 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:19.974895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d9ec74e3-328d-479f-99ee-671221ffda7f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:19.995478 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d9ec74e3-328d-479f-99ee-671221ffda7f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1376 microversion: 2.1 time: 0.501513 Oct 27 19:26:19.996670 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3271/6690] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:19 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1376 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:20.533157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c0b42a60-3494-4b3f-ad6f-21cb66dfe80b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:20.533820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c0b42a60-3494-4b3f-ad6f-21cb66dfe80b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:20.545562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0b42a60-3494-4b3f-ad6f-21cb66dfe80b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:20.547001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0b42a60-3494-4b3f-ad6f-21cb66dfe80b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:20.547201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0b42a60-3494-4b3f-ad6f-21cb66dfe80b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:20.547910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0b42a60-3494-4b3f-ad6f-21cb66dfe80b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:20.548397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0b42a60-3494-4b3f-ad6f-21cb66dfe80b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:20.548900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0b42a60-3494-4b3f-ad6f-21cb66dfe80b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:20.688083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-09d8bf03-08dc-47d3-9e71-2892068df530 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac513a8932e4435e88fcd8a023b31c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8019adc2594ba4970d50028c4b79db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:20.701188 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-09d8bf03-08dc-47d3-9e71-2892068df530 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 200 len: 1674 microversion: 2.1 time: 0.876354 Oct 27 19:26:20.704093 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3420/6691] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:19 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 1674 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:20.723006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-1afd63c5-3744-4dcd-a9a3-c8a4b211a7eb req-6fb21240-6ebe-4c07-9008-a49ada18bc8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e2ca13-a2f2-4aac-9018-ef436b487e00", "name": "network-vif-unplugged", "status": "completed", "tag": "f1ad43c0-31ac-45b2-a0ad-01368857adb2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:20.753215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1afd63c5-3744-4dcd-a9a3-c8a4b211a7eb req-6fb21240-6ebe-4c07-9008-a49ada18bc8f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:20.754592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1afd63c5-3744-4dcd-a9a3-c8a4b211a7eb req-6fb21240-6ebe-4c07-9008-a49ada18bc8f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:20.755388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1afd63c5-3744-4dcd-a9a3-c8a4b211a7eb req-6fb21240-6ebe-4c07-9008-a49ada18bc8f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:20.770645 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-1afd63c5-3744-4dcd-a9a3-c8a4b211a7eb req-6fb21240-6ebe-4c07-9008-a49ada18bc8f service nova] Creating event network-vif-unplugged:f1ad43c0-31ac-45b2-a0ad-01368857adb2 for instance 24e2ca13-a2f2-4aac-9018-ef436b487e00 on n-h2-860687-3 Oct 27 19:26:20.778472 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-1afd63c5-3744-4dcd-a9a3-c8a4b211a7eb req-6fb21240-6ebe-4c07-9008-a49ada18bc8f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069931 Oct 27 19:26:20.780386 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3421/6692] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:26:20.841618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6e2b66c1-023d-4c3d-8115-9f16fbd8c8c3 req-64fbf752-ce3b-41ac-a90d-0c99c2a0e55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0719014-1b89-4535-8418-f4fb85165af7", "name": "network-vif-deleted", "tag": "57fddc88-bdab-4281-89b1-edd171f702af"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:20.899111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6e2b66c1-023d-4c3d-8115-9f16fbd8c8c3 req-64fbf752-ce3b-41ac-a90d-0c99c2a0e55a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:20.902581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6e2b66c1-023d-4c3d-8115-9f16fbd8c8c3 req-64fbf752-ce3b-41ac-a90d-0c99c2a0e55a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:20.903517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6e2b66c1-023d-4c3d-8115-9f16fbd8c8c3 req-64fbf752-ce3b-41ac-a90d-0c99c2a0e55a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:20.936050 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6e2b66c1-023d-4c3d-8115-9f16fbd8c8c3 req-64fbf752-ce3b-41ac-a90d-0c99c2a0e55a service nova] Creating event network-vif-deleted:57fddc88-bdab-4281-89b1-edd171f702af for instance c0719014-1b89-4535-8418-f4fb85165af7 on n-h2-860687-3 Oct 27 19:26:20.953924 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6e2b66c1-023d-4c3d-8115-9f16fbd8c8c3 req-64fbf752-ce3b-41ac-a90d-0c99c2a0e55a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113650 Oct 27 19:26:20.956363 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3422/6693] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:26:20.981132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c0b42a60-3494-4b3f-ad6f-21cb66dfe80b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:20.996545 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c0b42a60-3494-4b3f-ad6f-21cb66dfe80b tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1696 microversion: 2.1 time: 0.468068 Oct 27 19:26:21.011019 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3272/6694] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:20 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1696 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:21.027253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-18414d00-31d6-4732-9070-39cba2ce6d8b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:21.028462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-18414d00-31d6-4732-9070-39cba2ce6d8b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:21.037339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18414d00-31d6-4732-9070-39cba2ce6d8b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:21.038360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18414d00-31d6-4732-9070-39cba2ce6d8b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:21.038919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18414d00-31d6-4732-9070-39cba2ce6d8b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:21.040437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18414d00-31d6-4732-9070-39cba2ce6d8b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:21.040997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18414d00-31d6-4732-9070-39cba2ce6d8b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:21.041753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18414d00-31d6-4732-9070-39cba2ce6d8b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:21.368115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-18414d00-31d6-4732-9070-39cba2ce6d8b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:21.378743 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-18414d00-31d6-4732-9070-39cba2ce6d8b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1562 microversion: 2.1 time: 0.363459 Oct 27 19:26:21.396512 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3423/6695] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:21 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1562 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:21.411114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1c10f9b6-84f2-4a52-845e-d2ace2c7480b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:21.411868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1c10f9b6-84f2-4a52-845e-d2ace2c7480b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:21.419771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c10f9b6-84f2-4a52-845e-d2ace2c7480b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:21.420912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c10f9b6-84f2-4a52-845e-d2ace2c7480b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:21.421678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c10f9b6-84f2-4a52-845e-d2ace2c7480b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:21.423021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c10f9b6-84f2-4a52-845e-d2ace2c7480b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:21.423767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c10f9b6-84f2-4a52-845e-d2ace2c7480b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:21.424460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c10f9b6-84f2-4a52-845e-d2ace2c7480b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:21.735041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a66d33dd-7f0d-47c4-a159-a9ea4bb551fe tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:21.736558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a66d33dd-7f0d-47c4-a159-a9ea4bb551fe tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:21.748404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a66d33dd-7f0d-47c4-a159-a9ea4bb551fe tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:21.748903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a66d33dd-7f0d-47c4-a159-a9ea4bb551fe tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:21.752962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a66d33dd-7f0d-47c4-a159-a9ea4bb551fe tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:21.753869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a66d33dd-7f0d-47c4-a159-a9ea4bb551fe tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:21.754370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a66d33dd-7f0d-47c4-a159-a9ea4bb551fe tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:21.754853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a66d33dd-7f0d-47c4-a159-a9ea4bb551fe tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:21.790930 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-a66d33dd-7f0d-47c4-a159-a9ea4bb551fe tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] HTTP exception thrown: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a66d33dd-7f0d-47c4-a159-a9ea4bb551fe tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Request method failure captured: Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 HTTP/1.1 Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtniMUDAuq4e1BIAZFAz2ZDdAogZhtvGa-gKyBzlZpZDATzQQ-s8JCfDVHsGT1FzSuAymzSSTJNTx7A5iyoQKJPO5DyL4Fc5rthR-PlctrSP9W5KgK-13fHiZQToHLxzGno8SauVbxyrlY-Gz-m_X0ADACErB59XqBBhL_4TS9Y6ca8 Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 9e8019adc2594ba4970d50028c4b79db Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9e8019adc2594ba4970d50028c4b79db", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 9e8019adc2594ba4970d50028c4b79db Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeTestJSON-1366128523-project Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ac513a8932e4435e88fcd8a023b31c5c Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeTestJSON-1366128523-project Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'c0719014-1b89-4535-8418-f4fb85165af7'} Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:21.799523 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:21.806895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:21.806895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:21.806895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:21.806895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:26:21.806895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:26:21.806895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:21.806895 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:21.806895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a66d33dd-7f0d-47c4-a159-a9ea4bb551fe tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Returning 404 to user: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:26:21.806895 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a66d33dd-7f0d-47c4-a159-a9ea4bb551fe tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 404 len: 111 microversion: 2.1 time: 0.077627 Oct 27 19:26:21.808116 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3424/6696] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:21 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:26:21.820128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8d458fc0-b65b-4b4c-ad04-dbd6ed822be4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '.version_select at 0x7fc86adbf820>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:21.849417 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8d458fc0-b65b-4b4c-ad04-dbd6ed822be4 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1293199183" status: 202 len: 0 microversion: 2.1 time: 0.036642 Oct 27 19:26:21.850653 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3425/6697] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 19:26:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1293199183 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:26:21.867606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1c10f9b6-84f2-4a52-845e-d2ace2c7480b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:21.907396 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1c10f9b6-84f2-4a52-845e-d2ace2c7480b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1562 microversion: 2.1 time: 0.500460 Oct 27 19:26:21.912332 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3273/6698] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:21 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1562 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:22.025585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce97d3b4-fa7e-4b01-a1b0-6db2691d8653 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:22.027064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ce97d3b4-fa7e-4b01-a1b0-6db2691d8653 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:22.049619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce97d3b4-fa7e-4b01-a1b0-6db2691d8653 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:22.051567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce97d3b4-fa7e-4b01-a1b0-6db2691d8653 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:22.054078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce97d3b4-fa7e-4b01-a1b0-6db2691d8653 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:22.056842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-52fdafca-6dd2-4daa-b6fa-160b9ac35a7a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:22.057868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce97d3b4-fa7e-4b01-a1b0-6db2691d8653 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:22.058119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-52fdafca-6dd2-4daa-b6fa-160b9ac35a7a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:22.058562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce97d3b4-fa7e-4b01-a1b0-6db2691d8653 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:22.059536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce97d3b4-fa7e-4b01-a1b0-6db2691d8653 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:22.070243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52fdafca-6dd2-4daa-b6fa-160b9ac35a7a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:22.071081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52fdafca-6dd2-4daa-b6fa-160b9ac35a7a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:22.075105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52fdafca-6dd2-4daa-b6fa-160b9ac35a7a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:22.076183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52fdafca-6dd2-4daa-b6fa-160b9ac35a7a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:22.076856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52fdafca-6dd2-4daa-b6fa-160b9ac35a7a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:22.077588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52fdafca-6dd2-4daa-b6fa-160b9ac35a7a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:22.135486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-52fdafca-6dd2-4daa-b6fa-160b9ac35a7a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:26:22.365285 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-52fdafca-6dd2-4daa-b6fa-160b9ac35a7a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "DELETE /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 204 len: 0 microversion: 2.1 time: 0.311000 Oct 27 19:26:22.366800 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3274/6699] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:26:22 2022] DELETE /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:26:22.380002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ac0f080f-5f40-4c73-951d-fa0a9c2ce848 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:22.385795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ac0f080f-5f40-4c73-951d-fa0a9c2ce848 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:22.405123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0f080f-5f40-4c73-951d-fa0a9c2ce848 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:22.406918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0f080f-5f40-4c73-951d-fa0a9c2ce848 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:22.407709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0f080f-5f40-4c73-951d-fa0a9c2ce848 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:22.409172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0f080f-5f40-4c73-951d-fa0a9c2ce848 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:22.413130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0f080f-5f40-4c73-951d-fa0a9c2ce848 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:22.414351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0f080f-5f40-4c73-951d-fa0a9c2ce848 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:22.472107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ce97d3b4-fa7e-4b01-a1b0-6db2691d8653 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:22.483228 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce97d3b4-fa7e-4b01-a1b0-6db2691d8653 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1696 microversion: 2.1 time: 0.462116 Oct 27 19:26:22.483970 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3426/6700] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:22 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1696 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:23.137808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ac0f080f-5f40-4c73-951d-fa0a9c2ce848 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:23.161889 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ac0f080f-5f40-4c73-951d-fa0a9c2ce848 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1568 microversion: 2.1 time: 0.790738 Oct 27 19:26:23.168821 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3275/6701] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:22 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1568 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:23.512270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d25aef16-490b-4db9-9d94-bbc160e514c0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:23.512941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d25aef16-490b-4db9-9d94-bbc160e514c0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:23.528586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d25aef16-490b-4db9-9d94-bbc160e514c0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:23.529085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d25aef16-490b-4db9-9d94-bbc160e514c0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:23.535210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d25aef16-490b-4db9-9d94-bbc160e514c0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:23.537860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d25aef16-490b-4db9-9d94-bbc160e514c0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:23.538367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d25aef16-490b-4db9-9d94-bbc160e514c0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:23.542222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d25aef16-490b-4db9-9d94-bbc160e514c0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:24.201174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-93f58c7b-f607-43f8-b2dc-46a2d485830a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:24.202731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-93f58c7b-f607-43f8-b2dc-46a2d485830a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:24.218853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93f58c7b-f607-43f8-b2dc-46a2d485830a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:24.221371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93f58c7b-f607-43f8-b2dc-46a2d485830a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:24.223716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93f58c7b-f607-43f8-b2dc-46a2d485830a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:24.225910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93f58c7b-f607-43f8-b2dc-46a2d485830a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:24.229205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93f58c7b-f607-43f8-b2dc-46a2d485830a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:24.229886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93f58c7b-f607-43f8-b2dc-46a2d485830a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:24.243732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:26:24.910583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d25aef16-490b-4db9-9d94-bbc160e514c0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:24.927789 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d25aef16-490b-4db9-9d94-bbc160e514c0 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1681 microversion: 2.1 time: 1.419479 Oct 27 19:26:24.928991 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3427/6702] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:23 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1681 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:24.966520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-39d2b289-1c66-4a1b-8be4-4988da2bcd7b req-83e487b3-8b8f-446c-8fef-c887049510cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e2ca13-a2f2-4aac-9018-ef436b487e00", "name": "network-vif-plugged", "status": "completed", "tag": "f1ad43c0-31ac-45b2-a0ad-01368857adb2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:24.990581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-39d2b289-1c66-4a1b-8be4-4988da2bcd7b req-83e487b3-8b8f-446c-8fef-c887049510cb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:24.991343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-39d2b289-1c66-4a1b-8be4-4988da2bcd7b req-83e487b3-8b8f-446c-8fef-c887049510cb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:24.991971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-39d2b289-1c66-4a1b-8be4-4988da2bcd7b req-83e487b3-8b8f-446c-8fef-c887049510cb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:25.014270 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-39d2b289-1c66-4a1b-8be4-4988da2bcd7b req-83e487b3-8b8f-446c-8fef-c887049510cb service nova] Creating event network-vif-plugged:f1ad43c0-31ac-45b2-a0ad-01368857adb2 for instance 24e2ca13-a2f2-4aac-9018-ef436b487e00 on n-h2-860687-3 Oct 27 19:26:25.024291 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-39d2b289-1c66-4a1b-8be4-4988da2bcd7b req-83e487b3-8b8f-446c-8fef-c887049510cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062138 Oct 27 19:26:25.025708 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3428/6703] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:26:25.101817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-93f58c7b-f607-43f8-b2dc-46a2d485830a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:25.113523 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-93f58c7b-f607-43f8-b2dc-46a2d485830a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1568 microversion: 2.1 time: 0.922856 Oct 27 19:26:25.119498 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3276/6704] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:24 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1568 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:25.859115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ea77d8b1-1fea-454b-be2c-fff17a8cb6e0 req-8d73564e-58fb-4e24-964e-355422d5065c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ca3740-89f4-4fd9-a97a-fa87c89dce3e", "name": "network-vif-deleted", "tag": "aea52e03-dd66-4be9-aa3e-1d6ec5c74cf7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:25.898448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ea77d8b1-1fea-454b-be2c-fff17a8cb6e0 req-8d73564e-58fb-4e24-964e-355422d5065c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:25.898958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ea77d8b1-1fea-454b-be2c-fff17a8cb6e0 req-8d73564e-58fb-4e24-964e-355422d5065c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:25.899431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ea77d8b1-1fea-454b-be2c-fff17a8cb6e0 req-8d73564e-58fb-4e24-964e-355422d5065c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:25.954733 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ea77d8b1-1fea-454b-be2c-fff17a8cb6e0 req-8d73564e-58fb-4e24-964e-355422d5065c service nova] Creating event network-vif-deleted:aea52e03-dd66-4be9-aa3e-1d6ec5c74cf7 for instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e on n-h1-860687-3 Oct 27 19:26:25.972165 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ea77d8b1-1fea-454b-be2c-fff17a8cb6e0 req-8d73564e-58fb-4e24-964e-355422d5065c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118458 Oct 27 19:26:25.973352 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3429/6705] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:26:26.173317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9dd02f57-d44e-45d1-af2f-85f77840443c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:26.175820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9dd02f57-d44e-45d1-af2f-85f77840443c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:26.211356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dd02f57-d44e-45d1-af2f-85f77840443c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:26.219439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dd02f57-d44e-45d1-af2f-85f77840443c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:26.220461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dd02f57-d44e-45d1-af2f-85f77840443c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:26.222098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dd02f57-d44e-45d1-af2f-85f77840443c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:26.222772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dd02f57-d44e-45d1-af2f-85f77840443c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:26.223522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9dd02f57-d44e-45d1-af2f-85f77840443c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:26.441831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9dd02f57-d44e-45d1-af2f-85f77840443c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:26.464688 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9dd02f57-d44e-45d1-af2f-85f77840443c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1361 microversion: 2.1 time: 0.315538 Oct 27 19:26:26.466797 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3277/6706] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:26 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1361 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:27.493872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6b071f83-171f-4a1f-b5f9-b108b505e1a6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:27.495524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6b071f83-171f-4a1f-b5f9-b108b505e1a6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:27.509114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b071f83-171f-4a1f-b5f9-b108b505e1a6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:27.509629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b071f83-171f-4a1f-b5f9-b108b505e1a6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:27.513167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b071f83-171f-4a1f-b5f9-b108b505e1a6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:27.513952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b071f83-171f-4a1f-b5f9-b108b505e1a6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:27.516785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b071f83-171f-4a1f-b5f9-b108b505e1a6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:27.518551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b071f83-171f-4a1f-b5f9-b108b505e1a6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:27.686102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6b071f83-171f-4a1f-b5f9-b108b505e1a6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:27.699082 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6b071f83-171f-4a1f-b5f9-b108b505e1a6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1361 microversion: 2.1 time: 0.210814 Oct 27 19:26:27.700181 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3430/6707] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:27 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:28.724677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fabc0cfa-7ddb-4ce7-a1d0-4019c2224542 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:28.725977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fabc0cfa-7ddb-4ce7-a1d0-4019c2224542 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:28.735013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fabc0cfa-7ddb-4ce7-a1d0-4019c2224542 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:28.735896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fabc0cfa-7ddb-4ce7-a1d0-4019c2224542 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:28.736561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fabc0cfa-7ddb-4ce7-a1d0-4019c2224542 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:28.737616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fabc0cfa-7ddb-4ce7-a1d0-4019c2224542 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:28.738441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fabc0cfa-7ddb-4ce7-a1d0-4019c2224542 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:28.745327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fabc0cfa-7ddb-4ce7-a1d0-4019c2224542 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:28.864310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fabc0cfa-7ddb-4ce7-a1d0-4019c2224542 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:28.875349 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fabc0cfa-7ddb-4ce7-a1d0-4019c2224542 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1361 microversion: 2.1 time: 0.155265 Oct 27 19:26:28.878362 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3278/6708] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:28 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:29.900341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3532237f-c7e4-45fb-a8a3-221108d1971f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:29.901881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3532237f-c7e4-45fb-a8a3-221108d1971f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:29.916224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3532237f-c7e4-45fb-a8a3-221108d1971f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:29.917076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3532237f-c7e4-45fb-a8a3-221108d1971f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:29.920261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3532237f-c7e4-45fb-a8a3-221108d1971f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:29.924131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3532237f-c7e4-45fb-a8a3-221108d1971f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:29.926852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3532237f-c7e4-45fb-a8a3-221108d1971f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:29.927813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3532237f-c7e4-45fb-a8a3-221108d1971f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:30.067754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3532237f-c7e4-45fb-a8a3-221108d1971f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:30.078307 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3532237f-c7e4-45fb-a8a3-221108d1971f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1361 microversion: 2.1 time: 0.181890 Oct 27 19:26:30.079464 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3431/6709] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:29 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:31.103978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2bb2ffab-4ff2-45e8-8dcc-12f745b69fa3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:31.104630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2bb2ffab-4ff2-45e8-8dcc-12f745b69fa3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:31.115737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bb2ffab-4ff2-45e8-8dcc-12f745b69fa3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:31.116263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bb2ffab-4ff2-45e8-8dcc-12f745b69fa3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:31.116742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bb2ffab-4ff2-45e8-8dcc-12f745b69fa3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:31.123059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bb2ffab-4ff2-45e8-8dcc-12f745b69fa3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:31.123683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bb2ffab-4ff2-45e8-8dcc-12f745b69fa3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:31.124240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bb2ffab-4ff2-45e8-8dcc-12f745b69fa3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:31.515128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2bb2ffab-4ff2-45e8-8dcc-12f745b69fa3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:31.531326 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2bb2ffab-4ff2-45e8-8dcc-12f745b69fa3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1361 microversion: 2.1 time: 0.427914 Oct 27 19:26:31.532930 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3279/6710] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:31 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1361 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:32.570314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-77bc666f-248b-434b-8974-de58cd8eb123 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:32.570943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-77bc666f-248b-434b-8974-de58cd8eb123 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:32.597657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc666f-248b-434b-8974-de58cd8eb123 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:32.598161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc666f-248b-434b-8974-de58cd8eb123 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:32.598643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc666f-248b-434b-8974-de58cd8eb123 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:32.599362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc666f-248b-434b-8974-de58cd8eb123 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:32.605930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc666f-248b-434b-8974-de58cd8eb123 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:32.606818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc666f-248b-434b-8974-de58cd8eb123 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:32.710750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc666f-248b-434b-8974-de58cd8eb123 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:32.711248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc666f-248b-434b-8974-de58cd8eb123 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:32.711691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-77bc666f-248b-434b-8974-de58cd8eb123 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:32.714961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-77bc666f-248b-434b-8974-de58cd8eb123 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lazy-loading 'fault' on Instance uuid 43ca3740-89f4-4fd9-a97a-fa87c89dce3e {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:26:32.833185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-77bc666f-248b-434b-8974-de58cd8eb123 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:32.859476 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-77bc666f-248b-434b-8974-de58cd8eb123 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 200 len: 1366 microversion: 2.1 time: 0.293583 Oct 27 19:26:32.862104 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3432/6711] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:32 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:33.884412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1bb96a42-f8fc-4f0d-85ac-414ae00e759c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:33.886211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1bb96a42-f8fc-4f0d-85ac-414ae00e759c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:33.901743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bb96a42-f8fc-4f0d-85ac-414ae00e759c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:33.902269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bb96a42-f8fc-4f0d-85ac-414ae00e759c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:33.910096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bb96a42-f8fc-4f0d-85ac-414ae00e759c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:33.911303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bb96a42-f8fc-4f0d-85ac-414ae00e759c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:33.914191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bb96a42-f8fc-4f0d-85ac-414ae00e759c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:33.914896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bb96a42-f8fc-4f0d-85ac-414ae00e759c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:33.949582 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-1bb96a42-f8fc-4f0d-85ac-414ae00e759c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1bb96a42-f8fc-4f0d-85ac-414ae00e759c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e HTTP/1.1 Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '43ca3740-89f4-4fd9-a97a-fa87c89dce3e'} Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:33.961827 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:33.970734 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:33.970734 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:33.970734 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:33.970734 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:26:33.970734 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:26:33.970734 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:33.970734 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:33.970734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1bb96a42-f8fc-4f0d-85ac-414ae00e759c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:26:33.970734 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1bb96a42-f8fc-4f0d-85ac-414ae00e759c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 404 len: 111 microversion: 2.1 time: 0.083232 Oct 27 19:26:33.970734 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3280/6712] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:33 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:26:36.325021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5ab75740-3b7c-48bf-99e9-de082c069a29 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Action: 'create', calling method: .version_select at 0x7fc87326cd30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-682876238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/joMGDW30jlfakDm4kNewPKbMyeRC9+O11CbpGlPT7rsT4wdaBfJIitl6EiK4cr2mrFlM9V91zOwMj2hTMVOZ2jZgfPfb+sNjhc3MkxbjWCEqehsXxcwByW5SSb6yFkA=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:36.360423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-5ab75740-3b7c-48bf-99e9-de082c069a29 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Getting quotas for project e2ecef554af04d36a8c61e2b30d8f9e8. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:26:36.372388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-5ab75740-3b7c-48bf-99e9-de082c069a29 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Getting quotas for user c460e1808e4a4788b1fc3984eb4ab43b and project e2ecef554af04d36a8c61e2b30d8f9e8. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:26:36.410919 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5ab75740-3b7c-48bf-99e9-de082c069a29 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.089909 Oct 27 19:26:36.412107 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3433/6713] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:26:36 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:26:37.197290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4066c3fb-c8a0-462c-b4d3-85c1ebba6d5d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:37.199261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4066c3fb-c8a0-462c-b4d3-85c1ebba6d5d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:37.236843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4066c3fb-c8a0-462c-b4d3-85c1ebba6d5d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:37.237630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4066c3fb-c8a0-462c-b4d3-85c1ebba6d5d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:37.238261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4066c3fb-c8a0-462c-b4d3-85c1ebba6d5d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:37.239172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4066c3fb-c8a0-462c-b4d3-85c1ebba6d5d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:37.241397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4066c3fb-c8a0-462c-b4d3-85c1ebba6d5d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:37.242076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4066c3fb-c8a0-462c-b4d3-85c1ebba6d5d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:37.282809 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-4066c3fb-c8a0-462c-b4d3-85c1ebba6d5d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] HTTP exception thrown: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4066c3fb-c8a0-462c-b4d3-85c1ebba6d5d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Request method failure captured: Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 HTTP/1.1 Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtniMUDAuq4e1BIAZFAz2ZDdAogZhtvGa-gKyBzlZpZDATzQQ-s8JCfDVHsGT1FzSuAymzSSTJNTx7A5iyoQKJPO5DyL4Fc5rthR-PlctrSP9W5KgK-13fHiZQToHLxzGno8SauVbxyrlY-Gz-m_X0ADACErB59XqBBhL_4TS9Y6ca8 Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 9e8019adc2594ba4970d50028c4b79db Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9e8019adc2594ba4970d50028c4b79db", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 9e8019adc2594ba4970d50028c4b79db Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AttachVolumeTestJSON-1366128523-project Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ac513a8932e4435e88fcd8a023b31c5c Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeTestJSON-1366128523-project Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'c0719014-1b89-4535-8418-f4fb85165af7'} Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:26:37.285642 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:26:37.292356 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:37.292356 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:37.292356 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:37.292356 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:37.292356 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:37.292356 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:37.292356 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:37.292356 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:26:37.292356 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:26:37.292356 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:37.292356 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:37.295216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4066c3fb-c8a0-462c-b4d3-85c1ebba6d5d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Returning 404 to user: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:26:37.312144 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4066c3fb-c8a0-462c-b4d3-85c1ebba6d5d tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 404 len: 111 microversion: 2.1 time: 0.120267 Oct 27 19:26:37.313663 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3281/6714] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:26:37 2022] DELETE /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:26:37.322227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ea088721-7e1f-4b18-bdee-f98a3512900c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:37.322955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ea088721-7e1f-4b18-bdee-f98a3512900c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: c0719014-1b89-4535-8418-f4fb85165af7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:37.333451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea088721-7e1f-4b18-bdee-f98a3512900c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:37.334136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea088721-7e1f-4b18-bdee-f98a3512900c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:37.337432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea088721-7e1f-4b18-bdee-f98a3512900c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:37.339999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea088721-7e1f-4b18-bdee-f98a3512900c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:37.341424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea088721-7e1f-4b18-bdee-f98a3512900c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:37.345022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea088721-7e1f-4b18-bdee-f98a3512900c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:37.392556 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-ea088721-7e1f-4b18-bdee-f98a3512900c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] HTTP exception thrown: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ea088721-7e1f-4b18-bdee-f98a3512900c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Request method failure captured: Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 HTTP/1.1 Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtniMUDAuq4e1BIAZFAz2ZDdAogZhtvGa-gKyBzlZpZDATzQQ-s8JCfDVHsGT1FzSuAymzSSTJNTx7A5iyoQKJPO5DyL4Fc5rthR-PlctrSP9W5KgK-13fHiZQToHLxzGno8SauVbxyrlY-Gz-m_X0ADACErB59XqBBhL_4TS9Y6ca8 Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 9e8019adc2594ba4970d50028c4b79db Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9e8019adc2594ba4970d50028c4b79db", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 9e8019adc2594ba4970d50028c4b79db Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-AttachVolumeTestJSON-1366128523-project Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ac513a8932e4435e88fcd8a023b31c5c Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-AttachVolumeTestJSON-1366128523-project Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'c0719014-1b89-4535-8418-f4fb85165af7'} Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:37.396755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:37.402060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:37.402060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:37.402060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:37.402060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:26:37.402060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:26:37.402060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. Oct 27 19:26:37.402060 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:37.402060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ea088721-7e1f-4b18-bdee-f98a3512900c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Returning 404 to user: Instance c0719014-1b89-4535-8418-f4fb85165af7 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:26:37.402060 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ea088721-7e1f-4b18-bdee-f98a3512900c tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7" status: 404 len: 111 microversion: 2.1 time: 0.080674 Oct 27 19:26:37.402060 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3434/6715] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:37 2022] GET /compute/v2.1/servers/c0719014-1b89-4535-8418-f4fb85165af7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:26:38.572528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-683442584", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "bc082a0f-7971-4ca9-bc41-9407c7814077"}], "key_name": "tempest-TestNetworkBasicOps-682876238", "security_groups": [{"name": "tempest-secgroup-smoke-852058820"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:39.119699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] validate_networks() for [('bc082a0f-7971-4ca9-bc41-9407c7814077', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:26:40.036807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:26:40.037958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:26:40.038865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:26:40.039554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:26:40.040518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:26:40.052391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:40.053381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:40.054074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:40.055124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:40.055853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:40.056743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:40.078744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Getting quotas for project e2ecef554af04d36a8c61e2b30d8f9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:26:40.085076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Getting quotas for user c460e1808e4a4788b1fc3984eb4ab43b and project e2ecef554af04d36a8c61e2b30d8f9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:26:40.113026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:26:40.115835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:26:40.226736 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f193f530-2a81-4816-9dd7-daabbe173a16 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.659606 Oct 27 19:26:40.229511 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3282/6716] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:26:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:26:40.242405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b9630781-1834-4132-a0ed-60331218cd61 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:40.243692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b9630781-1834-4132-a0ed-60331218cd61 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:40.414161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b9630781-1834-4132-a0ed-60331218cd61 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:40.431266 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b9630781-1834-4132-a0ed-60331218cd61 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1247 microversion: 2.1 time: 0.193262 Oct 27 19:26:40.432171 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3435/6717] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:40 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1247 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:41.464397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-09443119-dd34-4b51-acd9-17efeb4ee8eb tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:41.464951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-09443119-dd34-4b51-acd9-17efeb4ee8eb tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:41.483683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09443119-dd34-4b51-acd9-17efeb4ee8eb tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:41.484631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09443119-dd34-4b51-acd9-17efeb4ee8eb tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:41.491864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09443119-dd34-4b51-acd9-17efeb4ee8eb tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:41.493036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09443119-dd34-4b51-acd9-17efeb4ee8eb tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:41.493932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09443119-dd34-4b51-acd9-17efeb4ee8eb tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:41.496763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09443119-dd34-4b51-acd9-17efeb4ee8eb tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:41.609837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-09443119-dd34-4b51-acd9-17efeb4ee8eb tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:41.625496 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-09443119-dd34-4b51-acd9-17efeb4ee8eb tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1299 microversion: 2.1 time: 0.165497 Oct 27 19:26:41.626503 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3283/6718] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:41 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:42.653385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8f084ac7-973e-4c48-96a6-a008f58471ea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:42.654081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8f084ac7-973e-4c48-96a6-a008f58471ea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:42.666030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f084ac7-973e-4c48-96a6-a008f58471ea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:42.666541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f084ac7-973e-4c48-96a6-a008f58471ea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:42.667003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f084ac7-973e-4c48-96a6-a008f58471ea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:42.671549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f084ac7-973e-4c48-96a6-a008f58471ea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:42.672060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f084ac7-973e-4c48-96a6-a008f58471ea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:42.672516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f084ac7-973e-4c48-96a6-a008f58471ea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:42.819486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8f084ac7-973e-4c48-96a6-a008f58471ea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:42.832744 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8f084ac7-973e-4c48-96a6-a008f58471ea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1305 microversion: 2.1 time: 0.183131 Oct 27 19:26:42.861695 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3436/6719] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:42 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1305 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:42.878631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-57b84405-936e-47b9-82b2-59e1a014da01 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:42.882298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-57b84405-936e-47b9-82b2-59e1a014da01 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:42.893401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57b84405-936e-47b9-82b2-59e1a014da01 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:42.894114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57b84405-936e-47b9-82b2-59e1a014da01 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:42.894820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57b84405-936e-47b9-82b2-59e1a014da01 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:42.895757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57b84405-936e-47b9-82b2-59e1a014da01 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:42.896400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57b84405-936e-47b9-82b2-59e1a014da01 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:42.897061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57b84405-936e-47b9-82b2-59e1a014da01 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:42.935446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-57b84405-936e-47b9-82b2-59e1a014da01 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:26:43.087464 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-57b84405-936e-47b9-82b2-59e1a014da01 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "DELETE /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 204 len: 0 microversion: 2.1 time: 0.211851 Oct 27 19:26:43.092735 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3284/6720] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:26:42 2022] DELETE /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:26:43.113091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4d50302f-2201-4046-b53f-7f1cd380aeba tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:43.118148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4d50302f-2201-4046-b53f-7f1cd380aeba tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:43.122897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7c386210-59b8-45fc-b944-beb5b8318a27 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:43.123518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7c386210-59b8-45fc-b944-beb5b8318a27 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:43.130629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d50302f-2201-4046-b53f-7f1cd380aeba tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:43.131142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d50302f-2201-4046-b53f-7f1cd380aeba tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:43.131590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d50302f-2201-4046-b53f-7f1cd380aeba tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:43.132304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d50302f-2201-4046-b53f-7f1cd380aeba tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:43.138245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d50302f-2201-4046-b53f-7f1cd380aeba tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:43.139074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d50302f-2201-4046-b53f-7f1cd380aeba tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:43.144503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c386210-59b8-45fc-b944-beb5b8318a27 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:43.145317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c386210-59b8-45fc-b944-beb5b8318a27 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:43.147003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c386210-59b8-45fc-b944-beb5b8318a27 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:43.148828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c386210-59b8-45fc-b944-beb5b8318a27 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:43.150975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c386210-59b8-45fc-b944-beb5b8318a27 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:43.151629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c386210-59b8-45fc-b944-beb5b8318a27 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:43.187055 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-7c386210-59b8-45fc-b944-beb5b8318a27 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] HTTP exception thrown: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7c386210-59b8-45fc-b944-beb5b8318a27 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Request method failure captured: Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d HTTP/1.1 Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtniMUDAuq4e1BIAZFAz2ZDdAogZhtvGa-gKyBzlZpZDATzQQ-s8JCfDVHsGT1FzSuAymzSSTJNTx7A5iyoQKJPO5DyL4Fc5rthR-PlctrSP9W5KgK-13fHiZQToHLxzGno8SauVbxyrlY-Gz-m_X0ADACErB59XqBBhL_4TS9Y6ca8 Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 9e8019adc2594ba4970d50028c4b79db Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9e8019adc2594ba4970d50028c4b79db", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 9e8019adc2594ba4970d50028c4b79db Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AttachVolumeTestJSON-1366128523-project Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ac513a8932e4435e88fcd8a023b31c5c Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeTestJSON-1366128523-project Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'db56aa8c-7a19-4910-8226-c70ac28faf8d'} Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:26:43.189490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:26:43.194942 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:26:43.194942 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:43.194942 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:43.194942 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:43.194942 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:43.194942 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:43.194942 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:43.194942 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:26:43.194942 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:26:43.194942 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:26:43.194942 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:43.196153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7c386210-59b8-45fc-b944-beb5b8318a27 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Returning 404 to user: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:26:43.200193 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7c386210-59b8-45fc-b944-beb5b8318a27 tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "DELETE /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 404 len: 111 microversion: 2.1 time: 0.084600 Oct 27 19:26:43.204423 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3285/6721] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:26:43 2022] DELETE /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:26:43.214188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3b40ce92-7164-4840-a2d8-6951f6edc1df tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:43.215134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3b40ce92-7164-4840-a2d8-6951f6edc1df tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] [instance: db56aa8c-7a19-4910-8226-c70ac28faf8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:43.227296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b40ce92-7164-4840-a2d8-6951f6edc1df tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:43.227839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b40ce92-7164-4840-a2d8-6951f6edc1df tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:43.228313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b40ce92-7164-4840-a2d8-6951f6edc1df tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:43.229067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b40ce92-7164-4840-a2d8-6951f6edc1df tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:43.229547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b40ce92-7164-4840-a2d8-6951f6edc1df tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:43.230002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b40ce92-7164-4840-a2d8-6951f6edc1df tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:43.267597 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-3b40ce92-7164-4840-a2d8-6951f6edc1df tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] HTTP exception thrown: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3b40ce92-7164-4840-a2d8-6951f6edc1df tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Request method failure captured: Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d HTTP/1.1 Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtniMUDAuq4e1BIAZFAz2ZDdAogZhtvGa-gKyBzlZpZDATzQQ-s8JCfDVHsGT1FzSuAymzSSTJNTx7A5iyoQKJPO5DyL4Fc5rthR-PlctrSP9W5KgK-13fHiZQToHLxzGno8SauVbxyrlY-Gz-m_X0ADACErB59XqBBhL_4TS9Y6ca8 Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 9e8019adc2594ba4970d50028c4b79db Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9e8019adc2594ba4970d50028c4b79db", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e8019adc2594ba4970d50028c4b79db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 9e8019adc2594ba4970d50028c4b79db Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1366128523 Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-AttachVolumeTestJSON-1366128523-project Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ac513a8932e4435e88fcd8a023b31c5c Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeTestJSON-1366128523-project Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'db56aa8c-7a19-4910-8226-c70ac28faf8d'} Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:43.270124 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:43.275271 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:43.275271 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:43.275271 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:43.275271 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:26:43.275271 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:26:43.275271 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. Oct 27 19:26:43.275271 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:43.277591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3b40ce92-7164-4840-a2d8-6951f6edc1df tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] Returning 404 to user: Instance db56aa8c-7a19-4910-8226-c70ac28faf8d could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:26:43.278753 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3b40ce92-7164-4840-a2d8-6951f6edc1df tempest-AttachVolumeTestJSON-1366128523 tempest-AttachVolumeTestJSON-1366128523-project] 10.222.0.42 "GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d" status: 404 len: 111 microversion: 2.1 time: 0.072146 Oct 27 19:26:43.280707 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3286/6722] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:43 2022] GET /compute/v2.1/servers/db56aa8c-7a19-4910-8226-c70ac28faf8d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:26:43.493486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4d50302f-2201-4046-b53f-7f1cd380aeba tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:43.506241 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4d50302f-2201-4046-b53f-7f1cd380aeba tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1407 microversion: 2.1 time: 0.404986 Oct 27 19:26:43.507354 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3437/6723] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:43 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:43.860005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85c52223-f837-48e2-8a62-b07cfda013e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:43.861062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85c52223-f837-48e2-8a62-b07cfda013e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:43.881244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85c52223-f837-48e2-8a62-b07cfda013e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:43.883300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85c52223-f837-48e2-8a62-b07cfda013e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:43.884481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85c52223-f837-48e2-8a62-b07cfda013e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:43.885893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85c52223-f837-48e2-8a62-b07cfda013e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:43.886753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85c52223-f837-48e2-8a62-b07cfda013e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:43.887421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85c52223-f837-48e2-8a62-b07cfda013e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:44.267436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-85c52223-f837-48e2-8a62-b07cfda013e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:44.283971 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85c52223-f837-48e2-8a62-b07cfda013e8 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1372 microversion: 2.1 time: 0.429940 Oct 27 19:26:44.284599 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3287/6724] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:43 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1372 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:44.532473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3ebc41d6-48a2-4fcb-95e6-6b4d4d1d74fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:44.533116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3ebc41d6-48a2-4fcb-95e6-6b4d4d1d74fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:44.537497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:26:44.550073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ebc41d6-48a2-4fcb-95e6-6b4d4d1d74fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:44.552266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ebc41d6-48a2-4fcb-95e6-6b4d4d1d74fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:44.552953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ebc41d6-48a2-4fcb-95e6-6b4d4d1d74fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:44.553854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ebc41d6-48a2-4fcb-95e6-6b4d4d1d74fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:44.554116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ebc41d6-48a2-4fcb-95e6-6b4d4d1d74fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:44.554595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ebc41d6-48a2-4fcb-95e6-6b4d4d1d74fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:44.891059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3ebc41d6-48a2-4fcb-95e6-6b4d4d1d74fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:44.899572 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3ebc41d6-48a2-4fcb-95e6-6b4d4d1d74fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1407 microversion: 2.1 time: 0.372452 Oct 27 19:26:44.910494 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3438/6725] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:44 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1407 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:45.307014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-16cbb1c0-05bb-45a8-a8c8-911f7f6fa74c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:45.307642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-16cbb1c0-05bb-45a8-a8c8-911f7f6fa74c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:45.310876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:26:45.320772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16cbb1c0-05bb-45a8-a8c8-911f7f6fa74c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:45.321204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16cbb1c0-05bb-45a8-a8c8-911f7f6fa74c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:45.321695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16cbb1c0-05bb-45a8-a8c8-911f7f6fa74c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:45.322467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16cbb1c0-05bb-45a8-a8c8-911f7f6fa74c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:45.322948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16cbb1c0-05bb-45a8-a8c8-911f7f6fa74c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:45.323427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16cbb1c0-05bb-45a8-a8c8-911f7f6fa74c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:45.744020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-16cbb1c0-05bb-45a8-a8c8-911f7f6fa74c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:45.756689 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-16cbb1c0-05bb-45a8-a8c8-911f7f6fa74c tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1372 microversion: 2.1 time: 0.453269 Oct 27 19:26:45.773439 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3288/6726] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:45 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1372 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:45.852397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e4c7a6c3-b898-40c9-b16a-0a43a4414283 req-249735b8-128f-44c6-b697-89695d2ee58c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52566304-d33c-4d27-ad0e-edc4b0d3131d", "tag": "37e914e5-1732-4018-8349-9d980df65e1a"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:45.870840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e4c7a6c3-b898-40c9-b16a-0a43a4414283 req-249735b8-128f-44c6-b697-89695d2ee58c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:45.872216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e4c7a6c3-b898-40c9-b16a-0a43a4414283 req-249735b8-128f-44c6-b697-89695d2ee58c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:45.872868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e4c7a6c3-b898-40c9-b16a-0a43a4414283 req-249735b8-128f-44c6-b697-89695d2ee58c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:45.888500 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e4c7a6c3-b898-40c9-b16a-0a43a4414283 req-249735b8-128f-44c6-b697-89695d2ee58c service nova] Creating event network-changed:37e914e5-1732-4018-8349-9d980df65e1a for instance 52566304-d33c-4d27-ad0e-edc4b0d3131d on n-h1-860687-3 Oct 27 19:26:45.897921 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e4c7a6c3-b898-40c9-b16a-0a43a4414283 req-249735b8-128f-44c6-b697-89695d2ee58c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051952 Oct 27 19:26:45.898792 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3439/6727] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:26:45.927602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d68ec20d-45ce-460d-984d-e4ee91c3fc6b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:45.928903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d68ec20d-45ce-460d-984d-e4ee91c3fc6b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:45.948268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d68ec20d-45ce-460d-984d-e4ee91c3fc6b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:45.949145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d68ec20d-45ce-460d-984d-e4ee91c3fc6b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:45.949847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d68ec20d-45ce-460d-984d-e4ee91c3fc6b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:45.951188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d68ec20d-45ce-460d-984d-e4ee91c3fc6b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:45.952039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d68ec20d-45ce-460d-984d-e4ee91c3fc6b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:45.952667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d68ec20d-45ce-460d-984d-e4ee91c3fc6b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:46.051623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e3b31e5e-df91-45e3-a1a4-a2b22ae830c0 req-09ed9525-10e6-40d5-b58d-af8445079e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44eb19d0-1788-4dcc-b9ac-02518bcec8b1", "name": "network-vif-deleted", "tag": "d6457658-3c90-408b-a700-ec8fc8a47e7f"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:46.067006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e3b31e5e-df91-45e3-a1a4-a2b22ae830c0 req-09ed9525-10e6-40d5-b58d-af8445079e8f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:46.067494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e3b31e5e-df91-45e3-a1a4-a2b22ae830c0 req-09ed9525-10e6-40d5-b58d-af8445079e8f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:46.067930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e3b31e5e-df91-45e3-a1a4-a2b22ae830c0 req-09ed9525-10e6-40d5-b58d-af8445079e8f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:46.093834 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e3b31e5e-df91-45e3-a1a4-a2b22ae830c0 req-09ed9525-10e6-40d5-b58d-af8445079e8f service nova] Creating event network-vif-deleted:d6457658-3c90-408b-a700-ec8fc8a47e7f for instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 on n-h1-860687-3 Oct 27 19:26:46.112639 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e3b31e5e-df91-45e3-a1a4-a2b22ae830c0 req-09ed9525-10e6-40d5-b58d-af8445079e8f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066012 Oct 27 19:26:46.113262 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3440/6728] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:26:46.146471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d68ec20d-45ce-460d-984d-e4ee91c3fc6b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:46.163504 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d68ec20d-45ce-460d-984d-e4ee91c3fc6b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1365 microversion: 2.1 time: 0.242416 Oct 27 19:26:46.164107 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3289/6729] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:45 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:46.785072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-708d4aa5-2e71-48a4-a494-e56d1085a9d2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:46.785765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-708d4aa5-2e71-48a4-a494-e56d1085a9d2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:46.794071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708d4aa5-2e71-48a4-a494-e56d1085a9d2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:46.794905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708d4aa5-2e71-48a4-a494-e56d1085a9d2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:46.795553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708d4aa5-2e71-48a4-a494-e56d1085a9d2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:46.796576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708d4aa5-2e71-48a4-a494-e56d1085a9d2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:46.797392 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708d4aa5-2e71-48a4-a494-e56d1085a9d2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:46.797998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-708d4aa5-2e71-48a4-a494-e56d1085a9d2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:47.188242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9458590a-7871-486d-b1de-b349696134bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:47.191064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9458590a-7871-486d-b1de-b349696134bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:47.205339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9458590a-7871-486d-b1de-b349696134bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:47.210348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9458590a-7871-486d-b1de-b349696134bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:47.210965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9458590a-7871-486d-b1de-b349696134bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:47.212013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9458590a-7871-486d-b1de-b349696134bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:47.212663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-708d4aa5-2e71-48a4-a494-e56d1085a9d2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:47.213794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9458590a-7871-486d-b1de-b349696134bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:47.214997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9458590a-7871-486d-b1de-b349696134bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:47.225615 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-708d4aa5-2e71-48a4-a494-e56d1085a9d2 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1372 microversion: 2.1 time: 0.441694 Oct 27 19:26:47.241181 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3441/6730] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:46 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1372 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:47.320564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9458590a-7871-486d-b1de-b349696134bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:47.329443 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9458590a-7871-486d-b1de-b349696134bc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1200 microversion: 2.1 time: 0.145484 Oct 27 19:26:47.347729 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3290/6731] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:47 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1200 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:48.248704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2b5b6fa4-7838-4e0f-b499-a69a422cf242 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:48.250342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2b5b6fa4-7838-4e0f-b499-a69a422cf242 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:48.273626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5b6fa4-7838-4e0f-b499-a69a422cf242 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:48.276166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5b6fa4-7838-4e0f-b499-a69a422cf242 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:48.276625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5b6fa4-7838-4e0f-b499-a69a422cf242 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:48.277357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5b6fa4-7838-4e0f-b499-a69a422cf242 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:48.277824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5b6fa4-7838-4e0f-b499-a69a422cf242 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:48.278258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b5b6fa4-7838-4e0f-b499-a69a422cf242 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:48.364965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ba66ba98-9a1d-4356-865a-437d99e492c2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:48.366249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ba66ba98-9a1d-4356-865a-437d99e492c2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:48.379472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba66ba98-9a1d-4356-865a-437d99e492c2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:48.381404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba66ba98-9a1d-4356-865a-437d99e492c2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:48.386833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba66ba98-9a1d-4356-865a-437d99e492c2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:48.391303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba66ba98-9a1d-4356-865a-437d99e492c2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:48.394232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba66ba98-9a1d-4356-865a-437d99e492c2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:48.395002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba66ba98-9a1d-4356-865a-437d99e492c2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:48.763891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2b5b6fa4-7838-4e0f-b499-a69a422cf242 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:48.775435 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2b5b6fa4-7838-4e0f-b499-a69a422cf242 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1372 microversion: 2.1 time: 0.530541 Oct 27 19:26:48.777140 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3442/6732] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:48 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1372 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:48.851481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ba66ba98-9a1d-4356-865a-437d99e492c2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:48.870367 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ba66ba98-9a1d-4356-865a-437d99e492c2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1200 microversion: 2.1 time: 0.509985 Oct 27 19:26:48.871535 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3291/6733] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:48 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1200 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:26:49.801780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fca9fbc0-f252-40d2-b357-49249a9abc71 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:49.802497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fca9fbc0-f252-40d2-b357-49249a9abc71 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:49.815598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fca9fbc0-f252-40d2-b357-49249a9abc71 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:49.816292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fca9fbc0-f252-40d2-b357-49249a9abc71 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:49.817185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fca9fbc0-f252-40d2-b357-49249a9abc71 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:49.823871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fca9fbc0-f252-40d2-b357-49249a9abc71 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:49.824694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fca9fbc0-f252-40d2-b357-49249a9abc71 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:49.825314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fca9fbc0-f252-40d2-b357-49249a9abc71 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:49.882299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:26:49.895954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8b4f1c6c-f8af-4926-9c37-89849405dadc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:49.897354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8b4f1c6c-f8af-4926-9c37-89849405dadc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:49.918660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b4f1c6c-f8af-4926-9c37-89849405dadc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:49.922577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b4f1c6c-f8af-4926-9c37-89849405dadc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:49.923279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b4f1c6c-f8af-4926-9c37-89849405dadc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:49.926351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b4f1c6c-f8af-4926-9c37-89849405dadc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:49.928482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b4f1c6c-f8af-4926-9c37-89849405dadc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:49.929041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b4f1c6c-f8af-4926-9c37-89849405dadc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:50.071409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:26:50.088808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8b4f1c6c-f8af-4926-9c37-89849405dadc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:50.097737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:26:50.113013 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8b4f1c6c-f8af-4926-9c37-89849405dadc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1200 microversion: 2.1 time: 0.220918 Oct 27 19:26:50.117859 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3292/6734] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:49 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1200 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:50.251541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fca9fbc0-f252-40d2-b357-49249a9abc71 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:50.262642 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fca9fbc0-f252-40d2-b357-49249a9abc71 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1372 microversion: 2.1 time: 0.464739 Oct 27 19:26:50.263227 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3443/6735] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:49 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1372 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:51.142628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-df2b71b0-d7c9-48d3-ac01-ec21981cf223 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:51.144450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-df2b71b0-d7c9-48d3-ac01-ec21981cf223 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:51.156231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df2b71b0-d7c9-48d3-ac01-ec21981cf223 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:51.162633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df2b71b0-d7c9-48d3-ac01-ec21981cf223 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:51.163420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df2b71b0-d7c9-48d3-ac01-ec21981cf223 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:51.167691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df2b71b0-d7c9-48d3-ac01-ec21981cf223 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:51.168201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df2b71b0-d7c9-48d3-ac01-ec21981cf223 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:51.168764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df2b71b0-d7c9-48d3-ac01-ec21981cf223 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:51.245863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-df2b71b0-d7c9-48d3-ac01-ec21981cf223 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:51.257063 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-df2b71b0-d7c9-48d3-ac01-ec21981cf223 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1200 microversion: 2.1 time: 0.120547 Oct 27 19:26:51.258960 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3293/6736] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:51 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1200 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:51.287972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-26e0d30a-5a1f-4a3c-8b40-9f4c893fc6c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:51.288585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-26e0d30a-5a1f-4a3c-8b40-9f4c893fc6c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:51.290752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:26:51.297565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26e0d30a-5a1f-4a3c-8b40-9f4c893fc6c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:51.298339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26e0d30a-5a1f-4a3c-8b40-9f4c893fc6c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:51.298511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26e0d30a-5a1f-4a3c-8b40-9f4c893fc6c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:51.299397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26e0d30a-5a1f-4a3c-8b40-9f4c893fc6c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:51.300006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26e0d30a-5a1f-4a3c-8b40-9f4c893fc6c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:51.300856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26e0d30a-5a1f-4a3c-8b40-9f4c893fc6c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:51.629974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-26e0d30a-5a1f-4a3c-8b40-9f4c893fc6c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:51.652318 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-26e0d30a-5a1f-4a3c-8b40-9f4c893fc6c9 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1372 microversion: 2.1 time: 0.368493 Oct 27 19:26:51.659189 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3444/6737] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:51 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1372 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:52.135909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-0c9b0c67-9717-446b-baf2-bfed1b1a1281 req-70bfe275-45e4-4c0d-82e5-daafc24b7785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52566304-d33c-4d27-ad0e-edc4b0d3131d", "name": "network-vif-plugged", "status": "completed", "tag": "37e914e5-1732-4018-8349-9d980df65e1a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:52.146808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0c9b0c67-9717-446b-baf2-bfed1b1a1281 req-70bfe275-45e4-4c0d-82e5-daafc24b7785 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:52.148106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0c9b0c67-9717-446b-baf2-bfed1b1a1281 req-70bfe275-45e4-4c0d-82e5-daafc24b7785 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:52.148907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0c9b0c67-9717-446b-baf2-bfed1b1a1281 req-70bfe275-45e4-4c0d-82e5-daafc24b7785 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:52.195774 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-0c9b0c67-9717-446b-baf2-bfed1b1a1281 req-70bfe275-45e4-4c0d-82e5-daafc24b7785 service nova] Creating event network-vif-plugged:37e914e5-1732-4018-8349-9d980df65e1a for instance 52566304-d33c-4d27-ad0e-edc4b0d3131d on n-h1-860687-3 Oct 27 19:26:52.204695 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-0c9b0c67-9717-446b-baf2-bfed1b1a1281 req-70bfe275-45e4-4c0d-82e5-daafc24b7785 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.328711 Oct 27 19:26:52.206191 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3294/6738] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:26:52.283272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a0e4552-695a-4c06-8846-7249f52b502a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:52.285305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1a0e4552-695a-4c06-8846-7249f52b502a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:52.293806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a0e4552-695a-4c06-8846-7249f52b502a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:52.295127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a0e4552-695a-4c06-8846-7249f52b502a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:52.296667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a0e4552-695a-4c06-8846-7249f52b502a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:52.297693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a0e4552-695a-4c06-8846-7249f52b502a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:52.298371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a0e4552-695a-4c06-8846-7249f52b502a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:52.299000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a0e4552-695a-4c06-8846-7249f52b502a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:52.409197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1a0e4552-695a-4c06-8846-7249f52b502a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:52.429870 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1a0e4552-695a-4c06-8846-7249f52b502a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1200 microversion: 2.1 time: 0.152361 Oct 27 19:26:52.444744 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3445/6739] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:52 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1200 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:52.678480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7da4ecc1-3d80-43e4-ad2a-e23fbf861a35 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:52.679312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7da4ecc1-3d80-43e4-ad2a-e23fbf861a35 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:52.688105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7da4ecc1-3d80-43e4-ad2a-e23fbf861a35 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:52.688759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7da4ecc1-3d80-43e4-ad2a-e23fbf861a35 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:52.689521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7da4ecc1-3d80-43e4-ad2a-e23fbf861a35 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:52.691805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7da4ecc1-3d80-43e4-ad2a-e23fbf861a35 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:52.693412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7da4ecc1-3d80-43e4-ad2a-e23fbf861a35 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:52.693892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7da4ecc1-3d80-43e4-ad2a-e23fbf861a35 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:52.701338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:26:53.005853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7da4ecc1-3d80-43e4-ad2a-e23fbf861a35 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:53.014263 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7da4ecc1-3d80-43e4-ad2a-e23fbf861a35 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1372 microversion: 2.1 time: 0.341084 Oct 27 19:26:53.015594 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3295/6740] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:52 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1372 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:53.456072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4d5ffe02-4302-44d5-b90f-a3c36afec50c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:53.457244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4d5ffe02-4302-44d5-b90f-a3c36afec50c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:53.465656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d5ffe02-4302-44d5-b90f-a3c36afec50c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:53.466357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d5ffe02-4302-44d5-b90f-a3c36afec50c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:53.467027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d5ffe02-4302-44d5-b90f-a3c36afec50c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:53.467972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d5ffe02-4302-44d5-b90f-a3c36afec50c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:53.468602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d5ffe02-4302-44d5-b90f-a3c36afec50c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:53.469210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d5ffe02-4302-44d5-b90f-a3c36afec50c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:53.521011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d5ffe02-4302-44d5-b90f-a3c36afec50c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:53.521717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d5ffe02-4302-44d5-b90f-a3c36afec50c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:53.522333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4d5ffe02-4302-44d5-b90f-a3c36afec50c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:53.522986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-4d5ffe02-4302-44d5-b90f-a3c36afec50c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lazy-loading 'fault' on Instance uuid 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:26:53.696367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4d5ffe02-4302-44d5-b90f-a3c36afec50c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:53.707322 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4d5ffe02-4302-44d5-b90f-a3c36afec50c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 200 len: 1205 microversion: 2.1 time: 0.255639 Oct 27 19:26:53.718903 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3446/6741] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:53 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 1205 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:54.040447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b163d2c8-f200-4d2c-aca2-a04917a10881 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:54.041321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b163d2c8-f200-4d2c-aca2-a04917a10881 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:54.076802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b163d2c8-f200-4d2c-aca2-a04917a10881 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:54.078099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b163d2c8-f200-4d2c-aca2-a04917a10881 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:54.078753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b163d2c8-f200-4d2c-aca2-a04917a10881 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:54.082848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b163d2c8-f200-4d2c-aca2-a04917a10881 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:54.088519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b163d2c8-f200-4d2c-aca2-a04917a10881 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:54.089104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b163d2c8-f200-4d2c-aca2-a04917a10881 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:54.317924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b163d2c8-f200-4d2c-aca2-a04917a10881 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:54.330790 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b163d2c8-f200-4d2c-aca2-a04917a10881 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1543 microversion: 2.1 time: 0.294096 Oct 27 19:26:54.336113 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3296/6742] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:54 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1543 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:54.355273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-52474d60-25fe-4fbc-84cb-7f80ca0bfd8d tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:54.355897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-52474d60-25fe-4fbc-84cb-7f80ca0bfd8d tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:54.366120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52474d60-25fe-4fbc-84cb-7f80ca0bfd8d tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:54.366655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52474d60-25fe-4fbc-84cb-7f80ca0bfd8d tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:54.367300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52474d60-25fe-4fbc-84cb-7f80ca0bfd8d tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:54.368196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52474d60-25fe-4fbc-84cb-7f80ca0bfd8d tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:54.368831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52474d60-25fe-4fbc-84cb-7f80ca0bfd8d tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:54.369461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52474d60-25fe-4fbc-84cb-7f80ca0bfd8d tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:54.732480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1661e8db-b27e-42b5-be27-1cfc28150bd4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:54.733526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1661e8db-b27e-42b5-be27-1cfc28150bd4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:54.745101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1661e8db-b27e-42b5-be27-1cfc28150bd4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:54.746205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1661e8db-b27e-42b5-be27-1cfc28150bd4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:54.747296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1661e8db-b27e-42b5-be27-1cfc28150bd4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:54.751102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1661e8db-b27e-42b5-be27-1cfc28150bd4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:54.751692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1661e8db-b27e-42b5-be27-1cfc28150bd4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:54.754240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1661e8db-b27e-42b5-be27-1cfc28150bd4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:54.789804 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-1661e8db-b27e-42b5-be27-1cfc28150bd4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1661e8db-b27e-42b5-be27-1cfc28150bd4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 HTTP/1.1 Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '44eb19d0-1788-4dcc-b9ac-02518bcec8b1'} Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:54.798201 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:54.804235 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:54.804235 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:54.804235 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:54.804235 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:26:54.804235 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:26:54.804235 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:54.804235 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:54.805673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1661e8db-b27e-42b5-be27-1cfc28150bd4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:26:54.806615 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1661e8db-b27e-42b5-be27-1cfc28150bd4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 404 len: 111 microversion: 2.1 time: 0.078719 Oct 27 19:26:54.810872 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3297/6743] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:54 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:26:55.016133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-52474d60-25fe-4fbc-84cb-7f80ca0bfd8d tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:26:55.028938 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-52474d60-25fe-4fbc-84cb-7f80ca0bfd8d tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1543 microversion: 2.1 time: 0.677584 Oct 27 19:26:55.033553 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3447/6744] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:54 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1543 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:26:57.049011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7eea35e6-db8d-434d-ad32-ff9f28e97ec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:57.050990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7eea35e6-db8d-434d-ad32-ff9f28e97ec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:57.072784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7eea35e6-db8d-434d-ad32-ff9f28e97ec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:57.073604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7eea35e6-db8d-434d-ad32-ff9f28e97ec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:57.074240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7eea35e6-db8d-434d-ad32-ff9f28e97ec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:57.075188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7eea35e6-db8d-434d-ad32-ff9f28e97ec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:57.075825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7eea35e6-db8d-434d-ad32-ff9f28e97ec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:57.076455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7eea35e6-db8d-434d-ad32-ff9f28e97ec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:57.106122 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-7eea35e6-db8d-434d-ad32-ff9f28e97ec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7eea35e6-db8d-434d-ad32-ff9f28e97ec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e HTTP/1.1 Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '43ca3740-89f4-4fd9-a97a-fa87c89dce3e'} Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:26:57.112241 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:26:57.117798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:57.117798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:57.117798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:57.117798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:57.117798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:57.117798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:57.117798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:57.117798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:26:57.117798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:26:57.117798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:57.117798 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:57.117798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7eea35e6-db8d-434d-ad32-ff9f28e97ec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:26:57.117798 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7eea35e6-db8d-434d-ad32-ff9f28e97ec4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "DELETE /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 404 len: 111 microversion: 2.1 time: 0.069744 Oct 27 19:26:57.117798 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3298/6745] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:26:57 2022] DELETE /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:26:57.126324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-23f09ce6-2d49-499c-82e8-529e393ab536 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:57.127106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-23f09ce6-2d49-499c-82e8-529e393ab536 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 43ca3740-89f4-4fd9-a97a-fa87c89dce3e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:57.142017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23f09ce6-2d49-499c-82e8-529e393ab536 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:57.142860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23f09ce6-2d49-499c-82e8-529e393ab536 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:57.145723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23f09ce6-2d49-499c-82e8-529e393ab536 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:57.150864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23f09ce6-2d49-499c-82e8-529e393ab536 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:57.151444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23f09ce6-2d49-499c-82e8-529e393ab536 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:57.151832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23f09ce6-2d49-499c-82e8-529e393ab536 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:57.197949 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-23f09ce6-2d49-499c-82e8-529e393ab536 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-23f09ce6-2d49-499c-82e8-529e393ab536 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e HTTP/1.1 Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '43ca3740-89f4-4fd9-a97a-fa87c89dce3e'} Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:57.200296 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:57.205893 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:57.205893 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:57.205893 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:57.205893 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:26:57.205893 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:26:57.205893 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. Oct 27 19:26:57.205893 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:57.207418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-23f09ce6-2d49-499c-82e8-529e393ab536 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance 43ca3740-89f4-4fd9-a97a-fa87c89dce3e could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:26:57.211849 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-23f09ce6-2d49-499c-82e8-529e393ab536 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e" status: 404 len: 111 microversion: 2.1 time: 0.091420 Oct 27 19:26:57.212964 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3448/6746] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:57 2022] GET /compute/v2.1/servers/43ca3740-89f4-4fd9-a97a-fa87c89dce3e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:26:58.521337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b20c2e0a-436b-4176-ba7a-b9a966978202 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:58.521971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b20c2e0a-436b-4176-ba7a-b9a966978202 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:58.537993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b20c2e0a-436b-4176-ba7a-b9a966978202 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:58.541652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b20c2e0a-436b-4176-ba7a-b9a966978202 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:58.542361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b20c2e0a-436b-4176-ba7a-b9a966978202 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:58.543354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b20c2e0a-436b-4176-ba7a-b9a966978202 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:58.544034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b20c2e0a-436b-4176-ba7a-b9a966978202 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:58.544650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b20c2e0a-436b-4176-ba7a-b9a966978202 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:58.579498 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-b20c2e0a-436b-4176-ba7a-b9a966978202 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b20c2e0a-436b-4176-ba7a-b9a966978202 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 HTTP/1.1 Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '44eb19d0-1788-4dcc-b9ac-02518bcec8b1'} Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:26:58.582097 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:26:58.587212 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:58.587212 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:58.587212 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:58.587212 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:58.587212 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:58.587212 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:58.587212 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:58.587212 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:26:58.587212 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:26:58.587212 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:58.587212 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:26:58.590511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b20c2e0a-436b-4176-ba7a-b9a966978202 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:26:58.596334 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b20c2e0a-436b-4176-ba7a-b9a966978202 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "DELETE /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 404 len: 111 microversion: 2.1 time: 0.081850 Oct 27 19:26:58.597038 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3299/6747] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:26:58 2022] DELETE /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:26:58.606285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f94b55d2-ae25-4168-b3f4-e175879f7e9c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:26:58.607733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f94b55d2-ae25-4168-b3f4-e175879f7e9c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 44eb19d0-1788-4dcc-b9ac-02518bcec8b1] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:26:58.616523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f94b55d2-ae25-4168-b3f4-e175879f7e9c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:58.617241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f94b55d2-ae25-4168-b3f4-e175879f7e9c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:58.617903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f94b55d2-ae25-4168-b3f4-e175879f7e9c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:58.618933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f94b55d2-ae25-4168-b3f4-e175879f7e9c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:58.619640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f94b55d2-ae25-4168-b3f4-e175879f7e9c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:58.620309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f94b55d2-ae25-4168-b3f4-e175879f7e9c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:58.640752 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-f94b55d2-ae25-4168-b3f4-e175879f7e9c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f94b55d2-ae25-4168-b3f4-e175879f7e9c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 HTTP/1.1 Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '44eb19d0-1788-4dcc-b9ac-02518bcec8b1'} Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:26:58.642860 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:58.647405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:26:58.647405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:26:58.647405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:26:58.647405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:26:58.647405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:26:58.647405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. Oct 27 19:26:58.647405 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:26:58.649536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f94b55d2-ae25-4168-b3f4-e175879f7e9c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance 44eb19d0-1788-4dcc-b9ac-02518bcec8b1 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:26:58.650718 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f94b55d2-ae25-4168-b3f4-e175879f7e9c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1" status: 404 len: 111 microversion: 2.1 time: 0.048972 Oct 27 19:26:58.655295 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3449/6748] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:26:58 2022] GET /compute/v2.1/servers/44eb19d0-1788-4dcc-b9ac-02518bcec8b1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:26:58.784731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c45866eb-6f78-452f-8cfb-9a2f2d714fd3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Action: 'create', calling method: .version_select at 0x7fc86b01a670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-600353821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGybtS6IiA6y2xHvCgpDRxjltKyL1qssp/yFay5k0pJJimrmTysV5r0xocaLml7qFUruaCcp1tkqhrDc7M5Jwr+fZCLzT/b9zhwc4b2LeD71f3NduML5XKGVFdjZEsUvew=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:58.819491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c45866eb-6f78-452f-8cfb-9a2f2d714fd3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for project b84229fcbba74710a8c0c30c34dce78d. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:26:58.829340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c45866eb-6f78-452f-8cfb-9a2f2d714fd3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for user c8e60ff9ab0d45628195f314f1cac791 and project b84229fcbba74710a8c0c30c34dce78d. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:26:58.875426 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c45866eb-6f78-452f-8cfb-9a2f2d714fd3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.095327 Oct 27 19:26:58.897938 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3300/6749] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:26:58 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:26:59.244875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-7bcdf78b-95c1-4424-82f8-6b9950dfb8b7 req-9f979304-34e2-4068-9374-f44a1c320fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52566304-d33c-4d27-ad0e-edc4b0d3131d", "tag": "37e914e5-1732-4018-8349-9d980df65e1a"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:26:59.257518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7bcdf78b-95c1-4424-82f8-6b9950dfb8b7 req-9f979304-34e2-4068-9374-f44a1c320fa2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:26:59.258845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7bcdf78b-95c1-4424-82f8-6b9950dfb8b7 req-9f979304-34e2-4068-9374-f44a1c320fa2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:26:59.259521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7bcdf78b-95c1-4424-82f8-6b9950dfb8b7 req-9f979304-34e2-4068-9374-f44a1c320fa2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:26:59.272952 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-7bcdf78b-95c1-4424-82f8-6b9950dfb8b7 req-9f979304-34e2-4068-9374-f44a1c320fa2 service nova] Creating event network-changed:37e914e5-1732-4018-8349-9d980df65e1a for instance 52566304-d33c-4d27-ad0e-edc4b0d3131d on n-h1-860687-3 Oct 27 19:26:59.281383 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-7bcdf78b-95c1-4424-82f8-6b9950dfb8b7 req-9f979304-34e2-4068-9374-f44a1c320fa2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041314 Oct 27 19:26:59.283254 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3450/6750] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:27:19.889469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=17 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:27:19.890783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:27:19.891945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:27:19.896247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-50a833c5-cb9a-43e2-a222-3f1ba8356e66 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:27:19.911543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-50a833c5-cb9a-43e2-a222-3f1ba8356e66 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:19.918752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50a833c5-cb9a-43e2-a222-3f1ba8356e66 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:19.919272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50a833c5-cb9a-43e2-a222-3f1ba8356e66 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:19.919758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50a833c5-cb9a-43e2-a222-3f1ba8356e66 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:19.930585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50a833c5-cb9a-43e2-a222-3f1ba8356e66 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:19.931476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50a833c5-cb9a-43e2-a222-3f1ba8356e66 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:19.931958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50a833c5-cb9a-43e2-a222-3f1ba8356e66 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:20.059928 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-50a833c5-cb9a-43e2-a222-3f1ba8356e66 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "POST /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d/action" status: 200 len: 24557 microversion: 2.1 time: 0.172077 Oct 27 19:27:20.069730 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3301/6751] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:27:19 2022] POST /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d/action => generated 24557 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:27:26.609192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=27 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:27:26.610736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=37 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:27:26.615928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9ee55037-02ee-46d3-a110-65b4d3670a73 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:27:26.620830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9ee55037-02ee-46d3-a110-65b4d3670a73 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:26.636401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ee55037-02ee-46d3-a110-65b4d3670a73 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:26.636907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ee55037-02ee-46d3-a110-65b4d3670a73 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:26.637358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ee55037-02ee-46d3-a110-65b4d3670a73 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:26.644029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ee55037-02ee-46d3-a110-65b4d3670a73 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:26.644569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ee55037-02ee-46d3-a110-65b4d3670a73 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:26.645033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9ee55037-02ee-46d3-a110-65b4d3670a73 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:26.736389 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9ee55037-02ee-46d3-a110-65b4d3670a73 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "POST /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d/action" status: 200 len: 32625 microversion: 2.1 time: 0.129452 Oct 27 19:27:26.737057 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3451/6752] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:27:26 2022] POST /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d/action => generated 32625 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:27:27.399424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-730827996", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-600353821", "security_groups": [{"name": "tempest-secgroup-smoke-1058459960"}], "block_device_mapping_v2": [{"uuid": "898c1612-ab7f-4e3b-a8a1-194390116607", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:27:27.612398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] validate_networks() for [('0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:27:28.990283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:27:28.992755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:27:28.993510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:27:28.994684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:27:28.995719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:27:29.003189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4ba42580-1703-41ce-8eae-217204ced131 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:29.005873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4ba42580-1703-41ce-8eae-217204ced131 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:29.020971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:29.023461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ba42580-1703-41ce-8eae-217204ced131 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:29.024304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:29.024997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:29.026339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:29.026997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ba42580-1703-41ce-8eae-217204ced131 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:29.027690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ba42580-1703-41ce-8eae-217204ced131 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:29.028426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:29.031307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:29.031948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ba42580-1703-41ce-8eae-217204ced131 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:29.034976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ba42580-1703-41ce-8eae-217204ced131 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:29.035707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ba42580-1703-41ce-8eae-217204ced131 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:29.091957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:27:29.103009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for user c8e60ff9ab0d45628195f314f1cac791 and project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:27:29.116474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4ba42580-1703-41ce-8eae-217204ced131 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:27:29.209026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:27:29.213419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='898c1612-ab7f-4e3b-a8a1-194390116607',volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:27:29.291350 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4ba42580-1703-41ce-8eae-217204ced131 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "DELETE /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 204 len: 0 microversion: 2.1 time: 0.293072 Oct 27 19:27:29.291968 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3452/6753] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:27:28 2022] DELETE /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:27:29.435783 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5857da9b-6b43-4682-90fc-baf513c42b3a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.041548 Oct 27 19:27:29.439385 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3302/6754] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:27:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 2047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:27:29.456011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0e9e0f3c-31a7-47e4-822e-52e9c8738b85 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:29.457042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0e9e0f3c-31a7-47e4-822e-52e9c8738b85 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:29.469196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e9e0f3c-31a7-47e4-822e-52e9c8738b85 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:29.471201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e9e0f3c-31a7-47e4-822e-52e9c8738b85 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:29.471706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e9e0f3c-31a7-47e4-822e-52e9c8738b85 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:29.472455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e9e0f3c-31a7-47e4-822e-52e9c8738b85 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:29.474913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e9e0f3c-31a7-47e4-822e-52e9c8738b85 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:29.476197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e9e0f3c-31a7-47e4-822e-52e9c8738b85 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:29.612912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-8d6675bd-d765-4534-9e89-99c5ccc2fb93 req-ff408bf9-35b4-4bf3-8cbf-1970dbee409b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52566304-d33c-4d27-ad0e-edc4b0d3131d", "tag": "37e914e5-1732-4018-8349-9d980df65e1a"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:27:29.624383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8d6675bd-d765-4534-9e89-99c5ccc2fb93 req-ff408bf9-35b4-4bf3-8cbf-1970dbee409b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:29.625159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8d6675bd-d765-4534-9e89-99c5ccc2fb93 req-ff408bf9-35b4-4bf3-8cbf-1970dbee409b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:29.627451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8d6675bd-d765-4534-9e89-99c5ccc2fb93 req-ff408bf9-35b4-4bf3-8cbf-1970dbee409b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:29.654555 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8d6675bd-d765-4534-9e89-99c5ccc2fb93 req-ff408bf9-35b4-4bf3-8cbf-1970dbee409b service nova] Creating event network-changed:37e914e5-1732-4018-8349-9d980df65e1a for instance 52566304-d33c-4d27-ad0e-edc4b0d3131d on n-h1-860687-3 Oct 27 19:27:29.665956 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-8d6675bd-d765-4534-9e89-99c5ccc2fb93 req-ff408bf9-35b4-4bf3-8cbf-1970dbee409b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.372621 Oct 27 19:27:29.672485 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3453/6755] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:27:29.683497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3c4b76f0-939f-490d-9882-a24fdf12b1e1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:29.687814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3c4b76f0-939f-490d-9882-a24fdf12b1e1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:29.841697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3c4b76f0-939f-490d-9882-a24fdf12b1e1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:29.852443 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3c4b76f0-939f-490d-9882-a24fdf12b1e1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1093 microversion: 2.1 time: 0.176248 Oct 27 19:27:29.854050 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3454/6756] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:29 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1093 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:29.906485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0e9e0f3c-31a7-47e4-822e-52e9c8738b85 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:29.922740 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0e9e0f3c-31a7-47e4-822e-52e9c8738b85 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1667 microversion: 2.1 time: 0.481354 Oct 27 19:27:29.923971 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3303/6757] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:29 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1667 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:30.878712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-507fb827-eb8a-4bf1-8104-bd01725d6ea4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:30.879502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-507fb827-eb8a-4bf1-8104-bd01725d6ea4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:30.904105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-507fb827-eb8a-4bf1-8104-bd01725d6ea4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:30.905336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-507fb827-eb8a-4bf1-8104-bd01725d6ea4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:30.911537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-507fb827-eb8a-4bf1-8104-bd01725d6ea4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:30.912637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-507fb827-eb8a-4bf1-8104-bd01725d6ea4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:30.913936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-507fb827-eb8a-4bf1-8104-bd01725d6ea4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:30.914427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-507fb827-eb8a-4bf1-8104-bd01725d6ea4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:30.960315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fadbf10d-17f5-4b3d-bdbc-10c2cc34dbea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:30.961610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fadbf10d-17f5-4b3d-bdbc-10c2cc34dbea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:30.973807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fadbf10d-17f5-4b3d-bdbc-10c2cc34dbea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:30.974346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fadbf10d-17f5-4b3d-bdbc-10c2cc34dbea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:30.976902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fadbf10d-17f5-4b3d-bdbc-10c2cc34dbea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:30.977866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fadbf10d-17f5-4b3d-bdbc-10c2cc34dbea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:30.978366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fadbf10d-17f5-4b3d-bdbc-10c2cc34dbea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:30.979016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fadbf10d-17f5-4b3d-bdbc-10c2cc34dbea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:31.053445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-507fb827-eb8a-4bf1-8104-bd01725d6ea4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:31.066566 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-507fb827-eb8a-4bf1-8104-bd01725d6ea4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1191 microversion: 2.1 time: 0.194192 Oct 27 19:27:31.067235 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3455/6758] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:30 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1191 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:31.172071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fadbf10d-17f5-4b3d-bdbc-10c2cc34dbea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:31.182698 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fadbf10d-17f5-4b3d-bdbc-10c2cc34dbea tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1667 microversion: 2.1 time: 0.232237 Oct 27 19:27:31.199048 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3304/6759] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:30 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1667 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:27:32.090345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb461187-1170-4f3b-8f5e-4cbff58e003c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:32.091074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb461187-1170-4f3b-8f5e-4cbff58e003c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:32.108302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb461187-1170-4f3b-8f5e-4cbff58e003c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:32.108989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb461187-1170-4f3b-8f5e-4cbff58e003c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:32.109457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb461187-1170-4f3b-8f5e-4cbff58e003c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:32.110200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb461187-1170-4f3b-8f5e-4cbff58e003c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:32.110714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb461187-1170-4f3b-8f5e-4cbff58e003c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:32.111173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb461187-1170-4f3b-8f5e-4cbff58e003c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:32.237979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-eb461187-1170-4f3b-8f5e-4cbff58e003c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:32.249783 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb461187-1170-4f3b-8f5e-4cbff58e003c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1209 microversion: 2.1 time: 0.161302 Oct 27 19:27:32.265196 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3305/6760] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:32 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1209 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:32.290608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0ace7aac-3cbc-418d-bb63-dd4b8d192379 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:32.291284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0ace7aac-3cbc-418d-bb63-dd4b8d192379 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:32.301242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-54317164-cebe-439b-9e4a-237bb68d7fb6 req-7867dca3-ab8b-4df8-b704-c4e8a75b33c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52566304-d33c-4d27-ad0e-edc4b0d3131d", "name": "network-vif-deleted", "tag": "37e914e5-1732-4018-8349-9d980df65e1a"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:27:32.308536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ace7aac-3cbc-418d-bb63-dd4b8d192379 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:32.311664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ace7aac-3cbc-418d-bb63-dd4b8d192379 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:32.312225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ace7aac-3cbc-418d-bb63-dd4b8d192379 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:32.313061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ace7aac-3cbc-418d-bb63-dd4b8d192379 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:32.313748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ace7aac-3cbc-418d-bb63-dd4b8d192379 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:32.314412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ace7aac-3cbc-418d-bb63-dd4b8d192379 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:32.331223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-54317164-cebe-439b-9e4a-237bb68d7fb6 req-7867dca3-ab8b-4df8-b704-c4e8a75b33c7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:32.332543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-54317164-cebe-439b-9e4a-237bb68d7fb6 req-7867dca3-ab8b-4df8-b704-c4e8a75b33c7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:32.334572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-54317164-cebe-439b-9e4a-237bb68d7fb6 req-7867dca3-ab8b-4df8-b704-c4e8a75b33c7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:32.362521 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-54317164-cebe-439b-9e4a-237bb68d7fb6 req-7867dca3-ab8b-4df8-b704-c4e8a75b33c7 service nova] Creating event network-vif-deleted:37e914e5-1732-4018-8349-9d980df65e1a for instance 52566304-d33c-4d27-ad0e-edc4b0d3131d on n-h1-860687-3 Oct 27 19:27:32.383953 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-54317164-cebe-439b-9e4a-237bb68d7fb6 req-7867dca3-ab8b-4df8-b704-c4e8a75b33c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.623775 Oct 27 19:27:32.392446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ace7aac-3cbc-418d-bb63-dd4b8d192379 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:32.395092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ace7aac-3cbc-418d-bb63-dd4b8d192379 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:32.395819 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3456/6761] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:27:32.396910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ace7aac-3cbc-418d-bb63-dd4b8d192379 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:32.397797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-0ace7aac-3cbc-418d-bb63-dd4b8d192379 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lazy-loading 'fault' on Instance uuid 52566304-d33c-4d27-ad0e-edc4b0d3131d {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:27:32.472839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0ace7aac-3cbc-418d-bb63-dd4b8d192379 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c460e1808e4a4788b1fc3984eb4ab43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ecef554af04d36a8c61e2b30d8f9e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:32.483392 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0ace7aac-3cbc-418d-bb63-dd4b8d192379 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 200 len: 1337 microversion: 2.1 time: 0.209696 Oct 27 19:27:32.506416 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3306/6762] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:32 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 1337 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:33.277830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d40d4855-0834-4fce-8dbe-f058fbf8bf71 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:33.278566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d40d4855-0834-4fce-8dbe-f058fbf8bf71 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:33.297648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d40d4855-0834-4fce-8dbe-f058fbf8bf71 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:33.298162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d40d4855-0834-4fce-8dbe-f058fbf8bf71 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:33.298629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d40d4855-0834-4fce-8dbe-f058fbf8bf71 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:33.300280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d40d4855-0834-4fce-8dbe-f058fbf8bf71 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:33.303773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d40d4855-0834-4fce-8dbe-f058fbf8bf71 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:33.304868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d40d4855-0834-4fce-8dbe-f058fbf8bf71 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:33.507304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa378ef7-9d67-4f18-ae44-94e94c49cb02 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:33.507936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa378ef7-9d67-4f18-ae44-94e94c49cb02 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] [instance: 52566304-d33c-4d27-ad0e-edc4b0d3131d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:33.517900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa378ef7-9d67-4f18-ae44-94e94c49cb02 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:33.519996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa378ef7-9d67-4f18-ae44-94e94c49cb02 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:33.521609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa378ef7-9d67-4f18-ae44-94e94c49cb02 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:33.523933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa378ef7-9d67-4f18-ae44-94e94c49cb02 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:33.526309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa378ef7-9d67-4f18-ae44-94e94c49cb02 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:33.526973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa378ef7-9d67-4f18-ae44-94e94c49cb02 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:33.550205 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-fa378ef7-9d67-4f18-ae44-94e94c49cb02 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] HTTP exception thrown: Instance 52566304-d33c-4d27-ad0e-edc4b0d3131d could not be found. Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa378ef7-9d67-4f18-ae44-94e94c49cb02 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Request method failure captured: Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d HTTP/1.1 Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtq_8gJvgEp4VLwuycEe_R5NX8I-OfFiLuieg3_64JL-AobuIrLvvQBeXRLGz2hDfifq0mADDOlljKPHvmvYayORz_0VgKK9HTckdF7Jtfg-5uA-6RSz8Wm-jjvYuQGM3ONqY2zVl7SVDvXXvKz58liFZH9D8ZRrakUfPnT1BJZh27Q Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: e2ecef554af04d36a8c61e2b30d8f9e8 Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestNetworkBasicOps-2070918579 Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ecef554af04d36a8c61e2b30d8f9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ecef554af04d36a8c61e2b30d8f9e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ecef554af04d36a8c61e2b30d8f9e8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ecef554af04d36a8c61e2b30d8f9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestNetworkBasicOps-2070918579 Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: e2ecef554af04d36a8c61e2b30d8f9e8 Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestNetworkBasicOps-2070918579 Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestNetworkBasicOps-2070918579-project Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c460e1808e4a4788b1fc3984eb4ab43b Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestNetworkBasicOps-2070918579-project Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 52566304-d33c-4d27-ad0e-edc4b0d3131d could not be found. Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '52566304-d33c-4d27-ad0e-edc4b0d3131d'} Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52566304-d33c-4d27-ad0e-edc4b0d3131d could not be found. Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52566304-d33c-4d27-ad0e-edc4b0d3131d could not be found. Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:27:33.552664 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:27:33.558252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:27:33.558252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:27:33.558252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:27:33.558252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:27:33.558252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:27:33.558252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52566304-d33c-4d27-ad0e-edc4b0d3131d could not be found. Oct 27 19:27:33.558252 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:27:33.559788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa378ef7-9d67-4f18-ae44-94e94c49cb02 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Returning 404 to user: Instance 52566304-d33c-4d27-ad0e-edc4b0d3131d could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:27:33.560845 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fa378ef7-9d67-4f18-ae44-94e94c49cb02 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d" status: 404 len: 111 microversion: 2.1 time: 0.057631 Oct 27 19:27:33.562107 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3307/6763] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:33 2022] GET /compute/v2.1/servers/52566304-d33c-4d27-ad0e-edc4b0d3131d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:27:33.656288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d40d4855-0834-4fce-8dbe-f058fbf8bf71 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:33.664726 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d40d4855-0834-4fce-8dbe-f058fbf8bf71 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1277 microversion: 2.1 time: 0.391315 Oct 27 19:27:33.669224 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3457/6764] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:33 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1277 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:33.812818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4676fe5f-7e45-4114-8712-37fc1c59e531 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] Calling method '.version_select at 0x7fc8698794c0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:33.879752 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4676fe5f-7e45-4114-8712-37fc1c59e531 tempest-TestNetworkBasicOps-2070918579 tempest-TestNetworkBasicOps-2070918579-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-682876238" status: 202 len: 0 microversion: 2.1 time: 0.072048 Oct 27 19:27:33.880959 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3308/6765] 10.222.0.42 () {58 vars in 1254 bytes} [Thu Oct 27 19:27:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-682876238 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:27:34.441627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-c349df8a-6089-4d72-91be-1fe03a156c21 req-a7d54f35-d34a-4f4f-acda-7682dec03ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66ae73ec-73d0-4c47-b3ce-072de1189a9d", "tag": "d144f7e4-4148-43a7-b647-7a1cb79f4b70"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:27:34.464593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c349df8a-6089-4d72-91be-1fe03a156c21 req-a7d54f35-d34a-4f4f-acda-7682dec03ca6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:34.466162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c349df8a-6089-4d72-91be-1fe03a156c21 req-a7d54f35-d34a-4f4f-acda-7682dec03ca6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:34.469823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c349df8a-6089-4d72-91be-1fe03a156c21 req-a7d54f35-d34a-4f4f-acda-7682dec03ca6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:34.488648 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-c349df8a-6089-4d72-91be-1fe03a156c21 req-a7d54f35-d34a-4f4f-acda-7682dec03ca6 service nova] Creating event network-changed:d144f7e4-4148-43a7-b647-7a1cb79f4b70 for instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d on n-h1-860687-3 Oct 27 19:27:34.494625 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-c349df8a-6089-4d72-91be-1fe03a156c21 req-a7d54f35-d34a-4f4f-acda-7682dec03ca6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057009 Oct 27 19:27:34.495654 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3458/6766] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:27:34.696767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-986dce5f-feef-4ca3-bc39-24653e75e1ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:34.698020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-986dce5f-feef-4ca3-bc39-24653e75e1ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:34.716940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-986dce5f-feef-4ca3-bc39-24653e75e1ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:34.717765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-986dce5f-feef-4ca3-bc39-24653e75e1ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:34.718712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-986dce5f-feef-4ca3-bc39-24653e75e1ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:34.720446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-986dce5f-feef-4ca3-bc39-24653e75e1ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:34.725367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-986dce5f-feef-4ca3-bc39-24653e75e1ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:34.726112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-986dce5f-feef-4ca3-bc39-24653e75e1ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:35.076578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-986dce5f-feef-4ca3-bc39-24653e75e1ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:35.087084 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-986dce5f-feef-4ca3-bc39-24653e75e1ac tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1277 microversion: 2.1 time: 0.396857 Oct 27 19:27:35.089652 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3309/6767] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:34 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1277 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:36.112494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d047f94-ff7d-42fb-8e64-c7a2066d9b16 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:36.113893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9d047f94-ff7d-42fb-8e64-c7a2066d9b16 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:36.131415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d047f94-ff7d-42fb-8e64-c7a2066d9b16 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:36.131929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d047f94-ff7d-42fb-8e64-c7a2066d9b16 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:36.132389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d047f94-ff7d-42fb-8e64-c7a2066d9b16 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:36.133268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d047f94-ff7d-42fb-8e64-c7a2066d9b16 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:36.133744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d047f94-ff7d-42fb-8e64-c7a2066d9b16 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:36.134187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d047f94-ff7d-42fb-8e64-c7a2066d9b16 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:36.469090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9d047f94-ff7d-42fb-8e64-c7a2066d9b16 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:36.488024 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9d047f94-ff7d-42fb-8e64-c7a2066d9b16 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1277 microversion: 2.1 time: 0.380319 Oct 27 19:27:36.499383 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3459/6768] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:36 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1277 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:37.512867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c8a0e29f-2649-408c-972e-a2b5216ffdf1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:37.515338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c8a0e29f-2649-408c-972e-a2b5216ffdf1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:37.531631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8a0e29f-2649-408c-972e-a2b5216ffdf1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:37.536379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8a0e29f-2649-408c-972e-a2b5216ffdf1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:37.537172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8a0e29f-2649-408c-972e-a2b5216ffdf1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:37.538189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8a0e29f-2649-408c-972e-a2b5216ffdf1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:37.538934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8a0e29f-2649-408c-972e-a2b5216ffdf1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:37.539644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8a0e29f-2649-408c-972e-a2b5216ffdf1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:37.870982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c8a0e29f-2649-408c-972e-a2b5216ffdf1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:37.882673 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c8a0e29f-2649-408c-972e-a2b5216ffdf1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1277 microversion: 2.1 time: 0.373806 Oct 27 19:27:37.893267 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3310/6769] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:37 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1277 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:38.937768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42c9c5a4-e7b9-463c-8bf1-8742c9f838fd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:38.939376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-42c9c5a4-e7b9-463c-8bf1-8742c9f838fd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:38.961585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c9c5a4-e7b9-463c-8bf1-8742c9f838fd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:38.963766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c9c5a4-e7b9-463c-8bf1-8742c9f838fd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:38.964226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c9c5a4-e7b9-463c-8bf1-8742c9f838fd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:38.968259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c9c5a4-e7b9-463c-8bf1-8742c9f838fd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:38.974640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c9c5a4-e7b9-463c-8bf1-8742c9f838fd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:38.975183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42c9c5a4-e7b9-463c-8bf1-8742c9f838fd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:39.546552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-42c9c5a4-e7b9-463c-8bf1-8742c9f838fd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:39.556156 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-42c9c5a4-e7b9-463c-8bf1-8742c9f838fd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1277 microversion: 2.1 time: 0.640691 Oct 27 19:27:39.556747 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3460/6770] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:38 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1277 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:40.581884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-75e9f335-f1be-4553-b959-af668df1d864 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:40.583489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-75e9f335-f1be-4553-b959-af668df1d864 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:40.591956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:27:40.594395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:27:40.596853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75e9f335-f1be-4553-b959-af668df1d864 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:40.597735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75e9f335-f1be-4553-b959-af668df1d864 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:40.598629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75e9f335-f1be-4553-b959-af668df1d864 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:40.600439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75e9f335-f1be-4553-b959-af668df1d864 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:40.601607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75e9f335-f1be-4553-b959-af668df1d864 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:40.602706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-75e9f335-f1be-4553-b959-af668df1d864 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:40.860357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-75e9f335-f1be-4553-b959-af668df1d864 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:40.868779 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-75e9f335-f1be-4553-b959-af668df1d864 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1265 microversion: 2.1 time: 0.292702 Oct 27 19:27:40.869933 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3311/6771] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:40 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:41.894170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4e3ca2f3-b7b3-4ba1-be84-328f11f19235 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:41.894853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4e3ca2f3-b7b3-4ba1-be84-328f11f19235 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:41.906984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:27:41.910030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e3ca2f3-b7b3-4ba1-be84-328f11f19235 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:41.910713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e3ca2f3-b7b3-4ba1-be84-328f11f19235 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:41.911239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e3ca2f3-b7b3-4ba1-be84-328f11f19235 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:41.912104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e3ca2f3-b7b3-4ba1-be84-328f11f19235 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:41.912701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e3ca2f3-b7b3-4ba1-be84-328f11f19235 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:41.913449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4e3ca2f3-b7b3-4ba1-be84-328f11f19235 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:42.137317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4e3ca2f3-b7b3-4ba1-be84-328f11f19235 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:42.148204 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4e3ca2f3-b7b3-4ba1-be84-328f11f19235 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1265 microversion: 2.1 time: 0.256208 Oct 27 19:27:42.150308 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3461/6772] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:41 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:43.175842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c8db0455-8758-46fa-bc5f-6f5594230cc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:43.177049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c8db0455-8758-46fa-bc5f-6f5594230cc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:43.184723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8db0455-8758-46fa-bc5f-6f5594230cc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:43.186089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8db0455-8758-46fa-bc5f-6f5594230cc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:43.186966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8db0455-8758-46fa-bc5f-6f5594230cc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:43.188070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8db0455-8758-46fa-bc5f-6f5594230cc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:43.189039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8db0455-8758-46fa-bc5f-6f5594230cc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:43.189658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8db0455-8758-46fa-bc5f-6f5594230cc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:43.376587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c8db0455-8758-46fa-bc5f-6f5594230cc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:43.387238 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c8db0455-8758-46fa-bc5f-6f5594230cc8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1265 microversion: 2.1 time: 0.215157 Oct 27 19:27:43.394675 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3312/6773] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:43 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:44.413688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a13e1c7a-1204-4c73-b07f-9011a2033eae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:44.414950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a13e1c7a-1204-4c73-b07f-9011a2033eae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:44.434771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a13e1c7a-1204-4c73-b07f-9011a2033eae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:44.436593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a13e1c7a-1204-4c73-b07f-9011a2033eae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:44.437420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a13e1c7a-1204-4c73-b07f-9011a2033eae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:44.440403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a13e1c7a-1204-4c73-b07f-9011a2033eae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:44.442137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a13e1c7a-1204-4c73-b07f-9011a2033eae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:44.444565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a13e1c7a-1204-4c73-b07f-9011a2033eae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:44.711469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a13e1c7a-1204-4c73-b07f-9011a2033eae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:44.723302 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a13e1c7a-1204-4c73-b07f-9011a2033eae tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1265 microversion: 2.1 time: 0.315581 Oct 27 19:27:44.724135 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3462/6774] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:44 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1265 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:45.749050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a2c3595f-af5e-4e55-b82a-be0efd623ab7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:45.749808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a2c3595f-af5e-4e55-b82a-be0efd623ab7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:45.765529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2c3595f-af5e-4e55-b82a-be0efd623ab7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:45.766429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2c3595f-af5e-4e55-b82a-be0efd623ab7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:45.767112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2c3595f-af5e-4e55-b82a-be0efd623ab7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:45.768107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2c3595f-af5e-4e55-b82a-be0efd623ab7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:45.769168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2c3595f-af5e-4e55-b82a-be0efd623ab7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:45.769880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2c3595f-af5e-4e55-b82a-be0efd623ab7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:45.960989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a2c3595f-af5e-4e55-b82a-be0efd623ab7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:45.971249 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a2c3595f-af5e-4e55-b82a-be0efd623ab7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1265 microversion: 2.1 time: 0.227346 Oct 27 19:27:45.972470 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3313/6775] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:45 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:46.999887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce08498b-2b39-425c-bbd2-95f30e951d6a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:47.000500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ce08498b-2b39-425c-bbd2-95f30e951d6a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:47.007535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce08498b-2b39-425c-bbd2-95f30e951d6a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:47.008042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce08498b-2b39-425c-bbd2-95f30e951d6a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:47.008485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce08498b-2b39-425c-bbd2-95f30e951d6a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:47.009187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce08498b-2b39-425c-bbd2-95f30e951d6a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:47.009643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce08498b-2b39-425c-bbd2-95f30e951d6a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:47.010069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce08498b-2b39-425c-bbd2-95f30e951d6a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:47.180182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ce08498b-2b39-425c-bbd2-95f30e951d6a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:47.188642 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce08498b-2b39-425c-bbd2-95f30e951d6a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1265 microversion: 2.1 time: 0.192597 Oct 27 19:27:47.189233 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3463/6776] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:46 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:48.212382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d39a2444-795d-4411-9060-8ec2401bbbb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:48.213603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d39a2444-795d-4411-9060-8ec2401bbbb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:48.221341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d39a2444-795d-4411-9060-8ec2401bbbb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:48.222091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d39a2444-795d-4411-9060-8ec2401bbbb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:48.222744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d39a2444-795d-4411-9060-8ec2401bbbb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:48.223532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d39a2444-795d-4411-9060-8ec2401bbbb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:48.224012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d39a2444-795d-4411-9060-8ec2401bbbb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:48.224460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d39a2444-795d-4411-9060-8ec2401bbbb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:48.415949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d39a2444-795d-4411-9060-8ec2401bbbb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:48.429371 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d39a2444-795d-4411-9060-8ec2401bbbb2 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1265 microversion: 2.1 time: 0.221040 Oct 27 19:27:48.430557 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3314/6777] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:48 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:49.455609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-93c6f13b-f68c-45da-b601-df5476bd49b8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:49.456524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-93c6f13b-f68c-45da-b601-df5476bd49b8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:49.463806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93c6f13b-f68c-45da-b601-df5476bd49b8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:49.464420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93c6f13b-f68c-45da-b601-df5476bd49b8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:49.465147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93c6f13b-f68c-45da-b601-df5476bd49b8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:49.467197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93c6f13b-f68c-45da-b601-df5476bd49b8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:49.467789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93c6f13b-f68c-45da-b601-df5476bd49b8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:49.468338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93c6f13b-f68c-45da-b601-df5476bd49b8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:49.724343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-93c6f13b-f68c-45da-b601-df5476bd49b8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:49.735544 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-93c6f13b-f68c-45da-b601-df5476bd49b8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1265 microversion: 2.1 time: 0.284631 Oct 27 19:27:49.736223 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3464/6778] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:49 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:50.020722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d3129f9c-e0a7-4ae1-aaa6-a4afc8f0e86f req-0f16ad7a-e0ad-4c8f-9a5f-b91abe72f72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ae73ec-73d0-4c47-b3ce-072de1189a9d", "name": "network-vif-plugged", "status": "completed", "tag": "d144f7e4-4148-43a7-b647-7a1cb79f4b70"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:27:50.045214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:27:50.049525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d3129f9c-e0a7-4ae1-aaa6-a4afc8f0e86f req-0f16ad7a-e0ad-4c8f-9a5f-b91abe72f72a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:50.050287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d3129f9c-e0a7-4ae1-aaa6-a4afc8f0e86f req-0f16ad7a-e0ad-4c8f-9a5f-b91abe72f72a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:50.051040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d3129f9c-e0a7-4ae1-aaa6-a4afc8f0e86f req-0f16ad7a-e0ad-4c8f-9a5f-b91abe72f72a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:50.066683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=71 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:27:50.070869 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d3129f9c-e0a7-4ae1-aaa6-a4afc8f0e86f req-0f16ad7a-e0ad-4c8f-9a5f-b91abe72f72a service nova] Creating event network-vif-plugged:d144f7e4-4148-43a7-b647-7a1cb79f4b70 for instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d on n-h1-860687-3 Oct 27 19:27:50.086089 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d3129f9c-e0a7-4ae1-aaa6-a4afc8f0e86f req-0f16ad7a-e0ad-4c8f-9a5f-b91abe72f72a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074142 Oct 27 19:27:50.087175 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3315/6779] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:27:50.758876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cca13f92-4a30-4ce4-9d15-1624a09cfa80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:50.760145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cca13f92-4a30-4ce4-9d15-1624a09cfa80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:50.768858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cca13f92-4a30-4ce4-9d15-1624a09cfa80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:50.769655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cca13f92-4a30-4ce4-9d15-1624a09cfa80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:50.770287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cca13f92-4a30-4ce4-9d15-1624a09cfa80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:50.771213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cca13f92-4a30-4ce4-9d15-1624a09cfa80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:50.771844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cca13f92-4a30-4ce4-9d15-1624a09cfa80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:50.772445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cca13f92-4a30-4ce4-9d15-1624a09cfa80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:51.155676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cca13f92-4a30-4ce4-9d15-1624a09cfa80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:51.177804 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cca13f92-4a30-4ce4-9d15-1624a09cfa80 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1265 microversion: 2.1 time: 0.422118 Oct 27 19:27:51.199542 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3465/6780] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:50 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1265 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:52.212630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ec3bf5fd-d019-4148-8b3e-21e1dc4e31c9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:52.213397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ec3bf5fd-d019-4148-8b3e-21e1dc4e31c9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:52.220644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec3bf5fd-d019-4148-8b3e-21e1dc4e31c9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:52.221430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec3bf5fd-d019-4148-8b3e-21e1dc4e31c9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:52.222056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec3bf5fd-d019-4148-8b3e-21e1dc4e31c9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:52.223097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec3bf5fd-d019-4148-8b3e-21e1dc4e31c9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:52.223738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec3bf5fd-d019-4148-8b3e-21e1dc4e31c9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:52.224340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ec3bf5fd-d019-4148-8b3e-21e1dc4e31c9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:52.448506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ec3bf5fd-d019-4148-8b3e-21e1dc4e31c9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:52.462665 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ec3bf5fd-d019-4148-8b3e-21e1dc4e31c9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1452 microversion: 2.1 time: 0.258860 Oct 27 19:27:52.467012 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3316/6781] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:52 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1452 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:27:52.487355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-40d6cbbd-c850-479f-9534-5855702bebed tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:27:52.488621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-40d6cbbd-c850-479f-9534-5855702bebed tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:27:52.497681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40d6cbbd-c850-479f-9534-5855702bebed tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:52.498601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40d6cbbd-c850-479f-9534-5855702bebed tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:52.499230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40d6cbbd-c850-479f-9534-5855702bebed tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:52.500136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40d6cbbd-c850-479f-9534-5855702bebed tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:52.500799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40d6cbbd-c850-479f-9534-5855702bebed tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:52.501412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-40d6cbbd-c850-479f-9534-5855702bebed tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:52.769254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-40d6cbbd-c850-479f-9534-5855702bebed tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:27:52.785189 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-40d6cbbd-c850-479f-9534-5855702bebed tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1452 microversion: 2.1 time: 0.302088 Oct 27 19:27:52.786625 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3466/6782] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:27:52 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1452 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:27:54.983077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f902bc5d-9452-4b9a-b805-ee0993f2fadc req-cc3429e8-1845-490d-8dc1-53cd4eeed883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66ae73ec-73d0-4c47-b3ce-072de1189a9d", "tag": "d144f7e4-4148-43a7-b647-7a1cb79f4b70"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:27:54.994014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f902bc5d-9452-4b9a-b805-ee0993f2fadc req-cc3429e8-1845-490d-8dc1-53cd4eeed883 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:27:54.994785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f902bc5d-9452-4b9a-b805-ee0993f2fadc req-cc3429e8-1845-490d-8dc1-53cd4eeed883 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:27:54.995446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f902bc5d-9452-4b9a-b805-ee0993f2fadc req-cc3429e8-1845-490d-8dc1-53cd4eeed883 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:27:55.007925 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f902bc5d-9452-4b9a-b805-ee0993f2fadc req-cc3429e8-1845-490d-8dc1-53cd4eeed883 service nova] Creating event network-changed:d144f7e4-4148-43a7-b647-7a1cb79f4b70 for instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d on n-h1-860687-3 Oct 27 19:27:55.014156 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f902bc5d-9452-4b9a-b805-ee0993f2fadc req-cc3429e8-1845-490d-8dc1-53cd4eeed883 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035380 Oct 27 19:27:55.015559 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3317/6783] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:28:25.733077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bd2cd668-d2ae-4e42-a1e2-c25a1052840f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:28:25.735936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bd2cd668-d2ae-4e42-a1e2-c25a1052840f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:28:25.748222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:28:25.755847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:28:25.758535 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 19:28:25.760187 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 19:28:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00/action (ip 10.222.0.42) !!! Oct 27 19:28:25.778708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd2cd668-d2ae-4e42-a1e2-c25a1052840f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:25.779626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd2cd668-d2ae-4e42-a1e2-c25a1052840f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:25.781475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd2cd668-d2ae-4e42-a1e2-c25a1052840f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:25.783607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd2cd668-d2ae-4e42-a1e2-c25a1052840f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:25.784597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd2cd668-d2ae-4e42-a1e2-c25a1052840f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:25.785510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd2cd668-d2ae-4e42-a1e2-c25a1052840f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:25.865131 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bd2cd668-d2ae-4e42-a1e2-c25a1052840f tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "POST /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00/action" status: 200 len: 40132 microversion: 2.1 time: 0.138624 Oct 27 19:28:25.866151 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3467/6784] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:28:25 2022] POST /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00/action => generated 40132 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 19:28:26.045996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=5 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:28:26.048194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=9 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:28:26.236916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0a418f2d-20f4-48e7-9458-2db3d54f5fc0 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1332293849", "availability_zone": "foo_zone"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:28:26.241645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.aggregate [None req-0a418f2d-20f4-48e7-9458-2db3d54f5fc0 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Generated uuid 8026ab8d-1eb4-4095-813a-b3bed9edc8b2 for aggregate {{(pid=127028) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 19:28:26.289102 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0a418f2d-20f4-48e7-9458-2db3d54f5fc0 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.248669 Oct 27 19:28:26.290168 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3318/6785] 10.222.0.42 () {60 vars in 1164 bytes} [Thu Oct 27 19:28:26 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:28:26.302700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e77e25d3-baca-40ec-92e1-ea5c20733398 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:28:26.359679 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e77e25d3-baca-40ec-92e1-ea5c20733398 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.061754 Oct 27 19:28:26.362092 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3468/6786] 10.222.0.42 () {60 vars in 1194 bytes} [Thu Oct 27 19:28:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:28:26.378585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7a5e873c-c875-4f75-9234-bf156f296432 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:26.383477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a5e873c-c875-4f75-9234-bf156f296432 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:26.384032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a5e873c-c875-4f75-9234-bf156f296432 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:26.384497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a5e873c-c875-4f75-9234-bf156f296432 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:26.385362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a5e873c-c875-4f75-9234-bf156f296432 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:26.385806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a5e873c-c875-4f75-9234-bf156f296432 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:26.387063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a5e873c-c875-4f75-9234-bf156f296432 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:26.481121 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7a5e873c-c875-4f75-9234-bf156f296432 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.106393 Oct 27 19:28:26.494527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-24e524a7-939a-4298-89c0-b4b43b3320a5 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:26.499572 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3319/6787] 10.222.0.42 () {58 vars in 1176 bytes} [Thu Oct 27 19:28:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:28:26.510349 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-24e524a7-939a-4298-89c0-b4b43b3320a5 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.017168 Oct 27 19:28:26.512123 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3469/6788] 10.222.0.42 () {58 vars in 1143 bytes} [Thu Oct 27 19:28:26 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:28:26.525799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7c7ac24f-438e-4602-aafb-cbe37a92b436 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-3"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:28:26.548050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c7ac24f-438e-4602-aafb-cbe37a92b436 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:26.548729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c7ac24f-438e-4602-aafb-cbe37a92b436 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:26.555421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c7ac24f-438e-4602-aafb-cbe37a92b436 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:26.991134 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7c7ac24f-438e-4602-aafb-cbe37a92b436 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.471258 Oct 27 19:28:26.993154 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3320/6789] 10.222.0.42 () {60 vars in 1194 bytes} [Thu Oct 27 19:28:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:28:27.006861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6adff43c-3d19-4b43-bbd9-003b74c05309 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:27.024659 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6adff43c-3d19-4b43-bbd9-003b74c05309 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.022006 Oct 27 19:28:27.026538 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3470/6790] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 19:28:26 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:28:27.037347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-72c9807e-bf37-4042-94bc-7eb6c243f289 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-267478352", "availability_zone": "foo_zone"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:28:27.190734 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-72c9807e-bf37-4042-94bc-7eb6c243f289 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.156798 Oct 27 19:28:27.192948 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3321/6791] 10.222.0.42 () {60 vars in 1173 bytes} [Thu Oct 27 19:28:27 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:28:27.212402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-038d4f12-ba14-493a-b0bc-b9eda772a5a0 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:28:27.265333 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-038d4f12-ba14-493a-b0bc-b9eda772a5a0 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.062651 Oct 27 19:28:27.272471 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3471/6792] 10.222.0.42 () {60 vars in 1194 bytes} [Thu Oct 27 19:28:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:28:27.278556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1de8a6f2-04fc-4078-b814-fb6fe868e550 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:27.293626 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1de8a6f2-04fc-4078-b814-fb6fe868e550 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.019185 Oct 27 19:28:27.300749 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3322/6793] 10.222.0.42 () {58 vars in 1152 bytes} [Thu Oct 27 19:28:27 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:28:27.306617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-27411137-b007-4296-a5b3-7c2bf9a4aac7 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-3"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:28:27.320182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27411137-b007-4296-a5b3-7c2bf9a4aac7 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:27.320706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27411137-b007-4296-a5b3-7c2bf9a4aac7 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:27.321195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27411137-b007-4296-a5b3-7c2bf9a4aac7 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:27.567360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d0716d1-efda-4c6c-891b-300664f3ca06 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:27.568622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0d0716d1-efda-4c6c-891b-300664f3ca06 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:28:27.578460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d0716d1-efda-4c6c-891b-300664f3ca06 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:27.578460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d0716d1-efda-4c6c-891b-300664f3ca06 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:27.579344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d0716d1-efda-4c6c-891b-300664f3ca06 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:27.582536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d0716d1-efda-4c6c-891b-300664f3ca06 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:27.583205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d0716d1-efda-4c6c-891b-300664f3ca06 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:27.583776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d0716d1-efda-4c6c-891b-300664f3ca06 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:27.622822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0d0716d1-efda-4c6c-891b-300664f3ca06 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:28:27.749977 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d0716d1-efda-4c6c-891b-300664f3ca06 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "DELETE /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 204 len: 0 microversion: 2.1 time: 0.192200 Oct 27 19:28:27.750618 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3323/6794] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:28:27 2022] DELETE /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:28:27.756750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-70e498de-19b8-49b8-a446-dd84e2300036 req-288e257b-9109-42ff-8a1e-aac2ef269399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e2ca13-a2f2-4aac-9018-ef436b487e00", "tag": "f1ad43c0-31ac-45b2-a0ad-01368857adb2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:28:27.774075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-70e498de-19b8-49b8-a446-dd84e2300036 req-288e257b-9109-42ff-8a1e-aac2ef269399 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:27.774999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-70e498de-19b8-49b8-a446-dd84e2300036 req-288e257b-9109-42ff-8a1e-aac2ef269399 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:27.775713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-70e498de-19b8-49b8-a446-dd84e2300036 req-288e257b-9109-42ff-8a1e-aac2ef269399 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:27.791949 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-70e498de-19b8-49b8-a446-dd84e2300036 req-288e257b-9109-42ff-8a1e-aac2ef269399 service nova] Creating event network-changed:f1ad43c0-31ac-45b2-a0ad-01368857adb2 for instance 24e2ca13-a2f2-4aac-9018-ef436b487e00 on n-h2-860687-3 Oct 27 19:28:27.798202 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-70e498de-19b8-49b8-a446-dd84e2300036 req-288e257b-9109-42ff-8a1e-aac2ef269399 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045943 Oct 27 19:28:27.799378 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3324/6795] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:28:27.806790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5d222914-8816-4df9-a41c-8bbef59cae3e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:27.808513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5d222914-8816-4df9-a41c-8bbef59cae3e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:28:27.812385 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-27411137-b007-4296-a5b3-7c2bf9a4aac7 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.509943 Oct 27 19:28:27.819744 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3472/6796] 10.222.0.42 () {60 vars in 1194 bytes} [Thu Oct 27 19:28:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:28:27.819997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d222914-8816-4df9-a41c-8bbef59cae3e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:27.826702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d222914-8816-4df9-a41c-8bbef59cae3e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:27.826864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c3066b37-0ad3-47ce-bbc7-7bc4e18fe151 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:27.827672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d222914-8816-4df9-a41c-8bbef59cae3e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:27.828792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d222914-8816-4df9-a41c-8bbef59cae3e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:27.829595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d222914-8816-4df9-a41c-8bbef59cae3e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:27.830282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d222914-8816-4df9-a41c-8bbef59cae3e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:27.874672 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c3066b37-0ad3-47ce-bbc7-7bc4e18fe151 tempest-TestAggregatesBasicOps-1647363689 tempest-TestAggregatesBasicOps-1647363689-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.052736 Oct 27 19:28:27.878701 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3473/6797] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 19:28:27 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 27 19:28:28.041041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5d222914-8816-4df9-a41c-8bbef59cae3e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:28:28.050712 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5d222914-8816-4df9-a41c-8bbef59cae3e tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1687 microversion: 2.1 time: 0.249984 Oct 27 19:28:28.068025 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3325/6798] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:28:27 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1687 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:28:29.080928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7bca200a-92f5-4521-a55f-2fafed86bf37 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:29.081667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7bca200a-92f5-4521-a55f-2fafed86bf37 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:28:29.092732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bca200a-92f5-4521-a55f-2fafed86bf37 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:29.093303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bca200a-92f5-4521-a55f-2fafed86bf37 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:29.093749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bca200a-92f5-4521-a55f-2fafed86bf37 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:29.094494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bca200a-92f5-4521-a55f-2fafed86bf37 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:29.103214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bca200a-92f5-4521-a55f-2fafed86bf37 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:29.103679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7bca200a-92f5-4521-a55f-2fafed86bf37 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:29.852651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7bca200a-92f5-4521-a55f-2fafed86bf37 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f16b54dda477386daed20f1a2e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ac0c6e395469bb90c156aad129c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:28:29.861061 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7bca200a-92f5-4521-a55f-2fafed86bf37 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 200 len: 1687 microversion: 2.1 time: 0.784979 Oct 27 19:28:29.861657 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3474/6799] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:28:29 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 1687 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:28:30.008955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-44dc8e02-5616-4f6e-8354-c868b8020fb8 req-e4272957-1a38-47c6-9869-1c943eee3fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e2ca13-a2f2-4aac-9018-ef436b487e00", "name": "network-vif-deleted", "tag": "f1ad43c0-31ac-45b2-a0ad-01368857adb2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:28:30.033072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-44dc8e02-5616-4f6e-8354-c868b8020fb8 req-e4272957-1a38-47c6-9869-1c943eee3fc4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:30.033696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-44dc8e02-5616-4f6e-8354-c868b8020fb8 req-e4272957-1a38-47c6-9869-1c943eee3fc4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:30.038594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-44dc8e02-5616-4f6e-8354-c868b8020fb8 req-e4272957-1a38-47c6-9869-1c943eee3fc4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:30.056266 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-44dc8e02-5616-4f6e-8354-c868b8020fb8 req-e4272957-1a38-47c6-9869-1c943eee3fc4 service nova] Creating event network-vif-deleted:f1ad43c0-31ac-45b2-a0ad-01368857adb2 for instance 24e2ca13-a2f2-4aac-9018-ef436b487e00 on n-h2-860687-3 Oct 27 19:28:30.064576 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-44dc8e02-5616-4f6e-8354-c868b8020fb8 req-e4272957-1a38-47c6-9869-1c943eee3fc4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069502 Oct 27 19:28:30.065907 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3326/6800] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:28:30.890312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7199e941-3b27-4c97-841a-8f4af67c5aba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:30.890957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7199e941-3b27-4c97-841a-8f4af67c5aba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] [instance: 24e2ca13-a2f2-4aac-9018-ef436b487e00] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:28:30.905906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7199e941-3b27-4c97-841a-8f4af67c5aba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:30.906783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7199e941-3b27-4c97-841a-8f4af67c5aba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:30.907580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7199e941-3b27-4c97-841a-8f4af67c5aba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:30.908655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7199e941-3b27-4c97-841a-8f4af67c5aba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:30.910215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7199e941-3b27-4c97-841a-8f4af67c5aba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:30.910832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7199e941-3b27-4c97-841a-8f4af67c5aba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:30.931025 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-7199e941-3b27-4c97-841a-8f4af67c5aba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] HTTP exception thrown: Instance 24e2ca13-a2f2-4aac-9018-ef436b487e00 could not be found. Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7199e941-3b27-4c97-841a-8f4af67c5aba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Request method failure captured: Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 HTTP/1.1 Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWth-uE-L5hrFUr9RYtFBa20-n3WoCw93LoQ3rmxc3wuGw2wOUyFGeVumHG6CitxW2BQ_gI4upL36DmkN08Y2Y2Dzqu0geZsGjCkVWRBeHN3me4ZMtxNaaWwrBfsY64smWMRc2jLIbCc3BUZOyHtIp4Z7RZX-687YOz7etGENRciRsd4 Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 853ac0c6e395469bb90c156aad129c26 Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-969980032 Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/853ac0c6e395469bb90c156aad129c26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/853ac0c6e395469bb90c156aad129c26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_853ac0c6e395469bb90c156aad129c26", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/853ac0c6e395469bb90c156aad129c26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestNetworkAdvancedServerOps-969980032 Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 853ac0c6e395469bb90c156aad129c26 Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-969980032 Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestNetworkAdvancedServerOps-969980032-project Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ce7f16b54dda477386daed20f1a2e104 Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestNetworkAdvancedServerOps-969980032-project Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 24e2ca13-a2f2-4aac-9018-ef436b487e00 could not be found. Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '24e2ca13-a2f2-4aac-9018-ef436b487e00'} Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e2ca13-a2f2-4aac-9018-ef436b487e00 could not be found. Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e2ca13-a2f2-4aac-9018-ef436b487e00 could not be found. Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:28:30.934355 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:28:30.942417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:28:30.942417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:28:30.942417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:28:30.942417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:28:30.942417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:28:30.942417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:28:30.942417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e2ca13-a2f2-4aac-9018-ef436b487e00 could not be found. Oct 27 19:28:30.942417 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:28:30.944949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7199e941-3b27-4c97-841a-8f4af67c5aba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Returning 404 to user: Instance 24e2ca13-a2f2-4aac-9018-ef436b487e00 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:28:30.946084 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7199e941-3b27-4c97-841a-8f4af67c5aba tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00" status: 404 len: 111 microversion: 2.1 time: 0.060810 Oct 27 19:28:30.947607 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3475/6801] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:28:30 2022] GET /compute/v2.1/servers/24e2ca13-a2f2-4aac-9018-ef436b487e00 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:28:37.256716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:28:37.266257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1b2bbff9-c244-4026-8148-a979345b1f74 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] Calling method '.version_select at 0x7fc869cdc430>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:37.310196 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1b2bbff9-c244-4026-8148-a979345b1f74 tempest-TestNetworkAdvancedServerOps-969980032 tempest-TestNetworkAdvancedServerOps-969980032-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-110704288" status: 202 len: 0 microversion: 2.1 time: 0.057118 Oct 27 19:28:37.312305 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3327/6802] 10.222.0.42 () {58 vars in 1281 bytes} [Thu Oct 27 19:28:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-110704288 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:28:42.135675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:28:42.136551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=16 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:28:42.333588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d3bc3367-7ca0-4ee6-9f1b-9ec3a9b7a43b tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Action: 'create', calling method: .version_select at 0x7fc86a10df70>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-717801111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxNxnERPCs5sRTUq9K6ZGJNB1DhltmW+GlQHsCn32Ny82nd8KdeYZlLO5dZkH6ko09+iAMdboWXuKpn0nKQiqdZcS7/FW5eEyYWf+jaPV3/qdmuZ3ivzEblOBf/II2FEg=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:28:42.350687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-d3bc3367-7ca0-4ee6-9f1b-9ec3a9b7a43b tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Getting quotas for project ef53fd6f972d48af95acaf91edbc7630. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:28:42.356504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-d3bc3367-7ca0-4ee6-9f1b-9ec3a9b7a43b tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Getting quotas for user 6807ac75994940f890164e5e7650de80 and project ef53fd6f972d48af95acaf91edbc7630. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:28:42.384075 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d3bc3367-7ca0-4ee6-9f1b-9ec3a9b7a43b tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.255048 Oct 27 19:28:42.384751 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3476/6803] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:28:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:28:49.408832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:28:49.412959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:28:49.416871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1025766051-access_point-1959945676", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "4b593005-ba73-46f0-b49a-c9aa2a31d101"}], "key_name": "tempest-TestSecurityGroupsBasicOps-717801111", "security_groups": [{"name": "tempest-secgroup_access--1997597363"}, {"name": "tempest-secgroup_general--2027831449"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:28:49.625485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] validate_networks() for [('4b593005-ba73-46f0-b49a-c9aa2a31d101', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:28:50.159648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:28:50.160095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:28:50.161084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:28:50.161084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:28:50.161433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:28:50.179946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:50.182668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:50.185620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:50.187876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:50.189655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:50.192413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:50.237731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Getting quotas for project ef53fd6f972d48af95acaf91edbc7630. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:28:50.265352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Getting quotas for user 6807ac75994940f890164e5e7650de80 and project ef53fd6f972d48af95acaf91edbc7630. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:28:50.288895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:28:50.291562 n-d-860687-3 devstack@n-api.service[127028]: WARNING nova.utils [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1025766051-access_point-1959945676 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1025766051-ac Oct 27 19:28:50.292550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:28:50.376821 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-09cd5c63-854d-4d70-b078-2345597a454c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 0.969732 Oct 27 19:28:50.378371 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3328/6804] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:28:49 2022] POST /compute/v2.1/servers => generated 458 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:28:50.392491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1dcc22c5-a6b3-4818-bb8b-5ad38c3e5f28 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:50.395482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1dcc22c5-a6b3-4818-bb8b-5ad38c3e5f28 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:28:50.523212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1dcc22c5-a6b3-4818-bb8b-5ad38c3e5f28 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:28:50.545384 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1dcc22c5-a6b3-4818-bb8b-5ad38c3e5f28 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1294 microversion: 2.1 time: 0.159516 Oct 27 19:28:50.549872 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3477/6805] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:28:50 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1294 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:28:51.577343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f643cede-bb78-4f3f-93ed-edadeb54352f tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:51.578763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f643cede-bb78-4f3f-93ed-edadeb54352f tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:28:51.588094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f643cede-bb78-4f3f-93ed-edadeb54352f tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:51.589186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f643cede-bb78-4f3f-93ed-edadeb54352f tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:51.589780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f643cede-bb78-4f3f-93ed-edadeb54352f tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:51.590630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f643cede-bb78-4f3f-93ed-edadeb54352f tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:51.591319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f643cede-bb78-4f3f-93ed-edadeb54352f tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:51.591732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f643cede-bb78-4f3f-93ed-edadeb54352f tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:51.688585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f643cede-bb78-4f3f-93ed-edadeb54352f tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:28:51.699681 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f643cede-bb78-4f3f-93ed-edadeb54352f tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1346 microversion: 2.1 time: 0.129130 Oct 27 19:28:51.700883 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3329/6806] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:28:51 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1346 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:28:52.724665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a80a6ead-98f8-4d42-bb3c-c6c4a178e26c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:52.725294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a80a6ead-98f8-4d42-bb3c-c6c4a178e26c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:28:52.747946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a80a6ead-98f8-4d42-bb3c-c6c4a178e26c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:52.749091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a80a6ead-98f8-4d42-bb3c-c6c4a178e26c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:52.749603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a80a6ead-98f8-4d42-bb3c-c6c4a178e26c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:52.750363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a80a6ead-98f8-4d42-bb3c-c6c4a178e26c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:52.750868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a80a6ead-98f8-4d42-bb3c-c6c4a178e26c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:52.751475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a80a6ead-98f8-4d42-bb3c-c6c4a178e26c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:52.865960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a80a6ead-98f8-4d42-bb3c-c6c4a178e26c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:28:52.880355 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a80a6ead-98f8-4d42-bb3c-c6c4a178e26c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1352 microversion: 2.1 time: 0.159609 Oct 27 19:28:52.881635 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3478/6807] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:28:52 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1352 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:28:53.908351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b0579595-3a3e-40ac-978f-59ce4a70c631 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:53.909161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0579595-3a3e-40ac-978f-59ce4a70c631 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:28:53.916899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0579595-3a3e-40ac-978f-59ce4a70c631 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:53.917727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0579595-3a3e-40ac-978f-59ce4a70c631 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:53.918263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0579595-3a3e-40ac-978f-59ce4a70c631 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:53.919082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0579595-3a3e-40ac-978f-59ce4a70c631 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:53.919938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0579595-3a3e-40ac-978f-59ce4a70c631 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:53.920462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0579595-3a3e-40ac-978f-59ce4a70c631 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:54.153805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-b378b03a-734c-48eb-a6c5-97c8980b5633 req-0ab7a2f2-d8b6-4b4b-9201-8cbf000b4e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b76764fb-69a1-4e4f-af5c-2849a65fc90a", "tag": "9964b335-fdfe-471a-af53-3d9802f6192b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:28:54.174250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b378b03a-734c-48eb-a6c5-97c8980b5633 req-0ab7a2f2-d8b6-4b4b-9201-8cbf000b4e8c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:54.175100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b378b03a-734c-48eb-a6c5-97c8980b5633 req-0ab7a2f2-d8b6-4b4b-9201-8cbf000b4e8c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:54.175649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b378b03a-734c-48eb-a6c5-97c8980b5633 req-0ab7a2f2-d8b6-4b4b-9201-8cbf000b4e8c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:54.198686 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-b378b03a-734c-48eb-a6c5-97c8980b5633 req-0ab7a2f2-d8b6-4b4b-9201-8cbf000b4e8c service nova] Creating event network-changed:9964b335-fdfe-471a-af53-3d9802f6192b for instance b76764fb-69a1-4e4f-af5c-2849a65fc90a on n-h2-860687-3 Oct 27 19:28:54.209225 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-b378b03a-734c-48eb-a6c5-97c8980b5633 req-0ab7a2f2-d8b6-4b4b-9201-8cbf000b4e8c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060663 Oct 27 19:28:54.209869 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3479/6808] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:28:54.219758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0579595-3a3e-40ac-978f-59ce4a70c631 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:28:54.232555 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b0579595-3a3e-40ac-978f-59ce4a70c631 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1472 microversion: 2.1 time: 0.328000 Oct 27 19:28:54.234031 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3330/6809] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:28:53 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1472 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:28:55.262340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0bdfba27-3be6-4714-92ef-3a074856f4c8 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:55.263178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0bdfba27-3be6-4714-92ef-3a074856f4c8 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:28:55.269633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bdfba27-3be6-4714-92ef-3a074856f4c8 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:55.270290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bdfba27-3be6-4714-92ef-3a074856f4c8 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:55.270764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bdfba27-3be6-4714-92ef-3a074856f4c8 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:55.271460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bdfba27-3be6-4714-92ef-3a074856f4c8 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:55.271919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bdfba27-3be6-4714-92ef-3a074856f4c8 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:55.272346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0bdfba27-3be6-4714-92ef-3a074856f4c8 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:55.418438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0bdfba27-3be6-4714-92ef-3a074856f4c8 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:28:55.426472 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0bdfba27-3be6-4714-92ef-3a074856f4c8 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1472 microversion: 2.1 time: 0.169786 Oct 27 19:28:55.429977 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3480/6810] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:28:55 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1472 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:28:56.451496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-089e9552-44e1-4d38-bfcb-22a8a92b37fe tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:56.453206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-089e9552-44e1-4d38-bfcb-22a8a92b37fe tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:28:56.461168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-089e9552-44e1-4d38-bfcb-22a8a92b37fe tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:56.461650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-089e9552-44e1-4d38-bfcb-22a8a92b37fe tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:56.462532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-089e9552-44e1-4d38-bfcb-22a8a92b37fe tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:56.463921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-089e9552-44e1-4d38-bfcb-22a8a92b37fe tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:56.464537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-089e9552-44e1-4d38-bfcb-22a8a92b37fe tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:56.465132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-089e9552-44e1-4d38-bfcb-22a8a92b37fe tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:56.629161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-089e9552-44e1-4d38-bfcb-22a8a92b37fe tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:28:56.639323 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-089e9552-44e1-4d38-bfcb-22a8a92b37fe tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1472 microversion: 2.1 time: 0.192364 Oct 27 19:28:56.654409 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3331/6811] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:28:56 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1472 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:28:57.663554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3cc9eaf1-7726-45f6-ab3e-76802e30e2b7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:57.664209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3cc9eaf1-7726-45f6-ab3e-76802e30e2b7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:28:57.675608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3cc9eaf1-7726-45f6-ab3e-76802e30e2b7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:57.676120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3cc9eaf1-7726-45f6-ab3e-76802e30e2b7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:57.676572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3cc9eaf1-7726-45f6-ab3e-76802e30e2b7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:57.677303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3cc9eaf1-7726-45f6-ab3e-76802e30e2b7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:57.677769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3cc9eaf1-7726-45f6-ab3e-76802e30e2b7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:57.678374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3cc9eaf1-7726-45f6-ab3e-76802e30e2b7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:57.840477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3cc9eaf1-7726-45f6-ab3e-76802e30e2b7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:28:57.852964 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3cc9eaf1-7726-45f6-ab3e-76802e30e2b7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1472 microversion: 2.1 time: 0.193473 Oct 27 19:28:57.853672 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3481/6812] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:28:57 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1472 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:28:58.877182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c047e276-a034-4b3a-9397-b7063e33a024 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:28:58.878075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c047e276-a034-4b3a-9397-b7063e33a024 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:28:58.885424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c047e276-a034-4b3a-9397-b7063e33a024 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:58.886246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c047e276-a034-4b3a-9397-b7063e33a024 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:58.886959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c047e276-a034-4b3a-9397-b7063e33a024 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:58.887907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c047e276-a034-4b3a-9397-b7063e33a024 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:28:58.888724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c047e276-a034-4b3a-9397-b7063e33a024 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:28:58.889476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c047e276-a034-4b3a-9397-b7063e33a024 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:28:59.159741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c047e276-a034-4b3a-9397-b7063e33a024 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:28:59.170801 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c047e276-a034-4b3a-9397-b7063e33a024 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1472 microversion: 2.1 time: 0.297592 Oct 27 19:28:59.171749 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3332/6813] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:28:58 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:29:00.198554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6ed8197-cc64-4097-b2de-17e543e74502 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:29:00.199345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d6ed8197-cc64-4097-b2de-17e543e74502 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:29:00.208476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6ed8197-cc64-4097-b2de-17e543e74502 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:00.209782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6ed8197-cc64-4097-b2de-17e543e74502 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:00.210502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6ed8197-cc64-4097-b2de-17e543e74502 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:00.211952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6ed8197-cc64-4097-b2de-17e543e74502 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:00.213214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6ed8197-cc64-4097-b2de-17e543e74502 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:00.214256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6ed8197-cc64-4097-b2de-17e543e74502 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:00.400348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d6ed8197-cc64-4097-b2de-17e543e74502 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:29:00.409893 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d6ed8197-cc64-4097-b2de-17e543e74502 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1472 microversion: 2.1 time: 0.215653 Oct 27 19:29:00.411224 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3482/6814] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:29:00 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1472 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:29:00.592909 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-0f03e966-ef8e-43d4-86ac-2188177b3db1 req-009ec2d1-5a40-4fc0-bd32-9e2e82350b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76764fb-69a1-4e4f-af5c-2849a65fc90a", "name": "network-vif-plugged", "status": "completed", "tag": "9964b335-fdfe-471a-af53-3d9802f6192b"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:29:00.601348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:29:00.602669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:29:00.615630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0f03e966-ef8e-43d4-86ac-2188177b3db1 req-009ec2d1-5a40-4fc0-bd32-9e2e82350b27 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:00.616495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0f03e966-ef8e-43d4-86ac-2188177b3db1 req-009ec2d1-5a40-4fc0-bd32-9e2e82350b27 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:00.617206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0f03e966-ef8e-43d4-86ac-2188177b3db1 req-009ec2d1-5a40-4fc0-bd32-9e2e82350b27 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:00.637665 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-0f03e966-ef8e-43d4-86ac-2188177b3db1 req-009ec2d1-5a40-4fc0-bd32-9e2e82350b27 service nova] Creating event network-vif-plugged:9964b335-fdfe-471a-af53-3d9802f6192b for instance b76764fb-69a1-4e4f-af5c-2849a65fc90a on n-h2-860687-3 Oct 27 19:29:00.647681 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-0f03e966-ef8e-43d4-86ac-2188177b3db1 req-009ec2d1-5a40-4fc0-bd32-9e2e82350b27 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058496 Oct 27 19:29:00.648601 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3333/6815] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:29:01.440426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f5eebc96-9321-4543-949a-db301855825a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:29:01.441053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f5eebc96-9321-4543-949a-db301855825a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:29:01.445530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:29:01.454410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5eebc96-9321-4543-949a-db301855825a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:01.455217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5eebc96-9321-4543-949a-db301855825a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:01.455812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5eebc96-9321-4543-949a-db301855825a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:01.457637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5eebc96-9321-4543-949a-db301855825a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:01.458164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5eebc96-9321-4543-949a-db301855825a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:01.458781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f5eebc96-9321-4543-949a-db301855825a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:01.638782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f5eebc96-9321-4543-949a-db301855825a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:29:01.650201 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f5eebc96-9321-4543-949a-db301855825a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1472 microversion: 2.1 time: 0.219454 Oct 27 19:29:01.651065 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3483/6816] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:29:01 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1472 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:29:02.688552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bb943af9-f0bc-4d87-bf3b-a2877e3a62a1 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:29:02.690141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bb943af9-f0bc-4d87-bf3b-a2877e3a62a1 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:29:02.699578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb943af9-f0bc-4d87-bf3b-a2877e3a62a1 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:02.700604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb943af9-f0bc-4d87-bf3b-a2877e3a62a1 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:02.701216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb943af9-f0bc-4d87-bf3b-a2877e3a62a1 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:02.701966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb943af9-f0bc-4d87-bf3b-a2877e3a62a1 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:02.702467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb943af9-f0bc-4d87-bf3b-a2877e3a62a1 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:02.703071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb943af9-f0bc-4d87-bf3b-a2877e3a62a1 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:02.939915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bb943af9-f0bc-4d87-bf3b-a2877e3a62a1 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:29:02.949965 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bb943af9-f0bc-4d87-bf3b-a2877e3a62a1 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1643 microversion: 2.1 time: 0.266383 Oct 27 19:29:02.950841 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3334/6817] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:29:02 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1643 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:29:02.974737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1e0594fa-e897-464a-9090-5eb2de379edd tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:29:02.975366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1e0594fa-e897-464a-9090-5eb2de379edd tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:29:02.982772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e0594fa-e897-464a-9090-5eb2de379edd tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:02.983274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e0594fa-e897-464a-9090-5eb2de379edd tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:02.983725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e0594fa-e897-464a-9090-5eb2de379edd tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:02.984441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e0594fa-e897-464a-9090-5eb2de379edd tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:02.984905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e0594fa-e897-464a-9090-5eb2de379edd tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:02.985538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e0594fa-e897-464a-9090-5eb2de379edd tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:03.157621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1e0594fa-e897-464a-9090-5eb2de379edd tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:29:03.170588 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1e0594fa-e897-464a-9090-5eb2de379edd tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1643 microversion: 2.1 time: 0.199071 Oct 27 19:29:03.186470 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3484/6818] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:29:02 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1643 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:29:03.193953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-901f7268-b126-411e-9985-f2077f0c864c tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:29:03.194619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-901f7268-b126-411e-9985-f2077f0c864c tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:29:03.201669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-901f7268-b126-411e-9985-f2077f0c864c tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:03.202175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-901f7268-b126-411e-9985-f2077f0c864c tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:03.202692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-901f7268-b126-411e-9985-f2077f0c864c tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:03.203426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-901f7268-b126-411e-9985-f2077f0c864c tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:03.203897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-901f7268-b126-411e-9985-f2077f0c864c tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:03.204346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-901f7268-b126-411e-9985-f2077f0c864c tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:03.618065 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-901f7268-b126-411e-9985-f2077f0c864c tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1794 microversion: 2.1 time: 0.428085 Oct 27 19:29:03.628714 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3335/6819] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:29:03 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1794 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:29:05.547887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-b794ad42-061c-4c19-b06d-3aaf760fdaad req-067a807c-9ecc-4db9-bed3-853e84f1c42f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b76764fb-69a1-4e4f-af5c-2849a65fc90a", "tag": "9964b335-fdfe-471a-af53-3d9802f6192b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:29:05.567240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b794ad42-061c-4c19-b06d-3aaf760fdaad req-067a807c-9ecc-4db9-bed3-853e84f1c42f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:05.568553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b794ad42-061c-4c19-b06d-3aaf760fdaad req-067a807c-9ecc-4db9-bed3-853e84f1c42f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:05.569206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b794ad42-061c-4c19-b06d-3aaf760fdaad req-067a807c-9ecc-4db9-bed3-853e84f1c42f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:05.583742 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-b794ad42-061c-4c19-b06d-3aaf760fdaad req-067a807c-9ecc-4db9-bed3-853e84f1c42f service nova] Creating event network-changed:9964b335-fdfe-471a-af53-3d9802f6192b for instance b76764fb-69a1-4e4f-af5c-2849a65fc90a on n-h2-860687-3 Oct 27 19:29:05.590045 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-b794ad42-061c-4c19-b06d-3aaf760fdaad req-067a807c-9ecc-4db9-bed3-853e84f1c42f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045818 Oct 27 19:29:05.591795 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3485/6820] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:29:52.877674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d69f4878-e19a-401e-9494-19057ad0c601 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:29:52.878330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d69f4878-e19a-401e-9494-19057ad0c601 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:29:52.880746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:29:52.881547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=40 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:29:52.888509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d69f4878-e19a-401e-9494-19057ad0c601 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:52.889012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d69f4878-e19a-401e-9494-19057ad0c601 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:52.889468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d69f4878-e19a-401e-9494-19057ad0c601 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:52.890186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d69f4878-e19a-401e-9494-19057ad0c601 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:52.890750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d69f4878-e19a-401e-9494-19057ad0c601 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:52.891218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d69f4878-e19a-401e-9494-19057ad0c601 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:52.919038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d69f4878-e19a-401e-9494-19057ad0c601 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:29:52.999843 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d69f4878-e19a-401e-9494-19057ad0c601 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "DELETE /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 204 len: 0 microversion: 2.1 time: 0.126119 Oct 27 19:29:53.002464 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3336/6821] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:29:52 2022] DELETE /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:29:53.008972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:29:53.010128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=40 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:29:53.015675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-12cb8b04-2e9e-4888-b153-f462271aaeb1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:29:53.016389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-12cb8b04-2e9e-4888-b153-f462271aaeb1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:29:53.024333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12cb8b04-2e9e-4888-b153-f462271aaeb1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:53.024831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12cb8b04-2e9e-4888-b153-f462271aaeb1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:53.025272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12cb8b04-2e9e-4888-b153-f462271aaeb1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:53.025971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12cb8b04-2e9e-4888-b153-f462271aaeb1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:53.026448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12cb8b04-2e9e-4888-b153-f462271aaeb1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:53.026880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12cb8b04-2e9e-4888-b153-f462271aaeb1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:53.168368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-12cb8b04-2e9e-4888-b153-f462271aaeb1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:29:53.176603 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-12cb8b04-2e9e-4888-b153-f462271aaeb1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1577 microversion: 2.1 time: 0.170902 Oct 27 19:29:53.177205 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3486/6822] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:29:53 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:29:54.201773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-de9f9227-eb86-4016-99f6-7e3cead7c9ce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:29:54.202533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-de9f9227-eb86-4016-99f6-7e3cead7c9ce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:29:54.209818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de9f9227-eb86-4016-99f6-7e3cead7c9ce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:54.210910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de9f9227-eb86-4016-99f6-7e3cead7c9ce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:54.211561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de9f9227-eb86-4016-99f6-7e3cead7c9ce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:54.212274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de9f9227-eb86-4016-99f6-7e3cead7c9ce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:54.212743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de9f9227-eb86-4016-99f6-7e3cead7c9ce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:54.213187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de9f9227-eb86-4016-99f6-7e3cead7c9ce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:54.347537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-de9f9227-eb86-4016-99f6-7e3cead7c9ce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:29:54.355485 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-de9f9227-eb86-4016-99f6-7e3cead7c9ce tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1577 microversion: 2.1 time: 0.158046 Oct 27 19:29:54.356068 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3337/6823] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:29:54 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:29:55.378880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-34d9cbb3-3e7b-4dbb-bdd8-b8f7aa0867f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:29:55.379501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-34d9cbb3-3e7b-4dbb-bdd8-b8f7aa0867f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:29:55.386971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d9cbb3-3e7b-4dbb-bdd8-b8f7aa0867f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:55.387495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d9cbb3-3e7b-4dbb-bdd8-b8f7aa0867f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:55.387934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d9cbb3-3e7b-4dbb-bdd8-b8f7aa0867f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:55.388697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d9cbb3-3e7b-4dbb-bdd8-b8f7aa0867f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:55.389157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d9cbb3-3e7b-4dbb-bdd8-b8f7aa0867f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:55.389586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-34d9cbb3-3e7b-4dbb-bdd8-b8f7aa0867f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:55.467725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-34d9cbb3-3e7b-4dbb-bdd8-b8f7aa0867f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:29:55.475650 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-34d9cbb3-3e7b-4dbb-bdd8-b8f7aa0867f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1509 microversion: 2.1 time: 0.100660 Oct 27 19:29:55.476408 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3487/6824] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:29:55 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1509 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:29:55.907566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b60e48c5-c6bd-4a28-a1c5-937051e5f7a5 req-92bad990-b317-454f-83c4-e6b34b2c5733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ae73ec-73d0-4c47-b3ce-072de1189a9d", "name": "network-vif-deleted", "tag": "d144f7e4-4148-43a7-b647-7a1cb79f4b70"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:29:55.930082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b60e48c5-c6bd-4a28-a1c5-937051e5f7a5 req-92bad990-b317-454f-83c4-e6b34b2c5733 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:55.930639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b60e48c5-c6bd-4a28-a1c5-937051e5f7a5 req-92bad990-b317-454f-83c4-e6b34b2c5733 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:55.931106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b60e48c5-c6bd-4a28-a1c5-937051e5f7a5 req-92bad990-b317-454f-83c4-e6b34b2c5733 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:55.947441 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b60e48c5-c6bd-4a28-a1c5-937051e5f7a5 req-92bad990-b317-454f-83c4-e6b34b2c5733 service nova] Creating event network-vif-deleted:d144f7e4-4148-43a7-b647-7a1cb79f4b70 for instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d on n-h1-860687-3 Oct 27 19:29:55.952609 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b60e48c5-c6bd-4a28-a1c5-937051e5f7a5 req-92bad990-b317-454f-83c4-e6b34b2c5733 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049013 Oct 27 19:29:55.953554 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3338/6825] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:29:56.499549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9df1a7b1-cbcb-41ce-a4ff-71721f0acd7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:29:56.500170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9df1a7b1-cbcb-41ce-a4ff-71721f0acd7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:29:56.507092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9df1a7b1-cbcb-41ce-a4ff-71721f0acd7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:56.507797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9df1a7b1-cbcb-41ce-a4ff-71721f0acd7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:56.508243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9df1a7b1-cbcb-41ce-a4ff-71721f0acd7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:56.509121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9df1a7b1-cbcb-41ce-a4ff-71721f0acd7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:56.509593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9df1a7b1-cbcb-41ce-a4ff-71721f0acd7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:56.510030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9df1a7b1-cbcb-41ce-a4ff-71721f0acd7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:56.602121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9df1a7b1-cbcb-41ce-a4ff-71721f0acd7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:29:56.612255 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9df1a7b1-cbcb-41ce-a4ff-71721f0acd7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1224 microversion: 2.1 time: 0.116616 Oct 27 19:29:56.613187 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3488/6826] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:29:56 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:29:57.637284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4ab29126-e179-4957-b4a5-5f20f3fa5ac5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:29:57.638118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4ab29126-e179-4957-b4a5-5f20f3fa5ac5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:29:57.645124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ab29126-e179-4957-b4a5-5f20f3fa5ac5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:57.645636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ab29126-e179-4957-b4a5-5f20f3fa5ac5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:57.646099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ab29126-e179-4957-b4a5-5f20f3fa5ac5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:57.646864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ab29126-e179-4957-b4a5-5f20f3fa5ac5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:57.647344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ab29126-e179-4957-b4a5-5f20f3fa5ac5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:57.647845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ab29126-e179-4957-b4a5-5f20f3fa5ac5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:57.716065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4ab29126-e179-4957-b4a5-5f20f3fa5ac5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:29:57.724643 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4ab29126-e179-4957-b4a5-5f20f3fa5ac5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1224 microversion: 2.1 time: 0.093292 Oct 27 19:29:57.725456 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3339/6827] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:29:57 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:29:58.748366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-52cd22a6-208e-41e7-bb4a-d2079eb2d96c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:29:58.748892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-52cd22a6-208e-41e7-bb4a-d2079eb2d96c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:29:58.757516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52cd22a6-208e-41e7-bb4a-d2079eb2d96c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:58.758093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52cd22a6-208e-41e7-bb4a-d2079eb2d96c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:58.758530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52cd22a6-208e-41e7-bb4a-d2079eb2d96c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:58.759360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52cd22a6-208e-41e7-bb4a-d2079eb2d96c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:58.759919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52cd22a6-208e-41e7-bb4a-d2079eb2d96c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:58.760511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-52cd22a6-208e-41e7-bb4a-d2079eb2d96c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:58.828820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-52cd22a6-208e-41e7-bb4a-d2079eb2d96c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:29:58.837356 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-52cd22a6-208e-41e7-bb4a-d2079eb2d96c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1224 microversion: 2.1 time: 0.092737 Oct 27 19:29:58.841860 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3489/6828] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:29:58 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:29:59.861346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85eeaf40-922c-45b1-8e29-4bac4325ec8e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:29:59.861985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85eeaf40-922c-45b1-8e29-4bac4325ec8e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:29:59.870410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85eeaf40-922c-45b1-8e29-4bac4325ec8e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:59.870943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85eeaf40-922c-45b1-8e29-4bac4325ec8e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:59.871411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85eeaf40-922c-45b1-8e29-4bac4325ec8e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:59.872142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85eeaf40-922c-45b1-8e29-4bac4325ec8e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:29:59.872785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85eeaf40-922c-45b1-8e29-4bac4325ec8e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:29:59.873270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85eeaf40-922c-45b1-8e29-4bac4325ec8e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:29:59.946605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-85eeaf40-922c-45b1-8e29-4bac4325ec8e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:29:59.955119 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85eeaf40-922c-45b1-8e29-4bac4325ec8e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 200 len: 1224 microversion: 2.1 time: 0.097773 Oct 27 19:29:59.956030 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3340/6829] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:29:59 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:00.979639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2edec0ba-4cc4-4b6f-aeb3-062ba178f7d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:00.980263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2edec0ba-4cc4-4b6f-aeb3-062ba178f7d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:00.988040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2edec0ba-4cc4-4b6f-aeb3-062ba178f7d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:00.988552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2edec0ba-4cc4-4b6f-aeb3-062ba178f7d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:00.989082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2edec0ba-4cc4-4b6f-aeb3-062ba178f7d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:00.990015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2edec0ba-4cc4-4b6f-aeb3-062ba178f7d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:00.990516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2edec0ba-4cc4-4b6f-aeb3-062ba178f7d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:00.991529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2edec0ba-4cc4-4b6f-aeb3-062ba178f7d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:01.014595 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-2edec0ba-4cc4-4b6f-aeb3-062ba178f7d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2edec0ba-4cc4-4b6f-aeb3-062ba178f7d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d HTTP/1.1 Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '66ae73ec-73d0-4c47-b3ce-072de1189a9d'} Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:30:01.016322 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:01.025047 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:30:01.025047 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:30:01.025047 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:30:01.025047 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:30:01.025047 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:30:01.025047 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:30:01.025047 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:01.025047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2edec0ba-4cc4-4b6f-aeb3-062ba178f7d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:30:01.025047 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2edec0ba-4cc4-4b6f-aeb3-062ba178f7d6 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 404 len: 111 microversion: 2.1 time: 0.042187 Oct 27 19:30:01.025047 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3490/6830] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:00 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:30:01.157708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-925563463", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-600353821", "security_groups": [{"name": "tempest-secgroup-smoke-1058459960"}], "block_device_mapping_v2": [{"uuid": "898c1612-ab7f-4e3b-a8a1-194390116607", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:01.295898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] validate_networks() for [('0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:30:01.727605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:30:01.728294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:30:01.728934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:30:01.729566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:30:01.730108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:30:01.740488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:01.741385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:01.742131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:01.742804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:01.743302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:01.743750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:01.761596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:30:01.767301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for user c8e60ff9ab0d45628195f314f1cac791 and project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:30:01.839231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:30:01.853577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='898c1612-ab7f-4e3b-a8a1-194390116607',volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:30:01.996675 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-afcde321-3612-4216-bbe9-04a18850d06e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.842767 Oct 27 19:30:01.997907 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3341/6831] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:30:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:30:02.009662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-246086c6-7065-4815-a958-411c0c98ee78 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:02.010758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-246086c6-7065-4815-a958-411c0c98ee78 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:02.339809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-246086c6-7065-4815-a958-411c0c98ee78 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:02.348239 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-246086c6-7065-4815-a958-411c0c98ee78 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1093 microversion: 2.1 time: 0.343027 Oct 27 19:30:02.348927 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3491/6832] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:02 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1093 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:03.374355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c0e3a168-df7b-41a4-9c10-bc9a2afcf584 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:03.375729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c0e3a168-df7b-41a4-9c10-bc9a2afcf584 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:03.388447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0e3a168-df7b-41a4-9c10-bc9a2afcf584 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:03.390288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0e3a168-df7b-41a4-9c10-bc9a2afcf584 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:03.390288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0e3a168-df7b-41a4-9c10-bc9a2afcf584 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:03.391057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0e3a168-df7b-41a4-9c10-bc9a2afcf584 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:03.391360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0e3a168-df7b-41a4-9c10-bc9a2afcf584 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:03.391894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0e3a168-df7b-41a4-9c10-bc9a2afcf584 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:03.499188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c0e3a168-df7b-41a4-9c10-bc9a2afcf584 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:03.507409 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c0e3a168-df7b-41a4-9c10-bc9a2afcf584 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1209 microversion: 2.1 time: 0.137852 Oct 27 19:30:03.524352 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3342/6833] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:03 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1209 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:04.543831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f4dde294-ccbe-4427-aa4c-7cd5cbf8c436 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:04.545286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f4dde294-ccbe-4427-aa4c-7cd5cbf8c436 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:04.556399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4dde294-ccbe-4427-aa4c-7cd5cbf8c436 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:04.557243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4dde294-ccbe-4427-aa4c-7cd5cbf8c436 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:04.558007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4dde294-ccbe-4427-aa4c-7cd5cbf8c436 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:04.559930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4dde294-ccbe-4427-aa4c-7cd5cbf8c436 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:04.561721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4dde294-ccbe-4427-aa4c-7cd5cbf8c436 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:04.562865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f4dde294-ccbe-4427-aa4c-7cd5cbf8c436 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:04.815961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f4dde294-ccbe-4427-aa4c-7cd5cbf8c436 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:04.841487 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f4dde294-ccbe-4427-aa4c-7cd5cbf8c436 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1277 microversion: 2.1 time: 0.305837 Oct 27 19:30:04.855914 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3492/6834] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:04 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:04.991867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-4b81eb99-730d-4d46-a180-ffc2d697aab9 req-992308f2-95d0-4151-b5ff-558616c69528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "290d0514-04b2-45bf-8deb-09542250f95a", "tag": "294d4675-53e9-4880-8586-654ee6d03ff7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:05.012436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4b81eb99-730d-4d46-a180-ffc2d697aab9 req-992308f2-95d0-4151-b5ff-558616c69528 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:05.013386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4b81eb99-730d-4d46-a180-ffc2d697aab9 req-992308f2-95d0-4151-b5ff-558616c69528 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:05.015076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4b81eb99-730d-4d46-a180-ffc2d697aab9 req-992308f2-95d0-4151-b5ff-558616c69528 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:05.032851 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-4b81eb99-730d-4d46-a180-ffc2d697aab9 req-992308f2-95d0-4151-b5ff-558616c69528 service nova] Creating event network-changed:294d4675-53e9-4880-8586-654ee6d03ff7 for instance 290d0514-04b2-45bf-8deb-09542250f95a on n-h1-860687-3 Oct 27 19:30:05.042244 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-4b81eb99-730d-4d46-a180-ffc2d697aab9 req-992308f2-95d0-4151-b5ff-558616c69528 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057168 Oct 27 19:30:05.043378 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3343/6835] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:30:05.868257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-812e4170-23db-4ad3-b7da-9b0e9a583e1e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:05.869976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-812e4170-23db-4ad3-b7da-9b0e9a583e1e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:05.880579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-812e4170-23db-4ad3-b7da-9b0e9a583e1e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:05.881140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-812e4170-23db-4ad3-b7da-9b0e9a583e1e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:05.882182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-812e4170-23db-4ad3-b7da-9b0e9a583e1e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:05.882999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-812e4170-23db-4ad3-b7da-9b0e9a583e1e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:05.883472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-812e4170-23db-4ad3-b7da-9b0e9a583e1e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:05.883922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-812e4170-23db-4ad3-b7da-9b0e9a583e1e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:06.121657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-812e4170-23db-4ad3-b7da-9b0e9a583e1e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:06.130595 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-812e4170-23db-4ad3-b7da-9b0e9a583e1e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1277 microversion: 2.1 time: 0.266739 Oct 27 19:30:06.131214 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3493/6836] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:05 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1277 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:07.154984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bdbdad70-5dbd-4c9b-96a9-b73615d22b4a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:07.155832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bdbdad70-5dbd-4c9b-96a9-b73615d22b4a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:07.162306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdbdad70-5dbd-4c9b-96a9-b73615d22b4a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:07.163465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdbdad70-5dbd-4c9b-96a9-b73615d22b4a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:07.164027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdbdad70-5dbd-4c9b-96a9-b73615d22b4a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:07.164849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdbdad70-5dbd-4c9b-96a9-b73615d22b4a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:07.165427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdbdad70-5dbd-4c9b-96a9-b73615d22b4a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:07.165976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdbdad70-5dbd-4c9b-96a9-b73615d22b4a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:07.516451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bdbdad70-5dbd-4c9b-96a9-b73615d22b4a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:07.525813 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bdbdad70-5dbd-4c9b-96a9-b73615d22b4a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1277 microversion: 2.1 time: 0.375875 Oct 27 19:30:07.526507 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3344/6837] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:07 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1277 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:08.550166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-609d6e94-029b-420c-95c6-1b65fe54f5f5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:08.550848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-609d6e94-029b-420c-95c6-1b65fe54f5f5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:08.566732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-609d6e94-029b-420c-95c6-1b65fe54f5f5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:08.569894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-609d6e94-029b-420c-95c6-1b65fe54f5f5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:08.571154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-609d6e94-029b-420c-95c6-1b65fe54f5f5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:08.573120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-609d6e94-029b-420c-95c6-1b65fe54f5f5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:08.573900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-609d6e94-029b-420c-95c6-1b65fe54f5f5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:08.574560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-609d6e94-029b-420c-95c6-1b65fe54f5f5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:08.753340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-609d6e94-029b-420c-95c6-1b65fe54f5f5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:08.761494 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-609d6e94-029b-420c-95c6-1b65fe54f5f5 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1277 microversion: 2.1 time: 0.215761 Oct 27 19:30:08.762006 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3494/6838] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:08 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:30:09.787462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1eec34be-afa8-42b2-9ef7-8762b132f6de tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:09.789210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1eec34be-afa8-42b2-9ef7-8762b132f6de tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:09.796160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1eec34be-afa8-42b2-9ef7-8762b132f6de tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:09.796843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1eec34be-afa8-42b2-9ef7-8762b132f6de tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:09.797491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1eec34be-afa8-42b2-9ef7-8762b132f6de tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:09.798220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1eec34be-afa8-42b2-9ef7-8762b132f6de tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:09.798725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1eec34be-afa8-42b2-9ef7-8762b132f6de tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:09.799329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1eec34be-afa8-42b2-9ef7-8762b132f6de tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:10.067185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1eec34be-afa8-42b2-9ef7-8762b132f6de tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:10.076069 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1eec34be-afa8-42b2-9ef7-8762b132f6de tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1265 microversion: 2.1 time: 0.294512 Oct 27 19:30:10.076766 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3345/6839] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:09 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1265 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:11.107219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-947c04ce-0896-4136-8940-52c639f3b1fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:11.107853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-947c04ce-0896-4136-8940-52c639f3b1fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:11.116320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-947c04ce-0896-4136-8940-52c639f3b1fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:11.116829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-947c04ce-0896-4136-8940-52c639f3b1fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:11.117282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-947c04ce-0896-4136-8940-52c639f3b1fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:11.118070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-947c04ce-0896-4136-8940-52c639f3b1fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:11.118581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-947c04ce-0896-4136-8940-52c639f3b1fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:11.119024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-947c04ce-0896-4136-8940-52c639f3b1fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:11.315804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-947c04ce-0896-4136-8940-52c639f3b1fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:11.325042 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-947c04ce-0896-4136-8940-52c639f3b1fb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1265 microversion: 2.1 time: 0.221776 Oct 27 19:30:11.339230 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3495/6840] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:11 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:12.353410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-05513a6c-f791-4fdc-ac2a-ba20afc679a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:12.354870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-05513a6c-f791-4fdc-ac2a-ba20afc679a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:12.360071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:12.362292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:12.377517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05513a6c-f791-4fdc-ac2a-ba20afc679a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:12.378597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05513a6c-f791-4fdc-ac2a-ba20afc679a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:12.380347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05513a6c-f791-4fdc-ac2a-ba20afc679a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:12.381790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05513a6c-f791-4fdc-ac2a-ba20afc679a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:12.382695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05513a6c-f791-4fdc-ac2a-ba20afc679a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:12.383389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05513a6c-f791-4fdc-ac2a-ba20afc679a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:12.678101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-05513a6c-f791-4fdc-ac2a-ba20afc679a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:12.692452 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-05513a6c-f791-4fdc-ac2a-ba20afc679a9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1265 microversion: 2.1 time: 0.344844 Oct 27 19:30:12.694217 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3346/6841] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:12 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1265 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:13.721732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8f6e1fe9-38de-4e48-867d-738b084c47d3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:13.723013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8f6e1fe9-38de-4e48-867d-738b084c47d3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:13.726720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:13.738092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f6e1fe9-38de-4e48-867d-738b084c47d3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:13.740298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f6e1fe9-38de-4e48-867d-738b084c47d3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:13.743052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f6e1fe9-38de-4e48-867d-738b084c47d3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:13.745661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f6e1fe9-38de-4e48-867d-738b084c47d3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:13.746888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f6e1fe9-38de-4e48-867d-738b084c47d3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:13.753289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8f6e1fe9-38de-4e48-867d-738b084c47d3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:13.993451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8f6e1fe9-38de-4e48-867d-738b084c47d3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:14.007026 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8f6e1fe9-38de-4e48-867d-738b084c47d3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1265 microversion: 2.1 time: 0.288972 Oct 27 19:30:14.007881 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3496/6842] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:13 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:15.035367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d649d166-36e1-47f4-b3c0-cbfdfb711a56 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:15.037047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d649d166-36e1-47f4-b3c0-cbfdfb711a56 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:15.045208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d649d166-36e1-47f4-b3c0-cbfdfb711a56 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:15.047000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d649d166-36e1-47f4-b3c0-cbfdfb711a56 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:15.047727 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d649d166-36e1-47f4-b3c0-cbfdfb711a56 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:15.049078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d649d166-36e1-47f4-b3c0-cbfdfb711a56 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:15.051879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d649d166-36e1-47f4-b3c0-cbfdfb711a56 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:15.054988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d649d166-36e1-47f4-b3c0-cbfdfb711a56 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:15.316527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d649d166-36e1-47f4-b3c0-cbfdfb711a56 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:15.328062 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d649d166-36e1-47f4-b3c0-cbfdfb711a56 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1265 microversion: 2.1 time: 0.299047 Oct 27 19:30:15.334470 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3347/6843] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:15 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:15.494045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-636845713", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "7746e15f-6ab0-4d5f-9f77-e7e345dfd55c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-717801111", "security_groups": []}, "os:scheduler_hints": {"different_host": ["b76764fb-69a1-4e4f-af5c-2849a65fc90a"]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:15.570133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] validate_networks() for [('7746e15f-6ab0-4d5f-9f77-e7e345dfd55c', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:30:16.225494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:30:16.226401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:30:16.227664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:30:16.228167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:30:16.228671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:30:16.240704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:16.241967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:16.242532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:16.243462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:16.244003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:16.244530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:16.267717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Getting quotas for project ef53fd6f972d48af95acaf91edbc7630. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:30:16.274276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Getting quotas for user 6807ac75994940f890164e5e7650de80 and project ef53fd6f972d48af95acaf91edbc7630. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:30:16.291252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:30:16.293961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:30:16.353515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9b7d1bc1-a9bf-405c-abef-a0662e350eb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:16.354315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9b7d1bc1-a9bf-405c-abef-a0662e350eb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:16.376611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9b7d1bc1-a9bf-405c-abef-a0662e350eb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:16.377273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9b7d1bc1-a9bf-405c-abef-a0662e350eb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:16.379705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9b7d1bc1-a9bf-405c-abef-a0662e350eb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:16.380562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9b7d1bc1-a9bf-405c-abef-a0662e350eb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:16.383093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9b7d1bc1-a9bf-405c-abef-a0662e350eb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:16.384805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9b7d1bc1-a9bf-405c-abef-a0662e350eb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:16.404018 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bd154e2b-01d2-4500-a77d-e3c2556c1a01 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.914639 Oct 27 19:30:16.405079 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3497/6844] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:30:15 2022] POST /compute/v2.1/servers => generated 361 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:30:16.417706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a6d3b103-35ab-433c-88e9-8a72e30a3e3f tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:16.418352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a6d3b103-35ab-433c-88e9-8a72e30a3e3f tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:16.536590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a6d3b103-35ab-433c-88e9-8a72e30a3e3f tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:16.547417 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a6d3b103-35ab-433c-88e9-8a72e30a3e3f tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1240 microversion: 2.1 time: 0.134752 Oct 27 19:30:16.548961 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3498/6845] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:16 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1240 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:30:16.731632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9b7d1bc1-a9bf-405c-abef-a0662e350eb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:16.761927 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9b7d1bc1-a9bf-405c-abef-a0662e350eb3 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1265 microversion: 2.1 time: 0.392493 Oct 27 19:30:16.765176 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3348/6846] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:16 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1265 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:30:17.573038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-78228949-94e3-4830-adf9-e59448ecc211 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:17.573672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-78228949-94e3-4830-adf9-e59448ecc211 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:17.596912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78228949-94e3-4830-adf9-e59448ecc211 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:17.597638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78228949-94e3-4830-adf9-e59448ecc211 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:17.598789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78228949-94e3-4830-adf9-e59448ecc211 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:17.600846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78228949-94e3-4830-adf9-e59448ecc211 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:17.602687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78228949-94e3-4830-adf9-e59448ecc211 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:17.603704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78228949-94e3-4830-adf9-e59448ecc211 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:17.682326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-78228949-94e3-4830-adf9-e59448ecc211 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:17.690724 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-78228949-94e3-4830-adf9-e59448ecc211 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1292 microversion: 2.1 time: 0.122570 Oct 27 19:30:17.691700 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3499/6847] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:17 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1292 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:17.789567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-678b0bb4-c168-4edf-88a9-b578799ea36d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:17.790409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-678b0bb4-c168-4edf-88a9-b578799ea36d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:17.797396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-678b0bb4-c168-4edf-88a9-b578799ea36d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:17.797973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-678b0bb4-c168-4edf-88a9-b578799ea36d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:17.798532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-678b0bb4-c168-4edf-88a9-b578799ea36d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:17.799323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-678b0bb4-c168-4edf-88a9-b578799ea36d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:17.799861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-678b0bb4-c168-4edf-88a9-b578799ea36d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:17.800373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-678b0bb4-c168-4edf-88a9-b578799ea36d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:17.973290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-678b0bb4-c168-4edf-88a9-b578799ea36d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:17.991713 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-678b0bb4-c168-4edf-88a9-b578799ea36d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1265 microversion: 2.1 time: 0.207237 Oct 27 19:30:17.999177 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3349/6848] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:17 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:18.715391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2f4ce86c-2407-4765-8cde-074e00474400 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:18.717383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2f4ce86c-2407-4765-8cde-074e00474400 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:18.730519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f4ce86c-2407-4765-8cde-074e00474400 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:18.732838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f4ce86c-2407-4765-8cde-074e00474400 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:18.742012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f4ce86c-2407-4765-8cde-074e00474400 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:18.743181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f4ce86c-2407-4765-8cde-074e00474400 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:18.743930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f4ce86c-2407-4765-8cde-074e00474400 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:18.744593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f4ce86c-2407-4765-8cde-074e00474400 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:18.835545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2f4ce86c-2407-4765-8cde-074e00474400 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:18.845835 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2f4ce86c-2407-4765-8cde-074e00474400 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1298 microversion: 2.1 time: 0.134425 Oct 27 19:30:18.850127 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3500/6849] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:18 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1298 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:19.006308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ac6fa06f-3067-44e0-b46d-48914beef9a4 req-87c4ee0d-3ca5-438d-8de9-45a58380a0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290d0514-04b2-45bf-8deb-09542250f95a", "name": "network-vif-plugged", "status": "completed", "tag": "294d4675-53e9-4880-8586-654ee6d03ff7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:19.017640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bd8e8ecf-9a68-4986-8c1d-a98799a5d393 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:19.018949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bd8e8ecf-9a68-4986-8c1d-a98799a5d393 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:19.027918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ac6fa06f-3067-44e0-b46d-48914beef9a4 req-87c4ee0d-3ca5-438d-8de9-45a58380a0f3 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:19.028429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ac6fa06f-3067-44e0-b46d-48914beef9a4 req-87c4ee0d-3ca5-438d-8de9-45a58380a0f3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:19.029140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ac6fa06f-3067-44e0-b46d-48914beef9a4 req-87c4ee0d-3ca5-438d-8de9-45a58380a0f3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:19.031577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd8e8ecf-9a68-4986-8c1d-a98799a5d393 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:19.032426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd8e8ecf-9a68-4986-8c1d-a98799a5d393 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:19.033093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd8e8ecf-9a68-4986-8c1d-a98799a5d393 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:19.037154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd8e8ecf-9a68-4986-8c1d-a98799a5d393 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:19.039425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd8e8ecf-9a68-4986-8c1d-a98799a5d393 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:19.040147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bd8e8ecf-9a68-4986-8c1d-a98799a5d393 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:19.055354 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ac6fa06f-3067-44e0-b46d-48914beef9a4 req-87c4ee0d-3ca5-438d-8de9-45a58380a0f3 service nova] Creating event network-vif-plugged:294d4675-53e9-4880-8586-654ee6d03ff7 for instance 290d0514-04b2-45bf-8deb-09542250f95a on n-h1-860687-3 Oct 27 19:30:19.062373 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ac6fa06f-3067-44e0-b46d-48914beef9a4 req-87c4ee0d-3ca5-438d-8de9-45a58380a0f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061138 Oct 27 19:30:19.063589 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3350/6850] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:30:19.408198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bd8e8ecf-9a68-4986-8c1d-a98799a5d393 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:19.419873 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bd8e8ecf-9a68-4986-8c1d-a98799a5d393 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1265 microversion: 2.1 time: 0.407252 Oct 27 19:30:19.434629 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3501/6851] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:19 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1265 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:19.882100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1d87e8f0-cfef-441f-942c-31b9bd0efe48 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:19.883000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1d87e8f0-cfef-441f-942c-31b9bd0efe48 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:19.892442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d87e8f0-cfef-441f-942c-31b9bd0efe48 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:19.896079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d87e8f0-cfef-441f-942c-31b9bd0efe48 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:19.900003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d87e8f0-cfef-441f-942c-31b9bd0efe48 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:19.901006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d87e8f0-cfef-441f-942c-31b9bd0efe48 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:19.901641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d87e8f0-cfef-441f-942c-31b9bd0efe48 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:19.902279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d87e8f0-cfef-441f-942c-31b9bd0efe48 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:20.062296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1d87e8f0-cfef-441f-942c-31b9bd0efe48 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:20.071835 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1d87e8f0-cfef-441f-942c-31b9bd0efe48 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1298 microversion: 2.1 time: 0.198257 Oct 27 19:30:20.072434 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3351/6852] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:19 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1298 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:20.256507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-37c6ae6a-fdc7-422e-b53a-1e3ae7f7e141 req-ab383f92-e5ce-4011-aba9-9685efb5e541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e03492ee-34e4-4b29-b46a-b4dc892b8722", "tag": "0b383004-9f8f-4b85-8792-234d5499fbbc"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:20.269142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-37c6ae6a-fdc7-422e-b53a-1e3ae7f7e141 req-ab383f92-e5ce-4011-aba9-9685efb5e541 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:20.269687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-37c6ae6a-fdc7-422e-b53a-1e3ae7f7e141 req-ab383f92-e5ce-4011-aba9-9685efb5e541 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:20.270186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-37c6ae6a-fdc7-422e-b53a-1e3ae7f7e141 req-ab383f92-e5ce-4011-aba9-9685efb5e541 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:20.294477 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-37c6ae6a-fdc7-422e-b53a-1e3ae7f7e141 req-ab383f92-e5ce-4011-aba9-9685efb5e541 service nova] Creating event network-changed:0b383004-9f8f-4b85-8792-234d5499fbbc for instance e03492ee-34e4-4b29-b46a-b4dc892b8722 on n-h1-860687-3 Oct 27 19:30:20.301958 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-37c6ae6a-fdc7-422e-b53a-1e3ae7f7e141 req-ab383f92-e5ce-4011-aba9-9685efb5e541 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049238 Oct 27 19:30:20.304261 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3502/6853] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:30:20.445883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd76bdd7-ec42-496b-9c80-c8b5930bde2f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:20.446893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bd76bdd7-ec42-496b-9c80-c8b5930bde2f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:20.454070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd76bdd7-ec42-496b-9c80-c8b5930bde2f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:20.455146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd76bdd7-ec42-496b-9c80-c8b5930bde2f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:20.455770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd76bdd7-ec42-496b-9c80-c8b5930bde2f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:20.457125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd76bdd7-ec42-496b-9c80-c8b5930bde2f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:20.457756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd76bdd7-ec42-496b-9c80-c8b5930bde2f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:20.458479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd76bdd7-ec42-496b-9c80-c8b5930bde2f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:20.636461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bd76bdd7-ec42-496b-9c80-c8b5930bde2f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:20.657555 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bd76bdd7-ec42-496b-9c80-c8b5930bde2f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1265 microversion: 2.1 time: 0.216148 Oct 27 19:30:20.658554 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3352/6854] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:20 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:30:21.096065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4536c91c-7b85-4d73-b5fd-39d3e6ffaf5a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:21.096829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4536c91c-7b85-4d73-b5fd-39d3e6ffaf5a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:21.104368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4536c91c-7b85-4d73-b5fd-39d3e6ffaf5a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:21.104874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4536c91c-7b85-4d73-b5fd-39d3e6ffaf5a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:21.105325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4536c91c-7b85-4d73-b5fd-39d3e6ffaf5a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:21.106060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4536c91c-7b85-4d73-b5fd-39d3e6ffaf5a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:21.106558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4536c91c-7b85-4d73-b5fd-39d3e6ffaf5a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:21.106997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4536c91c-7b85-4d73-b5fd-39d3e6ffaf5a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:21.198152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4536c91c-7b85-4d73-b5fd-39d3e6ffaf5a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:21.206466 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4536c91c-7b85-4d73-b5fd-39d3e6ffaf5a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1298 microversion: 2.1 time: 0.114739 Oct 27 19:30:21.207075 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3503/6855] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:21 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:21.681431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8f17e126-4836-40ba-ae9b-e11e111310f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:21.682060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8f17e126-4836-40ba-ae9b-e11e111310f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:21.688603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f17e126-4836-40ba-ae9b-e11e111310f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:21.689103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f17e126-4836-40ba-ae9b-e11e111310f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:21.689559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f17e126-4836-40ba-ae9b-e11e111310f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:21.690264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f17e126-4836-40ba-ae9b-e11e111310f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:21.690764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f17e126-4836-40ba-ae9b-e11e111310f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:21.691456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f17e126-4836-40ba-ae9b-e11e111310f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:21.710642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:21.828970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8f17e126-4836-40ba-ae9b-e11e111310f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:21.836788 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8f17e126-4836-40ba-ae9b-e11e111310f4 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1451 microversion: 2.1 time: 0.159626 Oct 27 19:30:21.837362 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3353/6856] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:21 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:21.858663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-766e7cec-4359-43e1-a580-2d4719a7dfdb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:21.859905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-766e7cec-4359-43e1-a580-2d4719a7dfdb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:21.868734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-766e7cec-4359-43e1-a580-2d4719a7dfdb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:21.869267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-766e7cec-4359-43e1-a580-2d4719a7dfdb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:21.869937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-766e7cec-4359-43e1-a580-2d4719a7dfdb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:21.870677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-766e7cec-4359-43e1-a580-2d4719a7dfdb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:21.871141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-766e7cec-4359-43e1-a580-2d4719a7dfdb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:21.871573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-766e7cec-4359-43e1-a580-2d4719a7dfdb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:22.093934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-766e7cec-4359-43e1-a580-2d4719a7dfdb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:22.102932 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-766e7cec-4359-43e1-a580-2d4719a7dfdb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1451 microversion: 2.1 time: 0.248188 Oct 27 19:30:22.103651 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3504/6857] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:21 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1451 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:22.231442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6c36aad5-6d06-49ea-af72-5a8c0e12ac97 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:22.232129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6c36aad5-6d06-49ea-af72-5a8c0e12ac97 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:22.238014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c36aad5-6d06-49ea-af72-5a8c0e12ac97 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:22.238546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c36aad5-6d06-49ea-af72-5a8c0e12ac97 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:22.239001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c36aad5-6d06-49ea-af72-5a8c0e12ac97 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:22.239716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c36aad5-6d06-49ea-af72-5a8c0e12ac97 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:22.240275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c36aad5-6d06-49ea-af72-5a8c0e12ac97 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:22.241412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c36aad5-6d06-49ea-af72-5a8c0e12ac97 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:22.326551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6c36aad5-6d06-49ea-af72-5a8c0e12ac97 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:22.334513 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6c36aad5-6d06-49ea-af72-5a8c0e12ac97 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1298 microversion: 2.1 time: 0.106954 Oct 27 19:30:22.335284 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3354/6858] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:22 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:30:23.357180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3cc6ae18-b5e6-413f-bed8-49dc5d3ee576 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:23.357809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3cc6ae18-b5e6-413f-bed8-49dc5d3ee576 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:23.362096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:23.367139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3cc6ae18-b5e6-413f-bed8-49dc5d3ee576 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:23.367642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3cc6ae18-b5e6-413f-bed8-49dc5d3ee576 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:23.368088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3cc6ae18-b5e6-413f-bed8-49dc5d3ee576 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:23.368974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3cc6ae18-b5e6-413f-bed8-49dc5d3ee576 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:23.369445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3cc6ae18-b5e6-413f-bed8-49dc5d3ee576 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:23.369935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3cc6ae18-b5e6-413f-bed8-49dc5d3ee576 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:23.373541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=91 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:23.491682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3cc6ae18-b5e6-413f-bed8-49dc5d3ee576 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:23.499757 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3cc6ae18-b5e6-413f-bed8-49dc5d3ee576 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1298 microversion: 2.1 time: 0.146420 Oct 27 19:30:23.500597 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3505/6859] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:23 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1298 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:24.471607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-689cfceb-0137-4917-8ba8-178915c5fe6f req-e9967956-2608-42e3-9ea9-b50e2cc69f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "290d0514-04b2-45bf-8deb-09542250f95a", "tag": "294d4675-53e9-4880-8586-654ee6d03ff7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:24.477618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:24.483998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-689cfceb-0137-4917-8ba8-178915c5fe6f req-e9967956-2608-42e3-9ea9-b50e2cc69f38 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:24.484515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-689cfceb-0137-4917-8ba8-178915c5fe6f req-e9967956-2608-42e3-9ea9-b50e2cc69f38 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:24.484974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-689cfceb-0137-4917-8ba8-178915c5fe6f req-e9967956-2608-42e3-9ea9-b50e2cc69f38 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:24.497177 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-689cfceb-0137-4917-8ba8-178915c5fe6f req-e9967956-2608-42e3-9ea9-b50e2cc69f38 service nova] Creating event network-changed:294d4675-53e9-4880-8586-654ee6d03ff7 for instance 290d0514-04b2-45bf-8deb-09542250f95a on n-h1-860687-3 Oct 27 19:30:24.502862 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-689cfceb-0137-4917-8ba8-178915c5fe6f req-e9967956-2608-42e3-9ea9-b50e2cc69f38 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035007 Oct 27 19:30:24.503804 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3355/6860] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:30:24.525048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bf8be62a-2d08-4f86-bc01-42221a3d07ae tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:24.525695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bf8be62a-2d08-4f86-bc01-42221a3d07ae tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:24.533405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf8be62a-2d08-4f86-bc01-42221a3d07ae tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:24.534119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf8be62a-2d08-4f86-bc01-42221a3d07ae tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:24.534591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf8be62a-2d08-4f86-bc01-42221a3d07ae tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:24.535297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf8be62a-2d08-4f86-bc01-42221a3d07ae tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:24.535754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf8be62a-2d08-4f86-bc01-42221a3d07ae tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:24.536181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf8be62a-2d08-4f86-bc01-42221a3d07ae tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:24.688154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bf8be62a-2d08-4f86-bc01-42221a3d07ae tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:24.699932 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bf8be62a-2d08-4f86-bc01-42221a3d07ae tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1298 microversion: 2.1 time: 0.180367 Oct 27 19:30:24.700760 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3506/6861] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:24 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1298 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:24.830134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-a5755821-e205-4716-a5ac-1cbd5672de70 req-fb5d83a4-8a96-42d1-802c-f56cf99bc2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03492ee-34e4-4b29-b46a-b4dc892b8722", "name": "network-vif-plugged", "status": "completed", "tag": "0b383004-9f8f-4b85-8792-234d5499fbbc"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:24.840386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a5755821-e205-4716-a5ac-1cbd5672de70 req-fb5d83a4-8a96-42d1-802c-f56cf99bc2db service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:24.841186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a5755821-e205-4716-a5ac-1cbd5672de70 req-fb5d83a4-8a96-42d1-802c-f56cf99bc2db service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:24.842120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-a5755821-e205-4716-a5ac-1cbd5672de70 req-fb5d83a4-8a96-42d1-802c-f56cf99bc2db service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:24.854362 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-a5755821-e205-4716-a5ac-1cbd5672de70 req-fb5d83a4-8a96-42d1-802c-f56cf99bc2db service nova] Creating event network-vif-plugged:0b383004-9f8f-4b85-8792-234d5499fbbc for instance e03492ee-34e4-4b29-b46a-b4dc892b8722 on n-h1-860687-3 Oct 27 19:30:24.859634 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-a5755821-e205-4716-a5ac-1cbd5672de70 req-fb5d83a4-8a96-42d1-802c-f56cf99bc2db service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034842 Oct 27 19:30:24.862928 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3356/6862] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:30:25.723729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-69909afa-505c-4231-804e-fb7a92a8a1a3 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:25.724879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-69909afa-505c-4231-804e-fb7a92a8a1a3 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:25.731671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69909afa-505c-4231-804e-fb7a92a8a1a3 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:25.732153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69909afa-505c-4231-804e-fb7a92a8a1a3 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:25.732590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69909afa-505c-4231-804e-fb7a92a8a1a3 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:25.733280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69909afa-505c-4231-804e-fb7a92a8a1a3 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:25.733730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69909afa-505c-4231-804e-fb7a92a8a1a3 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:25.734164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-69909afa-505c-4231-804e-fb7a92a8a1a3 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:25.816790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-69909afa-505c-4231-804e-fb7a92a8a1a3 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:25.825051 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-69909afa-505c-4231-804e-fb7a92a8a1a3 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1298 microversion: 2.1 time: 0.105279 Oct 27 19:30:25.825623 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3507/6863] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:25 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:26.851261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3c61aba5-8c2f-45ff-9d74-910b9a46faf6 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:26.852081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3c61aba5-8c2f-45ff-9d74-910b9a46faf6 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:26.858314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c61aba5-8c2f-45ff-9d74-910b9a46faf6 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:26.859588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c61aba5-8c2f-45ff-9d74-910b9a46faf6 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:26.860207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c61aba5-8c2f-45ff-9d74-910b9a46faf6 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:26.861095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c61aba5-8c2f-45ff-9d74-910b9a46faf6 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:26.861724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c61aba5-8c2f-45ff-9d74-910b9a46faf6 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:26.862320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c61aba5-8c2f-45ff-9d74-910b9a46faf6 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:26.947030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3c61aba5-8c2f-45ff-9d74-910b9a46faf6 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:26.954830 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3c61aba5-8c2f-45ff-9d74-910b9a46faf6 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1471 microversion: 2.1 time: 0.109122 Oct 27 19:30:26.955403 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3357/6864] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:26 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1471 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:26.977089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f836263d-d465-44ea-82a7-13bfba77e266 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:26.977722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f836263d-d465-44ea-82a7-13bfba77e266 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:26.979593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:26.980299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:26.986941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f836263d-d465-44ea-82a7-13bfba77e266 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:26.987446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f836263d-d465-44ea-82a7-13bfba77e266 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:26.987897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f836263d-d465-44ea-82a7-13bfba77e266 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:26.988605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f836263d-d465-44ea-82a7-13bfba77e266 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:26.989070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f836263d-d465-44ea-82a7-13bfba77e266 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:26.989509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f836263d-d465-44ea-82a7-13bfba77e266 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:27.071446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f836263d-d465-44ea-82a7-13bfba77e266 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:27.079282 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f836263d-d465-44ea-82a7-13bfba77e266 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1471 microversion: 2.1 time: 0.106206 Oct 27 19:30:27.079856 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3508/6865] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:26 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1471 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:27.101519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ad9f6bc9-325b-4c8c-9b5a-d54fe8bbad2d tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:27.102240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ad9f6bc9-325b-4c8c-9b5a-d54fe8bbad2d tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:27.108257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad9f6bc9-325b-4c8c-9b5a-d54fe8bbad2d tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:27.108763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad9f6bc9-325b-4c8c-9b5a-d54fe8bbad2d tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:27.109223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad9f6bc9-325b-4c8c-9b5a-d54fe8bbad2d tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:27.109940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad9f6bc9-325b-4c8c-9b5a-d54fe8bbad2d tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:27.110442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad9f6bc9-325b-4c8c-9b5a-d54fe8bbad2d tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:27.110915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad9f6bc9-325b-4c8c-9b5a-d54fe8bbad2d tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:27.193089 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ad9f6bc9-325b-4c8c-9b5a-d54fe8bbad2d tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1622 microversion: 2.1 time: 0.095758 Oct 27 19:30:27.193997 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3358/6866] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:27 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1622 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:27.215544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-91c8e939-857f-4d09-8bbe-2569bcde9420 tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:27.216200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-91c8e939-857f-4d09-8bbe-2569bcde9420 tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:27.222504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91c8e939-857f-4d09-8bbe-2569bcde9420 tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:27.223036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91c8e939-857f-4d09-8bbe-2569bcde9420 tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:27.223488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91c8e939-857f-4d09-8bbe-2569bcde9420 tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:27.224229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91c8e939-857f-4d09-8bbe-2569bcde9420 tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:27.225249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91c8e939-857f-4d09-8bbe-2569bcde9420 tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:27.225686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91c8e939-857f-4d09-8bbe-2569bcde9420 tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:27.367084 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-91c8e939-857f-4d09-8bbe-2569bcde9420 tempest-TestSecurityGroupsBasicOps-37446800 tempest-TestSecurityGroupsBasicOps-37446800-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1912 microversion: 2.1 time: 0.155290 Oct 27 19:30:27.367665 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3509/6867] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:27 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1912 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:27.433080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-780ec336-d29a-40ca-b782-4f052e16461a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:27.433601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-780ec336-d29a-40ca-b782-4f052e16461a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:27.439684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-780ec336-d29a-40ca-b782-4f052e16461a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:27.440197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-780ec336-d29a-40ca-b782-4f052e16461a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:27.440994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-780ec336-d29a-40ca-b782-4f052e16461a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:27.441718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-780ec336-d29a-40ca-b782-4f052e16461a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:27.442196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-780ec336-d29a-40ca-b782-4f052e16461a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:27.442677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-780ec336-d29a-40ca-b782-4f052e16461a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:27.468038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-780ec336-d29a-40ca-b782-4f052e16461a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:30:27.544832 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-780ec336-d29a-40ca-b782-4f052e16461a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 204 len: 0 microversion: 2.1 time: 0.115453 Oct 27 19:30:27.545430 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3359/6868] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:30:27 2022] DELETE /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:30:27.554750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c59b1464-0b2c-4e30-b2cb-1f4ca3d65592 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:27.555398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c59b1464-0b2c-4e30-b2cb-1f4ca3d65592 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:27.561734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c59b1464-0b2c-4e30-b2cb-1f4ca3d65592 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:27.562231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c59b1464-0b2c-4e30-b2cb-1f4ca3d65592 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:27.562713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c59b1464-0b2c-4e30-b2cb-1f4ca3d65592 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:27.563484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c59b1464-0b2c-4e30-b2cb-1f4ca3d65592 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:27.564058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c59b1464-0b2c-4e30-b2cb-1f4ca3d65592 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:27.564380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c59b1464-0b2c-4e30-b2cb-1f4ca3d65592 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:27.649919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c59b1464-0b2c-4e30-b2cb-1f4ca3d65592 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:27.657746 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c59b1464-0b2c-4e30-b2cb-1f4ca3d65592 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1477 microversion: 2.1 time: 0.107827 Oct 27 19:30:27.658322 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3510/6869] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:27 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1477 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:28.681638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1ad1640f-3a24-4137-b667-871ee50ae24c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:28.682355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1ad1640f-3a24-4137-b667-871ee50ae24c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:28.689163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ad1640f-3a24-4137-b667-871ee50ae24c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:28.689671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ad1640f-3a24-4137-b667-871ee50ae24c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:28.690125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ad1640f-3a24-4137-b667-871ee50ae24c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:28.691135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ad1640f-3a24-4137-b667-871ee50ae24c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:28.691606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ad1640f-3a24-4137-b667-871ee50ae24c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:28.692050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ad1640f-3a24-4137-b667-871ee50ae24c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:28.785782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1ad1640f-3a24-4137-b667-871ee50ae24c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:28.797595 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1ad1640f-3a24-4137-b667-871ee50ae24c tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1477 microversion: 2.1 time: 0.120646 Oct 27 19:30:28.798501 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3360/6870] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:28 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1477 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:29.381903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-b500a125-2704-4889-ac09-3e432af6a1db req-266a8185-1c0b-4e20-a59f-3a5709660985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03492ee-34e4-4b29-b46a-b4dc892b8722", "name": "network-vif-deleted", "tag": "0b383004-9f8f-4b85-8792-234d5499fbbc"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:29.394570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b500a125-2704-4889-ac09-3e432af6a1db req-266a8185-1c0b-4e20-a59f-3a5709660985 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:29.395281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b500a125-2704-4889-ac09-3e432af6a1db req-266a8185-1c0b-4e20-a59f-3a5709660985 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:29.395708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b500a125-2704-4889-ac09-3e432af6a1db req-266a8185-1c0b-4e20-a59f-3a5709660985 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:29.408499 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-b500a125-2704-4889-ac09-3e432af6a1db req-266a8185-1c0b-4e20-a59f-3a5709660985 service nova] Creating event network-vif-deleted:0b383004-9f8f-4b85-8792-234d5499fbbc for instance e03492ee-34e4-4b29-b46a-b4dc892b8722 on n-h1-860687-3 Oct 27 19:30:29.415031 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-b500a125-2704-4889-ac09-3e432af6a1db req-266a8185-1c0b-4e20-a59f-3a5709660985 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037665 Oct 27 19:30:29.415643 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3511/6871] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:30:29.822737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f2171a5e-d2e0-4e36-9e83-70e1776c84c2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:29.823396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f2171a5e-d2e0-4e36-9e83-70e1776c84c2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:29.829431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2171a5e-d2e0-4e36-9e83-70e1776c84c2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:29.829931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2171a5e-d2e0-4e36-9e83-70e1776c84c2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:29.830394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2171a5e-d2e0-4e36-9e83-70e1776c84c2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:29.831165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2171a5e-d2e0-4e36-9e83-70e1776c84c2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:29.831676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2171a5e-d2e0-4e36-9e83-70e1776c84c2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:29.832118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2171a5e-d2e0-4e36-9e83-70e1776c84c2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:29.867872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2171a5e-d2e0-4e36-9e83-70e1776c84c2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:29.868375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2171a5e-d2e0-4e36-9e83-70e1776c84c2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:29.868839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2171a5e-d2e0-4e36-9e83-70e1776c84c2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:29.869303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-f2171a5e-d2e0-4e36-9e83-70e1776c84c2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lazy-loading 'fault' on Instance uuid e03492ee-34e4-4b29-b46a-b4dc892b8722 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:30:29.916395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f2171a5e-d2e0-4e36-9e83-70e1776c84c2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:29.924380 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f2171a5e-d2e0-4e36-9e83-70e1776c84c2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 200 len: 1330 microversion: 2.1 time: 0.106528 Oct 27 19:30:29.924973 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3361/6872] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:29 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:30.950096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84f631a2-02dc-4d21-9a72-bf0cc3768c66 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:30.950838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-84f631a2-02dc-4d21-9a72-bf0cc3768c66 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: e03492ee-34e4-4b29-b46a-b4dc892b8722] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:30.957068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84f631a2-02dc-4d21-9a72-bf0cc3768c66 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:30.957556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84f631a2-02dc-4d21-9a72-bf0cc3768c66 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:30.957996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84f631a2-02dc-4d21-9a72-bf0cc3768c66 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:30.959592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84f631a2-02dc-4d21-9a72-bf0cc3768c66 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:30.960058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84f631a2-02dc-4d21-9a72-bf0cc3768c66 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:30.960491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84f631a2-02dc-4d21-9a72-bf0cc3768c66 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:30.973745 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-84f631a2-02dc-4d21-9a72-bf0cc3768c66 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] HTTP exception thrown: Instance e03492ee-34e4-4b29-b46a-b4dc892b8722 could not be found. Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84f631a2-02dc-4d21-9a72-bf0cc3768c66 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Request method failure captured: Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 HTTP/1.1 Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtvoL_fLZ8CREHvZYgJLOt6yz76J5SaT25lozDB_m3AcFXroo3KQc5ceSLPYLC-VlZ2T6CI34DHR313oujxzf51M8w4tpaXZ0L6UjdsS53LT-GeXRKDYroU94MmSH0TIf5zRWWJLZVHZvvD0LaiD3H4e3CqKLJHBv2BzbQXOPRa6JKk Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ef53fd6f972d48af95acaf91edbc7630 Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1025766051 Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ef53fd6f972d48af95acaf91edbc7630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ef53fd6f972d48af95acaf91edbc7630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ef53fd6f972d48af95acaf91edbc7630", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ef53fd6f972d48af95acaf91edbc7630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1025766051 Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ef53fd6f972d48af95acaf91edbc7630 Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1025766051 Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestSecurityGroupsBasicOps-1025766051-project Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 6807ac75994940f890164e5e7650de80 Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1025766051-project Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance e03492ee-34e4-4b29-b46a-b4dc892b8722 could not be found. Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'e03492ee-34e4-4b29-b46a-b4dc892b8722'} Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e03492ee-34e4-4b29-b46a-b4dc892b8722 could not be found. Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e03492ee-34e4-4b29-b46a-b4dc892b8722 could not be found. Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:30.975437 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:30:30.979228 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:30.979228 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:30:30.979228 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:30:30.979228 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:30:30.979228 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:30:30.979228 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:30:30.979228 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e03492ee-34e4-4b29-b46a-b4dc892b8722 could not be found. Oct 27 19:30:30.979228 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:30.979228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84f631a2-02dc-4d21-9a72-bf0cc3768c66 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Returning 404 to user: Instance e03492ee-34e4-4b29-b46a-b4dc892b8722 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:30:30.979228 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-84f631a2-02dc-4d21-9a72-bf0cc3768c66 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722" status: 404 len: 111 microversion: 2.1 time: 0.031859 Oct 27 19:30:30.979228 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3512/6873] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:30 2022] GET /compute/v2.1/servers/e03492ee-34e4-4b29-b46a-b4dc892b8722 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:30:35.526891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dbe72bd5-34ea-4dc9-bd98-9d0878ae85d2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:35.527406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dbe72bd5-34ea-4dc9-bd98-9d0878ae85d2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:35.529246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a443da20-88a1-4ec8-a74b-283280e06740 req-4f08f25c-8e84-409e-a6f8-0ad7e99af27c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b76764fb-69a1-4e4f-af5c-2849a65fc90a", "tag": "9964b335-fdfe-471a-af53-3d9802f6192b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:35.535494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe72bd5-34ea-4dc9-bd98-9d0878ae85d2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:35.535998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe72bd5-34ea-4dc9-bd98-9d0878ae85d2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:35.537181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe72bd5-34ea-4dc9-bd98-9d0878ae85d2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:35.538900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe72bd5-34ea-4dc9-bd98-9d0878ae85d2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:35.539588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe72bd5-34ea-4dc9-bd98-9d0878ae85d2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:35.540257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe72bd5-34ea-4dc9-bd98-9d0878ae85d2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:35.540626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a443da20-88a1-4ec8-a74b-283280e06740 req-4f08f25c-8e84-409e-a6f8-0ad7e99af27c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:35.541141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a443da20-88a1-4ec8-a74b-283280e06740 req-4f08f25c-8e84-409e-a6f8-0ad7e99af27c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:35.541583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a443da20-88a1-4ec8-a74b-283280e06740 req-4f08f25c-8e84-409e-a6f8-0ad7e99af27c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:35.554128 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a443da20-88a1-4ec8-a74b-283280e06740 req-4f08f25c-8e84-409e-a6f8-0ad7e99af27c service nova] Creating event network-changed:9964b335-fdfe-471a-af53-3d9802f6192b for instance b76764fb-69a1-4e4f-af5c-2849a65fc90a on n-h2-860687-3 Oct 27 19:30:35.559792 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a443da20-88a1-4ec8-a74b-283280e06740 req-4f08f25c-8e84-409e-a6f8-0ad7e99af27c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034329 Oct 27 19:30:35.560621 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3513/6874] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:30:35.570035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dbe72bd5-34ea-4dc9-bd98-9d0878ae85d2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:30:35.665489 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dbe72bd5-34ea-4dc9-bd98-9d0878ae85d2 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 204 len: 0 microversion: 2.1 time: 0.142105 Oct 27 19:30:35.666346 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3362/6875] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:30:35 2022] DELETE /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:30:35.676131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bcf12d2a-5fd6-4672-88df-0155c87c7ed7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:35.676855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bcf12d2a-5fd6-4672-88df-0155c87c7ed7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:35.683414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bcf12d2a-5fd6-4672-88df-0155c87c7ed7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:35.683896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bcf12d2a-5fd6-4672-88df-0155c87c7ed7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:35.684353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bcf12d2a-5fd6-4672-88df-0155c87c7ed7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:35.685050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bcf12d2a-5fd6-4672-88df-0155c87c7ed7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:35.685508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bcf12d2a-5fd6-4672-88df-0155c87c7ed7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:35.685945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bcf12d2a-5fd6-4672-88df-0155c87c7ed7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:35.860529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bcf12d2a-5fd6-4672-88df-0155c87c7ed7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:35.869913 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bcf12d2a-5fd6-4672-88df-0155c87c7ed7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1767 microversion: 2.1 time: 0.198431 Oct 27 19:30:35.870533 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3514/6876] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:35 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1767 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:36.894965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9fa61deb-a7cf-4158-beca-ca79bd552781 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:36.895694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9fa61deb-a7cf-4158-beca-ca79bd552781 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:36.903954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fa61deb-a7cf-4158-beca-ca79bd552781 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:36.904724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fa61deb-a7cf-4158-beca-ca79bd552781 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:36.905187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fa61deb-a7cf-4158-beca-ca79bd552781 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:36.905946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fa61deb-a7cf-4158-beca-ca79bd552781 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:36.906442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fa61deb-a7cf-4158-beca-ca79bd552781 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:36.906898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9fa61deb-a7cf-4158-beca-ca79bd552781 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:37.050136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9fa61deb-a7cf-4158-beca-ca79bd552781 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:37.059127 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9fa61deb-a7cf-4158-beca-ca79bd552781 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1767 microversion: 2.1 time: 0.168523 Oct 27 19:30:37.060018 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3363/6877] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:36 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1767 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:37.744962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d8d3f3b8-4227-4a1c-9a7f-ecd29039803e req-f0a98daa-1035-4e9a-bf33-90444855ac22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76764fb-69a1-4e4f-af5c-2849a65fc90a", "name": "network-vif-deleted", "tag": "9964b335-fdfe-471a-af53-3d9802f6192b"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:37.755540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d8d3f3b8-4227-4a1c-9a7f-ecd29039803e req-f0a98daa-1035-4e9a-bf33-90444855ac22 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:37.756228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d8d3f3b8-4227-4a1c-9a7f-ecd29039803e req-f0a98daa-1035-4e9a-bf33-90444855ac22 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:37.756735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d8d3f3b8-4227-4a1c-9a7f-ecd29039803e req-f0a98daa-1035-4e9a-bf33-90444855ac22 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:37.768097 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d8d3f3b8-4227-4a1c-9a7f-ecd29039803e req-f0a98daa-1035-4e9a-bf33-90444855ac22 service nova] Creating event network-vif-deleted:9964b335-fdfe-471a-af53-3d9802f6192b for instance b76764fb-69a1-4e4f-af5c-2849a65fc90a on n-h2-860687-3 Oct 27 19:30:37.773060 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d8d3f3b8-4227-4a1c-9a7f-ecd29039803e req-f0a98daa-1035-4e9a-bf33-90444855ac22 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032216 Oct 27 19:30:37.773663 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3515/6878] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:30:38.085159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-46b7ee5c-7b0c-4397-b2c1-54da0185e667 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:38.085795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-46b7ee5c-7b0c-4397-b2c1-54da0185e667 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:38.094431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46b7ee5c-7b0c-4397-b2c1-54da0185e667 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:38.094992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46b7ee5c-7b0c-4397-b2c1-54da0185e667 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:38.095454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46b7ee5c-7b0c-4397-b2c1-54da0185e667 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:38.096211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46b7ee5c-7b0c-4397-b2c1-54da0185e667 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:38.096685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46b7ee5c-7b0c-4397-b2c1-54da0185e667 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:38.097138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46b7ee5c-7b0c-4397-b2c1-54da0185e667 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:38.132897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46b7ee5c-7b0c-4397-b2c1-54da0185e667 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:38.133324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46b7ee5c-7b0c-4397-b2c1-54da0185e667 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:38.133784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46b7ee5c-7b0c-4397-b2c1-54da0185e667 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:38.134303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-46b7ee5c-7b0c-4397-b2c1-54da0185e667 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lazy-loading 'fault' on Instance uuid b76764fb-69a1-4e4f-af5c-2849a65fc90a {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:30:38.184379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-46b7ee5c-7b0c-4397-b2c1-54da0185e667 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6807ac75994940f890164e5e7650de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef53fd6f972d48af95acaf91edbc7630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:38.194285 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-46b7ee5c-7b0c-4397-b2c1-54da0185e667 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 200 len: 1384 microversion: 2.1 time: 0.113792 Oct 27 19:30:38.195108 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3364/6879] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:38 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 1384 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:39.219948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d2ad943-d2cd-4dc3-9528-d56852e2b31a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:39.220654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3d2ad943-d2cd-4dc3-9528-d56852e2b31a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] [instance: b76764fb-69a1-4e4f-af5c-2849a65fc90a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:39.227569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2ad943-d2cd-4dc3-9528-d56852e2b31a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:39.228057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2ad943-d2cd-4dc3-9528-d56852e2b31a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:39.228499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2ad943-d2cd-4dc3-9528-d56852e2b31a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:39.229201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2ad943-d2cd-4dc3-9528-d56852e2b31a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:39.229659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2ad943-d2cd-4dc3-9528-d56852e2b31a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:39.230094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2ad943-d2cd-4dc3-9528-d56852e2b31a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:39.244028 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-3d2ad943-d2cd-4dc3-9528-d56852e2b31a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] HTTP exception thrown: Instance b76764fb-69a1-4e4f-af5c-2849a65fc90a could not be found. Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d2ad943-d2cd-4dc3-9528-d56852e2b31a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Request method failure captured: Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a HTTP/1.1 Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtvoL_fLZ8CREHvZYgJLOt6yz76J5SaT25lozDB_m3AcFXroo3KQc5ceSLPYLC-VlZ2T6CI34DHR313oujxzf51M8w4tpaXZ0L6UjdsS53LT-GeXRKDYroU94MmSH0TIf5zRWWJLZVHZvvD0LaiD3H4e3CqKLJHBv2BzbQXOPRa6JKk Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ef53fd6f972d48af95acaf91edbc7630 Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1025766051 Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ef53fd6f972d48af95acaf91edbc7630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ef53fd6f972d48af95acaf91edbc7630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ef53fd6f972d48af95acaf91edbc7630", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ef53fd6f972d48af95acaf91edbc7630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1025766051 Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ef53fd6f972d48af95acaf91edbc7630 Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1025766051 Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestSecurityGroupsBasicOps-1025766051-project Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 6807ac75994940f890164e5e7650de80 Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1025766051-project Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance b76764fb-69a1-4e4f-af5c-2849a65fc90a could not be found. Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'b76764fb-69a1-4e4f-af5c-2849a65fc90a'} Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b76764fb-69a1-4e4f-af5c-2849a65fc90a could not be found. Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b76764fb-69a1-4e4f-af5c-2849a65fc90a could not be found. Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:39.245653 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:30:39.249752 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:39.249752 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:30:39.249752 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:30:39.249752 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:30:39.249752 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:30:39.249752 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:30:39.249752 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b76764fb-69a1-4e4f-af5c-2849a65fc90a could not be found. Oct 27 19:30:39.249752 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:30:39.249752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d2ad943-d2cd-4dc3-9528-d56852e2b31a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Returning 404 to user: Instance b76764fb-69a1-4e4f-af5c-2849a65fc90a could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:30:39.249752 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3d2ad943-d2cd-4dc3-9528-d56852e2b31a tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a" status: 404 len: 111 microversion: 2.1 time: 0.032299 Oct 27 19:30:39.249752 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3516/6880] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:39 2022] GET /compute/v2.1/servers/b76764fb-69a1-4e4f-af5c-2849a65fc90a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:30:42.552934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b50d68a1-5e16-42c4-9db7-661901268cb7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] Calling method '.version_select at 0x7fc86ac5d0d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:42.576135 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b50d68a1-5e16-42c4-9db7-661901268cb7 tempest-TestSecurityGroupsBasicOps-1025766051 tempest-TestSecurityGroupsBasicOps-1025766051-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-717801111" status: 202 len: 0 microversion: 2.1 time: 0.027976 Oct 27 19:30:42.576737 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3365/6881] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:30:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-717801111 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:30:47.413115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1014208127", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "1c338fcd-2d8e-463f-ac35-900c2ab6329c"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:47.466713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] validate_networks() for [('1c338fcd-2d8e-463f-ac35-900c2ab6329c', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:30:47.919401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:30:47.919829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:30:47.920334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:30:47.920749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:30:47.921167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:30:47.930569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:47.931055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:47.931499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:47.932224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:47.932680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:47.933116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:47.950530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Getting quotas for project 92570ba62a9d41cc928b813ee4104d9c. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:30:47.955741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Getting quotas for user 1230c811e44943d39b63e0ef9244547a and project 92570ba62a9d41cc928b813ee4104d9c. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:30:47.968925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:30:47.971327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:30:48.016042 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c4b1dfbf-5cbe-4d78-8b2b-1a7d6b0d059a tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718181 Oct 27 19:30:48.016716 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3517/6882] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:30:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:30:48.029678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8a243812-d6d2-4aa9-acfd-8a91bed876d9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:48.030476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8a243812-d6d2-4aa9-acfd-8a91bed876d9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:48.087715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8a243812-d6d2-4aa9-acfd-8a91bed876d9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:48.094680 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8a243812-d6d2-4aa9-acfd-8a91bed876d9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1215 microversion: 2.1 time: 0.070027 Oct 27 19:30:48.095265 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3366/6883] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:48 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:49.119299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-444688f2-3868-4591-b276-fa1081483670 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:49.120116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-444688f2-3868-4591-b276-fa1081483670 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:49.127148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-444688f2-3868-4591-b276-fa1081483670 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:49.127721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-444688f2-3868-4591-b276-fa1081483670 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:49.128235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-444688f2-3868-4591-b276-fa1081483670 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:49.128954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-444688f2-3868-4591-b276-fa1081483670 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:49.129412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-444688f2-3868-4591-b276-fa1081483670 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:49.130332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-444688f2-3868-4591-b276-fa1081483670 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:49.233652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-444688f2-3868-4591-b276-fa1081483670 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:49.241427 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-444688f2-3868-4591-b276-fa1081483670 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1285 microversion: 2.1 time: 0.127808 Oct 27 19:30:49.242199 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3518/6884] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:49 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:50.264090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-da7fa134-4173-4376-836f-efc7e427ec30 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:50.264960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-da7fa134-4173-4376-836f-efc7e427ec30 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:50.267002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:50.273413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da7fa134-4173-4376-836f-efc7e427ec30 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:50.273913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da7fa134-4173-4376-836f-efc7e427ec30 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:50.274364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da7fa134-4173-4376-836f-efc7e427ec30 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:50.275247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da7fa134-4173-4376-836f-efc7e427ec30 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:50.275719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da7fa134-4173-4376-836f-efc7e427ec30 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:50.276161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da7fa134-4173-4376-836f-efc7e427ec30 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:50.408607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e3d6785f-8ee5-4f6f-836a-0176356b32e2 req-4b6d8965-2f6a-475b-9e11-12b8a7591744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "303c4e6c-871e-42bf-b85a-59a1d091cd8d", "tag": "ddd83461-bd0f-4e45-b91e-ba6acf5afa75"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:50.418884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-da7fa134-4173-4376-836f-efc7e427ec30 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:50.420261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e3d6785f-8ee5-4f6f-836a-0176356b32e2 req-4b6d8965-2f6a-475b-9e11-12b8a7591744 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:50.420865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e3d6785f-8ee5-4f6f-836a-0176356b32e2 req-4b6d8965-2f6a-475b-9e11-12b8a7591744 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:50.421416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e3d6785f-8ee5-4f6f-836a-0176356b32e2 req-4b6d8965-2f6a-475b-9e11-12b8a7591744 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:50.427288 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-da7fa134-4173-4376-836f-efc7e427ec30 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1315 microversion: 2.1 time: 0.167088 Oct 27 19:30:50.427988 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3367/6885] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:50 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:50.434350 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e3d6785f-8ee5-4f6f-836a-0176356b32e2 req-4b6d8965-2f6a-475b-9e11-12b8a7591744 service nova] Creating event network-changed:ddd83461-bd0f-4e45-b91e-ba6acf5afa75 for instance 303c4e6c-871e-42bf-b85a-59a1d091cd8d on n-h2-860687-3 Oct 27 19:30:50.439383 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e3d6785f-8ee5-4f6f-836a-0176356b32e2 req-4b6d8965-2f6a-475b-9e11-12b8a7591744 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037412 Oct 27 19:30:50.440055 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3519/6886] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:30:51.452047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-12ce53a3-09ff-4e68-8e8e-69d2da1cac56 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:51.452682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-12ce53a3-09ff-4e68-8e8e-69d2da1cac56 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:51.459481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12ce53a3-09ff-4e68-8e8e-69d2da1cac56 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:51.459986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12ce53a3-09ff-4e68-8e8e-69d2da1cac56 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:51.460444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12ce53a3-09ff-4e68-8e8e-69d2da1cac56 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:51.461157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12ce53a3-09ff-4e68-8e8e-69d2da1cac56 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:51.461634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12ce53a3-09ff-4e68-8e8e-69d2da1cac56 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:51.462082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12ce53a3-09ff-4e68-8e8e-69d2da1cac56 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:51.592592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-12ce53a3-09ff-4e68-8e8e-69d2da1cac56 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:51.600504 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-12ce53a3-09ff-4e68-8e8e-69d2da1cac56 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1315 microversion: 2.1 time: 0.152446 Oct 27 19:30:51.601098 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3368/6887] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:51 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:52.624550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3668cb1b-2cbf-417d-8fb2-8ac1e81c2934 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:52.625254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3668cb1b-2cbf-417d-8fb2-8ac1e81c2934 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:52.634195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3668cb1b-2cbf-417d-8fb2-8ac1e81c2934 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:52.634705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3668cb1b-2cbf-417d-8fb2-8ac1e81c2934 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:52.635145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3668cb1b-2cbf-417d-8fb2-8ac1e81c2934 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:52.635836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3668cb1b-2cbf-417d-8fb2-8ac1e81c2934 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:52.636290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3668cb1b-2cbf-417d-8fb2-8ac1e81c2934 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:52.636718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3668cb1b-2cbf-417d-8fb2-8ac1e81c2934 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:52.766713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3668cb1b-2cbf-417d-8fb2-8ac1e81c2934 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:52.775375 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3668cb1b-2cbf-417d-8fb2-8ac1e81c2934 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1315 microversion: 2.1 time: 0.155028 Oct 27 19:30:52.775949 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3520/6888] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:52 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:53.798736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-86fe643c-8994-4346-9842-6289b55aa5a9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:53.799292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-86fe643c-8994-4346-9842-6289b55aa5a9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:53.807051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86fe643c-8994-4346-9842-6289b55aa5a9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:53.807557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86fe643c-8994-4346-9842-6289b55aa5a9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:53.808018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86fe643c-8994-4346-9842-6289b55aa5a9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:53.808738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86fe643c-8994-4346-9842-6289b55aa5a9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:53.809214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86fe643c-8994-4346-9842-6289b55aa5a9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:53.809662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86fe643c-8994-4346-9842-6289b55aa5a9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:53.946770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-86fe643c-8994-4346-9842-6289b55aa5a9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:53.954640 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-86fe643c-8994-4346-9842-6289b55aa5a9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1315 microversion: 2.1 time: 0.159933 Oct 27 19:30:53.955236 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3369/6889] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:53 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:54.977941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e34e8a40-171a-4515-ab4b-2322706b2383 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:54.978597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e34e8a40-171a-4515-ab4b-2322706b2383 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:54.981376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:54.986617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e34e8a40-171a-4515-ab4b-2322706b2383 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:54.987106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e34e8a40-171a-4515-ab4b-2322706b2383 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:54.987542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e34e8a40-171a-4515-ab4b-2322706b2383 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:54.988240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e34e8a40-171a-4515-ab4b-2322706b2383 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:54.988695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e34e8a40-171a-4515-ab4b-2322706b2383 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:54.989755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e34e8a40-171a-4515-ab4b-2322706b2383 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:54.993154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=68 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:55.071086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f54017b7-ca4d-4c79-8e61-22bf05726d71 req-0f2ccec0-70c9-4c0d-b4c1-9e81b95f7193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303c4e6c-871e-42bf-b85a-59a1d091cd8d", "name": "network-vif-plugged", "status": "completed", "tag": "ddd83461-bd0f-4e45-b91e-ba6acf5afa75"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:55.076810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:55.083169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f54017b7-ca4d-4c79-8e61-22bf05726d71 req-0f2ccec0-70c9-4c0d-b4c1-9e81b95f7193 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:55.084067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f54017b7-ca4d-4c79-8e61-22bf05726d71 req-0f2ccec0-70c9-4c0d-b4c1-9e81b95f7193 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:55.085331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f54017b7-ca4d-4c79-8e61-22bf05726d71 req-0f2ccec0-70c9-4c0d-b4c1-9e81b95f7193 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:55.098643 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f54017b7-ca4d-4c79-8e61-22bf05726d71 req-0f2ccec0-70c9-4c0d-b4c1-9e81b95f7193 service nova] Creating event network-vif-plugged:ddd83461-bd0f-4e45-b91e-ba6acf5afa75 for instance 303c4e6c-871e-42bf-b85a-59a1d091cd8d on n-h2-860687-3 Oct 27 19:30:55.103810 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f54017b7-ca4d-4c79-8e61-22bf05726d71 req-0f2ccec0-70c9-4c0d-b4c1-9e81b95f7193 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037145 Oct 27 19:30:55.104806 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3370/6890] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:30:55.135528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e34e8a40-171a-4515-ab4b-2322706b2383 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:55.143670 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e34e8a40-171a-4515-ab4b-2322706b2383 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1315 microversion: 2.1 time: 0.170228 Oct 27 19:30:55.144265 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3521/6891] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:54 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:56.169399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-32ef26dc-e440-4fe6-8534-685c3df0e9ff tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:56.170120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-32ef26dc-e440-4fe6-8534-685c3df0e9ff tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:56.178363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32ef26dc-e440-4fe6-8534-685c3df0e9ff tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:56.178882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32ef26dc-e440-4fe6-8534-685c3df0e9ff tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:56.179952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32ef26dc-e440-4fe6-8534-685c3df0e9ff tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:56.180672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32ef26dc-e440-4fe6-8534-685c3df0e9ff tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:56.181148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32ef26dc-e440-4fe6-8534-685c3df0e9ff tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:56.181594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32ef26dc-e440-4fe6-8534-685c3df0e9ff tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:56.317622 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-32ef26dc-e440-4fe6-8534-685c3df0e9ff tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:56.325329 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-32ef26dc-e440-4fe6-8534-685c3df0e9ff tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1315 microversion: 2.1 time: 0.160823 Oct 27 19:30:56.325900 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3371/6892] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:56 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:57.348167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6f23aaf2-1ad8-49b4-adca-c0b30fc431b3 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:57.348790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6f23aaf2-1ad8-49b4-adca-c0b30fc431b3 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:57.355642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f23aaf2-1ad8-49b4-adca-c0b30fc431b3 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:57.356164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f23aaf2-1ad8-49b4-adca-c0b30fc431b3 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:57.356589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f23aaf2-1ad8-49b4-adca-c0b30fc431b3 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:57.357296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f23aaf2-1ad8-49b4-adca-c0b30fc431b3 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:57.357757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f23aaf2-1ad8-49b4-adca-c0b30fc431b3 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:57.358192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6f23aaf2-1ad8-49b4-adca-c0b30fc431b3 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:57.496314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6f23aaf2-1ad8-49b4-adca-c0b30fc431b3 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:57.504063 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6f23aaf2-1ad8-49b4-adca-c0b30fc431b3 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1502 microversion: 2.1 time: 0.159991 Oct 27 19:30:57.505516 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3522/6893] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:57 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:57.527365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-18045a15-5885-465c-90ec-0fe78dbc0417 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:57.528002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-18045a15-5885-465c-90ec-0fe78dbc0417 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:57.534846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18045a15-5885-465c-90ec-0fe78dbc0417 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:57.535362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18045a15-5885-465c-90ec-0fe78dbc0417 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:57.536086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18045a15-5885-465c-90ec-0fe78dbc0417 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:57.536810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18045a15-5885-465c-90ec-0fe78dbc0417 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:57.537291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18045a15-5885-465c-90ec-0fe78dbc0417 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:57.537741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18045a15-5885-465c-90ec-0fe78dbc0417 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:57.666951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-18045a15-5885-465c-90ec-0fe78dbc0417 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:57.674697 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-18045a15-5885-465c-90ec-0fe78dbc0417 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1502 microversion: 2.1 time: 0.151176 Oct 27 19:30:57.675282 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3372/6894] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:57 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:57.697943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5ec1353e-b427-4c38-9034-34a5207180d2 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:57.698517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5ec1353e-b427-4c38-9034-34a5207180d2 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:57.704472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ec1353e-b427-4c38-9034-34a5207180d2 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:57.704952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ec1353e-b427-4c38-9034-34a5207180d2 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:57.705418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ec1353e-b427-4c38-9034-34a5207180d2 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:57.706098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ec1353e-b427-4c38-9034-34a5207180d2 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:57.706589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ec1353e-b427-4c38-9034-34a5207180d2 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:57.707014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5ec1353e-b427-4c38-9034-34a5207180d2 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:57.730005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-5ec1353e-b427-4c38-9034-34a5207180d2 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lazy-loading 'flavor' on Instance uuid 303c4e6c-871e-42bf-b85a-59a1d091cd8d {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:30:57.798235 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5ec1353e-b427-4c38-9034-34a5207180d2 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "POST /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d/action" status: 202 len: 0 microversion: 2.1 time: 0.100749 Oct 27 19:30:57.798235 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3523/6895] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:30:57 2022] POST /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:30:57.804166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-65531da2-927a-492e-9490-ec31c960d019 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:57.804824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-65531da2-927a-492e-9490-ec31c960d019 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:57.810896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65531da2-927a-492e-9490-ec31c960d019 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:57.811448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65531da2-927a-492e-9490-ec31c960d019 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:57.811867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65531da2-927a-492e-9490-ec31c960d019 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:57.812663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65531da2-927a-492e-9490-ec31c960d019 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:57.813113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65531da2-927a-492e-9490-ec31c960d019 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:57.813559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65531da2-927a-492e-9490-ec31c960d019 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:57.948843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-65531da2-927a-492e-9490-ec31c960d019 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:57.956639 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-65531da2-927a-492e-9490-ec31c960d019 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1510 microversion: 2.1 time: 0.157132 Oct 27 19:30:57.957217 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3373/6896] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:57 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:58.976816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:58.977683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:58.983262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4cabbf5b-7c36-4092-8bf6-a4b8c0003353 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:58.984038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4cabbf5b-7c36-4092-8bf6-a4b8c0003353 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:58.991615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cabbf5b-7c36-4092-8bf6-a4b8c0003353 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:58.992040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cabbf5b-7c36-4092-8bf6-a4b8c0003353 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:58.992484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cabbf5b-7c36-4092-8bf6-a4b8c0003353 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:58.993183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cabbf5b-7c36-4092-8bf6-a4b8c0003353 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:58.993645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cabbf5b-7c36-4092-8bf6-a4b8c0003353 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:58.994079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4cabbf5b-7c36-4092-8bf6-a4b8c0003353 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:59.125004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4cabbf5b-7c36-4092-8bf6-a4b8c0003353 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:59.133520 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4cabbf5b-7c36-4092-8bf6-a4b8c0003353 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1493 microversion: 2.1 time: 0.157654 Oct 27 19:30:59.134084 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3524/6897] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:58 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1493 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:30:59.155741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a8d1a69a-61fc-422d-86db-7ba27b32fb88 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:30:59.156375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a8d1a69a-61fc-422d-86db-7ba27b32fb88 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:59.158422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:30:59.164591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8d1a69a-61fc-422d-86db-7ba27b32fb88 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:59.165101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8d1a69a-61fc-422d-86db-7ba27b32fb88 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:59.165564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8d1a69a-61fc-422d-86db-7ba27b32fb88 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:59.166282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8d1a69a-61fc-422d-86db-7ba27b32fb88 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:59.166795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8d1a69a-61fc-422d-86db-7ba27b32fb88 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:59.167246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8d1a69a-61fc-422d-86db-7ba27b32fb88 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:59.233624 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a8d1a69a-61fc-422d-86db-7ba27b32fb88 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "POST /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d/action" status: 202 len: 0 microversion: 2.1 time: 0.081546 Oct 27 19:30:59.234273 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3374/6898] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:30:59 2022] POST /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:30:59.243717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d9c8bc19-c435-44df-bf43-d068d251ad04 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:30:59.244430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d9c8bc19-c435-44df-bf43-d068d251ad04 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:30:59.250896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d9c8bc19-c435-44df-bf43-d068d251ad04 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:59.251367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d9c8bc19-c435-44df-bf43-d068d251ad04 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:59.251956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d9c8bc19-c435-44df-bf43-d068d251ad04 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:59.252713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d9c8bc19-c435-44df-bf43-d068d251ad04 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:30:59.253165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d9c8bc19-c435-44df-bf43-d068d251ad04 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:30:59.253667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d9c8bc19-c435-44df-bf43-d068d251ad04 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:30:59.481327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d9c8bc19-c435-44df-bf43-d068d251ad04 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:30:59.489742 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d9c8bc19-c435-44df-bf43-d068d251ad04 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1499 microversion: 2.1 time: 0.250079 Oct 27 19:30:59.490332 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3525/6899] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:30:59 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1499 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:31:00.514648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2ae09f65-0ecd-4e27-b921-d34243615271 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:31:00.515293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2ae09f65-0ecd-4e27-b921-d34243615271 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:31:00.522069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ae09f65-0ecd-4e27-b921-d34243615271 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:00.522606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ae09f65-0ecd-4e27-b921-d34243615271 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:00.523069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ae09f65-0ecd-4e27-b921-d34243615271 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:00.523780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ae09f65-0ecd-4e27-b921-d34243615271 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:00.524256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ae09f65-0ecd-4e27-b921-d34243615271 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:00.524704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ae09f65-0ecd-4e27-b921-d34243615271 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:00.660290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2ae09f65-0ecd-4e27-b921-d34243615271 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:31:00.669406 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2ae09f65-0ecd-4e27-b921-d34243615271 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1499 microversion: 2.1 time: 0.160058 Oct 27 19:31:00.669991 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3375/6900] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:31:00 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1499 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:31:01.693292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a1db4ed3-e6ea-4e21-b100-78965c8135d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:31:01.693950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a1db4ed3-e6ea-4e21-b100-78965c8135d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:31:01.700917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1db4ed3-e6ea-4e21-b100-78965c8135d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:01.701413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1db4ed3-e6ea-4e21-b100-78965c8135d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:01.701856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1db4ed3-e6ea-4e21-b100-78965c8135d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:01.702591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1db4ed3-e6ea-4e21-b100-78965c8135d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:01.703060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1db4ed3-e6ea-4e21-b100-78965c8135d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:01.703496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a1db4ed3-e6ea-4e21-b100-78965c8135d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:01.838502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a1db4ed3-e6ea-4e21-b100-78965c8135d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:31:01.846217 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a1db4ed3-e6ea-4e21-b100-78965c8135d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1502 microversion: 2.1 time: 0.157161 Oct 27 19:31:01.846827 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3526/6901] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:31:01 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:31:01.870946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3a4b7ad9-31ba-472b-bf98-0516fdf390e9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:31:01.871501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3a4b7ad9-31ba-472b-bf98-0516fdf390e9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:31:01.878354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a4b7ad9-31ba-472b-bf98-0516fdf390e9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:01.878923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a4b7ad9-31ba-472b-bf98-0516fdf390e9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:01.879669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a4b7ad9-31ba-472b-bf98-0516fdf390e9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:01.880475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a4b7ad9-31ba-472b-bf98-0516fdf390e9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:01.880958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a4b7ad9-31ba-472b-bf98-0516fdf390e9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:01.881408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a4b7ad9-31ba-472b-bf98-0516fdf390e9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:01.907275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-3a4b7ad9-31ba-472b-bf98-0516fdf390e9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lazy-loading 'flavor' on Instance uuid 303c4e6c-871e-42bf-b85a-59a1d091cd8d {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:31:01.977786 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3a4b7ad9-31ba-472b-bf98-0516fdf390e9 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "POST /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d/action" status: 202 len: 0 microversion: 2.1 time: 0.110672 Oct 27 19:31:01.978650 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3376/6902] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:31:01 2022] POST /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 19:31:01.986719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-71977d1b-5121-4b0c-9856-243038649ac5 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:31:01.987342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-71977d1b-5121-4b0c-9856-243038649ac5 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:31:01.993855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71977d1b-5121-4b0c-9856-243038649ac5 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:01.994643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71977d1b-5121-4b0c-9856-243038649ac5 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:01.995099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71977d1b-5121-4b0c-9856-243038649ac5 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:01.995812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71977d1b-5121-4b0c-9856-243038649ac5 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:01.996425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71977d1b-5121-4b0c-9856-243038649ac5 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:01.996990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71977d1b-5121-4b0c-9856-243038649ac5 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:02.127137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-71977d1b-5121-4b0c-9856-243038649ac5 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:31:02.136123 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-71977d1b-5121-4b0c-9856-243038649ac5 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1510 microversion: 2.1 time: 0.153436 Oct 27 19:31:02.136689 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3527/6903] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:31:01 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:31:03.160364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-134fce10-3fb7-45dc-b731-170ba0bf32e8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:31:03.161514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-134fce10-3fb7-45dc-b731-170ba0bf32e8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:31:03.168579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-134fce10-3fb7-45dc-b731-170ba0bf32e8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:03.169079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-134fce10-3fb7-45dc-b731-170ba0bf32e8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:03.169535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-134fce10-3fb7-45dc-b731-170ba0bf32e8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:03.170241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-134fce10-3fb7-45dc-b731-170ba0bf32e8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:03.170741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-134fce10-3fb7-45dc-b731-170ba0bf32e8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:03.171186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-134fce10-3fb7-45dc-b731-170ba0bf32e8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:03.305301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-134fce10-3fb7-45dc-b731-170ba0bf32e8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:31:03.313097 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-134fce10-3fb7-45dc-b731-170ba0bf32e8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1493 microversion: 2.1 time: 0.157037 Oct 27 19:31:03.313664 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3377/6904] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:31:03 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1493 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:31:03.336476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fbc74cb8-1251-4c25-80e8-6794e60cb059 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:31:03.337004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fbc74cb8-1251-4c25-80e8-6794e60cb059 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:31:03.343749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbc74cb8-1251-4c25-80e8-6794e60cb059 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:03.344241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbc74cb8-1251-4c25-80e8-6794e60cb059 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:03.344688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbc74cb8-1251-4c25-80e8-6794e60cb059 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:03.345385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbc74cb8-1251-4c25-80e8-6794e60cb059 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:03.345855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbc74cb8-1251-4c25-80e8-6794e60cb059 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:03.346285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbc74cb8-1251-4c25-80e8-6794e60cb059 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:03.412168 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fbc74cb8-1251-4c25-80e8-6794e60cb059 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "POST /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d/action" status: 202 len: 0 microversion: 2.1 time: 0.079833 Oct 27 19:31:03.412758 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3528/6905] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:31:03 2022] POST /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:31:03.420944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-080696ac-9a15-4d7e-94b6-8c95d0ab2caf tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:31:03.421579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-080696ac-9a15-4d7e-94b6-8c95d0ab2caf tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:31:03.428772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-080696ac-9a15-4d7e-94b6-8c95d0ab2caf tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:03.429326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-080696ac-9a15-4d7e-94b6-8c95d0ab2caf tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:03.429786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-080696ac-9a15-4d7e-94b6-8c95d0ab2caf tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:03.430591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-080696ac-9a15-4d7e-94b6-8c95d0ab2caf tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:03.431052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-080696ac-9a15-4d7e-94b6-8c95d0ab2caf tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:03.431505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-080696ac-9a15-4d7e-94b6-8c95d0ab2caf tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:03.572013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-080696ac-9a15-4d7e-94b6-8c95d0ab2caf tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:31:03.579936 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-080696ac-9a15-4d7e-94b6-8c95d0ab2caf tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1499 microversion: 2.1 time: 0.162895 Oct 27 19:31:03.580712 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3378/6906] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:31:03 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1499 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:31:04.605647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-98194283-0578-45a1-9f06-2e97b4a1d09b tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:31:04.606358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-98194283-0578-45a1-9f06-2e97b4a1d09b tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:31:04.614127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98194283-0578-45a1-9f06-2e97b4a1d09b tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:04.614657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98194283-0578-45a1-9f06-2e97b4a1d09b tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:04.615105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98194283-0578-45a1-9f06-2e97b4a1d09b tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:04.615820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98194283-0578-45a1-9f06-2e97b4a1d09b tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:04.616280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98194283-0578-45a1-9f06-2e97b4a1d09b tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:04.616717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98194283-0578-45a1-9f06-2e97b4a1d09b tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:04.777614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-98194283-0578-45a1-9f06-2e97b4a1d09b tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:31:04.785598 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-98194283-0578-45a1-9f06-2e97b4a1d09b tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1499 microversion: 2.1 time: 0.185163 Oct 27 19:31:04.786317 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3529/6907] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:31:04 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1499 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:31:05.811478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fdf519c2-e0a0-4044-9af8-c31c5ef4b049 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:31:05.812103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fdf519c2-e0a0-4044-9af8-c31c5ef4b049 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:31:05.820380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdf519c2-e0a0-4044-9af8-c31c5ef4b049 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:05.820883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdf519c2-e0a0-4044-9af8-c31c5ef4b049 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:05.821336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdf519c2-e0a0-4044-9af8-c31c5ef4b049 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:05.822042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdf519c2-e0a0-4044-9af8-c31c5ef4b049 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:05.822540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdf519c2-e0a0-4044-9af8-c31c5ef4b049 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:05.822991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fdf519c2-e0a0-4044-9af8-c31c5ef4b049 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:05.954175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fdf519c2-e0a0-4044-9af8-c31c5ef4b049 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:31:05.962870 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fdf519c2-e0a0-4044-9af8-c31c5ef4b049 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1502 microversion: 2.1 time: 0.155329 Oct 27 19:31:05.963440 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3379/6908] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:31:05 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:31:05.985510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0ba705bf-4c3a-409a-8f1c-3ce271160306 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:31:05.986022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0ba705bf-4c3a-409a-8f1c-3ce271160306 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:31:05.992640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ba705bf-4c3a-409a-8f1c-3ce271160306 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:05.993128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ba705bf-4c3a-409a-8f1c-3ce271160306 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:05.993577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ba705bf-4c3a-409a-8f1c-3ce271160306 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:05.994277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ba705bf-4c3a-409a-8f1c-3ce271160306 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:05.994770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ba705bf-4c3a-409a-8f1c-3ce271160306 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:05.995204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ba705bf-4c3a-409a-8f1c-3ce271160306 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:06.021438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0ba705bf-4c3a-409a-8f1c-3ce271160306 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:31:06.103512 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0ba705bf-4c3a-409a-8f1c-3ce271160306 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "DELETE /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 204 len: 0 microversion: 2.1 time: 0.121019 Oct 27 19:31:06.104295 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3530/6909] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:31:05 2022] DELETE /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:31:06.114330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-16a613aa-0acd-405f-8bcc-ef8d0e126c37 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:31:06.115197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-16a613aa-0acd-405f-8bcc-ef8d0e126c37 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:31:06.121863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16a613aa-0acd-405f-8bcc-ef8d0e126c37 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:06.122481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16a613aa-0acd-405f-8bcc-ef8d0e126c37 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:06.122941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16a613aa-0acd-405f-8bcc-ef8d0e126c37 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:06.123745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16a613aa-0acd-405f-8bcc-ef8d0e126c37 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:06.124337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16a613aa-0acd-405f-8bcc-ef8d0e126c37 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:06.124880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-16a613aa-0acd-405f-8bcc-ef8d0e126c37 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:06.269287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-16a613aa-0acd-405f-8bcc-ef8d0e126c37 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:31:06.277870 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-16a613aa-0acd-405f-8bcc-ef8d0e126c37 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1508 microversion: 2.1 time: 0.168876 Oct 27 19:31:06.278469 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3380/6910] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:31:06 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:31:07.303984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cf589831-cc0c-475d-b33f-ff220334d9d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:31:07.304748 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cf589831-cc0c-475d-b33f-ff220334d9d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:31:07.311766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf589831-cc0c-475d-b33f-ff220334d9d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:07.312304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf589831-cc0c-475d-b33f-ff220334d9d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:07.312800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf589831-cc0c-475d-b33f-ff220334d9d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:07.313523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf589831-cc0c-475d-b33f-ff220334d9d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:07.313984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf589831-cc0c-475d-b33f-ff220334d9d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:07.314439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cf589831-cc0c-475d-b33f-ff220334d9d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:07.458534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cf589831-cc0c-475d-b33f-ff220334d9d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:31:07.466771 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cf589831-cc0c-475d-b33f-ff220334d9d8 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1508 microversion: 2.1 time: 0.167955 Oct 27 19:31:07.467352 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3531/6911] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:31:07 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:31:08.476974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-7e4965f5-484a-471a-912d-de90ec28883b req-7c9a8731-78fd-441e-9348-4785c4c955a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303c4e6c-871e-42bf-b85a-59a1d091cd8d", "name": "network-vif-deleted", "tag": "ddd83461-bd0f-4e45-b91e-ba6acf5afa75"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:31:08.488907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7e4965f5-484a-471a-912d-de90ec28883b req-7c9a8731-78fd-441e-9348-4785c4c955a8 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:08.489414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7e4965f5-484a-471a-912d-de90ec28883b req-7c9a8731-78fd-441e-9348-4785c4c955a8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:08.489875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7e4965f5-484a-471a-912d-de90ec28883b req-7c9a8731-78fd-441e-9348-4785c4c955a8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:08.493871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-90a981ab-df77-45f8-a622-dae7771346ae tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:31:08.495500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-90a981ab-df77-45f8-a622-dae7771346ae tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:31:08.504053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90a981ab-df77-45f8-a622-dae7771346ae tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:08.504747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90a981ab-df77-45f8-a622-dae7771346ae tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:08.505359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90a981ab-df77-45f8-a622-dae7771346ae tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:08.506134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90a981ab-df77-45f8-a622-dae7771346ae tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:08.506643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90a981ab-df77-45f8-a622-dae7771346ae tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:08.507101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-90a981ab-df77-45f8-a622-dae7771346ae tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:08.507236 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-7e4965f5-484a-471a-912d-de90ec28883b req-7c9a8731-78fd-441e-9348-4785c4c955a8 service nova] Creating event network-vif-deleted:ddd83461-bd0f-4e45-b91e-ba6acf5afa75 for instance 303c4e6c-871e-42bf-b85a-59a1d091cd8d on n-h2-860687-3 Oct 27 19:31:08.515239 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-7e4965f5-484a-471a-912d-de90ec28883b req-7c9a8731-78fd-441e-9348-4785c4c955a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042153 Oct 27 19:31:08.516413 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3381/6912] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:31:08.578212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-90a981ab-df77-45f8-a622-dae7771346ae tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1230c811e44943d39b63e0ef9244547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92570ba62a9d41cc928b813ee4104d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:31:08.586991 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-90a981ab-df77-45f8-a622-dae7771346ae tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 200 len: 1300 microversion: 2.1 time: 0.099607 Oct 27 19:31:08.587795 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3532/6913] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:31:08 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:31:09.612006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7f8fbe66-3bc3-4422-ad19-b112e2127f63 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:31:09.612998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7f8fbe66-3bc3-4422-ad19-b112e2127f63 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] [instance: 303c4e6c-871e-42bf-b85a-59a1d091cd8d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:31:09.620807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f8fbe66-3bc3-4422-ad19-b112e2127f63 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:09.621309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f8fbe66-3bc3-4422-ad19-b112e2127f63 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:09.621760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f8fbe66-3bc3-4422-ad19-b112e2127f63 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:09.622496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f8fbe66-3bc3-4422-ad19-b112e2127f63 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:31:09.622982 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f8fbe66-3bc3-4422-ad19-b112e2127f63 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:31:09.623423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f8fbe66-3bc3-4422-ad19-b112e2127f63 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:31:09.627739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:31:09.639075 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-7f8fbe66-3bc3-4422-ad19-b112e2127f63 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] HTTP exception thrown: Instance 303c4e6c-871e-42bf-b85a-59a1d091cd8d could not be found. Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7f8fbe66-3bc3-4422-ad19-b112e2127f63 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Request method failure captured: Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d HTTP/1.1 Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtxltI9h91y_EqKbRyxYCQXDYNlg6QnQopf_nJnhDE9xiKs3_LZMhrBXTLBVR7B09XyiBSaLUgmRjDtNEtzqiXGs5fJJwnMOI8vbOCvgea0SQcXCeQr7w7ayBA1auJOaHd3Hq4xtNSSbTqRH7-Dw0jKaeEsXf-7ALuoUvVHtBuu_Q4E Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 92570ba62a9d41cc928b813ee4104d9c Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestServerAdvancedOps-786505531 Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92570ba62a9d41cc928b813ee4104d9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92570ba62a9d41cc928b813ee4104d9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92570ba62a9d41cc928b813ee4104d9c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92570ba62a9d41cc928b813ee4104d9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestServerAdvancedOps-786505531 Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 92570ba62a9d41cc928b813ee4104d9c Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestServerAdvancedOps-786505531 Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestServerAdvancedOps-786505531-project Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 1230c811e44943d39b63e0ef9244547a Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestServerAdvancedOps-786505531-project Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 303c4e6c-871e-42bf-b85a-59a1d091cd8d could not be found. Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '303c4e6c-871e-42bf-b85a-59a1d091cd8d'} Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 303c4e6c-871e-42bf-b85a-59a1d091cd8d could not be found. Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 303c4e6c-871e-42bf-b85a-59a1d091cd8d could not be found. Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:31:09.640790 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:31:09.645477 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:31:09.645477 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:31:09.645477 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:31:09.645477 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:31:09.645477 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:31:09.645477 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 303c4e6c-871e-42bf-b85a-59a1d091cd8d could not be found. Oct 27 19:31:09.645477 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:31:09.645477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7f8fbe66-3bc3-4422-ad19-b112e2127f63 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] Returning 404 to user: Instance 303c4e6c-871e-42bf-b85a-59a1d091cd8d could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:31:09.645477 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7f8fbe66-3bc3-4422-ad19-b112e2127f63 tempest-TestServerAdvancedOps-786505531 tempest-TestServerAdvancedOps-786505531-project] 10.222.0.42 "GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d" status: 404 len: 111 microversion: 2.1 time: 0.034566 Oct 27 19:31:09.645477 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3382/6914] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:31:09 2022] GET /compute/v2.1/servers/303c4e6c-871e-42bf-b85a-59a1d091cd8d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:32:14.031123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:32:14.031990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:32:14.032919 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 19:32:14.033157 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 19:32:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Oct 27 19:32:14.039099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-482417345", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-600353821", "security_groups": [{"name": "tempest-secgroup-smoke-1058459960"}], "block_device_mapping_v2": [{"uuid": "de4e5c86-7452-46b4-be16-7979214f7c3c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:32:14.175951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] validate_networks() for [('0d5b06ac-a20f-4a8f-9ae6-f3faa1e2a969', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:32:14.550689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:32:14.551120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:32:14.551596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:32:14.552009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:32:14.552458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:32:14.562697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:14.563664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:14.565449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:14.566208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:14.566713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:14.567186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:14.584851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:32:14.590223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Getting quotas for user c8e60ff9ab0d45628195f314f1cac791 and project b84229fcbba74710a8c0c30c34dce78d. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:32:14.649562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:32:14.651794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de4e5c86-7452-46b4-be16-7979214f7c3c',volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:32:14.787918 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-10f3c860-f176-487f-8b1b-7099f7351616 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.759012 Oct 27 19:32:14.789130 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3533/6915] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:32:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 19:32:14.800128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=25 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:32:14.802582 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 27 19:32:14.817216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-87986056-8162-409d-bbae-63bdd7e80081 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:14.823779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-87986056-8162-409d-bbae-63bdd7e80081 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:14.885517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-87986056-8162-409d-bbae-63bdd7e80081 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:14.895653 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-87986056-8162-409d-bbae-63bdd7e80081 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1093 microversion: 2.1 time: 0.098547 Oct 27 19:32:14.896727 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3383/6916] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:14 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1093 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:15.922006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fbaee50e-2696-4f00-8f84-60da8622571f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:15.924062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fbaee50e-2696-4f00-8f84-60da8622571f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:15.933469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbaee50e-2696-4f00-8f84-60da8622571f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:15.934365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbaee50e-2696-4f00-8f84-60da8622571f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:15.935267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbaee50e-2696-4f00-8f84-60da8622571f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:15.936251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbaee50e-2696-4f00-8f84-60da8622571f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:15.936952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbaee50e-2696-4f00-8f84-60da8622571f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:15.937897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbaee50e-2696-4f00-8f84-60da8622571f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:16.170890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fbaee50e-2696-4f00-8f84-60da8622571f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:16.183302 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fbaee50e-2696-4f00-8f84-60da8622571f tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1209 microversion: 2.1 time: 0.267429 Oct 27 19:32:16.184391 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3534/6917] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:15 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1209 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:32:17.208403 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6c7120c7-2c3b-45b0-b5a5-7e34c55d639e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:17.209835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6c7120c7-2c3b-45b0-b5a5-7e34c55d639e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:17.218633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c7120c7-2c3b-45b0-b5a5-7e34c55d639e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:17.219627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c7120c7-2c3b-45b0-b5a5-7e34c55d639e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:17.220849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c7120c7-2c3b-45b0-b5a5-7e34c55d639e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:17.221797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c7120c7-2c3b-45b0-b5a5-7e34c55d639e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:17.222517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c7120c7-2c3b-45b0-b5a5-7e34c55d639e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:17.223209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c7120c7-2c3b-45b0-b5a5-7e34c55d639e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:17.370368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6c7120c7-2c3b-45b0-b5a5-7e34c55d639e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:17.380331 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6c7120c7-2c3b-45b0-b5a5-7e34c55d639e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1277 microversion: 2.1 time: 0.175993 Oct 27 19:32:17.381173 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3384/6918] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:17 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:17.747904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-fc4ecbd1-6377-4780-9b62-aadfa3bf3843 req-26fb49d9-db53-40a3-9442-90eefe73244c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa44e23b-ce6e-450b-b7a1-68331c024506", "tag": "23f711e5-f60a-4a84-9b5e-b4a0ce1e0fb3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:32:17.759715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fc4ecbd1-6377-4780-9b62-aadfa3bf3843 req-26fb49d9-db53-40a3-9442-90eefe73244c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:17.760136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fc4ecbd1-6377-4780-9b62-aadfa3bf3843 req-26fb49d9-db53-40a3-9442-90eefe73244c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:17.761047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fc4ecbd1-6377-4780-9b62-aadfa3bf3843 req-26fb49d9-db53-40a3-9442-90eefe73244c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:17.810430 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-fc4ecbd1-6377-4780-9b62-aadfa3bf3843 req-26fb49d9-db53-40a3-9442-90eefe73244c service nova] Creating event network-changed:23f711e5-f60a-4a84-9b5e-b4a0ce1e0fb3 for instance aa44e23b-ce6e-450b-b7a1-68331c024506 on n-h2-860687-3 Oct 27 19:32:17.822163 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-fc4ecbd1-6377-4780-9b62-aadfa3bf3843 req-26fb49d9-db53-40a3-9442-90eefe73244c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078146 Oct 27 19:32:17.823569 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3535/6919] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:32:18.405293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00d16953-d03e-4090-b5cd-e24410b3e99a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:18.406996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-00d16953-d03e-4090-b5cd-e24410b3e99a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:18.415598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00d16953-d03e-4090-b5cd-e24410b3e99a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:18.416456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00d16953-d03e-4090-b5cd-e24410b3e99a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:18.418718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00d16953-d03e-4090-b5cd-e24410b3e99a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:18.420076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00d16953-d03e-4090-b5cd-e24410b3e99a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:18.420765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00d16953-d03e-4090-b5cd-e24410b3e99a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:18.421434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00d16953-d03e-4090-b5cd-e24410b3e99a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:18.585278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-00d16953-d03e-4090-b5cd-e24410b3e99a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:18.595568 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-00d16953-d03e-4090-b5cd-e24410b3e99a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1277 microversion: 2.1 time: 0.194431 Oct 27 19:32:18.596490 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3385/6920] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:18 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:19.622430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-562f5d2d-f269-410f-9c26-41ed5c43e7d1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:19.623061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-562f5d2d-f269-410f-9c26-41ed5c43e7d1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:19.630728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-562f5d2d-f269-410f-9c26-41ed5c43e7d1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:19.631227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-562f5d2d-f269-410f-9c26-41ed5c43e7d1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:19.631673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-562f5d2d-f269-410f-9c26-41ed5c43e7d1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:19.632383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-562f5d2d-f269-410f-9c26-41ed5c43e7d1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:19.632850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-562f5d2d-f269-410f-9c26-41ed5c43e7d1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:19.633287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-562f5d2d-f269-410f-9c26-41ed5c43e7d1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:19.792657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-562f5d2d-f269-410f-9c26-41ed5c43e7d1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:19.802052 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-562f5d2d-f269-410f-9c26-41ed5c43e7d1 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1277 microversion: 2.1 time: 0.184855 Oct 27 19:32:19.802973 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3536/6921] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:19 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:20.826308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dfa7bc0b-568f-4185-8bd5-e16e92d256c7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:20.827049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dfa7bc0b-568f-4185-8bd5-e16e92d256c7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:20.835432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa7bc0b-568f-4185-8bd5-e16e92d256c7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:20.835977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa7bc0b-568f-4185-8bd5-e16e92d256c7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:20.836528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa7bc0b-568f-4185-8bd5-e16e92d256c7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:20.837368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa7bc0b-568f-4185-8bd5-e16e92d256c7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:20.837906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa7bc0b-568f-4185-8bd5-e16e92d256c7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:20.838415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfa7bc0b-568f-4185-8bd5-e16e92d256c7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:21.025479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dfa7bc0b-568f-4185-8bd5-e16e92d256c7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:21.034802 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dfa7bc0b-568f-4185-8bd5-e16e92d256c7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1277 microversion: 2.1 time: 0.213104 Oct 27 19:32:21.045282 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3386/6922] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:20 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:32:22.059556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5d9b6102-87eb-48b3-8145-97a2377717e9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:22.060097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5d9b6102-87eb-48b3-8145-97a2377717e9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:22.067593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9b6102-87eb-48b3-8145-97a2377717e9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:22.068077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9b6102-87eb-48b3-8145-97a2377717e9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:22.068520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9b6102-87eb-48b3-8145-97a2377717e9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:22.069210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9b6102-87eb-48b3-8145-97a2377717e9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:22.069666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9b6102-87eb-48b3-8145-97a2377717e9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:22.070098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d9b6102-87eb-48b3-8145-97a2377717e9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:22.219117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5d9b6102-87eb-48b3-8145-97a2377717e9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:22.227914 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5d9b6102-87eb-48b3-8145-97a2377717e9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1265 microversion: 2.1 time: 0.172589 Oct 27 19:32:22.228506 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3537/6923] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:22 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:23.251823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b83f9f5e-a38d-412f-8c4a-0ecd36820b6d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:23.252359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b83f9f5e-a38d-412f-8c4a-0ecd36820b6d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:23.259714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b83f9f5e-a38d-412f-8c4a-0ecd36820b6d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:23.260240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b83f9f5e-a38d-412f-8c4a-0ecd36820b6d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:23.260712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b83f9f5e-a38d-412f-8c4a-0ecd36820b6d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:23.261460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b83f9f5e-a38d-412f-8c4a-0ecd36820b6d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:23.261943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b83f9f5e-a38d-412f-8c4a-0ecd36820b6d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:23.262422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b83f9f5e-a38d-412f-8c4a-0ecd36820b6d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:23.403597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b83f9f5e-a38d-412f-8c4a-0ecd36820b6d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:23.412639 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b83f9f5e-a38d-412f-8c4a-0ecd36820b6d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1265 microversion: 2.1 time: 0.165035 Oct 27 19:32:23.413218 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3387/6924] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:23 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:24.435402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-09eb897f-547e-4cef-9867-b5f21788e23a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:24.436219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-09eb897f-547e-4cef-9867-b5f21788e23a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:24.445000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09eb897f-547e-4cef-9867-b5f21788e23a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:24.445499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09eb897f-547e-4cef-9867-b5f21788e23a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:24.445949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09eb897f-547e-4cef-9867-b5f21788e23a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:24.446702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09eb897f-547e-4cef-9867-b5f21788e23a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:24.447208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09eb897f-547e-4cef-9867-b5f21788e23a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:24.447765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09eb897f-547e-4cef-9867-b5f21788e23a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:24.574727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:32:24.596060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-09eb897f-547e-4cef-9867-b5f21788e23a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:24.598296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:32:24.605196 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-09eb897f-547e-4cef-9867-b5f21788e23a tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1265 microversion: 2.1 time: 0.173760 Oct 27 19:32:24.605777 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3538/6925] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:24 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:25.628596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-72a20216-275c-4c36-b54c-87c7173100e0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:25.629320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-72a20216-275c-4c36-b54c-87c7173100e0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:25.632087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:32:25.637512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72a20216-275c-4c36-b54c-87c7173100e0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:25.638145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72a20216-275c-4c36-b54c-87c7173100e0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:25.638749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72a20216-275c-4c36-b54c-87c7173100e0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:25.639462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72a20216-275c-4c36-b54c-87c7173100e0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:25.639932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72a20216-275c-4c36-b54c-87c7173100e0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:25.640373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72a20216-275c-4c36-b54c-87c7173100e0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:25.780097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-72a20216-275c-4c36-b54c-87c7173100e0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:25.788688 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-72a20216-275c-4c36-b54c-87c7173100e0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1265 microversion: 2.1 time: 0.164077 Oct 27 19:32:25.789279 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3388/6926] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:25 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:26.812002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-43a72af4-d1d3-4fee-bca8-27e38f763ec7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:26.812696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-43a72af4-d1d3-4fee-bca8-27e38f763ec7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:26.819731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43a72af4-d1d3-4fee-bca8-27e38f763ec7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:26.820226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43a72af4-d1d3-4fee-bca8-27e38f763ec7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:26.820672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43a72af4-d1d3-4fee-bca8-27e38f763ec7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:26.821367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43a72af4-d1d3-4fee-bca8-27e38f763ec7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:26.821829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43a72af4-d1d3-4fee-bca8-27e38f763ec7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:26.822262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-43a72af4-d1d3-4fee-bca8-27e38f763ec7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:26.955905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-43a72af4-d1d3-4fee-bca8-27e38f763ec7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:26.963780 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-43a72af4-d1d3-4fee-bca8-27e38f763ec7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1265 microversion: 2.1 time: 0.155703 Oct 27 19:32:26.964352 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3539/6927] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:26 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:27.987365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6863aa74-e6f1-46e7-a4cd-60930e0d899c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:27.988136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6863aa74-e6f1-46e7-a4cd-60930e0d899c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:27.995546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6863aa74-e6f1-46e7-a4cd-60930e0d899c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:27.996063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6863aa74-e6f1-46e7-a4cd-60930e0d899c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:27.996635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6863aa74-e6f1-46e7-a4cd-60930e0d899c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:27.997238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6863aa74-e6f1-46e7-a4cd-60930e0d899c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:27.997715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6863aa74-e6f1-46e7-a4cd-60930e0d899c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:27.998164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6863aa74-e6f1-46e7-a4cd-60930e0d899c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:28.141270 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6863aa74-e6f1-46e7-a4cd-60930e0d899c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:28.149607 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6863aa74-e6f1-46e7-a4cd-60930e0d899c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1265 microversion: 2.1 time: 0.166686 Oct 27 19:32:28.150181 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3389/6928] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:27 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:29.173904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-79a3241c-12b3-4f6a-918b-79d02c39cedb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:29.174577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-79a3241c-12b3-4f6a-918b-79d02c39cedb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:29.181644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79a3241c-12b3-4f6a-918b-79d02c39cedb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:29.182193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79a3241c-12b3-4f6a-918b-79d02c39cedb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:29.182736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79a3241c-12b3-4f6a-918b-79d02c39cedb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:29.183475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79a3241c-12b3-4f6a-918b-79d02c39cedb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:29.183998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79a3241c-12b3-4f6a-918b-79d02c39cedb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:29.184464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79a3241c-12b3-4f6a-918b-79d02c39cedb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:29.329377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-79a3241c-12b3-4f6a-918b-79d02c39cedb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:29.339089 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-79a3241c-12b3-4f6a-918b-79d02c39cedb tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1265 microversion: 2.1 time: 0.169953 Oct 27 19:32:29.339761 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3540/6929] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:29 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:30.363573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-44249ebb-8fec-445d-bc3e-8ebaf30520be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:30.364300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-44249ebb-8fec-445d-bc3e-8ebaf30520be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:30.371847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44249ebb-8fec-445d-bc3e-8ebaf30520be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:30.372369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44249ebb-8fec-445d-bc3e-8ebaf30520be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:30.372829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44249ebb-8fec-445d-bc3e-8ebaf30520be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:30.373539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44249ebb-8fec-445d-bc3e-8ebaf30520be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:30.374010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44249ebb-8fec-445d-bc3e-8ebaf30520be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:30.374788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-44249ebb-8fec-445d-bc3e-8ebaf30520be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:30.522620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-44249ebb-8fec-445d-bc3e-8ebaf30520be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:30.530869 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-44249ebb-8fec-445d-bc3e-8ebaf30520be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1265 microversion: 2.1 time: 0.171878 Oct 27 19:32:30.531449 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3390/6930] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:30 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:31.555623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cd279aac-d39d-46c6-aea6-bb547d045c7b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:31.557121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cd279aac-d39d-46c6-aea6-bb547d045c7b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:31.557646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-473c3bc5-3be2-425b-85dd-bd64e454ab4e req-90be7902-14b5-41ca-b884-d7458b38cc60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa44e23b-ce6e-450b-b7a1-68331c024506", "name": "network-vif-plugged", "status": "completed", "tag": "23f711e5-f60a-4a84-9b5e-b4a0ce1e0fb3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:32:31.566685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd279aac-d39d-46c6-aea6-bb547d045c7b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:31.567281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd279aac-d39d-46c6-aea6-bb547d045c7b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:31.567823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd279aac-d39d-46c6-aea6-bb547d045c7b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:31.568672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd279aac-d39d-46c6-aea6-bb547d045c7b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:31.569246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd279aac-d39d-46c6-aea6-bb547d045c7b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:31.569773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd279aac-d39d-46c6-aea6-bb547d045c7b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:31.570287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-473c3bc5-3be2-425b-85dd-bd64e454ab4e req-90be7902-14b5-41ca-b884-d7458b38cc60 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:31.570978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-473c3bc5-3be2-425b-85dd-bd64e454ab4e req-90be7902-14b5-41ca-b884-d7458b38cc60 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:31.571546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-473c3bc5-3be2-425b-85dd-bd64e454ab4e req-90be7902-14b5-41ca-b884-d7458b38cc60 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:31.586497 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-473c3bc5-3be2-425b-85dd-bd64e454ab4e req-90be7902-14b5-41ca-b884-d7458b38cc60 service nova] Creating event network-vif-plugged:23f711e5-f60a-4a84-9b5e-b4a0ce1e0fb3 for instance aa44e23b-ce6e-450b-b7a1-68331c024506 on n-h2-860687-3 Oct 27 19:32:31.592072 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-473c3bc5-3be2-425b-85dd-bd64e454ab4e req-90be7902-14b5-41ca-b884-d7458b38cc60 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171753 Oct 27 19:32:31.592773 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3541/6931] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:32:31.732341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cd279aac-d39d-46c6-aea6-bb547d045c7b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:31.741264 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cd279aac-d39d-46c6-aea6-bb547d045c7b tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1265 microversion: 2.1 time: 0.189872 Oct 27 19:32:31.742027 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3391/6932] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:31 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:32.765131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-72951d57-0a9a-4177-b0d0-3893ea6f82fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:32.765838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-72951d57-0a9a-4177-b0d0-3893ea6f82fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:32.774494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72951d57-0a9a-4177-b0d0-3893ea6f82fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:32.774995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72951d57-0a9a-4177-b0d0-3893ea6f82fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:32.775442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72951d57-0a9a-4177-b0d0-3893ea6f82fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:32.776149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72951d57-0a9a-4177-b0d0-3893ea6f82fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:32.776618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72951d57-0a9a-4177-b0d0-3893ea6f82fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:32.777057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72951d57-0a9a-4177-b0d0-3893ea6f82fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:32.927266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-72951d57-0a9a-4177-b0d0-3893ea6f82fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:32.935007 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-72951d57-0a9a-4177-b0d0-3893ea6f82fc tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1265 microversion: 2.1 time: 0.174218 Oct 27 19:32:32.935944 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3542/6933] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:32 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:33.959857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-08944e19-c442-4327-affe-a0ed0fc038dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:33.960481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-08944e19-c442-4327-affe-a0ed0fc038dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:33.967347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08944e19-c442-4327-affe-a0ed0fc038dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:33.967850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08944e19-c442-4327-affe-a0ed0fc038dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:33.968334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08944e19-c442-4327-affe-a0ed0fc038dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:33.969041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08944e19-c442-4327-affe-a0ed0fc038dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:33.969511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08944e19-c442-4327-affe-a0ed0fc038dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:33.969954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-08944e19-c442-4327-affe-a0ed0fc038dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:34.114699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-08944e19-c442-4327-affe-a0ed0fc038dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:34.122592 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-08944e19-c442-4327-affe-a0ed0fc038dd tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1451 microversion: 2.1 time: 0.167262 Oct 27 19:32:34.123167 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3392/6934] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:33 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:32:34.146084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8b9a71ba-48ae-40be-a679-44609c312855 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:32:34.146817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8b9a71ba-48ae-40be-a679-44609c312855 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:32:34.153857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9a71ba-48ae-40be-a679-44609c312855 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:34.154444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9a71ba-48ae-40be-a679-44609c312855 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:34.154953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9a71ba-48ae-40be-a679-44609c312855 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:34.155714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9a71ba-48ae-40be-a679-44609c312855 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:34.156251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9a71ba-48ae-40be-a679-44609c312855 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:34.156773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b9a71ba-48ae-40be-a679-44609c312855 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:34.301662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8b9a71ba-48ae-40be-a679-44609c312855 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:32:34.309781 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8b9a71ba-48ae-40be-a679-44609c312855 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1451 microversion: 2.1 time: 0.168071 Oct 27 19:32:34.310358 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3543/6935] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:32:34 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:32:36.463084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-98142c94-814b-42b3-9635-7acce0e7eba7 req-a5e1fe36-a202-4fc5-836e-47b23233bfcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa44e23b-ce6e-450b-b7a1-68331c024506", "tag": "23f711e5-f60a-4a84-9b5e-b4a0ce1e0fb3"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:32:36.483015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-98142c94-814b-42b3-9635-7acce0e7eba7 req-a5e1fe36-a202-4fc5-836e-47b23233bfcd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:32:36.483606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-98142c94-814b-42b3-9635-7acce0e7eba7 req-a5e1fe36-a202-4fc5-836e-47b23233bfcd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:32:36.484886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-98142c94-814b-42b3-9635-7acce0e7eba7 req-a5e1fe36-a202-4fc5-836e-47b23233bfcd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:32:36.499141 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-98142c94-814b-42b3-9635-7acce0e7eba7 req-a5e1fe36-a202-4fc5-836e-47b23233bfcd service nova] Creating event network-changed:23f711e5-f60a-4a84-9b5e-b4a0ce1e0fb3 for instance aa44e23b-ce6e-450b-b7a1-68331c024506 on n-h2-860687-3 Oct 27 19:32:36.505613 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-98142c94-814b-42b3-9635-7acce0e7eba7 req-a5e1fe36-a202-4fc5-836e-47b23233bfcd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148636 Oct 27 19:32:36.510733 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3393/6936] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:33:12.904234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ec47c2aa-7aec-4c2f-8379-0ae8cf46783c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Action: 'create', calling method: .version_select at 0x7fc87325cdc0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1862672098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOky+4ZIzImYnbIi907FYQV4tOhBK49acP8MWTcxypb6Tp10DsayOfy779RNGexHKcEcWQJFDRjLew2bOxniqFOZfgH2p8SWcFfMLmomjPRozf9EpzHlqk+vudqLymL0bA=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:33:12.910079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:33:12.910769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=54 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:33:12.930245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-ec47c2aa-7aec-4c2f-8379-0ae8cf46783c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Getting quotas for project 382ab89d558a4ea7acba39accebc8c40. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:33:12.935384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-ec47c2aa-7aec-4c2f-8379-0ae8cf46783c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Getting quotas for user 9e73272360ab4bd7838d3c642edbb788 and project 382ab89d558a4ea7acba39accebc8c40. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:33:12.962480 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ec47c2aa-7aec-4c2f-8379-0ae8cf46783c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062179 Oct 27 19:33:12.963091 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3544/6937] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:33:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:33:13.951742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1089637584", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ac120fdd-76c2-4bdf-a6b5-42bcf37df4a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1862672098", "security_groups": [{"name": "tempest-secgroup-smoke-45335115"}], "networks": [{"uuid": "36a43fbe-4f99-4590-9523-42bfbc818fa6"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:33:13.962491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=24 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:33:13.963151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=56 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:33:14.068899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] validate_networks() for [('36a43fbe-4f99-4590-9523-42bfbc818fa6', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:33:14.563925 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:33:14.564637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:33:14.565143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:33:14.565579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:33:14.566017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:33:14.576799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:14.577323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:14.578317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:14.579632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:14.580130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:14.580577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:14.598570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Getting quotas for project 382ab89d558a4ea7acba39accebc8c40. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:33:14.603973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Getting quotas for user 9e73272360ab4bd7838d3c642edbb788 and project 382ab89d558a4ea7acba39accebc8c40. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:33:14.662687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:33:14.665079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac120fdd-76c2-4bdf-a6b5-42bcf37df4a5',volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:33:14.794528 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-093f6a9d-fc7b-4344-a964-675ade60a7d2 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.846918 Oct 27 19:33:14.795188 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3394/6938] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:33:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:33:14.807089 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-94a33700-0df2-4a1c-b473-9ce1304135d7 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:14.807708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-94a33700-0df2-4a1c-b473-9ce1304135d7 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:14.860926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-94a33700-0df2-4a1c-b473-9ce1304135d7 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:14.868584 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-94a33700-0df2-4a1c-b473-9ce1304135d7 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1099 microversion: 2.1 time: 0.066253 Oct 27 19:33:14.869155 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3545/6939] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:14 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1099 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:15.893778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ebbda6e4-3b5a-4f13-b999-6a5a0efc6c90 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:15.894533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ebbda6e4-3b5a-4f13-b999-6a5a0efc6c90 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:15.950654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ebbda6e4-3b5a-4f13-b999-6a5a0efc6c90 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:15.957891 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ebbda6e4-3b5a-4f13-b999-6a5a0efc6c90 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1099 microversion: 2.1 time: 0.069444 Oct 27 19:33:15.958492 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3395/6940] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:15 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1099 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:16.980588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8313091b-6f6e-4581-85ba-092c0038852d tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:16.981201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8313091b-6f6e-4581-85ba-092c0038852d tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:17.040430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8313091b-6f6e-4581-85ba-092c0038852d tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:17.047838 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8313091b-6f6e-4581-85ba-092c0038852d tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1099 microversion: 2.1 time: 0.071516 Oct 27 19:33:17.048426 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3546/6941] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:16 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1099 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:18.070756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0ba5624f-f774-4d20-9389-fd2d8303d0e0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:18.071395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0ba5624f-f774-4d20-9389-fd2d8303d0e0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:18.136596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0ba5624f-f774-4d20-9389-fd2d8303d0e0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:18.145484 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0ba5624f-f774-4d20-9389-fd2d8303d0e0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1099 microversion: 2.1 time: 0.078553 Oct 27 19:33:18.146158 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3396/6942] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:18 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1099 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:19.168745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e608b112-d549-4231-b10f-8595ddb320b8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:19.169376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e608b112-d549-4231-b10f-8595ddb320b8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:19.177770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e608b112-d549-4231-b10f-8595ddb320b8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:19.178260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e608b112-d549-4231-b10f-8595ddb320b8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:19.178735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e608b112-d549-4231-b10f-8595ddb320b8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:19.179430 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e608b112-d549-4231-b10f-8595ddb320b8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:19.179893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e608b112-d549-4231-b10f-8595ddb320b8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:19.180365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e608b112-d549-4231-b10f-8595ddb320b8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:19.241645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e608b112-d549-4231-b10f-8595ddb320b8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:19.251939 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e608b112-d549-4231-b10f-8595ddb320b8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1149 microversion: 2.1 time: 0.086985 Oct 27 19:33:19.252656 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3547/6943] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:19 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1149 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:20.274921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1f641df0-f983-49d1-bec6-d25fa9497e72 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:20.275728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1f641df0-f983-49d1-bec6-d25fa9497e72 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:20.285171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f641df0-f983-49d1-bec6-d25fa9497e72 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:20.285855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f641df0-f983-49d1-bec6-d25fa9497e72 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:20.286557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f641df0-f983-49d1-bec6-d25fa9497e72 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:20.287380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f641df0-f983-49d1-bec6-d25fa9497e72 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:20.287954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f641df0-f983-49d1-bec6-d25fa9497e72 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:20.289104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f641df0-f983-49d1-bec6-d25fa9497e72 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:20.355481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1f641df0-f983-49d1-bec6-d25fa9497e72 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:20.364793 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1f641df0-f983-49d1-bec6-d25fa9497e72 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1215 microversion: 2.1 time: 0.093690 Oct 27 19:33:20.365401 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3397/6944] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:20 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:21.388852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-12a550f4-2ff7-4248-871e-0499a2fc5b46 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:21.389777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-12a550f4-2ff7-4248-871e-0499a2fc5b46 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:21.399448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12a550f4-2ff7-4248-871e-0499a2fc5b46 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:21.400297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12a550f4-2ff7-4248-871e-0499a2fc5b46 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:21.400977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12a550f4-2ff7-4248-871e-0499a2fc5b46 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:21.402048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12a550f4-2ff7-4248-871e-0499a2fc5b46 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:21.402985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12a550f4-2ff7-4248-871e-0499a2fc5b46 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:21.403393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12a550f4-2ff7-4248-871e-0499a2fc5b46 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:21.539367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-dd94ceb0-536d-4e06-93d0-d71f5ab63844 req-2ac3d0f3-be5c-4c20-a9af-f3fd98b2973f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef", "tag": "4d95d231-d71f-4b8f-8afa-7c11cbe2d5a2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:33:21.553752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-dd94ceb0-536d-4e06-93d0-d71f5ab63844 req-2ac3d0f3-be5c-4c20-a9af-f3fd98b2973f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:21.554474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-dd94ceb0-536d-4e06-93d0-d71f5ab63844 req-2ac3d0f3-be5c-4c20-a9af-f3fd98b2973f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:21.554991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-dd94ceb0-536d-4e06-93d0-d71f5ab63844 req-2ac3d0f3-be5c-4c20-a9af-f3fd98b2973f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:21.569117 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-dd94ceb0-536d-4e06-93d0-d71f5ab63844 req-2ac3d0f3-be5c-4c20-a9af-f3fd98b2973f service nova] Creating event network-changed:4d95d231-d71f-4b8f-8afa-7c11cbe2d5a2 for instance bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef on n-h1-860687-3 Oct 27 19:33:21.575284 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-dd94ceb0-536d-4e06-93d0-d71f5ab63844 req-2ac3d0f3-be5c-4c20-a9af-f3fd98b2973f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161101 Oct 27 19:33:21.576650 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3398/6945] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:33:21.742799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-12a550f4-2ff7-4248-871e-0499a2fc5b46 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:21.753758 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-12a550f4-2ff7-4248-871e-0499a2fc5b46 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1281 microversion: 2.1 time: 0.369297 Oct 27 19:33:21.766416 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3548/6946] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:21 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1281 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:22.783033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-522c17d8-961f-4ec0-87af-2bc5b185f1a9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:22.783827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-522c17d8-961f-4ec0-87af-2bc5b185f1a9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:22.790424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-522c17d8-961f-4ec0-87af-2bc5b185f1a9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:22.791207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-522c17d8-961f-4ec0-87af-2bc5b185f1a9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:22.791793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-522c17d8-961f-4ec0-87af-2bc5b185f1a9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:22.792522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-522c17d8-961f-4ec0-87af-2bc5b185f1a9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:22.793310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-522c17d8-961f-4ec0-87af-2bc5b185f1a9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:22.793821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-522c17d8-961f-4ec0-87af-2bc5b185f1a9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:22.938207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-522c17d8-961f-4ec0-87af-2bc5b185f1a9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:22.946900 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-522c17d8-961f-4ec0-87af-2bc5b185f1a9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1281 microversion: 2.1 time: 0.170103 Oct 27 19:33:22.947747 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3399/6947] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:22 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1281 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:23.972149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d3aefe08-cf38-49b1-a9aa-cac79eb3827c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:23.972946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d3aefe08-cf38-49b1-a9aa-cac79eb3827c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:23.980655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3aefe08-cf38-49b1-a9aa-cac79eb3827c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:23.981363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3aefe08-cf38-49b1-a9aa-cac79eb3827c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:23.982004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3aefe08-cf38-49b1-a9aa-cac79eb3827c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:23.982965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3aefe08-cf38-49b1-a9aa-cac79eb3827c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:23.983545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3aefe08-cf38-49b1-a9aa-cac79eb3827c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:23.984198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3aefe08-cf38-49b1-a9aa-cac79eb3827c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:24.142574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d3aefe08-cf38-49b1-a9aa-cac79eb3827c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:24.151969 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d3aefe08-cf38-49b1-a9aa-cac79eb3827c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1281 microversion: 2.1 time: 0.184064 Oct 27 19:33:24.153303 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3549/6948] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:23 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1281 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:25.177886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-95f5916f-fcd0-4718-8980-04968e49816f tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:25.178499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-95f5916f-fcd0-4718-8980-04968e49816f tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:25.181616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:33:25.188096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95f5916f-fcd0-4718-8980-04968e49816f tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:25.188742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95f5916f-fcd0-4718-8980-04968e49816f tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:25.189457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95f5916f-fcd0-4718-8980-04968e49816f tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:25.190188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95f5916f-fcd0-4718-8980-04968e49816f tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:25.190714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95f5916f-fcd0-4718-8980-04968e49816f tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:25.191167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95f5916f-fcd0-4718-8980-04968e49816f tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:25.335051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-95f5916f-fcd0-4718-8980-04968e49816f tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:25.342841 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-95f5916f-fcd0-4718-8980-04968e49816f tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1281 microversion: 2.1 time: 0.169044 Oct 27 19:33:25.343917 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3400/6949] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:25 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1281 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:26.365871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0c158f79-f3f3-4a25-9438-4a2a1e462169 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:26.366527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0c158f79-f3f3-4a25-9438-4a2a1e462169 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:26.373240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c158f79-f3f3-4a25-9438-4a2a1e462169 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:26.373726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c158f79-f3f3-4a25-9438-4a2a1e462169 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:26.374169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c158f79-f3f3-4a25-9438-4a2a1e462169 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:26.374965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c158f79-f3f3-4a25-9438-4a2a1e462169 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:26.375426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c158f79-f3f3-4a25-9438-4a2a1e462169 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:26.375857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0c158f79-f3f3-4a25-9438-4a2a1e462169 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:26.508598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0c158f79-f3f3-4a25-9438-4a2a1e462169 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:26.517134 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0c158f79-f3f3-4a25-9438-4a2a1e462169 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1269 microversion: 2.1 time: 0.155204 Oct 27 19:33:26.517801 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3550/6950] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:26 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:27.541099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-399a88fb-2c60-464e-9ef7-43f73fd0fa15 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:27.541730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-399a88fb-2c60-464e-9ef7-43f73fd0fa15 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:27.549275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-399a88fb-2c60-464e-9ef7-43f73fd0fa15 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:27.549766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-399a88fb-2c60-464e-9ef7-43f73fd0fa15 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:27.550215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-399a88fb-2c60-464e-9ef7-43f73fd0fa15 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:27.550944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-399a88fb-2c60-464e-9ef7-43f73fd0fa15 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:27.551411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-399a88fb-2c60-464e-9ef7-43f73fd0fa15 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:27.551852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-399a88fb-2c60-464e-9ef7-43f73fd0fa15 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:27.684655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-399a88fb-2c60-464e-9ef7-43f73fd0fa15 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:27.692877 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-399a88fb-2c60-464e-9ef7-43f73fd0fa15 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1269 microversion: 2.1 time: 0.155744 Oct 27 19:33:27.693462 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3401/6951] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:27 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:28.715192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e10fb984-efad-4ed7-bf55-c3f8774b0188 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:28.715847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e10fb984-efad-4ed7-bf55-c3f8774b0188 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:28.717700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:33:28.724465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e10fb984-efad-4ed7-bf55-c3f8774b0188 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:28.724957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e10fb984-efad-4ed7-bf55-c3f8774b0188 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:28.725400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e10fb984-efad-4ed7-bf55-c3f8774b0188 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:28.726102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e10fb984-efad-4ed7-bf55-c3f8774b0188 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:28.726592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e10fb984-efad-4ed7-bf55-c3f8774b0188 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:28.727026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e10fb984-efad-4ed7-bf55-c3f8774b0188 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:28.867494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e10fb984-efad-4ed7-bf55-c3f8774b0188 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:28.875478 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e10fb984-efad-4ed7-bf55-c3f8774b0188 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1269 microversion: 2.1 time: 0.164435 Oct 27 19:33:28.876146 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3551/6952] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:28 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:33:29.898735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-130803d3-5ceb-4232-9e57-4484e25b02e3 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:29.899440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-130803d3-5ceb-4232-9e57-4484e25b02e3 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:29.901303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=10 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:33:29.908299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-130803d3-5ceb-4232-9e57-4484e25b02e3 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:29.908798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-130803d3-5ceb-4232-9e57-4484e25b02e3 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:29.909251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-130803d3-5ceb-4232-9e57-4484e25b02e3 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:29.909958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-130803d3-5ceb-4232-9e57-4484e25b02e3 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:29.910450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-130803d3-5ceb-4232-9e57-4484e25b02e3 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:29.910895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-130803d3-5ceb-4232-9e57-4484e25b02e3 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:30.047571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-130803d3-5ceb-4232-9e57-4484e25b02e3 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:30.055404 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-130803d3-5ceb-4232-9e57-4484e25b02e3 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1269 microversion: 2.1 time: 0.160717 Oct 27 19:33:30.055984 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3402/6953] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:29 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:31.079603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ef0fa169-5865-468f-82da-e4123d98afe6 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:31.080230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ef0fa169-5865-468f-82da-e4123d98afe6 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:31.087389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef0fa169-5865-468f-82da-e4123d98afe6 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:31.087886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef0fa169-5865-468f-82da-e4123d98afe6 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:31.088336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef0fa169-5865-468f-82da-e4123d98afe6 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:31.089045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef0fa169-5865-468f-82da-e4123d98afe6 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:31.089514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef0fa169-5865-468f-82da-e4123d98afe6 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:31.089962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ef0fa169-5865-468f-82da-e4123d98afe6 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:31.225874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ef0fa169-5865-468f-82da-e4123d98afe6 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:31.233715 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ef0fa169-5865-468f-82da-e4123d98afe6 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1269 microversion: 2.1 time: 0.158441 Oct 27 19:33:31.235168 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3552/6954] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:31 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:32.258448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-67f5e68b-49d5-4377-a8b4-4ea4f21e7de0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:32.259002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-67f5e68b-49d5-4377-a8b4-4ea4f21e7de0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:32.266536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67f5e68b-49d5-4377-a8b4-4ea4f21e7de0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:32.267048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67f5e68b-49d5-4377-a8b4-4ea4f21e7de0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:32.267505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67f5e68b-49d5-4377-a8b4-4ea4f21e7de0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:32.268218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67f5e68b-49d5-4377-a8b4-4ea4f21e7de0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:32.268698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67f5e68b-49d5-4377-a8b4-4ea4f21e7de0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:32.269146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67f5e68b-49d5-4377-a8b4-4ea4f21e7de0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:32.406707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-67f5e68b-49d5-4377-a8b4-4ea4f21e7de0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:32.414462 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-67f5e68b-49d5-4377-a8b4-4ea4f21e7de0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1269 microversion: 2.1 time: 0.160021 Oct 27 19:33:32.415045 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3403/6955] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:32 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:33.439101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-964a6acb-a2d0-4777-a21e-5c1acd852ff7 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:33.439977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-964a6acb-a2d0-4777-a21e-5c1acd852ff7 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:33.446825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-964a6acb-a2d0-4777-a21e-5c1acd852ff7 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:33.447322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-964a6acb-a2d0-4777-a21e-5c1acd852ff7 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:33.447768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-964a6acb-a2d0-4777-a21e-5c1acd852ff7 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:33.448514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-964a6acb-a2d0-4777-a21e-5c1acd852ff7 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:33.448972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-964a6acb-a2d0-4777-a21e-5c1acd852ff7 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:33.449408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-964a6acb-a2d0-4777-a21e-5c1acd852ff7 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:33.587102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-964a6acb-a2d0-4777-a21e-5c1acd852ff7 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:33.595567 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-964a6acb-a2d0-4777-a21e-5c1acd852ff7 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1269 microversion: 2.1 time: 0.161229 Oct 27 19:33:33.596140 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3553/6956] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:33 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:34.618716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bb8c147f-fca1-4190-a964-3601cf053a3d tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:34.619408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bb8c147f-fca1-4190-a964-3601cf053a3d tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:34.626971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb8c147f-fca1-4190-a964-3601cf053a3d tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:34.627468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb8c147f-fca1-4190-a964-3601cf053a3d tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:34.627921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb8c147f-fca1-4190-a964-3601cf053a3d tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:34.628624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb8c147f-fca1-4190-a964-3601cf053a3d tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:34.629095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb8c147f-fca1-4190-a964-3601cf053a3d tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:34.629536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb8c147f-fca1-4190-a964-3601cf053a3d tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:34.761551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bb8c147f-fca1-4190-a964-3601cf053a3d tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:34.769280 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bb8c147f-fca1-4190-a964-3601cf053a3d tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1269 microversion: 2.1 time: 0.154544 Oct 27 19:33:34.769856 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3404/6957] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:34 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:35.391396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-c4d4900e-4bdc-4142-a53f-db7f749b6d79 req-c1c4e81b-2e3f-483e-a585-02d44322d697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef", "name": "network-vif-plugged", "status": "completed", "tag": "4d95d231-d71f-4b8f-8afa-7c11cbe2d5a2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:33:35.403647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c4d4900e-4bdc-4142-a53f-db7f749b6d79 req-c1c4e81b-2e3f-483e-a585-02d44322d697 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:35.404136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c4d4900e-4bdc-4142-a53f-db7f749b6d79 req-c1c4e81b-2e3f-483e-a585-02d44322d697 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:35.405889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c4d4900e-4bdc-4142-a53f-db7f749b6d79 req-c1c4e81b-2e3f-483e-a585-02d44322d697 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:35.416034 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-c4d4900e-4bdc-4142-a53f-db7f749b6d79 req-c1c4e81b-2e3f-483e-a585-02d44322d697 service nova] Creating event network-vif-plugged:4d95d231-d71f-4b8f-8afa-7c11cbe2d5a2 for instance bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef on n-h1-860687-3 Oct 27 19:33:35.421952 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-c4d4900e-4bdc-4142-a53f-db7f749b6d79 req-c1c4e81b-2e3f-483e-a585-02d44322d697 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033903 Oct 27 19:33:35.422779 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3554/6958] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:33:35.792276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b44bf255-bfd9-4f1b-a260-449f96461369 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:35.792857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b44bf255-bfd9-4f1b-a260-449f96461369 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:35.799944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b44bf255-bfd9-4f1b-a260-449f96461369 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:35.800451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b44bf255-bfd9-4f1b-a260-449f96461369 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:35.800910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b44bf255-bfd9-4f1b-a260-449f96461369 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:35.801625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b44bf255-bfd9-4f1b-a260-449f96461369 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:35.802100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b44bf255-bfd9-4f1b-a260-449f96461369 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:35.802589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b44bf255-bfd9-4f1b-a260-449f96461369 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:35.942659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b44bf255-bfd9-4f1b-a260-449f96461369 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:35.950656 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b44bf255-bfd9-4f1b-a260-449f96461369 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1269 microversion: 2.1 time: 0.162356 Oct 27 19:33:35.951256 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3405/6959] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:35 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:36.974435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e4dc43e0-4f57-4717-a657-414f155a13d9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:36.975138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e4dc43e0-4f57-4717-a657-414f155a13d9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:36.982090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4dc43e0-4f57-4717-a657-414f155a13d9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:36.982606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4dc43e0-4f57-4717-a657-414f155a13d9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:36.983046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4dc43e0-4f57-4717-a657-414f155a13d9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:36.984258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4dc43e0-4f57-4717-a657-414f155a13d9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:36.984723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4dc43e0-4f57-4717-a657-414f155a13d9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:36.985152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4dc43e0-4f57-4717-a657-414f155a13d9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:37.120044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e4dc43e0-4f57-4717-a657-414f155a13d9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:37.128394 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e4dc43e0-4f57-4717-a657-414f155a13d9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1459 microversion: 2.1 time: 0.158169 Oct 27 19:33:37.128902 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3555/6960] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:36 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1459 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:37.150046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-31612ca5-868d-4798-ae8e-f275372206cf tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:33:37.150734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-31612ca5-868d-4798-ae8e-f275372206cf tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:33:37.157900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31612ca5-868d-4798-ae8e-f275372206cf tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:37.158432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31612ca5-868d-4798-ae8e-f275372206cf tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:37.158894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31612ca5-868d-4798-ae8e-f275372206cf tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:37.159607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31612ca5-868d-4798-ae8e-f275372206cf tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:37.160083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31612ca5-868d-4798-ae8e-f275372206cf tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:37.160532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31612ca5-868d-4798-ae8e-f275372206cf tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:37.295161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-31612ca5-868d-4798-ae8e-f275372206cf tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:33:37.303751 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-31612ca5-868d-4798-ae8e-f275372206cf tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1459 microversion: 2.1 time: 0.157582 Oct 27 19:33:37.304324 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3406/6961] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:33:37 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1459 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:33:38.954508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ed995c26-7da4-4cf0-abe9-9806e3580358 req-55ca69fc-0e7a-4e92-a129-b51ef665598c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef", "tag": "4d95d231-d71f-4b8f-8afa-7c11cbe2d5a2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:33:38.964185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ed995c26-7da4-4cf0-abe9-9806e3580358 req-55ca69fc-0e7a-4e92-a129-b51ef665598c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:38.964667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ed995c26-7da4-4cf0-abe9-9806e3580358 req-55ca69fc-0e7a-4e92-a129-b51ef665598c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:38.965102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ed995c26-7da4-4cf0-abe9-9806e3580358 req-55ca69fc-0e7a-4e92-a129-b51ef665598c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:38.976484 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ed995c26-7da4-4cf0-abe9-9806e3580358 req-55ca69fc-0e7a-4e92-a129-b51ef665598c service nova] Creating event network-changed:4d95d231-d71f-4b8f-8afa-7c11cbe2d5a2 for instance bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef on n-h1-860687-3 Oct 27 19:33:38.981583 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ed995c26-7da4-4cf0-abe9-9806e3580358 req-55ca69fc-0e7a-4e92-a129-b51ef665598c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031895 Oct 27 19:33:38.982369 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3556/6962] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:33:40.286176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-bd78a31d-41f5-4c59-8492-bf155856106c req-bd3ba6a7-b2fd-4825-ab9c-faf4310266da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef", "tag": "4d95d231-d71f-4b8f-8afa-7c11cbe2d5a2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:33:40.297275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bd78a31d-41f5-4c59-8492-bf155856106c req-bd3ba6a7-b2fd-4825-ab9c-faf4310266da service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:40.298046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bd78a31d-41f5-4c59-8492-bf155856106c req-bd3ba6a7-b2fd-4825-ab9c-faf4310266da service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:40.298846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bd78a31d-41f5-4c59-8492-bf155856106c req-bd3ba6a7-b2fd-4825-ab9c-faf4310266da service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:40.310269 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-bd78a31d-41f5-4c59-8492-bf155856106c req-bd3ba6a7-b2fd-4825-ab9c-faf4310266da service nova] Creating event network-changed:4d95d231-d71f-4b8f-8afa-7c11cbe2d5a2 for instance bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef on n-h1-860687-3 Oct 27 19:33:40.318672 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-bd78a31d-41f5-4c59-8492-bf155856106c req-bd3ba6a7-b2fd-4825-ab9c-faf4310266da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033902 Oct 27 19:33:40.318672 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3407/6963] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:33:42.332848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-10227835-d9a4-48ad-ba13-6f5d186d28e6 req-b3ac3abc-9a96-4cbf-8e40-260e2fc70647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef", "tag": "4d95d231-d71f-4b8f-8afa-7c11cbe2d5a2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:33:42.342266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-10227835-d9a4-48ad-ba13-6f5d186d28e6 req-b3ac3abc-9a96-4cbf-8e40-260e2fc70647 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:33:42.342781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-10227835-d9a4-48ad-ba13-6f5d186d28e6 req-b3ac3abc-9a96-4cbf-8e40-260e2fc70647 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:33:42.343216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-10227835-d9a4-48ad-ba13-6f5d186d28e6 req-b3ac3abc-9a96-4cbf-8e40-260e2fc70647 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:33:42.353869 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-10227835-d9a4-48ad-ba13-6f5d186d28e6 req-b3ac3abc-9a96-4cbf-8e40-260e2fc70647 service nova] Creating event network-changed:4d95d231-d71f-4b8f-8afa-7c11cbe2d5a2 for instance bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef on n-h1-860687-3 Oct 27 19:33:42.359391 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-10227835-d9a4-48ad-ba13-6f5d186d28e6 req-b3ac3abc-9a96-4cbf-8e40-260e2fc70647 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030968 Oct 27 19:33:42.359936 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3557/6964] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:34:16.449757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-04a46261-86da-46f4-9276-efde8d31f888 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:16.450515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04a46261-86da-46f4-9276-efde8d31f888 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:16.451472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:34:16.452871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=54 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:34:16.460206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:34:16.460911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=60 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:34:16.461930 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 19:34:16.462074 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 19:34:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 (ip 10.222.0.42) !!! Oct 27 19:34:16.465188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-8b173a11-4a0d-454b-9e68-84b4d1de0978 req-6f69f1ce-8d47-42f0-86f9-ee852a2b192a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa44e23b-ce6e-450b-b7a1-68331c024506", "tag": "23f711e5-f60a-4a84-9b5e-b4a0ce1e0fb3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:34:16.470887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04a46261-86da-46f4-9276-efde8d31f888 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:16.471425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04a46261-86da-46f4-9276-efde8d31f888 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:16.472073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04a46261-86da-46f4-9276-efde8d31f888 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:16.473258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04a46261-86da-46f4-9276-efde8d31f888 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:16.473975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04a46261-86da-46f4-9276-efde8d31f888 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:16.475334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-04a46261-86da-46f4-9276-efde8d31f888 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:16.507502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8b173a11-4a0d-454b-9e68-84b4d1de0978 req-6f69f1ce-8d47-42f0-86f9-ee852a2b192a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:16.512548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8b173a11-4a0d-454b-9e68-84b4d1de0978 req-6f69f1ce-8d47-42f0-86f9-ee852a2b192a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:16.513194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8b173a11-4a0d-454b-9e68-84b4d1de0978 req-6f69f1ce-8d47-42f0-86f9-ee852a2b192a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:16.522427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-04a46261-86da-46f4-9276-efde8d31f888 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:34:16.537411 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8b173a11-4a0d-454b-9e68-84b4d1de0978 req-6f69f1ce-8d47-42f0-86f9-ee852a2b192a service nova] Creating event network-changed:23f711e5-f60a-4a84-9b5e-b4a0ce1e0fb3 for instance aa44e23b-ce6e-450b-b7a1-68331c024506 on n-h2-860687-3 Oct 27 19:34:16.543443 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-8b173a11-4a0d-454b-9e68-84b4d1de0978 req-6f69f1ce-8d47-42f0-86f9-ee852a2b192a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095350 Oct 27 19:34:16.544737 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3558/6965] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:34:16.551602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b720108-3184-4656-8bbc-7a4e8c6b00c4 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:16.552521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1b720108-3184-4656-8bbc-7a4e8c6b00c4 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:16.565116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b720108-3184-4656-8bbc-7a4e8c6b00c4 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:16.565888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b720108-3184-4656-8bbc-7a4e8c6b00c4 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:16.566586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b720108-3184-4656-8bbc-7a4e8c6b00c4 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:16.567771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b720108-3184-4656-8bbc-7a4e8c6b00c4 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:16.568410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b720108-3184-4656-8bbc-7a4e8c6b00c4 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:16.568998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1b720108-3184-4656-8bbc-7a4e8c6b00c4 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:16.629181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1b720108-3184-4656-8bbc-7a4e8c6b00c4 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:34:16.648749 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-04a46261-86da-46f4-9276-efde8d31f888 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "DELETE /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 204 len: 0 microversion: 2.1 time: 0.203519 Oct 27 19:34:16.649628 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3408/6966] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:34:16 2022] DELETE /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:34:16.658168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-178af054-bdd0-457b-9b10-a13740b06459 req-902edec4-6f87-45ad-97c9-64a049ccb958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef", "tag": "4d95d231-d71f-4b8f-8afa-7c11cbe2d5a2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:34:16.675045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-178af054-bdd0-457b-9b10-a13740b06459 req-902edec4-6f87-45ad-97c9-64a049ccb958 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:16.675706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-178af054-bdd0-457b-9b10-a13740b06459 req-902edec4-6f87-45ad-97c9-64a049ccb958 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:16.676268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-178af054-bdd0-457b-9b10-a13740b06459 req-902edec4-6f87-45ad-97c9-64a049ccb958 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:16.691999 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-178af054-bdd0-457b-9b10-a13740b06459 req-902edec4-6f87-45ad-97c9-64a049ccb958 service nova] Creating event network-changed:4d95d231-d71f-4b8f-8afa-7c11cbe2d5a2 for instance bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef on n-h1-860687-3 Oct 27 19:34:16.697328 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-178af054-bdd0-457b-9b10-a13740b06459 req-902edec4-6f87-45ad-97c9-64a049ccb958 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043290 Oct 27 19:34:16.698506 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3409/6967] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:34:16.704934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e55dec64-d233-4079-9ab7-b6a9e5ba5e7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:16.705794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e55dec64-d233-4079-9ab7-b6a9e5ba5e7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:16.713059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e55dec64-d233-4079-9ab7-b6a9e5ba5e7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:16.713721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e55dec64-d233-4079-9ab7-b6a9e5ba5e7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:16.714587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e55dec64-d233-4079-9ab7-b6a9e5ba5e7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:16.715806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e55dec64-d233-4079-9ab7-b6a9e5ba5e7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:16.717792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e55dec64-d233-4079-9ab7-b6a9e5ba5e7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:16.718371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e55dec64-d233-4079-9ab7-b6a9e5ba5e7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:16.798590 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1b720108-3184-4656-8bbc-7a4e8c6b00c4 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 204 len: 0 microversion: 2.1 time: 0.251456 Oct 27 19:34:16.799611 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3559/6968] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:34:16 2022] DELETE /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:34:16.810583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9abffb0a-c65d-468a-bfee-893200fd5813 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:16.811320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9abffb0a-c65d-468a-bfee-893200fd5813 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:16.824754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9abffb0a-c65d-468a-bfee-893200fd5813 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:16.825263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9abffb0a-c65d-468a-bfee-893200fd5813 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:16.825706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9abffb0a-c65d-468a-bfee-893200fd5813 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:16.826973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9abffb0a-c65d-468a-bfee-893200fd5813 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:16.827441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9abffb0a-c65d-468a-bfee-893200fd5813 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:16.842879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9abffb0a-c65d-468a-bfee-893200fd5813 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:16.895844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e55dec64-d233-4079-9ab7-b6a9e5ba5e7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:16.904747 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e55dec64-d233-4079-9ab7-b6a9e5ba5e7e tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1575 microversion: 2.1 time: 0.204844 Oct 27 19:34:16.907220 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3410/6969] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:16 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:17.016929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9abffb0a-c65d-468a-bfee-893200fd5813 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:17.024915 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9abffb0a-c65d-468a-bfee-893200fd5813 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1583 microversion: 2.1 time: 0.220947 Oct 27 19:34:17.025685 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3560/6970] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:16 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1583 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:17.930714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f438f9c9-d605-4767-8777-d3d62dc2be28 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:17.931492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f438f9c9-d605-4767-8777-d3d62dc2be28 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:17.938580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f438f9c9-d605-4767-8777-d3d62dc2be28 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:17.939359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f438f9c9-d605-4767-8777-d3d62dc2be28 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:17.939820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f438f9c9-d605-4767-8777-d3d62dc2be28 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:17.940551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f438f9c9-d605-4767-8777-d3d62dc2be28 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:17.941034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f438f9c9-d605-4767-8777-d3d62dc2be28 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:17.941487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f438f9c9-d605-4767-8777-d3d62dc2be28 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:18.053760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5d596295-d131-47c9-8785-6f17f35c23ef tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:18.054408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5d596295-d131-47c9-8785-6f17f35c23ef tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:18.062453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d596295-d131-47c9-8785-6f17f35c23ef tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:18.063111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d596295-d131-47c9-8785-6f17f35c23ef tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:18.063674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d596295-d131-47c9-8785-6f17f35c23ef tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:18.064647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d596295-d131-47c9-8785-6f17f35c23ef tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:18.065291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d596295-d131-47c9-8785-6f17f35c23ef tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:18.065728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d596295-d131-47c9-8785-6f17f35c23ef tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:18.077584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f438f9c9-d605-4767-8777-d3d62dc2be28 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:18.086794 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f438f9c9-d605-4767-8777-d3d62dc2be28 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1575 microversion: 2.1 time: 0.159966 Oct 27 19:34:18.087632 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3411/6971] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:17 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:18.256583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5d596295-d131-47c9-8785-6f17f35c23ef tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:18.265821 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5d596295-d131-47c9-8785-6f17f35c23ef tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1583 microversion: 2.1 time: 0.216633 Oct 27 19:34:18.266404 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3561/6972] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:18 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1583 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:34:19.111666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3cfc5c0b-f49e-4bec-be06-894c05bc67f8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:19.112329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3cfc5c0b-f49e-4bec-be06-894c05bc67f8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:19.119587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfc5c0b-f49e-4bec-be06-894c05bc67f8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:19.120107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfc5c0b-f49e-4bec-be06-894c05bc67f8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:19.120571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfc5c0b-f49e-4bec-be06-894c05bc67f8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:19.121325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfc5c0b-f49e-4bec-be06-894c05bc67f8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:19.121784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfc5c0b-f49e-4bec-be06-894c05bc67f8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:19.122235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3cfc5c0b-f49e-4bec-be06-894c05bc67f8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:19.195943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3cfc5c0b-f49e-4bec-be06-894c05bc67f8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:19.204395 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3cfc5c0b-f49e-4bec-be06-894c05bc67f8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1389 microversion: 2.1 time: 0.096864 Oct 27 19:34:19.205007 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3412/6973] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:19 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1389 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:19.289897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-82227954-46b7-4240-a915-8be2800eaf71 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:19.290660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-82227954-46b7-4240-a915-8be2800eaf71 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:19.298999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82227954-46b7-4240-a915-8be2800eaf71 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:19.299595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82227954-46b7-4240-a915-8be2800eaf71 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:19.300100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82227954-46b7-4240-a915-8be2800eaf71 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:19.300816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82227954-46b7-4240-a915-8be2800eaf71 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:19.301273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82227954-46b7-4240-a915-8be2800eaf71 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:19.301699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-82227954-46b7-4240-a915-8be2800eaf71 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:19.537453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c6e9de5d-0168-4592-99d5-0a33ea4e4583 req-3c963499-ab84-41c6-a461-52219850ea1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa44e23b-ce6e-450b-b7a1-68331c024506", "name": "network-vif-deleted", "tag": "23f711e5-f60a-4a84-9b5e-b4a0ce1e0fb3"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:34:19.556222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c6e9de5d-0168-4592-99d5-0a33ea4e4583 req-3c963499-ab84-41c6-a461-52219850ea1c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:19.557325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c6e9de5d-0168-4592-99d5-0a33ea4e4583 req-3c963499-ab84-41c6-a461-52219850ea1c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:19.558040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c6e9de5d-0168-4592-99d5-0a33ea4e4583 req-3c963499-ab84-41c6-a461-52219850ea1c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:19.577560 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c6e9de5d-0168-4592-99d5-0a33ea4e4583 req-3c963499-ab84-41c6-a461-52219850ea1c service nova] Creating event network-vif-deleted:23f711e5-f60a-4a84-9b5e-b4a0ce1e0fb3 for instance aa44e23b-ce6e-450b-b7a1-68331c024506 on n-h2-860687-3 Oct 27 19:34:19.586226 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c6e9de5d-0168-4592-99d5-0a33ea4e4583 req-3c963499-ab84-41c6-a461-52219850ea1c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052598 Oct 27 19:34:19.587151 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3413/6974] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:34:19.636489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-82227954-46b7-4240-a915-8be2800eaf71 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:19.646657 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-82227954-46b7-4240-a915-8be2800eaf71 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1465 microversion: 2.1 time: 0.360545 Oct 27 19:34:19.647620 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3562/6975] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:19 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1465 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:20.230892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-204d18ec-0852-4349-9046-ba9cd4392020 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:20.231627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-204d18ec-0852-4349-9046-ba9cd4392020 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:20.239095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-204d18ec-0852-4349-9046-ba9cd4392020 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:20.239599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-204d18ec-0852-4349-9046-ba9cd4392020 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:20.240053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-204d18ec-0852-4349-9046-ba9cd4392020 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:20.240769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-204d18ec-0852-4349-9046-ba9cd4392020 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:20.241235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-204d18ec-0852-4349-9046-ba9cd4392020 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:20.241678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-204d18ec-0852-4349-9046-ba9cd4392020 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:20.305648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-204d18ec-0852-4349-9046-ba9cd4392020 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:20.314720 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-204d18ec-0852-4349-9046-ba9cd4392020 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1224 microversion: 2.1 time: 0.088646 Oct 27 19:34:20.315307 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3414/6976] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:20 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:34:20.674050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-80caf5b1-a6f8-44a8-936f-1412737a27af tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:20.674727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-80caf5b1-a6f8-44a8-936f-1412737a27af tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:20.681666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-80caf5b1-a6f8-44a8-936f-1412737a27af tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:20.682156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-80caf5b1-a6f8-44a8-936f-1412737a27af tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:20.682631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-80caf5b1-a6f8-44a8-936f-1412737a27af tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:20.683339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-80caf5b1-a6f8-44a8-936f-1412737a27af tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:20.683805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-80caf5b1-a6f8-44a8-936f-1412737a27af tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:20.684238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-80caf5b1-a6f8-44a8-936f-1412737a27af tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:20.746842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-80caf5b1-a6f8-44a8-936f-1412737a27af tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:20.755454 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-80caf5b1-a6f8-44a8-936f-1412737a27af tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1230 microversion: 2.1 time: 0.085464 Oct 27 19:34:20.756041 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3563/6977] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:20 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1230 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:21.337866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-27dcd31f-3f4e-4c8a-ae2d-d669419e1fa7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:21.338647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-27dcd31f-3f4e-4c8a-ae2d-d669419e1fa7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:21.345914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27dcd31f-3f4e-4c8a-ae2d-d669419e1fa7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:21.346454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27dcd31f-3f4e-4c8a-ae2d-d669419e1fa7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:21.346921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27dcd31f-3f4e-4c8a-ae2d-d669419e1fa7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:21.347642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27dcd31f-3f4e-4c8a-ae2d-d669419e1fa7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:21.348123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27dcd31f-3f4e-4c8a-ae2d-d669419e1fa7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:21.348571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27dcd31f-3f4e-4c8a-ae2d-d669419e1fa7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:21.412050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-27dcd31f-3f4e-4c8a-ae2d-d669419e1fa7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:21.420356 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-27dcd31f-3f4e-4c8a-ae2d-d669419e1fa7 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1224 microversion: 2.1 time: 0.086468 Oct 27 19:34:21.420969 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3415/6978] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:21 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:21.620636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-cbea45fd-d0ba-4ec3-99e1-c90953fc2f09 req-36000a32-4409-420b-b3f7-cea6b657dae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef", "name": "network-vif-deleted", "tag": "4d95d231-d71f-4b8f-8afa-7c11cbe2d5a2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:34:21.630751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cbea45fd-d0ba-4ec3-99e1-c90953fc2f09 req-36000a32-4409-420b-b3f7-cea6b657dae4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:21.631251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cbea45fd-d0ba-4ec3-99e1-c90953fc2f09 req-36000a32-4409-420b-b3f7-cea6b657dae4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:21.631642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cbea45fd-d0ba-4ec3-99e1-c90953fc2f09 req-36000a32-4409-420b-b3f7-cea6b657dae4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:21.643881 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-cbea45fd-d0ba-4ec3-99e1-c90953fc2f09 req-36000a32-4409-420b-b3f7-cea6b657dae4 service nova] Creating event network-vif-deleted:4d95d231-d71f-4b8f-8afa-7c11cbe2d5a2 for instance bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef on n-h1-860687-3 Oct 27 19:34:21.649051 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-cbea45fd-d0ba-4ec3-99e1-c90953fc2f09 req-36000a32-4409-420b-b3f7-cea6b657dae4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032014 Oct 27 19:34:21.649654 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3564/6979] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:34:21.778674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b3dd24fe-865f-4add-b255-e72680218eb0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:21.779843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b3dd24fe-865f-4add-b255-e72680218eb0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:21.785914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3dd24fe-865f-4add-b255-e72680218eb0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:21.786459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3dd24fe-865f-4add-b255-e72680218eb0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:21.786927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3dd24fe-865f-4add-b255-e72680218eb0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:21.787650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3dd24fe-865f-4add-b255-e72680218eb0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:21.788135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3dd24fe-865f-4add-b255-e72680218eb0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:21.788589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3dd24fe-865f-4add-b255-e72680218eb0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:21.863491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b3dd24fe-865f-4add-b255-e72680218eb0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:21.871546 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b3dd24fe-865f-4add-b255-e72680218eb0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1230 microversion: 2.1 time: 0.096842 Oct 27 19:34:21.872129 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3416/6980] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:21 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:22.445566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1d4d1b8d-aadf-45ee-a1e0-6b7770bc4c62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:22.446259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1d4d1b8d-aadf-45ee-a1e0-6b7770bc4c62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:22.453678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d4d1b8d-aadf-45ee-a1e0-6b7770bc4c62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:22.454175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d4d1b8d-aadf-45ee-a1e0-6b7770bc4c62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:22.454639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d4d1b8d-aadf-45ee-a1e0-6b7770bc4c62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:22.455331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d4d1b8d-aadf-45ee-a1e0-6b7770bc4c62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:22.455785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d4d1b8d-aadf-45ee-a1e0-6b7770bc4c62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:22.456241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d4d1b8d-aadf-45ee-a1e0-6b7770bc4c62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:22.523080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1d4d1b8d-aadf-45ee-a1e0-6b7770bc4c62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:22.531172 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1d4d1b8d-aadf-45ee-a1e0-6b7770bc4c62 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1224 microversion: 2.1 time: 0.090871 Oct 27 19:34:22.531845 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3565/6981] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:22 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:22.897284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3076c8c4-0712-4352-85fe-76026ed5f747 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:22.897948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3076c8c4-0712-4352-85fe-76026ed5f747 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:22.906164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3076c8c4-0712-4352-85fe-76026ed5f747 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:22.906703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3076c8c4-0712-4352-85fe-76026ed5f747 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:22.907158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3076c8c4-0712-4352-85fe-76026ed5f747 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:22.907881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3076c8c4-0712-4352-85fe-76026ed5f747 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:22.908348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3076c8c4-0712-4352-85fe-76026ed5f747 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:22.908788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3076c8c4-0712-4352-85fe-76026ed5f747 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:22.976490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3076c8c4-0712-4352-85fe-76026ed5f747 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:22.984448 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3076c8c4-0712-4352-85fe-76026ed5f747 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1230 microversion: 2.1 time: 0.091134 Oct 27 19:34:22.985019 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3417/6982] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:22 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1230 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:23.554515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f7940c6a-b10d-40c5-8d3c-c11be2560140 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:23.555027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f7940c6a-b10d-40c5-8d3c-c11be2560140 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:23.566985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7940c6a-b10d-40c5-8d3c-c11be2560140 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:23.567487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7940c6a-b10d-40c5-8d3c-c11be2560140 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:23.567931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7940c6a-b10d-40c5-8d3c-c11be2560140 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:23.568675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7940c6a-b10d-40c5-8d3c-c11be2560140 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:23.569139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7940c6a-b10d-40c5-8d3c-c11be2560140 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:23.569606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7940c6a-b10d-40c5-8d3c-c11be2560140 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:23.634664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f7940c6a-b10d-40c5-8d3c-c11be2560140 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:23.644101 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f7940c6a-b10d-40c5-8d3c-c11be2560140 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 200 len: 1224 microversion: 2.1 time: 0.093602 Oct 27 19:34:23.644907 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3566/6983] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:23 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:34:24.008439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4c52ebdb-d16d-408f-b5b6-843cb920925c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:24.009035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4c52ebdb-d16d-408f-b5b6-843cb920925c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:24.017002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c52ebdb-d16d-408f-b5b6-843cb920925c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:24.017518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c52ebdb-d16d-408f-b5b6-843cb920925c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:24.017972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c52ebdb-d16d-408f-b5b6-843cb920925c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:24.018735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c52ebdb-d16d-408f-b5b6-843cb920925c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:24.019208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c52ebdb-d16d-408f-b5b6-843cb920925c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:24.019650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c52ebdb-d16d-408f-b5b6-843cb920925c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:24.086596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4c52ebdb-d16d-408f-b5b6-843cb920925c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:24.096350 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4c52ebdb-d16d-408f-b5b6-843cb920925c tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1230 microversion: 2.1 time: 0.092169 Oct 27 19:34:24.096931 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3418/6984] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:24 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:24.668538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce6dc097-5d9c-4375-b84a-58a48f6fe199 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:24.669182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ce6dc097-5d9c-4375-b84a-58a48f6fe199 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: aa44e23b-ce6e-450b-b7a1-68331c024506] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:24.676808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce6dc097-5d9c-4375-b84a-58a48f6fe199 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:24.677297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce6dc097-5d9c-4375-b84a-58a48f6fe199 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:24.677740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce6dc097-5d9c-4375-b84a-58a48f6fe199 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:24.678469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce6dc097-5d9c-4375-b84a-58a48f6fe199 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:24.678935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce6dc097-5d9c-4375-b84a-58a48f6fe199 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:24.679367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce6dc097-5d9c-4375-b84a-58a48f6fe199 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:24.693029 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-ce6dc097-5d9c-4375-b84a-58a48f6fe199 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance aa44e23b-ce6e-450b-b7a1-68331c024506 could not be found. Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce6dc097-5d9c-4375-b84a-58a48f6fe199 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 HTTP/1.1 Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance aa44e23b-ce6e-450b-b7a1-68331c024506 could not be found. Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'aa44e23b-ce6e-450b-b7a1-68331c024506'} Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa44e23b-ce6e-450b-b7a1-68331c024506 could not be found. Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa44e23b-ce6e-450b-b7a1-68331c024506 could not be found. Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:34:24.694754 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:24.699149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:24.699149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:34:24.699149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:34:24.699149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:34:24.699149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:34:24.699149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa44e23b-ce6e-450b-b7a1-68331c024506 could not be found. Oct 27 19:34:24.699149 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:24.699149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce6dc097-5d9c-4375-b84a-58a48f6fe199 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance aa44e23b-ce6e-450b-b7a1-68331c024506 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:34:24.699149 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce6dc097-5d9c-4375-b84a-58a48f6fe199 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506" status: 404 len: 111 microversion: 2.1 time: 0.031578 Oct 27 19:34:24.699149 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3567/6985] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:24 2022] GET /compute/v2.1/servers/aa44e23b-ce6e-450b-b7a1-68331c024506 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:34:25.120712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d1c166d-97b9-4a75-a51b-1bdc29a68c49 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:25.121371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d1c166d-97b9-4a75-a51b-1bdc29a68c49 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:25.129473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1c166d-97b9-4a75-a51b-1bdc29a68c49 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:25.129999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1c166d-97b9-4a75-a51b-1bdc29a68c49 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:25.130497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1c166d-97b9-4a75-a51b-1bdc29a68c49 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:25.132746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1c166d-97b9-4a75-a51b-1bdc29a68c49 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:25.132746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1c166d-97b9-4a75-a51b-1bdc29a68c49 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:25.132746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1c166d-97b9-4a75-a51b-1bdc29a68c49 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:25.199393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d1c166d-97b9-4a75-a51b-1bdc29a68c49 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:25.208559 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d1c166d-97b9-4a75-a51b-1bdc29a68c49 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1230 microversion: 2.1 time: 0.091670 Oct 27 19:34:25.209249 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3419/6986] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:25 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:26.233636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d4482131-0a07-4562-8355-6adfcfc969ac tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:26.234177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d4482131-0a07-4562-8355-6adfcfc969ac tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:26.240742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4482131-0a07-4562-8355-6adfcfc969ac tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:26.241229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4482131-0a07-4562-8355-6adfcfc969ac tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:26.241671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4482131-0a07-4562-8355-6adfcfc969ac tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:26.242372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4482131-0a07-4562-8355-6adfcfc969ac tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:26.242852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4482131-0a07-4562-8355-6adfcfc969ac tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:26.243277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4482131-0a07-4562-8355-6adfcfc969ac tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:26.309127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d4482131-0a07-4562-8355-6adfcfc969ac tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:26.317283 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d4482131-0a07-4562-8355-6adfcfc969ac tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1230 microversion: 2.1 time: 0.088578 Oct 27 19:34:26.317853 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3568/6987] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:26 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1230 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:27.340851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b9be1327-47e6-4226-ba5f-72a814ddf5d0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:27.342047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b9be1327-47e6-4226-ba5f-72a814ddf5d0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:27.349804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9be1327-47e6-4226-ba5f-72a814ddf5d0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:27.350311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9be1327-47e6-4226-ba5f-72a814ddf5d0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:27.350786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9be1327-47e6-4226-ba5f-72a814ddf5d0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:27.351503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9be1327-47e6-4226-ba5f-72a814ddf5d0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:27.351973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9be1327-47e6-4226-ba5f-72a814ddf5d0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:27.352413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9be1327-47e6-4226-ba5f-72a814ddf5d0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:27.415740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b9be1327-47e6-4226-ba5f-72a814ddf5d0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e73272360ab4bd7838d3c642edbb788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382ab89d558a4ea7acba39accebc8c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:27.424031 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b9be1327-47e6-4226-ba5f-72a814ddf5d0 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 200 len: 1230 microversion: 2.1 time: 0.087070 Oct 27 19:34:27.424611 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3420/6988] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:27 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 1230 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:28.448345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5546d50b-9ab8-4aac-878a-9a7a5eae5fc8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:28.448981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5546d50b-9ab8-4aac-878a-9a7a5eae5fc8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] [instance: bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:28.456444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5546d50b-9ab8-4aac-878a-9a7a5eae5fc8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:28.456949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5546d50b-9ab8-4aac-878a-9a7a5eae5fc8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:28.457399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5546d50b-9ab8-4aac-878a-9a7a5eae5fc8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:28.458175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5546d50b-9ab8-4aac-878a-9a7a5eae5fc8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:28.458622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5546d50b-9ab8-4aac-878a-9a7a5eae5fc8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:28.459061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5546d50b-9ab8-4aac-878a-9a7a5eae5fc8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:28.474427 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-5546d50b-9ab8-4aac-878a-9a7a5eae5fc8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] HTTP exception thrown: Instance bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef could not be found. Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5546d50b-9ab8-4aac-878a-9a7a5eae5fc8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Request method failure captured: Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef HTTP/1.1 Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtyED9zoOibUlHXqmWRkvOxUGq0NYayzBS8mESXLlQwwgLuLmbUx0wJqFAANkn57FdEo5mXFCDqJJyLUPRQcqMRLMfvehyH9L39PAiX1VVITnSvO36bsA_suri140cFXVEJSnekPHJrdcVeSkrzmeh6n7u7aUudF5A1ftvNXl7ll9Ko Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 382ab89d558a4ea7acba39accebc8c40 Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestVolumeBackupRestore-682101576 Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/382ab89d558a4ea7acba39accebc8c40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/382ab89d558a4ea7acba39accebc8c40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_382ab89d558a4ea7acba39accebc8c40", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/382ab89d558a4ea7acba39accebc8c40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestVolumeBackupRestore-682101576 Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 382ab89d558a4ea7acba39accebc8c40 Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestVolumeBackupRestore-682101576 Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestVolumeBackupRestore-682101576-project Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 9e73272360ab4bd7838d3c642edbb788 Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestVolumeBackupRestore-682101576-project Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef could not be found. Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef'} Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef could not be found. Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef could not be found. Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:34:28.476004 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:28.479755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:28.479755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:34:28.479755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:34:28.479755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:34:28.479755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:34:28.479755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef could not be found. Oct 27 19:34:28.479755 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:28.479755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5546d50b-9ab8-4aac-878a-9a7a5eae5fc8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Returning 404 to user: Instance bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:34:28.479755 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5546d50b-9ab8-4aac-878a-9a7a5eae5fc8 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef" status: 404 len: 111 microversion: 2.1 time: 0.033575 Oct 27 19:34:28.479755 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3569/6989] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:28 2022] GET /compute/v2.1/servers/bb122a0d-5f04-42c2-bc2f-b8037b9dd2ef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:34:28.641347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf6eb3a0-4d2b-4ae4-a14e-ade232f4a0a9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] Calling method '.version_select at 0x7fc87337cd30>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:28.671502 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cf6eb3a0-4d2b-4ae4-a14e-ade232f4a0a9 tempest-TestVolumeBackupRestore-682101576 tempest-TestVolumeBackupRestore-682101576-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1862672098" status: 202 len: 0 microversion: 2.1 time: 0.035480 Oct 27 19:34:28.672331 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3421/6990] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 19:34:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1862672098 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:34:34.343962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c1895fe0-34b2-4ce5-9515-215d025324f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:34.344572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c1895fe0-34b2-4ce5-9515-215d025324f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:34.350877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b37b33a3-5abe-4baa-8846-51860034a8e7 req-3009a6bd-c047-4769-9cf5-a014280250da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "290d0514-04b2-45bf-8deb-09542250f95a", "tag": "294d4675-53e9-4880-8586-654ee6d03ff7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:34:34.368799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1895fe0-34b2-4ce5-9515-215d025324f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:34.369323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1895fe0-34b2-4ce5-9515-215d025324f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:34.369782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1895fe0-34b2-4ce5-9515-215d025324f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:34.370549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1895fe0-34b2-4ce5-9515-215d025324f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:34.371021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1895fe0-34b2-4ce5-9515-215d025324f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:34.371463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c1895fe0-34b2-4ce5-9515-215d025324f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:34.372152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b37b33a3-5abe-4baa-8846-51860034a8e7 req-3009a6bd-c047-4769-9cf5-a014280250da service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:34.373643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b37b33a3-5abe-4baa-8846-51860034a8e7 req-3009a6bd-c047-4769-9cf5-a014280250da service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:34.374317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b37b33a3-5abe-4baa-8846-51860034a8e7 req-3009a6bd-c047-4769-9cf5-a014280250da service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:34.387910 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b37b33a3-5abe-4baa-8846-51860034a8e7 req-3009a6bd-c047-4769-9cf5-a014280250da service nova] Creating event network-changed:294d4675-53e9-4880-8586-654ee6d03ff7 for instance 290d0514-04b2-45bf-8deb-09542250f95a on n-h1-860687-3 Oct 27 19:34:34.394285 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b37b33a3-5abe-4baa-8846-51860034a8e7 req-3009a6bd-c047-4769-9cf5-a014280250da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046892 Oct 27 19:34:34.399532 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3422/6991] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:34:34.411070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c1895fe0-34b2-4ce5-9515-215d025324f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:34:34.517991 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c1895fe0-34b2-4ce5-9515-215d025324f9 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "DELETE /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 204 len: 0 microversion: 2.1 time: 0.177739 Oct 27 19:34:34.522493 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3570/6992] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:34:34 2022] DELETE /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:34:34.533529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-177b505b-8278-4d81-974b-84f9b2061e79 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:34.535068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-177b505b-8278-4d81-974b-84f9b2061e79 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:34.547643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-177b505b-8278-4d81-974b-84f9b2061e79 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:34.548251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-177b505b-8278-4d81-974b-84f9b2061e79 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:34.548950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-177b505b-8278-4d81-974b-84f9b2061e79 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:34.549973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-177b505b-8278-4d81-974b-84f9b2061e79 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:34.550742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-177b505b-8278-4d81-974b-84f9b2061e79 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:34.551385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-177b505b-8278-4d81-974b-84f9b2061e79 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:34.730867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-177b505b-8278-4d81-974b-84f9b2061e79 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:34.744195 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-177b505b-8278-4d81-974b-84f9b2061e79 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1575 microversion: 2.1 time: 0.218348 Oct 27 19:34:34.744973 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3423/6993] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:34 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:35.774038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ec37231c-674d-41a6-9aef-1b2fb9d5b222 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:35.774795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ec37231c-674d-41a6-9aef-1b2fb9d5b222 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:35.800087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec37231c-674d-41a6-9aef-1b2fb9d5b222 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:35.800593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec37231c-674d-41a6-9aef-1b2fb9d5b222 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:35.801256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec37231c-674d-41a6-9aef-1b2fb9d5b222 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:35.802664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec37231c-674d-41a6-9aef-1b2fb9d5b222 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:35.803285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec37231c-674d-41a6-9aef-1b2fb9d5b222 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:35.803871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec37231c-674d-41a6-9aef-1b2fb9d5b222 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:36.081271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ec37231c-674d-41a6-9aef-1b2fb9d5b222 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:36.092393 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ec37231c-674d-41a6-9aef-1b2fb9d5b222 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1575 microversion: 2.1 time: 0.326251 Oct 27 19:34:36.103182 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3571/6994] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:35 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1575 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:34:36.845492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-94aca337-4b77-4c82-8cfc-fabedfdf909e req-c81858b1-d633-47f3-9ed0-1694a957c573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290d0514-04b2-45bf-8deb-09542250f95a", "name": "network-vif-deleted", "tag": "294d4675-53e9-4880-8586-654ee6d03ff7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:34:36.856092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-94aca337-4b77-4c82-8cfc-fabedfdf909e req-c81858b1-d633-47f3-9ed0-1694a957c573 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:36.856573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-94aca337-4b77-4c82-8cfc-fabedfdf909e req-c81858b1-d633-47f3-9ed0-1694a957c573 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:36.857198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-94aca337-4b77-4c82-8cfc-fabedfdf909e req-c81858b1-d633-47f3-9ed0-1694a957c573 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:36.869278 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-94aca337-4b77-4c82-8cfc-fabedfdf909e req-c81858b1-d633-47f3-9ed0-1694a957c573 service nova] Creating event network-vif-deleted:294d4675-53e9-4880-8586-654ee6d03ff7 for instance 290d0514-04b2-45bf-8deb-09542250f95a on n-h1-860687-3 Oct 27 19:34:36.874670 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-94aca337-4b77-4c82-8cfc-fabedfdf909e req-c81858b1-d633-47f3-9ed0-1694a957c573 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033403 Oct 27 19:34:36.875520 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3424/6995] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:34:37.132452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fbb388c0-3d22-4b58-bd77-ea691289c43c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:37.133074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fbb388c0-3d22-4b58-bd77-ea691289c43c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:37.142665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbb388c0-3d22-4b58-bd77-ea691289c43c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:37.143362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbb388c0-3d22-4b58-bd77-ea691289c43c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:37.144161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbb388c0-3d22-4b58-bd77-ea691289c43c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:37.145042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbb388c0-3d22-4b58-bd77-ea691289c43c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:37.145663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbb388c0-3d22-4b58-bd77-ea691289c43c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:37.146243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbb388c0-3d22-4b58-bd77-ea691289c43c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:37.538005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fbb388c0-3d22-4b58-bd77-ea691289c43c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:37.546853 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fbb388c0-3d22-4b58-bd77-ea691289c43c tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1224 microversion: 2.1 time: 0.418763 Oct 27 19:34:37.560479 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3572/6996] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:37 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1224 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:38.574532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-82099e15-15ae-4617-98b6-5556f00b11c0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:38.575939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-82099e15-15ae-4617-98b6-5556f00b11c0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:38.583094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82099e15-15ae-4617-98b6-5556f00b11c0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:38.583735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82099e15-15ae-4617-98b6-5556f00b11c0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:38.584458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82099e15-15ae-4617-98b6-5556f00b11c0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:38.585685 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82099e15-15ae-4617-98b6-5556f00b11c0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:38.585791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82099e15-15ae-4617-98b6-5556f00b11c0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:38.586181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-82099e15-15ae-4617-98b6-5556f00b11c0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:38.675055 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-82099e15-15ae-4617-98b6-5556f00b11c0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:38.683494 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-82099e15-15ae-4617-98b6-5556f00b11c0 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1224 microversion: 2.1 time: 0.114168 Oct 27 19:34:38.684349 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3425/6997] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:38 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:39.708744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ebbf7fe3-2f24-40ea-acf6-acfa872d6fca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:39.709360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ebbf7fe3-2f24-40ea-acf6-acfa872d6fca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:39.723040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebbf7fe3-2f24-40ea-acf6-acfa872d6fca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:39.723898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebbf7fe3-2f24-40ea-acf6-acfa872d6fca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:39.724517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebbf7fe3-2f24-40ea-acf6-acfa872d6fca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:39.725405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebbf7fe3-2f24-40ea-acf6-acfa872d6fca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:39.726024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebbf7fe3-2f24-40ea-acf6-acfa872d6fca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:39.726656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebbf7fe3-2f24-40ea-acf6-acfa872d6fca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:39.835697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ebbf7fe3-2f24-40ea-acf6-acfa872d6fca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:39.842780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:34:39.846603 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ebbf7fe3-2f24-40ea-acf6-acfa872d6fca tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1224 microversion: 2.1 time: 0.142025 Oct 27 19:34:39.853172 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3573/6998] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:39 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1224 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:40.870767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae6af08b-6510-456f-b3f7-6cc652f1db3d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:40.871411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ae6af08b-6510-456f-b3f7-6cc652f1db3d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:40.878327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae6af08b-6510-456f-b3f7-6cc652f1db3d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:40.878855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae6af08b-6510-456f-b3f7-6cc652f1db3d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:40.879314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae6af08b-6510-456f-b3f7-6cc652f1db3d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:40.880029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae6af08b-6510-456f-b3f7-6cc652f1db3d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:40.880510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae6af08b-6510-456f-b3f7-6cc652f1db3d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:40.881698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae6af08b-6510-456f-b3f7-6cc652f1db3d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:40.902092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:34:40.972483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae6af08b-6510-456f-b3f7-6cc652f1db3d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e60ff9ab0d45628195f314f1cac791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84229fcbba74710a8c0c30c34dce78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:34:40.981281 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ae6af08b-6510-456f-b3f7-6cc652f1db3d tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 200 len: 1224 microversion: 2.1 time: 0.114701 Oct 27 19:34:40.982041 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3426/6999] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:40 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:34:42.004344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cfe45261-e531-446c-ade3-1c81cb0a32e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:42.005131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cfe45261-e531-446c-ade3-1c81cb0a32e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 290d0514-04b2-45bf-8deb-09542250f95a] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:42.013617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cfe45261-e531-446c-ade3-1c81cb0a32e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:42.014231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cfe45261-e531-446c-ade3-1c81cb0a32e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:42.014775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cfe45261-e531-446c-ade3-1c81cb0a32e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:42.015557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cfe45261-e531-446c-ade3-1c81cb0a32e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:42.016087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cfe45261-e531-446c-ade3-1c81cb0a32e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:42.016582 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cfe45261-e531-446c-ade3-1c81cb0a32e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:42.032769 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-cfe45261-e531-446c-ade3-1c81cb0a32e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance 290d0514-04b2-45bf-8deb-09542250f95a could not be found. Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cfe45261-e531-446c-ade3-1c81cb0a32e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a HTTP/1.1 Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 290d0514-04b2-45bf-8deb-09542250f95a could not be found. Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '290d0514-04b2-45bf-8deb-09542250f95a'} Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 290d0514-04b2-45bf-8deb-09542250f95a could not be found. Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 290d0514-04b2-45bf-8deb-09542250f95a could not be found. Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:34:42.034805 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.039050 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:42.039050 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:34:42.039050 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:34:42.039050 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:34:42.039050 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:34:42.039050 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 290d0514-04b2-45bf-8deb-09542250f95a could not be found. Oct 27 19:34:42.039050 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.039050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cfe45261-e531-446c-ade3-1c81cb0a32e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance 290d0514-04b2-45bf-8deb-09542250f95a could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:34:42.039050 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cfe45261-e531-446c-ade3-1c81cb0a32e8 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a" status: 404 len: 111 microversion: 2.1 time: 0.036374 Oct 27 19:34:42.039050 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3574/7000] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:41 2022] GET /compute/v2.1/servers/290d0514-04b2-45bf-8deb-09542250f95a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:34:42.584291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d1179cc-dc2d-4b90-8c6e-3086a13af9be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:42.584834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0d1179cc-dc2d-4b90-8c6e-3086a13af9be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:42.593048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d1179cc-dc2d-4b90-8c6e-3086a13af9be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:42.593598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d1179cc-dc2d-4b90-8c6e-3086a13af9be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:42.594089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d1179cc-dc2d-4b90-8c6e-3086a13af9be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:42.594843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d1179cc-dc2d-4b90-8c6e-3086a13af9be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:42.595315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d1179cc-dc2d-4b90-8c6e-3086a13af9be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:42.595761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d1179cc-dc2d-4b90-8c6e-3086a13af9be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:42.609448 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-0d1179cc-dc2d-4b90-8c6e-3086a13af9be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d1179cc-dc2d-4b90-8c6e-3086a13af9be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d HTTP/1.1 Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '66ae73ec-73d0-4c47-b3ce-072de1189a9d'} Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:34:42.611206 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:34:42.615358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:34:42.615358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.615358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:34:42.615358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.615358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:42.615358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:34:42.615358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:34:42.615358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:34:42.615358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:34:42.615358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:34:42.615358 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.615358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d1179cc-dc2d-4b90-8c6e-3086a13af9be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:34:42.615358 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d1179cc-dc2d-4b90-8c6e-3086a13af9be tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "DELETE /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 404 len: 111 microversion: 2.1 time: 0.032798 Oct 27 19:34:42.615358 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3427/7001] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:34:42 2022] DELETE /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:34:42.626460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84d882f0-706b-4e9c-962f-39f8e2b27265 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:42.627082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-84d882f0-706b-4e9c-962f-39f8e2b27265 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] [instance: 66ae73ec-73d0-4c47-b3ce-072de1189a9d] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:34:42.633424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84d882f0-706b-4e9c-962f-39f8e2b27265 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:42.633915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84d882f0-706b-4e9c-962f-39f8e2b27265 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:42.634366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84d882f0-706b-4e9c-962f-39f8e2b27265 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:42.635092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84d882f0-706b-4e9c-962f-39f8e2b27265 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:34:42.635551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84d882f0-706b-4e9c-962f-39f8e2b27265 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:34:42.635978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84d882f0-706b-4e9c-962f-39f8e2b27265 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:34:42.650001 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-84d882f0-706b-4e9c-962f-39f8e2b27265 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] HTTP exception thrown: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84d882f0-706b-4e9c-962f-39f8e2b27265 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Request method failure captured: Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d HTTP/1.1 Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWtnu6-NREhw3h8tPqytaqw6tdKFFNqOWPRLW8vLswp7X8-EckSki1esSQRdtCquHQcMqosr6NH7Aj_f69UjCiK8P9CUeyPagXhkKZZmiLxqIWTFT8binmKn0kY9BBwsrsi2qBzdMZF3Ag_0DnJAPyqSxUr-7MHWXvQJoXMJs7EY6gKY Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b84229fcbba74710a8c0c30c34dce78d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b84229fcbba74710a8c0c30c34dce78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestVolumeBootPattern-473832568 Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: b84229fcbba74710a8c0c30c34dce78d Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestVolumeBootPattern-473832568 Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c8e60ff9ab0d45628195f314f1cac791 Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestVolumeBootPattern-473832568-project Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '66ae73ec-73d0-4c47-b3ce-072de1189a9d'} Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:34:42.651702 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.655719 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:34:42.655719 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:34:42.655719 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:34:42.655719 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:34:42.655719 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:34:42.655719 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. Oct 27 19:34:42.655719 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:34:42.655719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84d882f0-706b-4e9c-962f-39f8e2b27265 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Returning 404 to user: Instance 66ae73ec-73d0-4c47-b3ce-072de1189a9d could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:34:42.655719 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-84d882f0-706b-4e9c-962f-39f8e2b27265 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d" status: 404 len: 111 microversion: 2.1 time: 0.032037 Oct 27 19:34:42.655719 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3575/7002] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:34:42 2022] GET /compute/v2.1/servers/66ae73ec-73d0-4c47-b3ce-072de1189a9d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:34:46.087939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3a35cd21-68e2-4330-aa3c-9a4f118c6b37 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] Calling method '.version_select at 0x7fc8733bdee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:34:46.116497 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3a35cd21-68e2-4330-aa3c-9a4f118c6b37 tempest-TestVolumeBootPattern-473832568 tempest-TestVolumeBootPattern-473832568-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-600353821" status: 202 len: 0 microversion: 2.1 time: 0.032660 Oct 27 19:34:46.117465 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3428/7003] 10.222.0.42 () {58 vars in 1260 bytes} [Thu Oct 27 19:34:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-600353821 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:35:04.294813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:04.295620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:04.424354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1986682058", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:35:04.583812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] validate_networks() for None {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:35:04.852079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:35:04.852509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:35:04.852991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:35:04.853408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:35:04.853831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:35:04.862764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:04.863255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:04.863722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:04.864462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:04.864922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:04.865359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:04.881779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Getting quotas for project ede1473158f24f25b5fadec8cd9b531e. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:35:04.888275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Getting quotas for user 0116ab0be20d427f9564c8189f9eae18 and project ede1473158f24f25b5fadec8cd9b531e. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:35:04.900476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:35:04.903839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:35:04.947556 n-d-860687-3 devstack@n-api.service[127029]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [b3c38cf1-6804-49a6-a067-e9961f217723] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 19:35:05.955146 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [b3c38cf1-6804-49a6-a067-e9961f217723] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 33644. Oct 27 19:35:05.959607 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5222c49c-1de2-43b9-9e79-9275d02a5f95 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.670809 Oct 27 19:35:05.960253 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3576/7004] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:35:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:35:05.975065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8a956e38-bcd0-4246-9d66-10ade8a2c48c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:05.975718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8a956e38-bcd0-4246-9d66-10ade8a2c48c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:05.979483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:05.980294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:06.038581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8a956e38-bcd0-4246-9d66-10ade8a2c48c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0116ab0be20d427f9564c8189f9eae18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1473158f24f25b5fadec8cd9b531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:06.046465 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8a956e38-bcd0-4246-9d66-10ade8a2c48c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 200 len: 1222 microversion: 2.1 time: 0.076126 Oct 27 19:35:06.047063 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3429/7005] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:05 2022] GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:07.070368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-933fa220-64ef-4deb-a4c8-55cf80a0e8f4 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:07.070967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-933fa220-64ef-4deb-a4c8-55cf80a0e8f4 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:07.077684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-933fa220-64ef-4deb-a4c8-55cf80a0e8f4 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:07.078155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-933fa220-64ef-4deb-a4c8-55cf80a0e8f4 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:07.078624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-933fa220-64ef-4deb-a4c8-55cf80a0e8f4 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:07.079321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-933fa220-64ef-4deb-a4c8-55cf80a0e8f4 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:07.079799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-933fa220-64ef-4deb-a4c8-55cf80a0e8f4 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:07.080213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-933fa220-64ef-4deb-a4c8-55cf80a0e8f4 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:07.171944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-933fa220-64ef-4deb-a4c8-55cf80a0e8f4 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0116ab0be20d427f9564c8189f9eae18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1473158f24f25b5fadec8cd9b531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:07.179645 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-933fa220-64ef-4deb-a4c8-55cf80a0e8f4 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 200 len: 1274 microversion: 2.1 time: 0.114145 Oct 27 19:35:07.180207 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3577/7006] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:07 2022] GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 1274 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:08.205629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-63cf3b2f-9065-4af4-b1bb-1a64d8ad96ff tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:08.206620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-63cf3b2f-9065-4af4-b1bb-1a64d8ad96ff tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:08.213848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63cf3b2f-9065-4af4-b1bb-1a64d8ad96ff tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:08.214576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63cf3b2f-9065-4af4-b1bb-1a64d8ad96ff tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:08.215908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63cf3b2f-9065-4af4-b1bb-1a64d8ad96ff tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:08.216830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63cf3b2f-9065-4af4-b1bb-1a64d8ad96ff tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:08.217402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63cf3b2f-9065-4af4-b1bb-1a64d8ad96ff tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:08.217903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63cf3b2f-9065-4af4-b1bb-1a64d8ad96ff tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:08.479552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-63cf3b2f-9065-4af4-b1bb-1a64d8ad96ff tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0116ab0be20d427f9564c8189f9eae18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1473158f24f25b5fadec8cd9b531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:08.488096 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-63cf3b2f-9065-4af4-b1bb-1a64d8ad96ff tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 200 len: 1322 microversion: 2.1 time: 0.287188 Oct 27 19:35:08.488808 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3430/7007] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:08 2022] GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:08.918579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-fd7894ef-04ad-4b2e-a544-f60256b383e6 req-34b041d6-0e08-4df5-ae67-f4ed54372c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc46f87f-7f86-4e4b-892f-8e7d4d2c0605", "tag": "49ab202e-95df-43c6-9d96-77fc9b7bffed"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:35:08.930077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fd7894ef-04ad-4b2e-a544-f60256b383e6 req-34b041d6-0e08-4df5-ae67-f4ed54372c20 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:08.930620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fd7894ef-04ad-4b2e-a544-f60256b383e6 req-34b041d6-0e08-4df5-ae67-f4ed54372c20 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:08.931070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fd7894ef-04ad-4b2e-a544-f60256b383e6 req-34b041d6-0e08-4df5-ae67-f4ed54372c20 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:08.944188 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-fd7894ef-04ad-4b2e-a544-f60256b383e6 req-34b041d6-0e08-4df5-ae67-f4ed54372c20 service nova] Creating event network-changed:49ab202e-95df-43c6-9d96-77fc9b7bffed for instance bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 on n-h2-860687-3 Oct 27 19:35:08.950564 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-fd7894ef-04ad-4b2e-a544-f60256b383e6 req-34b041d6-0e08-4df5-ae67-f4ed54372c20 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036997 Oct 27 19:35:08.951502 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3578/7008] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:35:09.512587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-acc26972-75ce-4796-9e42-b17aab413724 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:09.513391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-acc26972-75ce-4796-9e42-b17aab413724 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:09.521812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acc26972-75ce-4796-9e42-b17aab413724 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:09.522321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acc26972-75ce-4796-9e42-b17aab413724 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:09.522802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acc26972-75ce-4796-9e42-b17aab413724 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:09.523522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acc26972-75ce-4796-9e42-b17aab413724 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:09.523997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acc26972-75ce-4796-9e42-b17aab413724 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:09.524443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-acc26972-75ce-4796-9e42-b17aab413724 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:09.676971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-acc26972-75ce-4796-9e42-b17aab413724 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0116ab0be20d427f9564c8189f9eae18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1473158f24f25b5fadec8cd9b531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:09.686640 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-acc26972-75ce-4796-9e42-b17aab413724 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 200 len: 1322 microversion: 2.1 time: 0.178614 Oct 27 19:35:09.687230 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3431/7009] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:09 2022] GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:10.712667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3a20a1bc-c86e-44f9-aa76-e3c6faa02396 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:10.713312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3a20a1bc-c86e-44f9-aa76-e3c6faa02396 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:10.719771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a20a1bc-c86e-44f9-aa76-e3c6faa02396 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:10.720265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a20a1bc-c86e-44f9-aa76-e3c6faa02396 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:10.720720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a20a1bc-c86e-44f9-aa76-e3c6faa02396 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:10.721417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a20a1bc-c86e-44f9-aa76-e3c6faa02396 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:10.721884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a20a1bc-c86e-44f9-aa76-e3c6faa02396 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:10.722321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3a20a1bc-c86e-44f9-aa76-e3c6faa02396 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:10.861891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3a20a1bc-c86e-44f9-aa76-e3c6faa02396 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0116ab0be20d427f9564c8189f9eae18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1473158f24f25b5fadec8cd9b531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:10.869708 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3a20a1bc-c86e-44f9-aa76-e3c6faa02396 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 200 len: 1322 microversion: 2.1 time: 0.162249 Oct 27 19:35:10.870288 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3579/7010] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:10 2022] GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:11.894197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9178a795-2390-4420-9415-2c67fa3366ad tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:11.894865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9178a795-2390-4420-9415-2c67fa3366ad tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:11.901691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9178a795-2390-4420-9415-2c67fa3366ad tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:11.902200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9178a795-2390-4420-9415-2c67fa3366ad tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:11.903754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9178a795-2390-4420-9415-2c67fa3366ad tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:11.904472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9178a795-2390-4420-9415-2c67fa3366ad tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:11.904948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9178a795-2390-4420-9415-2c67fa3366ad tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:11.905396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9178a795-2390-4420-9415-2c67fa3366ad tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:12.036833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9178a795-2390-4420-9415-2c67fa3366ad tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0116ab0be20d427f9564c8189f9eae18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1473158f24f25b5fadec8cd9b531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:12.045217 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9178a795-2390-4420-9415-2c67fa3366ad tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 200 len: 1322 microversion: 2.1 time: 0.155350 Oct 27 19:35:12.045797 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3432/7011] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:11 2022] GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:13.068690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cdbbad55-f87c-4f96-8fee-55aa5b4ef902 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:13.069301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cdbbad55-f87c-4f96-8fee-55aa5b4ef902 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:13.076689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdbbad55-f87c-4f96-8fee-55aa5b4ef902 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:13.077177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdbbad55-f87c-4f96-8fee-55aa5b4ef902 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:13.077615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdbbad55-f87c-4f96-8fee-55aa5b4ef902 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:13.078309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdbbad55-f87c-4f96-8fee-55aa5b4ef902 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:13.078788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdbbad55-f87c-4f96-8fee-55aa5b4ef902 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:13.079219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cdbbad55-f87c-4f96-8fee-55aa5b4ef902 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:13.214587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cdbbad55-f87c-4f96-8fee-55aa5b4ef902 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0116ab0be20d427f9564c8189f9eae18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1473158f24f25b5fadec8cd9b531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:13.223231 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cdbbad55-f87c-4f96-8fee-55aa5b4ef902 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 200 len: 1322 microversion: 2.1 time: 0.158436 Oct 27 19:35:13.223790 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3580/7012] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:13 2022] GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:14.247196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-67c387de-cf2a-482d-a29e-daac60f9bb05 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:14.247833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-67c387de-cf2a-482d-a29e-daac60f9bb05 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:14.254817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67c387de-cf2a-482d-a29e-daac60f9bb05 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:14.255325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67c387de-cf2a-482d-a29e-daac60f9bb05 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:14.255787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67c387de-cf2a-482d-a29e-daac60f9bb05 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:14.256532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67c387de-cf2a-482d-a29e-daac60f9bb05 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:14.257010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67c387de-cf2a-482d-a29e-daac60f9bb05 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:14.257463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67c387de-cf2a-482d-a29e-daac60f9bb05 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:14.391419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-67c387de-cf2a-482d-a29e-daac60f9bb05 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0116ab0be20d427f9564c8189f9eae18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1473158f24f25b5fadec8cd9b531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:14.399191 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-67c387de-cf2a-482d-a29e-daac60f9bb05 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 200 len: 1322 microversion: 2.1 time: 0.156513 Oct 27 19:35:14.399847 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3433/7013] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:14 2022] GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:15.422404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fe955870-7ee7-448f-b3ed-c5b1332d88d9 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:15.423026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fe955870-7ee7-448f-b3ed-c5b1332d88d9 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:15.425778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:15.426460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:15.432060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe955870-7ee7-448f-b3ed-c5b1332d88d9 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:15.432545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe955870-7ee7-448f-b3ed-c5b1332d88d9 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:15.432984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe955870-7ee7-448f-b3ed-c5b1332d88d9 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:15.434205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe955870-7ee7-448f-b3ed-c5b1332d88d9 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:15.434895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe955870-7ee7-448f-b3ed-c5b1332d88d9 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:15.435101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fe955870-7ee7-448f-b3ed-c5b1332d88d9 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:15.570167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fe955870-7ee7-448f-b3ed-c5b1332d88d9 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0116ab0be20d427f9564c8189f9eae18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1473158f24f25b5fadec8cd9b531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:15.579034 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fe955870-7ee7-448f-b3ed-c5b1332d88d9 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 200 len: 1322 microversion: 2.1 time: 0.160624 Oct 27 19:35:15.579603 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3581/7014] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:15 2022] GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:16.149656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-13568bc7-7790-4654-ba64-e386a74ecec4 req-fa397ce8-52e8-4212-8c29-0cd367abd680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc46f87f-7f86-4e4b-892f-8e7d4d2c0605", "name": "network-vif-plugged", "status": "completed", "tag": "49ab202e-95df-43c6-9d96-77fc9b7bffed"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:35:16.155792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:16.161783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-13568bc7-7790-4654-ba64-e386a74ecec4 req-fa397ce8-52e8-4212-8c29-0cd367abd680 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:16.162159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-13568bc7-7790-4654-ba64-e386a74ecec4 req-fa397ce8-52e8-4212-8c29-0cd367abd680 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:16.162643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-13568bc7-7790-4654-ba64-e386a74ecec4 req-fa397ce8-52e8-4212-8c29-0cd367abd680 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:16.175977 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-13568bc7-7790-4654-ba64-e386a74ecec4 req-fa397ce8-52e8-4212-8c29-0cd367abd680 service nova] Creating event network-vif-plugged:49ab202e-95df-43c6-9d96-77fc9b7bffed for instance bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 on n-h2-860687-3 Oct 27 19:35:16.181180 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-13568bc7-7790-4654-ba64-e386a74ecec4 req-fa397ce8-52e8-4212-8c29-0cd367abd680 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035343 Oct 27 19:35:16.181788 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3434/7015] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:35:16.601769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ca04b6a4-fcab-41fb-9ea1-8cce3ad0767c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:16.602418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ca04b6a4-fcab-41fb-9ea1-8cce3ad0767c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:16.609226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca04b6a4-fcab-41fb-9ea1-8cce3ad0767c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:16.609711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca04b6a4-fcab-41fb-9ea1-8cce3ad0767c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:16.610152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca04b6a4-fcab-41fb-9ea1-8cce3ad0767c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:16.610876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca04b6a4-fcab-41fb-9ea1-8cce3ad0767c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:16.611337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca04b6a4-fcab-41fb-9ea1-8cce3ad0767c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:16.611768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ca04b6a4-fcab-41fb-9ea1-8cce3ad0767c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:16.741922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ca04b6a4-fcab-41fb-9ea1-8cce3ad0767c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0116ab0be20d427f9564c8189f9eae18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1473158f24f25b5fadec8cd9b531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:16.749883 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ca04b6a4-fcab-41fb-9ea1-8cce3ad0767c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 200 len: 1322 microversion: 2.1 time: 0.152036 Oct 27 19:35:16.750466 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3582/7016] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:16 2022] GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:17.774751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b37d957d-3dcf-4d36-8654-eb6a29a5ed8c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:17.775479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b37d957d-3dcf-4d36-8654-eb6a29a5ed8c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:17.782204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b37d957d-3dcf-4d36-8654-eb6a29a5ed8c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:17.782737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b37d957d-3dcf-4d36-8654-eb6a29a5ed8c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:17.783199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b37d957d-3dcf-4d36-8654-eb6a29a5ed8c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:17.783911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b37d957d-3dcf-4d36-8654-eb6a29a5ed8c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:17.784392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b37d957d-3dcf-4d36-8654-eb6a29a5ed8c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:17.784839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b37d957d-3dcf-4d36-8654-eb6a29a5ed8c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:17.917467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b37d957d-3dcf-4d36-8654-eb6a29a5ed8c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0116ab0be20d427f9564c8189f9eae18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1473158f24f25b5fadec8cd9b531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:17.925969 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b37d957d-3dcf-4d36-8654-eb6a29a5ed8c tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 200 len: 1472 microversion: 2.1 time: 0.156508 Oct 27 19:35:17.926643 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3435/7017] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:17 2022] GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:18.001820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-82073c66-221d-4b64-a84c-adee2815bf14 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Calling method '.version_select at 0x7fc869e62790>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:18.067415 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-82073c66-221d-4b64-a84c-adee2815bf14 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/9ad55b64b7f040cfa22059e3ada32fd9" status: 200 len: 371 microversion: 2.1 time: 0.120027 Oct 27 19:35:18.067980 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3583/7018] 10.222.0.42 () {58 vars in 1242 bytes} [Thu Oct 27 19:35:17 2022] GET /compute/v2.1/os-quota-sets/9ad55b64b7f040cfa22059e3ada32fd9 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:35:18.080567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f05bac85-ccc4-4d26-8898-ec1bf1fe641c tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1997055324", "id": 418007719, "os-flavor-access:is_public": "True"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:35:18.099055 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f05bac85-ccc4-4d26-8898-ec1bf1fe641c tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022351 Oct 27 19:35:18.099638 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3436/7019] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:35:18 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:35:18.112242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "418007719"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:35:18.114672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:18.120699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:18.121266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:18.121708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:18.122446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:18.122917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:18.123353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:18.210360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c6608f433827488db0eb14532d6955df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad55b64b7f040cfa22059e3ada32fd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:18.217299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1997055324 {{(pid=127029) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 19:35:18.224054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:18.224543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:18.224986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:18.225720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:18.226183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:18.226639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:18.246855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Getting quotas for project ede1473158f24f25b5fadec8cd9b531e. Resources: {'cores', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:35:18.251970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Getting quotas for user 0116ab0be20d427f9564c8189f9eae18 and project ede1473158f24f25b5fadec8cd9b531e. Resources: {'cores', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:35:18.264572 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.compute.api [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] ram quota exceeded for 9ad55b64b7f040cfa22059e3ada32fd9, tried to resize instance. Oct 27 19:35:18.265110 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Request method failure captured: Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605/action HTTP/1.1 Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 38 Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt1oTLUKE3JRT-tHGCxafZe8fF4pPUr2ZtdMQOum6IVXI1XcwSsGW7RKIvJa2FXpPTwcroAMxnNRnnNdg0xstHMsDJor32oRFkOjZRWhdPo1uFNPFnaCFjF8v2JWxcCTZ2XsxfDyqru0YPJo5EGmx0P8D-heAFNKWU2YTFVX-ALGajE Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 9ad55b64b7f040cfa22059e3ada32fd9 Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1937139759 Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Role: admin,member,reader Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: admin,member,reader Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ad55b64b7f040cfa22059e3ada32fd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ad55b64b7f040cfa22059e3ada32fd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ad55b64b7f040cfa22059e3ada32fd9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ad55b64b7f040cfa22059e3ada32fd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1937139759 Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 9ad55b64b7f040cfa22059e3ada32fd9 Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1937139759 Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersAdminNegativeTestJSON-1937139759-project-admin Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c6608f433827488db0eb14532d6955df Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1937139759-project-admin Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: {"resize": {"flavorRef": "418007719"}} Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'bc46f87f-7f86-4e4b-892f-8e7d4d2c0605', 'body': {'resize': {'flavorRef': '418007719'}}} Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:35:18.267199 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6e227e36-17d2-483e-bd10-e4ab7887b3b5 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605/action" status: 403 len: 118 microversion: 2.1 time: 0.160244 Oct 27 19:35:18.271424 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3584/7020] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:35:18 2022] POST /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605/action => generated 118 bytes in 161 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:35:18.278469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d8306bcb-44b2-4ca5-9725-c54a1d2e4360 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:18.295555 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d8306bcb-44b2-4ca5-9725-c54a1d2e4360 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/418007719" status: 202 len: 0 microversion: 2.1 time: 0.021726 Oct 27 19:35:18.296123 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3437/7021] 10.222.0.42 () {58 vars in 1158 bytes} [Thu Oct 27 19:35:18 2022] DELETE /compute/v2.1/flavors/418007719 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:35:18.304046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bea2c844-5490-4f10-84f4-f6897abec353 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:18.325607 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bea2c844-5490-4f10-84f4-f6897abec353 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025347 Oct 27 19:35:18.326168 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3585/7022] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 19:35:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:18.346808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-10418498-15a0-4f3c-b4f4-8c4f63023c51 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Calling method '.version_select at 0x7fc8699265e0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:18.419918 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-10418498-15a0-4f3c-b4f4-8c4f63023c51 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/9ad55b64b7f040cfa22059e3ada32fd9" status: 200 len: 371 microversion: 2.1 time: 0.076799 Oct 27 19:35:18.420504 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3438/7023] 10.222.0.42 () {58 vars in 1242 bytes} [Thu Oct 27 19:35:18 2022] GET /compute/v2.1/os-quota-sets/9ad55b64b7f040cfa22059e3ada32fd9 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:35:18.432154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-318c47b1-f367-4049-9c01-9b835a02d35d tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1780284334", "id": 439156253, "os-flavor-access:is_public": "True"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:35:18.450309 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-318c47b1-f367-4049-9c01-9b835a02d35d tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021842 Oct 27 19:35:18.450922 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3586/7024] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:35:18 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:35:18.463279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "439156253"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:35:18.466339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:18.472423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:18.472926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:18.473380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:18.474093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:18.474607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:18.475053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:18.563549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c6608f433827488db0eb14532d6955df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad55b64b7f040cfa22059e3ada32fd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:18.570128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1780284334 {{(pid=127028) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 19:35:18.577431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:18.577929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:18.578408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:18.579140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:18.579603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:18.580041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:18.606410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Getting quotas for project ede1473158f24f25b5fadec8cd9b531e. Resources: {'cores', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:35:18.611431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Getting quotas for user 0116ab0be20d427f9564c8189f9eae18 and project ede1473158f24f25b5fadec8cd9b531e. Resources: {'cores', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:35:18.623766 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.compute.api [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] cores quota exceeded for 9ad55b64b7f040cfa22059e3ada32fd9, tried to resize instance. Oct 27 19:35:18.624252 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Request method failure captured: Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605/action HTTP/1.1 Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 38 Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt1oTLUKE3JRT-tHGCxafZe8fF4pPUr2ZtdMQOum6IVXI1XcwSsGW7RKIvJa2FXpPTwcroAMxnNRnnNdg0xstHMsDJor32oRFkOjZRWhdPo1uFNPFnaCFjF8v2JWxcCTZ2XsxfDyqru0YPJo5EGmx0P8D-heAFNKWU2YTFVX-ALGajE Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 9ad55b64b7f040cfa22059e3ada32fd9 Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1937139759 Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Role: admin,member,reader Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: admin,member,reader Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ad55b64b7f040cfa22059e3ada32fd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ad55b64b7f040cfa22059e3ada32fd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ad55b64b7f040cfa22059e3ada32fd9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ad55b64b7f040cfa22059e3ada32fd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1937139759 Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 9ad55b64b7f040cfa22059e3ada32fd9 Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1937139759 Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersAdminNegativeTestJSON-1937139759-project-admin Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c6608f433827488db0eb14532d6955df Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1937139759-project-admin Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: {"resize": {"flavorRef": "439156253"}} Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'bc46f87f-7f86-4e4b-892f-8e7d4d2c0605', 'body': {'resize': {'flavorRef': '439156253'}}} Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:35:18.626307 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7d26c1c0-4c69-4109-abe0-479db80cd5ca tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605/action" status: 403 len: 113 microversion: 2.1 time: 0.168374 Oct 27 19:35:18.630562 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3439/7025] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:35:18 2022] POST /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605/action => generated 113 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:35:18.636459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-327f886d-1ef1-4bec-ac16-2df65dd64fa9 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:18.653928 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-327f886d-1ef1-4bec-ac16-2df65dd64fa9 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/439156253" status: 202 len: 0 microversion: 2.1 time: 0.021196 Oct 27 19:35:18.654518 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3587/7026] 10.222.0.42 () {58 vars in 1158 bytes} [Thu Oct 27 19:35:18 2022] DELETE /compute/v2.1/flavors/439156253 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:35:18.662200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8229e743-4961-413c-a0b4-fcc9f1f8d885 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:18.682462 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8229e743-4961-413c-a0b4-fcc9f1f8d885 tempest-ServersAdminNegativeTestJSON-1937139759 tempest-ServersAdminNegativeTestJSON-1937139759-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023653 Oct 27 19:35:18.683259 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3440/7027] 10.222.0.42 () {58 vars in 1146 bytes} [Thu Oct 27 19:35:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:18.705594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-acd79d89-3ad9-427b-afe8-088a2a77ca96 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:18.706097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-acd79d89-3ad9-427b-afe8-088a2a77ca96 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:18.712070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-acd79d89-3ad9-427b-afe8-088a2a77ca96 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:18.712562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-acd79d89-3ad9-427b-afe8-088a2a77ca96 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:18.713004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-acd79d89-3ad9-427b-afe8-088a2a77ca96 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:18.713695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-acd79d89-3ad9-427b-afe8-088a2a77ca96 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:18.714151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-acd79d89-3ad9-427b-afe8-088a2a77ca96 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:18.714614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-acd79d89-3ad9-427b-afe8-088a2a77ca96 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:18.740387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-acd79d89-3ad9-427b-afe8-088a2a77ca96 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:35:18.820539 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-acd79d89-3ad9-427b-afe8-088a2a77ca96 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 204 len: 0 microversion: 2.1 time: 0.118659 Oct 27 19:35:18.821138 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3588/7028] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:35:18 2022] DELETE /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:35:18.829215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2eeb4e2b-aff8-423b-9d6e-a65b0f92ca16 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:18.829850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2eeb4e2b-aff8-423b-9d6e-a65b0f92ca16 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:18.836835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eeb4e2b-aff8-423b-9d6e-a65b0f92ca16 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:18.837338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eeb4e2b-aff8-423b-9d6e-a65b0f92ca16 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:18.837797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eeb4e2b-aff8-423b-9d6e-a65b0f92ca16 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:18.838534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eeb4e2b-aff8-423b-9d6e-a65b0f92ca16 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:18.839014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eeb4e2b-aff8-423b-9d6e-a65b0f92ca16 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:18.839462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2eeb4e2b-aff8-423b-9d6e-a65b0f92ca16 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:18.972532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2eeb4e2b-aff8-423b-9d6e-a65b0f92ca16 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0116ab0be20d427f9564c8189f9eae18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1473158f24f25b5fadec8cd9b531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:18.980464 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2eeb4e2b-aff8-423b-9d6e-a65b0f92ca16 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 200 len: 1478 microversion: 2.1 time: 0.155200 Oct 27 19:35:18.981049 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3441/7029] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:18 2022] GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 1478 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:20.004217 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-89ac1ae1-639e-4835-b43c-acaa5dfcb1e6 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:20.004933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-89ac1ae1-639e-4835-b43c-acaa5dfcb1e6 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:20.012424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89ac1ae1-639e-4835-b43c-acaa5dfcb1e6 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:20.012918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89ac1ae1-639e-4835-b43c-acaa5dfcb1e6 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:20.013370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89ac1ae1-639e-4835-b43c-acaa5dfcb1e6 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:20.014070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89ac1ae1-639e-4835-b43c-acaa5dfcb1e6 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:20.014561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89ac1ae1-639e-4835-b43c-acaa5dfcb1e6 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:20.015001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89ac1ae1-639e-4835-b43c-acaa5dfcb1e6 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:20.152649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-89ac1ae1-639e-4835-b43c-acaa5dfcb1e6 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0116ab0be20d427f9564c8189f9eae18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1473158f24f25b5fadec8cd9b531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:20.160533 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-89ac1ae1-639e-4835-b43c-acaa5dfcb1e6 tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 200 len: 1478 microversion: 2.1 time: 0.160628 Oct 27 19:35:20.161099 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3589/7030] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:19 2022] GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 1478 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:20.687529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-03b07955-e6b6-4786-b2af-47336fab94d1 req-a3d7f424-0f77-4ed1-955d-47872cf9cce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc46f87f-7f86-4e4b-892f-8e7d4d2c0605", "name": "network-vif-deleted", "tag": "49ab202e-95df-43c6-9d96-77fc9b7bffed"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:35:20.702319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-03b07955-e6b6-4786-b2af-47336fab94d1 req-a3d7f424-0f77-4ed1-955d-47872cf9cce0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:20.703092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-03b07955-e6b6-4786-b2af-47336fab94d1 req-a3d7f424-0f77-4ed1-955d-47872cf9cce0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:20.703541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-03b07955-e6b6-4786-b2af-47336fab94d1 req-a3d7f424-0f77-4ed1-955d-47872cf9cce0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:20.718338 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-03b07955-e6b6-4786-b2af-47336fab94d1 req-a3d7f424-0f77-4ed1-955d-47872cf9cce0 service nova] Creating event network-vif-deleted:49ab202e-95df-43c6-9d96-77fc9b7bffed for instance bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 on n-h2-860687-3 Oct 27 19:35:20.724266 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-03b07955-e6b6-4786-b2af-47336fab94d1 req-a3d7f424-0f77-4ed1-955d-47872cf9cce0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041329 Oct 27 19:35:20.724887 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3442/7031] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:35:21.183390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-439c4f40-4e16-4f8c-95a9-6b2cd97818eb tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:21.184177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-439c4f40-4e16-4f8c-95a9-6b2cd97818eb tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] [instance: bc46f87f-7f86-4e4b-892f-8e7d4d2c0605] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:21.191536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-439c4f40-4e16-4f8c-95a9-6b2cd97818eb tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:21.192037 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-439c4f40-4e16-4f8c-95a9-6b2cd97818eb tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:21.192486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-439c4f40-4e16-4f8c-95a9-6b2cd97818eb tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:21.193191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-439c4f40-4e16-4f8c-95a9-6b2cd97818eb tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:21.193845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-439c4f40-4e16-4f8c-95a9-6b2cd97818eb tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:21.194283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-439c4f40-4e16-4f8c-95a9-6b2cd97818eb tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:21.210119 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-439c4f40-4e16-4f8c-95a9-6b2cd97818eb tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] HTTP exception thrown: Instance bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 could not be found. Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-439c4f40-4e16-4f8c-95a9-6b2cd97818eb tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Request method failure captured: Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 HTTP/1.1 Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt1nrVr_V4FxWqYuL2PPoP_dvqj_qUpUkqQaYNEadGY6FOdi6DZWaGrhXyYUBO_1Q2Tluw8WsaB1b296Fe6JCbXUl1AopCAAgBrMbHCrElc5MT84_L9oFdHtqOF_WS2nQvrgwjuQT13ZQOt6dx3iHUvA5wXA3IDQIb3fmpLLOUwBRow Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ede1473158f24f25b5fadec8cd9b531e Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1518882899 Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ede1473158f24f25b5fadec8cd9b531e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ede1473158f24f25b5fadec8cd9b531e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ede1473158f24f25b5fadec8cd9b531e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ede1473158f24f25b5fadec8cd9b531e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1518882899 Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ede1473158f24f25b5fadec8cd9b531e Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1518882899 Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersAdminNegativeTestJSON-1518882899-project Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 0116ab0be20d427f9564c8189f9eae18 Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1518882899-project Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 could not be found. Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'bc46f87f-7f86-4e4b-892f-8e7d4d2c0605'} Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 could not be found. Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 could not be found. Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:35:21.211841 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:35:21.217362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:35:21.217362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:35:21.217362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:35:21.217362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:35:21.217362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:35:21.217362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:35:21.217362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 could not be found. Oct 27 19:35:21.217362 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:35:21.217362 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-439c4f40-4e16-4f8c-95a9-6b2cd97818eb tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] Returning 404 to user: Instance bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:35:21.217362 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-439c4f40-4e16-4f8c-95a9-6b2cd97818eb tempest-ServersAdminNegativeTestJSON-1518882899 tempest-ServersAdminNegativeTestJSON-1518882899-project] 10.222.0.42 "GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605" status: 404 len: 111 microversion: 2.1 time: 0.034009 Oct 27 19:35:21.217362 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3590/7032] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:21 2022] GET /compute/v2.1/servers/bc46f87f-7f86-4e4b-892f-8e7d4d2c0605 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:35:27.534468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-939989691", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "6098641d-be10-4edd-8d47-05051a14c0df"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:35:27.593334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] validate_networks() for [('6098641d-be10-4edd-8d47-05051a14c0df', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:35:27.977990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:35:27.978477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:35:27.978978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:35:27.979412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:35:27.979846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:35:27.990845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:27.991250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:27.991750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:27.992555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:27.993077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:27.993570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:28.013144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Getting quotas for project f1109c57e50a40d29f95f2126dad0a6e. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:35:28.018978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Getting quotas for user 77c2fb3631b64b6ebd902fcea96c8ab6 and project f1109c57e50a40d29f95f2126dad0a6e. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:35:28.032492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:35:28.035127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:35:28.084350 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b28e4c13-c56a-4a88-a205-06bce0f88ecb tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688574 Oct 27 19:35:28.085021 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3443/7033] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:35:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:35:28.096758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7f8abac5-93d6-4c64-8b6e-ddef0d289ea7 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:28.097387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7f8abac5-93d6-4c64-8b6e-ddef0d289ea7 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:28.100168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:28.164068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7f8abac5-93d6-4c64-8b6e-ddef0d289ea7 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:28.173394 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7f8abac5-93d6-4c64-8b6e-ddef0d289ea7 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1214 microversion: 2.1 time: 0.080538 Oct 27 19:35:28.174213 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3591/7034] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:28 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:29.198470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c0836c99-a382-41e4-b84d-4c3ac979011e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:29.199920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c0836c99-a382-41e4-b84d-4c3ac979011e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:29.207897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0836c99-a382-41e4-b84d-4c3ac979011e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:29.208412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0836c99-a382-41e4-b84d-4c3ac979011e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:29.208948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0836c99-a382-41e4-b84d-4c3ac979011e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:29.209683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0836c99-a382-41e4-b84d-4c3ac979011e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:29.210164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0836c99-a382-41e4-b84d-4c3ac979011e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:29.210697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0836c99-a382-41e4-b84d-4c3ac979011e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:29.287424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c0836c99-a382-41e4-b84d-4c3ac979011e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:29.298430 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c0836c99-a382-41e4-b84d-4c3ac979011e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1266 microversion: 2.1 time: 0.104642 Oct 27 19:35:29.299264 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3444/7035] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:29 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:30.326008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a287d8ba-aadd-41e9-9f03-dbf6d5a20941 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:30.326662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a287d8ba-aadd-41e9-9f03-dbf6d5a20941 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:30.328629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:30.335949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a287d8ba-aadd-41e9-9f03-dbf6d5a20941 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:30.336370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a287d8ba-aadd-41e9-9f03-dbf6d5a20941 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:30.337056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a287d8ba-aadd-41e9-9f03-dbf6d5a20941 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:30.337941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a287d8ba-aadd-41e9-9f03-dbf6d5a20941 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:30.338438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a287d8ba-aadd-41e9-9f03-dbf6d5a20941 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:30.338887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a287d8ba-aadd-41e9-9f03-dbf6d5a20941 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:30.619887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a287d8ba-aadd-41e9-9f03-dbf6d5a20941 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:30.629593 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a287d8ba-aadd-41e9-9f03-dbf6d5a20941 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1314 microversion: 2.1 time: 0.308531 Oct 27 19:35:30.630982 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3592/7036] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:30 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:31.035881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-34e8c5e6-abc8-4347-ae2b-ea8981e411cc req-d2f78dcf-8476-4af5-91f7-4e30a333cf51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6856362-9f52-4eec-b999-b1a77c7e9427", "tag": "e6bc93f5-fe0e-4b52-ae61-79f64d89ce26"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:35:31.047973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-34e8c5e6-abc8-4347-ae2b-ea8981e411cc req-d2f78dcf-8476-4af5-91f7-4e30a333cf51 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:31.048519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-34e8c5e6-abc8-4347-ae2b-ea8981e411cc req-d2f78dcf-8476-4af5-91f7-4e30a333cf51 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:31.049050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-34e8c5e6-abc8-4347-ae2b-ea8981e411cc req-d2f78dcf-8476-4af5-91f7-4e30a333cf51 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:31.066616 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-34e8c5e6-abc8-4347-ae2b-ea8981e411cc req-d2f78dcf-8476-4af5-91f7-4e30a333cf51 service nova] Creating event network-changed:e6bc93f5-fe0e-4b52-ae61-79f64d89ce26 for instance e6856362-9f52-4eec-b999-b1a77c7e9427 on n-h2-860687-3 Oct 27 19:35:31.072062 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-34e8c5e6-abc8-4347-ae2b-ea8981e411cc req-d2f78dcf-8476-4af5-91f7-4e30a333cf51 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040662 Oct 27 19:35:31.072893 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3445/7037] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:35:31.656294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d3ea681b-999a-4ee2-aa1c-3029e2ea28e9 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:31.656916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d3ea681b-999a-4ee2-aa1c-3029e2ea28e9 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:31.664355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ea681b-999a-4ee2-aa1c-3029e2ea28e9 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:31.664851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ea681b-999a-4ee2-aa1c-3029e2ea28e9 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:31.665302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ea681b-999a-4ee2-aa1c-3029e2ea28e9 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:31.666007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ea681b-999a-4ee2-aa1c-3029e2ea28e9 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:31.666497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ea681b-999a-4ee2-aa1c-3029e2ea28e9 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:31.666944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d3ea681b-999a-4ee2-aa1c-3029e2ea28e9 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:31.813297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d3ea681b-999a-4ee2-aa1c-3029e2ea28e9 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:31.821412 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d3ea681b-999a-4ee2-aa1c-3029e2ea28e9 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1314 microversion: 2.1 time: 0.169892 Oct 27 19:35:31.821986 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3593/7038] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:31 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:32.846022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e64b0c86-e0cd-4123-a3a4-f4d2285d9fc2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:32.846803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e64b0c86-e0cd-4123-a3a4-f4d2285d9fc2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:32.852952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e64b0c86-e0cd-4123-a3a4-f4d2285d9fc2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:32.853454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e64b0c86-e0cd-4123-a3a4-f4d2285d9fc2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:32.853914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e64b0c86-e0cd-4123-a3a4-f4d2285d9fc2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:32.854652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e64b0c86-e0cd-4123-a3a4-f4d2285d9fc2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:32.855179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e64b0c86-e0cd-4123-a3a4-f4d2285d9fc2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:32.855671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e64b0c86-e0cd-4123-a3a4-f4d2285d9fc2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:33.309983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e64b0c86-e0cd-4123-a3a4-f4d2285d9fc2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:33.317914 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e64b0c86-e0cd-4123-a3a4-f4d2285d9fc2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1314 microversion: 2.1 time: 0.477040 Oct 27 19:35:33.318507 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3446/7039] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:32 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:34.342001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-670ef5e8-6746-49fa-844d-74d369369a11 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:34.342670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-670ef5e8-6746-49fa-844d-74d369369a11 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:34.345289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:34.350540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-670ef5e8-6746-49fa-844d-74d369369a11 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:34.351027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-670ef5e8-6746-49fa-844d-74d369369a11 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:34.351465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-670ef5e8-6746-49fa-844d-74d369369a11 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:34.352184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-670ef5e8-6746-49fa-844d-74d369369a11 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:34.352640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-670ef5e8-6746-49fa-844d-74d369369a11 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:34.353069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-670ef5e8-6746-49fa-844d-74d369369a11 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:34.358849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:34.492956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-670ef5e8-6746-49fa-844d-74d369369a11 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:34.500712 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-670ef5e8-6746-49fa-844d-74d369369a11 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1314 microversion: 2.1 time: 0.163727 Oct 27 19:35:34.501284 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3594/7040] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:34 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:35.523635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-25a63318-22e1-46d6-9fb4-e03b3118571b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:35.524208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-25a63318-22e1-46d6-9fb4-e03b3118571b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:35.531686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25a63318-22e1-46d6-9fb4-e03b3118571b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:35.532187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25a63318-22e1-46d6-9fb4-e03b3118571b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:35.532637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25a63318-22e1-46d6-9fb4-e03b3118571b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:35.533542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25a63318-22e1-46d6-9fb4-e03b3118571b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:35.534005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25a63318-22e1-46d6-9fb4-e03b3118571b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:35.534485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25a63318-22e1-46d6-9fb4-e03b3118571b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:35.670460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-25a63318-22e1-46d6-9fb4-e03b3118571b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:35.678374 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-25a63318-22e1-46d6-9fb4-e03b3118571b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1314 microversion: 2.1 time: 0.158733 Oct 27 19:35:35.679013 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3447/7041] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:35 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:36.703482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bc80dd03-041e-4a9f-b374-1c7a283931b4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:36.704010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bc80dd03-041e-4a9f-b374-1c7a283931b4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:36.710870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc80dd03-041e-4a9f-b374-1c7a283931b4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:36.711365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc80dd03-041e-4a9f-b374-1c7a283931b4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:36.711813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc80dd03-041e-4a9f-b374-1c7a283931b4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:36.712520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc80dd03-041e-4a9f-b374-1c7a283931b4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:36.712983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc80dd03-041e-4a9f-b374-1c7a283931b4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:36.713420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc80dd03-041e-4a9f-b374-1c7a283931b4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:36.842970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bc80dd03-041e-4a9f-b374-1c7a283931b4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:36.850712 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bc80dd03-041e-4a9f-b374-1c7a283931b4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1314 microversion: 2.1 time: 0.151317 Oct 27 19:35:36.851284 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3595/7042] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:36 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:37.873800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fcb8ce68-70e3-42fb-b15e-305c83a2aca6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:37.874452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fcb8ce68-70e3-42fb-b15e-305c83a2aca6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:37.877017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:37.882332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcb8ce68-70e3-42fb-b15e-305c83a2aca6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:37.882879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcb8ce68-70e3-42fb-b15e-305c83a2aca6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:37.883333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcb8ce68-70e3-42fb-b15e-305c83a2aca6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:37.884041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcb8ce68-70e3-42fb-b15e-305c83a2aca6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:37.884510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcb8ce68-70e3-42fb-b15e-305c83a2aca6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:37.884952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fcb8ce68-70e3-42fb-b15e-305c83a2aca6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:37.889633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=76 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:38.002583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=5 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:38.022639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fcb8ce68-70e3-42fb-b15e-305c83a2aca6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:38.026006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:38.031445 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fcb8ce68-70e3-42fb-b15e-305c83a2aca6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1314 microversion: 2.1 time: 0.162026 Oct 27 19:35:38.032031 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3448/7043] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:37 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:35:38.298871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-2d522e10-9265-4d2e-b20c-10a6dcebe833 req-ef0a3ef1-f68b-40dc-bdfe-decaafaf3dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6856362-9f52-4eec-b999-b1a77c7e9427", "name": "network-vif-plugged", "status": "completed", "tag": "e6bc93f5-fe0e-4b52-ae61-79f64d89ce26"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:35:38.307016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:35:38.312610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2d522e10-9265-4d2e-b20c-10a6dcebe833 req-ef0a3ef1-f68b-40dc-bdfe-decaafaf3dd1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:38.313176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2d522e10-9265-4d2e-b20c-10a6dcebe833 req-ef0a3ef1-f68b-40dc-bdfe-decaafaf3dd1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:38.313688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2d522e10-9265-4d2e-b20c-10a6dcebe833 req-ef0a3ef1-f68b-40dc-bdfe-decaafaf3dd1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:38.326795 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-2d522e10-9265-4d2e-b20c-10a6dcebe833 req-ef0a3ef1-f68b-40dc-bdfe-decaafaf3dd1 service nova] Creating event network-vif-plugged:e6bc93f5-fe0e-4b52-ae61-79f64d89ce26 for instance e6856362-9f52-4eec-b999-b1a77c7e9427 on n-h2-860687-3 Oct 27 19:35:38.331899 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-2d522e10-9265-4d2e-b20c-10a6dcebe833 req-ef0a3ef1-f68b-40dc-bdfe-decaafaf3dd1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036805 Oct 27 19:35:38.332495 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3596/7044] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:35:39.054653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-798e3aa0-5c3a-40ae-b12c-dbdf578d884a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:39.055193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-798e3aa0-5c3a-40ae-b12c-dbdf578d884a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:39.063228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-798e3aa0-5c3a-40ae-b12c-dbdf578d884a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:39.063731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-798e3aa0-5c3a-40ae-b12c-dbdf578d884a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:39.064448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-798e3aa0-5c3a-40ae-b12c-dbdf578d884a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:39.065155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-798e3aa0-5c3a-40ae-b12c-dbdf578d884a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:39.065628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-798e3aa0-5c3a-40ae-b12c-dbdf578d884a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:39.066073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-798e3aa0-5c3a-40ae-b12c-dbdf578d884a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:39.194931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-798e3aa0-5c3a-40ae-b12c-dbdf578d884a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:39.203414 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-798e3aa0-5c3a-40ae-b12c-dbdf578d884a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1314 microversion: 2.1 time: 0.152903 Oct 27 19:35:39.203994 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3449/7045] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:39 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:40.228220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9fab0370-faf5-449e-868d-5851d4ec3601 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:40.228844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9fab0370-faf5-449e-868d-5851d4ec3601 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:40.235540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fab0370-faf5-449e-868d-5851d4ec3601 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:40.236029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fab0370-faf5-449e-868d-5851d4ec3601 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:40.236470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fab0370-faf5-449e-868d-5851d4ec3601 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:40.237164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fab0370-faf5-449e-868d-5851d4ec3601 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:40.237628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fab0370-faf5-449e-868d-5851d4ec3601 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:40.238082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9fab0370-faf5-449e-868d-5851d4ec3601 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:40.372691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9fab0370-faf5-449e-868d-5851d4ec3601 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:40.380472 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9fab0370-faf5-449e-868d-5851d4ec3601 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1502 microversion: 2.1 time: 0.157465 Oct 27 19:35:40.381040 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3597/7046] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:40 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:40.403473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:35:40.405787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:40.412532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:40.413030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:40.413485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:40.414189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:40.414688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:40.415135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:40.443256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:40.450210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Old instance type m1.heat2, new instance type m1.heat {{(pid=127028) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 19:35:40.456927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:35:40.457362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:35:40.457852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:35:40.458273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:35:40.458722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:35:40.519707 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a928ea88-b6f6-48e7-9ac2-18c10b10df81 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "POST /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427/action" status: 202 len: 0 microversion: 2.1 time: 0.120219 Oct 27 19:35:40.520454 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3450/7047] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:35:40 2022] POST /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:35:40.529414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fdda5f51-1afe-48c8-b7b7-4c7ef49f0250 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:40.530040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fdda5f51-1afe-48c8-b7b7-4c7ef49f0250 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:40.536550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fdda5f51-1afe-48c8-b7b7-4c7ef49f0250 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:40.537057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fdda5f51-1afe-48c8-b7b7-4c7ef49f0250 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:40.537565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fdda5f51-1afe-48c8-b7b7-4c7ef49f0250 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:40.538319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fdda5f51-1afe-48c8-b7b7-4c7ef49f0250 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:40.538828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fdda5f51-1afe-48c8-b7b7-4c7ef49f0250 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:40.539270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fdda5f51-1afe-48c8-b7b7-4c7ef49f0250 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:40.707537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fdda5f51-1afe-48c8-b7b7-4c7ef49f0250 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:40.715670 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fdda5f51-1afe-48c8-b7b7-4c7ef49f0250 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1511 microversion: 2.1 time: 0.190699 Oct 27 19:35:40.716254 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3598/7048] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:40 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:41.740080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-969f0026-7280-41fa-899e-4d9418a6c46d tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:41.740739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-969f0026-7280-41fa-899e-4d9418a6c46d tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:41.750194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-969f0026-7280-41fa-899e-4d9418a6c46d tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:41.750734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-969f0026-7280-41fa-899e-4d9418a6c46d tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:41.751190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-969f0026-7280-41fa-899e-4d9418a6c46d tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:41.751895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-969f0026-7280-41fa-899e-4d9418a6c46d tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:41.752363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-969f0026-7280-41fa-899e-4d9418a6c46d tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:41.752805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-969f0026-7280-41fa-899e-4d9418a6c46d tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:41.886022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-969f0026-7280-41fa-899e-4d9418a6c46d tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:41.894141 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-969f0026-7280-41fa-899e-4d9418a6c46d tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1511 microversion: 2.1 time: 0.159250 Oct 27 19:35:41.894778 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3451/7049] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:41 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:42.918576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d89db2cc-3ff0-4992-b349-1acc02e0b44a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:42.919196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d89db2cc-3ff0-4992-b349-1acc02e0b44a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:42.926002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d89db2cc-3ff0-4992-b349-1acc02e0b44a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:42.926521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d89db2cc-3ff0-4992-b349-1acc02e0b44a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:42.926971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d89db2cc-3ff0-4992-b349-1acc02e0b44a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:42.927670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d89db2cc-3ff0-4992-b349-1acc02e0b44a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:42.928131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d89db2cc-3ff0-4992-b349-1acc02e0b44a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:42.928565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d89db2cc-3ff0-4992-b349-1acc02e0b44a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:43.062457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d89db2cc-3ff0-4992-b349-1acc02e0b44a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:43.070442 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d89db2cc-3ff0-4992-b349-1acc02e0b44a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.156453 Oct 27 19:35:43.071016 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3599/7050] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:42 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:44.094118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ec349bd-488d-4e6d-9fc4-075dad8275cc tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:44.094773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ec349bd-488d-4e6d-9fc4-075dad8275cc tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:44.101998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ec349bd-488d-4e6d-9fc4-075dad8275cc tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:44.102535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ec349bd-488d-4e6d-9fc4-075dad8275cc tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:44.102992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ec349bd-488d-4e6d-9fc4-075dad8275cc tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:44.103734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ec349bd-488d-4e6d-9fc4-075dad8275cc tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:44.104204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ec349bd-488d-4e6d-9fc4-075dad8275cc tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:44.104701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ec349bd-488d-4e6d-9fc4-075dad8275cc tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:44.236413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9ec349bd-488d-4e6d-9fc4-075dad8275cc tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:44.244306 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ec349bd-488d-4e6d-9fc4-075dad8275cc tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.154065 Oct 27 19:35:44.244888 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3452/7051] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:44 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:45.268280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3f538078-93a5-46a9-b1ae-8376b6064ab2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:45.268919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3f538078-93a5-46a9-b1ae-8376b6064ab2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:45.275701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f538078-93a5-46a9-b1ae-8376b6064ab2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:45.276195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f538078-93a5-46a9-b1ae-8376b6064ab2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:45.277251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f538078-93a5-46a9-b1ae-8376b6064ab2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:45.277954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f538078-93a5-46a9-b1ae-8376b6064ab2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:45.278446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f538078-93a5-46a9-b1ae-8376b6064ab2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:45.278885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f538078-93a5-46a9-b1ae-8376b6064ab2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:45.409350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3f538078-93a5-46a9-b1ae-8376b6064ab2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:45.417117 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3f538078-93a5-46a9-b1ae-8376b6064ab2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.152739 Oct 27 19:35:45.417800 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3600/7052] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:45 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:46.440722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ee643679-9cb7-45b3-92ad-79c044c4450a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:46.441365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ee643679-9cb7-45b3-92ad-79c044c4450a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:46.448309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee643679-9cb7-45b3-92ad-79c044c4450a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:46.449009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee643679-9cb7-45b3-92ad-79c044c4450a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:46.449473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee643679-9cb7-45b3-92ad-79c044c4450a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:46.450197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee643679-9cb7-45b3-92ad-79c044c4450a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:46.450711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee643679-9cb7-45b3-92ad-79c044c4450a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:46.451179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ee643679-9cb7-45b3-92ad-79c044c4450a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:46.585641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ee643679-9cb7-45b3-92ad-79c044c4450a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:46.594089 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ee643679-9cb7-45b3-92ad-79c044c4450a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.157635 Oct 27 19:35:46.594824 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3453/7053] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:46 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:47.617127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e181b680-aa9b-49d5-b8fa-2093e3311da7 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:47.617741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e181b680-aa9b-49d5-b8fa-2093e3311da7 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:47.625279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e181b680-aa9b-49d5-b8fa-2093e3311da7 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:47.625764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e181b680-aa9b-49d5-b8fa-2093e3311da7 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:47.626204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e181b680-aa9b-49d5-b8fa-2093e3311da7 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:47.626918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e181b680-aa9b-49d5-b8fa-2093e3311da7 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:47.627374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e181b680-aa9b-49d5-b8fa-2093e3311da7 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:47.627799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e181b680-aa9b-49d5-b8fa-2093e3311da7 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:47.756930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e181b680-aa9b-49d5-b8fa-2093e3311da7 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:47.764759 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e181b680-aa9b-49d5-b8fa-2093e3311da7 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.151574 Oct 27 19:35:47.765325 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3601/7054] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:47 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:48.787179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a0a3903b-5eab-4bdd-893f-9c357974791b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:48.787815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a0a3903b-5eab-4bdd-893f-9c357974791b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:48.795544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0a3903b-5eab-4bdd-893f-9c357974791b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:48.796058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0a3903b-5eab-4bdd-893f-9c357974791b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:48.796525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0a3903b-5eab-4bdd-893f-9c357974791b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:48.797255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0a3903b-5eab-4bdd-893f-9c357974791b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:48.797736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0a3903b-5eab-4bdd-893f-9c357974791b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:48.798233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0a3903b-5eab-4bdd-893f-9c357974791b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:48.929548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0a3903b-5eab-4bdd-893f-9c357974791b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:48.938045 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a0a3903b-5eab-4bdd-893f-9c357974791b tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.154738 Oct 27 19:35:48.938576 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3454/7055] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:48 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:49.961450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a9651626-4896-4532-a8eb-a4b5e71acae6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:49.962070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a9651626-4896-4532-a8eb-a4b5e71acae6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:49.969985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9651626-4896-4532-a8eb-a4b5e71acae6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:49.970508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9651626-4896-4532-a8eb-a4b5e71acae6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:49.970952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9651626-4896-4532-a8eb-a4b5e71acae6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:49.971651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9651626-4896-4532-a8eb-a4b5e71acae6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:49.972110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9651626-4896-4532-a8eb-a4b5e71acae6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:49.972549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9651626-4896-4532-a8eb-a4b5e71acae6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:50.107379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a9651626-4896-4532-a8eb-a4b5e71acae6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:50.115206 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a9651626-4896-4532-a8eb-a4b5e71acae6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.157699 Oct 27 19:35:50.115787 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3602/7056] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:49 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:51.139840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ed6a0933-8a83-4da7-abc1-038483145215 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:51.140472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ed6a0933-8a83-4da7-abc1-038483145215 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:51.147239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed6a0933-8a83-4da7-abc1-038483145215 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:51.147745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed6a0933-8a83-4da7-abc1-038483145215 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:51.148201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed6a0933-8a83-4da7-abc1-038483145215 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:51.148911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed6a0933-8a83-4da7-abc1-038483145215 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:51.149386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed6a0933-8a83-4da7-abc1-038483145215 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:51.149832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed6a0933-8a83-4da7-abc1-038483145215 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:51.281060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ed6a0933-8a83-4da7-abc1-038483145215 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:51.288860 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ed6a0933-8a83-4da7-abc1-038483145215 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.153589 Oct 27 19:35:51.289434 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3455/7057] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:51 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:52.313293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4ee3e2a9-addf-4e29-a3b1-f73d088f946e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:52.314183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4ee3e2a9-addf-4e29-a3b1-f73d088f946e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:52.325022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee3e2a9-addf-4e29-a3b1-f73d088f946e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:52.325758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee3e2a9-addf-4e29-a3b1-f73d088f946e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:52.326198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee3e2a9-addf-4e29-a3b1-f73d088f946e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:52.326933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee3e2a9-addf-4e29-a3b1-f73d088f946e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:52.327433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee3e2a9-addf-4e29-a3b1-f73d088f946e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:52.327866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ee3e2a9-addf-4e29-a3b1-f73d088f946e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:52.460894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4ee3e2a9-addf-4e29-a3b1-f73d088f946e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:52.469235 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4ee3e2a9-addf-4e29-a3b1-f73d088f946e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.160778 Oct 27 19:35:52.469801 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3603/7058] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:52 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:53.492379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd2b87b0-fb4f-453f-9cb2-c06849323e30 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:53.493014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bd2b87b0-fb4f-453f-9cb2-c06849323e30 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:53.499841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2b87b0-fb4f-453f-9cb2-c06849323e30 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:53.500350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2b87b0-fb4f-453f-9cb2-c06849323e30 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:53.500807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2b87b0-fb4f-453f-9cb2-c06849323e30 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:53.501518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2b87b0-fb4f-453f-9cb2-c06849323e30 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:53.501993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2b87b0-fb4f-453f-9cb2-c06849323e30 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:53.502468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd2b87b0-fb4f-453f-9cb2-c06849323e30 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:53.636361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bd2b87b0-fb4f-453f-9cb2-c06849323e30 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:53.644128 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bd2b87b0-fb4f-453f-9cb2-c06849323e30 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.155664 Oct 27 19:35:53.644702 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3456/7059] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:53 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:54.670661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ab198419-75dc-4fb1-a074-695e29cd0a4a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:54.671255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ab198419-75dc-4fb1-a074-695e29cd0a4a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:54.678114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab198419-75dc-4fb1-a074-695e29cd0a4a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:54.678645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab198419-75dc-4fb1-a074-695e29cd0a4a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:54.679099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab198419-75dc-4fb1-a074-695e29cd0a4a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:54.679807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab198419-75dc-4fb1-a074-695e29cd0a4a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:54.680275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab198419-75dc-4fb1-a074-695e29cd0a4a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:54.680712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab198419-75dc-4fb1-a074-695e29cd0a4a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:54.813475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ab198419-75dc-4fb1-a074-695e29cd0a4a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:54.821575 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ab198419-75dc-4fb1-a074-695e29cd0a4a tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.155734 Oct 27 19:35:54.822158 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3604/7060] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:54 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:55.845212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-27501ade-d7d7-4bc8-a1e5-5f00aba72f3c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:55.845869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-27501ade-d7d7-4bc8-a1e5-5f00aba72f3c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:55.855418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27501ade-d7d7-4bc8-a1e5-5f00aba72f3c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:55.855929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27501ade-d7d7-4bc8-a1e5-5f00aba72f3c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:55.856391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27501ade-d7d7-4bc8-a1e5-5f00aba72f3c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:55.857105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27501ade-d7d7-4bc8-a1e5-5f00aba72f3c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:55.857576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27501ade-d7d7-4bc8-a1e5-5f00aba72f3c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:55.858019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27501ade-d7d7-4bc8-a1e5-5f00aba72f3c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:55.992396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-27501ade-d7d7-4bc8-a1e5-5f00aba72f3c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:56.000547 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-27501ade-d7d7-4bc8-a1e5-5f00aba72f3c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.159223 Oct 27 19:35:56.001117 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3457/7061] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:55 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:57.023727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7b55f057-8ae3-40e1-a9ed-8bddf487cbb2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:57.024346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7b55f057-8ae3-40e1-a9ed-8bddf487cbb2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:57.027730 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 19:35:57.027863 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 19:35:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 (ip 10.222.0.42) !!! Oct 27 19:35:57.037934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b55f057-8ae3-40e1-a9ed-8bddf487cbb2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:57.038496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b55f057-8ae3-40e1-a9ed-8bddf487cbb2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:57.038946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b55f057-8ae3-40e1-a9ed-8bddf487cbb2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:57.039657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b55f057-8ae3-40e1-a9ed-8bddf487cbb2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:57.040149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b55f057-8ae3-40e1-a9ed-8bddf487cbb2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:57.040583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b55f057-8ae3-40e1-a9ed-8bddf487cbb2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:57.170406 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7b55f057-8ae3-40e1-a9ed-8bddf487cbb2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:57.178187 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7b55f057-8ae3-40e1-a9ed-8bddf487cbb2 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.158547 Oct 27 19:35:57.178791 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3605/7062] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:57 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:58.202781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-665b9ed2-0538-414f-9fd6-d2e80d2609f8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:58.203418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-665b9ed2-0538-414f-9fd6-d2e80d2609f8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:58.210945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-665b9ed2-0538-414f-9fd6-d2e80d2609f8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:58.211451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-665b9ed2-0538-414f-9fd6-d2e80d2609f8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:58.211910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-665b9ed2-0538-414f-9fd6-d2e80d2609f8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:58.212625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-665b9ed2-0538-414f-9fd6-d2e80d2609f8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:58.213097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-665b9ed2-0538-414f-9fd6-d2e80d2609f8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:58.214058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-665b9ed2-0538-414f-9fd6-d2e80d2609f8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:58.345796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-665b9ed2-0538-414f-9fd6-d2e80d2609f8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:58.353538 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-665b9ed2-0538-414f-9fd6-d2e80d2609f8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.155349 Oct 27 19:35:58.354176 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3458/7063] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:58 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:35:59.377725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a3128e70-46e7-4d01-9f33-829e13774444 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:35:59.378349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a3128e70-46e7-4d01-9f33-829e13774444 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:35:59.385051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3128e70-46e7-4d01-9f33-829e13774444 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:59.385549 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3128e70-46e7-4d01-9f33-829e13774444 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:59.386067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3128e70-46e7-4d01-9f33-829e13774444 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:59.386717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3128e70-46e7-4d01-9f33-829e13774444 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:35:59.387178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3128e70-46e7-4d01-9f33-829e13774444 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:35:59.387614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3128e70-46e7-4d01-9f33-829e13774444 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:35:59.520986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a3128e70-46e7-4d01-9f33-829e13774444 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:35:59.529199 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a3128e70-46e7-4d01-9f33-829e13774444 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.155486 Oct 27 19:35:59.529765 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3606/7064] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:35:59 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:00.552882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-37e3d642-6951-498b-abc8-a38ed7c6d4f0 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:00.553507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-37e3d642-6951-498b-abc8-a38ed7c6d4f0 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:00.561013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e3d642-6951-498b-abc8-a38ed7c6d4f0 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:00.561518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e3d642-6951-498b-abc8-a38ed7c6d4f0 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:00.561974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e3d642-6951-498b-abc8-a38ed7c6d4f0 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:00.562711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e3d642-6951-498b-abc8-a38ed7c6d4f0 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:00.563182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e3d642-6951-498b-abc8-a38ed7c6d4f0 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:00.563625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e3d642-6951-498b-abc8-a38ed7c6d4f0 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:00.693730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-37e3d642-6951-498b-abc8-a38ed7c6d4f0 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:00.701911 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-37e3d642-6951-498b-abc8-a38ed7c6d4f0 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.152914 Oct 27 19:36:00.702510 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3459/7065] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:00 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:01.725766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b9687d80-b988-4320-8621-7bc7aea70504 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:01.726405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b9687d80-b988-4320-8621-7bc7aea70504 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:01.733993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9687d80-b988-4320-8621-7bc7aea70504 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:01.734521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9687d80-b988-4320-8621-7bc7aea70504 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:01.734968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9687d80-b988-4320-8621-7bc7aea70504 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:01.735668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9687d80-b988-4320-8621-7bc7aea70504 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:01.736131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9687d80-b988-4320-8621-7bc7aea70504 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:01.736567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9687d80-b988-4320-8621-7bc7aea70504 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:01.867679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b9687d80-b988-4320-8621-7bc7aea70504 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:01.876581 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b9687d80-b988-4320-8621-7bc7aea70504 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.154734 Oct 27 19:36:01.877161 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3607/7066] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:01 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:36:02.900015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2ae268f5-2f53-4a99-9c3b-9777ad1782fe tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:02.900646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2ae268f5-2f53-4a99-9c3b-9777ad1782fe tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:02.908015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ae268f5-2f53-4a99-9c3b-9777ad1782fe tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:02.908519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ae268f5-2f53-4a99-9c3b-9777ad1782fe tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:02.908975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ae268f5-2f53-4a99-9c3b-9777ad1782fe tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:02.909680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ae268f5-2f53-4a99-9c3b-9777ad1782fe tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:02.910152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ae268f5-2f53-4a99-9c3b-9777ad1782fe tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:02.910627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ae268f5-2f53-4a99-9c3b-9777ad1782fe tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:03.044908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2ae268f5-2f53-4a99-9c3b-9777ad1782fe tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:03.052626 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2ae268f5-2f53-4a99-9c3b-9777ad1782fe tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.156602 Oct 27 19:36:03.053193 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3460/7067] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:02 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:04.076573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-977d9797-5b38-4b1f-bf1b-a9b71b5c3066 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:04.077222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-977d9797-5b38-4b1f-bf1b-a9b71b5c3066 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:04.084100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-977d9797-5b38-4b1f-bf1b-a9b71b5c3066 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:04.084590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-977d9797-5b38-4b1f-bf1b-a9b71b5c3066 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:04.085033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-977d9797-5b38-4b1f-bf1b-a9b71b5c3066 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:04.085728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-977d9797-5b38-4b1f-bf1b-a9b71b5c3066 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:04.086186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-977d9797-5b38-4b1f-bf1b-a9b71b5c3066 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:04.086649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-977d9797-5b38-4b1f-bf1b-a9b71b5c3066 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:04.216320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-977d9797-5b38-4b1f-bf1b-a9b71b5c3066 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:04.224006 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-977d9797-5b38-4b1f-bf1b-a9b71b5c3066 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.152212 Oct 27 19:36:04.224579 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3608/7068] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:04 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:05.247841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-87cf5135-230d-4b85-be17-b63479ecd150 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:05.248497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-87cf5135-230d-4b85-be17-b63479ecd150 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:05.255342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87cf5135-230d-4b85-be17-b63479ecd150 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:05.255846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87cf5135-230d-4b85-be17-b63479ecd150 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:05.256302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87cf5135-230d-4b85-be17-b63479ecd150 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:05.257009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87cf5135-230d-4b85-be17-b63479ecd150 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:05.257483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87cf5135-230d-4b85-be17-b63479ecd150 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:05.257930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87cf5135-230d-4b85-be17-b63479ecd150 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:05.386863 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-87cf5135-230d-4b85-be17-b63479ecd150 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:05.394665 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-87cf5135-230d-4b85-be17-b63479ecd150 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.150759 Oct 27 19:36:05.395234 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3461/7069] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:05 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:06.419018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-505b9bf2-424a-4e2f-b422-beb79995273e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:06.419649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-505b9bf2-424a-4e2f-b422-beb79995273e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:06.422360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=30 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:36:06.427697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-505b9bf2-424a-4e2f-b422-beb79995273e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:06.428171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-505b9bf2-424a-4e2f-b422-beb79995273e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:06.428619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-505b9bf2-424a-4e2f-b422-beb79995273e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:06.429320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-505b9bf2-424a-4e2f-b422-beb79995273e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:06.429785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-505b9bf2-424a-4e2f-b422-beb79995273e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:06.430222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-505b9bf2-424a-4e2f-b422-beb79995273e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:06.432974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=86 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:36:06.562838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-505b9bf2-424a-4e2f-b422-beb79995273e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:06.570977 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-505b9bf2-424a-4e2f-b422-beb79995273e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.156813 Oct 27 19:36:06.571552 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3609/7070] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:06 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:07.594869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9515d354-76f4-46b9-99e3-37b65a0a9bb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:07.595503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9515d354-76f4-46b9-99e3-37b65a0a9bb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:07.602184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9515d354-76f4-46b9-99e3-37b65a0a9bb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:07.602734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9515d354-76f4-46b9-99e3-37b65a0a9bb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:07.603196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9515d354-76f4-46b9-99e3-37b65a0a9bb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:07.603907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9515d354-76f4-46b9-99e3-37b65a0a9bb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:07.604386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9515d354-76f4-46b9-99e3-37b65a0a9bb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:07.604835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9515d354-76f4-46b9-99e3-37b65a0a9bb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:07.732423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9515d354-76f4-46b9-99e3-37b65a0a9bb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:07.740216 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9515d354-76f4-46b9-99e3-37b65a0a9bb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.149261 Oct 27 19:36:07.740795 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3462/7071] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:07 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:36:08.763511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a5d8257f-3dce-4076-ada2-8147bde90050 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:08.764086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a5d8257f-3dce-4076-ada2-8147bde90050 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:08.770910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5d8257f-3dce-4076-ada2-8147bde90050 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:08.771400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5d8257f-3dce-4076-ada2-8147bde90050 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:08.771842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5d8257f-3dce-4076-ada2-8147bde90050 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:08.772531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5d8257f-3dce-4076-ada2-8147bde90050 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:08.772987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5d8257f-3dce-4076-ada2-8147bde90050 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:08.773421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5d8257f-3dce-4076-ada2-8147bde90050 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:08.907232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a5d8257f-3dce-4076-ada2-8147bde90050 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:08.915024 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a5d8257f-3dce-4076-ada2-8147bde90050 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1516 microversion: 2.1 time: 0.155870 Oct 27 19:36:08.915590 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3610/7072] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:08 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:09.940103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-11c8b4d8-e140-4a40-86f9-e1ea36eaae5e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:09.940904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-11c8b4d8-e140-4a40-86f9-e1ea36eaae5e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:09.943803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=34 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:36:09.949499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11c8b4d8-e140-4a40-86f9-e1ea36eaae5e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:09.950024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11c8b4d8-e140-4a40-86f9-e1ea36eaae5e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:09.950552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11c8b4d8-e140-4a40-86f9-e1ea36eaae5e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:09.951291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11c8b4d8-e140-4a40-86f9-e1ea36eaae5e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:09.951784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11c8b4d8-e140-4a40-86f9-e1ea36eaae5e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:09.952235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-11c8b4d8-e140-4a40-86f9-e1ea36eaae5e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:09.955412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:36:10.099370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-11c8b4d8-e140-4a40-86f9-e1ea36eaae5e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:10.108078 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-11c8b4d8-e140-4a40-86f9-e1ea36eaae5e tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1515 microversion: 2.1 time: 0.172123 Oct 27 19:36:10.108685 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3463/7073] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:09 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:10.404404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-f9f206d9-1363-41b7-9f97-59f079a110f5 req-ea32bc01-113c-4af0-b34d-40e895811994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6856362-9f52-4eec-b999-b1a77c7e9427", "name": "network-vif-unplugged", "status": "completed", "tag": "e6bc93f5-fe0e-4b52-ae61-79f64d89ce26"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:36:10.417329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f9f206d9-1363-41b7-9f97-59f079a110f5 req-ea32bc01-113c-4af0-b34d-40e895811994 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:10.418331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f9f206d9-1363-41b7-9f97-59f079a110f5 req-ea32bc01-113c-4af0-b34d-40e895811994 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:10.418797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f9f206d9-1363-41b7-9f97-59f079a110f5 req-ea32bc01-113c-4af0-b34d-40e895811994 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:10.431406 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-f9f206d9-1363-41b7-9f97-59f079a110f5 req-ea32bc01-113c-4af0-b34d-40e895811994 service nova] Creating event network-vif-unplugged:e6bc93f5-fe0e-4b52-ae61-79f64d89ce26 for instance e6856362-9f52-4eec-b999-b1a77c7e9427 on n-h1-860687-3 Oct 27 19:36:10.438173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-f9f206d9-1363-41b7-9f97-59f079a110f5 req-ea32bc01-113c-4af0-b34d-40e895811994 service nova] Instance e6856362-9f52-4eec-b999-b1a77c7e9427 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:36:10.456085 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-f9f206d9-1363-41b7-9f97-59f079a110f5 req-ea32bc01-113c-4af0-b34d-40e895811994 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057235 Oct 27 19:36:10.456994 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3611/7074] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:36:11.133397 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b90a9796-b24a-4dc4-8fa6-9916c7737e86 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:11.134038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b90a9796-b24a-4dc4-8fa6-9916c7737e86 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:11.141946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b90a9796-b24a-4dc4-8fa6-9916c7737e86 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:11.142501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b90a9796-b24a-4dc4-8fa6-9916c7737e86 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:11.142955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b90a9796-b24a-4dc4-8fa6-9916c7737e86 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:11.143688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b90a9796-b24a-4dc4-8fa6-9916c7737e86 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:11.144164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b90a9796-b24a-4dc4-8fa6-9916c7737e86 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:11.144615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b90a9796-b24a-4dc4-8fa6-9916c7737e86 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:11.278348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b90a9796-b24a-4dc4-8fa6-9916c7737e86 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:11.286295 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b90a9796-b24a-4dc4-8fa6-9916c7737e86 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1515 microversion: 2.1 time: 0.156817 Oct 27 19:36:11.286912 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3464/7075] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:11 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:12.311784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce60525a-62af-4c93-b800-d7af00a12c71 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:12.312493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ce60525a-62af-4c93-b800-d7af00a12c71 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:12.318927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce60525a-62af-4c93-b800-d7af00a12c71 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:12.319412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce60525a-62af-4c93-b800-d7af00a12c71 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:12.319855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce60525a-62af-4c93-b800-d7af00a12c71 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:12.320546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce60525a-62af-4c93-b800-d7af00a12c71 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:12.321000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce60525a-62af-4c93-b800-d7af00a12c71 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:12.321429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce60525a-62af-4c93-b800-d7af00a12c71 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:12.454532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ce60525a-62af-4c93-b800-d7af00a12c71 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:12.462519 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce60525a-62af-4c93-b800-d7af00a12c71 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1513 microversion: 2.1 time: 0.156418 Oct 27 19:36:12.463101 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3612/7076] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:12 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:12.478904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-070fa38e-e502-45c5-b8b9-7a908595ece0 req-469c43c3-cde8-4120-a63c-01ce6b6093cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6856362-9f52-4eec-b999-b1a77c7e9427", "tag": "e6bc93f5-fe0e-4b52-ae61-79f64d89ce26"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:36:12.489217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-070fa38e-e502-45c5-b8b9-7a908595ece0 req-469c43c3-cde8-4120-a63c-01ce6b6093cb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:12.489713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-070fa38e-e502-45c5-b8b9-7a908595ece0 req-469c43c3-cde8-4120-a63c-01ce6b6093cb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:12.490162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-070fa38e-e502-45c5-b8b9-7a908595ece0 req-469c43c3-cde8-4120-a63c-01ce6b6093cb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:12.501907 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-070fa38e-e502-45c5-b8b9-7a908595ece0 req-469c43c3-cde8-4120-a63c-01ce6b6093cb service nova] Creating event network-changed:e6bc93f5-fe0e-4b52-ae61-79f64d89ce26 for instance e6856362-9f52-4eec-b999-b1a77c7e9427 on n-h1-860687-3 Oct 27 19:36:12.507131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-070fa38e-e502-45c5-b8b9-7a908595ece0 req-469c43c3-cde8-4120-a63c-01ce6b6093cb service nova] Instance e6856362-9f52-4eec-b999-b1a77c7e9427 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:36:12.518642 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-070fa38e-e502-45c5-b8b9-7a908595ece0 req-469c43c3-cde8-4120-a63c-01ce6b6093cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043717 Oct 27 19:36:12.519262 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3465/7077] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:36:13.488003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2ed84ab8-c944-4a34-8bc1-8c510e1e0e6c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:13.488611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2ed84ab8-c944-4a34-8bc1-8c510e1e0e6c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:13.495533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ed84ab8-c944-4a34-8bc1-8c510e1e0e6c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:13.496027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ed84ab8-c944-4a34-8bc1-8c510e1e0e6c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:13.496477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ed84ab8-c944-4a34-8bc1-8c510e1e0e6c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:13.497184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ed84ab8-c944-4a34-8bc1-8c510e1e0e6c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:13.497650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ed84ab8-c944-4a34-8bc1-8c510e1e0e6c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:13.498088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ed84ab8-c944-4a34-8bc1-8c510e1e0e6c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:13.632370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2ed84ab8-c944-4a34-8bc1-8c510e1e0e6c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:13.640808 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2ed84ab8-c944-4a34-8bc1-8c510e1e0e6c tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1510 microversion: 2.1 time: 0.156856 Oct 27 19:36:13.641408 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3613/7078] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:13 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:13.665015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ecfbf7d4-062d-4a39-a781-68bc090163d4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:13.665628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ecfbf7d4-062d-4a39-a781-68bc090163d4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:13.671871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecfbf7d4-062d-4a39-a781-68bc090163d4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:13.672371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecfbf7d4-062d-4a39-a781-68bc090163d4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:13.672828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecfbf7d4-062d-4a39-a781-68bc090163d4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:13.673536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecfbf7d4-062d-4a39-a781-68bc090163d4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:13.674015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecfbf7d4-062d-4a39-a781-68bc090163d4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:13.674495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecfbf7d4-062d-4a39-a781-68bc090163d4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:13.700650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ecfbf7d4-062d-4a39-a781-68bc090163d4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:36:13.749820 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.compute.api [None req-ecfbf7d4-062d-4a39-a781-68bc090163d4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Found an unconfirmed migration during delete, id: 16, status: finished Oct 27 19:36:15.127331 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ecfbf7d4-062d-4a39-a781-68bc090163d4 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 204 len: 0 microversion: 2.1 time: 1.467110 Oct 27 19:36:15.128057 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3466/7079] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:36:13 2022] DELETE /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 0 bytes in 1469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:36:15.137286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a9659047-2f6f-4569-94e6-4cfe3cec2eb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:15.137945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a9659047-2f6f-4569-94e6-4cfe3cec2eb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:15.144977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9659047-2f6f-4569-94e6-4cfe3cec2eb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:15.145468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9659047-2f6f-4569-94e6-4cfe3cec2eb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:15.145917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9659047-2f6f-4569-94e6-4cfe3cec2eb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:15.146656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9659047-2f6f-4569-94e6-4cfe3cec2eb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:15.147125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9659047-2f6f-4569-94e6-4cfe3cec2eb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:15.147563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a9659047-2f6f-4569-94e6-4cfe3cec2eb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:15.277994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a9659047-2f6f-4569-94e6-4cfe3cec2eb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:15.286657 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a9659047-2f6f-4569-94e6-4cfe3cec2eb8 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1502 microversion: 2.1 time: 0.154093 Oct 27 19:36:15.287249 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3614/7080] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:15 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:16.039087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-8a67c90f-7641-46ca-adf8-a974a7b43608 req-a723e9da-422c-49ea-b9ef-09b057b01d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6856362-9f52-4eec-b999-b1a77c7e9427", "name": "network-vif-plugged", "status": "completed", "tag": "e6bc93f5-fe0e-4b52-ae61-79f64d89ce26"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:36:16.050275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8a67c90f-7641-46ca-adf8-a974a7b43608 req-a723e9da-422c-49ea-b9ef-09b057b01d4c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:16.050815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8a67c90f-7641-46ca-adf8-a974a7b43608 req-a723e9da-422c-49ea-b9ef-09b057b01d4c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:16.051277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8a67c90f-7641-46ca-adf8-a974a7b43608 req-a723e9da-422c-49ea-b9ef-09b057b01d4c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:16.063101 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-8a67c90f-7641-46ca-adf8-a974a7b43608 req-a723e9da-422c-49ea-b9ef-09b057b01d4c service nova] Creating event network-vif-plugged:e6bc93f5-fe0e-4b52-ae61-79f64d89ce26 for instance e6856362-9f52-4eec-b999-b1a77c7e9427 on n-h1-860687-3 Oct 27 19:36:16.068140 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-8a67c90f-7641-46ca-adf8-a974a7b43608 req-a723e9da-422c-49ea-b9ef-09b057b01d4c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033195 Oct 27 19:36:16.068740 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3467/7081] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:36:16.310145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-170082cf-7722-42de-b191-0c8b2b0691a6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:16.310758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-170082cf-7722-42de-b191-0c8b2b0691a6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:16.317848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-170082cf-7722-42de-b191-0c8b2b0691a6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:16.318342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-170082cf-7722-42de-b191-0c8b2b0691a6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:16.318833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-170082cf-7722-42de-b191-0c8b2b0691a6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:16.319536 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-170082cf-7722-42de-b191-0c8b2b0691a6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:16.320002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-170082cf-7722-42de-b191-0c8b2b0691a6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:16.320441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-170082cf-7722-42de-b191-0c8b2b0691a6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:16.452286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-170082cf-7722-42de-b191-0c8b2b0691a6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c2fb3631b64b6ebd902fcea96c8ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1109c57e50a40d29f95f2126dad0a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:16.460555 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-170082cf-7722-42de-b191-0c8b2b0691a6 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 200 len: 1502 microversion: 2.1 time: 0.154537 Oct 27 19:36:16.461340 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3615/7082] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:16 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:17.037043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-e5e9f646-c3e5-4d48-a4fd-c0e7a4ee74cf req-047915eb-812a-4593-8e61-f52fae2bb670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6856362-9f52-4eec-b999-b1a77c7e9427", "name": "network-vif-deleted", "tag": "e6bc93f5-fe0e-4b52-ae61-79f64d89ce26"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:36:17.047908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e5e9f646-c3e5-4d48-a4fd-c0e7a4ee74cf req-047915eb-812a-4593-8e61-f52fae2bb670 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:17.048412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e5e9f646-c3e5-4d48-a4fd-c0e7a4ee74cf req-047915eb-812a-4593-8e61-f52fae2bb670 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:17.048859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e5e9f646-c3e5-4d48-a4fd-c0e7a4ee74cf req-047915eb-812a-4593-8e61-f52fae2bb670 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:17.061895 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-e5e9f646-c3e5-4d48-a4fd-c0e7a4ee74cf req-047915eb-812a-4593-8e61-f52fae2bb670 service nova] Creating event network-vif-deleted:e6bc93f5-fe0e-4b52-ae61-79f64d89ce26 for instance e6856362-9f52-4eec-b999-b1a77c7e9427 on n-h1-860687-3 Oct 27 19:36:17.067534 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-e5e9f646-c3e5-4d48-a4fd-c0e7a4ee74cf req-047915eb-812a-4593-8e61-f52fae2bb670 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034851 Oct 27 19:36:17.068401 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3468/7083] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:36:17.486165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a5a57ac-ce03-4066-bf92-c75e946e8d20 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:17.486730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5a5a57ac-ce03-4066-bf92-c75e946e8d20 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:17.493573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a5a57ac-ce03-4066-bf92-c75e946e8d20 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:17.494063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a5a57ac-ce03-4066-bf92-c75e946e8d20 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:17.495264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a5a57ac-ce03-4066-bf92-c75e946e8d20 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:17.496454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a5a57ac-ce03-4066-bf92-c75e946e8d20 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:17.496917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a5a57ac-ce03-4066-bf92-c75e946e8d20 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:17.497353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a5a57ac-ce03-4066-bf92-c75e946e8d20 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:17.511035 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-5a5a57ac-ce03-4066-bf92-c75e946e8d20 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] HTTP exception thrown: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a5a57ac-ce03-4066-bf92-c75e946e8d20 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Request method failure captured: Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 HTTP/1.1 Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt1_1wUB1XylHp7WP5sdsfvtULDGdAtCk8WwccyFliU0Mf3PCO-iy_RS5Hlamhpo6vISEyfQxq3NiQLE16b1l7_x5m3tXTxJB7FEWMnewEgLTcmlPZ6HSXLk8TwJ_I5xTRdB4kKIeRxWNaGzu8meUiIBXvegNqKahfa5SqLqFR9NERs Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f1109c57e50a40d29f95f2126dad0a6e Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-DeleteServersTestJSON-246580647 Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1109c57e50a40d29f95f2126dad0a6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1109c57e50a40d29f95f2126dad0a6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1109c57e50a40d29f95f2126dad0a6e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1109c57e50a40d29f95f2126dad0a6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-DeleteServersTestJSON-246580647 Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f1109c57e50a40d29f95f2126dad0a6e Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-DeleteServersTestJSON-246580647 Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-DeleteServersTestJSON-246580647-project Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 77c2fb3631b64b6ebd902fcea96c8ab6 Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-DeleteServersTestJSON-246580647-project Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'e6856362-9f52-4eec-b999-b1a77c7e9427'} Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:36:17.512697 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.517528 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:36:17.517528 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:36:17.517528 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:36:17.517528 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:36:17.517528 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:36:17.517528 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.517528 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.517528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a5a57ac-ce03-4066-bf92-c75e946e8d20 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Returning 404 to user: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:36:17.517528 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5a5a57ac-ce03-4066-bf92-c75e946e8d20 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 404 len: 111 microversion: 2.1 time: 0.032005 Oct 27 19:36:17.517528 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3616/7084] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:17 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:36:17.531100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2b528b44-c6c8-4f5e-8eed-ff94339da8ec tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:17.531732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2b528b44-c6c8-4f5e-8eed-ff94339da8ec tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:17.537856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b528b44-c6c8-4f5e-8eed-ff94339da8ec tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:17.538352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b528b44-c6c8-4f5e-8eed-ff94339da8ec tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:17.538847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b528b44-c6c8-4f5e-8eed-ff94339da8ec tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:17.539551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b528b44-c6c8-4f5e-8eed-ff94339da8ec tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:17.540018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b528b44-c6c8-4f5e-8eed-ff94339da8ec tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:17.540458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b528b44-c6c8-4f5e-8eed-ff94339da8ec tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:17.554358 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-2b528b44-c6c8-4f5e-8eed-ff94339da8ec tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] HTTP exception thrown: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2b528b44-c6c8-4f5e-8eed-ff94339da8ec tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Request method failure captured: Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 HTTP/1.1 Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt1_1wUB1XylHp7WP5sdsfvtULDGdAtCk8WwccyFliU0Mf3PCO-iy_RS5Hlamhpo6vISEyfQxq3NiQLE16b1l7_x5m3tXTxJB7FEWMnewEgLTcmlPZ6HSXLk8TwJ_I5xTRdB4kKIeRxWNaGzu8meUiIBXvegNqKahfa5SqLqFR9NERs Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: f1109c57e50a40d29f95f2126dad0a6e Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-246580647 Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1109c57e50a40d29f95f2126dad0a6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1109c57e50a40d29f95f2126dad0a6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1109c57e50a40d29f95f2126dad0a6e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1109c57e50a40d29f95f2126dad0a6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-246580647 Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: f1109c57e50a40d29f95f2126dad0a6e Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-246580647 Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-246580647-project Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 77c2fb3631b64b6ebd902fcea96c8ab6 Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-246580647-project Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'e6856362-9f52-4eec-b999-b1a77c7e9427'} Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:36:17.556041 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:36:17.560993 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.560993 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.560993 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:36:17.560993 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.560993 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:36:17.560993 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:36:17.560993 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:36:17.560993 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:36:17.560993 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:36:17.560993 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.560993 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.560993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2b528b44-c6c8-4f5e-8eed-ff94339da8ec tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Returning 404 to user: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:36:17.560993 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2b528b44-c6c8-4f5e-8eed-ff94339da8ec tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 404 len: 111 microversion: 2.1 time: 0.031772 Oct 27 19:36:17.560993 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3469/7085] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:36:17 2022] DELETE /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:36:17.567491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c5b7042c-e401-4d5d-aba2-79d1bddf8a75 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:17.568176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c5b7042c-e401-4d5d-aba2-79d1bddf8a75 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] [instance: e6856362-9f52-4eec-b999-b1a77c7e9427] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:17.574830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5b7042c-e401-4d5d-aba2-79d1bddf8a75 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:17.575330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5b7042c-e401-4d5d-aba2-79d1bddf8a75 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:17.575780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5b7042c-e401-4d5d-aba2-79d1bddf8a75 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:17.576487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5b7042c-e401-4d5d-aba2-79d1bddf8a75 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:17.576955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5b7042c-e401-4d5d-aba2-79d1bddf8a75 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:17.577398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5b7042c-e401-4d5d-aba2-79d1bddf8a75 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:17.591975 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-c5b7042c-e401-4d5d-aba2-79d1bddf8a75 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] HTTP exception thrown: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c5b7042c-e401-4d5d-aba2-79d1bddf8a75 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Request method failure captured: Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 HTTP/1.1 Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt1_1wUB1XylHp7WP5sdsfvtULDGdAtCk8WwccyFliU0Mf3PCO-iy_RS5Hlamhpo6vISEyfQxq3NiQLE16b1l7_x5m3tXTxJB7FEWMnewEgLTcmlPZ6HSXLk8TwJ_I5xTRdB4kKIeRxWNaGzu8meUiIBXvegNqKahfa5SqLqFR9NERs Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: f1109c57e50a40d29f95f2126dad0a6e Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-DeleteServersTestJSON-246580647 Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1109c57e50a40d29f95f2126dad0a6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1109c57e50a40d29f95f2126dad0a6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1109c57e50a40d29f95f2126dad0a6e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1109c57e50a40d29f95f2126dad0a6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-DeleteServersTestJSON-246580647 Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: f1109c57e50a40d29f95f2126dad0a6e Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-DeleteServersTestJSON-246580647 Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-DeleteServersTestJSON-246580647-project Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 77c2fb3631b64b6ebd902fcea96c8ab6 Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-DeleteServersTestJSON-246580647-project Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'e6856362-9f52-4eec-b999-b1a77c7e9427'} Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:36:17.593541 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.597807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:36:17.597807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:36:17.597807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:36:17.597807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:36:17.597807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:36:17.597807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. Oct 27 19:36:17.597807 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:36:17.597807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c5b7042c-e401-4d5d-aba2-79d1bddf8a75 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] Returning 404 to user: Instance e6856362-9f52-4eec-b999-b1a77c7e9427 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:36:17.597807 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c5b7042c-e401-4d5d-aba2-79d1bddf8a75 tempest-DeleteServersTestJSON-246580647 tempest-DeleteServersTestJSON-246580647-project] 10.222.0.42 "GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427" status: 404 len: 111 microversion: 2.1 time: 0.031664 Oct 27 19:36:17.597807 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3617/7086] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:17 2022] GET /compute/v2.1/servers/e6856362-9f52-4eec-b999-b1a77c7e9427 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:36:26.072679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1792612664", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "4fdcc0cb-66a7-410f-81c5-b8b60371538b"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:36:26.134202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] validate_networks() for [('4fdcc0cb-66a7-410f-81c5-b8b60371538b', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:36:26.542061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:36:26.542552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:36:26.543091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:36:26.543527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:36:26.543966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:36:26.560498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:26.561021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:26.561487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:26.562252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:26.562765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:26.563223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:26.585713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Getting quotas for project 99515ca14d7b4d5686ce8b423bf3bec5. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:36:26.591653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Getting quotas for user 530926eb36014c24af125c6e5acbd6aa and project 99515ca14d7b4d5686ce8b423bf3bec5. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:36:26.605718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:36:26.608106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:36:26.662333 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-946093a8-bfc6-41e3-8a07-9fff86a985aa tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711261 Oct 27 19:36:26.666426 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3470/7087] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:36:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:36:26.676282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cb454a9c-099e-4c67-bda5-884bf96a2c86 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:26.676907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cb454a9c-099e-4c67-bda5-884bf96a2c86 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:26.735883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cb454a9c-099e-4c67-bda5-884bf96a2c86 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:26.743957 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cb454a9c-099e-4c67-bda5-884bf96a2c86 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1218 microversion: 2.1 time: 0.071683 Oct 27 19:36:26.745285 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3618/7088] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:26 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:27.769895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9f340719-686d-42b1-b88f-7557c56b12d8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:27.770566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9f340719-686d-42b1-b88f-7557c56b12d8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:27.779061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f340719-686d-42b1-b88f-7557c56b12d8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:27.779578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f340719-686d-42b1-b88f-7557c56b12d8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:27.780034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f340719-686d-42b1-b88f-7557c56b12d8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:27.780750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f340719-686d-42b1-b88f-7557c56b12d8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:27.781226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f340719-686d-42b1-b88f-7557c56b12d8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:27.781695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9f340719-686d-42b1-b88f-7557c56b12d8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:27.862860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9f340719-686d-42b1-b88f-7557c56b12d8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:27.872591 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9f340719-686d-42b1-b88f-7557c56b12d8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1270 microversion: 2.1 time: 0.106755 Oct 27 19:36:27.873177 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3471/7089] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:27 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:28.897384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d056d1be-87b9-419b-85f3-2e599b7d5c24 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:28.898699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d056d1be-87b9-419b-85f3-2e599b7d5c24 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:28.903511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=43 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:36:28.915680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d056d1be-87b9-419b-85f3-2e599b7d5c24 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:28.916165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d056d1be-87b9-419b-85f3-2e599b7d5c24 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:28.916621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d056d1be-87b9-419b-85f3-2e599b7d5c24 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:28.917519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d056d1be-87b9-419b-85f3-2e599b7d5c24 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:28.917993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d056d1be-87b9-419b-85f3-2e599b7d5c24 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:28.918465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d056d1be-87b9-419b-85f3-2e599b7d5c24 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:29.158767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d056d1be-87b9-419b-85f3-2e599b7d5c24 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:29.167319 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d056d1be-87b9-419b-85f3-2e599b7d5c24 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1318 microversion: 2.1 time: 0.274204 Oct 27 19:36:29.167821 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3619/7090] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:28 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:29.707283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-30f9fe7d-807c-4601-84c1-cb5cc91fc849 req-70390566-d55f-46a6-a712-16ef4a262efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455babe3-639a-49de-a614-4a37d5e215d8", "tag": "2c75bc83-8fbd-4706-a45d-39c86b472703"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:36:29.726010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-30f9fe7d-807c-4601-84c1-cb5cc91fc849 req-70390566-d55f-46a6-a712-16ef4a262efd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:29.726550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-30f9fe7d-807c-4601-84c1-cb5cc91fc849 req-70390566-d55f-46a6-a712-16ef4a262efd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:29.727040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-30f9fe7d-807c-4601-84c1-cb5cc91fc849 req-70390566-d55f-46a6-a712-16ef4a262efd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:29.743696 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-30f9fe7d-807c-4601-84c1-cb5cc91fc849 req-70390566-d55f-46a6-a712-16ef4a262efd service nova] Creating event network-changed:2c75bc83-8fbd-4706-a45d-39c86b472703 for instance 455babe3-639a-49de-a614-4a37d5e215d8 on n-h1-860687-3 Oct 27 19:36:29.749188 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-30f9fe7d-807c-4601-84c1-cb5cc91fc849 req-70390566-d55f-46a6-a712-16ef4a262efd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045877 Oct 27 19:36:29.750780 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3472/7091] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:36:30.192212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dbe0f0ce-c4fb-4bf3-afa6-2088c5963c98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:30.192942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dbe0f0ce-c4fb-4bf3-afa6-2088c5963c98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:30.204917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbe0f0ce-c4fb-4bf3-afa6-2088c5963c98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:30.205409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbe0f0ce-c4fb-4bf3-afa6-2088c5963c98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:30.205852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbe0f0ce-c4fb-4bf3-afa6-2088c5963c98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:30.206602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbe0f0ce-c4fb-4bf3-afa6-2088c5963c98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:30.207066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbe0f0ce-c4fb-4bf3-afa6-2088c5963c98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:30.207499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dbe0f0ce-c4fb-4bf3-afa6-2088c5963c98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:30.350113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dbe0f0ce-c4fb-4bf3-afa6-2088c5963c98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:30.358258 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dbe0f0ce-c4fb-4bf3-afa6-2088c5963c98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1318 microversion: 2.1 time: 0.170646 Oct 27 19:36:30.358879 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3620/7092] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:30 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:31.382698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4cfa9042-18be-4773-94e6-cb281e31910e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:31.383427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4cfa9042-18be-4773-94e6-cb281e31910e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:31.389945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4cfa9042-18be-4773-94e6-cb281e31910e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:31.390476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4cfa9042-18be-4773-94e6-cb281e31910e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:31.390940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4cfa9042-18be-4773-94e6-cb281e31910e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:31.391648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4cfa9042-18be-4773-94e6-cb281e31910e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:31.392141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4cfa9042-18be-4773-94e6-cb281e31910e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:31.392582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4cfa9042-18be-4773-94e6-cb281e31910e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:31.536503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4cfa9042-18be-4773-94e6-cb281e31910e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:31.544625 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4cfa9042-18be-4773-94e6-cb281e31910e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1318 microversion: 2.1 time: 0.167191 Oct 27 19:36:31.545211 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3473/7093] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:31 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:32.575796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bf9546ca-0657-459c-9b6f-34e1992b1182 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:32.575796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bf9546ca-0657-459c-9b6f-34e1992b1182 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:32.583587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9546ca-0657-459c-9b6f-34e1992b1182 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:32.584940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9546ca-0657-459c-9b6f-34e1992b1182 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:32.585391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9546ca-0657-459c-9b6f-34e1992b1182 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:32.586115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9546ca-0657-459c-9b6f-34e1992b1182 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:32.586647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9546ca-0657-459c-9b6f-34e1992b1182 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:32.587120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf9546ca-0657-459c-9b6f-34e1992b1182 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:32.726651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bf9546ca-0657-459c-9b6f-34e1992b1182 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:32.735826 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bf9546ca-0657-459c-9b6f-34e1992b1182 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1318 microversion: 2.1 time: 0.170662 Oct 27 19:36:32.736419 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3621/7094] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:32 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:33.758963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a0d219c2-fdb6-4137-bc83-d2bf6bb0c4d6 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:33.759626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a0d219c2-fdb6-4137-bc83-d2bf6bb0c4d6 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:33.766496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0d219c2-fdb6-4137-bc83-d2bf6bb0c4d6 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:33.766996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0d219c2-fdb6-4137-bc83-d2bf6bb0c4d6 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:33.767445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0d219c2-fdb6-4137-bc83-d2bf6bb0c4d6 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:33.768152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0d219c2-fdb6-4137-bc83-d2bf6bb0c4d6 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:33.768617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0d219c2-fdb6-4137-bc83-d2bf6bb0c4d6 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:33.769054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0d219c2-fdb6-4137-bc83-d2bf6bb0c4d6 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:33.905416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0d219c2-fdb6-4137-bc83-d2bf6bb0c4d6 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:33.913152 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a0d219c2-fdb6-4137-bc83-d2bf6bb0c4d6 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1318 microversion: 2.1 time: 0.158095 Oct 27 19:36:33.913731 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3474/7095] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:33 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:34.125005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e893296b-8154-40d4-8cc9-80b0327125a5 req-a9389260-6521-4180-b0ac-515791ffdec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455babe3-639a-49de-a614-4a37d5e215d8", "name": "network-vif-plugged", "status": "completed", "tag": "2c75bc83-8fbd-4706-a45d-39c86b472703"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:36:34.136177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e893296b-8154-40d4-8cc9-80b0327125a5 req-a9389260-6521-4180-b0ac-515791ffdec9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:34.136679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e893296b-8154-40d4-8cc9-80b0327125a5 req-a9389260-6521-4180-b0ac-515791ffdec9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:34.137126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e893296b-8154-40d4-8cc9-80b0327125a5 req-a9389260-6521-4180-b0ac-515791ffdec9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:34.148560 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e893296b-8154-40d4-8cc9-80b0327125a5 req-a9389260-6521-4180-b0ac-515791ffdec9 service nova] Creating event network-vif-plugged:2c75bc83-8fbd-4706-a45d-39c86b472703 for instance 455babe3-639a-49de-a614-4a37d5e215d8 on n-h1-860687-3 Oct 27 19:36:34.154166 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e893296b-8154-40d4-8cc9-80b0327125a5 req-a9389260-6521-4180-b0ac-515791ffdec9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033126 Oct 27 19:36:34.154813 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3622/7096] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:36:34.936271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2c3fa346-26ce-4d60-9794-5ba884f7e6fb tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:34.936898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2c3fa346-26ce-4d60-9794-5ba884f7e6fb tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:34.944072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c3fa346-26ce-4d60-9794-5ba884f7e6fb tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:34.944571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c3fa346-26ce-4d60-9794-5ba884f7e6fb tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:34.945025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c3fa346-26ce-4d60-9794-5ba884f7e6fb tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:34.945726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c3fa346-26ce-4d60-9794-5ba884f7e6fb tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:34.946194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c3fa346-26ce-4d60-9794-5ba884f7e6fb tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:34.946672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2c3fa346-26ce-4d60-9794-5ba884f7e6fb tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:35.079751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2c3fa346-26ce-4d60-9794-5ba884f7e6fb tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:35.087515 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2c3fa346-26ce-4d60-9794-5ba884f7e6fb tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1318 microversion: 2.1 time: 0.155228 Oct 27 19:36:35.088747 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3475/7097] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:34 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:36.112372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4707f505-6d43-441e-9b39-e88351276a54 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:36.113093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4707f505-6d43-441e-9b39-e88351276a54 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:36.120088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4707f505-6d43-441e-9b39-e88351276a54 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:36.120578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4707f505-6d43-441e-9b39-e88351276a54 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:36.121024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4707f505-6d43-441e-9b39-e88351276a54 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:36.121727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4707f505-6d43-441e-9b39-e88351276a54 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:36.122191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4707f505-6d43-441e-9b39-e88351276a54 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:36.122660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4707f505-6d43-441e-9b39-e88351276a54 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:36.252141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4707f505-6d43-441e-9b39-e88351276a54 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:36.259980 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4707f505-6d43-441e-9b39-e88351276a54 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1507 microversion: 2.1 time: 0.152821 Oct 27 19:36:36.260550 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3623/7098] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:36 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:36.283422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-94605e12-4eed-42c7-a2e2-1e219fc4b534 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:36.284122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-94605e12-4eed-42c7-a2e2-1e219fc4b534 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:36.291577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94605e12-4eed-42c7-a2e2-1e219fc4b534 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:36.292081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94605e12-4eed-42c7-a2e2-1e219fc4b534 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:36.292547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94605e12-4eed-42c7-a2e2-1e219fc4b534 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:36.293288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94605e12-4eed-42c7-a2e2-1e219fc4b534 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:36.293764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94605e12-4eed-42c7-a2e2-1e219fc4b534 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:36.294218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94605e12-4eed-42c7-a2e2-1e219fc4b534 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:36.422091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-94605e12-4eed-42c7-a2e2-1e219fc4b534 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:36.429940 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-94605e12-4eed-42c7-a2e2-1e219fc4b534 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1507 microversion: 2.1 time: 0.150466 Oct 27 19:36:36.430544 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3476/7099] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:36 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:36.452284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d25274df-938d-49ef-9153-2446cc9be243 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:36:36.454842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d25274df-938d-49ef-9153-2446cc9be243 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:36.456820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=32 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:36:36.462107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d25274df-938d-49ef-9153-2446cc9be243 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:36.462621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d25274df-938d-49ef-9153-2446cc9be243 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:36.463584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d25274df-938d-49ef-9153-2446cc9be243 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:36.464275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d25274df-938d-49ef-9153-2446cc9be243 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:36.464734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d25274df-938d-49ef-9153-2446cc9be243 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:36.465165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d25274df-938d-49ef-9153-2446cc9be243 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:36.528215 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d25274df-938d-49ef-9153-2446cc9be243 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "PUT /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1079 microversion: 2.1 time: 0.079960 Oct 27 19:36:36.528834 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3624/7100] 10.222.0.42 () {60 vars in 1256 bytes} [Thu Oct 27 19:36:36 2022] PUT /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1079 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:36.547990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7f155757-b3f9-4800-99db-b0d46ed6df55 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:36.548633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7f155757-b3f9-4800-99db-b0d46ed6df55 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:36.554763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f155757-b3f9-4800-99db-b0d46ed6df55 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:36.555273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f155757-b3f9-4800-99db-b0d46ed6df55 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:36.555734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f155757-b3f9-4800-99db-b0d46ed6df55 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:36.556463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f155757-b3f9-4800-99db-b0d46ed6df55 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:36.557000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f155757-b3f9-4800-99db-b0d46ed6df55 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:36.557451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f155757-b3f9-4800-99db-b0d46ed6df55 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:36.575490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:36:36.598788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:36:36.694791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7f155757-b3f9-4800-99db-b0d46ed6df55 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:36.702801 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7f155757-b3f9-4800-99db-b0d46ed6df55 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1505 microversion: 2.1 time: 0.158532 Oct 27 19:36:36.703359 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3477/7101] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:36 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:36.725225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-024fa5c4-2325-41b6-b028-d95d195d920d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:36.725874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-024fa5c4-2325-41b6-b028-d95d195d920d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:36.732573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-024fa5c4-2325-41b6-b028-d95d195d920d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:36.733055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-024fa5c4-2325-41b6-b028-d95d195d920d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:36.733493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-024fa5c4-2325-41b6-b028-d95d195d920d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:36.734185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-024fa5c4-2325-41b6-b028-d95d195d920d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:36.734669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-024fa5c4-2325-41b6-b028-d95d195d920d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:36.735101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-024fa5c4-2325-41b6-b028-d95d195d920d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:36.749756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:36:36.869154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-024fa5c4-2325-41b6-b028-d95d195d920d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:36.877273 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-024fa5c4-2325-41b6-b028-d95d195d920d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1505 microversion: 2.1 time: 0.155950 Oct 27 19:36:36.877840 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3625/7102] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:36 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:36.901190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:36:36.903518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:36.909507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:36.910009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:36.910635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:36.911346 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:36.911812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:36.912251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:36.941595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:36.946948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Old instance type m1.heat2, new instance type m1.heat {{(pid=127028) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 19:36:36.953363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:36:36.953734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:36:36.954220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:36:36.954667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:36:36.955093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:36:37.018054 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2e1a30ec-bd1a-463b-baa5-d9b0794389f2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "POST /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8/action" status: 202 len: 0 microversion: 2.1 time: 0.120990 Oct 27 19:36:37.018984 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3478/7103] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:36:36 2022] POST /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:36:37.027431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f785446c-87fa-4a15-b8ea-12ce1e138ddf tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:37.028093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f785446c-87fa-4a15-b8ea-12ce1e138ddf tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:37.034160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f785446c-87fa-4a15-b8ea-12ce1e138ddf tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:37.034702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f785446c-87fa-4a15-b8ea-12ce1e138ddf tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:37.035143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f785446c-87fa-4a15-b8ea-12ce1e138ddf tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:37.035863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f785446c-87fa-4a15-b8ea-12ce1e138ddf tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:37.036334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f785446c-87fa-4a15-b8ea-12ce1e138ddf tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:37.036774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f785446c-87fa-4a15-b8ea-12ce1e138ddf tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:37.195787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f785446c-87fa-4a15-b8ea-12ce1e138ddf tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:37.204141 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f785446c-87fa-4a15-b8ea-12ce1e138ddf tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1516 microversion: 2.1 time: 0.180842 Oct 27 19:36:37.204664 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3626/7104] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:37 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:38.229556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a3f407f3-e7bc-44ff-90b4-152dd6b2fefc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:38.230196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a3f407f3-e7bc-44ff-90b4-152dd6b2fefc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:38.237587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3f407f3-e7bc-44ff-90b4-152dd6b2fefc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:38.238092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3f407f3-e7bc-44ff-90b4-152dd6b2fefc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:38.238596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3f407f3-e7bc-44ff-90b4-152dd6b2fefc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:38.239339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3f407f3-e7bc-44ff-90b4-152dd6b2fefc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:38.239815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3f407f3-e7bc-44ff-90b4-152dd6b2fefc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:38.240266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3f407f3-e7bc-44ff-90b4-152dd6b2fefc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:38.375744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a3f407f3-e7bc-44ff-90b4-152dd6b2fefc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:38.378096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:36:38.385802 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a3f407f3-e7bc-44ff-90b4-152dd6b2fefc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1516 microversion: 2.1 time: 0.161745 Oct 27 19:36:38.386528 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3479/7105] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:38 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:39.409304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1f7a03e1-f9a7-48f8-9b85-a0c5152f0422 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:39.409937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1f7a03e1-f9a7-48f8-9b85-a0c5152f0422 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:39.417717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f7a03e1-f9a7-48f8-9b85-a0c5152f0422 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:39.418210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f7a03e1-f9a7-48f8-9b85-a0c5152f0422 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:39.418690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f7a03e1-f9a7-48f8-9b85-a0c5152f0422 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:39.419403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f7a03e1-f9a7-48f8-9b85-a0c5152f0422 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:39.419862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f7a03e1-f9a7-48f8-9b85-a0c5152f0422 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:39.420299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1f7a03e1-f9a7-48f8-9b85-a0c5152f0422 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:39.559278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1f7a03e1-f9a7-48f8-9b85-a0c5152f0422 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:39.567552 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1f7a03e1-f9a7-48f8-9b85-a0c5152f0422 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.162246 Oct 27 19:36:39.568132 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3627/7106] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:39 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:40.591516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8feb476b-2604-47dd-a623-7c4b0e210f16 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:40.592152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8feb476b-2604-47dd-a623-7c4b0e210f16 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:40.594778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:36:40.601151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8feb476b-2604-47dd-a623-7c4b0e210f16 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:40.601656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8feb476b-2604-47dd-a623-7c4b0e210f16 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:40.602111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8feb476b-2604-47dd-a623-7c4b0e210f16 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:40.602868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8feb476b-2604-47dd-a623-7c4b0e210f16 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:40.603903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8feb476b-2604-47dd-a623-7c4b0e210f16 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:40.604419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8feb476b-2604-47dd-a623-7c4b0e210f16 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:40.740418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8feb476b-2604-47dd-a623-7c4b0e210f16 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:40.749291 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8feb476b-2604-47dd-a623-7c4b0e210f16 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.162527 Oct 27 19:36:40.749891 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3480/7107] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:40 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:41.772516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2c7e1ca9-9918-40b3-9166-cf03c5eab929 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:41.773159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2c7e1ca9-9918-40b3-9166-cf03c5eab929 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:41.779997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c7e1ca9-9918-40b3-9166-cf03c5eab929 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:41.780482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c7e1ca9-9918-40b3-9166-cf03c5eab929 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:41.780920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c7e1ca9-9918-40b3-9166-cf03c5eab929 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:41.781609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c7e1ca9-9918-40b3-9166-cf03c5eab929 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:41.782067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c7e1ca9-9918-40b3-9166-cf03c5eab929 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:41.782520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2c7e1ca9-9918-40b3-9166-cf03c5eab929 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:41.919681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2c7e1ca9-9918-40b3-9166-cf03c5eab929 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:41.927495 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2c7e1ca9-9918-40b3-9166-cf03c5eab929 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.158971 Oct 27 19:36:41.928064 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3628/7108] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:41 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:42.951444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b1fee663-ecde-4772-b29e-58be0a21f7f7 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:42.952128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b1fee663-ecde-4772-b29e-58be0a21f7f7 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:42.958994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1fee663-ecde-4772-b29e-58be0a21f7f7 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:42.959494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1fee663-ecde-4772-b29e-58be0a21f7f7 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:42.959949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1fee663-ecde-4772-b29e-58be0a21f7f7 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:42.960658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1fee663-ecde-4772-b29e-58be0a21f7f7 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:42.961125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1fee663-ecde-4772-b29e-58be0a21f7f7 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:42.961564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b1fee663-ecde-4772-b29e-58be0a21f7f7 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:43.089537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b1fee663-ecde-4772-b29e-58be0a21f7f7 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:43.097192 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b1fee663-ecde-4772-b29e-58be0a21f7f7 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.149856 Oct 27 19:36:43.097760 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3481/7109] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:42 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:44.120949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-38a6c10b-0515-4ee9-889e-11aa2652adb5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:44.121573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-38a6c10b-0515-4ee9-889e-11aa2652adb5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:44.128534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38a6c10b-0515-4ee9-889e-11aa2652adb5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:44.129048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38a6c10b-0515-4ee9-889e-11aa2652adb5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:44.129482 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38a6c10b-0515-4ee9-889e-11aa2652adb5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:44.130191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38a6c10b-0515-4ee9-889e-11aa2652adb5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:44.130688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38a6c10b-0515-4ee9-889e-11aa2652adb5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:44.131131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-38a6c10b-0515-4ee9-889e-11aa2652adb5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:44.262257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-38a6c10b-0515-4ee9-889e-11aa2652adb5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:44.270151 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-38a6c10b-0515-4ee9-889e-11aa2652adb5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.153198 Oct 27 19:36:44.270755 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3629/7110] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:44 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:45.294089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-da0ea7a4-f2e6-4ba5-b1e1-4f9f5e32b870 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:45.294883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-da0ea7a4-f2e6-4ba5-b1e1-4f9f5e32b870 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:45.301662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da0ea7a4-f2e6-4ba5-b1e1-4f9f5e32b870 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:45.302160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da0ea7a4-f2e6-4ba5-b1e1-4f9f5e32b870 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:45.302643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da0ea7a4-f2e6-4ba5-b1e1-4f9f5e32b870 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:45.303349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da0ea7a4-f2e6-4ba5-b1e1-4f9f5e32b870 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:45.303817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da0ea7a4-f2e6-4ba5-b1e1-4f9f5e32b870 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:45.304260 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da0ea7a4-f2e6-4ba5-b1e1-4f9f5e32b870 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:45.436355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-da0ea7a4-f2e6-4ba5-b1e1-4f9f5e32b870 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:45.444367 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-da0ea7a4-f2e6-4ba5-b1e1-4f9f5e32b870 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.155266 Oct 27 19:36:45.444943 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3482/7111] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:45 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:46.469163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5e2323b5-4eef-4bce-bd96-810de322e713 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:46.469783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5e2323b5-4eef-4bce-bd96-810de322e713 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:46.476994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e2323b5-4eef-4bce-bd96-810de322e713 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:46.477480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e2323b5-4eef-4bce-bd96-810de322e713 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:46.477921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e2323b5-4eef-4bce-bd96-810de322e713 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:46.479409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e2323b5-4eef-4bce-bd96-810de322e713 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:46.479868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e2323b5-4eef-4bce-bd96-810de322e713 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:46.480298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5e2323b5-4eef-4bce-bd96-810de322e713 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:46.611010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5e2323b5-4eef-4bce-bd96-810de322e713 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:46.618758 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5e2323b5-4eef-4bce-bd96-810de322e713 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.153668 Oct 27 19:36:46.619624 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3630/7112] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:46 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:47.641838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c7707a09-5c3f-4b33-9bed-dda9d912ee12 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:47.642498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c7707a09-5c3f-4b33-9bed-dda9d912ee12 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:47.649400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7707a09-5c3f-4b33-9bed-dda9d912ee12 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:47.650454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7707a09-5c3f-4b33-9bed-dda9d912ee12 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:47.650998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7707a09-5c3f-4b33-9bed-dda9d912ee12 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:47.651708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7707a09-5c3f-4b33-9bed-dda9d912ee12 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:47.652174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7707a09-5c3f-4b33-9bed-dda9d912ee12 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:47.652616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7707a09-5c3f-4b33-9bed-dda9d912ee12 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:47.783462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c7707a09-5c3f-4b33-9bed-dda9d912ee12 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:47.792007 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c7707a09-5c3f-4b33-9bed-dda9d912ee12 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.154029 Oct 27 19:36:47.792579 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3483/7113] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:47 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:48.815886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f955a82f-d728-4237-92b9-32027221de32 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:48.816512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f955a82f-d728-4237-92b9-32027221de32 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:48.824621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f955a82f-d728-4237-92b9-32027221de32 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:48.825121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f955a82f-d728-4237-92b9-32027221de32 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:48.825565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f955a82f-d728-4237-92b9-32027221de32 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:48.826280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f955a82f-d728-4237-92b9-32027221de32 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:48.826769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f955a82f-d728-4237-92b9-32027221de32 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:48.827206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f955a82f-d728-4237-92b9-32027221de32 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:48.966271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f955a82f-d728-4237-92b9-32027221de32 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:48.974065 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f955a82f-d728-4237-92b9-32027221de32 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.163630 Oct 27 19:36:48.974663 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3631/7114] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:48 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:49.997938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb3b82c1-f1c2-4b9a-b4dd-6228d02b4c93 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:49.998633 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fb3b82c1-f1c2-4b9a-b4dd-6228d02b4c93 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:50.005748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb3b82c1-f1c2-4b9a-b4dd-6228d02b4c93 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:50.006256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb3b82c1-f1c2-4b9a-b4dd-6228d02b4c93 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:50.006753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb3b82c1-f1c2-4b9a-b4dd-6228d02b4c93 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:50.007479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb3b82c1-f1c2-4b9a-b4dd-6228d02b4c93 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:50.007955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb3b82c1-f1c2-4b9a-b4dd-6228d02b4c93 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:50.008406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb3b82c1-f1c2-4b9a-b4dd-6228d02b4c93 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:50.141087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fb3b82c1-f1c2-4b9a-b4dd-6228d02b4c93 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:50.154128 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fb3b82c1-f1c2-4b9a-b4dd-6228d02b4c93 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.160763 Oct 27 19:36:50.154749 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3484/7115] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:49 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:51.178051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-62f9f4d7-bcab-47c0-a31f-6c5cf2ffbc6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:51.178705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-62f9f4d7-bcab-47c0-a31f-6c5cf2ffbc6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:51.185655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62f9f4d7-bcab-47c0-a31f-6c5cf2ffbc6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:51.186151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62f9f4d7-bcab-47c0-a31f-6c5cf2ffbc6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:51.186644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62f9f4d7-bcab-47c0-a31f-6c5cf2ffbc6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:51.187360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62f9f4d7-bcab-47c0-a31f-6c5cf2ffbc6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:51.187825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62f9f4d7-bcab-47c0-a31f-6c5cf2ffbc6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:51.188267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62f9f4d7-bcab-47c0-a31f-6c5cf2ffbc6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:51.317394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-62f9f4d7-bcab-47c0-a31f-6c5cf2ffbc6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:51.325915 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-62f9f4d7-bcab-47c0-a31f-6c5cf2ffbc6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.151814 Oct 27 19:36:51.326504 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3632/7116] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:51 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:52.349971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd7a8460-fc5e-4181-8de6-510442007154 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:52.350629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dd7a8460-fc5e-4181-8de6-510442007154 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:52.357794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd7a8460-fc5e-4181-8de6-510442007154 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:52.358299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd7a8460-fc5e-4181-8de6-510442007154 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:52.358792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd7a8460-fc5e-4181-8de6-510442007154 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:52.359499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd7a8460-fc5e-4181-8de6-510442007154 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:52.359974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd7a8460-fc5e-4181-8de6-510442007154 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:52.360420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd7a8460-fc5e-4181-8de6-510442007154 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:52.493538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dd7a8460-fc5e-4181-8de6-510442007154 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:52.501808 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dd7a8460-fc5e-4181-8de6-510442007154 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.155957 Oct 27 19:36:52.502397 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3485/7117] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:52 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:53.524202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-68f03d6d-c91e-482b-b168-4a589a044d6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:53.524823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-68f03d6d-c91e-482b-b168-4a589a044d6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:53.531978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68f03d6d-c91e-482b-b168-4a589a044d6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:53.532468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68f03d6d-c91e-482b-b168-4a589a044d6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:53.532911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68f03d6d-c91e-482b-b168-4a589a044d6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:53.533612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68f03d6d-c91e-482b-b168-4a589a044d6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:53.534102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68f03d6d-c91e-482b-b168-4a589a044d6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:53.534568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-68f03d6d-c91e-482b-b168-4a589a044d6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:53.673820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-68f03d6d-c91e-482b-b168-4a589a044d6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:53.681632 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-68f03d6d-c91e-482b-b168-4a589a044d6a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.161421 Oct 27 19:36:53.682221 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3633/7118] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:53 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:54.705496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-39f2addc-f695-4309-86bf-34128a522a2d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:54.706080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-39f2addc-f695-4309-86bf-34128a522a2d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:54.712949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39f2addc-f695-4309-86bf-34128a522a2d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:54.713446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39f2addc-f695-4309-86bf-34128a522a2d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:54.714423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39f2addc-f695-4309-86bf-34128a522a2d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:54.715143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39f2addc-f695-4309-86bf-34128a522a2d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:54.715612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39f2addc-f695-4309-86bf-34128a522a2d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:54.716056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-39f2addc-f695-4309-86bf-34128a522a2d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:54.845624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-39f2addc-f695-4309-86bf-34128a522a2d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:54.853361 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-39f2addc-f695-4309-86bf-34128a522a2d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.151844 Oct 27 19:36:54.853965 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3486/7119] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:54 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:55.877172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-78a911b8-145e-484b-bce8-e5d461094f77 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:55.877794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-78a911b8-145e-484b-bce8-e5d461094f77 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:55.884693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78a911b8-145e-484b-bce8-e5d461094f77 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:55.885182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78a911b8-145e-484b-bce8-e5d461094f77 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:55.886232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78a911b8-145e-484b-bce8-e5d461094f77 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:55.886963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78a911b8-145e-484b-bce8-e5d461094f77 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:55.887422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78a911b8-145e-484b-bce8-e5d461094f77 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:55.887856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78a911b8-145e-484b-bce8-e5d461094f77 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:56.021385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-78a911b8-145e-484b-bce8-e5d461094f77 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:56.029320 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-78a911b8-145e-484b-bce8-e5d461094f77 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.156183 Oct 27 19:36:56.029895 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3634/7120] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:55 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:57.052628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-59f278a2-52c9-4eac-a21c-f44f1fffaf69 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:57.053267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-59f278a2-52c9-4eac-a21c-f44f1fffaf69 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:57.060307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59f278a2-52c9-4eac-a21c-f44f1fffaf69 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:57.060810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59f278a2-52c9-4eac-a21c-f44f1fffaf69 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:57.061264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59f278a2-52c9-4eac-a21c-f44f1fffaf69 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:57.061975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59f278a2-52c9-4eac-a21c-f44f1fffaf69 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:57.062547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59f278a2-52c9-4eac-a21c-f44f1fffaf69 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:57.062998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59f278a2-52c9-4eac-a21c-f44f1fffaf69 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:57.194320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-59f278a2-52c9-4eac-a21c-f44f1fffaf69 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:57.203061 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-59f278a2-52c9-4eac-a21c-f44f1fffaf69 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.154344 Oct 27 19:36:57.203642 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3487/7121] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:57 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:58.227821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-090eddd1-084d-4b25-bc1b-6d0649008137 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:58.228437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-090eddd1-084d-4b25-bc1b-6d0649008137 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:58.234847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-090eddd1-084d-4b25-bc1b-6d0649008137 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:58.235335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-090eddd1-084d-4b25-bc1b-6d0649008137 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:58.235773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-090eddd1-084d-4b25-bc1b-6d0649008137 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:58.236460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-090eddd1-084d-4b25-bc1b-6d0649008137 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:58.236915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-090eddd1-084d-4b25-bc1b-6d0649008137 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:58.237344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-090eddd1-084d-4b25-bc1b-6d0649008137 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:58.255464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:36:58.371267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-090eddd1-084d-4b25-bc1b-6d0649008137 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:58.379087 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-090eddd1-084d-4b25-bc1b-6d0649008137 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.155343 Oct 27 19:36:58.379665 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3635/7122] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:58 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:36:59.403405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d6192eb-7024-4b7e-869a-c71048f8caa3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:36:59.404042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d6192eb-7024-4b7e-869a-c71048f8caa3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:36:59.411066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d6192eb-7024-4b7e-869a-c71048f8caa3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:59.411570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d6192eb-7024-4b7e-869a-c71048f8caa3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:59.412025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d6192eb-7024-4b7e-869a-c71048f8caa3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:59.412738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d6192eb-7024-4b7e-869a-c71048f8caa3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:36:59.413209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d6192eb-7024-4b7e-869a-c71048f8caa3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:36:59.413657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d6192eb-7024-4b7e-869a-c71048f8caa3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:36:59.541615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d6192eb-7024-4b7e-869a-c71048f8caa3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:36:59.549382 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d6192eb-7024-4b7e-869a-c71048f8caa3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.150593 Oct 27 19:36:59.549960 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3488/7123] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:36:59 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:00.573024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-846fa0a2-7869-439d-815a-c99b670acd56 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:00.574159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-846fa0a2-7869-439d-815a-c99b670acd56 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:00.581347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-846fa0a2-7869-439d-815a-c99b670acd56 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:00.581839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-846fa0a2-7869-439d-815a-c99b670acd56 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:00.582283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-846fa0a2-7869-439d-815a-c99b670acd56 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:00.583016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-846fa0a2-7869-439d-815a-c99b670acd56 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:00.583474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-846fa0a2-7869-439d-815a-c99b670acd56 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:00.584198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-846fa0a2-7869-439d-815a-c99b670acd56 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:00.714313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-846fa0a2-7869-439d-815a-c99b670acd56 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:00.722243 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-846fa0a2-7869-439d-815a-c99b670acd56 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.153287 Oct 27 19:37:00.722841 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3636/7124] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:00 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:01.745697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e0af889c-6ad8-45cf-82dd-5c16bf0e3b07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:01.746344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e0af889c-6ad8-45cf-82dd-5c16bf0e3b07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:01.753529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e0af889c-6ad8-45cf-82dd-5c16bf0e3b07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:01.754028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e0af889c-6ad8-45cf-82dd-5c16bf0e3b07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:01.754513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e0af889c-6ad8-45cf-82dd-5c16bf0e3b07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:01.755228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e0af889c-6ad8-45cf-82dd-5c16bf0e3b07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:01.755703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e0af889c-6ad8-45cf-82dd-5c16bf0e3b07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:01.756181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e0af889c-6ad8-45cf-82dd-5c16bf0e3b07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:01.886220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e0af889c-6ad8-45cf-82dd-5c16bf0e3b07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:01.893957 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e0af889c-6ad8-45cf-82dd-5c16bf0e3b07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.152787 Oct 27 19:37:01.894649 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3489/7125] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:01 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:02.917941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-751c37b9-8fa3-4d12-b421-2e6b988f8ad4 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:02.918674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-751c37b9-8fa3-4d12-b421-2e6b988f8ad4 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:02.925654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-751c37b9-8fa3-4d12-b421-2e6b988f8ad4 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:02.926172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-751c37b9-8fa3-4d12-b421-2e6b988f8ad4 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:02.926660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-751c37b9-8fa3-4d12-b421-2e6b988f8ad4 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:02.927365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-751c37b9-8fa3-4d12-b421-2e6b988f8ad4 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:02.927829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-751c37b9-8fa3-4d12-b421-2e6b988f8ad4 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:02.928267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-751c37b9-8fa3-4d12-b421-2e6b988f8ad4 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:03.058532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-751c37b9-8fa3-4d12-b421-2e6b988f8ad4 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:03.066634 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-751c37b9-8fa3-4d12-b421-2e6b988f8ad4 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.153306 Oct 27 19:37:03.067222 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3637/7126] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:02 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:04.090278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5125f77d-a2f2-4cbc-863b-86ab77ff1f6c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:04.090937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5125f77d-a2f2-4cbc-863b-86ab77ff1f6c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:04.097660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5125f77d-a2f2-4cbc-863b-86ab77ff1f6c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:04.098170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5125f77d-a2f2-4cbc-863b-86ab77ff1f6c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:04.098661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5125f77d-a2f2-4cbc-863b-86ab77ff1f6c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:04.099410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5125f77d-a2f2-4cbc-863b-86ab77ff1f6c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:04.099883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5125f77d-a2f2-4cbc-863b-86ab77ff1f6c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:04.100328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5125f77d-a2f2-4cbc-863b-86ab77ff1f6c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:04.236098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5125f77d-a2f2-4cbc-863b-86ab77ff1f6c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:04.244042 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5125f77d-a2f2-4cbc-863b-86ab77ff1f6c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.157720 Oct 27 19:37:04.244620 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3490/7127] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:04 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:05.267875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e0f1290c-cff7-417a-afe5-b2353559d819 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:05.268495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e0f1290c-cff7-417a-afe5-b2353559d819 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:05.275357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0f1290c-cff7-417a-afe5-b2353559d819 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:05.275851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0f1290c-cff7-417a-afe5-b2353559d819 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:05.276425 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0f1290c-cff7-417a-afe5-b2353559d819 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:05.277081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0f1290c-cff7-417a-afe5-b2353559d819 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:05.277544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0f1290c-cff7-417a-afe5-b2353559d819 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:05.277980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0f1290c-cff7-417a-afe5-b2353559d819 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:05.411924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e0f1290c-cff7-417a-afe5-b2353559d819 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:05.420544 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e0f1290c-cff7-417a-afe5-b2353559d819 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1521 microversion: 2.1 time: 0.156782 Oct 27 19:37:05.421123 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3638/7128] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:05 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:06.276827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-91932fc2-598c-4920-9189-8cc2cff30014 req-a131e55d-7c60-44d6-b5e3-25b9970b1f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455babe3-639a-49de-a614-4a37d5e215d8", "name": "network-vif-unplugged", "status": "completed", "tag": "2c75bc83-8fbd-4706-a45d-39c86b472703"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:37:06.288193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-91932fc2-598c-4920-9189-8cc2cff30014 req-a131e55d-7c60-44d6-b5e3-25b9970b1f8c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:06.288836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-91932fc2-598c-4920-9189-8cc2cff30014 req-a131e55d-7c60-44d6-b5e3-25b9970b1f8c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:06.289330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-91932fc2-598c-4920-9189-8cc2cff30014 req-a131e55d-7c60-44d6-b5e3-25b9970b1f8c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:06.302100 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-91932fc2-598c-4920-9189-8cc2cff30014 req-a131e55d-7c60-44d6-b5e3-25b9970b1f8c service nova] Creating event network-vif-unplugged:2c75bc83-8fbd-4706-a45d-39c86b472703 for instance 455babe3-639a-49de-a614-4a37d5e215d8 on n-h2-860687-3 Oct 27 19:37:06.308482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-91932fc2-598c-4920-9189-8cc2cff30014 req-a131e55d-7c60-44d6-b5e3-25b9970b1f8c service nova] Instance 455babe3-639a-49de-a614-4a37d5e215d8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:37:06.319666 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-91932fc2-598c-4920-9189-8cc2cff30014 req-a131e55d-7c60-44d6-b5e3-25b9970b1f8c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047065 Oct 27 19:37:06.320435 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3491/7129] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:37:06.444410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e3eed839-49e2-48bc-97f2-d923b2c11631 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:06.445126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e3eed839-49e2-48bc-97f2-d923b2c11631 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:06.452388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3eed839-49e2-48bc-97f2-d923b2c11631 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:06.452885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3eed839-49e2-48bc-97f2-d923b2c11631 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:06.453333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3eed839-49e2-48bc-97f2-d923b2c11631 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:06.454077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3eed839-49e2-48bc-97f2-d923b2c11631 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:06.454569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3eed839-49e2-48bc-97f2-d923b2c11631 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:06.455008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e3eed839-49e2-48bc-97f2-d923b2c11631 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:06.643787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e3eed839-49e2-48bc-97f2-d923b2c11631 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:06.652669 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e3eed839-49e2-48bc-97f2-d923b2c11631 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1520 microversion: 2.1 time: 0.212180 Oct 27 19:37:06.662682 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3639/7130] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:06 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:07.678988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bdb7192f-3d6b-4786-854d-47d37cc75765 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:07.679710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bdb7192f-3d6b-4786-854d-47d37cc75765 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:07.686705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdb7192f-3d6b-4786-854d-47d37cc75765 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:07.687206 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdb7192f-3d6b-4786-854d-47d37cc75765 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:07.687659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdb7192f-3d6b-4786-854d-47d37cc75765 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:07.688373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdb7192f-3d6b-4786-854d-47d37cc75765 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:07.689101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdb7192f-3d6b-4786-854d-47d37cc75765 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:07.689555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bdb7192f-3d6b-4786-854d-47d37cc75765 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:07.818465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bdb7192f-3d6b-4786-854d-47d37cc75765 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:07.826436 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bdb7192f-3d6b-4786-854d-47d37cc75765 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1518 microversion: 2.1 time: 0.152643 Oct 27 19:37:07.827012 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3492/7131] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:07 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:08.334898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-7a261b6b-abb3-46f6-a7ab-fc42dd7dd367 req-1c08ffdb-3e19-4c8c-9ef6-64463df036aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455babe3-639a-49de-a614-4a37d5e215d8", "tag": "2c75bc83-8fbd-4706-a45d-39c86b472703"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:37:08.341262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=32 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:37:08.347309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7a261b6b-abb3-46f6-a7ab-fc42dd7dd367 req-1c08ffdb-3e19-4c8c-9ef6-64463df036aa service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:08.347833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7a261b6b-abb3-46f6-a7ab-fc42dd7dd367 req-1c08ffdb-3e19-4c8c-9ef6-64463df036aa service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:08.348278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7a261b6b-abb3-46f6-a7ab-fc42dd7dd367 req-1c08ffdb-3e19-4c8c-9ef6-64463df036aa service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:08.362972 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-7a261b6b-abb3-46f6-a7ab-fc42dd7dd367 req-1c08ffdb-3e19-4c8c-9ef6-64463df036aa service nova] Creating event network-changed:2c75bc83-8fbd-4706-a45d-39c86b472703 for instance 455babe3-639a-49de-a614-4a37d5e215d8 on n-h2-860687-3 Oct 27 19:37:08.368229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-7a261b6b-abb3-46f6-a7ab-fc42dd7dd367 req-1c08ffdb-3e19-4c8c-9ef6-64463df036aa service nova] Instance 455babe3-639a-49de-a614-4a37d5e215d8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:37:08.379165 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-7a261b6b-abb3-46f6-a7ab-fc42dd7dd367 req-1c08ffdb-3e19-4c8c-9ef6-64463df036aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047961 Oct 27 19:37:08.379804 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3640/7132] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:37:08.851281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-67989da2-7fea-4e4d-b96a-efb05dbed8f5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:08.851918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-67989da2-7fea-4e4d-b96a-efb05dbed8f5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:08.858993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67989da2-7fea-4e4d-b96a-efb05dbed8f5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:08.859507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67989da2-7fea-4e4d-b96a-efb05dbed8f5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:08.859972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67989da2-7fea-4e4d-b96a-efb05dbed8f5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:08.860701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67989da2-7fea-4e4d-b96a-efb05dbed8f5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:08.861179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67989da2-7fea-4e4d-b96a-efb05dbed8f5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:08.861637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67989da2-7fea-4e4d-b96a-efb05dbed8f5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:08.999310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-67989da2-7fea-4e4d-b96a-efb05dbed8f5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:09.007072 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-67989da2-7fea-4e4d-b96a-efb05dbed8f5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1518 microversion: 2.1 time: 0.160301 Oct 27 19:37:09.007654 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3493/7133] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:08 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:10.032317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-62a00c60-8df5-40c2-9b66-e94bf8983e80 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:10.033031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-62a00c60-8df5-40c2-9b66-e94bf8983e80 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:10.039327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62a00c60-8df5-40c2-9b66-e94bf8983e80 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:10.039818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62a00c60-8df5-40c2-9b66-e94bf8983e80 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:10.040262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62a00c60-8df5-40c2-9b66-e94bf8983e80 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:10.040974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62a00c60-8df5-40c2-9b66-e94bf8983e80 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:10.041494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62a00c60-8df5-40c2-9b66-e94bf8983e80 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:10.042041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-62a00c60-8df5-40c2-9b66-e94bf8983e80 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:10.258230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-62a00c60-8df5-40c2-9b66-e94bf8983e80 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:10.266337 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-62a00c60-8df5-40c2-9b66-e94bf8983e80 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1515 microversion: 2.1 time: 0.239108 Oct 27 19:37:10.267020 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3641/7134] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:10 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1515 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:10.289282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d39f87a-d5e8-4dbc-9519-8b84eb1ee993 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:37:10.289861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9d39f87a-d5e8-4dbc-9519-8b84eb1ee993 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:10.297543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d39f87a-d5e8-4dbc-9519-8b84eb1ee993 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:10.298053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d39f87a-d5e8-4dbc-9519-8b84eb1ee993 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:10.298536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d39f87a-d5e8-4dbc-9519-8b84eb1ee993 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:10.299254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d39f87a-d5e8-4dbc-9519-8b84eb1ee993 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:10.299724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d39f87a-d5e8-4dbc-9519-8b84eb1ee993 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:10.300169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9d39f87a-d5e8-4dbc-9519-8b84eb1ee993 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:10.360268 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9d39f87a-d5e8-4dbc-9519-8b84eb1ee993 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "POST /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8/action" status: 204 len: 0 microversion: 2.1 time: 0.074841 Oct 27 19:37:10.361073 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3494/7135] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:37:10 2022] POST /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:37:10.368995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7f00c807-c921-44bc-a2c8-86ba7af33290 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:10.369727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7f00c807-c921-44bc-a2c8-86ba7af33290 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:10.376644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f00c807-c921-44bc-a2c8-86ba7af33290 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:10.377379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f00c807-c921-44bc-a2c8-86ba7af33290 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:10.377992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f00c807-c921-44bc-a2c8-86ba7af33290 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:10.378947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f00c807-c921-44bc-a2c8-86ba7af33290 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:10.379572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f00c807-c921-44bc-a2c8-86ba7af33290 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:10.380047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f00c807-c921-44bc-a2c8-86ba7af33290 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:10.593351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7f00c807-c921-44bc-a2c8-86ba7af33290 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:10.601207 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7f00c807-c921-44bc-a2c8-86ba7af33290 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1515 microversion: 2.1 time: 0.236052 Oct 27 19:37:10.601809 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3642/7136] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:10 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:11.628138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e08d3697-975f-4841-a5c3-9ce0b70465a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:11.628906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e08d3697-975f-4841-a5c3-9ce0b70465a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:11.631430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=30 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:37:11.637395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e08d3697-975f-4841-a5c3-9ce0b70465a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:11.638357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e08d3697-975f-4841-a5c3-9ce0b70465a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:11.638957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e08d3697-975f-4841-a5c3-9ce0b70465a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:11.639752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e08d3697-975f-4841-a5c3-9ce0b70465a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:11.640673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e08d3697-975f-4841-a5c3-9ce0b70465a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:11.641319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e08d3697-975f-4841-a5c3-9ce0b70465a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:11.648801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:37:11.798367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e08d3697-975f-4841-a5c3-9ce0b70465a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:11.807918 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e08d3697-975f-4841-a5c3-9ce0b70465a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1507 microversion: 2.1 time: 0.185852 Oct 27 19:37:11.808938 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3495/7137] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:11 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1507 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:11.831720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ad6b24bf-66f7-4200-9b16-34a0c47fce71 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:11.832337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ad6b24bf-66f7-4200-9b16-34a0c47fce71 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:11.840731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad6b24bf-66f7-4200-9b16-34a0c47fce71 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:11.841234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad6b24bf-66f7-4200-9b16-34a0c47fce71 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:11.841682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad6b24bf-66f7-4200-9b16-34a0c47fce71 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:11.842462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad6b24bf-66f7-4200-9b16-34a0c47fce71 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:11.842979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad6b24bf-66f7-4200-9b16-34a0c47fce71 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:11.843410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ad6b24bf-66f7-4200-9b16-34a0c47fce71 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:11.992940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ad6b24bf-66f7-4200-9b16-34a0c47fce71 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:12.002099 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ad6b24bf-66f7-4200-9b16-34a0c47fce71 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1507 microversion: 2.1 time: 0.174788 Oct 27 19:37:12.002716 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3643/7138] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:11 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:12.030315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-718af463-0aa0-4496-b48e-2e6eb0a0b4c3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Action: 'create', calling method: .version_select at 0x7fc8699b6c10>, body: {"keypair": {"name": "tempest-keypair-654074373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFwTE0D5yHKnJSqv7oUMM2evQNMKSa4UpNoZLdUT2r3i9s+wezxNmvAx/tQNVoJ/mRnAilb+h+ZKfSQ+DWYOecSyZomZyONURp3tHpctYNF001KoxaTHpUPI2RfH0uzDw=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:37:12.047549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-718af463-0aa0-4496-b48e-2e6eb0a0b4c3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Getting quotas for project 99515ca14d7b4d5686ce8b423bf3bec5. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:37:12.052937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-718af463-0aa0-4496-b48e-2e6eb0a0b4c3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Getting quotas for user 530926eb36014c24af125c6e5acbd6aa and project 99515ca14d7b4d5686ce8b423bf3bec5. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:37:12.081865 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-718af463-0aa0-4496-b48e-2e6eb0a0b4c3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055654 Oct 27 19:37:12.082515 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3496/7139] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:37:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:37:12.836747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e34f7de8-69b9-4bc1-b584-1c3113a520fe req-1110b6f1-7adb-4fd3-9800-618d5c4a4312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455babe3-639a-49de-a614-4a37d5e215d8", "name": "network-vif-plugged", "status": "completed", "tag": "2c75bc83-8fbd-4706-a45d-39c86b472703"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:37:12.852189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e34f7de8-69b9-4bc1-b584-1c3113a520fe req-1110b6f1-7adb-4fd3-9800-618d5c4a4312 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:12.852760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e34f7de8-69b9-4bc1-b584-1c3113a520fe req-1110b6f1-7adb-4fd3-9800-618d5c4a4312 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:12.853265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e34f7de8-69b9-4bc1-b584-1c3113a520fe req-1110b6f1-7adb-4fd3-9800-618d5c4a4312 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:12.865116 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e34f7de8-69b9-4bc1-b584-1c3113a520fe req-1110b6f1-7adb-4fd3-9800-618d5c4a4312 service nova] Creating event network-vif-plugged:2c75bc83-8fbd-4706-a45d-39c86b472703 for instance 455babe3-639a-49de-a614-4a37d5e215d8 on n-h2-860687-3 Oct 27 19:37:12.871271 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e34f7de8-69b9-4bc1-b584-1c3113a520fe req-1110b6f1-7adb-4fd3-9800-618d5c4a4312 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039301 Oct 27 19:37:12.872323 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3644/7140] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:37:13.602541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aea0426c-ef79-46fe-8bcc-efe9127b359e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:13.603175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aea0426c-ef79-46fe-8bcc-efe9127b359e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:13.613410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aea0426c-ef79-46fe-8bcc-efe9127b359e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:13.613916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aea0426c-ef79-46fe-8bcc-efe9127b359e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:13.614422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aea0426c-ef79-46fe-8bcc-efe9127b359e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:13.615116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aea0426c-ef79-46fe-8bcc-efe9127b359e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:13.615592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aea0426c-ef79-46fe-8bcc-efe9127b359e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:13.616041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aea0426c-ef79-46fe-8bcc-efe9127b359e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:13.750029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-aea0426c-ef79-46fe-8bcc-efe9127b359e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:13.757755 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aea0426c-ef79-46fe-8bcc-efe9127b359e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 200 len: 1507 microversion: 2.1 time: 0.160008 Oct 27 19:37:13.758374 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3497/7141] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:13 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:13.780716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-64afa068-2082-4c37-861f-a8b5a71f02a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:13.781310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-64afa068-2082-4c37-861f-a8b5a71f02a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:13.787467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64afa068-2082-4c37-861f-a8b5a71f02a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:13.787948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64afa068-2082-4c37-861f-a8b5a71f02a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:13.788389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64afa068-2082-4c37-861f-a8b5a71f02a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:13.789095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64afa068-2082-4c37-861f-a8b5a71f02a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:13.789541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64afa068-2082-4c37-861f-a8b5a71f02a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:13.789970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64afa068-2082-4c37-861f-a8b5a71f02a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:13.816054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-64afa068-2082-4c37-861f-a8b5a71f02a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:37:13.890231 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-64afa068-2082-4c37-861f-a8b5a71f02a5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "DELETE /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 204 len: 0 microversion: 2.1 time: 0.113416 Oct 27 19:37:13.892346 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3645/7142] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:37:13 2022] DELETE /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:37:13.947617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-424052805", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "4fdcc0cb-66a7-410f-81c5-b8b60371538b"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:37:14.000559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] validate_networks() for [('4fdcc0cb-66a7-410f-81c5-b8b60371538b', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:37:14.377231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:37:14.377683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:37:14.378221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:37:14.378705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:37:14.379171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:37:14.388790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:14.389297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:14.389756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:14.390543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:14.391020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:14.391470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:14.408568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Getting quotas for project 99515ca14d7b4d5686ce8b423bf3bec5. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:37:14.413835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Getting quotas for user 530926eb36014c24af125c6e5acbd6aa and project 99515ca14d7b4d5686ce8b423bf3bec5. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:37:14.426587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:37:14.428908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:37:14.475691 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-832aa934-bcd1-4886-bb30-c7494132604b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531908 Oct 27 19:37:14.476448 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3498/7143] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:37:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:37:14.488082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a28575cd-c14e-4bc2-8863-6995a19d69d9 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:14.488795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a28575cd-c14e-4bc2-8863-6995a19d69d9 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:14.543505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a28575cd-c14e-4bc2-8863-6995a19d69d9 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:14.551585 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a28575cd-c14e-4bc2-8863-6995a19d69d9 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1217 microversion: 2.1 time: 0.067715 Oct 27 19:37:14.552221 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3646/7144] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:14 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:15.578082 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-21d0609a-525f-4cb4-9658-6aa12c65f51a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:15.578990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-21d0609a-525f-4cb4-9658-6aa12c65f51a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:15.589009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d0609a-525f-4cb4-9658-6aa12c65f51a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:15.589528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d0609a-525f-4cb4-9658-6aa12c65f51a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:15.590017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d0609a-525f-4cb4-9658-6aa12c65f51a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:15.590774 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d0609a-525f-4cb4-9658-6aa12c65f51a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:15.591255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d0609a-525f-4cb4-9658-6aa12c65f51a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:15.591706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d0609a-525f-4cb4-9658-6aa12c65f51a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:15.705222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-21d0609a-525f-4cb4-9658-6aa12c65f51a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:15.717649 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-21d0609a-525f-4cb4-9658-6aa12c65f51a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1277 microversion: 2.1 time: 0.146255 Oct 27 19:37:15.718522 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3499/7145] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:15 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:16.027554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5d05e26a-c75c-4dfb-84b6-f769de7230e4 req-5e5f0b45-d4b1-4a0e-8225-b22da0cac2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455babe3-639a-49de-a614-4a37d5e215d8", "name": "network-vif-deleted", "tag": "2c75bc83-8fbd-4706-a45d-39c86b472703"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:37:16.039700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5d05e26a-c75c-4dfb-84b6-f769de7230e4 req-5e5f0b45-d4b1-4a0e-8225-b22da0cac2c0 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:16.040563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5d05e26a-c75c-4dfb-84b6-f769de7230e4 req-5e5f0b45-d4b1-4a0e-8225-b22da0cac2c0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:16.041913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5d05e26a-c75c-4dfb-84b6-f769de7230e4 req-5e5f0b45-d4b1-4a0e-8225-b22da0cac2c0 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:16.055867 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5d05e26a-c75c-4dfb-84b6-f769de7230e4 req-5e5f0b45-d4b1-4a0e-8225-b22da0cac2c0 service nova] Creating event network-vif-deleted:2c75bc83-8fbd-4706-a45d-39c86b472703 for instance 455babe3-639a-49de-a614-4a37d5e215d8 on n-h2-860687-3 Oct 27 19:37:16.062549 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5d05e26a-c75c-4dfb-84b6-f769de7230e4 req-5e5f0b45-d4b1-4a0e-8225-b22da0cac2c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039110 Oct 27 19:37:16.064143 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3647/7146] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:37:16.741262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-54999c77-270b-4c2b-bea8-c938585b4508 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:16.741900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-54999c77-270b-4c2b-bea8-c938585b4508 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:16.750170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-54999c77-270b-4c2b-bea8-c938585b4508 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:16.750933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-54999c77-270b-4c2b-bea8-c938585b4508 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:16.751579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-54999c77-270b-4c2b-bea8-c938585b4508 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:16.752482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-54999c77-270b-4c2b-bea8-c938585b4508 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:16.752956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-54999c77-270b-4c2b-bea8-c938585b4508 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:16.753398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-54999c77-270b-4c2b-bea8-c938585b4508 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:17.040200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-54999c77-270b-4c2b-bea8-c938585b4508 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:17.048999 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-54999c77-270b-4c2b-bea8-c938585b4508 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1317 microversion: 2.1 time: 0.311670 Oct 27 19:37:17.049582 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3500/7147] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:16 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:17.514411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a9c86cac-06b7-4ce2-9b86-82865525675c req-c51ade72-0dc6-4f07-88fb-cc1df74a4733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37fee760-e4a8-42ee-88c1-6fff4d6f1faf", "tag": "ad864b0f-77cc-488c-90c6-f8f7e4e714fb"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:37:17.527344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a9c86cac-06b7-4ce2-9b86-82865525675c req-c51ade72-0dc6-4f07-88fb-cc1df74a4733 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:17.527927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a9c86cac-06b7-4ce2-9b86-82865525675c req-c51ade72-0dc6-4f07-88fb-cc1df74a4733 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:17.528441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a9c86cac-06b7-4ce2-9b86-82865525675c req-c51ade72-0dc6-4f07-88fb-cc1df74a4733 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:17.543858 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a9c86cac-06b7-4ce2-9b86-82865525675c req-c51ade72-0dc6-4f07-88fb-cc1df74a4733 service nova] Creating event network-changed:ad864b0f-77cc-488c-90c6-f8f7e4e714fb for instance 37fee760-e4a8-42ee-88c1-6fff4d6f1faf on n-h2-860687-3 Oct 27 19:37:17.549179 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a9c86cac-06b7-4ce2-9b86-82865525675c req-c51ade72-0dc6-4f07-88fb-cc1df74a4733 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040947 Oct 27 19:37:17.549807 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3648/7148] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:37:18.072991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f0ea967b-49a6-43f2-84b4-6a9be0cc1e1c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:18.073742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f0ea967b-49a6-43f2-84b4-6a9be0cc1e1c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:18.080390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0ea967b-49a6-43f2-84b4-6a9be0cc1e1c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:18.080887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0ea967b-49a6-43f2-84b4-6a9be0cc1e1c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:18.081340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0ea967b-49a6-43f2-84b4-6a9be0cc1e1c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:18.082044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0ea967b-49a6-43f2-84b4-6a9be0cc1e1c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:18.082547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0ea967b-49a6-43f2-84b4-6a9be0cc1e1c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:18.082989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f0ea967b-49a6-43f2-84b4-6a9be0cc1e1c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:18.211640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f0ea967b-49a6-43f2-84b4-6a9be0cc1e1c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:18.220087 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f0ea967b-49a6-43f2-84b4-6a9be0cc1e1c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1317 microversion: 2.1 time: 0.151648 Oct 27 19:37:18.220659 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3501/7149] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:18 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:19.244092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c9b7fa10-1f29-4916-94db-11ea8df09f5c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:19.244836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c9b7fa10-1f29-4916-94db-11ea8df09f5c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:19.250993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9b7fa10-1f29-4916-94db-11ea8df09f5c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:19.251480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9b7fa10-1f29-4916-94db-11ea8df09f5c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:19.251925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9b7fa10-1f29-4916-94db-11ea8df09f5c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:19.252625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9b7fa10-1f29-4916-94db-11ea8df09f5c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:19.253083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9b7fa10-1f29-4916-94db-11ea8df09f5c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:19.253512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c9b7fa10-1f29-4916-94db-11ea8df09f5c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:19.383184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c9b7fa10-1f29-4916-94db-11ea8df09f5c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:19.391146 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c9b7fa10-1f29-4916-94db-11ea8df09f5c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1317 microversion: 2.1 time: 0.152201 Oct 27 19:37:19.391718 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3649/7150] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:19 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:20.414703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6c2c6b3b-6d24-449f-aaa0-17a6a732e82f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:20.415431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6c2c6b3b-6d24-449f-aaa0-17a6a732e82f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:20.423006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c2c6b3b-6d24-449f-aaa0-17a6a732e82f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:20.423637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c2c6b3b-6d24-449f-aaa0-17a6a732e82f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:20.424185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c2c6b3b-6d24-449f-aaa0-17a6a732e82f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:20.424917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c2c6b3b-6d24-449f-aaa0-17a6a732e82f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:20.425395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c2c6b3b-6d24-449f-aaa0-17a6a732e82f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:20.425866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c2c6b3b-6d24-449f-aaa0-17a6a732e82f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:20.563214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6c2c6b3b-6d24-449f-aaa0-17a6a732e82f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:20.571567 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6c2c6b3b-6d24-449f-aaa0-17a6a732e82f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1317 microversion: 2.1 time: 0.160825 Oct 27 19:37:20.572091 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3502/7151] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:20 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:21.594867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-39f0d37b-2b36-4c0f-ad79-7d1c5ef7b153 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:21.595607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-39f0d37b-2b36-4c0f-ad79-7d1c5ef7b153 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:21.602670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39f0d37b-2b36-4c0f-ad79-7d1c5ef7b153 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:21.603163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39f0d37b-2b36-4c0f-ad79-7d1c5ef7b153 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:21.604485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39f0d37b-2b36-4c0f-ad79-7d1c5ef7b153 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:21.605570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39f0d37b-2b36-4c0f-ad79-7d1c5ef7b153 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:21.606034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39f0d37b-2b36-4c0f-ad79-7d1c5ef7b153 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:21.606506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39f0d37b-2b36-4c0f-ad79-7d1c5ef7b153 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:21.739513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-39f0d37b-2b36-4c0f-ad79-7d1c5ef7b153 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:21.747254 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-39f0d37b-2b36-4c0f-ad79-7d1c5ef7b153 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1317 microversion: 2.1 time: 0.156366 Oct 27 19:37:21.747828 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3650/7152] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:21 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:22.770762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d43ab3b6-d0c4-40bd-a227-27f6eb842a0e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:22.771379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d43ab3b6-d0c4-40bd-a227-27f6eb842a0e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:22.779443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d43ab3b6-d0c4-40bd-a227-27f6eb842a0e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:22.779942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d43ab3b6-d0c4-40bd-a227-27f6eb842a0e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:22.780650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d43ab3b6-d0c4-40bd-a227-27f6eb842a0e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:22.781407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d43ab3b6-d0c4-40bd-a227-27f6eb842a0e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:22.781878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d43ab3b6-d0c4-40bd-a227-27f6eb842a0e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:22.782321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d43ab3b6-d0c4-40bd-a227-27f6eb842a0e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:22.919785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d43ab3b6-d0c4-40bd-a227-27f6eb842a0e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:22.927497 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d43ab3b6-d0c4-40bd-a227-27f6eb842a0e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1317 microversion: 2.1 time: 0.160798 Oct 27 19:37:22.928069 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3503/7153] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:22 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:23.951009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c748d66a-e798-4b38-b5a1-2a7d057a1134 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:23.951727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c748d66a-e798-4b38-b5a1-2a7d057a1134 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:23.958967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c748d66a-e798-4b38-b5a1-2a7d057a1134 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:23.959532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c748d66a-e798-4b38-b5a1-2a7d057a1134 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:23.960043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c748d66a-e798-4b38-b5a1-2a7d057a1134 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:23.960810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c748d66a-e798-4b38-b5a1-2a7d057a1134 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:23.961334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c748d66a-e798-4b38-b5a1-2a7d057a1134 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:23.961850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c748d66a-e798-4b38-b5a1-2a7d057a1134 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:24.092779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c748d66a-e798-4b38-b5a1-2a7d057a1134 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:24.101506 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c748d66a-e798-4b38-b5a1-2a7d057a1134 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1317 microversion: 2.1 time: 0.154332 Oct 27 19:37:24.102320 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3651/7154] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:23 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:24.871460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-fd9ad825-ca99-4abf-b626-3234fbb54eea req-9edd12e9-c77c-4c82-87ed-b697034f1d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37fee760-e4a8-42ee-88c1-6fff4d6f1faf", "name": "network-vif-plugged", "status": "completed", "tag": "ad864b0f-77cc-488c-90c6-f8f7e4e714fb"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:37:24.877575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:37:24.878242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=10 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:37:24.884294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fd9ad825-ca99-4abf-b626-3234fbb54eea req-9edd12e9-c77c-4c82-87ed-b697034f1d39 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:24.884846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fd9ad825-ca99-4abf-b626-3234fbb54eea req-9edd12e9-c77c-4c82-87ed-b697034f1d39 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:24.885302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fd9ad825-ca99-4abf-b626-3234fbb54eea req-9edd12e9-c77c-4c82-87ed-b697034f1d39 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:24.896775 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-fd9ad825-ca99-4abf-b626-3234fbb54eea req-9edd12e9-c77c-4c82-87ed-b697034f1d39 service nova] Creating event network-vif-plugged:ad864b0f-77cc-488c-90c6-f8f7e4e714fb for instance 37fee760-e4a8-42ee-88c1-6fff4d6f1faf on n-h2-860687-3 Oct 27 19:37:24.902283 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-fd9ad825-ca99-4abf-b626-3234fbb54eea req-9edd12e9-c77c-4c82-87ed-b697034f1d39 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035300 Oct 27 19:37:24.902923 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3504/7155] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:37:25.125588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e0263b0e-9aa1-4ad3-b892-da6aa01a3109 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:25.126205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e0263b0e-9aa1-4ad3-b892-da6aa01a3109 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:25.128189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:37:25.134238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0263b0e-9aa1-4ad3-b892-da6aa01a3109 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:25.134785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0263b0e-9aa1-4ad3-b892-da6aa01a3109 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:25.135729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0263b0e-9aa1-4ad3-b892-da6aa01a3109 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:25.136427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0263b0e-9aa1-4ad3-b892-da6aa01a3109 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:25.136882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0263b0e-9aa1-4ad3-b892-da6aa01a3109 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:25.137310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e0263b0e-9aa1-4ad3-b892-da6aa01a3109 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:25.270912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e0263b0e-9aa1-4ad3-b892-da6aa01a3109 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:25.279732 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e0263b0e-9aa1-4ad3-b892-da6aa01a3109 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1317 microversion: 2.1 time: 0.158090 Oct 27 19:37:25.280314 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3652/7156] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:25 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:26.306058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d78c40c3-2a80-4111-bcdd-cf1631870ecc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:26.307421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d78c40c3-2a80-4111-bcdd-cf1631870ecc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:26.313988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d78c40c3-2a80-4111-bcdd-cf1631870ecc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:26.314527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d78c40c3-2a80-4111-bcdd-cf1631870ecc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:26.314989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d78c40c3-2a80-4111-bcdd-cf1631870ecc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:26.315699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d78c40c3-2a80-4111-bcdd-cf1631870ecc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:26.316171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d78c40c3-2a80-4111-bcdd-cf1631870ecc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:26.316614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d78c40c3-2a80-4111-bcdd-cf1631870ecc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:26.460178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d78c40c3-2a80-4111-bcdd-cf1631870ecc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:26.468321 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d78c40c3-2a80-4111-bcdd-cf1631870ecc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1317 microversion: 2.1 time: 0.167443 Oct 27 19:37:26.468907 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3505/7157] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:26 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:27.491877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f93de49a-6c8b-45d1-bf8e-a433cf82bd8f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:27.493238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f93de49a-6c8b-45d1-bf8e-a433cf82bd8f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:27.500372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f93de49a-6c8b-45d1-bf8e-a433cf82bd8f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:27.500864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f93de49a-6c8b-45d1-bf8e-a433cf82bd8f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:27.501308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f93de49a-6c8b-45d1-bf8e-a433cf82bd8f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:27.502014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f93de49a-6c8b-45d1-bf8e-a433cf82bd8f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:27.502496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f93de49a-6c8b-45d1-bf8e-a433cf82bd8f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:27.502979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f93de49a-6c8b-45d1-bf8e-a433cf82bd8f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:27.634710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f93de49a-6c8b-45d1-bf8e-a433cf82bd8f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:27.638855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:37:27.643869 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f93de49a-6c8b-45d1-bf8e-a433cf82bd8f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1507 microversion: 2.1 time: 0.156172 Oct 27 19:37:27.644451 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3653/7158] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:27 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:27.665843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d8da461b-a9f8-4739-b396-d91db164e10f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:27.666663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d8da461b-a9f8-4739-b396-d91db164e10f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:27.673471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8da461b-a9f8-4739-b396-d91db164e10f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:27.673976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8da461b-a9f8-4739-b396-d91db164e10f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:27.674486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8da461b-a9f8-4739-b396-d91db164e10f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:27.675211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8da461b-a9f8-4739-b396-d91db164e10f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:27.675688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8da461b-a9f8-4739-b396-d91db164e10f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:27.676135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8da461b-a9f8-4739-b396-d91db164e10f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:27.806425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d8da461b-a9f8-4739-b396-d91db164e10f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:27.815007 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d8da461b-a9f8-4739-b396-d91db164e10f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1507 microversion: 2.1 time: 0.153061 Oct 27 19:37:27.815582 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3506/7159] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:27 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:27.838135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:37:27.840461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:27.848080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:27.848581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:27.849033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:27.849738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:27.850212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:27.850677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:27.883243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:27.888738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Old instance type m1.heat2, new instance type m1.heat {{(pid=127029) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 19:37:27.895283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:37:27.895733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:37:27.896304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:37:27.896725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:37:27.897350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:37:27.960545 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ee1b5552-ed97-4bb3-80af-15a179060d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "POST /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf/action" status: 202 len: 0 microversion: 2.1 time: 0.126525 Oct 27 19:37:27.961168 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3654/7160] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:37:27 2022] POST /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:37:27.969742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2387c852-b346-461b-a9b8-e86a8c641862 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:27.970635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2387c852-b346-461b-a9b8-e86a8c641862 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:27.976703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2387c852-b346-461b-a9b8-e86a8c641862 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:27.977217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2387c852-b346-461b-a9b8-e86a8c641862 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:27.977678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2387c852-b346-461b-a9b8-e86a8c641862 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:27.978921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2387c852-b346-461b-a9b8-e86a8c641862 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:27.979401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2387c852-b346-461b-a9b8-e86a8c641862 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:27.979950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2387c852-b346-461b-a9b8-e86a8c641862 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:28.119693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2387c852-b346-461b-a9b8-e86a8c641862 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:28.127897 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2387c852-b346-461b-a9b8-e86a8c641862 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1514 microversion: 2.1 time: 0.162058 Oct 27 19:37:28.128482 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3507/7161] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:27 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:29.153105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-58e7445d-5255-48b3-ae89-eee833caa25e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:29.153725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-58e7445d-5255-48b3-ae89-eee833caa25e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:29.159869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58e7445d-5255-48b3-ae89-eee833caa25e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:29.160348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58e7445d-5255-48b3-ae89-eee833caa25e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:29.160783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58e7445d-5255-48b3-ae89-eee833caa25e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:29.161470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58e7445d-5255-48b3-ae89-eee833caa25e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:29.161921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58e7445d-5255-48b3-ae89-eee833caa25e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:29.162349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-58e7445d-5255-48b3-ae89-eee833caa25e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:29.307684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-58e7445d-5255-48b3-ae89-eee833caa25e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:29.316261 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-58e7445d-5255-48b3-ae89-eee833caa25e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1514 microversion: 2.1 time: 0.168801 Oct 27 19:37:29.316947 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3655/7162] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:29 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:30.340864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c1b253d7-ed53-43ad-9ab3-0934092d27bc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:30.341496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c1b253d7-ed53-43ad-9ab3-0934092d27bc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:30.348524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1b253d7-ed53-43ad-9ab3-0934092d27bc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:30.349029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1b253d7-ed53-43ad-9ab3-0934092d27bc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:30.349484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1b253d7-ed53-43ad-9ab3-0934092d27bc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:30.350197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1b253d7-ed53-43ad-9ab3-0934092d27bc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:30.350701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1b253d7-ed53-43ad-9ab3-0934092d27bc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:30.351148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1b253d7-ed53-43ad-9ab3-0934092d27bc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:30.482032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c1b253d7-ed53-43ad-9ab3-0934092d27bc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:30.490672 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c1b253d7-ed53-43ad-9ab3-0934092d27bc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.154355 Oct 27 19:37:30.491258 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3508/7163] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:30 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:31.515816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c0e5e356-938b-4f3f-a886-c6f7f6494c10 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:31.516455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c0e5e356-938b-4f3f-a886-c6f7f6494c10 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:31.523498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0e5e356-938b-4f3f-a886-c6f7f6494c10 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:31.524003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0e5e356-938b-4f3f-a886-c6f7f6494c10 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:31.524448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0e5e356-938b-4f3f-a886-c6f7f6494c10 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:31.525237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0e5e356-938b-4f3f-a886-c6f7f6494c10 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:31.526372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0e5e356-938b-4f3f-a886-c6f7f6494c10 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:31.526859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c0e5e356-938b-4f3f-a886-c6f7f6494c10 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:31.659825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c0e5e356-938b-4f3f-a886-c6f7f6494c10 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:31.668030 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c0e5e356-938b-4f3f-a886-c6f7f6494c10 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.156263 Oct 27 19:37:31.668609 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3656/7164] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:31 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:37:32.692690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-15d392c8-9f33-483e-8093-04cedc739d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:32.693252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-15d392c8-9f33-483e-8093-04cedc739d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:32.701215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15d392c8-9f33-483e-8093-04cedc739d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:32.701736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15d392c8-9f33-483e-8093-04cedc739d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:32.702201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15d392c8-9f33-483e-8093-04cedc739d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:32.702970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15d392c8-9f33-483e-8093-04cedc739d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:32.703450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15d392c8-9f33-483e-8093-04cedc739d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:32.703906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15d392c8-9f33-483e-8093-04cedc739d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:32.839623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-15d392c8-9f33-483e-8093-04cedc739d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:32.847473 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-15d392c8-9f33-483e-8093-04cedc739d79 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.159235 Oct 27 19:37:32.848058 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3509/7165] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:32 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:33.871155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af73fd88-74b0-4afc-a223-b743a13c564a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:33.871781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-af73fd88-74b0-4afc-a223-b743a13c564a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:33.878785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af73fd88-74b0-4afc-a223-b743a13c564a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:33.879278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af73fd88-74b0-4afc-a223-b743a13c564a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:33.879723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af73fd88-74b0-4afc-a223-b743a13c564a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:33.880423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af73fd88-74b0-4afc-a223-b743a13c564a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:33.880883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af73fd88-74b0-4afc-a223-b743a13c564a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:33.881316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af73fd88-74b0-4afc-a223-b743a13c564a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:34.016130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-af73fd88-74b0-4afc-a223-b743a13c564a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:34.023846 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-af73fd88-74b0-4afc-a223-b743a13c564a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.157037 Oct 27 19:37:34.024430 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3657/7166] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:33 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:35.048226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9c71f0ca-c058-4082-9841-5bc063404016 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:35.048865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9c71f0ca-c058-4082-9841-5bc063404016 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:35.055922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c71f0ca-c058-4082-9841-5bc063404016 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:35.056485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c71f0ca-c058-4082-9841-5bc063404016 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:35.056956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c71f0ca-c058-4082-9841-5bc063404016 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:35.057762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c71f0ca-c058-4082-9841-5bc063404016 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:35.058247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c71f0ca-c058-4082-9841-5bc063404016 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:35.058726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c71f0ca-c058-4082-9841-5bc063404016 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:35.190814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9c71f0ca-c058-4082-9841-5bc063404016 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:35.198518 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9c71f0ca-c058-4082-9841-5bc063404016 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.154271 Oct 27 19:37:35.199107 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3510/7167] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:35 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:37:36.222591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-53de80e3-c9a6-4ce3-a057-e00ac71fc2ac tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:36.223216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-53de80e3-c9a6-4ce3-a057-e00ac71fc2ac tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:36.230803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53de80e3-c9a6-4ce3-a057-e00ac71fc2ac tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:36.231296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53de80e3-c9a6-4ce3-a057-e00ac71fc2ac tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:36.231738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53de80e3-c9a6-4ce3-a057-e00ac71fc2ac tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:36.232439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53de80e3-c9a6-4ce3-a057-e00ac71fc2ac tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:36.232908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53de80e3-c9a6-4ce3-a057-e00ac71fc2ac tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:36.233346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53de80e3-c9a6-4ce3-a057-e00ac71fc2ac tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:36.366145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-53de80e3-c9a6-4ce3-a057-e00ac71fc2ac tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:36.374705 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-53de80e3-c9a6-4ce3-a057-e00ac71fc2ac tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.156028 Oct 27 19:37:36.375294 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3658/7168] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:36 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:37.398758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7c647f95-228c-42e6-90b4-6b298400868d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:37.399410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7c647f95-228c-42e6-90b4-6b298400868d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:37.406447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c647f95-228c-42e6-90b4-6b298400868d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:37.406955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c647f95-228c-42e6-90b4-6b298400868d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:37.407414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c647f95-228c-42e6-90b4-6b298400868d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:37.408125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c647f95-228c-42e6-90b4-6b298400868d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:37.408594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c647f95-228c-42e6-90b4-6b298400868d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:37.409064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c647f95-228c-42e6-90b4-6b298400868d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:37.545208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7c647f95-228c-42e6-90b4-6b298400868d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:37.553006 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7c647f95-228c-42e6-90b4-6b298400868d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.158246 Oct 27 19:37:37.553588 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3511/7169] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:37 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:38.578818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-848b8c97-eaab-4ff7-8fa3-5dafa4d51992 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:38.579457 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-848b8c97-eaab-4ff7-8fa3-5dafa4d51992 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:38.582851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:37:38.589470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-848b8c97-eaab-4ff7-8fa3-5dafa4d51992 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:38.589957 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-848b8c97-eaab-4ff7-8fa3-5dafa4d51992 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:38.590420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-848b8c97-eaab-4ff7-8fa3-5dafa4d51992 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:38.591126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-848b8c97-eaab-4ff7-8fa3-5dafa4d51992 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:38.591585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-848b8c97-eaab-4ff7-8fa3-5dafa4d51992 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:38.592015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-848b8c97-eaab-4ff7-8fa3-5dafa4d51992 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:38.724876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-848b8c97-eaab-4ff7-8fa3-5dafa4d51992 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:38.732762 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-848b8c97-eaab-4ff7-8fa3-5dafa4d51992 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.159691 Oct 27 19:37:38.733352 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3659/7170] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:38 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:39.757169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d0cbafef-a82d-472d-8508-e481f6d90e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:39.757811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d0cbafef-a82d-472d-8508-e481f6d90e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:39.767316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0cbafef-a82d-472d-8508-e481f6d90e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:39.767822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0cbafef-a82d-472d-8508-e481f6d90e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:39.768283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0cbafef-a82d-472d-8508-e481f6d90e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:39.769006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0cbafef-a82d-472d-8508-e481f6d90e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:39.769500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0cbafef-a82d-472d-8508-e481f6d90e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:39.769939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d0cbafef-a82d-472d-8508-e481f6d90e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:39.901744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d0cbafef-a82d-472d-8508-e481f6d90e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:39.909590 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d0cbafef-a82d-472d-8508-e481f6d90e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.156676 Oct 27 19:37:39.910167 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3512/7171] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:39 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:37:40.934174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7151ba83-bc56-4e63-813b-2e6f9229b337 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:40.934897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7151ba83-bc56-4e63-813b-2e6f9229b337 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:40.941893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7151ba83-bc56-4e63-813b-2e6f9229b337 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:40.942395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7151ba83-bc56-4e63-813b-2e6f9229b337 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:40.942864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7151ba83-bc56-4e63-813b-2e6f9229b337 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:40.943568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7151ba83-bc56-4e63-813b-2e6f9229b337 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:40.944034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7151ba83-bc56-4e63-813b-2e6f9229b337 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:40.944470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7151ba83-bc56-4e63-813b-2e6f9229b337 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:41.082440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7151ba83-bc56-4e63-813b-2e6f9229b337 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:41.090241 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7151ba83-bc56-4e63-813b-2e6f9229b337 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.160659 Oct 27 19:37:41.090867 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3660/7172] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:40 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:42.113548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1f94a981-4ab7-4691-8106-8267b2ad66ee tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:42.114182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1f94a981-4ab7-4691-8106-8267b2ad66ee tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:42.117109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:37:42.123456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f94a981-4ab7-4691-8106-8267b2ad66ee tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:42.123959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f94a981-4ab7-4691-8106-8267b2ad66ee tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:42.124415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f94a981-4ab7-4691-8106-8267b2ad66ee tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:42.125159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f94a981-4ab7-4691-8106-8267b2ad66ee tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:42.125631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f94a981-4ab7-4691-8106-8267b2ad66ee tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:42.126076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f94a981-4ab7-4691-8106-8267b2ad66ee tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:42.128867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=94 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:37:42.260097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1f94a981-4ab7-4691-8106-8267b2ad66ee tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:42.267994 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1f94a981-4ab7-4691-8106-8267b2ad66ee tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.158395 Oct 27 19:37:42.268582 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3513/7173] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:42 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:43.293853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9990ecde-a0a7-45e2-94b6-10b50e55c3c8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:43.294506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9990ecde-a0a7-45e2-94b6-10b50e55c3c8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:43.301466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9990ecde-a0a7-45e2-94b6-10b50e55c3c8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:43.301960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9990ecde-a0a7-45e2-94b6-10b50e55c3c8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:43.302439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9990ecde-a0a7-45e2-94b6-10b50e55c3c8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:43.303221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9990ecde-a0a7-45e2-94b6-10b50e55c3c8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:43.303684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9990ecde-a0a7-45e2-94b6-10b50e55c3c8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:43.304119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9990ecde-a0a7-45e2-94b6-10b50e55c3c8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:43.434838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9990ecde-a0a7-45e2-94b6-10b50e55c3c8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:43.442938 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9990ecde-a0a7-45e2-94b6-10b50e55c3c8 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.153843 Oct 27 19:37:43.443517 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3661/7174] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:43 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:44.465146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5db18063-ab8e-42aa-91ae-aebda4c55f98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:44.465785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5db18063-ab8e-42aa-91ae-aebda4c55f98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:44.472941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5db18063-ab8e-42aa-91ae-aebda4c55f98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:44.473448 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5db18063-ab8e-42aa-91ae-aebda4c55f98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:44.473911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5db18063-ab8e-42aa-91ae-aebda4c55f98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:44.474653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5db18063-ab8e-42aa-91ae-aebda4c55f98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:44.475130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5db18063-ab8e-42aa-91ae-aebda4c55f98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:44.475581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5db18063-ab8e-42aa-91ae-aebda4c55f98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:44.608261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5db18063-ab8e-42aa-91ae-aebda4c55f98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:44.616038 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5db18063-ab8e-42aa-91ae-aebda4c55f98 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.154873 Oct 27 19:37:44.616618 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3514/7175] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:44 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:45.640542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-01166061-145a-4ca3-883c-407c14f99d2f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:45.641193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-01166061-145a-4ca3-883c-407c14f99d2f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:45.648100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01166061-145a-4ca3-883c-407c14f99d2f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:45.648588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01166061-145a-4ca3-883c-407c14f99d2f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:45.649033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01166061-145a-4ca3-883c-407c14f99d2f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:45.649740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01166061-145a-4ca3-883c-407c14f99d2f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:45.650219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01166061-145a-4ca3-883c-407c14f99d2f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:45.650677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-01166061-145a-4ca3-883c-407c14f99d2f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:45.785086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-01166061-145a-4ca3-883c-407c14f99d2f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:45.793377 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-01166061-145a-4ca3-883c-407c14f99d2f tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.156783 Oct 27 19:37:45.793955 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3662/7176] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:45 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:46.817191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cfc89d2b-0db2-4b29-ade6-eff8dd54ecbc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:46.817816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cfc89d2b-0db2-4b29-ade6-eff8dd54ecbc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:46.825261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfc89d2b-0db2-4b29-ade6-eff8dd54ecbc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:46.825757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfc89d2b-0db2-4b29-ade6-eff8dd54ecbc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:46.826212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfc89d2b-0db2-4b29-ade6-eff8dd54ecbc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:46.826947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfc89d2b-0db2-4b29-ade6-eff8dd54ecbc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:46.827413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfc89d2b-0db2-4b29-ade6-eff8dd54ecbc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:46.827851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cfc89d2b-0db2-4b29-ade6-eff8dd54ecbc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:46.961868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cfc89d2b-0db2-4b29-ade6-eff8dd54ecbc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:46.969598 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cfc89d2b-0db2-4b29-ade6-eff8dd54ecbc tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.156505 Oct 27 19:37:46.970180 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3515/7177] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:46 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:47.993735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2344e9a5-d67c-49d4-9b8f-014057ccf120 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:47.994367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2344e9a5-d67c-49d4-9b8f-014057ccf120 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:48.001296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2344e9a5-d67c-49d4-9b8f-014057ccf120 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:48.001790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2344e9a5-d67c-49d4-9b8f-014057ccf120 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:48.002260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2344e9a5-d67c-49d4-9b8f-014057ccf120 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:48.002988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2344e9a5-d67c-49d4-9b8f-014057ccf120 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:48.003453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2344e9a5-d67c-49d4-9b8f-014057ccf120 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:48.003888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2344e9a5-d67c-49d4-9b8f-014057ccf120 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:48.132218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2344e9a5-d67c-49d4-9b8f-014057ccf120 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:48.140477 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2344e9a5-d67c-49d4-9b8f-014057ccf120 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.150748 Oct 27 19:37:48.141055 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3663/7178] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:47 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:49.163812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cde5ce41-45ce-435e-9d9e-87fba357a37d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:49.164364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cde5ce41-45ce-435e-9d9e-87fba357a37d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:49.171246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cde5ce41-45ce-435e-9d9e-87fba357a37d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:49.171747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cde5ce41-45ce-435e-9d9e-87fba357a37d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:49.172200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cde5ce41-45ce-435e-9d9e-87fba357a37d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:49.172905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cde5ce41-45ce-435e-9d9e-87fba357a37d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:49.173371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cde5ce41-45ce-435e-9d9e-87fba357a37d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:49.173812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cde5ce41-45ce-435e-9d9e-87fba357a37d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:49.304716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cde5ce41-45ce-435e-9d9e-87fba357a37d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:49.313044 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cde5ce41-45ce-435e-9d9e-87fba357a37d tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.153240 Oct 27 19:37:49.313622 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3516/7179] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:49 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:50.336496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b7ecb517-9302-4fc5-aa11-d71556b307a3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:50.337137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b7ecb517-9302-4fc5-aa11-d71556b307a3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:50.344875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7ecb517-9302-4fc5-aa11-d71556b307a3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:50.345371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7ecb517-9302-4fc5-aa11-d71556b307a3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:50.345815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7ecb517-9302-4fc5-aa11-d71556b307a3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:50.346562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7ecb517-9302-4fc5-aa11-d71556b307a3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:50.347026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7ecb517-9302-4fc5-aa11-d71556b307a3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:50.347462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b7ecb517-9302-4fc5-aa11-d71556b307a3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:50.486070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b7ecb517-9302-4fc5-aa11-d71556b307a3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:50.494354 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b7ecb517-9302-4fc5-aa11-d71556b307a3 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.161733 Oct 27 19:37:50.494965 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3664/7180] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:50 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:51.517179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5c715192-62ed-456d-af58-48e5ef64aff1 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:51.517822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5c715192-62ed-456d-af58-48e5ef64aff1 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:51.524723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c715192-62ed-456d-af58-48e5ef64aff1 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:51.525238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c715192-62ed-456d-af58-48e5ef64aff1 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:51.525695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c715192-62ed-456d-af58-48e5ef64aff1 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:51.526437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c715192-62ed-456d-af58-48e5ef64aff1 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:51.526917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c715192-62ed-456d-af58-48e5ef64aff1 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:51.527362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c715192-62ed-456d-af58-48e5ef64aff1 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:51.658994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5c715192-62ed-456d-af58-48e5ef64aff1 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:51.666901 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5c715192-62ed-456d-af58-48e5ef64aff1 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.153643 Oct 27 19:37:51.667473 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3517/7181] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:51 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:52.690320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4fd4c828-d1b6-4d70-ac66-3156b28629c0 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:52.690998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4fd4c828-d1b6-4d70-ac66-3156b28629c0 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:52.698564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fd4c828-d1b6-4d70-ac66-3156b28629c0 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:52.699065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fd4c828-d1b6-4d70-ac66-3156b28629c0 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:52.699517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fd4c828-d1b6-4d70-ac66-3156b28629c0 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:52.700224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fd4c828-d1b6-4d70-ac66-3156b28629c0 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:52.700694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fd4c828-d1b6-4d70-ac66-3156b28629c0 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:52.701133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fd4c828-d1b6-4d70-ac66-3156b28629c0 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:52.833726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4fd4c828-d1b6-4d70-ac66-3156b28629c0 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:52.842189 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4fd4c828-d1b6-4d70-ac66-3156b28629c0 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.156109 Oct 27 19:37:52.842818 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3665/7182] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:52 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:53.865429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-78981a65-60c2-4170-8570-f83a53410025 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:53.866092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-78981a65-60c2-4170-8570-f83a53410025 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:53.873418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78981a65-60c2-4170-8570-f83a53410025 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:53.873916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78981a65-60c2-4170-8570-f83a53410025 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:53.874846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78981a65-60c2-4170-8570-f83a53410025 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:53.875558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78981a65-60c2-4170-8570-f83a53410025 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:53.876025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78981a65-60c2-4170-8570-f83a53410025 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:53.876472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78981a65-60c2-4170-8570-f83a53410025 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:54.009363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-78981a65-60c2-4170-8570-f83a53410025 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:54.017396 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-78981a65-60c2-4170-8570-f83a53410025 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.155880 Oct 27 19:37:54.017966 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3518/7183] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:53 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:55.040553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2937c5ed-9c69-4df2-a042-e1cbe5f1ff07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:55.041180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2937c5ed-9c69-4df2-a042-e1cbe5f1ff07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:55.048242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2937c5ed-9c69-4df2-a042-e1cbe5f1ff07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:55.048732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2937c5ed-9c69-4df2-a042-e1cbe5f1ff07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:55.049182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2937c5ed-9c69-4df2-a042-e1cbe5f1ff07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:55.049881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2937c5ed-9c69-4df2-a042-e1cbe5f1ff07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:55.050345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2937c5ed-9c69-4df2-a042-e1cbe5f1ff07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:55.050836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2937c5ed-9c69-4df2-a042-e1cbe5f1ff07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:55.183611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2937c5ed-9c69-4df2-a042-e1cbe5f1ff07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:55.191638 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2937c5ed-9c69-4df2-a042-e1cbe5f1ff07 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.155058 Oct 27 19:37:55.192219 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3666/7184] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:55 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:56.216290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8c89bd5e-28eb-4d32-abaf-b4cb23310c81 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:56.216924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8c89bd5e-28eb-4d32-abaf-b4cb23310c81 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:56.223775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c89bd5e-28eb-4d32-abaf-b4cb23310c81 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:56.224280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c89bd5e-28eb-4d32-abaf-b4cb23310c81 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:56.224737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c89bd5e-28eb-4d32-abaf-b4cb23310c81 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:56.225453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c89bd5e-28eb-4d32-abaf-b4cb23310c81 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:56.225923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c89bd5e-28eb-4d32-abaf-b4cb23310c81 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:56.226372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c89bd5e-28eb-4d32-abaf-b4cb23310c81 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:56.358021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8c89bd5e-28eb-4d32-abaf-b4cb23310c81 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:56.365929 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8c89bd5e-28eb-4d32-abaf-b4cb23310c81 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1519 microversion: 2.1 time: 0.154142 Oct 27 19:37:56.366536 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3519/7185] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:56 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:57.098256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-33de40c2-8d83-482a-8d06-6168c1118bc0 req-90c47a6f-32a0-4307-b8a9-623e9bdcc491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37fee760-e4a8-42ee-88c1-6fff4d6f1faf", "name": "network-vif-unplugged", "status": "completed", "tag": "ad864b0f-77cc-488c-90c6-f8f7e4e714fb"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:37:57.109160 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-33de40c2-8d83-482a-8d06-6168c1118bc0 req-90c47a6f-32a0-4307-b8a9-623e9bdcc491 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:57.109642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-33de40c2-8d83-482a-8d06-6168c1118bc0 req-90c47a6f-32a0-4307-b8a9-623e9bdcc491 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:57.110099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-33de40c2-8d83-482a-8d06-6168c1118bc0 req-90c47a6f-32a0-4307-b8a9-623e9bdcc491 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:57.122569 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-33de40c2-8d83-482a-8d06-6168c1118bc0 req-90c47a6f-32a0-4307-b8a9-623e9bdcc491 service nova] Creating event network-vif-unplugged:ad864b0f-77cc-488c-90c6-f8f7e4e714fb for instance 37fee760-e4a8-42ee-88c1-6fff4d6f1faf on n-h1-860687-3 Oct 27 19:37:57.128036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-33de40c2-8d83-482a-8d06-6168c1118bc0 req-90c47a6f-32a0-4307-b8a9-623e9bdcc491 service nova] Instance 37fee760-e4a8-42ee-88c1-6fff4d6f1faf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:37:57.139888 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-33de40c2-8d83-482a-8d06-6168c1118bc0 req-90c47a6f-32a0-4307-b8a9-623e9bdcc491 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045480 Oct 27 19:37:57.140718 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3667/7186] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:37:57.389467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8bfa6b21-de8f-44b7-b1c0-6a944b892797 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:57.390123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8bfa6b21-de8f-44b7-b1c0-6a944b892797 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:57.397327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8bfa6b21-de8f-44b7-b1c0-6a944b892797 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:57.397838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8bfa6b21-de8f-44b7-b1c0-6a944b892797 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:57.398296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8bfa6b21-de8f-44b7-b1c0-6a944b892797 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:57.399045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8bfa6b21-de8f-44b7-b1c0-6a944b892797 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:57.400130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8bfa6b21-de8f-44b7-b1c0-6a944b892797 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:57.400751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8bfa6b21-de8f-44b7-b1c0-6a944b892797 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:57.544891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8bfa6b21-de8f-44b7-b1c0-6a944b892797 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:57.552692 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8bfa6b21-de8f-44b7-b1c0-6a944b892797 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1518 microversion: 2.1 time: 0.167120 Oct 27 19:37:57.553276 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3520/7187] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:57 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:37:58.578699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c3040567-6c33-4d78-b8f0-bc56ba061e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:58.579412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c3040567-6c33-4d78-b8f0-bc56ba061e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:58.585885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3040567-6c33-4d78-b8f0-bc56ba061e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:58.586372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3040567-6c33-4d78-b8f0-bc56ba061e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:58.586876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3040567-6c33-4d78-b8f0-bc56ba061e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:58.587584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3040567-6c33-4d78-b8f0-bc56ba061e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:58.588047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3040567-6c33-4d78-b8f0-bc56ba061e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:58.588493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3040567-6c33-4d78-b8f0-bc56ba061e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:58.591193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:37:58.722187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c3040567-6c33-4d78-b8f0-bc56ba061e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:58.730946 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c3040567-6c33-4d78-b8f0-bc56ba061e2b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1516 microversion: 2.1 time: 0.157608 Oct 27 19:37:58.731522 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3668/7188] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:58 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:37:59.156462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-01d96a29-4e6c-4f6f-bd73-3238b604d106 req-81a90b8b-7007-4825-9b0c-50bac7194df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37fee760-e4a8-42ee-88c1-6fff4d6f1faf", "tag": "ad864b0f-77cc-488c-90c6-f8f7e4e714fb"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:37:59.167740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-01d96a29-4e6c-4f6f-bd73-3238b604d106 req-81a90b8b-7007-4825-9b0c-50bac7194df5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:59.168264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-01d96a29-4e6c-4f6f-bd73-3238b604d106 req-81a90b8b-7007-4825-9b0c-50bac7194df5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:59.168712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-01d96a29-4e6c-4f6f-bd73-3238b604d106 req-81a90b8b-7007-4825-9b0c-50bac7194df5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:59.180086 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-01d96a29-4e6c-4f6f-bd73-3238b604d106 req-81a90b8b-7007-4825-9b0c-50bac7194df5 service nova] Creating event network-changed:ad864b0f-77cc-488c-90c6-f8f7e4e714fb for instance 37fee760-e4a8-42ee-88c1-6fff4d6f1faf on n-h1-860687-3 Oct 27 19:37:59.185568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-01d96a29-4e6c-4f6f-bd73-3238b604d106 req-81a90b8b-7007-4825-9b0c-50bac7194df5 service nova] Instance 37fee760-e4a8-42ee-88c1-6fff4d6f1faf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:37:59.196805 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-01d96a29-4e6c-4f6f-bd73-3238b604d106 req-81a90b8b-7007-4825-9b0c-50bac7194df5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044021 Oct 27 19:37:59.197405 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3521/7189] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:37:59.757250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-50f7534e-163b-4252-8198-3f48d5a54026 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:37:59.757946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-50f7534e-163b-4252-8198-3f48d5a54026 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:37:59.772930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50f7534e-163b-4252-8198-3f48d5a54026 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:59.773707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50f7534e-163b-4252-8198-3f48d5a54026 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:59.774161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50f7534e-163b-4252-8198-3f48d5a54026 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:59.775469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50f7534e-163b-4252-8198-3f48d5a54026 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:37:59.775933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50f7534e-163b-4252-8198-3f48d5a54026 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:37:59.776368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50f7534e-163b-4252-8198-3f48d5a54026 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:37:59.988441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-50f7534e-163b-4252-8198-3f48d5a54026 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:37:59.996561 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-50f7534e-163b-4252-8198-3f48d5a54026 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1513 microversion: 2.1 time: 0.243667 Oct 27 19:37:59.997149 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3669/7190] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:37:59 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:00.020553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aa5fadbd-c773-4ad1-8cae-093da00582d2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:38:00.021205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aa5fadbd-c773-4ad1-8cae-093da00582d2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:00.028083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa5fadbd-c773-4ad1-8cae-093da00582d2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:00.028589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa5fadbd-c773-4ad1-8cae-093da00582d2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:00.029053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa5fadbd-c773-4ad1-8cae-093da00582d2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:00.029772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa5fadbd-c773-4ad1-8cae-093da00582d2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:00.030249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa5fadbd-c773-4ad1-8cae-093da00582d2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:00.030730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa5fadbd-c773-4ad1-8cae-093da00582d2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:00.091229 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aa5fadbd-c773-4ad1-8cae-093da00582d2 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "POST /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf/action" status: 204 len: 0 microversion: 2.1 time: 0.074833 Oct 27 19:38:00.091903 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3522/7191] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:38:00 2022] POST /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:38:00.100007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-64a65962-804b-452a-8e2e-cdc49d95b4ea tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:00.100631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-64a65962-804b-452a-8e2e-cdc49d95b4ea tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:00.106659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64a65962-804b-452a-8e2e-cdc49d95b4ea tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:00.107179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64a65962-804b-452a-8e2e-cdc49d95b4ea tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:00.107599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64a65962-804b-452a-8e2e-cdc49d95b4ea tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:00.108308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64a65962-804b-452a-8e2e-cdc49d95b4ea tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:00.109015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64a65962-804b-452a-8e2e-cdc49d95b4ea tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:00.109521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64a65962-804b-452a-8e2e-cdc49d95b4ea tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:00.242500 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-64a65962-804b-452a-8e2e-cdc49d95b4ea tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:00.250979 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-64a65962-804b-452a-8e2e-cdc49d95b4ea tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1513 microversion: 2.1 time: 0.154834 Oct 27 19:38:00.251567 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3670/7192] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:00 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:01.275589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fddc4627-d54d-4f9c-8335-71064c63094c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:01.276307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fddc4627-d54d-4f9c-8335-71064c63094c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:01.282602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fddc4627-d54d-4f9c-8335-71064c63094c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:01.283162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fddc4627-d54d-4f9c-8335-71064c63094c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:01.283555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fddc4627-d54d-4f9c-8335-71064c63094c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:01.284263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fddc4627-d54d-4f9c-8335-71064c63094c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:01.284738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fddc4627-d54d-4f9c-8335-71064c63094c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:01.285186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fddc4627-d54d-4f9c-8335-71064c63094c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:01.423630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fddc4627-d54d-4f9c-8335-71064c63094c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:01.431645 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fddc4627-d54d-4f9c-8335-71064c63094c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1513 microversion: 2.1 time: 0.161436 Oct 27 19:38:01.432238 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3523/7193] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:01 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:02.455291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae9b311c-63e6-4064-b747-95a1fa365229 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:02.456140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ae9b311c-63e6-4064-b747-95a1fa365229 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:02.464854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae9b311c-63e6-4064-b747-95a1fa365229 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:02.465468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae9b311c-63e6-4064-b747-95a1fa365229 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:02.466051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae9b311c-63e6-4064-b747-95a1fa365229 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:02.467058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae9b311c-63e6-4064-b747-95a1fa365229 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:02.467856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae9b311c-63e6-4064-b747-95a1fa365229 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:02.468564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae9b311c-63e6-4064-b747-95a1fa365229 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:02.521397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-23089308-e3d9-4865-ad0f-5f1196c5acd9 req-b7955aa4-b36d-4c04-8a0b-7bf6129da01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37fee760-e4a8-42ee-88c1-6fff4d6f1faf", "name": "network-vif-plugged", "status": "completed", "tag": "ad864b0f-77cc-488c-90c6-f8f7e4e714fb"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:38:02.532242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-23089308-e3d9-4865-ad0f-5f1196c5acd9 req-b7955aa4-b36d-4c04-8a0b-7bf6129da01c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:02.532640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-23089308-e3d9-4865-ad0f-5f1196c5acd9 req-b7955aa4-b36d-4c04-8a0b-7bf6129da01c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:02.533079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-23089308-e3d9-4865-ad0f-5f1196c5acd9 req-b7955aa4-b36d-4c04-8a0b-7bf6129da01c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:02.546794 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-23089308-e3d9-4865-ad0f-5f1196c5acd9 req-b7955aa4-b36d-4c04-8a0b-7bf6129da01c service nova] Creating event network-vif-plugged:ad864b0f-77cc-488c-90c6-f8f7e4e714fb for instance 37fee760-e4a8-42ee-88c1-6fff4d6f1faf on n-h1-860687-3 Oct 27 19:38:02.552387 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-23089308-e3d9-4865-ad0f-5f1196c5acd9 req-b7955aa4-b36d-4c04-8a0b-7bf6129da01c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126700 Oct 27 19:38:02.553129 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3671/7194] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:38:02.899659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae9b311c-63e6-4064-b747-95a1fa365229 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:02.909075 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ae9b311c-63e6-4064-b747-95a1fa365229 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1505 microversion: 2.1 time: 0.457898 Oct 27 19:38:02.909662 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3524/7195] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:02 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1505 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:38:02.934713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b6419df3-23f6-489d-849a-7b95e774ba3e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:02.935530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b6419df3-23f6-489d-849a-7b95e774ba3e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:02.942311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6419df3-23f6-489d-849a-7b95e774ba3e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:02.943045 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6419df3-23f6-489d-849a-7b95e774ba3e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:02.943535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6419df3-23f6-489d-849a-7b95e774ba3e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:02.944301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6419df3-23f6-489d-849a-7b95e774ba3e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:02.944777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6419df3-23f6-489d-849a-7b95e774ba3e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:02.945225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6419df3-23f6-489d-849a-7b95e774ba3e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:03.076796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b6419df3-23f6-489d-849a-7b95e774ba3e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:03.084583 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b6419df3-23f6-489d-849a-7b95e774ba3e tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1505 microversion: 2.1 time: 0.154988 Oct 27 19:38:03.085157 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3672/7196] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:02 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:03.107066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-81ce6f69-8ac5-4b0e-91bb-01c2e223627a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:03.107700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-81ce6f69-8ac5-4b0e-91bb-01c2e223627a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:03.113572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81ce6f69-8ac5-4b0e-91bb-01c2e223627a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:03.114080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81ce6f69-8ac5-4b0e-91bb-01c2e223627a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:03.114569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81ce6f69-8ac5-4b0e-91bb-01c2e223627a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:03.115282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81ce6f69-8ac5-4b0e-91bb-01c2e223627a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:03.115759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81ce6f69-8ac5-4b0e-91bb-01c2e223627a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:03.116208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81ce6f69-8ac5-4b0e-91bb-01c2e223627a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:03.248793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-81ce6f69-8ac5-4b0e-91bb-01c2e223627a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:03.256469 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-81ce6f69-8ac5-4b0e-91bb-01c2e223627a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1505 microversion: 2.1 time: 0.153236 Oct 27 19:38:03.257061 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3525/7197] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:03 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:03.280011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ffc95a48-c4af-4a20-90d1-9dcc749da6fd tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:03.280513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ffc95a48-c4af-4a20-90d1-9dcc749da6fd tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:03.286594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffc95a48-c4af-4a20-90d1-9dcc749da6fd tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:03.287081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffc95a48-c4af-4a20-90d1-9dcc749da6fd tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:03.287522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffc95a48-c4af-4a20-90d1-9dcc749da6fd tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:03.288212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffc95a48-c4af-4a20-90d1-9dcc749da6fd tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:03.288666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffc95a48-c4af-4a20-90d1-9dcc749da6fd tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:03.289093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffc95a48-c4af-4a20-90d1-9dcc749da6fd tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:03.313407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ffc95a48-c4af-4a20-90d1-9dcc749da6fd tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:38:03.393156 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ffc95a48-c4af-4a20-90d1-9dcc749da6fd tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "DELETE /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 204 len: 0 microversion: 2.1 time: 0.117377 Oct 27 19:38:03.393821 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3673/7198] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:38:03 2022] DELETE /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:38:03.412457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5fb5b7b2-d0de-4da2-80e1-77d725da45ab tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:03.412975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5fb5b7b2-d0de-4da2-80e1-77d725da45ab tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:03.419435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fb5b7b2-d0de-4da2-80e1-77d725da45ab tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:03.419945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fb5b7b2-d0de-4da2-80e1-77d725da45ab tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:03.420400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fb5b7b2-d0de-4da2-80e1-77d725da45ab tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:03.421110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fb5b7b2-d0de-4da2-80e1-77d725da45ab tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:03.421577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fb5b7b2-d0de-4da2-80e1-77d725da45ab tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:03.422018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5fb5b7b2-d0de-4da2-80e1-77d725da45ab tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:03.448476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5fb5b7b2-d0de-4da2-80e1-77d725da45ab tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:38:03.492572 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.compute.api [None req-5fb5b7b2-d0de-4da2-80e1-77d725da45ab tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Instance is already in deleting state, ignoring this request Oct 27 19:38:03.493914 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5fb5b7b2-d0de-4da2-80e1-77d725da45ab tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "DELETE /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 204 len: 0 microversion: 2.1 time: 0.086068 Oct 27 19:38:03.494500 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3526/7199] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:38:03 2022] DELETE /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:38:03.503167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-237a3201-f66d-476f-beef-2704cd900dc5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:03.503886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-237a3201-f66d-476f-beef-2704cd900dc5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:03.511612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-237a3201-f66d-476f-beef-2704cd900dc5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:03.512111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-237a3201-f66d-476f-beef-2704cd900dc5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:03.512556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-237a3201-f66d-476f-beef-2704cd900dc5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:03.513264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-237a3201-f66d-476f-beef-2704cd900dc5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:03.513729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-237a3201-f66d-476f-beef-2704cd900dc5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:03.514167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-237a3201-f66d-476f-beef-2704cd900dc5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:03.648503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-237a3201-f66d-476f-beef-2704cd900dc5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:03.656606 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-237a3201-f66d-476f-beef-2704cd900dc5 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1511 microversion: 2.1 time: 0.157709 Oct 27 19:38:03.657178 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3674/7200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:03 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:04.679545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8953ae21-46fa-4b85-b66c-5b6af502415c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:04.680188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8953ae21-46fa-4b85-b66c-5b6af502415c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:04.688106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8953ae21-46fa-4b85-b66c-5b6af502415c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:04.688616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8953ae21-46fa-4b85-b66c-5b6af502415c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:04.689335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8953ae21-46fa-4b85-b66c-5b6af502415c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:04.690049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8953ae21-46fa-4b85-b66c-5b6af502415c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:04.690564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8953ae21-46fa-4b85-b66c-5b6af502415c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:04.691019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8953ae21-46fa-4b85-b66c-5b6af502415c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:04.709131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:38:04.823407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8953ae21-46fa-4b85-b66c-5b6af502415c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530926eb36014c24af125c6e5acbd6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99515ca14d7b4d5686ce8b423bf3bec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:04.831469 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8953ae21-46fa-4b85-b66c-5b6af502415c tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 200 len: 1511 microversion: 2.1 time: 0.155840 Oct 27 19:38:04.832054 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3527/7201] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:04 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:05.273177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e0759a10-0377-4d3f-8243-e2f80bcc3fec req-ff4c00da-a415-4e04-a66a-fcd154419913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37fee760-e4a8-42ee-88c1-6fff4d6f1faf", "name": "network-vif-deleted", "tag": "ad864b0f-77cc-488c-90c6-f8f7e4e714fb"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:38:05.288628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e0759a10-0377-4d3f-8243-e2f80bcc3fec req-ff4c00da-a415-4e04-a66a-fcd154419913 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:05.289121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e0759a10-0377-4d3f-8243-e2f80bcc3fec req-ff4c00da-a415-4e04-a66a-fcd154419913 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:05.289754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e0759a10-0377-4d3f-8243-e2f80bcc3fec req-ff4c00da-a415-4e04-a66a-fcd154419913 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:05.304288 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e0759a10-0377-4d3f-8243-e2f80bcc3fec req-ff4c00da-a415-4e04-a66a-fcd154419913 service nova] Creating event network-vif-deleted:ad864b0f-77cc-488c-90c6-f8f7e4e714fb for instance 37fee760-e4a8-42ee-88c1-6fff4d6f1faf on n-h1-860687-3 Oct 27 19:38:05.310627 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e0759a10-0377-4d3f-8243-e2f80bcc3fec req-ff4c00da-a415-4e04-a66a-fcd154419913 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041257 Oct 27 19:38:05.311261 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3675/7202] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:38:05.855399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8d89e04b-bf8f-4764-ace4-90b674968909 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:05.856048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8d89e04b-bf8f-4764-ace4-90b674968909 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 37fee760-e4a8-42ee-88c1-6fff4d6f1faf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:05.862946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d89e04b-bf8f-4764-ace4-90b674968909 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:05.863464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d89e04b-bf8f-4764-ace4-90b674968909 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:05.863966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d89e04b-bf8f-4764-ace4-90b674968909 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:05.864704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d89e04b-bf8f-4764-ace4-90b674968909 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:05.865193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d89e04b-bf8f-4764-ace4-90b674968909 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:05.865653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d89e04b-bf8f-4764-ace4-90b674968909 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:05.879085 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-8d89e04b-bf8f-4764-ace4-90b674968909 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] HTTP exception thrown: Instance 37fee760-e4a8-42ee-88c1-6fff4d6f1faf could not be found. Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8d89e04b-bf8f-4764-ace4-90b674968909 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Request method failure captured: Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf HTTP/1.1 Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt25AflDTTk9rGBiO7BQVMTSPYwfGvIY2q442lZAuEQb1IhVypKZUnibcWikYl1Ipg8YSPkU50wIlFdAUGQnGl18fVL4bE2xU06yd8Fsje3RxLCHCVhnmVoHEzNsVitKm7hmbI-gpPRl0d_41eMl8Hhqy8J18OKtzxYvb9hocqDT3Lc Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 99515ca14d7b4d5686ce8b423bf3bec5 Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerDiskConfigTestJSON-614640710 Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/99515ca14d7b4d5686ce8b423bf3bec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99515ca14d7b4d5686ce8b423bf3bec5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_99515ca14d7b4d5686ce8b423bf3bec5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99515ca14d7b4d5686ce8b423bf3bec5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerDiskConfigTestJSON-614640710 Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 99515ca14d7b4d5686ce8b423bf3bec5 Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-614640710 Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerDiskConfigTestJSON-614640710-project Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 530926eb36014c24af125c6e5acbd6aa Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerDiskConfigTestJSON-614640710-project Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 37fee760-e4a8-42ee-88c1-6fff4d6f1faf could not be found. Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '37fee760-e4a8-42ee-88c1-6fff4d6f1faf'} Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37fee760-e4a8-42ee-88c1-6fff4d6f1faf could not be found. Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37fee760-e4a8-42ee-88c1-6fff4d6f1faf could not be found. Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:38:05.880771 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:38:05.885819 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:38:05.885819 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:38:05.885819 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:38:05.885819 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:38:05.885819 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:38:05.885819 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37fee760-e4a8-42ee-88c1-6fff4d6f1faf could not be found. Oct 27 19:38:05.885819 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:38:05.885819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8d89e04b-bf8f-4764-ace4-90b674968909 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Returning 404 to user: Instance 37fee760-e4a8-42ee-88c1-6fff4d6f1faf could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:38:05.885819 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8d89e04b-bf8f-4764-ace4-90b674968909 tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf" status: 404 len: 111 microversion: 2.1 time: 0.031548 Oct 27 19:38:05.885819 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3528/7203] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:05 2022] GET /compute/v2.1/servers/37fee760-e4a8-42ee-88c1-6fff4d6f1faf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:38:05.891856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5f458daf-bda6-4171-8a35-e700be6c5b9b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '.version_select at 0x7fc86b183b80>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:05.916929 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5f458daf-bda6-4171-8a35-e700be6c5b9b tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-654074373" status: 202 len: 0 microversion: 2.1 time: 0.029195 Oct 27 19:38:05.917518 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3676/7204] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Oct 27 19:38:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-654074373 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:38:06.530564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2a25876a-497a-41c8-bee9-a9bb60f5380a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:06.531093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2a25876a-497a-41c8-bee9-a9bb60f5380a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:06.537148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a25876a-497a-41c8-bee9-a9bb60f5380a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:06.537665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a25876a-497a-41c8-bee9-a9bb60f5380a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:06.538125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a25876a-497a-41c8-bee9-a9bb60f5380a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:06.538883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a25876a-497a-41c8-bee9-a9bb60f5380a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:06.539365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a25876a-497a-41c8-bee9-a9bb60f5380a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:06.539850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a25876a-497a-41c8-bee9-a9bb60f5380a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:06.556992 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-2a25876a-497a-41c8-bee9-a9bb60f5380a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] HTTP exception thrown: Instance 455babe3-639a-49de-a614-4a37d5e215d8 could not be found. Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2a25876a-497a-41c8-bee9-a9bb60f5380a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Request method failure captured: Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 HTTP/1.1 Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt25AflDTTk9rGBiO7BQVMTSPYwfGvIY2q442lZAuEQb1IhVypKZUnibcWikYl1Ipg8YSPkU50wIlFdAUGQnGl18fVL4bE2xU06yd8Fsje3RxLCHCVhnmVoHEzNsVitKm7hmbI-gpPRl0d_41eMl8Hhqy8J18OKtzxYvb9hocqDT3Lc Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 99515ca14d7b4d5686ce8b423bf3bec5 Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerDiskConfigTestJSON-614640710 Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/99515ca14d7b4d5686ce8b423bf3bec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99515ca14d7b4d5686ce8b423bf3bec5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_99515ca14d7b4d5686ce8b423bf3bec5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99515ca14d7b4d5686ce8b423bf3bec5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerDiskConfigTestJSON-614640710 Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 99515ca14d7b4d5686ce8b423bf3bec5 Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-614640710 Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerDiskConfigTestJSON-614640710-project Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 530926eb36014c24af125c6e5acbd6aa Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerDiskConfigTestJSON-614640710-project Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 455babe3-639a-49de-a614-4a37d5e215d8 could not be found. Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '455babe3-639a-49de-a614-4a37d5e215d8'} Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455babe3-639a-49de-a614-4a37d5e215d8 could not be found. Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:38:06.558609 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:38:06.562956 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455babe3-639a-49de-a614-4a37d5e215d8 could not be found. Oct 27 19:38:06.562956 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:38:06.562956 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:38:06.562956 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:38:06.562956 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:38:06.562956 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:38:06.562956 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:38:06.562956 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:38:06.562956 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:38:06.562956 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455babe3-639a-49de-a614-4a37d5e215d8 could not be found. Oct 27 19:38:06.562956 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:38:06.562956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2a25876a-497a-41c8-bee9-a9bb60f5380a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Returning 404 to user: Instance 455babe3-639a-49de-a614-4a37d5e215d8 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:38:06.562956 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2a25876a-497a-41c8-bee9-a9bb60f5380a tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "DELETE /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 404 len: 111 microversion: 2.1 time: 0.033522 Oct 27 19:38:06.562956 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3529/7205] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:38:06 2022] DELETE /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:38:06.570025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4912deb3-718a-493f-888a-5fb262df66ce tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:06.570838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4912deb3-718a-493f-888a-5fb262df66ce tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] [instance: 455babe3-639a-49de-a614-4a37d5e215d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:06.578257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4912deb3-718a-493f-888a-5fb262df66ce tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:06.579384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4912deb3-718a-493f-888a-5fb262df66ce tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:06.579840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4912deb3-718a-493f-888a-5fb262df66ce tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:06.580550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4912deb3-718a-493f-888a-5fb262df66ce tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:06.581019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4912deb3-718a-493f-888a-5fb262df66ce tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:06.581458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4912deb3-718a-493f-888a-5fb262df66ce tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:06.594863 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-4912deb3-718a-493f-888a-5fb262df66ce tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] HTTP exception thrown: Instance 455babe3-639a-49de-a614-4a37d5e215d8 could not be found. Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4912deb3-718a-493f-888a-5fb262df66ce tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Request method failure captured: Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 HTTP/1.1 Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt25AflDTTk9rGBiO7BQVMTSPYwfGvIY2q442lZAuEQb1IhVypKZUnibcWikYl1Ipg8YSPkU50wIlFdAUGQnGl18fVL4bE2xU06yd8Fsje3RxLCHCVhnmVoHEzNsVitKm7hmbI-gpPRl0d_41eMl8Hhqy8J18OKtzxYvb9hocqDT3Lc Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 99515ca14d7b4d5686ce8b423bf3bec5 Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerDiskConfigTestJSON-614640710 Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/99515ca14d7b4d5686ce8b423bf3bec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99515ca14d7b4d5686ce8b423bf3bec5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_99515ca14d7b4d5686ce8b423bf3bec5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99515ca14d7b4d5686ce8b423bf3bec5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerDiskConfigTestJSON-614640710 Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 99515ca14d7b4d5686ce8b423bf3bec5 Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-614640710 Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerDiskConfigTestJSON-614640710-project Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 530926eb36014c24af125c6e5acbd6aa Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerDiskConfigTestJSON-614640710-project Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 455babe3-639a-49de-a614-4a37d5e215d8 could not be found. Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '455babe3-639a-49de-a614-4a37d5e215d8'} Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455babe3-639a-49de-a614-4a37d5e215d8 could not be found. Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455babe3-639a-49de-a614-4a37d5e215d8 could not be found. Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:38:06.596554 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:38:06.601250 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:38:06.601250 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:38:06.601250 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:38:06.601250 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:38:06.601250 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:38:06.601250 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455babe3-639a-49de-a614-4a37d5e215d8 could not be found. Oct 27 19:38:06.601250 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:38:06.601250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4912deb3-718a-493f-888a-5fb262df66ce tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] Returning 404 to user: Instance 455babe3-639a-49de-a614-4a37d5e215d8 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:38:06.601250 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4912deb3-718a-493f-888a-5fb262df66ce tempest-ServerDiskConfigTestJSON-614640710 tempest-ServerDiskConfigTestJSON-614640710-project] 10.222.0.42 "GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8" status: 404 len: 111 microversion: 2.1 time: 0.032876 Oct 27 19:38:06.601250 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3677/7206] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:06 2022] GET /compute/v2.1/servers/455babe3-639a-49de-a614-4a37d5e215d8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:38:15.470993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e6a01eec-df25-4554-98c3-654356d63f61 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'create', calling method: .version_select at 0x7fc869a39280>, body: {"keypair": {"name": "tempest-keypair-2116444884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5zyqft0B9ZGzTdTqbEoopBfuKJpk4NmKL70++7ykcRfteTk358zf4BPuAugLj2Hys3ZAD9hida3QWt7/47N4Oftck1aQDKdvXdxTJ5zQXaeP2eDXJlhkpX/mwbWDp2bg=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:38:15.476368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=34 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:38:15.488022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e6a01eec-df25-4554-98c3-654356d63f61 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Getting quotas for project 612eaff9b8f24492b2c53c62e6be5aa0. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:38:15.493772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e6a01eec-df25-4554-98c3-654356d63f61 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Getting quotas for user c036fdc2fff644aa92e90481e04933c0 and project 612eaff9b8f24492b2c53c62e6be5aa0. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:38:15.519556 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e6a01eec-df25-4554-98c3-654356d63f61 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169709 Oct 27 19:38:15.520544 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3530/7207] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:38:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:38:16.802763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:38:16.803522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:38:16.808566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-530686077", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c454dce-b174-4189-a970-7d03caf6318a"}], "security_groups": [{"name": "tempest-securitygroup--1252788107"}], "key_name": "tempest-keypair-2116444884", "user_data": "}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:38:16.926317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] validate_networks() for [('5c454dce-b174-4189-a970-7d03caf6318a', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:38:17.364675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:38:17.365107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:38:17.365590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:38:17.366008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:38:17.366459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:38:17.375528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:17.376021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:17.376467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:17.377209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:17.377673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:17.378118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:17.395585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Getting quotas for project 612eaff9b8f24492b2c53c62e6be5aa0. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:38:17.401717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Getting quotas for user c036fdc2fff644aa92e90481e04933c0 and project 612eaff9b8f24492b2c53c62e6be5aa0. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:38:17.414155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:38:17.416567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:38:17.465253 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-342fba8e-f116-41e1-85ff-eddb89ebae8b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.664612 Oct 27 19:38:17.466126 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3678/7208] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:38:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:38:17.474838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:38:17.479391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-350aa543-8b9f-4342-8a64-08326992dc63 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:17.480302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-350aa543-8b9f-4342-8a64-08326992dc63 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:17.543242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-350aa543-8b9f-4342-8a64-08326992dc63 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:17.550265 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-350aa543-8b9f-4342-8a64-08326992dc63 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1238 microversion: 2.1 time: 0.077129 Oct 27 19:38:17.556440 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3531/7209] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:17 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:18.575984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cd88bf36-d00b-48f2-99f2-52e5b07fba5d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:18.576968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cd88bf36-d00b-48f2-99f2-52e5b07fba5d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:18.597036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd88bf36-d00b-48f2-99f2-52e5b07fba5d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:18.597565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd88bf36-d00b-48f2-99f2-52e5b07fba5d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:18.598116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd88bf36-d00b-48f2-99f2-52e5b07fba5d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:18.599187 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd88bf36-d00b-48f2-99f2-52e5b07fba5d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:18.599943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd88bf36-d00b-48f2-99f2-52e5b07fba5d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:18.600394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd88bf36-d00b-48f2-99f2-52e5b07fba5d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:18.677404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cd88bf36-d00b-48f2-99f2-52e5b07fba5d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:18.688047 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cd88bf36-d00b-48f2-99f2-52e5b07fba5d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1290 microversion: 2.1 time: 0.117962 Oct 27 19:38:18.694873 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3679/7210] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:18 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1290 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:19.718324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e8eba073-6f82-4cec-bbf5-207573003c69 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:19.718945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e8eba073-6f82-4cec-bbf5-207573003c69 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:19.726542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8eba073-6f82-4cec-bbf5-207573003c69 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:19.727421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8eba073-6f82-4cec-bbf5-207573003c69 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:19.727882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8eba073-6f82-4cec-bbf5-207573003c69 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:19.728618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8eba073-6f82-4cec-bbf5-207573003c69 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:19.729098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8eba073-6f82-4cec-bbf5-207573003c69 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:19.729549 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8eba073-6f82-4cec-bbf5-207573003c69 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:19.871673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8eba073-6f82-4cec-bbf5-207573003c69 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:19.879571 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e8eba073-6f82-4cec-bbf5-207573003c69 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1364 microversion: 2.1 time: 0.165596 Oct 27 19:38:19.880139 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3532/7211] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:19 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:20.227002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-334e8bdd-f5f2-4ed8-bca7-da0647a68bd7 req-c0633dfe-b9a3-47b3-8320-bc3fdcd75c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef07c0f8-ec33-44bd-94b1-f17aeec8f073", "tag": "adc25d83-b329-4554-ad2e-eb40fda03177"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:38:20.236815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-334e8bdd-f5f2-4ed8-bca7-da0647a68bd7 req-c0633dfe-b9a3-47b3-8320-bc3fdcd75c71 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:20.237312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-334e8bdd-f5f2-4ed8-bca7-da0647a68bd7 req-c0633dfe-b9a3-47b3-8320-bc3fdcd75c71 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:20.237754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-334e8bdd-f5f2-4ed8-bca7-da0647a68bd7 req-c0633dfe-b9a3-47b3-8320-bc3fdcd75c71 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:20.249813 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-334e8bdd-f5f2-4ed8-bca7-da0647a68bd7 req-c0633dfe-b9a3-47b3-8320-bc3fdcd75c71 service nova] Creating event network-changed:adc25d83-b329-4554-ad2e-eb40fda03177 for instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 on n-h1-860687-3 Oct 27 19:38:20.254880 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-334e8bdd-f5f2-4ed8-bca7-da0647a68bd7 req-c0633dfe-b9a3-47b3-8320-bc3fdcd75c71 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106979 Oct 27 19:38:20.255499 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3680/7212] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:38:20.904794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d37efb8b-a293-4cb7-9aef-1035a041cd1e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:20.905369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d37efb8b-a293-4cb7-9aef-1035a041cd1e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:20.912250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d37efb8b-a293-4cb7-9aef-1035a041cd1e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:20.912762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d37efb8b-a293-4cb7-9aef-1035a041cd1e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:20.913222 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d37efb8b-a293-4cb7-9aef-1035a041cd1e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:20.913942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d37efb8b-a293-4cb7-9aef-1035a041cd1e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:20.915041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d37efb8b-a293-4cb7-9aef-1035a041cd1e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:20.915500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d37efb8b-a293-4cb7-9aef-1035a041cd1e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:21.047840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d37efb8b-a293-4cb7-9aef-1035a041cd1e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:21.055560 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d37efb8b-a293-4cb7-9aef-1035a041cd1e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1364 microversion: 2.1 time: 0.154886 Oct 27 19:38:21.056279 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3533/7213] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:20 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:22.081447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-390f7fbe-ec12-415b-9bca-d21b39618803 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:22.082191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-390f7fbe-ec12-415b-9bca-d21b39618803 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:22.088971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-390f7fbe-ec12-415b-9bca-d21b39618803 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:22.089473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-390f7fbe-ec12-415b-9bca-d21b39618803 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:22.089924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-390f7fbe-ec12-415b-9bca-d21b39618803 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:22.090668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-390f7fbe-ec12-415b-9bca-d21b39618803 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:22.091403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-390f7fbe-ec12-415b-9bca-d21b39618803 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:22.091848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-390f7fbe-ec12-415b-9bca-d21b39618803 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:22.233214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-390f7fbe-ec12-415b-9bca-d21b39618803 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:22.241015 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-390f7fbe-ec12-415b-9bca-d21b39618803 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1364 microversion: 2.1 time: 0.164825 Oct 27 19:38:22.241590 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3681/7214] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:22 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:38:23.271059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8fcbe3f1-11ff-4090-b04d-cf8506ef244c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:23.271442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8fcbe3f1-11ff-4090-b04d-cf8506ef244c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:23.278441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fcbe3f1-11ff-4090-b04d-cf8506ef244c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:23.278960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fcbe3f1-11ff-4090-b04d-cf8506ef244c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:23.279428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fcbe3f1-11ff-4090-b04d-cf8506ef244c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:23.280158 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fcbe3f1-11ff-4090-b04d-cf8506ef244c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:23.280635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fcbe3f1-11ff-4090-b04d-cf8506ef244c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:23.281084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fcbe3f1-11ff-4090-b04d-cf8506ef244c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:23.416381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8fcbe3f1-11ff-4090-b04d-cf8506ef244c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:23.424144 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8fcbe3f1-11ff-4090-b04d-cf8506ef244c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1364 microversion: 2.1 time: 0.157415 Oct 27 19:38:23.424714 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3534/7215] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:23 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:24.448939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-72c56529-6f8d-4fee-8e87-8f34a2d37484 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:24.449507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-72c56529-6f8d-4fee-8e87-8f34a2d37484 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:24.457079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72c56529-6f8d-4fee-8e87-8f34a2d37484 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:24.457601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72c56529-6f8d-4fee-8e87-8f34a2d37484 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:24.458055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72c56529-6f8d-4fee-8e87-8f34a2d37484 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:24.459359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72c56529-6f8d-4fee-8e87-8f34a2d37484 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:24.459359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72c56529-6f8d-4fee-8e87-8f34a2d37484 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:24.459732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-72c56529-6f8d-4fee-8e87-8f34a2d37484 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:24.501355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-50ca3762-73f6-4e48-9585-3d4522e5fa5a req-bd2242cb-4be8-4a37-8f80-213713ea3b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef07c0f8-ec33-44bd-94b1-f17aeec8f073", "name": "network-vif-plugged", "status": "completed", "tag": "adc25d83-b329-4554-ad2e-eb40fda03177"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:38:24.513555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-50ca3762-73f6-4e48-9585-3d4522e5fa5a req-bd2242cb-4be8-4a37-8f80-213713ea3b40 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:24.514071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-50ca3762-73f6-4e48-9585-3d4522e5fa5a req-bd2242cb-4be8-4a37-8f80-213713ea3b40 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:24.514565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-50ca3762-73f6-4e48-9585-3d4522e5fa5a req-bd2242cb-4be8-4a37-8f80-213713ea3b40 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:24.526300 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-50ca3762-73f6-4e48-9585-3d4522e5fa5a req-bd2242cb-4be8-4a37-8f80-213713ea3b40 service nova] Creating event network-vif-plugged:adc25d83-b329-4554-ad2e-eb40fda03177 for instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 on n-h1-860687-3 Oct 27 19:38:24.533538 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-50ca3762-73f6-4e48-9585-3d4522e5fa5a req-bd2242cb-4be8-4a37-8f80-213713ea3b40 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036656 Oct 27 19:38:24.534374 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3535/7216] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:38:24.630971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-72c56529-6f8d-4fee-8e87-8f34a2d37484 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:24.639886 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-72c56529-6f8d-4fee-8e87-8f34a2d37484 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1364 microversion: 2.1 time: 0.195981 Oct 27 19:38:24.640468 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3682/7217] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:24 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:25.664060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6e5455d5-3b02-4b96-bb40-f2ca4b8c8b67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:25.665007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6e5455d5-3b02-4b96-bb40-f2ca4b8c8b67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:25.671737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e5455d5-3b02-4b96-bb40-f2ca4b8c8b67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:25.672304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e5455d5-3b02-4b96-bb40-f2ca4b8c8b67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:25.672775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e5455d5-3b02-4b96-bb40-f2ca4b8c8b67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:25.673496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e5455d5-3b02-4b96-bb40-f2ca4b8c8b67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:25.673981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e5455d5-3b02-4b96-bb40-f2ca4b8c8b67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:25.674459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e5455d5-3b02-4b96-bb40-f2ca4b8c8b67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:25.806133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6e5455d5-3b02-4b96-bb40-f2ca4b8c8b67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:25.814205 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6e5455d5-3b02-4b96-bb40-f2ca4b8c8b67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1364 microversion: 2.1 time: 0.155236 Oct 27 19:38:25.814826 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3536/7218] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:25 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:26.836631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a833975c-acd0-4c4e-9960-06654c373dcf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:26.837170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a833975c-acd0-4c4e-9960-06654c373dcf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:26.843383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a833975c-acd0-4c4e-9960-06654c373dcf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:26.843878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a833975c-acd0-4c4e-9960-06654c373dcf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:26.844323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a833975c-acd0-4c4e-9960-06654c373dcf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:26.845028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a833975c-acd0-4c4e-9960-06654c373dcf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:26.845489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a833975c-acd0-4c4e-9960-06654c373dcf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:26.845920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a833975c-acd0-4c4e-9960-06654c373dcf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:26.975912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a833975c-acd0-4c4e-9960-06654c373dcf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:38:26.983850 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a833975c-acd0-4c4e-9960-06654c373dcf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1551 microversion: 2.1 time: 0.151700 Oct 27 19:38:26.984420 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3683/7219] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:38:26 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:38:27.006790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-087b16f2-a380-4f23-bc94-89fd00b06368 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:38:27.007294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-087b16f2-a380-4f23-bc94-89fd00b06368 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:38:27.014736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-087b16f2-a380-4f23-bc94-89fd00b06368 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:27.015242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-087b16f2-a380-4f23-bc94-89fd00b06368 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:27.015743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-087b16f2-a380-4f23-bc94-89fd00b06368 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:27.016457 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-087b16f2-a380-4f23-bc94-89fd00b06368 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:27.016933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-087b16f2-a380-4f23-bc94-89fd00b06368 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:27.017380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-087b16f2-a380-4f23-bc94-89fd00b06368 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:27.095537 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-087b16f2-a380-4f23-bc94-89fd00b06368 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092548 Oct 27 19:38:27.096290 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3537/7220] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:38:27 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:38:28.029017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:38:28.030214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:38:28.094644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-904bc873-f08d-413a-a5a8-15320367edd0 req-4cfffbe3-45de-4f02-91ac-8199ee17dabe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef07c0f8-ec33-44bd-94b1-f17aeec8f073", "tag": "adc25d83-b329-4554-ad2e-eb40fda03177"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:38:28.104853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-904bc873-f08d-413a-a5a8-15320367edd0 req-4cfffbe3-45de-4f02-91ac-8199ee17dabe service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:38:28.105335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-904bc873-f08d-413a-a5a8-15320367edd0 req-4cfffbe3-45de-4f02-91ac-8199ee17dabe service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:38:28.105767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-904bc873-f08d-413a-a5a8-15320367edd0 req-4cfffbe3-45de-4f02-91ac-8199ee17dabe service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:38:28.116832 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-904bc873-f08d-413a-a5a8-15320367edd0 req-4cfffbe3-45de-4f02-91ac-8199ee17dabe service nova] Creating event network-changed:adc25d83-b329-4554-ad2e-eb40fda03177 for instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 on n-h1-860687-3 Oct 27 19:38:28.122760 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-904bc873-f08d-413a-a5a8-15320367edd0 req-4cfffbe3-45de-4f02-91ac-8199ee17dabe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098411 Oct 27 19:38:28.123357 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3684/7221] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:39:02.845363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:39:02.847374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:39:02.848057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=30 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:39:02.852388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e1e57eaa-e4b6-46e7-8eb3-fc511db7aaa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:02.853029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e1e57eaa-e4b6-46e7-8eb3-fc511db7aaa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:02.860696 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1e57eaa-e4b6-46e7-8eb3-fc511db7aaa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:02.861207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1e57eaa-e4b6-46e7-8eb3-fc511db7aaa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:02.861669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1e57eaa-e4b6-46e7-8eb3-fc511db7aaa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:02.862408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1e57eaa-e4b6-46e7-8eb3-fc511db7aaa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:02.862896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1e57eaa-e4b6-46e7-8eb3-fc511db7aaa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:02.863358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1e57eaa-e4b6-46e7-8eb3-fc511db7aaa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:02.999618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e1e57eaa-e4b6-46e7-8eb3-fc511db7aaa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:03.008370 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e1e57eaa-e4b6-46e7-8eb3-fc511db7aaa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1669 microversion: 2.1 time: 0.163174 Oct 27 19:39:03.008998 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3538/7222] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:02 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:03.033027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c5c91ec8-34ab-49a9-9e05-7ff44032c8e7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:03.033740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c5c91ec8-34ab-49a9-9e05-7ff44032c8e7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:03.035932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:39:03.036587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=30 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:39:03.042774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5c91ec8-34ab-49a9-9e05-7ff44032c8e7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:03.043269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5c91ec8-34ab-49a9-9e05-7ff44032c8e7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:03.043720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5c91ec8-34ab-49a9-9e05-7ff44032c8e7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:03.044422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5c91ec8-34ab-49a9-9e05-7ff44032c8e7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:03.044880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5c91ec8-34ab-49a9-9e05-7ff44032c8e7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:03.045311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5c91ec8-34ab-49a9-9e05-7ff44032c8e7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:03.176353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c5c91ec8-34ab-49a9-9e05-7ff44032c8e7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:03.184130 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c5c91ec8-34ab-49a9-9e05-7ff44032c8e7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1669 microversion: 2.1 time: 0.155737 Oct 27 19:39:03.184702 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3685/7223] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:03 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:03.207218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6917bc03-a818-4662-a2f3-011653ff670f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:03.207860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6917bc03-a818-4662-a2f3-011653ff670f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:03.214467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6917bc03-a818-4662-a2f3-011653ff670f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:03.214979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6917bc03-a818-4662-a2f3-011653ff670f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:03.215441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6917bc03-a818-4662-a2f3-011653ff670f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:03.216165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6917bc03-a818-4662-a2f3-011653ff670f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:03.216643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6917bc03-a818-4662-a2f3-011653ff670f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:03.217094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6917bc03-a818-4662-a2f3-011653ff670f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:03.347315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6917bc03-a818-4662-a2f3-011653ff670f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:03.355177 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6917bc03-a818-4662-a2f3-011653ff670f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1669 microversion: 2.1 time: 0.151965 Oct 27 19:39:03.355754 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3539/7224] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:03 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:03.378028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:39:03.380324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:03.387021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:03.387518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:03.387962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:03.388665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:03.389127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:03.389561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:03.417654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:03.423204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Old instance type m1.heat2, new instance type m1.heat {{(pid=127029) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 19:39:03.430529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:39:03.430954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:39:03.431433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:39:03.431849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:39:03.432266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:39:03.496006 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8fc37996-2880-40ce-9b9e-24a38786afb2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073/action" status: 202 len: 0 microversion: 2.1 time: 0.121902 Oct 27 19:39:03.496618 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3686/7225] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:39:03 2022] POST /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:39:03.505050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5a5acad7-17bf-4c15-a32f-ab6f44d94cf9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:03.505692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5a5acad7-17bf-4c15-a32f-ab6f44d94cf9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:03.512377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a5acad7-17bf-4c15-a32f-ab6f44d94cf9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:03.512906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a5acad7-17bf-4c15-a32f-ab6f44d94cf9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:03.513355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a5acad7-17bf-4c15-a32f-ab6f44d94cf9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:03.514077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a5acad7-17bf-4c15-a32f-ab6f44d94cf9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:03.514587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a5acad7-17bf-4c15-a32f-ab6f44d94cf9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:03.515044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5a5acad7-17bf-4c15-a32f-ab6f44d94cf9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:03.649475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5a5acad7-17bf-4c15-a32f-ab6f44d94cf9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:03.657814 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5a5acad7-17bf-4c15-a32f-ab6f44d94cf9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1678 microversion: 2.1 time: 0.156740 Oct 27 19:39:03.658408 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3540/7226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:03 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:04.682764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3ec5cefe-0c7b-4691-9861-61bfcae0e735 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:04.683388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3ec5cefe-0c7b-4691-9861-61bfcae0e735 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:04.690628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ec5cefe-0c7b-4691-9861-61bfcae0e735 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:04.691123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ec5cefe-0c7b-4691-9861-61bfcae0e735 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:04.691572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ec5cefe-0c7b-4691-9861-61bfcae0e735 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:04.692276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ec5cefe-0c7b-4691-9861-61bfcae0e735 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:04.692756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ec5cefe-0c7b-4691-9861-61bfcae0e735 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:04.693172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ec5cefe-0c7b-4691-9861-61bfcae0e735 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:04.896458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3ec5cefe-0c7b-4691-9861-61bfcae0e735 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:04.905384 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3ec5cefe-0c7b-4691-9861-61bfcae0e735 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1678 microversion: 2.1 time: 0.228149 Oct 27 19:39:04.905985 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3687/7227] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:04 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:05.932039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-752af85a-ea14-4031-a157-b6ff1e778a6f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:05.932666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-752af85a-ea14-4031-a157-b6ff1e778a6f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:05.939803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-752af85a-ea14-4031-a157-b6ff1e778a6f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:05.940304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-752af85a-ea14-4031-a157-b6ff1e778a6f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:05.940763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-752af85a-ea14-4031-a157-b6ff1e778a6f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:05.941471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-752af85a-ea14-4031-a157-b6ff1e778a6f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:05.941944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-752af85a-ea14-4031-a157-b6ff1e778a6f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:05.942413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-752af85a-ea14-4031-a157-b6ff1e778a6f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:06.071092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-752af85a-ea14-4031-a157-b6ff1e778a6f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:06.078877 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-752af85a-ea14-4031-a157-b6ff1e778a6f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.151487 Oct 27 19:39:06.079458 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3541/7228] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:05 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:07.103100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b4c6bdae-a1d8-4706-9247-3802af3b85de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:07.103719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b4c6bdae-a1d8-4706-9247-3802af3b85de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:07.110571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4c6bdae-a1d8-4706-9247-3802af3b85de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:07.111059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4c6bdae-a1d8-4706-9247-3802af3b85de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:07.111496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4c6bdae-a1d8-4706-9247-3802af3b85de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:07.112189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4c6bdae-a1d8-4706-9247-3802af3b85de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:07.112652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4c6bdae-a1d8-4706-9247-3802af3b85de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:07.113082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b4c6bdae-a1d8-4706-9247-3802af3b85de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:07.245529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b4c6bdae-a1d8-4706-9247-3802af3b85de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:07.253310 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b4c6bdae-a1d8-4706-9247-3802af3b85de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.154689 Oct 27 19:39:07.253885 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3688/7229] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:07 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:08.277960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f2ff591d-061d-446e-9716-e313bfc6fc5e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:08.278627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f2ff591d-061d-446e-9716-e313bfc6fc5e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:08.285287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2ff591d-061d-446e-9716-e313bfc6fc5e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:08.285805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2ff591d-061d-446e-9716-e313bfc6fc5e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:08.286271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2ff591d-061d-446e-9716-e313bfc6fc5e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:08.287023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2ff591d-061d-446e-9716-e313bfc6fc5e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:08.287509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2ff591d-061d-446e-9716-e313bfc6fc5e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:08.287966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2ff591d-061d-446e-9716-e313bfc6fc5e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:08.418530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f2ff591d-061d-446e-9716-e313bfc6fc5e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:08.426406 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f2ff591d-061d-446e-9716-e313bfc6fc5e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.152485 Oct 27 19:39:08.426980 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3542/7230] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:08 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:09.451083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-011c6ca6-c598-40cc-979e-cca02d3ceb19 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:09.451711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-011c6ca6-c598-40cc-979e-cca02d3ceb19 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:09.458557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-011c6ca6-c598-40cc-979e-cca02d3ceb19 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:09.459051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-011c6ca6-c598-40cc-979e-cca02d3ceb19 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:09.459493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-011c6ca6-c598-40cc-979e-cca02d3ceb19 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:09.460188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-011c6ca6-c598-40cc-979e-cca02d3ceb19 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:09.460649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-011c6ca6-c598-40cc-979e-cca02d3ceb19 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:09.461083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-011c6ca6-c598-40cc-979e-cca02d3ceb19 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:09.593422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-011c6ca6-c598-40cc-979e-cca02d3ceb19 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:09.601175 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-011c6ca6-c598-40cc-979e-cca02d3ceb19 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.154071 Oct 27 19:39:09.602074 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3689/7231] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:09 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:10.624698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9b2742b1-625e-4887-b894-702bc93d621b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:10.625374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9b2742b1-625e-4887-b894-702bc93d621b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:10.632303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9b2742b1-625e-4887-b894-702bc93d621b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:10.633390 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9b2742b1-625e-4887-b894-702bc93d621b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:10.634113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9b2742b1-625e-4887-b894-702bc93d621b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:10.634878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9b2742b1-625e-4887-b894-702bc93d621b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:10.635366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9b2742b1-625e-4887-b894-702bc93d621b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:10.635823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9b2742b1-625e-4887-b894-702bc93d621b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:10.767851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9b2742b1-625e-4887-b894-702bc93d621b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:10.776258 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9b2742b1-625e-4887-b894-702bc93d621b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.155555 Oct 27 19:39:10.776837 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3543/7232] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:10 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:11.799734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f475bef7-432b-450a-a11d-42465a444cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:11.800391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f475bef7-432b-450a-a11d-42465a444cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:11.808241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f475bef7-432b-450a-a11d-42465a444cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:11.808727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f475bef7-432b-450a-a11d-42465a444cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:11.809164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f475bef7-432b-450a-a11d-42465a444cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:11.809856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f475bef7-432b-450a-a11d-42465a444cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:11.810315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f475bef7-432b-450a-a11d-42465a444cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:11.810772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f475bef7-432b-450a-a11d-42465a444cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:11.941485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f475bef7-432b-450a-a11d-42465a444cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:11.950435 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f475bef7-432b-450a-a11d-42465a444cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.154582 Oct 27 19:39:11.951019 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3690/7233] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:11 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:12.973518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-915ed15b-9e36-4589-bf90-d8245b3fc937 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:12.974157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-915ed15b-9e36-4589-bf90-d8245b3fc937 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:12.981241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-915ed15b-9e36-4589-bf90-d8245b3fc937 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:12.981750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-915ed15b-9e36-4589-bf90-d8245b3fc937 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:12.982212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-915ed15b-9e36-4589-bf90-d8245b3fc937 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:12.982959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-915ed15b-9e36-4589-bf90-d8245b3fc937 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:12.983440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-915ed15b-9e36-4589-bf90-d8245b3fc937 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:12.983892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-915ed15b-9e36-4589-bf90-d8245b3fc937 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:13.114716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-915ed15b-9e36-4589-bf90-d8245b3fc937 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:13.123112 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-915ed15b-9e36-4589-bf90-d8245b3fc937 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.153552 Oct 27 19:39:13.123696 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3544/7234] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:12 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:14.146274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4c6f41c5-ca54-45ec-901d-b70294c33082 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:14.146946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4c6f41c5-ca54-45ec-901d-b70294c33082 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:14.154828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c6f41c5-ca54-45ec-901d-b70294c33082 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:14.155327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c6f41c5-ca54-45ec-901d-b70294c33082 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:14.155782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c6f41c5-ca54-45ec-901d-b70294c33082 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:14.156489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c6f41c5-ca54-45ec-901d-b70294c33082 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:14.156959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c6f41c5-ca54-45ec-901d-b70294c33082 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:14.157397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4c6f41c5-ca54-45ec-901d-b70294c33082 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:14.290912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4c6f41c5-ca54-45ec-901d-b70294c33082 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:14.298790 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4c6f41c5-ca54-45ec-901d-b70294c33082 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.156430 Oct 27 19:39:14.299370 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3691/7235] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:14 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:15.322941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-123fe49b-0fea-4fc1-8743-13364ee2dc2c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:15.323641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-123fe49b-0fea-4fc1-8743-13364ee2dc2c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:15.330576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-123fe49b-0fea-4fc1-8743-13364ee2dc2c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:15.331091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-123fe49b-0fea-4fc1-8743-13364ee2dc2c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:15.331556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-123fe49b-0fea-4fc1-8743-13364ee2dc2c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:15.332281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-123fe49b-0fea-4fc1-8743-13364ee2dc2c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:15.332764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-123fe49b-0fea-4fc1-8743-13364ee2dc2c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:15.333223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-123fe49b-0fea-4fc1-8743-13364ee2dc2c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:15.468662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-123fe49b-0fea-4fc1-8743-13364ee2dc2c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:15.477267 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-123fe49b-0fea-4fc1-8743-13364ee2dc2c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.157666 Oct 27 19:39:15.477852 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3545/7236] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:15 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:16.499763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a1ff2cb-c029-46cd-b4b5-3b9d031c856a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:16.500383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8a1ff2cb-c029-46cd-b4b5-3b9d031c856a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:16.507279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a1ff2cb-c029-46cd-b4b5-3b9d031c856a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:16.507977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a1ff2cb-c029-46cd-b4b5-3b9d031c856a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:16.508426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a1ff2cb-c029-46cd-b4b5-3b9d031c856a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:16.509129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a1ff2cb-c029-46cd-b4b5-3b9d031c856a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:16.509590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a1ff2cb-c029-46cd-b4b5-3b9d031c856a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:16.510025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a1ff2cb-c029-46cd-b4b5-3b9d031c856a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:16.643095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8a1ff2cb-c029-46cd-b4b5-3b9d031c856a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:16.650909 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8a1ff2cb-c029-46cd-b4b5-3b9d031c856a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.155114 Oct 27 19:39:16.651501 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3692/7237] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:16 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:17.674623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2f5206b4-731d-4767-af77-2d8970b4b98e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:17.675258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2f5206b4-731d-4767-af77-2d8970b4b98e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:17.683599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f5206b4-731d-4767-af77-2d8970b4b98e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:17.684112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f5206b4-731d-4767-af77-2d8970b4b98e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:17.684568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f5206b4-731d-4767-af77-2d8970b4b98e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:17.685285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f5206b4-731d-4767-af77-2d8970b4b98e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:17.685789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f5206b4-731d-4767-af77-2d8970b4b98e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:17.686237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f5206b4-731d-4767-af77-2d8970b4b98e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:17.818500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2f5206b4-731d-4767-af77-2d8970b4b98e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:17.826935 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2f5206b4-731d-4767-af77-2d8970b4b98e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.156291 Oct 27 19:39:17.827507 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3546/7238] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:17 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:18.850368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bf0e4c93-e1b2-49fa-b507-381709ca769d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:18.851022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bf0e4c93-e1b2-49fa-b507-381709ca769d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:18.858798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf0e4c93-e1b2-49fa-b507-381709ca769d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:18.859293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf0e4c93-e1b2-49fa-b507-381709ca769d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:18.859734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf0e4c93-e1b2-49fa-b507-381709ca769d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:18.860437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf0e4c93-e1b2-49fa-b507-381709ca769d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:18.860901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf0e4c93-e1b2-49fa-b507-381709ca769d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:18.861335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bf0e4c93-e1b2-49fa-b507-381709ca769d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:18.994412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bf0e4c93-e1b2-49fa-b507-381709ca769d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:19.002290 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bf0e4c93-e1b2-49fa-b507-381709ca769d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.155814 Oct 27 19:39:19.002896 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3693/7239] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:18 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:20.025419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-be64a3ed-2944-4a5f-9ea5-202a45342435 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:20.026071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-be64a3ed-2944-4a5f-9ea5-202a45342435 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:20.033734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be64a3ed-2944-4a5f-9ea5-202a45342435 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:20.034230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be64a3ed-2944-4a5f-9ea5-202a45342435 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:20.034719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be64a3ed-2944-4a5f-9ea5-202a45342435 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:20.035429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be64a3ed-2944-4a5f-9ea5-202a45342435 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:20.035900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be64a3ed-2944-4a5f-9ea5-202a45342435 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:20.036344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-be64a3ed-2944-4a5f-9ea5-202a45342435 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:20.167938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-be64a3ed-2944-4a5f-9ea5-202a45342435 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:20.175725 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-be64a3ed-2944-4a5f-9ea5-202a45342435 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.154760 Oct 27 19:39:20.176305 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3547/7240] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:20 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:21.200361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-adde0651-ccf9-48ed-afe6-24e950706076 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:21.200914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-adde0651-ccf9-48ed-afe6-24e950706076 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:21.207802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adde0651-ccf9-48ed-afe6-24e950706076 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:21.208296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adde0651-ccf9-48ed-afe6-24e950706076 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:21.208744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adde0651-ccf9-48ed-afe6-24e950706076 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:21.209453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adde0651-ccf9-48ed-afe6-24e950706076 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:21.209919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adde0651-ccf9-48ed-afe6-24e950706076 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:21.210356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adde0651-ccf9-48ed-afe6-24e950706076 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:21.346296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-adde0651-ccf9-48ed-afe6-24e950706076 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:21.354333 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-adde0651-ccf9-48ed-afe6-24e950706076 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.158068 Oct 27 19:39:21.354942 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3694/7241] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:21 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:22.377767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-67b7db09-1004-4f63-86b9-557d2a889f8f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:22.378460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-67b7db09-1004-4f63-86b9-557d2a889f8f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:22.385461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67b7db09-1004-4f63-86b9-557d2a889f8f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:22.385975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67b7db09-1004-4f63-86b9-557d2a889f8f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:22.386460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67b7db09-1004-4f63-86b9-557d2a889f8f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:22.387186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67b7db09-1004-4f63-86b9-557d2a889f8f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:22.387669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67b7db09-1004-4f63-86b9-557d2a889f8f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:22.388124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67b7db09-1004-4f63-86b9-557d2a889f8f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:22.525516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-67b7db09-1004-4f63-86b9-557d2a889f8f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:22.533318 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-67b7db09-1004-4f63-86b9-557d2a889f8f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1683 microversion: 2.1 time: 0.159520 Oct 27 19:39:22.533892 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3548/7242] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:22 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:23.215556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-cd4ea998-bfc4-40c4-92be-9dac5fc921ba req-ca0372e4-941b-45b2-84af-777f37c4c096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef07c0f8-ec33-44bd-94b1-f17aeec8f073", "name": "network-vif-unplugged", "status": "completed", "tag": "adc25d83-b329-4554-ad2e-eb40fda03177"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:39:23.227132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cd4ea998-bfc4-40c4-92be-9dac5fc921ba req-ca0372e4-941b-45b2-84af-777f37c4c096 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:23.227629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cd4ea998-bfc4-40c4-92be-9dac5fc921ba req-ca0372e4-941b-45b2-84af-777f37c4c096 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:23.228072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cd4ea998-bfc4-40c4-92be-9dac5fc921ba req-ca0372e4-941b-45b2-84af-777f37c4c096 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:23.240008 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-cd4ea998-bfc4-40c4-92be-9dac5fc921ba req-ca0372e4-941b-45b2-84af-777f37c4c096 service nova] Creating event network-vif-unplugged:adc25d83-b329-4554-ad2e-eb40fda03177 for instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 on n-h2-860687-3 Oct 27 19:39:23.245475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-cd4ea998-bfc4-40c4-92be-9dac5fc921ba req-ca0372e4-941b-45b2-84af-777f37c4c096 service nova] Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:39:23.256426 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-cd4ea998-bfc4-40c4-92be-9dac5fc921ba req-ca0372e4-941b-45b2-84af-777f37c4c096 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045488 Oct 27 19:39:23.257211 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3695/7243] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:39:23.557864 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6e35148a-85a6-4177-be48-ff9b1e99f7ce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:23.559318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6e35148a-85a6-4177-be48-ff9b1e99f7ce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:23.568825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e35148a-85a6-4177-be48-ff9b1e99f7ce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:23.569444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e35148a-85a6-4177-be48-ff9b1e99f7ce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:23.570564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e35148a-85a6-4177-be48-ff9b1e99f7ce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:23.571382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e35148a-85a6-4177-be48-ff9b1e99f7ce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:23.571944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e35148a-85a6-4177-be48-ff9b1e99f7ce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:23.572477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e35148a-85a6-4177-be48-ff9b1e99f7ce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:23.904694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6e35148a-85a6-4177-be48-ff9b1e99f7ce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:23.916158 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6e35148a-85a6-4177-be48-ff9b1e99f7ce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1682 microversion: 2.1 time: 0.362409 Oct 27 19:39:23.923564 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3549/7244] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:23 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1682 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:24.942669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e18c5d5b-5e51-460a-8754-893289a36b8e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:24.943397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e18c5d5b-5e51-460a-8754-893289a36b8e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:24.949696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e18c5d5b-5e51-460a-8754-893289a36b8e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:24.950182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e18c5d5b-5e51-460a-8754-893289a36b8e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:24.950665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e18c5d5b-5e51-460a-8754-893289a36b8e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:24.951354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e18c5d5b-5e51-460a-8754-893289a36b8e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:24.951813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e18c5d5b-5e51-460a-8754-893289a36b8e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:24.952240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e18c5d5b-5e51-460a-8754-893289a36b8e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:25.081020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e18c5d5b-5e51-460a-8754-893289a36b8e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:25.089325 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e18c5d5b-5e51-460a-8754-893289a36b8e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1680 microversion: 2.1 time: 0.152269 Oct 27 19:39:25.089900 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3696/7245] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:24 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:25.285854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-50a095aa-9347-4aa5-b655-6f1e9d25a6a3 req-66dcb2b5-a643-4ad1-bcdd-80984aa98a5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef07c0f8-ec33-44bd-94b1-f17aeec8f073", "tag": "adc25d83-b329-4554-ad2e-eb40fda03177"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:39:25.296695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-50a095aa-9347-4aa5-b655-6f1e9d25a6a3 req-66dcb2b5-a643-4ad1-bcdd-80984aa98a5f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:25.297198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-50a095aa-9347-4aa5-b655-6f1e9d25a6a3 req-66dcb2b5-a643-4ad1-bcdd-80984aa98a5f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:25.297650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-50a095aa-9347-4aa5-b655-6f1e9d25a6a3 req-66dcb2b5-a643-4ad1-bcdd-80984aa98a5f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:25.308932 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-50a095aa-9347-4aa5-b655-6f1e9d25a6a3 req-66dcb2b5-a643-4ad1-bcdd-80984aa98a5f service nova] Creating event network-changed:adc25d83-b329-4554-ad2e-eb40fda03177 for instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 on n-h2-860687-3 Oct 27 19:39:25.314493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-50a095aa-9347-4aa5-b655-6f1e9d25a6a3 req-66dcb2b5-a643-4ad1-bcdd-80984aa98a5f service nova] Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:39:25.325202 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-50a095aa-9347-4aa5-b655-6f1e9d25a6a3 req-66dcb2b5-a643-4ad1-bcdd-80984aa98a5f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043064 Oct 27 19:39:25.325794 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3550/7246] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:39:26.113540 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b8c40f19-19ab-4415-8844-232b4def2afe tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:26.114161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b8c40f19-19ab-4415-8844-232b4def2afe tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:26.121084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8c40f19-19ab-4415-8844-232b4def2afe tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:26.121578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8c40f19-19ab-4415-8844-232b4def2afe tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:26.122031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8c40f19-19ab-4415-8844-232b4def2afe tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:26.122761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8c40f19-19ab-4415-8844-232b4def2afe tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:26.123230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8c40f19-19ab-4415-8844-232b4def2afe tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:26.123665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b8c40f19-19ab-4415-8844-232b4def2afe tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:26.268666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b8c40f19-19ab-4415-8844-232b4def2afe tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:26.277214 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b8c40f19-19ab-4415-8844-232b4def2afe tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1680 microversion: 2.1 time: 0.167660 Oct 27 19:39:26.277834 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3697/7247] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:26 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:27.302870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-996b3706-59be-4684-b8a9-817f8a665bfb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:27.303607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-996b3706-59be-4684-b8a9-817f8a665bfb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:27.310827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b3706-59be-4684-b8a9-817f8a665bfb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:27.311369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b3706-59be-4684-b8a9-817f8a665bfb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:27.311831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b3706-59be-4684-b8a9-817f8a665bfb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:27.312662 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b3706-59be-4684-b8a9-817f8a665bfb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:27.313170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b3706-59be-4684-b8a9-817f8a665bfb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:27.313626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-996b3706-59be-4684-b8a9-817f8a665bfb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:27.528652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-996b3706-59be-4684-b8a9-817f8a665bfb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:27.536567 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-996b3706-59be-4684-b8a9-817f8a665bfb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1680 microversion: 2.1 time: 0.239243 Oct 27 19:39:27.537148 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3551/7248] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:27 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:28.561208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-35601cd4-7661-4140-8280-ae6af4fc63f5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:28.561921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-35601cd4-7661-4140-8280-ae6af4fc63f5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:28.568761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35601cd4-7661-4140-8280-ae6af4fc63f5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:28.569249 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35601cd4-7661-4140-8280-ae6af4fc63f5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:28.570265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35601cd4-7661-4140-8280-ae6af4fc63f5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:28.571081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35601cd4-7661-4140-8280-ae6af4fc63f5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:28.571587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35601cd4-7661-4140-8280-ae6af4fc63f5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:28.572023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-35601cd4-7661-4140-8280-ae6af4fc63f5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:28.703028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-35601cd4-7661-4140-8280-ae6af4fc63f5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:28.711452 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-35601cd4-7661-4140-8280-ae6af4fc63f5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1677 microversion: 2.1 time: 0.153734 Oct 27 19:39:28.712040 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3698/7249] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:28 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:28.734024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8dd39d32-c432-4aeb-85f9-2650825bde12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:39:28.734623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8dd39d32-c432-4aeb-85f9-2650825bde12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:28.741425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dd39d32-c432-4aeb-85f9-2650825bde12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:28.742110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dd39d32-c432-4aeb-85f9-2650825bde12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:28.742636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dd39d32-c432-4aeb-85f9-2650825bde12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:28.743362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dd39d32-c432-4aeb-85f9-2650825bde12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:28.743842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dd39d32-c432-4aeb-85f9-2650825bde12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:28.744295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8dd39d32-c432-4aeb-85f9-2650825bde12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:28.806568 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8dd39d32-c432-4aeb-85f9-2650825bde12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073/action" status: 204 len: 0 microversion: 2.1 time: 0.076104 Oct 27 19:39:28.807154 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3552/7250] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:39:28 2022] POST /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:39:28.815499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-39fea777-4549-44c4-ae7d-103a5fbe2e8d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:28.816126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-39fea777-4549-44c4-ae7d-103a5fbe2e8d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:28.823088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39fea777-4549-44c4-ae7d-103a5fbe2e8d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:28.823590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39fea777-4549-44c4-ae7d-103a5fbe2e8d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:28.824036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39fea777-4549-44c4-ae7d-103a5fbe2e8d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:28.824746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39fea777-4549-44c4-ae7d-103a5fbe2e8d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:28.825208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39fea777-4549-44c4-ae7d-103a5fbe2e8d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:28.825641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-39fea777-4549-44c4-ae7d-103a5fbe2e8d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:29.013091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-39fea777-4549-44c4-ae7d-103a5fbe2e8d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:29.020937 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-39fea777-4549-44c4-ae7d-103a5fbe2e8d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1677 microversion: 2.1 time: 0.209538 Oct 27 19:39:29.021501 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3699/7251] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:28 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:30.046416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ce165763-4918-4d99-b72a-0c7acccc387e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:30.047149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ce165763-4918-4d99-b72a-0c7acccc387e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:30.053340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce165763-4918-4d99-b72a-0c7acccc387e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:30.053851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce165763-4918-4d99-b72a-0c7acccc387e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:30.054980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce165763-4918-4d99-b72a-0c7acccc387e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:30.055732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce165763-4918-4d99-b72a-0c7acccc387e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:30.056209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce165763-4918-4d99-b72a-0c7acccc387e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:30.056665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce165763-4918-4d99-b72a-0c7acccc387e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:30.192814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ce165763-4918-4d99-b72a-0c7acccc387e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:30.195450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:39:30.202625 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ce165763-4918-4d99-b72a-0c7acccc387e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1677 microversion: 2.1 time: 0.161266 Oct 27 19:39:30.203211 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3553/7252] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:30 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:31.225510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b0a93420-50cd-4fc8-bcb0-cb4060aa5bf4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:31.226556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b0a93420-50cd-4fc8-bcb0-cb4060aa5bf4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:31.233374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0a93420-50cd-4fc8-bcb0-cb4060aa5bf4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:31.233865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0a93420-50cd-4fc8-bcb0-cb4060aa5bf4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:31.234311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0a93420-50cd-4fc8-bcb0-cb4060aa5bf4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:31.235032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0a93420-50cd-4fc8-bcb0-cb4060aa5bf4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:31.235492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0a93420-50cd-4fc8-bcb0-cb4060aa5bf4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:31.235922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b0a93420-50cd-4fc8-bcb0-cb4060aa5bf4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:31.254912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:39:31.376078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b0a93420-50cd-4fc8-bcb0-cb4060aa5bf4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:31.385221 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b0a93420-50cd-4fc8-bcb0-cb4060aa5bf4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1669 microversion: 2.1 time: 0.163618 Oct 27 19:39:31.386194 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3700/7253] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:31 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:31.409027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ded33fd6-c980-4201-b181-9731694f5cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:31.409757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ded33fd6-c980-4201-b181-9731694f5cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:31.419697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded33fd6-c980-4201-b181-9731694f5cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:31.420430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded33fd6-c980-4201-b181-9731694f5cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:31.421080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded33fd6-c980-4201-b181-9731694f5cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:31.421687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-cff9634a-7d83-433d-a6db-e491f8dcfa90 req-148fbce9-7944-4ab2-966c-b57ef909069e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef07c0f8-ec33-44bd-94b1-f17aeec8f073", "name": "network-vif-plugged", "status": "completed", "tag": "adc25d83-b329-4554-ad2e-eb40fda03177"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:39:31.422185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded33fd6-c980-4201-b181-9731694f5cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:31.422697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded33fd6-c980-4201-b181-9731694f5cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:31.423152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ded33fd6-c980-4201-b181-9731694f5cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:31.434760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cff9634a-7d83-433d-a6db-e491f8dcfa90 req-148fbce9-7944-4ab2-966c-b57ef909069e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:31.435441 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cff9634a-7d83-433d-a6db-e491f8dcfa90 req-148fbce9-7944-4ab2-966c-b57ef909069e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:31.436248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cff9634a-7d83-433d-a6db-e491f8dcfa90 req-148fbce9-7944-4ab2-966c-b57ef909069e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:31.452579 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-cff9634a-7d83-433d-a6db-e491f8dcfa90 req-148fbce9-7944-4ab2-966c-b57ef909069e service nova] Creating event network-vif-plugged:adc25d83-b329-4554-ad2e-eb40fda03177 for instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 on n-h2-860687-3 Oct 27 19:39:31.458977 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-cff9634a-7d83-433d-a6db-e491f8dcfa90 req-148fbce9-7944-4ab2-966c-b57ef909069e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041347 Oct 27 19:39:31.459968 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3701/7254] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:39:31.570298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ded33fd6-c980-4201-b181-9731694f5cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:31.578371 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ded33fd6-c980-4201-b181-9731694f5cab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1669 microversion: 2.1 time: 0.174229 Oct 27 19:39:31.578984 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3554/7255] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:31 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1669 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:31.601757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-65d98fc8-11b2-49bc-b714-943def2367e4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:31.602499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-65d98fc8-11b2-49bc-b714-943def2367e4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:31.608708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65d98fc8-11b2-49bc-b714-943def2367e4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:31.609199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65d98fc8-11b2-49bc-b714-943def2367e4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:31.609644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65d98fc8-11b2-49bc-b714-943def2367e4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:31.610343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65d98fc8-11b2-49bc-b714-943def2367e4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:31.610833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65d98fc8-11b2-49bc-b714-943def2367e4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:31.611271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-65d98fc8-11b2-49bc-b714-943def2367e4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:31.749129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-65d98fc8-11b2-49bc-b714-943def2367e4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:31.756913 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-65d98fc8-11b2-49bc-b714-943def2367e4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1669 microversion: 2.1 time: 0.160048 Oct 27 19:39:31.757901 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3702/7256] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:31 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:31.780030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-441f0d3b-9770-4b97-b183-c53d2407c52d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:31.780554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-441f0d3b-9770-4b97-b183-c53d2407c52d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:31.786699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-441f0d3b-9770-4b97-b183-c53d2407c52d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:31.787218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-441f0d3b-9770-4b97-b183-c53d2407c52d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:31.787684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-441f0d3b-9770-4b97-b183-c53d2407c52d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:31.788933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-441f0d3b-9770-4b97-b183-c53d2407c52d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:31.789461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-441f0d3b-9770-4b97-b183-c53d2407c52d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:31.789944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-441f0d3b-9770-4b97-b183-c53d2407c52d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:31.815651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-441f0d3b-9770-4b97-b183-c53d2407c52d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:39:31.890325 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-441f0d3b-9770-4b97-b183-c53d2407c52d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 204 len: 0 microversion: 2.1 time: 0.113891 Oct 27 19:39:31.890959 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3555/7257] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:39:31 2022] DELETE /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:39:31.900463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6e67c5d-b196-45af-b706-5f2acf348335 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:31.901116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d6e67c5d-b196-45af-b706-5f2acf348335 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:31.907259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6e67c5d-b196-45af-b706-5f2acf348335 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:31.907758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6e67c5d-b196-45af-b706-5f2acf348335 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:31.908203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6e67c5d-b196-45af-b706-5f2acf348335 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:31.908912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6e67c5d-b196-45af-b706-5f2acf348335 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:31.909373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6e67c5d-b196-45af-b706-5f2acf348335 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:31.909811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6e67c5d-b196-45af-b706-5f2acf348335 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:32.040189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d6e67c5d-b196-45af-b706-5f2acf348335 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:32.047989 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d6e67c5d-b196-45af-b706-5f2acf348335 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1675 microversion: 2.1 time: 0.151926 Oct 27 19:39:32.048562 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3703/7258] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:31 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:33.071724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ad9f67c8-2867-43c4-b6d2-2b2fadc4a258 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:33.072369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ad9f67c8-2867-43c4-b6d2-2b2fadc4a258 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:33.075183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:39:33.080554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad9f67c8-2867-43c4-b6d2-2b2fadc4a258 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:33.081067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad9f67c8-2867-43c4-b6d2-2b2fadc4a258 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:33.081536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad9f67c8-2867-43c4-b6d2-2b2fadc4a258 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:33.082258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad9f67c8-2867-43c4-b6d2-2b2fadc4a258 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:33.082776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad9f67c8-2867-43c4-b6d2-2b2fadc4a258 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:33.083232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad9f67c8-2867-43c4-b6d2-2b2fadc4a258 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:33.219358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ad9f67c8-2867-43c4-b6d2-2b2fadc4a258 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:33.228152 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ad9f67c8-2867-43c4-b6d2-2b2fadc4a258 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1675 microversion: 2.1 time: 0.160866 Oct 27 19:39:33.228842 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3556/7259] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:33 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:34.241478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-9e8319e7-d012-4b68-88c2-004aeebd00bc req-c1bd408c-842d-4a7e-8099-55fd1912878c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef07c0f8-ec33-44bd-94b1-f17aeec8f073", "name": "network-vif-deleted", "tag": "adc25d83-b329-4554-ad2e-eb40fda03177"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:39:34.251271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=43 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:39:34.252983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-98af1cb0-9d74-4028-bf19-49edcd294598 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:34.253763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-98af1cb0-9d74-4028-bf19-49edcd294598 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:34.255936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9e8319e7-d012-4b68-88c2-004aeebd00bc req-c1bd408c-842d-4a7e-8099-55fd1912878c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:34.257272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9e8319e7-d012-4b68-88c2-004aeebd00bc req-c1bd408c-842d-4a7e-8099-55fd1912878c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:34.257724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9e8319e7-d012-4b68-88c2-004aeebd00bc req-c1bd408c-842d-4a7e-8099-55fd1912878c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:34.265190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98af1cb0-9d74-4028-bf19-49edcd294598 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:34.265722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98af1cb0-9d74-4028-bf19-49edcd294598 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:34.266194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98af1cb0-9d74-4028-bf19-49edcd294598 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:34.266970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98af1cb0-9d74-4028-bf19-49edcd294598 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:34.267458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98af1cb0-9d74-4028-bf19-49edcd294598 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:34.267917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98af1cb0-9d74-4028-bf19-49edcd294598 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:34.280984 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-9e8319e7-d012-4b68-88c2-004aeebd00bc req-c1bd408c-842d-4a7e-8099-55fd1912878c service nova] Creating event network-vif-deleted:adc25d83-b329-4554-ad2e-eb40fda03177 for instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 on n-h2-860687-3 Oct 27 19:39:34.290926 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-9e8319e7-d012-4b68-88c2-004aeebd00bc req-c1bd408c-842d-4a7e-8099-55fd1912878c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052762 Oct 27 19:39:34.296831 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3704/7260] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:39:34.346626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-98af1cb0-9d74-4028-bf19-49edcd294598 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:34.356020 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-98af1cb0-9d74-4028-bf19-49edcd294598 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 200 len: 1607 microversion: 2.1 time: 0.107224 Oct 27 19:39:34.356907 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3557/7261] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:34 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 1607 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:39:35.381502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f75e9884-2f67-43d6-bbbb-4dd61d416f85 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:35.382218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f75e9884-2f67-43d6-bbbb-4dd61d416f85 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:35.389130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f75e9884-2f67-43d6-bbbb-4dd61d416f85 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:35.389622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f75e9884-2f67-43d6-bbbb-4dd61d416f85 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:35.390063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f75e9884-2f67-43d6-bbbb-4dd61d416f85 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:35.390787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f75e9884-2f67-43d6-bbbb-4dd61d416f85 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:35.391254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f75e9884-2f67-43d6-bbbb-4dd61d416f85 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:35.391690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f75e9884-2f67-43d6-bbbb-4dd61d416f85 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:35.405605 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-f75e9884-2f67-43d6-bbbb-4dd61d416f85 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f75e9884-2f67-43d6-bbbb-4dd61d416f85 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 HTTP/1.1 Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'ef07c0f8-ec33-44bd-94b1-f17aeec8f073'} Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:39:35.407301 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:39:35.412262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:39:35.412262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:39:35.412262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:39:35.412262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:39:35.412262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:39:35.412262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:39:35.412262 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:39:35.412262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f75e9884-2f67-43d6-bbbb-4dd61d416f85 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:39:35.412262 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f75e9884-2f67-43d6-bbbb-4dd61d416f85 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 404 len: 111 microversion: 2.1 time: 0.032490 Oct 27 19:39:35.412262 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3705/7262] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:35 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:39:35.422377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f2a722a7-8baf-4d94-b832-7d64189a5a99 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:35.423122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f2a722a7-8baf-4d94-b832-7d64189a5a99 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:35.429950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2a722a7-8baf-4d94-b832-7d64189a5a99 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:35.430901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2a722a7-8baf-4d94-b832-7d64189a5a99 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:35.431366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2a722a7-8baf-4d94-b832-7d64189a5a99 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:35.432086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2a722a7-8baf-4d94-b832-7d64189a5a99 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:35.432568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2a722a7-8baf-4d94-b832-7d64189a5a99 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:35.433032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2a722a7-8baf-4d94-b832-7d64189a5a99 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:35.450049 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-f2a722a7-8baf-4d94-b832-7d64189a5a99 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f2a722a7-8baf-4d94-b832-7d64189a5a99 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 HTTP/1.1 Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'ef07c0f8-ec33-44bd-94b1-f17aeec8f073'} Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:39:35.451748 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:39:35.456418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:39:35.456418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:39:35.456418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:39:35.456418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:39:35.456418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:39:35.456418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:39:35.456418 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:39:35.456418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f2a722a7-8baf-4d94-b832-7d64189a5a99 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:39:35.456418 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f2a722a7-8baf-4d94-b832-7d64189a5a99 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 404 len: 111 microversion: 2.1 time: 0.034702 Oct 27 19:39:35.456418 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3558/7263] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:35 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:39:35.501812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1802404895", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "5c454dce-b174-4189-a970-7d03caf6318a"}], "security_groups": [{"name": "tempest-securitygroup--1252788107"}], "key_name": "tempest-keypair-2116444884", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:39:35.609116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] validate_networks() for [('5c454dce-b174-4189-a970-7d03caf6318a', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:39:35.976355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:39:35.976788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:39:35.977306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:39:35.977722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:39:35.978142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:39:35.987949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:35.988435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:35.988874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:35.989608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:35.990065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:35.990525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:36.007414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Getting quotas for project 612eaff9b8f24492b2c53c62e6be5aa0. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:39:36.013574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Getting quotas for user c036fdc2fff644aa92e90481e04933c0 and project 612eaff9b8f24492b2c53c62e6be5aa0. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:39:36.026848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:39:36.029195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:39:36.076833 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a63c9739-39d4-46c8-835d-7647f83c8b12 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.578838 Oct 27 19:39:36.077407 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3706/7264] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:39:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:39:36.089275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-675eadcc-8bad-41e4-84ca-e11273766ddb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:36.089920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-675eadcc-8bad-41e4-84ca-e11273766ddb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:36.148986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-675eadcc-8bad-41e4-84ca-e11273766ddb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:36.156798 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-675eadcc-8bad-41e4-84ca-e11273766ddb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1239 microversion: 2.1 time: 0.072069 Oct 27 19:39:36.157389 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3559/7265] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:36 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:39:37.182493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de28bfba-6421-4324-be39-b15977202b08 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:37.183821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-de28bfba-6421-4324-be39-b15977202b08 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:37.191138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de28bfba-6421-4324-be39-b15977202b08 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:37.191712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de28bfba-6421-4324-be39-b15977202b08 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:37.192342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de28bfba-6421-4324-be39-b15977202b08 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:37.193294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de28bfba-6421-4324-be39-b15977202b08 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:37.193875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de28bfba-6421-4324-be39-b15977202b08 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:37.194429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de28bfba-6421-4324-be39-b15977202b08 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:37.275389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-de28bfba-6421-4324-be39-b15977202b08 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:37.283117 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-de28bfba-6421-4324-be39-b15977202b08 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1309 microversion: 2.1 time: 0.106391 Oct 27 19:39:37.283697 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3707/7266] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:37 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:38.307459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ef07cc4b-da71-48fd-bf03-eef83b459afa tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:38.308261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ef07cc4b-da71-48fd-bf03-eef83b459afa tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:38.316124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef07cc4b-da71-48fd-bf03-eef83b459afa tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:38.316629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef07cc4b-da71-48fd-bf03-eef83b459afa tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:38.317088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef07cc4b-da71-48fd-bf03-eef83b459afa tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:38.317836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef07cc4b-da71-48fd-bf03-eef83b459afa tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:38.318313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef07cc4b-da71-48fd-bf03-eef83b459afa tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:38.318797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef07cc4b-da71-48fd-bf03-eef83b459afa tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:38.453429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ef07cc4b-da71-48fd-bf03-eef83b459afa tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:38.462500 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ef07cc4b-da71-48fd-bf03-eef83b459afa tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1365 microversion: 2.1 time: 0.158308 Oct 27 19:39:38.463316 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3560/7267] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:38 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:38.571428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-9abe48df-b7e6-4c02-a3b3-f344e3fd5ec2 req-fffe30b3-7bb2-4942-947a-10dc8c32faa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1baf440-dcba-4ffe-952f-2b8a30696126", "tag": "2edf6369-296a-408c-9b72-9fb5cfffcecc"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:39:38.584034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9abe48df-b7e6-4c02-a3b3-f344e3fd5ec2 req-fffe30b3-7bb2-4942-947a-10dc8c32faa4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:38.584525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9abe48df-b7e6-4c02-a3b3-f344e3fd5ec2 req-fffe30b3-7bb2-4942-947a-10dc8c32faa4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:38.585509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9abe48df-b7e6-4c02-a3b3-f344e3fd5ec2 req-fffe30b3-7bb2-4942-947a-10dc8c32faa4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:38.597566 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-9abe48df-b7e6-4c02-a3b3-f344e3fd5ec2 req-fffe30b3-7bb2-4942-947a-10dc8c32faa4 service nova] Creating event network-changed:2edf6369-296a-408c-9b72-9fb5cfffcecc for instance b1baf440-dcba-4ffe-952f-2b8a30696126 on n-h1-860687-3 Oct 27 19:39:38.603531 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-9abe48df-b7e6-4c02-a3b3-f344e3fd5ec2 req-fffe30b3-7bb2-4942-947a-10dc8c32faa4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036355 Oct 27 19:39:38.604314 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3708/7268] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:39:39.487192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-825593a2-a69a-486d-82d0-4f21e23cded3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:39.487829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-825593a2-a69a-486d-82d0-4f21e23cded3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:39.496058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-825593a2-a69a-486d-82d0-4f21e23cded3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:39.496571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-825593a2-a69a-486d-82d0-4f21e23cded3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:39.497060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-825593a2-a69a-486d-82d0-4f21e23cded3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:39.497783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-825593a2-a69a-486d-82d0-4f21e23cded3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:39.498263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-825593a2-a69a-486d-82d0-4f21e23cded3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:39.498745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-825593a2-a69a-486d-82d0-4f21e23cded3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:39.632824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-825593a2-a69a-486d-82d0-4f21e23cded3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:39.641631 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-825593a2-a69a-486d-82d0-4f21e23cded3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1365 microversion: 2.1 time: 0.158363 Oct 27 19:39:39.642221 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3561/7269] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:39 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:40.666801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3628fb9c-8483-4e2d-8679-88d50e7e1377 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:40.667523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3628fb9c-8483-4e2d-8679-88d50e7e1377 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:40.674075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3628fb9c-8483-4e2d-8679-88d50e7e1377 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:40.674607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3628fb9c-8483-4e2d-8679-88d50e7e1377 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:40.675056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3628fb9c-8483-4e2d-8679-88d50e7e1377 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:40.675759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3628fb9c-8483-4e2d-8679-88d50e7e1377 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:40.676221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3628fb9c-8483-4e2d-8679-88d50e7e1377 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:40.676657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3628fb9c-8483-4e2d-8679-88d50e7e1377 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:40.811660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3628fb9c-8483-4e2d-8679-88d50e7e1377 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:40.820049 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3628fb9c-8483-4e2d-8679-88d50e7e1377 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1365 microversion: 2.1 time: 0.158788 Oct 27 19:39:40.821816 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3709/7270] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:40 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:41.844115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9954317c-8fa6-45a6-9c92-5c25395ae83f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:41.844744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9954317c-8fa6-45a6-9c92-5c25395ae83f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:41.851610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9954317c-8fa6-45a6-9c92-5c25395ae83f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:41.852769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9954317c-8fa6-45a6-9c92-5c25395ae83f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:41.853229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9954317c-8fa6-45a6-9c92-5c25395ae83f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:41.853942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9954317c-8fa6-45a6-9c92-5c25395ae83f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:41.854436 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9954317c-8fa6-45a6-9c92-5c25395ae83f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:41.854884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9954317c-8fa6-45a6-9c92-5c25395ae83f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:41.985471 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9954317c-8fa6-45a6-9c92-5c25395ae83f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:41.993241 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9954317c-8fa6-45a6-9c92-5c25395ae83f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1365 microversion: 2.1 time: 0.152955 Oct 27 19:39:41.993810 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3562/7271] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:41 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:42.864150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-19702ad4-4ffc-4a0b-b17b-5b011b04e65f req-1067cd57-cbea-4646-8a41-2e4193d5dbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1baf440-dcba-4ffe-952f-2b8a30696126", "name": "network-vif-plugged", "status": "completed", "tag": "2edf6369-296a-408c-9b72-9fb5cfffcecc"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:39:42.876959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-19702ad4-4ffc-4a0b-b17b-5b011b04e65f req-1067cd57-cbea-4646-8a41-2e4193d5dbb5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:42.877449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-19702ad4-4ffc-4a0b-b17b-5b011b04e65f req-1067cd57-cbea-4646-8a41-2e4193d5dbb5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:42.877885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-19702ad4-4ffc-4a0b-b17b-5b011b04e65f req-1067cd57-cbea-4646-8a41-2e4193d5dbb5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:42.890779 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-19702ad4-4ffc-4a0b-b17b-5b011b04e65f req-1067cd57-cbea-4646-8a41-2e4193d5dbb5 service nova] Creating event network-vif-plugged:2edf6369-296a-408c-9b72-9fb5cfffcecc for instance b1baf440-dcba-4ffe-952f-2b8a30696126 on n-h1-860687-3 Oct 27 19:39:42.896000 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-19702ad4-4ffc-4a0b-b17b-5b011b04e65f req-1067cd57-cbea-4646-8a41-2e4193d5dbb5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036027 Oct 27 19:39:42.896606 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3710/7272] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:39:43.017273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-669be6ce-d32f-4a6a-9ac7-ed432c5a1947 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:43.017910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-669be6ce-d32f-4a6a-9ac7-ed432c5a1947 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:43.025709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-669be6ce-d32f-4a6a-9ac7-ed432c5a1947 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:43.026221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-669be6ce-d32f-4a6a-9ac7-ed432c5a1947 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:43.026735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-669be6ce-d32f-4a6a-9ac7-ed432c5a1947 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:43.027461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-669be6ce-d32f-4a6a-9ac7-ed432c5a1947 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:43.027941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-669be6ce-d32f-4a6a-9ac7-ed432c5a1947 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:43.028398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-669be6ce-d32f-4a6a-9ac7-ed432c5a1947 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:43.159890 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-669be6ce-d32f-4a6a-9ac7-ed432c5a1947 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:43.167719 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-669be6ce-d32f-4a6a-9ac7-ed432c5a1947 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1365 microversion: 2.1 time: 0.154428 Oct 27 19:39:43.168296 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3563/7273] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:43 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:44.191781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2322ad91-4fe5-4efb-a745-deb6c29ac1fb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:44.192538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2322ad91-4fe5-4efb-a745-deb6c29ac1fb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:44.200230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2322ad91-4fe5-4efb-a745-deb6c29ac1fb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:44.200714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2322ad91-4fe5-4efb-a745-deb6c29ac1fb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:44.201156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2322ad91-4fe5-4efb-a745-deb6c29ac1fb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:44.201850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2322ad91-4fe5-4efb-a745-deb6c29ac1fb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:44.202310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2322ad91-4fe5-4efb-a745-deb6c29ac1fb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:44.202766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2322ad91-4fe5-4efb-a745-deb6c29ac1fb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:44.340408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2322ad91-4fe5-4efb-a745-deb6c29ac1fb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:44.348266 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2322ad91-4fe5-4efb-a745-deb6c29ac1fb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1365 microversion: 2.1 time: 0.160980 Oct 27 19:39:44.349132 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3711/7274] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:44 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:45.371857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9232c501-9aa3-48bb-8150-5cb8702e50df tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:45.372479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9232c501-9aa3-48bb-8150-5cb8702e50df tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:45.379413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9232c501-9aa3-48bb-8150-5cb8702e50df tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:45.379918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9232c501-9aa3-48bb-8150-5cb8702e50df tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:45.380382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9232c501-9aa3-48bb-8150-5cb8702e50df tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:45.381097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9232c501-9aa3-48bb-8150-5cb8702e50df tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:45.381574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9232c501-9aa3-48bb-8150-5cb8702e50df tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:45.382016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9232c501-9aa3-48bb-8150-5cb8702e50df tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:45.515438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9232c501-9aa3-48bb-8150-5cb8702e50df tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:39:45.523097 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9232c501-9aa3-48bb-8150-5cb8702e50df tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1552 microversion: 2.1 time: 0.155371 Oct 27 19:39:45.524207 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3564/7275] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:39:45 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:39:45.548216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-50cf39b3-0978-452d-b318-90e814128954 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:39:45.548721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-50cf39b3-0978-452d-b318-90e814128954 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:39:45.555555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50cf39b3-0978-452d-b318-90e814128954 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:45.556048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50cf39b3-0978-452d-b318-90e814128954 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:45.556493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50cf39b3-0978-452d-b318-90e814128954 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:45.557197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50cf39b3-0978-452d-b318-90e814128954 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:45.557660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50cf39b3-0978-452d-b318-90e814128954 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:45.558095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-50cf39b3-0978-452d-b318-90e814128954 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:45.638702 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-50cf39b3-0978-452d-b318-90e814128954 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094320 Oct 27 19:39:45.639323 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3712/7276] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:39:45 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:39:46.876366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d16da247-aaf1-4f2c-9059-fa173fe01369 req-92f65e1f-73eb-4285-b003-1293ea187776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1baf440-dcba-4ffe-952f-2b8a30696126", "tag": "2edf6369-296a-408c-9b72-9fb5cfffcecc"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:39:46.881181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:39:46.888825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d16da247-aaf1-4f2c-9059-fa173fe01369 req-92f65e1f-73eb-4285-b003-1293ea187776 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:39:46.889340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d16da247-aaf1-4f2c-9059-fa173fe01369 req-92f65e1f-73eb-4285-b003-1293ea187776 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:39:46.889798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d16da247-aaf1-4f2c-9059-fa173fe01369 req-92f65e1f-73eb-4285-b003-1293ea187776 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:39:46.902032 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d16da247-aaf1-4f2c-9059-fa173fe01369 req-92f65e1f-73eb-4285-b003-1293ea187776 service nova] Creating event network-changed:2edf6369-296a-408c-9b72-9fb5cfffcecc for instance b1baf440-dcba-4ffe-952f-2b8a30696126 on n-h1-860687-3 Oct 27 19:39:46.907813 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d16da247-aaf1-4f2c-9059-fa173fe01369 req-92f65e1f-73eb-4285-b003-1293ea187776 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034909 Oct 27 19:39:46.910924 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3565/7277] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:40:19.999509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:40:20.000450 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:40:20.002734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:40:20.003435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=48 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:40:20.008434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-adf7b113-1b82-414d-b12f-b57f6d208dda tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:40:20.017764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adf7b113-1b82-414d-b12f-b57f6d208dda tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:20.018255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adf7b113-1b82-414d-b12f-b57f6d208dda tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:20.018734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-adf7b113-1b82-414d-b12f-b57f6d208dda tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:20.041515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-adf7b113-1b82-414d-b12f-b57f6d208dda tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Going to try to stop instance {{(pid=127029) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 19:40:20.084316 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-adf7b113-1b82-414d-b12f-b57f6d208dda tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126/action" status: 202 len: 0 microversion: 2.1 time: 0.085377 Oct 27 19:40:20.084958 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3713/7278] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:40:19 2022] POST /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:40:20.091804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=21 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:40:20.092642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:40:20.097080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b087326b-e091-4c73-8ad6-2dc860e769a5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:20.097814 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b087326b-e091-4c73-8ad6-2dc860e769a5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:20.105996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b087326b-e091-4c73-8ad6-2dc860e769a5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:20.106537 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b087326b-e091-4c73-8ad6-2dc860e769a5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:20.106997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b087326b-e091-4c73-8ad6-2dc860e769a5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:20.107724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b087326b-e091-4c73-8ad6-2dc860e769a5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:20.108199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b087326b-e091-4c73-8ad6-2dc860e769a5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:20.108646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b087326b-e091-4c73-8ad6-2dc860e769a5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:20.304496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b087326b-e091-4c73-8ad6-2dc860e769a5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:20.313537 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b087326b-e091-4c73-8ad6-2dc860e769a5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1680 microversion: 2.1 time: 0.223920 Oct 27 19:40:20.314107 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3566/7279] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:20 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1680 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:21.339204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-79ad0b38-27d5-474d-99ee-c0a656b80bac tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:21.339847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-79ad0b38-27d5-474d-99ee-c0a656b80bac tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:21.346191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ad0b38-27d5-474d-99ee-c0a656b80bac tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:21.346717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ad0b38-27d5-474d-99ee-c0a656b80bac tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:21.347167 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ad0b38-27d5-474d-99ee-c0a656b80bac tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:21.347865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ad0b38-27d5-474d-99ee-c0a656b80bac tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:21.348328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ad0b38-27d5-474d-99ee-c0a656b80bac tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:21.348763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ad0b38-27d5-474d-99ee-c0a656b80bac tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:21.541754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-79ad0b38-27d5-474d-99ee-c0a656b80bac tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:21.549530 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-79ad0b38-27d5-474d-99ee-c0a656b80bac tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1680 microversion: 2.1 time: 0.215876 Oct 27 19:40:21.550100 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3714/7280] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:21 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1680 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:22.573775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-54fa283e-77b6-4a3a-9a3e-11224a34ae5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:22.574424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-54fa283e-77b6-4a3a-9a3e-11224a34ae5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:22.581334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-54fa283e-77b6-4a3a-9a3e-11224a34ae5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:22.581841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-54fa283e-77b6-4a3a-9a3e-11224a34ae5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:22.582296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-54fa283e-77b6-4a3a-9a3e-11224a34ae5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:22.583051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-54fa283e-77b6-4a3a-9a3e-11224a34ae5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:22.583526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-54fa283e-77b6-4a3a-9a3e-11224a34ae5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:22.584152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-54fa283e-77b6-4a3a-9a3e-11224a34ae5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:22.722083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-54fa283e-77b6-4a3a-9a3e-11224a34ae5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:22.730143 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-54fa283e-77b6-4a3a-9a3e-11224a34ae5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1680 microversion: 2.1 time: 0.160978 Oct 27 19:40:22.730780 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3567/7281] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:22 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:23.753219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dc9b7dc7-7457-4407-856f-97eae44b749a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:23.753843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dc9b7dc7-7457-4407-856f-97eae44b749a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:23.761015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc9b7dc7-7457-4407-856f-97eae44b749a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:23.761507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc9b7dc7-7457-4407-856f-97eae44b749a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:23.761955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc9b7dc7-7457-4407-856f-97eae44b749a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:23.762695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc9b7dc7-7457-4407-856f-97eae44b749a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:23.763162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc9b7dc7-7457-4407-856f-97eae44b749a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:23.763599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc9b7dc7-7457-4407-856f-97eae44b749a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:23.898101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dc9b7dc7-7457-4407-856f-97eae44b749a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:23.907172 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dc9b7dc7-7457-4407-856f-97eae44b749a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1680 microversion: 2.1 time: 0.157863 Oct 27 19:40:23.907768 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3715/7282] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:23 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:24.931968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0918060c-5005-4370-9a21-7a3e76a4d70a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:24.932628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0918060c-5005-4370-9a21-7a3e76a4d70a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:24.939807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0918060c-5005-4370-9a21-7a3e76a4d70a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:24.940322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0918060c-5005-4370-9a21-7a3e76a4d70a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:24.940788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0918060c-5005-4370-9a21-7a3e76a4d70a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:24.941514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0918060c-5005-4370-9a21-7a3e76a4d70a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:24.941997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0918060c-5005-4370-9a21-7a3e76a4d70a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:24.942477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0918060c-5005-4370-9a21-7a3e76a4d70a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:25.072914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0918060c-5005-4370-9a21-7a3e76a4d70a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:25.080660 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0918060c-5005-4370-9a21-7a3e76a4d70a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1680 microversion: 2.1 time: 0.152810 Oct 27 19:40:25.081231 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3568/7283] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:24 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:26.105026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0f9ce3c1-8ea8-408c-acb3-ae2cfdc11029 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:26.105649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0f9ce3c1-8ea8-408c-acb3-ae2cfdc11029 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:26.112526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f9ce3c1-8ea8-408c-acb3-ae2cfdc11029 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:26.113054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f9ce3c1-8ea8-408c-acb3-ae2cfdc11029 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:26.113505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f9ce3c1-8ea8-408c-acb3-ae2cfdc11029 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:26.114208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f9ce3c1-8ea8-408c-acb3-ae2cfdc11029 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:26.114706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f9ce3c1-8ea8-408c-acb3-ae2cfdc11029 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:26.115147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0f9ce3c1-8ea8-408c-acb3-ae2cfdc11029 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:26.247749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0f9ce3c1-8ea8-408c-acb3-ae2cfdc11029 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:26.255501 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0f9ce3c1-8ea8-408c-acb3-ae2cfdc11029 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1680 microversion: 2.1 time: 0.155075 Oct 27 19:40:26.256074 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3716/7284] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:26 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:27.280209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a3ad48e5-8625-4e72-8e75-c7bd2806c841 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:27.280848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a3ad48e5-8625-4e72-8e75-c7bd2806c841 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:27.287704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3ad48e5-8625-4e72-8e75-c7bd2806c841 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:27.288214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3ad48e5-8625-4e72-8e75-c7bd2806c841 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:27.288682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3ad48e5-8625-4e72-8e75-c7bd2806c841 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:27.289400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3ad48e5-8625-4e72-8e75-c7bd2806c841 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:27.289879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3ad48e5-8625-4e72-8e75-c7bd2806c841 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:27.291044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3ad48e5-8625-4e72-8e75-c7bd2806c841 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:27.419879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a3ad48e5-8625-4e72-8e75-c7bd2806c841 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:27.427665 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a3ad48e5-8625-4e72-8e75-c7bd2806c841 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1680 microversion: 2.1 time: 0.151459 Oct 27 19:40:27.428239 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3569/7285] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:27 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:28.452305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-035f8fcc-ba9d-4f5d-af7e-0f757b2deee7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:28.452932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-035f8fcc-ba9d-4f5d-af7e-0f757b2deee7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:28.459521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-035f8fcc-ba9d-4f5d-af7e-0f757b2deee7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:28.460016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-035f8fcc-ba9d-4f5d-af7e-0f757b2deee7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:28.460466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-035f8fcc-ba9d-4f5d-af7e-0f757b2deee7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:28.461171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-035f8fcc-ba9d-4f5d-af7e-0f757b2deee7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:28.461639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-035f8fcc-ba9d-4f5d-af7e-0f757b2deee7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:28.462868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-035f8fcc-ba9d-4f5d-af7e-0f757b2deee7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:28.592212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-035f8fcc-ba9d-4f5d-af7e-0f757b2deee7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:28.600376 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-035f8fcc-ba9d-4f5d-af7e-0f757b2deee7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1680 microversion: 2.1 time: 0.152256 Oct 27 19:40:28.600949 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3717/7286] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:28 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:40:29.624111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-56e68312-a16b-4164-97c8-1e7952754454 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:29.624760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-56e68312-a16b-4164-97c8-1e7952754454 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:29.631755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56e68312-a16b-4164-97c8-1e7952754454 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:29.632266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56e68312-a16b-4164-97c8-1e7952754454 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:29.632731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56e68312-a16b-4164-97c8-1e7952754454 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:29.633454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56e68312-a16b-4164-97c8-1e7952754454 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:29.633937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56e68312-a16b-4164-97c8-1e7952754454 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:29.634409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56e68312-a16b-4164-97c8-1e7952754454 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:29.766262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-56e68312-a16b-4164-97c8-1e7952754454 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:29.774176 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-56e68312-a16b-4164-97c8-1e7952754454 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1680 microversion: 2.1 time: 0.154054 Oct 27 19:40:29.776085 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3570/7287] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:29 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:30.800197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-84082ae4-ee6f-46c4-922b-ff30a70c76d5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:30.800739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-84082ae4-ee6f-46c4-922b-ff30a70c76d5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:30.808435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84082ae4-ee6f-46c4-922b-ff30a70c76d5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:30.808922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84082ae4-ee6f-46c4-922b-ff30a70c76d5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:30.809370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84082ae4-ee6f-46c4-922b-ff30a70c76d5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:30.810070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84082ae4-ee6f-46c4-922b-ff30a70c76d5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:30.810572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84082ae4-ee6f-46c4-922b-ff30a70c76d5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:30.811012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-84082ae4-ee6f-46c4-922b-ff30a70c76d5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:30.943961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-84082ae4-ee6f-46c4-922b-ff30a70c76d5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:30.951860 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-84082ae4-ee6f-46c4-922b-ff30a70c76d5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1657 microversion: 2.1 time: 0.155776 Oct 27 19:40:30.952455 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3718/7288] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:30 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1657 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:30.974524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:40:30.976847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:30.984422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:30.984938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:30.985417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:30.986130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:30.986639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:30.987097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:31.016327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:31.021748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Old instance type m1.heat2, new instance type m1.heat {{(pid=127028) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 19:40:31.028802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:40:31.029248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:40:31.029744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:40:31.030176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:40:31.030642 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:40:31.094394 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b601d1fc-e3a9-409e-a915-f5938c7fff11 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126/action" status: 202 len: 0 microversion: 2.1 time: 0.123792 Oct 27 19:40:31.095260 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3571/7289] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:40:30 2022] POST /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:40:31.103417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ec7371e2-797b-4005-a8f7-dd72ec4be35e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:31.104300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ec7371e2-797b-4005-a8f7-dd72ec4be35e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:31.110444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec7371e2-797b-4005-a8f7-dd72ec4be35e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:31.110938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec7371e2-797b-4005-a8f7-dd72ec4be35e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:31.111376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec7371e2-797b-4005-a8f7-dd72ec4be35e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:31.112071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec7371e2-797b-4005-a8f7-dd72ec4be35e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:31.112533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec7371e2-797b-4005-a8f7-dd72ec4be35e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:31.112963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec7371e2-797b-4005-a8f7-dd72ec4be35e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:31.270687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ec7371e2-797b-4005-a8f7-dd72ec4be35e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:31.278619 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ec7371e2-797b-4005-a8f7-dd72ec4be35e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1680 microversion: 2.1 time: 0.179297 Oct 27 19:40:31.279199 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3719/7290] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:31 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:32.302668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-51303495-9546-485d-80c7-10379db23424 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:32.303276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-51303495-9546-485d-80c7-10379db23424 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:32.314593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-51303495-9546-485d-80c7-10379db23424 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:32.315130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-51303495-9546-485d-80c7-10379db23424 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:32.315706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-51303495-9546-485d-80c7-10379db23424 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:32.316694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-51303495-9546-485d-80c7-10379db23424 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:32.317338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-51303495-9546-485d-80c7-10379db23424 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:32.317901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-51303495-9546-485d-80c7-10379db23424 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:32.456258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-51303495-9546-485d-80c7-10379db23424 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:32.464946 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-51303495-9546-485d-80c7-10379db23424 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1680 microversion: 2.1 time: 0.167502 Oct 27 19:40:32.465539 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3572/7291] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:32 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:33.489346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-33efe2b8-df47-4d89-84cb-b74a4f789615 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:33.489964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-33efe2b8-df47-4d89-84cb-b74a4f789615 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:33.497276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33efe2b8-df47-4d89-84cb-b74a4f789615 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:33.497762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33efe2b8-df47-4d89-84cb-b74a4f789615 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:33.498203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33efe2b8-df47-4d89-84cb-b74a4f789615 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:33.498924 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33efe2b8-df47-4d89-84cb-b74a4f789615 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:33.499375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33efe2b8-df47-4d89-84cb-b74a4f789615 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:33.499806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33efe2b8-df47-4d89-84cb-b74a4f789615 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:33.630632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-33efe2b8-df47-4d89-84cb-b74a4f789615 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:33.638901 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-33efe2b8-df47-4d89-84cb-b74a4f789615 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1685 microversion: 2.1 time: 0.153582 Oct 27 19:40:33.639470 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3720/7292] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:33 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:34.662830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1c073d1e-22d9-4224-b1b7-48073e4059c5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:34.663503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1c073d1e-22d9-4224-b1b7-48073e4059c5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:34.670839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c073d1e-22d9-4224-b1b7-48073e4059c5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:34.671356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c073d1e-22d9-4224-b1b7-48073e4059c5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:34.671816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c073d1e-22d9-4224-b1b7-48073e4059c5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:34.672558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c073d1e-22d9-4224-b1b7-48073e4059c5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:34.673037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c073d1e-22d9-4224-b1b7-48073e4059c5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:34.673487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c073d1e-22d9-4224-b1b7-48073e4059c5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:34.803062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1c073d1e-22d9-4224-b1b7-48073e4059c5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:34.810988 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1c073d1e-22d9-4224-b1b7-48073e4059c5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1685 microversion: 2.1 time: 0.152164 Oct 27 19:40:34.811571 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3573/7293] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:34 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:35.565399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-0b17871f-101e-475b-be4b-9a88bc42a59b req-787f32fc-ad2e-496e-a036-adf8a027a476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1baf440-dcba-4ffe-952f-2b8a30696126", "name": "network-vif-unplugged", "status": "completed", "tag": "2edf6369-296a-408c-9b72-9fb5cfffcecc"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:40:35.577313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0b17871f-101e-475b-be4b-9a88bc42a59b req-787f32fc-ad2e-496e-a036-adf8a027a476 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:35.577813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0b17871f-101e-475b-be4b-9a88bc42a59b req-787f32fc-ad2e-496e-a036-adf8a027a476 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:35.578258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0b17871f-101e-475b-be4b-9a88bc42a59b req-787f32fc-ad2e-496e-a036-adf8a027a476 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:35.590451 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-0b17871f-101e-475b-be4b-9a88bc42a59b req-787f32fc-ad2e-496e-a036-adf8a027a476 service nova] Creating event network-vif-unplugged:2edf6369-296a-408c-9b72-9fb5cfffcecc for instance b1baf440-dcba-4ffe-952f-2b8a30696126 on n-h2-860687-3 Oct 27 19:40:35.595920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-0b17871f-101e-475b-be4b-9a88bc42a59b req-787f32fc-ad2e-496e-a036-adf8a027a476 service nova] Instance b1baf440-dcba-4ffe-952f-2b8a30696126 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:40:35.607970 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-0b17871f-101e-475b-be4b-9a88bc42a59b req-787f32fc-ad2e-496e-a036-adf8a027a476 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047945 Oct 27 19:40:35.608589 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3721/7294] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:40:35.835340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7e01d28c-afe7-4d87-b6cf-faf16dca5866 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:35.835978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7e01d28c-afe7-4d87-b6cf-faf16dca5866 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:35.843010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e01d28c-afe7-4d87-b6cf-faf16dca5866 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:35.843539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e01d28c-afe7-4d87-b6cf-faf16dca5866 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:35.843996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e01d28c-afe7-4d87-b6cf-faf16dca5866 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:35.844720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e01d28c-afe7-4d87-b6cf-faf16dca5866 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:35.845200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e01d28c-afe7-4d87-b6cf-faf16dca5866 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:35.845655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e01d28c-afe7-4d87-b6cf-faf16dca5866 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:36.052897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7e01d28c-afe7-4d87-b6cf-faf16dca5866 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:36.061856 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7e01d28c-afe7-4d87-b6cf-faf16dca5866 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1684 microversion: 2.1 time: 0.230439 Oct 27 19:40:36.062466 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3574/7295] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:35 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1684 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:37.087322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b35d8e80-f26d-42b4-bb52-a12515509c07 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:37.087963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b35d8e80-f26d-42b4-bb52-a12515509c07 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:37.094128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b35d8e80-f26d-42b4-bb52-a12515509c07 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:37.094646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b35d8e80-f26d-42b4-bb52-a12515509c07 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:37.095096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b35d8e80-f26d-42b4-bb52-a12515509c07 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:37.095791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b35d8e80-f26d-42b4-bb52-a12515509c07 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:37.096255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b35d8e80-f26d-42b4-bb52-a12515509c07 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:37.096689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b35d8e80-f26d-42b4-bb52-a12515509c07 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:37.227765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b35d8e80-f26d-42b4-bb52-a12515509c07 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:37.235686 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b35d8e80-f26d-42b4-bb52-a12515509c07 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1682 microversion: 2.1 time: 0.153662 Oct 27 19:40:37.236267 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3722/7296] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:37 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:37.649884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-4aa6e5cc-e25a-4b56-8bd7-54ad457c1459 req-37de836b-c61e-48e3-943c-cb11cb83c6ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1baf440-dcba-4ffe-952f-2b8a30696126", "tag": "2edf6369-296a-408c-9b72-9fb5cfffcecc"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:40:37.659920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4aa6e5cc-e25a-4b56-8bd7-54ad457c1459 req-37de836b-c61e-48e3-943c-cb11cb83c6ea service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:37.660425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4aa6e5cc-e25a-4b56-8bd7-54ad457c1459 req-37de836b-c61e-48e3-943c-cb11cb83c6ea service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:37.660886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4aa6e5cc-e25a-4b56-8bd7-54ad457c1459 req-37de836b-c61e-48e3-943c-cb11cb83c6ea service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:37.672980 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-4aa6e5cc-e25a-4b56-8bd7-54ad457c1459 req-37de836b-c61e-48e3-943c-cb11cb83c6ea service nova] Creating event network-changed:2edf6369-296a-408c-9b72-9fb5cfffcecc for instance b1baf440-dcba-4ffe-952f-2b8a30696126 on n-h2-860687-3 Oct 27 19:40:37.678308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-4aa6e5cc-e25a-4b56-8bd7-54ad457c1459 req-37de836b-c61e-48e3-943c-cb11cb83c6ea service nova] Instance b1baf440-dcba-4ffe-952f-2b8a30696126 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:40:37.689838 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-4aa6e5cc-e25a-4b56-8bd7-54ad457c1459 req-37de836b-c61e-48e3-943c-cb11cb83c6ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043542 Oct 27 19:40:37.690470 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3575/7297] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:40:38.260593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6b02abc2-155f-4e78-acbf-d9b355b96132 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:38.261218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6b02abc2-155f-4e78-acbf-d9b355b96132 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:38.268059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b02abc2-155f-4e78-acbf-d9b355b96132 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:38.268557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b02abc2-155f-4e78-acbf-d9b355b96132 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:38.269005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b02abc2-155f-4e78-acbf-d9b355b96132 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:38.269714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b02abc2-155f-4e78-acbf-d9b355b96132 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:38.270186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b02abc2-155f-4e78-acbf-d9b355b96132 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:38.270661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6b02abc2-155f-4e78-acbf-d9b355b96132 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:38.402220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6b02abc2-155f-4e78-acbf-d9b355b96132 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:38.409999 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6b02abc2-155f-4e78-acbf-d9b355b96132 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1682 microversion: 2.1 time: 0.154001 Oct 27 19:40:38.410607 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3723/7298] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:38 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:39.434966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d1536417-fa45-4597-918d-54e129530256 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:39.435602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d1536417-fa45-4597-918d-54e129530256 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:39.442488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1536417-fa45-4597-918d-54e129530256 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:39.443005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1536417-fa45-4597-918d-54e129530256 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:39.443462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1536417-fa45-4597-918d-54e129530256 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:39.444194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1536417-fa45-4597-918d-54e129530256 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:39.444676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1536417-fa45-4597-918d-54e129530256 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:39.445123 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1536417-fa45-4597-918d-54e129530256 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:39.879492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d1536417-fa45-4597-918d-54e129530256 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:39.888371 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d1536417-fa45-4597-918d-54e129530256 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1678 microversion: 2.1 time: 0.459534 Oct 27 19:40:39.889294 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3576/7299] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:39 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1678 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:39.912534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ebf91bf7-7103-4bc2-9ca0-46b3a7976e33 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:40:39.913112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ebf91bf7-7103-4bc2-9ca0-46b3a7976e33 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:39.921216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebf91bf7-7103-4bc2-9ca0-46b3a7976e33 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:39.921706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebf91bf7-7103-4bc2-9ca0-46b3a7976e33 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:39.922149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebf91bf7-7103-4bc2-9ca0-46b3a7976e33 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:39.922916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebf91bf7-7103-4bc2-9ca0-46b3a7976e33 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:39.923375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebf91bf7-7103-4bc2-9ca0-46b3a7976e33 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:39.923807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ebf91bf7-7103-4bc2-9ca0-46b3a7976e33 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:39.983765 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ebf91bf7-7103-4bc2-9ca0-46b3a7976e33 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126/action" status: 204 len: 0 microversion: 2.1 time: 0.075524 Oct 27 19:40:39.984424 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3724/7300] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:40:39 2022] POST /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:40:39.992789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3d876027-fae4-4248-a6ed-860059998401 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:39.993459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3d876027-fae4-4248-a6ed-860059998401 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:40.000620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d876027-fae4-4248-a6ed-860059998401 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:40.001144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d876027-fae4-4248-a6ed-860059998401 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:40.001610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d876027-fae4-4248-a6ed-860059998401 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:40.002335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d876027-fae4-4248-a6ed-860059998401 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:40.002842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d876027-fae4-4248-a6ed-860059998401 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:40.003296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d876027-fae4-4248-a6ed-860059998401 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:40.240249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d876027-fae4-4248-a6ed-860059998401 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:40.248901 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3d876027-fae4-4248-a6ed-860059998401 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1678 microversion: 2.1 time: 0.260133 Oct 27 19:40:40.254459 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3577/7301] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:39 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1678 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:41.273910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-438d9eb5-4378-4841-a8e1-68e9cb27a32a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:41.275235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-438d9eb5-4378-4841-a8e1-68e9cb27a32a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:41.281496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-438d9eb5-4378-4841-a8e1-68e9cb27a32a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:41.281993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-438d9eb5-4378-4841-a8e1-68e9cb27a32a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:41.282469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-438d9eb5-4378-4841-a8e1-68e9cb27a32a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:41.283182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-438d9eb5-4378-4841-a8e1-68e9cb27a32a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:41.283647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-438d9eb5-4378-4841-a8e1-68e9cb27a32a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:41.284086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-438d9eb5-4378-4841-a8e1-68e9cb27a32a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:41.427898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-438d9eb5-4378-4841-a8e1-68e9cb27a32a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:41.436929 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-438d9eb5-4378-4841-a8e1-68e9cb27a32a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1657 microversion: 2.1 time: 0.168114 Oct 27 19:40:41.437516 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3725/7302] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:41 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1657 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:41.459693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dbe76847-a262-4756-909e-3f71846a266a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:41.460339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dbe76847-a262-4756-909e-3f71846a266a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:41.467580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe76847-a262-4756-909e-3f71846a266a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:41.468101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe76847-a262-4756-909e-3f71846a266a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:41.468566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe76847-a262-4756-909e-3f71846a266a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:41.469304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe76847-a262-4756-909e-3f71846a266a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:41.469787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe76847-a262-4756-909e-3f71846a266a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:41.470242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe76847-a262-4756-909e-3f71846a266a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:41.605181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dbe76847-a262-4756-909e-3f71846a266a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:41.613035 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dbe76847-a262-4756-909e-3f71846a266a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1657 microversion: 2.1 time: 0.157175 Oct 27 19:40:41.613617 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3578/7303] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:41 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1657 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:41.635365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-26eab76f-97e3-43c9-a5bc-428b69f709de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:40:41.641490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26eab76f-97e3-43c9-a5bc-428b69f709de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:41.641991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26eab76f-97e3-43c9-a5bc-428b69f709de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:41.642484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26eab76f-97e3-43c9-a5bc-428b69f709de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:41.668291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-26eab76f-97e3-43c9-a5bc-428b69f709de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Going to try to start instance {{(pid=127029) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 19:40:41.702477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:40:41.712907 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-26eab76f-97e3-43c9-a5bc-428b69f709de tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126/action" status: 202 len: 0 microversion: 2.1 time: 0.081325 Oct 27 19:40:41.713530 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3726/7304] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:40:41 2022] POST /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:40:41.724047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3f2cf7a9-1298-4253-a619-196f0bf4da87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:41.724991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3f2cf7a9-1298-4253-a619-196f0bf4da87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:41.734021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f2cf7a9-1298-4253-a619-196f0bf4da87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:41.734568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f2cf7a9-1298-4253-a619-196f0bf4da87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:41.735026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f2cf7a9-1298-4253-a619-196f0bf4da87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:41.736301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f2cf7a9-1298-4253-a619-196f0bf4da87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:41.737221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f2cf7a9-1298-4253-a619-196f0bf4da87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:41.737849 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f2cf7a9-1298-4253-a619-196f0bf4da87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:41.970401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3f2cf7a9-1298-4253-a619-196f0bf4da87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:41.979445 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3f2cf7a9-1298-4253-a619-196f0bf4da87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1666 microversion: 2.1 time: 0.261244 Oct 27 19:40:41.980129 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3579/7305] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:41 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1666 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:40:43.004913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ab5e0076-8ad7-46b4-a083-a36d47b5515b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:43.005630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ab5e0076-8ad7-46b4-a083-a36d47b5515b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:43.013452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab5e0076-8ad7-46b4-a083-a36d47b5515b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:43.013946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab5e0076-8ad7-46b4-a083-a36d47b5515b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:43.014411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab5e0076-8ad7-46b4-a083-a36d47b5515b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:43.015115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab5e0076-8ad7-46b4-a083-a36d47b5515b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:43.015586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab5e0076-8ad7-46b4-a083-a36d47b5515b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:43.016022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ab5e0076-8ad7-46b4-a083-a36d47b5515b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:43.146234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ab5e0076-8ad7-46b4-a083-a36d47b5515b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:43.154238 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ab5e0076-8ad7-46b4-a083-a36d47b5515b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1670 microversion: 2.1 time: 0.154400 Oct 27 19:40:43.154845 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3727/7306] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:42 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:43.177042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ecfb85b7-7592-4875-bd3a-cd6ee10474bb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:43.177570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ecfb85b7-7592-4875-bd3a-cd6ee10474bb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:43.185246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecfb85b7-7592-4875-bd3a-cd6ee10474bb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:43.185756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecfb85b7-7592-4875-bd3a-cd6ee10474bb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:43.186221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecfb85b7-7592-4875-bd3a-cd6ee10474bb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:43.186968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecfb85b7-7592-4875-bd3a-cd6ee10474bb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:43.187450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecfb85b7-7592-4875-bd3a-cd6ee10474bb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:43.187905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ecfb85b7-7592-4875-bd3a-cd6ee10474bb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:43.215285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ecfb85b7-7592-4875-bd3a-cd6ee10474bb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:40:43.242649 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:40:43.293426 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ecfb85b7-7592-4875-bd3a-cd6ee10474bb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 204 len: 0 microversion: 2.1 time: 0.120024 Oct 27 19:40:43.293967 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3580/7307] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:40:43 2022] DELETE /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:40:43.302896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1e1812ed-0ef6-4617-acf9-55f3a4bde017 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:43.303505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1e1812ed-0ef6-4617-acf9-55f3a4bde017 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:43.310011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e1812ed-0ef6-4617-acf9-55f3a4bde017 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:43.310548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e1812ed-0ef6-4617-acf9-55f3a4bde017 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:43.310997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e1812ed-0ef6-4617-acf9-55f3a4bde017 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:43.311701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e1812ed-0ef6-4617-acf9-55f3a4bde017 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:43.312163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e1812ed-0ef6-4617-acf9-55f3a4bde017 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:43.312595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1e1812ed-0ef6-4617-acf9-55f3a4bde017 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:43.445269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1e1812ed-0ef6-4617-acf9-55f3a4bde017 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:43.453666 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1e1812ed-0ef6-4617-acf9-55f3a4bde017 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1676 microversion: 2.1 time: 0.154701 Oct 27 19:40:43.454241 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3728/7308] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:43 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:43.726928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-de1a9c21-3598-487d-ba74-6b8a31b7a8b8 req-ce4e4807-c6de-4cfd-983b-c4474aa60c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1baf440-dcba-4ffe-952f-2b8a30696126", "name": "network-vif-plugged", "status": "completed", "tag": "2edf6369-296a-408c-9b72-9fb5cfffcecc"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:40:43.737726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-de1a9c21-3598-487d-ba74-6b8a31b7a8b8 req-ce4e4807-c6de-4cfd-983b-c4474aa60c27 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:43.738233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-de1a9c21-3598-487d-ba74-6b8a31b7a8b8 req-ce4e4807-c6de-4cfd-983b-c4474aa60c27 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:43.738724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-de1a9c21-3598-487d-ba74-6b8a31b7a8b8 req-ce4e4807-c6de-4cfd-983b-c4474aa60c27 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:43.751192 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-de1a9c21-3598-487d-ba74-6b8a31b7a8b8 req-ce4e4807-c6de-4cfd-983b-c4474aa60c27 service nova] Creating event network-vif-plugged:2edf6369-296a-408c-9b72-9fb5cfffcecc for instance b1baf440-dcba-4ffe-952f-2b8a30696126 on n-h2-860687-3 Oct 27 19:40:43.756004 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-de1a9c21-3598-487d-ba74-6b8a31b7a8b8 req-ce4e4807-c6de-4cfd-983b-c4474aa60c27 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033270 Oct 27 19:40:43.756714 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3581/7309] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:40:44.477412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4defd69d-d158-4574-aed2-8bfe37f6d6ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:44.478350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4defd69d-d158-4574-aed2-8bfe37f6d6ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:44.485261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4defd69d-d158-4574-aed2-8bfe37f6d6ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:44.485761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4defd69d-d158-4574-aed2-8bfe37f6d6ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:44.486205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4defd69d-d158-4574-aed2-8bfe37f6d6ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:44.486930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4defd69d-d158-4574-aed2-8bfe37f6d6ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:44.487393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4defd69d-d158-4574-aed2-8bfe37f6d6ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:44.487825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4defd69d-d158-4574-aed2-8bfe37f6d6ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:44.620369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4defd69d-d158-4574-aed2-8bfe37f6d6ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:44.628282 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4defd69d-d158-4574-aed2-8bfe37f6d6ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1676 microversion: 2.1 time: 0.154834 Oct 27 19:40:44.628798 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3729/7310] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:44 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:45.516114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-2ce72e1e-e4f0-46f4-a921-e3dae49b77fc req-96d9f2dc-46d5-499c-8bc5-b6e2988b4d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1baf440-dcba-4ffe-952f-2b8a30696126", "name": "network-vif-deleted", "tag": "2edf6369-296a-408c-9b72-9fb5cfffcecc"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:40:45.528347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2ce72e1e-e4f0-46f4-a921-e3dae49b77fc req-96d9f2dc-46d5-499c-8bc5-b6e2988b4d2a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:45.528851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2ce72e1e-e4f0-46f4-a921-e3dae49b77fc req-96d9f2dc-46d5-499c-8bc5-b6e2988b4d2a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:45.529609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2ce72e1e-e4f0-46f4-a921-e3dae49b77fc req-96d9f2dc-46d5-499c-8bc5-b6e2988b4d2a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:45.550140 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-2ce72e1e-e4f0-46f4-a921-e3dae49b77fc req-96d9f2dc-46d5-499c-8bc5-b6e2988b4d2a service nova] Creating event network-vif-deleted:2edf6369-296a-408c-9b72-9fb5cfffcecc for instance b1baf440-dcba-4ffe-952f-2b8a30696126 on n-h2-860687-3 Oct 27 19:40:45.555152 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-2ce72e1e-e4f0-46f4-a921-e3dae49b77fc req-96d9f2dc-46d5-499c-8bc5-b6e2988b4d2a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044688 Oct 27 19:40:45.557708 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3582/7311] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:40:45.654171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3ef6f11f-b494-43f2-8751-983d448d8900 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:45.654822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3ef6f11f-b494-43f2-8751-983d448d8900 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:45.662166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6f11f-b494-43f2-8751-983d448d8900 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:45.662904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6f11f-b494-43f2-8751-983d448d8900 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:45.663645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6f11f-b494-43f2-8751-983d448d8900 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:45.664516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6f11f-b494-43f2-8751-983d448d8900 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:45.665135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6f11f-b494-43f2-8751-983d448d8900 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:45.665569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6f11f-b494-43f2-8751-983d448d8900 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:45.700331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6f11f-b494-43f2-8751-983d448d8900 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:45.700997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6f11f-b494-43f2-8751-983d448d8900 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:45.701523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ef6f11f-b494-43f2-8751-983d448d8900 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:45.702057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-3ef6f11f-b494-43f2-8751-983d448d8900 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lazy-loading 'fault' on Instance uuid b1baf440-dcba-4ffe-952f-2b8a30696126 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:40:45.748546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3ef6f11f-b494-43f2-8751-983d448d8900 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:45.755576 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3ef6f11f-b494-43f2-8751-983d448d8900 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 200 len: 1329 microversion: 2.1 time: 0.107898 Oct 27 19:40:45.756193 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3730/7312] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:45 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 1329 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:46.781320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9675a069-66be-4625-b6ba-862525890896 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:46.782049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9675a069-66be-4625-b6ba-862525890896 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:46.788466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9675a069-66be-4625-b6ba-862525890896 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:46.788983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9675a069-66be-4625-b6ba-862525890896 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:46.789453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9675a069-66be-4625-b6ba-862525890896 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:46.790433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9675a069-66be-4625-b6ba-862525890896 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:46.790996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9675a069-66be-4625-b6ba-862525890896 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:46.791388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9675a069-66be-4625-b6ba-862525890896 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:46.804950 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-9675a069-66be-4625-b6ba-862525890896 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9675a069-66be-4625-b6ba-862525890896 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 HTTP/1.1 Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'b1baf440-dcba-4ffe-952f-2b8a30696126'} Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:40:46.807084 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:40:46.812484 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:40:46.812484 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:40:46.812484 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:40:46.812484 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:40:46.812484 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:40:46.812484 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:40:46.812484 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:40:46.812484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9675a069-66be-4625-b6ba-862525890896 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:40:46.812484 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9675a069-66be-4625-b6ba-862525890896 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 404 len: 111 microversion: 2.1 time: 0.032469 Oct 27 19:40:46.812484 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3583/7313] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:46 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:40:46.825974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8d6270f3-7898-4871-b74f-9174fc824eeb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:46.826675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8d6270f3-7898-4871-b74f-9174fc824eeb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:46.833640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d6270f3-7898-4871-b74f-9174fc824eeb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:46.834170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d6270f3-7898-4871-b74f-9174fc824eeb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:46.834651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d6270f3-7898-4871-b74f-9174fc824eeb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:46.835389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d6270f3-7898-4871-b74f-9174fc824eeb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:46.835859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d6270f3-7898-4871-b74f-9174fc824eeb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:46.836301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d6270f3-7898-4871-b74f-9174fc824eeb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:46.849947 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-8d6270f3-7898-4871-b74f-9174fc824eeb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8d6270f3-7898-4871-b74f-9174fc824eeb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 HTTP/1.1 Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'b1baf440-dcba-4ffe-952f-2b8a30696126'} Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:40:46.851635 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:40:46.856314 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:40:46.856314 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:40:46.856314 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:40:46.856314 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:40:46.856314 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:40:46.856314 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:40:46.856314 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:40:46.856314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8d6270f3-7898-4871-b74f-9174fc824eeb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:40:46.856314 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8d6270f3-7898-4871-b74f-9174fc824eeb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 404 len: 111 microversion: 2.1 time: 0.031915 Oct 27 19:40:46.856314 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3731/7314] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:46 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:40:46.901907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-391264274", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "5c454dce-b174-4189-a970-7d03caf6318a"}], "security_groups": [{"name": "tempest-securitygroup--1252788107"}], "key_name": "tempest-keypair-2116444884", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:40:47.018255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] validate_networks() for [('5c454dce-b174-4189-a970-7d03caf6318a', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:40:47.446966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:40:47.447504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:40:47.448006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:40:47.448440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:40:47.448878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:40:47.457788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:47.458293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:47.458783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:47.459541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:47.460072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:47.460502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:47.477335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Getting quotas for project 612eaff9b8f24492b2c53c62e6be5aa0. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:40:47.483231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Getting quotas for user c036fdc2fff644aa92e90481e04933c0 and project 612eaff9b8f24492b2c53c62e6be5aa0. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:40:47.496374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:40:47.498725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:40:47.546091 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e1e64607-90ea-4344-a4db-541db3f9c9a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.648173 Oct 27 19:40:47.546795 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3584/7315] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:40:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:40:47.558850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-15093ae0-973d-46c4-b6ad-caaf404c5153 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:47.559483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-15093ae0-973d-46c4-b6ad-caaf404c5153 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:47.618951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-15093ae0-973d-46c4-b6ad-caaf404c5153 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:47.626245 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-15093ae0-973d-46c4-b6ad-caaf404c5153 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1238 microversion: 2.1 time: 0.071768 Oct 27 19:40:47.626921 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3732/7316] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:47 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:48.651722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cd8278d4-cfaf-418c-8f77-cd17b6e895f6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:48.652500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cd8278d4-cfaf-418c-8f77-cd17b6e895f6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:48.659780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd8278d4-cfaf-418c-8f77-cd17b6e895f6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:48.660328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd8278d4-cfaf-418c-8f77-cd17b6e895f6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:48.660794 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd8278d4-cfaf-418c-8f77-cd17b6e895f6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:48.661621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd8278d4-cfaf-418c-8f77-cd17b6e895f6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:48.662103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd8278d4-cfaf-418c-8f77-cd17b6e895f6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:48.662775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd8278d4-cfaf-418c-8f77-cd17b6e895f6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:48.767790 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cd8278d4-cfaf-418c-8f77-cd17b6e895f6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:48.777008 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cd8278d4-cfaf-418c-8f77-cd17b6e895f6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1298 microversion: 2.1 time: 0.131141 Oct 27 19:40:48.777849 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3585/7317] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:48 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1298 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:49.802833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a4574ae5-9ab9-46cd-b67f-d23d88c723f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:49.803656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a4574ae5-9ab9-46cd-b67f-d23d88c723f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:49.815596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4574ae5-9ab9-46cd-b67f-d23d88c723f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:49.816150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4574ae5-9ab9-46cd-b67f-d23d88c723f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:49.816588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4574ae5-9ab9-46cd-b67f-d23d88c723f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:49.817285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4574ae5-9ab9-46cd-b67f-d23d88c723f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:49.817742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4574ae5-9ab9-46cd-b67f-d23d88c723f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:49.818171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4574ae5-9ab9-46cd-b67f-d23d88c723f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:49.954331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a4574ae5-9ab9-46cd-b67f-d23d88c723f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:49.962410 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a4574ae5-9ab9-46cd-b67f-d23d88c723f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1364 microversion: 2.1 time: 0.163547 Oct 27 19:40:49.962989 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3733/7318] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:49 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:50.134846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f95d4717-1b8b-4566-bf55-bbbb882795f9 req-572f0b02-9b16-411a-b0df-712a64581cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23934ebc-aaa0-47f9-8aaf-733d0fb83bdc", "tag": "e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:40:50.142958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:40:50.148641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f95d4717-1b8b-4566-bf55-bbbb882795f9 req-572f0b02-9b16-411a-b0df-712a64581cdc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:50.149150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f95d4717-1b8b-4566-bf55-bbbb882795f9 req-572f0b02-9b16-411a-b0df-712a64581cdc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:50.149651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f95d4717-1b8b-4566-bf55-bbbb882795f9 req-572f0b02-9b16-411a-b0df-712a64581cdc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:50.176512 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f95d4717-1b8b-4566-bf55-bbbb882795f9 req-572f0b02-9b16-411a-b0df-712a64581cdc service nova] Creating event network-changed:e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3 for instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc on n-h2-860687-3 Oct 27 19:40:50.185575 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f95d4717-1b8b-4566-bf55-bbbb882795f9 req-572f0b02-9b16-411a-b0df-712a64581cdc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055920 Oct 27 19:40:50.186356 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3586/7319] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:40:50.986269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f64b96d4-a234-4b20-8f95-1cfdde0a09a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:50.987020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f64b96d4-a234-4b20-8f95-1cfdde0a09a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:50.989711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=47 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:40:50.995499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f64b96d4-a234-4b20-8f95-1cfdde0a09a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:50.996005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f64b96d4-a234-4b20-8f95-1cfdde0a09a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:50.996452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f64b96d4-a234-4b20-8f95-1cfdde0a09a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:50.997166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f64b96d4-a234-4b20-8f95-1cfdde0a09a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:50.997630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f64b96d4-a234-4b20-8f95-1cfdde0a09a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:50.998068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f64b96d4-a234-4b20-8f95-1cfdde0a09a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:51.133048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f64b96d4-a234-4b20-8f95-1cfdde0a09a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:51.141439 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f64b96d4-a234-4b20-8f95-1cfdde0a09a1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1364 microversion: 2.1 time: 0.159110 Oct 27 19:40:51.142006 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3734/7320] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:50 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:52.167352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0cf582e2-bae2-4885-909a-92010d1ca700 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:52.168088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0cf582e2-bae2-4885-909a-92010d1ca700 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:52.174353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cf582e2-bae2-4885-909a-92010d1ca700 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:52.174897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cf582e2-bae2-4885-909a-92010d1ca700 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:52.175423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cf582e2-bae2-4885-909a-92010d1ca700 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:52.176153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cf582e2-bae2-4885-909a-92010d1ca700 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:52.176637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cf582e2-bae2-4885-909a-92010d1ca700 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:52.177095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cf582e2-bae2-4885-909a-92010d1ca700 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:52.312024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0cf582e2-bae2-4885-909a-92010d1ca700 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:52.320024 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0cf582e2-bae2-4885-909a-92010d1ca700 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1364 microversion: 2.1 time: 0.158187 Oct 27 19:40:52.320614 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3587/7321] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:52 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:53.344265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f32f474c-df5d-43e3-ae63-57ea2d768d6e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:53.344893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f32f474c-df5d-43e3-ae63-57ea2d768d6e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:53.351928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f32f474c-df5d-43e3-ae63-57ea2d768d6e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:53.352427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f32f474c-df5d-43e3-ae63-57ea2d768d6e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:53.353375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f32f474c-df5d-43e3-ae63-57ea2d768d6e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:53.354141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f32f474c-df5d-43e3-ae63-57ea2d768d6e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:53.354637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f32f474c-df5d-43e3-ae63-57ea2d768d6e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:53.355081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f32f474c-df5d-43e3-ae63-57ea2d768d6e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:53.490817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f32f474c-df5d-43e3-ae63-57ea2d768d6e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:53.499300 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f32f474c-df5d-43e3-ae63-57ea2d768d6e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1364 microversion: 2.1 time: 0.159012 Oct 27 19:40:53.499874 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3735/7322] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:53 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:54.522554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0fa2e87f-841a-4d62-9cd9-1bd07c0e04f4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:54.523188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0fa2e87f-841a-4d62-9cd9-1bd07c0e04f4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:54.530061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fa2e87f-841a-4d62-9cd9-1bd07c0e04f4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:54.530599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fa2e87f-841a-4d62-9cd9-1bd07c0e04f4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:54.531057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fa2e87f-841a-4d62-9cd9-1bd07c0e04f4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:54.531769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fa2e87f-841a-4d62-9cd9-1bd07c0e04f4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:54.532243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fa2e87f-841a-4d62-9cd9-1bd07c0e04f4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:54.532684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fa2e87f-841a-4d62-9cd9-1bd07c0e04f4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:54.664387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0fa2e87f-841a-4d62-9cd9-1bd07c0e04f4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:54.672917 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0fa2e87f-841a-4d62-9cd9-1bd07c0e04f4 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1364 microversion: 2.1 time: 0.154330 Oct 27 19:40:54.673494 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3588/7323] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:54 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:55.698138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4fb3751d-cea1-4f1c-9c64-7b50fb41b83d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:55.698809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4fb3751d-cea1-4f1c-9c64-7b50fb41b83d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:55.705651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fb3751d-cea1-4f1c-9c64-7b50fb41b83d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:55.706147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fb3751d-cea1-4f1c-9c64-7b50fb41b83d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:55.706624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fb3751d-cea1-4f1c-9c64-7b50fb41b83d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:55.707335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fb3751d-cea1-4f1c-9c64-7b50fb41b83d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:55.707797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fb3751d-cea1-4f1c-9c64-7b50fb41b83d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:55.708235 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4fb3751d-cea1-4f1c-9c64-7b50fb41b83d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:55.773495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-725b520c-03dd-4ee4-8007-96eca61aaf3b req-9dba3fce-4f85-4703-900b-e124e00ca7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23934ebc-aaa0-47f9-8aaf-733d0fb83bdc", "name": "network-vif-plugged", "status": "completed", "tag": "e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:40:55.789788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-725b520c-03dd-4ee4-8007-96eca61aaf3b req-9dba3fce-4f85-4703-900b-e124e00ca7df service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:55.796058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-725b520c-03dd-4ee4-8007-96eca61aaf3b req-9dba3fce-4f85-4703-900b-e124e00ca7df service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:55.796560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-725b520c-03dd-4ee4-8007-96eca61aaf3b req-9dba3fce-4f85-4703-900b-e124e00ca7df service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:55.810111 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-725b520c-03dd-4ee4-8007-96eca61aaf3b req-9dba3fce-4f85-4703-900b-e124e00ca7df service nova] Creating event network-vif-plugged:e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3 for instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc on n-h2-860687-3 Oct 27 19:40:55.815943 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-725b520c-03dd-4ee4-8007-96eca61aaf3b req-9dba3fce-4f85-4703-900b-e124e00ca7df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047551 Oct 27 19:40:55.816927 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3589/7324] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:40:55.845955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4fb3751d-cea1-4f1c-9c64-7b50fb41b83d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:55.855201 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4fb3751d-cea1-4f1c-9c64-7b50fb41b83d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1364 microversion: 2.1 time: 0.161194 Oct 27 19:40:55.855789 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3736/7325] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:55 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:40:56.880280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7866f81a-7c4b-41fc-acde-471725806e5c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:56.881006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7866f81a-7c4b-41fc-acde-471725806e5c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:56.889135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7866f81a-7c4b-41fc-acde-471725806e5c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:56.889634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7866f81a-7c4b-41fc-acde-471725806e5c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:56.890093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7866f81a-7c4b-41fc-acde-471725806e5c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:56.890831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7866f81a-7c4b-41fc-acde-471725806e5c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:56.891306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7866f81a-7c4b-41fc-acde-471725806e5c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:56.891748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7866f81a-7c4b-41fc-acde-471725806e5c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:57.023393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7866f81a-7c4b-41fc-acde-471725806e5c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:57.031829 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7866f81a-7c4b-41fc-acde-471725806e5c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1364 microversion: 2.1 time: 0.155934 Oct 27 19:40:57.032414 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3590/7326] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:56 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:58.054541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-73f5a63d-2953-42ee-ae90-2de8b84a872c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:58.055170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-73f5a63d-2953-42ee-ae90-2de8b84a872c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:58.058177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:40:58.063588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73f5a63d-2953-42ee-ae90-2de8b84a872c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:58.064083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73f5a63d-2953-42ee-ae90-2de8b84a872c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:58.064792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73f5a63d-2953-42ee-ae90-2de8b84a872c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:58.065491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73f5a63d-2953-42ee-ae90-2de8b84a872c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:58.065989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73f5a63d-2953-42ee-ae90-2de8b84a872c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:58.066448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-73f5a63d-2953-42ee-ae90-2de8b84a872c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:58.199256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-73f5a63d-2953-42ee-ae90-2de8b84a872c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:40:58.206974 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-73f5a63d-2953-42ee-ae90-2de8b84a872c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1551 microversion: 2.1 time: 0.156349 Oct 27 19:40:58.207689 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3737/7327] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:40:58 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:40:58.230220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-567f42b5-f8af-4d55-9b59-e87c51cf874f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:40:58.230771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-567f42b5-f8af-4d55-9b59-e87c51cf874f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:40:58.232738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:40:58.233431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:40:58.240066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-567f42b5-f8af-4d55-9b59-e87c51cf874f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:58.240573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-567f42b5-f8af-4d55-9b59-e87c51cf874f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:58.241037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-567f42b5-f8af-4d55-9b59-e87c51cf874f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:58.241757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-567f42b5-f8af-4d55-9b59-e87c51cf874f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:58.242234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-567f42b5-f8af-4d55-9b59-e87c51cf874f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:58.242712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-567f42b5-f8af-4d55-9b59-e87c51cf874f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:58.324937 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-567f42b5-f8af-4d55-9b59-e87c51cf874f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098667 Oct 27 19:40:58.325571 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3591/7328] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:40:58 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:40:59.257821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-85e02e77-4d24-4c4a-8b8a-2b5d90277d38 req-e7c43a24-4d36-4cd3-801a-031f29637c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23934ebc-aaa0-47f9-8aaf-733d0fb83bdc", "tag": "e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:40:59.263698 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 19:40:59.263849 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 19:40:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 27 19:40:59.274258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-85e02e77-4d24-4c4a-8b8a-2b5d90277d38 req-e7c43a24-4d36-4cd3-801a-031f29637c44 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:40:59.274864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-85e02e77-4d24-4c4a-8b8a-2b5d90277d38 req-e7c43a24-4d36-4cd3-801a-031f29637c44 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:40:59.275310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-85e02e77-4d24-4c4a-8b8a-2b5d90277d38 req-e7c43a24-4d36-4cd3-801a-031f29637c44 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:40:59.285911 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-85e02e77-4d24-4c4a-8b8a-2b5d90277d38 req-e7c43a24-4d36-4cd3-801a-031f29637c44 service nova] Creating event network-changed:e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3 for instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc on n-h2-860687-3 Oct 27 19:40:59.292013 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-85e02e77-4d24-4c4a-8b8a-2b5d90277d38 req-e7c43a24-4d36-4cd3-801a-031f29637c44 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037973 Oct 27 19:40:59.292625 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3738/7329] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:42:00.995930 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 19:42:00.997051 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 19:42:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc/action (ip 10.222.0.42) !!! Oct 27 19:42:00.997639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=11 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:42:00.998538 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:42:01.004210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:42:01.006511 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:01.016205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:01.016722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:01.017186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:01.017911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:01.018410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:01.018865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:01.048503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:01.053958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Old instance type m1.heat2, new instance type m1.heat {{(pid=127028) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 19:42:01.061173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:42:01.061623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:42:01.062127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:42:01.062606 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:42:01.063066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:42:01.126249 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7298d4fd-cd34-4a21-bf17-96610e76a154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc/action" status: 202 len: 0 microversion: 2.1 time: 0.133082 Oct 27 19:42:01.126960 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3592/7330] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:42:00 2022] POST /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:42:01.134027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=9 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:42:01.134819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=60 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:42:01.140194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4f1da19f-37ca-41fa-a5d1-1db944efec42 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:01.140931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4f1da19f-37ca-41fa-a5d1-1db944efec42 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:01.148740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f1da19f-37ca-41fa-a5d1-1db944efec42 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:01.149096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f1da19f-37ca-41fa-a5d1-1db944efec42 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:01.149618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f1da19f-37ca-41fa-a5d1-1db944efec42 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:01.150530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f1da19f-37ca-41fa-a5d1-1db944efec42 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:01.151005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f1da19f-37ca-41fa-a5d1-1db944efec42 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:01.151469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4f1da19f-37ca-41fa-a5d1-1db944efec42 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:01.322025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4f1da19f-37ca-41fa-a5d1-1db944efec42 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:01.330744 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4f1da19f-37ca-41fa-a5d1-1db944efec42 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1678 microversion: 2.1 time: 0.199358 Oct 27 19:42:01.331667 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3739/7331] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:01 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1678 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:42:02.354709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1f119264-9dc5-4c3b-9a99-e078d0ceb910 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:02.355354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1f119264-9dc5-4c3b-9a99-e078d0ceb910 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:02.362455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f119264-9dc5-4c3b-9a99-e078d0ceb910 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:02.362971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f119264-9dc5-4c3b-9a99-e078d0ceb910 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:02.363439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f119264-9dc5-4c3b-9a99-e078d0ceb910 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:02.364157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f119264-9dc5-4c3b-9a99-e078d0ceb910 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:02.364635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f119264-9dc5-4c3b-9a99-e078d0ceb910 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:02.365087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1f119264-9dc5-4c3b-9a99-e078d0ceb910 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:02.498917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1f119264-9dc5-4c3b-9a99-e078d0ceb910 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:02.507678 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1f119264-9dc5-4c3b-9a99-e078d0ceb910 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1678 microversion: 2.1 time: 0.157754 Oct 27 19:42:02.508261 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3593/7332] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:02 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:03.532672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0eb99f70-e2fa-480c-8d70-2c58c0ba9d2f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:03.533294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0eb99f70-e2fa-480c-8d70-2c58c0ba9d2f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:03.540272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0eb99f70-e2fa-480c-8d70-2c58c0ba9d2f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:03.540767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0eb99f70-e2fa-480c-8d70-2c58c0ba9d2f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:03.541216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0eb99f70-e2fa-480c-8d70-2c58c0ba9d2f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:03.541925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0eb99f70-e2fa-480c-8d70-2c58c0ba9d2f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:03.542411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0eb99f70-e2fa-480c-8d70-2c58c0ba9d2f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:03.542851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0eb99f70-e2fa-480c-8d70-2c58c0ba9d2f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:03.677665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0eb99f70-e2fa-480c-8d70-2c58c0ba9d2f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:03.686119 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0eb99f70-e2fa-480c-8d70-2c58c0ba9d2f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1683 microversion: 2.1 time: 0.157359 Oct 27 19:42:03.686719 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3740/7333] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:03 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:04.709654 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2f5d9f20-31e0-4acb-89ae-581cb4aead73 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:04.710301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2f5d9f20-31e0-4acb-89ae-581cb4aead73 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:04.717356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f5d9f20-31e0-4acb-89ae-581cb4aead73 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:04.717871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f5d9f20-31e0-4acb-89ae-581cb4aead73 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:04.718338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f5d9f20-31e0-4acb-89ae-581cb4aead73 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:04.719094 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f5d9f20-31e0-4acb-89ae-581cb4aead73 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:04.719583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f5d9f20-31e0-4acb-89ae-581cb4aead73 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:04.720041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f5d9f20-31e0-4acb-89ae-581cb4aead73 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:04.854576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2f5d9f20-31e0-4acb-89ae-581cb4aead73 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:04.862509 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2f5d9f20-31e0-4acb-89ae-581cb4aead73 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1683 microversion: 2.1 time: 0.156803 Oct 27 19:42:04.863119 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3594/7334] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:04 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:05.886596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-865f1940-acd7-4b6a-87a1-4a4e82d70e55 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:05.887241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-865f1940-acd7-4b6a-87a1-4a4e82d70e55 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:05.894684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-865f1940-acd7-4b6a-87a1-4a4e82d70e55 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:05.895177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-865f1940-acd7-4b6a-87a1-4a4e82d70e55 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:05.895622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-865f1940-acd7-4b6a-87a1-4a4e82d70e55 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:05.896320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-865f1940-acd7-4b6a-87a1-4a4e82d70e55 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:05.896785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-865f1940-acd7-4b6a-87a1-4a4e82d70e55 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:05.897216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-865f1940-acd7-4b6a-87a1-4a4e82d70e55 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:06.031039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-865f1940-acd7-4b6a-87a1-4a4e82d70e55 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:06.038854 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-865f1940-acd7-4b6a-87a1-4a4e82d70e55 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1683 microversion: 2.1 time: 0.156275 Oct 27 19:42:06.039431 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3741/7335] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:05 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:07.062134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0bca41fc-f141-45e0-b827-3047d77dc767 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:07.062792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0bca41fc-f141-45e0-b827-3047d77dc767 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:07.069809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bca41fc-f141-45e0-b827-3047d77dc767 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:07.070365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bca41fc-f141-45e0-b827-3047d77dc767 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:07.070804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bca41fc-f141-45e0-b827-3047d77dc767 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:07.071512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bca41fc-f141-45e0-b827-3047d77dc767 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:07.071985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bca41fc-f141-45e0-b827-3047d77dc767 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:07.072431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bca41fc-f141-45e0-b827-3047d77dc767 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:07.201670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0bca41fc-f141-45e0-b827-3047d77dc767 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:07.209472 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0bca41fc-f141-45e0-b827-3047d77dc767 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1683 microversion: 2.1 time: 0.151427 Oct 27 19:42:07.210051 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3595/7336] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:07 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:08.234793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3bfbff86-ba30-4497-a7a6-5f83261e249a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:08.235444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3bfbff86-ba30-4497-a7a6-5f83261e249a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:08.242470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3bfbff86-ba30-4497-a7a6-5f83261e249a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:08.242967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3bfbff86-ba30-4497-a7a6-5f83261e249a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:08.243422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3bfbff86-ba30-4497-a7a6-5f83261e249a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:08.244128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3bfbff86-ba30-4497-a7a6-5f83261e249a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:08.244597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3bfbff86-ba30-4497-a7a6-5f83261e249a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:08.245038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3bfbff86-ba30-4497-a7a6-5f83261e249a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:08.378343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3bfbff86-ba30-4497-a7a6-5f83261e249a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:08.386142 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3bfbff86-ba30-4497-a7a6-5f83261e249a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1683 microversion: 2.1 time: 0.155426 Oct 27 19:42:08.386745 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3742/7337] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:08 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:09.411031 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd8de134-fd65-4bb2-a58e-6525d97aa818 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:09.411713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bd8de134-fd65-4bb2-a58e-6525d97aa818 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:09.418313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8de134-fd65-4bb2-a58e-6525d97aa818 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:09.418856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8de134-fd65-4bb2-a58e-6525d97aa818 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:09.420003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8de134-fd65-4bb2-a58e-6525d97aa818 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:09.420757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8de134-fd65-4bb2-a58e-6525d97aa818 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:09.421236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8de134-fd65-4bb2-a58e-6525d97aa818 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:09.421690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8de134-fd65-4bb2-a58e-6525d97aa818 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:09.555043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bd8de134-fd65-4bb2-a58e-6525d97aa818 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:09.563514 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bd8de134-fd65-4bb2-a58e-6525d97aa818 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1683 microversion: 2.1 time: 0.156669 Oct 27 19:42:09.564130 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3596/7338] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:09 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:10.587088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6c1953d9-07df-417e-921e-a5abf70fc345 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:10.587829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6c1953d9-07df-417e-921e-a5abf70fc345 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:10.595770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c1953d9-07df-417e-921e-a5abf70fc345 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:10.596267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c1953d9-07df-417e-921e-a5abf70fc345 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:10.596716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c1953d9-07df-417e-921e-a5abf70fc345 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:10.597424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c1953d9-07df-417e-921e-a5abf70fc345 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:10.597890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c1953d9-07df-417e-921e-a5abf70fc345 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:10.598328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c1953d9-07df-417e-921e-a5abf70fc345 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:10.727424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6c1953d9-07df-417e-921e-a5abf70fc345 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:10.735297 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6c1953d9-07df-417e-921e-a5abf70fc345 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1683 microversion: 2.1 time: 0.152192 Oct 27 19:42:10.735873 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3743/7339] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:10 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:11.758848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f67cdb52-b63c-416c-8a91-003b3697711e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:11.759469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f67cdb52-b63c-416c-8a91-003b3697711e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:11.767000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f67cdb52-b63c-416c-8a91-003b3697711e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:11.767505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f67cdb52-b63c-416c-8a91-003b3697711e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:11.767963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f67cdb52-b63c-416c-8a91-003b3697711e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:11.768673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f67cdb52-b63c-416c-8a91-003b3697711e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:11.769148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f67cdb52-b63c-416c-8a91-003b3697711e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:11.769592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f67cdb52-b63c-416c-8a91-003b3697711e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:11.898060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f67cdb52-b63c-416c-8a91-003b3697711e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:11.906478 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f67cdb52-b63c-416c-8a91-003b3697711e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1683 microversion: 2.1 time: 0.151538 Oct 27 19:42:11.907060 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3597/7340] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:11 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:12.930278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aef3fe91-97fe-4de6-8a64-45afc153ffab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:12.930934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-aef3fe91-97fe-4de6-8a64-45afc153ffab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:12.938345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aef3fe91-97fe-4de6-8a64-45afc153ffab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:12.938870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aef3fe91-97fe-4de6-8a64-45afc153ffab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:12.939315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aef3fe91-97fe-4de6-8a64-45afc153ffab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:12.940269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aef3fe91-97fe-4de6-8a64-45afc153ffab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:12.940728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aef3fe91-97fe-4de6-8a64-45afc153ffab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:12.941163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aef3fe91-97fe-4de6-8a64-45afc153ffab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:13.072146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-aef3fe91-97fe-4de6-8a64-45afc153ffab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:13.080955 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aef3fe91-97fe-4de6-8a64-45afc153ffab tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1683 microversion: 2.1 time: 0.154669 Oct 27 19:42:13.081526 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3744/7341] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:12 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:14.105168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0ece6324-b1d2-462a-a42c-6028530c7d4f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:14.105811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0ece6324-b1d2-462a-a42c-6028530c7d4f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:14.113352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ece6324-b1d2-462a-a42c-6028530c7d4f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:14.113870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ece6324-b1d2-462a-a42c-6028530c7d4f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:14.114344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ece6324-b1d2-462a-a42c-6028530c7d4f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:14.115096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ece6324-b1d2-462a-a42c-6028530c7d4f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:14.115580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ece6324-b1d2-462a-a42c-6028530c7d4f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:14.116033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0ece6324-b1d2-462a-a42c-6028530c7d4f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:14.250191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0ece6324-b1d2-462a-a42c-6028530c7d4f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:14.258045 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0ece6324-b1d2-462a-a42c-6028530c7d4f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1683 microversion: 2.1 time: 0.157078 Oct 27 19:42:14.258675 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3598/7342] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:14 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:15.282105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8b0824fd-3f2e-48d4-8d56-5e584ad592ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:15.282753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8b0824fd-3f2e-48d4-8d56-5e584ad592ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:15.294864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b0824fd-3f2e-48d4-8d56-5e584ad592ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:15.295476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b0824fd-3f2e-48d4-8d56-5e584ad592ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:15.296220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b0824fd-3f2e-48d4-8d56-5e584ad592ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:15.297001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b0824fd-3f2e-48d4-8d56-5e584ad592ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:15.297468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b0824fd-3f2e-48d4-8d56-5e584ad592ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:15.297903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8b0824fd-3f2e-48d4-8d56-5e584ad592ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:15.515959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8b0824fd-3f2e-48d4-8d56-5e584ad592ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:15.523966 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8b0824fd-3f2e-48d4-8d56-5e584ad592ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1682 microversion: 2.1 time: 0.246682 Oct 27 19:42:15.524922 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3745/7343] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:15 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1682 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:15.812988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-175856e5-76e3-4bf2-b959-60e06da88e5e req-fed0eca1-806e-4a3d-b571-f14fe9b189ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23934ebc-aaa0-47f9-8aaf-733d0fb83bdc", "name": "network-vif-unplugged", "status": "completed", "tag": "e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:42:15.823928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-175856e5-76e3-4bf2-b959-60e06da88e5e req-fed0eca1-806e-4a3d-b571-f14fe9b189ec service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:15.824831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-175856e5-76e3-4bf2-b959-60e06da88e5e req-fed0eca1-806e-4a3d-b571-f14fe9b189ec service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:15.825416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-175856e5-76e3-4bf2-b959-60e06da88e5e req-fed0eca1-806e-4a3d-b571-f14fe9b189ec service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:15.839254 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-175856e5-76e3-4bf2-b959-60e06da88e5e req-fed0eca1-806e-4a3d-b571-f14fe9b189ec service nova] Creating event network-vif-unplugged:e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3 for instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc on n-h1-860687-3 Oct 27 19:42:15.844798 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-175856e5-76e3-4bf2-b959-60e06da88e5e req-fed0eca1-806e-4a3d-b571-f14fe9b189ec service nova] Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:42:15.857257 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-175856e5-76e3-4bf2-b959-60e06da88e5e req-fed0eca1-806e-4a3d-b571-f14fe9b189ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049015 Oct 27 19:42:15.858142 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3599/7344] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:42:16.549734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-470b0685-7d43-44bf-aeff-d6a548363466 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:16.550518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-470b0685-7d43-44bf-aeff-d6a548363466 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:16.560418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-470b0685-7d43-44bf-aeff-d6a548363466 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:16.561360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-470b0685-7d43-44bf-aeff-d6a548363466 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:16.562206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-470b0685-7d43-44bf-aeff-d6a548363466 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:16.563562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-470b0685-7d43-44bf-aeff-d6a548363466 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:16.564466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-470b0685-7d43-44bf-aeff-d6a548363466 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:16.565530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-470b0685-7d43-44bf-aeff-d6a548363466 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:16.818609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-470b0685-7d43-44bf-aeff-d6a548363466 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:16.831520 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-470b0685-7d43-44bf-aeff-d6a548363466 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1682 microversion: 2.1 time: 0.286042 Oct 27 19:42:16.846611 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3746/7345] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:16 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1682 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:17.857671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-154683d7-f2ae-4f94-adcb-06636811258e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:17.858426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-154683d7-f2ae-4f94-adcb-06636811258e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:17.865824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154683d7-f2ae-4f94-adcb-06636811258e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:17.866334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154683d7-f2ae-4f94-adcb-06636811258e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:17.866824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154683d7-f2ae-4f94-adcb-06636811258e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:17.867545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154683d7-f2ae-4f94-adcb-06636811258e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:17.868022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154683d7-f2ae-4f94-adcb-06636811258e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:17.868676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-154683d7-f2ae-4f94-adcb-06636811258e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:17.913947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-0a50431d-58f2-40bf-8201-f3965b0aee30 req-178e60ee-dc94-4f84-9057-c9f7c9449d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23934ebc-aaa0-47f9-8aaf-733d0fb83bdc", "tag": "e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:42:17.925214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0a50431d-58f2-40bf-8201-f3965b0aee30 req-178e60ee-dc94-4f84-9057-c9f7c9449d87 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:17.925701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0a50431d-58f2-40bf-8201-f3965b0aee30 req-178e60ee-dc94-4f84-9057-c9f7c9449d87 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:17.926141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0a50431d-58f2-40bf-8201-f3965b0aee30 req-178e60ee-dc94-4f84-9057-c9f7c9449d87 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:17.938500 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-0a50431d-58f2-40bf-8201-f3965b0aee30 req-178e60ee-dc94-4f84-9057-c9f7c9449d87 service nova] Creating event network-changed:e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3 for instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc on n-h1-860687-3 Oct 27 19:42:17.944184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-0a50431d-58f2-40bf-8201-f3965b0aee30 req-178e60ee-dc94-4f84-9057-c9f7c9449d87 service nova] Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:42:17.955486 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-0a50431d-58f2-40bf-8201-f3965b0aee30 req-178e60ee-dc94-4f84-9057-c9f7c9449d87 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044829 Oct 27 19:42:17.955834 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3747/7346] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:42:18.015433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-154683d7-f2ae-4f94-adcb-06636811258e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:18.023489 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-154683d7-f2ae-4f94-adcb-06636811258e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1680 microversion: 2.1 time: 0.171169 Oct 27 19:42:18.024268 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3600/7347] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:17 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:19.048829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8298706d-cc3e-419e-828e-174a02861570 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:19.049537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8298706d-cc3e-419e-828e-174a02861570 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:19.055697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8298706d-cc3e-419e-828e-174a02861570 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:19.056191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8298706d-cc3e-419e-828e-174a02861570 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:19.056637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8298706d-cc3e-419e-828e-174a02861570 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:19.057333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8298706d-cc3e-419e-828e-174a02861570 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:19.057794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8298706d-cc3e-419e-828e-174a02861570 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:19.058244 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8298706d-cc3e-419e-828e-174a02861570 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:19.194039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8298706d-cc3e-419e-828e-174a02861570 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:19.202422 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8298706d-cc3e-419e-828e-174a02861570 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1677 microversion: 2.1 time: 0.158837 Oct 27 19:42:19.203003 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3748/7348] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:19 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:19.225038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:42:19.225586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:19.233162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:19.233661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:19.234119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:19.234858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:19.235334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:19.235778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:19.272986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:19.273405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:19.273860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:19.274634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:19.275106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:19.275548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:19.296177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Getting quotas for project 612eaff9b8f24492b2c53c62e6be5aa0. Resources: {'cores', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:42:19.301370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Getting quotas for user c036fdc2fff644aa92e90481e04933c0 and project 612eaff9b8f24492b2c53c62e6be5aa0. Resources: {'cores', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:42:19.400377 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3f827889-0957-4650-a280-dafb252afc2d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc/action" status: 202 len: 0 microversion: 2.1 time: 0.179102 Oct 27 19:42:19.400979 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3601/7349] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:42:19 2022] POST /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:42:19.409597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0be8a930-aa84-4e6a-a708-11639cabc753 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:19.410250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0be8a930-aa84-4e6a-a708-11639cabc753 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:19.416576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0be8a930-aa84-4e6a-a708-11639cabc753 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:19.417071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0be8a930-aa84-4e6a-a708-11639cabc753 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:19.417515 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0be8a930-aa84-4e6a-a708-11639cabc753 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:19.418465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0be8a930-aa84-4e6a-a708-11639cabc753 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:19.419708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0be8a930-aa84-4e6a-a708-11639cabc753 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:19.420038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0be8a930-aa84-4e6a-a708-11639cabc753 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:19.621555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0be8a930-aa84-4e6a-a708-11639cabc753 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:19.630410 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0be8a930-aa84-4e6a-a708-11639cabc753 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1676 microversion: 2.1 time: 0.224924 Oct 27 19:42:19.630998 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3749/7350] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:19 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:20.655929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c886ef02-ee9d-43c8-9497-f72e9fea7f37 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:20.656653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c886ef02-ee9d-43c8-9497-f72e9fea7f37 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:20.663800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c886ef02-ee9d-43c8-9497-f72e9fea7f37 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:20.664303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c886ef02-ee9d-43c8-9497-f72e9fea7f37 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:20.664757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c886ef02-ee9d-43c8-9497-f72e9fea7f37 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:20.665464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c886ef02-ee9d-43c8-9497-f72e9fea7f37 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:20.665939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c886ef02-ee9d-43c8-9497-f72e9fea7f37 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:20.666407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c886ef02-ee9d-43c8-9497-f72e9fea7f37 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:20.804032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c886ef02-ee9d-43c8-9497-f72e9fea7f37 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:20.812509 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c886ef02-ee9d-43c8-9497-f72e9fea7f37 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1676 microversion: 2.1 time: 0.162059 Oct 27 19:42:20.813083 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3602/7351] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:20 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:21.838127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aca2bf8e-c9af-4256-b707-b01559c0a871 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:21.839929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-aca2bf8e-c9af-4256-b707-b01559c0a871 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:21.848264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aca2bf8e-c9af-4256-b707-b01559c0a871 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:21.848774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aca2bf8e-c9af-4256-b707-b01559c0a871 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:21.849385 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aca2bf8e-c9af-4256-b707-b01559c0a871 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:21.850106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aca2bf8e-c9af-4256-b707-b01559c0a871 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:21.850606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aca2bf8e-c9af-4256-b707-b01559c0a871 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:21.851044 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aca2bf8e-c9af-4256-b707-b01559c0a871 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:21.985344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-aca2bf8e-c9af-4256-b707-b01559c0a871 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:21.993193 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aca2bf8e-c9af-4256-b707-b01559c0a871 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1676 microversion: 2.1 time: 0.159107 Oct 27 19:42:21.993766 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3750/7352] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:21 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:23.018147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-40d577f7-7640-4fa3-b661-894e4d95e7a8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:23.018830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-40d577f7-7640-4fa3-b661-894e4d95e7a8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:23.025592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40d577f7-7640-4fa3-b661-894e4d95e7a8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:23.026225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40d577f7-7640-4fa3-b661-894e4d95e7a8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:23.026730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40d577f7-7640-4fa3-b661-894e4d95e7a8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:23.027498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40d577f7-7640-4fa3-b661-894e4d95e7a8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:23.027979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40d577f7-7640-4fa3-b661-894e4d95e7a8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:23.029083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40d577f7-7640-4fa3-b661-894e4d95e7a8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:23.243726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-40d577f7-7640-4fa3-b661-894e4d95e7a8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:23.252072 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-40d577f7-7640-4fa3-b661-894e4d95e7a8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1676 microversion: 2.1 time: 0.238024 Oct 27 19:42:23.252654 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3603/7353] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:23 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:23.460000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-81e8521d-86d7-4b47-878e-46c03dd591bc req-601a5818-7b47-4c6c-a0f8-078dd5572b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23934ebc-aaa0-47f9-8aaf-733d0fb83bdc", "tag": "e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:42:23.475286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-81e8521d-86d7-4b47-878e-46c03dd591bc req-601a5818-7b47-4c6c-a0f8-078dd5572b83 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:23.475780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-81e8521d-86d7-4b47-878e-46c03dd591bc req-601a5818-7b47-4c6c-a0f8-078dd5572b83 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:23.476226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-81e8521d-86d7-4b47-878e-46c03dd591bc req-601a5818-7b47-4c6c-a0f8-078dd5572b83 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:23.489040 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-81e8521d-86d7-4b47-878e-46c03dd591bc req-601a5818-7b47-4c6c-a0f8-078dd5572b83 service nova] Creating event network-changed:e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3 for instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc on n-h2-860687-3 Oct 27 19:42:23.494773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-81e8521d-86d7-4b47-878e-46c03dd591bc req-601a5818-7b47-4c6c-a0f8-078dd5572b83 service nova] Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:42:23.507666 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-81e8521d-86d7-4b47-878e-46c03dd591bc req-601a5818-7b47-4c6c-a0f8-078dd5572b83 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058407 Oct 27 19:42:23.508549 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3751/7354] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:42:24.276336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bb19c32d-c473-4f9a-8d7d-26ec6378c94e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:24.276887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bb19c32d-c473-4f9a-8d7d-26ec6378c94e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:24.284444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb19c32d-c473-4f9a-8d7d-26ec6378c94e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:24.284949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb19c32d-c473-4f9a-8d7d-26ec6378c94e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:24.285402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb19c32d-c473-4f9a-8d7d-26ec6378c94e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:24.286118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb19c32d-c473-4f9a-8d7d-26ec6378c94e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:24.286618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb19c32d-c473-4f9a-8d7d-26ec6378c94e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:24.287063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb19c32d-c473-4f9a-8d7d-26ec6378c94e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:24.305947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:42:24.428284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bb19c32d-c473-4f9a-8d7d-26ec6378c94e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:24.436089 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bb19c32d-c473-4f9a-8d7d-26ec6378c94e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1676 microversion: 2.1 time: 0.163809 Oct 27 19:42:24.436673 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3604/7355] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:24 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:25.460790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-12b0411e-7eca-4965-b618-d2c2c530c980 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:25.461535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-12b0411e-7eca-4965-b618-d2c2c530c980 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:25.469481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12b0411e-7eca-4965-b618-d2c2c530c980 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:25.469977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12b0411e-7eca-4965-b618-d2c2c530c980 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:25.470449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12b0411e-7eca-4965-b618-d2c2c530c980 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:25.471164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12b0411e-7eca-4965-b618-d2c2c530c980 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:25.471630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12b0411e-7eca-4965-b618-d2c2c530c980 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:25.472072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12b0411e-7eca-4965-b618-d2c2c530c980 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:25.612550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-12b0411e-7eca-4965-b618-d2c2c530c980 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:25.620331 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-12b0411e-7eca-4965-b618-d2c2c530c980 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1676 microversion: 2.1 time: 0.163899 Oct 27 19:42:25.620905 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3752/7356] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:25 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:26.644620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-98ff8544-18a8-4d4b-ad8f-210ad55a8f9e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:26.645180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-98ff8544-18a8-4d4b-ad8f-210ad55a8f9e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:26.652282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98ff8544-18a8-4d4b-ad8f-210ad55a8f9e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:26.652842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98ff8544-18a8-4d4b-ad8f-210ad55a8f9e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:26.654002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98ff8544-18a8-4d4b-ad8f-210ad55a8f9e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:26.654753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98ff8544-18a8-4d4b-ad8f-210ad55a8f9e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:26.655243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98ff8544-18a8-4d4b-ad8f-210ad55a8f9e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:26.655726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-98ff8544-18a8-4d4b-ad8f-210ad55a8f9e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:26.847296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-98ff8544-18a8-4d4b-ad8f-210ad55a8f9e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:26.855772 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-98ff8544-18a8-4d4b-ad8f-210ad55a8f9e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1676 microversion: 2.1 time: 0.215128 Oct 27 19:42:26.856752 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3605/7357] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:26 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1676 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:27.880904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d180e015-07ca-4f78-90c8-287d9f699bf3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:27.881563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d180e015-07ca-4f78-90c8-287d9f699bf3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:27.888721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d180e015-07ca-4f78-90c8-287d9f699bf3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:27.889218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d180e015-07ca-4f78-90c8-287d9f699bf3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:27.889670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d180e015-07ca-4f78-90c8-287d9f699bf3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:27.890375 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d180e015-07ca-4f78-90c8-287d9f699bf3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:27.890869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d180e015-07ca-4f78-90c8-287d9f699bf3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:27.891309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d180e015-07ca-4f78-90c8-287d9f699bf3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:28.025889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d180e015-07ca-4f78-90c8-287d9f699bf3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:28.034712 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d180e015-07ca-4f78-90c8-287d9f699bf3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1669 microversion: 2.1 time: 0.157826 Oct 27 19:42:28.035311 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3753/7358] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:27 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:28.058016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fa00ef9b-634b-4a2a-848b-de6919b46e9a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:28.058668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fa00ef9b-634b-4a2a-848b-de6919b46e9a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:28.065875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa00ef9b-634b-4a2a-848b-de6919b46e9a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:28.066375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa00ef9b-634b-4a2a-848b-de6919b46e9a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:28.066858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa00ef9b-634b-4a2a-848b-de6919b46e9a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:28.067572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa00ef9b-634b-4a2a-848b-de6919b46e9a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:28.068047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa00ef9b-634b-4a2a-848b-de6919b46e9a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:28.068492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fa00ef9b-634b-4a2a-848b-de6919b46e9a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:28.202906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fa00ef9b-634b-4a2a-848b-de6919b46e9a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:28.210897 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fa00ef9b-634b-4a2a-848b-de6919b46e9a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1669 microversion: 2.1 time: 0.156659 Oct 27 19:42:28.211585 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3606/7359] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:28 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:28.234368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-663a9406-7827-428b-9ec6-2100031add95 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:28.235003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-663a9406-7827-428b-9ec6-2100031add95 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:28.240942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-663a9406-7827-428b-9ec6-2100031add95 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:28.241428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-663a9406-7827-428b-9ec6-2100031add95 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:28.241867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-663a9406-7827-428b-9ec6-2100031add95 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:28.242591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-663a9406-7827-428b-9ec6-2100031add95 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:28.243054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-663a9406-7827-428b-9ec6-2100031add95 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:28.243481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-663a9406-7827-428b-9ec6-2100031add95 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:28.374197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-663a9406-7827-428b-9ec6-2100031add95 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:28.382072 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-663a9406-7827-428b-9ec6-2100031add95 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1669 microversion: 2.1 time: 0.152391 Oct 27 19:42:28.382697 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3754/7360] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:28 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:28.406143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f99193f8-414c-4087-96f9-47f5f2485fa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:28.406629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f99193f8-414c-4087-96f9-47f5f2485fa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:28.412610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f99193f8-414c-4087-96f9-47f5f2485fa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:28.413120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f99193f8-414c-4087-96f9-47f5f2485fa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:28.413583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f99193f8-414c-4087-96f9-47f5f2485fa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:28.414301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f99193f8-414c-4087-96f9-47f5f2485fa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:28.414807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f99193f8-414c-4087-96f9-47f5f2485fa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:28.415262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f99193f8-414c-4087-96f9-47f5f2485fa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:28.440287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f99193f8-414c-4087-96f9-47f5f2485fa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:42:28.516846 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f99193f8-414c-4087-96f9-47f5f2485fa3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "DELETE /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 204 len: 0 microversion: 2.1 time: 0.114815 Oct 27 19:42:28.517458 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3607/7361] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:42:28 2022] DELETE /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:42:28.526444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-44a078f6-f7dc-47bf-978d-d3433be2fc65 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:28.527055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-44a078f6-f7dc-47bf-978d-d3433be2fc65 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:28.534586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44a078f6-f7dc-47bf-978d-d3433be2fc65 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:28.535072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44a078f6-f7dc-47bf-978d-d3433be2fc65 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:28.535508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44a078f6-f7dc-47bf-978d-d3433be2fc65 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:28.536198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44a078f6-f7dc-47bf-978d-d3433be2fc65 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:28.536653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44a078f6-f7dc-47bf-978d-d3433be2fc65 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:28.537085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44a078f6-f7dc-47bf-978d-d3433be2fc65 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:28.674744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-44a078f6-f7dc-47bf-978d-d3433be2fc65 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:28.682707 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-44a078f6-f7dc-47bf-978d-d3433be2fc65 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1675 microversion: 2.1 time: 0.160154 Oct 27 19:42:28.683382 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3755/7362] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:28 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:29.707257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7a3c3dc7-556b-4311-b969-2b7762638402 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:29.707988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7a3c3dc7-556b-4311-b969-2b7762638402 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:29.710767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:42:29.716799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a3c3dc7-556b-4311-b969-2b7762638402 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:29.717309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a3c3dc7-556b-4311-b969-2b7762638402 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:29.717772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a3c3dc7-556b-4311-b969-2b7762638402 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:29.718524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a3c3dc7-556b-4311-b969-2b7762638402 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:29.719017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a3c3dc7-556b-4311-b969-2b7762638402 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:29.719453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7a3c3dc7-556b-4311-b969-2b7762638402 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:29.861529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7a3c3dc7-556b-4311-b969-2b7762638402 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:29.869488 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7a3c3dc7-556b-4311-b969-2b7762638402 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1675 microversion: 2.1 time: 0.166588 Oct 27 19:42:29.870077 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3608/7363] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:29 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:30.439320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-3c5570e9-769a-487e-b0ce-0a497e97a276 req-06cfaf6f-a9b9-4b0c-ad9f-1ab7ce715e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23934ebc-aaa0-47f9-8aaf-733d0fb83bdc", "name": "network-vif-plugged", "status": "completed", "tag": "e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:42:30.454136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3c5570e9-769a-487e-b0ce-0a497e97a276 req-06cfaf6f-a9b9-4b0c-ad9f-1ab7ce715e12 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:30.455120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3c5570e9-769a-487e-b0ce-0a497e97a276 req-06cfaf6f-a9b9-4b0c-ad9f-1ab7ce715e12 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:30.455670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3c5570e9-769a-487e-b0ce-0a497e97a276 req-06cfaf6f-a9b9-4b0c-ad9f-1ab7ce715e12 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:30.460189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:42:30.469464 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-3c5570e9-769a-487e-b0ce-0a497e97a276 req-06cfaf6f-a9b9-4b0c-ad9f-1ab7ce715e12 service nova] Creating event network-vif-plugged:e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3 for instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc on n-h2-860687-3 Oct 27 19:42:30.475071 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-3c5570e9-769a-487e-b0ce-0a497e97a276 req-06cfaf6f-a9b9-4b0c-ad9f-1ab7ce715e12 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041469 Oct 27 19:42:30.475981 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3756/7364] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:42:30.893583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a628f1d4-3411-42b1-9309-ada9198ab413 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:30.895255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a628f1d4-3411-42b1-9309-ada9198ab413 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:30.902607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a628f1d4-3411-42b1-9309-ada9198ab413 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:30.903617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a628f1d4-3411-42b1-9309-ada9198ab413 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:30.904792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a628f1d4-3411-42b1-9309-ada9198ab413 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:30.905619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a628f1d4-3411-42b1-9309-ada9198ab413 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:30.906109 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a628f1d4-3411-42b1-9309-ada9198ab413 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:30.906625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a628f1d4-3411-42b1-9309-ada9198ab413 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:30.980901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a628f1d4-3411-42b1-9309-ada9198ab413 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:30.991123 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a628f1d4-3411-42b1-9309-ada9198ab413 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 200 len: 1607 microversion: 2.1 time: 0.101429 Oct 27 19:42:30.991883 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3609/7365] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:30 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 1607 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:31.082879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6c9425eb-30b4-47cf-8278-a9e02652d8e6 req-84b0940a-ae9e-4469-838f-fe4befb5c198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23934ebc-aaa0-47f9-8aaf-733d0fb83bdc", "name": "network-vif-deleted", "tag": "e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:42:31.093807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6c9425eb-30b4-47cf-8278-a9e02652d8e6 req-84b0940a-ae9e-4469-838f-fe4befb5c198 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:31.094303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6c9425eb-30b4-47cf-8278-a9e02652d8e6 req-84b0940a-ae9e-4469-838f-fe4befb5c198 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:31.094786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6c9425eb-30b4-47cf-8278-a9e02652d8e6 req-84b0940a-ae9e-4469-838f-fe4befb5c198 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:31.107957 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6c9425eb-30b4-47cf-8278-a9e02652d8e6 req-84b0940a-ae9e-4469-838f-fe4befb5c198 service nova] Creating event network-vif-deleted:e4fe2e2c-b7fc-49f6-a8cd-165af92d2aa3 for instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc on n-h2-860687-3 Oct 27 19:42:31.113909 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6c9425eb-30b4-47cf-8278-a9e02652d8e6 req-84b0940a-ae9e-4469-838f-fe4befb5c198 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035282 Oct 27 19:42:31.118251 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3757/7366] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:42:32.015894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b5c02e7b-fce5-45e0-9eeb-62991ed23572 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:32.016534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b5c02e7b-fce5-45e0-9eeb-62991ed23572 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:32.019304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:42:32.024637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5c02e7b-fce5-45e0-9eeb-62991ed23572 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:32.025155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5c02e7b-fce5-45e0-9eeb-62991ed23572 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:32.025624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5c02e7b-fce5-45e0-9eeb-62991ed23572 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:32.026357 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5c02e7b-fce5-45e0-9eeb-62991ed23572 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:32.026920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5c02e7b-fce5-45e0-9eeb-62991ed23572 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:32.027377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5c02e7b-fce5-45e0-9eeb-62991ed23572 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:32.042720 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-b5c02e7b-fce5-45e0-9eeb-62991ed23572 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b5c02e7b-fce5-45e0-9eeb-62991ed23572 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc HTTP/1.1 Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '23934ebc-aaa0-47f9-8aaf-733d0fb83bdc'} Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:42:32.044439 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:42:32.049365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:42:32.049365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:42:32.049365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:42:32.049365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:42:32.049365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:42:32.049365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:42:32.049365 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:42:32.049365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b5c02e7b-fce5-45e0-9eeb-62991ed23572 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:42:32.049365 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b5c02e7b-fce5-45e0-9eeb-62991ed23572 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 404 len: 111 microversion: 2.1 time: 0.034534 Oct 27 19:42:32.049365 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3610/7367] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:32 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:42:32.063271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-67dd6658-55d1-4b27-af53-d3eb21b01292 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:32.063984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-67dd6658-55d1-4b27-af53-d3eb21b01292 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:32.067092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=39 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:42:32.072573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67dd6658-55d1-4b27-af53-d3eb21b01292 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:32.073064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67dd6658-55d1-4b27-af53-d3eb21b01292 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:32.073512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67dd6658-55d1-4b27-af53-d3eb21b01292 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:32.074215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67dd6658-55d1-4b27-af53-d3eb21b01292 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:32.074704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67dd6658-55d1-4b27-af53-d3eb21b01292 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:32.075638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67dd6658-55d1-4b27-af53-d3eb21b01292 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:32.089402 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-67dd6658-55d1-4b27-af53-d3eb21b01292 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-67dd6658-55d1-4b27-af53-d3eb21b01292 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc HTTP/1.1 Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '23934ebc-aaa0-47f9-8aaf-733d0fb83bdc'} Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:42:32.091673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:42:32.096225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:42:32.096225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:42:32.096225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:42:32.096225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:42:32.096225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:42:32.096225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:42:32.096225 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:42:32.096225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-67dd6658-55d1-4b27-af53-d3eb21b01292 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:42:32.096225 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-67dd6658-55d1-4b27-af53-d3eb21b01292 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 404 len: 111 microversion: 2.1 time: 0.034215 Oct 27 19:42:32.096225 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3758/7368] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:32 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:42:32.141885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-223040715", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "5c454dce-b174-4189-a970-7d03caf6318a"}], "security_groups": [{"name": "tempest-securitygroup--1252788107"}], "key_name": "tempest-keypair-2116444884", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:42:32.248561 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] validate_networks() for [('5c454dce-b174-4189-a970-7d03caf6318a', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:42:32.617102 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:42:32.617554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:42:32.618077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:42:32.618550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:42:32.618990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:42:32.628091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:32.628596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:32.629058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:32.629844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:32.630325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:32.630809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:32.648914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Getting quotas for project 612eaff9b8f24492b2c53c62e6be5aa0. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:42:32.654755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Getting quotas for user c036fdc2fff644aa92e90481e04933c0 and project 612eaff9b8f24492b2c53c62e6be5aa0. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:42:32.667146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:42:32.670135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:42:32.718302 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6df4ffde-0155-4dc7-95bb-0e8800678478 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.580913 Oct 27 19:42:32.719058 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3611/7369] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:42:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:42:32.730585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1b6374a9-dec7-4b2a-acd8-28ff9de53abb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:32.731847 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1b6374a9-dec7-4b2a-acd8-28ff9de53abb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:32.787567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1b6374a9-dec7-4b2a-acd8-28ff9de53abb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:32.795262 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1b6374a9-dec7-4b2a-acd8-28ff9de53abb tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1238 microversion: 2.1 time: 0.068518 Oct 27 19:42:32.795857 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3759/7370] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:32 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:42:33.821240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-318bc217-b103-4d8e-811e-06de50b22651 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:33.821887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-318bc217-b103-4d8e-811e-06de50b22651 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:33.830061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-318bc217-b103-4d8e-811e-06de50b22651 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:33.830695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-318bc217-b103-4d8e-811e-06de50b22651 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:33.831286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-318bc217-b103-4d8e-811e-06de50b22651 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:33.832417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-318bc217-b103-4d8e-811e-06de50b22651 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:33.833363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-318bc217-b103-4d8e-811e-06de50b22651 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:33.833835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-318bc217-b103-4d8e-811e-06de50b22651 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:33.900921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-318bc217-b103-4d8e-811e-06de50b22651 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:33.910747 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-318bc217-b103-4d8e-811e-06de50b22651 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1308 microversion: 2.1 time: 0.094279 Oct 27 19:42:33.912270 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3612/7371] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:33 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:34.936617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a69f2ee2-0fa8-44d4-8358-2b47c8fbf536 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:34.937236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a69f2ee2-0fa8-44d4-8358-2b47c8fbf536 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:34.945310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a69f2ee2-0fa8-44d4-8358-2b47c8fbf536 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:34.945803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a69f2ee2-0fa8-44d4-8358-2b47c8fbf536 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:34.946253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a69f2ee2-0fa8-44d4-8358-2b47c8fbf536 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:34.947017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a69f2ee2-0fa8-44d4-8358-2b47c8fbf536 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:34.947497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a69f2ee2-0fa8-44d4-8358-2b47c8fbf536 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:34.947925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a69f2ee2-0fa8-44d4-8358-2b47c8fbf536 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:35.153603 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a69f2ee2-0fa8-44d4-8358-2b47c8fbf536 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:35.162324 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a69f2ee2-0fa8-44d4-8358-2b47c8fbf536 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1364 microversion: 2.1 time: 0.229628 Oct 27 19:42:35.163148 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3760/7372] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:34 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:35.296777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-735ca2a9-40fe-4dfe-aac3-a648087eb767 req-8a3adc69-e128-45c6-bc49-ee909f2f520a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b51d183-74c7-48df-a8c2-3584dabd5ad6", "tag": "4530905d-f24a-4e71-8054-ec2d96d398a7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:42:35.307788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-735ca2a9-40fe-4dfe-aac3-a648087eb767 req-8a3adc69-e128-45c6-bc49-ee909f2f520a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:35.308321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-735ca2a9-40fe-4dfe-aac3-a648087eb767 req-8a3adc69-e128-45c6-bc49-ee909f2f520a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:35.308767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-735ca2a9-40fe-4dfe-aac3-a648087eb767 req-8a3adc69-e128-45c6-bc49-ee909f2f520a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:35.324508 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-735ca2a9-40fe-4dfe-aac3-a648087eb767 req-8a3adc69-e128-45c6-bc49-ee909f2f520a service nova] Creating event network-changed:4530905d-f24a-4e71-8054-ec2d96d398a7 for instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 on n-h1-860687-3 Oct 27 19:42:35.329771 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-735ca2a9-40fe-4dfe-aac3-a648087eb767 req-8a3adc69-e128-45c6-bc49-ee909f2f520a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037500 Oct 27 19:42:35.330409 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3613/7373] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:42:36.187829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0be12296-7873-4855-9bc0-013be1fb26b3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:36.188368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0be12296-7873-4855-9bc0-013be1fb26b3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:36.195544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0be12296-7873-4855-9bc0-013be1fb26b3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:36.196047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0be12296-7873-4855-9bc0-013be1fb26b3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:36.196490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0be12296-7873-4855-9bc0-013be1fb26b3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:36.197191 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0be12296-7873-4855-9bc0-013be1fb26b3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:36.197655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0be12296-7873-4855-9bc0-013be1fb26b3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:36.198090 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0be12296-7873-4855-9bc0-013be1fb26b3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:36.325180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0be12296-7873-4855-9bc0-013be1fb26b3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:36.332885 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0be12296-7873-4855-9bc0-013be1fb26b3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1364 microversion: 2.1 time: 0.149906 Oct 27 19:42:36.333449 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3761/7374] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:36 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:37.358213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-07d6194c-5dde-4c9e-86c5-33a36f8823dd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:37.358980 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-07d6194c-5dde-4c9e-86c5-33a36f8823dd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:37.365193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07d6194c-5dde-4c9e-86c5-33a36f8823dd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:37.365705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07d6194c-5dde-4c9e-86c5-33a36f8823dd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:37.366167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07d6194c-5dde-4c9e-86c5-33a36f8823dd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:37.366916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07d6194c-5dde-4c9e-86c5-33a36f8823dd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:37.367406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07d6194c-5dde-4c9e-86c5-33a36f8823dd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:37.367860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07d6194c-5dde-4c9e-86c5-33a36f8823dd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:37.506196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-07d6194c-5dde-4c9e-86c5-33a36f8823dd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:37.514775 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-07d6194c-5dde-4c9e-86c5-33a36f8823dd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1364 microversion: 2.1 time: 0.161819 Oct 27 19:42:37.515362 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3614/7375] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:37 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:38.539297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-213631b1-aefb-475d-a0a2-88aaff9722f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:38.539914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-213631b1-aefb-475d-a0a2-88aaff9722f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:38.547649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-213631b1-aefb-475d-a0a2-88aaff9722f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:38.548131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-213631b1-aefb-475d-a0a2-88aaff9722f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:38.548567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-213631b1-aefb-475d-a0a2-88aaff9722f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:38.549261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-213631b1-aefb-475d-a0a2-88aaff9722f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:38.549715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-213631b1-aefb-475d-a0a2-88aaff9722f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:38.550143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-213631b1-aefb-475d-a0a2-88aaff9722f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:38.682785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-213631b1-aefb-475d-a0a2-88aaff9722f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:38.691849 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-213631b1-aefb-475d-a0a2-88aaff9722f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1364 microversion: 2.1 time: 0.156487 Oct 27 19:42:38.692418 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3762/7376] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:38 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:39.715749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c8b1204a-f5c5-4894-a125-adc0680c6986 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:39.716540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c8b1204a-f5c5-4894-a125-adc0680c6986 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:39.723579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8b1204a-f5c5-4894-a125-adc0680c6986 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:39.724089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8b1204a-f5c5-4894-a125-adc0680c6986 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:39.724553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8b1204a-f5c5-4894-a125-adc0680c6986 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:39.725283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8b1204a-f5c5-4894-a125-adc0680c6986 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:39.725764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8b1204a-f5c5-4894-a125-adc0680c6986 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:39.726214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8b1204a-f5c5-4894-a125-adc0680c6986 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:39.870445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c8b1204a-f5c5-4894-a125-adc0680c6986 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:39.879041 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c8b1204a-f5c5-4894-a125-adc0680c6986 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1364 microversion: 2.1 time: 0.167354 Oct 27 19:42:39.879636 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3615/7377] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:39 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:42:40.902506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b15db9c0-9f8f-4cdb-ad7f-083a30b0c460 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:40.903631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b15db9c0-9f8f-4cdb-ad7f-083a30b0c460 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:40.905630 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 19:42:40.905770 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 19:42:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 (ip 10.222.0.42) !!! Oct 27 19:42:40.916076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b15db9c0-9f8f-4cdb-ad7f-083a30b0c460 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:40.916571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b15db9c0-9f8f-4cdb-ad7f-083a30b0c460 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:40.917014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b15db9c0-9f8f-4cdb-ad7f-083a30b0c460 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:40.917714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b15db9c0-9f8f-4cdb-ad7f-083a30b0c460 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:40.918176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b15db9c0-9f8f-4cdb-ad7f-083a30b0c460 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:40.919314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b15db9c0-9f8f-4cdb-ad7f-083a30b0c460 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:41.052155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b15db9c0-9f8f-4cdb-ad7f-083a30b0c460 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:41.060251 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b15db9c0-9f8f-4cdb-ad7f-083a30b0c460 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1364 microversion: 2.1 time: 0.161717 Oct 27 19:42:41.060875 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3763/7378] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:40 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:41.798896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-64af9e6c-ba47-47d9-a122-246ef46e658b req-760cbec5-a437-4dd6-aa9f-f6a75f365969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b51d183-74c7-48df-a8c2-3584dabd5ad6", "name": "network-vif-plugged", "status": "completed", "tag": "4530905d-f24a-4e71-8054-ec2d96d398a7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:42:41.812288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-64af9e6c-ba47-47d9-a122-246ef46e658b req-760cbec5-a437-4dd6-aa9f-f6a75f365969 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:41.812838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-64af9e6c-ba47-47d9-a122-246ef46e658b req-760cbec5-a437-4dd6-aa9f-f6a75f365969 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:41.813475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-64af9e6c-ba47-47d9-a122-246ef46e658b req-760cbec5-a437-4dd6-aa9f-f6a75f365969 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:41.825667 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-64af9e6c-ba47-47d9-a122-246ef46e658b req-760cbec5-a437-4dd6-aa9f-f6a75f365969 service nova] Creating event network-vif-plugged:4530905d-f24a-4e71-8054-ec2d96d398a7 for instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 on n-h1-860687-3 Oct 27 19:42:41.830864 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-64af9e6c-ba47-47d9-a122-246ef46e658b req-760cbec5-a437-4dd6-aa9f-f6a75f365969 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035752 Oct 27 19:42:41.831477 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3616/7379] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:42:42.084506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-597be971-e203-42d2-881f-e664709751f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:42.085078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-597be971-e203-42d2-881f-e664709751f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:42.091978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-597be971-e203-42d2-881f-e664709751f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:42.092468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-597be971-e203-42d2-881f-e664709751f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:42.092908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-597be971-e203-42d2-881f-e664709751f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:42.093605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-597be971-e203-42d2-881f-e664709751f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:42.094063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-597be971-e203-42d2-881f-e664709751f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:42.094527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-597be971-e203-42d2-881f-e664709751f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:42.224161 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-597be971-e203-42d2-881f-e664709751f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:42.232460 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-597be971-e203-42d2-881f-e664709751f7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1364 microversion: 2.1 time: 0.152045 Oct 27 19:42:42.233021 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3764/7380] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:42 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:43.257367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d2ae21b1-1abd-45ce-a9d2-339b8a823b89 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:43.258114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d2ae21b1-1abd-45ce-a9d2-339b8a823b89 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:43.260120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:42:43.260817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:42:43.268027 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ae21b1-1abd-45ce-a9d2-339b8a823b89 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:43.268544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ae21b1-1abd-45ce-a9d2-339b8a823b89 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:43.269011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ae21b1-1abd-45ce-a9d2-339b8a823b89 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:43.269740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ae21b1-1abd-45ce-a9d2-339b8a823b89 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:43.270220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ae21b1-1abd-45ce-a9d2-339b8a823b89 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:43.270708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d2ae21b1-1abd-45ce-a9d2-339b8a823b89 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:43.402922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d2ae21b1-1abd-45ce-a9d2-339b8a823b89 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:42:43.410908 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d2ae21b1-1abd-45ce-a9d2-339b8a823b89 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1552 microversion: 2.1 time: 0.158333 Oct 27 19:42:43.411492 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3617/7381] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:42:43 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:42:43.442739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5696f1b4-e5f6-4ebb-a674-6d8339d38647 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:42:43.443256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5696f1b4-e5f6-4ebb-a674-6d8339d38647 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:42:43.445055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:42:43.451869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5696f1b4-e5f6-4ebb-a674-6d8339d38647 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:43.452647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5696f1b4-e5f6-4ebb-a674-6d8339d38647 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:43.453095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5696f1b4-e5f6-4ebb-a674-6d8339d38647 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:43.453786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5696f1b4-e5f6-4ebb-a674-6d8339d38647 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:43.454247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5696f1b4-e5f6-4ebb-a674-6d8339d38647 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:43.454715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5696f1b4-e5f6-4ebb-a674-6d8339d38647 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:43.535344 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5696f1b4-e5f6-4ebb-a674-6d8339d38647 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097022 Oct 27 19:42:43.535948 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3765/7382] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:42:43 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:42:44.460246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-799ac386-ab5e-4cc3-a033-1dd136e7a97d req-d82f9bc2-1075-4062-a720-81bc11ad7234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b51d183-74c7-48df-a8c2-3584dabd5ad6", "tag": "4530905d-f24a-4e71-8054-ec2d96d398a7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:42:44.470787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-799ac386-ab5e-4cc3-a033-1dd136e7a97d req-d82f9bc2-1075-4062-a720-81bc11ad7234 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:42:44.471295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-799ac386-ab5e-4cc3-a033-1dd136e7a97d req-d82f9bc2-1075-4062-a720-81bc11ad7234 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:42:44.471757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-799ac386-ab5e-4cc3-a033-1dd136e7a97d req-d82f9bc2-1075-4062-a720-81bc11ad7234 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:42:44.483146 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-799ac386-ab5e-4cc3-a033-1dd136e7a97d req-d82f9bc2-1075-4062-a720-81bc11ad7234 service nova] Creating event network-changed:4530905d-f24a-4e71-8054-ec2d96d398a7 for instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 on n-h1-860687-3 Oct 27 19:42:44.488253 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-799ac386-ab5e-4cc3-a033-1dd136e7a97d req-d82f9bc2-1075-4062-a720-81bc11ad7234 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031878 Oct 27 19:42:44.489040 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3618/7383] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:43:19.211444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=17 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:43:19.212283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=38 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:43:19.216564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5bcc816a-4e2e-4edb-ab49-971a2f346b10 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:19.217171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5bcc816a-4e2e-4edb-ab49-971a2f346b10 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:19.223916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bcc816a-4e2e-4edb-ab49-971a2f346b10 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:19.224399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bcc816a-4e2e-4edb-ab49-971a2f346b10 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:19.224837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bcc816a-4e2e-4edb-ab49-971a2f346b10 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:19.225526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bcc816a-4e2e-4edb-ab49-971a2f346b10 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:19.225983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bcc816a-4e2e-4edb-ab49-971a2f346b10 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:19.226478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5bcc816a-4e2e-4edb-ab49-971a2f346b10 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:19.493332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5bcc816a-4e2e-4edb-ab49-971a2f346b10 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:19.501753 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5bcc816a-4e2e-4edb-ab49-971a2f346b10 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1670 microversion: 2.1 time: 0.292381 Oct 27 19:43:19.502325 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3766/7384] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:19 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1670 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:19.523751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:43:19.524451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:43:19.528821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-702ce34a-bd56-4ca4-a906-25c53c457c87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1dda95d-d747-4a6a-a986-e19c8ecab944"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:43:19.531423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-702ce34a-bd56-4ca4-a906-25c53c457c87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:19.539062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-702ce34a-bd56-4ca4-a906-25c53c457c87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:19.539574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-702ce34a-bd56-4ca4-a906-25c53c457c87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:19.540038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-702ce34a-bd56-4ca4-a906-25c53c457c87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:19.540749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-702ce34a-bd56-4ca4-a906-25c53c457c87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:19.541230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-702ce34a-bd56-4ca4-a906-25c53c457c87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:19.541686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-702ce34a-bd56-4ca4-a906-25c53c457c87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:19.943674 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-702ce34a-bd56-4ca4-a906-25c53c457c87 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421977 Oct 27 19:43:19.944300 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3619/7385] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:43:19 2022] POST /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:43:30.674650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:43:30.677043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:30.679355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:43:30.680020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:43:30.685889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:30.686401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:30.686857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:30.687564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:30.688017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:30.688451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:30.717246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:30.723192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Old instance type m1.heat2, new instance type m1.heat {{(pid=127029) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 19:43:30.730177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:43:30.730631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:43:30.731116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:43:30.731533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:43:30.731955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:43:30.798125 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7eb8a14a-07f2-4a49-b1b0-be5b6ba4f0c8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6/action" status: 202 len: 0 microversion: 2.1 time: 0.127949 Oct 27 19:43:30.798671 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3767/7386] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:43:30 2022] POST /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:43:30.805451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:43:30.806231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:43:30.810433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d2f62c2-a49d-4fa1-a1f2-cd6011bef045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:30.811429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d2f62c2-a49d-4fa1-a1f2-cd6011bef045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:30.820437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d2f62c2-a49d-4fa1-a1f2-cd6011bef045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:30.820990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d2f62c2-a49d-4fa1-a1f2-cd6011bef045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:30.821484 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d2f62c2-a49d-4fa1-a1f2-cd6011bef045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:30.822242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d2f62c2-a49d-4fa1-a1f2-cd6011bef045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:30.822800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d2f62c2-a49d-4fa1-a1f2-cd6011bef045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:30.823245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d2f62c2-a49d-4fa1-a1f2-cd6011bef045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:30.966806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6d2f62c2-a49d-4fa1-a1f2-cd6011bef045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:30.975392 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d2f62c2-a49d-4fa1-a1f2-cd6011bef045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1725 microversion: 2.1 time: 0.171901 Oct 27 19:43:30.975951 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3620/7387] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:30 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:32.000919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-11b89d7b-18ad-4fe3-898b-bfaf2a1cef4e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:32.001544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-11b89d7b-18ad-4fe3-898b-bfaf2a1cef4e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:32.008564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11b89d7b-18ad-4fe3-898b-bfaf2a1cef4e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:32.009061 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11b89d7b-18ad-4fe3-898b-bfaf2a1cef4e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:32.009508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11b89d7b-18ad-4fe3-898b-bfaf2a1cef4e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:32.010208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11b89d7b-18ad-4fe3-898b-bfaf2a1cef4e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:32.010700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11b89d7b-18ad-4fe3-898b-bfaf2a1cef4e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:32.011142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-11b89d7b-18ad-4fe3-898b-bfaf2a1cef4e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:32.224876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-11b89d7b-18ad-4fe3-898b-bfaf2a1cef4e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:32.233211 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-11b89d7b-18ad-4fe3-898b-bfaf2a1cef4e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1725 microversion: 2.1 time: 0.237701 Oct 27 19:43:32.233786 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3768/7388] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:31 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:33.260147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e36cff85-abfa-4f7f-a770-e56009dd029a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:33.260817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e36cff85-abfa-4f7f-a770-e56009dd029a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:33.268287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e36cff85-abfa-4f7f-a770-e56009dd029a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:33.268792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e36cff85-abfa-4f7f-a770-e56009dd029a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:33.269253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e36cff85-abfa-4f7f-a770-e56009dd029a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:33.269971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e36cff85-abfa-4f7f-a770-e56009dd029a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:33.270483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e36cff85-abfa-4f7f-a770-e56009dd029a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:33.270937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e36cff85-abfa-4f7f-a770-e56009dd029a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:33.403631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e36cff85-abfa-4f7f-a770-e56009dd029a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:33.412711 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e36cff85-abfa-4f7f-a770-e56009dd029a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.156524 Oct 27 19:43:33.413290 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3621/7389] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:33 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:34.436062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b325bdca-95ec-45bc-95a3-486e012ff7b8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:34.436693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b325bdca-95ec-45bc-95a3-486e012ff7b8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:34.443964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b325bdca-95ec-45bc-95a3-486e012ff7b8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:34.444465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b325bdca-95ec-45bc-95a3-486e012ff7b8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:34.444910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b325bdca-95ec-45bc-95a3-486e012ff7b8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:34.445611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b325bdca-95ec-45bc-95a3-486e012ff7b8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:34.446071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b325bdca-95ec-45bc-95a3-486e012ff7b8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:34.446541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b325bdca-95ec-45bc-95a3-486e012ff7b8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:34.580059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b325bdca-95ec-45bc-95a3-486e012ff7b8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:34.588436 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b325bdca-95ec-45bc-95a3-486e012ff7b8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.156416 Oct 27 19:43:34.589009 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3769/7390] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:34 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:35.612250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-291d3034-3c00-4dff-9d4a-8b71ecefaf0e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:35.612865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-291d3034-3c00-4dff-9d4a-8b71ecefaf0e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:35.619910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-291d3034-3c00-4dff-9d4a-8b71ecefaf0e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:35.620415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-291d3034-3c00-4dff-9d4a-8b71ecefaf0e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:35.620874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-291d3034-3c00-4dff-9d4a-8b71ecefaf0e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:35.621592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-291d3034-3c00-4dff-9d4a-8b71ecefaf0e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:35.622065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-291d3034-3c00-4dff-9d4a-8b71ecefaf0e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:35.622610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-291d3034-3c00-4dff-9d4a-8b71ecefaf0e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:35.754613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-291d3034-3c00-4dff-9d4a-8b71ecefaf0e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:35.763110 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-291d3034-3c00-4dff-9d4a-8b71ecefaf0e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.155021 Oct 27 19:43:35.763696 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3622/7391] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:35 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:36.786145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-79ba8ffb-4c58-4ab8-a0cf-e30c446ab382 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:36.786796 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-79ba8ffb-4c58-4ab8-a0cf-e30c446ab382 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:36.793599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ba8ffb-4c58-4ab8-a0cf-e30c446ab382 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:36.794088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ba8ffb-4c58-4ab8-a0cf-e30c446ab382 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:36.794570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ba8ffb-4c58-4ab8-a0cf-e30c446ab382 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:36.795267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ba8ffb-4c58-4ab8-a0cf-e30c446ab382 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:36.795728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ba8ffb-4c58-4ab8-a0cf-e30c446ab382 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:36.796158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ba8ffb-4c58-4ab8-a0cf-e30c446ab382 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:36.930596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-79ba8ffb-4c58-4ab8-a0cf-e30c446ab382 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:36.940662 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-79ba8ffb-4c58-4ab8-a0cf-e30c446ab382 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.158436 Oct 27 19:43:36.941236 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3770/7392] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:36 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:37.964584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-12c6c86c-f977-431b-82a9-7be2046114ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:37.965223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-12c6c86c-f977-431b-82a9-7be2046114ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:37.972711 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12c6c86c-f977-431b-82a9-7be2046114ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:37.973243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12c6c86c-f977-431b-82a9-7be2046114ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:37.973692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12c6c86c-f977-431b-82a9-7be2046114ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:37.974445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12c6c86c-f977-431b-82a9-7be2046114ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:37.974930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12c6c86c-f977-431b-82a9-7be2046114ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:37.975386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12c6c86c-f977-431b-82a9-7be2046114ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:38.103972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-12c6c86c-f977-431b-82a9-7be2046114ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:38.113054 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-12c6c86c-f977-431b-82a9-7be2046114ec tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.152515 Oct 27 19:43:38.113649 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3623/7393] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:37 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:39.136588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bc4ab0ef-00a5-4419-9cc1-cafb510848cd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:39.137210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bc4ab0ef-00a5-4419-9cc1-cafb510848cd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:39.144833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc4ab0ef-00a5-4419-9cc1-cafb510848cd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:39.145328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc4ab0ef-00a5-4419-9cc1-cafb510848cd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:39.145778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc4ab0ef-00a5-4419-9cc1-cafb510848cd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:39.146514 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc4ab0ef-00a5-4419-9cc1-cafb510848cd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:39.146985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc4ab0ef-00a5-4419-9cc1-cafb510848cd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:39.147421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bc4ab0ef-00a5-4419-9cc1-cafb510848cd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:39.277104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bc4ab0ef-00a5-4419-9cc1-cafb510848cd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:39.286132 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bc4ab0ef-00a5-4419-9cc1-cafb510848cd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.153605 Oct 27 19:43:39.286758 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3771/7394] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:39 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:40.309504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c7cb7a89-1841-4536-a78f-d59a08533687 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:40.310139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c7cb7a89-1841-4536-a78f-d59a08533687 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:40.318292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7cb7a89-1841-4536-a78f-d59a08533687 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:40.318825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7cb7a89-1841-4536-a78f-d59a08533687 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:40.319282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7cb7a89-1841-4536-a78f-d59a08533687 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:40.319996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7cb7a89-1841-4536-a78f-d59a08533687 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:40.320466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7cb7a89-1841-4536-a78f-d59a08533687 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:40.320912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7cb7a89-1841-4536-a78f-d59a08533687 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:40.454789 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c7cb7a89-1841-4536-a78f-d59a08533687 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:40.463194 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c7cb7a89-1841-4536-a78f-d59a08533687 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.157684 Oct 27 19:43:40.463786 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3624/7395] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:40 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:41.487386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3228b021-c97c-4a34-8ddb-fbf4f20fb634 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:41.488001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3228b021-c97c-4a34-8ddb-fbf4f20fb634 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:41.494986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3228b021-c97c-4a34-8ddb-fbf4f20fb634 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:41.495473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3228b021-c97c-4a34-8ddb-fbf4f20fb634 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:41.495912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3228b021-c97c-4a34-8ddb-fbf4f20fb634 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:41.496599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3228b021-c97c-4a34-8ddb-fbf4f20fb634 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:41.497108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3228b021-c97c-4a34-8ddb-fbf4f20fb634 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:41.497484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3228b021-c97c-4a34-8ddb-fbf4f20fb634 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:41.626884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3228b021-c97c-4a34-8ddb-fbf4f20fb634 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:41.635247 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3228b021-c97c-4a34-8ddb-fbf4f20fb634 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.152252 Oct 27 19:43:41.635822 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3772/7396] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:41 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:42.659396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-416e9fd8-f9d3-4f68-98d8-1cf6718ca0bf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:42.660073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-416e9fd8-f9d3-4f68-98d8-1cf6718ca0bf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:42.669220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-416e9fd8-f9d3-4f68-98d8-1cf6718ca0bf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:42.669737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-416e9fd8-f9d3-4f68-98d8-1cf6718ca0bf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:42.670201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-416e9fd8-f9d3-4f68-98d8-1cf6718ca0bf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:42.670955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-416e9fd8-f9d3-4f68-98d8-1cf6718ca0bf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:42.671495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-416e9fd8-f9d3-4f68-98d8-1cf6718ca0bf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:42.671948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-416e9fd8-f9d3-4f68-98d8-1cf6718ca0bf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:42.805118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-416e9fd8-f9d3-4f68-98d8-1cf6718ca0bf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:42.813727 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-416e9fd8-f9d3-4f68-98d8-1cf6718ca0bf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.158764 Oct 27 19:43:42.814310 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3625/7397] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:42 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:43:43.837777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce640533-d7a1-440a-8b6b-b9ba957ed0be tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:43.838333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ce640533-d7a1-440a-8b6b-b9ba957ed0be tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:43.845654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce640533-d7a1-440a-8b6b-b9ba957ed0be tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:43.846138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce640533-d7a1-440a-8b6b-b9ba957ed0be tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:43.846610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce640533-d7a1-440a-8b6b-b9ba957ed0be tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:43.847302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce640533-d7a1-440a-8b6b-b9ba957ed0be tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:43.847755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce640533-d7a1-440a-8b6b-b9ba957ed0be tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:43.848359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce640533-d7a1-440a-8b6b-b9ba957ed0be tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:44.299382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ce640533-d7a1-440a-8b6b-b9ba957ed0be tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:44.307566 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce640533-d7a1-440a-8b6b-b9ba957ed0be tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.473814 Oct 27 19:43:44.308152 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3773/7398] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:43 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:45.331327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d8483a6d-6728-49fc-8418-d5859b79cbdf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:45.331967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d8483a6d-6728-49fc-8418-d5859b79cbdf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:45.338910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8483a6d-6728-49fc-8418-d5859b79cbdf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:45.339418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8483a6d-6728-49fc-8418-d5859b79cbdf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:45.339883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8483a6d-6728-49fc-8418-d5859b79cbdf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:45.340603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8483a6d-6728-49fc-8418-d5859b79cbdf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:45.341087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8483a6d-6728-49fc-8418-d5859b79cbdf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:45.341569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d8483a6d-6728-49fc-8418-d5859b79cbdf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:45.480837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d8483a6d-6728-49fc-8418-d5859b79cbdf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:45.489356 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d8483a6d-6728-49fc-8418-d5859b79cbdf tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.162527 Oct 27 19:43:45.489946 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3626/7399] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:45 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:46.513399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7dfa1368-5689-4db4-be0f-5f564abd545a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:46.514059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7dfa1368-5689-4db4-be0f-5f564abd545a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:46.521494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dfa1368-5689-4db4-be0f-5f564abd545a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:46.521923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dfa1368-5689-4db4-be0f-5f564abd545a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:46.522369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dfa1368-5689-4db4-be0f-5f564abd545a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:46.523104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dfa1368-5689-4db4-be0f-5f564abd545a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:46.523569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dfa1368-5689-4db4-be0f-5f564abd545a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:46.524008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7dfa1368-5689-4db4-be0f-5f564abd545a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:46.654785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7dfa1368-5689-4db4-be0f-5f564abd545a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:46.663893 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7dfa1368-5689-4db4-be0f-5f564abd545a tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.154440 Oct 27 19:43:46.664471 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3774/7400] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:46 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:47.688381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8b8e3905-769b-43a1-811e-a746b7747b5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:47.688915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8b8e3905-769b-43a1-811e-a746b7747b5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:47.697063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b8e3905-769b-43a1-811e-a746b7747b5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:47.697568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b8e3905-769b-43a1-811e-a746b7747b5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:47.698026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b8e3905-769b-43a1-811e-a746b7747b5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:47.698768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b8e3905-769b-43a1-811e-a746b7747b5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:47.699243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b8e3905-769b-43a1-811e-a746b7747b5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:47.699687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b8e3905-769b-43a1-811e-a746b7747b5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:47.830754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8b8e3905-769b-43a1-811e-a746b7747b5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:47.839168 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8b8e3905-769b-43a1-811e-a746b7747b5f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.155430 Oct 27 19:43:47.839741 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3627/7401] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:47 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:43:48.863713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a4997137-8bd5-42a4-a981-ba5bb0f050d9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:48.864350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a4997137-8bd5-42a4-a981-ba5bb0f050d9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:48.871328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4997137-8bd5-42a4-a981-ba5bb0f050d9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:48.871820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4997137-8bd5-42a4-a981-ba5bb0f050d9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:48.872264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4997137-8bd5-42a4-a981-ba5bb0f050d9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:48.872962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4997137-8bd5-42a4-a981-ba5bb0f050d9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:48.873422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4997137-8bd5-42a4-a981-ba5bb0f050d9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:48.873855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a4997137-8bd5-42a4-a981-ba5bb0f050d9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:49.013133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a4997137-8bd5-42a4-a981-ba5bb0f050d9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:49.021579 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a4997137-8bd5-42a4-a981-ba5bb0f050d9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.161966 Oct 27 19:43:49.022167 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3775/7402] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:48 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:50.045153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-685fe2e8-a138-4fb9-af9f-78636bb4d89d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:50.045829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-685fe2e8-a138-4fb9-af9f-78636bb4d89d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:50.052999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685fe2e8-a138-4fb9-af9f-78636bb4d89d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:50.053517 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685fe2e8-a138-4fb9-af9f-78636bb4d89d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:50.053987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685fe2e8-a138-4fb9-af9f-78636bb4d89d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:50.054758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685fe2e8-a138-4fb9-af9f-78636bb4d89d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:50.055241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685fe2e8-a138-4fb9-af9f-78636bb4d89d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:50.055700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-685fe2e8-a138-4fb9-af9f-78636bb4d89d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:50.191498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-685fe2e8-a138-4fb9-af9f-78636bb4d89d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:50.199882 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-685fe2e8-a138-4fb9-af9f-78636bb4d89d tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.158671 Oct 27 19:43:50.200461 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3628/7403] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:50 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:51.224447 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eaff99f6-b2b3-458e-838f-f425f7e2bef6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:51.225062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-eaff99f6-b2b3-458e-838f-f425f7e2bef6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:51.232077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaff99f6-b2b3-458e-838f-f425f7e2bef6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:51.232572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaff99f6-b2b3-458e-838f-f425f7e2bef6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:51.233004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaff99f6-b2b3-458e-838f-f425f7e2bef6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:51.234373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaff99f6-b2b3-458e-838f-f425f7e2bef6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:51.234831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaff99f6-b2b3-458e-838f-f425f7e2bef6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:51.235264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eaff99f6-b2b3-458e-838f-f425f7e2bef6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:51.364618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-eaff99f6-b2b3-458e-838f-f425f7e2bef6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:51.372855 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eaff99f6-b2b3-458e-838f-f425f7e2bef6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1730 microversion: 2.1 time: 0.152375 Oct 27 19:43:51.373428 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3776/7404] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:51 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:43:52.397272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-372f0236-645e-42bf-a156-5b17c13af883 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:52.397891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-372f0236-645e-42bf-a156-5b17c13af883 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:52.404388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-372f0236-645e-42bf-a156-5b17c13af883 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:52.404896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-372f0236-645e-42bf-a156-5b17c13af883 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:52.406005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-372f0236-645e-42bf-a156-5b17c13af883 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:52.406913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-372f0236-645e-42bf-a156-5b17c13af883 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:52.407398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-372f0236-645e-42bf-a156-5b17c13af883 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:52.407857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-372f0236-645e-42bf-a156-5b17c13af883 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:52.621591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-372f0236-645e-42bf-a156-5b17c13af883 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:52.632611 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-372f0236-645e-42bf-a156-5b17c13af883 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1729 microversion: 2.1 time: 0.239473 Oct 27 19:43:52.633298 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3629/7405] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:52 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:52.782220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-c60181de-6a80-4c98-bd13-af5a82ed8a88 req-804ad692-f7b2-43fb-8907-0deca8d07d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b51d183-74c7-48df-a8c2-3584dabd5ad6", "name": "network-vif-unplugged", "status": "completed", "tag": "4530905d-f24a-4e71-8054-ec2d96d398a7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:43:52.791804 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c60181de-6a80-4c98-bd13-af5a82ed8a88 req-804ad692-f7b2-43fb-8907-0deca8d07d52 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:52.792302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c60181de-6a80-4c98-bd13-af5a82ed8a88 req-804ad692-f7b2-43fb-8907-0deca8d07d52 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:52.792716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c60181de-6a80-4c98-bd13-af5a82ed8a88 req-804ad692-f7b2-43fb-8907-0deca8d07d52 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:52.813268 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-c60181de-6a80-4c98-bd13-af5a82ed8a88 req-804ad692-f7b2-43fb-8907-0deca8d07d52 service nova] Creating event network-vif-unplugged:4530905d-f24a-4e71-8054-ec2d96d398a7 for instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 on n-h2-860687-3 Oct 27 19:43:52.819022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-c60181de-6a80-4c98-bd13-af5a82ed8a88 req-804ad692-f7b2-43fb-8907-0deca8d07d52 service nova] Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:43:52.831911 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-c60181de-6a80-4c98-bd13-af5a82ed8a88 req-804ad692-f7b2-43fb-8907-0deca8d07d52 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105148 Oct 27 19:43:52.832523 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3777/7406] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:43:53.657961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d1aaecdf-351a-4e24-a2e1-376a555aded1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:53.658660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d1aaecdf-351a-4e24-a2e1-376a555aded1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:53.665739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1aaecdf-351a-4e24-a2e1-376a555aded1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:53.666252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1aaecdf-351a-4e24-a2e1-376a555aded1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:53.666752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1aaecdf-351a-4e24-a2e1-376a555aded1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:53.667495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1aaecdf-351a-4e24-a2e1-376a555aded1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:53.667963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1aaecdf-351a-4e24-a2e1-376a555aded1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:53.668416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d1aaecdf-351a-4e24-a2e1-376a555aded1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:53.808721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d1aaecdf-351a-4e24-a2e1-376a555aded1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:53.817530 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d1aaecdf-351a-4e24-a2e1-376a555aded1 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1729 microversion: 2.1 time: 0.164055 Oct 27 19:43:53.818123 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3630/7407] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:53 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:54.842036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f117c6cd-ba0a-420e-861a-b1489e9e1ccd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:54.842769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f117c6cd-ba0a-420e-861a-b1489e9e1ccd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:54.849981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f117c6cd-ba0a-420e-861a-b1489e9e1ccd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:54.850563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f117c6cd-ba0a-420e-861a-b1489e9e1ccd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:54.851009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f117c6cd-ba0a-420e-861a-b1489e9e1ccd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:54.851718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f117c6cd-ba0a-420e-861a-b1489e9e1ccd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:54.852176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f117c6cd-ba0a-420e-861a-b1489e9e1ccd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:54.852605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f117c6cd-ba0a-420e-861a-b1489e9e1ccd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:54.866459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-254a98fe-fe0a-4038-95ed-afb6fb3c1be0 req-521a8419-2fc0-48cb-94c0-83d4b2f8c1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b51d183-74c7-48df-a8c2-3584dabd5ad6", "tag": "4530905d-f24a-4e71-8054-ec2d96d398a7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:43:54.880489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-254a98fe-fe0a-4038-95ed-afb6fb3c1be0 req-521a8419-2fc0-48cb-94c0-83d4b2f8c1e4 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:54.881326 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-254a98fe-fe0a-4038-95ed-afb6fb3c1be0 req-521a8419-2fc0-48cb-94c0-83d4b2f8c1e4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:54.882018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-254a98fe-fe0a-4038-95ed-afb6fb3c1be0 req-521a8419-2fc0-48cb-94c0-83d4b2f8c1e4 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:54.895081 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-254a98fe-fe0a-4038-95ed-afb6fb3c1be0 req-521a8419-2fc0-48cb-94c0-83d4b2f8c1e4 service nova] Creating event network-changed:4530905d-f24a-4e71-8054-ec2d96d398a7 for instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 on n-h2-860687-3 Oct 27 19:43:54.900886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-254a98fe-fe0a-4038-95ed-afb6fb3c1be0 req-521a8419-2fc0-48cb-94c0-83d4b2f8c1e4 service nova] Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:43:54.913294 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-254a98fe-fe0a-4038-95ed-afb6fb3c1be0 req-521a8419-2fc0-48cb-94c0-83d4b2f8c1e4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050565 Oct 27 19:43:54.914264 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3631/7408] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:43:55.057379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f117c6cd-ba0a-420e-861a-b1489e9e1ccd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:55.071710 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f117c6cd-ba0a-420e-861a-b1489e9e1ccd tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1727 microversion: 2.1 time: 0.234846 Oct 27 19:43:55.073292 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3778/7409] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:54 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1727 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:56.098279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-48f6bbd0-dcc6-4745-aada-74fc91be6b88 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:56.099161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-48f6bbd0-dcc6-4745-aada-74fc91be6b88 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:56.105584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48f6bbd0-dcc6-4745-aada-74fc91be6b88 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:56.106184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48f6bbd0-dcc6-4745-aada-74fc91be6b88 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:56.106753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48f6bbd0-dcc6-4745-aada-74fc91be6b88 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:56.107542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48f6bbd0-dcc6-4745-aada-74fc91be6b88 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:56.108028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48f6bbd0-dcc6-4745-aada-74fc91be6b88 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:56.108516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48f6bbd0-dcc6-4745-aada-74fc91be6b88 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:56.249753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-48f6bbd0-dcc6-4745-aada-74fc91be6b88 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:56.259184 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-48f6bbd0-dcc6-4745-aada-74fc91be6b88 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1727 microversion: 2.1 time: 0.166258 Oct 27 19:43:56.259783 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3632/7410] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:56 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:57.284795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a49a321-d51c-441d-8ca9-b3387885d64f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:57.285434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1a49a321-d51c-441d-8ca9-b3387885d64f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:57.292128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a49a321-d51c-441d-8ca9-b3387885d64f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:57.292622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a49a321-d51c-441d-8ca9-b3387885d64f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:57.293095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a49a321-d51c-441d-8ca9-b3387885d64f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:57.293806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a49a321-d51c-441d-8ca9-b3387885d64f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:57.294266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a49a321-d51c-441d-8ca9-b3387885d64f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:57.294732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a49a321-d51c-441d-8ca9-b3387885d64f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:57.428370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1a49a321-d51c-441d-8ca9-b3387885d64f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:57.437377 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1a49a321-d51c-441d-8ca9-b3387885d64f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1727 microversion: 2.1 time: 0.156533 Oct 27 19:43:57.437967 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3779/7411] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:57 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:43:58.461325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b9941f80-01f7-432d-9d92-85d0fdb44e24 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:58.461970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b9941f80-01f7-432d-9d92-85d0fdb44e24 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:58.469994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9941f80-01f7-432d-9d92-85d0fdb44e24 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:58.470533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9941f80-01f7-432d-9d92-85d0fdb44e24 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:58.471002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9941f80-01f7-432d-9d92-85d0fdb44e24 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:58.471733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9941f80-01f7-432d-9d92-85d0fdb44e24 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:58.472218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9941f80-01f7-432d-9d92-85d0fdb44e24 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:58.472706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9941f80-01f7-432d-9d92-85d0fdb44e24 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:58.611717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b9941f80-01f7-432d-9d92-85d0fdb44e24 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:58.620584 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b9941f80-01f7-432d-9d92-85d0fdb44e24 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1727 microversion: 2.1 time: 0.163188 Oct 27 19:43:58.621195 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3633/7412] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:58 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:43:59.644354 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6bf4f7de-e234-4bfe-8c34-c13cc29dcb53 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:43:59.645007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6bf4f7de-e234-4bfe-8c34-c13cc29dcb53 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:43:59.651700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bf4f7de-e234-4bfe-8c34-c13cc29dcb53 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:59.652188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bf4f7de-e234-4bfe-8c34-c13cc29dcb53 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:59.652631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bf4f7de-e234-4bfe-8c34-c13cc29dcb53 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:59.653325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bf4f7de-e234-4bfe-8c34-c13cc29dcb53 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:43:59.653795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bf4f7de-e234-4bfe-8c34-c13cc29dcb53 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:43:59.654229 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6bf4f7de-e234-4bfe-8c34-c13cc29dcb53 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:43:59.788282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6bf4f7de-e234-4bfe-8c34-c13cc29dcb53 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:43:59.798296 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6bf4f7de-e234-4bfe-8c34-c13cc29dcb53 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1727 microversion: 2.1 time: 0.157778 Oct 27 19:43:59.798928 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3780/7413] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:43:59 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:00.823417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-da254d17-aa2b-438e-8bb5-f1bd983b8e67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:00.824073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-da254d17-aa2b-438e-8bb5-f1bd983b8e67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:00.826894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=29 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:44:00.832303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da254d17-aa2b-438e-8bb5-f1bd983b8e67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:00.832807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da254d17-aa2b-438e-8bb5-f1bd983b8e67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:00.833265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da254d17-aa2b-438e-8bb5-f1bd983b8e67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:00.834029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da254d17-aa2b-438e-8bb5-f1bd983b8e67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:00.834488 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da254d17-aa2b-438e-8bb5-f1bd983b8e67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:00.834935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da254d17-aa2b-438e-8bb5-f1bd983b8e67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:00.849737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=85 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:44:00.966196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-da254d17-aa2b-438e-8bb5-f1bd983b8e67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:00.974573 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-da254d17-aa2b-438e-8bb5-f1bd983b8e67 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1727 microversion: 2.1 time: 0.155137 Oct 27 19:44:00.975161 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3634/7414] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:00 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:01.997877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e4b4bba1-3e71-4da6-8a40-23db452fb1f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:01.998533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e4b4bba1-3e71-4da6-8a40-23db452fb1f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:02.001341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=33 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:44:02.006652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4b4bba1-3e71-4da6-8a40-23db452fb1f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:02.007146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4b4bba1-3e71-4da6-8a40-23db452fb1f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:02.007589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4b4bba1-3e71-4da6-8a40-23db452fb1f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:02.008290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4b4bba1-3e71-4da6-8a40-23db452fb1f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:02.008750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4b4bba1-3e71-4da6-8a40-23db452fb1f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:02.009185 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4b4bba1-3e71-4da6-8a40-23db452fb1f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:02.011959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:44:02.145506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e4b4bba1-3e71-4da6-8a40-23db452fb1f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:02.153806 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e4b4bba1-3e71-4da6-8a40-23db452fb1f9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1727 microversion: 2.1 time: 0.159952 Oct 27 19:44:02.154402 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3781/7415] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:01 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:03.178020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ff077c5-6da2-405a-8119-64ab2884cc77 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:03.178690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5ff077c5-6da2-405a-8119-64ab2884cc77 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:03.185620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ff077c5-6da2-405a-8119-64ab2884cc77 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:03.186127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ff077c5-6da2-405a-8119-64ab2884cc77 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:03.186718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ff077c5-6da2-405a-8119-64ab2884cc77 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:03.187462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ff077c5-6da2-405a-8119-64ab2884cc77 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:03.187947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ff077c5-6da2-405a-8119-64ab2884cc77 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:03.188399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ff077c5-6da2-405a-8119-64ab2884cc77 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:03.321579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5ff077c5-6da2-405a-8119-64ab2884cc77 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:03.330469 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5ff077c5-6da2-405a-8119-64ab2884cc77 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1727 microversion: 2.1 time: 0.156441 Oct 27 19:44:03.331046 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3635/7416] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:03 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:04.353629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6c088b1b-c623-4e19-a9ef-58772fecc902 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:04.354253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6c088b1b-c623-4e19-a9ef-58772fecc902 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:04.362197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c088b1b-c623-4e19-a9ef-58772fecc902 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:04.362704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c088b1b-c623-4e19-a9ef-58772fecc902 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:04.363145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c088b1b-c623-4e19-a9ef-58772fecc902 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:04.363836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c088b1b-c623-4e19-a9ef-58772fecc902 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:04.364295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c088b1b-c623-4e19-a9ef-58772fecc902 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:04.364729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6c088b1b-c623-4e19-a9ef-58772fecc902 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:04.496972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6c088b1b-c623-4e19-a9ef-58772fecc902 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:04.505227 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6c088b1b-c623-4e19-a9ef-58772fecc902 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1727 microversion: 2.1 time: 0.155561 Oct 27 19:44:04.505804 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3782/7417] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:04 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:05.529337 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a8523b7e-2163-4057-be7c-2464570989d7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:05.529974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a8523b7e-2163-4057-be7c-2464570989d7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:05.537276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8523b7e-2163-4057-be7c-2464570989d7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:05.537787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8523b7e-2163-4057-be7c-2464570989d7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:05.538247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8523b7e-2163-4057-be7c-2464570989d7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:05.539000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8523b7e-2163-4057-be7c-2464570989d7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:05.539480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8523b7e-2163-4057-be7c-2464570989d7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:05.539927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a8523b7e-2163-4057-be7c-2464570989d7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:05.673917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a8523b7e-2163-4057-be7c-2464570989d7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:05.682159 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a8523b7e-2163-4057-be7c-2464570989d7 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1727 microversion: 2.1 time: 0.156815 Oct 27 19:44:05.682768 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3636/7418] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:05 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:06.706069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d9721dc7-85f6-49e4-9b30-c609b85bbace tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:06.706730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d9721dc7-85f6-49e4-9b30-c609b85bbace tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:06.713442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d9721dc7-85f6-49e4-9b30-c609b85bbace tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:06.713926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d9721dc7-85f6-49e4-9b30-c609b85bbace tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:06.714365 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d9721dc7-85f6-49e4-9b30-c609b85bbace tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:06.715093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d9721dc7-85f6-49e4-9b30-c609b85bbace tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:06.715548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d9721dc7-85f6-49e4-9b30-c609b85bbace tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:06.715974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d9721dc7-85f6-49e4-9b30-c609b85bbace tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:06.850767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d9721dc7-85f6-49e4-9b30-c609b85bbace tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:06.859776 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d9721dc7-85f6-49e4-9b30-c609b85bbace tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1727 microversion: 2.1 time: 0.157736 Oct 27 19:44:06.860365 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3783/7419] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:06 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:07.883749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fd4d20c5-0389-431d-b3b8-2d70168b78c9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:07.884385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fd4d20c5-0389-431d-b3b8-2d70168b78c9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:07.891600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd4d20c5-0389-431d-b3b8-2d70168b78c9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:07.892108 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd4d20c5-0389-431d-b3b8-2d70168b78c9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:07.892566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd4d20c5-0389-431d-b3b8-2d70168b78c9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:07.893281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd4d20c5-0389-431d-b3b8-2d70168b78c9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:07.893755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd4d20c5-0389-431d-b3b8-2d70168b78c9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:07.894204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd4d20c5-0389-431d-b3b8-2d70168b78c9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:08.029305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd4d20c5-0389-431d-b3b8-2d70168b78c9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:08.037819 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fd4d20c5-0389-431d-b3b8-2d70168b78c9 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1724 microversion: 2.1 time: 0.158036 Oct 27 19:44:08.038428 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3637/7420] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:07 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:08.060451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:44:08.060990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:08.068752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:08.069243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:08.069685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:08.070378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:08.070927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:08.071356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:08.108907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:08.109380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:08.109816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:08.110569 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:08.111030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:08.111459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:08.131764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Getting quotas for project 612eaff9b8f24492b2c53c62e6be5aa0. Resources: {'cores', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:44:08.136903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Getting quotas for user c036fdc2fff644aa92e90481e04933c0 and project 612eaff9b8f24492b2c53c62e6be5aa0. Resources: {'cores', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:44:08.238958 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e2dfaa59-36cb-4768-bc54-c285b0a38126 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "POST /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6/action" status: 202 len: 0 microversion: 2.1 time: 0.182169 Oct 27 19:44:08.239706 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3784/7421] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:44:08 2022] POST /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:44:08.248096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2614f93b-b4f7-492a-a685-2ef3a10ce220 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:08.248731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2614f93b-b4f7-492a-a685-2ef3a10ce220 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:08.255341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2614f93b-b4f7-492a-a685-2ef3a10ce220 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:08.255965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2614f93b-b4f7-492a-a685-2ef3a10ce220 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:08.256407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2614f93b-b4f7-492a-a685-2ef3a10ce220 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:08.257113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2614f93b-b4f7-492a-a685-2ef3a10ce220 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:08.257589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2614f93b-b4f7-492a-a685-2ef3a10ce220 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:08.258035 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2614f93b-b4f7-492a-a685-2ef3a10ce220 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:08.688151 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2614f93b-b4f7-492a-a685-2ef3a10ce220 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:08.699838 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2614f93b-b4f7-492a-a685-2ef3a10ce220 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.455595 Oct 27 19:44:08.700461 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3638/7422] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:08 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:09.726586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-afb86a83-6cf4-4cc0-82fd-56c5a32d550b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:09.727296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-afb86a83-6cf4-4cc0-82fd-56c5a32d550b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:09.735403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-afb86a83-6cf4-4cc0-82fd-56c5a32d550b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:09.735890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-afb86a83-6cf4-4cc0-82fd-56c5a32d550b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:09.736331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-afb86a83-6cf4-4cc0-82fd-56c5a32d550b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:09.737020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-afb86a83-6cf4-4cc0-82fd-56c5a32d550b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:09.737480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-afb86a83-6cf4-4cc0-82fd-56c5a32d550b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:09.737909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-afb86a83-6cf4-4cc0-82fd-56c5a32d550b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:09.874363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-afb86a83-6cf4-4cc0-82fd-56c5a32d550b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:09.882759 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-afb86a83-6cf4-4cc0-82fd-56c5a32d550b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.161324 Oct 27 19:44:09.883338 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3785/7423] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:09 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:10.875851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-28782c66-79f3-4c17-8971-306f0bbff291 req-dd3d4b33-82f0-4c23-b0df-5a8c8325ec62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b51d183-74c7-48df-a8c2-3584dabd5ad6", "name": "network-vif-plugged", "status": "completed", "tag": "4530905d-f24a-4e71-8054-ec2d96d398a7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:44:10.885407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-28782c66-79f3-4c17-8971-306f0bbff291 req-dd3d4b33-82f0-4c23-b0df-5a8c8325ec62 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:10.885908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-28782c66-79f3-4c17-8971-306f0bbff291 req-dd3d4b33-82f0-4c23-b0df-5a8c8325ec62 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:10.886364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-28782c66-79f3-4c17-8971-306f0bbff291 req-dd3d4b33-82f0-4c23-b0df-5a8c8325ec62 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:10.898574 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-28782c66-79f3-4c17-8971-306f0bbff291 req-dd3d4b33-82f0-4c23-b0df-5a8c8325ec62 service nova] Creating event network-vif-plugged:4530905d-f24a-4e71-8054-ec2d96d398a7 for instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 on n-h2-860687-3 Oct 27 19:44:10.904022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-28782c66-79f3-4c17-8971-306f0bbff291 req-dd3d4b33-82f0-4c23-b0df-5a8c8325ec62 service nova] Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:44:10.907489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-556f1e44-5c27-4bba-8231-0da6ce03e510 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:10.908115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-556f1e44-5c27-4bba-8231-0da6ce03e510 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:10.916752 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-28782c66-79f3-4c17-8971-306f0bbff291 req-dd3d4b33-82f0-4c23-b0df-5a8c8325ec62 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095181 Oct 27 19:44:10.917630 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3639/7424] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:44:10.917981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-556f1e44-5c27-4bba-8231-0da6ce03e510 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:10.918509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-556f1e44-5c27-4bba-8231-0da6ce03e510 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:10.919042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-556f1e44-5c27-4bba-8231-0da6ce03e510 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:10.919746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-556f1e44-5c27-4bba-8231-0da6ce03e510 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:10.920211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-556f1e44-5c27-4bba-8231-0da6ce03e510 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:10.921369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-556f1e44-5c27-4bba-8231-0da6ce03e510 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:11.066030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-556f1e44-5c27-4bba-8231-0da6ce03e510 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:11.074265 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-556f1e44-5c27-4bba-8231-0da6ce03e510 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.171563 Oct 27 19:44:11.074877 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3786/7425] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:10 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:12.100310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d5a9913-7316-4f3d-b127-dca0a836dca0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:12.100958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0d5a9913-7316-4f3d-b127-dca0a836dca0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:12.107248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d5a9913-7316-4f3d-b127-dca0a836dca0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:12.107755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d5a9913-7316-4f3d-b127-dca0a836dca0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:12.108291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d5a9913-7316-4f3d-b127-dca0a836dca0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:12.109105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d5a9913-7316-4f3d-b127-dca0a836dca0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:12.109579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d5a9913-7316-4f3d-b127-dca0a836dca0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:12.110030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d5a9913-7316-4f3d-b127-dca0a836dca0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:12.247913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0d5a9913-7316-4f3d-b127-dca0a836dca0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:12.256409 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d5a9913-7316-4f3d-b127-dca0a836dca0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.161324 Oct 27 19:44:12.256991 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3640/7426] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:12 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:13.281341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0d8cf706-d90e-4a1b-84a7-e735445b0154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:13.281990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0d8cf706-d90e-4a1b-84a7-e735445b0154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:13.289023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d8cf706-d90e-4a1b-84a7-e735445b0154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:13.289521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d8cf706-d90e-4a1b-84a7-e735445b0154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:13.289973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d8cf706-d90e-4a1b-84a7-e735445b0154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:13.290709 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d8cf706-d90e-4a1b-84a7-e735445b0154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:13.291179 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d8cf706-d90e-4a1b-84a7-e735445b0154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:13.291612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0d8cf706-d90e-4a1b-84a7-e735445b0154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:13.464622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0d8cf706-d90e-4a1b-84a7-e735445b0154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:13.473595 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0d8cf706-d90e-4a1b-84a7-e735445b0154 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.196857 Oct 27 19:44:13.474107 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3787/7427] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:13 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:13.954273 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-8b51a06a-0565-4dc7-b536-4f466a36288a req-2eda3f87-ec92-4771-a0be-30c9993bccbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b51d183-74c7-48df-a8c2-3584dabd5ad6", "name": "network-vif-unplugged", "status": "completed", "tag": "4530905d-f24a-4e71-8054-ec2d96d398a7"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:44:13.969657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8b51a06a-0565-4dc7-b536-4f466a36288a req-2eda3f87-ec92-4771-a0be-30c9993bccbd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:13.970194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8b51a06a-0565-4dc7-b536-4f466a36288a req-2eda3f87-ec92-4771-a0be-30c9993bccbd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:13.970673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8b51a06a-0565-4dc7-b536-4f466a36288a req-2eda3f87-ec92-4771-a0be-30c9993bccbd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:13.982575 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-8b51a06a-0565-4dc7-b536-4f466a36288a req-2eda3f87-ec92-4771-a0be-30c9993bccbd service nova] Creating event network-vif-unplugged:4530905d-f24a-4e71-8054-ec2d96d398a7 for instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 on n-h1-860687-3 Oct 27 19:44:13.989026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-8b51a06a-0565-4dc7-b536-4f466a36288a req-2eda3f87-ec92-4771-a0be-30c9993bccbd service nova] Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:44:14.000871 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-8b51a06a-0565-4dc7-b536-4f466a36288a req-2eda3f87-ec92-4771-a0be-30c9993bccbd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102151 Oct 27 19:44:14.001419 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3641/7428] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:44:14.497448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-07aa8cb3-6690-4668-a2ba-511c9badf2da tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:14.498155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-07aa8cb3-6690-4668-a2ba-511c9badf2da tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:14.505314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07aa8cb3-6690-4668-a2ba-511c9badf2da tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:14.505732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07aa8cb3-6690-4668-a2ba-511c9badf2da tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:14.506180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07aa8cb3-6690-4668-a2ba-511c9badf2da tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:14.506915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07aa8cb3-6690-4668-a2ba-511c9badf2da tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:14.507380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07aa8cb3-6690-4668-a2ba-511c9badf2da tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:14.507813 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07aa8cb3-6690-4668-a2ba-511c9badf2da tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:14.706420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-07aa8cb3-6690-4668-a2ba-511c9badf2da tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:14.715434 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-07aa8cb3-6690-4668-a2ba-511c9badf2da tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.221853 Oct 27 19:44:14.716040 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3788/7429] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:14 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:15.741785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7837dcd0-d745-40e6-8a4e-7c9594672a39 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:15.742601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7837dcd0-d745-40e6-8a4e-7c9594672a39 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:15.749127 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7837dcd0-d745-40e6-8a4e-7c9594672a39 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:15.749635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7837dcd0-d745-40e6-8a4e-7c9594672a39 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:15.750119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7837dcd0-d745-40e6-8a4e-7c9594672a39 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:15.750855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7837dcd0-d745-40e6-8a4e-7c9594672a39 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:15.751332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7837dcd0-d745-40e6-8a4e-7c9594672a39 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:15.751784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7837dcd0-d745-40e6-8a4e-7c9594672a39 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:15.886942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7837dcd0-d745-40e6-8a4e-7c9594672a39 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:15.896594 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7837dcd0-d745-40e6-8a4e-7c9594672a39 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.160085 Oct 27 19:44:15.897421 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3642/7430] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:15 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:16.016873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-4c63b161-ed20-4ffe-9e05-57f11a850484 req-af46fdcd-bcb8-43e7-89bd-a48501225990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b51d183-74c7-48df-a8c2-3584dabd5ad6", "tag": "4530905d-f24a-4e71-8054-ec2d96d398a7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:44:16.028367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4c63b161-ed20-4ffe-9e05-57f11a850484 req-af46fdcd-bcb8-43e7-89bd-a48501225990 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:16.028987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4c63b161-ed20-4ffe-9e05-57f11a850484 req-af46fdcd-bcb8-43e7-89bd-a48501225990 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:16.029533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4c63b161-ed20-4ffe-9e05-57f11a850484 req-af46fdcd-bcb8-43e7-89bd-a48501225990 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:16.043393 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-4c63b161-ed20-4ffe-9e05-57f11a850484 req-af46fdcd-bcb8-43e7-89bd-a48501225990 service nova] Creating event network-changed:4530905d-f24a-4e71-8054-ec2d96d398a7 for instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 on n-h1-860687-3 Oct 27 19:44:16.049741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-4c63b161-ed20-4ffe-9e05-57f11a850484 req-af46fdcd-bcb8-43e7-89bd-a48501225990 service nova] Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 19:44:16.061349 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-4c63b161-ed20-4ffe-9e05-57f11a850484 req-af46fdcd-bcb8-43e7-89bd-a48501225990 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048717 Oct 27 19:44:16.061913 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3789/7431] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:44:16.920558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ff4c73a7-a5b6-4e1d-bb3e-f0fbe7d9ac68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:16.921182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ff4c73a7-a5b6-4e1d-bb3e-f0fbe7d9ac68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:16.928378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff4c73a7-a5b6-4e1d-bb3e-f0fbe7d9ac68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:16.928931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff4c73a7-a5b6-4e1d-bb3e-f0fbe7d9ac68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:16.929491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff4c73a7-a5b6-4e1d-bb3e-f0fbe7d9ac68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:16.930344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff4c73a7-a5b6-4e1d-bb3e-f0fbe7d9ac68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:16.930929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff4c73a7-a5b6-4e1d-bb3e-f0fbe7d9ac68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:16.931413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ff4c73a7-a5b6-4e1d-bb3e-f0fbe7d9ac68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:17.077370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ff4c73a7-a5b6-4e1d-bb3e-f0fbe7d9ac68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:17.086415 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ff4c73a7-a5b6-4e1d-bb3e-f0fbe7d9ac68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.169943 Oct 27 19:44:17.087016 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3643/7432] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:16 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:18.112327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-956e6c39-8f46-4365-97ef-e0085a335204 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:18.113104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-956e6c39-8f46-4365-97ef-e0085a335204 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:18.119462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-956e6c39-8f46-4365-97ef-e0085a335204 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:18.119963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-956e6c39-8f46-4365-97ef-e0085a335204 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:18.120412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-956e6c39-8f46-4365-97ef-e0085a335204 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:18.121114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-956e6c39-8f46-4365-97ef-e0085a335204 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:18.121580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-956e6c39-8f46-4365-97ef-e0085a335204 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:18.122021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-956e6c39-8f46-4365-97ef-e0085a335204 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:18.122575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:44:18.267266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-956e6c39-8f46-4365-97ef-e0085a335204 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:18.278223 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-956e6c39-8f46-4365-97ef-e0085a335204 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.171771 Oct 27 19:44:18.278850 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3790/7433] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:18 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:19.361540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c4f61fbd-71b4-4e2e-8bc0-b9aec86e51ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:19.362208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c4f61fbd-71b4-4e2e-8bc0-b9aec86e51ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:19.369381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4f61fbd-71b4-4e2e-8bc0-b9aec86e51ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:19.369897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4f61fbd-71b4-4e2e-8bc0-b9aec86e51ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:19.370360 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4f61fbd-71b4-4e2e-8bc0-b9aec86e51ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:19.371117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4f61fbd-71b4-4e2e-8bc0-b9aec86e51ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:19.371597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4f61fbd-71b4-4e2e-8bc0-b9aec86e51ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:19.372059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c4f61fbd-71b4-4e2e-8bc0-b9aec86e51ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:19.515693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c4f61fbd-71b4-4e2e-8bc0-b9aec86e51ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:19.524230 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c4f61fbd-71b4-4e2e-8bc0-b9aec86e51ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.167602 Oct 27 19:44:19.524816 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3644/7434] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:19 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:20.549764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-71da0154-959d-4559-81f6-10e0081e3b68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:20.550316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-71da0154-959d-4559-81f6-10e0081e3b68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:20.560421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71da0154-959d-4559-81f6-10e0081e3b68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:20.561669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71da0154-959d-4559-81f6-10e0081e3b68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:20.562265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71da0154-959d-4559-81f6-10e0081e3b68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:20.563159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71da0154-959d-4559-81f6-10e0081e3b68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:20.563705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71da0154-959d-4559-81f6-10e0081e3b68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:20.564206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71da0154-959d-4559-81f6-10e0081e3b68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:20.696624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-71da0154-959d-4559-81f6-10e0081e3b68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:20.704956 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-71da0154-959d-4559-81f6-10e0081e3b68 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.159831 Oct 27 19:44:20.705533 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3791/7435] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:20 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:21.728996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71538316-95f1-4369-976c-b4f8ce834829 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:21.729609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-71538316-95f1-4369-976c-b4f8ce834829 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:21.737276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71538316-95f1-4369-976c-b4f8ce834829 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:21.737786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71538316-95f1-4369-976c-b4f8ce834829 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:21.738251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71538316-95f1-4369-976c-b4f8ce834829 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:21.738999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71538316-95f1-4369-976c-b4f8ce834829 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:21.739481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71538316-95f1-4369-976c-b4f8ce834829 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:21.739934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71538316-95f1-4369-976c-b4f8ce834829 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:21.875528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-71538316-95f1-4369-976c-b4f8ce834829 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:21.883990 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-71538316-95f1-4369-976c-b4f8ce834829 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.159597 Oct 27 19:44:21.884792 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3645/7436] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:21 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:22.912487 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3dd511c5-982c-4fd9-aa61-8ad6abaa5bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:22.913136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3dd511c5-982c-4fd9-aa61-8ad6abaa5bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:22.915351 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 19:44:22.915487 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 19:44:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 (ip 10.222.0.42) !!! Oct 27 19:44:22.925094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dd511c5-982c-4fd9-aa61-8ad6abaa5bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:22.925588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dd511c5-982c-4fd9-aa61-8ad6abaa5bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:22.926036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dd511c5-982c-4fd9-aa61-8ad6abaa5bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:22.926773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dd511c5-982c-4fd9-aa61-8ad6abaa5bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:22.927241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dd511c5-982c-4fd9-aa61-8ad6abaa5bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:22.927685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3dd511c5-982c-4fd9-aa61-8ad6abaa5bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:23.063393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3dd511c5-982c-4fd9-aa61-8ad6abaa5bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:23.071916 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3dd511c5-982c-4fd9-aa61-8ad6abaa5bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.163427 Oct 27 19:44:23.072497 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3792/7437] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:22 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:24.095486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c208f54e-e997-4a14-9b82-3ebdb40fca92 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:24.096113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c208f54e-e997-4a14-9b82-3ebdb40fca92 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:24.103402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c208f54e-e997-4a14-9b82-3ebdb40fca92 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:24.103916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c208f54e-e997-4a14-9b82-3ebdb40fca92 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:24.104380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c208f54e-e997-4a14-9b82-3ebdb40fca92 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:24.105107 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c208f54e-e997-4a14-9b82-3ebdb40fca92 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:24.105589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c208f54e-e997-4a14-9b82-3ebdb40fca92 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:24.106046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c208f54e-e997-4a14-9b82-3ebdb40fca92 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:24.244373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c208f54e-e997-4a14-9b82-3ebdb40fca92 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:24.253773 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c208f54e-e997-4a14-9b82-3ebdb40fca92 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.162588 Oct 27 19:44:24.266423 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3646/7438] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:24 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:25.278454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3c7a40b4-4b71-4c1a-bced-efa9266ccea8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:25.279069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3c7a40b4-4b71-4c1a-bced-efa9266ccea8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:25.286593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c7a40b4-4b71-4c1a-bced-efa9266ccea8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:25.287132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c7a40b4-4b71-4c1a-bced-efa9266ccea8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:25.287595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c7a40b4-4b71-4c1a-bced-efa9266ccea8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:25.288327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c7a40b4-4b71-4c1a-bced-efa9266ccea8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:25.288815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c7a40b4-4b71-4c1a-bced-efa9266ccea8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:25.289271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3c7a40b4-4b71-4c1a-bced-efa9266ccea8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:25.419689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3c7a40b4-4b71-4c1a-bced-efa9266ccea8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:25.428253 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3c7a40b4-4b71-4c1a-bced-efa9266ccea8 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.153788 Oct 27 19:44:25.428836 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3793/7439] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:25 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:26.454197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5da2f1a9-efd6-4be0-9dd8-e0026e3d31d6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:26.454884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5da2f1a9-efd6-4be0-9dd8-e0026e3d31d6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:26.461881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5da2f1a9-efd6-4be0-9dd8-e0026e3d31d6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:26.462409 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5da2f1a9-efd6-4be0-9dd8-e0026e3d31d6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:26.462874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5da2f1a9-efd6-4be0-9dd8-e0026e3d31d6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:26.463585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5da2f1a9-efd6-4be0-9dd8-e0026e3d31d6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:26.464069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5da2f1a9-efd6-4be0-9dd8-e0026e3d31d6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:26.464500 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5da2f1a9-efd6-4be0-9dd8-e0026e3d31d6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:26.599883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5da2f1a9-efd6-4be0-9dd8-e0026e3d31d6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:26.609343 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5da2f1a9-efd6-4be0-9dd8-e0026e3d31d6 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1723 microversion: 2.1 time: 0.159604 Oct 27 19:44:26.609959 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3647/7440] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:26 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:27.635382 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-503b6e29-aab0-4c0f-857b-de4c25037045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:27.635999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-503b6e29-aab0-4c0f-857b-de4c25037045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:27.643388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-503b6e29-aab0-4c0f-857b-de4c25037045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:27.643898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-503b6e29-aab0-4c0f-857b-de4c25037045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:27.644335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-503b6e29-aab0-4c0f-857b-de4c25037045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:27.645028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-503b6e29-aab0-4c0f-857b-de4c25037045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:27.645491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-503b6e29-aab0-4c0f-857b-de4c25037045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:27.645919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-503b6e29-aab0-4c0f-857b-de4c25037045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:27.780307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-503b6e29-aab0-4c0f-857b-de4c25037045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:27.789306 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-503b6e29-aab0-4c0f-857b-de4c25037045 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1716 microversion: 2.1 time: 0.158226 Oct 27 19:44:27.789959 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3794/7441] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:27 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:27.813579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-accd015a-21d8-49e1-b0cc-07c97783f9b2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:27.814217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-accd015a-21d8-49e1-b0cc-07c97783f9b2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:27.823498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-accd015a-21d8-49e1-b0cc-07c97783f9b2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:27.824005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-accd015a-21d8-49e1-b0cc-07c97783f9b2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:27.824474 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-accd015a-21d8-49e1-b0cc-07c97783f9b2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:27.825186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-accd015a-21d8-49e1-b0cc-07c97783f9b2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:27.825665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-accd015a-21d8-49e1-b0cc-07c97783f9b2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:27.826116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-accd015a-21d8-49e1-b0cc-07c97783f9b2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:27.970221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-accd015a-21d8-49e1-b0cc-07c97783f9b2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:27.978670 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-accd015a-21d8-49e1-b0cc-07c97783f9b2 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1716 microversion: 2.1 time: 0.169746 Oct 27 19:44:27.979250 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3648/7442] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:27 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:28.000925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-059bc92c-7166-4669-a5c6-e23c01918bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:28.001535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-059bc92c-7166-4669-a5c6-e23c01918bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:28.007651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-059bc92c-7166-4669-a5c6-e23c01918bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:28.008133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-059bc92c-7166-4669-a5c6-e23c01918bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:28.008571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-059bc92c-7166-4669-a5c6-e23c01918bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:28.009287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-059bc92c-7166-4669-a5c6-e23c01918bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:28.009744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-059bc92c-7166-4669-a5c6-e23c01918bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:28.010176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-059bc92c-7166-4669-a5c6-e23c01918bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:28.014932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:44:28.150262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-059bc92c-7166-4669-a5c6-e23c01918bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:28.160265 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-059bc92c-7166-4669-a5c6-e23c01918bce tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1716 microversion: 2.1 time: 0.163116 Oct 27 19:44:28.160833 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3795/7443] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:27 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:28.191987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e3b094db-48b8-4287-ba1d-0ed03b8eb372 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:28.192576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e3b094db-48b8-4287-ba1d-0ed03b8eb372 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:28.198903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3b094db-48b8-4287-ba1d-0ed03b8eb372 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:28.199440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3b094db-48b8-4287-ba1d-0ed03b8eb372 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:28.199919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3b094db-48b8-4287-ba1d-0ed03b8eb372 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:28.200688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3b094db-48b8-4287-ba1d-0ed03b8eb372 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:28.201185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3b094db-48b8-4287-ba1d-0ed03b8eb372 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:28.203050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e3b094db-48b8-4287-ba1d-0ed03b8eb372 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:28.229610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e3b094db-48b8-4287-ba1d-0ed03b8eb372 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:44:28.315110 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e3b094db-48b8-4287-ba1d-0ed03b8eb372 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 204 len: 0 microversion: 2.1 time: 0.128502 Oct 27 19:44:28.316371 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3649/7444] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:44:28 2022] DELETE /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 19:44:28.325530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de0a8716-bd6d-4e0f-8fc4-9eac304d829e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:28.326270 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-de0a8716-bd6d-4e0f-8fc4-9eac304d829e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:28.332739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de0a8716-bd6d-4e0f-8fc4-9eac304d829e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:28.333228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de0a8716-bd6d-4e0f-8fc4-9eac304d829e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:28.333668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de0a8716-bd6d-4e0f-8fc4-9eac304d829e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:28.334364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de0a8716-bd6d-4e0f-8fc4-9eac304d829e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:28.334863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de0a8716-bd6d-4e0f-8fc4-9eac304d829e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:28.335292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de0a8716-bd6d-4e0f-8fc4-9eac304d829e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:28.465544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-de0a8716-bd6d-4e0f-8fc4-9eac304d829e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:28.474341 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-de0a8716-bd6d-4e0f-8fc4-9eac304d829e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1722 microversion: 2.1 time: 0.153604 Oct 27 19:44:28.474955 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3796/7445] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:28 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:29.501585 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-74e56e1c-0611-4ab0-9b6d-d56efe364b3c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:29.502316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-74e56e1c-0611-4ab0-9b6d-d56efe364b3c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:29.509566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74e56e1c-0611-4ab0-9b6d-d56efe364b3c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:29.510143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74e56e1c-0611-4ab0-9b6d-d56efe364b3c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:29.510746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74e56e1c-0611-4ab0-9b6d-d56efe364b3c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:29.511527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74e56e1c-0611-4ab0-9b6d-d56efe364b3c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:29.512034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74e56e1c-0611-4ab0-9b6d-d56efe364b3c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:29.512535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74e56e1c-0611-4ab0-9b6d-d56efe364b3c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:29.515520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:44:29.648085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-74e56e1c-0611-4ab0-9b6d-d56efe364b3c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:29.657209 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-74e56e1c-0611-4ab0-9b6d-d56efe364b3c tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1722 microversion: 2.1 time: 0.160771 Oct 27 19:44:29.657825 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3650/7446] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:29 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:30.464667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a88e69c5-0fdd-4536-a123-e4cd77f3c11d req-17a8b457-9b6c-4409-881b-b254d74e5ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b51d183-74c7-48df-a8c2-3584dabd5ad6", "name": "network-vif-plugged", "status": "completed", "tag": "4530905d-f24a-4e71-8054-ec2d96d398a7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:44:30.479953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a88e69c5-0fdd-4536-a123-e4cd77f3c11d req-17a8b457-9b6c-4409-881b-b254d74e5ed1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:30.480477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a88e69c5-0fdd-4536-a123-e4cd77f3c11d req-17a8b457-9b6c-4409-881b-b254d74e5ed1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:30.480948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a88e69c5-0fdd-4536-a123-e4cd77f3c11d req-17a8b457-9b6c-4409-881b-b254d74e5ed1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:30.495102 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a88e69c5-0fdd-4536-a123-e4cd77f3c11d req-17a8b457-9b6c-4409-881b-b254d74e5ed1 service nova] Creating event network-vif-plugged:4530905d-f24a-4e71-8054-ec2d96d398a7 for instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 on n-h1-860687-3 Oct 27 19:44:30.501637 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a88e69c5-0fdd-4536-a123-e4cd77f3c11d req-17a8b457-9b6c-4409-881b-b254d74e5ed1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041095 Oct 27 19:44:30.502443 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3797/7447] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:44:30.681502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-31bb8649-63e6-4e2d-bbaa-6b49387640f0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:30.682282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-31bb8649-63e6-4e2d-bbaa-6b49387640f0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:30.690068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31bb8649-63e6-4e2d-bbaa-6b49387640f0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:30.691008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31bb8649-63e6-4e2d-bbaa-6b49387640f0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:30.691579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31bb8649-63e6-4e2d-bbaa-6b49387640f0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:30.692480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31bb8649-63e6-4e2d-bbaa-6b49387640f0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:30.693051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31bb8649-63e6-4e2d-bbaa-6b49387640f0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:30.693594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31bb8649-63e6-4e2d-bbaa-6b49387640f0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:30.765385 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-31bb8649-63e6-4e2d-bbaa-6b49387640f0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:30.773989 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-31bb8649-63e6-4e2d-bbaa-6b49387640f0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1654 microversion: 2.1 time: 0.096489 Oct 27 19:44:30.774882 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3651/7448] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:30 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1654 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:31.219922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a05d553f-f0a7-4a32-8ff4-5c57e1c85ce5 req-c268a182-70f6-42f5-97d9-cee84117d4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b51d183-74c7-48df-a8c2-3584dabd5ad6", "name": "network-vif-deleted", "tag": "4530905d-f24a-4e71-8054-ec2d96d398a7"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:44:31.240605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a05d553f-f0a7-4a32-8ff4-5c57e1c85ce5 req-c268a182-70f6-42f5-97d9-cee84117d4d9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:31.241207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a05d553f-f0a7-4a32-8ff4-5c57e1c85ce5 req-c268a182-70f6-42f5-97d9-cee84117d4d9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:31.242299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a05d553f-f0a7-4a32-8ff4-5c57e1c85ce5 req-c268a182-70f6-42f5-97d9-cee84117d4d9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:31.258405 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a05d553f-f0a7-4a32-8ff4-5c57e1c85ce5 req-c268a182-70f6-42f5-97d9-cee84117d4d9 service nova] Creating event network-vif-deleted:4530905d-f24a-4e71-8054-ec2d96d398a7 for instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 on n-h1-860687-3 Oct 27 19:44:31.263624 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a05d553f-f0a7-4a32-8ff4-5c57e1c85ce5 req-c268a182-70f6-42f5-97d9-cee84117d4d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048545 Oct 27 19:44:31.265100 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3798/7449] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:44:31.799130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d05e88c-4780-4318-a54b-a7f5d11836bc tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:31.799773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0d05e88c-4780-4318-a54b-a7f5d11836bc tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:31.802838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:44:31.809749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d05e88c-4780-4318-a54b-a7f5d11836bc tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:31.810294 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d05e88c-4780-4318-a54b-a7f5d11836bc tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:31.810960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d05e88c-4780-4318-a54b-a7f5d11836bc tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:31.811767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d05e88c-4780-4318-a54b-a7f5d11836bc tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:31.812251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d05e88c-4780-4318-a54b-a7f5d11836bc tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:31.812754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d05e88c-4780-4318-a54b-a7f5d11836bc tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:31.894138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0d05e88c-4780-4318-a54b-a7f5d11836bc tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:31.903619 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d05e88c-4780-4318-a54b-a7f5d11836bc tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1369 microversion: 2.1 time: 0.108668 Oct 27 19:44:31.904304 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3652/7450] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:31 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:32.928702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-07534f1d-15ec-492c-99e0-1d1bec82112e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:32.929556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-07534f1d-15ec-492c-99e0-1d1bec82112e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:32.932181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:44:32.943175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07534f1d-15ec-492c-99e0-1d1bec82112e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:32.944025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07534f1d-15ec-492c-99e0-1d1bec82112e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:32.944497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07534f1d-15ec-492c-99e0-1d1bec82112e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:32.945219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07534f1d-15ec-492c-99e0-1d1bec82112e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:32.945708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07534f1d-15ec-492c-99e0-1d1bec82112e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:32.946138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07534f1d-15ec-492c-99e0-1d1bec82112e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:33.018258 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-07534f1d-15ec-492c-99e0-1d1bec82112e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:33.027244 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-07534f1d-15ec-492c-99e0-1d1bec82112e tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1369 microversion: 2.1 time: 0.104095 Oct 27 19:44:33.027830 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3799/7451] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:32 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:34.051562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-808d6fc7-b1de-4e14-a6ce-5c16809a2e2b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:34.052752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-808d6fc7-b1de-4e14-a6ce-5c16809a2e2b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:34.059978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-808d6fc7-b1de-4e14-a6ce-5c16809a2e2b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:34.060480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-808d6fc7-b1de-4e14-a6ce-5c16809a2e2b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:34.061779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-808d6fc7-b1de-4e14-a6ce-5c16809a2e2b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:34.062331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-808d6fc7-b1de-4e14-a6ce-5c16809a2e2b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:34.062858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-808d6fc7-b1de-4e14-a6ce-5c16809a2e2b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:34.063305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-808d6fc7-b1de-4e14-a6ce-5c16809a2e2b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:34.127359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-808d6fc7-b1de-4e14-a6ce-5c16809a2e2b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:34.136168 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-808d6fc7-b1de-4e14-a6ce-5c16809a2e2b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1369 microversion: 2.1 time: 0.088818 Oct 27 19:44:34.136785 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3653/7452] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:34 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:35.159910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c10a2635-4449-4063-85e3-f81fa0f184d0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:35.160539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c10a2635-4449-4063-85e3-f81fa0f184d0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:35.167546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c10a2635-4449-4063-85e3-f81fa0f184d0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:35.168075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c10a2635-4449-4063-85e3-f81fa0f184d0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:35.168541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c10a2635-4449-4063-85e3-f81fa0f184d0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:35.169319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c10a2635-4449-4063-85e3-f81fa0f184d0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:35.169822 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c10a2635-4449-4063-85e3-f81fa0f184d0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:35.170325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c10a2635-4449-4063-85e3-f81fa0f184d0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:35.235102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c10a2635-4449-4063-85e3-f81fa0f184d0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036fdc2fff644aa92e90481e04933c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612eaff9b8f24492b2c53c62e6be5aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:35.243813 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c10a2635-4449-4063-85e3-f81fa0f184d0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 200 len: 1369 microversion: 2.1 time: 0.087820 Oct 27 19:44:35.244420 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3800/7453] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:35 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:44:36.267605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e14d1b6a-d23a-40c1-a5d6-1e995b9222c0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:36.268242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e14d1b6a-d23a-40c1-a5d6-1e995b9222c0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:36.275184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e14d1b6a-d23a-40c1-a5d6-1e995b9222c0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:36.275692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e14d1b6a-d23a-40c1-a5d6-1e995b9222c0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:36.276154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e14d1b6a-d23a-40c1-a5d6-1e995b9222c0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:36.276871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e14d1b6a-d23a-40c1-a5d6-1e995b9222c0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:36.277353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e14d1b6a-d23a-40c1-a5d6-1e995b9222c0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:36.277806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e14d1b6a-d23a-40c1-a5d6-1e995b9222c0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:36.292727 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-e14d1b6a-d23a-40c1-a5d6-1e995b9222c0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e14d1b6a-d23a-40c1-a5d6-1e995b9222c0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 HTTP/1.1 Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '7b51d183-74c7-48df-a8c2-3584dabd5ad6'} Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:36.294521 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:36.300376 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:36.300376 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:36.300376 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:36.300376 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:44:36.300376 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:44:36.300376 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:36.300376 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:36.300376 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e14d1b6a-d23a-40c1-a5d6-1e995b9222c0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:44:36.300376 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e14d1b6a-d23a-40c1-a5d6-1e995b9222c0 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 404 len: 111 microversion: 2.1 time: 0.032995 Oct 27 19:44:36.300376 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3654/7454] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:36 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:44:36.356697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de8ae74c-d574-4395-aa35-255212e7d9b5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:36.359726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-de8ae74c-d574-4395-aa35-255212e7d9b5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:36.366605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de8ae74c-d574-4395-aa35-255212e7d9b5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:36.367092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de8ae74c-d574-4395-aa35-255212e7d9b5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:36.367534 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de8ae74c-d574-4395-aa35-255212e7d9b5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:36.368225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de8ae74c-d574-4395-aa35-255212e7d9b5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:36.368685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de8ae74c-d574-4395-aa35-255212e7d9b5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:36.369115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-de8ae74c-d574-4395-aa35-255212e7d9b5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:36.382564 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-de8ae74c-d574-4395-aa35-255212e7d9b5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de8ae74c-d574-4395-aa35-255212e7d9b5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6/os-volume_attachments HTTP/1.1 Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'server_id': '7b51d183-74c7-48df-a8c2-3584dabd5ad6'} Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:44:36.384254 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:44:36.389155 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:36.389155 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:36.389155 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:36.389155 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:36.389155 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:36.389155 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:36.389155 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:36.389155 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:44:36.389155 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:44:36.389155 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:36.389155 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:36.389155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-de8ae74c-d574-4395-aa35-255212e7d9b5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:44:36.389155 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-de8ae74c-d574-4395-aa35-255212e7d9b5 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032975 Oct 27 19:44:36.389155 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3801/7455] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:44:36 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:44:39.715014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d5f68012-c2b4-4c31-b5af-e264bf4e068b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:39.715551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d5f68012-c2b4-4c31-b5af-e264bf4e068b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:39.723393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5f68012-c2b4-4c31-b5af-e264bf4e068b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.723902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5f68012-c2b4-4c31-b5af-e264bf4e068b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.724368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5f68012-c2b4-4c31-b5af-e264bf4e068b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.725089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5f68012-c2b4-4c31-b5af-e264bf4e068b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.725570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5f68012-c2b4-4c31-b5af-e264bf4e068b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.726020 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5f68012-c2b4-4c31-b5af-e264bf4e068b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.740415 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d5f68012-c2b4-4c31-b5af-e264bf4e068b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d5f68012-c2b4-4c31-b5af-e264bf4e068b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 HTTP/1.1 Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '7b51d183-74c7-48df-a8c2-3584dabd5ad6'} Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:44:39.741995 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:44:39.745973 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:39.745973 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.745973 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:39.745973 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.745973 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.745973 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:39.745973 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:39.745973 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:44:39.745973 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:44:39.745973 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:39.745973 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.745973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d5f68012-c2b4-4c31-b5af-e264bf4e068b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:44:39.745973 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d5f68012-c2b4-4c31-b5af-e264bf4e068b tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 404 len: 111 microversion: 2.1 time: 0.032481 Oct 27 19:44:39.745973 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3655/7456] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:44:39 2022] DELETE /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:44:39.752184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c3ac25fc-4eab-4b6f-8232-7c39d3c4f394 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:39.752810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c3ac25fc-4eab-4b6f-8232-7c39d3c4f394 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 7b51d183-74c7-48df-a8c2-3584dabd5ad6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:39.759823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3ac25fc-4eab-4b6f-8232-7c39d3c4f394 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.760309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3ac25fc-4eab-4b6f-8232-7c39d3c4f394 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.760756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3ac25fc-4eab-4b6f-8232-7c39d3c4f394 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.761455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3ac25fc-4eab-4b6f-8232-7c39d3c4f394 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.761918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3ac25fc-4eab-4b6f-8232-7c39d3c4f394 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.762353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c3ac25fc-4eab-4b6f-8232-7c39d3c4f394 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.776480 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-c3ac25fc-4eab-4b6f-8232-7c39d3c4f394 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c3ac25fc-4eab-4b6f-8232-7c39d3c4f394 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 HTTP/1.1 Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '7b51d183-74c7-48df-a8c2-3584dabd5ad6'} Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:39.778056 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.783843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.783843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:39.783843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:39.783843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:44:39.783843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:44:39.783843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. Oct 27 19:44:39.783843 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.783843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c3ac25fc-4eab-4b6f-8232-7c39d3c4f394 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance 7b51d183-74c7-48df-a8c2-3584dabd5ad6 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:44:39.783843 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c3ac25fc-4eab-4b6f-8232-7c39d3c4f394 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6" status: 404 len: 111 microversion: 2.1 time: 0.031287 Oct 27 19:44:39.783843 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3802/7457] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:39 2022] GET /compute/v2.1/servers/7b51d183-74c7-48df-a8c2-3584dabd5ad6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:44:39.788658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-90add3c5-790d-4d85-941f-2c41e95f3ab3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:39.789359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-90add3c5-790d-4d85-941f-2c41e95f3ab3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:39.795530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90add3c5-790d-4d85-941f-2c41e95f3ab3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.796057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90add3c5-790d-4d85-941f-2c41e95f3ab3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.796513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90add3c5-790d-4d85-941f-2c41e95f3ab3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.797301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90add3c5-790d-4d85-941f-2c41e95f3ab3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.797787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90add3c5-790d-4d85-941f-2c41e95f3ab3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.798284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90add3c5-790d-4d85-941f-2c41e95f3ab3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.813367 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-90add3c5-790d-4d85-941f-2c41e95f3ab3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-90add3c5-790d-4d85-941f-2c41e95f3ab3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc HTTP/1.1 Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '23934ebc-aaa0-47f9-8aaf-733d0fb83bdc'} Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:44:39.815080 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:44:39.822994 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:44:39.822994 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.822994 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:39.822994 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.822994 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.822994 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:39.822994 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:39.822994 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:44:39.822994 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:44:39.822994 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:44:39.822994 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.822994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-90add3c5-790d-4d85-941f-2c41e95f3ab3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:44:39.822994 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-90add3c5-790d-4d85-941f-2c41e95f3ab3 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "DELETE /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 404 len: 111 microversion: 2.1 time: 0.032115 Oct 27 19:44:39.822994 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3656/7458] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:44:39 2022] DELETE /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:44:39.826988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cfe16279-c12f-4747-9d1b-7910235ce642 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:39.828255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cfe16279-c12f-4747-9d1b-7910235ce642 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:39.834874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cfe16279-c12f-4747-9d1b-7910235ce642 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.835286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cfe16279-c12f-4747-9d1b-7910235ce642 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.835727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cfe16279-c12f-4747-9d1b-7910235ce642 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.836438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cfe16279-c12f-4747-9d1b-7910235ce642 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.836896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cfe16279-c12f-4747-9d1b-7910235ce642 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.837327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cfe16279-c12f-4747-9d1b-7910235ce642 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.852724 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-cfe16279-c12f-4747-9d1b-7910235ce642 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cfe16279-c12f-4747-9d1b-7910235ce642 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc HTTP/1.1 Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '23934ebc-aaa0-47f9-8aaf-733d0fb83bdc'} Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:39.854298 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.859883 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.859883 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:39.859883 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:39.859883 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:44:39.859883 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:44:39.859883 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. Oct 27 19:44:39.859883 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.859883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cfe16279-c12f-4747-9d1b-7910235ce642 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance 23934ebc-aaa0-47f9-8aaf-733d0fb83bdc could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:44:39.859883 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cfe16279-c12f-4747-9d1b-7910235ce642 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc" status: 404 len: 111 microversion: 2.1 time: 0.034105 Oct 27 19:44:39.859883 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3803/7459] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:39 2022] GET /compute/v2.1/servers/23934ebc-aaa0-47f9-8aaf-733d0fb83bdc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:44:39.864860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb41db8d-61bb-4a69-91df-f55d8fb1f8ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:39.865386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb41db8d-61bb-4a69-91df-f55d8fb1f8ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:39.872095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb41db8d-61bb-4a69-91df-f55d8fb1f8ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.872605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb41db8d-61bb-4a69-91df-f55d8fb1f8ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.873105 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb41db8d-61bb-4a69-91df-f55d8fb1f8ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.874553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb41db8d-61bb-4a69-91df-f55d8fb1f8ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.875039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb41db8d-61bb-4a69-91df-f55d8fb1f8ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.875492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb41db8d-61bb-4a69-91df-f55d8fb1f8ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.891638 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-eb41db8d-61bb-4a69-91df-f55d8fb1f8ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb41db8d-61bb-4a69-91df-f55d8fb1f8ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 HTTP/1.1 Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'b1baf440-dcba-4ffe-952f-2b8a30696126'} Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:44:39.893330 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:44:39.899071 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:44:39.899071 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.899071 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:39.899071 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.899071 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.899071 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:39.899071 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:39.899071 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:44:39.899071 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:44:39.899071 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:44:39.899071 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.899071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb41db8d-61bb-4a69-91df-f55d8fb1f8ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:44:39.899071 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb41db8d-61bb-4a69-91df-f55d8fb1f8ad tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 404 len: 111 microversion: 2.1 time: 0.034038 Oct 27 19:44:39.899071 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3657/7460] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:44:39 2022] DELETE /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:44:39.903713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d2106fe2-1078-456c-ac3a-e2fd47c1d225 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:39.904998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d2106fe2-1078-456c-ac3a-e2fd47c1d225 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: b1baf440-dcba-4ffe-952f-2b8a30696126] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:39.911511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2106fe2-1078-456c-ac3a-e2fd47c1d225 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.912059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2106fe2-1078-456c-ac3a-e2fd47c1d225 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.912461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2106fe2-1078-456c-ac3a-e2fd47c1d225 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.913176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2106fe2-1078-456c-ac3a-e2fd47c1d225 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.913671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2106fe2-1078-456c-ac3a-e2fd47c1d225 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.914139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d2106fe2-1078-456c-ac3a-e2fd47c1d225 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.930527 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-d2106fe2-1078-456c-ac3a-e2fd47c1d225 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d2106fe2-1078-456c-ac3a-e2fd47c1d225 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 HTTP/1.1 Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'b1baf440-dcba-4ffe-952f-2b8a30696126'} Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:39.932186 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.937789 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.937789 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:39.937789 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:39.937789 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:44:39.937789 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:44:39.937789 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. Oct 27 19:44:39.937789 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.937789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d2106fe2-1078-456c-ac3a-e2fd47c1d225 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance b1baf440-dcba-4ffe-952f-2b8a30696126 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:44:39.937789 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d2106fe2-1078-456c-ac3a-e2fd47c1d225 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126" status: 404 len: 111 microversion: 2.1 time: 0.033882 Oct 27 19:44:39.937789 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3804/7461] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:39 2022] GET /compute/v2.1/servers/b1baf440-dcba-4ffe-952f-2b8a30696126 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:44:39.943307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d93573be-c479-4bdb-8654-0e2071f1434f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:39.943881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d93573be-c479-4bdb-8654-0e2071f1434f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:39.949998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d93573be-c479-4bdb-8654-0e2071f1434f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.950540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d93573be-c479-4bdb-8654-0e2071f1434f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.951005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d93573be-c479-4bdb-8654-0e2071f1434f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.952235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d93573be-c479-4bdb-8654-0e2071f1434f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.952717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d93573be-c479-4bdb-8654-0e2071f1434f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.953168 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d93573be-c479-4bdb-8654-0e2071f1434f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.967704 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d93573be-c479-4bdb-8654-0e2071f1434f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d93573be-c479-4bdb-8654-0e2071f1434f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 HTTP/1.1 Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'ef07c0f8-ec33-44bd-94b1-f17aeec8f073'} Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:44:39.969289 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:44:39.974876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:44:39.974876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.974876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:39.974876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.974876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:39.974876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:39.974876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:39.974876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:44:39.974876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:44:39.974876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:44:39.974876 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:44:39.974876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d93573be-c479-4bdb-8654-0e2071f1434f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:44:39.974876 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d93573be-c479-4bdb-8654-0e2071f1434f tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 404 len: 111 microversion: 2.1 time: 0.031729 Oct 27 19:44:39.974876 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3658/7462] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:44:39 2022] DELETE /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:44:39.979238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7f3d59fc-a513-491b-9cc1-b2be13ee0b79 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:39.979861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7f3d59fc-a513-491b-9cc1-b2be13ee0b79 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] [instance: ef07c0f8-ec33-44bd-94b1-f17aeec8f073] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:39.986058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f3d59fc-a513-491b-9cc1-b2be13ee0b79 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.986572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f3d59fc-a513-491b-9cc1-b2be13ee0b79 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.987012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f3d59fc-a513-491b-9cc1-b2be13ee0b79 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:39.987713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f3d59fc-a513-491b-9cc1-b2be13ee0b79 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:39.988174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f3d59fc-a513-491b-9cc1-b2be13ee0b79 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:39.988610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7f3d59fc-a513-491b-9cc1-b2be13ee0b79 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:40.002469 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-7f3d59fc-a513-491b-9cc1-b2be13ee0b79 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] HTTP exception thrown: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7f3d59fc-a513-491b-9cc1-b2be13ee0b79 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Request method failure captured: Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 HTTP/1.1 Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt4njraRSBN_Z5dgnaVpLCugRc4X3o0qqwuZD9cZ5IXgYnc9IZ7rzykqyPxe1O7kazy1CopHqVYMP5BP83tzMZ3LbXIPJ8a3bmsuyJ0lZCze5GFZNIzQAmVqqClIvUbDk29E263x3cP8gyW59i4KmeG8mCF8rBB3pvRdhIGZe9Hm8Wo Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_612eaff9b8f24492b2c53c62e6be5aa0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/612eaff9b8f24492b2c53c62e6be5aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 612eaff9b8f24492b2c53c62e6be5aa0 Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServerActionsTestJSON-539665216 Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: c036fdc2fff644aa92e90481e04933c0 Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServerActionsTestJSON-539665216-project Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'ef07c0f8-ec33-44bd-94b1-f17aeec8f073'} Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:44:40.004083 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:40.009530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:44:40.009530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:44:40.009530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:44:40.009530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:44:40.009530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:44:40.009530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. Oct 27 19:44:40.009530 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:44:40.009530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7f3d59fc-a513-491b-9cc1-b2be13ee0b79 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Returning 404 to user: Instance ef07c0f8-ec33-44bd-94b1-f17aeec8f073 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:44:40.009530 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7f3d59fc-a513-491b-9cc1-b2be13ee0b79 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073" status: 404 len: 111 microversion: 2.1 time: 0.030116 Oct 27 19:44:40.009530 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3805/7463] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:39 2022] GET /compute/v2.1/servers/ef07c0f8-ec33-44bd-94b1-f17aeec8f073 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:44:40.015677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3e187037-8ac3-4271-86f6-37caf876ee59 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] Calling method '.version_select at 0x7fc8687cb940>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:40.039003 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3e187037-8ac3-4271-86f6-37caf876ee59 tempest-ServerActionsTestJSON-539665216 tempest-ServerActionsTestJSON-539665216-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116444884" status: 202 len: 0 microversion: 2.1 time: 0.027601 Oct 27 19:44:40.039598 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3659/7464] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 19:44:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116444884 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:44:49.396471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1317774751", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "749c076d-89ab-481e-a97f-f3f8f94d3488"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:44:49.455097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] validate_networks() for [('749c076d-89ab-481e-a97f-f3f8f94d3488', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:44:49.974712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:44:49.975149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:44:49.975643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:44:49.976066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:44:49.976490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:44:49.989353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:49.989939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:49.990553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:49.991374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:49.991909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:49.992410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:49.995213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=37 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:44:50.016193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Getting quotas for project 644f660823684a01a3eefd7bb0f9dfc0. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:44:50.021953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Getting quotas for user b3346a44186e40dd954f245bb08d3f6c and project 644f660823684a01a3eefd7bb0f9dfc0. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:44:50.036371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:44:50.038795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:44:50.088435 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3f55620a-d28e-4560-b2f0-052ee707b81b tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816454 Oct 27 19:44:50.096384 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3806/7465] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:44:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:44:50.099724 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=33 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:44:50.100708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:44:50.104780 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3c4c6f89-d64d-4d8c-9e66-7283379b876d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:50.105522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3c4c6f89-d64d-4d8c-9e66-7283379b876d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:50.173595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3c4c6f89-d64d-4d8c-9e66-7283379b876d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:50.193702 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3c4c6f89-d64d-4d8c-9e66-7283379b876d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1217 microversion: 2.1 time: 0.095537 Oct 27 19:44:50.196204 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3660/7466] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:50 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:51.219725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-631c37f0-09e0-492c-bae1-12f7c272b1b2 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:51.221204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-631c37f0-09e0-492c-bae1-12f7c272b1b2 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:51.230052 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-631c37f0-09e0-492c-bae1-12f7c272b1b2 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:51.231253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-631c37f0-09e0-492c-bae1-12f7c272b1b2 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:51.231993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-631c37f0-09e0-492c-bae1-12f7c272b1b2 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:51.233329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-631c37f0-09e0-492c-bae1-12f7c272b1b2 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:51.234004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-631c37f0-09e0-492c-bae1-12f7c272b1b2 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:51.234578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-631c37f0-09e0-492c-bae1-12f7c272b1b2 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:51.339110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-631c37f0-09e0-492c-bae1-12f7c272b1b2 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:51.349853 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-631c37f0-09e0-492c-bae1-12f7c272b1b2 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1277 microversion: 2.1 time: 0.134825 Oct 27 19:44:51.350842 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3807/7467] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:51 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1277 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:52.374825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5c410af3-b731-454d-960f-3dde9f63fade tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:52.376157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5c410af3-b731-454d-960f-3dde9f63fade tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:52.384418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c410af3-b731-454d-960f-3dde9f63fade tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:52.385172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c410af3-b731-454d-960f-3dde9f63fade tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:52.386307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c410af3-b731-454d-960f-3dde9f63fade tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:52.387170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c410af3-b731-454d-960f-3dde9f63fade tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:52.388459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c410af3-b731-454d-960f-3dde9f63fade tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:52.389560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c410af3-b731-454d-960f-3dde9f63fade tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:52.540786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5c410af3-b731-454d-960f-3dde9f63fade tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:52.550644 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5c410af3-b731-454d-960f-3dde9f63fade tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1317 microversion: 2.1 time: 0.180402 Oct 27 19:44:52.551425 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3661/7468] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:52 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:52.920691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5361d41a-9f9f-4070-8486-936aaa0d1f43 req-8e38c8c6-a69b-4e77-90f3-475d197a3392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d876fdf9-3d21-4bc5-99eb-c0f200020a9e", "tag": "a828bab3-1637-46bd-83d0-472fb55e4181"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:44:52.948239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5361d41a-9f9f-4070-8486-936aaa0d1f43 req-8e38c8c6-a69b-4e77-90f3-475d197a3392 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:52.949049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5361d41a-9f9f-4070-8486-936aaa0d1f43 req-8e38c8c6-a69b-4e77-90f3-475d197a3392 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:52.949719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5361d41a-9f9f-4070-8486-936aaa0d1f43 req-8e38c8c6-a69b-4e77-90f3-475d197a3392 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:52.980740 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5361d41a-9f9f-4070-8486-936aaa0d1f43 req-8e38c8c6-a69b-4e77-90f3-475d197a3392 service nova] Creating event network-changed:a828bab3-1637-46bd-83d0-472fb55e4181 for instance d876fdf9-3d21-4bc5-99eb-c0f200020a9e on n-h1-860687-3 Oct 27 19:44:52.987090 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5361d41a-9f9f-4070-8486-936aaa0d1f43 req-8e38c8c6-a69b-4e77-90f3-475d197a3392 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079745 Oct 27 19:44:52.988671 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3808/7469] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:44:53.575387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a5886562-1a49-4d04-a888-b84368272028 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:53.576496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a5886562-1a49-4d04-a888-b84368272028 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:53.583869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5886562-1a49-4d04-a888-b84368272028 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:53.584293 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5886562-1a49-4d04-a888-b84368272028 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:53.584760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5886562-1a49-4d04-a888-b84368272028 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:53.585493 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5886562-1a49-4d04-a888-b84368272028 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:53.586010 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5886562-1a49-4d04-a888-b84368272028 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:53.586492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5886562-1a49-4d04-a888-b84368272028 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:53.722759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a5886562-1a49-4d04-a888-b84368272028 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:53.730507 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a5886562-1a49-4d04-a888-b84368272028 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1317 microversion: 2.1 time: 0.159281 Oct 27 19:44:53.731189 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3662/7470] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:53 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:54.753830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-91c20e6b-82a5-43f8-b9db-b5fa04ae6e03 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:54.754727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-91c20e6b-82a5-43f8-b9db-b5fa04ae6e03 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:54.763225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91c20e6b-82a5-43f8-b9db-b5fa04ae6e03 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:54.764489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91c20e6b-82a5-43f8-b9db-b5fa04ae6e03 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:54.764947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91c20e6b-82a5-43f8-b9db-b5fa04ae6e03 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:54.765933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91c20e6b-82a5-43f8-b9db-b5fa04ae6e03 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:54.766426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91c20e6b-82a5-43f8-b9db-b5fa04ae6e03 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:54.766872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-91c20e6b-82a5-43f8-b9db-b5fa04ae6e03 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:54.937805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-91c20e6b-82a5-43f8-b9db-b5fa04ae6e03 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:54.945869 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-91c20e6b-82a5-43f8-b9db-b5fa04ae6e03 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1317 microversion: 2.1 time: 0.196368 Oct 27 19:44:54.946469 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3809/7471] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:54 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:55.970064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00a1843a-7235-484a-90e5-45281e5a12bd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:55.970728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-00a1843a-7235-484a-90e5-45281e5a12bd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:55.977608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00a1843a-7235-484a-90e5-45281e5a12bd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:55.978095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00a1843a-7235-484a-90e5-45281e5a12bd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:55.978592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00a1843a-7235-484a-90e5-45281e5a12bd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:55.979307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00a1843a-7235-484a-90e5-45281e5a12bd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:55.979775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00a1843a-7235-484a-90e5-45281e5a12bd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:55.980220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00a1843a-7235-484a-90e5-45281e5a12bd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:56.109697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-00a1843a-7235-484a-90e5-45281e5a12bd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:56.117578 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-00a1843a-7235-484a-90e5-45281e5a12bd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1317 microversion: 2.1 time: 0.152363 Oct 27 19:44:56.118172 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3663/7472] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:55 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:57.140654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b220965e-6345-48c9-8f66-e2c3c5fbc44f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:57.141268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b220965e-6345-48c9-8f66-e2c3c5fbc44f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:57.147903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b220965e-6345-48c9-8f66-e2c3c5fbc44f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:57.148390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b220965e-6345-48c9-8f66-e2c3c5fbc44f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:57.148833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b220965e-6345-48c9-8f66-e2c3c5fbc44f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:57.149524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b220965e-6345-48c9-8f66-e2c3c5fbc44f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:57.149978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b220965e-6345-48c9-8f66-e2c3c5fbc44f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:57.150434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b220965e-6345-48c9-8f66-e2c3c5fbc44f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:57.280291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b220965e-6345-48c9-8f66-e2c3c5fbc44f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:57.288191 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b220965e-6345-48c9-8f66-e2c3c5fbc44f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1317 microversion: 2.1 time: 0.151553 Oct 27 19:44:57.288761 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3810/7473] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:57 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:58.311214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-36003525-45b6-4c66-b388-2a5bb20d972d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:58.311856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-36003525-45b6-4c66-b388-2a5bb20d972d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:58.319024 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36003525-45b6-4c66-b388-2a5bb20d972d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:58.319527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36003525-45b6-4c66-b388-2a5bb20d972d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:58.319983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36003525-45b6-4c66-b388-2a5bb20d972d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:58.320706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36003525-45b6-4c66-b388-2a5bb20d972d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:58.321178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36003525-45b6-4c66-b388-2a5bb20d972d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:58.321621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36003525-45b6-4c66-b388-2a5bb20d972d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:58.384157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a0d8531a-b02f-4411-83ff-b82d9d6b6ca8 req-beeda930-cafd-469e-9f27-b9d32fa73aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d876fdf9-3d21-4bc5-99eb-c0f200020a9e", "name": "network-vif-plugged", "status": "completed", "tag": "a828bab3-1637-46bd-83d0-472fb55e4181"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:44:58.396633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a0d8531a-b02f-4411-83ff-b82d9d6b6ca8 req-beeda930-cafd-469e-9f27-b9d32fa73aa8 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:58.397142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a0d8531a-b02f-4411-83ff-b82d9d6b6ca8 req-beeda930-cafd-469e-9f27-b9d32fa73aa8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:58.397596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a0d8531a-b02f-4411-83ff-b82d9d6b6ca8 req-beeda930-cafd-469e-9f27-b9d32fa73aa8 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:58.410925 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a0d8531a-b02f-4411-83ff-b82d9d6b6ca8 req-beeda930-cafd-469e-9f27-b9d32fa73aa8 service nova] Creating event network-vif-plugged:a828bab3-1637-46bd-83d0-472fb55e4181 for instance d876fdf9-3d21-4bc5-99eb-c0f200020a9e on n-h1-860687-3 Oct 27 19:44:58.416015 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a0d8531a-b02f-4411-83ff-b82d9d6b6ca8 req-beeda930-cafd-469e-9f27-b9d32fa73aa8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036038 Oct 27 19:44:58.416794 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3811/7474] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:44:58.469712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-36003525-45b6-4c66-b388-2a5bb20d972d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:58.477700 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-36003525-45b6-4c66-b388-2a5bb20d972d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1317 microversion: 2.1 time: 0.170665 Oct 27 19:44:58.478284 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3664/7475] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:58 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:44:59.503657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4ae6f44d-8536-46c9-ac3e-9a73bc4f92ee tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:44:59.504571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4ae6f44d-8536-46c9-ac3e-9a73bc4f92ee tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:44:59.510917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ae6f44d-8536-46c9-ac3e-9a73bc4f92ee tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:59.511401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ae6f44d-8536-46c9-ac3e-9a73bc4f92ee tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:59.511834 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ae6f44d-8536-46c9-ac3e-9a73bc4f92ee tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:59.512518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ae6f44d-8536-46c9-ac3e-9a73bc4f92ee tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:44:59.512970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ae6f44d-8536-46c9-ac3e-9a73bc4f92ee tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:44:59.514416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ae6f44d-8536-46c9-ac3e-9a73bc4f92ee tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:44:59.653721 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4ae6f44d-8536-46c9-ac3e-9a73bc4f92ee tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:44:59.663122 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4ae6f44d-8536-46c9-ac3e-9a73bc4f92ee tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1317 microversion: 2.1 time: 0.165404 Oct 27 19:44:59.663742 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3812/7476] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:44:59 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:00.688305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-77f0c6a8-1277-4769-93d2-0b4090d1dc4c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:00.688937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-77f0c6a8-1277-4769-93d2-0b4090d1dc4c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:00.691939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:45:00.697533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77f0c6a8-1277-4769-93d2-0b4090d1dc4c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:00.698038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77f0c6a8-1277-4769-93d2-0b4090d1dc4c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:00.698533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77f0c6a8-1277-4769-93d2-0b4090d1dc4c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:00.699252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77f0c6a8-1277-4769-93d2-0b4090d1dc4c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:00.699726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77f0c6a8-1277-4769-93d2-0b4090d1dc4c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:00.700181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77f0c6a8-1277-4769-93d2-0b4090d1dc4c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:00.830311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-77f0c6a8-1277-4769-93d2-0b4090d1dc4c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:00.838064 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-77f0c6a8-1277-4769-93d2-0b4090d1dc4c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1506 microversion: 2.1 time: 0.154382 Oct 27 19:45:00.838666 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3665/7477] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:00 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:00.899722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-331854093", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "749c076d-89ab-481e-a97f-f3f8f94d3488"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:45:00.909295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:45:00.910102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:45:00.958843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] validate_networks() for [('749c076d-89ab-481e-a97f-f3f8f94d3488', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:45:01.329999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:45:01.330458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:45:01.330948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:45:01.331367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:45:01.331787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:45:01.340717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:01.341761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:01.342546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:01.343208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:01.343697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:01.344134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:01.364024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Getting quotas for project 644f660823684a01a3eefd7bb0f9dfc0. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:45:01.371564 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Getting quotas for user b3346a44186e40dd954f245bb08d3f6c and project 644f660823684a01a3eefd7bb0f9dfc0. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:45:01.384498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:45:01.386841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:45:01.433698 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b017fa73-0191-44de-a1e2-975a2c80100f tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538287 Oct 27 19:45:01.434477 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3813/7478] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:45:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:45:01.446173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8b705e27-b143-4a2a-9435-5214c057e5a4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:01.446867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8b705e27-b143-4a2a-9435-5214c057e5a4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:01.504387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8b705e27-b143-4a2a-9435-5214c057e5a4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:01.511486 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8b705e27-b143-4a2a-9435-5214c057e5a4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 200 len: 1216 microversion: 2.1 time: 0.069412 Oct 27 19:45:01.512059 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3666/7479] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:01 2022] GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:02.536421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-969b27b7-222b-4bad-b4f8-1b85add9d6e5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:02.537076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-969b27b7-222b-4bad-b4f8-1b85add9d6e5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:02.545318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969b27b7-222b-4bad-b4f8-1b85add9d6e5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:02.545745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969b27b7-222b-4bad-b4f8-1b85add9d6e5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:02.546192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969b27b7-222b-4bad-b4f8-1b85add9d6e5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:02.546930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969b27b7-222b-4bad-b4f8-1b85add9d6e5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:02.547395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969b27b7-222b-4bad-b4f8-1b85add9d6e5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:02.547833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-969b27b7-222b-4bad-b4f8-1b85add9d6e5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:02.614579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-969b27b7-222b-4bad-b4f8-1b85add9d6e5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:02.623352 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-969b27b7-222b-4bad-b4f8-1b85add9d6e5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 200 len: 1274 microversion: 2.1 time: 0.090291 Oct 27 19:45:02.624135 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3814/7480] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:02 2022] GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:03.647426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-622d7aab-3c7a-4ca0-980c-1caf4ba7646d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:03.648089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-622d7aab-3c7a-4ca0-980c-1caf4ba7646d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:03.658851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-622d7aab-3c7a-4ca0-980c-1caf4ba7646d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:03.659363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-622d7aab-3c7a-4ca0-980c-1caf4ba7646d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:03.659820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-622d7aab-3c7a-4ca0-980c-1caf4ba7646d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:03.660544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-622d7aab-3c7a-4ca0-980c-1caf4ba7646d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:03.661023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-622d7aab-3c7a-4ca0-980c-1caf4ba7646d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:03.661469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-622d7aab-3c7a-4ca0-980c-1caf4ba7646d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:03.820683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-55716ef0-a848-4897-a618-ca2d9fffebf4 req-b8d99541-f8b6-49a6-9f77-487b121b1823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db56dd36-0372-484f-b7e3-c262c5d7d7db", "tag": "4ecc8dba-53d3-4753-9635-917b17bc3123"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:45:03.829318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:45:03.836134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-55716ef0-a848-4897-a618-ca2d9fffebf4 req-b8d99541-f8b6-49a6-9f77-487b121b1823 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:03.836631 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-55716ef0-a848-4897-a618-ca2d9fffebf4 req-b8d99541-f8b6-49a6-9f77-487b121b1823 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:03.837262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-55716ef0-a848-4897-a618-ca2d9fffebf4 req-b8d99541-f8b6-49a6-9f77-487b121b1823 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:03.850202 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-55716ef0-a848-4897-a618-ca2d9fffebf4 req-b8d99541-f8b6-49a6-9f77-487b121b1823 service nova] Creating event network-changed:4ecc8dba-53d3-4753-9635-917b17bc3123 for instance db56dd36-0372-484f-b7e3-c262c5d7d7db on n-h2-860687-3 Oct 27 19:45:03.855049 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-55716ef0-a848-4897-a618-ca2d9fffebf4 req-b8d99541-f8b6-49a6-9f77-487b121b1823 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039397 Oct 27 19:45:03.855756 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3815/7481] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:45:03.912068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-622d7aab-3c7a-4ca0-980c-1caf4ba7646d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:03.921016 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-622d7aab-3c7a-4ca0-980c-1caf4ba7646d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 200 len: 1316 microversion: 2.1 time: 0.277329 Oct 27 19:45:03.922201 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3667/7482] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:03 2022] GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:04.946776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-282706c4-06a1-4f13-b666-92f37d93239d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:04.947511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-282706c4-06a1-4f13-b666-92f37d93239d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:04.955419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-282706c4-06a1-4f13-b666-92f37d93239d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:04.955901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-282706c4-06a1-4f13-b666-92f37d93239d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:04.956332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-282706c4-06a1-4f13-b666-92f37d93239d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:04.957023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-282706c4-06a1-4f13-b666-92f37d93239d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:04.957477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-282706c4-06a1-4f13-b666-92f37d93239d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:04.957906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-282706c4-06a1-4f13-b666-92f37d93239d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:05.088726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-282706c4-06a1-4f13-b666-92f37d93239d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:05.096997 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-282706c4-06a1-4f13-b666-92f37d93239d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 200 len: 1316 microversion: 2.1 time: 0.154544 Oct 27 19:45:05.097565 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3816/7483] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:04 2022] GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:06.119595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dee3646f-ad80-463b-874b-c5d6092c4061 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:06.120245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dee3646f-ad80-463b-874b-c5d6092c4061 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:06.127392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dee3646f-ad80-463b-874b-c5d6092c4061 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:06.127900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dee3646f-ad80-463b-874b-c5d6092c4061 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:06.128402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dee3646f-ad80-463b-874b-c5d6092c4061 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:06.129120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dee3646f-ad80-463b-874b-c5d6092c4061 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:06.129599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dee3646f-ad80-463b-874b-c5d6092c4061 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:06.130050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dee3646f-ad80-463b-874b-c5d6092c4061 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:06.271821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dee3646f-ad80-463b-874b-c5d6092c4061 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:06.280446 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dee3646f-ad80-463b-874b-c5d6092c4061 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 200 len: 1316 microversion: 2.1 time: 0.164759 Oct 27 19:45:06.281043 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3668/7484] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:06 2022] GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:45:07.303546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f63bee60-9a82-4d08-a2fe-f586ac6d9227 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:07.304082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f63bee60-9a82-4d08-a2fe-f586ac6d9227 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:07.313825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f63bee60-9a82-4d08-a2fe-f586ac6d9227 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:07.314316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f63bee60-9a82-4d08-a2fe-f586ac6d9227 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:07.314792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f63bee60-9a82-4d08-a2fe-f586ac6d9227 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:07.315496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f63bee60-9a82-4d08-a2fe-f586ac6d9227 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:07.316224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f63bee60-9a82-4d08-a2fe-f586ac6d9227 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:07.316661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f63bee60-9a82-4d08-a2fe-f586ac6d9227 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:07.452740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f63bee60-9a82-4d08-a2fe-f586ac6d9227 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:07.460802 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f63bee60-9a82-4d08-a2fe-f586ac6d9227 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 200 len: 1316 microversion: 2.1 time: 0.161240 Oct 27 19:45:07.461426 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3817/7485] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:07 2022] GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:08.484329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5f8fec50-0cc6-4ffe-bbda-4e57d54d7509 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:08.484953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5f8fec50-0cc6-4ffe-bbda-4e57d54d7509 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:08.491572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f8fec50-0cc6-4ffe-bbda-4e57d54d7509 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:08.492072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f8fec50-0cc6-4ffe-bbda-4e57d54d7509 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:08.492528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f8fec50-0cc6-4ffe-bbda-4e57d54d7509 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:08.493233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f8fec50-0cc6-4ffe-bbda-4e57d54d7509 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:08.493729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f8fec50-0cc6-4ffe-bbda-4e57d54d7509 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:08.494172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f8fec50-0cc6-4ffe-bbda-4e57d54d7509 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:08.629942 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5f8fec50-0cc6-4ffe-bbda-4e57d54d7509 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:08.637773 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5f8fec50-0cc6-4ffe-bbda-4e57d54d7509 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 200 len: 1316 microversion: 2.1 time: 0.157486 Oct 27 19:45:08.639114 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3669/7486] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:08 2022] GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:09.081213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-ddd2329a-34f6-4d8f-8d97-ce5f1674f0fc req-b8c129dc-f537-4cdb-9037-e79904073e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db56dd36-0372-484f-b7e3-c262c5d7d7db", "name": "network-vif-plugged", "status": "completed", "tag": "4ecc8dba-53d3-4753-9635-917b17bc3123"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:45:09.093952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ddd2329a-34f6-4d8f-8d97-ce5f1674f0fc req-b8c129dc-f537-4cdb-9037-e79904073e7e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:09.094496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ddd2329a-34f6-4d8f-8d97-ce5f1674f0fc req-b8c129dc-f537-4cdb-9037-e79904073e7e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:09.094942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-ddd2329a-34f6-4d8f-8d97-ce5f1674f0fc req-b8c129dc-f537-4cdb-9037-e79904073e7e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:09.106837 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-ddd2329a-34f6-4d8f-8d97-ce5f1674f0fc req-b8c129dc-f537-4cdb-9037-e79904073e7e service nova] Creating event network-vif-plugged:4ecc8dba-53d3-4753-9635-917b17bc3123 for instance db56dd36-0372-484f-b7e3-c262c5d7d7db on n-h2-860687-3 Oct 27 19:45:09.112710 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-ddd2329a-34f6-4d8f-8d97-ce5f1674f0fc req-b8c129dc-f537-4cdb-9037-e79904073e7e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034937 Oct 27 19:45:09.113327 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3818/7487] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:45:09.661275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9de99094-2321-48db-bdae-42d8288000aa tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:09.661908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9de99094-2321-48db-bdae-42d8288000aa tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:09.668851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9de99094-2321-48db-bdae-42d8288000aa tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:09.669367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9de99094-2321-48db-bdae-42d8288000aa tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:09.669827 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9de99094-2321-48db-bdae-42d8288000aa tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:09.670591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9de99094-2321-48db-bdae-42d8288000aa tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:09.671073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9de99094-2321-48db-bdae-42d8288000aa tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:09.671521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9de99094-2321-48db-bdae-42d8288000aa tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:09.806829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9de99094-2321-48db-bdae-42d8288000aa tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:09.815722 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9de99094-2321-48db-bdae-42d8288000aa tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 200 len: 1316 microversion: 2.1 time: 0.158337 Oct 27 19:45:09.816572 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3670/7488] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:09 2022] GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:10.840042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fc87b46b-b5b6-4305-85c0-17ad1bca3725 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:10.840750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fc87b46b-b5b6-4305-85c0-17ad1bca3725 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:10.848226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc87b46b-b5b6-4305-85c0-17ad1bca3725 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:10.848711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc87b46b-b5b6-4305-85c0-17ad1bca3725 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:10.849151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc87b46b-b5b6-4305-85c0-17ad1bca3725 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:10.849840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc87b46b-b5b6-4305-85c0-17ad1bca3725 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:10.850301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc87b46b-b5b6-4305-85c0-17ad1bca3725 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:10.850756 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fc87b46b-b5b6-4305-85c0-17ad1bca3725 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:10.986812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fc87b46b-b5b6-4305-85c0-17ad1bca3725 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:10.994564 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fc87b46b-b5b6-4305-85c0-17ad1bca3725 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 200 len: 1505 microversion: 2.1 time: 0.159076 Oct 27 19:45:10.995135 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3819/7489] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:10 2022] GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:11.017809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d2884ee-d377-4a0c-a3c7-8a79c76dc3eb tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:11.018361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d2884ee-d377-4a0c-a3c7-8a79c76dc3eb tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:11.027374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d2884ee-d377-4a0c-a3c7-8a79c76dc3eb tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:11.027885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d2884ee-d377-4a0c-a3c7-8a79c76dc3eb tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:11.028355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d2884ee-d377-4a0c-a3c7-8a79c76dc3eb tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:11.029704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d2884ee-d377-4a0c-a3c7-8a79c76dc3eb tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:11.030187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d2884ee-d377-4a0c-a3c7-8a79c76dc3eb tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:11.030671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d2884ee-d377-4a0c-a3c7-8a79c76dc3eb tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:11.056676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d2884ee-d377-4a0c-a3c7-8a79c76dc3eb tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:45:11.132347 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d2884ee-d377-4a0c-a3c7-8a79c76dc3eb tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "DELETE /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 204 len: 0 microversion: 2.1 time: 0.118166 Oct 27 19:45:11.133175 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3671/7490] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:45:11 2022] DELETE /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:45:11.143080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-af3f60a7-fc33-4dfe-b549-2e8a22d14efd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:11.143720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-af3f60a7-fc33-4dfe-b549-2e8a22d14efd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:11.149982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af3f60a7-fc33-4dfe-b549-2e8a22d14efd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:11.150502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af3f60a7-fc33-4dfe-b549-2e8a22d14efd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:11.150948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af3f60a7-fc33-4dfe-b549-2e8a22d14efd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:11.151643 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af3f60a7-fc33-4dfe-b549-2e8a22d14efd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:11.152103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af3f60a7-fc33-4dfe-b549-2e8a22d14efd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:11.152537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-af3f60a7-fc33-4dfe-b549-2e8a22d14efd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:11.289102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-af3f60a7-fc33-4dfe-b549-2e8a22d14efd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:11.297356 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-af3f60a7-fc33-4dfe-b549-2e8a22d14efd tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 200 len: 1511 microversion: 2.1 time: 0.159596 Oct 27 19:45:11.297943 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3820/7491] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:11 2022] GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:12.322029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6e11fa99-9969-4c13-bd96-177da540d0b5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:12.322823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6e11fa99-9969-4c13-bd96-177da540d0b5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:12.324765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:45:12.331713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e11fa99-9969-4c13-bd96-177da540d0b5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:12.332226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e11fa99-9969-4c13-bd96-177da540d0b5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:12.332688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e11fa99-9969-4c13-bd96-177da540d0b5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:12.333417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e11fa99-9969-4c13-bd96-177da540d0b5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:12.333894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e11fa99-9969-4c13-bd96-177da540d0b5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:12.334347 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e11fa99-9969-4c13-bd96-177da540d0b5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:12.464611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6e11fa99-9969-4c13-bd96-177da540d0b5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:12.472827 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6e11fa99-9969-4c13-bd96-177da540d0b5 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 200 len: 1511 microversion: 2.1 time: 0.155172 Oct 27 19:45:12.473446 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3672/7492] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:12 2022] GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:12.959148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-7aa096d5-0796-46d9-a920-58389ddd2e77 req-72faa38b-a85b-4db3-a344-61afbe92035d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db56dd36-0372-484f-b7e3-c262c5d7d7db", "name": "network-vif-deleted", "tag": "4ecc8dba-53d3-4753-9635-917b17bc3123"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:45:12.971388 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:45:12.972769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:45:12.979812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7aa096d5-0796-46d9-a920-58389ddd2e77 req-72faa38b-a85b-4db3-a344-61afbe92035d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:12.980705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7aa096d5-0796-46d9-a920-58389ddd2e77 req-72faa38b-a85b-4db3-a344-61afbe92035d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:12.981276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7aa096d5-0796-46d9-a920-58389ddd2e77 req-72faa38b-a85b-4db3-a344-61afbe92035d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:12.999041 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-7aa096d5-0796-46d9-a920-58389ddd2e77 req-72faa38b-a85b-4db3-a344-61afbe92035d service nova] Creating event network-vif-deleted:4ecc8dba-53d3-4753-9635-917b17bc3123 for instance db56dd36-0372-484f-b7e3-c262c5d7d7db on n-h2-860687-3 Oct 27 19:45:13.005460 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-7aa096d5-0796-46d9-a920-58389ddd2e77 req-72faa38b-a85b-4db3-a344-61afbe92035d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050684 Oct 27 19:45:13.006571 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3821/7493] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:45:13.496243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-adb59e77-60d6-4f43-995c-33ba56fb23ac tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:13.496876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-adb59e77-60d6-4f43-995c-33ba56fb23ac tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:13.504453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adb59e77-60d6-4f43-995c-33ba56fb23ac tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:13.504961 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adb59e77-60d6-4f43-995c-33ba56fb23ac tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:13.505422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adb59e77-60d6-4f43-995c-33ba56fb23ac tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:13.506142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adb59e77-60d6-4f43-995c-33ba56fb23ac tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:13.506650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adb59e77-60d6-4f43-995c-33ba56fb23ac tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:13.507101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adb59e77-60d6-4f43-995c-33ba56fb23ac tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:13.521490 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-adb59e77-60d6-4f43-995c-33ba56fb23ac tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] HTTP exception thrown: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-adb59e77-60d6-4f43-995c-33ba56fb23ac tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Request method failure captured: Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db HTTP/1.1 Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt-xhmrMTYxt7rBkZxaNkFBr38jpbbc1xYCg3w1QKXAXAcQkjZ4NdLaf2wSAdXSVEY4KyZTdVjRI_38kbHzKtSQedDv1l24TtDOPxV-Osahbqzxb82os7qn2PdPFkWHAitJwuSgwxWBGxQY_Xd3L0CYcgejEO1RR_s1K1Rt557rd5ZQ Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 644f660823684a01a3eefd7bb0f9dfc0 Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_644f660823684a01a3eefd7bb0f9dfc0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 644f660823684a01a3eefd7bb0f9dfc0 Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-172786693-project Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b3346a44186e40dd954f245bb08d3f6c Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-172786693-project Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'db56dd36-0372-484f-b7e3-c262c5d7d7db'} Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:45:13.523248 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:13.528494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:13.528494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:45:13.528494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:45:13.528494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:45:13.528494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:45:13.528494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:13.528494 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:13.528494 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-adb59e77-60d6-4f43-995c-33ba56fb23ac tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Returning 404 to user: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:45:13.528494 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-adb59e77-60d6-4f43-995c-33ba56fb23ac tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 404 len: 111 microversion: 2.1 time: 0.032515 Oct 27 19:45:13.528494 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3673/7494] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:13 2022] GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:45:13.534505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-19637655-0091-431b-bf3a-94c9e83b3117 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:13.535220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-19637655-0091-431b-bf3a-94c9e83b3117 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:13.541326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19637655-0091-431b-bf3a-94c9e83b3117 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:13.541817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19637655-0091-431b-bf3a-94c9e83b3117 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:13.542261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19637655-0091-431b-bf3a-94c9e83b3117 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:13.543002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19637655-0091-431b-bf3a-94c9e83b3117 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:13.543468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19637655-0091-431b-bf3a-94c9e83b3117 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:13.543899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19637655-0091-431b-bf3a-94c9e83b3117 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:13.675868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-19637655-0091-431b-bf3a-94c9e83b3117 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:13.683649 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-19637655-0091-431b-bf3a-94c9e83b3117 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1506 microversion: 2.1 time: 0.153452 Oct 27 19:45:13.684225 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3822/7495] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:13 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:13.707239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-191a2d9f-f450-48c2-a915-ba59795a4fc3 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:45:13.709651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-191a2d9f-f450-48c2-a915-ba59795a4fc3 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: fe5bb201-5a10-4935-a7ad-2b9ed883a42b] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:13.715171 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-191a2d9f-f450-48c2-a915-ba59795a4fc3 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] HTTP exception thrown: Instance fe5bb201-5a10-4935-a7ad-2b9ed883a42b could not be found. Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-191a2d9f-f450-48c2-a915-ba59795a4fc3 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Request method failure captured: Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/fe5bb201-5a10-4935-a7ad-2b9ed883a42b/action HTTP/1.1 Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 32 Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt-xhmrMTYxt7rBkZxaNkFBr38jpbbc1xYCg3w1QKXAXAcQkjZ4NdLaf2wSAdXSVEY4KyZTdVjRI_38kbHzKtSQedDv1l24TtDOPxV-Osahbqzxb82os7qn2PdPFkWHAitJwuSgwxWBGxQY_Xd3L0CYcgejEO1RR_s1K1Rt557rd5ZQ Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 644f660823684a01a3eefd7bb0f9dfc0 Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_644f660823684a01a3eefd7bb0f9dfc0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 644f660823684a01a3eefd7bb0f9dfc0 Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-172786693-project Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b3346a44186e40dd954f245bb08d3f6c Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-172786693-project Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: {"resize": {"flavorRef": "452"}} Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance fe5bb201-5a10-4935-a7ad-2b9ed883a42b could not be found. Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'fe5bb201-5a10-4935-a7ad-2b9ed883a42b', 'body': {'resize': {'flavorRef': '452'}}} Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5bb201-5a10-4935-a7ad-2b9ed883a42b could not be found. Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:45:13.717400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:45:13.721753 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5bb201-5a10-4935-a7ad-2b9ed883a42b could not be found. Oct 27 19:45:13.721753 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:13.721753 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:45:13.721753 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:13.721753 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:13.721753 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:45:13.721753 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:45:13.721753 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:45:13.721753 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:45:13.721753 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5bb201-5a10-4935-a7ad-2b9ed883a42b could not be found. Oct 27 19:45:13.721753 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:13.721753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-191a2d9f-f450-48c2-a915-ba59795a4fc3 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Returning 404 to user: Instance fe5bb201-5a10-4935-a7ad-2b9ed883a42b could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:45:13.721753 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-191a2d9f-f450-48c2-a915-ba59795a4fc3 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "POST /compute/v2.1/servers/fe5bb201-5a10-4935-a7ad-2b9ed883a42b/action" status: 404 len: 111 microversion: 2.1 time: 0.015625 Oct 27 19:45:13.721753 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3674/7496] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:45:13 2022] POST /compute/v2.1/servers/fe5bb201-5a10-4935-a7ad-2b9ed883a42b/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:45:13.727358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b9e81bf6-e74e-43b6-9ece-4e68a2cfc36c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:13.727987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b9e81bf6-e74e-43b6-9ece-4e68a2cfc36c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:13.734053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9e81bf6-e74e-43b6-9ece-4e68a2cfc36c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:13.734595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9e81bf6-e74e-43b6-9ece-4e68a2cfc36c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:13.735046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9e81bf6-e74e-43b6-9ece-4e68a2cfc36c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:13.735743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9e81bf6-e74e-43b6-9ece-4e68a2cfc36c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:13.736208 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9e81bf6-e74e-43b6-9ece-4e68a2cfc36c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:13.736645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b9e81bf6-e74e-43b6-9ece-4e68a2cfc36c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:13.863417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b9e81bf6-e74e-43b6-9ece-4e68a2cfc36c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:13.871197 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b9e81bf6-e74e-43b6-9ece-4e68a2cfc36c tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1506 microversion: 2.1 time: 0.147767 Oct 27 19:45:13.871780 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3823/7497] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:13 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:13.894560 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b3d62810-f8ef-4782-ac6c-13b95287323a tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:13.895139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b3d62810-f8ef-4782-ac6c-13b95287323a tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:13.902029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3d62810-f8ef-4782-ac6c-13b95287323a tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:13.902572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3d62810-f8ef-4782-ac6c-13b95287323a tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:13.903041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3d62810-f8ef-4782-ac6c-13b95287323a tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:13.904361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3d62810-f8ef-4782-ac6c-13b95287323a tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:13.904843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3d62810-f8ef-4782-ac6c-13b95287323a tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:13.905297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b3d62810-f8ef-4782-ac6c-13b95287323a tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.033241 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b3d62810-f8ef-4782-ac6c-13b95287323a tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:14.041096 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b3d62810-f8ef-4782-ac6c-13b95287323a tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1506 microversion: 2.1 time: 0.150518 Oct 27 19:45:14.041671 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3675/7498] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:13 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:14.063949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ea7aaeb6-981a-4406-b792-735d11875481 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "5c2b1c97-fd37-436b-8ac4-2e6969aa502f"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:45:14.066502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ea7aaeb6-981a-4406-b792-735d11875481 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:14.073408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea7aaeb6-981a-4406-b792-735d11875481 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.073938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea7aaeb6-981a-4406-b792-735d11875481 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.074436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea7aaeb6-981a-4406-b792-735d11875481 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.075169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea7aaeb6-981a-4406-b792-735d11875481 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.076323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea7aaeb6-981a-4406-b792-735d11875481 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.076757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ea7aaeb6-981a-4406-b792-735d11875481 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.104646 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ea7aaeb6-981a-4406-b792-735d11875481 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:14.109650 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-ea7aaeb6-981a-4406-b792-735d11875481 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] HTTP exception thrown: Flavor 5c2b1c97-fd37-436b-8ac4-2e6969aa502f could not be found. Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ea7aaeb6-981a-4406-b792-735d11875481 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Request method failure captured: Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: request: POST /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e/action HTTP/1.1 Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 65 Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt-xhmrMTYxt7rBkZxaNkFBr38jpbbc1xYCg3w1QKXAXAcQkjZ4NdLaf2wSAdXSVEY4KyZTdVjRI_38kbHzKtSQedDv1l24TtDOPxV-Osahbqzxb82os7qn2PdPFkWHAitJwuSgwxWBGxQY_Xd3L0CYcgejEO1RR_s1K1Rt557rd5ZQ Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 644f660823684a01a3eefd7bb0f9dfc0 Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_644f660823684a01a3eefd7bb0f9dfc0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 644f660823684a01a3eefd7bb0f9dfc0 Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-172786693-project Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b3346a44186e40dd954f245bb08d3f6c Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-172786693-project Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: {"resize": {"flavorRef": "5c2b1c97-fd37-436b-8ac4-2e6969aa502f"}} Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: exception: Flavor 5c2b1c97-fd37-436b-8ac4-2e6969aa502f could not be found. Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'd876fdf9-3d21-4bc5-99eb-c0f200020a9e', 'body': {'resize': {'flavorRef': '5c2b1c97-fd37-436b-8ac4-2e6969aa502f'}}} Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:45:14.120685 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 5c2b1c97-fd37-436b-8ac4-2e6969aa502f could not be found. Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 5c2b1c97-fd37-436b-8ac4-2e6969aa502f could not be found. Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 5c2b1c97-fd37-436b-8ac4-2e6969aa502f could not be found. Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ea7aaeb6-981a-4406-b792-735d11875481 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Returning 400 to user: Flavor 5c2b1c97-fd37-436b-8ac4-2e6969aa502f could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ea7aaeb6-981a-4406-b792-735d11875481 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "POST /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e/action" status: 400 len: 107 microversion: 2.1 time: 0.062898 Oct 27 19:45:14.126673 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3824/7499] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:45:14 2022] POST /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e/action => generated 107 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:45:14.131853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-20d5eeaf-f6e4-4e3a-bd34-fa9e7624ad44 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:14.132485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-20d5eeaf-f6e4-4e3a-bd34-fa9e7624ad44 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:14.139124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20d5eeaf-f6e4-4e3a-bd34-fa9e7624ad44 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.139624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20d5eeaf-f6e4-4e3a-bd34-fa9e7624ad44 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.140083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20d5eeaf-f6e4-4e3a-bd34-fa9e7624ad44 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.140799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20d5eeaf-f6e4-4e3a-bd34-fa9e7624ad44 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.141271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20d5eeaf-f6e4-4e3a-bd34-fa9e7624ad44 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.141715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20d5eeaf-f6e4-4e3a-bd34-fa9e7624ad44 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.278828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-20d5eeaf-f6e4-4e3a-bd34-fa9e7624ad44 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:14.286891 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-20d5eeaf-f6e4-4e3a-bd34-fa9e7624ad44 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1506 microversion: 2.1 time: 0.159063 Oct 27 19:45:14.287480 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3676/7500] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:14 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:14.311795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dba43ad2-43da-422d-a9cd-917c4398d65e tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:14.312420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dba43ad2-43da-422d-a9cd-917c4398d65e tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:14.318577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dba43ad2-43da-422d-a9cd-917c4398d65e tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.319062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dba43ad2-43da-422d-a9cd-917c4398d65e tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.319499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dba43ad2-43da-422d-a9cd-917c4398d65e tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.320184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dba43ad2-43da-422d-a9cd-917c4398d65e tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.320641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dba43ad2-43da-422d-a9cd-917c4398d65e tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.321067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dba43ad2-43da-422d-a9cd-917c4398d65e tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.462701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dba43ad2-43da-422d-a9cd-917c4398d65e tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:14.471032 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dba43ad2-43da-422d-a9cd-917c4398d65e tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1506 microversion: 2.1 time: 0.164003 Oct 27 19:45:14.471600 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3825/7501] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:14 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:14.493657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-875297d0-3712-4799-ac83-3bfbacc77db9 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-875297d0-3712-4799-ac83-3bfbacc77db9 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Request method failure captured: Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e/action HTTP/1.1 Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 29 Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt-xhmrMTYxt7rBkZxaNkFBr38jpbbc1xYCg3w1QKXAXAcQkjZ4NdLaf2wSAdXSVEY4KyZTdVjRI_38kbHzKtSQedDv1l24TtDOPxV-Osahbqzxb82os7qn2PdPFkWHAitJwuSgwxWBGxQY_Xd3L0CYcgejEO1RR_s1K1Rt557rd5ZQ Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 644f660823684a01a3eefd7bb0f9dfc0 Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_644f660823684a01a3eefd7bb0f9dfc0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 644f660823684a01a3eefd7bb0f9dfc0 Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-172786693-project Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b3346a44186e40dd954f245bb08d3f6c Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-172786693-project Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: {"resize": {"flavorRef": ""}} Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'd876fdf9-3d21-4bc5-99eb-c0f200020a9e', 'body': {'resize': {'flavorRef': ''}}} Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi '' Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.497361 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:45:14.502996 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.502996 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:14.502996 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:45:14.502996 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:45:14.502996 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 19:45:14.502996 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 19:45:14.502996 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 27 19:45:14.502996 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.502996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-875297d0-3712-4799-ac83-3bfbacc77db9 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:45:14.502996 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-875297d0-3712-4799-ac83-3bfbacc77db9 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "POST /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e/action" status: 400 len: 113 microversion: 2.1 time: 0.009254 Oct 27 19:45:14.502996 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3677/7502] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:45:14 2022] POST /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 19:45:14.507993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a95ad48-004c-4dd9-a7cc-5e2de29e09f9 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:14.508619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1a95ad48-004c-4dd9-a7cc-5e2de29e09f9 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:14.514678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a95ad48-004c-4dd9-a7cc-5e2de29e09f9 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.515180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a95ad48-004c-4dd9-a7cc-5e2de29e09f9 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.515628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a95ad48-004c-4dd9-a7cc-5e2de29e09f9 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.516334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a95ad48-004c-4dd9-a7cc-5e2de29e09f9 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.516805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a95ad48-004c-4dd9-a7cc-5e2de29e09f9 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.517243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a95ad48-004c-4dd9-a7cc-5e2de29e09f9 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.645799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1a95ad48-004c-4dd9-a7cc-5e2de29e09f9 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:14.654610 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1a95ad48-004c-4dd9-a7cc-5e2de29e09f9 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1506 microversion: 2.1 time: 0.149411 Oct 27 19:45:14.654969 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3826/7503] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:14 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:14.680921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-de6f8fa1-90df-4caf-b6f8-c2935c472629 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:14.681671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-de6f8fa1-90df-4caf-b6f8-c2935c472629 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:14.689924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de6f8fa1-90df-4caf-b6f8-c2935c472629 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.690460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de6f8fa1-90df-4caf-b6f8-c2935c472629 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.691741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de6f8fa1-90df-4caf-b6f8-c2935c472629 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.692472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de6f8fa1-90df-4caf-b6f8-c2935c472629 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.692946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de6f8fa1-90df-4caf-b6f8-c2935c472629 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.693393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de6f8fa1-90df-4caf-b6f8-c2935c472629 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.708018 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-de6f8fa1-90df-4caf-b6f8-c2935c472629 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] HTTP exception thrown: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-de6f8fa1-90df-4caf-b6f8-c2935c472629 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Request method failure captured: Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db HTTP/1.1 Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt-xhmrMTYxt7rBkZxaNkFBr38jpbbc1xYCg3w1QKXAXAcQkjZ4NdLaf2wSAdXSVEY4KyZTdVjRI_38kbHzKtSQedDv1l24TtDOPxV-Osahbqzxb82os7qn2PdPFkWHAitJwuSgwxWBGxQY_Xd3L0CYcgejEO1RR_s1K1Rt557rd5ZQ Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 644f660823684a01a3eefd7bb0f9dfc0 Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_644f660823684a01a3eefd7bb0f9dfc0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 644f660823684a01a3eefd7bb0f9dfc0 Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-ServersNegativeTestJSON-172786693-project Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: b3346a44186e40dd954f245bb08d3f6c Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-ServersNegativeTestJSON-172786693-project Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'db56dd36-0372-484f-b7e3-c262c5d7d7db'} Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:45:14.709613 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:45:14.714569 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:14.714569 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.714569 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:45:14.714569 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.714569 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:14.714569 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:45:14.714569 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:45:14.714569 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:45:14.714569 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:45:14.714569 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:14.714569 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.714569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-de6f8fa1-90df-4caf-b6f8-c2935c472629 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Returning 404 to user: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:45:14.714569 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-de6f8fa1-90df-4caf-b6f8-c2935c472629 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "DELETE /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 404 len: 111 microversion: 2.1 time: 0.035087 Oct 27 19:45:14.714569 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3678/7504] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:45:14 2022] DELETE /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:45:14.720427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cb2bb8e3-d199-4a73-af54-2a759decc3f4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:14.721047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cb2bb8e3-d199-4a73-af54-2a759decc3f4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: db56dd36-0372-484f-b7e3-c262c5d7d7db] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:14.727057 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb2bb8e3-d199-4a73-af54-2a759decc3f4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.727544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb2bb8e3-d199-4a73-af54-2a759decc3f4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.727989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb2bb8e3-d199-4a73-af54-2a759decc3f4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.728684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb2bb8e3-d199-4a73-af54-2a759decc3f4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.729145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb2bb8e3-d199-4a73-af54-2a759decc3f4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.729576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cb2bb8e3-d199-4a73-af54-2a759decc3f4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.743872 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-cb2bb8e3-d199-4a73-af54-2a759decc3f4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] HTTP exception thrown: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cb2bb8e3-d199-4a73-af54-2a759decc3f4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Request method failure captured: Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db HTTP/1.1 Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt-xhmrMTYxt7rBkZxaNkFBr38jpbbc1xYCg3w1QKXAXAcQkjZ4NdLaf2wSAdXSVEY4KyZTdVjRI_38kbHzKtSQedDv1l24TtDOPxV-Osahbqzxb82os7qn2PdPFkWHAitJwuSgwxWBGxQY_Xd3L0CYcgejEO1RR_s1K1Rt557rd5ZQ Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 644f660823684a01a3eefd7bb0f9dfc0 Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_644f660823684a01a3eefd7bb0f9dfc0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 644f660823684a01a3eefd7bb0f9dfc0 Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-172786693-project Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b3346a44186e40dd954f245bb08d3f6c Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-172786693-project Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'db56dd36-0372-484f-b7e3-c262c5d7d7db'} Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:45:14.745334 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.750555 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:14.750555 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:45:14.750555 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:45:14.750555 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:45:14.750555 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:45:14.750555 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. Oct 27 19:45:14.750555 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:14.750555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cb2bb8e3-d199-4a73-af54-2a759decc3f4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Returning 404 to user: Instance db56dd36-0372-484f-b7e3-c262c5d7d7db could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:45:14.750555 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cb2bb8e3-d199-4a73-af54-2a759decc3f4 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db" status: 404 len: 111 microversion: 2.1 time: 0.031018 Oct 27 19:45:14.750555 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3827/7505] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:14 2022] GET /compute/v2.1/servers/db56dd36-0372-484f-b7e3-c262c5d7d7db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:45:14.755418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-93803a21-6cfd-483a-8b05-d5f1c8aecaca tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:14.755937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-93803a21-6cfd-483a-8b05-d5f1c8aecaca tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:14.762124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93803a21-6cfd-483a-8b05-d5f1c8aecaca tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.762663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93803a21-6cfd-483a-8b05-d5f1c8aecaca tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.763683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93803a21-6cfd-483a-8b05-d5f1c8aecaca tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.764399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93803a21-6cfd-483a-8b05-d5f1c8aecaca tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.764876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93803a21-6cfd-483a-8b05-d5f1c8aecaca tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.765592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-93803a21-6cfd-483a-8b05-d5f1c8aecaca tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.791987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-93803a21-6cfd-483a-8b05-d5f1c8aecaca tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:45:14.806761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:45:14.868557 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-93803a21-6cfd-483a-8b05-d5f1c8aecaca tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 204 len: 0 microversion: 2.1 time: 0.116601 Oct 27 19:45:14.869270 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3679/7506] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:45:14 2022] DELETE /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:45:14.877888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ec9d1cf0-7c55-4792-a144-256e9ba543ed tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:14.878550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ec9d1cf0-7c55-4792-a144-256e9ba543ed tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:14.884519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec9d1cf0-7c55-4792-a144-256e9ba543ed tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.885002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec9d1cf0-7c55-4792-a144-256e9ba543ed tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.885444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec9d1cf0-7c55-4792-a144-256e9ba543ed tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.886202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec9d1cf0-7c55-4792-a144-256e9ba543ed tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:14.886729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec9d1cf0-7c55-4792-a144-256e9ba543ed tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:14.887163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ec9d1cf0-7c55-4792-a144-256e9ba543ed tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:14.891313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=100 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:45:15.020585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ec9d1cf0-7c55-4792-a144-256e9ba543ed tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:15.028415 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ec9d1cf0-7c55-4792-a144-256e9ba543ed tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1512 microversion: 2.1 time: 0.154399 Oct 27 19:45:15.029688 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3828/7507] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:14 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:16.051838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8480125d-815b-441e-a31c-9eaf53d9fa08 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:16.052564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8480125d-815b-441e-a31c-9eaf53d9fa08 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:16.059400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8480125d-815b-441e-a31c-9eaf53d9fa08 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:16.060587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8480125d-815b-441e-a31c-9eaf53d9fa08 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:16.061053 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8480125d-815b-441e-a31c-9eaf53d9fa08 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:16.061763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8480125d-815b-441e-a31c-9eaf53d9fa08 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:16.062239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8480125d-815b-441e-a31c-9eaf53d9fa08 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:16.062716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8480125d-815b-441e-a31c-9eaf53d9fa08 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:16.193250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8480125d-815b-441e-a31c-9eaf53d9fa08 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:16.201184 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8480125d-815b-441e-a31c-9eaf53d9fa08 tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1512 microversion: 2.1 time: 0.153676 Oct 27 19:45:16.201798 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3680/7508] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:16 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:16.775894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-69cb270c-d146-43c4-9394-55fb5ae6ca87 req-a71de7b8-a9a7-469d-95a7-1b612d0e0acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d876fdf9-3d21-4bc5-99eb-c0f200020a9e", "name": "network-vif-deleted", "tag": "a828bab3-1637-46bd-83d0-472fb55e4181"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:45:16.788128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-69cb270c-d146-43c4-9394-55fb5ae6ca87 req-a71de7b8-a9a7-469d-95a7-1b612d0e0acb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:16.789003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-69cb270c-d146-43c4-9394-55fb5ae6ca87 req-a71de7b8-a9a7-469d-95a7-1b612d0e0acb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:16.789519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-69cb270c-d146-43c4-9394-55fb5ae6ca87 req-a71de7b8-a9a7-469d-95a7-1b612d0e0acb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:16.804270 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-69cb270c-d146-43c4-9394-55fb5ae6ca87 req-a71de7b8-a9a7-469d-95a7-1b612d0e0acb service nova] Creating event network-vif-deleted:a828bab3-1637-46bd-83d0-472fb55e4181 for instance d876fdf9-3d21-4bc5-99eb-c0f200020a9e on n-h1-860687-3 Oct 27 19:45:16.809918 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-69cb270c-d146-43c4-9394-55fb5ae6ca87 req-a71de7b8-a9a7-469d-95a7-1b612d0e0acb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037717 Oct 27 19:45:16.810784 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3829/7509] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:45:17.224214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-32d8cfb9-06ec-4aa0-84c4-8fdf5216c99d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:17.224776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-32d8cfb9-06ec-4aa0-84c4-8fdf5216c99d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:17.232417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32d8cfb9-06ec-4aa0-84c4-8fdf5216c99d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:17.232926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32d8cfb9-06ec-4aa0-84c4-8fdf5216c99d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:17.233388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32d8cfb9-06ec-4aa0-84c4-8fdf5216c99d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:17.234136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32d8cfb9-06ec-4aa0-84c4-8fdf5216c99d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:17.234648 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32d8cfb9-06ec-4aa0-84c4-8fdf5216c99d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:17.235101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32d8cfb9-06ec-4aa0-84c4-8fdf5216c99d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:17.268159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32d8cfb9-06ec-4aa0-84c4-8fdf5216c99d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:17.268672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32d8cfb9-06ec-4aa0-84c4-8fdf5216c99d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:17.269132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-32d8cfb9-06ec-4aa0-84c4-8fdf5216c99d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:17.269601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-32d8cfb9-06ec-4aa0-84c4-8fdf5216c99d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lazy-loading 'fault' on Instance uuid d876fdf9-3d21-4bc5-99eb-c0f200020a9e {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:45:17.314356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-32d8cfb9-06ec-4aa0-84c4-8fdf5216c99d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3346a44186e40dd954f245bb08d3f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644f660823684a01a3eefd7bb0f9dfc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:17.322874 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-32d8cfb9-06ec-4aa0-84c4-8fdf5216c99d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 200 len: 1307 microversion: 2.1 time: 0.102669 Oct 27 19:45:17.323734 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3681/7510] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:17 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:18.350227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-44cf0735-47cc-43bc-a480-655fb4917a8d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:18.350960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-44cf0735-47cc-43bc-a480-655fb4917a8d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] [instance: d876fdf9-3d21-4bc5-99eb-c0f200020a9e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:18.357705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44cf0735-47cc-43bc-a480-655fb4917a8d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:18.358199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44cf0735-47cc-43bc-a480-655fb4917a8d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:18.358672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44cf0735-47cc-43bc-a480-655fb4917a8d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:18.359838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44cf0735-47cc-43bc-a480-655fb4917a8d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:18.360310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44cf0735-47cc-43bc-a480-655fb4917a8d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:18.360744 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-44cf0735-47cc-43bc-a480-655fb4917a8d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:18.374215 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-44cf0735-47cc-43bc-a480-655fb4917a8d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] HTTP exception thrown: Instance d876fdf9-3d21-4bc5-99eb-c0f200020a9e could not be found. Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-44cf0735-47cc-43bc-a480-655fb4917a8d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Request method failure captured: Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e HTTP/1.1 Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt-xhmrMTYxt7rBkZxaNkFBr38jpbbc1xYCg3w1QKXAXAcQkjZ4NdLaf2wSAdXSVEY4KyZTdVjRI_38kbHzKtSQedDv1l24TtDOPxV-Osahbqzxb82os7qn2PdPFkWHAitJwuSgwxWBGxQY_Xd3L0CYcgejEO1RR_s1K1Rt557rd5ZQ Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 644f660823684a01a3eefd7bb0f9dfc0 Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_644f660823684a01a3eefd7bb0f9dfc0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/644f660823684a01a3eefd7bb0f9dfc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 644f660823684a01a3eefd7bb0f9dfc0 Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-ServersNegativeTestJSON-172786693 Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-ServersNegativeTestJSON-172786693-project Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: b3346a44186e40dd954f245bb08d3f6c Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-ServersNegativeTestJSON-172786693-project Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance d876fdf9-3d21-4bc5-99eb-c0f200020a9e could not be found. Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'd876fdf9-3d21-4bc5-99eb-c0f200020a9e'} Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d876fdf9-3d21-4bc5-99eb-c0f200020a9e could not be found. Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d876fdf9-3d21-4bc5-99eb-c0f200020a9e could not be found. Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:45:18.375866 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:18.380348 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:45:18.380348 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:45:18.380348 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:45:18.380348 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:45:18.380348 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:45:18.380348 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d876fdf9-3d21-4bc5-99eb-c0f200020a9e could not be found. Oct 27 19:45:18.380348 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:45:18.380348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-44cf0735-47cc-43bc-a480-655fb4917a8d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] Returning 404 to user: Instance d876fdf9-3d21-4bc5-99eb-c0f200020a9e could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:45:18.380348 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-44cf0735-47cc-43bc-a480-655fb4917a8d tempest-ServersNegativeTestJSON-172786693 tempest-ServersNegativeTestJSON-172786693-project] 10.222.0.42 "GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e" status: 404 len: 111 microversion: 2.1 time: 0.032250 Oct 27 19:45:18.380348 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3830/7511] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:18 2022] GET /compute/v2.1/servers/d876fdf9-3d21-4bc5-99eb-c0f200020a9e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:45:51.373088 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 19:45:51.373676 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 19:45:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.42) !!! Oct 27 19:45:51.375087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:45:51.376046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:45:51.572899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-930753aa-a26b-4519-9854-f7944b8d1911 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Action: 'create', calling method: .version_select at 0x7fc86b1fa9d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2025674409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFiAR1a6LubUzKr0LgKh2GlXJj0hWfwJya6DVjstxkojKdjL5QVoROwMppPLmtD7w/xS00pY1UjYJ59YzQydS97eMcc+h6FR66e4EhfSNEqRnRnS5mY2UxyDQv4/w6R3Q=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:45:51.590372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-930753aa-a26b-4519-9854-f7944b8d1911 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Getting quotas for project ed78653a585844d7a9a87ca61890af77. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:45:51.596200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-930753aa-a26b-4519-9854-f7944b8d1911 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Getting quotas for user 4f5ac2c017be437ab418c19504dc55b2 and project ed78653a585844d7a9a87ca61890af77. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:45:51.643608 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-930753aa-a26b-4519-9854-f7944b8d1911 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.276778 Oct 27 19:45:51.644236 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3682/7512] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:45:51 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:45:51.698259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1504730269", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2025674409", "networks": [{"uuid": "37eebe64-a4e1-4566-a24a-172f48495360"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:45:51.718233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=33 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:45:51.719583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:45:51.758585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] validate_networks() for [('37eebe64-a4e1-4566-a24a-172f48495360', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:45:52.131495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:45:52.131983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:45:52.132679 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:45:52.133130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:45:52.133598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:45:52.144835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:52.145372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:52.145843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:52.146681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:52.147171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:52.147635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:52.165907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Getting quotas for project ed78653a585844d7a9a87ca61890af77. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:45:52.172066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Getting quotas for user 4f5ac2c017be437ab418c19504dc55b2 and project ed78653a585844d7a9a87ca61890af77. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:45:52.185535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:45:52.187947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:45:52.239149 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-99713eb2-806a-4e7f-8ad2-d76be32f745b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545161 Oct 27 19:45:52.245792 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3831/7513] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:45:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:45:52.252138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ad1d33d-1f3e-4fc4-936f-5d3f7821f057 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:52.253149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ad1d33d-1f3e-4fc4-936f-5d3f7821f057 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:52.315115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ad1d33d-1f3e-4fc4-936f-5d3f7821f057 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:52.323831 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ad1d33d-1f3e-4fc4-936f-5d3f7821f057 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 200 len: 1263 microversion: 2.1 time: 0.076001 Oct 27 19:45:52.325149 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3683/7514] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:52 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 1263 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:53.349131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-946d9769-47fc-4ce4-9870-fce9dc21fdaa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:53.349751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-946d9769-47fc-4ce4-9870-fce9dc21fdaa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:53.355839 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-946d9769-47fc-4ce4-9870-fce9dc21fdaa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:53.356697 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-946d9769-47fc-4ce4-9870-fce9dc21fdaa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:53.357154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-946d9769-47fc-4ce4-9870-fce9dc21fdaa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:53.357919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-946d9769-47fc-4ce4-9870-fce9dc21fdaa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:53.358402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-946d9769-47fc-4ce4-9870-fce9dc21fdaa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:53.358918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-946d9769-47fc-4ce4-9870-fce9dc21fdaa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:53.424444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-946d9769-47fc-4ce4-9870-fce9dc21fdaa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:53.432520 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-946d9769-47fc-4ce4-9870-fce9dc21fdaa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 200 len: 1315 microversion: 2.1 time: 0.088903 Oct 27 19:45:53.433093 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3832/7515] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:53 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 1315 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:54.457305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c839c6bf-76dd-45f4-bdbf-e1dc9dd269c1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:54.458613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c839c6bf-76dd-45f4-bdbf-e1dc9dd269c1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:54.472430 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c839c6bf-76dd-45f4-bdbf-e1dc9dd269c1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:54.478224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c839c6bf-76dd-45f4-bdbf-e1dc9dd269c1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:54.478875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c839c6bf-76dd-45f4-bdbf-e1dc9dd269c1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:54.479752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c839c6bf-76dd-45f4-bdbf-e1dc9dd269c1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:54.480316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c839c6bf-76dd-45f4-bdbf-e1dc9dd269c1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:54.481791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c839c6bf-76dd-45f4-bdbf-e1dc9dd269c1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:54.665975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c839c6bf-76dd-45f4-bdbf-e1dc9dd269c1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:54.676246 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c839c6bf-76dd-45f4-bdbf-e1dc9dd269c1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 200 len: 1363 microversion: 2.1 time: 0.222985 Oct 27 19:45:54.676846 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3684/7516] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:54 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:55.084615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-f6c27894-db2a-4fd6-9cd4-2cdbe0834653 req-63d0e0c1-2bbd-4b33-97ae-ec18bf833c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9371b8dd-ccf0-433b-89f6-7309e3274bc3", "tag": "98bcaebb-4521-40ac-a394-50222745d167"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:45:55.107340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f6c27894-db2a-4fd6-9cd4-2cdbe0834653 req-63d0e0c1-2bbd-4b33-97ae-ec18bf833c58 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:55.108256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f6c27894-db2a-4fd6-9cd4-2cdbe0834653 req-63d0e0c1-2bbd-4b33-97ae-ec18bf833c58 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:55.110438 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f6c27894-db2a-4fd6-9cd4-2cdbe0834653 req-63d0e0c1-2bbd-4b33-97ae-ec18bf833c58 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:55.126665 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-f6c27894-db2a-4fd6-9cd4-2cdbe0834653 req-63d0e0c1-2bbd-4b33-97ae-ec18bf833c58 service nova] Creating event network-changed:98bcaebb-4521-40ac-a394-50222745d167 for instance 9371b8dd-ccf0-433b-89f6-7309e3274bc3 on n-h1-860687-3 Oct 27 19:45:55.146782 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-f6c27894-db2a-4fd6-9cd4-2cdbe0834653 req-63d0e0c1-2bbd-4b33-97ae-ec18bf833c58 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056552 Oct 27 19:45:55.148099 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3833/7517] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:45:55.700749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-97f43b4b-d6aa-4dcc-9c86-6d4f995b519a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:55.701386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-97f43b4b-d6aa-4dcc-9c86-6d4f995b519a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:55.708694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97f43b4b-d6aa-4dcc-9c86-6d4f995b519a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:55.709209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97f43b4b-d6aa-4dcc-9c86-6d4f995b519a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:55.709677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97f43b4b-d6aa-4dcc-9c86-6d4f995b519a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:55.710423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97f43b4b-d6aa-4dcc-9c86-6d4f995b519a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:55.710913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97f43b4b-d6aa-4dcc-9c86-6d4f995b519a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:55.711369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97f43b4b-d6aa-4dcc-9c86-6d4f995b519a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:55.847150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-97f43b4b-d6aa-4dcc-9c86-6d4f995b519a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:55.855047 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-97f43b4b-d6aa-4dcc-9c86-6d4f995b519a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 200 len: 1363 microversion: 2.1 time: 0.158947 Oct 27 19:45:55.855642 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3685/7518] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:55 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:56.879516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8ed610e9-7554-47db-9734-2acd2e4256e4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:56.880226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8ed610e9-7554-47db-9734-2acd2e4256e4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:56.893118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed610e9-7554-47db-9734-2acd2e4256e4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:56.897021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed610e9-7554-47db-9734-2acd2e4256e4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:56.898059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed610e9-7554-47db-9734-2acd2e4256e4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:56.899312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed610e9-7554-47db-9734-2acd2e4256e4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:56.903395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed610e9-7554-47db-9734-2acd2e4256e4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:56.904256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8ed610e9-7554-47db-9734-2acd2e4256e4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:57.089523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8ed610e9-7554-47db-9734-2acd2e4256e4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:57.098540 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8ed610e9-7554-47db-9734-2acd2e4256e4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 200 len: 1363 microversion: 2.1 time: 0.223922 Oct 27 19:45:57.099214 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3834/7519] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:56 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:58.121987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b7f11dd1-6faf-42bb-9d55-c278fdd258fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:58.122736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b7f11dd1-6faf-42bb-9d55-c278fdd258fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:58.129619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7f11dd1-6faf-42bb-9d55-c278fdd258fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:58.130129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7f11dd1-6faf-42bb-9d55-c278fdd258fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:58.130621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7f11dd1-6faf-42bb-9d55-c278fdd258fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:58.131396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7f11dd1-6faf-42bb-9d55-c278fdd258fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:58.131852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7f11dd1-6faf-42bb-9d55-c278fdd258fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:58.132303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b7f11dd1-6faf-42bb-9d55-c278fdd258fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:58.266338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b7f11dd1-6faf-42bb-9d55-c278fdd258fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:58.274067 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b7f11dd1-6faf-42bb-9d55-c278fdd258fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 200 len: 1363 microversion: 2.1 time: 0.156744 Oct 27 19:45:58.274679 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3686/7520] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:58 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:45:59.297716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4a534dcf-4b60-43e7-b717-27d67ef534f2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:45:59.298369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4a534dcf-4b60-43e7-b717-27d67ef534f2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:45:59.304905 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a534dcf-4b60-43e7-b717-27d67ef534f2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:59.305403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a534dcf-4b60-43e7-b717-27d67ef534f2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:59.305857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a534dcf-4b60-43e7-b717-27d67ef534f2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:59.306596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a534dcf-4b60-43e7-b717-27d67ef534f2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:45:59.307064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a534dcf-4b60-43e7-b717-27d67ef534f2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:45:59.307505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4a534dcf-4b60-43e7-b717-27d67ef534f2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:45:59.437745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4a534dcf-4b60-43e7-b717-27d67ef534f2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:45:59.445779 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4a534dcf-4b60-43e7-b717-27d67ef534f2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 200 len: 1363 microversion: 2.1 time: 0.152469 Oct 27 19:45:59.446356 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3835/7521] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:45:59 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:00.469336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6856119-f68f-46df-93bf-de6e86694ca4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:00.469970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d6856119-f68f-46df-93bf-de6e86694ca4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:00.476723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6856119-f68f-46df-93bf-de6e86694ca4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:00.477224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6856119-f68f-46df-93bf-de6e86694ca4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:00.477680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6856119-f68f-46df-93bf-de6e86694ca4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:00.478416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6856119-f68f-46df-93bf-de6e86694ca4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:00.478891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6856119-f68f-46df-93bf-de6e86694ca4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:00.479333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6856119-f68f-46df-93bf-de6e86694ca4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:00.561325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-85edb1f0-232f-469d-98d2-e79d5eda41be req-ed6d0971-daa8-4462-abc7-fd93efd775ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9371b8dd-ccf0-433b-89f6-7309e3274bc3", "name": "network-vif-plugged", "status": "completed", "tag": "98bcaebb-4521-40ac-a394-50222745d167"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:46:00.572989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-85edb1f0-232f-469d-98d2-e79d5eda41be req-ed6d0971-daa8-4462-abc7-fd93efd775ba service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:00.573589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-85edb1f0-232f-469d-98d2-e79d5eda41be req-ed6d0971-daa8-4462-abc7-fd93efd775ba service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:00.574091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-85edb1f0-232f-469d-98d2-e79d5eda41be req-ed6d0971-daa8-4462-abc7-fd93efd775ba service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:00.588162 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-85edb1f0-232f-469d-98d2-e79d5eda41be req-ed6d0971-daa8-4462-abc7-fd93efd775ba service nova] Creating event network-vif-plugged:98bcaebb-4521-40ac-a394-50222745d167 for instance 9371b8dd-ccf0-433b-89f6-7309e3274bc3 on n-h1-860687-3 Oct 27 19:46:00.593786 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-85edb1f0-232f-469d-98d2-e79d5eda41be req-ed6d0971-daa8-4462-abc7-fd93efd775ba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040319 Oct 27 19:46:00.594710 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3836/7522] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:46:00.632006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d6856119-f68f-46df-93bf-de6e86694ca4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:00.640666 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d6856119-f68f-46df-93bf-de6e86694ca4 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 200 len: 1363 microversion: 2.1 time: 0.175815 Oct 27 19:46:00.641261 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3687/7523] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:00 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:01.665714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-00c768ee-e664-40ed-87a8-ee24402a84d2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:01.666347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-00c768ee-e664-40ed-87a8-ee24402a84d2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:01.673610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00c768ee-e664-40ed-87a8-ee24402a84d2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:01.674102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00c768ee-e664-40ed-87a8-ee24402a84d2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:01.674581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00c768ee-e664-40ed-87a8-ee24402a84d2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:01.675269 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00c768ee-e664-40ed-87a8-ee24402a84d2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:01.675732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00c768ee-e664-40ed-87a8-ee24402a84d2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:01.676159 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-00c768ee-e664-40ed-87a8-ee24402a84d2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:01.816389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-00c768ee-e664-40ed-87a8-ee24402a84d2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:01.824123 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-00c768ee-e664-40ed-87a8-ee24402a84d2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 200 len: 1363 microversion: 2.1 time: 0.163602 Oct 27 19:46:01.824759 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3837/7524] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:01 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:02.847643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e87c67b6-917a-489f-a94e-ca6240dfbed0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:02.848364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e87c67b6-917a-489f-a94e-ca6240dfbed0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:02.851389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:46:02.857843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e87c67b6-917a-489f-a94e-ca6240dfbed0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:02.858435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e87c67b6-917a-489f-a94e-ca6240dfbed0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:02.858917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e87c67b6-917a-489f-a94e-ca6240dfbed0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:02.859643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e87c67b6-917a-489f-a94e-ca6240dfbed0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:02.860134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e87c67b6-917a-489f-a94e-ca6240dfbed0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:02.860625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e87c67b6-917a-489f-a94e-ca6240dfbed0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:02.999417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e87c67b6-917a-489f-a94e-ca6240dfbed0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:03.007276 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e87c67b6-917a-489f-a94e-ca6240dfbed0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 200 len: 1555 microversion: 2.1 time: 0.163700 Oct 27 19:46:03.008089 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3688/7525] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:02 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:03.030287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-169a9f37-a549-4323-a9dc-3fd41d604c36 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:03.030967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-169a9f37-a549-4323-a9dc-3fd41d604c36 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:03.032949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:46:03.033633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:46:03.041112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-169a9f37-a549-4323-a9dc-3fd41d604c36 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:03.041607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-169a9f37-a549-4323-a9dc-3fd41d604c36 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:03.042054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-169a9f37-a549-4323-a9dc-3fd41d604c36 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:03.042789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-169a9f37-a549-4323-a9dc-3fd41d604c36 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:03.043897 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-169a9f37-a549-4323-a9dc-3fd41d604c36 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:03.044309 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-169a9f37-a549-4323-a9dc-3fd41d604c36 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:03.173539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-169a9f37-a549-4323-a9dc-3fd41d604c36 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:03.181311 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-169a9f37-a549-4323-a9dc-3fd41d604c36 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 200 len: 1555 microversion: 2.1 time: 0.155089 Oct 27 19:46:03.181891 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3838/7526] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:03 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:04.780228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-61e268db-5153-49f0-8f16-0cb0e6549ec0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa7a2c2f-4f6a-4cd4-afe5-c64e69db9de2"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:46:04.782716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-61e268db-5153-49f0-8f16-0cb0e6549ec0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:04.789503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61e268db-5153-49f0-8f16-0cb0e6549ec0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:04.790040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61e268db-5153-49f0-8f16-0cb0e6549ec0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:04.790522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61e268db-5153-49f0-8f16-0cb0e6549ec0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:04.791237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61e268db-5153-49f0-8f16-0cb0e6549ec0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:04.791709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61e268db-5153-49f0-8f16-0cb0e6549ec0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:04.792154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61e268db-5153-49f0-8f16-0cb0e6549ec0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:05.041988 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-61e268db-5153-49f0-8f16-0cb0e6549ec0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "POST /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266513 Oct 27 19:46:05.042661 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3689/7527] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:46:04 2022] POST /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:15.758955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-67cbc328-145e-4f13-9eaf-8fb80dd5a8fc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:15.759483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-67cbc328-145e-4f13-9eaf-8fb80dd5a8fc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:15.762254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:46:15.763114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=36 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:46:15.769123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67cbc328-145e-4f13-9eaf-8fb80dd5a8fc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:15.769618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67cbc328-145e-4f13-9eaf-8fb80dd5a8fc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:15.770069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67cbc328-145e-4f13-9eaf-8fb80dd5a8fc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:15.770800 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67cbc328-145e-4f13-9eaf-8fb80dd5a8fc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:15.771267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67cbc328-145e-4f13-9eaf-8fb80dd5a8fc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:15.771711 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67cbc328-145e-4f13-9eaf-8fb80dd5a8fc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:15.854327 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-67cbc328-145e-4f13-9eaf-8fb80dd5a8fc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lazy-loading 'services' on Instance uuid 9371b8dd-ccf0-433b-89f6-7309e3274bc3 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:46:15.929145 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-67cbc328-145e-4f13-9eaf-8fb80dd5a8fc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments/aa7a2c2f-4f6a-4cd4-afe5-c64e69db9de2" status: 202 len: 0 microversion: 2.1 time: 0.174095 Oct 27 19:46:15.929780 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3839/7528] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:46:15 2022] DELETE /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments/aa7a2c2f-4f6a-4cd4-afe5-c64e69db9de2 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:46:15.936286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:46:15.937101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:46:15.942691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6dee7d1b-318e-4719-a634-176469d1e87e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:15.945608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6dee7d1b-318e-4719-a634-176469d1e87e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:15.954935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dee7d1b-318e-4719-a634-176469d1e87e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:15.955452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dee7d1b-318e-4719-a634-176469d1e87e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:15.955914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dee7d1b-318e-4719-a634-176469d1e87e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:15.956641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dee7d1b-318e-4719-a634-176469d1e87e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:15.957118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dee7d1b-318e-4719-a634-176469d1e87e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:15.957567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dee7d1b-318e-4719-a634-176469d1e87e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:15.995328 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6dee7d1b-318e-4719-a634-176469d1e87e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060954 Oct 27 19:46:15.996421 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3690/7529] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:46:15 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:17.009556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f31f9ea7-bbe6-4229-9154-e644b893b6dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:17.012722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f31f9ea7-bbe6-4229-9154-e644b893b6dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:17.018946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f31f9ea7-bbe6-4229-9154-e644b893b6dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:17.019444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f31f9ea7-bbe6-4229-9154-e644b893b6dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:17.019889 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f31f9ea7-bbe6-4229-9154-e644b893b6dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:17.020595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f31f9ea7-bbe6-4229-9154-e644b893b6dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:17.021058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f31f9ea7-bbe6-4229-9154-e644b893b6dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:17.021495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f31f9ea7-bbe6-4229-9154-e644b893b6dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:17.054195 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f31f9ea7-bbe6-4229-9154-e644b893b6dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049841 Oct 27 19:46:17.054801 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3840/7530] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:46:17 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:18.067570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e2a6a6df-24d6-4994-950f-04c6e25f1e48 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:18.069775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e2a6a6df-24d6-4994-950f-04c6e25f1e48 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:18.077071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a6a6df-24d6-4994-950f-04c6e25f1e48 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:18.077745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a6a6df-24d6-4994-950f-04c6e25f1e48 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:18.078018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a6a6df-24d6-4994-950f-04c6e25f1e48 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:18.078772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a6a6df-24d6-4994-950f-04c6e25f1e48 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:18.079272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a6a6df-24d6-4994-950f-04c6e25f1e48 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:18.079717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2a6a6df-24d6-4994-950f-04c6e25f1e48 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:18.112891 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e2a6a6df-24d6-4994-950f-04c6e25f1e48 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049991 Oct 27 19:46:18.113481 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3691/7531] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:46:18 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:19.125978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-67f57305-c1a5-406b-a511-f8f497612204 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:19.128150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-67f57305-c1a5-406b-a511-f8f497612204 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:19.134862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67f57305-c1a5-406b-a511-f8f497612204 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:19.135350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67f57305-c1a5-406b-a511-f8f497612204 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:19.135866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67f57305-c1a5-406b-a511-f8f497612204 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:19.136932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67f57305-c1a5-406b-a511-f8f497612204 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:19.137074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67f57305-c1a5-406b-a511-f8f497612204 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:19.137486 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67f57305-c1a5-406b-a511-f8f497612204 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:19.168883 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-67f57305-c1a5-406b-a511-f8f497612204 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046327 Oct 27 19:46:19.169546 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3841/7532] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:46:19 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:20.182870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a6b19bc8-5dd0-434f-9e27-64d11acd9231 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:20.186310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a6b19bc8-5dd0-434f-9e27-64d11acd9231 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:20.193848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6b19bc8-5dd0-434f-9e27-64d11acd9231 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:20.194523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6b19bc8-5dd0-434f-9e27-64d11acd9231 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:20.194993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6b19bc8-5dd0-434f-9e27-64d11acd9231 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:20.195893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6b19bc8-5dd0-434f-9e27-64d11acd9231 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:20.196521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6b19bc8-5dd0-434f-9e27-64d11acd9231 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:20.197129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6b19bc8-5dd0-434f-9e27-64d11acd9231 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:20.229797 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a6b19bc8-5dd0-434f-9e27-64d11acd9231 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052393 Oct 27 19:46:20.230914 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3692/7533] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:46:20 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:21.243825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1fb8d6ae-d91c-4eb9-8d56-6ac1a84ce4bb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:21.246776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1fb8d6ae-d91c-4eb9-8d56-6ac1a84ce4bb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:21.255987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fb8d6ae-d91c-4eb9-8d56-6ac1a84ce4bb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:21.256601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fb8d6ae-d91c-4eb9-8d56-6ac1a84ce4bb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:21.257267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fb8d6ae-d91c-4eb9-8d56-6ac1a84ce4bb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:21.258071 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fb8d6ae-d91c-4eb9-8d56-6ac1a84ce4bb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:21.258735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fb8d6ae-d91c-4eb9-8d56-6ac1a84ce4bb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:21.259338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fb8d6ae-d91c-4eb9-8d56-6ac1a84ce4bb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:21.288829 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1fb8d6ae-d91c-4eb9-8d56-6ac1a84ce4bb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048999 Oct 27 19:46:21.289390 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3842/7534] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:46:21 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 19:46:21.301497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7038866-3617-40a8-ad37-9ed0304aac17 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:21.302054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a7038866-3617-40a8-ad37-9ed0304aac17 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:21.308668 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7038866-3617-40a8-ad37-9ed0304aac17 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:21.309186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7038866-3617-40a8-ad37-9ed0304aac17 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:21.309670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7038866-3617-40a8-ad37-9ed0304aac17 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:21.310413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7038866-3617-40a8-ad37-9ed0304aac17 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:21.310905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7038866-3617-40a8-ad37-9ed0304aac17 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:21.311361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7038866-3617-40a8-ad37-9ed0304aac17 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:21.404227 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-a7038866-3617-40a8-ad37-9ed0304aac17 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] HTTP exception thrown: Instance 9371b8dd-ccf0-433b-89f6-7309e3274bc3 is not attached to volume aa7a2c2f-4f6a-4cd4-afe5-c64e69db9de2 Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7038866-3617-40a8-ad37-9ed0304aac17 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Request method failure captured: Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments/aa7a2c2f-4f6a-4cd4-afe5-c64e69db9de2 HTTP/1.1 Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt_qrgMxtcW-GFcVDxEo1E-OCTOsdNDx0_T8PS8tTAGBKTqbyqsFs1wtx3jR4xxgEol2NL4ri9xUMVCj501TVzUCaxRCICTU2UknGnGgsv0rwBfb18rXgYADaw5fFL_fVt_BYKvRg17eykzyrINQWeulkw2S8cm1yo3Dvna-esaF604 Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: ed78653a585844d7a9a87ca61890af77 Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ed78653a585844d7a9a87ca61890af77", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: ed78653a585844d7a9a87ca61890af77 Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestEncryptedCinderVolumes-315383562-project Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 4f5ac2c017be437ab418c19504dc55b2 Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestEncryptedCinderVolumes-315383562-project Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 9371b8dd-ccf0-433b-89f6-7309e3274bc3 is not attached to volume aa7a2c2f-4f6a-4cd4-afe5-c64e69db9de2 Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'server_id': '9371b8dd-ccf0-433b-89f6-7309e3274bc3', 'id': 'aa7a2c2f-4f6a-4cd4-afe5-c64e69db9de2'} Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id aa7a2c2f-4f6a-4cd4-afe5-c64e69db9de2. Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9371b8dd-ccf0-433b-89f6-7309e3274bc3 is not attached to volume aa7a2c2f-4f6a-4cd4-afe5-c64e69db9de2 Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:46:21.408490 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:46:21.413661 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:46:21.413661 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:46:21.413661 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9371b8dd-ccf0-433b-89f6-7309e3274bc3 is not attached to volume aa7a2c2f-4f6a-4cd4-afe5-c64e69db9de2 Oct 27 19:46:21.413661 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:21.413661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7038866-3617-40a8-ad37-9ed0304aac17 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Returning 404 to user: Instance 9371b8dd-ccf0-433b-89f6-7309e3274bc3 is not attached to volume aa7a2c2f-4f6a-4cd4-afe5-c64e69db9de2 {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:46:21.413661 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7038866-3617-40a8-ad37-9ed0304aac17 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments/aa7a2c2f-4f6a-4cd4-afe5-c64e69db9de2" status: 404 len: 154 microversion: 2.1 time: 0.113047 Oct 27 19:46:21.413661 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3693/7535] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:46:21 2022] DELETE /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3/os-volume_attachments/aa7a2c2f-4f6a-4cd4-afe5-c64e69db9de2 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:46:24.783573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7e29adc9-9e66-47cf-bf99-bef7285fc1bf tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:24.784107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7e29adc9-9e66-47cf-bf99-bef7285fc1bf tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:24.790935 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e29adc9-9e66-47cf-bf99-bef7285fc1bf tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:24.791414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e29adc9-9e66-47cf-bf99-bef7285fc1bf tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:24.791860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e29adc9-9e66-47cf-bf99-bef7285fc1bf tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:24.793078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e29adc9-9e66-47cf-bf99-bef7285fc1bf tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:24.793775 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e29adc9-9e66-47cf-bf99-bef7285fc1bf tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:24.793970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7e29adc9-9e66-47cf-bf99-bef7285fc1bf tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:24.822927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7e29adc9-9e66-47cf-bf99-bef7285fc1bf tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:46:24.917264 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7e29adc9-9e66-47cf-bf99-bef7285fc1bf tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 204 len: 0 microversion: 2.1 time: 0.137245 Oct 27 19:46:24.919216 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3843/7536] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:46:24 2022] DELETE /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:46:24.928006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-23e07466-b119-439b-9876-77db83daf019 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:24.929085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-23e07466-b119-439b-9876-77db83daf019 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:24.937483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23e07466-b119-439b-9876-77db83daf019 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:24.938002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23e07466-b119-439b-9876-77db83daf019 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:24.938499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23e07466-b119-439b-9876-77db83daf019 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:24.939279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23e07466-b119-439b-9876-77db83daf019 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:24.939963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23e07466-b119-439b-9876-77db83daf019 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:24.940460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-23e07466-b119-439b-9876-77db83daf019 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:25.075164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-23e07466-b119-439b-9876-77db83daf019 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:25.083582 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-23e07466-b119-439b-9876-77db83daf019 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 200 len: 1561 microversion: 2.1 time: 0.159608 Oct 27 19:46:25.084154 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3694/7537] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:24 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:26.109592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e2e83874-9f96-49c9-9e11-45e3b1941175 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:26.110480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e2e83874-9f96-49c9-9e11-45e3b1941175 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:26.117290 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2e83874-9f96-49c9-9e11-45e3b1941175 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:26.117781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2e83874-9f96-49c9-9e11-45e3b1941175 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:26.118230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2e83874-9f96-49c9-9e11-45e3b1941175 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:26.119015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2e83874-9f96-49c9-9e11-45e3b1941175 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:26.119517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2e83874-9f96-49c9-9e11-45e3b1941175 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:26.120001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e2e83874-9f96-49c9-9e11-45e3b1941175 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:26.254440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e2e83874-9f96-49c9-9e11-45e3b1941175 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:26.262790 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e2e83874-9f96-49c9-9e11-45e3b1941175 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 200 len: 1561 microversion: 2.1 time: 0.158154 Oct 27 19:46:26.263378 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3844/7538] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:26 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:27.016266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-30952383-5ad1-41aa-a3c7-e795e5cc0841 req-780440c8-b49c-4935-9520-e8ee0ff55795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9371b8dd-ccf0-433b-89f6-7309e3274bc3", "name": "network-vif-deleted", "tag": "98bcaebb-4521-40ac-a394-50222745d167"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:46:27.027902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-30952383-5ad1-41aa-a3c7-e795e5cc0841 req-780440c8-b49c-4935-9520-e8ee0ff55795 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:27.028492 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-30952383-5ad1-41aa-a3c7-e795e5cc0841 req-780440c8-b49c-4935-9520-e8ee0ff55795 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:27.028960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-30952383-5ad1-41aa-a3c7-e795e5cc0841 req-780440c8-b49c-4935-9520-e8ee0ff55795 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:27.041285 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-30952383-5ad1-41aa-a3c7-e795e5cc0841 req-780440c8-b49c-4935-9520-e8ee0ff55795 service nova] Creating event network-vif-deleted:98bcaebb-4521-40ac-a394-50222745d167 for instance 9371b8dd-ccf0-433b-89f6-7309e3274bc3 on n-h1-860687-3 Oct 27 19:46:27.047925 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-30952383-5ad1-41aa-a3c7-e795e5cc0841 req-780440c8-b49c-4935-9520-e8ee0ff55795 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035580 Oct 27 19:46:27.049319 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3695/7539] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:27.285887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1075ef61-6e72-44b0-982b-ffc25c7d0c4e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:27.286654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1075ef61-6e72-44b0-982b-ffc25c7d0c4e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:27.293414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1075ef61-6e72-44b0-982b-ffc25c7d0c4e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:27.293903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1075ef61-6e72-44b0-982b-ffc25c7d0c4e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:27.294364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1075ef61-6e72-44b0-982b-ffc25c7d0c4e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:27.295065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1075ef61-6e72-44b0-982b-ffc25c7d0c4e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:27.295524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1075ef61-6e72-44b0-982b-ffc25c7d0c4e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:27.295956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1075ef61-6e72-44b0-982b-ffc25c7d0c4e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:27.328256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1075ef61-6e72-44b0-982b-ffc25c7d0c4e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:27.328742 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1075ef61-6e72-44b0-982b-ffc25c7d0c4e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:27.329183 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1075ef61-6e72-44b0-982b-ffc25c7d0c4e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:27.329636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-1075ef61-6e72-44b0-982b-ffc25c7d0c4e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lazy-loading 'fault' on Instance uuid 9371b8dd-ccf0-433b-89f6-7309e3274bc3 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:46:27.371322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1075ef61-6e72-44b0-982b-ffc25c7d0c4e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:27.379176 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1075ef61-6e72-44b0-982b-ffc25c7d0c4e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 200 len: 1353 microversion: 2.1 time: 0.097248 Oct 27 19:46:27.379754 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3845/7540] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:27 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 1353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:28.405007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-089ecd88-5c6f-4a75-9853-eff9ae48e1cc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:28.405753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-089ecd88-5c6f-4a75-9853-eff9ae48e1cc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 9371b8dd-ccf0-433b-89f6-7309e3274bc3] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:28.412029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-089ecd88-5c6f-4a75-9853-eff9ae48e1cc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:28.412539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-089ecd88-5c6f-4a75-9853-eff9ae48e1cc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:28.413001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-089ecd88-5c6f-4a75-9853-eff9ae48e1cc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:28.413718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-089ecd88-5c6f-4a75-9853-eff9ae48e1cc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:28.414199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-089ecd88-5c6f-4a75-9853-eff9ae48e1cc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:28.414683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-089ecd88-5c6f-4a75-9853-eff9ae48e1cc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:28.428235 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-089ecd88-5c6f-4a75-9853-eff9ae48e1cc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] HTTP exception thrown: Instance 9371b8dd-ccf0-433b-89f6-7309e3274bc3 could not be found. Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-089ecd88-5c6f-4a75-9853-eff9ae48e1cc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Request method failure captured: Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 HTTP/1.1 Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt_qrgMxtcW-GFcVDxEo1E-OCTOsdNDx0_T8PS8tTAGBKTqbyqsFs1wtx3jR4xxgEol2NL4ri9xUMVCj501TVzUCaxRCICTU2UknGnGgsv0rwBfb18rXgYADaw5fFL_fVt_BYKvRg17eykzyrINQWeulkw2S8cm1yo3Dvna-esaF604 Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: ed78653a585844d7a9a87ca61890af77 Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ed78653a585844d7a9a87ca61890af77", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: ed78653a585844d7a9a87ca61890af77 Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestEncryptedCinderVolumes-315383562-project Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 4f5ac2c017be437ab418c19504dc55b2 Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestEncryptedCinderVolumes-315383562-project Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 9371b8dd-ccf0-433b-89f6-7309e3274bc3 could not be found. Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '9371b8dd-ccf0-433b-89f6-7309e3274bc3'} Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9371b8dd-ccf0-433b-89f6-7309e3274bc3 could not be found. Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9371b8dd-ccf0-433b-89f6-7309e3274bc3 could not be found. Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:46:28.429912 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:28.435066 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:46:28.435066 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:46:28.435066 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:46:28.435066 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:46:28.435066 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:46:28.435066 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9371b8dd-ccf0-433b-89f6-7309e3274bc3 could not be found. Oct 27 19:46:28.435066 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:28.435066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-089ecd88-5c6f-4a75-9853-eff9ae48e1cc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Returning 404 to user: Instance 9371b8dd-ccf0-433b-89f6-7309e3274bc3 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:46:28.435066 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-089ecd88-5c6f-4a75-9853-eff9ae48e1cc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3" status: 404 len: 111 microversion: 2.1 time: 0.032573 Oct 27 19:46:28.435066 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3696/7541] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:28 2022] GET /compute/v2.1/servers/9371b8dd-ccf0-433b-89f6-7309e3274bc3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:46:28.441215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c2b4dd28-512d-4930-8018-70729b3bcf65 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '.version_select at 0x7fc86b2849d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:28.466237 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c2b4dd28-512d-4930-8018-70729b3bcf65 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2025674409" status: 202 len: 0 microversion: 2.1 time: 0.029643 Oct 27 19:46:28.466862 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3846/7542] 10.222.0.42 () {58 vars in 1278 bytes} [Thu Oct 27 19:46:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2025674409 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:46:28.483918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f591222a-ab8a-4ed6-8090-910b3947dcd8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Action: 'create', calling method: .version_select at 0x7fc86a400ca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-641705134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8x3Odn/F1gvqwwA3UPjPgHNvuOo/ZPOibtC7NoCWM+COHFRfxw5AKFRqcw5UkZ9G+xJMvb3IyzFsK+iZK72yTrQvsgrUF/LAT1TEOl4C47mFWNkeuv03MbwsNfe6AGiQ=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:46:28.501455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-f591222a-ab8a-4ed6-8090-910b3947dcd8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Getting quotas for project ed78653a585844d7a9a87ca61890af77. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:46:28.507519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-f591222a-ab8a-4ed6-8090-910b3947dcd8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Getting quotas for user 4f5ac2c017be437ab418c19504dc55b2 and project ed78653a585844d7a9a87ca61890af77. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:46:28.531930 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f591222a-ab8a-4ed6-8090-910b3947dcd8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051992 Oct 27 19:46:28.532742 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3697/7543] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:46:28 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:28.585271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1334241575", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-641705134", "networks": [{"uuid": "37eebe64-a4e1-4566-a24a-172f48495360"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:46:28.641479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] validate_networks() for [('37eebe64-a4e1-4566-a24a-172f48495360', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:46:29.019810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:46:29.020243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:46:29.020724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:46:29.021142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:46:29.021563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:46:29.031493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:29.031981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:29.032714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:29.033455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:29.033918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:29.034348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:29.051384 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Getting quotas for project ed78653a585844d7a9a87ca61890af77. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:46:29.056664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Getting quotas for user 4f5ac2c017be437ab418c19504dc55b2 and project ed78653a585844d7a9a87ca61890af77. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:46:29.068936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:46:29.071284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:46:29.118211 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7b306ac5-26ac-4cd5-96bf-ae9a0bf0bdee tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536796 Oct 27 19:46:29.118896 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3847/7544] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:46:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:46:29.130524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-31bfeabf-bef2-4c4d-8782-860e51998a35 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:29.131187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-31bfeabf-bef2-4c4d-8782-860e51998a35 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:29.187959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-31bfeabf-bef2-4c4d-8782-860e51998a35 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:29.195661 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-31bfeabf-bef2-4c4d-8782-860e51998a35 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 200 len: 1262 microversion: 2.1 time: 0.068926 Oct 27 19:46:29.196100 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3698/7545] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:29 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:30.218770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f7d5fe3e-ad88-428d-80da-34828849e62a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:30.219331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f7d5fe3e-ad88-428d-80da-34828849e62a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:30.227198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7d5fe3e-ad88-428d-80da-34828849e62a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:30.227717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7d5fe3e-ad88-428d-80da-34828849e62a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:30.228151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7d5fe3e-ad88-428d-80da-34828849e62a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:30.228853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7d5fe3e-ad88-428d-80da-34828849e62a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:30.229315 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7d5fe3e-ad88-428d-80da-34828849e62a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:30.229751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f7d5fe3e-ad88-428d-80da-34828849e62a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:30.298725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f7d5fe3e-ad88-428d-80da-34828849e62a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:30.306708 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f7d5fe3e-ad88-428d-80da-34828849e62a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 200 len: 1314 microversion: 2.1 time: 0.092552 Oct 27 19:46:30.307286 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3848/7546] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:30 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 1314 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:31.331473 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e065ca19-b609-48e3-b441-9c8506aeddd2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:31.332148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e065ca19-b609-48e3-b441-9c8506aeddd2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:31.339466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e065ca19-b609-48e3-b441-9c8506aeddd2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:31.340567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e065ca19-b609-48e3-b441-9c8506aeddd2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:31.341032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e065ca19-b609-48e3-b441-9c8506aeddd2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:31.341753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e065ca19-b609-48e3-b441-9c8506aeddd2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:31.342226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e065ca19-b609-48e3-b441-9c8506aeddd2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:31.342697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e065ca19-b609-48e3-b441-9c8506aeddd2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:31.487259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e065ca19-b609-48e3-b441-9c8506aeddd2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:31.495159 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e065ca19-b609-48e3-b441-9c8506aeddd2 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 200 len: 1362 microversion: 2.1 time: 0.167700 Oct 27 19:46:31.510408 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3699/7547] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:31 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:31.696317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5031b10b-a022-4cbf-8657-0483889b0acc req-ad22869d-55e6-47ac-88c3-ec85d1cbed90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "614309c1-c824-45af-9b45-dd377fb068d8", "tag": "b150501d-e7f0-4466-b286-0949d1c91240"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:46:31.708416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5031b10b-a022-4cbf-8657-0483889b0acc req-ad22869d-55e6-47ac-88c3-ec85d1cbed90 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:31.708938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5031b10b-a022-4cbf-8657-0483889b0acc req-ad22869d-55e6-47ac-88c3-ec85d1cbed90 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:31.710423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5031b10b-a022-4cbf-8657-0483889b0acc req-ad22869d-55e6-47ac-88c3-ec85d1cbed90 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:31.724017 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5031b10b-a022-4cbf-8657-0483889b0acc req-ad22869d-55e6-47ac-88c3-ec85d1cbed90 service nova] Creating event network-changed:b150501d-e7f0-4466-b286-0949d1c91240 for instance 614309c1-c824-45af-9b45-dd377fb068d8 on n-h1-860687-3 Oct 27 19:46:31.728754 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5031b10b-a022-4cbf-8657-0483889b0acc req-ad22869d-55e6-47ac-88c3-ec85d1cbed90 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037614 Oct 27 19:46:31.729363 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3849/7548] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:32.520811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03840769-1c08-45c3-b9a1-ad6d8c06c9dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:32.521528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-03840769-1c08-45c3-b9a1-ad6d8c06c9dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:32.529458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03840769-1c08-45c3-b9a1-ad6d8c06c9dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:32.529965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03840769-1c08-45c3-b9a1-ad6d8c06c9dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:32.530459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03840769-1c08-45c3-b9a1-ad6d8c06c9dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:32.531193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03840769-1c08-45c3-b9a1-ad6d8c06c9dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:32.531675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03840769-1c08-45c3-b9a1-ad6d8c06c9dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:32.532128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03840769-1c08-45c3-b9a1-ad6d8c06c9dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:32.672919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-03840769-1c08-45c3-b9a1-ad6d8c06c9dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:32.680888 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-03840769-1c08-45c3-b9a1-ad6d8c06c9dc tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 200 len: 1362 microversion: 2.1 time: 0.164321 Oct 27 19:46:32.681470 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3700/7549] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:32 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:33.705875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9acb36a4-982e-4a56-b626-36c4da82ce09 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:33.706613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9acb36a4-982e-4a56-b626-36c4da82ce09 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:33.713615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acb36a4-982e-4a56-b626-36c4da82ce09 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:33.714113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acb36a4-982e-4a56-b626-36c4da82ce09 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:33.715153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acb36a4-982e-4a56-b626-36c4da82ce09 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:33.715850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acb36a4-982e-4a56-b626-36c4da82ce09 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:33.716308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acb36a4-982e-4a56-b626-36c4da82ce09 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:33.716767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9acb36a4-982e-4a56-b626-36c4da82ce09 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:33.854064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9acb36a4-982e-4a56-b626-36c4da82ce09 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:33.862149 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9acb36a4-982e-4a56-b626-36c4da82ce09 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 200 len: 1362 microversion: 2.1 time: 0.160890 Oct 27 19:46:33.862848 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3850/7550] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:33 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:34.886657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f7b98d3b-2b63-44cc-a859-e609dcc161f0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:34.887295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f7b98d3b-2b63-44cc-a859-e609dcc161f0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:34.894209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7b98d3b-2b63-44cc-a859-e609dcc161f0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:34.894773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7b98d3b-2b63-44cc-a859-e609dcc161f0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:34.895237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7b98d3b-2b63-44cc-a859-e609dcc161f0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:34.895956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7b98d3b-2b63-44cc-a859-e609dcc161f0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:34.896432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7b98d3b-2b63-44cc-a859-e609dcc161f0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:34.896879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7b98d3b-2b63-44cc-a859-e609dcc161f0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:35.038304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f7b98d3b-2b63-44cc-a859-e609dcc161f0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:35.046326 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f7b98d3b-2b63-44cc-a859-e609dcc161f0 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 200 len: 1362 microversion: 2.1 time: 0.163697 Oct 27 19:46:35.046939 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3701/7551] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:34 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:36.069212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1a029511-0797-40b7-94b3-c567eea4a497 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:36.069868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1a029511-0797-40b7-94b3-c567eea4a497 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:36.077720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a029511-0797-40b7-94b3-c567eea4a497 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:36.078203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a029511-0797-40b7-94b3-c567eea4a497 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:36.078670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a029511-0797-40b7-94b3-c567eea4a497 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:36.079366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a029511-0797-40b7-94b3-c567eea4a497 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:36.079823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a029511-0797-40b7-94b3-c567eea4a497 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:36.080254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1a029511-0797-40b7-94b3-c567eea4a497 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:36.213266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1a029511-0797-40b7-94b3-c567eea4a497 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:36.221832 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1a029511-0797-40b7-94b3-c567eea4a497 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 200 len: 1362 microversion: 2.1 time: 0.156967 Oct 27 19:46:36.222471 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3851/7552] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:36 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:36.725700 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-9fd71dbd-dc83-4533-9964-92a50a2213ee req-87251217-5eff-4455-b3e9-4cf983661ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614309c1-c824-45af-9b45-dd377fb068d8", "name": "network-vif-plugged", "status": "completed", "tag": "b150501d-e7f0-4466-b286-0949d1c91240"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:46:36.737302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9fd71dbd-dc83-4533-9964-92a50a2213ee req-87251217-5eff-4455-b3e9-4cf983661ccf service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:36.737933 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9fd71dbd-dc83-4533-9964-92a50a2213ee req-87251217-5eff-4455-b3e9-4cf983661ccf service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:36.738563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9fd71dbd-dc83-4533-9964-92a50a2213ee req-87251217-5eff-4455-b3e9-4cf983661ccf service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:36.751954 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-9fd71dbd-dc83-4533-9964-92a50a2213ee req-87251217-5eff-4455-b3e9-4cf983661ccf service nova] Creating event network-vif-plugged:b150501d-e7f0-4466-b286-0949d1c91240 for instance 614309c1-c824-45af-9b45-dd377fb068d8 on n-h1-860687-3 Oct 27 19:46:36.756937 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-9fd71dbd-dc83-4533-9964-92a50a2213ee req-87251217-5eff-4455-b3e9-4cf983661ccf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035194 Oct 27 19:46:36.757562 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3702/7553] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:46:37.245274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2e7eec7b-4646-49c1-9d5d-15f89f29a663 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:37.246543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2e7eec7b-4646-49c1-9d5d-15f89f29a663 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:37.253326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e7eec7b-4646-49c1-9d5d-15f89f29a663 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:37.253810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e7eec7b-4646-49c1-9d5d-15f89f29a663 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:37.254254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e7eec7b-4646-49c1-9d5d-15f89f29a663 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:37.254973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e7eec7b-4646-49c1-9d5d-15f89f29a663 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:37.255434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e7eec7b-4646-49c1-9d5d-15f89f29a663 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:37.255869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2e7eec7b-4646-49c1-9d5d-15f89f29a663 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:37.389016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2e7eec7b-4646-49c1-9d5d-15f89f29a663 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:37.396901 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2e7eec7b-4646-49c1-9d5d-15f89f29a663 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 200 len: 1362 microversion: 2.1 time: 0.155662 Oct 27 19:46:37.397468 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3852/7554] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:37 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:38.421175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4da0a85f-f44c-4b05-81fd-1842e55042ab tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:38.421899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4da0a85f-f44c-4b05-81fd-1842e55042ab tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:38.428121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4da0a85f-f44c-4b05-81fd-1842e55042ab tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:38.428652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4da0a85f-f44c-4b05-81fd-1842e55042ab tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:38.429106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4da0a85f-f44c-4b05-81fd-1842e55042ab tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:38.429822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4da0a85f-f44c-4b05-81fd-1842e55042ab tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:38.430336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4da0a85f-f44c-4b05-81fd-1842e55042ab tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:38.430822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4da0a85f-f44c-4b05-81fd-1842e55042ab tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:38.564216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4da0a85f-f44c-4b05-81fd-1842e55042ab tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:38.572769 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4da0a85f-f44c-4b05-81fd-1842e55042ab tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 200 len: 1555 microversion: 2.1 time: 0.157161 Oct 27 19:46:38.573354 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3703/7555] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:38 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:38.596517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b1fae615-dc6c-4ab4-8d9b-d4e9145d01d5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:38.597189 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b1fae615-dc6c-4ab4-8d9b-d4e9145d01d5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:38.604213 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1fae615-dc6c-4ab4-8d9b-d4e9145d01d5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:38.604758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1fae615-dc6c-4ab4-8d9b-d4e9145d01d5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:38.605855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1fae615-dc6c-4ab4-8d9b-d4e9145d01d5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:38.606596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1fae615-dc6c-4ab4-8d9b-d4e9145d01d5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:38.607070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1fae615-dc6c-4ab4-8d9b-d4e9145d01d5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:38.607509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1fae615-dc6c-4ab4-8d9b-d4e9145d01d5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:38.736592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b1fae615-dc6c-4ab4-8d9b-d4e9145d01d5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:46:38.744658 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b1fae615-dc6c-4ab4-8d9b-d4e9145d01d5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 200 len: 1555 microversion: 2.1 time: 0.152232 Oct 27 19:46:38.745370 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3853/7556] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:46:38 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:46:40.241405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-37f2975a-f08f-41d6-8949-5e460466974c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "274037c2-6461-4be5-b7e7-ba2f3c52d7d9"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:46:40.243805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-37f2975a-f08f-41d6-8949-5e460466974c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:40.246286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:46:40.252231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37f2975a-f08f-41d6-8949-5e460466974c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:40.252732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37f2975a-f08f-41d6-8949-5e460466974c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:40.253188 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37f2975a-f08f-41d6-8949-5e460466974c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:40.253896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37f2975a-f08f-41d6-8949-5e460466974c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:40.254366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37f2975a-f08f-41d6-8949-5e460466974c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:40.254833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37f2975a-f08f-41d6-8949-5e460466974c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:40.487940 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-37f2975a-f08f-41d6-8949-5e460466974c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "POST /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250245 Oct 27 19:46:40.488488 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3704/7557] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:46:40 2022] POST /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:51.203639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1c052a3a-f041-4a53-9520-f248b7a86b6f tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:51.204184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1c052a3a-f041-4a53-9520-f248b7a86b6f tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:51.206214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:46:51.206911 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:46:51.208656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:46:51.209517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:46:51.217510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c052a3a-f041-4a53-9520-f248b7a86b6f tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:51.218006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c052a3a-f041-4a53-9520-f248b7a86b6f tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:51.218610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c052a3a-f041-4a53-9520-f248b7a86b6f tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:51.219318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c052a3a-f041-4a53-9520-f248b7a86b6f tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:51.219790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c052a3a-f041-4a53-9520-f248b7a86b6f tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:51.220227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c052a3a-f041-4a53-9520-f248b7a86b6f tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:51.302875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-1c052a3a-f041-4a53-9520-f248b7a86b6f tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lazy-loading 'services' on Instance uuid 614309c1-c824-45af-9b45-dd377fb068d8 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:46:51.374408 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1c052a3a-f041-4a53-9520-f248b7a86b6f tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "DELETE /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments/274037c2-6461-4be5-b7e7-ba2f3c52d7d9" status: 202 len: 0 microversion: 2.1 time: 0.174665 Oct 27 19:46:51.375036 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3854/7558] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:46:51 2022] DELETE /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments/274037c2-6461-4be5-b7e7-ba2f3c52d7d9 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:46:51.381540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:46:51.382447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:46:51.388429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70849807-fd94-4b31-b381-413f6c6192d9 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:51.390808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-70849807-fd94-4b31-b381-413f6c6192d9 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:51.398425 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70849807-fd94-4b31-b381-413f6c6192d9 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:51.398934 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70849807-fd94-4b31-b381-413f6c6192d9 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:51.399472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70849807-fd94-4b31-b381-413f6c6192d9 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:51.400197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70849807-fd94-4b31-b381-413f6c6192d9 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:51.400669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70849807-fd94-4b31-b381-413f6c6192d9 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:51.401111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70849807-fd94-4b31-b381-413f6c6192d9 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:51.438175 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70849807-fd94-4b31-b381-413f6c6192d9 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058560 Oct 27 19:46:51.438802 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3705/7559] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:46:51 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:52.453012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ffa11973-4360-45a9-ac2f-15af1d35db01 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:52.455560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ffa11973-4360-45a9-ac2f-15af1d35db01 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:52.461904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffa11973-4360-45a9-ac2f-15af1d35db01 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:52.462407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffa11973-4360-45a9-ac2f-15af1d35db01 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:52.462861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffa11973-4360-45a9-ac2f-15af1d35db01 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:52.463561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffa11973-4360-45a9-ac2f-15af1d35db01 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:52.464259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffa11973-4360-45a9-ac2f-15af1d35db01 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:52.464824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ffa11973-4360-45a9-ac2f-15af1d35db01 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:52.496095 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ffa11973-4360-45a9-ac2f-15af1d35db01 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047946 Oct 27 19:46:52.496777 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3855/7560] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:46:52 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:53.509074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b31b3c7d-66cf-4465-a961-71a3d28fe16e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:53.512202 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b31b3c7d-66cf-4465-a961-71a3d28fe16e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:53.519536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b31b3c7d-66cf-4465-a961-71a3d28fe16e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:53.520045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b31b3c7d-66cf-4465-a961-71a3d28fe16e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:53.520505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b31b3c7d-66cf-4465-a961-71a3d28fe16e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:53.521240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b31b3c7d-66cf-4465-a961-71a3d28fe16e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:53.521718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b31b3c7d-66cf-4465-a961-71a3d28fe16e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:53.522172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b31b3c7d-66cf-4465-a961-71a3d28fe16e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:53.554317 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b31b3c7d-66cf-4465-a961-71a3d28fe16e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049354 Oct 27 19:46:53.555205 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3706/7561] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:46:53 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:54.567879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cd84f7da-78ff-4c90-936b-c90621adc8fa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:54.570169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cd84f7da-78ff-4c90-936b-c90621adc8fa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:54.577203 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd84f7da-78ff-4c90-936b-c90621adc8fa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:54.577699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd84f7da-78ff-4c90-936b-c90621adc8fa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:54.578146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd84f7da-78ff-4c90-936b-c90621adc8fa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:54.578901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd84f7da-78ff-4c90-936b-c90621adc8fa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:54.579368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd84f7da-78ff-4c90-936b-c90621adc8fa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:54.579801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd84f7da-78ff-4c90-936b-c90621adc8fa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:54.611598 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cd84f7da-78ff-4c90-936b-c90621adc8fa tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047995 Oct 27 19:46:54.612173 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3856/7562] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:46:54 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:55.624869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4fdf45dc-7c7c-43c6-9821-d48fed41be83 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:55.627134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4fdf45dc-7c7c-43c6-9821-d48fed41be83 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:55.634005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fdf45dc-7c7c-43c6-9821-d48fed41be83 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:55.634557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fdf45dc-7c7c-43c6-9821-d48fed41be83 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:55.635022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fdf45dc-7c7c-43c6-9821-d48fed41be83 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:55.636476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fdf45dc-7c7c-43c6-9821-d48fed41be83 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:55.637046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fdf45dc-7c7c-43c6-9821-d48fed41be83 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:55.637508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4fdf45dc-7c7c-43c6-9821-d48fed41be83 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:55.668296 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4fdf45dc-7c7c-43c6-9821-d48fed41be83 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048046 Oct 27 19:46:55.668870 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3707/7563] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:46:55 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:46:56.681131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4ad07cab-01b0-4044-9e92-7ffd5ffe9017 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:56.683405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4ad07cab-01b0-4044-9e92-7ffd5ffe9017 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:56.690504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ad07cab-01b0-4044-9e92-7ffd5ffe9017 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:56.690904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ad07cab-01b0-4044-9e92-7ffd5ffe9017 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:56.691361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ad07cab-01b0-4044-9e92-7ffd5ffe9017 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:56.692301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ad07cab-01b0-4044-9e92-7ffd5ffe9017 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:56.692753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ad07cab-01b0-4044-9e92-7ffd5ffe9017 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:56.693182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ad07cab-01b0-4044-9e92-7ffd5ffe9017 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:56.724895 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4ad07cab-01b0-4044-9e92-7ffd5ffe9017 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047890 Oct 27 19:46:56.725451 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3857/7564] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:46:56 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 19:46:56.736396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ca36b11-9207-4492-86b1-0c8f4b34b1fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:46:56.737030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3ca36b11-9207-4492-86b1-0c8f4b34b1fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:46:56.743975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ca36b11-9207-4492-86b1-0c8f4b34b1fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:56.744443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ca36b11-9207-4492-86b1-0c8f4b34b1fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:56.745000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ca36b11-9207-4492-86b1-0c8f4b34b1fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:56.746189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ca36b11-9207-4492-86b1-0c8f4b34b1fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:46:56.746740 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ca36b11-9207-4492-86b1-0c8f4b34b1fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:46:56.747191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ca36b11-9207-4492-86b1-0c8f4b34b1fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:46:56.827575 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-3ca36b11-9207-4492-86b1-0c8f4b34b1fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] HTTP exception thrown: Instance 614309c1-c824-45af-9b45-dd377fb068d8 is not attached to volume 274037c2-6461-4be5-b7e7-ba2f3c52d7d9 Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ca36b11-9207-4492-86b1-0c8f4b34b1fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Request method failure captured: Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments/274037c2-6461-4be5-b7e7-ba2f3c52d7d9 HTTP/1.1 Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt_qrgMxtcW-GFcVDxEo1E-OCTOsdNDx0_T8PS8tTAGBKTqbyqsFs1wtx3jR4xxgEol2NL4ri9xUMVCj501TVzUCaxRCICTU2UknGnGgsv0rwBfb18rXgYADaw5fFL_fVt_BYKvRg17eykzyrINQWeulkw2S8cm1yo3Dvna-esaF604 Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: ed78653a585844d7a9a87ca61890af77 Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ed78653a585844d7a9a87ca61890af77", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: ed78653a585844d7a9a87ca61890af77 Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestEncryptedCinderVolumes-315383562-project Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 4f5ac2c017be437ab418c19504dc55b2 Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestEncryptedCinderVolumes-315383562-project Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 614309c1-c824-45af-9b45-dd377fb068d8 is not attached to volume 274037c2-6461-4be5-b7e7-ba2f3c52d7d9 Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'server_id': '614309c1-c824-45af-9b45-dd377fb068d8', 'id': '274037c2-6461-4be5-b7e7-ba2f3c52d7d9'} Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 274037c2-6461-4be5-b7e7-ba2f3c52d7d9. Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614309c1-c824-45af-9b45-dd377fb068d8 is not attached to volume 274037c2-6461-4be5-b7e7-ba2f3c52d7d9 Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:46:56.829261 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:46:56.833936 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:46:56.833936 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:46:56.833936 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614309c1-c824-45af-9b45-dd377fb068d8 is not attached to volume 274037c2-6461-4be5-b7e7-ba2f3c52d7d9 Oct 27 19:46:56.833936 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:46:56.833936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ca36b11-9207-4492-86b1-0c8f4b34b1fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Returning 404 to user: Instance 614309c1-c824-45af-9b45-dd377fb068d8 is not attached to volume 274037c2-6461-4be5-b7e7-ba2f3c52d7d9 {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:46:56.833936 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3ca36b11-9207-4492-86b1-0c8f4b34b1fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "DELETE /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments/274037c2-6461-4be5-b7e7-ba2f3c52d7d9" status: 404 len: 154 microversion: 2.1 time: 0.098608 Oct 27 19:46:56.833936 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3708/7565] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:46:56 2022] DELETE /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8/os-volume_attachments/274037c2-6461-4be5-b7e7-ba2f3c52d7d9 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:47:00.189647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-003b98b6-ddd4-4aa4-a608-896960ae765b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:00.190238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-003b98b6-ddd4-4aa4-a608-896960ae765b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:00.197337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-003b98b6-ddd4-4aa4-a608-896960ae765b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:00.197841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-003b98b6-ddd4-4aa4-a608-896960ae765b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:00.198982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-003b98b6-ddd4-4aa4-a608-896960ae765b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:00.199878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-003b98b6-ddd4-4aa4-a608-896960ae765b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:00.200348 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-003b98b6-ddd4-4aa4-a608-896960ae765b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:00.200786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-003b98b6-ddd4-4aa4-a608-896960ae765b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:00.228622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-003b98b6-ddd4-4aa4-a608-896960ae765b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:47:00.310910 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-003b98b6-ddd4-4aa4-a608-896960ae765b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "DELETE /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 204 len: 0 microversion: 2.1 time: 0.125174 Oct 27 19:47:00.311525 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3858/7566] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:47:00 2022] DELETE /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:47:00.320317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-37974bfb-f88c-4d19-80e9-9f5eff32c099 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:00.320921 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-37974bfb-f88c-4d19-80e9-9f5eff32c099 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:00.329771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37974bfb-f88c-4d19-80e9-9f5eff32c099 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:00.330359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37974bfb-f88c-4d19-80e9-9f5eff32c099 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:00.331106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37974bfb-f88c-4d19-80e9-9f5eff32c099 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:00.332187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37974bfb-f88c-4d19-80e9-9f5eff32c099 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:00.332704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37974bfb-f88c-4d19-80e9-9f5eff32c099 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:00.333276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37974bfb-f88c-4d19-80e9-9f5eff32c099 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:00.468554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-37974bfb-f88c-4d19-80e9-9f5eff32c099 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:00.477096 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-37974bfb-f88c-4d19-80e9-9f5eff32c099 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 200 len: 1561 microversion: 2.1 time: 0.161082 Oct 27 19:47:00.477679 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3709/7567] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:00 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:01.501271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4aad2e00-e2f3-4c9a-acd6-58d12e0a2113 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:01.501978 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4aad2e00-e2f3-4c9a-acd6-58d12e0a2113 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:01.508842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aad2e00-e2f3-4c9a-acd6-58d12e0a2113 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:01.509321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aad2e00-e2f3-4c9a-acd6-58d12e0a2113 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:01.509758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aad2e00-e2f3-4c9a-acd6-58d12e0a2113 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:01.510985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aad2e00-e2f3-4c9a-acd6-58d12e0a2113 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:01.511550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aad2e00-e2f3-4c9a-acd6-58d12e0a2113 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:01.511980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4aad2e00-e2f3-4c9a-acd6-58d12e0a2113 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:01.650428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4aad2e00-e2f3-4c9a-acd6-58d12e0a2113 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:01.658286 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4aad2e00-e2f3-4c9a-acd6-58d12e0a2113 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 200 len: 1561 microversion: 2.1 time: 0.161486 Oct 27 19:47:01.658892 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3859/7568] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:01 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:02.682883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-38301c5d-9db5-4345-a704-94ee49c428a5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:02.683647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-38301c5d-9db5-4345-a704-94ee49c428a5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:02.691016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38301c5d-9db5-4345-a704-94ee49c428a5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:02.691578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38301c5d-9db5-4345-a704-94ee49c428a5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:02.692297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38301c5d-9db5-4345-a704-94ee49c428a5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:02.693036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38301c5d-9db5-4345-a704-94ee49c428a5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:02.693589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38301c5d-9db5-4345-a704-94ee49c428a5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:02.694043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38301c5d-9db5-4345-a704-94ee49c428a5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:02.804496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-38301c5d-9db5-4345-a704-94ee49c428a5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:02.813769 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-38301c5d-9db5-4345-a704-94ee49c428a5 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 200 len: 1519 microversion: 2.1 time: 0.135987 Oct 27 19:47:02.816003 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3710/7569] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:02 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 1519 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:02.835580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-8793d230-adad-41f1-992a-3023a01ed344 req-a6b3cd97-feb0-47b2-bd3e-a4d249035049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614309c1-c824-45af-9b45-dd377fb068d8", "name": "network-vif-deleted", "tag": "b150501d-e7f0-4466-b286-0949d1c91240"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:47:02.846092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8793d230-adad-41f1-992a-3023a01ed344 req-a6b3cd97-feb0-47b2-bd3e-a4d249035049 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:02.846622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8793d230-adad-41f1-992a-3023a01ed344 req-a6b3cd97-feb0-47b2-bd3e-a4d249035049 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:02.847075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8793d230-adad-41f1-992a-3023a01ed344 req-a6b3cd97-feb0-47b2-bd3e-a4d249035049 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:02.860559 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8793d230-adad-41f1-992a-3023a01ed344 req-a6b3cd97-feb0-47b2-bd3e-a4d249035049 service nova] Creating event network-vif-deleted:b150501d-e7f0-4466-b286-0949d1c91240 for instance 614309c1-c824-45af-9b45-dd377fb068d8 on n-h1-860687-3 Oct 27 19:47:02.865436 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-8793d230-adad-41f1-992a-3023a01ed344 req-a6b3cd97-feb0-47b2-bd3e-a4d249035049 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033693 Oct 27 19:47:02.866050 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3860/7570] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:47:03.837325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-513c0d88-876b-4da5-bb49-d2b4ed879ee1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:03.837868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-513c0d88-876b-4da5-bb49-d2b4ed879ee1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: 614309c1-c824-45af-9b45-dd377fb068d8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:03.845515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-513c0d88-876b-4da5-bb49-d2b4ed879ee1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:03.846015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-513c0d88-876b-4da5-bb49-d2b4ed879ee1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:03.846524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-513c0d88-876b-4da5-bb49-d2b4ed879ee1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:03.847234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-513c0d88-876b-4da5-bb49-d2b4ed879ee1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:03.847703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-513c0d88-876b-4da5-bb49-d2b4ed879ee1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:03.848148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-513c0d88-876b-4da5-bb49-d2b4ed879ee1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:03.861753 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-513c0d88-876b-4da5-bb49-d2b4ed879ee1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] HTTP exception thrown: Instance 614309c1-c824-45af-9b45-dd377fb068d8 could not be found. Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-513c0d88-876b-4da5-bb49-d2b4ed879ee1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Request method failure captured: Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 HTTP/1.1 Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWt_qrgMxtcW-GFcVDxEo1E-OCTOsdNDx0_T8PS8tTAGBKTqbyqsFs1wtx3jR4xxgEol2NL4ri9xUMVCj501TVzUCaxRCICTU2UknGnGgsv0rwBfb18rXgYADaw5fFL_fVt_BYKvRg17eykzyrINQWeulkw2S8cm1yo3Dvna-esaF604 Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: ed78653a585844d7a9a87ca61890af77 Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ed78653a585844d7a9a87ca61890af77", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: ed78653a585844d7a9a87ca61890af77 Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestEncryptedCinderVolumes-315383562-project Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 4f5ac2c017be437ab418c19504dc55b2 Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestEncryptedCinderVolumes-315383562-project Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 614309c1-c824-45af-9b45-dd377fb068d8 could not be found. Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '614309c1-c824-45af-9b45-dd377fb068d8'} Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 614309c1-c824-45af-9b45-dd377fb068d8 could not be found. Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614309c1-c824-45af-9b45-dd377fb068d8 could not be found. Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:47:03.863375 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:47:03.868552 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:47:03.868552 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:47:03.868552 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:47:03.868552 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:47:03.868552 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:47:03.868552 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614309c1-c824-45af-9b45-dd377fb068d8 could not be found. Oct 27 19:47:03.868552 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:47:03.868552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-513c0d88-876b-4da5-bb49-d2b4ed879ee1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Returning 404 to user: Instance 614309c1-c824-45af-9b45-dd377fb068d8 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:47:03.868552 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-513c0d88-876b-4da5-bb49-d2b4ed879ee1 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8" status: 404 len: 111 microversion: 2.1 time: 0.031534 Oct 27 19:47:03.868552 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3711/7571] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:03 2022] GET /compute/v2.1/servers/614309c1-c824-45af-9b45-dd377fb068d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:47:03.875753 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-909ac956-74ee-435c-8102-b87e39ea4125 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '.version_select at 0x7fc86a6f08b0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:03.896302 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-909ac956-74ee-435c-8102-b87e39ea4125 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-641705134" status: 202 len: 0 microversion: 2.1 time: 0.026159 Oct 27 19:47:03.896886 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3861/7572] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:47:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-641705134 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:47:03.913999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-63b6bd39-82e7-4921-8438-4f13a4556729 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Action: 'create', calling method: .version_select at 0x7fc86b05e0d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-801253923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLq+O4QpHFKD4LEC6nsqcGqItdSYKekhihI+pxmlIX5QEDUCA95svrrhfOKQUmeCfCxgfNUaSKcFv0hvsIQjHUxoslv6JBw5dPMSQ4WCzc4/a0gO4a1RJDvyt7+nGjiYoA=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:47:03.929509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-63b6bd39-82e7-4921-8438-4f13a4556729 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Getting quotas for project ed78653a585844d7a9a87ca61890af77. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:47:03.936097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-63b6bd39-82e7-4921-8438-4f13a4556729 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Getting quotas for user 4f5ac2c017be437ab418c19504dc55b2 and project ed78653a585844d7a9a87ca61890af77. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:47:03.962031 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-63b6bd39-82e7-4921-8438-4f13a4556729 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.052033 Oct 27 19:47:03.962668 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3712/7573] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:47:03 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:47:04.014231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-257031377", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-801253923", "networks": [{"uuid": "37eebe64-a4e1-4566-a24a-172f48495360"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:47:04.067349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] validate_networks() for [('37eebe64-a4e1-4566-a24a-172f48495360', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:47:04.442317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:47:04.442779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:47:04.443262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:47:04.443678 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:47:04.444098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:47:04.453135 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:04.453615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:04.454087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:04.454922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:04.455377 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:04.455803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:04.472577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Getting quotas for project ed78653a585844d7a9a87ca61890af77. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:47:04.478274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Getting quotas for user 4f5ac2c017be437ab418c19504dc55b2 and project ed78653a585844d7a9a87ca61890af77. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:47:04.491274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:47:04.493710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:47:04.540530 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c51d9a47-9756-4878-bed0-7535baf3e414 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531026 Oct 27 19:47:04.541192 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3862/7574] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:47:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:47:04.553059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9da85fe7-3e36-41f2-9c19-065b277205a9 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:04.553682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9da85fe7-3e36-41f2-9c19-065b277205a9 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:04.611878 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9da85fe7-3e36-41f2-9c19-065b277205a9 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:04.619444 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9da85fe7-3e36-41f2-9c19-065b277205a9 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 200 len: 1261 microversion: 2.1 time: 0.070381 Oct 27 19:47:04.620251 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3713/7575] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:04 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 1261 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:05.642919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6000c34-a6b2-4899-8831-3998aecf79fb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:05.643758 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d6000c34-a6b2-4899-8831-3998aecf79fb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:05.652558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6000c34-a6b2-4899-8831-3998aecf79fb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:05.653059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6000c34-a6b2-4899-8831-3998aecf79fb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:05.653509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6000c34-a6b2-4899-8831-3998aecf79fb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:05.654232 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6000c34-a6b2-4899-8831-3998aecf79fb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:05.654724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6000c34-a6b2-4899-8831-3998aecf79fb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:05.655162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6000c34-a6b2-4899-8831-3998aecf79fb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:05.727956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d6000c34-a6b2-4899-8831-3998aecf79fb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:05.737279 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d6000c34-a6b2-4899-8831-3998aecf79fb tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 200 len: 1321 microversion: 2.1 time: 0.098408 Oct 27 19:47:05.738416 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3863/7576] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:05 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 1321 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:06.762688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ccabf68-b7b2-4fc0-af7c-da37a21d0c2d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:06.763331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ccabf68-b7b2-4fc0-af7c-da37a21d0c2d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:06.770747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ccabf68-b7b2-4fc0-af7c-da37a21d0c2d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:06.771352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ccabf68-b7b2-4fc0-af7c-da37a21d0c2d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:06.771713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ccabf68-b7b2-4fc0-af7c-da37a21d0c2d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:06.772620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ccabf68-b7b2-4fc0-af7c-da37a21d0c2d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:06.773110 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ccabf68-b7b2-4fc0-af7c-da37a21d0c2d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:06.773562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ccabf68-b7b2-4fc0-af7c-da37a21d0c2d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:06.915852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ccabf68-b7b2-4fc0-af7c-da37a21d0c2d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:06.924513 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ccabf68-b7b2-4fc0-af7c-da37a21d0c2d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 200 len: 1361 microversion: 2.1 time: 0.166732 Oct 27 19:47:06.925133 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3714/7577] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:06 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:07.097397 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-bc2b512c-5df9-4d04-915d-638b94606181 req-14dbb423-26ea-45ae-9505-62e1015a2fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4804b44-ecba-46a0-9447-22da8c626482", "tag": "9d98642a-b858-4a33-8eb2-a3786d1eebf0"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:47:07.111312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-bc2b512c-5df9-4d04-915d-638b94606181 req-14dbb423-26ea-45ae-9505-62e1015a2fdc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:07.111900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-bc2b512c-5df9-4d04-915d-638b94606181 req-14dbb423-26ea-45ae-9505-62e1015a2fdc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:07.112324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-bc2b512c-5df9-4d04-915d-638b94606181 req-14dbb423-26ea-45ae-9505-62e1015a2fdc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:07.126425 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-bc2b512c-5df9-4d04-915d-638b94606181 req-14dbb423-26ea-45ae-9505-62e1015a2fdc service nova] Creating event network-changed:9d98642a-b858-4a33-8eb2-a3786d1eebf0 for instance a4804b44-ecba-46a0-9447-22da8c626482 on n-h1-860687-3 Oct 27 19:47:07.131404 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-bc2b512c-5df9-4d04-915d-638b94606181 req-14dbb423-26ea-45ae-9505-62e1015a2fdc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037893 Oct 27 19:47:07.132056 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3864/7578] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:47:07.949541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-49ad6af8-9bfa-46a1-9933-f29ba0e24009 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:07.950182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-49ad6af8-9bfa-46a1-9933-f29ba0e24009 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:07.957119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49ad6af8-9bfa-46a1-9933-f29ba0e24009 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:07.957628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49ad6af8-9bfa-46a1-9933-f29ba0e24009 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:07.958090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49ad6af8-9bfa-46a1-9933-f29ba0e24009 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:07.958850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49ad6af8-9bfa-46a1-9933-f29ba0e24009 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:07.959332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49ad6af8-9bfa-46a1-9933-f29ba0e24009 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:07.959784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-49ad6af8-9bfa-46a1-9933-f29ba0e24009 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:08.094288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-49ad6af8-9bfa-46a1-9933-f29ba0e24009 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:08.102180 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-49ad6af8-9bfa-46a1-9933-f29ba0e24009 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 200 len: 1361 microversion: 2.1 time: 0.157315 Oct 27 19:47:08.102856 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3715/7579] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:07 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:09.126828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e82f3b7b-0ca9-473d-bbf4-dbc659d44cec tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:09.127533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e82f3b7b-0ca9-473d-bbf4-dbc659d44cec tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:09.134546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e82f3b7b-0ca9-473d-bbf4-dbc659d44cec tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:09.135034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e82f3b7b-0ca9-473d-bbf4-dbc659d44cec tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:09.136133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e82f3b7b-0ca9-473d-bbf4-dbc659d44cec tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:09.136956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e82f3b7b-0ca9-473d-bbf4-dbc659d44cec tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:09.137412 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e82f3b7b-0ca9-473d-bbf4-dbc659d44cec tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:09.137842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e82f3b7b-0ca9-473d-bbf4-dbc659d44cec tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:09.276987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e82f3b7b-0ca9-473d-bbf4-dbc659d44cec tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:09.284496 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e82f3b7b-0ca9-473d-bbf4-dbc659d44cec tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 200 len: 1361 microversion: 2.1 time: 0.161863 Oct 27 19:47:09.285025 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3865/7580] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:09 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:10.309419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85b71673-bbf4-4089-b110-cd85074556c3 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:10.310059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85b71673-bbf4-4089-b110-cd85074556c3 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:10.317287 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85b71673-bbf4-4089-b110-cd85074556c3 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:10.317795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85b71673-bbf4-4089-b110-cd85074556c3 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:10.318254 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85b71673-bbf4-4089-b110-cd85074556c3 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:10.319009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85b71673-bbf4-4089-b110-cd85074556c3 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:10.319487 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85b71673-bbf4-4089-b110-cd85074556c3 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:10.319938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85b71673-bbf4-4089-b110-cd85074556c3 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:10.451919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-85b71673-bbf4-4089-b110-cd85074556c3 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:10.459722 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85b71673-bbf4-4089-b110-cd85074556c3 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 200 len: 1361 microversion: 2.1 time: 0.155312 Oct 27 19:47:10.460355 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3716/7581] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:10 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:11.483892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-366b0502-6ad5-46d0-ab8b-77275ac3da70 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:11.484546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-366b0502-6ad5-46d0-ab8b-77275ac3da70 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:11.491610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-366b0502-6ad5-46d0-ab8b-77275ac3da70 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:11.492104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-366b0502-6ad5-46d0-ab8b-77275ac3da70 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:11.492588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-366b0502-6ad5-46d0-ab8b-77275ac3da70 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:11.493293 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-366b0502-6ad5-46d0-ab8b-77275ac3da70 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:11.493759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-366b0502-6ad5-46d0-ab8b-77275ac3da70 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:11.494196 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-366b0502-6ad5-46d0-ab8b-77275ac3da70 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:11.626088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-366b0502-6ad5-46d0-ab8b-77275ac3da70 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:11.633797 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-366b0502-6ad5-46d0-ab8b-77275ac3da70 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 200 len: 1361 microversion: 2.1 time: 0.154611 Oct 27 19:47:11.634377 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3866/7582] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:11 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:12.657217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cb67704e-a45b-4056-9b10-02fce5c0ae52 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:12.657850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cb67704e-a45b-4056-9b10-02fce5c0ae52 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:12.665006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb67704e-a45b-4056-9b10-02fce5c0ae52 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:12.665562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb67704e-a45b-4056-9b10-02fce5c0ae52 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:12.666019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb67704e-a45b-4056-9b10-02fce5c0ae52 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:12.667775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb67704e-a45b-4056-9b10-02fce5c0ae52 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:12.668257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb67704e-a45b-4056-9b10-02fce5c0ae52 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:12.668705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cb67704e-a45b-4056-9b10-02fce5c0ae52 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:12.804199 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-cb67704e-a45b-4056-9b10-02fce5c0ae52 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:12.813040 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cb67704e-a45b-4056-9b10-02fce5c0ae52 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 200 len: 1361 microversion: 2.1 time: 0.159739 Oct 27 19:47:12.813670 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3717/7583] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:12 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:12.961563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-7026d474-36db-4f44-9f6a-bede9a3342bd req-d90cf020-34c1-436e-87f8-fd305b3dbfaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4804b44-ecba-46a0-9447-22da8c626482", "name": "network-vif-plugged", "status": "completed", "tag": "9d98642a-b858-4a33-8eb2-a3786d1eebf0"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:47:12.976495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7026d474-36db-4f44-9f6a-bede9a3342bd req-d90cf020-34c1-436e-87f8-fd305b3dbfaa service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:12.976987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7026d474-36db-4f44-9f6a-bede9a3342bd req-d90cf020-34c1-436e-87f8-fd305b3dbfaa service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:12.977432 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7026d474-36db-4f44-9f6a-bede9a3342bd req-d90cf020-34c1-436e-87f8-fd305b3dbfaa service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:12.989536 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-7026d474-36db-4f44-9f6a-bede9a3342bd req-d90cf020-34c1-436e-87f8-fd305b3dbfaa service nova] Creating event network-vif-plugged:9d98642a-b858-4a33-8eb2-a3786d1eebf0 for instance a4804b44-ecba-46a0-9447-22da8c626482 on n-h1-860687-3 Oct 27 19:47:12.994486 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-7026d474-36db-4f44-9f6a-bede9a3342bd req-d90cf020-34c1-436e-87f8-fd305b3dbfaa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037307 Oct 27 19:47:12.995123 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3867/7584] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:47:13.837008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ed33cf0-5648-4ea2-9243-4aae38e1f710 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:13.837567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ed33cf0-5648-4ea2-9243-4aae38e1f710 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:13.845233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ed33cf0-5648-4ea2-9243-4aae38e1f710 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:13.845715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ed33cf0-5648-4ea2-9243-4aae38e1f710 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:13.846174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ed33cf0-5648-4ea2-9243-4aae38e1f710 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:13.846918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ed33cf0-5648-4ea2-9243-4aae38e1f710 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:13.847406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ed33cf0-5648-4ea2-9243-4aae38e1f710 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:13.847854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ed33cf0-5648-4ea2-9243-4aae38e1f710 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:13.989304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ed33cf0-5648-4ea2-9243-4aae38e1f710 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:13.997828 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ed33cf0-5648-4ea2-9243-4aae38e1f710 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 200 len: 1361 microversion: 2.1 time: 0.164931 Oct 27 19:47:13.998429 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3718/7585] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:13 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:15.019785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:47:15.020492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:47:15.024989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2b0025da-0359-4f11-8d2c-552d71e77d2b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:15.025696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2b0025da-0359-4f11-8d2c-552d71e77d2b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:15.032766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b0025da-0359-4f11-8d2c-552d71e77d2b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:15.033370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b0025da-0359-4f11-8d2c-552d71e77d2b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:15.034088 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b0025da-0359-4f11-8d2c-552d71e77d2b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:15.034816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b0025da-0359-4f11-8d2c-552d71e77d2b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:15.035279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b0025da-0359-4f11-8d2c-552d71e77d2b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:15.035713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2b0025da-0359-4f11-8d2c-552d71e77d2b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:15.167434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2b0025da-0359-4f11-8d2c-552d71e77d2b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:15.175628 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2b0025da-0359-4f11-8d2c-552d71e77d2b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 200 len: 1553 microversion: 2.1 time: 0.157725 Oct 27 19:47:15.176217 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3868/7586] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:15 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:15.199088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c7c4f31a-45fa-4751-adc9-b904a297d10e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:15.199729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c7c4f31a-45fa-4751-adc9-b904a297d10e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:15.201620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:47:15.208375 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7c4f31a-45fa-4751-adc9-b904a297d10e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:15.208904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7c4f31a-45fa-4751-adc9-b904a297d10e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:15.209368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7c4f31a-45fa-4751-adc9-b904a297d10e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:15.210090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7c4f31a-45fa-4751-adc9-b904a297d10e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:15.210601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7c4f31a-45fa-4751-adc9-b904a297d10e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:15.211061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7c4f31a-45fa-4751-adc9-b904a297d10e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:15.348307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c7c4f31a-45fa-4751-adc9-b904a297d10e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:15.356652 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c7c4f31a-45fa-4751-adc9-b904a297d10e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 200 len: 1553 microversion: 2.1 time: 0.161714 Oct 27 19:47:15.357228 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3719/7587] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:15 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:16.857126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d83d7b8-1e66-43b0-81ab-a0d1ccc80502 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af85760e-8f92-4c9c-ab84-a778371c59cd"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:47:16.859595 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3d83d7b8-1e66-43b0-81ab-a0d1ccc80502 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:16.866369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d83d7b8-1e66-43b0-81ab-a0d1ccc80502 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:16.866892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d83d7b8-1e66-43b0-81ab-a0d1ccc80502 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:16.867336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d83d7b8-1e66-43b0-81ab-a0d1ccc80502 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:16.868032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d83d7b8-1e66-43b0-81ab-a0d1ccc80502 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:16.868490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d83d7b8-1e66-43b0-81ab-a0d1ccc80502 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:16.868920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d83d7b8-1e66-43b0-81ab-a0d1ccc80502 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:17.108252 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3d83d7b8-1e66-43b0-81ab-a0d1ccc80502 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "POST /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255339 Oct 27 19:47:17.109008 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3869/7588] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:47:16 2022] POST /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:47:27.844958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7c8f2d2a-65ab-4831-ba87-a84ae7125930 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:27.845489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7c8f2d2a-65ab-4831-ba87-a84ae7125930 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:27.848173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:47:27.848971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=74 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:47:27.856198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d2a-65ab-4831-ba87-a84ae7125930 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:27.856713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d2a-65ab-4831-ba87-a84ae7125930 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:27.857179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d2a-65ab-4831-ba87-a84ae7125930 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:27.857905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d2a-65ab-4831-ba87-a84ae7125930 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:27.858410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d2a-65ab-4831-ba87-a84ae7125930 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:27.858867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d2a-65ab-4831-ba87-a84ae7125930 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:27.942435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-7c8f2d2a-65ab-4831-ba87-a84ae7125930 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lazy-loading 'services' on Instance uuid a4804b44-ecba-46a0-9447-22da8c626482 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:47:28.012946 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7c8f2d2a-65ab-4831-ba87-a84ae7125930 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments/af85760e-8f92-4c9c-ab84-a778371c59cd" status: 202 len: 0 microversion: 2.1 time: 0.171891 Oct 27 19:47:28.013559 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3720/7589] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:47:27 2022] DELETE /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments/af85760e-8f92-4c9c-ab84-a778371c59cd => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:47:28.020341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:47:28.021207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:47:28.026391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-93060d98-0381-43da-96a6-1bee8b7d82f6 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:28.028636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-93060d98-0381-43da-96a6-1bee8b7d82f6 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:28.036545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93060d98-0381-43da-96a6-1bee8b7d82f6 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:28.037114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93060d98-0381-43da-96a6-1bee8b7d82f6 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:28.037556 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93060d98-0381-43da-96a6-1bee8b7d82f6 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:28.038291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93060d98-0381-43da-96a6-1bee8b7d82f6 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:28.038825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93060d98-0381-43da-96a6-1bee8b7d82f6 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:28.039250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-93060d98-0381-43da-96a6-1bee8b7d82f6 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:28.074014 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-93060d98-0381-43da-96a6-1bee8b7d82f6 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055687 Oct 27 19:47:28.074606 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3870/7590] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:47:28 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:47:29.088963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70d79a9a-7529-41f6-9aca-87f79cf72d16 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:29.091456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-70d79a9a-7529-41f6-9aca-87f79cf72d16 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:29.097859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70d79a9a-7529-41f6-9aca-87f79cf72d16 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:29.098371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70d79a9a-7529-41f6-9aca-87f79cf72d16 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:29.098837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70d79a9a-7529-41f6-9aca-87f79cf72d16 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:29.099546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70d79a9a-7529-41f6-9aca-87f79cf72d16 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:29.100016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70d79a9a-7529-41f6-9aca-87f79cf72d16 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:29.100459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70d79a9a-7529-41f6-9aca-87f79cf72d16 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:29.131195 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70d79a9a-7529-41f6-9aca-87f79cf72d16 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048201 Oct 27 19:47:29.131765 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3721/7591] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:47:29 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:47:30.146825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6683adc-ecad-4eb5-9a3c-88ec233bb99a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:30.150062 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c6683adc-ecad-4eb5-9a3c-88ec233bb99a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:30.158282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6683adc-ecad-4eb5-9a3c-88ec233bb99a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:30.158845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6683adc-ecad-4eb5-9a3c-88ec233bb99a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:30.159289 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6683adc-ecad-4eb5-9a3c-88ec233bb99a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:30.160006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6683adc-ecad-4eb5-9a3c-88ec233bb99a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:30.160504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6683adc-ecad-4eb5-9a3c-88ec233bb99a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:30.160941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6683adc-ecad-4eb5-9a3c-88ec233bb99a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:30.196414 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c6683adc-ecad-4eb5-9a3c-88ec233bb99a tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055406 Oct 27 19:47:30.197009 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3871/7592] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:47:30 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:47:31.210422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-37d7cab9-874a-46ac-9079-8c85d176ca5d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:31.212547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-37d7cab9-874a-46ac-9079-8c85d176ca5d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:31.219698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37d7cab9-874a-46ac-9079-8c85d176ca5d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:31.220205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37d7cab9-874a-46ac-9079-8c85d176ca5d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:31.220664 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37d7cab9-874a-46ac-9079-8c85d176ca5d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:31.221386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37d7cab9-874a-46ac-9079-8c85d176ca5d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:31.221860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37d7cab9-874a-46ac-9079-8c85d176ca5d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:31.222301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37d7cab9-874a-46ac-9079-8c85d176ca5d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:31.253343 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-37d7cab9-874a-46ac-9079-8c85d176ca5d tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047101 Oct 27 19:47:31.253920 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3722/7593] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:47:31 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:47:32.265639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-933b6504-0184-40c0-92ac-da9a119328e7 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:32.268241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-933b6504-0184-40c0-92ac-da9a119328e7 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:32.275295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-933b6504-0184-40c0-92ac-da9a119328e7 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:32.276150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-933b6504-0184-40c0-92ac-da9a119328e7 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:32.276404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-933b6504-0184-40c0-92ac-da9a119328e7 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:32.277137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-933b6504-0184-40c0-92ac-da9a119328e7 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:32.277628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-933b6504-0184-40c0-92ac-da9a119328e7 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:32.278133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-933b6504-0184-40c0-92ac-da9a119328e7 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:32.310398 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-933b6504-0184-40c0-92ac-da9a119328e7 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048909 Oct 27 19:47:32.310990 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3872/7594] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:47:32 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:47:33.323518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6ef6b6c5-e2c7-4662-b0de-f6b4f316b50b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:33.325723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6ef6b6c5-e2c7-4662-b0de-f6b4f316b50b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:33.333128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ef6b6c5-e2c7-4662-b0de-f6b4f316b50b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:33.333628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ef6b6c5-e2c7-4662-b0de-f6b4f316b50b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:33.334085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ef6b6c5-e2c7-4662-b0de-f6b4f316b50b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:33.334820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ef6b6c5-e2c7-4662-b0de-f6b4f316b50b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:33.335291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ef6b6c5-e2c7-4662-b0de-f6b4f316b50b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:33.335735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6ef6b6c5-e2c7-4662-b0de-f6b4f316b50b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:33.365615 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6ef6b6c5-e2c7-4662-b0de-f6b4f316b50b tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046275 Oct 27 19:47:33.366178 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3723/7595] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:47:33 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 19:47:33.376841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-816b3ba5-b94b-4f89-a1d3-891e55d90dc8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:33.377335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-816b3ba5-b94b-4f89-a1d3-891e55d90dc8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:33.384136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-816b3ba5-b94b-4f89-a1d3-891e55d90dc8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:33.384624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-816b3ba5-b94b-4f89-a1d3-891e55d90dc8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:33.385145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-816b3ba5-b94b-4f89-a1d3-891e55d90dc8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:33.385846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-816b3ba5-b94b-4f89-a1d3-891e55d90dc8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:33.386301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-816b3ba5-b94b-4f89-a1d3-891e55d90dc8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:33.386763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-816b3ba5-b94b-4f89-a1d3-891e55d90dc8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:33.464780 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-816b3ba5-b94b-4f89-a1d3-891e55d90dc8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] HTTP exception thrown: Instance a4804b44-ecba-46a0-9447-22da8c626482 is not attached to volume af85760e-8f92-4c9c-ab84-a778371c59cd Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-816b3ba5-b94b-4f89-a1d3-891e55d90dc8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Request method failure captured: Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments/af85760e-8f92-4c9c-ab84-a778371c59cd HTTP/1.1 Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt_qrgMxtcW-GFcVDxEo1E-OCTOsdNDx0_T8PS8tTAGBKTqbyqsFs1wtx3jR4xxgEol2NL4ri9xUMVCj501TVzUCaxRCICTU2UknGnGgsv0rwBfb18rXgYADaw5fFL_fVt_BYKvRg17eykzyrINQWeulkw2S8cm1yo3Dvna-esaF604 Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ed78653a585844d7a9a87ca61890af77 Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ed78653a585844d7a9a87ca61890af77", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ed78653a585844d7a9a87ca61890af77 Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestEncryptedCinderVolumes-315383562-project Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 4f5ac2c017be437ab418c19504dc55b2 Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestEncryptedCinderVolumes-315383562-project Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance a4804b44-ecba-46a0-9447-22da8c626482 is not attached to volume af85760e-8f92-4c9c-ab84-a778371c59cd Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'server_id': 'a4804b44-ecba-46a0-9447-22da8c626482', 'id': 'af85760e-8f92-4c9c-ab84-a778371c59cd'} Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id af85760e-8f92-4c9c-ab84-a778371c59cd. Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4804b44-ecba-46a0-9447-22da8c626482 is not attached to volume af85760e-8f92-4c9c-ab84-a778371c59cd Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:47:33.466731 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:47:33.471614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:47:33.471614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:47:33.471614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4804b44-ecba-46a0-9447-22da8c626482 is not attached to volume af85760e-8f92-4c9c-ab84-a778371c59cd Oct 27 19:47:33.471614 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:47:33.471614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-816b3ba5-b94b-4f89-a1d3-891e55d90dc8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Returning 404 to user: Instance a4804b44-ecba-46a0-9447-22da8c626482 is not attached to volume af85760e-8f92-4c9c-ab84-a778371c59cd {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:47:33.471614 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-816b3ba5-b94b-4f89-a1d3-891e55d90dc8 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments/af85760e-8f92-4c9c-ab84-a778371c59cd" status: 404 len: 154 microversion: 2.1 time: 0.095430 Oct 27 19:47:33.471614 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3873/7596] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:47:33 2022] DELETE /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482/os-volume_attachments/af85760e-8f92-4c9c-ab84-a778371c59cd => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:47:36.823625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-220fe7b0-15da-4e32-b41e-e49b9e0df82c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:36.824383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-220fe7b0-15da-4e32-b41e-e49b9e0df82c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:36.832004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-220fe7b0-15da-4e32-b41e-e49b9e0df82c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:36.832522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-220fe7b0-15da-4e32-b41e-e49b9e0df82c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:36.832989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-220fe7b0-15da-4e32-b41e-e49b9e0df82c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:36.833781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-220fe7b0-15da-4e32-b41e-e49b9e0df82c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:36.834224 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-220fe7b0-15da-4e32-b41e-e49b9e0df82c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:36.834707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-220fe7b0-15da-4e32-b41e-e49b9e0df82c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:36.863459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-220fe7b0-15da-4e32-b41e-e49b9e0df82c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:47:36.948005 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-220fe7b0-15da-4e32-b41e-e49b9e0df82c tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 204 len: 0 microversion: 2.1 time: 0.127892 Oct 27 19:47:36.953091 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3724/7597] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:47:36 2022] DELETE /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:47:36.959411 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9e0a2b8c-0e8c-4fb3-98d7-305d056ea05e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:36.960416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9e0a2b8c-0e8c-4fb3-98d7-305d056ea05e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:36.968734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e0a2b8c-0e8c-4fb3-98d7-305d056ea05e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:36.969356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e0a2b8c-0e8c-4fb3-98d7-305d056ea05e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:36.969812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e0a2b8c-0e8c-4fb3-98d7-305d056ea05e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:36.970585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e0a2b8c-0e8c-4fb3-98d7-305d056ea05e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:36.971051 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e0a2b8c-0e8c-4fb3-98d7-305d056ea05e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:36.971490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9e0a2b8c-0e8c-4fb3-98d7-305d056ea05e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:37.104665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9e0a2b8c-0e8c-4fb3-98d7-305d056ea05e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:37.112644 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9e0a2b8c-0e8c-4fb3-98d7-305d056ea05e tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 200 len: 1559 microversion: 2.1 time: 0.158006 Oct 27 19:47:37.113216 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3874/7598] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:36 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:38.138085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-918f3bcb-9da6-4cae-b2f3-905dec9890fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:38.138836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-918f3bcb-9da6-4cae-b2f3-905dec9890fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:38.145583 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-918f3bcb-9da6-4cae-b2f3-905dec9890fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:38.146088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-918f3bcb-9da6-4cae-b2f3-905dec9890fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:38.146576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-918f3bcb-9da6-4cae-b2f3-905dec9890fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:38.147296 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-918f3bcb-9da6-4cae-b2f3-905dec9890fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:38.147770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-918f3bcb-9da6-4cae-b2f3-905dec9890fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:38.148223 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-918f3bcb-9da6-4cae-b2f3-905dec9890fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:38.284477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-918f3bcb-9da6-4cae-b2f3-905dec9890fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:38.291905 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-918f3bcb-9da6-4cae-b2f3-905dec9890fe tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 200 len: 1559 microversion: 2.1 time: 0.158812 Oct 27 19:47:38.292527 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3725/7599] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:38 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:47:39.317567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-47651129-d4a2-4513-a2ec-fb591e7e7261 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:39.318174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-47651129-d4a2-4513-a2ec-fb591e7e7261 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:39.325205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47651129-d4a2-4513-a2ec-fb591e7e7261 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:39.325692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47651129-d4a2-4513-a2ec-fb591e7e7261 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:39.326132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47651129-d4a2-4513-a2ec-fb591e7e7261 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:39.326863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47651129-d4a2-4513-a2ec-fb591e7e7261 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:39.327307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47651129-d4a2-4513-a2ec-fb591e7e7261 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:39.327736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47651129-d4a2-4513-a2ec-fb591e7e7261 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:39.437639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-47651129-d4a2-4513-a2ec-fb591e7e7261 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ac2c017be437ab418c19504dc55b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed78653a585844d7a9a87ca61890af77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:47:39.446762 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-47651129-d4a2-4513-a2ec-fb591e7e7261 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 200 len: 1517 microversion: 2.1 time: 0.134129 Oct 27 19:47:39.459739 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3875/7600] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:39 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 1517 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:47:39.491520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-db81b200-dd4a-4899-b6b8-ef01a889182c req-0c8b0ee8-ed79-4771-a902-d8d749984ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4804b44-ecba-46a0-9447-22da8c626482", "name": "network-vif-deleted", "tag": "9d98642a-b858-4a33-8eb2-a3786d1eebf0"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:47:39.503092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-db81b200-dd4a-4899-b6b8-ef01a889182c req-0c8b0ee8-ed79-4771-a902-d8d749984ecd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:39.503801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-db81b200-dd4a-4899-b6b8-ef01a889182c req-0c8b0ee8-ed79-4771-a902-d8d749984ecd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:39.504318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-db81b200-dd4a-4899-b6b8-ef01a889182c req-0c8b0ee8-ed79-4771-a902-d8d749984ecd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:39.520911 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-db81b200-dd4a-4899-b6b8-ef01a889182c req-0c8b0ee8-ed79-4771-a902-d8d749984ecd service nova] Creating event network-vif-deleted:9d98642a-b858-4a33-8eb2-a3786d1eebf0 for instance a4804b44-ecba-46a0-9447-22da8c626482 on n-h1-860687-3 Oct 27 19:47:39.527075 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-db81b200-dd4a-4899-b6b8-ef01a889182c req-0c8b0ee8-ed79-4771-a902-d8d749984ecd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038840 Oct 27 19:47:39.531054 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3726/7601] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:47:40.471380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-480a23dc-63db-489b-9a9f-51b643a8f0ad tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:40.472006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-480a23dc-63db-489b-9a9f-51b643a8f0ad tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] [instance: a4804b44-ecba-46a0-9447-22da8c626482] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:47:40.479216 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-480a23dc-63db-489b-9a9f-51b643a8f0ad tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:40.479717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-480a23dc-63db-489b-9a9f-51b643a8f0ad tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:40.480171 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-480a23dc-63db-489b-9a9f-51b643a8f0ad tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:40.480880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-480a23dc-63db-489b-9a9f-51b643a8f0ad tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:47:40.481346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-480a23dc-63db-489b-9a9f-51b643a8f0ad tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:47:40.481785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-480a23dc-63db-489b-9a9f-51b643a8f0ad tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:47:40.495407 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-480a23dc-63db-489b-9a9f-51b643a8f0ad tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] HTTP exception thrown: Instance a4804b44-ecba-46a0-9447-22da8c626482 could not be found. Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-480a23dc-63db-489b-9a9f-51b643a8f0ad tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Request method failure captured: Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 HTTP/1.1 Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWt_qrgMxtcW-GFcVDxEo1E-OCTOsdNDx0_T8PS8tTAGBKTqbyqsFs1wtx3jR4xxgEol2NL4ri9xUMVCj501TVzUCaxRCICTU2UknGnGgsv0rwBfb18rXgYADaw5fFL_fVt_BYKvRg17eykzyrINQWeulkw2S8cm1yo3Dvna-esaF604 Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: ed78653a585844d7a9a87ca61890af77 Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ed78653a585844d7a9a87ca61890af77", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed78653a585844d7a9a87ca61890af77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: ed78653a585844d7a9a87ca61890af77 Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-315383562 Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestEncryptedCinderVolumes-315383562-project Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 4f5ac2c017be437ab418c19504dc55b2 Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestEncryptedCinderVolumes-315383562-project Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance a4804b44-ecba-46a0-9447-22da8c626482 could not be found. Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'a4804b44-ecba-46a0-9447-22da8c626482'} Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4804b44-ecba-46a0-9447-22da8c626482 could not be found. Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4804b44-ecba-46a0-9447-22da8c626482 could not be found. Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:47:40.496948 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:47:40.501427 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:47:40.501427 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:47:40.501427 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:47:40.501427 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:47:40.501427 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:47:40.501427 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4804b44-ecba-46a0-9447-22da8c626482 could not be found. Oct 27 19:47:40.501427 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:47:40.501427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-480a23dc-63db-489b-9a9f-51b643a8f0ad tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Returning 404 to user: Instance a4804b44-ecba-46a0-9447-22da8c626482 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:47:40.501427 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-480a23dc-63db-489b-9a9f-51b643a8f0ad tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482" status: 404 len: 111 microversion: 2.1 time: 0.030986 Oct 27 19:47:40.501427 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3876/7602] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:47:40 2022] GET /compute/v2.1/servers/a4804b44-ecba-46a0-9447-22da8c626482 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:47:40.509075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fadf9f71-837a-459e-8876-bc4bfc565d62 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] Calling method '.version_select at 0x7fc86ac46af0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:47:40.530903 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fadf9f71-837a-459e-8876-bc4bfc565d62 tempest-TestEncryptedCinderVolumes-315383562 tempest-TestEncryptedCinderVolumes-315383562-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-801253923" status: 202 len: 0 microversion: 2.1 time: 0.027313 Oct 27 19:47:40.531670 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3727/7603] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 19:47:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-801253923 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:48:08.111836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-80b4bbe4-4624-4475-9cf4-7bcfd40f48ac tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Action: 'create', calling method: .version_select at 0x7fc86a8a99d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1261948030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+xNzZAJR9XX+tIEf6bQaYcyW1tHmW7bZ/R5n7C0OPcrRzMwAHnFwYzrpbmYYqdbBu3uWLZwgA+JVfIuUiebtwaC9YnUb/C95xTG+AroSr3PLkxVMAEHwzdw8ViXgVk9w=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:48:08.118114 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=14 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:48:08.119417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=38 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:48:08.131268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-80b4bbe4-4624-4475-9cf4-7bcfd40f48ac tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Getting quotas for project 8e51a6992dcd4ee0b08f295d39e44746. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:48:08.137571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-80b4bbe4-4624-4475-9cf4-7bcfd40f48ac tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Getting quotas for user 7472e97186cb406bbfe973fc665d7d7e and project 8e51a6992dcd4ee0b08f295d39e44746. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:48:08.160483 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-80b4bbe4-4624-4475-9cf4-7bcfd40f48ac tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053009 Oct 27 19:48:08.161066 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3877/7604] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:48:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:48:08.210371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:48:08.211179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:48:08.215663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-685032851", "imageRef": "d72c5050-fdf3-417d-8e5c-4810cd1d8724", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1261948030", "networks": [{"uuid": "5653e3b3-adab-40af-8c18-23d60336e6bd"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:48:08.270316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] validate_networks() for [('5653e3b3-adab-40af-8c18-23d60336e6bd', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:48:08.770268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:48:08.770752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:48:08.771283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:48:08.771721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:48:08.772160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:48:08.782155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:08.782698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:08.783164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:08.783931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:08.784410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:08.784861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:08.804435 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Getting quotas for project 8e51a6992dcd4ee0b08f295d39e44746. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:48:08.810458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Getting quotas for user 7472e97186cb406bbfe973fc665d7d7e and project 8e51a6992dcd4ee0b08f295d39e44746. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:48:08.824045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:48:08.826458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d72c5050-fdf3-417d-8e5c-4810cd1d8724',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:48:08.873428 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-56ccb235-a2bd-40c5-96ac-325f783e6ec1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665223 Oct 27 19:48:08.874185 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3728/7605] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:48:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:48:08.885719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a25dabc1-460b-4f9d-980e-501d04fb8a92 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:08.886333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a25dabc1-460b-4f9d-980e-501d04fb8a92 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:08.941434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a25dabc1-460b-4f9d-980e-501d04fb8a92 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:08.950260 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a25dabc1-460b-4f9d-980e-501d04fb8a92 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1258 microversion: 2.1 time: 0.068952 Oct 27 19:48:08.950995 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3878/7606] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:08 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:09.974946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-38803256-6c24-4b7d-9f57-70e0677bfa65 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:09.975592 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-38803256-6c24-4b7d-9f57-70e0677bfa65 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:09.983905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38803256-6c24-4b7d-9f57-70e0677bfa65 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:09.984689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38803256-6c24-4b7d-9f57-70e0677bfa65 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:09.985155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38803256-6c24-4b7d-9f57-70e0677bfa65 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:09.986017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38803256-6c24-4b7d-9f57-70e0677bfa65 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:09.986528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38803256-6c24-4b7d-9f57-70e0677bfa65 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:09.992477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38803256-6c24-4b7d-9f57-70e0677bfa65 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:10.053579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-38803256-6c24-4b7d-9f57-70e0677bfa65 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:10.062467 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-38803256-6c24-4b7d-9f57-70e0677bfa65 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1318 microversion: 2.1 time: 0.092413 Oct 27 19:48:10.063351 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3729/7607] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:09 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1318 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:11.087916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1334be57-e242-4f44-8684-e1f8ec354e33 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:11.088665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1334be57-e242-4f44-8684-e1f8ec354e33 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:11.096772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1334be57-e242-4f44-8684-e1f8ec354e33 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:11.097268 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1334be57-e242-4f44-8684-e1f8ec354e33 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:11.097713 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1334be57-e242-4f44-8684-e1f8ec354e33 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:11.098455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1334be57-e242-4f44-8684-e1f8ec354e33 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:11.098921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1334be57-e242-4f44-8684-e1f8ec354e33 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:11.099357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1334be57-e242-4f44-8684-e1f8ec354e33 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:11.243843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1334be57-e242-4f44-8684-e1f8ec354e33 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:11.251765 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1334be57-e242-4f44-8684-e1f8ec354e33 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1358 microversion: 2.1 time: 0.168606 Oct 27 19:48:11.252358 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3879/7608] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:11 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:12.277646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ea725b0e-e99a-460a-b682-76c12761ddd5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:12.278472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ea725b0e-e99a-460a-b682-76c12761ddd5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:12.285658 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea725b0e-e99a-460a-b682-76c12761ddd5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:12.286171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea725b0e-e99a-460a-b682-76c12761ddd5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:12.286657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea725b0e-e99a-460a-b682-76c12761ddd5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:12.287382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea725b0e-e99a-460a-b682-76c12761ddd5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:12.287854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea725b0e-e99a-460a-b682-76c12761ddd5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:12.288300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ea725b0e-e99a-460a-b682-76c12761ddd5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:12.434763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ea725b0e-e99a-460a-b682-76c12761ddd5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:12.443838 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ea725b0e-e99a-460a-b682-76c12761ddd5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1358 microversion: 2.1 time: 0.170683 Oct 27 19:48:12.444637 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3730/7609] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:12 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:13.468719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d2be5c3-ba85-44d3-81a5-a4cb0799ab6d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:13.470054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3d2be5c3-ba85-44d3-81a5-a4cb0799ab6d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:13.477123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2be5c3-ba85-44d3-81a5-a4cb0799ab6d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:13.477616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2be5c3-ba85-44d3-81a5-a4cb0799ab6d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:13.478844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2be5c3-ba85-44d3-81a5-a4cb0799ab6d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:13.479695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2be5c3-ba85-44d3-81a5-a4cb0799ab6d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:13.480262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2be5c3-ba85-44d3-81a5-a4cb0799ab6d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:13.480749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2be5c3-ba85-44d3-81a5-a4cb0799ab6d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:13.622011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3d2be5c3-ba85-44d3-81a5-a4cb0799ab6d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:13.630302 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3d2be5c3-ba85-44d3-81a5-a4cb0799ab6d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1358 microversion: 2.1 time: 0.165464 Oct 27 19:48:13.631023 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3880/7610] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:13 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:14.654442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-862915c4-6fc4-4d0a-8c6d-9dc8f7574c1a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:14.655166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-862915c4-6fc4-4d0a-8c6d-9dc8f7574c1a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:14.662481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-862915c4-6fc4-4d0a-8c6d-9dc8f7574c1a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:14.663001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-862915c4-6fc4-4d0a-8c6d-9dc8f7574c1a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:14.663465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-862915c4-6fc4-4d0a-8c6d-9dc8f7574c1a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:14.664362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-862915c4-6fc4-4d0a-8c6d-9dc8f7574c1a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:14.664954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-862915c4-6fc4-4d0a-8c6d-9dc8f7574c1a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:14.666539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-862915c4-6fc4-4d0a-8c6d-9dc8f7574c1a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:14.814603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-862915c4-6fc4-4d0a-8c6d-9dc8f7574c1a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:14.824475 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-862915c4-6fc4-4d0a-8c6d-9dc8f7574c1a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1358 microversion: 2.1 time: 0.174963 Oct 27 19:48:14.825211 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3731/7611] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:14 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:15.847890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8769c05e-2cf8-463a-84a4-53c5ecffc00b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:15.848959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8769c05e-2cf8-463a-84a4-53c5ecffc00b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:15.856876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8769c05e-2cf8-463a-84a4-53c5ecffc00b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:15.857361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8769c05e-2cf8-463a-84a4-53c5ecffc00b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:15.857840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8769c05e-2cf8-463a-84a4-53c5ecffc00b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:15.858673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8769c05e-2cf8-463a-84a4-53c5ecffc00b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:15.859210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8769c05e-2cf8-463a-84a4-53c5ecffc00b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:15.859687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8769c05e-2cf8-463a-84a4-53c5ecffc00b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:16.004943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8769c05e-2cf8-463a-84a4-53c5ecffc00b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:16.014633 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8769c05e-2cf8-463a-84a4-53c5ecffc00b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1358 microversion: 2.1 time: 0.171068 Oct 27 19:48:16.015416 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3881/7612] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:15 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:17.037378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f7507d19-265b-4669-b987-c3ce761312f4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:17.038463 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f7507d19-265b-4669-b987-c3ce761312f4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:17.048086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7507d19-265b-4669-b987-c3ce761312f4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:17.048873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7507d19-265b-4669-b987-c3ce761312f4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:17.049608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7507d19-265b-4669-b987-c3ce761312f4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:17.050441 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7507d19-265b-4669-b987-c3ce761312f4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:17.050995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7507d19-265b-4669-b987-c3ce761312f4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:17.051456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7507d19-265b-4669-b987-c3ce761312f4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:17.189116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f7507d19-265b-4669-b987-c3ce761312f4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:17.199071 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f7507d19-265b-4669-b987-c3ce761312f4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1358 microversion: 2.1 time: 0.165667 Oct 27 19:48:17.200039 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3732/7613] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:17 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:18.223311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fb55e6f7-b602-4530-90c6-01d093d40cee tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:18.223990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fb55e6f7-b602-4530-90c6-01d093d40cee tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:18.231333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb55e6f7-b602-4530-90c6-01d093d40cee tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:18.231803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb55e6f7-b602-4530-90c6-01d093d40cee tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:18.232241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb55e6f7-b602-4530-90c6-01d093d40cee tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:18.232946 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb55e6f7-b602-4530-90c6-01d093d40cee tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:18.233403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb55e6f7-b602-4530-90c6-01d093d40cee tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:18.233830 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb55e6f7-b602-4530-90c6-01d093d40cee tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:18.372779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fb55e6f7-b602-4530-90c6-01d093d40cee tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:18.381801 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fb55e6f7-b602-4530-90c6-01d093d40cee tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1358 microversion: 2.1 time: 0.162372 Oct 27 19:48:18.382419 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3882/7614] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:18 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:19.405371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7121b03-1040-4b46-af8c-26039ba71820 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:19.406009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7121b03-1040-4b46-af8c-26039ba71820 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:19.408778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:48:19.409584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:48:19.416518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7121b03-1040-4b46-af8c-26039ba71820 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:19.417078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7121b03-1040-4b46-af8c-26039ba71820 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:19.417545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7121b03-1040-4b46-af8c-26039ba71820 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:19.418628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7121b03-1040-4b46-af8c-26039ba71820 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:19.419095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7121b03-1040-4b46-af8c-26039ba71820 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:19.419618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7121b03-1040-4b46-af8c-26039ba71820 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:19.631894 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-1f901f61-cd34-4ae1-b1ce-a2b464d7559d req-b5251ac6-1249-40d8-8187-0276b8b0e1fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2dc725c-c1b6-43a6-955f-505b0fc8d609", "tag": "b1940763-9563-4d67-9540-8164094bf09c"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:48:19.646099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:48:19.655859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1f901f61-cd34-4ae1-b1ce-a2b464d7559d req-b5251ac6-1249-40d8-8187-0276b8b0e1fd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:19.656885 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1f901f61-cd34-4ae1-b1ce-a2b464d7559d req-b5251ac6-1249-40d8-8187-0276b8b0e1fd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:19.657542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1f901f61-cd34-4ae1-b1ce-a2b464d7559d req-b5251ac6-1249-40d8-8187-0276b8b0e1fd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:19.670226 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-1f901f61-cd34-4ae1-b1ce-a2b464d7559d req-b5251ac6-1249-40d8-8187-0276b8b0e1fd service nova] Creating event network-changed:b1940763-9563-4d67-9540-8164094bf09c for instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 on n-h1-860687-3 Oct 27 19:48:19.676283 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-1f901f61-cd34-4ae1-b1ce-a2b464d7559d req-b5251ac6-1249-40d8-8187-0276b8b0e1fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048181 Oct 27 19:48:19.677330 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3883/7615] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:48:19.683120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7121b03-1040-4b46-af8c-26039ba71820 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:19.691293 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7121b03-1040-4b46-af8c-26039ba71820 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1358 microversion: 2.1 time: 0.289844 Oct 27 19:48:19.692186 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3733/7616] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:19 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:20.716101 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6edc7628-5343-4e0f-add3-8ac666395b7c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:20.716808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6edc7628-5343-4e0f-add3-8ac666395b7c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:20.723048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6edc7628-5343-4e0f-add3-8ac666395b7c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:20.723531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6edc7628-5343-4e0f-add3-8ac666395b7c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:20.723969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6edc7628-5343-4e0f-add3-8ac666395b7c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:20.724660 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6edc7628-5343-4e0f-add3-8ac666395b7c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:20.725118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6edc7628-5343-4e0f-add3-8ac666395b7c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:20.725545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6edc7628-5343-4e0f-add3-8ac666395b7c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:20.914901 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6edc7628-5343-4e0f-add3-8ac666395b7c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:20.923202 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6edc7628-5343-4e0f-add3-8ac666395b7c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1358 microversion: 2.1 time: 0.212291 Oct 27 19:48:20.923779 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3884/7617] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:20 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:21.946529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ca7d1cd3-b4df-428a-b861-57480f49c91b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:21.947250 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ca7d1cd3-b4df-428a-b861-57480f49c91b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:21.954562 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca7d1cd3-b4df-428a-b861-57480f49c91b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:21.955054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca7d1cd3-b4df-428a-b861-57480f49c91b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:21.955512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca7d1cd3-b4df-428a-b861-57480f49c91b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:21.956227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca7d1cd3-b4df-428a-b861-57480f49c91b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:21.956698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca7d1cd3-b4df-428a-b861-57480f49c91b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:21.957144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca7d1cd3-b4df-428a-b861-57480f49c91b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:22.089356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ca7d1cd3-b4df-428a-b861-57480f49c91b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:22.097188 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ca7d1cd3-b4df-428a-b861-57480f49c91b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1358 microversion: 2.1 time: 0.155039 Oct 27 19:48:22.097775 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3734/7618] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:21 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:23.121627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9a2c23bd-92d6-4cbc-89c8-65d12379961a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:23.122246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9a2c23bd-92d6-4cbc-89c8-65d12379961a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:23.128959 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a2c23bd-92d6-4cbc-89c8-65d12379961a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:23.129433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a2c23bd-92d6-4cbc-89c8-65d12379961a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:23.129908 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a2c23bd-92d6-4cbc-89c8-65d12379961a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:23.130642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a2c23bd-92d6-4cbc-89c8-65d12379961a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:23.131095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a2c23bd-92d6-4cbc-89c8-65d12379961a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:23.131522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9a2c23bd-92d6-4cbc-89c8-65d12379961a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:23.267999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9a2c23bd-92d6-4cbc-89c8-65d12379961a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:23.277053 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9a2c23bd-92d6-4cbc-89c8-65d12379961a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1358 microversion: 2.1 time: 0.160082 Oct 27 19:48:23.277992 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3885/7619] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:23 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:24.301126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7e46af41-4929-4970-ad55-7d597ae4c37e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:24.301764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7e46af41-4929-4970-ad55-7d597ae4c37e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:24.309089 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e46af41-4929-4970-ad55-7d597ae4c37e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:24.309604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e46af41-4929-4970-ad55-7d597ae4c37e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:24.310073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e46af41-4929-4970-ad55-7d597ae4c37e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:24.310835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e46af41-4929-4970-ad55-7d597ae4c37e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:24.311514 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e46af41-4929-4970-ad55-7d597ae4c37e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:24.312336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e46af41-4929-4970-ad55-7d597ae4c37e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:24.466842 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7e46af41-4929-4970-ad55-7d597ae4c37e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:24.474901 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7e46af41-4929-4970-ad55-7d597ae4c37e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1358 microversion: 2.1 time: 0.177672 Oct 27 19:48:24.475546 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3735/7620] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:24 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:25.281878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-4ac17f38-2147-4909-8cce-068df66b4f43 req-9274faf7-5972-4e14-a37b-03d4eb5caf42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2dc725c-c1b6-43a6-955f-505b0fc8d609", "name": "network-vif-plugged", "status": "completed", "tag": "b1940763-9563-4d67-9540-8164094bf09c"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:48:25.295236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4ac17f38-2147-4909-8cce-068df66b4f43 req-9274faf7-5972-4e14-a37b-03d4eb5caf42 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:25.295732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4ac17f38-2147-4909-8cce-068df66b4f43 req-9274faf7-5972-4e14-a37b-03d4eb5caf42 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:25.296176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4ac17f38-2147-4909-8cce-068df66b4f43 req-9274faf7-5972-4e14-a37b-03d4eb5caf42 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:25.311477 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-4ac17f38-2147-4909-8cce-068df66b4f43 req-9274faf7-5972-4e14-a37b-03d4eb5caf42 service nova] Creating event network-vif-plugged:b1940763-9563-4d67-9540-8164094bf09c for instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 on n-h1-860687-3 Oct 27 19:48:25.316501 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-4ac17f38-2147-4909-8cce-068df66b4f43 req-9274faf7-5972-4e14-a37b-03d4eb5caf42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038444 Oct 27 19:48:25.317119 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3886/7621] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:48:25.499193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-56d6f826-c6d5-47bc-abca-a9e40c8f69c7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:25.499831 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-56d6f826-c6d5-47bc-abca-a9e40c8f69c7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:25.507012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d6f826-c6d5-47bc-abca-a9e40c8f69c7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:25.507520 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d6f826-c6d5-47bc-abca-a9e40c8f69c7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:25.507981 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d6f826-c6d5-47bc-abca-a9e40c8f69c7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:25.508754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d6f826-c6d5-47bc-abca-a9e40c8f69c7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:25.509231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d6f826-c6d5-47bc-abca-a9e40c8f69c7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:25.509679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56d6f826-c6d5-47bc-abca-a9e40c8f69c7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:25.644800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-56d6f826-c6d5-47bc-abca-a9e40c8f69c7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:25.652832 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-56d6f826-c6d5-47bc-abca-a9e40c8f69c7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1358 microversion: 2.1 time: 0.157663 Oct 27 19:48:25.653424 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3736/7622] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:25 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:26.676554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e1df9527-150e-461a-aaf0-8808d0534af3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:26.677264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e1df9527-150e-461a-aaf0-8808d0534af3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:26.684322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1df9527-150e-461a-aaf0-8808d0534af3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:26.684815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1df9527-150e-461a-aaf0-8808d0534af3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:26.685260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1df9527-150e-461a-aaf0-8808d0534af3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:26.685973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1df9527-150e-461a-aaf0-8808d0534af3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:26.686481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1df9527-150e-461a-aaf0-8808d0534af3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:26.687007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e1df9527-150e-461a-aaf0-8808d0534af3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:26.821907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e1df9527-150e-461a-aaf0-8808d0534af3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:26.829824 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e1df9527-150e-461a-aaf0-8808d0534af3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1549 microversion: 2.1 time: 0.157553 Oct 27 19:48:26.830419 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3887/7623] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:26 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:26.852593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e9ac69ea-f7f3-4bbf-b7a8-b96c6e8b4229 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:26.853378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e9ac69ea-f7f3-4bbf-b7a8-b96c6e8b4229 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:26.860275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9ac69ea-f7f3-4bbf-b7a8-b96c6e8b4229 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:26.860781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9ac69ea-f7f3-4bbf-b7a8-b96c6e8b4229 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:26.861247 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9ac69ea-f7f3-4bbf-b7a8-b96c6e8b4229 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:26.861963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9ac69ea-f7f3-4bbf-b7a8-b96c6e8b4229 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:26.862472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9ac69ea-f7f3-4bbf-b7a8-b96c6e8b4229 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:26.862923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9ac69ea-f7f3-4bbf-b7a8-b96c6e8b4229 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:26.995743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e9ac69ea-f7f3-4bbf-b7a8-b96c6e8b4229 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:27.003650 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e9ac69ea-f7f3-4bbf-b7a8-b96c6e8b4229 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1549 microversion: 2.1 time: 0.155017 Oct 27 19:48:27.004232 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3737/7624] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:26 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:27.026001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2393540c-277e-463e-8cb9-070edbc41ef8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:27.031960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2393540c-277e-463e-8cb9-070edbc41ef8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:27.032728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2393540c-277e-463e-8cb9-070edbc41ef8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Searching by: {'deleted': False, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 19:48:27.037987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2393540c-277e-463e-8cb9-070edbc41ef8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:27.038526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2393540c-277e-463e-8cb9-070edbc41ef8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:27.038970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2393540c-277e-463e-8cb9-070edbc41ef8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:27.039690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2393540c-277e-463e-8cb9-070edbc41ef8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:27.040591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2393540c-277e-463e-8cb9-070edbc41ef8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:27.041024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2393540c-277e-463e-8cb9-070edbc41ef8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:27.064675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-2393540c-277e-463e-8cb9-070edbc41ef8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 19:48:27.092809 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2393540c-277e-463e-8cb9-070edbc41ef8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070685 Oct 27 19:48:27.093384 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3888/7625] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 19:48:27 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:48:27.105138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-019623a4-d421-4d61-8b50-2b0f9b358933 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:27.105707 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-019623a4-d421-4d61-8b50-2b0f9b358933 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:27.111813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-019623a4-d421-4d61-8b50-2b0f9b358933 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:27.112319 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-019623a4-d421-4d61-8b50-2b0f9b358933 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:27.112777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-019623a4-d421-4d61-8b50-2b0f9b358933 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:27.113490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-019623a4-d421-4d61-8b50-2b0f9b358933 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:27.113963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-019623a4-d421-4d61-8b50-2b0f9b358933 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:27.114437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-019623a4-d421-4d61-8b50-2b0f9b358933 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:27.244495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-019623a4-d421-4d61-8b50-2b0f9b358933 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:27.252294 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-019623a4-d421-4d61-8b50-2b0f9b358933 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1549 microversion: 2.1 time: 0.151260 Oct 27 19:48:27.252875 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3738/7626] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:27 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:28.819792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9375fcbe-a247-4cb2-88ee-0d0890802e72 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d21f15d7-f82a-4b5b-b9b9-b252231da326"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:48:28.822522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9375fcbe-a247-4cb2-88ee-0d0890802e72 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:28.829000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9375fcbe-a247-4cb2-88ee-0d0890802e72 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:28.829485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9375fcbe-a247-4cb2-88ee-0d0890802e72 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:28.829929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9375fcbe-a247-4cb2-88ee-0d0890802e72 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:28.830654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9375fcbe-a247-4cb2-88ee-0d0890802e72 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:28.831119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9375fcbe-a247-4cb2-88ee-0d0890802e72 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:28.831557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9375fcbe-a247-4cb2-88ee-0d0890802e72 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:29.072320 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9375fcbe-a247-4cb2-88ee-0d0890802e72 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "POST /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256073 Oct 27 19:48:29.072967 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3889/7627] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:48:28 2022] POST /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:48:42.295213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9f0dbe2-8ef3-4c65-b539-ee98efb2cd41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:42.295861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d9f0dbe2-8ef3-4c65-b539-ee98efb2cd41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:42.298559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:48:42.299246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=62 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:48:42.304995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9f0dbe2-8ef3-4c65-b539-ee98efb2cd41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:42.305997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9f0dbe2-8ef3-4c65-b539-ee98efb2cd41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:42.306495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9f0dbe2-8ef3-4c65-b539-ee98efb2cd41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:42.307218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9f0dbe2-8ef3-4c65-b539-ee98efb2cd41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:42.307697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9f0dbe2-8ef3-4c65-b539-ee98efb2cd41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:42.308214 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9f0dbe2-8ef3-4c65-b539-ee98efb2cd41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:42.438759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d9f0dbe2-8ef3-4c65-b539-ee98efb2cd41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:42.447992 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d9f0dbe2-8ef3-4c65-b539-ee98efb2cd41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1595 microversion: 2.1 time: 0.156691 Oct 27 19:48:42.448577 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3739/7628] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:42 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1595 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:48:44.396143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-335b8947-4172-4779-b1c3-da67629e8fa6 req-1417649a-9257-4669-87ad-f01171e1189f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2dc725c-c1b6-43a6-955f-505b0fc8d609", "tag": "b1940763-9563-4d67-9540-8164094bf09c"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:48:44.402723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:48:44.403396 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:48:44.404047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:48:44.410230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-335b8947-4172-4779-b1c3-da67629e8fa6 req-1417649a-9257-4669-87ad-f01171e1189f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:44.410843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-335b8947-4172-4779-b1c3-da67629e8fa6 req-1417649a-9257-4669-87ad-f01171e1189f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:44.411543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-335b8947-4172-4779-b1c3-da67629e8fa6 req-1417649a-9257-4669-87ad-f01171e1189f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:44.427172 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-335b8947-4172-4779-b1c3-da67629e8fa6 req-1417649a-9257-4669-87ad-f01171e1189f service nova] Creating event network-changed:b1940763-9563-4d67-9540-8164094bf09c for instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 on n-h1-860687-3 Oct 27 19:48:44.434274 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-335b8947-4172-4779-b1c3-da67629e8fa6 req-1417649a-9257-4669-87ad-f01171e1189f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042172 Oct 27 19:48:44.435181 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3890/7629] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:48:45.525442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6e0735bc-c5d4-4f38-9253-3350259b79be tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1779090938"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:48:45.526363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6e0735bc-c5d4-4f38-9253-3350259b79be tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:45.533593 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e0735bc-c5d4-4f38-9253-3350259b79be tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:45.534201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e0735bc-c5d4-4f38-9253-3350259b79be tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:45.534753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e0735bc-c5d4-4f38-9253-3350259b79be tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:45.535541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e0735bc-c5d4-4f38-9253-3350259b79be tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:45.536083 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e0735bc-c5d4-4f38-9253-3350259b79be tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:45.536534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e0735bc-c5d4-4f38-9253-3350259b79be tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:45.667390 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.network.security_group_api [None req-6e0735bc-c5d4-4f38-9253-3350259b79be tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Adding security group 3a28bbbd-24b9-420e-a7de-9033340ea6c0 to port b1940763-9563-4d67-9540-8164094bf09c Oct 27 19:48:45.986755 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6e0735bc-c5d4-4f38-9253-3350259b79be tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "POST /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/action" status: 202 len: 0 microversion: 2.1 time: 0.465887 Oct 27 19:48:45.998105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-b2c5f1b9-1886-4337-bc74-b8c326c3e316 req-cdc68071-e429-4809-b7a6-b52cafeac1df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2dc725c-c1b6-43a6-955f-505b0fc8d609", "tag": "b1940763-9563-4d67-9540-8164094bf09c"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:48:46.004205 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3740/7630] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:48:45 2022] POST /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:48:46.010433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-646c706b-cd48-4258-83da-a0cdc631ddac tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:48:46.011065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-646c706b-cd48-4258-83da-a0cdc631ddac tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:48:46.017695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b2c5f1b9-1886-4337-bc74-b8c326c3e316 req-cdc68071-e429-4809-b7a6-b52cafeac1df service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:46.018184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b2c5f1b9-1886-4337-bc74-b8c326c3e316 req-cdc68071-e429-4809-b7a6-b52cafeac1df service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:46.020763 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b2c5f1b9-1886-4337-bc74-b8c326c3e316 req-cdc68071-e429-4809-b7a6-b52cafeac1df service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:46.026495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-646c706b-cd48-4258-83da-a0cdc631ddac tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:46.027021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-646c706b-cd48-4258-83da-a0cdc631ddac tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:46.027543 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-646c706b-cd48-4258-83da-a0cdc631ddac tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:46.028193 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-646c706b-cd48-4258-83da-a0cdc631ddac tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:48:46.028666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-646c706b-cd48-4258-83da-a0cdc631ddac tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:48:46.029114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-646c706b-cd48-4258-83da-a0cdc631ddac tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:48:46.045585 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-b2c5f1b9-1886-4337-bc74-b8c326c3e316 req-cdc68071-e429-4809-b7a6-b52cafeac1df service nova] Creating event network-changed:b1940763-9563-4d67-9540-8164094bf09c for instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 on n-h1-860687-3 Oct 27 19:48:46.063886 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-b2c5f1b9-1886-4337-bc74-b8c326c3e316 req-cdc68071-e429-4809-b7a6-b52cafeac1df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062843 Oct 27 19:48:46.064884 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3891/7631] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:48:46.200124 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-646c706b-cd48-4258-83da-a0cdc631ddac tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:48:46.209781 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-646c706b-cd48-4258-83da-a0cdc631ddac tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1760 microversion: 2.1 time: 0.204209 Oct 27 19:48:46.210784 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3741/7632] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:48:46 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1760 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:50:29.128822 n-d-860687-3 devstack@n-api.service[127029]: ERROR oslo.messaging._drivers.impl_rabbit [-] [66fa3103-a1fe-46ef-965e-69c22fe0df2e] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 19:50:29.130078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:50:29.131016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:50:29.132346 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 19:50:29.132590 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 19:50:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/action (ip 10.222.0.42) !!! Oct 27 19:50:29.134091 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 19:50:29.134240 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 19:50:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/action (ip 10.222.0.42) !!! Oct 27 19:50:29.139990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ba1055f3-ddba-4bc6-8b72-e30a2da58cf7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:50:29.143078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ba1055f3-ddba-4bc6-8b72-e30a2da58cf7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:50:29.153749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba1055f3-ddba-4bc6-8b72-e30a2da58cf7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:50:29.154238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba1055f3-ddba-4bc6-8b72-e30a2da58cf7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:50:29.154717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba1055f3-ddba-4bc6-8b72-e30a2da58cf7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:50:29.155427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba1055f3-ddba-4bc6-8b72-e30a2da58cf7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:50:29.155950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba1055f3-ddba-4bc6-8b72-e30a2da58cf7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:50:29.156445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba1055f3-ddba-4bc6-8b72-e30a2da58cf7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:50:29.229790 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ba1055f3-ddba-4bc6-8b72-e30a2da58cf7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "POST /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/action" status: 202 len: 0 microversion: 2.1 time: 0.102753 Oct 27 19:50:29.230438 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3892/7633] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:50:29 2022] POST /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:50:29.236879 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:50:29.237731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=16 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:50:29.239034 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 19:50:29.239198 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 19:50:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 (ip 10.222.0.42) !!! Oct 27 19:50:29.240542 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 19:50:29.240729 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 19:50:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 (ip 10.222.0.42) !!! Oct 27 19:50:29.246044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e6a60b1d-37f3-462f-a9ee-7441e76ea35b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:50:29.246709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e6a60b1d-37f3-462f-a9ee-7441e76ea35b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:50:29.263278 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6a60b1d-37f3-462f-a9ee-7441e76ea35b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:50:29.263792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6a60b1d-37f3-462f-a9ee-7441e76ea35b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:50:29.264252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6a60b1d-37f3-462f-a9ee-7441e76ea35b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:50:29.265006 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6a60b1d-37f3-462f-a9ee-7441e76ea35b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:50:29.265490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6a60b1d-37f3-462f-a9ee-7441e76ea35b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:50:29.265946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6a60b1d-37f3-462f-a9ee-7441e76ea35b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:50:29.421459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e6a60b1d-37f3-462f-a9ee-7441e76ea35b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:50:29.431041 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e6a60b1d-37f3-462f-a9ee-7441e76ea35b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1762 microversion: 2.1 time: 0.196177 Oct 27 19:50:29.431645 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3742/7634] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:50:29 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1762 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:50:30.459741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e6d0077b-16a3-4118-9305-8695ed7863c0 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:50:30.460455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e6d0077b-16a3-4118-9305-8695ed7863c0 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:50:30.467725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6d0077b-16a3-4118-9305-8695ed7863c0 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:50:30.468215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6d0077b-16a3-4118-9305-8695ed7863c0 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:50:30.468659 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6d0077b-16a3-4118-9305-8695ed7863c0 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:50:30.469355 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6d0077b-16a3-4118-9305-8695ed7863c0 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:50:30.469819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6d0077b-16a3-4118-9305-8695ed7863c0 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:50:30.470254 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6d0077b-16a3-4118-9305-8695ed7863c0 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:50:30.477261 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] [66fa3103-a1fe-46ef-965e-69c22fe0df2e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 36658. Oct 27 19:50:30.622925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e6d0077b-16a3-4118-9305-8695ed7863c0 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:50:30.633482 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e6d0077b-16a3-4118-9305-8695ed7863c0 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1760 microversion: 2.1 time: 0.179202 Oct 27 19:50:30.634102 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3893/7635] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:50:30 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1760 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:51:44.483638 n-d-860687-3 devstack@n-api.service[127028]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e8240a4d-ecaa-42c4-8b5a-9ab82de7a90d] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 19:51:44.484499 n-d-860687-3 devstack@n-api.service[127028]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a87a1486-b96d-4ed3-afbc-04da999a872c] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 19:51:44.485266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:51:44.486180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:51:44.491595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-61760f79-d215-4ee1-bd7c-5766dbc7c00a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1779090938"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:51:44.492318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-61760f79-d215-4ee1-bd7c-5766dbc7c00a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:51:44.500857 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61760f79-d215-4ee1-bd7c-5766dbc7c00a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:44.501364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61760f79-d215-4ee1-bd7c-5766dbc7c00a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:44.501819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61760f79-d215-4ee1-bd7c-5766dbc7c00a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:44.502557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61760f79-d215-4ee1-bd7c-5766dbc7c00a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:44.503038 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61760f79-d215-4ee1-bd7c-5766dbc7c00a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:44.503478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-61760f79-d215-4ee1-bd7c-5766dbc7c00a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:44.635078 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.network.security_group_api [None req-61760f79-d215-4ee1-bd7c-5766dbc7c00a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Removing security group 3a28bbbd-24b9-420e-a7de-9033340ea6c0 from port b1940763-9563-4d67-9540-8164094bf09c Oct 27 19:51:44.942190 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-61760f79-d215-4ee1-bd7c-5766dbc7c00a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "POST /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/action" status: 202 len: 0 microversion: 2.1 time: 0.460234 Oct 27 19:51:44.943038 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3743/7636] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:51:44 2022] POST /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:51:44.955551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:51:44.956519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:51:45.037081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-b30088fb-86ec-4ccf-ab7d-eac88d7ab3dc req-c05d6645-e788-4649-b846-06bb07817760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2dc725c-c1b6-43a6-955f-505b0fc8d609", "tag": "b1940763-9563-4d67-9540-8164094bf09c"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:51:45.047817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b30088fb-86ec-4ccf-ab7d-eac88d7ab3dc req-c05d6645-e788-4649-b846-06bb07817760 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:45.047817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b30088fb-86ec-4ccf-ab7d-eac88d7ab3dc req-c05d6645-e788-4649-b846-06bb07817760 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:45.047817 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b30088fb-86ec-4ccf-ab7d-eac88d7ab3dc req-c05d6645-e788-4649-b846-06bb07817760 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:45.060570 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-b30088fb-86ec-4ccf-ab7d-eac88d7ab3dc req-c05d6645-e788-4649-b846-06bb07817760 service nova] Creating event network-changed:b1940763-9563-4d67-9540-8164094bf09c for instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 on n-h1-860687-3 Oct 27 19:51:45.066029 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-b30088fb-86ec-4ccf-ab7d-eac88d7ab3dc req-c05d6645-e788-4649-b846-06bb07817760 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116286 Oct 27 19:51:45.066876 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3894/7637] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:51:46.365459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3da9d463-1f4e-4495-bf5b-f77435ae425b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:51:46.365998 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3da9d463-1f4e-4495-bf5b-f77435ae425b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:51:46.375066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3da9d463-1f4e-4495-bf5b-f77435ae425b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:46.375612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3da9d463-1f4e-4495-bf5b-f77435ae425b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:46.376080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3da9d463-1f4e-4495-bf5b-f77435ae425b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:46.376817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3da9d463-1f4e-4495-bf5b-f77435ae425b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:46.377297 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3da9d463-1f4e-4495-bf5b-f77435ae425b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:46.377757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3da9d463-1f4e-4495-bf5b-f77435ae425b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:46.381982 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] [a87a1486-b96d-4ed3-afbc-04da999a872c] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 36712. Oct 27 19:51:46.383217 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] [e8240a4d-ecaa-42c4-8b5a-9ab82de7a90d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 36710. Oct 27 19:51:46.476754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-3da9d463-1f4e-4495-bf5b-f77435ae425b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lazy-loading 'services' on Instance uuid a2dc725c-c1b6-43a6-955f-505b0fc8d609 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:51:46.554947 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3da9d463-1f4e-4495-bf5b-f77435ae425b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments/d21f15d7-f82a-4b5b-b9b9-b252231da326" status: 202 len: 0 microversion: 2.1 time: 0.195325 Oct 27 19:51:46.555859 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3744/7638] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:51:46 2022] DELETE /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments/d21f15d7-f82a-4b5b-b9b9-b252231da326 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:51:46.566272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0073c95-39e3-4214-9f5e-d363562a3289 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:51:46.571650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f0073c95-39e3-4214-9f5e-d363562a3289 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:51:46.578435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0073c95-39e3-4214-9f5e-d363562a3289 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:46.579166 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0073c95-39e3-4214-9f5e-d363562a3289 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:46.579764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0073c95-39e3-4214-9f5e-d363562a3289 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:46.580645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0073c95-39e3-4214-9f5e-d363562a3289 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:46.581265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0073c95-39e3-4214-9f5e-d363562a3289 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:46.581705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0073c95-39e3-4214-9f5e-d363562a3289 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:46.616474 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f0073c95-39e3-4214-9f5e-d363562a3289 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055742 Oct 27 19:51:46.617053 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3895/7639] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:51:46 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:51:47.082152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-68fca592-bc77-451b-a189-fe6ef4b6cbc5 req-862f6af2-d8bb-4610-a581-19d880a0bdfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2dc725c-c1b6-43a6-955f-505b0fc8d609", "tag": "b1940763-9563-4d67-9540-8164094bf09c"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:51:47.093018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-68fca592-bc77-451b-a189-fe6ef4b6cbc5 req-862f6af2-d8bb-4610-a581-19d880a0bdfb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:47.093527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-68fca592-bc77-451b-a189-fe6ef4b6cbc5 req-862f6af2-d8bb-4610-a581-19d880a0bdfb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:47.093985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-68fca592-bc77-451b-a189-fe6ef4b6cbc5 req-862f6af2-d8bb-4610-a581-19d880a0bdfb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:47.105565 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-68fca592-bc77-451b-a189-fe6ef4b6cbc5 req-862f6af2-d8bb-4610-a581-19d880a0bdfb service nova] Creating event network-changed:b1940763-9563-4d67-9540-8164094bf09c for instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 on n-h1-860687-3 Oct 27 19:51:47.110677 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-68fca592-bc77-451b-a189-fe6ef4b6cbc5 req-862f6af2-d8bb-4610-a581-19d880a0bdfb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032756 Oct 27 19:51:47.111302 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3745/7640] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:51:47.629241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2f7709ed-a665-40f2-a77d-cdd9ef1947d8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:51:47.632316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2f7709ed-a665-40f2-a77d-cdd9ef1947d8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:51:47.639294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f7709ed-a665-40f2-a77d-cdd9ef1947d8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:47.639898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f7709ed-a665-40f2-a77d-cdd9ef1947d8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:47.640529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f7709ed-a665-40f2-a77d-cdd9ef1947d8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:47.641353 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f7709ed-a665-40f2-a77d-cdd9ef1947d8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:47.641850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f7709ed-a665-40f2-a77d-cdd9ef1947d8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:47.642275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f7709ed-a665-40f2-a77d-cdd9ef1947d8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:47.674919 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2f7709ed-a665-40f2-a77d-cdd9ef1947d8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049469 Oct 27 19:51:47.675907 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3896/7641] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:51:47 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:51:48.690415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b196d55-da24-42f3-b5a3-4cfc4936f609 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:51:48.693437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6b196d55-da24-42f3-b5a3-4cfc4936f609 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:51:48.700042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b196d55-da24-42f3-b5a3-4cfc4936f609 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:48.700544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b196d55-da24-42f3-b5a3-4cfc4936f609 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:48.701000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b196d55-da24-42f3-b5a3-4cfc4936f609 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:48.701712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b196d55-da24-42f3-b5a3-4cfc4936f609 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:48.702183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b196d55-da24-42f3-b5a3-4cfc4936f609 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:48.702665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b196d55-da24-42f3-b5a3-4cfc4936f609 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:48.736507 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b196d55-da24-42f3-b5a3-4cfc4936f609 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051251 Oct 27 19:51:48.737362 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3746/7642] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:51:48 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:51:49.749428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-09fc5fa4-80b1-44f0-afc8-c2e8a3c8f7b9 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:51:49.751597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-09fc5fa4-80b1-44f0-afc8-c2e8a3c8f7b9 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:51:49.759100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09fc5fa4-80b1-44f0-afc8-c2e8a3c8f7b9 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:49.759592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09fc5fa4-80b1-44f0-afc8-c2e8a3c8f7b9 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:49.760040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09fc5fa4-80b1-44f0-afc8-c2e8a3c8f7b9 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:49.760745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09fc5fa4-80b1-44f0-afc8-c2e8a3c8f7b9 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:49.761205 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09fc5fa4-80b1-44f0-afc8-c2e8a3c8f7b9 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:49.761641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-09fc5fa4-80b1-44f0-afc8-c2e8a3c8f7b9 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:49.792270 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-09fc5fa4-80b1-44f0-afc8-c2e8a3c8f7b9 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046905 Oct 27 19:51:49.792852 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3897/7643] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:51:49 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:51:50.805886 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-575318c9-0cf1-4f8c-9f9c-5d3fc10d85eb tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:51:50.808231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-575318c9-0cf1-4f8c-9f9c-5d3fc10d85eb tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:51:50.815380 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-575318c9-0cf1-4f8c-9f9c-5d3fc10d85eb tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:50.815917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-575318c9-0cf1-4f8c-9f9c-5d3fc10d85eb tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:50.816413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-575318c9-0cf1-4f8c-9f9c-5d3fc10d85eb tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:50.817917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-575318c9-0cf1-4f8c-9f9c-5d3fc10d85eb tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:50.818423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-575318c9-0cf1-4f8c-9f9c-5d3fc10d85eb tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:50.818884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-575318c9-0cf1-4f8c-9f9c-5d3fc10d85eb tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:50.848900 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-575318c9-0cf1-4f8c-9f9c-5d3fc10d85eb tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047788 Oct 27 19:51:50.849486 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3747/7644] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:51:50 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:51:51.861736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cbc56087-988c-4fb6-8294-11b61d0dc430 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:51:51.863952 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cbc56087-988c-4fb6-8294-11b61d0dc430 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:51:51.871323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbc56087-988c-4fb6-8294-11b61d0dc430 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:51.872030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbc56087-988c-4fb6-8294-11b61d0dc430 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:51.872478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbc56087-988c-4fb6-8294-11b61d0dc430 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:51.873219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbc56087-988c-4fb6-8294-11b61d0dc430 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:51.873772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbc56087-988c-4fb6-8294-11b61d0dc430 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:51.874150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cbc56087-988c-4fb6-8294-11b61d0dc430 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:51.903926 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cbc56087-988c-4fb6-8294-11b61d0dc430 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046640 Oct 27 19:51:51.904484 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3898/7645] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:51:51 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 19:51:51.916301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d16e90fd-ec59-418d-bb79-8c5d6d7cbb13 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:51:51.916801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d16e90fd-ec59-418d-bb79-8c5d6d7cbb13 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:51:51.923771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d16e90fd-ec59-418d-bb79-8c5d6d7cbb13 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:51.924268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d16e90fd-ec59-418d-bb79-8c5d6d7cbb13 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:51.924723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d16e90fd-ec59-418d-bb79-8c5d6d7cbb13 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:51.925433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d16e90fd-ec59-418d-bb79-8c5d6d7cbb13 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:51.925905 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d16e90fd-ec59-418d-bb79-8c5d6d7cbb13 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:51.927036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d16e90fd-ec59-418d-bb79-8c5d6d7cbb13 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:52.002711 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d16e90fd-ec59-418d-bb79-8c5d6d7cbb13 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] HTTP exception thrown: Instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 is not attached to volume d21f15d7-f82a-4b5b-b9b9-b252231da326 Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d16e90fd-ec59-418d-bb79-8c5d6d7cbb13 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Request method failure captured: Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments/d21f15d7-f82a-4b5b-b9b9-b252231da326 HTTP/1.1 Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWuBprlMxhftEROb8p871RGF2-FE8nWqTSFnfjGUqJ702bnTiboKOyiPmsQNozzpMxhiDplryo3nuAByf7abL8gkbgfphqwqX1kC5GDmFb3A2vw7e6P9JWByVPwVtFA2oaw0yTTdcLfLBWdXI2vd1t4C-qajOPPW4-dFlO8_ps2ggD24 Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 8e51a6992dcd4ee0b08f295d39e44746 Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestMinimumBasicScenario-1956853124 Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8e51a6992dcd4ee0b08f295d39e44746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8e51a6992dcd4ee0b08f295d39e44746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8e51a6992dcd4ee0b08f295d39e44746", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8e51a6992dcd4ee0b08f295d39e44746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestMinimumBasicScenario-1956853124 Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 8e51a6992dcd4ee0b08f295d39e44746 Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1956853124 Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestMinimumBasicScenario-1956853124-project Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 7472e97186cb406bbfe973fc665d7d7e Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestMinimumBasicScenario-1956853124-project Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 is not attached to volume d21f15d7-f82a-4b5b-b9b9-b252231da326 Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'server_id': 'a2dc725c-c1b6-43a6-955f-505b0fc8d609', 'id': 'd21f15d7-f82a-4b5b-b9b9-b252231da326'} Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d21f15d7-f82a-4b5b-b9b9-b252231da326. Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 is not attached to volume d21f15d7-f82a-4b5b-b9b9-b252231da326 Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:51:52.004400 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:51:52.010235 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:51:52.010235 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:51:52.010235 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 is not attached to volume d21f15d7-f82a-4b5b-b9b9-b252231da326 Oct 27 19:51:52.010235 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:51:52.010235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d16e90fd-ec59-418d-bb79-8c5d6d7cbb13 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Returning 404 to user: Instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 is not attached to volume d21f15d7-f82a-4b5b-b9b9-b252231da326 {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:51:52.010235 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d16e90fd-ec59-418d-bb79-8c5d6d7cbb13 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments/d21f15d7-f82a-4b5b-b9b9-b252231da326" status: 404 len: 154 microversion: 2.1 time: 0.094558 Oct 27 19:51:52.010235 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3748/7646] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:51:51 2022] DELETE /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609/os-volume_attachments/d21f15d7-f82a-4b5b-b9b9-b252231da326 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:51:55.256288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-97b3ee61-f62f-4560-ba07-76bdd9c11ae7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:51:55.256841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-97b3ee61-f62f-4560-ba07-76bdd9c11ae7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:51:55.263755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-97b3ee61-f62f-4560-ba07-76bdd9c11ae7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:55.264250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-97b3ee61-f62f-4560-ba07-76bdd9c11ae7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:55.264701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-97b3ee61-f62f-4560-ba07-76bdd9c11ae7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:55.265410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-97b3ee61-f62f-4560-ba07-76bdd9c11ae7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:55.265892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-97b3ee61-f62f-4560-ba07-76bdd9c11ae7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:55.266325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-97b3ee61-f62f-4560-ba07-76bdd9c11ae7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:55.292554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-97b3ee61-f62f-4560-ba07-76bdd9c11ae7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:51:55.370296 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-97b3ee61-f62f-4560-ba07-76bdd9c11ae7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 204 len: 0 microversion: 2.1 time: 0.117725 Oct 27 19:51:55.370987 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3899/7647] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:51:55 2022] DELETE /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:51:55.380739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5c0bb0a7-7869-4d86-a933-77d10d1814b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:51:55.381590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5c0bb0a7-7869-4d86-a933-77d10d1814b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:51:55.389945 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c0bb0a7-7869-4d86-a933-77d10d1814b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:55.390489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c0bb0a7-7869-4d86-a933-77d10d1814b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:55.390957 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c0bb0a7-7869-4d86-a933-77d10d1814b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:55.391694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c0bb0a7-7869-4d86-a933-77d10d1814b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:55.392172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c0bb0a7-7869-4d86-a933-77d10d1814b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:55.392627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c0bb0a7-7869-4d86-a933-77d10d1814b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:55.534670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5c0bb0a7-7869-4d86-a933-77d10d1814b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:51:55.543221 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5c0bb0a7-7869-4d86-a933-77d10d1814b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1555 microversion: 2.1 time: 0.167798 Oct 27 19:51:55.543803 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3749/7648] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:51:55 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:51:56.568072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-785e66f7-7784-4224-8189-63a95e984a74 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:51:56.568777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-785e66f7-7784-4224-8189-63a95e984a74 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:51:56.576589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-785e66f7-7784-4224-8189-63a95e984a74 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:56.577083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-785e66f7-7784-4224-8189-63a95e984a74 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:56.577526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-785e66f7-7784-4224-8189-63a95e984a74 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:56.578237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-785e66f7-7784-4224-8189-63a95e984a74 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:56.578719 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-785e66f7-7784-4224-8189-63a95e984a74 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:56.579149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-785e66f7-7784-4224-8189-63a95e984a74 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:56.713137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-785e66f7-7784-4224-8189-63a95e984a74 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:51:56.720936 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-785e66f7-7784-4224-8189-63a95e984a74 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1555 microversion: 2.1 time: 0.157829 Oct 27 19:51:56.721508 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3900/7649] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:51:56 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:51:57.653462 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-5e427eac-b30e-4dba-b0cf-e321deb44fde req-4ec4bf47-d258-4d22-8c42-7b18eb914df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2dc725c-c1b6-43a6-955f-505b0fc8d609", "name": "network-vif-deleted", "tag": "b1940763-9563-4d67-9540-8164094bf09c"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:51:57.664830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5e427eac-b30e-4dba-b0cf-e321deb44fde req-4ec4bf47-d258-4d22-8c42-7b18eb914df2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:57.665330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5e427eac-b30e-4dba-b0cf-e321deb44fde req-4ec4bf47-d258-4d22-8c42-7b18eb914df2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:57.665782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5e427eac-b30e-4dba-b0cf-e321deb44fde req-4ec4bf47-d258-4d22-8c42-7b18eb914df2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:57.680504 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5e427eac-b30e-4dba-b0cf-e321deb44fde req-4ec4bf47-d258-4d22-8c42-7b18eb914df2 service nova] Creating event network-vif-deleted:b1940763-9563-4d67-9540-8164094bf09c for instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 on n-h1-860687-3 Oct 27 19:51:57.685505 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-5e427eac-b30e-4dba-b0cf-e321deb44fde req-4ec4bf47-d258-4d22-8c42-7b18eb914df2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096573 Oct 27 19:51:57.686186 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3750/7650] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:51:57.745665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7979968f-9bf8-4964-8bbb-131893b1c08d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:51:57.746319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7979968f-9bf8-4964-8bbb-131893b1c08d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:51:57.752947 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7979968f-9bf8-4964-8bbb-131893b1c08d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:57.753431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7979968f-9bf8-4964-8bbb-131893b1c08d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:57.753871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7979968f-9bf8-4964-8bbb-131893b1c08d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:57.755276 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7979968f-9bf8-4964-8bbb-131893b1c08d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:57.755746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7979968f-9bf8-4964-8bbb-131893b1c08d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:57.756165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7979968f-9bf8-4964-8bbb-131893b1c08d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:57.791591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7979968f-9bf8-4964-8bbb-131893b1c08d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:57.792083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7979968f-9bf8-4964-8bbb-131893b1c08d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:57.792518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7979968f-9bf8-4964-8bbb-131893b1c08d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:57.792967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-7979968f-9bf8-4964-8bbb-131893b1c08d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lazy-loading 'fault' on Instance uuid a2dc725c-c1b6-43a6-955f-505b0fc8d609 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:51:57.837613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7979968f-9bf8-4964-8bbb-131893b1c08d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:51:57.845427 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7979968f-9bf8-4964-8bbb-131893b1c08d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 200 len: 1348 microversion: 2.1 time: 0.104019 Oct 27 19:51:57.846069 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3901/7651] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:51:57 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:51:58.870644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3a2f0143-faaf-44e6-83c3-589be8844f84 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:51:58.871378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3a2f0143-faaf-44e6-83c3-589be8844f84 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: a2dc725c-c1b6-43a6-955f-505b0fc8d609] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:51:58.877712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a2f0143-faaf-44e6-83c3-589be8844f84 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:58.878221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a2f0143-faaf-44e6-83c3-589be8844f84 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:58.878717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a2f0143-faaf-44e6-83c3-589be8844f84 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:58.879839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a2f0143-faaf-44e6-83c3-589be8844f84 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:51:58.880047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a2f0143-faaf-44e6-83c3-589be8844f84 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:51:58.880524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a2f0143-faaf-44e6-83c3-589be8844f84 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:51:58.894419 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-3a2f0143-faaf-44e6-83c3-589be8844f84 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] HTTP exception thrown: Instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 could not be found. Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3a2f0143-faaf-44e6-83c3-589be8844f84 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Request method failure captured: Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 HTTP/1.1 Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWuBprlMxhftEROb8p871RGF2-FE8nWqTSFnfjGUqJ702bnTiboKOyiPmsQNozzpMxhiDplryo3nuAByf7abL8gkbgfphqwqX1kC5GDmFb3A2vw7e6P9JWByVPwVtFA2oaw0yTTdcLfLBWdXI2vd1t4C-qajOPPW4-dFlO8_ps2ggD24 Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 8e51a6992dcd4ee0b08f295d39e44746 Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestMinimumBasicScenario-1956853124 Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8e51a6992dcd4ee0b08f295d39e44746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8e51a6992dcd4ee0b08f295d39e44746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8e51a6992dcd4ee0b08f295d39e44746", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8e51a6992dcd4ee0b08f295d39e44746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestMinimumBasicScenario-1956853124 Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 8e51a6992dcd4ee0b08f295d39e44746 Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1956853124 Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestMinimumBasicScenario-1956853124-project Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 7472e97186cb406bbfe973fc665d7d7e Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestMinimumBasicScenario-1956853124-project Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 could not be found. Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'a2dc725c-c1b6-43a6-955f-505b0fc8d609'} Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 could not be found. Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 could not be found. Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:51:58.896997 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:51:58.902136 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:51:58.902136 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:51:58.902136 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:51:58.902136 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:51:58.902136 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:51:58.902136 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 could not be found. Oct 27 19:51:58.902136 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:51:58.902136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3a2f0143-faaf-44e6-83c3-589be8844f84 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Returning 404 to user: Instance a2dc725c-c1b6-43a6-955f-505b0fc8d609 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:51:58.902136 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3a2f0143-faaf-44e6-83c3-589be8844f84 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609" status: 404 len: 111 microversion: 2.1 time: 0.033078 Oct 27 19:51:58.902136 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3751/7652] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:51:58 2022] GET /compute/v2.1/servers/a2dc725c-c1b6-43a6-955f-505b0fc8d609 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:51:58.907714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2e5e4d73-dd2b-4431-8ce9-3f5dd5a45184 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '.version_select at 0x7fc86a02e430>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:51:58.932269 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2e5e4d73-dd2b-4431-8ce9-3f5dd5a45184 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1261948030" status: 202 len: 0 microversion: 2.1 time: 0.028522 Oct 27 19:51:58.932835 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3902/7653] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 19:51:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1261948030 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:52:08.125751 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-60dc917b-a3b5-40b9-b652-bd4d53c55833 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Action: 'create', calling method: .version_select at 0x7fc869d32c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1681647125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGMlrXpcztLQMhNxBZdv2Au29XHdv9ynhBRD2iZtAM3W3i1HV8Ez0gfjwiCAufBsvDaLbtkY/v/igTjA0Vpgfrq5QxpLhHcw7wEw1uabaaK4J1W5kVBZPZUoeNih7d77w=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:52:08.143195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-60dc917b-a3b5-40b9-b652-bd4d53c55833 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Getting quotas for project 8e51a6992dcd4ee0b08f295d39e44746. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:52:08.149659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-60dc917b-a3b5-40b9-b652-bd4d53c55833 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Getting quotas for user 7472e97186cb406bbfe973fc665d7d7e and project 8e51a6992dcd4ee0b08f295d39e44746. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:52:08.177523 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-60dc917b-a3b5-40b9-b652-bd4d53c55833 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055620 Oct 27 19:52:08.178127 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3752/7654] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:52:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:52:08.228801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1794653359", "imageRef": "6927fa9c-d129-4ee1-9f4d-7bb76559ed3f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1681647125", "networks": [{"uuid": "5653e3b3-adab-40af-8c18-23d60336e6bd"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:52:08.239202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:52:08.284808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] validate_networks() for [('5653e3b3-adab-40af-8c18-23d60336e6bd', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:52:08.690151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:52:08.690640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:52:08.691131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:52:08.691546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:52:08.692570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:52:08.701821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:08.702310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:08.702794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:08.703535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:08.704058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:08.704492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:08.721308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Getting quotas for project 8e51a6992dcd4ee0b08f295d39e44746. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:52:08.726570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Getting quotas for user 7472e97186cb406bbfe973fc665d7d7e and project 8e51a6992dcd4ee0b08f295d39e44746. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:52:08.739305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:52:08.741568 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6927fa9c-d129-4ee1-9f4d-7bb76559ed3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:52:08.790408 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-478b8b67-de04-446d-a165-b889ccb4740e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565668 Oct 27 19:52:08.791081 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3903/7655] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:52:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:52:08.803283 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-047a0c05-6f9e-4410-893d-529e61ce5c39 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:08.803926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-047a0c05-6f9e-4410-893d-529e61ce5c39 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:08.859581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-047a0c05-6f9e-4410-893d-529e61ce5c39 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:08.868127 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-047a0c05-6f9e-4410-893d-529e61ce5c39 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1259 microversion: 2.1 time: 0.069999 Oct 27 19:52:08.868709 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3753/7656] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:08 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:52:09.893325 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6d62bebd-b0e9-45c0-87a7-5d0255ccd3f5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:09.895418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6d62bebd-b0e9-45c0-87a7-5d0255ccd3f5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:09.902977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d62bebd-b0e9-45c0-87a7-5d0255ccd3f5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:09.903470 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d62bebd-b0e9-45c0-87a7-5d0255ccd3f5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:09.903921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d62bebd-b0e9-45c0-87a7-5d0255ccd3f5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:09.904624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d62bebd-b0e9-45c0-87a7-5d0255ccd3f5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:09.905115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d62bebd-b0e9-45c0-87a7-5d0255ccd3f5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:09.905558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6d62bebd-b0e9-45c0-87a7-5d0255ccd3f5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:09.977846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6d62bebd-b0e9-45c0-87a7-5d0255ccd3f5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:09.985653 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6d62bebd-b0e9-45c0-87a7-5d0255ccd3f5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1329 microversion: 2.1 time: 0.097595 Oct 27 19:52:09.986230 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3904/7657] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:09 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1329 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:52:11.010077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-373fbd13-9a98-4a41-b384-ae2aeaa97375 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:11.010659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-373fbd13-9a98-4a41-b384-ae2aeaa97375 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:11.012734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:52:11.014399 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 19:52:11.014565 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 19:52:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf (ip 10.222.0.42) !!! Oct 27 19:52:11.023411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-373fbd13-9a98-4a41-b384-ae2aeaa97375 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:11.023926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-373fbd13-9a98-4a41-b384-ae2aeaa97375 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:11.024382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-373fbd13-9a98-4a41-b384-ae2aeaa97375 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:11.025111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-373fbd13-9a98-4a41-b384-ae2aeaa97375 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:11.025582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-373fbd13-9a98-4a41-b384-ae2aeaa97375 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:11.026032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-373fbd13-9a98-4a41-b384-ae2aeaa97375 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:11.180261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-373fbd13-9a98-4a41-b384-ae2aeaa97375 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:11.188571 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-373fbd13-9a98-4a41-b384-ae2aeaa97375 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.182544 Oct 27 19:52:11.189386 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3754/7658] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:11 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:12.213224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c50694f3-345f-40ae-89b5-53a1a1f73b0f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:12.214499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c50694f3-345f-40ae-89b5-53a1a1f73b0f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:12.221933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c50694f3-345f-40ae-89b5-53a1a1f73b0f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:12.223340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c50694f3-345f-40ae-89b5-53a1a1f73b0f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:12.224046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c50694f3-345f-40ae-89b5-53a1a1f73b0f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:12.225000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c50694f3-345f-40ae-89b5-53a1a1f73b0f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:12.225682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c50694f3-345f-40ae-89b5-53a1a1f73b0f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:12.226334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c50694f3-345f-40ae-89b5-53a1a1f73b0f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:12.387640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c50694f3-345f-40ae-89b5-53a1a1f73b0f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:12.396105 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c50694f3-345f-40ae-89b5-53a1a1f73b0f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.186944 Oct 27 19:52:12.396680 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3905/7659] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:12 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:13.422144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-600833ea-523a-43e4-b5da-f135adf05c1c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:13.423996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-600833ea-523a-43e4-b5da-f135adf05c1c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:13.431255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-600833ea-523a-43e4-b5da-f135adf05c1c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:13.432120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-600833ea-523a-43e4-b5da-f135adf05c1c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:13.432835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-600833ea-523a-43e4-b5da-f135adf05c1c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:13.433943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-600833ea-523a-43e4-b5da-f135adf05c1c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:13.434671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-600833ea-523a-43e4-b5da-f135adf05c1c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:13.435335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-600833ea-523a-43e4-b5da-f135adf05c1c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:13.579170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-600833ea-523a-43e4-b5da-f135adf05c1c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:13.588201 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-600833ea-523a-43e4-b5da-f135adf05c1c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.171959 Oct 27 19:52:13.588980 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3755/7660] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:13 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:14.614277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e4f03723-478e-4cbc-9071-bd0e3fe9c765 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:14.615039 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e4f03723-478e-4cbc-9071-bd0e3fe9c765 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:14.621932 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4f03723-478e-4cbc-9071-bd0e3fe9c765 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:14.622448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4f03723-478e-4cbc-9071-bd0e3fe9c765 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:14.622916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4f03723-478e-4cbc-9071-bd0e3fe9c765 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:14.623623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4f03723-478e-4cbc-9071-bd0e3fe9c765 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:14.624078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4f03723-478e-4cbc-9071-bd0e3fe9c765 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:14.624508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e4f03723-478e-4cbc-9071-bd0e3fe9c765 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:14.789174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e4f03723-478e-4cbc-9071-bd0e3fe9c765 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:14.799107 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e4f03723-478e-4cbc-9071-bd0e3fe9c765 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.188815 Oct 27 19:52:14.813693 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3906/7661] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:14 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:15.827626 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-17823b91-68f4-49ea-b00d-3a60c243b91e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:15.828602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-17823b91-68f4-49ea-b00d-3a60c243b91e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:15.833830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:52:15.838853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17823b91-68f4-49ea-b00d-3a60c243b91e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:15.839528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17823b91-68f4-49ea-b00d-3a60c243b91e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:15.840086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17823b91-68f4-49ea-b00d-3a60c243b91e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:15.841072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17823b91-68f4-49ea-b00d-3a60c243b91e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:15.841651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17823b91-68f4-49ea-b00d-3a60c243b91e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:15.842197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17823b91-68f4-49ea-b00d-3a60c243b91e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:15.995989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-17823b91-68f4-49ea-b00d-3a60c243b91e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:16.005289 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-17823b91-68f4-49ea-b00d-3a60c243b91e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.181982 Oct 27 19:52:16.006192 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3756/7662] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:15 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:17.031673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a44d9f5a-602d-4fa3-b838-cfec1364f9d4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:17.032337 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a44d9f5a-602d-4fa3-b838-cfec1364f9d4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:17.036448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:52:17.045393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a44d9f5a-602d-4fa3-b838-cfec1364f9d4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:17.046040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a44d9f5a-602d-4fa3-b838-cfec1364f9d4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:17.046529 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a44d9f5a-602d-4fa3-b838-cfec1364f9d4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:17.047304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a44d9f5a-602d-4fa3-b838-cfec1364f9d4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:17.047832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a44d9f5a-602d-4fa3-b838-cfec1364f9d4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:17.048516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a44d9f5a-602d-4fa3-b838-cfec1364f9d4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:17.208197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a44d9f5a-602d-4fa3-b838-cfec1364f9d4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:17.215954 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a44d9f5a-602d-4fa3-b838-cfec1364f9d4 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.189397 Oct 27 19:52:17.216663 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3907/7663] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:17 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:18.242017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d06a80f6-f795-4ba6-b90c-ca92ac3b6ad5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:18.242970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d06a80f6-f795-4ba6-b90c-ca92ac3b6ad5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:18.249075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d06a80f6-f795-4ba6-b90c-ca92ac3b6ad5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:18.249573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d06a80f6-f795-4ba6-b90c-ca92ac3b6ad5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:18.250033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d06a80f6-f795-4ba6-b90c-ca92ac3b6ad5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:18.250768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d06a80f6-f795-4ba6-b90c-ca92ac3b6ad5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:18.251237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d06a80f6-f795-4ba6-b90c-ca92ac3b6ad5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:18.251677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d06a80f6-f795-4ba6-b90c-ca92ac3b6ad5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:18.382460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d06a80f6-f795-4ba6-b90c-ca92ac3b6ad5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:18.390155 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d06a80f6-f795-4ba6-b90c-ca92ac3b6ad5 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.152959 Oct 27 19:52:18.390763 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3757/7664] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:18 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:19.414170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3ed5ea6d-4d63-4d73-a77c-71dda2d5692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:19.414818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3ed5ea6d-4d63-4d73-a77c-71dda2d5692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:19.417533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:52:19.418219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:52:19.424074 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ed5ea6d-4d63-4d73-a77c-71dda2d5692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:19.424560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ed5ea6d-4d63-4d73-a77c-71dda2d5692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:19.425003 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ed5ea6d-4d63-4d73-a77c-71dda2d5692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:19.425703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ed5ea6d-4d63-4d73-a77c-71dda2d5692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:19.426803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ed5ea6d-4d63-4d73-a77c-71dda2d5692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:19.427240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3ed5ea6d-4d63-4d73-a77c-71dda2d5692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:19.559812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3ed5ea6d-4d63-4d73-a77c-71dda2d5692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:19.567950 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3ed5ea6d-4d63-4d73-a77c-71dda2d5692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.158257 Oct 27 19:52:19.568631 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3908/7665] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:19 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:20.591000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-785c0020-8647-4fca-b7e2-fa85ce292ef6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:20.591630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-785c0020-8647-4fca-b7e2-fa85ce292ef6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:20.593481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:52:20.600240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-785c0020-8647-4fca-b7e2-fa85ce292ef6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:20.600738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-785c0020-8647-4fca-b7e2-fa85ce292ef6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:20.601194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-785c0020-8647-4fca-b7e2-fa85ce292ef6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:20.601896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-785c0020-8647-4fca-b7e2-fa85ce292ef6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:20.602367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-785c0020-8647-4fca-b7e2-fa85ce292ef6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:20.602836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-785c0020-8647-4fca-b7e2-fa85ce292ef6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:20.734455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-785c0020-8647-4fca-b7e2-fa85ce292ef6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:20.743014 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-785c0020-8647-4fca-b7e2-fa85ce292ef6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.155991 Oct 27 19:52:20.743586 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3758/7666] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:20 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:21.766152 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8cca4565-2b3b-4924-9252-5827e50f9c53 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:21.766799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8cca4565-2b3b-4924-9252-5827e50f9c53 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:21.774214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cca4565-2b3b-4924-9252-5827e50f9c53 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:21.774735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cca4565-2b3b-4924-9252-5827e50f9c53 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:21.775180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cca4565-2b3b-4924-9252-5827e50f9c53 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:21.775883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cca4565-2b3b-4924-9252-5827e50f9c53 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:21.776345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cca4565-2b3b-4924-9252-5827e50f9c53 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:21.776780 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8cca4565-2b3b-4924-9252-5827e50f9c53 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:21.918890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8cca4565-2b3b-4924-9252-5827e50f9c53 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:21.927271 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8cca4565-2b3b-4924-9252-5827e50f9c53 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.164878 Oct 27 19:52:21.928288 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3909/7667] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:21 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:21.959745 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d78c3c19-842f-44af-93e5-de3a7f60ddfd req-43433c97-f5b8-493d-ae9f-60adf1c1adeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c24bf903-06f2-4f9f-a371-3bce459f33cf", "tag": "ae452663-4a35-4b05-a968-99fde3dfbf86"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:52:21.982407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d78c3c19-842f-44af-93e5-de3a7f60ddfd req-43433c97-f5b8-493d-ae9f-60adf1c1adeb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:21.983422 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d78c3c19-842f-44af-93e5-de3a7f60ddfd req-43433c97-f5b8-493d-ae9f-60adf1c1adeb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:21.983907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d78c3c19-842f-44af-93e5-de3a7f60ddfd req-43433c97-f5b8-493d-ae9f-60adf1c1adeb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:21.999398 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d78c3c19-842f-44af-93e5-de3a7f60ddfd req-43433c97-f5b8-493d-ae9f-60adf1c1adeb service nova] Creating event network-changed:ae452663-4a35-4b05-a968-99fde3dfbf86 for instance c24bf903-06f2-4f9f-a371-3bce459f33cf on n-h2-860687-3 Oct 27 19:52:22.004819 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d78c3c19-842f-44af-93e5-de3a7f60ddfd req-43433c97-f5b8-493d-ae9f-60adf1c1adeb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049554 Oct 27 19:52:22.005455 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3759/7668] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:52:22.951418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6117a97b-73f6-46ac-9306-39b4b5e5b607 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:22.952040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6117a97b-73f6-46ac-9306-39b4b5e5b607 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:22.959927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6117a97b-73f6-46ac-9306-39b4b5e5b607 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:22.960477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6117a97b-73f6-46ac-9306-39b4b5e5b607 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:22.960920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6117a97b-73f6-46ac-9306-39b4b5e5b607 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:22.961615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6117a97b-73f6-46ac-9306-39b4b5e5b607 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:22.962078 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6117a97b-73f6-46ac-9306-39b4b5e5b607 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:22.962544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6117a97b-73f6-46ac-9306-39b4b5e5b607 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:23.093222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6117a97b-73f6-46ac-9306-39b4b5e5b607 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:23.101623 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6117a97b-73f6-46ac-9306-39b4b5e5b607 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.154084 Oct 27 19:52:23.102193 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3910/7669] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:22 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:24.126682 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-704b33aa-ac25-4e33-bdb4-a04ea92908b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:24.127551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-704b33aa-ac25-4e33-bdb4-a04ea92908b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:24.134847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-704b33aa-ac25-4e33-bdb4-a04ea92908b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:24.135348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-704b33aa-ac25-4e33-bdb4-a04ea92908b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:24.135803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-704b33aa-ac25-4e33-bdb4-a04ea92908b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:24.136518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-704b33aa-ac25-4e33-bdb4-a04ea92908b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:24.136993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-704b33aa-ac25-4e33-bdb4-a04ea92908b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:24.137539 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-704b33aa-ac25-4e33-bdb4-a04ea92908b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:24.297072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-704b33aa-ac25-4e33-bdb4-a04ea92908b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:24.306106 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-704b33aa-ac25-4e33-bdb4-a04ea92908b6 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.184600 Oct 27 19:52:24.306716 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3760/7670] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:24 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:25.329923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d65c4f06-4748-4dfa-a107-5c83b8ec6fa7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:25.330585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d65c4f06-4748-4dfa-a107-5c83b8ec6fa7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:25.338220 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65c4f06-4748-4dfa-a107-5c83b8ec6fa7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:25.338747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65c4f06-4748-4dfa-a107-5c83b8ec6fa7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:25.339199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65c4f06-4748-4dfa-a107-5c83b8ec6fa7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:25.339950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65c4f06-4748-4dfa-a107-5c83b8ec6fa7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:25.340723 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65c4f06-4748-4dfa-a107-5c83b8ec6fa7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:25.341192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d65c4f06-4748-4dfa-a107-5c83b8ec6fa7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:25.482872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d65c4f06-4748-4dfa-a107-5c83b8ec6fa7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:25.491577 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d65c4f06-4748-4dfa-a107-5c83b8ec6fa7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.165586 Oct 27 19:52:25.492152 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3911/7671] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:25 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:26.515073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55469d73-8452-4e7f-bd97-e3c223f23ce8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:26.515734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-55469d73-8452-4e7f-bd97-e3c223f23ce8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:26.522819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55469d73-8452-4e7f-bd97-e3c223f23ce8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:26.523327 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55469d73-8452-4e7f-bd97-e3c223f23ce8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:26.523818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55469d73-8452-4e7f-bd97-e3c223f23ce8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:26.524534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55469d73-8452-4e7f-bd97-e3c223f23ce8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:26.525015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55469d73-8452-4e7f-bd97-e3c223f23ce8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:26.525465 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55469d73-8452-4e7f-bd97-e3c223f23ce8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:26.663407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-55469d73-8452-4e7f-bd97-e3c223f23ce8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:26.671546 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-55469d73-8452-4e7f-bd97-e3c223f23ce8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.160398 Oct 27 19:52:26.672141 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3761/7672] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:26 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:27.275859 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-f0d16e4e-55d5-484f-b934-4b628a7d2882 req-214248d1-a6d1-4288-9393-3267b667face service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24bf903-06f2-4f9f-a371-3bce459f33cf", "name": "network-vif-plugged", "status": "completed", "tag": "ae452663-4a35-4b05-a968-99fde3dfbf86"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:52:27.287527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f0d16e4e-55d5-484f-b934-4b628a7d2882 req-214248d1-a6d1-4288-9393-3267b667face service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:27.288022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f0d16e4e-55d5-484f-b934-4b628a7d2882 req-214248d1-a6d1-4288-9393-3267b667face service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:27.288471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f0d16e4e-55d5-484f-b934-4b628a7d2882 req-214248d1-a6d1-4288-9393-3267b667face service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:27.300981 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-f0d16e4e-55d5-484f-b934-4b628a7d2882 req-214248d1-a6d1-4288-9393-3267b667face service nova] Creating event network-vif-plugged:ae452663-4a35-4b05-a968-99fde3dfbf86 for instance c24bf903-06f2-4f9f-a371-3bce459f33cf on n-h2-860687-3 Oct 27 19:52:27.306231 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-f0d16e4e-55d5-484f-b934-4b628a7d2882 req-214248d1-a6d1-4288-9393-3267b667face service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090721 Oct 27 19:52:27.306913 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3912/7673] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:52:27.696449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a7d7ba20-c910-4d63-ba92-762c4c5ed095 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:27.697091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a7d7ba20-c910-4d63-ba92-762c4c5ed095 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:27.704030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7d7ba20-c910-4d63-ba92-762c4c5ed095 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:27.704475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7d7ba20-c910-4d63-ba92-762c4c5ed095 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:27.704936 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7d7ba20-c910-4d63-ba92-762c4c5ed095 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:27.705650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7d7ba20-c910-4d63-ba92-762c4c5ed095 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:27.706122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7d7ba20-c910-4d63-ba92-762c4c5ed095 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:27.706604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a7d7ba20-c910-4d63-ba92-762c4c5ed095 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:27.840987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a7d7ba20-c910-4d63-ba92-762c4c5ed095 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:27.848890 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a7d7ba20-c910-4d63-ba92-762c4c5ed095 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1359 microversion: 2.1 time: 0.157415 Oct 27 19:52:27.849655 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3762/7674] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:27 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:28.874147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cd7a6a62-3fe8-482c-96a5-7498d4a01e12 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:28.874918 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cd7a6a62-3fe8-482c-96a5-7498d4a01e12 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:28.881650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd7a6a62-3fe8-482c-96a5-7498d4a01e12 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:28.882144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd7a6a62-3fe8-482c-96a5-7498d4a01e12 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:28.882620 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd7a6a62-3fe8-482c-96a5-7498d4a01e12 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:28.883322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd7a6a62-3fe8-482c-96a5-7498d4a01e12 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:28.883790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd7a6a62-3fe8-482c-96a5-7498d4a01e12 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:28.884223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cd7a6a62-3fe8-482c-96a5-7498d4a01e12 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:29.021671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cd7a6a62-3fe8-482c-96a5-7498d4a01e12 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:29.029623 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cd7a6a62-3fe8-482c-96a5-7498d4a01e12 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1549 microversion: 2.1 time: 0.160810 Oct 27 19:52:29.030195 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3913/7675] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:28 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:29.052773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7c8bd4d9-6dd7-42ba-af71-9c02fa14863b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:29.053405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7c8bd4d9-6dd7-42ba-af71-9c02fa14863b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:29.060309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8bd4d9-6dd7-42ba-af71-9c02fa14863b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:29.060806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8bd4d9-6dd7-42ba-af71-9c02fa14863b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:29.061261 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8bd4d9-6dd7-42ba-af71-9c02fa14863b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:29.061974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8bd4d9-6dd7-42ba-af71-9c02fa14863b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:29.062555 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8bd4d9-6dd7-42ba-af71-9c02fa14863b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:29.063005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c8bd4d9-6dd7-42ba-af71-9c02fa14863b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:29.197554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7c8bd4d9-6dd7-42ba-af71-9c02fa14863b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:29.205375 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7c8bd4d9-6dd7-42ba-af71-9c02fa14863b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1549 microversion: 2.1 time: 0.157185 Oct 27 19:52:29.205953 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3763/7676] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:29 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:29.228493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-79ff7386-9e99-4446-b470-dfcc891f6c1b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:29.233318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-79ff7386-9e99-4446-b470-dfcc891f6c1b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:29.234118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-79ff7386-9e99-4446-b470-dfcc891f6c1b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Searching by: {'deleted': False, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746'} {{(pid=127029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 19:52:29.239995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ff7386-9e99-4446-b470-dfcc891f6c1b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:29.240477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ff7386-9e99-4446-b470-dfcc891f6c1b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:29.240923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ff7386-9e99-4446-b470-dfcc891f6c1b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:29.241655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ff7386-9e99-4446-b470-dfcc891f6c1b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:29.242123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ff7386-9e99-4446-b470-dfcc891f6c1b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:29.242594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-79ff7386-9e99-4446-b470-dfcc891f6c1b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:29.266717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.multi_cell_list [None req-79ff7386-9e99-4446-b470-dfcc891f6c1b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 19:52:29.292989 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-79ff7386-9e99-4446-b470-dfcc891f6c1b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068424 Oct 27 19:52:29.293570 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3914/7677] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 19:52:29 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:52:29.305782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6374d591-1976-4120-bcdf-e9f4e43c37b2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:29.306432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6374d591-1976-4120-bcdf-e9f4e43c37b2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:29.312362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6374d591-1976-4120-bcdf-e9f4e43c37b2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:29.312924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6374d591-1976-4120-bcdf-e9f4e43c37b2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:29.313310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6374d591-1976-4120-bcdf-e9f4e43c37b2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:29.314050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6374d591-1976-4120-bcdf-e9f4e43c37b2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:29.314509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6374d591-1976-4120-bcdf-e9f4e43c37b2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:29.314954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6374d591-1976-4120-bcdf-e9f4e43c37b2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:29.447567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6374d591-1976-4120-bcdf-e9f4e43c37b2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:29.455329 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6374d591-1976-4120-bcdf-e9f4e43c37b2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1549 microversion: 2.1 time: 0.153450 Oct 27 19:52:29.455908 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3764/7678] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:29 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:30.985443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13d6506a-ce10-48f7-abf9-2e44cf2f3ead tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b324a23-fa83-4632-8cd5-6959b75e0111"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:52:30.987833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-13d6506a-ce10-48f7-abf9-2e44cf2f3ead tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:30.995107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13d6506a-ce10-48f7-abf9-2e44cf2f3ead tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:30.995632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13d6506a-ce10-48f7-abf9-2e44cf2f3ead tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:30.996083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13d6506a-ce10-48f7-abf9-2e44cf2f3ead tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:30.996790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13d6506a-ce10-48f7-abf9-2e44cf2f3ead tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:30.997261 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13d6506a-ce10-48f7-abf9-2e44cf2f3ead tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:30.997698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13d6506a-ce10-48f7-abf9-2e44cf2f3ead tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:31.236304 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13d6506a-ce10-48f7-abf9-2e44cf2f3ead tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "POST /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254646 Oct 27 19:52:31.243036 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3915/7679] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 19:52:30 2022] POST /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:52:42.025362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b0c906ac-aa20-469f-b801-d3301cf6837f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:42.026008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0c906ac-aa20-469f-b801-d3301cf6837f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:42.029072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=17 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:52:42.029767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=62 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:52:42.036262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0c906ac-aa20-469f-b801-d3301cf6837f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:42.036776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0c906ac-aa20-469f-b801-d3301cf6837f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:42.037240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0c906ac-aa20-469f-b801-d3301cf6837f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:42.037968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0c906ac-aa20-469f-b801-d3301cf6837f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:42.038481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0c906ac-aa20-469f-b801-d3301cf6837f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:42.038935 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0c906ac-aa20-469f-b801-d3301cf6837f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:42.170762 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0c906ac-aa20-469f-b801-d3301cf6837f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:42.179661 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b0c906ac-aa20-469f-b801-d3301cf6837f tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1595 microversion: 2.1 time: 0.158232 Oct 27 19:52:42.180239 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3765/7680] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:42 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:44.024020 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:52:44.025436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=17 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:52:44.025951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:52:44.030956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-8540983d-10ad-4716-b24d-e1192cba913e req-698adf0b-13aa-4b0b-978e-c140e72dd869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c24bf903-06f2-4f9f-a371-3bce459f33cf", "tag": "ae452663-4a35-4b05-a968-99fde3dfbf86"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:52:44.045148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8540983d-10ad-4716-b24d-e1192cba913e req-698adf0b-13aa-4b0b-978e-c140e72dd869 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:44.045764 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8540983d-10ad-4716-b24d-e1192cba913e req-698adf0b-13aa-4b0b-978e-c140e72dd869 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:44.046214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-8540983d-10ad-4716-b24d-e1192cba913e req-698adf0b-13aa-4b0b-978e-c140e72dd869 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:44.059974 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-8540983d-10ad-4716-b24d-e1192cba913e req-698adf0b-13aa-4b0b-978e-c140e72dd869 service nova] Creating event network-changed:ae452663-4a35-4b05-a968-99fde3dfbf86 for instance c24bf903-06f2-4f9f-a371-3bce459f33cf on n-h2-860687-3 Oct 27 19:52:44.066734 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-8540983d-10ad-4716-b24d-e1192cba913e req-698adf0b-13aa-4b0b-978e-c140e72dd869 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043630 Oct 27 19:52:44.067903 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3916/7681] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:52:45.245424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-40034209-37c7-438f-9989-a35e7d56e6a8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1174290176"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:52:45.245988 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-40034209-37c7-438f-9989-a35e7d56e6a8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:45.253076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40034209-37c7-438f-9989-a35e7d56e6a8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:45.254269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40034209-37c7-438f-9989-a35e7d56e6a8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:45.255191 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40034209-37c7-438f-9989-a35e7d56e6a8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:45.255932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40034209-37c7-438f-9989-a35e7d56e6a8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:45.256614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40034209-37c7-438f-9989-a35e7d56e6a8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:45.257069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-40034209-37c7-438f-9989-a35e7d56e6a8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:45.385202 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.network.security_group_api [None req-40034209-37c7-438f-9989-a35e7d56e6a8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Adding security group d4dd8c52-c802-4cfd-938a-a0668d07bb69 to port ae452663-4a35-4b05-a968-99fde3dfbf86 Oct 27 19:52:45.708582 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-40034209-37c7-438f-9989-a35e7d56e6a8 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "POST /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/action" status: 202 len: 0 microversion: 2.1 time: 0.467068 Oct 27 19:52:45.709487 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3766/7682] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:52:45 2022] POST /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:52:45.720551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fa27d627-6f86-48b9-a106-650c9e22b62a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:52:45.721491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fa27d627-6f86-48b9-a106-650c9e22b62a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:52:45.730207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa27d627-6f86-48b9-a106-650c9e22b62a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:45.730829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa27d627-6f86-48b9-a106-650c9e22b62a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:45.731272 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa27d627-6f86-48b9-a106-650c9e22b62a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:45.732174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa27d627-6f86-48b9-a106-650c9e22b62a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:45.732849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa27d627-6f86-48b9-a106-650c9e22b62a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:45.733427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa27d627-6f86-48b9-a106-650c9e22b62a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:45.886473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fa27d627-6f86-48b9-a106-650c9e22b62a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:52:45.895945 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fa27d627-6f86-48b9-a106-650c9e22b62a tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1761 microversion: 2.1 time: 0.181725 Oct 27 19:52:45.896792 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3917/7683] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:52:45 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1761 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:52:46.083022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ed3b8cf7-78e5-4160-83dc-42820fb8ee77 req-2474cac8-1fbd-4154-b3a5-b3f5267fad29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c24bf903-06f2-4f9f-a371-3bce459f33cf", "tag": "ae452663-4a35-4b05-a968-99fde3dfbf86"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:52:46.092597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ed3b8cf7-78e5-4160-83dc-42820fb8ee77 req-2474cac8-1fbd-4154-b3a5-b3f5267fad29 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:52:46.093100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ed3b8cf7-78e5-4160-83dc-42820fb8ee77 req-2474cac8-1fbd-4154-b3a5-b3f5267fad29 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:52:46.093553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ed3b8cf7-78e5-4160-83dc-42820fb8ee77 req-2474cac8-1fbd-4154-b3a5-b3f5267fad29 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:52:46.107844 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ed3b8cf7-78e5-4160-83dc-42820fb8ee77 req-2474cac8-1fbd-4154-b3a5-b3f5267fad29 service nova] Creating event network-changed:ae452663-4a35-4b05-a968-99fde3dfbf86 for instance c24bf903-06f2-4f9f-a371-3bce459f33cf on n-h2-860687-3 Oct 27 19:52:46.113760 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ed3b8cf7-78e5-4160-83dc-42820fb8ee77 req-2474cac8-1fbd-4154-b3a5-b3f5267fad29 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033788 Oct 27 19:52:46.114742 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3767/7684] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:53:43.334206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:53:43.334883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:53:43.405507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8a158e37-c7c6-422f-8216-d218385c9745 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:53:43.407837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8a158e37-c7c6-422f-8216-d218385c9745 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:53:43.413819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a158e37-c7c6-422f-8216-d218385c9745 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:43.414307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a158e37-c7c6-422f-8216-d218385c9745 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:43.414864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a158e37-c7c6-422f-8216-d218385c9745 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:43.415554 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a158e37-c7c6-422f-8216-d218385c9745 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:43.416008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a158e37-c7c6-422f-8216-d218385c9745 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:43.416433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8a158e37-c7c6-422f-8216-d218385c9745 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:43.490100 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8a158e37-c7c6-422f-8216-d218385c9745 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "POST /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/action" status: 202 len: 0 microversion: 2.1 time: 0.161391 Oct 27 19:53:43.490763 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3918/7685] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:53:43 2022] POST /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:53:43.499426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ebfd72fd-59a2-446d-9df9-31449863692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:53:43.500262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ebfd72fd-59a2-446d-9df9-31449863692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:53:43.504233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:53:43.504987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=12 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:53:43.511086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ebfd72fd-59a2-446d-9df9-31449863692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:43.511601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ebfd72fd-59a2-446d-9df9-31449863692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:43.512077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ebfd72fd-59a2-446d-9df9-31449863692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:43.512804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ebfd72fd-59a2-446d-9df9-31449863692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:43.513280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ebfd72fd-59a2-446d-9df9-31449863692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:43.513742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ebfd72fd-59a2-446d-9df9-31449863692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:43.796197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ebfd72fd-59a2-446d-9df9-31449863692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:53:43.804753 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ebfd72fd-59a2-446d-9df9-31449863692b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1753 microversion: 2.1 time: 0.309487 Oct 27 19:53:43.805337 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3768/7686] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:53:43 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1753 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:53:44.830949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-da56b0a2-9141-474c-b8a4-9e3a19a5ef21 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:53:44.831675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-da56b0a2-9141-474c-b8a4-9e3a19a5ef21 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:53:44.837887 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da56b0a2-9141-474c-b8a4-9e3a19a5ef21 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:44.838311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da56b0a2-9141-474c-b8a4-9e3a19a5ef21 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:44.838802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da56b0a2-9141-474c-b8a4-9e3a19a5ef21 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:44.839495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da56b0a2-9141-474c-b8a4-9e3a19a5ef21 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:44.839950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da56b0a2-9141-474c-b8a4-9e3a19a5ef21 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:44.840379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da56b0a2-9141-474c-b8a4-9e3a19a5ef21 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:45.345398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-da56b0a2-9141-474c-b8a4-9e3a19a5ef21 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:53:45.353926 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-da56b0a2-9141-474c-b8a4-9e3a19a5ef21 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1758 microversion: 2.1 time: 0.528592 Oct 27 19:53:45.354515 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3919/7687] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:53:44 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1758 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:53:46.378012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7e3f0af7-80af-4649-a030-3fe876d45980 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:53:46.378815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7e3f0af7-80af-4649-a030-3fe876d45980 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:53:46.385796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e3f0af7-80af-4649-a030-3fe876d45980 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:46.386301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e3f0af7-80af-4649-a030-3fe876d45980 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:46.386792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e3f0af7-80af-4649-a030-3fe876d45980 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:46.387506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e3f0af7-80af-4649-a030-3fe876d45980 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:46.388008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e3f0af7-80af-4649-a030-3fe876d45980 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:46.388458 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e3f0af7-80af-4649-a030-3fe876d45980 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:46.537997 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7e3f0af7-80af-4649-a030-3fe876d45980 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:53:46.546489 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7e3f0af7-80af-4649-a030-3fe876d45980 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1758 microversion: 2.1 time: 0.172898 Oct 27 19:53:46.547079 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3769/7688] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:53:46 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:53:47.570866 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a734b92b-17b7-423d-9345-d422621b54d7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:53:47.571464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a734b92b-17b7-423d-9345-d422621b54d7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:53:47.578280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a734b92b-17b7-423d-9345-d422621b54d7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:47.578794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a734b92b-17b7-423d-9345-d422621b54d7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:47.579236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a734b92b-17b7-423d-9345-d422621b54d7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:47.579926 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a734b92b-17b7-423d-9345-d422621b54d7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:47.580572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a734b92b-17b7-423d-9345-d422621b54d7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:47.581008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a734b92b-17b7-423d-9345-d422621b54d7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:47.722530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a734b92b-17b7-423d-9345-d422621b54d7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:53:47.731128 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a734b92b-17b7-423d-9345-d422621b54d7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1758 microversion: 2.1 time: 0.164544 Oct 27 19:53:47.731707 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3920/7689] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:53:47 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:53:48.757395 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-499e6dea-cd81-43a2-bd4a-881336255050 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:53:48.758025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-499e6dea-cd81-43a2-bd4a-881336255050 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:53:48.765096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-499e6dea-cd81-43a2-bd4a-881336255050 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:48.765596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-499e6dea-cd81-43a2-bd4a-881336255050 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:48.766052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-499e6dea-cd81-43a2-bd4a-881336255050 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:48.766797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-499e6dea-cd81-43a2-bd4a-881336255050 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:48.767272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-499e6dea-cd81-43a2-bd4a-881336255050 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:48.767719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-499e6dea-cd81-43a2-bd4a-881336255050 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:48.912034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-499e6dea-cd81-43a2-bd4a-881336255050 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:53:48.920561 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-499e6dea-cd81-43a2-bd4a-881336255050 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1758 microversion: 2.1 time: 0.167143 Oct 27 19:53:48.921139 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3770/7690] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:53:48 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:53:49.946724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-23e21427-ac37-45a3-87dd-c028823d1310 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:53:49.947339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-23e21427-ac37-45a3-87dd-c028823d1310 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:53:49.955281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23e21427-ac37-45a3-87dd-c028823d1310 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:49.956288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23e21427-ac37-45a3-87dd-c028823d1310 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:49.956727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23e21427-ac37-45a3-87dd-c028823d1310 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:49.957413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23e21427-ac37-45a3-87dd-c028823d1310 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:49.957868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23e21427-ac37-45a3-87dd-c028823d1310 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:49.958301 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23e21427-ac37-45a3-87dd-c028823d1310 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:50.106372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-23e21427-ac37-45a3-87dd-c028823d1310 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:53:50.114749 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-23e21427-ac37-45a3-87dd-c028823d1310 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1758 microversion: 2.1 time: 0.172195 Oct 27 19:53:50.115328 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3921/7691] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:53:49 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:53:51.139760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e513cf5e-9605-4d16-aa0d-658f650bd42e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:53:51.140394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e513cf5e-9605-4d16-aa0d-658f650bd42e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:53:51.148161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e513cf5e-9605-4d16-aa0d-658f650bd42e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:51.148657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e513cf5e-9605-4d16-aa0d-658f650bd42e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:51.149113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e513cf5e-9605-4d16-aa0d-658f650bd42e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:51.149830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e513cf5e-9605-4d16-aa0d-658f650bd42e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:51.150305 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e513cf5e-9605-4d16-aa0d-658f650bd42e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:51.150802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e513cf5e-9605-4d16-aa0d-658f650bd42e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:51.295183 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e513cf5e-9605-4d16-aa0d-658f650bd42e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:53:51.304301 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e513cf5e-9605-4d16-aa0d-658f650bd42e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1758 microversion: 2.1 time: 0.168520 Oct 27 19:53:51.304887 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3771/7692] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:53:51 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:53:52.328803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1d1bb54f-8520-4b8f-b4f8-a75eaea1433c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:53:52.329427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1d1bb54f-8520-4b8f-b4f8-a75eaea1433c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:53:52.337343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d1bb54f-8520-4b8f-b4f8-a75eaea1433c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:52.337835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d1bb54f-8520-4b8f-b4f8-a75eaea1433c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:52.338283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d1bb54f-8520-4b8f-b4f8-a75eaea1433c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:52.339013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d1bb54f-8520-4b8f-b4f8-a75eaea1433c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:52.339476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d1bb54f-8520-4b8f-b4f8-a75eaea1433c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:52.339910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1d1bb54f-8520-4b8f-b4f8-a75eaea1433c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:52.482609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1d1bb54f-8520-4b8f-b4f8-a75eaea1433c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:53:52.491778 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1d1bb54f-8520-4b8f-b4f8-a75eaea1433c tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1758 microversion: 2.1 time: 0.166962 Oct 27 19:53:52.492567 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3922/7693] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:53:52 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:53:53.515995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb07ed2e-a17e-49b9-b59c-abc83fbffff2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:53:53.516624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb07ed2e-a17e-49b9-b59c-abc83fbffff2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:53:53.524136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb07ed2e-a17e-49b9-b59c-abc83fbffff2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:53.524635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb07ed2e-a17e-49b9-b59c-abc83fbffff2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:53.525086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb07ed2e-a17e-49b9-b59c-abc83fbffff2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:53.525793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb07ed2e-a17e-49b9-b59c-abc83fbffff2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:53.526263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb07ed2e-a17e-49b9-b59c-abc83fbffff2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:53.526773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb07ed2e-a17e-49b9-b59c-abc83fbffff2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:53.676014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-eb07ed2e-a17e-49b9-b59c-abc83fbffff2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:53:53.684334 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb07ed2e-a17e-49b9-b59c-abc83fbffff2 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1758 microversion: 2.1 time: 0.172268 Oct 27 19:53:53.684913 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3772/7694] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:53:53 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:53:54.709504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8316a6db-746f-4f67-8556-7ddbc7ae6e41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:53:54.710126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8316a6db-746f-4f67-8556-7ddbc7ae6e41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:53:54.717193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8316a6db-746f-4f67-8556-7ddbc7ae6e41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:54.717685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8316a6db-746f-4f67-8556-7ddbc7ae6e41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:54.718131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8316a6db-746f-4f67-8556-7ddbc7ae6e41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:54.718867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8316a6db-746f-4f67-8556-7ddbc7ae6e41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:54.719332 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8316a6db-746f-4f67-8556-7ddbc7ae6e41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:54.719771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8316a6db-746f-4f67-8556-7ddbc7ae6e41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:54.863560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8316a6db-746f-4f67-8556-7ddbc7ae6e41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:53:54.872048 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8316a6db-746f-4f67-8556-7ddbc7ae6e41 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1758 microversion: 2.1 time: 0.167028 Oct 27 19:53:54.872636 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3923/7695] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:53:54 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:53:55.899135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28cb6f11-289b-420a-9df1-7d1d92bb095b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:53:55.899779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-28cb6f11-289b-420a-9df1-7d1d92bb095b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:53:55.906723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28cb6f11-289b-420a-9df1-7d1d92bb095b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:55.907235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28cb6f11-289b-420a-9df1-7d1d92bb095b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:55.907702 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28cb6f11-289b-420a-9df1-7d1d92bb095b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:55.908454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28cb6f11-289b-420a-9df1-7d1d92bb095b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:53:55.908932 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28cb6f11-289b-420a-9df1-7d1d92bb095b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:53:55.909381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28cb6f11-289b-420a-9df1-7d1d92bb095b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:53:56.052320 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-28cb6f11-289b-420a-9df1-7d1d92bb095b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:53:56.060767 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-28cb6f11-289b-420a-9df1-7d1d92bb095b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1761 microversion: 2.1 time: 0.165595 Oct 27 19:53:56.061360 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3773/7696] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:53:55 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1761 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:54:50.688850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-33f59a4a-bcb0-441c-b587-99f4a1be903d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1174290176"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:54:50.689502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-33f59a4a-bcb0-441c-b587-99f4a1be903d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:54:50.691786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=12 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:54:50.692561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:54:50.699067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33f59a4a-bcb0-441c-b587-99f4a1be903d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:50.699633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33f59a4a-bcb0-441c-b587-99f4a1be903d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:50.700209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33f59a4a-bcb0-441c-b587-99f4a1be903d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:50.701036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33f59a4a-bcb0-441c-b587-99f4a1be903d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:50.701611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33f59a4a-bcb0-441c-b587-99f4a1be903d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:50.702125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-33f59a4a-bcb0-441c-b587-99f4a1be903d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:50.835711 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.network.security_group_api [None req-33f59a4a-bcb0-441c-b587-99f4a1be903d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Removing security group d4dd8c52-c802-4cfd-938a-a0668d07bb69 from port ae452663-4a35-4b05-a968-99fde3dfbf86 Oct 27 19:54:51.142176 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-33f59a4a-bcb0-441c-b587-99f4a1be903d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "POST /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/action" status: 202 len: 0 microversion: 2.1 time: 0.458027 Oct 27 19:54:51.145961 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3924/7697] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:54:50 2022] POST /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:54:51.151527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-cd56b4ec-ed6d-4483-b6a5-9095828aa28e req-9204e0e5-2aa0-4082-8325-68908eed137b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c24bf903-06f2-4f9f-a371-3bce459f33cf", "tag": "ae452663-4a35-4b05-a968-99fde3dfbf86"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:54:51.161911 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=12 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:54:51.162969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=36 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:54:51.166070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cd56b4ec-ed6d-4483-b6a5-9095828aa28e req-9204e0e5-2aa0-4082-8325-68908eed137b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:51.166869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cd56b4ec-ed6d-4483-b6a5-9095828aa28e req-9204e0e5-2aa0-4082-8325-68908eed137b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:51.168050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-cd56b4ec-ed6d-4483-b6a5-9095828aa28e req-9204e0e5-2aa0-4082-8325-68908eed137b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:51.185785 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-cd56b4ec-ed6d-4483-b6a5-9095828aa28e req-9204e0e5-2aa0-4082-8325-68908eed137b service nova] Creating event network-changed:ae452663-4a35-4b05-a968-99fde3dfbf86 for instance c24bf903-06f2-4f9f-a371-3bce459f33cf on n-h2-860687-3 Oct 27 19:54:51.195041 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-cd56b4ec-ed6d-4483-b6a5-9095828aa28e req-9204e0e5-2aa0-4082-8325-68908eed137b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047935 Oct 27 19:54:51.197233 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3774/7698] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:54:52.316954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a75b0b3b-3b49-427a-bc78-2b907129d8a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:54:52.317519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a75b0b3b-3b49-427a-bc78-2b907129d8a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:54:52.325146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a75b0b3b-3b49-427a-bc78-2b907129d8a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:52.325685 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a75b0b3b-3b49-427a-bc78-2b907129d8a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:52.326141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a75b0b3b-3b49-427a-bc78-2b907129d8a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:52.326876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a75b0b3b-3b49-427a-bc78-2b907129d8a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:52.327339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a75b0b3b-3b49-427a-bc78-2b907129d8a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:52.327770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a75b0b3b-3b49-427a-bc78-2b907129d8a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:52.418174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-a75b0b3b-3b49-427a-bc78-2b907129d8a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lazy-loading 'services' on Instance uuid c24bf903-06f2-4f9f-a371-3bce459f33cf {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:54:52.499164 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a75b0b3b-3b49-427a-bc78-2b907129d8a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments/2b324a23-fa83-4632-8cd5-6959b75e0111" status: 202 len: 0 microversion: 2.1 time: 0.187101 Oct 27 19:54:52.504068 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3925/7699] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:54:52 2022] DELETE /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments/2b324a23-fa83-4632-8cd5-6959b75e0111 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:54:52.515677 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70828809-75a8-4753-a9d4-470f4da401a7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:54:52.523812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-70828809-75a8-4753-a9d4-470f4da401a7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:54:52.536018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70828809-75a8-4753-a9d4-470f4da401a7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:52.536579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70828809-75a8-4753-a9d4-470f4da401a7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:52.537043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70828809-75a8-4753-a9d4-470f4da401a7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:52.537778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70828809-75a8-4753-a9d4-470f4da401a7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:52.549497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70828809-75a8-4753-a9d4-470f4da401a7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:52.550507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70828809-75a8-4753-a9d4-470f4da401a7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:52.589889 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70828809-75a8-4753-a9d4-470f4da401a7 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083980 Oct 27 19:54:52.590871 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3775/7700] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:54:52 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:54:53.214033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-4a1ada8b-e3b4-48b6-badf-a85395aa64e6 req-997780db-b220-4a69-a0fd-d2ff18ffe960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c24bf903-06f2-4f9f-a371-3bce459f33cf", "tag": "ae452663-4a35-4b05-a968-99fde3dfbf86"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:54:53.225250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4a1ada8b-e3b4-48b6-badf-a85395aa64e6 req-997780db-b220-4a69-a0fd-d2ff18ffe960 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:53.226012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4a1ada8b-e3b4-48b6-badf-a85395aa64e6 req-997780db-b220-4a69-a0fd-d2ff18ffe960 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:53.226694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4a1ada8b-e3b4-48b6-badf-a85395aa64e6 req-997780db-b220-4a69-a0fd-d2ff18ffe960 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:53.239847 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-4a1ada8b-e3b4-48b6-badf-a85395aa64e6 req-997780db-b220-4a69-a0fd-d2ff18ffe960 service nova] Creating event network-changed:ae452663-4a35-4b05-a968-99fde3dfbf86 for instance c24bf903-06f2-4f9f-a371-3bce459f33cf on n-h2-860687-3 Oct 27 19:54:53.245421 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-4a1ada8b-e3b4-48b6-badf-a85395aa64e6 req-997780db-b220-4a69-a0fd-d2ff18ffe960 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035875 Oct 27 19:54:53.246041 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3926/7701] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:54:53.604230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-641c9258-1a14-4d50-9f3b-2ad89f13d325 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:54:53.606737 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-641c9258-1a14-4d50-9f3b-2ad89f13d325 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:54:53.613687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-641c9258-1a14-4d50-9f3b-2ad89f13d325 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:53.614536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-641c9258-1a14-4d50-9f3b-2ad89f13d325 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:53.615078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-641c9258-1a14-4d50-9f3b-2ad89f13d325 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:53.615917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-641c9258-1a14-4d50-9f3b-2ad89f13d325 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:53.616478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-641c9258-1a14-4d50-9f3b-2ad89f13d325 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:53.617002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-641c9258-1a14-4d50-9f3b-2ad89f13d325 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:53.650537 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-641c9258-1a14-4d50-9f3b-2ad89f13d325 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050181 Oct 27 19:54:53.651127 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3776/7702] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:54:53 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:54:54.665882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a248427d-b60a-4312-a875-6eb03223ce4d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:54:54.668218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a248427d-b60a-4312-a875-6eb03223ce4d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:54:54.675506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a248427d-b60a-4312-a875-6eb03223ce4d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:54.676100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a248427d-b60a-4312-a875-6eb03223ce4d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:54.676638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a248427d-b60a-4312-a875-6eb03223ce4d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:54.677525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a248427d-b60a-4312-a875-6eb03223ce4d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:54.677998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a248427d-b60a-4312-a875-6eb03223ce4d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:54.678572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a248427d-b60a-4312-a875-6eb03223ce4d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:54.712836 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a248427d-b60a-4312-a875-6eb03223ce4d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052052 Oct 27 19:54:54.713861 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3927/7703] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:54:54 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:54:55.725587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6c6a665d-61f7-46ca-880c-0864e9f3bc45 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:54:55.727773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6c6a665d-61f7-46ca-880c-0864e9f3bc45 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:54:55.734676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c6a665d-61f7-46ca-880c-0864e9f3bc45 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:55.735782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c6a665d-61f7-46ca-880c-0864e9f3bc45 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:55.736870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c6a665d-61f7-46ca-880c-0864e9f3bc45 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:55.737590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c6a665d-61f7-46ca-880c-0864e9f3bc45 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:55.738065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c6a665d-61f7-46ca-880c-0864e9f3bc45 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:55.738542 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c6a665d-61f7-46ca-880c-0864e9f3bc45 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:55.772891 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6c6a665d-61f7-46ca-880c-0864e9f3bc45 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051438 Oct 27 19:54:55.773476 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3777/7704] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:54:55 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:54:56.785922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-231dd707-4bb2-425c-8311-45541449a085 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:54:56.788277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-231dd707-4bb2-425c-8311-45541449a085 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:54:56.796060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231dd707-4bb2-425c-8311-45541449a085 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:56.796552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231dd707-4bb2-425c-8311-45541449a085 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:56.796987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231dd707-4bb2-425c-8311-45541449a085 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:56.798969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231dd707-4bb2-425c-8311-45541449a085 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:56.799446 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231dd707-4bb2-425c-8311-45541449a085 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:56.799879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-231dd707-4bb2-425c-8311-45541449a085 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:56.832975 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-231dd707-4bb2-425c-8311-45541449a085 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051605 Oct 27 19:54:56.833538 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3928/7705] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:54:56 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:54:57.845714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-06642ed2-93cf-4aab-8e80-3a8028e9c49e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:54:57.847960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-06642ed2-93cf-4aab-8e80-3a8028e9c49e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:54:57.854781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06642ed2-93cf-4aab-8e80-3a8028e9c49e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:57.855279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06642ed2-93cf-4aab-8e80-3a8028e9c49e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:57.855733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06642ed2-93cf-4aab-8e80-3a8028e9c49e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:57.856469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06642ed2-93cf-4aab-8e80-3a8028e9c49e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:57.856940 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06642ed2-93cf-4aab-8e80-3a8028e9c49e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:57.857384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06642ed2-93cf-4aab-8e80-3a8028e9c49e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:57.886974 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-06642ed2-93cf-4aab-8e80-3a8028e9c49e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045451 Oct 27 19:54:57.887538 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3778/7706] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 19:54:57 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 19:54:57.898238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6ad8b71-646d-4745-bb10-bc22174b53a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:54:57.898769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c6ad8b71-646d-4745-bb10-bc22174b53a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:54:57.905630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6ad8b71-646d-4745-bb10-bc22174b53a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:57.906151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6ad8b71-646d-4745-bb10-bc22174b53a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:57.906662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6ad8b71-646d-4745-bb10-bc22174b53a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:57.907525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6ad8b71-646d-4745-bb10-bc22174b53a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:54:57.907974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6ad8b71-646d-4745-bb10-bc22174b53a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:54:57.908415 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c6ad8b71-646d-4745-bb10-bc22174b53a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:54:57.983669 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-c6ad8b71-646d-4745-bb10-bc22174b53a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] HTTP exception thrown: Instance c24bf903-06f2-4f9f-a371-3bce459f33cf is not attached to volume 2b324a23-fa83-4632-8cd5-6959b75e0111 Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6ad8b71-646d-4745-bb10-bc22174b53a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Request method failure captured: Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: request: DELETE /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments/2b324a23-fa83-4632-8cd5-6959b75e0111 HTTP/1.1 Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWuBprlMxhftEROb8p871RGF2-FE8nWqTSFnfjGUqJ702bnTiboKOyiPmsQNozzpMxhiDplryo3nuAByf7abL8gkbgfphqwqX1kC5GDmFb3A2vw7e6P9JWByVPwVtFA2oaw0yTTdcLfLBWdXI2vd1t4C-qajOPPW4-dFlO8_ps2ggD24 Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 8e51a6992dcd4ee0b08f295d39e44746 Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestMinimumBasicScenario-1956853124 Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8e51a6992dcd4ee0b08f295d39e44746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8e51a6992dcd4ee0b08f295d39e44746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8e51a6992dcd4ee0b08f295d39e44746", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8e51a6992dcd4ee0b08f295d39e44746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestMinimumBasicScenario-1956853124 Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 8e51a6992dcd4ee0b08f295d39e44746 Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1956853124 Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestMinimumBasicScenario-1956853124-project Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 7472e97186cb406bbfe973fc665d7d7e Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestMinimumBasicScenario-1956853124-project Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance c24bf903-06f2-4f9f-a371-3bce459f33cf is not attached to volume 2b324a23-fa83-4632-8cd5-6959b75e0111 Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'server_id': 'c24bf903-06f2-4f9f-a371-3bce459f33cf', 'id': '2b324a23-fa83-4632-8cd5-6959b75e0111'} Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2b324a23-fa83-4632-8cd5-6959b75e0111. Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c24bf903-06f2-4f9f-a371-3bce459f33cf is not attached to volume 2b324a23-fa83-4632-8cd5-6959b75e0111 Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:54:57.985820 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:54:57.990575 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:54:57.990575 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:54:57.990575 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c24bf903-06f2-4f9f-a371-3bce459f33cf is not attached to volume 2b324a23-fa83-4632-8cd5-6959b75e0111 Oct 27 19:54:57.990575 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:54:57.990575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c6ad8b71-646d-4745-bb10-bc22174b53a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Returning 404 to user: Instance c24bf903-06f2-4f9f-a371-3bce459f33cf is not attached to volume 2b324a23-fa83-4632-8cd5-6959b75e0111 {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:54:57.990575 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c6ad8b71-646d-4745-bb10-bc22174b53a1 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments/2b324a23-fa83-4632-8cd5-6959b75e0111" status: 404 len: 154 microversion: 2.1 time: 0.093259 Oct 27 19:54:57.990575 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3929/7707] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 19:54:57 2022] DELETE /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf/os-volume_attachments/2b324a23-fa83-4632-8cd5-6959b75e0111 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:55:01.245447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8981fb53-64fb-4a28-9a30-0909edfd4474 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:01.245952 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8981fb53-64fb-4a28-9a30-0909edfd4474 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:01.254226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8981fb53-64fb-4a28-9a30-0909edfd4474 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:01.254941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8981fb53-64fb-4a28-9a30-0909edfd4474 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:01.255404 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8981fb53-64fb-4a28-9a30-0909edfd4474 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:01.256152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8981fb53-64fb-4a28-9a30-0909edfd4474 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:01.256632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8981fb53-64fb-4a28-9a30-0909edfd4474 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:01.257078 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8981fb53-64fb-4a28-9a30-0909edfd4474 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:01.283617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8981fb53-64fb-4a28-9a30-0909edfd4474 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:55:01.370465 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8981fb53-64fb-4a28-9a30-0909edfd4474 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 204 len: 0 microversion: 2.1 time: 0.128674 Oct 27 19:55:01.371631 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3779/7708] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:55:01 2022] DELETE /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:55:01.381512 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2f5fde48-06df-4c1c-afed-01ecbd54628e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:01.382141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2f5fde48-06df-4c1c-afed-01ecbd54628e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:01.389826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f5fde48-06df-4c1c-afed-01ecbd54628e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:01.390333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f5fde48-06df-4c1c-afed-01ecbd54628e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:01.390809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f5fde48-06df-4c1c-afed-01ecbd54628e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:01.392164 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f5fde48-06df-4c1c-afed-01ecbd54628e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:01.392895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f5fde48-06df-4c1c-afed-01ecbd54628e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:01.393086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f5fde48-06df-4c1c-afed-01ecbd54628e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:01.528644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2f5fde48-06df-4c1c-afed-01ecbd54628e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:01.536623 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2f5fde48-06df-4c1c-afed-01ecbd54628e tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1555 microversion: 2.1 time: 0.159380 Oct 27 19:55:01.537200 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3930/7709] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:01 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:55:02.560806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-466a1c08-220b-46e4-a686-91e9a6c2de3d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:02.561650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-466a1c08-220b-46e4-a686-91e9a6c2de3d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:02.570048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-466a1c08-220b-46e4-a686-91e9a6c2de3d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:02.570591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-466a1c08-220b-46e4-a686-91e9a6c2de3d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:02.571056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-466a1c08-220b-46e4-a686-91e9a6c2de3d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:02.572147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-466a1c08-220b-46e4-a686-91e9a6c2de3d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:02.572630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-466a1c08-220b-46e4-a686-91e9a6c2de3d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:02.573081 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-466a1c08-220b-46e4-a686-91e9a6c2de3d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:02.709567 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-466a1c08-220b-46e4-a686-91e9a6c2de3d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:02.717787 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-466a1c08-220b-46e4-a686-91e9a6c2de3d tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1555 microversion: 2.1 time: 0.161395 Oct 27 19:55:02.718396 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3780/7710] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:02 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:55:03.743538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fb07eb3c-3345-438e-a56c-91fcfbec49c3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:03.744790 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fb07eb3c-3345-438e-a56c-91fcfbec49c3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:03.752012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb07eb3c-3345-438e-a56c-91fcfbec49c3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:03.752566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb07eb3c-3345-438e-a56c-91fcfbec49c3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:03.753113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb07eb3c-3345-438e-a56c-91fcfbec49c3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:03.753973 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb07eb3c-3345-438e-a56c-91fcfbec49c3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:03.754601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb07eb3c-3345-438e-a56c-91fcfbec49c3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:03.755087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fb07eb3c-3345-438e-a56c-91fcfbec49c3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:03.833657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fb07eb3c-3345-438e-a56c-91fcfbec49c3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7472e97186cb406bbfe973fc665d7d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e51a6992dcd4ee0b08f295d39e44746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:03.843583 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fb07eb3c-3345-438e-a56c-91fcfbec49c3 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 200 len: 1513 microversion: 2.1 time: 0.103464 Oct 27 19:55:03.844384 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3931/7711] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:03 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 1513 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:55:03.852209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-230fd3c4-3849-46df-8982-5c82c5101b6f req-f109b7bb-373a-4d8d-a898-5bbbe2ffd713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24bf903-06f2-4f9f-a371-3bce459f33cf", "name": "network-vif-deleted", "tag": "ae452663-4a35-4b05-a968-99fde3dfbf86"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:55:03.863618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-230fd3c4-3849-46df-8982-5c82c5101b6f req-f109b7bb-373a-4d8d-a898-5bbbe2ffd713 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:03.864213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-230fd3c4-3849-46df-8982-5c82c5101b6f req-f109b7bb-373a-4d8d-a898-5bbbe2ffd713 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:03.864746 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-230fd3c4-3849-46df-8982-5c82c5101b6f req-f109b7bb-373a-4d8d-a898-5bbbe2ffd713 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:03.877274 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-230fd3c4-3849-46df-8982-5c82c5101b6f req-f109b7bb-373a-4d8d-a898-5bbbe2ffd713 service nova] Creating event network-vif-deleted:ae452663-4a35-4b05-a968-99fde3dfbf86 for instance c24bf903-06f2-4f9f-a371-3bce459f33cf on n-h2-860687-3 Oct 27 19:55:03.882169 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-230fd3c4-3849-46df-8982-5c82c5101b6f req-f109b7bb-373a-4d8d-a898-5bbbe2ffd713 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033771 Oct 27 19:55:03.882824 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3781/7712] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:55:04.871349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6a0a13f-93d5-47f9-81c6-4c1be1a96332 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:04.871974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d6a0a13f-93d5-47f9-81c6-4c1be1a96332 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] [instance: c24bf903-06f2-4f9f-a371-3bce459f33cf] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:04.879026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6a0a13f-93d5-47f9-81c6-4c1be1a96332 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:04.879520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6a0a13f-93d5-47f9-81c6-4c1be1a96332 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:04.879964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6a0a13f-93d5-47f9-81c6-4c1be1a96332 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:04.880663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6a0a13f-93d5-47f9-81c6-4c1be1a96332 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:04.881126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6a0a13f-93d5-47f9-81c6-4c1be1a96332 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:04.881560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d6a0a13f-93d5-47f9-81c6-4c1be1a96332 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:04.895072 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-d6a0a13f-93d5-47f9-81c6-4c1be1a96332 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] HTTP exception thrown: Instance c24bf903-06f2-4f9f-a371-3bce459f33cf could not be found. Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6a0a13f-93d5-47f9-81c6-4c1be1a96332 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Request method failure captured: Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf HTTP/1.1 Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWuBprlMxhftEROb8p871RGF2-FE8nWqTSFnfjGUqJ702bnTiboKOyiPmsQNozzpMxhiDplryo3nuAByf7abL8gkbgfphqwqX1kC5GDmFb3A2vw7e6P9JWByVPwVtFA2oaw0yTTdcLfLBWdXI2vd1t4C-qajOPPW4-dFlO8_ps2ggD24 Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 8e51a6992dcd4ee0b08f295d39e44746 Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestMinimumBasicScenario-1956853124 Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8e51a6992dcd4ee0b08f295d39e44746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8e51a6992dcd4ee0b08f295d39e44746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8e51a6992dcd4ee0b08f295d39e44746", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8e51a6992dcd4ee0b08f295d39e44746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestMinimumBasicScenario-1956853124 Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 8e51a6992dcd4ee0b08f295d39e44746 Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1956853124 Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestMinimumBasicScenario-1956853124-project Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 7472e97186cb406bbfe973fc665d7d7e Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestMinimumBasicScenario-1956853124-project Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance c24bf903-06f2-4f9f-a371-3bce459f33cf could not be found. Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'c24bf903-06f2-4f9f-a371-3bce459f33cf'} Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c24bf903-06f2-4f9f-a371-3bce459f33cf could not be found. Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c24bf903-06f2-4f9f-a371-3bce459f33cf could not be found. Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:55:04.896605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:55:04.901370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:55:04.901370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:55:04.901370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:55:04.901370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:55:04.901370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:55:04.901370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c24bf903-06f2-4f9f-a371-3bce459f33cf could not be found. Oct 27 19:55:04.901370 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:55:04.901370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d6a0a13f-93d5-47f9-81c6-4c1be1a96332 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Returning 404 to user: Instance c24bf903-06f2-4f9f-a371-3bce459f33cf could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:55:04.901370 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d6a0a13f-93d5-47f9-81c6-4c1be1a96332 tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf" status: 404 len: 111 microversion: 2.1 time: 0.030575 Oct 27 19:55:04.901370 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3932/7713] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:04 2022] GET /compute/v2.1/servers/c24bf903-06f2-4f9f-a371-3bce459f33cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:55:04.909525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e78f3a27-bd21-496a-92bd-e908e933250b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] Calling method '.version_select at 0x7fc869cdc8b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:04.930455 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e78f3a27-bd21-496a-92bd-e908e933250b tempest-TestMinimumBasicScenario-1956853124 tempest-TestMinimumBasicScenario-1956853124-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1681647125" status: 202 len: 0 microversion: 2.1 time: 0.027129 Oct 27 19:55:04.931041 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3782/7714] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Oct 27 19:55:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1681647125 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:55:14.019483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ff80063b-ba83-4c3e-98f8-7c62864c3ec2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'create', calling method: .version_select at 0x7fc869e2e310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-996471759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWfq34Phw9X9KbMArd+pPMWPliK+NR/HXcB8g7/Dd9S1lEOVpV5+Nu3Np2/HGIKgzJFme54swhoXhkrMXb1UoClTdSxrTDGLQ7k/Fr13aj3NBixkdK++es0F8djy0gbXg=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:55:14.034746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-ff80063b-ba83-4c3e-98f8-7c62864c3ec2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for project 6f32defe34974d2e800bf51c55662659. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:55:14.040706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-ff80063b-ba83-4c3e-98f8-7c62864c3ec2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for user 68cb39c4d811401f83ef30c675914669 and project 6f32defe34974d2e800bf51c55662659. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:55:14.065442 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ff80063b-ba83-4c3e-98f8-7c62864c3ec2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.208396 Oct 27 19:55:14.066081 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3933/7715] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:55:13 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:55:20.180079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:55:20.181692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:55:20.187162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2001415798", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "a8877e5d-2d09-4f42-a0df-8fbc2d37a44c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-996471759", "security_groups": [{"name": "tempest-secgroup-smoke-1757089886"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:55:20.313950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] validate_networks() for [('a8877e5d-2d09-4f42-a0df-8fbc2d37a44c', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:55:20.786169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:55:20.786650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:55:20.787180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:55:20.787610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:55:20.788040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:55:20.796949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:20.797499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:20.798230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:20.798716 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:20.799185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:20.799627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:20.820885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for project 6f32defe34974d2e800bf51c55662659. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:55:20.826623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for user 68cb39c4d811401f83ef30c675914669 and project 6f32defe34974d2e800bf51c55662659. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:55:20.839335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:55:20.841767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:55:20.888611 n-d-860687-3 devstack@n-api.service[127028]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [ead75ab1-53a2-4ae2-877d-afd1cf49a2fe] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 19:55:21.898709 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [ead75ab1-53a2-4ae2-877d-afd1cf49a2fe] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37340. Oct 27 19:55:21.903435 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c1e40260-868e-4b12-bb62-5fba77d0de13 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.725472 Oct 27 19:55:21.904260 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3783/7716] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:55:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:55:21.914025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:55:21.918765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5fa473e2-83b4-4b27-9fd3-317b15e68c53 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:21.919575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5fa473e2-83b4-4b27-9fd3-317b15e68c53 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:21.921637 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:55:21.997692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5fa473e2-83b4-4b27-9fd3-317b15e68c53 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:22.006320 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5fa473e2-83b4-4b27-9fd3-317b15e68c53 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1266 microversion: 2.1 time: 0.093865 Oct 27 19:55:22.007195 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3934/7717] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:21 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:55:23.031230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3a3575ee-e571-4ae3-bdcd-88aa940d1a9c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:23.032690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3a3575ee-e571-4ae3-bdcd-88aa940d1a9c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:23.040219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a3575ee-e571-4ae3-bdcd-88aa940d1a9c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:23.040973 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a3575ee-e571-4ae3-bdcd-88aa940d1a9c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:23.041433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a3575ee-e571-4ae3-bdcd-88aa940d1a9c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:23.042161 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a3575ee-e571-4ae3-bdcd-88aa940d1a9c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:23.042680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a3575ee-e571-4ae3-bdcd-88aa940d1a9c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:23.043129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3a3575ee-e571-4ae3-bdcd-88aa940d1a9c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:23.115817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3a3575ee-e571-4ae3-bdcd-88aa940d1a9c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:23.127199 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3a3575ee-e571-4ae3-bdcd-88aa940d1a9c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1318 microversion: 2.1 time: 0.100714 Oct 27 19:55:23.129150 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3784/7718] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:23 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1318 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:55:24.153782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aa19e23a-8723-40ab-8759-7b160a700a21 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:24.154339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-aa19e23a-8723-40ab-8759-7b160a700a21 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:24.166705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa19e23a-8723-40ab-8759-7b160a700a21 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:24.167452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa19e23a-8723-40ab-8759-7b160a700a21 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:24.168184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa19e23a-8723-40ab-8759-7b160a700a21 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:24.169109 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa19e23a-8723-40ab-8759-7b160a700a21 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:24.169919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa19e23a-8723-40ab-8759-7b160a700a21 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:24.170558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aa19e23a-8723-40ab-8759-7b160a700a21 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:24.433784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-aa19e23a-8723-40ab-8759-7b160a700a21 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:24.442344 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aa19e23a-8723-40ab-8759-7b160a700a21 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1392 microversion: 2.1 time: 0.293988 Oct 27 19:55:24.442941 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3935/7719] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:24 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1392 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:55:24.827515 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-3839e824-ed26-41d7-b8bb-5470a830e546 req-7e05053a-d9cd-486e-aa56-c977d50cbc25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6139246-0e5f-4e76-a122-83b3ab5179ad", "tag": "a912420c-978f-4f6f-8396-3c9e0a20f4db"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:55:24.839637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3839e824-ed26-41d7-b8bb-5470a830e546 req-7e05053a-d9cd-486e-aa56-c977d50cbc25 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:24.840289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3839e824-ed26-41d7-b8bb-5470a830e546 req-7e05053a-d9cd-486e-aa56-c977d50cbc25 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:24.840883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3839e824-ed26-41d7-b8bb-5470a830e546 req-7e05053a-d9cd-486e-aa56-c977d50cbc25 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:24.852831 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-3839e824-ed26-41d7-b8bb-5470a830e546 req-7e05053a-d9cd-486e-aa56-c977d50cbc25 service nova] Creating event network-changed:a912420c-978f-4f6f-8396-3c9e0a20f4db for instance a6139246-0e5f-4e76-a122-83b3ab5179ad on n-h1-860687-3 Oct 27 19:55:24.857982 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-3839e824-ed26-41d7-b8bb-5470a830e546 req-7e05053a-d9cd-486e-aa56-c977d50cbc25 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034302 Oct 27 19:55:24.858753 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3785/7720] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:55:25.466127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9cfb8303-f3a7-4987-b5a1-6408c2098101 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:25.467370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9cfb8303-f3a7-4987-b5a1-6408c2098101 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:25.474547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cfb8303-f3a7-4987-b5a1-6408c2098101 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:25.475036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cfb8303-f3a7-4987-b5a1-6408c2098101 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:25.475484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cfb8303-f3a7-4987-b5a1-6408c2098101 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:25.476522 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cfb8303-f3a7-4987-b5a1-6408c2098101 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:25.476967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cfb8303-f3a7-4987-b5a1-6408c2098101 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:25.477395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9cfb8303-f3a7-4987-b5a1-6408c2098101 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:25.617460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9cfb8303-f3a7-4987-b5a1-6408c2098101 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:25.625673 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9cfb8303-f3a7-4987-b5a1-6408c2098101 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1392 microversion: 2.1 time: 0.163289 Oct 27 19:55:25.626272 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3936/7721] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:25 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:55:26.649684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f81bd625-36b3-4df8-a6bd-a4dc533ec83a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:26.650439 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f81bd625-36b3-4df8-a6bd-a4dc533ec83a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:26.657371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f81bd625-36b3-4df8-a6bd-a4dc533ec83a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:26.657852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f81bd625-36b3-4df8-a6bd-a4dc533ec83a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:26.658415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f81bd625-36b3-4df8-a6bd-a4dc533ec83a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:26.659145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f81bd625-36b3-4df8-a6bd-a4dc533ec83a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:26.659628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f81bd625-36b3-4df8-a6bd-a4dc533ec83a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:26.660080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f81bd625-36b3-4df8-a6bd-a4dc533ec83a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:26.804884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f81bd625-36b3-4df8-a6bd-a4dc533ec83a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:26.812698 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f81bd625-36b3-4df8-a6bd-a4dc533ec83a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1392 microversion: 2.1 time: 0.168182 Oct 27 19:55:26.813428 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3786/7722] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:26 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:55:27.835921 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-55ecf8ab-1176-488b-95c6-a3ae8c949b51 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:27.836488 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-55ecf8ab-1176-488b-95c6-a3ae8c949b51 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:27.845980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55ecf8ab-1176-488b-95c6-a3ae8c949b51 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:27.846841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55ecf8ab-1176-488b-95c6-a3ae8c949b51 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:27.847599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55ecf8ab-1176-488b-95c6-a3ae8c949b51 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:27.848792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55ecf8ab-1176-488b-95c6-a3ae8c949b51 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:27.849551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55ecf8ab-1176-488b-95c6-a3ae8c949b51 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:27.850285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-55ecf8ab-1176-488b-95c6-a3ae8c949b51 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:27.994819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-55ecf8ab-1176-488b-95c6-a3ae8c949b51 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:28.003522 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-55ecf8ab-1176-488b-95c6-a3ae8c949b51 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1392 microversion: 2.1 time: 0.171647 Oct 27 19:55:28.004107 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3937/7723] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:27 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:55:29.028030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ed6b7e7-5f53-4cb3-ba01-33f929d1a62d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:29.028675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ed6b7e7-5f53-4cb3-ba01-33f929d1a62d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:29.035836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ed6b7e7-5f53-4cb3-ba01-33f929d1a62d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:29.036332 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ed6b7e7-5f53-4cb3-ba01-33f929d1a62d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:29.036805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ed6b7e7-5f53-4cb3-ba01-33f929d1a62d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:29.037535 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ed6b7e7-5f53-4cb3-ba01-33f929d1a62d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:29.038016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ed6b7e7-5f53-4cb3-ba01-33f929d1a62d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:29.038858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ed6b7e7-5f53-4cb3-ba01-33f929d1a62d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:29.178209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9ed6b7e7-5f53-4cb3-ba01-33f929d1a62d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:29.186633 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ed6b7e7-5f53-4cb3-ba01-33f929d1a62d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1392 microversion: 2.1 time: 0.162640 Oct 27 19:55:29.187237 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3787/7724] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:29 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:55:30.210840 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2d846e70-a3af-4aea-8bd1-14b00738c11a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:30.211413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2d846e70-a3af-4aea-8bd1-14b00738c11a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:30.218349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d846e70-a3af-4aea-8bd1-14b00738c11a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:30.218890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d846e70-a3af-4aea-8bd1-14b00738c11a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:30.219928 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d846e70-a3af-4aea-8bd1-14b00738c11a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:30.220621 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d846e70-a3af-4aea-8bd1-14b00738c11a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:30.221082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d846e70-a3af-4aea-8bd1-14b00738c11a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:30.221507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2d846e70-a3af-4aea-8bd1-14b00738c11a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:30.352238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2d846e70-a3af-4aea-8bd1-14b00738c11a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:30.360946 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2d846e70-a3af-4aea-8bd1-14b00738c11a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1392 microversion: 2.1 time: 0.154335 Oct 27 19:55:30.361518 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3938/7725] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:30 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:55:31.091559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-3ba65192-18b5-4dbd-bd7f-533fa27160d6 req-60082ae7-bb76-4389-b12b-ac0c54fc4690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6139246-0e5f-4e76-a122-83b3ab5179ad", "name": "network-vif-plugged", "status": "completed", "tag": "a912420c-978f-4f6f-8396-3c9e0a20f4db"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:55:31.098106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:55:31.099013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:55:31.105594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3ba65192-18b5-4dbd-bd7f-533fa27160d6 req-60082ae7-bb76-4389-b12b-ac0c54fc4690 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:31.106103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3ba65192-18b5-4dbd-bd7f-533fa27160d6 req-60082ae7-bb76-4389-b12b-ac0c54fc4690 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:31.106608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-3ba65192-18b5-4dbd-bd7f-533fa27160d6 req-60082ae7-bb76-4389-b12b-ac0c54fc4690 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:31.118969 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-3ba65192-18b5-4dbd-bd7f-533fa27160d6 req-60082ae7-bb76-4389-b12b-ac0c54fc4690 service nova] Creating event network-vif-plugged:a912420c-978f-4f6f-8396-3c9e0a20f4db for instance a6139246-0e5f-4e76-a122-83b3ab5179ad on n-h1-860687-3 Oct 27 19:55:31.124004 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-3ba65192-18b5-4dbd-bd7f-533fa27160d6 req-60082ae7-bb76-4389-b12b-ac0c54fc4690 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036267 Oct 27 19:55:31.124771 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3788/7726] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:55:31.383925 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f21571a5-e8a4-49a4-ba7d-659dfd13c2a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:31.384555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f21571a5-e8a4-49a4-ba7d-659dfd13c2a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:31.391627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f21571a5-e8a4-49a4-ba7d-659dfd13c2a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:31.392170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f21571a5-e8a4-49a4-ba7d-659dfd13c2a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:31.392617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f21571a5-e8a4-49a4-ba7d-659dfd13c2a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:31.393356 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f21571a5-e8a4-49a4-ba7d-659dfd13c2a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:31.393815 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f21571a5-e8a4-49a4-ba7d-659dfd13c2a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:31.394253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f21571a5-e8a4-49a4-ba7d-659dfd13c2a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:31.524759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f21571a5-e8a4-49a4-ba7d-659dfd13c2a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:31.532665 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f21571a5-e8a4-49a4-ba7d-659dfd13c2a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1392 microversion: 2.1 time: 0.152631 Oct 27 19:55:31.533238 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3939/7727] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:31 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:55:32.558119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9c480324-23c1-4ae2-8b98-d2ea63736a12 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:32.558919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9c480324-23c1-4ae2-8b98-d2ea63736a12 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:32.566099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c480324-23c1-4ae2-8b98-d2ea63736a12 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:32.566635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c480324-23c1-4ae2-8b98-d2ea63736a12 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:32.567324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c480324-23c1-4ae2-8b98-d2ea63736a12 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:32.567813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c480324-23c1-4ae2-8b98-d2ea63736a12 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:32.568318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c480324-23c1-4ae2-8b98-d2ea63736a12 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:32.568771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c480324-23c1-4ae2-8b98-d2ea63736a12 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:32.711755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9c480324-23c1-4ae2-8b98-d2ea63736a12 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:32.720599 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9c480324-23c1-4ae2-8b98-d2ea63736a12 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1563 microversion: 2.1 time: 0.168148 Oct 27 19:55:32.721180 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3789/7728] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:32 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:55:32.743342 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e19299f8-6f1a-4f73-a6eb-1683173801a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:32.743888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e19299f8-6f1a-4f73-a6eb-1683173801a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:32.745794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:55:32.752369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e19299f8-6f1a-4f73-a6eb-1683173801a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:32.752853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e19299f8-6f1a-4f73-a6eb-1683173801a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:32.753294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e19299f8-6f1a-4f73-a6eb-1683173801a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:32.754002 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e19299f8-6f1a-4f73-a6eb-1683173801a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:32.754478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e19299f8-6f1a-4f73-a6eb-1683173801a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:32.754895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e19299f8-6f1a-4f73-a6eb-1683173801a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:32.890596 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e19299f8-6f1a-4f73-a6eb-1683173801a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:32.899242 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e19299f8-6f1a-4f73-a6eb-1683173801a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1563 microversion: 2.1 time: 0.159804 Oct 27 19:55:32.899868 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3940/7729] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:32 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:55:34.485665 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f62553c9-ff7f-4158-82d2-3e150eef217f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:55:34.486299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f62553c9-ff7f-4158-82d2-3e150eef217f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:34.487292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-2f7d6f34-748f-4900-88ed-70bcd62a48e0 req-b4fe1eae-5a6e-434e-aeb2-81c030f2a99b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6139246-0e5f-4e76-a122-83b3ab5179ad", "tag": "a912420c-978f-4f6f-8396-3c9e0a20f4db"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:55:34.493238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f62553c9-ff7f-4158-82d2-3e150eef217f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:34.493741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f62553c9-ff7f-4158-82d2-3e150eef217f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:34.494196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f62553c9-ff7f-4158-82d2-3e150eef217f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:34.494941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f62553c9-ff7f-4158-82d2-3e150eef217f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:34.495413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f62553c9-ff7f-4158-82d2-3e150eef217f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:34.495855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f62553c9-ff7f-4158-82d2-3e150eef217f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:34.498708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2f7d6f34-748f-4900-88ed-70bcd62a48e0 req-b4fe1eae-5a6e-434e-aeb2-81c030f2a99b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:34.499273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2f7d6f34-748f-4900-88ed-70bcd62a48e0 req-b4fe1eae-5a6e-434e-aeb2-81c030f2a99b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:34.499799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-2f7d6f34-748f-4900-88ed-70bcd62a48e0 req-b4fe1eae-5a6e-434e-aeb2-81c030f2a99b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:34.516834 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-2f7d6f34-748f-4900-88ed-70bcd62a48e0 req-b4fe1eae-5a6e-434e-aeb2-81c030f2a99b service nova] Creating event network-changed:a912420c-978f-4f6f-8396-3c9e0a20f4db for instance a6139246-0e5f-4e76-a122-83b3ab5179ad on n-h1-860687-3 Oct 27 19:55:34.523381 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-2f7d6f34-748f-4900-88ed-70bcd62a48e0 req-b4fe1eae-5a6e-434e-aeb2-81c030f2a99b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039937 Oct 27 19:55:34.524001 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3941/7730] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:55:34.640536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f62553c9-ff7f-4158-82d2-3e150eef217f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:55:34.649784 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f62553c9-ff7f-4158-82d2-3e150eef217f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1563 microversion: 2.1 time: 0.168388 Oct 27 19:55:34.650378 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3790/7731] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:55:34 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:55:57.917594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2ea6fd57-3eec-4741-8f7f-3d4845380f4a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:55:57.919969 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2ea6fd57-3eec-4741-8f7f-3d4845380f4a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:55:57.923471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=17 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:55:57.924130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=38 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:55:57.930255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea6fd57-3eec-4741-8f7f-3d4845380f4a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:57.930786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea6fd57-3eec-4741-8f7f-3d4845380f4a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:57.931237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea6fd57-3eec-4741-8f7f-3d4845380f4a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:57.931949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea6fd57-3eec-4741-8f7f-3d4845380f4a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:55:57.932414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea6fd57-3eec-4741-8f7f-3d4845380f4a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:55:57.932846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ea6fd57-3eec-4741-8f7f-3d4845380f4a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:55:57.984791 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2ea6fd57-3eec-4741-8f7f-3d4845380f4a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad/action" status: 200 len: 24558 microversion: 2.1 time: 0.071234 Oct 27 19:55:57.985560 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3942/7732] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:55:57 2022] POST /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad/action => generated 24558 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:56:08.845736 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:56:08.846812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=36 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:56:08.851295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2dc12ead-c9a3-4805-8e58-7ab476154ee6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:56:08.851851 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2dc12ead-c9a3-4805-8e58-7ab476154ee6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:08.859871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2dc12ead-c9a3-4805-8e58-7ab476154ee6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:08.860377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2dc12ead-c9a3-4805-8e58-7ab476154ee6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:08.860837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2dc12ead-c9a3-4805-8e58-7ab476154ee6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:08.861556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2dc12ead-c9a3-4805-8e58-7ab476154ee6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:08.862032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2dc12ead-c9a3-4805-8e58-7ab476154ee6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:08.862512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2dc12ead-c9a3-4805-8e58-7ab476154ee6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:08.928728 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2dc12ead-c9a3-4805-8e58-7ab476154ee6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad/action" status: 202 len: 0 microversion: 2.1 time: 0.084100 Oct 27 19:56:08.929572 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3791/7733] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:56:08 2022] POST /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:56:08.938675 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-421a9623-bb08-4fef-bebd-03100fecd52c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:08.939395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-421a9623-bb08-4fef-bebd-03100fecd52c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:08.941976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:56:08.942879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:56:08.949398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-421a9623-bb08-4fef-bebd-03100fecd52c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:08.949712 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-421a9623-bb08-4fef-bebd-03100fecd52c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:08.950158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-421a9623-bb08-4fef-bebd-03100fecd52c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:08.950913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-421a9623-bb08-4fef-bebd-03100fecd52c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:08.951378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-421a9623-bb08-4fef-bebd-03100fecd52c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:08.951829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-421a9623-bb08-4fef-bebd-03100fecd52c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:09.098107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-421a9623-bb08-4fef-bebd-03100fecd52c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:09.106063 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-421a9623-bb08-4fef-bebd-03100fecd52c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1687 microversion: 2.1 time: 0.172068 Oct 27 19:56:09.106663 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3943/7734] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:08 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:10.133258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b5637d9a-a602-43f9-9ac8-837e79379771 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:10.133984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b5637d9a-a602-43f9-9ac8-837e79379771 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:10.140919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5637d9a-a602-43f9-9ac8-837e79379771 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:10.141432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5637d9a-a602-43f9-9ac8-837e79379771 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:10.141894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5637d9a-a602-43f9-9ac8-837e79379771 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:10.142639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5637d9a-a602-43f9-9ac8-837e79379771 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:10.143117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5637d9a-a602-43f9-9ac8-837e79379771 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:10.143566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5637d9a-a602-43f9-9ac8-837e79379771 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:10.276755 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b5637d9a-a602-43f9-9ac8-837e79379771 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:10.284646 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b5637d9a-a602-43f9-9ac8-837e79379771 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1667 microversion: 2.1 time: 0.156778 Oct 27 19:56:10.285226 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3792/7735] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:10 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:11.386869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-aded8761-5765-4796-86c5-76be0e71a2b9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:56:11.389129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-aded8761-5765-4796-86c5-76be0e71a2b9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:11.396609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aded8761-5765-4796-86c5-76be0e71a2b9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:11.397103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aded8761-5765-4796-86c5-76be0e71a2b9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:11.397547 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aded8761-5765-4796-86c5-76be0e71a2b9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:11.398247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aded8761-5765-4796-86c5-76be0e71a2b9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:11.398812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aded8761-5765-4796-86c5-76be0e71a2b9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:11.399246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-aded8761-5765-4796-86c5-76be0e71a2b9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:11.457374 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-aded8761-5765-4796-86c5-76be0e71a2b9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad/action" status: 200 len: 32622 microversion: 2.1 time: 0.074364 Oct 27 19:56:11.458547 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3944/7736] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:56:11 2022] POST /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad/action => generated 32622 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:56:11.470421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-90221b89-d9fb-4b7d-9f99-fff33738dba1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:56:11.470985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-90221b89-d9fb-4b7d-9f99-fff33738dba1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:11.477804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90221b89-d9fb-4b7d-9f99-fff33738dba1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:11.478317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90221b89-d9fb-4b7d-9f99-fff33738dba1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:11.478817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90221b89-d9fb-4b7d-9f99-fff33738dba1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:11.479541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90221b89-d9fb-4b7d-9f99-fff33738dba1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:11.480025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90221b89-d9fb-4b7d-9f99-fff33738dba1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:11.480481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90221b89-d9fb-4b7d-9f99-fff33738dba1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:11.547609 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-90221b89-d9fb-4b7d-9f99-fff33738dba1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad/action" status: 202 len: 0 microversion: 2.1 time: 0.081663 Oct 27 19:56:11.548255 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3793/7737] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:56:11 2022] POST /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:56:11.557176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-19dcf6af-535b-4b56-8f4e-d855e4c179b8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:11.557893 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-19dcf6af-535b-4b56-8f4e-d855e4c179b8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:11.566874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19dcf6af-535b-4b56-8f4e-d855e4c179b8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:11.567410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19dcf6af-535b-4b56-8f4e-d855e4c179b8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:11.567882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19dcf6af-535b-4b56-8f4e-d855e4c179b8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:11.568586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19dcf6af-535b-4b56-8f4e-d855e4c179b8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:11.569046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19dcf6af-535b-4b56-8f4e-d855e4c179b8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:11.569474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-19dcf6af-535b-4b56-8f4e-d855e4c179b8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:11.707849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-19dcf6af-535b-4b56-8f4e-d855e4c179b8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:11.716685 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-19dcf6af-535b-4b56-8f4e-d855e4c179b8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1674 microversion: 2.1 time: 0.163825 Oct 27 19:56:11.717267 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3945/7738] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:11 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:12.742005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0710dc87-39fc-4acf-a58a-40026410d2f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:12.742760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0710dc87-39fc-4acf-a58a-40026410d2f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:12.749244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0710dc87-39fc-4acf-a58a-40026410d2f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:12.749852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0710dc87-39fc-4acf-a58a-40026410d2f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:12.750312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0710dc87-39fc-4acf-a58a-40026410d2f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:12.751050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0710dc87-39fc-4acf-a58a-40026410d2f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:12.751553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0710dc87-39fc-4acf-a58a-40026410d2f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:12.752000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0710dc87-39fc-4acf-a58a-40026410d2f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:12.887679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0710dc87-39fc-4acf-a58a-40026410d2f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:12.896409 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0710dc87-39fc-4acf-a58a-40026410d2f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1682 microversion: 2.1 time: 0.159803 Oct 27 19:56:12.896973 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3794/7739] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:12 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:12.992502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-83338ab0-78b6-4b3f-bc6b-7c47d3cda7a3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:56:12.994777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-83338ab0-78b6-4b3f-bc6b-7c47d3cda7a3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:13.002972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83338ab0-78b6-4b3f-bc6b-7c47d3cda7a3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:13.003485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83338ab0-78b6-4b3f-bc6b-7c47d3cda7a3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:13.003902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83338ab0-78b6-4b3f-bc6b-7c47d3cda7a3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:13.004602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83338ab0-78b6-4b3f-bc6b-7c47d3cda7a3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:13.005065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83338ab0-78b6-4b3f-bc6b-7c47d3cda7a3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:13.005498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83338ab0-78b6-4b3f-bc6b-7c47d3cda7a3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:13.055072 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-83338ab0-78b6-4b3f-bc6b-7c47d3cda7a3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad/action" status: 200 len: 38414 microversion: 2.1 time: 0.066704 Oct 27 19:56:13.055718 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3946/7740] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:56:12 2022] POST /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad/action => generated 38414 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:56:14.300201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d804c512-797d-4c45-94c2-396c06711b05 req-6e3ff5cc-05eb-4091-826e-ae8580a21d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6139246-0e5f-4e76-a122-83b3ab5179ad", "tag": "a912420c-978f-4f6f-8396-3c9e0a20f4db"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:56:14.305580 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd105e24-e074-4c2d-b718-b42059f5780f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:14.306112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dd105e24-e074-4c2d-b718-b42059f5780f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:14.314080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd105e24-e074-4c2d-b718-b42059f5780f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:14.314891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd105e24-e074-4c2d-b718-b42059f5780f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:14.315660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd105e24-e074-4c2d-b718-b42059f5780f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:14.316490 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd105e24-e074-4c2d-b718-b42059f5780f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:14.317189 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd105e24-e074-4c2d-b718-b42059f5780f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:14.317854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd105e24-e074-4c2d-b718-b42059f5780f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:14.319687 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d804c512-797d-4c45-94c2-396c06711b05 req-6e3ff5cc-05eb-4091-826e-ae8580a21d44 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:14.320333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d804c512-797d-4c45-94c2-396c06711b05 req-6e3ff5cc-05eb-4091-826e-ae8580a21d44 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:14.320779 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d804c512-797d-4c45-94c2-396c06711b05 req-6e3ff5cc-05eb-4091-826e-ae8580a21d44 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:14.333433 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d804c512-797d-4c45-94c2-396c06711b05 req-6e3ff5cc-05eb-4091-826e-ae8580a21d44 service nova] Creating event network-changed:a912420c-978f-4f6f-8396-3c9e0a20f4db for instance a6139246-0e5f-4e76-a122-83b3ab5179ad on n-h1-860687-3 Oct 27 19:56:14.338660 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d804c512-797d-4c45-94c2-396c06711b05 req-6e3ff5cc-05eb-4091-826e-ae8580a21d44 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043028 Oct 27 19:56:14.339464 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3947/7741] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:56:14.347663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dd105e24-e074-4c2d-b718-b42059f5780f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:56:14.430136 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dd105e24-e074-4c2d-b718-b42059f5780f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 204 len: 0 microversion: 2.1 time: 0.136888 Oct 27 19:56:14.431153 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3795/7742] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:56:14 2022] DELETE /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:56:14.441546 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-23aeaf8d-e476-4985-b9cf-97b5c1926e20 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:14.442442 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-23aeaf8d-e476-4985-b9cf-97b5c1926e20 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:14.449787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23aeaf8d-e476-4985-b9cf-97b5c1926e20 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:14.450281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23aeaf8d-e476-4985-b9cf-97b5c1926e20 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:14.450971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23aeaf8d-e476-4985-b9cf-97b5c1926e20 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:14.451861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23aeaf8d-e476-4985-b9cf-97b5c1926e20 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:14.452553 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23aeaf8d-e476-4985-b9cf-97b5c1926e20 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:14.453154 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-23aeaf8d-e476-4985-b9cf-97b5c1926e20 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:14.622417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-23aeaf8d-e476-4985-b9cf-97b5c1926e20 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:14.631540 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-23aeaf8d-e476-4985-b9cf-97b5c1926e20 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1688 microversion: 2.1 time: 0.195641 Oct 27 19:56:14.632121 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3948/7743] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:14 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:56:15.657133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f96a5ba3-7a83-4aec-bc55-400cfaa142aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:15.657852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f96a5ba3-7a83-4aec-bc55-400cfaa142aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:15.664943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f96a5ba3-7a83-4aec-bc55-400cfaa142aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:15.665447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f96a5ba3-7a83-4aec-bc55-400cfaa142aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:15.665900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f96a5ba3-7a83-4aec-bc55-400cfaa142aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:15.666701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f96a5ba3-7a83-4aec-bc55-400cfaa142aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:15.667176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f96a5ba3-7a83-4aec-bc55-400cfaa142aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:15.667645 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f96a5ba3-7a83-4aec-bc55-400cfaa142aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:15.811502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f96a5ba3-7a83-4aec-bc55-400cfaa142aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:15.819933 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f96a5ba3-7a83-4aec-bc55-400cfaa142aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1688 microversion: 2.1 time: 0.167642 Oct 27 19:56:15.820525 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3796/7744] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:15 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:16.634036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-0f17d919-f54c-46dd-bd1d-59391e23a6d5 req-d3e1ac50-8242-4fce-b694-8c04ebdcba40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6139246-0e5f-4e76-a122-83b3ab5179ad", "name": "network-vif-deleted", "tag": "a912420c-978f-4f6f-8396-3c9e0a20f4db"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:56:16.644880 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0f17d919-f54c-46dd-bd1d-59391e23a6d5 req-d3e1ac50-8242-4fce-b694-8c04ebdcba40 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:16.645366 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0f17d919-f54c-46dd-bd1d-59391e23a6d5 req-d3e1ac50-8242-4fce-b694-8c04ebdcba40 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:16.645798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0f17d919-f54c-46dd-bd1d-59391e23a6d5 req-d3e1ac50-8242-4fce-b694-8c04ebdcba40 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:16.657081 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-0f17d919-f54c-46dd-bd1d-59391e23a6d5 req-d3e1ac50-8242-4fce-b694-8c04ebdcba40 service nova] Creating event network-vif-deleted:a912420c-978f-4f6f-8396-3c9e0a20f4db for instance a6139246-0e5f-4e76-a122-83b3ab5179ad on n-h1-860687-3 Oct 27 19:56:16.661905 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-0f17d919-f54c-46dd-bd1d-59391e23a6d5 req-d3e1ac50-8242-4fce-b694-8c04ebdcba40 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031551 Oct 27 19:56:16.662478 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3949/7745] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:56:16.845196 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2fc107a0-e1c8-48b9-ab3d-1ba901d33cad tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:16.845984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2fc107a0-e1c8-48b9-ab3d-1ba901d33cad tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:16.852324 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fc107a0-e1c8-48b9-ab3d-1ba901d33cad tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:16.852840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fc107a0-e1c8-48b9-ab3d-1ba901d33cad tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:16.853310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fc107a0-e1c8-48b9-ab3d-1ba901d33cad tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:16.854037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fc107a0-e1c8-48b9-ab3d-1ba901d33cad tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:16.854552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fc107a0-e1c8-48b9-ab3d-1ba901d33cad tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:16.855012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fc107a0-e1c8-48b9-ab3d-1ba901d33cad tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:16.887008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fc107a0-e1c8-48b9-ab3d-1ba901d33cad tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:16.887516 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fc107a0-e1c8-48b9-ab3d-1ba901d33cad tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:16.887984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fc107a0-e1c8-48b9-ab3d-1ba901d33cad tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:16.888476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-2fc107a0-e1c8-48b9-ab3d-1ba901d33cad tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lazy-loading 'fault' on Instance uuid a6139246-0e5f-4e76-a122-83b3ab5179ad {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 19:56:16.932131 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2fc107a0-e1c8-48b9-ab3d-1ba901d33cad tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:16.940204 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2fc107a0-e1c8-48b9-ab3d-1ba901d33cad tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 200 len: 1356 microversion: 2.1 time: 0.099719 Oct 27 19:56:16.940800 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3797/7746] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:16 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:17.965846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b89778c9-23d9-4e49-a304-4a5de9a936d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:17.966588 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b89778c9-23d9-4e49-a304-4a5de9a936d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: a6139246-0e5f-4e76-a122-83b3ab5179ad] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:17.973535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b89778c9-23d9-4e49-a304-4a5de9a936d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:17.974026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b89778c9-23d9-4e49-a304-4a5de9a936d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:17.974496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b89778c9-23d9-4e49-a304-4a5de9a936d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:17.975215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b89778c9-23d9-4e49-a304-4a5de9a936d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:17.975662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b89778c9-23d9-4e49-a304-4a5de9a936d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:17.976100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b89778c9-23d9-4e49-a304-4a5de9a936d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:17.992782 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-b89778c9-23d9-4e49-a304-4a5de9a936d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] HTTP exception thrown: Instance a6139246-0e5f-4e76-a122-83b3ab5179ad could not be found. Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b89778c9-23d9-4e49-a304-4a5de9a936d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Request method failure captured: Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad HTTP/1.1 Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWuIhEo6bnXfnQbfze91TPiUq6e3C1UZIBGyGMNtUG7b7n7o47fTBtvG8uPaXe0795-tcRstRRvH7IjrJC0MLr_IL4s3LOxJnrGzq5tR_pq301tmK6VALgPLCzdZofwVV_RAvm6GRoRRWpIM7qR4MATGRqCzTZPHBTLjyiG12WkI1voI Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 6f32defe34974d2e800bf51c55662659 Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6f32defe34974d2e800bf51c55662659"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6f32defe34974d2e800bf51c55662659"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6f32defe34974d2e800bf51c55662659", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6f32defe34974d2e800bf51c55662659"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 6f32defe34974d2e800bf51c55662659 Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestNetworkAdvancedServerOps-656006975-project Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 68cb39c4d811401f83ef30c675914669 Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestNetworkAdvancedServerOps-656006975-project Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance a6139246-0e5f-4e76-a122-83b3ab5179ad could not be found. Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': 'a6139246-0e5f-4e76-a122-83b3ab5179ad'} Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6139246-0e5f-4e76-a122-83b3ab5179ad could not be found. Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6139246-0e5f-4e76-a122-83b3ab5179ad could not be found. Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:56:17.994440 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:56:17.999701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:56:17.999701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:56:17.999701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:56:17.999701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:56:17.999701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:56:17.999701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:56:17.999701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6139246-0e5f-4e76-a122-83b3ab5179ad could not be found. Oct 27 19:56:17.999701 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 19:56:17.999701 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b89778c9-23d9-4e49-a304-4a5de9a936d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Returning 404 to user: Instance a6139246-0e5f-4e76-a122-83b3ab5179ad could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:56:17.999701 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b89778c9-23d9-4e49-a304-4a5de9a936d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad" status: 404 len: 111 microversion: 2.1 time: 0.035345 Oct 27 19:56:17.999701 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3950/7747] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:17 2022] GET /compute/v2.1/servers/a6139246-0e5f-4e76-a122-83b3ab5179ad => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 19:56:21.363445 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0e4a3084-bdc0-438c-98e3-078158c3d4e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '.version_select at 0x7fc869dfc8b0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:21.386670 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0e4a3084-bdc0-438c-98e3-078158c3d4e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-996471759" status: 202 len: 0 microversion: 2.1 time: 0.034231 Oct 27 19:56:21.391658 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3798/7748] 10.222.0.42 () {58 vars in 1281 bytes} [Thu Oct 27 19:56:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-996471759 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:56:21.413128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b6aad8c-e339-4109-818c-b09b5636d211 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'create', calling method: .version_select at 0x7fc869d698b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1640050878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEl+CvRILwPhV53pZD2lLOX3eGgehAgPILcTIZ91iuk3BEo+33OfZswhrHDHk/5M5LzMZxOMgObuVf1Dr/2Jmn5uArhzAs8WpfDBw7ogJhMsuBCqg4gLFyOr4LYhUV9zBA=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:56:21.430727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-3b6aad8c-e339-4109-818c-b09b5636d211 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for project 6f32defe34974d2e800bf51c55662659. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:56:21.436988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-3b6aad8c-e339-4109-818c-b09b5636d211 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for user 68cb39c4d811401f83ef30c675914669 and project 6f32defe34974d2e800bf51c55662659. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:56:21.461390 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b6aad8c-e339-4109-818c-b09b5636d211 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052157 Oct 27 19:56:21.461995 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3951/7749] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:56:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:56:27.235275 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-273565713", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "e883d16b-7eea-4cab-b094-43e7ed7181ac"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1640050878", "security_groups": [{"name": "tempest-secgroup-smoke-84005019"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:56:27.247000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:56:27.360823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] validate_networks() for [('e883d16b-7eea-4cab-b094-43e7ed7181ac', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:56:27.799636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:56:27.800177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:56:27.800788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:56:27.801266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:56:27.801705 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:56:27.813468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:27.813900 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:27.814366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:27.815678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:27.816220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:27.816675 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:27.838045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for project 6f32defe34974d2e800bf51c55662659. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:56:27.844398 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for user 68cb39c4d811401f83ef30c675914669 and project 6f32defe34974d2e800bf51c55662659. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:56:27.860013 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:56:27.862587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:56:27.911998 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c033284c-7fcb-423b-8a37-ed8d495d0010 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.681527 Oct 27 19:56:27.912989 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3799/7750] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:56:27 2022] POST /compute/v2.1/servers => generated 404 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:56:27.925985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2461ee28-cda9-4d65-b810-3dc0ea459545 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:27.926695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2461ee28-cda9-4d65-b810-3dc0ea459545 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:27.980671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=32 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:56:27.991993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2461ee28-cda9-4d65-b810-3dc0ea459545 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:28.002085 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2461ee28-cda9-4d65-b810-3dc0ea459545 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1266 microversion: 2.1 time: 0.081397 Oct 27 19:56:28.002755 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3952/7751] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:27 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:29.029097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-27f794c9-9af6-4f9f-b114-0b585b0e55e7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:29.029924 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-27f794c9-9af6-4f9f-b114-0b585b0e55e7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:29.053316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27f794c9-9af6-4f9f-b114-0b585b0e55e7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:29.059217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27f794c9-9af6-4f9f-b114-0b585b0e55e7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:29.060060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27f794c9-9af6-4f9f-b114-0b585b0e55e7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:29.071437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27f794c9-9af6-4f9f-b114-0b585b0e55e7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:29.072217 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27f794c9-9af6-4f9f-b114-0b585b0e55e7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:29.072704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-27f794c9-9af6-4f9f-b114-0b585b0e55e7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:29.178607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-27f794c9-9af6-4f9f-b114-0b585b0e55e7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:29.195044 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-27f794c9-9af6-4f9f-b114-0b585b0e55e7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1326 microversion: 2.1 time: 0.170668 Oct 27 19:56:29.198435 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3800/7752] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:29 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1326 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:30.222464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-78e82fd6-ac26-43bc-bcb4-73cf0570c2e4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:30.223207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-78e82fd6-ac26-43bc-bcb4-73cf0570c2e4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:30.236050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78e82fd6-ac26-43bc-bcb4-73cf0570c2e4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:30.236559 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78e82fd6-ac26-43bc-bcb4-73cf0570c2e4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:30.237227 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78e82fd6-ac26-43bc-bcb4-73cf0570c2e4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:30.238146 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78e82fd6-ac26-43bc-bcb4-73cf0570c2e4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:30.239083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78e82fd6-ac26-43bc-bcb4-73cf0570c2e4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:30.239761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-78e82fd6-ac26-43bc-bcb4-73cf0570c2e4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:30.413852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-78e82fd6-ac26-43bc-bcb4-73cf0570c2e4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:30.423963 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-78e82fd6-ac26-43bc-bcb4-73cf0570c2e4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1390 microversion: 2.1 time: 0.207515 Oct 27 19:56:30.424692 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3953/7753] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:30 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1390 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:31.002456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-9fc63081-0125-44cb-ba7c-62e68f955ecc req-1ee42259-e4da-4ced-8b05-f4c59b26be71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9414828b-22d5-44b7-9327-d9c19d3cd6e7", "tag": "7c68808e-9af8-439b-a0c7-11a49b7a8ee3"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:56:31.018100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9fc63081-0125-44cb-ba7c-62e68f955ecc req-1ee42259-e4da-4ced-8b05-f4c59b26be71 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:31.019169 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9fc63081-0125-44cb-ba7c-62e68f955ecc req-1ee42259-e4da-4ced-8b05-f4c59b26be71 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:31.019714 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9fc63081-0125-44cb-ba7c-62e68f955ecc req-1ee42259-e4da-4ced-8b05-f4c59b26be71 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:31.037097 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-9fc63081-0125-44cb-ba7c-62e68f955ecc req-1ee42259-e4da-4ced-8b05-f4c59b26be71 service nova] Creating event network-changed:7c68808e-9af8-439b-a0c7-11a49b7a8ee3 for instance 9414828b-22d5-44b7-9327-d9c19d3cd6e7 on n-h2-860687-3 Oct 27 19:56:31.043662 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-9fc63081-0125-44cb-ba7c-62e68f955ecc req-1ee42259-e4da-4ced-8b05-f4c59b26be71 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046634 Oct 27 19:56:31.044294 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3801/7754] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:56:31.449121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d4325c13-e503-4472-95cf-a04f186168ca tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:31.449622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d4325c13-e503-4472-95cf-a04f186168ca tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:31.457727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4325c13-e503-4472-95cf-a04f186168ca tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:31.458231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4325c13-e503-4472-95cf-a04f186168ca tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:31.458734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4325c13-e503-4472-95cf-a04f186168ca tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:31.459535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4325c13-e503-4472-95cf-a04f186168ca tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:31.460001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4325c13-e503-4472-95cf-a04f186168ca tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:31.460445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4325c13-e503-4472-95cf-a04f186168ca tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:31.599914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d4325c13-e503-4472-95cf-a04f186168ca tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:31.607966 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d4325c13-e503-4472-95cf-a04f186168ca tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1390 microversion: 2.1 time: 0.163216 Oct 27 19:56:31.608763 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3954/7755] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:31 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:32.632839 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1efaadb3-7f37-43f6-97f3-c5c4a972cb2f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:32.634671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1efaadb3-7f37-43f6-97f3-c5c4a972cb2f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:32.639994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1efaadb3-7f37-43f6-97f3-c5c4a972cb2f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:32.640596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1efaadb3-7f37-43f6-97f3-c5c4a972cb2f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:32.641064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1efaadb3-7f37-43f6-97f3-c5c4a972cb2f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:32.641821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1efaadb3-7f37-43f6-97f3-c5c4a972cb2f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:32.642304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1efaadb3-7f37-43f6-97f3-c5c4a972cb2f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:32.642807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1efaadb3-7f37-43f6-97f3-c5c4a972cb2f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:32.778996 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1efaadb3-7f37-43f6-97f3-c5c4a972cb2f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:32.787548 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1efaadb3-7f37-43f6-97f3-c5c4a972cb2f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1390 microversion: 2.1 time: 0.159854 Oct 27 19:56:32.788135 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3802/7756] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:32 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:33.810781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b54490f0-a10e-43af-aa1d-3be2721a552f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:33.811677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b54490f0-a10e-43af-aa1d-3be2721a552f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:33.818652 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b54490f0-a10e-43af-aa1d-3be2721a552f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:33.819238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b54490f0-a10e-43af-aa1d-3be2721a552f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:33.819668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b54490f0-a10e-43af-aa1d-3be2721a552f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:33.820357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b54490f0-a10e-43af-aa1d-3be2721a552f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:33.820819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b54490f0-a10e-43af-aa1d-3be2721a552f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:33.821247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b54490f0-a10e-43af-aa1d-3be2721a552f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:33.956607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b54490f0-a10e-43af-aa1d-3be2721a552f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:33.964355 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b54490f0-a10e-43af-aa1d-3be2721a552f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1390 microversion: 2.1 time: 0.157624 Oct 27 19:56:33.964932 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3955/7757] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:33 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:34.988483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8898152d-22f0-4757-b4cd-cfcc7c34a100 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:34.989220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8898152d-22f0-4757-b4cd-cfcc7c34a100 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:34.995873 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8898152d-22f0-4757-b4cd-cfcc7c34a100 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:34.996374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8898152d-22f0-4757-b4cd-cfcc7c34a100 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:34.996830 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8898152d-22f0-4757-b4cd-cfcc7c34a100 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:34.997541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8898152d-22f0-4757-b4cd-cfcc7c34a100 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:34.998012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8898152d-22f0-4757-b4cd-cfcc7c34a100 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:34.998483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8898152d-22f0-4757-b4cd-cfcc7c34a100 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:35.137552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8898152d-22f0-4757-b4cd-cfcc7c34a100 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:35.145808 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8898152d-22f0-4757-b4cd-cfcc7c34a100 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1390 microversion: 2.1 time: 0.161241 Oct 27 19:56:35.146512 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3803/7758] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:34 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:36.169565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5d6ebae9-00c1-4d4c-b967-7ebcfbc1c163 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:36.170188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5d6ebae9-00c1-4d4c-b967-7ebcfbc1c163 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:36.177683 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d6ebae9-00c1-4d4c-b967-7ebcfbc1c163 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:36.178181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d6ebae9-00c1-4d4c-b967-7ebcfbc1c163 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:36.178667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d6ebae9-00c1-4d4c-b967-7ebcfbc1c163 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:36.179367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d6ebae9-00c1-4d4c-b967-7ebcfbc1c163 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:36.179829 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d6ebae9-00c1-4d4c-b967-7ebcfbc1c163 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:36.180264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5d6ebae9-00c1-4d4c-b967-7ebcfbc1c163 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:36.321209 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5d6ebae9-00c1-4d4c-b967-7ebcfbc1c163 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:36.329379 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5d6ebae9-00c1-4d4c-b967-7ebcfbc1c163 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1390 microversion: 2.1 time: 0.164010 Oct 27 19:56:36.329963 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3956/7759] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:36 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:36.384162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-983aacfe-e7ad-4c3d-833c-df6f708bd547 req-7e7353a2-067b-4f3c-801a-2e9c481d10f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9414828b-22d5-44b7-9327-d9c19d3cd6e7", "name": "network-vif-plugged", "status": "completed", "tag": "7c68808e-9af8-439b-a0c7-11a49b7a8ee3"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:56:36.395545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-983aacfe-e7ad-4c3d-833c-df6f708bd547 req-7e7353a2-067b-4f3c-801a-2e9c481d10f7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:36.396041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-983aacfe-e7ad-4c3d-833c-df6f708bd547 req-7e7353a2-067b-4f3c-801a-2e9c481d10f7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:36.396496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-983aacfe-e7ad-4c3d-833c-df6f708bd547 req-7e7353a2-067b-4f3c-801a-2e9c481d10f7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:36.408125 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-983aacfe-e7ad-4c3d-833c-df6f708bd547 req-7e7353a2-067b-4f3c-801a-2e9c481d10f7 service nova] Creating event network-vif-plugged:7c68808e-9af8-439b-a0c7-11a49b7a8ee3 for instance 9414828b-22d5-44b7-9327-d9c19d3cd6e7 on n-h2-860687-3 Oct 27 19:56:36.413289 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-983aacfe-e7ad-4c3d-833c-df6f708bd547 req-7e7353a2-067b-4f3c-801a-2e9c481d10f7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032819 Oct 27 19:56:36.413940 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3804/7760] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:56:37.352639 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d8a0ff22-3550-447b-9a12-a235a584d121 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:37.353263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d8a0ff22-3550-447b-9a12-a235a584d121 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:37.360915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8a0ff22-3550-447b-9a12-a235a584d121 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:37.361404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8a0ff22-3550-447b-9a12-a235a584d121 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:37.361852 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8a0ff22-3550-447b-9a12-a235a584d121 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:37.362616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8a0ff22-3550-447b-9a12-a235a584d121 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:37.363083 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8a0ff22-3550-447b-9a12-a235a584d121 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:37.363517 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d8a0ff22-3550-447b-9a12-a235a584d121 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:37.492910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d8a0ff22-3550-447b-9a12-a235a584d121 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:37.501012 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d8a0ff22-3550-447b-9a12-a235a584d121 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1390 microversion: 2.1 time: 0.152364 Oct 27 19:56:37.501582 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3957/7761] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:37 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:38.523632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:56:38.524419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:56:38.529227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0fd2ee34-2b1b-4b49-b497-df3d56e99e50 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:38.529939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0fd2ee34-2b1b-4b49-b497-df3d56e99e50 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:38.537186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fd2ee34-2b1b-4b49-b497-df3d56e99e50 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:38.537680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fd2ee34-2b1b-4b49-b497-df3d56e99e50 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:38.538136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fd2ee34-2b1b-4b49-b497-df3d56e99e50 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:38.538872 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fd2ee34-2b1b-4b49-b497-df3d56e99e50 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:38.539344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fd2ee34-2b1b-4b49-b497-df3d56e99e50 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:38.539787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0fd2ee34-2b1b-4b49-b497-df3d56e99e50 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:38.682068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0fd2ee34-2b1b-4b49-b497-df3d56e99e50 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:38.690254 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0fd2ee34-2b1b-4b49-b497-df3d56e99e50 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1562 microversion: 2.1 time: 0.168453 Oct 27 19:56:38.690870 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3805/7762] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:38 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:38.712842 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-607739e0-22dc-463f-85ad-e778e0b44bb0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:38.713485 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-607739e0-22dc-463f-85ad-e778e0b44bb0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:38.715393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:56:38.722281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-607739e0-22dc-463f-85ad-e778e0b44bb0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:38.722824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-607739e0-22dc-463f-85ad-e778e0b44bb0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:38.723296 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-607739e0-22dc-463f-85ad-e778e0b44bb0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:38.724053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-607739e0-22dc-463f-85ad-e778e0b44bb0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:38.724520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-607739e0-22dc-463f-85ad-e778e0b44bb0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:38.725056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-607739e0-22dc-463f-85ad-e778e0b44bb0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:38.859730 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-607739e0-22dc-463f-85ad-e778e0b44bb0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:38.867646 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-607739e0-22dc-463f-85ad-e778e0b44bb0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1562 microversion: 2.1 time: 0.158706 Oct 27 19:56:38.868242 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3958/7763] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:38 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:56:40.460036 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1be74089-c1e3-4daa-b9e7-9810d27d9e9a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:56:40.460674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1be74089-c1e3-4daa-b9e7-9810d27d9e9a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:56:40.462423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-0026ead1-fa8a-4578-8bbf-21647cf3583d req-113c8516-e142-4717-ace4-f068a5460664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9414828b-22d5-44b7-9327-d9c19d3cd6e7", "tag": "7c68808e-9af8-439b-a0c7-11a49b7a8ee3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:56:40.464486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:56:40.468381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1be74089-c1e3-4daa-b9e7-9810d27d9e9a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:40.468895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1be74089-c1e3-4daa-b9e7-9810d27d9e9a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:40.469350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1be74089-c1e3-4daa-b9e7-9810d27d9e9a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:40.470068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1be74089-c1e3-4daa-b9e7-9810d27d9e9a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:40.470765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1be74089-c1e3-4daa-b9e7-9810d27d9e9a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:40.471197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:56:40.471340 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1be74089-c1e3-4daa-b9e7-9810d27d9e9a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:40.475618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0026ead1-fa8a-4578-8bbf-21647cf3583d req-113c8516-e142-4717-ace4-f068a5460664 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:56:40.476336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0026ead1-fa8a-4578-8bbf-21647cf3583d req-113c8516-e142-4717-ace4-f068a5460664 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:56:40.476778 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-0026ead1-fa8a-4578-8bbf-21647cf3583d req-113c8516-e142-4717-ace4-f068a5460664 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:56:40.490595 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-0026ead1-fa8a-4578-8bbf-21647cf3583d req-113c8516-e142-4717-ace4-f068a5460664 service nova] Creating event network-changed:7c68808e-9af8-439b-a0c7-11a49b7a8ee3 for instance 9414828b-22d5-44b7-9327-d9c19d3cd6e7 on n-h2-860687-3 Oct 27 19:56:40.496499 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-0026ead1-fa8a-4578-8bbf-21647cf3583d req-113c8516-e142-4717-ace4-f068a5460664 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038423 Oct 27 19:56:40.497113 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3959/7764] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:56:40.705339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1be74089-c1e3-4daa-b9e7-9810d27d9e9a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:56:40.727008 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1be74089-c1e3-4daa-b9e7-9810d27d9e9a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1562 microversion: 2.1 time: 0.270991 Oct 27 19:56:40.727979 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3806/7765] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:56:40 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1562 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:57:14.018340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f1ffa1a9-77ef-4d5d-9b2d-1ba8fca498cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:57:14.020634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f1ffa1a9-77ef-4d5d-9b2d-1ba8fca498cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:57:14.023923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=38 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:57:14.025096 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 19:57:14.025500 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 19:57:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7/action (ip 10.222.0.42) !!! Oct 27 19:57:14.033601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ffa1a9-77ef-4d5d-9b2d-1ba8fca498cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:14.034093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ffa1a9-77ef-4d5d-9b2d-1ba8fca498cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:14.034566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ffa1a9-77ef-4d5d-9b2d-1ba8fca498cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:14.035271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ffa1a9-77ef-4d5d-9b2d-1ba8fca498cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:14.035728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ffa1a9-77ef-4d5d-9b2d-1ba8fca498cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:14.036162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f1ffa1a9-77ef-4d5d-9b2d-1ba8fca498cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:14.089658 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f1ffa1a9-77ef-4d5d-9b2d-1ba8fca498cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7/action" status: 200 len: 24568 microversion: 2.1 time: 0.075763 Oct 27 19:57:14.090285 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3960/7766] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:57:14 2022] POST /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7/action => generated 24568 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:57:44.493937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:57:44.494695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=36 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:57:44.499793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f56ce99a-6635-42f7-bb35-293fc6a06fee tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:57:44.502284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f56ce99a-6635-42f7-bb35-293fc6a06fee tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:57:44.509597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f56ce99a-6635-42f7-bb35-293fc6a06fee tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:44.510129 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f56ce99a-6635-42f7-bb35-293fc6a06fee tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:44.510624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f56ce99a-6635-42f7-bb35-293fc6a06fee tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:44.511345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f56ce99a-6635-42f7-bb35-293fc6a06fee tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:44.511844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f56ce99a-6635-42f7-bb35-293fc6a06fee tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:44.512315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f56ce99a-6635-42f7-bb35-293fc6a06fee tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:44.590706 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f56ce99a-6635-42f7-bb35-293fc6a06fee tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7/action" status: 202 len: 0 microversion: 2.1 time: 0.098430 Oct 27 19:57:44.591439 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3807/7767] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:57:44 2022] POST /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:57:44.600436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d4fa8e6e-f658-4fc6-9d8c-af9bd7059147 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:57:44.601149 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d4fa8e6e-f658-4fc6-9d8c-af9bd7059147 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:57:44.603913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:57:44.604574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:57:44.610929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4fa8e6e-f658-4fc6-9d8c-af9bd7059147 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:44.611503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4fa8e6e-f658-4fc6-9d8c-af9bd7059147 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:44.611953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4fa8e6e-f658-4fc6-9d8c-af9bd7059147 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:44.612737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4fa8e6e-f658-4fc6-9d8c-af9bd7059147 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:44.613147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4fa8e6e-f658-4fc6-9d8c-af9bd7059147 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:44.613579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4fa8e6e-f658-4fc6-9d8c-af9bd7059147 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:44.758917 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d4fa8e6e-f658-4fc6-9d8c-af9bd7059147 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:57:44.767091 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d4fa8e6e-f658-4fc6-9d8c-af9bd7059147 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1673 microversion: 2.1 time: 0.170987 Oct 27 19:57:44.767675 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3961/7768] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:57:44 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:57:45.792513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f624ffe-7a71-4884-b7da-d7258f4184aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:57:45.793269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0f624ffe-7a71-4884-b7da-d7258f4184aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:57:45.801165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f624ffe-7a71-4884-b7da-d7258f4184aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:45.801676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f624ffe-7a71-4884-b7da-d7258f4184aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:45.802135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f624ffe-7a71-4884-b7da-d7258f4184aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:45.802895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f624ffe-7a71-4884-b7da-d7258f4184aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:45.803378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f624ffe-7a71-4884-b7da-d7258f4184aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:45.803825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f624ffe-7a71-4884-b7da-d7258f4184aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:45.937984 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0f624ffe-7a71-4884-b7da-d7258f4184aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:57:45.945785 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0f624ffe-7a71-4884-b7da-d7258f4184aa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1678 microversion: 2.1 time: 0.158635 Oct 27 19:57:45.946361 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3808/7769] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:57:45 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:57:46.972180 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-47d3bb8e-25d0-4437-8c46-60b720a831a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:57:46.972799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-47d3bb8e-25d0-4437-8c46-60b720a831a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:57:46.979581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47d3bb8e-25d0-4437-8c46-60b720a831a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:46.980063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47d3bb8e-25d0-4437-8c46-60b720a831a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:46.980501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47d3bb8e-25d0-4437-8c46-60b720a831a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:46.981195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47d3bb8e-25d0-4437-8c46-60b720a831a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:46.981651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47d3bb8e-25d0-4437-8c46-60b720a831a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:46.982769 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47d3bb8e-25d0-4437-8c46-60b720a831a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:47.115581 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-47d3bb8e-25d0-4437-8c46-60b720a831a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:57:47.123512 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-47d3bb8e-25d0-4437-8c46-60b720a831a8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1678 microversion: 2.1 time: 0.155214 Oct 27 19:57:47.124073 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3962/7770] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:57:46 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:57:48.147318 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9500c577-5593-46a5-bcd8-a886600c326e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:57:48.147958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9500c577-5593-46a5-bcd8-a886600c326e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:57:48.154692 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9500c577-5593-46a5-bcd8-a886600c326e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:48.155210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9500c577-5593-46a5-bcd8-a886600c326e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:48.155676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9500c577-5593-46a5-bcd8-a886600c326e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:48.156427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9500c577-5593-46a5-bcd8-a886600c326e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:48.156908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9500c577-5593-46a5-bcd8-a886600c326e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:48.157356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9500c577-5593-46a5-bcd8-a886600c326e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:48.290615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9500c577-5593-46a5-bcd8-a886600c326e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:57:48.299397 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9500c577-5593-46a5-bcd8-a886600c326e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1678 microversion: 2.1 time: 0.156286 Oct 27 19:57:48.299975 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3809/7771] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:57:48 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:57:49.324399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-47894d4a-b4a2-4331-a975-72baacd96c06 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:57:49.325012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-47894d4a-b4a2-4331-a975-72baacd96c06 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:57:49.332717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47894d4a-b4a2-4331-a975-72baacd96c06 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:49.333181 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47894d4a-b4a2-4331-a975-72baacd96c06 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:49.333623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47894d4a-b4a2-4331-a975-72baacd96c06 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:49.334344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47894d4a-b4a2-4331-a975-72baacd96c06 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:49.334826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47894d4a-b4a2-4331-a975-72baacd96c06 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:49.335275 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-47894d4a-b4a2-4331-a975-72baacd96c06 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:49.472043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-47894d4a-b4a2-4331-a975-72baacd96c06 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:57:49.479858 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-47894d4a-b4a2-4331-a975-72baacd96c06 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1678 microversion: 2.1 time: 0.159938 Oct 27 19:57:49.480429 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3963/7772] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:57:49 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:57:50.504194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f4595ce4-3c28-4806-8be5-19a1c56f3190 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:57:50.504854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f4595ce4-3c28-4806-8be5-19a1c56f3190 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:57:50.511877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4595ce4-3c28-4806-8be5-19a1c56f3190 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:50.512383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4595ce4-3c28-4806-8be5-19a1c56f3190 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:50.512876 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4595ce4-3c28-4806-8be5-19a1c56f3190 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:50.514100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4595ce4-3c28-4806-8be5-19a1c56f3190 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:50.514799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4595ce4-3c28-4806-8be5-19a1c56f3190 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:50.515253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4595ce4-3c28-4806-8be5-19a1c56f3190 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:50.654333 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f4595ce4-3c28-4806-8be5-19a1c56f3190 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:57:50.662590 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f4595ce4-3c28-4806-8be5-19a1c56f3190 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1678 microversion: 2.1 time: 0.162336 Oct 27 19:57:50.663187 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3810/7773] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:57:50 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:57:51.687698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-faf5f63a-cd1a-4f74-8e85-5ec341905ac8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:57:51.688628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-faf5f63a-cd1a-4f74-8e85-5ec341905ac8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:57:51.695636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faf5f63a-cd1a-4f74-8e85-5ec341905ac8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:51.696125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faf5f63a-cd1a-4f74-8e85-5ec341905ac8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:51.696566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faf5f63a-cd1a-4f74-8e85-5ec341905ac8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:51.697259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faf5f63a-cd1a-4f74-8e85-5ec341905ac8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:51.697716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faf5f63a-cd1a-4f74-8e85-5ec341905ac8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:51.698433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-faf5f63a-cd1a-4f74-8e85-5ec341905ac8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:51.836791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-faf5f63a-cd1a-4f74-8e85-5ec341905ac8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:57:51.845477 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-faf5f63a-cd1a-4f74-8e85-5ec341905ac8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1678 microversion: 2.1 time: 0.162269 Oct 27 19:57:51.846057 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3964/7774] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:57:51 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:57:52.869211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf9b1f46-1a39-4120-8f68-1abc987fa1dd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:57:52.869859 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf9b1f46-1a39-4120-8f68-1abc987fa1dd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:57:52.877476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf9b1f46-1a39-4120-8f68-1abc987fa1dd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:52.877990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf9b1f46-1a39-4120-8f68-1abc987fa1dd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:52.878489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf9b1f46-1a39-4120-8f68-1abc987fa1dd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:52.879252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf9b1f46-1a39-4120-8f68-1abc987fa1dd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:52.879739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf9b1f46-1a39-4120-8f68-1abc987fa1dd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:52.880213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf9b1f46-1a39-4120-8f68-1abc987fa1dd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:53.016148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf9b1f46-1a39-4120-8f68-1abc987fa1dd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:57:53.024258 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf9b1f46-1a39-4120-8f68-1abc987fa1dd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1678 microversion: 2.1 time: 0.159012 Oct 27 19:57:53.024838 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3811/7775] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:57:52 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:57:54.048349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b556e374-4b82-415d-9eba-a27e7598d453 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:57:54.048965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b556e374-4b82-415d-9eba-a27e7598d453 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:57:54.055767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b556e374-4b82-415d-9eba-a27e7598d453 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:54.056259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b556e374-4b82-415d-9eba-a27e7598d453 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:54.056703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b556e374-4b82-415d-9eba-a27e7598d453 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:54.057401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b556e374-4b82-415d-9eba-a27e7598d453 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:54.057861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b556e374-4b82-415d-9eba-a27e7598d453 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:54.058295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b556e374-4b82-415d-9eba-a27e7598d453 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:54.199849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b556e374-4b82-415d-9eba-a27e7598d453 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:57:54.208295 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b556e374-4b82-415d-9eba-a27e7598d453 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1678 microversion: 2.1 time: 0.163961 Oct 27 19:57:54.208868 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3965/7776] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:57:54 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:57:55.234016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb5a3b5e-b077-4a97-8381-80313cfa07dc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:57:55.234681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb5a3b5e-b077-4a97-8381-80313cfa07dc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:57:55.241891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5a3b5e-b077-4a97-8381-80313cfa07dc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:55.242470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5a3b5e-b077-4a97-8381-80313cfa07dc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:55.242956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5a3b5e-b077-4a97-8381-80313cfa07dc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:55.243674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5a3b5e-b077-4a97-8381-80313cfa07dc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:55.244153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5a3b5e-b077-4a97-8381-80313cfa07dc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:55.244597 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5a3b5e-b077-4a97-8381-80313cfa07dc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:55.383280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-eb5a3b5e-b077-4a97-8381-80313cfa07dc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:57:55.391348 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb5a3b5e-b077-4a97-8381-80313cfa07dc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1678 microversion: 2.1 time: 0.162569 Oct 27 19:57:55.391995 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3812/7777] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:57:55 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:57:56.415408 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2fe612f9-09be-42d3-8042-33c63837006d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:57:56.416011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2fe612f9-09be-42d3-8042-33c63837006d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:57:56.423623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fe612f9-09be-42d3-8042-33c63837006d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:56.424116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fe612f9-09be-42d3-8042-33c63837006d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:56.424557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fe612f9-09be-42d3-8042-33c63837006d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:56.425288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fe612f9-09be-42d3-8042-33c63837006d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:57:56.425747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fe612f9-09be-42d3-8042-33c63837006d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:57:56.426177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fe612f9-09be-42d3-8042-33c63837006d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:57:56.565747 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2fe612f9-09be-42d3-8042-33c63837006d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:57:56.574017 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2fe612f9-09be-42d3-8042-33c63837006d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1681 microversion: 2.1 time: 0.162485 Oct 27 19:57:56.574645 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3966/7778] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:57:56 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:58:28.802330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5c54629f-2e26-471d-80dd-ae136a4817c2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:58:28.804630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5c54629f-2e26-471d-80dd-ae136a4817c2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:58:28.806953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=12 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:58:28.807640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:58:28.814482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c54629f-2e26-471d-80dd-ae136a4817c2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:58:28.814987 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c54629f-2e26-471d-80dd-ae136a4817c2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:58:28.815442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c54629f-2e26-471d-80dd-ae136a4817c2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:58:28.816159 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c54629f-2e26-471d-80dd-ae136a4817c2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:58:28.816631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c54629f-2e26-471d-80dd-ae136a4817c2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:58:28.817074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c54629f-2e26-471d-80dd-ae136a4817c2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:58:28.874941 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5c54629f-2e26-471d-80dd-ae136a4817c2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7/action" status: 200 len: 69093 microversion: 2.1 time: 0.076698 Oct 27 19:58:28.875648 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3813/7779] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:58:28 2022] POST /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7/action => generated 69093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:58:46.393950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9d0637eb-4aac-4cf4-adaf-e1597ea608c1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:58:46.401218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:58:46.401919 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9d0637eb-4aac-4cf4-adaf-e1597ea608c1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:58:46.402060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:58:46.409206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=12 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:58:46.409892 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=36 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:58:46.411975 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d0637eb-4aac-4cf4-adaf-e1597ea608c1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:58:46.412469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d0637eb-4aac-4cf4-adaf-e1597ea608c1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:58:46.412937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d0637eb-4aac-4cf4-adaf-e1597ea608c1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:58:46.414627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d0637eb-4aac-4cf4-adaf-e1597ea608c1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:58:46.415104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d0637eb-4aac-4cf4-adaf-e1597ea608c1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:58:46.415544 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9d0637eb-4aac-4cf4-adaf-e1597ea608c1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:58:46.444923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9d0637eb-4aac-4cf4-adaf-e1597ea608c1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 19:58:46.513466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-e7abc10a-e835-4cec-aedf-ebf6416d97ca req-8bde6c8e-36fb-4745-9ab1-ff04e56fb501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9414828b-22d5-44b7-9327-d9c19d3cd6e7", "tag": "7c68808e-9af8-439b-a0c7-11a49b7a8ee3"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:58:46.528258 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e7abc10a-e835-4cec-aedf-ebf6416d97ca req-8bde6c8e-36fb-4745-9ab1-ff04e56fb501 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:58:46.528840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e7abc10a-e835-4cec-aedf-ebf6416d97ca req-8bde6c8e-36fb-4745-9ab1-ff04e56fb501 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:58:46.529334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e7abc10a-e835-4cec-aedf-ebf6416d97ca req-8bde6c8e-36fb-4745-9ab1-ff04e56fb501 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:58:46.542038 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-e7abc10a-e835-4cec-aedf-ebf6416d97ca req-8bde6c8e-36fb-4745-9ab1-ff04e56fb501 service nova] Creating event network-changed:7c68808e-9af8-439b-a0c7-11a49b7a8ee3 for instance 9414828b-22d5-44b7-9327-d9c19d3cd6e7 on n-h2-860687-3 Oct 27 19:58:46.549572 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9d0637eb-4aac-4cf4-adaf-e1597ea608c1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 204 len: 0 microversion: 2.1 time: 0.159523 Oct 27 19:58:46.549941 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-e7abc10a-e835-4cec-aedf-ebf6416d97ca req-8bde6c8e-36fb-4745-9ab1-ff04e56fb501 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153527 Oct 27 19:58:46.550642 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3967/7780] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 19:58:46 2022] DELETE /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 19:58:46.551362 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3814/7781] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:58:46.560725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-48ee590e-47d6-421c-9c5b-7ce4e53a5903 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:58:46.561583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-48ee590e-47d6-421c-9c5b-7ce4e53a5903 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:58:46.568093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48ee590e-47d6-421c-9c5b-7ce4e53a5903 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:58:46.568506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48ee590e-47d6-421c-9c5b-7ce4e53a5903 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:58:46.568949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48ee590e-47d6-421c-9c5b-7ce4e53a5903 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:58:46.569667 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48ee590e-47d6-421c-9c5b-7ce4e53a5903 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:58:46.570139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48ee590e-47d6-421c-9c5b-7ce4e53a5903 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:58:46.570610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-48ee590e-47d6-421c-9c5b-7ce4e53a5903 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:58:46.780422 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-48ee590e-47d6-421c-9c5b-7ce4e53a5903 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:58:46.788562 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-48ee590e-47d6-421c-9c5b-7ce4e53a5903 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1687 microversion: 2.1 time: 0.233412 Oct 27 19:58:46.789409 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3968/7782] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:58:46 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1687 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:58:47.813858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8f55e8e2-5db7-4b79-abbe-7e8bd1a7f3f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:58:47.814619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8f55e8e2-5db7-4b79-abbe-7e8bd1a7f3f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:58:47.821728 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f55e8e2-5db7-4b79-abbe-7e8bd1a7f3f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:58:47.822263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f55e8e2-5db7-4b79-abbe-7e8bd1a7f3f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:58:47.822730 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f55e8e2-5db7-4b79-abbe-7e8bd1a7f3f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:58:47.823706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f55e8e2-5db7-4b79-abbe-7e8bd1a7f3f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:58:47.824192 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f55e8e2-5db7-4b79-abbe-7e8bd1a7f3f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:58:47.824655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f55e8e2-5db7-4b79-abbe-7e8bd1a7f3f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:58:48.093393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8f55e8e2-5db7-4b79-abbe-7e8bd1a7f3f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:58:48.101205 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8f55e8e2-5db7-4b79-abbe-7e8bd1a7f3f6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 200 len: 1687 microversion: 2.1 time: 0.291754 Oct 27 19:58:48.101787 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3815/7783] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:58:47 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 1687 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:58:48.631458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-9bb742d4-f967-4945-9ea1-a217e877b9c0 req-7dbd3c0a-60fd-4abd-bc23-fbf6c4acbd63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9414828b-22d5-44b7-9327-d9c19d3cd6e7", "name": "network-vif-deleted", "tag": "7c68808e-9af8-439b-a0c7-11a49b7a8ee3"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:58:48.643112 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9bb742d4-f967-4945-9ea1-a217e877b9c0 req-7dbd3c0a-60fd-4abd-bc23-fbf6c4acbd63 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:58:48.643607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9bb742d4-f967-4945-9ea1-a217e877b9c0 req-7dbd3c0a-60fd-4abd-bc23-fbf6c4acbd63 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:58:48.644054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-9bb742d4-f967-4945-9ea1-a217e877b9c0 req-7dbd3c0a-60fd-4abd-bc23-fbf6c4acbd63 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:58:48.656312 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-9bb742d4-f967-4945-9ea1-a217e877b9c0 req-7dbd3c0a-60fd-4abd-bc23-fbf6c4acbd63 service nova] Creating event network-vif-deleted:7c68808e-9af8-439b-a0c7-11a49b7a8ee3 for instance 9414828b-22d5-44b7-9327-d9c19d3cd6e7 on n-h2-860687-3 Oct 27 19:58:48.661258 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-9bb742d4-f967-4945-9ea1-a217e877b9c0 req-7dbd3c0a-60fd-4abd-bc23-fbf6c4acbd63 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033505 Oct 27 19:58:48.661895 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3969/7784] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:58:49.127489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8f6d692d-afef-4fcb-b991-7cd864fffefa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:58:49.128237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8f6d692d-afef-4fcb-b991-7cd864fffefa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 9414828b-22d5-44b7-9327-d9c19d3cd6e7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:58:49.137652 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f6d692d-afef-4fcb-b991-7cd864fffefa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:58:49.138157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f6d692d-afef-4fcb-b991-7cd864fffefa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:58:49.138779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f6d692d-afef-4fcb-b991-7cd864fffefa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:58:49.139821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f6d692d-afef-4fcb-b991-7cd864fffefa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:58:49.140993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f6d692d-afef-4fcb-b991-7cd864fffefa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:58:49.141443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f6d692d-afef-4fcb-b991-7cd864fffefa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:58:49.159361 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-8f6d692d-afef-4fcb-b991-7cd864fffefa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] HTTP exception thrown: Instance 9414828b-22d5-44b7-9327-d9c19d3cd6e7 could not be found. Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8f6d692d-afef-4fcb-b991-7cd864fffefa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Request method failure captured: Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 HTTP/1.1 Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWuIhEo6bnXfnQbfze91TPiUq6e3C1UZIBGyGMNtUG7b7n7o47fTBtvG8uPaXe0795-tcRstRRvH7IjrJC0MLr_IL4s3LOxJnrGzq5tR_pq301tmK6VALgPLCzdZofwVV_RAvm6GRoRRWpIM7qR4MATGRqCzTZPHBTLjyiG12WkI1voI Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 6f32defe34974d2e800bf51c55662659 Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6f32defe34974d2e800bf51c55662659"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6f32defe34974d2e800bf51c55662659"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6f32defe34974d2e800bf51c55662659", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6f32defe34974d2e800bf51c55662659"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 6f32defe34974d2e800bf51c55662659 Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestNetworkAdvancedServerOps-656006975-project Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 68cb39c4d811401f83ef30c675914669 Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestNetworkAdvancedServerOps-656006975-project Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 9414828b-22d5-44b7-9327-d9c19d3cd6e7 could not be found. Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '9414828b-22d5-44b7-9327-d9c19d3cd6e7'} Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9414828b-22d5-44b7-9327-d9c19d3cd6e7 could not be found. Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9414828b-22d5-44b7-9327-d9c19d3cd6e7 could not be found. Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:58:49.161021 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 19:58:49.167410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:58:49.167410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 19:58:49.167410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 19:58:49.167410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 19:58:49.167410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 19:58:49.167410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 19:58:49.167410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9414828b-22d5-44b7-9327-d9c19d3cd6e7 could not be found. Oct 27 19:58:49.167410 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 19:58:49.167410 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8f6d692d-afef-4fcb-b991-7cd864fffefa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Returning 404 to user: Instance 9414828b-22d5-44b7-9327-d9c19d3cd6e7 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 19:58:49.167410 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8f6d692d-afef-4fcb-b991-7cd864fffefa tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7" status: 404 len: 111 microversion: 2.1 time: 0.039936 Oct 27 19:58:49.167410 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3816/7785] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:58:49 2022] GET /compute/v2.1/servers/9414828b-22d5-44b7-9327-d9c19d3cd6e7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 19:58:52.308130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0712aef3-d09a-4f76-bf6d-d886d4c63ade tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '.version_select at 0x7fc869d609d0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:58:52.313567 n-d-860687-3 devstack@n-api.service[127029]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0712aef3-d09a-4f76-bf6d-d886d4c63ade tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [45e3239b-77d3-409e-8cf7-5992f44b7136] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 19:58:53.320494 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [None req-0712aef3-d09a-4f76-bf6d-d886d4c63ade tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [45e3239b-77d3-409e-8cf7-5992f44b7136] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37666. Oct 27 19:58:53.340233 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0712aef3-d09a-4f76-bf6d-d886d4c63ade tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1640050878" status: 202 len: 0 microversion: 2.1 time: 1.037140 Oct 27 19:58:53.340925 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3970/7786] 10.222.0.42 () {58 vars in 1284 bytes} [Thu Oct 27 19:58:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1640050878 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:58:53.370970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f5c43321-9804-4882-82ad-e79289f9dbb1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'create', calling method: .version_select at 0x7fc86b4ec3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-808037286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJoVc6i999lWEtSgqglBh7b4M2Jw07Q/80Fbz2AyT8N1OUP5uKgOYhDDdhhidOuZgIUccEbuIalv9Mtdxs90Xr4FYDDwW33facbtb6gou0FO0m1K1j5ltOrYHga0mrogQ=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:58:53.389374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-f5c43321-9804-4882-82ad-e79289f9dbb1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for project 6f32defe34974d2e800bf51c55662659. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:58:53.394641 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-f5c43321-9804-4882-82ad-e79289f9dbb1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for user 68cb39c4d811401f83ef30c675914669 and project 6f32defe34974d2e800bf51c55662659. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:58:53.407974 n-d-860687-3 devstack@n-api.service[127028]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f5c43321-9804-4882-82ad-e79289f9dbb1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [ae950e16-18c6-472e-bd09-615816b04be5] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 19:58:54.413996 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [None req-f5c43321-9804-4882-82ad-e79289f9dbb1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [ae950e16-18c6-472e-bd09-615816b04be5] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37670. Oct 27 19:58:54.429764 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f5c43321-9804-4882-82ad-e79289f9dbb1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.062946 Oct 27 19:58:54.430372 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3817/7787] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 19:58:53 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:59:00.050407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:59:00.054735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1400243575", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "554348e3-7cae-4f76-9588-246711406bb8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-808037286", "security_groups": [{"name": "tempest-secgroup-smoke-1512164282"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:59:00.173509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] validate_networks() for [('554348e3-7cae-4f76-9588-246711406bb8', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 19:59:00.664299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:59:00.664737 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:59:00.665225 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:59:00.665647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:59:00.666234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:59:00.675980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:00.676506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:00.676953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:00.677700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:00.678162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:00.678655 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:00.696376 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for project 6f32defe34974d2e800bf51c55662659. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 19:59:00.702340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for user 68cb39c4d811401f83ef30c675914669 and project 6f32defe34974d2e800bf51c55662659. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 19:59:00.715483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 19:59:00.717878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 19:59:00.774532 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-530b23b4-0c36-4c39-a7e8-e870a2d7ed72 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726439 Oct 27 19:59:00.775576 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3971/7788] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 19:59:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 19:59:00.786234 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=10 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:59:00.790454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a1939001-b465-4e22-8a9d-c1f28d254643 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:00.791103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a1939001-b465-4e22-8a9d-c1f28d254643 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:00.860265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a1939001-b465-4e22-8a9d-c1f28d254643 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:00.868158 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a1939001-b465-4e22-8a9d-c1f28d254643 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1266 microversion: 2.1 time: 0.083619 Oct 27 19:59:00.869054 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3818/7789] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:00 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:01.895341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fbffbef4-354d-497f-a610-1b68389272d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:01.896093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fbffbef4-354d-497f-a610-1b68389272d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:01.904399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbffbef4-354d-497f-a610-1b68389272d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:01.905103 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbffbef4-354d-497f-a610-1b68389272d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:01.905610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbffbef4-354d-497f-a610-1b68389272d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:01.906623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbffbef4-354d-497f-a610-1b68389272d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:01.907451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbffbef4-354d-497f-a610-1b68389272d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:01.908286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fbffbef4-354d-497f-a610-1b68389272d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:02.003030 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-fbffbef4-354d-497f-a610-1b68389272d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:02.017962 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fbffbef4-354d-497f-a610-1b68389272d1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1326 microversion: 2.1 time: 0.125741 Oct 27 19:59:02.019817 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3972/7790] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:01 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1326 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:03.049143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e9fcc7cc-0296-4e36-af27-179649079a2d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:03.049779 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e9fcc7cc-0296-4e36-af27-179649079a2d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:03.056776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9fcc7cc-0296-4e36-af27-179649079a2d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:03.057292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9fcc7cc-0296-4e36-af27-179649079a2d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:03.057757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9fcc7cc-0296-4e36-af27-179649079a2d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:03.059167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9fcc7cc-0296-4e36-af27-179649079a2d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:03.060265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9fcc7cc-0296-4e36-af27-179649079a2d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:03.060930 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9fcc7cc-0296-4e36-af27-179649079a2d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:03.575547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e9fcc7cc-0296-4e36-af27-179649079a2d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:03.584650 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e9fcc7cc-0296-4e36-af27-179649079a2d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1392 microversion: 2.1 time: 0.539350 Oct 27 19:59:03.585301 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3819/7791] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:03 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1392 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:03.901513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6f36f9ad-8715-40d4-88a6-0a53aacd8191 req-3bebfaaf-f079-40d6-a43c-dbaf9261c82f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a1f9db-2c32-4848-b137-1ee8f7057a80", "tag": "c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:59:03.913632 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6f36f9ad-8715-40d4-88a6-0a53aacd8191 req-3bebfaaf-f079-40d6-a43c-dbaf9261c82f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:03.914311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6f36f9ad-8715-40d4-88a6-0a53aacd8191 req-3bebfaaf-f079-40d6-a43c-dbaf9261c82f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:03.914881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6f36f9ad-8715-40d4-88a6-0a53aacd8191 req-3bebfaaf-f079-40d6-a43c-dbaf9261c82f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:03.927608 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6f36f9ad-8715-40d4-88a6-0a53aacd8191 req-3bebfaaf-f079-40d6-a43c-dbaf9261c82f service nova] Creating event network-changed:c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2 for instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 on n-h1-860687-3 Oct 27 19:59:03.933324 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6f36f9ad-8715-40d4-88a6-0a53aacd8191 req-3bebfaaf-f079-40d6-a43c-dbaf9261c82f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102775 Oct 27 19:59:03.934278 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3973/7792] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:59:04.609938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-027afda1-901c-40f5-b149-e6a0cddc9e0f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:04.610610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-027afda1-901c-40f5-b149-e6a0cddc9e0f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:04.617470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-027afda1-901c-40f5-b149-e6a0cddc9e0f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:04.617977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-027afda1-901c-40f5-b149-e6a0cddc9e0f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:04.618466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-027afda1-901c-40f5-b149-e6a0cddc9e0f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:04.619185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-027afda1-901c-40f5-b149-e6a0cddc9e0f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:04.619666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-027afda1-901c-40f5-b149-e6a0cddc9e0f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:04.620116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-027afda1-901c-40f5-b149-e6a0cddc9e0f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:04.759156 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-027afda1-901c-40f5-b149-e6a0cddc9e0f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:04.767804 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-027afda1-901c-40f5-b149-e6a0cddc9e0f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1392 microversion: 2.1 time: 0.162758 Oct 27 19:59:04.768380 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3820/7793] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:04 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:05.793590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a3448361-ec50-4275-9d4f-f1aeeea63ff1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:05.794292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a3448361-ec50-4275-9d4f-f1aeeea63ff1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:05.801087 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3448361-ec50-4275-9d4f-f1aeeea63ff1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:05.801644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3448361-ec50-4275-9d4f-f1aeeea63ff1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:05.802102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3448361-ec50-4275-9d4f-f1aeeea63ff1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:05.802843 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3448361-ec50-4275-9d4f-f1aeeea63ff1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:05.803311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3448361-ec50-4275-9d4f-f1aeeea63ff1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:05.803752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a3448361-ec50-4275-9d4f-f1aeeea63ff1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:05.943331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a3448361-ec50-4275-9d4f-f1aeeea63ff1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:05.952143 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a3448361-ec50-4275-9d4f-f1aeeea63ff1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1392 microversion: 2.1 time: 0.164446 Oct 27 19:59:05.952718 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3974/7794] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:05 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:06.976836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-691c3548-a787-4310-9534-de10bcc52cdb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:06.977466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-691c3548-a787-4310-9534-de10bcc52cdb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:06.984495 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-691c3548-a787-4310-9534-de10bcc52cdb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:06.985001 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-691c3548-a787-4310-9534-de10bcc52cdb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:06.985460 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-691c3548-a787-4310-9534-de10bcc52cdb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:06.986179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-691c3548-a787-4310-9534-de10bcc52cdb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:06.986690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-691c3548-a787-4310-9534-de10bcc52cdb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:06.987142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-691c3548-a787-4310-9534-de10bcc52cdb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:07.119314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-691c3548-a787-4310-9534-de10bcc52cdb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:07.128736 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-691c3548-a787-4310-9534-de10bcc52cdb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1392 microversion: 2.1 time: 0.155808 Oct 27 19:59:07.130647 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3821/7795] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:06 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:08.152777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7949d671-dacd-4a0a-ad60-945ed9fdb7b4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:08.153477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7949d671-dacd-4a0a-ad60-945ed9fdb7b4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:08.160347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7949d671-dacd-4a0a-ad60-945ed9fdb7b4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:08.160835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7949d671-dacd-4a0a-ad60-945ed9fdb7b4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:08.161278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7949d671-dacd-4a0a-ad60-945ed9fdb7b4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:08.161976 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7949d671-dacd-4a0a-ad60-945ed9fdb7b4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:08.162466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7949d671-dacd-4a0a-ad60-945ed9fdb7b4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:08.162904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7949d671-dacd-4a0a-ad60-945ed9fdb7b4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:08.296175 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7949d671-dacd-4a0a-ad60-945ed9fdb7b4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:08.303967 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7949d671-dacd-4a0a-ad60-945ed9fdb7b4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1392 microversion: 2.1 time: 0.155630 Oct 27 19:59:08.304539 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3975/7796] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:08 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:08.459392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-e2fb2a6b-3a88-409f-af00-8227862879d8 req-c40cc770-5ead-4a0a-80d5-286c0092f5cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a1f9db-2c32-4848-b137-1ee8f7057a80", "name": "network-vif-plugged", "status": "completed", "tag": "c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:59:08.470276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e2fb2a6b-3a88-409f-af00-8227862879d8 req-c40cc770-5ead-4a0a-80d5-286c0092f5cb service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:08.470825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e2fb2a6b-3a88-409f-af00-8227862879d8 req-c40cc770-5ead-4a0a-80d5-286c0092f5cb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:08.471280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e2fb2a6b-3a88-409f-af00-8227862879d8 req-c40cc770-5ead-4a0a-80d5-286c0092f5cb service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:08.482468 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-e2fb2a6b-3a88-409f-af00-8227862879d8 req-c40cc770-5ead-4a0a-80d5-286c0092f5cb service nova] Creating event network-vif-plugged:c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2 for instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 on n-h1-860687-3 Oct 27 19:59:08.487493 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-e2fb2a6b-3a88-409f-af00-8227862879d8 req-c40cc770-5ead-4a0a-80d5-286c0092f5cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101430 Oct 27 19:59:08.488081 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3822/7797] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 19:59:09.328282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e48060b0-ebbc-4e57-ba55-185994f70735 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:09.328909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e48060b0-ebbc-4e57-ba55-185994f70735 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:09.336615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e48060b0-ebbc-4e57-ba55-185994f70735 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:09.337106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e48060b0-ebbc-4e57-ba55-185994f70735 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:09.337552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e48060b0-ebbc-4e57-ba55-185994f70735 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:09.338255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e48060b0-ebbc-4e57-ba55-185994f70735 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:09.338766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e48060b0-ebbc-4e57-ba55-185994f70735 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:09.339201 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e48060b0-ebbc-4e57-ba55-185994f70735 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:09.474791 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e48060b0-ebbc-4e57-ba55-185994f70735 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:09.483048 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e48060b0-ebbc-4e57-ba55-185994f70735 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1392 microversion: 2.1 time: 0.160013 Oct 27 19:59:09.483624 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3976/7798] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:09 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:10.506867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0aeb5033-e87e-45db-a158-313d77532440 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:10.507499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0aeb5033-e87e-45db-a158-313d77532440 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:10.516579 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0aeb5033-e87e-45db-a158-313d77532440 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:10.517244 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0aeb5033-e87e-45db-a158-313d77532440 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:10.518066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0aeb5033-e87e-45db-a158-313d77532440 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:10.518804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0aeb5033-e87e-45db-a158-313d77532440 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:10.519282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0aeb5033-e87e-45db-a158-313d77532440 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:10.519726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0aeb5033-e87e-45db-a158-313d77532440 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:10.657989 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0aeb5033-e87e-45db-a158-313d77532440 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:10.665930 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0aeb5033-e87e-45db-a158-313d77532440 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1565 microversion: 2.1 time: 0.163577 Oct 27 19:59:10.666538 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3823/7799] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:10 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:10.688767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-962583f3-b529-466b-bd8c-fe11bb8f3802 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:10.689389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-962583f3-b529-466b-bd8c-fe11bb8f3802 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:10.692211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:59:10.697902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-962583f3-b529-466b-bd8c-fe11bb8f3802 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:10.698413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-962583f3-b529-466b-bd8c-fe11bb8f3802 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:10.699647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-962583f3-b529-466b-bd8c-fe11bb8f3802 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:10.700420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-962583f3-b529-466b-bd8c-fe11bb8f3802 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:10.700884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-962583f3-b529-466b-bd8c-fe11bb8f3802 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:10.701320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-962583f3-b529-466b-bd8c-fe11bb8f3802 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:10.717279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:59:10.836308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-962583f3-b529-466b-bd8c-fe11bb8f3802 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:10.845048 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-962583f3-b529-466b-bd8c-fe11bb8f3802 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1565 microversion: 2.1 time: 0.160128 Oct 27 19:59:10.845621 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3977/7800] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:10 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:12.467502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e48600b6-27bf-4d20-b147-b1623b0d635f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:12.468237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e48600b6-27bf-4d20-b147-b1623b0d635f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:12.469510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e7db720e-f4dc-4fad-b924-180abf60f32e req-658ede3d-08bc-4377-bbdd-3dcea4f20d7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a1f9db-2c32-4848-b137-1ee8f7057a80", "tag": "c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:59:12.471576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:59:12.477264 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e48600b6-27bf-4d20-b147-b1623b0d635f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:12.477881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e48600b6-27bf-4d20-b147-b1623b0d635f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:12.478509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e48600b6-27bf-4d20-b147-b1623b0d635f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:12.479330 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e48600b6-27bf-4d20-b147-b1623b0d635f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:12.479906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e48600b6-27bf-4d20-b147-b1623b0d635f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:12.481478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e48600b6-27bf-4d20-b147-b1623b0d635f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:12.481616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e7db720e-f4dc-4fad-b924-180abf60f32e req-658ede3d-08bc-4377-bbdd-3dcea4f20d7d service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:12.481616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e7db720e-f4dc-4fad-b924-180abf60f32e req-658ede3d-08bc-4377-bbdd-3dcea4f20d7d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:12.481819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e7db720e-f4dc-4fad-b924-180abf60f32e req-658ede3d-08bc-4377-bbdd-3dcea4f20d7d service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:12.497123 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e7db720e-f4dc-4fad-b924-180abf60f32e req-658ede3d-08bc-4377-bbdd-3dcea4f20d7d service nova] Creating event network-changed:c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2 for instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 on n-h1-860687-3 Oct 27 19:59:12.502725 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e7db720e-f4dc-4fad-b924-180abf60f32e req-658ede3d-08bc-4377-bbdd-3dcea4f20d7d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037636 Oct 27 19:59:12.503715 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3978/7801] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 19:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 19:59:12.708732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e48600b6-27bf-4d20-b147-b1623b0d635f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:12.718129 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e48600b6-27bf-4d20-b147-b1623b0d635f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1565 microversion: 2.1 time: 0.256057 Oct 27 19:59:12.719212 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3824/7802] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:12 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1565 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:36.009279 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:59:36.010165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=36 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:59:36.014498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-10ba0ce1-40d3-43da-9d07-d99e2cf38320 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:59:36.016750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-10ba0ce1-40d3-43da-9d07-d99e2cf38320 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:36.024399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10ba0ce1-40d3-43da-9d07-d99e2cf38320 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:36.024888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10ba0ce1-40d3-43da-9d07-d99e2cf38320 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:36.025334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10ba0ce1-40d3-43da-9d07-d99e2cf38320 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:36.026029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10ba0ce1-40d3-43da-9d07-d99e2cf38320 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:36.026518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10ba0ce1-40d3-43da-9d07-d99e2cf38320 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:36.026999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-10ba0ce1-40d3-43da-9d07-d99e2cf38320 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:36.080886 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-10ba0ce1-40d3-43da-9d07-d99e2cf38320 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80/action" status: 200 len: 24567 microversion: 2.1 time: 0.073374 Oct 27 19:59:36.081518 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3979/7803] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:59:36 2022] POST /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80/action => generated 24567 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 19:59:47.004268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 19:59:47.006713 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:47.008902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:59:47.009627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=32 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:59:47.011918 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 19:59:47.012102 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 19:59:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80/action (ip 10.222.0.42) !!! Oct 27 19:59:47.020825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:47.021325 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:47.021783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:47.022526 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:47.023011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:47.023455 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:47.068361 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:47.075678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Old instance type m1.heat2, new instance type m1.heat {{(pid=127028) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 19:59:47.082218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 19:59:47.082687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 19:59:47.083174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 19:59:47.083603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 19:59:47.084028 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 19:59:47.152231 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f53921fe-ca9e-4a94-b1b8-ff68b90488d2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80/action" status: 202 len: 0 microversion: 2.1 time: 0.151884 Oct 27 19:59:47.152789 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3825/7804] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 19:59:46 2022] POST /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 19:59:47.161601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-15066ab7-c285-4bc7-ba93-a5229fa3358d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:47.162379 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-15066ab7-c285-4bc7-ba93-a5229fa3358d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:47.165349 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=4 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:59:47.166013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 19:59:47.173077 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-15066ab7-c285-4bc7-ba93-a5229fa3358d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:47.173575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-15066ab7-c285-4bc7-ba93-a5229fa3358d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:47.174143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-15066ab7-c285-4bc7-ba93-a5229fa3358d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:47.174985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-15066ab7-c285-4bc7-ba93-a5229fa3358d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:47.175572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-15066ab7-c285-4bc7-ba93-a5229fa3358d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:47.175981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-15066ab7-c285-4bc7-ba93-a5229fa3358d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:47.357291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-15066ab7-c285-4bc7-ba93-a5229fa3358d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:47.366021 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-15066ab7-c285-4bc7-ba93-a5229fa3358d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1693 microversion: 2.1 time: 0.208786 Oct 27 19:59:47.366873 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3980/7805] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:47 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1693 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:48.393003 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b4b6864f-ce47-4164-9244-90f6a1a2cbc7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:48.393638 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b4b6864f-ce47-4164-9244-90f6a1a2cbc7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:48.401149 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4b6864f-ce47-4164-9244-90f6a1a2cbc7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:48.401809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4b6864f-ce47-4164-9244-90f6a1a2cbc7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:48.401809 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4b6864f-ce47-4164-9244-90f6a1a2cbc7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:48.402906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4b6864f-ce47-4164-9244-90f6a1a2cbc7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:48.403382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4b6864f-ce47-4164-9244-90f6a1a2cbc7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:48.403833 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b4b6864f-ce47-4164-9244-90f6a1a2cbc7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:48.544913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b4b6864f-ce47-4164-9244-90f6a1a2cbc7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:48.552862 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b4b6864f-ce47-4164-9244-90f6a1a2cbc7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1693 microversion: 2.1 time: 0.165704 Oct 27 19:59:48.553444 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3826/7806] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:48 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:59:49.579042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-db223618-e76b-461c-a3d0-6426637e3c70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:49.579583 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-db223618-e76b-461c-a3d0-6426637e3c70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:49.585793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db223618-e76b-461c-a3d0-6426637e3c70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:49.586285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db223618-e76b-461c-a3d0-6426637e3c70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:49.586774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db223618-e76b-461c-a3d0-6426637e3c70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:49.587475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db223618-e76b-461c-a3d0-6426637e3c70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:49.587936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db223618-e76b-461c-a3d0-6426637e3c70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:49.588372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db223618-e76b-461c-a3d0-6426637e3c70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:49.725350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-db223618-e76b-461c-a3d0-6426637e3c70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:49.733874 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-db223618-e76b-461c-a3d0-6426637e3c70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.160683 Oct 27 19:59:49.734455 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3981/7807] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:49 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:50.758880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-252de335-7115-4de0-ba8e-abdb693edaa6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:50.759506 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-252de335-7115-4de0-ba8e-abdb693edaa6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:50.766726 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-252de335-7115-4de0-ba8e-abdb693edaa6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:50.767230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-252de335-7115-4de0-ba8e-abdb693edaa6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:50.767687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-252de335-7115-4de0-ba8e-abdb693edaa6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:50.768401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-252de335-7115-4de0-ba8e-abdb693edaa6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:50.768870 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-252de335-7115-4de0-ba8e-abdb693edaa6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:50.769315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-252de335-7115-4de0-ba8e-abdb693edaa6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:50.903691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-252de335-7115-4de0-ba8e-abdb693edaa6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:50.911714 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-252de335-7115-4de0-ba8e-abdb693edaa6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.156903 Oct 27 19:59:50.912343 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3827/7808] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:50 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:51.937064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-81b67168-700d-4d64-a8b5-25d10d263c4c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:51.937751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-81b67168-700d-4d64-a8b5-25d10d263c4c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:51.944803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81b67168-700d-4d64-a8b5-25d10d263c4c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:51.945308 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81b67168-700d-4d64-a8b5-25d10d263c4c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:51.945787 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81b67168-700d-4d64-a8b5-25d10d263c4c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:51.946521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81b67168-700d-4d64-a8b5-25d10d263c4c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:51.947013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81b67168-700d-4d64-a8b5-25d10d263c4c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:51.947478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81b67168-700d-4d64-a8b5-25d10d263c4c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:52.086097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-81b67168-700d-4d64-a8b5-25d10d263c4c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:52.094115 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-81b67168-700d-4d64-a8b5-25d10d263c4c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.162204 Oct 27 19:59:52.094760 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3982/7809] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:51 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:53.118482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a3c0ac33-3e54-4a94-8dc6-ddcffca3f345 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:53.119115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a3c0ac33-3e54-4a94-8dc6-ddcffca3f345 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:53.126452 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3c0ac33-3e54-4a94-8dc6-ddcffca3f345 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:53.126962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3c0ac33-3e54-4a94-8dc6-ddcffca3f345 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:53.127420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3c0ac33-3e54-4a94-8dc6-ddcffca3f345 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:53.128133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3c0ac33-3e54-4a94-8dc6-ddcffca3f345 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:53.128604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3c0ac33-3e54-4a94-8dc6-ddcffca3f345 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:53.129051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3c0ac33-3e54-4a94-8dc6-ddcffca3f345 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:53.264004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a3c0ac33-3e54-4a94-8dc6-ddcffca3f345 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:53.272070 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a3c0ac33-3e54-4a94-8dc6-ddcffca3f345 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.157660 Oct 27 19:59:53.272663 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3828/7810] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:53 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:59:54.295823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e6b7f59b-4bd3-4bcc-b7c8-22f71c37a4cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:54.296452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e6b7f59b-4bd3-4bcc-b7c8-22f71c37a4cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:54.303372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6b7f59b-4bd3-4bcc-b7c8-22f71c37a4cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:54.303860 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6b7f59b-4bd3-4bcc-b7c8-22f71c37a4cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:54.304303 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6b7f59b-4bd3-4bcc-b7c8-22f71c37a4cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:54.305031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6b7f59b-4bd3-4bcc-b7c8-22f71c37a4cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:54.305497 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6b7f59b-4bd3-4bcc-b7c8-22f71c37a4cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:54.305931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e6b7f59b-4bd3-4bcc-b7c8-22f71c37a4cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:54.439210 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e6b7f59b-4bd3-4bcc-b7c8-22f71c37a4cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:54.446960 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e6b7f59b-4bd3-4bcc-b7c8-22f71c37a4cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.155501 Oct 27 19:59:54.447511 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3983/7811] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:54 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:55.471351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0373c4a4-fa16-4895-a2ba-257d8fe1302b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:55.471895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0373c4a4-fa16-4895-a2ba-257d8fe1302b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:55.478915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0373c4a4-fa16-4895-a2ba-257d8fe1302b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:55.479424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0373c4a4-fa16-4895-a2ba-257d8fe1302b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:55.480042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0373c4a4-fa16-4895-a2ba-257d8fe1302b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:55.480590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0373c4a4-fa16-4895-a2ba-257d8fe1302b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:55.481067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0373c4a4-fa16-4895-a2ba-257d8fe1302b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:55.481518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0373c4a4-fa16-4895-a2ba-257d8fe1302b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:55.619026 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0373c4a4-fa16-4895-a2ba-257d8fe1302b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:55.627401 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0373c4a4-fa16-4895-a2ba-257d8fe1302b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.160147 Oct 27 19:59:55.627977 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3829/7812] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:55 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:56.651801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-29cbb840-8406-4dcd-8895-516ca014c05e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:56.652423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-29cbb840-8406-4dcd-8895-516ca014c05e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:56.659509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29cbb840-8406-4dcd-8895-516ca014c05e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:56.660005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29cbb840-8406-4dcd-8895-516ca014c05e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:56.660449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29cbb840-8406-4dcd-8895-516ca014c05e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:56.661144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29cbb840-8406-4dcd-8895-516ca014c05e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:56.661630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29cbb840-8406-4dcd-8895-516ca014c05e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:56.662070 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-29cbb840-8406-4dcd-8895-516ca014c05e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:56.798578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-29cbb840-8406-4dcd-8895-516ca014c05e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:56.806458 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-29cbb840-8406-4dcd-8895-516ca014c05e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.158640 Oct 27 19:59:56.807037 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3984/7813] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:56 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 19:59:57.833939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e37520ce-7bbb-4f56-8074-dbc8ade5d6d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:57.834596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e37520ce-7bbb-4f56-8074-dbc8ade5d6d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:57.842413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e37520ce-7bbb-4f56-8074-dbc8ade5d6d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:57.842923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e37520ce-7bbb-4f56-8074-dbc8ade5d6d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:57.843381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e37520ce-7bbb-4f56-8074-dbc8ade5d6d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:57.844140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e37520ce-7bbb-4f56-8074-dbc8ade5d6d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:57.844630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e37520ce-7bbb-4f56-8074-dbc8ade5d6d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:57.845133 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e37520ce-7bbb-4f56-8074-dbc8ade5d6d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:57.985157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e37520ce-7bbb-4f56-8074-dbc8ade5d6d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:57.993369 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e37520ce-7bbb-4f56-8074-dbc8ade5d6d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.163838 Oct 27 19:59:57.993954 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3830/7814] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:57 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 19:59:59.018521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dc4d359f-d890-4e2d-b228-15a0b6ba03d0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 19:59:59.019147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dc4d359f-d890-4e2d-b228-15a0b6ba03d0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 19:59:59.025541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc4d359f-d890-4e2d-b228-15a0b6ba03d0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:59.026036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc4d359f-d890-4e2d-b228-15a0b6ba03d0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:59.026640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc4d359f-d890-4e2d-b228-15a0b6ba03d0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:59.027343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc4d359f-d890-4e2d-b228-15a0b6ba03d0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 19:59:59.027809 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc4d359f-d890-4e2d-b228-15a0b6ba03d0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 19:59:59.028247 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc4d359f-d890-4e2d-b228-15a0b6ba03d0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 19:59:59.163464 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dc4d359f-d890-4e2d-b228-15a0b6ba03d0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 19:59:59.172882 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dc4d359f-d890-4e2d-b228-15a0b6ba03d0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.158859 Oct 27 19:59:59.173475 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3985/7815] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 19:59:59 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:00.198763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d55571f-a925-468f-bfe8-fb242b1f39f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:00:00.199800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d55571f-a925-468f-bfe8-fb242b1f39f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:00.207281 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d55571f-a925-468f-bfe8-fb242b1f39f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:00.207820 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d55571f-a925-468f-bfe8-fb242b1f39f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:00.208315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d55571f-a925-468f-bfe8-fb242b1f39f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:00.209099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d55571f-a925-468f-bfe8-fb242b1f39f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:00.209603 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d55571f-a925-468f-bfe8-fb242b1f39f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:00.210122 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d55571f-a925-468f-bfe8-fb242b1f39f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:00.351742 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6d55571f-a925-468f-bfe8-fb242b1f39f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:00:00.359644 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d55571f-a925-468f-bfe8-fb242b1f39f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.166087 Oct 27 20:00:00.360235 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3831/7816] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:00:00 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:01.383472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bfe19a00-ae48-4506-97fd-67e66a3be67c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:00:01.384082 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bfe19a00-ae48-4506-97fd-67e66a3be67c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:01.391915 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe19a00-ae48-4506-97fd-67e66a3be67c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:01.392426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe19a00-ae48-4506-97fd-67e66a3be67c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:01.392868 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe19a00-ae48-4506-97fd-67e66a3be67c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:01.393558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe19a00-ae48-4506-97fd-67e66a3be67c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:01.394013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe19a00-ae48-4506-97fd-67e66a3be67c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:01.394473 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bfe19a00-ae48-4506-97fd-67e66a3be67c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:01.529799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bfe19a00-ae48-4506-97fd-67e66a3be67c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:00:01.537837 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bfe19a00-ae48-4506-97fd-67e66a3be67c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.158354 Oct 27 20:00:01.538429 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3986/7817] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:00:01 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:02.563554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-245b3ca7-101a-41a2-9581-bbb33760dfa0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:00:02.564195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-245b3ca7-101a-41a2-9581-bbb33760dfa0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:02.571298 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-245b3ca7-101a-41a2-9581-bbb33760dfa0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:02.571812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-245b3ca7-101a-41a2-9581-bbb33760dfa0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:02.572279 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-245b3ca7-101a-41a2-9581-bbb33760dfa0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:02.573137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-245b3ca7-101a-41a2-9581-bbb33760dfa0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:02.574640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-245b3ca7-101a-41a2-9581-bbb33760dfa0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:02.575121 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-245b3ca7-101a-41a2-9581-bbb33760dfa0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:02.709334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-245b3ca7-101a-41a2-9581-bbb33760dfa0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:00:02.717388 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-245b3ca7-101a-41a2-9581-bbb33760dfa0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.158275 Oct 27 20:00:02.718016 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3832/7818] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:00:02 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:03.741190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-51553ff4-a50f-4d28-ba69-21ce43cc54da tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:00:03.741812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-51553ff4-a50f-4d28-ba69-21ce43cc54da tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:03.749416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51553ff4-a50f-4d28-ba69-21ce43cc54da tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:03.749927 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51553ff4-a50f-4d28-ba69-21ce43cc54da tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:03.750372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51553ff4-a50f-4d28-ba69-21ce43cc54da tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:03.751204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51553ff4-a50f-4d28-ba69-21ce43cc54da tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:03.751668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51553ff4-a50f-4d28-ba69-21ce43cc54da tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:03.752104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-51553ff4-a50f-4d28-ba69-21ce43cc54da tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:03.886256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-51553ff4-a50f-4d28-ba69-21ce43cc54da tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:00:03.894039 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-51553ff4-a50f-4d28-ba69-21ce43cc54da tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.156788 Oct 27 20:00:03.894633 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3987/7819] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:00:03 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:04.917760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d453aa32-ef78-4b96-975c-999695a066d7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:00:04.918476 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d453aa32-ef78-4b96-975c-999695a066d7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:04.925552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d453aa32-ef78-4b96-975c-999695a066d7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:04.926058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d453aa32-ef78-4b96-975c-999695a066d7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:04.926575 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d453aa32-ef78-4b96-975c-999695a066d7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:04.927302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d453aa32-ef78-4b96-975c-999695a066d7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:04.927785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d453aa32-ef78-4b96-975c-999695a066d7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:04.928239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d453aa32-ef78-4b96-975c-999695a066d7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:05.064571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d453aa32-ef78-4b96-975c-999695a066d7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:00:05.072489 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d453aa32-ef78-4b96-975c-999695a066d7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.158915 Oct 27 20:00:05.073235 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3833/7820] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:00:04 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:06.096874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c438746f-1314-4a23-a4e1-5c286f87f380 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:00:06.097478 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c438746f-1314-4a23-a4e1-5c286f87f380 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:06.104439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c438746f-1314-4a23-a4e1-5c286f87f380 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:06.104931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c438746f-1314-4a23-a4e1-5c286f87f380 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:06.105381 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c438746f-1314-4a23-a4e1-5c286f87f380 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:06.106080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c438746f-1314-4a23-a4e1-5c286f87f380 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:06.106586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c438746f-1314-4a23-a4e1-5c286f87f380 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:06.107023 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c438746f-1314-4a23-a4e1-5c286f87f380 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:06.241560 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c438746f-1314-4a23-a4e1-5c286f87f380 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:00:06.249789 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c438746f-1314-4a23-a4e1-5c286f87f380 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1698 microversion: 2.1 time: 0.156876 Oct 27 20:00:06.250369 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3988/7821] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:00:06 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:06.928481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-8e92b582-7c34-4143-9dc1-b3c204523500 req-8e5bb099-2c36-4ca6-8153-ad2121a802b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a1f9db-2c32-4848-b137-1ee8f7057a80", "name": "network-vif-unplugged", "status": "completed", "tag": "c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:00:06.939951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8e92b582-7c34-4143-9dc1-b3c204523500 req-8e5bb099-2c36-4ca6-8153-ad2121a802b2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:06.940464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8e92b582-7c34-4143-9dc1-b3c204523500 req-8e5bb099-2c36-4ca6-8153-ad2121a802b2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:06.940928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8e92b582-7c34-4143-9dc1-b3c204523500 req-8e5bb099-2c36-4ca6-8153-ad2121a802b2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:06.954056 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-8e92b582-7c34-4143-9dc1-b3c204523500 req-8e5bb099-2c36-4ca6-8153-ad2121a802b2 service nova] Creating event network-vif-unplugged:c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2 for instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 on n-h2-860687-3 Oct 27 20:00:06.959768 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [req-8e92b582-7c34-4143-9dc1-b3c204523500 req-8e5bb099-2c36-4ca6-8153-ad2121a802b2 service nova] Instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127028) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 20:00:06.972239 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-8e92b582-7c34-4143-9dc1-b3c204523500 req-8e5bb099-2c36-4ca6-8153-ad2121a802b2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047951 Oct 27 20:00:06.972921 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3834/7822] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:00:07.352846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f82883bc-5421-423b-b6bf-bd1723d12362 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:00:07.353466 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f82883bc-5421-423b-b6bf-bd1723d12362 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:07.361419 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f82883bc-5421-423b-b6bf-bd1723d12362 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:07.361907 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f82883bc-5421-423b-b6bf-bd1723d12362 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:07.362417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f82883bc-5421-423b-b6bf-bd1723d12362 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:07.363096 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f82883bc-5421-423b-b6bf-bd1723d12362 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:07.363566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f82883bc-5421-423b-b6bf-bd1723d12362 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:07.364122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f82883bc-5421-423b-b6bf-bd1723d12362 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:07.592383 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f82883bc-5421-423b-b6bf-bd1723d12362 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:00:07.600737 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f82883bc-5421-423b-b6bf-bd1723d12362 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1697 microversion: 2.1 time: 0.251726 Oct 27 20:00:07.601323 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3989/7823] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:00:07 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1697 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:08.627323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f894386d-fd09-4fb7-8f39-ab16330608cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:00:08.628046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f894386d-fd09-4fb7-8f39-ab16330608cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:08.634262 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f894386d-fd09-4fb7-8f39-ab16330608cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:08.634801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f894386d-fd09-4fb7-8f39-ab16330608cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:08.635255 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f894386d-fd09-4fb7-8f39-ab16330608cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:08.637160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f894386d-fd09-4fb7-8f39-ab16330608cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:08.637650 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f894386d-fd09-4fb7-8f39-ab16330608cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:08.638101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f894386d-fd09-4fb7-8f39-ab16330608cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:08.778059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f894386d-fd09-4fb7-8f39-ab16330608cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:00:08.785896 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f894386d-fd09-4fb7-8f39-ab16330608cf tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1695 microversion: 2.1 time: 0.163985 Oct 27 20:00:08.786484 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3835/7824] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:00:08 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:09.011985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-f23cf9dd-e27e-4eb2-a307-caf740dc9dc1 req-48b67269-b2e0-4e98-83d8-b6293485ba27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a1f9db-2c32-4848-b137-1ee8f7057a80", "tag": "c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:00:09.022155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f23cf9dd-e27e-4eb2-a307-caf740dc9dc1 req-48b67269-b2e0-4e98-83d8-b6293485ba27 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:09.022674 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f23cf9dd-e27e-4eb2-a307-caf740dc9dc1 req-48b67269-b2e0-4e98-83d8-b6293485ba27 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:09.023117 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-f23cf9dd-e27e-4eb2-a307-caf740dc9dc1 req-48b67269-b2e0-4e98-83d8-b6293485ba27 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:09.034604 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-f23cf9dd-e27e-4eb2-a307-caf740dc9dc1 req-48b67269-b2e0-4e98-83d8-b6293485ba27 service nova] Creating event network-changed:c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2 for instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 on n-h2-860687-3 Oct 27 20:00:09.039781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [req-f23cf9dd-e27e-4eb2-a307-caf740dc9dc1 req-48b67269-b2e0-4e98-83d8-b6293485ba27 service nova] Instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-3', 'n-h2-860687-3'} {{(pid=127029) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 20:00:09.051313 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-f23cf9dd-e27e-4eb2-a307-caf740dc9dc1 req-48b67269-b2e0-4e98-83d8-b6293485ba27 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042822 Oct 27 20:00:09.051917 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3990/7825] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:00:09.810412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-730e9c6c-960b-4c31-9f12-643ca0004768 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:00:09.811074 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-730e9c6c-960b-4c31-9f12-643ca0004768 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:09.818064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-730e9c6c-960b-4c31-9f12-643ca0004768 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:09.818617 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-730e9c6c-960b-4c31-9f12-643ca0004768 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:09.819085 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-730e9c6c-960b-4c31-9f12-643ca0004768 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:09.819813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-730e9c6c-960b-4c31-9f12-643ca0004768 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:09.820290 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-730e9c6c-960b-4c31-9f12-643ca0004768 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:09.820741 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-730e9c6c-960b-4c31-9f12-643ca0004768 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:09.958914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-730e9c6c-960b-4c31-9f12-643ca0004768 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:00:09.967285 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-730e9c6c-960b-4c31-9f12-643ca0004768 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1695 microversion: 2.1 time: 0.161592 Oct 27 20:00:09.967877 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3836/7826] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:00:09 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:10.992825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-64cc505d-879a-44da-90e3-ccf90853802e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:00:10.993533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-64cc505d-879a-44da-90e3-ccf90853802e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:11.001849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64cc505d-879a-44da-90e3-ccf90853802e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:11.002344 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64cc505d-879a-44da-90e3-ccf90853802e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:11.002825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64cc505d-879a-44da-90e3-ccf90853802e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:11.003538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64cc505d-879a-44da-90e3-ccf90853802e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:11.004005 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64cc505d-879a-44da-90e3-ccf90853802e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:11.004590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-64cc505d-879a-44da-90e3-ccf90853802e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:11.199165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-64cc505d-879a-44da-90e3-ccf90853802e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:00:11.207714 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-64cc505d-879a-44da-90e3-ccf90853802e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1695 microversion: 2.1 time: 0.219252 Oct 27 20:00:11.212406 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3991/7827] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:00:10 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1695 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:12.233154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4b6b16a1-96a5-4248-96a1-9b5cf331d77e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:00:12.233784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4b6b16a1-96a5-4248-96a1-9b5cf331d77e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:12.240670 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b6b16a1-96a5-4248-96a1-9b5cf331d77e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:12.241170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b6b16a1-96a5-4248-96a1-9b5cf331d77e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:12.241635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b6b16a1-96a5-4248-96a1-9b5cf331d77e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:12.242345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b6b16a1-96a5-4248-96a1-9b5cf331d77e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:12.242845 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b6b16a1-96a5-4248-96a1-9b5cf331d77e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:12.243291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b6b16a1-96a5-4248-96a1-9b5cf331d77e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:12.387600 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4b6b16a1-96a5-4248-96a1-9b5cf331d77e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:00:12.395370 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4b6b16a1-96a5-4248-96a1-9b5cf331d77e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1692 microversion: 2.1 time: 0.167114 Oct 27 20:00:12.395960 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3837/7828] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:00:12 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:12.419699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6998947a-8548-4276-ab1e-2ea930c9c31a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:00:12.420255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6998947a-8548-4276-ab1e-2ea930c9c31a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:12.427246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6998947a-8548-4276-ab1e-2ea930c9c31a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:12.427743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6998947a-8548-4276-ab1e-2ea930c9c31a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:12.428192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6998947a-8548-4276-ab1e-2ea930c9c31a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:12.428898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6998947a-8548-4276-ab1e-2ea930c9c31a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:12.429368 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6998947a-8548-4276-ab1e-2ea930c9c31a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:12.429803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6998947a-8548-4276-ab1e-2ea930c9c31a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:12.492923 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6998947a-8548-4276-ab1e-2ea930c9c31a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80/action" status: 204 len: 0 microversion: 2.1 time: 0.077402 Oct 27 20:00:12.493582 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3992/7829] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:00:12 2022] POST /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 20:00:12.502908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3be9f79e-c794-42a7-88b5-31b8756a9087 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:00:12.503602 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3be9f79e-c794-42a7-88b5-31b8756a9087 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:12.510096 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3be9f79e-c794-42a7-88b5-31b8756a9087 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:12.510688 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3be9f79e-c794-42a7-88b5-31b8756a9087 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:12.511165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3be9f79e-c794-42a7-88b5-31b8756a9087 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:12.511964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3be9f79e-c794-42a7-88b5-31b8756a9087 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:12.512450 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3be9f79e-c794-42a7-88b5-31b8756a9087 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:12.513054 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3be9f79e-c794-42a7-88b5-31b8756a9087 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:12.728920 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3be9f79e-c794-42a7-88b5-31b8756a9087 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:00:12.736876 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3be9f79e-c794-42a7-88b5-31b8756a9087 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1692 microversion: 2.1 time: 0.238477 Oct 27 20:00:12.737470 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3838/7830] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:00:12 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1692 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:12.761116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7021487c-2024-437a-84f1-ccdee1f16a80 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:00:12.761896 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7021487c-2024-437a-84f1-ccdee1f16a80 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:12.767965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7021487c-2024-437a-84f1-ccdee1f16a80 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:12.768452 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7021487c-2024-437a-84f1-ccdee1f16a80 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:12.769040 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7021487c-2024-437a-84f1-ccdee1f16a80 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:12.769757 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7021487c-2024-437a-84f1-ccdee1f16a80 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:12.770218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7021487c-2024-437a-84f1-ccdee1f16a80 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:12.770666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7021487c-2024-437a-84f1-ccdee1f16a80 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:12.915509 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7021487c-2024-437a-84f1-ccdee1f16a80 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:00:12.923498 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7021487c-2024-437a-84f1-ccdee1f16a80 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1692 microversion: 2.1 time: 0.167258 Oct 27 20:00:12.924091 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3993/7831] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:00:12 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:14.007902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c3ff74ea-e971-4f38-a8f3-f423da80e76d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:00:14.008588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c3ff74ea-e971-4f38-a8f3-f423da80e76d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:14.016559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3ff74ea-e971-4f38-a8f3-f423da80e76d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:14.017067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3ff74ea-e971-4f38-a8f3-f423da80e76d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:14.017697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3ff74ea-e971-4f38-a8f3-f423da80e76d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:14.018454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3ff74ea-e971-4f38-a8f3-f423da80e76d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:14.018939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3ff74ea-e971-4f38-a8f3-f423da80e76d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:14.019402 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3ff74ea-e971-4f38-a8f3-f423da80e76d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:14.156399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c3ff74ea-e971-4f38-a8f3-f423da80e76d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:00:14.164180 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c3ff74ea-e971-4f38-a8f3-f423da80e76d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1684 microversion: 2.1 time: 0.219787 Oct 27 20:00:14.164746 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3839/7832] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:00:13 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1684 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:00:15.352870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-31ce03c8-8a35-4e56-93d9-c11d96f4279c req-4916d447-fd96-441c-9c00-84b0d532ba22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a1f9db-2c32-4848-b137-1ee8f7057a80", "name": "network-vif-plugged", "status": "completed", "tag": "c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:00:15.363136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-31ce03c8-8a35-4e56-93d9-c11d96f4279c req-4916d447-fd96-441c-9c00-84b0d532ba22 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:15.363627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-31ce03c8-8a35-4e56-93d9-c11d96f4279c req-4916d447-fd96-441c-9c00-84b0d532ba22 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:15.364066 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-31ce03c8-8a35-4e56-93d9-c11d96f4279c req-4916d447-fd96-441c-9c00-84b0d532ba22 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:15.376507 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-31ce03c8-8a35-4e56-93d9-c11d96f4279c req-4916d447-fd96-441c-9c00-84b0d532ba22 service nova] Creating event network-vif-plugged:c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2 for instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 on n-h2-860687-3 Oct 27 20:00:15.381758 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-31ce03c8-8a35-4e56-93d9-c11d96f4279c req-4916d447-fd96-441c-9c00-84b0d532ba22 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032733 Oct 27 20:00:15.382733 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3994/7833] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 20:00:44.376676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-88f4f7b1-765c-4408-8060-ef8caddef723 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:00:44.379016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-88f4f7b1-765c-4408-8060-ef8caddef723 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:00:44.381530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=34 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:00:44.382208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:00:44.388434 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88f4f7b1-765c-4408-8060-ef8caddef723 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:44.388939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88f4f7b1-765c-4408-8060-ef8caddef723 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:44.389743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88f4f7b1-765c-4408-8060-ef8caddef723 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:44.390502 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88f4f7b1-765c-4408-8060-ef8caddef723 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:00:44.390974 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88f4f7b1-765c-4408-8060-ef8caddef723 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:00:44.391418 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88f4f7b1-765c-4408-8060-ef8caddef723 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:00:44.446450 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-88f4f7b1-765c-4408-8060-ef8caddef723 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80/action" status: 200 len: 24573 microversion: 2.1 time: 0.073974 Oct 27 20:00:44.447118 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3840/7834] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:00:44 2022] POST /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80/action => generated 24573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 20:01:01.946414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-95469a98-2cea-4c95-99db-3899fd5be758 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:01.947369 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-95469a98-2cea-4c95-99db-3899fd5be758 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:01.948722 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-e9635209-5cba-4d06-b027-7d7a0e88c322 req-b898ef42-defa-444f-95cb-3ab3f9ccaf2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a1f9db-2c32-4848-b137-1ee8f7057a80", "tag": "c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:01:01.951681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=30 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:01:01.952537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:01:01.954551 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 27 20:01:01.960922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95469a98-2cea-4c95-99db-3899fd5be758 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:01.961781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95469a98-2cea-4c95-99db-3899fd5be758 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:01.962233 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95469a98-2cea-4c95-99db-3899fd5be758 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:01.963145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:01:01.963541 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95469a98-2cea-4c95-99db-3899fd5be758 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:01.964014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95469a98-2cea-4c95-99db-3899fd5be758 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:01.964691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95469a98-2cea-4c95-99db-3899fd5be758 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:01.964861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:01:01.967469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e9635209-5cba-4d06-b027-7d7a0e88c322 req-b898ef42-defa-444f-95cb-3ab3f9ccaf2f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:01.967949 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e9635209-5cba-4d06-b027-7d7a0e88c322 req-b898ef42-defa-444f-95cb-3ab3f9ccaf2f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:01.968467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e9635209-5cba-4d06-b027-7d7a0e88c322 req-b898ef42-defa-444f-95cb-3ab3f9ccaf2f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:01.983343 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-e9635209-5cba-4d06-b027-7d7a0e88c322 req-b898ef42-defa-444f-95cb-3ab3f9ccaf2f service nova] Creating event network-changed:c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2 for instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 on n-h2-860687-3 Oct 27 20:01:01.990145 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-e9635209-5cba-4d06-b027-7d7a0e88c322 req-b898ef42-defa-444f-95cb-3ab3f9ccaf2f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045953 Oct 27 20:01:01.991310 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3841/7835] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:01:01.995499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-95469a98-2cea-4c95-99db-3899fd5be758 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 20:01:02.079592 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-95469a98-2cea-4c95-99db-3899fd5be758 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "DELETE /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 204 len: 0 microversion: 2.1 time: 0.136924 Oct 27 20:01:02.082463 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3995/7836] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 20:01:01 2022] DELETE /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 20:01:02.090213 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-48893e64-09f3-44fa-8bd2-c7c69e4528ff tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:02.090983 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-48893e64-09f3-44fa-8bd2-c7c69e4528ff tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:02.097826 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48893e64-09f3-44fa-8bd2-c7c69e4528ff tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:02.098362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48893e64-09f3-44fa-8bd2-c7c69e4528ff tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:02.098858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48893e64-09f3-44fa-8bd2-c7c69e4528ff tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:02.099596 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48893e64-09f3-44fa-8bd2-c7c69e4528ff tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:02.100172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48893e64-09f3-44fa-8bd2-c7c69e4528ff tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:02.100628 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48893e64-09f3-44fa-8bd2-c7c69e4528ff tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:02.245075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-48893e64-09f3-44fa-8bd2-c7c69e4528ff tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:01:02.253487 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-48893e64-09f3-44fa-8bd2-c7c69e4528ff tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1690 microversion: 2.1 time: 0.168571 Oct 27 20:01:02.254153 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3842/7837] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:01:02 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 20:01:03.281095 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ee9a673a-8c29-4590-8736-1759edc35be3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:03.281913 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ee9a673a-8c29-4590-8736-1759edc35be3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:03.288895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee9a673a-8c29-4590-8736-1759edc35be3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:03.289387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee9a673a-8c29-4590-8736-1759edc35be3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:03.289832 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee9a673a-8c29-4590-8736-1759edc35be3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:03.290613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee9a673a-8c29-4590-8736-1759edc35be3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:03.291085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee9a673a-8c29-4590-8736-1759edc35be3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:03.291516 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee9a673a-8c29-4590-8736-1759edc35be3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:03.503600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ee9a673a-8c29-4590-8736-1759edc35be3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:01:03.513256 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ee9a673a-8c29-4590-8736-1759edc35be3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 200 len: 1690 microversion: 2.1 time: 0.236333 Oct 27 20:01:03.524404 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3996/7838] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:01:03 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 1690 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:01:04.005781 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-9311433e-34d8-414a-97cd-54c6918e9337 req-e733045e-fad7-41aa-9155-279646b6f163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a1f9db-2c32-4848-b137-1ee8f7057a80", "name": "network-vif-deleted", "tag": "c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:01:04.016783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9311433e-34d8-414a-97cd-54c6918e9337 req-e733045e-fad7-41aa-9155-279646b6f163 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:04.017289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9311433e-34d8-414a-97cd-54c6918e9337 req-e733045e-fad7-41aa-9155-279646b6f163 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:04.017749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9311433e-34d8-414a-97cd-54c6918e9337 req-e733045e-fad7-41aa-9155-279646b6f163 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:04.029721 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-9311433e-34d8-414a-97cd-54c6918e9337 req-e733045e-fad7-41aa-9155-279646b6f163 service nova] Creating event network-vif-deleted:c03feb03-b6f5-4bd2-b256-4fdb9d7a42b2 for instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 on n-h2-860687-3 Oct 27 20:01:04.034944 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-9311433e-34d8-414a-97cd-54c6918e9337 req-e733045e-fad7-41aa-9155-279646b6f163 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032665 Oct 27 20:01:04.035506 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3843/7839] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:01:04.539890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae43f174-f19d-4ed0-a39f-d22ebe37a269 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:04.540455 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ae43f174-f19d-4ed0-a39f-d22ebe37a269 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 33a1f9db-2c32-4848-b137-1ee8f7057a80] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:04.548158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae43f174-f19d-4ed0-a39f-d22ebe37a269 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:04.548656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae43f174-f19d-4ed0-a39f-d22ebe37a269 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:04.549104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae43f174-f19d-4ed0-a39f-d22ebe37a269 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:04.549807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae43f174-f19d-4ed0-a39f-d22ebe37a269 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:04.550292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae43f174-f19d-4ed0-a39f-d22ebe37a269 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:04.550762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ae43f174-f19d-4ed0-a39f-d22ebe37a269 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:04.564544 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-ae43f174-f19d-4ed0-a39f-d22ebe37a269 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] HTTP exception thrown: Instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 could not be found. Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae43f174-f19d-4ed0-a39f-d22ebe37a269 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Request method failure captured: Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 HTTP/1.1 Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWuIhEo6bnXfnQbfze91TPiUq6e3C1UZIBGyGMNtUG7b7n7o47fTBtvG8uPaXe0795-tcRstRRvH7IjrJC0MLr_IL4s3LOxJnrGzq5tR_pq301tmK6VALgPLCzdZofwVV_RAvm6GRoRRWpIM7qR4MATGRqCzTZPHBTLjyiG12WkI1voI Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 6f32defe34974d2e800bf51c55662659 Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6f32defe34974d2e800bf51c55662659"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6f32defe34974d2e800bf51c55662659"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6f32defe34974d2e800bf51c55662659", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6f32defe34974d2e800bf51c55662659"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 6f32defe34974d2e800bf51c55662659 Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestNetworkAdvancedServerOps-656006975-project Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 68cb39c4d811401f83ef30c675914669 Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestNetworkAdvancedServerOps-656006975-project Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 could not be found. Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '33a1f9db-2c32-4848-b137-1ee8f7057a80'} Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 could not be found. Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 could not be found. Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:01:04.566212 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 20:01:04.571903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:01:04.571903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:01:04.571903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 20:01:04.571903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 20:01:04.571903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 20:01:04.571903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 20:01:04.571903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 could not be found. Oct 27 20:01:04.571903 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:01:04.571903 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ae43f174-f19d-4ed0-a39f-d22ebe37a269 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Returning 404 to user: Instance 33a1f9db-2c32-4848-b137-1ee8f7057a80 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 20:01:04.571903 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ae43f174-f19d-4ed0-a39f-d22ebe37a269 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80" status: 404 len: 111 microversion: 2.1 time: 0.031830 Oct 27 20:01:04.571903 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3997/7840] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:01:04 2022] GET /compute/v2.1/servers/33a1f9db-2c32-4848-b137-1ee8f7057a80 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 20:01:07.646710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f97e094e-66e5-4e80-b4dc-833b5ba9c056 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '.version_select at 0x7fc869d4a0d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:07.669234 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f97e094e-66e5-4e80-b4dc-833b5ba9c056 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-808037286" status: 202 len: 0 microversion: 2.1 time: 0.026459 Oct 27 20:01:07.670131 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3844/7841] 10.222.0.42 () {58 vars in 1281 bytes} [Thu Oct 27 20:01:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-808037286 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 20:01:07.698668 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5dac7278-5674-4bc0-811d-3d6f3d13a5da tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'create', calling method: .version_select at 0x7fc869e2ef70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-230471103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0mqVCSjLwDu1APzZfBQC6JTgFqdlVBJkyEorH1BWXo94bbYmBA193ULdYJeUDFlligTQkxG31RmNOtnjeUXnvWS6glLwUxd6h9QjlKhpcDzem+TUwqTpivHMY1KP7VFg=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:01:07.716651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-5dac7278-5674-4bc0-811d-3d6f3d13a5da tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for project 6f32defe34974d2e800bf51c55662659. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 20:01:07.721930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-5dac7278-5674-4bc0-811d-3d6f3d13a5da tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for user 68cb39c4d811401f83ef30c675914669 and project 6f32defe34974d2e800bf51c55662659. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 20:01:07.750036 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5dac7278-5674-4bc0-811d-3d6f3d13a5da tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055455 Oct 27 20:01:07.750694 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3998/7842] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 20:01:07 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:01:13.206177 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2097456386", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "4727b5af-854c-4ab7-a5e5-c8cd262f3dfe"}], "key_name": "tempest-TestNetworkAdvancedServerOps-230471103", "security_groups": [{"name": "tempest-secgroup-smoke-836262341"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:01:13.330423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] validate_networks() for [('4727b5af-854c-4ab7-a5e5-c8cd262f3dfe', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 20:01:13.836810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 20:01:13.837777 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 20:01:13.838344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 20:01:13.838817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 20:01:13.839284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 20:01:13.852061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:13.852534 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:13.854142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:13.854963 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:13.855681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:13.856370 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:13.878477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for project 6f32defe34974d2e800bf51c55662659. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 20:01:13.886232 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for user 68cb39c4d811401f83ef30c675914669 and project 6f32defe34974d2e800bf51c55662659. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 20:01:13.906694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 20:01:13.910112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 20:01:13.982319 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-81109b5f-52fc-4af2-a2f0-162428cb5f84 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.781171 Oct 27 20:01:13.983828 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3845/7843] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 20:01:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 20:01:13.997102 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d932e38f-e979-4b65-a246-a82fa04909c0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:13.997740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d932e38f-e979-4b65-a246-a82fa04909c0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:14.114811 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d932e38f-e979-4b65-a246-a82fa04909c0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:01:14.125216 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d932e38f-e979-4b65-a246-a82fa04909c0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1266 microversion: 2.1 time: 0.132408 Oct 27 20:01:14.128236 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 3999/7844] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:01:13 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:01:15.152231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-63ffd2ad-69a4-4865-9371-56026ee9e609 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:15.152880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-63ffd2ad-69a4-4865-9371-56026ee9e609 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:15.160032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63ffd2ad-69a4-4865-9371-56026ee9e609 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:15.160550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63ffd2ad-69a4-4865-9371-56026ee9e609 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:15.161018 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63ffd2ad-69a4-4865-9371-56026ee9e609 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:15.161787 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63ffd2ad-69a4-4865-9371-56026ee9e609 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:15.162729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63ffd2ad-69a4-4865-9371-56026ee9e609 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:15.162953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-63ffd2ad-69a4-4865-9371-56026ee9e609 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:15.249632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-63ffd2ad-69a4-4865-9371-56026ee9e609 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:01:15.270448 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-63ffd2ad-69a4-4865-9371-56026ee9e609 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1318 microversion: 2.1 time: 0.123289 Oct 27 20:01:15.271421 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3846/7845] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:01:15 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1318 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:01:16.296502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8fb3e844-cf41-4d98-a9c8-99ad372cef49 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:16.297453 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8fb3e844-cf41-4d98-a9c8-99ad372cef49 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:16.299671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:01:16.311727 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fb3e844-cf41-4d98-a9c8-99ad372cef49 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:16.312236 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fb3e844-cf41-4d98-a9c8-99ad372cef49 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:16.312850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fb3e844-cf41-4d98-a9c8-99ad372cef49 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:16.313629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fb3e844-cf41-4d98-a9c8-99ad372cef49 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:16.318428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fb3e844-cf41-4d98-a9c8-99ad372cef49 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:16.318954 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8fb3e844-cf41-4d98-a9c8-99ad372cef49 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:16.480093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8fb3e844-cf41-4d98-a9c8-99ad372cef49 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:01:16.488753 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8fb3e844-cf41-4d98-a9c8-99ad372cef49 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1391 microversion: 2.1 time: 0.196600 Oct 27 20:01:16.502576 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4000/7846] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:01:16 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1391 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 20:01:16.929951 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-4856be0c-30cf-4fe4-a247-56d3c9755682 req-802ccdaa-6da5-4565-a943-cf9f1bfbd748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00e826a3-306f-470f-9b64-7b5c3e36f1f7", "tag": "5d48517b-f74a-43a2-83d0-5a49f93749ed"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:01:16.941379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4856be0c-30cf-4fe4-a247-56d3c9755682 req-802ccdaa-6da5-4565-a943-cf9f1bfbd748 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:16.941891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4856be0c-30cf-4fe4-a247-56d3c9755682 req-802ccdaa-6da5-4565-a943-cf9f1bfbd748 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:16.942355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4856be0c-30cf-4fe4-a247-56d3c9755682 req-802ccdaa-6da5-4565-a943-cf9f1bfbd748 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:16.956689 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-4856be0c-30cf-4fe4-a247-56d3c9755682 req-802ccdaa-6da5-4565-a943-cf9f1bfbd748 service nova] Creating event network-changed:5d48517b-f74a-43a2-83d0-5a49f93749ed for instance 00e826a3-306f-470f-9b64-7b5c3e36f1f7 on n-h1-860687-3 Oct 27 20:01:16.962991 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-4856be0c-30cf-4fe4-a247-56d3c9755682 req-802ccdaa-6da5-4565-a943-cf9f1bfbd748 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036912 Oct 27 20:01:16.963716 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3847/7847] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:01:17.514086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b502999f-e7ca-456a-83e3-1b7be9992ee7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:17.514641 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b502999f-e7ca-456a-83e3-1b7be9992ee7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:17.521513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b502999f-e7ca-456a-83e3-1b7be9992ee7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:17.521999 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b502999f-e7ca-456a-83e3-1b7be9992ee7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:17.522461 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b502999f-e7ca-456a-83e3-1b7be9992ee7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:17.523153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b502999f-e7ca-456a-83e3-1b7be9992ee7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:17.523608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b502999f-e7ca-456a-83e3-1b7be9992ee7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:17.524041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b502999f-e7ca-456a-83e3-1b7be9992ee7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:17.657759 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b502999f-e7ca-456a-83e3-1b7be9992ee7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:01:17.666223 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b502999f-e7ca-456a-83e3-1b7be9992ee7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1391 microversion: 2.1 time: 0.156093 Oct 27 20:01:17.666854 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4001/7848] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:01:17 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:01:18.690659 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71583364-73f0-48f9-b6f8-dc4a2d29d3f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:18.691381 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-71583364-73f0-48f9-b6f8-dc4a2d29d3f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:18.698093 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71583364-73f0-48f9-b6f8-dc4a2d29d3f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:18.698636 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71583364-73f0-48f9-b6f8-dc4a2d29d3f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:18.699084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71583364-73f0-48f9-b6f8-dc4a2d29d3f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:18.699825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71583364-73f0-48f9-b6f8-dc4a2d29d3f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:18.700530 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71583364-73f0-48f9-b6f8-dc4a2d29d3f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:18.700977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-71583364-73f0-48f9-b6f8-dc4a2d29d3f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:18.910271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-71583364-73f0-48f9-b6f8-dc4a2d29d3f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:01:18.919671 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-71583364-73f0-48f9-b6f8-dc4a2d29d3f5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1391 microversion: 2.1 time: 0.234204 Oct 27 20:01:18.920317 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3848/7849] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:01:18 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1391 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:01:19.945532 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2fda93c8-77b5-45c8-a57f-e8ea2ade8f60 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:19.946162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2fda93c8-77b5-45c8-a57f-e8ea2ade8f60 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:19.954494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fda93c8-77b5-45c8-a57f-e8ea2ade8f60 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:19.954985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fda93c8-77b5-45c8-a57f-e8ea2ade8f60 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:19.955440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fda93c8-77b5-45c8-a57f-e8ea2ade8f60 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:19.956151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fda93c8-77b5-45c8-a57f-e8ea2ade8f60 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:19.956661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fda93c8-77b5-45c8-a57f-e8ea2ade8f60 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:19.957150 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2fda93c8-77b5-45c8-a57f-e8ea2ade8f60 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:20.088448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2fda93c8-77b5-45c8-a57f-e8ea2ade8f60 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:01:20.096135 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2fda93c8-77b5-45c8-a57f-e8ea2ade8f60 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1391 microversion: 2.1 time: 0.156729 Oct 27 20:01:20.096706 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4002/7850] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:01:19 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:01:20.974684 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f32c430a-be46-4b4e-9cf8-ade6e1fa1435 req-48c1c5c4-25b6-45f7-97d6-4f69ae2dfe4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e826a3-306f-470f-9b64-7b5c3e36f1f7", "name": "network-vif-plugged", "status": "completed", "tag": "5d48517b-f74a-43a2-83d0-5a49f93749ed"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:01:20.988424 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f32c430a-be46-4b4e-9cf8-ade6e1fa1435 req-48c1c5c4-25b6-45f7-97d6-4f69ae2dfe4c service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:20.989021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f32c430a-be46-4b4e-9cf8-ade6e1fa1435 req-48c1c5c4-25b6-45f7-97d6-4f69ae2dfe4c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:20.989481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f32c430a-be46-4b4e-9cf8-ade6e1fa1435 req-48c1c5c4-25b6-45f7-97d6-4f69ae2dfe4c service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:21.001720 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f32c430a-be46-4b4e-9cf8-ade6e1fa1435 req-48c1c5c4-25b6-45f7-97d6-4f69ae2dfe4c service nova] Creating event network-vif-plugged:5d48517b-f74a-43a2-83d0-5a49f93749ed for instance 00e826a3-306f-470f-9b64-7b5c3e36f1f7 on n-h1-860687-3 Oct 27 20:01:21.006809 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f32c430a-be46-4b4e-9cf8-ade6e1fa1435 req-48c1c5c4-25b6-45f7-97d6-4f69ae2dfe4c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035953 Oct 27 20:01:21.007412 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3849/7851] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:01:21.119836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-da59c2b5-6c21-46a6-9282-dbcda328bee3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:21.120458 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-da59c2b5-6c21-46a6-9282-dbcda328bee3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:21.127566 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da59c2b5-6c21-46a6-9282-dbcda328bee3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:21.128065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da59c2b5-6c21-46a6-9282-dbcda328bee3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:21.128530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da59c2b5-6c21-46a6-9282-dbcda328bee3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:21.129222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da59c2b5-6c21-46a6-9282-dbcda328bee3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:21.129686 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da59c2b5-6c21-46a6-9282-dbcda328bee3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:21.130127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-da59c2b5-6c21-46a6-9282-dbcda328bee3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:21.268578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-da59c2b5-6c21-46a6-9282-dbcda328bee3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:01:21.276429 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-da59c2b5-6c21-46a6-9282-dbcda328bee3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1391 microversion: 2.1 time: 0.160502 Oct 27 20:01:21.277000 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4003/7852] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:01:21 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:01:22.301550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e022ebc-d679-4eb3-bc71-de2a1f08c8f8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:22.302178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e022ebc-d679-4eb3-bc71-de2a1f08c8f8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:22.309616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e022ebc-d679-4eb3-bc71-de2a1f08c8f8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:22.310139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e022ebc-d679-4eb3-bc71-de2a1f08c8f8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:22.310635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e022ebc-d679-4eb3-bc71-de2a1f08c8f8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:22.311354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e022ebc-d679-4eb3-bc71-de2a1f08c8f8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:22.311832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e022ebc-d679-4eb3-bc71-de2a1f08c8f8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:22.312282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e022ebc-d679-4eb3-bc71-de2a1f08c8f8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:22.448341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e022ebc-d679-4eb3-bc71-de2a1f08c8f8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:01:22.456245 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e022ebc-d679-4eb3-bc71-de2a1f08c8f8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1391 microversion: 2.1 time: 0.159848 Oct 27 20:01:22.456811 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3850/7853] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:01:22 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:01:23.479593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-94549431-373d-44d8-b5a5-99746d59bdbc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:23.480145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-94549431-373d-44d8-b5a5-99746d59bdbc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:23.487097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-94549431-373d-44d8-b5a5-99746d59bdbc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:23.487598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-94549431-373d-44d8-b5a5-99746d59bdbc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:23.488047 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-94549431-373d-44d8-b5a5-99746d59bdbc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:23.488760 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-94549431-373d-44d8-b5a5-99746d59bdbc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:23.489223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-94549431-373d-44d8-b5a5-99746d59bdbc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:23.489664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-94549431-373d-44d8-b5a5-99746d59bdbc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:23.622733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-94549431-373d-44d8-b5a5-99746d59bdbc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:01:23.630936 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-94549431-373d-44d8-b5a5-99746d59bdbc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1563 microversion: 2.1 time: 0.155400 Oct 27 20:01:23.631543 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4004/7854] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:01:23 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:01:23.654739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9c9ed2e1-f605-4b16-83d4-095ef6f73ce2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:23.655382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9c9ed2e1-f605-4b16-83d4-095ef6f73ce2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:23.662322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c9ed2e1-f605-4b16-83d4-095ef6f73ce2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:23.662868 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c9ed2e1-f605-4b16-83d4-095ef6f73ce2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:23.663339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c9ed2e1-f605-4b16-83d4-095ef6f73ce2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:23.664185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c9ed2e1-f605-4b16-83d4-095ef6f73ce2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:23.664672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c9ed2e1-f605-4b16-83d4-095ef6f73ce2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:23.665184 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9c9ed2e1-f605-4b16-83d4-095ef6f73ce2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:23.802235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9c9ed2e1-f605-4b16-83d4-095ef6f73ce2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:01:23.810571 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9c9ed2e1-f605-4b16-83d4-095ef6f73ce2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1563 microversion: 2.1 time: 0.159810 Oct 27 20:01:23.811156 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3851/7855] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:01:23 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:01:25.674618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-feede515-b7e4-4f04-8c17-bf528d146641 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:01:25.675237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-feede515-b7e4-4f04-8c17-bf528d146641 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:25.676559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-9ccded30-9958-433c-8d04-51ff46c11074 req-c3200ab1-8880-452a-89ec-8364714c36d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00e826a3-306f-470f-9b64-7b5c3e36f1f7", "tag": "5d48517b-f74a-43a2-83d0-5a49f93749ed"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:01:25.677131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:01:25.682637 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:01:25.683584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:01:25.688573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-feede515-b7e4-4f04-8c17-bf528d146641 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:25.689221 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-feede515-b7e4-4f04-8c17-bf528d146641 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:25.689672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-feede515-b7e4-4f04-8c17-bf528d146641 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:25.690692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-feede515-b7e4-4f04-8c17-bf528d146641 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:25.690899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-feede515-b7e4-4f04-8c17-bf528d146641 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:25.691313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-feede515-b7e4-4f04-8c17-bf528d146641 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:25.692977 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9ccded30-9958-433c-8d04-51ff46c11074 req-c3200ab1-8880-452a-89ec-8364714c36d6 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:25.693703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9ccded30-9958-433c-8d04-51ff46c11074 req-c3200ab1-8880-452a-89ec-8364714c36d6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:25.694174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9ccded30-9958-433c-8d04-51ff46c11074 req-c3200ab1-8880-452a-89ec-8364714c36d6 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:25.706184 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-9ccded30-9958-433c-8d04-51ff46c11074 req-c3200ab1-8880-452a-89ec-8364714c36d6 service nova] Creating event network-changed:5d48517b-f74a-43a2-83d0-5a49f93749ed for instance 00e826a3-306f-470f-9b64-7b5c3e36f1f7 on n-h1-860687-3 Oct 27 20:01:25.718037 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-9ccded30-9958-433c-8d04-51ff46c11074 req-c3200ab1-8880-452a-89ec-8364714c36d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045028 Oct 27 20:01:25.719049 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3852/7856] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 20:01:25.843016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-feede515-b7e4-4f04-8c17-bf528d146641 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:01:25.853667 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-feede515-b7e4-4f04-8c17-bf528d146641 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1563 microversion: 2.1 time: 0.183046 Oct 27 20:01:25.854400 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4005/7857] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:01:25 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:01:49.111249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:01:49.112116 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=42 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:01:49.116518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bb2d1043-8c0a-4c77-b26d-679ff83510b2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:01:49.119037 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bb2d1043-8c0a-4c77-b26d-679ff83510b2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:01:49.127334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb2d1043-8c0a-4c77-b26d-679ff83510b2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:49.127846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb2d1043-8c0a-4c77-b26d-679ff83510b2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:49.128311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb2d1043-8c0a-4c77-b26d-679ff83510b2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:49.129032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb2d1043-8c0a-4c77-b26d-679ff83510b2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:01:49.129512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb2d1043-8c0a-4c77-b26d-679ff83510b2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:01:49.129967 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb2d1043-8c0a-4c77-b26d-679ff83510b2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:01:49.185665 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bb2d1043-8c0a-4c77-b26d-679ff83510b2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7/action" status: 200 len: 24568 microversion: 2.1 time: 0.077037 Oct 27 20:01:49.186315 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3853/7858] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:01:49 2022] POST /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7/action => generated 24568 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 20:02:00.241449 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b5f0b78b-e0a0-49a0-b9f2-873ceb34f01d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:02:00.244264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:02:00.244931 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=36 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:02:00.250895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5f0b78b-e0a0-49a0-b9f2-873ceb34f01d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:00.251390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5f0b78b-e0a0-49a0-b9f2-873ceb34f01d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:00.251838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b5f0b78b-e0a0-49a0-b9f2-873ceb34f01d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:00.277341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b5f0b78b-e0a0-49a0-b9f2-873ceb34f01d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Going to try to stop instance {{(pid=127029) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 20:02:00.320883 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b5f0b78b-e0a0-49a0-b9f2-873ceb34f01d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7/action" status: 202 len: 0 microversion: 2.1 time: 0.083376 Oct 27 20:02:00.321487 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4006/7859] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:02:00 2022] POST /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 20:02:00.330694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d43ea1d3-977b-4fb8-bec2-498dfd5743fe tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:00.331433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d43ea1d3-977b-4fb8-bec2-498dfd5743fe tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:00.334371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:02:00.335208 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:02:00.343198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d43ea1d3-977b-4fb8-bec2-498dfd5743fe tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:00.343710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d43ea1d3-977b-4fb8-bec2-498dfd5743fe tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:00.344185 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d43ea1d3-977b-4fb8-bec2-498dfd5743fe tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:00.344959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d43ea1d3-977b-4fb8-bec2-498dfd5743fe tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:00.345406 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d43ea1d3-977b-4fb8-bec2-498dfd5743fe tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:00.345856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d43ea1d3-977b-4fb8-bec2-498dfd5743fe tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:00.487810 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d43ea1d3-977b-4fb8-bec2-498dfd5743fe tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:00.495791 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d43ea1d3-977b-4fb8-bec2-498dfd5743fe tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1692 microversion: 2.1 time: 0.169445 Oct 27 20:02:00.496304 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3854/7860] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:00 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 20:02:01.520696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4692db05-9a6d-4812-bd15-8f33e17b1d37 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:01.521395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4692db05-9a6d-4812-bd15-8f33e17b1d37 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:01.528610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4692db05-9a6d-4812-bd15-8f33e17b1d37 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:01.529092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4692db05-9a6d-4812-bd15-8f33e17b1d37 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:01.529530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4692db05-9a6d-4812-bd15-8f33e17b1d37 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:01.530228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4692db05-9a6d-4812-bd15-8f33e17b1d37 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:01.530716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4692db05-9a6d-4812-bd15-8f33e17b1d37 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:01.531147 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4692db05-9a6d-4812-bd15-8f33e17b1d37 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:01.668091 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4692db05-9a6d-4812-bd15-8f33e17b1d37 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:01.675792 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4692db05-9a6d-4812-bd15-8f33e17b1d37 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1692 microversion: 2.1 time: 0.159558 Oct 27 20:02:01.676351 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4007/7861] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:01 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:02.699721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-744dae18-9be3-4a1a-b052-cde6534d9e27 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:02.700647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-744dae18-9be3-4a1a-b052-cde6534d9e27 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:02.707475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-744dae18-9be3-4a1a-b052-cde6534d9e27 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:02.707986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-744dae18-9be3-4a1a-b052-cde6534d9e27 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:02.708431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-744dae18-9be3-4a1a-b052-cde6534d9e27 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:02.709140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-744dae18-9be3-4a1a-b052-cde6534d9e27 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:02.709609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-744dae18-9be3-4a1a-b052-cde6534d9e27 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:02.710056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-744dae18-9be3-4a1a-b052-cde6534d9e27 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:02.842160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-744dae18-9be3-4a1a-b052-cde6534d9e27 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:02.849858 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-744dae18-9be3-4a1a-b052-cde6534d9e27 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1692 microversion: 2.1 time: 0.154503 Oct 27 20:02:02.850453 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3855/7862] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:02 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:03.874418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2de92583-4283-4f13-814b-098bf844e7c9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:03.875042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2de92583-4283-4f13-814b-098bf844e7c9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:03.881826 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2de92583-4283-4f13-814b-098bf844e7c9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:03.882316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2de92583-4283-4f13-814b-098bf844e7c9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:03.883328 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2de92583-4283-4f13-814b-098bf844e7c9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:03.884036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2de92583-4283-4f13-814b-098bf844e7c9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:03.884502 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2de92583-4283-4f13-814b-098bf844e7c9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:03.884937 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2de92583-4283-4f13-814b-098bf844e7c9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:04.015654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2de92583-4283-4f13-814b-098bf844e7c9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:04.024683 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2de92583-4283-4f13-814b-098bf844e7c9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1692 microversion: 2.1 time: 0.153141 Oct 27 20:02:04.025259 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4008/7863] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:03 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:05.048468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0086690a-9fda-4bf5-99be-9b941d08deb8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:05.049098 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0086690a-9fda-4bf5-99be-9b941d08deb8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:05.056367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0086690a-9fda-4bf5-99be-9b941d08deb8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:05.056871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0086690a-9fda-4bf5-99be-9b941d08deb8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:05.057331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0086690a-9fda-4bf5-99be-9b941d08deb8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:05.058040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0086690a-9fda-4bf5-99be-9b941d08deb8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:05.058550 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0086690a-9fda-4bf5-99be-9b941d08deb8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:05.058999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0086690a-9fda-4bf5-99be-9b941d08deb8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:05.191773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-0086690a-9fda-4bf5-99be-9b941d08deb8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:05.200775 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0086690a-9fda-4bf5-99be-9b941d08deb8 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1692 microversion: 2.1 time: 0.156030 Oct 27 20:02:05.201352 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3856/7864] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:05 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:06.224989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-74256cb4-c2f3-4f8e-9c42-99f4df18f76f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:06.225589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-74256cb4-c2f3-4f8e-9c42-99f4df18f76f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:06.233202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74256cb4-c2f3-4f8e-9c42-99f4df18f76f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:06.233695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74256cb4-c2f3-4f8e-9c42-99f4df18f76f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:06.234141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74256cb4-c2f3-4f8e-9c42-99f4df18f76f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:06.234869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74256cb4-c2f3-4f8e-9c42-99f4df18f76f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:06.235334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74256cb4-c2f3-4f8e-9c42-99f4df18f76f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:06.235767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-74256cb4-c2f3-4f8e-9c42-99f4df18f76f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:06.367223 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-74256cb4-c2f3-4f8e-9c42-99f4df18f76f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:06.375086 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-74256cb4-c2f3-4f8e-9c42-99f4df18f76f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1692 microversion: 2.1 time: 0.154010 Oct 27 20:02:06.375659 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4009/7865] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:06 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:07.399838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-518ee784-c443-4150-bb6e-27b1ccbb199e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:07.400482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-518ee784-c443-4150-bb6e-27b1ccbb199e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:07.407386 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-518ee784-c443-4150-bb6e-27b1ccbb199e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:07.407896 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-518ee784-c443-4150-bb6e-27b1ccbb199e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:07.408389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-518ee784-c443-4150-bb6e-27b1ccbb199e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:07.409111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-518ee784-c443-4150-bb6e-27b1ccbb199e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:07.409594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-518ee784-c443-4150-bb6e-27b1ccbb199e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:07.410048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-518ee784-c443-4150-bb6e-27b1ccbb199e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:07.542301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-518ee784-c443-4150-bb6e-27b1ccbb199e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:07.550093 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-518ee784-c443-4150-bb6e-27b1ccbb199e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1692 microversion: 2.1 time: 0.154387 Oct 27 20:02:07.550705 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3857/7866] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:07 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:08.575661 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14e2b376-9355-4c4c-b959-1e958b55cd2c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:08.576318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-14e2b376-9355-4c4c-b959-1e958b55cd2c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:08.583278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14e2b376-9355-4c4c-b959-1e958b55cd2c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:08.584172 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14e2b376-9355-4c4c-b959-1e958b55cd2c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:08.584310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14e2b376-9355-4c4c-b959-1e958b55cd2c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:08.584904 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14e2b376-9355-4c4c-b959-1e958b55cd2c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:08.585370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14e2b376-9355-4c4c-b959-1e958b55cd2c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:08.585805 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14e2b376-9355-4c4c-b959-1e958b55cd2c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:08.719481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-14e2b376-9355-4c4c-b959-1e958b55cd2c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:08.727749 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-14e2b376-9355-4c4c-b959-1e958b55cd2c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1692 microversion: 2.1 time: 0.156261 Oct 27 20:02:08.728331 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4010/7867] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:08 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:09.752301 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-73d64a00-a27e-431d-83bd-e54bb668588b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:09.752897 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-73d64a00-a27e-431d-83bd-e54bb668588b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:09.760171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73d64a00-a27e-431d-83bd-e54bb668588b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:09.760683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73d64a00-a27e-431d-83bd-e54bb668588b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:09.761150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73d64a00-a27e-431d-83bd-e54bb668588b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:09.762125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73d64a00-a27e-431d-83bd-e54bb668588b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:09.762767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73d64a00-a27e-431d-83bd-e54bb668588b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:09.763251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73d64a00-a27e-431d-83bd-e54bb668588b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:09.896883 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-73d64a00-a27e-431d-83bd-e54bb668588b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:09.904814 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-73d64a00-a27e-431d-83bd-e54bb668588b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1692 microversion: 2.1 time: 0.156542 Oct 27 20:02:09.905382 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3858/7868] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:09 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:10.928983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c47cf0a8-4aac-473a-9621-b67f2a043a70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:10.930108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c47cf0a8-4aac-473a-9621-b67f2a043a70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:10.937197 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47cf0a8-4aac-473a-9621-b67f2a043a70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:10.937692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47cf0a8-4aac-473a-9621-b67f2a043a70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:10.938138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47cf0a8-4aac-473a-9621-b67f2a043a70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:10.938877 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47cf0a8-4aac-473a-9621-b67f2a043a70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:10.939346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47cf0a8-4aac-473a-9621-b67f2a043a70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:10.939784 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c47cf0a8-4aac-473a-9621-b67f2a043a70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:11.073029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c47cf0a8-4aac-473a-9621-b67f2a043a70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:11.081141 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c47cf0a8-4aac-473a-9621-b67f2a043a70 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1692 microversion: 2.1 time: 0.156137 Oct 27 20:02:11.081712 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4011/7869] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:10 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:12.105674 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-79ce1b55-03ce-4153-8202-71f2fa674ba3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:12.106328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-79ce1b55-03ce-4153-8202-71f2fa674ba3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:12.113266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79ce1b55-03ce-4153-8202-71f2fa674ba3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:12.113767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79ce1b55-03ce-4153-8202-71f2fa674ba3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:12.114225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79ce1b55-03ce-4153-8202-71f2fa674ba3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:12.114965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79ce1b55-03ce-4153-8202-71f2fa674ba3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:12.115443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79ce1b55-03ce-4153-8202-71f2fa674ba3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:12.115888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79ce1b55-03ce-4153-8202-71f2fa674ba3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:12.251608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-79ce1b55-03ce-4153-8202-71f2fa674ba3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:12.259810 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-79ce1b55-03ce-4153-8202-71f2fa674ba3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1692 microversion: 2.1 time: 0.158722 Oct 27 20:02:12.260397 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3859/7870] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:12 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 20:02:13.283576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-465ca3fa-01d0-4fa7-a84b-618d72daeecd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:13.284204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-465ca3fa-01d0-4fa7-a84b-618d72daeecd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:13.291100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-465ca3fa-01d0-4fa7-a84b-618d72daeecd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:13.291591 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-465ca3fa-01d0-4fa7-a84b-618d72daeecd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:13.292038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-465ca3fa-01d0-4fa7-a84b-618d72daeecd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:13.292739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-465ca3fa-01d0-4fa7-a84b-618d72daeecd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:13.293200 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-465ca3fa-01d0-4fa7-a84b-618d72daeecd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:13.293634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-465ca3fa-01d0-4fa7-a84b-618d72daeecd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:13.431916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-465ca3fa-01d0-4fa7-a84b-618d72daeecd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:13.439739 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-465ca3fa-01d0-4fa7-a84b-618d72daeecd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1692 microversion: 2.1 time: 0.160140 Oct 27 20:02:13.440319 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4012/7871] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:13 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 20:02:14.463509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bbeb0916-ac9f-4d61-a560-80ead510a842 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:14.464143 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bbeb0916-ac9f-4d61-a560-80ead510a842 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:14.471062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbeb0916-ac9f-4d61-a560-80ead510a842 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:14.471569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbeb0916-ac9f-4d61-a560-80ead510a842 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:14.472034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbeb0916-ac9f-4d61-a560-80ead510a842 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:14.472753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbeb0916-ac9f-4d61-a560-80ead510a842 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:14.473229 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbeb0916-ac9f-4d61-a560-80ead510a842 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:14.473681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bbeb0916-ac9f-4d61-a560-80ead510a842 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:14.609852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bbeb0916-ac9f-4d61-a560-80ead510a842 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:14.618132 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bbeb0916-ac9f-4d61-a560-80ead510a842 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1692 microversion: 2.1 time: 0.159158 Oct 27 20:02:14.618749 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3860/7872] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:14 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:15.642306 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dc416f21-377e-4ff3-93f4-bfe3f9c2c281 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:15.643055 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dc416f21-377e-4ff3-93f4-bfe3f9c2c281 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:15.650468 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc416f21-377e-4ff3-93f4-bfe3f9c2c281 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:15.650961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc416f21-377e-4ff3-93f4-bfe3f9c2c281 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:15.651403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc416f21-377e-4ff3-93f4-bfe3f9c2c281 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:15.652099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc416f21-377e-4ff3-93f4-bfe3f9c2c281 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:15.652585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc416f21-377e-4ff3-93f4-bfe3f9c2c281 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:15.653024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dc416f21-377e-4ff3-93f4-bfe3f9c2c281 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:15.793285 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dc416f21-377e-4ff3-93f4-bfe3f9c2c281 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:15.801276 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dc416f21-377e-4ff3-93f4-bfe3f9c2c281 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1692 microversion: 2.1 time: 0.162879 Oct 27 20:02:15.801850 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4013/7873] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:15 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:16.826356 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9efeed4f-122c-4bef-86b2-305ca56a4b09 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:16.826959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9efeed4f-122c-4bef-86b2-305ca56a4b09 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:16.833426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9efeed4f-122c-4bef-86b2-305ca56a4b09 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:16.833928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9efeed4f-122c-4bef-86b2-305ca56a4b09 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:16.834400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9efeed4f-122c-4bef-86b2-305ca56a4b09 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:16.835114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9efeed4f-122c-4bef-86b2-305ca56a4b09 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:16.836008 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9efeed4f-122c-4bef-86b2-305ca56a4b09 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:16.836469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9efeed4f-122c-4bef-86b2-305ca56a4b09 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:16.970426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9efeed4f-122c-4bef-86b2-305ca56a4b09 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:16.978952 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9efeed4f-122c-4bef-86b2-305ca56a4b09 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1669 microversion: 2.1 time: 0.157029 Oct 27 20:02:16.979534 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3861/7874] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:16 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:18.073495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0e36fc3c-c416-495b-9a6b-6f6b156f6b4e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:02:18.076094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0e36fc3c-c416-495b-9a6b-6f6b156f6b4e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:18.082995 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e36fc3c-c416-495b-9a6b-6f6b156f6b4e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:18.083491 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e36fc3c-c416-495b-9a6b-6f6b156f6b4e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:18.083943 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e36fc3c-c416-495b-9a6b-6f6b156f6b4e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:18.084647 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e36fc3c-c416-495b-9a6b-6f6b156f6b4e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:18.085116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e36fc3c-c416-495b-9a6b-6f6b156f6b4e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:18.085590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e36fc3c-c416-495b-9a6b-6f6b156f6b4e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:18.147167 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0e36fc3c-c416-495b-9a6b-6f6b156f6b4e tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7/action" status: 200 len: 38377 microversion: 2.1 time: 0.077601 Oct 27 20:02:18.147834 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4014/7875] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:02:18 2022] POST /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7/action => generated 38377 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 20:02:18.159791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c00747ca-3e71-4e8c-b025-49c9d1834059 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:02:18.167352 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c00747ca-3e71-4e8c-b025-49c9d1834059 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:18.167852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c00747ca-3e71-4e8c-b025-49c9d1834059 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:18.168308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c00747ca-3e71-4e8c-b025-49c9d1834059 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:18.191823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c00747ca-3e71-4e8c-b025-49c9d1834059 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Going to try to start instance {{(pid=127028) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 20:02:18.235725 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c00747ca-3e71-4e8c-b025-49c9d1834059 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7/action" status: 202 len: 0 microversion: 2.1 time: 0.079728 Oct 27 20:02:18.236329 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3862/7876] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:02:18 2022] POST /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 20:02:18.245864 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b57b2cc-9a2e-4c92-a7db-87b4f8dc157c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:18.246617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b57b2cc-9a2e-4c92-a7db-87b4f8dc157c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:18.253542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57b2cc-9a2e-4c92-a7db-87b4f8dc157c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:18.254073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57b2cc-9a2e-4c92-a7db-87b4f8dc157c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:18.254524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57b2cc-9a2e-4c92-a7db-87b4f8dc157c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:18.255324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57b2cc-9a2e-4c92-a7db-87b4f8dc157c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:18.255930 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57b2cc-9a2e-4c92-a7db-87b4f8dc157c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:18.256499 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b57b2cc-9a2e-4c92-a7db-87b4f8dc157c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:18.398956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3b57b2cc-9a2e-4c92-a7db-87b4f8dc157c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:18.406923 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b57b2cc-9a2e-4c92-a7db-87b4f8dc157c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1678 microversion: 2.1 time: 0.165891 Oct 27 20:02:18.407503 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4015/7877] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:18 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:19.434894 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-69d5d736-0627-48bf-84ec-ae083101e86b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:19.435687 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-69d5d736-0627-48bf-84ec-ae083101e86b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:19.442691 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69d5d736-0627-48bf-84ec-ae083101e86b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:19.443195 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69d5d736-0627-48bf-84ec-ae083101e86b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:19.443651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69d5d736-0627-48bf-84ec-ae083101e86b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:19.444363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69d5d736-0627-48bf-84ec-ae083101e86b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:19.445760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69d5d736-0627-48bf-84ec-ae083101e86b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:19.446212 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-69d5d736-0627-48bf-84ec-ae083101e86b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:19.581066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-69d5d736-0627-48bf-84ec-ae083101e86b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:19.590037 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-69d5d736-0627-48bf-84ec-ae083101e86b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1682 microversion: 2.1 time: 0.160946 Oct 27 20:02:19.590648 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3863/7878] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:19 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:45.784765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-074d5252-0793-42e0-b9ec-2f29337951a1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:02:45.786980 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-074d5252-0793-42e0-b9ec-2f29337951a1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:45.793876 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=20 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:02:45.794576 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:02:45.795482 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 20:02:45.795647 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 20:02:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7/action (ip 10.222.0.42) !!! Oct 27 20:02:45.805899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-074d5252-0793-42e0-b9ec-2f29337951a1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:45.806402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-074d5252-0793-42e0-b9ec-2f29337951a1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:45.806854 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-074d5252-0793-42e0-b9ec-2f29337951a1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:45.807558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-074d5252-0793-42e0-b9ec-2f29337951a1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:45.808016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-074d5252-0793-42e0-b9ec-2f29337951a1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:45.808451 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-074d5252-0793-42e0-b9ec-2f29337951a1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:45.868630 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-074d5252-0793-42e0-b9ec-2f29337951a1 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7/action" status: 200 len: 62944 microversion: 2.1 time: 0.087613 Oct 27 20:02:45.869286 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4016/7879] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:02:45 2022] POST /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7/action => generated 62944 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 20:02:53.155541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4be021d0-ca36-4db8-8877-179c14d280e0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:53.156200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4be021d0-ca36-4db8-8877-179c14d280e0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:53.159101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=20 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:02:53.159251 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-c704128c-c021-4ff4-ba08-96d935c94c13 req-a7051749-158a-46e9-9080-f74f4cd907f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00e826a3-306f-470f-9b64-7b5c3e36f1f7", "tag": "5d48517b-f74a-43a2-83d0-5a49f93749ed"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:02:53.159803 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:02:53.167805 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4be021d0-ca36-4db8-8877-179c14d280e0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:53.168443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4be021d0-ca36-4db8-8877-179c14d280e0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:53.169146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4be021d0-ca36-4db8-8877-179c14d280e0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:53.169651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4be021d0-ca36-4db8-8877-179c14d280e0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:53.170147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4be021d0-ca36-4db8-8877-179c14d280e0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:53.170704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4be021d0-ca36-4db8-8877-179c14d280e0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:53.173400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c704128c-c021-4ff4-ba08-96d935c94c13 req-a7051749-158a-46e9-9080-f74f4cd907f3 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:53.173548 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c704128c-c021-4ff4-ba08-96d935c94c13 req-a7051749-158a-46e9-9080-f74f4cd907f3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:53.174059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-c704128c-c021-4ff4-ba08-96d935c94c13 req-a7051749-158a-46e9-9080-f74f4cd907f3 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:53.186966 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-c704128c-c021-4ff4-ba08-96d935c94c13 req-a7051749-158a-46e9-9080-f74f4cd907f3 service nova] Creating event network-changed:5d48517b-f74a-43a2-83d0-5a49f93749ed for instance 00e826a3-306f-470f-9b64-7b5c3e36f1f7 on n-h1-860687-3 Oct 27 20:02:53.192260 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-c704128c-c021-4ff4-ba08-96d935c94c13 req-a7051749-158a-46e9-9080-f74f4cd907f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037386 Oct 27 20:02:53.193303 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4017/7880] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:02:53.199382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4be021d0-ca36-4db8-8877-179c14d280e0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 20:02:53.296122 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4be021d0-ca36-4db8-8877-179c14d280e0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "DELETE /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 204 len: 0 microversion: 2.1 time: 0.144735 Oct 27 20:02:53.296748 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3864/7881] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 20:02:53 2022] DELETE /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 20:02:53.306194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-94cc4f92-85ba-4b09-aa46-7ee9463655cd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:53.307067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-94cc4f92-85ba-4b09-aa46-7ee9463655cd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:53.313594 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-94cc4f92-85ba-4b09-aa46-7ee9463655cd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:53.314148 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-94cc4f92-85ba-4b09-aa46-7ee9463655cd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:53.314722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-94cc4f92-85ba-4b09-aa46-7ee9463655cd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:53.315673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-94cc4f92-85ba-4b09-aa46-7ee9463655cd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:53.316212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-94cc4f92-85ba-4b09-aa46-7ee9463655cd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:53.316736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-94cc4f92-85ba-4b09-aa46-7ee9463655cd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:53.458283 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-94cc4f92-85ba-4b09-aa46-7ee9463655cd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:53.466708 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-94cc4f92-85ba-4b09-aa46-7ee9463655cd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1688 microversion: 2.1 time: 0.165319 Oct 27 20:02:53.467287 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4018/7882] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:53 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:54.493586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3df70209-d920-4222-9ab7-4e7518889d24 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:54.494311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3df70209-d920-4222-9ab7-4e7518889d24 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:54.501528 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3df70209-d920-4222-9ab7-4e7518889d24 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:54.502029 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3df70209-d920-4222-9ab7-4e7518889d24 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:54.502519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3df70209-d920-4222-9ab7-4e7518889d24 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:54.503238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3df70209-d920-4222-9ab7-4e7518889d24 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:54.503708 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3df70209-d920-4222-9ab7-4e7518889d24 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:54.504150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3df70209-d920-4222-9ab7-4e7518889d24 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:54.641491 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3df70209-d920-4222-9ab7-4e7518889d24 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:54.649697 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3df70209-d920-4222-9ab7-4e7518889d24 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1688 microversion: 2.1 time: 0.161670 Oct 27 20:02:54.650297 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3865/7883] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:54 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:55.424068 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-6244890c-e7d5-4fb0-978b-f1ceeb4d7682 req-95059ad5-bb36-43db-acf3-59697d1815d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e826a3-306f-470f-9b64-7b5c3e36f1f7", "name": "network-vif-deleted", "tag": "5d48517b-f74a-43a2-83d0-5a49f93749ed"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:02:55.436501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6244890c-e7d5-4fb0-978b-f1ceeb4d7682 req-95059ad5-bb36-43db-acf3-59697d1815d7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:55.436992 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6244890c-e7d5-4fb0-978b-f1ceeb4d7682 req-95059ad5-bb36-43db-acf3-59697d1815d7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:55.437426 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-6244890c-e7d5-4fb0-978b-f1ceeb4d7682 req-95059ad5-bb36-43db-acf3-59697d1815d7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:55.451441 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-6244890c-e7d5-4fb0-978b-f1ceeb4d7682 req-95059ad5-bb36-43db-acf3-59697d1815d7 service nova] Creating event network-vif-deleted:5d48517b-f74a-43a2-83d0-5a49f93749ed for instance 00e826a3-306f-470f-9b64-7b5c3e36f1f7 on n-h1-860687-3 Oct 27 20:02:55.456945 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-6244890c-e7d5-4fb0-978b-f1ceeb4d7682 req-95059ad5-bb36-43db-acf3-59697d1815d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036630 Oct 27 20:02:55.457537 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4019/7884] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:02:55.673057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-35293641-a4b1-440b-90c9-6a563103d2b7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:55.673695 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-35293641-a4b1-440b-90c9-6a563103d2b7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:55.680939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35293641-a4b1-440b-90c9-6a563103d2b7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:55.681377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35293641-a4b1-440b-90c9-6a563103d2b7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:55.681912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35293641-a4b1-440b-90c9-6a563103d2b7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:55.682582 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35293641-a4b1-440b-90c9-6a563103d2b7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:55.683061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35293641-a4b1-440b-90c9-6a563103d2b7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:55.683508 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35293641-a4b1-440b-90c9-6a563103d2b7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:55.721044 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35293641-a4b1-440b-90c9-6a563103d2b7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:55.721554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35293641-a4b1-440b-90c9-6a563103d2b7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:55.722014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35293641-a4b1-440b-90c9-6a563103d2b7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:55.722519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-35293641-a4b1-440b-90c9-6a563103d2b7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lazy-loading 'fault' on Instance uuid 00e826a3-306f-470f-9b64-7b5c3e36f1f7 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 20:02:55.767844 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-35293641-a4b1-440b-90c9-6a563103d2b7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:02:55.776414 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-35293641-a4b1-440b-90c9-6a563103d2b7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 200 len: 1356 microversion: 2.1 time: 0.107186 Oct 27 20:02:55.777000 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3866/7885] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:55 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:02:56.805781 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-678917a0-6235-4f1f-b4da-df9b8f49fe15 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:02:56.806628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-678917a0-6235-4f1f-b4da-df9b8f49fe15 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 00e826a3-306f-470f-9b64-7b5c3e36f1f7] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:02:56.814341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-678917a0-6235-4f1f-b4da-df9b8f49fe15 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:56.814874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-678917a0-6235-4f1f-b4da-df9b8f49fe15 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:56.815322 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-678917a0-6235-4f1f-b4da-df9b8f49fe15 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:56.816029 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-678917a0-6235-4f1f-b4da-df9b8f49fe15 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:02:56.816521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-678917a0-6235-4f1f-b4da-df9b8f49fe15 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:02:56.817157 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-678917a0-6235-4f1f-b4da-df9b8f49fe15 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:02:56.831449 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-678917a0-6235-4f1f-b4da-df9b8f49fe15 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] HTTP exception thrown: Instance 00e826a3-306f-470f-9b64-7b5c3e36f1f7 could not be found. Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-678917a0-6235-4f1f-b4da-df9b8f49fe15 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Request method failure captured: Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 HTTP/1.1 Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWuIhEo6bnXfnQbfze91TPiUq6e3C1UZIBGyGMNtUG7b7n7o47fTBtvG8uPaXe0795-tcRstRRvH7IjrJC0MLr_IL4s3LOxJnrGzq5tR_pq301tmK6VALgPLCzdZofwVV_RAvm6GRoRRWpIM7qR4MATGRqCzTZPHBTLjyiG12WkI1voI Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 6f32defe34974d2e800bf51c55662659 Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6f32defe34974d2e800bf51c55662659"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6f32defe34974d2e800bf51c55662659"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6f32defe34974d2e800bf51c55662659", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6f32defe34974d2e800bf51c55662659"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 6f32defe34974d2e800bf51c55662659 Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestNetworkAdvancedServerOps-656006975-project Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: 68cb39c4d811401f83ef30c675914669 Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestNetworkAdvancedServerOps-656006975-project Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 00e826a3-306f-470f-9b64-7b5c3e36f1f7 could not be found. Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '00e826a3-306f-470f-9b64-7b5c3e36f1f7'} Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00e826a3-306f-470f-9b64-7b5c3e36f1f7 could not be found. Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00e826a3-306f-470f-9b64-7b5c3e36f1f7 could not be found. Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:02:56.833881 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 20:02:56.839277 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:02:56.839277 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:02:56.839277 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 20:02:56.839277 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 20:02:56.839277 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 20:02:56.839277 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 20:02:56.839277 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00e826a3-306f-470f-9b64-7b5c3e36f1f7 could not be found. Oct 27 20:02:56.839277 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:02:56.839277 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-678917a0-6235-4f1f-b4da-df9b8f49fe15 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Returning 404 to user: Instance 00e826a3-306f-470f-9b64-7b5c3e36f1f7 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 20:02:56.839277 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-678917a0-6235-4f1f-b4da-df9b8f49fe15 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7" status: 404 len: 111 microversion: 2.1 time: 0.034425 Oct 27 20:02:56.839277 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4020/7886] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:02:56 2022] GET /compute/v2.1/servers/00e826a3-306f-470f-9b64-7b5c3e36f1f7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 20:03:00.185841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2f95710f-691e-4337-9395-cbb0fcf9cea2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '.version_select at 0x7fc86a391820>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:03:00.213634 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2f95710f-691e-4337-9395-cbb0fcf9cea2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-230471103" status: 202 len: 0 microversion: 2.1 time: 0.030802 Oct 27 20:03:00.214336 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3867/7887] 10.222.0.42 () {58 vars in 1281 bytes} [Thu Oct 27 20:03:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-230471103 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 20:03:00.244245 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d5196ae4-d456-4e9d-af01-bc133bb89c82 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'create', calling method: .version_select at 0x7fc869d96550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-946377921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwtNv4vyaB3br/+S1+ObPmeoI1jC11iaDVuLAgDSmdmSx/c4rYxovMrMFDORrJkE7e/cPI8giVAJXa4Dedcn7cHH9uTNFCORAmJUj/WedfWC2Y0P4Yak67I2/aVN/lgFA=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:03:00.260313 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-d5196ae4-d456-4e9d-af01-bc133bb89c82 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for project 6f32defe34974d2e800bf51c55662659. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 20:03:00.266234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-d5196ae4-d456-4e9d-af01-bc133bb89c82 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for user 68cb39c4d811401f83ef30c675914669 and project 6f32defe34974d2e800bf51c55662659. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 20:03:00.289156 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d5196ae4-d456-4e9d-af01-bc133bb89c82 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.049608 Oct 27 20:03:00.289749 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4021/7888] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 20:03:00 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:03:05.767377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1326971853", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "networks": [{"uuid": "792844f9-28e3-419d-81f0-132c63e0ba2b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-946377921", "security_groups": [{"name": "tempest-secgroup-smoke-756059993"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:03:05.778965 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:03:05.893529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] validate_networks() for [('792844f9-28e3-419d-81f0-132c63e0ba2b', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 20:03:06.336574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 20:03:06.337482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 20:03:06.337976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 20:03:06.338431 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 20:03:06.339661 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 20:03:06.350669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:06.351282 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:06.352065 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:06.357620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:06.358119 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:06.358608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:06.377910 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for project 6f32defe34974d2e800bf51c55662659. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 20:03:06.385087 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Getting quotas for user 68cb39c4d811401f83ef30c675914669 and project 6f32defe34974d2e800bf51c55662659. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 20:03:06.400792 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 20:03:06.403190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 20:03:06.460518 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8be0c2b3-ceac-48d2-853b-5b836f973054 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.696038 Oct 27 20:03:06.461655 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3868/7889] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 20:03:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 20:03:06.472950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-41ff3c01-b1ff-4a17-9e4a-345438df4436 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:03:06.473570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-41ff3c01-b1ff-4a17-9e4a-345438df4436 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:03:06.540116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-41ff3c01-b1ff-4a17-9e4a-345438df4436 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:03:06.548503 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-41ff3c01-b1ff-4a17-9e4a-345438df4436 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1266 microversion: 2.1 time: 0.079369 Oct 27 20:03:06.549250 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4022/7890] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:03:06 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:03:07.574377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-36e48aca-2e98-4a48-b314-3d752ca2eb36 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:03:07.575304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-36e48aca-2e98-4a48-b314-3d752ca2eb36 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:03:07.582671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36e48aca-2e98-4a48-b314-3d752ca2eb36 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:07.584378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36e48aca-2e98-4a48-b314-3d752ca2eb36 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:07.585288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36e48aca-2e98-4a48-b314-3d752ca2eb36 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:07.586778 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36e48aca-2e98-4a48-b314-3d752ca2eb36 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:07.588253 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36e48aca-2e98-4a48-b314-3d752ca2eb36 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:07.588895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36e48aca-2e98-4a48-b314-3d752ca2eb36 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:07.675064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-36e48aca-2e98-4a48-b314-3d752ca2eb36 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:03:07.684644 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-36e48aca-2e98-4a48-b314-3d752ca2eb36 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1336 microversion: 2.1 time: 0.115187 Oct 27 20:03:07.685555 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3869/7891] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:03:07 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1336 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:03:08.709398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dfab5a9f-bc11-49ee-933e-2ca17a187f32 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:03:08.710734 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dfab5a9f-bc11-49ee-933e-2ca17a187f32 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:03:08.712835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=16 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:03:08.720405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dfab5a9f-bc11-49ee-933e-2ca17a187f32 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:08.720936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dfab5a9f-bc11-49ee-933e-2ca17a187f32 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:08.721437 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dfab5a9f-bc11-49ee-933e-2ca17a187f32 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:08.722204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dfab5a9f-bc11-49ee-933e-2ca17a187f32 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:08.722799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dfab5a9f-bc11-49ee-933e-2ca17a187f32 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:08.723281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dfab5a9f-bc11-49ee-933e-2ca17a187f32 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:08.885475 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dfab5a9f-bc11-49ee-933e-2ca17a187f32 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:03:08.894548 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dfab5a9f-bc11-49ee-933e-2ca17a187f32 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1391 microversion: 2.1 time: 0.189140 Oct 27 20:03:08.895260 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4023/7892] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:03:08 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:03:09.088135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-671c5a36-8704-4a9f-998f-52080a225793 req-60e85069-e8bf-4f95-a630-a18ac52fac69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4155f6f0-d135-42b4-ac67-da2b451e3eb0", "tag": "0370d0e7-0ffa-4790-a98a-ed76171229f1"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:03:09.102918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-671c5a36-8704-4a9f-998f-52080a225793 req-60e85069-e8bf-4f95-a630-a18ac52fac69 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:09.103895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-671c5a36-8704-4a9f-998f-52080a225793 req-60e85069-e8bf-4f95-a630-a18ac52fac69 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:09.104618 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-671c5a36-8704-4a9f-998f-52080a225793 req-60e85069-e8bf-4f95-a630-a18ac52fac69 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:09.117780 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-671c5a36-8704-4a9f-998f-52080a225793 req-60e85069-e8bf-4f95-a630-a18ac52fac69 service nova] Creating event network-changed:0370d0e7-0ffa-4790-a98a-ed76171229f1 for instance 4155f6f0-d135-42b4-ac67-da2b451e3eb0 on n-h2-860687-3 Oct 27 20:03:09.123316 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-671c5a36-8704-4a9f-998f-52080a225793 req-60e85069-e8bf-4f95-a630-a18ac52fac69 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040009 Oct 27 20:03:09.124373 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3870/7893] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:03:09.918972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-183b28f9-a706-477b-a1d9-d8e42b0093d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:03:09.919597 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-183b28f9-a706-477b-a1d9-d8e42b0093d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:03:09.926630 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-183b28f9-a706-477b-a1d9-d8e42b0093d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:09.927126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-183b28f9-a706-477b-a1d9-d8e42b0093d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:09.928130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-183b28f9-a706-477b-a1d9-d8e42b0093d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:09.929153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-183b28f9-a706-477b-a1d9-d8e42b0093d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:09.929619 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-183b28f9-a706-477b-a1d9-d8e42b0093d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:09.930059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-183b28f9-a706-477b-a1d9-d8e42b0093d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:10.081439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-183b28f9-a706-477b-a1d9-d8e42b0093d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:03:10.090597 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-183b28f9-a706-477b-a1d9-d8e42b0093d9 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1391 microversion: 2.1 time: 0.175492 Oct 27 20:03:10.091174 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4024/7894] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:03:09 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:03:11.116882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5c8e804e-e7fc-4bd3-ae39-2e1ed2b7166c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:03:11.117608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5c8e804e-e7fc-4bd3-ae39-2e1ed2b7166c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:03:11.123846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c8e804e-e7fc-4bd3-ae39-2e1ed2b7166c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:11.124345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c8e804e-e7fc-4bd3-ae39-2e1ed2b7166c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:11.124799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c8e804e-e7fc-4bd3-ae39-2e1ed2b7166c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:11.125505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c8e804e-e7fc-4bd3-ae39-2e1ed2b7166c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:11.125971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c8e804e-e7fc-4bd3-ae39-2e1ed2b7166c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:11.126440 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5c8e804e-e7fc-4bd3-ae39-2e1ed2b7166c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:11.257888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5c8e804e-e7fc-4bd3-ae39-2e1ed2b7166c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:03:11.266096 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5c8e804e-e7fc-4bd3-ae39-2e1ed2b7166c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1391 microversion: 2.1 time: 0.154989 Oct 27 20:03:11.266816 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3871/7895] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:03:11 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:03:12.289257 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a28fa9c3-fc73-465d-b7d8-576e62dbfddd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:03:12.289883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a28fa9c3-fc73-465d-b7d8-576e62dbfddd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:03:12.296944 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a28fa9c3-fc73-465d-b7d8-576e62dbfddd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:12.297295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a28fa9c3-fc73-465d-b7d8-576e62dbfddd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:12.297743 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a28fa9c3-fc73-465d-b7d8-576e62dbfddd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:12.298496 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a28fa9c3-fc73-465d-b7d8-576e62dbfddd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:12.298962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a28fa9c3-fc73-465d-b7d8-576e62dbfddd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:12.299399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a28fa9c3-fc73-465d-b7d8-576e62dbfddd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:12.432945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-a28fa9c3-fc73-465d-b7d8-576e62dbfddd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:03:12.440857 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a28fa9c3-fc73-465d-b7d8-576e62dbfddd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1391 microversion: 2.1 time: 0.155600 Oct 27 20:03:12.441437 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4025/7896] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:03:12 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:03:13.464828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9ff794fb-d2b5-48ea-b4ff-fe318b71f3e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:03:13.465478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9ff794fb-d2b5-48ea-b4ff-fe318b71f3e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:03:13.472408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ff794fb-d2b5-48ea-b4ff-fe318b71f3e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:13.472917 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ff794fb-d2b5-48ea-b4ff-fe318b71f3e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:13.473382 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ff794fb-d2b5-48ea-b4ff-fe318b71f3e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:13.474710 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ff794fb-d2b5-48ea-b4ff-fe318b71f3e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:13.475197 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ff794fb-d2b5-48ea-b4ff-fe318b71f3e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:13.475867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9ff794fb-d2b5-48ea-b4ff-fe318b71f3e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:13.615565 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9ff794fb-d2b5-48ea-b4ff-fe318b71f3e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:03:13.623352 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9ff794fb-d2b5-48ea-b4ff-fe318b71f3e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1391 microversion: 2.1 time: 0.162499 Oct 27 20:03:13.623931 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3872/7897] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:03:13 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:03:14.646865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b886fa6c-df8e-4ace-8336-c2084b5dded5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:03:14.647616 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b886fa6c-df8e-4ace-8336-c2084b5dded5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:03:14.654550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b886fa6c-df8e-4ace-8336-c2084b5dded5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:14.655048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b886fa6c-df8e-4ace-8336-c2084b5dded5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:14.655495 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b886fa6c-df8e-4ace-8336-c2084b5dded5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:14.656207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b886fa6c-df8e-4ace-8336-c2084b5dded5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:14.656669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b886fa6c-df8e-4ace-8336-c2084b5dded5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:14.657136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b886fa6c-df8e-4ace-8336-c2084b5dded5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:14.795373 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b886fa6c-df8e-4ace-8336-c2084b5dded5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:03:14.803638 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b886fa6c-df8e-4ace-8336-c2084b5dded5 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1391 microversion: 2.1 time: 0.160754 Oct 27 20:03:14.804212 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4026/7898] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:03:14 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:03:15.827118 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-37fee3b8-3910-4a83-aa48-ec8802b5b895 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:03:15.827760 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-37fee3b8-3910-4a83-aa48-ec8802b5b895 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:03:15.835507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37fee3b8-3910-4a83-aa48-ec8802b5b895 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:15.835958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37fee3b8-3910-4a83-aa48-ec8802b5b895 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:15.836428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37fee3b8-3910-4a83-aa48-ec8802b5b895 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:15.837139 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37fee3b8-3910-4a83-aa48-ec8802b5b895 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:15.837616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37fee3b8-3910-4a83-aa48-ec8802b5b895 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:15.838067 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37fee3b8-3910-4a83-aa48-ec8802b5b895 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:15.977720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-37fee3b8-3910-4a83-aa48-ec8802b5b895 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:03:15.985454 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-37fee3b8-3910-4a83-aa48-ec8802b5b895 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1391 microversion: 2.1 time: 0.162565 Oct 27 20:03:15.986044 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3873/7899] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:03:15 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:03:16.155592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-670951f1-7df5-4774-84fe-ceff42193939 req-65cda43b-66c3-4804-af26-436048fd8119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4155f6f0-d135-42b4-ac67-da2b451e3eb0", "name": "network-vif-plugged", "status": "completed", "tag": "0370d0e7-0ffa-4790-a98a-ed76171229f1"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:03:16.162237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:03:16.171754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-670951f1-7df5-4774-84fe-ceff42193939 req-65cda43b-66c3-4804-af26-436048fd8119 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:16.172246 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-670951f1-7df5-4774-84fe-ceff42193939 req-65cda43b-66c3-4804-af26-436048fd8119 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:16.172677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-670951f1-7df5-4774-84fe-ceff42193939 req-65cda43b-66c3-4804-af26-436048fd8119 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:16.184470 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-670951f1-7df5-4774-84fe-ceff42193939 req-65cda43b-66c3-4804-af26-436048fd8119 service nova] Creating event network-vif-plugged:0370d0e7-0ffa-4790-a98a-ed76171229f1 for instance 4155f6f0-d135-42b4-ac67-da2b451e3eb0 on n-h2-860687-3 Oct 27 20:03:16.189774 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-670951f1-7df5-4774-84fe-ceff42193939 req-65cda43b-66c3-4804-af26-436048fd8119 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037905 Oct 27 20:03:16.190605 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4027/7900] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:03:17.009892 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-de95cc54-9744-4f04-8a97-982ec486109b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:03:17.010554 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-de95cc54-9744-4f04-8a97-982ec486109b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:03:17.012587 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:03:17.013284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:03:17.019012 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de95cc54-9744-4f04-8a97-982ec486109b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:17.019523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de95cc54-9744-4f04-8a97-982ec486109b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:17.020048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de95cc54-9744-4f04-8a97-982ec486109b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:17.021306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de95cc54-9744-4f04-8a97-982ec486109b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:17.021699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de95cc54-9744-4f04-8a97-982ec486109b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:17.022271 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-de95cc54-9744-4f04-8a97-982ec486109b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:17.156971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-de95cc54-9744-4f04-8a97-982ec486109b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:03:17.164816 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-de95cc54-9744-4f04-8a97-982ec486109b tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1391 microversion: 2.1 time: 0.159305 Oct 27 20:03:17.165395 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3874/7901] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:03:17 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:03:18.185048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:03:18.190816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-4ca3efc9-5b0d-49a4-93e5-a6114f9beb7d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:03:18.191531 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-4ca3efc9-5b0d-49a4-93e5-a6114f9beb7d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:03:18.198288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ca3efc9-5b0d-49a4-93e5-a6114f9beb7d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:18.198802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ca3efc9-5b0d-49a4-93e5-a6114f9beb7d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:18.199243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ca3efc9-5b0d-49a4-93e5-a6114f9beb7d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:18.200238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ca3efc9-5b0d-49a4-93e5-a6114f9beb7d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:18.200698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ca3efc9-5b0d-49a4-93e5-a6114f9beb7d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:18.201132 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-4ca3efc9-5b0d-49a4-93e5-a6114f9beb7d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:18.333736 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-4ca3efc9-5b0d-49a4-93e5-a6114f9beb7d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:03:18.342114 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-4ca3efc9-5b0d-49a4-93e5-a6114f9beb7d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1563 microversion: 2.1 time: 0.158027 Oct 27 20:03:18.342740 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4028/7902] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:03:18 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:03:18.365034 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7e6a124b-771c-4736-8149-05864e6c822a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:03:18.365673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7e6a124b-771c-4736-8149-05864e6c822a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:03:18.372563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e6a124b-771c-4736-8149-05864e6c822a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:18.373076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e6a124b-771c-4736-8149-05864e6c822a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:18.373546 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e6a124b-771c-4736-8149-05864e6c822a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:18.374303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e6a124b-771c-4736-8149-05864e6c822a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:18.374815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e6a124b-771c-4736-8149-05864e6c822a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:18.375269 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e6a124b-771c-4736-8149-05864e6c822a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:18.506341 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7e6a124b-771c-4736-8149-05864e6c822a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:03:18.514112 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7e6a124b-771c-4736-8149-05864e6c822a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1563 microversion: 2.1 time: 0.153136 Oct 27 20:03:18.514738 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3875/7903] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:03:18 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:03:20.113941 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-583d2cd2-9a64-4c25-a9a3-154e5f9f055a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:03:20.114818 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-583d2cd2-9a64-4c25-a9a3-154e5f9f055a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:03:20.116673 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-5deae236-b8aa-429e-ba73-a36ae0d562df req-66743bdb-a894-41ac-8b3e-db2d9b50fc11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4155f6f0-d135-42b4-ac67-da2b451e3eb0", "tag": "0370d0e7-0ffa-4790-a98a-ed76171229f1"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:03:20.122746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-583d2cd2-9a64-4c25-a9a3-154e5f9f055a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:20.123248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-583d2cd2-9a64-4c25-a9a3-154e5f9f055a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:20.123694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-583d2cd2-9a64-4c25-a9a3-154e5f9f055a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:20.124404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-583d2cd2-9a64-4c25-a9a3-154e5f9f055a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:20.125048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-583d2cd2-9a64-4c25-a9a3-154e5f9f055a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:20.125493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-583d2cd2-9a64-4c25-a9a3-154e5f9f055a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:20.128761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5deae236-b8aa-429e-ba73-a36ae0d562df req-66743bdb-a894-41ac-8b3e-db2d9b50fc11 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:20.129353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5deae236-b8aa-429e-ba73-a36ae0d562df req-66743bdb-a894-41ac-8b3e-db2d9b50fc11 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:20.129908 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5deae236-b8aa-429e-ba73-a36ae0d562df req-66743bdb-a894-41ac-8b3e-db2d9b50fc11 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:20.142198 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5deae236-b8aa-429e-ba73-a36ae0d562df req-66743bdb-a894-41ac-8b3e-db2d9b50fc11 service nova] Creating event network-changed:0370d0e7-0ffa-4790-a98a-ed76171229f1 for instance 4155f6f0-d135-42b4-ac67-da2b451e3eb0 on n-h2-860687-3 Oct 27 20:03:20.148405 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-5deae236-b8aa-429e-ba73-a36ae0d562df req-66743bdb-a894-41ac-8b3e-db2d9b50fc11 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036097 Oct 27 20:03:20.149715 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3876/7904] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:03:20.278614 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-583d2cd2-9a64-4c25-a9a3-154e5f9f055a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:03:20.288322 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-583d2cd2-9a64-4c25-a9a3-154e5f9f055a tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1563 microversion: 2.1 time: 0.178363 Oct 27 20:03:20.289615 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4029/7905] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:03:20 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:03:53.609887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a0093d8d-d612-4a9f-a566-7a4a36ae34fd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:03:53.612225 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a0093d8d-d612-4a9f-a566-7a4a36ae34fd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:03:53.615477 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:03:53.616145 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=42 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:03:53.622763 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0093d8d-d612-4a9f-a566-7a4a36ae34fd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:53.623266 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0093d8d-d612-4a9f-a566-7a4a36ae34fd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:53.623725 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0093d8d-d612-4a9f-a566-7a4a36ae34fd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:53.624443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0093d8d-d612-4a9f-a566-7a4a36ae34fd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:03:53.624916 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0093d8d-d612-4a9f-a566-7a4a36ae34fd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:03:53.625389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0093d8d-d612-4a9f-a566-7a4a36ae34fd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:03:53.684819 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a0093d8d-d612-4a9f-a566-7a4a36ae34fd tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0/action" status: 200 len: 24579 microversion: 2.1 time: 0.078998 Oct 27 20:03:53.685709 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3877/7906] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:03:53 2022] POST /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0/action => generated 24579 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 20:04:24.040933 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=5 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:04:24.041799 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=38 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:04:24.046395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f487173e-f62b-4b2a-ba6a-4dcf7c4936c6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:04:24.047010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f487173e-f62b-4b2a-ba6a-4dcf7c4936c6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:24.054507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f487173e-f62b-4b2a-ba6a-4dcf7c4936c6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:24.055067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f487173e-f62b-4b2a-ba6a-4dcf7c4936c6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:24.055551 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f487173e-f62b-4b2a-ba6a-4dcf7c4936c6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:24.056312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f487173e-f62b-4b2a-ba6a-4dcf7c4936c6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:24.056882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f487173e-f62b-4b2a-ba6a-4dcf7c4936c6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:24.057357 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f487173e-f62b-4b2a-ba6a-4dcf7c4936c6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:24.081656 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-f487173e-f62b-4b2a-ba6a-4dcf7c4936c6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lazy-loading 'flavor' on Instance uuid 4155f6f0-d135-42b4-ac67-da2b451e3eb0 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 20:04:24.151014 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f487173e-f62b-4b2a-ba6a-4dcf7c4936c6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0/action" status: 202 len: 0 microversion: 2.1 time: 0.111865 Oct 27 20:04:24.151887 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4030/7907] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:04:24 2022] POST /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 20:04:24.163174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4e5a5cfb-90b5-418c-b15f-5bccc7593655 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:24.163888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4e5a5cfb-90b5-418c-b15f-5bccc7593655 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:24.167510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:04:24.168233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:04:24.172693 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5a5cfb-90b5-418c-b15f-5bccc7593655 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:24.173210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5a5cfb-90b5-418c-b15f-5bccc7593655 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:24.173804 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5a5cfb-90b5-418c-b15f-5bccc7593655 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:24.174571 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5a5cfb-90b5-418c-b15f-5bccc7593655 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:24.175699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5a5cfb-90b5-418c-b15f-5bccc7593655 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:24.176216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e5a5cfb-90b5-418c-b15f-5bccc7593655 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:24.394039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4e5a5cfb-90b5-418c-b15f-5bccc7593655 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:24.402049 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4e5a5cfb-90b5-418c-b15f-5bccc7593655 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1689 microversion: 2.1 time: 0.244419 Oct 27 20:04:24.402664 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3878/7908] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:24 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1689 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:25.429058 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0b4a4a84-3128-458b-9e03-161f20c0f4a4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:25.429771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0b4a4a84-3128-458b-9e03-161f20c0f4a4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:25.437013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b4a4a84-3128-458b-9e03-161f20c0f4a4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:25.437507 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b4a4a84-3128-458b-9e03-161f20c0f4a4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:25.437956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b4a4a84-3128-458b-9e03-161f20c0f4a4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:25.438698 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b4a4a84-3128-458b-9e03-161f20c0f4a4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:25.439163 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b4a4a84-3128-458b-9e03-161f20c0f4a4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:25.439600 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0b4a4a84-3128-458b-9e03-161f20c0f4a4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:25.629431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0b4a4a84-3128-458b-9e03-161f20c0f4a4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:25.637309 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0b4a4a84-3128-458b-9e03-161f20c0f4a4 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1689 microversion: 2.1 time: 0.213251 Oct 27 20:04:25.637889 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4031/7909] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:25 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1689 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:26.661968 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c1de61d0-8ca3-4a14-8678-e7653cd1f7bc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:26.662646 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c1de61d0-8ca3-4a14-8678-e7653cd1f7bc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:26.669566 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1de61d0-8ca3-4a14-8678-e7653cd1f7bc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:26.670072 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1de61d0-8ca3-4a14-8678-e7653cd1f7bc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:26.670569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1de61d0-8ca3-4a14-8678-e7653cd1f7bc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:26.671284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1de61d0-8ca3-4a14-8678-e7653cd1f7bc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:26.671761 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1de61d0-8ca3-4a14-8678-e7653cd1f7bc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:26.672211 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c1de61d0-8ca3-4a14-8678-e7653cd1f7bc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:26.804709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-c1de61d0-8ca3-4a14-8678-e7653cd1f7bc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:26.812618 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c1de61d0-8ca3-4a14-8678-e7653cd1f7bc tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1672 microversion: 2.1 time: 0.155410 Oct 27 20:04:26.813183 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3879/7910] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:26 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:27.912530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6db997f4-4974-4a4a-b08d-2c28ce2ece8c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:04:27.914836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6db997f4-4974-4a4a-b08d-2c28ce2ece8c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:27.922263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6db997f4-4974-4a4a-b08d-2c28ce2ece8c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:27.922792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6db997f4-4974-4a4a-b08d-2c28ce2ece8c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:27.923239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6db997f4-4974-4a4a-b08d-2c28ce2ece8c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:27.923942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6db997f4-4974-4a4a-b08d-2c28ce2ece8c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:27.924401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6db997f4-4974-4a4a-b08d-2c28ce2ece8c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:27.924945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6db997f4-4974-4a4a-b08d-2c28ce2ece8c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:27.976650 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6db997f4-4974-4a4a-b08d-2c28ce2ece8c tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0/action" status: 200 len: 38462 microversion: 2.1 time: 0.068984 Oct 27 20:04:27.977312 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4032/7911] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:04:27 2022] POST /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0/action => generated 38462 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 20:04:27.990032 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fff1f58f-7aca-4c93-805c-45e9b1a80402 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:04:27.990616 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fff1f58f-7aca-4c93-805c-45e9b1a80402 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:27.997387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fff1f58f-7aca-4c93-805c-45e9b1a80402 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:27.997891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fff1f58f-7aca-4c93-805c-45e9b1a80402 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:27.998345 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fff1f58f-7aca-4c93-805c-45e9b1a80402 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:27.999079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fff1f58f-7aca-4c93-805c-45e9b1a80402 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:27.999548 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fff1f58f-7aca-4c93-805c-45e9b1a80402 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:27.999991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fff1f58f-7aca-4c93-805c-45e9b1a80402 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:28.069264 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fff1f58f-7aca-4c93-805c-45e9b1a80402 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0/action" status: 202 len: 0 microversion: 2.1 time: 0.083735 Oct 27 20:04:28.069921 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3880/7912] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:04:27 2022] POST /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 20:04:28.079158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b1f647e7-780e-4166-bba8-88207fd9756d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:28.079863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b1f647e7-780e-4166-bba8-88207fd9756d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:28.087318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1f647e7-780e-4166-bba8-88207fd9756d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:28.087808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1f647e7-780e-4166-bba8-88207fd9756d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:28.088317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1f647e7-780e-4166-bba8-88207fd9756d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:28.089174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1f647e7-780e-4166-bba8-88207fd9756d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:28.090273 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1f647e7-780e-4166-bba8-88207fd9756d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:28.090746 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b1f647e7-780e-4166-bba8-88207fd9756d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:28.238983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b1f647e7-780e-4166-bba8-88207fd9756d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:28.246966 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b1f647e7-780e-4166-bba8-88207fd9756d tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1678 microversion: 2.1 time: 0.172303 Oct 27 20:04:28.247541 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4033/7913] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:28 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:29.273350 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7117e7a-ac31-4d1c-9553-9e5c50e6f7b6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:29.274070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7117e7a-ac31-4d1c-9553-9e5c50e6f7b6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:29.280322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7117e7a-ac31-4d1c-9553-9e5c50e6f7b6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:29.280835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7117e7a-ac31-4d1c-9553-9e5c50e6f7b6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:29.281286 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7117e7a-ac31-4d1c-9553-9e5c50e6f7b6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:29.282000 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7117e7a-ac31-4d1c-9553-9e5c50e6f7b6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:29.282507 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7117e7a-ac31-4d1c-9553-9e5c50e6f7b6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:29.282955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7117e7a-ac31-4d1c-9553-9e5c50e6f7b6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:29.426313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7117e7a-ac31-4d1c-9553-9e5c50e6f7b6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:29.434096 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7117e7a-ac31-4d1c-9553-9e5c50e6f7b6 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1678 microversion: 2.1 time: 0.166953 Oct 27 20:04:29.434718 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3881/7914] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:29 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:30.459099 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8e5cfbfa-fca7-4fec-95c9-f993a30045a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:30.460104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8e5cfbfa-fca7-4fec-95c9-f993a30045a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:30.466990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e5cfbfa-fca7-4fec-95c9-f993a30045a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:30.467477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e5cfbfa-fca7-4fec-95c9-f993a30045a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:30.467916 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e5cfbfa-fca7-4fec-95c9-f993a30045a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:30.468608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e5cfbfa-fca7-4fec-95c9-f993a30045a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:30.469073 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e5cfbfa-fca7-4fec-95c9-f993a30045a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:30.469503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e5cfbfa-fca7-4fec-95c9-f993a30045a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:30.603086 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8e5cfbfa-fca7-4fec-95c9-f993a30045a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:30.610819 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8e5cfbfa-fca7-4fec-95c9-f993a30045a0 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1681 microversion: 2.1 time: 0.155776 Oct 27 20:04:30.611387 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4034/7915] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:30 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:30.707451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70a54884-e95b-45c4-ab19-fb05278b13f7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:04:30.709729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-70a54884-e95b-45c4-ab19-fb05278b13f7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:30.716540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70a54884-e95b-45c4-ab19-fb05278b13f7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:30.717051 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70a54884-e95b-45c4-ab19-fb05278b13f7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:30.717519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70a54884-e95b-45c4-ab19-fb05278b13f7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:30.718238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70a54884-e95b-45c4-ab19-fb05278b13f7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:30.718749 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70a54884-e95b-45c4-ab19-fb05278b13f7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:30.719203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70a54884-e95b-45c4-ab19-fb05278b13f7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:30.760407 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70a54884-e95b-45c4-ab19-fb05278b13f7 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "POST /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0/action" status: 200 len: 38462 microversion: 2.1 time: 0.056778 Oct 27 20:04:30.761045 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3882/7916] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:04:30 2022] POST /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0/action => generated 38462 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 20:04:32.009439 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a0850251-4663-464a-9f2a-86a29402aefb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:32.009955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a0850251-4663-464a-9f2a-86a29402aefb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:32.024253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0850251-4663-464a-9f2a-86a29402aefb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:32.024846 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0850251-4663-464a-9f2a-86a29402aefb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:32.025404 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0850251-4663-464a-9f2a-86a29402aefb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:32.026224 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0850251-4663-464a-9f2a-86a29402aefb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:32.026789 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0850251-4663-464a-9f2a-86a29402aefb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:32.027222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a0850251-4663-464a-9f2a-86a29402aefb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:32.054677 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a0850251-4663-464a-9f2a-86a29402aefb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 20:04:32.068729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-9d3104e1-2136-4a22-a0c1-9647ca03bf17 req-6d63de9e-ac1e-428e-9302-249af48e4737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4155f6f0-d135-42b4-ac67-da2b451e3eb0", "tag": "0370d0e7-0ffa-4790-a98a-ed76171229f1"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:04:32.080663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9d3104e1-2136-4a22-a0c1-9647ca03bf17 req-6d63de9e-ac1e-428e-9302-249af48e4737 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:32.081480 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9d3104e1-2136-4a22-a0c1-9647ca03bf17 req-6d63de9e-ac1e-428e-9302-249af48e4737 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:32.082308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9d3104e1-2136-4a22-a0c1-9647ca03bf17 req-6d63de9e-ac1e-428e-9302-249af48e4737 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:32.093862 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-9d3104e1-2136-4a22-a0c1-9647ca03bf17 req-6d63de9e-ac1e-428e-9302-249af48e4737 service nova] Creating event network-changed:0370d0e7-0ffa-4790-a98a-ed76171229f1 for instance 4155f6f0-d135-42b4-ac67-da2b451e3eb0 on n-h2-860687-3 Oct 27 20:04:32.099688 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-9d3104e1-2136-4a22-a0c1-9647ca03bf17 req-6d63de9e-ac1e-428e-9302-249af48e4737 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091487 Oct 27 20:04:32.100305 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3883/7917] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:04:32.141166 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a0850251-4663-464a-9f2a-86a29402aefb tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 204 len: 0 microversion: 2.1 time: 0.135029 Oct 27 20:04:32.141817 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4035/7918] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 20:04:32 2022] DELETE /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 20:04:32.152841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f76f67c7-8c8e-4edf-9132-53d5c22e61e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:32.153569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f76f67c7-8c8e-4edf-9132-53d5c22e61e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:32.162796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f76f67c7-8c8e-4edf-9132-53d5c22e61e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:32.163311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f76f67c7-8c8e-4edf-9132-53d5c22e61e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:32.163773 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f76f67c7-8c8e-4edf-9132-53d5c22e61e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:32.164503 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f76f67c7-8c8e-4edf-9132-53d5c22e61e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:32.165173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f76f67c7-8c8e-4edf-9132-53d5c22e61e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:32.165800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f76f67c7-8c8e-4edf-9132-53d5c22e61e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:32.305979 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-f76f67c7-8c8e-4edf-9132-53d5c22e61e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:32.314079 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f76f67c7-8c8e-4edf-9132-53d5c22e61e3 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1687 microversion: 2.1 time: 0.167350 Oct 27 20:04:32.314695 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3884/7919] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:32 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:33.341986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-474c2b9a-d63e-4731-a0e1-54894e46812f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:33.343352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-474c2b9a-d63e-4731-a0e1-54894e46812f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:33.355013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-474c2b9a-d63e-4731-a0e1-54894e46812f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:33.355533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-474c2b9a-d63e-4731-a0e1-54894e46812f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:33.355985 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-474c2b9a-d63e-4731-a0e1-54894e46812f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:33.356702 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-474c2b9a-d63e-4731-a0e1-54894e46812f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:33.357169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-474c2b9a-d63e-4731-a0e1-54894e46812f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:33.357611 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-474c2b9a-d63e-4731-a0e1-54894e46812f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:33.514170 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-474c2b9a-d63e-4731-a0e1-54894e46812f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:33.526671 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-474c2b9a-d63e-4731-a0e1-54894e46812f tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1687 microversion: 2.1 time: 0.190205 Oct 27 20:04:33.527268 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4036/7920] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:33 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1687 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:34.378578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-00b51bb5-9b94-444e-8d05-b33eb40b4901 req-2528fbd8-1171-40d5-97b6-5952fb314819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4155f6f0-d135-42b4-ac67-da2b451e3eb0", "name": "network-vif-deleted", "tag": "0370d0e7-0ffa-4790-a98a-ed76171229f1"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:04:34.389238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-00b51bb5-9b94-444e-8d05-b33eb40b4901 req-2528fbd8-1171-40d5-97b6-5952fb314819 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:34.389738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-00b51bb5-9b94-444e-8d05-b33eb40b4901 req-2528fbd8-1171-40d5-97b6-5952fb314819 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:34.390187 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-00b51bb5-9b94-444e-8d05-b33eb40b4901 req-2528fbd8-1171-40d5-97b6-5952fb314819 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:34.402874 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-00b51bb5-9b94-444e-8d05-b33eb40b4901 req-2528fbd8-1171-40d5-97b6-5952fb314819 service nova] Creating event network-vif-deleted:0370d0e7-0ffa-4790-a98a-ed76171229f1 for instance 4155f6f0-d135-42b4-ac67-da2b451e3eb0 on n-h2-860687-3 Oct 27 20:04:34.407695 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-00b51bb5-9b94-444e-8d05-b33eb40b4901 req-2528fbd8-1171-40d5-97b6-5952fb314819 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092235 Oct 27 20:04:34.408308 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3885/7921] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:04:34.551837 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5a1cb9eb-1409-4bf2-9fee-f0aef484c926 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:34.552374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5a1cb9eb-1409-4bf2-9fee-f0aef484c926 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:34.559523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a1cb9eb-1409-4bf2-9fee-f0aef484c926 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:34.560019 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a1cb9eb-1409-4bf2-9fee-f0aef484c926 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:34.560467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a1cb9eb-1409-4bf2-9fee-f0aef484c926 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:34.561230 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a1cb9eb-1409-4bf2-9fee-f0aef484c926 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:34.561695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a1cb9eb-1409-4bf2-9fee-f0aef484c926 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:34.562128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a1cb9eb-1409-4bf2-9fee-f0aef484c926 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:34.597888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a1cb9eb-1409-4bf2-9fee-f0aef484c926 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:34.598405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a1cb9eb-1409-4bf2-9fee-f0aef484c926 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:34.598865 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5a1cb9eb-1409-4bf2-9fee-f0aef484c926 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:34.599329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-5a1cb9eb-1409-4bf2-9fee-f0aef484c926 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lazy-loading 'fault' on Instance uuid 4155f6f0-d135-42b4-ac67-da2b451e3eb0 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 20:04:34.643695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5a1cb9eb-1409-4bf2-9fee-f0aef484c926 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cb39c4d811401f83ef30c675914669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f32defe34974d2e800bf51c55662659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:34.652724 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5a1cb9eb-1409-4bf2-9fee-f0aef484c926 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 200 len: 1356 microversion: 2.1 time: 0.105532 Oct 27 20:04:34.653325 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4037/7922] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:34 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:35.678895 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4a38d843-2db3-4189-a3d2-d9f4ff65d394 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:35.679627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4a38d843-2db3-4189-a3d2-d9f4ff65d394 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] [instance: 4155f6f0-d135-42b4-ac67-da2b451e3eb0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:35.686104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a38d843-2db3-4189-a3d2-d9f4ff65d394 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:35.686643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a38d843-2db3-4189-a3d2-d9f4ff65d394 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:35.687101 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a38d843-2db3-4189-a3d2-d9f4ff65d394 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:35.687813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a38d843-2db3-4189-a3d2-d9f4ff65d394 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:35.688288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a38d843-2db3-4189-a3d2-d9f4ff65d394 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:35.688731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a38d843-2db3-4189-a3d2-d9f4ff65d394 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:35.703680 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-4a38d843-2db3-4189-a3d2-d9f4ff65d394 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] HTTP exception thrown: Instance 4155f6f0-d135-42b4-ac67-da2b451e3eb0 could not be found. Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4a38d843-2db3-4189-a3d2-d9f4ff65d394 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Request method failure captured: Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 HTTP/1.1 Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWuIhEo6bnXfnQbfze91TPiUq6e3C1UZIBGyGMNtUG7b7n7o47fTBtvG8uPaXe0795-tcRstRRvH7IjrJC0MLr_IL4s3LOxJnrGzq5tR_pq301tmK6VALgPLCzdZofwVV_RAvm6GRoRRWpIM7qR4MATGRqCzTZPHBTLjyiG12WkI1voI Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 6f32defe34974d2e800bf51c55662659 Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6f32defe34974d2e800bf51c55662659"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6f32defe34974d2e800bf51c55662659"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6f32defe34974d2e800bf51c55662659", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6f32defe34974d2e800bf51c55662659"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 6f32defe34974d2e800bf51c55662659 Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-656006975 Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestNetworkAdvancedServerOps-656006975-project Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: 68cb39c4d811401f83ef30c675914669 Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestNetworkAdvancedServerOps-656006975-project Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance 4155f6f0-d135-42b4-ac67-da2b451e3eb0 could not be found. Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': '4155f6f0-d135-42b4-ac67-da2b451e3eb0'} Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4155f6f0-d135-42b4-ac67-da2b451e3eb0 could not be found. Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4155f6f0-d135-42b4-ac67-da2b451e3eb0 could not be found. Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 20:04:35.705314 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 20:04:35.711807 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 20:04:35.711807 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:04:35.711807 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 20:04:35.711807 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 20:04:35.711807 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 20:04:35.711807 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 20:04:35.711807 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4155f6f0-d135-42b4-ac67-da2b451e3eb0 could not be found. Oct 27 20:04:35.711807 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 20:04:35.711807 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4a38d843-2db3-4189-a3d2-d9f4ff65d394 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Returning 404 to user: Instance 4155f6f0-d135-42b4-ac67-da2b451e3eb0 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 20:04:35.711807 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4a38d843-2db3-4189-a3d2-d9f4ff65d394 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0" status: 404 len: 111 microversion: 2.1 time: 0.034643 Oct 27 20:04:35.711807 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3886/7923] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:35 2022] GET /compute/v2.1/servers/4155f6f0-d135-42b4-ac67-da2b451e3eb0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 20:04:38.801169 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-235d69c1-226d-4882-af43-99197cdad1a2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] Calling method '.version_select at 0x7fc87330d4c0>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:38.834510 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-235d69c1-226d-4882-af43-99197cdad1a2 tempest-TestNetworkAdvancedServerOps-656006975 tempest-TestNetworkAdvancedServerOps-656006975-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-946377921" status: 202 len: 0 microversion: 2.1 time: 0.037552 Oct 27 20:04:38.838673 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4038/7924] 10.222.0.42 () {58 vars in 1281 bytes} [Thu Oct 27 20:04:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-946377921 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 20:04:50.068995 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=18 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:04:50.071415 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:04:50.284819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8742b523-2ce4-468d-b222-cdbc417f4559 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Action: 'create', calling method: .version_select at 0x7fc86ae38310>, body: {"keypair": {"name": "tempest-TestShelveInstance-631459227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG14D6v4zh0D5paVVgWCOo0y8YNX30KLmZJvvOWJgstVllq7KQc4l4VNwAO1ww/SO0sZXm88MqHArlG868YI8kfvkZ5I6zcvSvCC6IYb6R0qFTR90/hfo7L3s902d1Csg=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:04:50.306990 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-8742b523-2ce4-468d-b222-cdbc417f4559 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Getting quotas for project 84e997bd7269417282b7994f0c6f3412. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 20:04:50.314599 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-8742b523-2ce4-468d-b222-cdbc417f4559 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Getting quotas for user ea6b28f9423b40e0bf3ed5e697208cab and project 84e997bd7269417282b7994f0c6f3412. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 20:04:50.350964 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8742b523-2ce4-468d-b222-cdbc417f4559 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.288324 Oct 27 20:04:50.351606 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3887/7925] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 20:04:50 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:04:51.376996 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:04:51.377882 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:04:51.382405 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-966293064", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-631459227", "security_groups": [{"name": "tempest-secgroup-smoke-278101275"}], "networks": [{"uuid": "850e60e0-aa62-4a43-8a43-da3de355a6bc"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:04:51.505046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] validate_networks() for [('850e60e0-aa62-4a43-8a43-da3de355a6bc', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 20:04:52.020570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 20:04:52.021027 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 20:04:52.021506 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 20:04:52.021949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 20:04:52.022513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 20:04:52.032188 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:52.032690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:52.033207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:52.033983 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:52.034479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:52.034922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:52.053869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Getting quotas for project 84e997bd7269417282b7994f0c6f3412. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 20:04:52.059623 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Getting quotas for user ea6b28f9423b40e0bf3ed5e697208cab and project 84e997bd7269417282b7994f0c6f3412. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 20:04:52.073587 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 20:04:52.076239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 20:04:52.126718 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-fa57c19a-180c-49a4-ae48-7db828adcf0f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.751398 Oct 27 20:04:52.127939 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4039/7926] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 20:04:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 20:04:52.140126 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b8932af7-ce1d-4c18-8c5e-191ef5479012 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:52.141313 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b8932af7-ce1d-4c18-8c5e-191ef5479012 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:52.217384 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-b8932af7-ce1d-4c18-8c5e-191ef5479012 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:52.225717 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b8932af7-ce1d-4c18-8c5e-191ef5479012 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1245 microversion: 2.1 time: 0.089976 Oct 27 20:04:52.227337 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3888/7927] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:52 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 20:04:53.253263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b6d43e89-23c1-4340-90fd-af18a178bbfb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:53.253831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b6d43e89-23c1-4340-90fd-af18a178bbfb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:53.265378 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6d43e89-23c1-4340-90fd-af18a178bbfb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:53.265950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6d43e89-23c1-4340-90fd-af18a178bbfb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:53.266493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6d43e89-23c1-4340-90fd-af18a178bbfb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:53.268607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6d43e89-23c1-4340-90fd-af18a178bbfb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:53.269416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6d43e89-23c1-4340-90fd-af18a178bbfb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:53.270127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6d43e89-23c1-4340-90fd-af18a178bbfb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:53.420797 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b6d43e89-23c1-4340-90fd-af18a178bbfb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:53.430618 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b6d43e89-23c1-4340-90fd-af18a178bbfb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1305 microversion: 2.1 time: 0.183016 Oct 27 20:04:53.439195 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4040/7928] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:53 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1305 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:54.465533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-406bdfcb-edce-4aa7-ba8e-0d3944f1f5ce tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:54.466501 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-406bdfcb-edce-4aa7-ba8e-0d3944f1f5ce tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:54.479456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-406bdfcb-edce-4aa7-ba8e-0d3944f1f5ce tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:54.480284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-406bdfcb-edce-4aa7-ba8e-0d3944f1f5ce tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:54.480808 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-406bdfcb-edce-4aa7-ba8e-0d3944f1f5ce tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:54.481556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-406bdfcb-edce-4aa7-ba8e-0d3944f1f5ce tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:54.482045 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-406bdfcb-edce-4aa7-ba8e-0d3944f1f5ce tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:54.482660 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-406bdfcb-edce-4aa7-ba8e-0d3944f1f5ce tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:54.625527 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-406bdfcb-edce-4aa7-ba8e-0d3944f1f5ce tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:54.633625 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-406bdfcb-edce-4aa7-ba8e-0d3944f1f5ce tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1370 microversion: 2.1 time: 0.172165 Oct 27 20:04:54.634861 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3889/7929] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:54 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:54.910460 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-5856be22-e0fb-4444-a337-a6b847729b10 req-5fe0d2ac-4ffb-4f02-89ee-6dcebc2a77cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1650670-237d-4fc5-8faa-2cfa7066ae4c", "tag": "56394358-de2a-4703-af5d-1bfe0096d01f"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:04:54.928380 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5856be22-e0fb-4444-a337-a6b847729b10 req-5fe0d2ac-4ffb-4f02-89ee-6dcebc2a77cd service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:54.929014 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5856be22-e0fb-4444-a337-a6b847729b10 req-5fe0d2ac-4ffb-4f02-89ee-6dcebc2a77cd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:54.929695 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-5856be22-e0fb-4444-a337-a6b847729b10 req-5fe0d2ac-4ffb-4f02-89ee-6dcebc2a77cd service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:54.943714 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-5856be22-e0fb-4444-a337-a6b847729b10 req-5fe0d2ac-4ffb-4f02-89ee-6dcebc2a77cd service nova] Creating event network-changed:56394358-de2a-4703-af5d-1bfe0096d01f for instance c1650670-237d-4fc5-8faa-2cfa7066ae4c on n-h1-860687-3 Oct 27 20:04:54.948860 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-5856be22-e0fb-4444-a337-a6b847729b10 req-5fe0d2ac-4ffb-4f02-89ee-6dcebc2a77cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042544 Oct 27 20:04:54.949733 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4041/7930] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:04:55.661147 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bba79a83-c3d7-4808-a146-b82a1e267704 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:55.661784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bba79a83-c3d7-4808-a146-b82a1e267704 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:55.667836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bba79a83-c3d7-4808-a146-b82a1e267704 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:55.668342 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bba79a83-c3d7-4808-a146-b82a1e267704 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:55.668799 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bba79a83-c3d7-4808-a146-b82a1e267704 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:55.669519 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bba79a83-c3d7-4808-a146-b82a1e267704 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:55.670002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bba79a83-c3d7-4808-a146-b82a1e267704 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:55.670482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bba79a83-c3d7-4808-a146-b82a1e267704 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:55.810525 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bba79a83-c3d7-4808-a146-b82a1e267704 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:55.819273 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bba79a83-c3d7-4808-a146-b82a1e267704 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1370 microversion: 2.1 time: 0.163966 Oct 27 20:04:55.819863 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3890/7931] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:55 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:56.845018 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8eb9fe38-7cd6-48a3-aeec-33614ad58496 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:56.846113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8eb9fe38-7cd6-48a3-aeec-33614ad58496 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:56.852692 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8eb9fe38-7cd6-48a3-aeec-33614ad58496 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:56.853194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8eb9fe38-7cd6-48a3-aeec-33614ad58496 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:56.853676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8eb9fe38-7cd6-48a3-aeec-33614ad58496 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:56.854434 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8eb9fe38-7cd6-48a3-aeec-33614ad58496 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:56.854906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8eb9fe38-7cd6-48a3-aeec-33614ad58496 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:56.855345 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8eb9fe38-7cd6-48a3-aeec-33614ad58496 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:56.994827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8eb9fe38-7cd6-48a3-aeec-33614ad58496 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:57.003298 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8eb9fe38-7cd6-48a3-aeec-33614ad58496 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1370 microversion: 2.1 time: 0.163892 Oct 27 20:04:57.003880 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4042/7932] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:56 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:58.030152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-73799ba2-ccc1-4bf5-b542-9fa9e1f2af54 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:58.030840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-73799ba2-ccc1-4bf5-b542-9fa9e1f2af54 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:58.037912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73799ba2-ccc1-4bf5-b542-9fa9e1f2af54 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:58.038449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73799ba2-ccc1-4bf5-b542-9fa9e1f2af54 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:58.038906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73799ba2-ccc1-4bf5-b542-9fa9e1f2af54 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:58.039615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73799ba2-ccc1-4bf5-b542-9fa9e1f2af54 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:58.040088 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73799ba2-ccc1-4bf5-b542-9fa9e1f2af54 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:58.040533 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73799ba2-ccc1-4bf5-b542-9fa9e1f2af54 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:58.181308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-73799ba2-ccc1-4bf5-b542-9fa9e1f2af54 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:58.189935 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-73799ba2-ccc1-4bf5-b542-9fa9e1f2af54 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1370 microversion: 2.1 time: 0.163908 Oct 27 20:04:58.190552 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3891/7933] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:58 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:59.217391 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-60a8ad24-2c3a-4a9f-904e-ead58ab188cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:04:59.218010 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-60a8ad24-2c3a-4a9f-904e-ead58ab188cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:04:59.224966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60a8ad24-2c3a-4a9f-904e-ead58ab188cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:59.225454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60a8ad24-2c3a-4a9f-904e-ead58ab188cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:59.225902 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60a8ad24-2c3a-4a9f-904e-ead58ab188cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:59.226682 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60a8ad24-2c3a-4a9f-904e-ead58ab188cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:59.227107 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60a8ad24-2c3a-4a9f-904e-ead58ab188cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:59.227543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-60a8ad24-2c3a-4a9f-904e-ead58ab188cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:04:59.362745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-60a8ad24-2c3a-4a9f-904e-ead58ab188cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:04:59.371823 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-60a8ad24-2c3a-4a9f-904e-ead58ab188cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1370 microversion: 2.1 time: 0.158525 Oct 27 20:04:59.372414 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4043/7934] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:04:59 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:04:59.985914 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b926562a-e7d0-45ba-a1a4-f10584d37743 req-1b753455-c781-4299-acf0-f2a5ac25890b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1650670-237d-4fc5-8faa-2cfa7066ae4c", "name": "network-vif-plugged", "status": "completed", "tag": "56394358-de2a-4703-af5d-1bfe0096d01f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:04:59.996321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b926562a-e7d0-45ba-a1a4-f10584d37743 req-1b753455-c781-4299-acf0-f2a5ac25890b service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:04:59.996867 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b926562a-e7d0-45ba-a1a4-f10584d37743 req-1b753455-c781-4299-acf0-f2a5ac25890b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:04:59.997704 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b926562a-e7d0-45ba-a1a4-f10584d37743 req-1b753455-c781-4299-acf0-f2a5ac25890b service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:05:00.011509 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b926562a-e7d0-45ba-a1a4-f10584d37743 req-1b753455-c781-4299-acf0-f2a5ac25890b service nova] Creating event network-vif-plugged:56394358-de2a-4703-af5d-1bfe0096d01f for instance c1650670-237d-4fc5-8faa-2cfa7066ae4c on n-h1-860687-3 Oct 27 20:05:00.016868 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b926562a-e7d0-45ba-a1a4-f10584d37743 req-1b753455-c781-4299-acf0-f2a5ac25890b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097407 Oct 27 20:05:00.018874 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3892/7935] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:05:00.396555 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-12b30ad4-4a79-4453-8ea7-b7055c656cbd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:05:00.397176 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-12b30ad4-4a79-4453-8ea7-b7055c656cbd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:05:00.404119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12b30ad4-4a79-4453-8ea7-b7055c656cbd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:05:00.404612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12b30ad4-4a79-4453-8ea7-b7055c656cbd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:05:00.405059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12b30ad4-4a79-4453-8ea7-b7055c656cbd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:05:00.405762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12b30ad4-4a79-4453-8ea7-b7055c656cbd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:05:00.406226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12b30ad4-4a79-4453-8ea7-b7055c656cbd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:05:00.406696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12b30ad4-4a79-4453-8ea7-b7055c656cbd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:05:00.537773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-12b30ad4-4a79-4453-8ea7-b7055c656cbd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:05:00.545549 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-12b30ad4-4a79-4453-8ea7-b7055c656cbd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1370 microversion: 2.1 time: 0.152991 Oct 27 20:05:00.546127 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4044/7936] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:05:00 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:05:01.570135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-01f52ef6-d04b-47e3-92af-e991f668559e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:05:01.570815 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-01f52ef6-d04b-47e3-92af-e991f668559e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:05:01.577383 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01f52ef6-d04b-47e3-92af-e991f668559e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:05:01.577893 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01f52ef6-d04b-47e3-92af-e991f668559e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:05:01.578358 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01f52ef6-d04b-47e3-92af-e991f668559e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:05:01.579103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01f52ef6-d04b-47e3-92af-e991f668559e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:05:01.579586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01f52ef6-d04b-47e3-92af-e991f668559e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:05:01.580043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-01f52ef6-d04b-47e3-92af-e991f668559e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:05:01.720392 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-01f52ef6-d04b-47e3-92af-e991f668559e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:05:01.728303 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-01f52ef6-d04b-47e3-92af-e991f668559e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1554 microversion: 2.1 time: 0.163584 Oct 27 20:05:01.728888 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3893/7937] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:05:01 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:05:01.751454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-26b1b5e9-501b-4c7f-8034-74480ca685dd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:05:01.752636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-26b1b5e9-501b-4c7f-8034-74480ca685dd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:05:01.759552 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26b1b5e9-501b-4c7f-8034-74480ca685dd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:05:01.760049 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26b1b5e9-501b-4c7f-8034-74480ca685dd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:05:01.760498 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26b1b5e9-501b-4c7f-8034-74480ca685dd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:05:01.761204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26b1b5e9-501b-4c7f-8034-74480ca685dd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:05:01.761670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26b1b5e9-501b-4c7f-8034-74480ca685dd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:05:01.762110 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-26b1b5e9-501b-4c7f-8034-74480ca685dd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:05:01.899042 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-26b1b5e9-501b-4c7f-8034-74480ca685dd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:05:01.906900 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-26b1b5e9-501b-4c7f-8034-74480ca685dd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1554 microversion: 2.1 time: 0.159436 Oct 27 20:05:01.907477 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4045/7938] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:05:01 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:05:03.995140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-610fc554-7bc0-4bdb-8a9d-21459be66260 req-cb2c455d-d09d-4119-a62c-ecf6a51125b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1650670-237d-4fc5-8faa-2cfa7066ae4c", "tag": "56394358-de2a-4703-af5d-1bfe0096d01f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:05:04.000444 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:05:04.008824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-610fc554-7bc0-4bdb-8a9d-21459be66260 req-cb2c455d-d09d-4119-a62c-ecf6a51125b5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:05:04.009591 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-610fc554-7bc0-4bdb-8a9d-21459be66260 req-cb2c455d-d09d-4119-a62c-ecf6a51125b5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:05:04.010047 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-610fc554-7bc0-4bdb-8a9d-21459be66260 req-cb2c455d-d09d-4119-a62c-ecf6a51125b5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:05:04.022786 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-610fc554-7bc0-4bdb-8a9d-21459be66260 req-cb2c455d-d09d-4119-a62c-ecf6a51125b5 service nova] Creating event network-changed:56394358-de2a-4703-af5d-1bfe0096d01f for instance c1650670-237d-4fc5-8faa-2cfa7066ae4c on n-h1-860687-3 Oct 27 20:05:04.028667 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-610fc554-7bc0-4bdb-8a9d-21459be66260 req-cb2c455d-d09d-4119-a62c-ecf6a51125b5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037282 Oct 27 20:05:04.029818 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3894/7939] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:06:59.895473 n-d-860687-3 devstack@n-api.service[127029]: ERROR oslo.messaging._drivers.impl_rabbit [-] [40297e18-f715-404d-a7a8-44159721b4a8] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 20:06:59.896647 n-d-860687-3 devstack@n-api.service[127029]: ERROR oslo.messaging._drivers.impl_rabbit [-] [66fa3103-a1fe-46ef-965e-69c22fe0df2e] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 20:06:59.897011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:06:59.897774 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:06:59.898633 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:06:59.899310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=34 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:06:59.900598 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 20:06:59.900762 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 20:06:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c/action (ip 10.222.0.42) !!! Oct 27 20:06:59.906849 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-03e8e9b3-6e1b-498f-81f8-7fbcbc396705 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:06:59.907400 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-03e8e9b3-6e1b-498f-81f8-7fbcbc396705 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:06:59.917330 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03e8e9b3-6e1b-498f-81f8-7fbcbc396705 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:06:59.917823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03e8e9b3-6e1b-498f-81f8-7fbcbc396705 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:06:59.918266 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03e8e9b3-6e1b-498f-81f8-7fbcbc396705 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:06:59.919011 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03e8e9b3-6e1b-498f-81f8-7fbcbc396705 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:06:59.919477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03e8e9b3-6e1b-498f-81f8-7fbcbc396705 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:06:59.919971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-03e8e9b3-6e1b-498f-81f8-7fbcbc396705 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:06:59.944119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-03e8e9b3-6e1b-498f-81f8-7fbcbc396705 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lazy-loading 'flavor' on Instance uuid c1650670-237d-4fc5-8faa-2cfa7066ae4c {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 20:07:00.145952 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-03e8e9b3-6e1b-498f-81f8-7fbcbc396705 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "POST /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c/action" status: 202 len: 0 microversion: 2.1 time: 0.252072 Oct 27 20:07:00.146534 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4046/7940] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:06:59 2022] POST /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 20:07:00.152948 n-d-860687-3 devstack@n-api.service[127028]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e8240a4d-ecaa-42c4-8b5a-9ab82de7a90d] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 20:07:00.153805 n-d-860687-3 devstack@n-api.service[127028]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a87a1486-b96d-4ed3-afbc-04da999a872c] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 20:07:00.154590 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:07:00.155512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=28 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:07:00.156943 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 20:07:00.157098 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 20:07:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c (ip 10.222.0.42) !!! Oct 27 20:07:00.158098 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 20:07:00.158248 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 20:07:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c (ip 10.222.0.42) !!! Oct 27 20:07:00.164541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-52e92b25-cf7e-4552-bab4-e57f726cb003 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:00.165277 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-52e92b25-cf7e-4552-bab4-e57f726cb003 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:00.176372 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52e92b25-cf7e-4552-bab4-e57f726cb003 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:00.176913 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52e92b25-cf7e-4552-bab4-e57f726cb003 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:00.177378 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52e92b25-cf7e-4552-bab4-e57f726cb003 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:00.178104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52e92b25-cf7e-4552-bab4-e57f726cb003 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:00.178614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52e92b25-cf7e-4552-bab4-e57f726cb003 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:00.179068 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-52e92b25-cf7e-4552-bab4-e57f726cb003 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:00.318797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-52e92b25-cf7e-4552-bab4-e57f726cb003 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:00.326904 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-52e92b25-cf7e-4552-bab4-e57f726cb003 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1678 microversion: 2.1 time: 0.175841 Oct 27 20:07:00.327484 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3895/7941] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:00 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:01.353026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1c445e2e-b093-4b94-aa6f-868006461a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:01.353729 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1c445e2e-b093-4b94-aa6f-868006461a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:01.367874 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] [40297e18-f715-404d-a7a8-44159721b4a8] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38518. Oct 27 20:07:01.369573 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c445e2e-b093-4b94-aa6f-868006461a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:01.370056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c445e2e-b093-4b94-aa6f-868006461a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:01.370523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c445e2e-b093-4b94-aa6f-868006461a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:01.371212 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c445e2e-b093-4b94-aa6f-868006461a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:01.371669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c445e2e-b093-4b94-aa6f-868006461a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:01.372094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1c445e2e-b093-4b94-aa6f-868006461a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:01.373769 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] [66fa3103-a1fe-46ef-965e-69c22fe0df2e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38520. Oct 27 20:07:01.511717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1c445e2e-b093-4b94-aa6f-868006461a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:01.520296 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1c445e2e-b093-4b94-aa6f-868006461a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1678 microversion: 2.1 time: 0.173395 Oct 27 20:07:01.520863 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4047/7942] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:01 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:02.544048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7f5234fd-16d6-4ffc-a44c-b284ea992af7 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:02.545256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7f5234fd-16d6-4ffc-a44c-b284ea992af7 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:02.553923 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f5234fd-16d6-4ffc-a44c-b284ea992af7 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:02.554456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f5234fd-16d6-4ffc-a44c-b284ea992af7 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:02.554919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f5234fd-16d6-4ffc-a44c-b284ea992af7 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:02.555639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f5234fd-16d6-4ffc-a44c-b284ea992af7 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:02.556117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f5234fd-16d6-4ffc-a44c-b284ea992af7 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:02.556573 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7f5234fd-16d6-4ffc-a44c-b284ea992af7 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:02.565127 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] [e8240a4d-ecaa-42c4-8b5a-9ab82de7a90d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38524. Oct 27 20:07:02.565871 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] [a87a1486-b96d-4ed3-afbc-04da999a872c] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38526. Oct 27 20:07:02.692822 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7f5234fd-16d6-4ffc-a44c-b284ea992af7 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:02.701039 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7f5234fd-16d6-4ffc-a44c-b284ea992af7 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1678 microversion: 2.1 time: 0.160900 Oct 27 20:07:02.701791 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3896/7943] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:02 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:03.724783 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2adb5e64-ee89-4da6-812b-357ca6be01f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:03.725394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2adb5e64-ee89-4da6-812b-357ca6be01f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:03.732304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2adb5e64-ee89-4da6-812b-357ca6be01f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:03.733374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2adb5e64-ee89-4da6-812b-357ca6be01f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:03.733814 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2adb5e64-ee89-4da6-812b-357ca6be01f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:03.734526 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2adb5e64-ee89-4da6-812b-357ca6be01f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:03.734981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2adb5e64-ee89-4da6-812b-357ca6be01f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:03.735407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2adb5e64-ee89-4da6-812b-357ca6be01f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:03.869395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2adb5e64-ee89-4da6-812b-357ca6be01f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:03.877380 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2adb5e64-ee89-4da6-812b-357ca6be01f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1678 microversion: 2.1 time: 0.156579 Oct 27 20:07:03.877961 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4048/7944] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:03 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:04.901165 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70233d9d-c0bc-4e22-bffd-c0be8c3a6762 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:04.901802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-70233d9d-c0bc-4e22-bffd-c0be8c3a6762 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:04.909394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70233d9d-c0bc-4e22-bffd-c0be8c3a6762 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:04.909902 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70233d9d-c0bc-4e22-bffd-c0be8c3a6762 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:04.910362 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70233d9d-c0bc-4e22-bffd-c0be8c3a6762 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:04.911106 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70233d9d-c0bc-4e22-bffd-c0be8c3a6762 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:04.911584 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70233d9d-c0bc-4e22-bffd-c0be8c3a6762 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:04.912064 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-70233d9d-c0bc-4e22-bffd-c0be8c3a6762 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:05.050308 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-70233d9d-c0bc-4e22-bffd-c0be8c3a6762 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:05.058142 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70233d9d-c0bc-4e22-bffd-c0be8c3a6762 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1678 microversion: 2.1 time: 0.160977 Oct 27 20:07:05.058759 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3897/7945] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:04 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:06.083239 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-e29d38b2-4fb1-4596-a9ba-0e3e5a66005a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:06.083873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-e29d38b2-4fb1-4596-a9ba-0e3e5a66005a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:06.090691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e29d38b2-4fb1-4596-a9ba-0e3e5a66005a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:06.091192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e29d38b2-4fb1-4596-a9ba-0e3e5a66005a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:06.091820 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e29d38b2-4fb1-4596-a9ba-0e3e5a66005a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:06.092435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e29d38b2-4fb1-4596-a9ba-0e3e5a66005a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:06.092899 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e29d38b2-4fb1-4596-a9ba-0e3e5a66005a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:06.093341 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-e29d38b2-4fb1-4596-a9ba-0e3e5a66005a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:06.301605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-e29d38b2-4fb1-4596-a9ba-0e3e5a66005a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:06.309453 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-e29d38b2-4fb1-4596-a9ba-0e3e5a66005a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1678 microversion: 2.1 time: 0.230176 Oct 27 20:07:06.310031 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4049/7946] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:06 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:07.335022 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dad3d315-9b99-4cda-ade0-0c9b8f7214be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:07.335639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dad3d315-9b99-4cda-ade0-0c9b8f7214be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:07.343257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dad3d315-9b99-4cda-ade0-0c9b8f7214be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:07.343756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dad3d315-9b99-4cda-ade0-0c9b8f7214be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:07.344219 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dad3d315-9b99-4cda-ade0-0c9b8f7214be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:07.344937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dad3d315-9b99-4cda-ade0-0c9b8f7214be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:07.345437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dad3d315-9b99-4cda-ade0-0c9b8f7214be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:07.345885 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dad3d315-9b99-4cda-ade0-0c9b8f7214be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:07.477717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-dad3d315-9b99-4cda-ade0-0c9b8f7214be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:07.485947 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dad3d315-9b99-4cda-ade0-0c9b8f7214be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1678 microversion: 2.1 time: 0.154907 Oct 27 20:07:07.486559 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3898/7947] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:07 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:08.509094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-16c7c086-2235-43ea-97a6-3fffe3aa72a9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:08.509807 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-16c7c086-2235-43ea-97a6-3fffe3aa72a9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:08.516542 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16c7c086-2235-43ea-97a6-3fffe3aa72a9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:08.517028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16c7c086-2235-43ea-97a6-3fffe3aa72a9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:08.517469 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16c7c086-2235-43ea-97a6-3fffe3aa72a9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:08.518162 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16c7c086-2235-43ea-97a6-3fffe3aa72a9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:08.518645 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16c7c086-2235-43ea-97a6-3fffe3aa72a9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:08.519081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16c7c086-2235-43ea-97a6-3fffe3aa72a9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:08.655627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-16c7c086-2235-43ea-97a6-3fffe3aa72a9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:08.663509 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-16c7c086-2235-43ea-97a6-3fffe3aa72a9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1678 microversion: 2.1 time: 0.158373 Oct 27 20:07:08.664098 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4050/7948] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:08 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:09.688417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ab2e508b-df69-47e8-9d2d-eab78e1f467c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:09.688960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ab2e508b-df69-47e8-9d2d-eab78e1f467c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:09.695846 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab2e508b-df69-47e8-9d2d-eab78e1f467c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:09.696353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab2e508b-df69-47e8-9d2d-eab78e1f467c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:09.696817 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab2e508b-df69-47e8-9d2d-eab78e1f467c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:09.697536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab2e508b-df69-47e8-9d2d-eab78e1f467c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:09.698015 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab2e508b-df69-47e8-9d2d-eab78e1f467c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:09.698499 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ab2e508b-df69-47e8-9d2d-eab78e1f467c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:09.831080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ab2e508b-df69-47e8-9d2d-eab78e1f467c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:09.838991 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ab2e508b-df69-47e8-9d2d-eab78e1f467c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1678 microversion: 2.1 time: 0.155363 Oct 27 20:07:09.839578 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3899/7949] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:09 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:10.862481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ba3f1602-c22b-4e37-baed-375f3a0297b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:10.863105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ba3f1602-c22b-4e37-baed-375f3a0297b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:10.870108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba3f1602-c22b-4e37-baed-375f3a0297b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:10.870629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba3f1602-c22b-4e37-baed-375f3a0297b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:10.871080 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba3f1602-c22b-4e37-baed-375f3a0297b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:10.871776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba3f1602-c22b-4e37-baed-375f3a0297b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:10.872241 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba3f1602-c22b-4e37-baed-375f3a0297b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:10.873076 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ba3f1602-c22b-4e37-baed-375f3a0297b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:11.004510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ba3f1602-c22b-4e37-baed-375f3a0297b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:11.012437 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ba3f1602-c22b-4e37-baed-375f3a0297b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1699 microversion: 2.1 time: 0.153895 Oct 27 20:07:11.013010 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4051/7950] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:10 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1699 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:12.037540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-94cec887-144c-4e34-838c-feebade2d01d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:12.038411 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-94cec887-144c-4e34-838c-feebade2d01d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:12.046322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94cec887-144c-4e34-838c-feebade2d01d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:12.046847 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94cec887-144c-4e34-838c-feebade2d01d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:12.047303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94cec887-144c-4e34-838c-feebade2d01d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:12.048011 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94cec887-144c-4e34-838c-feebade2d01d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:12.048486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94cec887-144c-4e34-838c-feebade2d01d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:12.048927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-94cec887-144c-4e34-838c-feebade2d01d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:12.462915 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-94cec887-144c-4e34-838c-feebade2d01d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:12.472212 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-94cec887-144c-4e34-838c-feebade2d01d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1699 microversion: 2.1 time: 0.438581 Oct 27 20:07:12.472811 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3900/7951] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:12 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1699 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:13.496629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-746b085b-4b85-4a11-8216-5cbb95ef0233 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:13.497436 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-746b085b-4b85-4a11-8216-5cbb95ef0233 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:13.505545 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-746b085b-4b85-4a11-8216-5cbb95ef0233 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:13.506069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-746b085b-4b85-4a11-8216-5cbb95ef0233 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:13.506733 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-746b085b-4b85-4a11-8216-5cbb95ef0233 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:13.507765 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-746b085b-4b85-4a11-8216-5cbb95ef0233 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:13.508414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-746b085b-4b85-4a11-8216-5cbb95ef0233 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:13.508858 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-746b085b-4b85-4a11-8216-5cbb95ef0233 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:13.662093 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-746b085b-4b85-4a11-8216-5cbb95ef0233 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:13.670001 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-746b085b-4b85-4a11-8216-5cbb95ef0233 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1694 microversion: 2.1 time: 0.177348 Oct 27 20:07:13.670800 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4052/7952] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:13 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:14.612906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-77c4366e-2955-4062-a7dd-f9a899314973 req-3af32b7b-7f2d-4474-a552-da254426dd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1650670-237d-4fc5-8faa-2cfa7066ae4c", "name": "network-vif-plugged", "status": "completed", "tag": "56394358-de2a-4703-af5d-1bfe0096d01f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:07:14.632426 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-77c4366e-2955-4062-a7dd-f9a899314973 req-3af32b7b-7f2d-4474-a552-da254426dd6f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:14.633394 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-77c4366e-2955-4062-a7dd-f9a899314973 req-3af32b7b-7f2d-4474-a552-da254426dd6f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:14.634144 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-77c4366e-2955-4062-a7dd-f9a899314973 req-3af32b7b-7f2d-4474-a552-da254426dd6f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:14.650082 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-77c4366e-2955-4062-a7dd-f9a899314973 req-3af32b7b-7f2d-4474-a552-da254426dd6f service nova] Creating event network-vif-plugged:56394358-de2a-4703-af5d-1bfe0096d01f for instance c1650670-237d-4fc5-8faa-2cfa7066ae4c on n-h1-860687-3 Oct 27 20:07:14.656786 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-77c4366e-2955-4062-a7dd-f9a899314973 req-3af32b7b-7f2d-4474-a552-da254426dd6f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049017 Oct 27 20:07:14.658531 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3901/7953] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:07:14.695681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-530d6ab4-b158-455e-8d13-c6fab8051f74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:14.696326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-530d6ab4-b158-455e-8d13-c6fab8051f74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:14.705524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-530d6ab4-b158-455e-8d13-c6fab8051f74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:14.706113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-530d6ab4-b158-455e-8d13-c6fab8051f74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:14.706650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-530d6ab4-b158-455e-8d13-c6fab8051f74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:14.707423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-530d6ab4-b158-455e-8d13-c6fab8051f74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:14.707942 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-530d6ab4-b158-455e-8d13-c6fab8051f74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:14.708599 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-530d6ab4-b158-455e-8d13-c6fab8051f74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:14.878122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-530d6ab4-b158-455e-8d13-c6fab8051f74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:14.887325 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-530d6ab4-b158-455e-8d13-c6fab8051f74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1694 microversion: 2.1 time: 0.195811 Oct 27 20:07:14.888815 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4053/7954] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:14 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1694 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:15.919735 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1b2e4e4a-88b4-4a48-9df1-58645bfaf68a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:15.921162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1b2e4e4a-88b4-4a48-9df1-58645bfaf68a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:15.928640 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b2e4e4a-88b4-4a48-9df1-58645bfaf68a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:15.929146 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b2e4e4a-88b4-4a48-9df1-58645bfaf68a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:15.929607 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b2e4e4a-88b4-4a48-9df1-58645bfaf68a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:15.930569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b2e4e4a-88b4-4a48-9df1-58645bfaf68a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:15.931220 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b2e4e4a-88b4-4a48-9df1-58645bfaf68a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:15.931840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b2e4e4a-88b4-4a48-9df1-58645bfaf68a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:16.106043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1b2e4e4a-88b4-4a48-9df1-58645bfaf68a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:16.115862 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1b2e4e4a-88b4-4a48-9df1-58645bfaf68a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1694 microversion: 2.1 time: 0.201714 Oct 27 20:07:16.116479 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3902/7955] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:15 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1694 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:17.140320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-6a54f6e4-7ef6-44db-a2e4-a7f9fb2b193d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:17.140979 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-6a54f6e4-7ef6-44db-a2e4-a7f9fb2b193d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:17.148370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a54f6e4-7ef6-44db-a2e4-a7f9fb2b193d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:17.148961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a54f6e4-7ef6-44db-a2e4-a7f9fb2b193d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:17.149663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a54f6e4-7ef6-44db-a2e4-a7f9fb2b193d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:17.150638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a54f6e4-7ef6-44db-a2e4-a7f9fb2b193d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:17.151343 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a54f6e4-7ef6-44db-a2e4-a7f9fb2b193d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:17.151857 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-6a54f6e4-7ef6-44db-a2e4-a7f9fb2b193d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:17.296994 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-6a54f6e4-7ef6-44db-a2e4-a7f9fb2b193d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:17.305946 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-6a54f6e4-7ef6-44db-a2e4-a7f9fb2b193d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1694 microversion: 2.1 time: 0.170042 Oct 27 20:07:17.306763 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4054/7956] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:17 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:18.331540 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4a382225-d355-44b6-8722-68510f67849c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:18.332181 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4a382225-d355-44b6-8722-68510f67849c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:18.338891 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a382225-d355-44b6-8722-68510f67849c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:18.339412 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a382225-d355-44b6-8722-68510f67849c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:18.339877 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a382225-d355-44b6-8722-68510f67849c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:18.340631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a382225-d355-44b6-8722-68510f67849c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:18.341138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a382225-d355-44b6-8722-68510f67849c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:18.342456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4a382225-d355-44b6-8722-68510f67849c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:18.493489 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4a382225-d355-44b6-8722-68510f67849c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:18.502287 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4a382225-d355-44b6-8722-68510f67849c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1694 microversion: 2.1 time: 0.176502 Oct 27 20:07:18.503034 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3903/7957] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:18 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:19.527493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-06efc3d4-7705-4dcf-8071-624f8a5dfe8d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:19.528215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-06efc3d4-7705-4dcf-8071-624f8a5dfe8d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:19.535640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06efc3d4-7705-4dcf-8071-624f8a5dfe8d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:19.536133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06efc3d4-7705-4dcf-8071-624f8a5dfe8d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:19.536570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06efc3d4-7705-4dcf-8071-624f8a5dfe8d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:19.538194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06efc3d4-7705-4dcf-8071-624f8a5dfe8d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:19.538194 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06efc3d4-7705-4dcf-8071-624f8a5dfe8d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:19.538440 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06efc3d4-7705-4dcf-8071-624f8a5dfe8d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:19.689317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-06efc3d4-7705-4dcf-8071-624f8a5dfe8d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:19.697492 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-06efc3d4-7705-4dcf-8071-624f8a5dfe8d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1694 microversion: 2.1 time: 0.174163 Oct 27 20:07:19.717197 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4055/7958] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:19 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:20.724302 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-062432b5-3f63-49a1-b3ad-f9bd3cc0a968 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:20.724975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-062432b5-3f63-49a1-b3ad-f9bd3cc0a968 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:20.731738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-062432b5-3f63-49a1-b3ad-f9bd3cc0a968 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:20.732256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-062432b5-3f63-49a1-b3ad-f9bd3cc0a968 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:20.732709 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-062432b5-3f63-49a1-b3ad-f9bd3cc0a968 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:20.733446 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-062432b5-3f63-49a1-b3ad-f9bd3cc0a968 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:20.733918 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-062432b5-3f63-49a1-b3ad-f9bd3cc0a968 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:20.734371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-062432b5-3f63-49a1-b3ad-f9bd3cc0a968 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:20.882832 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-062432b5-3f63-49a1-b3ad-f9bd3cc0a968 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:20.893533 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-062432b5-3f63-49a1-b3ad-f9bd3cc0a968 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1694 microversion: 2.1 time: 0.173046 Oct 27 20:07:20.910417 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3904/7959] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:20 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:21.918418 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-542d4df9-9c98-4aa4-a349-33a601dd76eb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:21.919028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-542d4df9-9c98-4aa4-a349-33a601dd76eb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:21.933602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-542d4df9-9c98-4aa4-a349-33a601dd76eb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:21.934105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-542d4df9-9c98-4aa4-a349-33a601dd76eb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:21.934574 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-542d4df9-9c98-4aa4-a349-33a601dd76eb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:21.936001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-542d4df9-9c98-4aa4-a349-33a601dd76eb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:21.936456 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-542d4df9-9c98-4aa4-a349-33a601dd76eb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:21.936888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-542d4df9-9c98-4aa4-a349-33a601dd76eb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:22.091218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-542d4df9-9c98-4aa4-a349-33a601dd76eb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:22.099878 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-542d4df9-9c98-4aa4-a349-33a601dd76eb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1694 microversion: 2.1 time: 0.185323 Oct 27 20:07:22.100344 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4056/7960] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:21 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1694 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:23.125764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1d6079a3-55ea-4e6b-9aa2-abf2e852f3d2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:23.126419 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1d6079a3-55ea-4e6b-9aa2-abf2e852f3d2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:23.133399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d6079a3-55ea-4e6b-9aa2-abf2e852f3d2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:23.133906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d6079a3-55ea-4e6b-9aa2-abf2e852f3d2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:23.134438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d6079a3-55ea-4e6b-9aa2-abf2e852f3d2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:23.135112 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d6079a3-55ea-4e6b-9aa2-abf2e852f3d2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:23.135588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d6079a3-55ea-4e6b-9aa2-abf2e852f3d2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:23.136043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d6079a3-55ea-4e6b-9aa2-abf2e852f3d2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:23.277625 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1d6079a3-55ea-4e6b-9aa2-abf2e852f3d2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:23.289334 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1d6079a3-55ea-4e6b-9aa2-abf2e852f3d2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1676 microversion: 2.1 time: 0.167944 Oct 27 20:07:23.290978 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3905/7961] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:23 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:24.315238 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-24841a52-9f0c-4592-aa92-ef1ada9898ff tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:24.315968 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-24841a52-9f0c-4592-aa92-ef1ada9898ff tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:24.322861 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24841a52-9f0c-4592-aa92-ef1ada9898ff tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:24.323351 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24841a52-9f0c-4592-aa92-ef1ada9898ff tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:24.323792 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24841a52-9f0c-4592-aa92-ef1ada9898ff tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:24.324741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24841a52-9f0c-4592-aa92-ef1ada9898ff tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:24.325198 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24841a52-9f0c-4592-aa92-ef1ada9898ff tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:24.326237 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-24841a52-9f0c-4592-aa92-ef1ada9898ff tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:24.461228 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-24841a52-9f0c-4592-aa92-ef1ada9898ff tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:24.470191 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-24841a52-9f0c-4592-aa92-ef1ada9898ff tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1676 microversion: 2.1 time: 0.158990 Oct 27 20:07:24.471833 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4057/7962] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:24 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:25.495163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e9622d83-7416-4fb9-9fc9-8f615c47642e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:25.495796 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e9622d83-7416-4fb9-9fc9-8f615c47642e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:25.503259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9622d83-7416-4fb9-9fc9-8f615c47642e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:25.503800 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9622d83-7416-4fb9-9fc9-8f615c47642e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:25.504259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9622d83-7416-4fb9-9fc9-8f615c47642e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:25.504972 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9622d83-7416-4fb9-9fc9-8f615c47642e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:25.505443 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9622d83-7416-4fb9-9fc9-8f615c47642e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:25.505888 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9622d83-7416-4fb9-9fc9-8f615c47642e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:25.637079 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e9622d83-7416-4fb9-9fc9-8f615c47642e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:25.645177 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e9622d83-7416-4fb9-9fc9-8f615c47642e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1619 microversion: 2.1 time: 0.153964 Oct 27 20:07:25.645762 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3906/7963] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:25 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1619 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:25.668013 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8d5b5361-329c-4ae2-996a-00fae401247c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:07:25.668624 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8d5b5361-329c-4ae2-996a-00fae401247c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:25.676126 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d5b5361-329c-4ae2-996a-00fae401247c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:25.676608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d5b5361-329c-4ae2-996a-00fae401247c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:25.677043 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d5b5361-329c-4ae2-996a-00fae401247c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:25.677755 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d5b5361-329c-4ae2-996a-00fae401247c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:25.678193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d5b5361-329c-4ae2-996a-00fae401247c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:25.678650 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8d5b5361-329c-4ae2-996a-00fae401247c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:25.722873 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8d5b5361-329c-4ae2-996a-00fae401247c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127029) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 20:07:26.042842 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8d5b5361-329c-4ae2-996a-00fae401247c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "POST /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c/action" status: 202 len: 0 microversion: 2.1 time: 0.378239 Oct 27 20:07:26.043371 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4058/7964] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:07:25 2022] POST /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 20:07:26.051904 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e00d7829-3225-4f92-9675-4fe9d008662c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:26.052744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e00d7829-3225-4f92-9675-4fe9d008662c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:26.059140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e00d7829-3225-4f92-9675-4fe9d008662c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:26.060016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e00d7829-3225-4f92-9675-4fe9d008662c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:26.060545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e00d7829-3225-4f92-9675-4fe9d008662c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:26.061268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e00d7829-3225-4f92-9675-4fe9d008662c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:26.061753 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e00d7829-3225-4f92-9675-4fe9d008662c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:26.062235 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e00d7829-3225-4f92-9675-4fe9d008662c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:26.197578 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e00d7829-3225-4f92-9675-4fe9d008662c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:26.206513 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e00d7829-3225-4f92-9675-4fe9d008662c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1627 microversion: 2.1 time: 0.158592 Oct 27 20:07:26.222492 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3907/7965] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:26 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1627 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:26.604501 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-cb5e5abd-e082-44af-9e9a-1de5c800c6d0 req-51de4ef0-cb85-4425-bb56-a23eb21f08f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1650670-237d-4fc5-8faa-2cfa7066ae4c", "name": "network-vif-unplugged", "status": "completed", "tag": "56394358-de2a-4703-af5d-1bfe0096d01f"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:07:26.615140 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cb5e5abd-e082-44af-9e9a-1de5c800c6d0 req-51de4ef0-cb85-4425-bb56-a23eb21f08f2 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:26.615853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cb5e5abd-e082-44af-9e9a-1de5c800c6d0 req-51de4ef0-cb85-4425-bb56-a23eb21f08f2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:26.616484 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-cb5e5abd-e082-44af-9e9a-1de5c800c6d0 req-51de4ef0-cb85-4425-bb56-a23eb21f08f2 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:26.630871 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.compute.server_external_events [req-cb5e5abd-e082-44af-9e9a-1de5c800c6d0 req-51de4ef0-cb85-4425-bb56-a23eb21f08f2 service nova] Unable to find a host for instance c1650670-237d-4fc5-8faa-2cfa7066ae4c. Dropping event network-vif-unplugged {{(pid=127029) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 20:07:26.631767 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-cb5e5abd-e082-44af-9e9a-1de5c800c6d0 req-51de4ef0-cb85-4425-bb56-a23eb21f08f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031304 Oct 27 20:07:26.632500 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4059/7966] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 20:07:27.230136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bea0020b-d26a-407c-9a8c-70bf96156fbc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:27.230806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bea0020b-d26a-407c-9a8c-70bf96156fbc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:27.238180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bea0020b-d26a-407c-9a8c-70bf96156fbc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:27.238718 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bea0020b-d26a-407c-9a8c-70bf96156fbc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:27.239172 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bea0020b-d26a-407c-9a8c-70bf96156fbc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:27.239880 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bea0020b-d26a-407c-9a8c-70bf96156fbc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:27.240349 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bea0020b-d26a-407c-9a8c-70bf96156fbc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:27.240791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bea0020b-d26a-407c-9a8c-70bf96156fbc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:27.377747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bea0020b-d26a-407c-9a8c-70bf96156fbc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:27.385638 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bea0020b-d26a-407c-9a8c-70bf96156fbc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.159404 Oct 27 20:07:27.386216 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3908/7967] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:27 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:28.184174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-27c2ed70-2b0d-4787-aa5f-9488b0e82273 req-b46dacaf-81fd-4b24-a465-41740f0eb08f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1650670-237d-4fc5-8faa-2cfa7066ae4c", "tag": "56394358-de2a-4703-af5d-1bfe0096d01f"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:07:28.195997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-27c2ed70-2b0d-4787-aa5f-9488b0e82273 req-b46dacaf-81fd-4b24-a465-41740f0eb08f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:28.196481 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-27c2ed70-2b0d-4787-aa5f-9488b0e82273 req-b46dacaf-81fd-4b24-a465-41740f0eb08f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:28.196934 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-27c2ed70-2b0d-4787-aa5f-9488b0e82273 req-b46dacaf-81fd-4b24-a465-41740f0eb08f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:28.201806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:07:28.209709 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-27c2ed70-2b0d-4787-aa5f-9488b0e82273 req-b46dacaf-81fd-4b24-a465-41740f0eb08f service nova] Creating event network-changed:56394358-de2a-4703-af5d-1bfe0096d01f for instance c1650670-237d-4fc5-8faa-2cfa7066ae4c on n-h2-860687-3 Oct 27 20:07:28.215819 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-27c2ed70-2b0d-4787-aa5f-9488b0e82273 req-b46dacaf-81fd-4b24-a465-41740f0eb08f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035282 Oct 27 20:07:28.216433 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4060/7968] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:07:28.410138 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-af317a25-72d3-47b4-96c9-cbaf08708910 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:28.410786 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-af317a25-72d3-47b4-96c9-cbaf08708910 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:28.417552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af317a25-72d3-47b4-96c9-cbaf08708910 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:28.418056 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af317a25-72d3-47b4-96c9-cbaf08708910 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:28.418564 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af317a25-72d3-47b4-96c9-cbaf08708910 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:28.420556 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af317a25-72d3-47b4-96c9-cbaf08708910 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:28.421104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af317a25-72d3-47b4-96c9-cbaf08708910 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:28.421558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af317a25-72d3-47b4-96c9-cbaf08708910 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:28.562454 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-af317a25-72d3-47b4-96c9-cbaf08708910 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:28.570681 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-af317a25-72d3-47b4-96c9-cbaf08708910 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.164438 Oct 27 20:07:28.571261 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3909/7969] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:28 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:29.596292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3b42eee8-58e9-4b0c-a99a-3ed3ccd375f6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:29.597848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3b42eee8-58e9-4b0c-a99a-3ed3ccd375f6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:29.607601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b42eee8-58e9-4b0c-a99a-3ed3ccd375f6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:29.608193 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b42eee8-58e9-4b0c-a99a-3ed3ccd375f6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:29.608539 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b42eee8-58e9-4b0c-a99a-3ed3ccd375f6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:29.609253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b42eee8-58e9-4b0c-a99a-3ed3ccd375f6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:29.609714 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b42eee8-58e9-4b0c-a99a-3ed3ccd375f6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:29.610142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3b42eee8-58e9-4b0c-a99a-3ed3ccd375f6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:29.759710 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3b42eee8-58e9-4b0c-a99a-3ed3ccd375f6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:29.768697 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3b42eee8-58e9-4b0c-a99a-3ed3ccd375f6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.177552 Oct 27 20:07:29.769564 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4061/7970] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:29 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:30.793690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4537086a-d1be-4deb-9d23-35aa9e892d59 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:30.794663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4537086a-d1be-4deb-9d23-35aa9e892d59 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:30.797284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=31 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:07:30.803259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4537086a-d1be-4deb-9d23-35aa9e892d59 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:30.803770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4537086a-d1be-4deb-9d23-35aa9e892d59 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:30.804317 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4537086a-d1be-4deb-9d23-35aa9e892d59 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:30.805099 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4537086a-d1be-4deb-9d23-35aa9e892d59 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:30.805802 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4537086a-d1be-4deb-9d23-35aa9e892d59 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:30.806257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4537086a-d1be-4deb-9d23-35aa9e892d59 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:30.809179 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=87 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:07:30.957791 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4537086a-d1be-4deb-9d23-35aa9e892d59 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:30.967310 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4537086a-d1be-4deb-9d23-35aa9e892d59 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.176337 Oct 27 20:07:30.982140 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3910/7971] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:30 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:31.991627 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-470c2f4d-2270-4efb-a00d-6fc3fedc60ed tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:31.992231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-470c2f4d-2270-4efb-a00d-6fc3fedc60ed tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:31.994508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:07:32.000543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-470c2f4d-2270-4efb-a00d-6fc3fedc60ed tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:32.001046 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-470c2f4d-2270-4efb-a00d-6fc3fedc60ed tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:32.001492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-470c2f4d-2270-4efb-a00d-6fc3fedc60ed tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:32.002207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-470c2f4d-2270-4efb-a00d-6fc3fedc60ed tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:32.002699 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-470c2f4d-2270-4efb-a00d-6fc3fedc60ed tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:32.003139 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-470c2f4d-2270-4efb-a00d-6fc3fedc60ed tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:32.146204 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-470c2f4d-2270-4efb-a00d-6fc3fedc60ed tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:32.155179 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-470c2f4d-2270-4efb-a00d-6fc3fedc60ed tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.167901 Oct 27 20:07:32.156019 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4062/7972] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:31 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:33.180164 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e1aaef36-822c-4ad0-ac0d-09ce24ec8696 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:33.180797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e1aaef36-822c-4ad0-ac0d-09ce24ec8696 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:33.188198 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1aaef36-822c-4ad0-ac0d-09ce24ec8696 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:33.188821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1aaef36-822c-4ad0-ac0d-09ce24ec8696 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:33.189389 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1aaef36-822c-4ad0-ac0d-09ce24ec8696 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:33.190221 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1aaef36-822c-4ad0-ac0d-09ce24ec8696 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:33.190818 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1aaef36-822c-4ad0-ac0d-09ce24ec8696 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:33.191335 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1aaef36-822c-4ad0-ac0d-09ce24ec8696 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:33.335576 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e1aaef36-822c-4ad0-ac0d-09ce24ec8696 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:33.345209 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e1aaef36-822c-4ad0-ac0d-09ce24ec8696 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.169120 Oct 27 20:07:33.346200 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3911/7973] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:33 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:34.377776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8e7a6347-692e-44f3-b0db-b8d683c17a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:34.378671 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8e7a6347-692e-44f3-b0db-b8d683c17a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:34.384827 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e7a6347-692e-44f3-b0db-b8d683c17a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:34.385331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e7a6347-692e-44f3-b0db-b8d683c17a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:34.385777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e7a6347-692e-44f3-b0db-b8d683c17a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:34.386518 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e7a6347-692e-44f3-b0db-b8d683c17a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:34.386981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e7a6347-692e-44f3-b0db-b8d683c17a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:34.387642 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8e7a6347-692e-44f3-b0db-b8d683c17a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:34.537168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8e7a6347-692e-44f3-b0db-b8d683c17a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:34.545710 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8e7a6347-692e-44f3-b0db-b8d683c17a74 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.174017 Oct 27 20:07:34.546540 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4063/7974] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:34 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:35.570141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-354de8cf-3eeb-49db-96ca-47ce93833b3e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:35.571464 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-354de8cf-3eeb-49db-96ca-47ce93833b3e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:35.579615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-354de8cf-3eeb-49db-96ca-47ce93833b3e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:35.580135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-354de8cf-3eeb-49db-96ca-47ce93833b3e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:35.580605 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-354de8cf-3eeb-49db-96ca-47ce93833b3e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:35.581348 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-354de8cf-3eeb-49db-96ca-47ce93833b3e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:35.581829 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-354de8cf-3eeb-49db-96ca-47ce93833b3e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:35.582284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-354de8cf-3eeb-49db-96ca-47ce93833b3e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:35.728080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-354de8cf-3eeb-49db-96ca-47ce93833b3e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:35.736598 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-354de8cf-3eeb-49db-96ca-47ce93833b3e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.170359 Oct 27 20:07:35.737198 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3912/7975] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:35 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 20:07:36.763318 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7eb5924a-1d1e-4b42-80fd-9f9fbbf8da78 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:36.764372 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7eb5924a-1d1e-4b42-80fd-9f9fbbf8da78 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:36.772471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb5924a-1d1e-4b42-80fd-9f9fbbf8da78 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:36.772471 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb5924a-1d1e-4b42-80fd-9f9fbbf8da78 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:36.772909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb5924a-1d1e-4b42-80fd-9f9fbbf8da78 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:36.780116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb5924a-1d1e-4b42-80fd-9f9fbbf8da78 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:36.780116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb5924a-1d1e-4b42-80fd-9f9fbbf8da78 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:36.780116 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7eb5924a-1d1e-4b42-80fd-9f9fbbf8da78 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:36.958524 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7eb5924a-1d1e-4b42-80fd-9f9fbbf8da78 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:36.968009 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7eb5924a-1d1e-4b42-80fd-9f9fbbf8da78 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.207798 Oct 27 20:07:36.968979 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4064/7976] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:36 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:37.991912 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-77ff3650-f742-4bfe-aed2-422ef7025d0d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:37.992574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-77ff3650-f742-4bfe-aed2-422ef7025d0d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:38.000518 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77ff3650-f742-4bfe-aed2-422ef7025d0d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:38.001033 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77ff3650-f742-4bfe-aed2-422ef7025d0d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:38.001496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77ff3650-f742-4bfe-aed2-422ef7025d0d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:38.002216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77ff3650-f742-4bfe-aed2-422ef7025d0d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:38.002732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77ff3650-f742-4bfe-aed2-422ef7025d0d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:38.003209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77ff3650-f742-4bfe-aed2-422ef7025d0d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:38.137999 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-77ff3650-f742-4bfe-aed2-422ef7025d0d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:38.146229 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-77ff3650-f742-4bfe-aed2-422ef7025d0d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.158213 Oct 27 20:07:38.146903 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3913/7977] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:37 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:39.172006 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-83d97255-d071-47be-937d-647b42dc5579 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:39.172665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-83d97255-d071-47be-937d-647b42dc5579 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:39.179535 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d97255-d071-47be-937d-647b42dc5579 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:39.180031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d97255-d071-47be-937d-647b42dc5579 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:39.180479 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d97255-d071-47be-937d-647b42dc5579 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:39.181186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d97255-d071-47be-937d-647b42dc5579 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:39.181649 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d97255-d071-47be-937d-647b42dc5579 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:39.182081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-83d97255-d071-47be-937d-647b42dc5579 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:39.406416 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-83d97255-d071-47be-937d-647b42dc5579 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:39.414496 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-83d97255-d071-47be-937d-647b42dc5579 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.247252 Oct 27 20:07:39.415656 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4065/7978] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:39 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:40.440042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1638c492-eba5-460d-ad5c-772eb8f259cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:40.440681 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1638c492-eba5-460d-ad5c-772eb8f259cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:40.447557 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1638c492-eba5-460d-ad5c-772eb8f259cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:40.448063 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1638c492-eba5-460d-ad5c-772eb8f259cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:40.448524 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1638c492-eba5-460d-ad5c-772eb8f259cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:40.449510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1638c492-eba5-460d-ad5c-772eb8f259cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:40.450635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1638c492-eba5-460d-ad5c-772eb8f259cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:40.451207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1638c492-eba5-460d-ad5c-772eb8f259cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:40.585601 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-1638c492-eba5-460d-ad5c-772eb8f259cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:40.594066 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1638c492-eba5-460d-ad5c-772eb8f259cf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.158013 Oct 27 20:07:40.594673 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3914/7979] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:40 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:41.616795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0a1f65b0-7636-4f4e-94d4-bea406d2c2bd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:41.617409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0a1f65b0-7636-4f4e-94d4-bea406d2c2bd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:41.624939 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a1f65b0-7636-4f4e-94d4-bea406d2c2bd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:41.625431 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a1f65b0-7636-4f4e-94d4-bea406d2c2bd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:41.625875 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a1f65b0-7636-4f4e-94d4-bea406d2c2bd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:41.626598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a1f65b0-7636-4f4e-94d4-bea406d2c2bd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:41.627064 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a1f65b0-7636-4f4e-94d4-bea406d2c2bd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:41.627492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0a1f65b0-7636-4f4e-94d4-bea406d2c2bd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:41.759590 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0a1f65b0-7636-4f4e-94d4-bea406d2c2bd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:41.767447 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0a1f65b0-7636-4f4e-94d4-bea406d2c2bd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.154534 Oct 27 20:07:41.768014 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4066/7980] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:41 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:42.791581 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d34a4364-f374-4c3b-85b3-f6223bad7360 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:42.792251 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d34a4364-f374-4c3b-85b3-f6223bad7360 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:42.799322 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34a4364-f374-4c3b-85b3-f6223bad7360 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:42.799854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34a4364-f374-4c3b-85b3-f6223bad7360 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:42.800343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34a4364-f374-4c3b-85b3-f6223bad7360 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:42.801128 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34a4364-f374-4c3b-85b3-f6223bad7360 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:42.801613 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34a4364-f374-4c3b-85b3-f6223bad7360 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:42.802070 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d34a4364-f374-4c3b-85b3-f6223bad7360 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:42.936732 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d34a4364-f374-4c3b-85b3-f6223bad7360 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:42.944943 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d34a4364-f374-4c3b-85b3-f6223bad7360 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.157616 Oct 27 20:07:42.945571 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3915/7981] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:42 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:43.970879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ce3a5c91-23d4-428f-a578-70a64e20fdd8 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:43.971492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ce3a5c91-23d4-428f-a578-70a64e20fdd8 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:43.978752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce3a5c91-23d4-428f-a578-70a64e20fdd8 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:43.979250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce3a5c91-23d4-428f-a578-70a64e20fdd8 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:43.979691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce3a5c91-23d4-428f-a578-70a64e20fdd8 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:43.980401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce3a5c91-23d4-428f-a578-70a64e20fdd8 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:43.980867 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce3a5c91-23d4-428f-a578-70a64e20fdd8 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:43.981427 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ce3a5c91-23d4-428f-a578-70a64e20fdd8 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:44.124207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ce3a5c91-23d4-428f-a578-70a64e20fdd8 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:44.132124 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ce3a5c91-23d4-428f-a578-70a64e20fdd8 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.166551 Oct 27 20:07:44.132706 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4067/7982] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:43 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:45.156671 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-88ea6c1b-3982-493f-8188-4cc30f79acf2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:45.157312 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-88ea6c1b-3982-493f-8188-4cc30f79acf2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:45.164417 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88ea6c1b-3982-493f-8188-4cc30f79acf2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:45.164929 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88ea6c1b-3982-493f-8188-4cc30f79acf2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:45.165393 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88ea6c1b-3982-493f-8188-4cc30f79acf2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:45.166115 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88ea6c1b-3982-493f-8188-4cc30f79acf2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:45.166630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88ea6c1b-3982-493f-8188-4cc30f79acf2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:45.167095 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88ea6c1b-3982-493f-8188-4cc30f79acf2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:45.301130 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-88ea6c1b-3982-493f-8188-4cc30f79acf2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:45.308926 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-88ea6c1b-3982-493f-8188-4cc30f79acf2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.156915 Oct 27 20:07:45.309664 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3916/7983] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:45 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:45.506041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-3f73b4c7-269b-448b-ad74-849590b4bacb req-b9746f3b-628b-47f4-baa2-a9bd38213987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1650670-237d-4fc5-8faa-2cfa7066ae4c", "name": "network-vif-plugged", "status": "completed", "tag": "56394358-de2a-4703-af5d-1bfe0096d01f"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:07:45.518607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3f73b4c7-269b-448b-ad74-849590b4bacb req-b9746f3b-628b-47f4-baa2-a9bd38213987 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:45.519106 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3f73b4c7-269b-448b-ad74-849590b4bacb req-b9746f3b-628b-47f4-baa2-a9bd38213987 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:45.519543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-3f73b4c7-269b-448b-ad74-849590b4bacb req-b9746f3b-628b-47f4-baa2-a9bd38213987 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:45.531050 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-3f73b4c7-269b-448b-ad74-849590b4bacb req-b9746f3b-628b-47f4-baa2-a9bd38213987 service nova] Creating event network-vif-plugged:56394358-de2a-4703-af5d-1bfe0096d01f for instance c1650670-237d-4fc5-8faa-2cfa7066ae4c on n-h2-860687-3 Oct 27 20:07:45.536468 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-3f73b4c7-269b-448b-ad74-849590b4bacb req-b9746f3b-628b-47f4-baa2-a9bd38213987 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034317 Oct 27 20:07:45.537418 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4068/7984] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:07:46.333295 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-edf27b3c-9175-4c64-9a65-0bf147578aad tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:46.333959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-edf27b3c-9175-4c64-9a65-0bf147578aad tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:46.341656 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edf27b3c-9175-4c64-9a65-0bf147578aad tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:46.342163 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edf27b3c-9175-4c64-9a65-0bf147578aad tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:46.342651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edf27b3c-9175-4c64-9a65-0bf147578aad tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:46.343366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edf27b3c-9175-4c64-9a65-0bf147578aad tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:46.343838 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edf27b3c-9175-4c64-9a65-0bf147578aad tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:46.344285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-edf27b3c-9175-4c64-9a65-0bf147578aad tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:46.479366 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-edf27b3c-9175-4c64-9a65-0bf147578aad tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:46.487388 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-edf27b3c-9175-4c64-9a65-0bf147578aad tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.158038 Oct 27 20:07:46.487973 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3917/7985] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:46 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:47.513608 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-201d7260-b7ec-4772-911f-01d82a9b0480 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:47.514519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-201d7260-b7ec-4772-911f-01d82a9b0480 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:47.521808 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-201d7260-b7ec-4772-911f-01d82a9b0480 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:47.522299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-201d7260-b7ec-4772-911f-01d82a9b0480 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:47.522773 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-201d7260-b7ec-4772-911f-01d82a9b0480 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:47.523618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-201d7260-b7ec-4772-911f-01d82a9b0480 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:47.524009 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-201d7260-b7ec-4772-911f-01d82a9b0480 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:47.524605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-201d7260-b7ec-4772-911f-01d82a9b0480 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:47.669530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-201d7260-b7ec-4772-911f-01d82a9b0480 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:47.677417 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-201d7260-b7ec-4772-911f-01d82a9b0480 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1685 microversion: 2.1 time: 0.168399 Oct 27 20:07:47.677996 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4069/7986] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:47 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:07:48.701407 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-15408dfb-8c3e-46fd-a676-846bf6bace68 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:07:48.702039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-15408dfb-8c3e-46fd-a676-846bf6bace68 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:07:48.708899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15408dfb-8c3e-46fd-a676-846bf6bace68 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:48.709400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15408dfb-8c3e-46fd-a676-846bf6bace68 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:48.709856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15408dfb-8c3e-46fd-a676-846bf6bace68 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:48.710595 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15408dfb-8c3e-46fd-a676-846bf6bace68 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:07:48.711066 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15408dfb-8c3e-46fd-a676-846bf6bace68 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:07:48.711509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-15408dfb-8c3e-46fd-a676-846bf6bace68 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:07:48.845837 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-15408dfb-8c3e-46fd-a676-846bf6bace68 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:07:48.853582 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-15408dfb-8c3e-46fd-a676-846bf6bace68 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1672 microversion: 2.1 time: 0.156634 Oct 27 20:07:48.854162 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3918/7987] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:07:48 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:09:34.060669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=15 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:09:34.061821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=50 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:09:34.067016 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a5318c7b-2f9a-4436-ad00-a3c2255291d9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:09:34.067186 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-480ca16a-188f-450c-b312-1c71366f56af req-eda548a8-9f7c-483d-98a1-29415846ded7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1650670-237d-4fc5-8faa-2cfa7066ae4c", "tag": "56394358-de2a-4703-af5d-1bfe0096d01f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:09:34.067604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a5318c7b-2f9a-4436-ad00-a3c2255291d9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:09:34.073793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=17 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:09:34.075021 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=53 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:09:34.076370 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 20:09:34.076515 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 20:09:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 27 20:09:34.076615 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5318c7b-2f9a-4436-ad00-a3c2255291d9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:34.077123 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5318c7b-2f9a-4436-ad00-a3c2255291d9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:34.078462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5318c7b-2f9a-4436-ad00-a3c2255291d9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:34.079271 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5318c7b-2f9a-4436-ad00-a3c2255291d9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:34.079833 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5318c7b-2f9a-4436-ad00-a3c2255291d9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:34.080282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a5318c7b-2f9a-4436-ad00-a3c2255291d9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:34.090498 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-480ca16a-188f-450c-b312-1c71366f56af req-eda548a8-9f7c-483d-98a1-29415846ded7 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:34.091007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-480ca16a-188f-450c-b312-1c71366f56af req-eda548a8-9f7c-483d-98a1-29415846ded7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:34.091461 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-480ca16a-188f-450c-b312-1c71366f56af req-eda548a8-9f7c-483d-98a1-29415846ded7 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:34.104517 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-480ca16a-188f-450c-b312-1c71366f56af req-eda548a8-9f7c-483d-98a1-29415846ded7 service nova] Creating event network-changed:56394358-de2a-4703-af5d-1bfe0096d01f for instance c1650670-237d-4fc5-8faa-2cfa7066ae4c on n-h2-860687-3 Oct 27 20:09:34.109816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a5318c7b-2f9a-4436-ad00-a3c2255291d9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Going to try to terminate instance {{(pid=127029) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 20:09:34.111185 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-480ca16a-188f-450c-b312-1c71366f56af req-eda548a8-9f7c-483d-98a1-29415846ded7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050312 Oct 27 20:09:34.112193 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3919/7988] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 20:09:34.209013 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a5318c7b-2f9a-4436-ad00-a3c2255291d9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 204 len: 0 microversion: 2.1 time: 0.150950 Oct 27 20:09:34.210143 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4070/7989] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 20:09:34 2022] DELETE /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 20:09:34.221703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ac0d143a-6ab7-4c01-98e2-b65c6d5d8c12 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:09:34.222643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ac0d143a-6ab7-4c01-98e2-b65c6d5d8c12 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:09:34.232280 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0d143a-6ab7-4c01-98e2-b65c6d5d8c12 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:34.233207 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0d143a-6ab7-4c01-98e2-b65c6d5d8c12 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:34.233758 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0d143a-6ab7-4c01-98e2-b65c6d5d8c12 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:34.235964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0d143a-6ab7-4c01-98e2-b65c6d5d8c12 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:34.235964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0d143a-6ab7-4c01-98e2-b65c6d5d8c12 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:34.235964 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ac0d143a-6ab7-4c01-98e2-b65c6d5d8c12 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:34.464712 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-ac0d143a-6ab7-4c01-98e2-b65c6d5d8c12 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:09:34.472552 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ac0d143a-6ab7-4c01-98e2-b65c6d5d8c12 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1678 microversion: 2.1 time: 0.255275 Oct 27 20:09:34.473143 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3920/7990] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:09:34 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1678 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:09:35.497143 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ee8509a7-417a-496b-8ad6-0fc244ce689a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:09:35.497878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ee8509a7-417a-496b-8ad6-0fc244ce689a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:09:35.504835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee8509a7-417a-496b-8ad6-0fc244ce689a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:35.505334 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee8509a7-417a-496b-8ad6-0fc244ce689a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:35.505785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee8509a7-417a-496b-8ad6-0fc244ce689a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:35.506521 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee8509a7-417a-496b-8ad6-0fc244ce689a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:35.506990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee8509a7-417a-496b-8ad6-0fc244ce689a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:35.507428 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ee8509a7-417a-496b-8ad6-0fc244ce689a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:35.702433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ee8509a7-417a-496b-8ad6-0fc244ce689a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:09:35.710275 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ee8509a7-417a-496b-8ad6-0fc244ce689a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1678 microversion: 2.1 time: 0.217570 Oct 27 20:09:35.710890 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4071/7991] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:09:35 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:09:36.358017 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-0915b539-eded-4289-93cb-8a28f8c5c102 req-0520fcb6-b22e-46a8-8e20-cbfc891e5062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1650670-237d-4fc5-8faa-2cfa7066ae4c", "name": "network-vif-deleted", "tag": "56394358-de2a-4703-af5d-1bfe0096d01f"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:09:36.368040 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0915b539-eded-4289-93cb-8a28f8c5c102 req-0520fcb6-b22e-46a8-8e20-cbfc891e5062 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:36.368610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0915b539-eded-4289-93cb-8a28f8c5c102 req-0520fcb6-b22e-46a8-8e20-cbfc891e5062 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:36.369062 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0915b539-eded-4289-93cb-8a28f8c5c102 req-0520fcb6-b22e-46a8-8e20-cbfc891e5062 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:36.380792 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-0915b539-eded-4289-93cb-8a28f8c5c102 req-0520fcb6-b22e-46a8-8e20-cbfc891e5062 service nova] Creating event network-vif-deleted:56394358-de2a-4703-af5d-1bfe0096d01f for instance c1650670-237d-4fc5-8faa-2cfa7066ae4c on n-h2-860687-3 Oct 27 20:09:36.386132 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-0915b539-eded-4289-93cb-8a28f8c5c102 req-0520fcb6-b22e-46a8-8e20-cbfc891e5062 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091829 Oct 27 20:09:36.386789 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3921/7992] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:09:36.734511 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-53e9c267-763e-4a20-9b89-742980bff875 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:09:36.735788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-53e9c267-763e-4a20-9b89-742980bff875 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:09:36.742848 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e9c267-763e-4a20-9b89-742980bff875 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:36.743338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e9c267-763e-4a20-9b89-742980bff875 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:36.744557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e9c267-763e-4a20-9b89-742980bff875 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:36.745617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e9c267-763e-4a20-9b89-742980bff875 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:36.746284 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e9c267-763e-4a20-9b89-742980bff875 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:36.746740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e9c267-763e-4a20-9b89-742980bff875 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:36.782602 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e9c267-763e-4a20-9b89-742980bff875 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:36.783165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e9c267-763e-4a20-9b89-742980bff875 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:36.783806 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53e9c267-763e-4a20-9b89-742980bff875 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:36.784319 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-53e9c267-763e-4a20-9b89-742980bff875 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lazy-loading 'fault' on Instance uuid c1650670-237d-4fc5-8faa-2cfa7066ae4c {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 20:09:36.830130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-53e9c267-763e-4a20-9b89-742980bff875 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:09:36.837867 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-53e9c267-763e-4a20-9b89-742980bff875 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 200 len: 1335 microversion: 2.1 time: 0.106923 Oct 27 20:09:36.838487 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4072/7993] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:09:36 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 1335 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:09:37.863292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3314652e-3f17-49f4-8a54-39ea45271d9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:09:37.864043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3314652e-3f17-49f4-8a54-39ea45271d9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: c1650670-237d-4fc5-8faa-2cfa7066ae4c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:09:37.870619 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3314652e-3f17-49f4-8a54-39ea45271d9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:37.871311 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3314652e-3f17-49f4-8a54-39ea45271d9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:37.871586 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3314652e-3f17-49f4-8a54-39ea45271d9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:37.872307 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3314652e-3f17-49f4-8a54-39ea45271d9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:37.872783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3314652e-3f17-49f4-8a54-39ea45271d9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:37.873353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3314652e-3f17-49f4-8a54-39ea45271d9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:37.888560 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-3314652e-3f17-49f4-8a54-39ea45271d9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] HTTP exception thrown: Instance c1650670-237d-4fc5-8faa-2cfa7066ae4c could not be found. Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3314652e-3f17-49f4-8a54-39ea45271d9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Request method failure captured: Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c HTTP/1.1 Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: Accept: application/json Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: Accept-Encoding: identity Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: Connection: close Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: Content-Length: 0 Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: Content-Type: application/json Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: Host: 10.222.0.42 Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: Openstack-System-Scope: None Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjWuRcEVseTxIdR_4WpxC0bvwVUA13sjW-rR6RCAJsDUnA7GqnkHYt8cEovXteknM_knoJBPwqYKdp1aZ9iUwLOMDq4obd8QIs07SSrgcSKx1vv2eBFtCoI1yqun6VnYZ3raNdL0s709hlBP-Nmvh13y2kGKATKHbnDwM7cHA5VbYiK3Y Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Id: None Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Domain-Name: None Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Identity-Status: Confirmed Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Is-Admin-Project: True Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Id: default Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Domain-Name: Default Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Id: 84e997bd7269417282b7994f0c6f3412 Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Project-Name: tempest-TestShelveInstance-2024553854 Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Role: member,reader Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Roles: member,reader Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/84e997bd7269417282b7994f0c6f3412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/84e997bd7269417282b7994f0c6f3412"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_84e997bd7269417282b7994f0c6f3412", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/84e997bd7269417282b7994f0c6f3412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant: tempest-TestShelveInstance-2024553854 Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Id: 84e997bd7269417282b7994f0c6f3412 Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestShelveInstance-2024553854 Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-User: tempest-TestShelveInstance-2024553854-project Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Id: default Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-User-Domain-Name: Default Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-User-Id: ea6b28f9423b40e0bf3ed5e697208cab Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: X-User-Name: tempest-TestShelveInstance-2024553854-project Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: method: > Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: exception: Instance c1650670-237d-4fc5-8faa-2cfa7066ae4c could not be found. Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: action_args: {'id': 'c1650670-237d-4fc5-8faa-2cfa7066ae4c'} Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1650670-237d-4fc5-8faa-2cfa7066ae4c could not be found. Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1650670-237d-4fc5-8faa-2cfa7066ae4c could not be found. Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 20:09:37.890292 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 20:09:37.896456 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:09:37.896456 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 20:09:37.896456 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 20:09:37.896456 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 20:09:37.896456 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 20:09:37.896456 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1650670-237d-4fc5-8faa-2cfa7066ae4c could not be found. Oct 27 20:09:37.896456 n-d-860687-3 devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Oct 27 20:09:37.896456 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3314652e-3f17-49f4-8a54-39ea45271d9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Returning 404 to user: Instance c1650670-237d-4fc5-8faa-2cfa7066ae4c could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 20:09:37.896456 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3314652e-3f17-49f4-8a54-39ea45271d9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c" status: 404 len: 111 microversion: 2.1 time: 0.033831 Oct 27 20:09:37.896456 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3922/7994] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:09:37 2022] GET /compute/v2.1/servers/c1650670-237d-4fc5-8faa-2cfa7066ae4c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 20:09:38.069311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-89d470f8-aeb2-4d79-8cdd-86a1259a4fc8 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '.version_select at 0x7fc869de0b80>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:09:38.107196 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-89d470f8-aeb2-4d79-8cdd-86a1259a4fc8 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-631459227" status: 202 len: 0 microversion: 2.1 time: 0.042850 Oct 27 20:09:38.111392 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4073/7995] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 20:09:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-631459227 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 20:09:38.136016 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a384229f-a5fa-42c0-b069-ea3210afc7ca tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Action: 'create', calling method: .version_select at 0x7fc86992ba60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1066558570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQYolxe7tJNYdDbydnA0BAf5jE0alKuDPUMJK+tbxEdbQWs1poKx3CHakanPTCl+MOOqjrUxg/6xQ19YtN4r9jTtt0Xrc3tjBoF1Sf+/a5tPULMhm29CrLKgVXjF6AEiw=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:09:38.153204 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-a384229f-a5fa-42c0-b069-ea3210afc7ca tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Getting quotas for project 84e997bd7269417282b7994f0c6f3412. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 20:09:38.159396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-a384229f-a5fa-42c0-b069-ea3210afc7ca tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Getting quotas for user ea6b28f9423b40e0bf3ed5e697208cab and project 84e997bd7269417282b7994f0c6f3412. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 20:09:38.192709 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a384229f-a5fa-42c0-b069-ea3210afc7ca tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.061252 Oct 27 20:09:38.193496 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3923/7996] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 20:09:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 20:09:54.503240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-279123793", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1066558570", "security_groups": [{"name": "tempest-secgroup-smoke-100065178"}], "networks": [{"uuid": "850e60e0-aa62-4a43-8a43-da3de355a6bc"}], "block_device_mapping_v2": [{"uuid": "842f9a8f-3aad-4727-8376-2af4ae43012f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:09:54.514970 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:09:54.515625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:09:54.622752 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] validate_networks() for [('850e60e0-aa62-4a43-8a43-da3de355a6bc', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 20:09:55.033294 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 20:09:55.033732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 20:09:55.034219 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 20:09:55.034669 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 20:09:55.035094 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 20:09:55.045036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:55.045519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:55.045963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:55.046739 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:09:55.047202 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:09:55.047635 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:09:55.064718 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Getting quotas for project 84e997bd7269417282b7994f0c6f3412. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 20:09:55.069884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Getting quotas for user ea6b28f9423b40e0bf3ed5e697208cab and project 84e997bd7269417282b7994f0c6f3412. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 20:09:55.128505 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 20:09:55.130741 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='842f9a8f-3aad-4727-8376-2af4ae43012f',volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 20:09:55.257065 n-d-860687-3 devstack@n-api.service[127029]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [b3c38cf1-6804-49a6-a067-e9961f217723] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 20:09:56.266239 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [b3c38cf1-6804-49a6-a067-e9961f217723] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38968. Oct 27 20:09:56.270319 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-a703d51a-b9b6-486f-8220-91a121e689fc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.771047 Oct 27 20:09:56.271000 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4074/7997] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 20:09:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 20:09:56.280588 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=12 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:09:56.281369 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:09:56.282132 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:09:56.285975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9996396e-74da-4176-8916-3023cbc405af tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:09:56.287042 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9996396e-74da-4176-8916-3023cbc405af tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:09:56.344723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9996396e-74da-4176-8916-3023cbc405af tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:09:56.351745 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9996396e-74da-4176-8916-3023cbc405af tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1088 microversion: 2.1 time: 0.072958 Oct 27 20:09:56.352372 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3924/7998] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:09:56 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:09:57.376081 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f5dc6fd4-a58b-48c8-bcf7-4a3b800d2f9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:09:57.376707 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f5dc6fd4-a58b-48c8-bcf7-4a3b800d2f9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:09:57.430165 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f5dc6fd4-a58b-48c8-bcf7-4a3b800d2f9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:09:57.437875 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f5dc6fd4-a58b-48c8-bcf7-4a3b800d2f9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1088 microversion: 2.1 time: 0.066561 Oct 27 20:09:57.438466 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4075/7999] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:09:57 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:09:58.461227 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-912bbb86-5347-47b7-97f1-03d5f5716e32 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:09:58.462428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-912bbb86-5347-47b7-97f1-03d5f5716e32 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:09:58.518180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-912bbb86-5347-47b7-97f1-03d5f5716e32 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:09:58.526195 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-912bbb86-5347-47b7-97f1-03d5f5716e32 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1088 microversion: 2.1 time: 0.068810 Oct 27 20:09:58.526804 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3925/8000] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:09:58 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:09:59.549480 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-081c4524-ab3f-4bdc-9097-8de6467fdf2a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:09:59.550115 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-081c4524-ab3f-4bdc-9097-8de6467fdf2a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:09:59.605844 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-081c4524-ab3f-4bdc-9097-8de6467fdf2a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:09:59.613466 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-081c4524-ab3f-4bdc-9097-8de6467fdf2a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1088 microversion: 2.1 time: 0.068150 Oct 27 20:09:59.614052 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4076/8001] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:09:59 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:00.636861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85ebd132-b68a-4d3a-86e7-329b250f779d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:00.637510 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85ebd132-b68a-4d3a-86e7-329b250f779d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:00.644354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85ebd132-b68a-4d3a-86e7-329b250f779d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:00.644856 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85ebd132-b68a-4d3a-86e7-329b250f779d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:00.645309 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85ebd132-b68a-4d3a-86e7-329b250f779d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:00.646043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85ebd132-b68a-4d3a-86e7-329b250f779d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:00.646545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85ebd132-b68a-4d3a-86e7-329b250f779d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:00.646991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85ebd132-b68a-4d3a-86e7-329b250f779d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:00.712624 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-85ebd132-b68a-4d3a-86e7-329b250f779d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:00.720415 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85ebd132-b68a-4d3a-86e7-329b250f779d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1138 microversion: 2.1 time: 0.088011 Oct 27 20:10:00.720995 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3926/8002] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:00 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1138 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:01.742651 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-53345273-bb33-4d13-8b67-06ce389bd916 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:01.743964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-53345273-bb33-4d13-8b67-06ce389bd916 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:01.750703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53345273-bb33-4d13-8b67-06ce389bd916 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:01.751280 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53345273-bb33-4d13-8b67-06ce389bd916 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:01.751801 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53345273-bb33-4d13-8b67-06ce389bd916 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:01.752613 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53345273-bb33-4d13-8b67-06ce389bd916 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:01.753206 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53345273-bb33-4d13-8b67-06ce389bd916 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:01.753708 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-53345273-bb33-4d13-8b67-06ce389bd916 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:01.831300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-53345273-bb33-4d13-8b67-06ce389bd916 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:01.839521 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-53345273-bb33-4d13-8b67-06ce389bd916 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1204 microversion: 2.1 time: 0.100824 Oct 27 20:10:01.840218 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4077/8003] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:01 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:02.863154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8aa75b1b-319e-469e-ab2d-a5d1927845be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:02.864245 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8aa75b1b-319e-469e-ab2d-a5d1927845be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:02.871766 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aa75b1b-319e-469e-ab2d-a5d1927845be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:02.872364 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aa75b1b-319e-469e-ab2d-a5d1927845be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:02.873073 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aa75b1b-319e-469e-ab2d-a5d1927845be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:02.873954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aa75b1b-319e-469e-ab2d-a5d1927845be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:02.874666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aa75b1b-319e-469e-ab2d-a5d1927845be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:02.875284 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8aa75b1b-319e-469e-ab2d-a5d1927845be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:03.022371 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8aa75b1b-319e-469e-ab2d-a5d1927845be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:03.031010 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8aa75b1b-319e-469e-ab2d-a5d1927845be tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1271 microversion: 2.1 time: 0.171766 Oct 27 20:10:03.031601 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3927/8004] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:02 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:03.259472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-1b2c0ea3-e247-49cc-8eb0-fa538df5c34e req-113406bb-3053-411d-915f-a313cc56f46a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5dd873-c006-4367-85b9-4360f51cf6e9", "tag": "b1ca8476-7710-417f-8ea5-22678866a65e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:10:03.271622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1b2c0ea3-e247-49cc-8eb0-fa538df5c34e req-113406bb-3053-411d-915f-a313cc56f46a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:03.272259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1b2c0ea3-e247-49cc-8eb0-fa538df5c34e req-113406bb-3053-411d-915f-a313cc56f46a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:03.272794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-1b2c0ea3-e247-49cc-8eb0-fa538df5c34e req-113406bb-3053-411d-915f-a313cc56f46a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:03.285591 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-1b2c0ea3-e247-49cc-8eb0-fa538df5c34e req-113406bb-3053-411d-915f-a313cc56f46a service nova] Creating event network-changed:b1ca8476-7710-417f-8ea5-22678866a65e for instance 4f5dd873-c006-4367-85b9-4360f51cf6e9 on n-h1-860687-3 Oct 27 20:10:03.291895 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-1b2c0ea3-e247-49cc-8eb0-fa538df5c34e req-113406bb-3053-411d-915f-a313cc56f46a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036678 Oct 27 20:10:03.293161 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4078/8005] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:10:04.054855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9d5fabc-6a01-4e44-a7ec-74f15f8e93e5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:04.055594 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d9d5fabc-6a01-4e44-a7ec-74f15f8e93e5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:04.062653 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9d5fabc-6a01-4e44-a7ec-74f15f8e93e5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:04.063162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9d5fabc-6a01-4e44-a7ec-74f15f8e93e5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:04.063843 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9d5fabc-6a01-4e44-a7ec-74f15f8e93e5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:04.064577 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9d5fabc-6a01-4e44-a7ec-74f15f8e93e5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:04.065059 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9d5fabc-6a01-4e44-a7ec-74f15f8e93e5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:04.065509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9d5fabc-6a01-4e44-a7ec-74f15f8e93e5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:04.204210 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d9d5fabc-6a01-4e44-a7ec-74f15f8e93e5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:04.212543 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d9d5fabc-6a01-4e44-a7ec-74f15f8e93e5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1271 microversion: 2.1 time: 0.161989 Oct 27 20:10:04.213344 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3928/8006] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:04 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:05.234965 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:10:05.239153 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-7d87ecff-f5e7-49f3-a6b0-b64be1ad55e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:05.239862 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-7d87ecff-f5e7-49f3-a6b0-b64be1ad55e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:05.246339 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d87ecff-f5e7-49f3-a6b0-b64be1ad55e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:05.246856 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d87ecff-f5e7-49f3-a6b0-b64be1ad55e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:05.247295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d87ecff-f5e7-49f3-a6b0-b64be1ad55e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:05.247988 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d87ecff-f5e7-49f3-a6b0-b64be1ad55e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:05.248444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d87ecff-f5e7-49f3-a6b0-b64be1ad55e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:05.248874 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-7d87ecff-f5e7-49f3-a6b0-b64be1ad55e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:05.392543 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-7d87ecff-f5e7-49f3-a6b0-b64be1ad55e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:05.400458 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-7d87ecff-f5e7-49f3-a6b0-b64be1ad55e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1271 microversion: 2.1 time: 0.167364 Oct 27 20:10:05.401027 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4079/8007] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:05 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:06.429861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a0f9ffb4-244d-4894-8e49-acc2b0f0bcbf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:06.431962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a0f9ffb4-244d-4894-8e49-acc2b0f0bcbf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:06.438835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0f9ffb4-244d-4894-8e49-acc2b0f0bcbf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:06.439428 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0f9ffb4-244d-4894-8e49-acc2b0f0bcbf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:06.439993 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0f9ffb4-244d-4894-8e49-acc2b0f0bcbf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:06.440825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0f9ffb4-244d-4894-8e49-acc2b0f0bcbf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:06.441300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0f9ffb4-244d-4894-8e49-acc2b0f0bcbf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:06.441772 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0f9ffb4-244d-4894-8e49-acc2b0f0bcbf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:06.584978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0f9ffb4-244d-4894-8e49-acc2b0f0bcbf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:06.594212 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a0f9ffb4-244d-4894-8e49-acc2b0f0bcbf tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1271 microversion: 2.1 time: 0.169213 Oct 27 20:10:06.594915 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3929/8008] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:06 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:07.617256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-95acf969-8dc4-4533-8ee8-02103918d44e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:07.618705 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-95acf969-8dc4-4533-8ee8-02103918d44e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:07.625199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95acf969-8dc4-4533-8ee8-02103918d44e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:07.625693 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95acf969-8dc4-4533-8ee8-02103918d44e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:07.626138 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95acf969-8dc4-4533-8ee8-02103918d44e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:07.626863 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95acf969-8dc4-4533-8ee8-02103918d44e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:07.627329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95acf969-8dc4-4533-8ee8-02103918d44e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:07.627766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-95acf969-8dc4-4533-8ee8-02103918d44e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:07.764108 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-95acf969-8dc4-4533-8ee8-02103918d44e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:07.771885 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-95acf969-8dc4-4533-8ee8-02103918d44e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1259 microversion: 2.1 time: 0.158625 Oct 27 20:10:07.772489 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4080/8009] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:07 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:08.796226 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fd1139e7-ea95-4a1d-adb2-249425aef3bb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:08.796797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fd1139e7-ea95-4a1d-adb2-249425aef3bb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:08.799570 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:10:08.805367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd1139e7-ea95-4a1d-adb2-249425aef3bb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:08.806075 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd1139e7-ea95-4a1d-adb2-249425aef3bb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:08.806647 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd1139e7-ea95-4a1d-adb2-249425aef3bb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:08.807374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd1139e7-ea95-4a1d-adb2-249425aef3bb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:08.807854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd1139e7-ea95-4a1d-adb2-249425aef3bb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:08.808306 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd1139e7-ea95-4a1d-adb2-249425aef3bb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:08.939174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd1139e7-ea95-4a1d-adb2-249425aef3bb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:08.947693 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fd1139e7-ea95-4a1d-adb2-249425aef3bb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1259 microversion: 2.1 time: 0.155543 Oct 27 20:10:08.948269 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3930/8010] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:08 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:09.971122 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f9d192c8-0410-4885-bf31-4bd650188040 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:09.971735 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f9d192c8-0410-4885-bf31-4bd650188040 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:09.974371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=10 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:10:09.981017 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9d192c8-0410-4885-bf31-4bd650188040 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:09.981580 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9d192c8-0410-4885-bf31-4bd650188040 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:09.981974 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9d192c8-0410-4885-bf31-4bd650188040 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:09.982696 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9d192c8-0410-4885-bf31-4bd650188040 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:09.983155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9d192c8-0410-4885-bf31-4bd650188040 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:09.983586 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f9d192c8-0410-4885-bf31-4bd650188040 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:10.121989 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f9d192c8-0410-4885-bf31-4bd650188040 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:10.129788 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f9d192c8-0410-4885-bf31-4bd650188040 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1259 microversion: 2.1 time: 0.162550 Oct 27 20:10:10.130359 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4081/8011] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:09 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:11.153242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d1709c6-eecf-460a-8ebd-c81863e5254a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:11.153881 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d1709c6-eecf-460a-8ebd-c81863e5254a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:11.160959 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1709c6-eecf-460a-8ebd-c81863e5254a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:11.161467 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1709c6-eecf-460a-8ebd-c81863e5254a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:11.161926 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1709c6-eecf-460a-8ebd-c81863e5254a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:11.162669 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1709c6-eecf-460a-8ebd-c81863e5254a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:11.163148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1709c6-eecf-460a-8ebd-c81863e5254a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:11.163598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d1709c6-eecf-460a-8ebd-c81863e5254a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:11.299113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d1709c6-eecf-460a-8ebd-c81863e5254a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:11.307471 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d1709c6-eecf-460a-8ebd-c81863e5254a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1259 microversion: 2.1 time: 0.158724 Oct 27 20:10:11.308048 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3931/8012] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:11 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:12.330274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-14cc99e8-6865-4d24-847a-b9dc18467ae5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:12.330923 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-14cc99e8-6865-4d24-847a-b9dc18467ae5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:12.338395 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14cc99e8-6865-4d24-847a-b9dc18467ae5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:12.338891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14cc99e8-6865-4d24-847a-b9dc18467ae5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:12.339333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14cc99e8-6865-4d24-847a-b9dc18467ae5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:12.340024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14cc99e8-6865-4d24-847a-b9dc18467ae5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:12.340483 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14cc99e8-6865-4d24-847a-b9dc18467ae5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:12.340914 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-14cc99e8-6865-4d24-847a-b9dc18467ae5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:12.470215 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-14cc99e8-6865-4d24-847a-b9dc18467ae5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:12.478857 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-14cc99e8-6865-4d24-847a-b9dc18467ae5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1259 microversion: 2.1 time: 0.152510 Oct 27 20:10:12.479428 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4082/8013] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:12 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:13.501086 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-58c9a558-1946-441b-9b19-ce80a3b88091 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:13.501733 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-58c9a558-1946-441b-9b19-ce80a3b88091 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:13.509414 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58c9a558-1946-441b-9b19-ce80a3b88091 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:13.509928 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58c9a558-1946-441b-9b19-ce80a3b88091 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:13.510408 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58c9a558-1946-441b-9b19-ce80a3b88091 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:13.511134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58c9a558-1946-441b-9b19-ce80a3b88091 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:13.511614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58c9a558-1946-441b-9b19-ce80a3b88091 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:13.512069 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-58c9a558-1946-441b-9b19-ce80a3b88091 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:13.647243 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-58c9a558-1946-441b-9b19-ce80a3b88091 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:13.655583 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-58c9a558-1946-441b-9b19-ce80a3b88091 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1259 microversion: 2.1 time: 0.158420 Oct 27 20:10:13.656324 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3932/8014] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:13 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:14.679264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-578b88a3-aa6f-42f8-b905-1d5c301e8484 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:14.679910 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-578b88a3-aa6f-42f8-b905-1d5c301e8484 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:14.687477 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-578b88a3-aa6f-42f8-b905-1d5c301e8484 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:14.687971 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-578b88a3-aa6f-42f8-b905-1d5c301e8484 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:14.688423 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-578b88a3-aa6f-42f8-b905-1d5c301e8484 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:14.689125 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-578b88a3-aa6f-42f8-b905-1d5c301e8484 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:14.689589 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-578b88a3-aa6f-42f8-b905-1d5c301e8484 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:14.690025 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-578b88a3-aa6f-42f8-b905-1d5c301e8484 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:14.826056 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-578b88a3-aa6f-42f8-b905-1d5c301e8484 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:14.833915 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-578b88a3-aa6f-42f8-b905-1d5c301e8484 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1259 microversion: 2.1 time: 0.158568 Oct 27 20:10:14.834445 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4083/8015] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:14 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:15.857080 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-89ca901e-0bd0-4dec-8e95-df47d524ba26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:15.857715 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-89ca901e-0bd0-4dec-8e95-df47d524ba26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:15.864623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89ca901e-0bd0-4dec-8e95-df47d524ba26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:15.865048 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89ca901e-0bd0-4dec-8e95-df47d524ba26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:15.865504 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89ca901e-0bd0-4dec-8e95-df47d524ba26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:15.866215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89ca901e-0bd0-4dec-8e95-df47d524ba26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:15.866719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89ca901e-0bd0-4dec-8e95-df47d524ba26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:15.867291 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-89ca901e-0bd0-4dec-8e95-df47d524ba26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:16.000497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-89ca901e-0bd0-4dec-8e95-df47d524ba26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:16.009150 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-89ca901e-0bd0-4dec-8e95-df47d524ba26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1259 microversion: 2.1 time: 0.156058 Oct 27 20:10:16.009863 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3933/8016] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:15 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 20:10:17.032527 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-98059faa-9f39-4c08-b42c-91e8011aafd0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:17.033178 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-98059faa-9f39-4c08-b42c-91e8011aafd0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:17.040195 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98059faa-9f39-4c08-b42c-91e8011aafd0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:17.040691 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98059faa-9f39-4c08-b42c-91e8011aafd0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:17.041136 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98059faa-9f39-4c08-b42c-91e8011aafd0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:17.041836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98059faa-9f39-4c08-b42c-91e8011aafd0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:17.042298 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98059faa-9f39-4c08-b42c-91e8011aafd0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:17.042761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-98059faa-9f39-4c08-b42c-91e8011aafd0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:17.174335 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-98059faa-9f39-4c08-b42c-91e8011aafd0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:17.182792 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-98059faa-9f39-4c08-b42c-91e8011aafd0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1259 microversion: 2.1 time: 0.154193 Oct 27 20:10:17.183363 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4084/8017] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:17 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:17.578840 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-bfb942ff-363e-46ea-a8c7-f681486a9207 req-e37bd592-a1de-480b-b5f6-3f60ead18892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5dd873-c006-4367-85b9-4360f51cf6e9", "name": "network-vif-plugged", "status": "completed", "tag": "b1ca8476-7710-417f-8ea5-22678866a65e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:10:17.589756 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bfb942ff-363e-46ea-a8c7-f681486a9207 req-e37bd592-a1de-480b-b5f6-3f60ead18892 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:17.590267 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bfb942ff-363e-46ea-a8c7-f681486a9207 req-e37bd592-a1de-480b-b5f6-3f60ead18892 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:17.590938 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bfb942ff-363e-46ea-a8c7-f681486a9207 req-e37bd592-a1de-480b-b5f6-3f60ead18892 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:17.603490 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-bfb942ff-363e-46ea-a8c7-f681486a9207 req-e37bd592-a1de-480b-b5f6-3f60ead18892 service nova] Creating event network-vif-plugged:b1ca8476-7710-417f-8ea5-22678866a65e for instance 4f5dd873-c006-4367-85b9-4360f51cf6e9 on n-h1-860687-3 Oct 27 20:10:17.609329 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-bfb942ff-363e-46ea-a8c7-f681486a9207 req-e37bd592-a1de-480b-b5f6-3f60ead18892 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094965 Oct 27 20:10:17.609991 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3934/8018] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:10:18.206617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-cc763b85-9aca-4ac5-9f66-cc18a7914c1f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:18.207177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-cc763b85-9aca-4ac5-9f66-cc18a7914c1f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:18.214075 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc763b85-9aca-4ac5-9f66-cc18a7914c1f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:18.216489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc763b85-9aca-4ac5-9f66-cc18a7914c1f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:18.216951 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc763b85-9aca-4ac5-9f66-cc18a7914c1f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:18.217662 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc763b85-9aca-4ac5-9f66-cc18a7914c1f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:18.218130 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc763b85-9aca-4ac5-9f66-cc18a7914c1f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:18.218607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-cc763b85-9aca-4ac5-9f66-cc18a7914c1f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:18.358028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-cc763b85-9aca-4ac5-9f66-cc18a7914c1f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:18.365823 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-cc763b85-9aca-4ac5-9f66-cc18a7914c1f tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1259 microversion: 2.1 time: 0.163327 Oct 27 20:10:18.366628 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4085/8019] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:18 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:19.389901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7e98d590-3dba-40de-ad94-9706df081b83 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:19.390812 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7e98d590-3dba-40de-ad94-9706df081b83 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:19.397966 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e98d590-3dba-40de-ad94-9706df081b83 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:19.399058 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e98d590-3dba-40de-ad94-9706df081b83 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:19.399547 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e98d590-3dba-40de-ad94-9706df081b83 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:19.400289 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e98d590-3dba-40de-ad94-9706df081b83 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:19.400797 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e98d590-3dba-40de-ad94-9706df081b83 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:19.401272 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7e98d590-3dba-40de-ad94-9706df081b83 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:19.542906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-7e98d590-3dba-40de-ad94-9706df081b83 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:19.550660 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7e98d590-3dba-40de-ad94-9706df081b83 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1444 microversion: 2.1 time: 0.165038 Oct 27 20:10:19.551230 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3935/8020] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:19 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:19.573465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-8af0e3d0-9604-41b5-ab45-8e21eb4bc5aa tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:10:19.574084 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-8af0e3d0-9604-41b5-ab45-8e21eb4bc5aa tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:10:19.581638 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8af0e3d0-9604-41b5-ab45-8e21eb4bc5aa tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:19.582120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8af0e3d0-9604-41b5-ab45-8e21eb4bc5aa tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:19.582618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8af0e3d0-9604-41b5-ab45-8e21eb4bc5aa tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:19.583358 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8af0e3d0-9604-41b5-ab45-8e21eb4bc5aa tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:19.583825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8af0e3d0-9604-41b5-ab45-8e21eb4bc5aa tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:19.584558 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-8af0e3d0-9604-41b5-ab45-8e21eb4bc5aa tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:19.721253 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-8af0e3d0-9604-41b5-ab45-8e21eb4bc5aa tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:10:19.729375 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-8af0e3d0-9604-41b5-ab45-8e21eb4bc5aa tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1444 microversion: 2.1 time: 0.159945 Oct 27 20:10:19.729958 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4086/8021] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:10:19 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:10:21.373706 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-fe09637f-3b8a-4a07-9b95-81a4996207a2 req-bb361d90-ac96-4c31-a2c4-4a4ad0faa3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5dd873-c006-4367-85b9-4360f51cf6e9", "tag": "b1ca8476-7710-417f-8ea5-22678866a65e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:10:21.384231 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fe09637f-3b8a-4a07-9b95-81a4996207a2 req-bb361d90-ac96-4c31-a2c4-4a4ad0faa3d9 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:10:21.384738 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fe09637f-3b8a-4a07-9b95-81a4996207a2 req-bb361d90-ac96-4c31-a2c4-4a4ad0faa3d9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:10:21.385194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fe09637f-3b8a-4a07-9b95-81a4996207a2 req-bb361d90-ac96-4c31-a2c4-4a4ad0faa3d9 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:10:21.396415 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-fe09637f-3b8a-4a07-9b95-81a4996207a2 req-bb361d90-ac96-4c31-a2c4-4a4ad0faa3d9 service nova] Creating event network-changed:b1ca8476-7710-417f-8ea5-22678866a65e for instance 4f5dd873-c006-4367-85b9-4360f51cf6e9 on n-h1-860687-3 Oct 27 20:10:21.401676 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-fe09637f-3b8a-4a07-9b95-81a4996207a2 req-bb361d90-ac96-4c31-a2c4-4a4ad0faa3d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031653 Oct 27 20:10:21.402293 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3936/8022] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:12:18.962500 n-d-860687-3 devstack@n-api.service[127029]: ERROR oslo.messaging._drivers.impl_rabbit [-] [66fa3103-a1fe-46ef-965e-69c22fe0df2e] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 20:12:18.963406 n-d-860687-3 devstack@n-api.service[127029]: ERROR oslo.messaging._drivers.impl_rabbit [-] [40297e18-f715-404d-a7a8-44159721b4a8] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 20:12:18.963981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:12:18.964724 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=58 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:12:18.965632 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 20:12:18.965785 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 20:12:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9/action (ip 10.222.0.42) !!! Oct 27 20:12:18.967167 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 20:12:18.967343 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 20:12:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9/action (ip 10.222.0.42) !!! Oct 27 20:12:18.971728 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d4680a95-3d4d-4be0-98c0-17b363e5ab77 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:12:18.972281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d4680a95-3d4d-4be0-98c0-17b363e5ab77 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:18.983493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4680a95-3d4d-4be0-98c0-17b363e5ab77 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:18.983982 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4680a95-3d4d-4be0-98c0-17b363e5ab77 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:18.984421 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4680a95-3d4d-4be0-98c0-17b363e5ab77 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:18.985128 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4680a95-3d4d-4be0-98c0-17b363e5ab77 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:18.985571 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4680a95-3d4d-4be0-98c0-17b363e5ab77 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:18.985998 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d4680a95-3d4d-4be0-98c0-17b363e5ab77 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:19.010538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.objects.instance [None req-d4680a95-3d4d-4be0-98c0-17b363e5ab77 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lazy-loading 'flavor' on Instance uuid 4f5dd873-c006-4367-85b9-4360f51cf6e9 {{(pid=127029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 20:12:19.087506 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d4680a95-3d4d-4be0-98c0-17b363e5ab77 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "POST /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9/action" status: 202 len: 0 microversion: 2.1 time: 0.126809 Oct 27 20:12:19.088119 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4087/8023] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:12:18 2022] POST /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 20:12:19.094767 n-d-860687-3 devstack@n-api.service[127028]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a87a1486-b96d-4ed3-afbc-04da999a872c] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 20:12:19.096290 n-d-860687-3 devstack@n-api.service[127028]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e8240a4d-ecaa-42c4-8b5a-9ab82de7a90d] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 20:12:19.096970 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=30 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:12:19.097884 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=58 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:12:19.098912 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 20:12:19.099220 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 20:12:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 (ip 10.222.0.42) !!! Oct 27 20:12:19.101388 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 20:12:19.101526 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 20:12:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 (ip 10.222.0.42) !!! Oct 27 20:12:19.115644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8c02211a-ea9c-424f-9d16-99697d4f1ccb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:19.116377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8c02211a-ea9c-424f-9d16-99697d4f1ccb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:19.127901 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c02211a-ea9c-424f-9d16-99697d4f1ccb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:19.128399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c02211a-ea9c-424f-9d16-99697d4f1ccb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:19.128853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c02211a-ea9c-424f-9d16-99697d4f1ccb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:19.129568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c02211a-ea9c-424f-9d16-99697d4f1ccb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:19.130698 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c02211a-ea9c-424f-9d16-99697d4f1ccb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:19.131249 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c02211a-ea9c-424f-9d16-99697d4f1ccb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:19.268947 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-8c02211a-ea9c-424f-9d16-99697d4f1ccb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:19.277036 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8c02211a-ea9c-424f-9d16-99697d4f1ccb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1569 microversion: 2.1 time: 0.184160 Oct 27 20:12:19.277616 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3937/8024] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:19 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:20.306751 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-16af8098-ec04-4ecf-b35f-140508526a82 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:20.307386 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-16af8098-ec04-4ecf-b35f-140508526a82 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:20.315850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16af8098-ec04-4ecf-b35f-140508526a82 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:20.316340 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16af8098-ec04-4ecf-b35f-140508526a82 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:20.316785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16af8098-ec04-4ecf-b35f-140508526a82 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:20.317653 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16af8098-ec04-4ecf-b35f-140508526a82 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:20.318127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16af8098-ec04-4ecf-b35f-140508526a82 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:20.318593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-16af8098-ec04-4ecf-b35f-140508526a82 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:20.323316 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] [66fa3103-a1fe-46ef-965e-69c22fe0df2e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39102. Oct 27 20:12:20.324023 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] [40297e18-f715-404d-a7a8-44159721b4a8] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39104. Oct 27 20:12:20.458704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-16af8098-ec04-4ecf-b35f-140508526a82 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:20.466694 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-16af8098-ec04-4ecf-b35f-140508526a82 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1569 microversion: 2.1 time: 0.166695 Oct 27 20:12:20.467273 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4088/8025] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:20 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:21.490854 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-53adbc4b-eb08-421d-904b-e7cac39c7d64 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:21.491505 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-53adbc4b-eb08-421d-904b-e7cac39c7d64 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:21.501667 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53adbc4b-eb08-421d-904b-e7cac39c7d64 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:21.502180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53adbc4b-eb08-421d-904b-e7cac39c7d64 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:21.502666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53adbc4b-eb08-421d-904b-e7cac39c7d64 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:21.503396 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53adbc4b-eb08-421d-904b-e7cac39c7d64 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:21.504175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53adbc4b-eb08-421d-904b-e7cac39c7d64 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:21.505178 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53adbc4b-eb08-421d-904b-e7cac39c7d64 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:21.513506 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] [e8240a4d-ecaa-42c4-8b5a-9ab82de7a90d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39110. Oct 27 20:12:21.514231 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] [a87a1486-b96d-4ed3-afbc-04da999a872c] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39108. Oct 27 20:12:21.644976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-53adbc4b-eb08-421d-904b-e7cac39c7d64 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:21.653401 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-53adbc4b-eb08-421d-904b-e7cac39c7d64 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1569 microversion: 2.1 time: 0.166598 Oct 27 20:12:21.653981 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3938/8026] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:21 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:22.677703 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bda88a97-f516-454c-be91-111a53c15aee tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:22.678324 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bda88a97-f516-454c-be91-111a53c15aee tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:22.685134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bda88a97-f516-454c-be91-111a53c15aee tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:22.685634 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bda88a97-f516-454c-be91-111a53c15aee tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:22.686079 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bda88a97-f516-454c-be91-111a53c15aee tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:22.686836 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bda88a97-f516-454c-be91-111a53c15aee tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:22.687299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bda88a97-f516-454c-be91-111a53c15aee tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:22.687740 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bda88a97-f516-454c-be91-111a53c15aee tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:22.824715 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-bda88a97-f516-454c-be91-111a53c15aee tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:22.832836 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bda88a97-f516-454c-be91-111a53c15aee tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1569 microversion: 2.1 time: 0.159628 Oct 27 20:12:22.833479 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4089/8027] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:22 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 20:12:23.856451 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d7908e30-7596-4b25-adf3-6e8b25cb75e6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:23.857125 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d7908e30-7596-4b25-adf3-6e8b25cb75e6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:23.864268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7908e30-7596-4b25-adf3-6e8b25cb75e6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:23.864783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7908e30-7596-4b25-adf3-6e8b25cb75e6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:23.865246 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7908e30-7596-4b25-adf3-6e8b25cb75e6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:23.865978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7908e30-7596-4b25-adf3-6e8b25cb75e6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:23.866481 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7908e30-7596-4b25-adf3-6e8b25cb75e6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:23.866941 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d7908e30-7596-4b25-adf3-6e8b25cb75e6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:24.006023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d7908e30-7596-4b25-adf3-6e8b25cb75e6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:24.015448 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d7908e30-7596-4b25-adf3-6e8b25cb75e6 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1569 microversion: 2.1 time: 0.162942 Oct 27 20:12:24.016286 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3939/8028] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:23 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:25.041048 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-ed604d41-fd7d-41be-933b-20271241db3c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:25.041672 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-ed604d41-fd7d-41be-933b-20271241db3c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:25.048520 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed604d41-fd7d-41be-933b-20271241db3c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:25.049004 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed604d41-fd7d-41be-933b-20271241db3c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:25.049443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed604d41-fd7d-41be-933b-20271241db3c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:25.050134 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed604d41-fd7d-41be-933b-20271241db3c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:25.050618 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed604d41-fd7d-41be-933b-20271241db3c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:25.051050 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-ed604d41-fd7d-41be-933b-20271241db3c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:25.183256 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-ed604d41-fd7d-41be-933b-20271241db3c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:25.191036 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-ed604d41-fd7d-41be-933b-20271241db3c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1569 microversion: 2.1 time: 0.153949 Oct 27 20:12:25.191604 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4090/8029] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:25 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:26.215154 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-50699e40-c512-49a3-ba5b-5f380c5b3b22 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:26.215785 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-50699e40-c512-49a3-ba5b-5f380c5b3b22 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:26.222860 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50699e40-c512-49a3-ba5b-5f380c5b3b22 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:26.224084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50699e40-c512-49a3-ba5b-5f380c5b3b22 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:26.224975 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50699e40-c512-49a3-ba5b-5f380c5b3b22 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:26.225686 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50699e40-c512-49a3-ba5b-5f380c5b3b22 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:26.226160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50699e40-c512-49a3-ba5b-5f380c5b3b22 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:26.226639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-50699e40-c512-49a3-ba5b-5f380c5b3b22 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:26.360030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-50699e40-c512-49a3-ba5b-5f380c5b3b22 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:26.368524 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-50699e40-c512-49a3-ba5b-5f380c5b3b22 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1569 microversion: 2.1 time: 0.157336 Oct 27 20:12:26.369108 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3940/8030] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:26 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:27.392598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-eff7204f-e2c1-4929-a825-2895aa0976f0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:27.393214 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-eff7204f-e2c1-4929-a825-2895aa0976f0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:27.400819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eff7204f-e2c1-4929-a825-2895aa0976f0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:27.401317 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eff7204f-e2c1-4929-a825-2895aa0976f0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:27.401771 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eff7204f-e2c1-4929-a825-2895aa0976f0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:27.402508 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eff7204f-e2c1-4929-a825-2895aa0976f0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:27.402977 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eff7204f-e2c1-4929-a825-2895aa0976f0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:27.403417 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-eff7204f-e2c1-4929-a825-2895aa0976f0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:27.532585 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-eff7204f-e2c1-4929-a825-2895aa0976f0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:27.541176 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-eff7204f-e2c1-4929-a825-2895aa0976f0 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1569 microversion: 2.1 time: 0.152591 Oct 27 20:12:27.541753 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4091/8031] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:27 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:28.565111 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d31398b-dcd5-486a-a8d0-28c90f7633cc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:28.565739 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d31398b-dcd5-486a-a8d0-28c90f7633cc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:28.573922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d31398b-dcd5-486a-a8d0-28c90f7633cc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:28.574447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d31398b-dcd5-486a-a8d0-28c90f7633cc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:28.575170 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d31398b-dcd5-486a-a8d0-28c90f7633cc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:28.575875 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d31398b-dcd5-486a-a8d0-28c90f7633cc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:28.576343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d31398b-dcd5-486a-a8d0-28c90f7633cc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:28.576783 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d31398b-dcd5-486a-a8d0-28c90f7633cc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:28.706922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6d31398b-dcd5-486a-a8d0-28c90f7633cc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:28.715611 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d31398b-dcd5-486a-a8d0-28c90f7633cc tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1569 microversion: 2.1 time: 0.154481 Oct 27 20:12:28.716193 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3941/8032] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:28 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:29.739825 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-06530f2e-f90f-4c81-b0ec-5b496e5c744d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:29.740445 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-06530f2e-f90f-4c81-b0ec-5b496e5c744d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:29.747401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06530f2e-f90f-4c81-b0ec-5b496e5c744d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:29.748127 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06530f2e-f90f-4c81-b0ec-5b496e5c744d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:29.748323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06530f2e-f90f-4c81-b0ec-5b496e5c744d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:29.749022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06530f2e-f90f-4c81-b0ec-5b496e5c744d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:29.749476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06530f2e-f90f-4c81-b0ec-5b496e5c744d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:29.749906 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-06530f2e-f90f-4c81-b0ec-5b496e5c744d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:29.947402 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-06530f2e-f90f-4c81-b0ec-5b496e5c744d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:29.955549 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-06530f2e-f90f-4c81-b0ec-5b496e5c744d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1569 microversion: 2.1 time: 0.220313 Oct 27 20:12:29.956116 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4092/8033] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:29 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:30.979459 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5d614164-df79-42c9-bc9a-584cfb6c660c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:30.980103 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5d614164-df79-42c9-bc9a-584cfb6c660c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:30.987171 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d614164-df79-42c9-bc9a-584cfb6c660c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:30.987690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d614164-df79-42c9-bc9a-584cfb6c660c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:30.988153 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d614164-df79-42c9-bc9a-584cfb6c660c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:30.989377 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d614164-df79-42c9-bc9a-584cfb6c660c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:30.989858 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d614164-df79-42c9-bc9a-584cfb6c660c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:30.990433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d614164-df79-42c9-bc9a-584cfb6c660c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:31.124861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5d614164-df79-42c9-bc9a-584cfb6c660c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:31.133272 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5d614164-df79-42c9-bc9a-584cfb6c660c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1569 microversion: 2.1 time: 0.157799 Oct 27 20:12:31.133868 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3942/8034] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:30 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:32.157184 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c25b3118-6de3-4157-bc6e-c25f278668cd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:32.158015 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c25b3118-6de3-4157-bc6e-c25f278668cd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:32.165300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c25b3118-6de3-4157-bc6e-c25f278668cd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:32.165794 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c25b3118-6de3-4157-bc6e-c25f278668cd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:32.166243 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c25b3118-6de3-4157-bc6e-c25f278668cd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:32.167001 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c25b3118-6de3-4157-bc6e-c25f278668cd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:32.167462 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c25b3118-6de3-4157-bc6e-c25f278668cd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:32.168026 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c25b3118-6de3-4157-bc6e-c25f278668cd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:32.303131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c25b3118-6de3-4157-bc6e-c25f278668cd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:32.311214 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c25b3118-6de3-4157-bc6e-c25f278668cd tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1569 microversion: 2.1 time: 0.158002 Oct 27 20:12:32.311780 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4093/8035] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:32 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:33.335100 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e6992028-6268-4280-bf1a-d22e2fdb9174 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:33.335764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e6992028-6268-4280-bf1a-d22e2fdb9174 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:33.342611 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6992028-6268-4280-bf1a-d22e2fdb9174 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:33.343162 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6992028-6268-4280-bf1a-d22e2fdb9174 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:33.343629 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6992028-6268-4280-bf1a-d22e2fdb9174 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:33.344351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6992028-6268-4280-bf1a-d22e2fdb9174 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:33.344825 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6992028-6268-4280-bf1a-d22e2fdb9174 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:33.345274 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6992028-6268-4280-bf1a-d22e2fdb9174 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:33.492438 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e6992028-6268-4280-bf1a-d22e2fdb9174 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:33.500785 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e6992028-6268-4280-bf1a-d22e2fdb9174 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1569 microversion: 2.1 time: 0.170336 Oct 27 20:12:33.501428 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3943/8036] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:33 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:34.526021 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5fb79455-7f11-4aaa-8c7f-e4ce4d881540 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:34.526648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5fb79455-7f11-4aaa-8c7f-e4ce4d881540 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:34.533503 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb79455-7f11-4aaa-8c7f-e4ce4d881540 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:34.533990 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb79455-7f11-4aaa-8c7f-e4ce4d881540 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:34.534454 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb79455-7f11-4aaa-8c7f-e4ce4d881540 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:34.535151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb79455-7f11-4aaa-8c7f-e4ce4d881540 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:34.536248 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb79455-7f11-4aaa-8c7f-e4ce4d881540 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:34.536967 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5fb79455-7f11-4aaa-8c7f-e4ce4d881540 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:34.671168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5fb79455-7f11-4aaa-8c7f-e4ce4d881540 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:34.679781 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5fb79455-7f11-4aaa-8c7f-e4ce4d881540 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1510 microversion: 2.1 time: 0.157795 Oct 27 20:12:34.680357 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4094/8037] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:34 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 20:12:34.703541 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-80834f16-6fcb-407f-86cb-c45315d22f8c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:12:34.704167 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-80834f16-6fcb-407f-86cb-c45315d22f8c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:34.711134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80834f16-6fcb-407f-86cb-c45315d22f8c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:34.711643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80834f16-6fcb-407f-86cb-c45315d22f8c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:34.712104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80834f16-6fcb-407f-86cb-c45315d22f8c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:34.712823 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80834f16-6fcb-407f-86cb-c45315d22f8c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:34.713303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80834f16-6fcb-407f-86cb-c45315d22f8c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:34.713752 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-80834f16-6fcb-407f-86cb-c45315d22f8c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:34.797141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-80834f16-6fcb-407f-86cb-c45315d22f8c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127028) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 20:12:34.862704 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-80834f16-6fcb-407f-86cb-c45315d22f8c tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "POST /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9/action" status: 202 len: 0 microversion: 2.1 time: 0.163350 Oct 27 20:12:34.863327 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3944/8038] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:12:34 2022] POST /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 20:12:34.871785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-3d2decf3-3960-4646-ab9c-dd984469c354 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:34.872403 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-3d2decf3-3960-4646-ab9c-dd984469c354 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:34.878570 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2decf3-3960-4646-ab9c-dd984469c354 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:34.879065 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2decf3-3960-4646-ab9c-dd984469c354 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:34.880156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2decf3-3960-4646-ab9c-dd984469c354 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:34.880895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2decf3-3960-4646-ab9c-dd984469c354 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:34.881359 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2decf3-3960-4646-ab9c-dd984469c354 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:34.881795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-3d2decf3-3960-4646-ab9c-dd984469c354 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:35.050949 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-3d2decf3-3960-4646-ab9c-dd984469c354 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:35.059729 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-3d2decf3-3960-4646-ab9c-dd984469c354 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1518 microversion: 2.1 time: 0.191978 Oct 27 20:12:35.060299 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4095/8039] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:34 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1518 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:36.041634 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-faa07636-0bd4-4bac-865d-3af1f9e08355 req-e43566df-ed60-4fb7-8cdd-7d6d27a073bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5dd873-c006-4367-85b9-4360f51cf6e9", "name": "network-vif-unplugged", "status": "completed", "tag": "b1ca8476-7710-417f-8ea5-22678866a65e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:12:36.052703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-faa07636-0bd4-4bac-865d-3af1f9e08355 req-e43566df-ed60-4fb7-8cdd-7d6d27a073bc service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:36.053201 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-faa07636-0bd4-4bac-865d-3af1f9e08355 req-e43566df-ed60-4fb7-8cdd-7d6d27a073bc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:36.055182 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-faa07636-0bd4-4bac-865d-3af1f9e08355 req-e43566df-ed60-4fb7-8cdd-7d6d27a073bc service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:36.064852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.compute.server_external_events [req-faa07636-0bd4-4bac-865d-3af1f9e08355 req-e43566df-ed60-4fb7-8cdd-7d6d27a073bc service nova] Unable to find a host for instance 4f5dd873-c006-4367-85b9-4360f51cf6e9. Dropping event network-vif-unplugged {{(pid=127028) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 20:12:36.065721 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-faa07636-0bd4-4bac-865d-3af1f9e08355 req-e43566df-ed60-4fb7-8cdd-7d6d27a073bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028993 Oct 27 20:12:36.066507 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3945/8040] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 20:12:36.085472 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-248d9ebe-aaa7-474f-bfa0-0701071369b5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:36.086092 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-248d9ebe-aaa7-474f-bfa0-0701071369b5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:36.092945 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-248d9ebe-aaa7-474f-bfa0-0701071369b5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:36.093673 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-248d9ebe-aaa7-474f-bfa0-0701071369b5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:36.094118 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-248d9ebe-aaa7-474f-bfa0-0701071369b5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:36.095032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-248d9ebe-aaa7-474f-bfa0-0701071369b5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:36.095492 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-248d9ebe-aaa7-474f-bfa0-0701071369b5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:36.095948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-248d9ebe-aaa7-474f-bfa0-0701071369b5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:36.234291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-248d9ebe-aaa7-474f-bfa0-0701071369b5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:36.242994 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-248d9ebe-aaa7-474f-bfa0-0701071369b5 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1520 microversion: 2.1 time: 0.162347 Oct 27 20:12:36.243568 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4096/8041] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:36 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:37.267719 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d480bde3-e3cc-4e49-95cf-360f471da81a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:37.268363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d480bde3-e3cc-4e49-95cf-360f471da81a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:37.275985 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d480bde3-e3cc-4e49-95cf-360f471da81a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:37.276486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d480bde3-e3cc-4e49-95cf-360f471da81a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:37.276950 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d480bde3-e3cc-4e49-95cf-360f471da81a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:37.277683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d480bde3-e3cc-4e49-95cf-360f471da81a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:37.278160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d480bde3-e3cc-4e49-95cf-360f471da81a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:37.278644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d480bde3-e3cc-4e49-95cf-360f471da81a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:37.414328 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d480bde3-e3cc-4e49-95cf-360f471da81a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:37.422356 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d480bde3-e3cc-4e49-95cf-360f471da81a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1520 microversion: 2.1 time: 0.158617 Oct 27 20:12:37.422976 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3946/8042] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:37 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:38.447226 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b28d4c2e-9927-4392-ae5c-3969cd71ca04 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:38.448072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b28d4c2e-9927-4392-ae5c-3969cd71ca04 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:38.454347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b28d4c2e-9927-4392-ae5c-3969cd71ca04 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:38.454883 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b28d4c2e-9927-4392-ae5c-3969cd71ca04 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:38.455329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b28d4c2e-9927-4392-ae5c-3969cd71ca04 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:38.456032 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b28d4c2e-9927-4392-ae5c-3969cd71ca04 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:38.456494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b28d4c2e-9927-4392-ae5c-3969cd71ca04 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:38.456929 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b28d4c2e-9927-4392-ae5c-3969cd71ca04 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:38.596533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b28d4c2e-9927-4392-ae5c-3969cd71ca04 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:38.604932 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b28d4c2e-9927-4392-ae5c-3969cd71ca04 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1520 microversion: 2.1 time: 0.162551 Oct 27 20:12:38.605634 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4097/8043] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:38 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:39.630228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d64501a2-0790-4770-b5cf-8c1f04782956 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:39.630898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d64501a2-0790-4770-b5cf-8c1f04782956 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:39.637850 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d64501a2-0790-4770-b5cf-8c1f04782956 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:39.638351 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d64501a2-0790-4770-b5cf-8c1f04782956 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:39.638836 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d64501a2-0790-4770-b5cf-8c1f04782956 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:39.639559 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d64501a2-0790-4770-b5cf-8c1f04782956 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:39.640025 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d64501a2-0790-4770-b5cf-8c1f04782956 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:39.640466 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d64501a2-0790-4770-b5cf-8c1f04782956 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:39.778874 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d64501a2-0790-4770-b5cf-8c1f04782956 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:39.787483 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d64501a2-0790-4770-b5cf-8c1f04782956 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1520 microversion: 2.1 time: 0.161947 Oct 27 20:12:39.788100 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3947/8044] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:39 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:40.810745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2ce74390-6d03-4e96-be4f-bf1453a81d53 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:40.811374 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2ce74390-6d03-4e96-be4f-bf1453a81d53 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:40.818598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ce74390-6d03-4e96-be4f-bf1453a81d53 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:40.819097 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ce74390-6d03-4e96-be4f-bf1453a81d53 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:40.819563 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ce74390-6d03-4e96-be4f-bf1453a81d53 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:40.820260 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ce74390-6d03-4e96-be4f-bf1453a81d53 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:40.820731 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ce74390-6d03-4e96-be4f-bf1453a81d53 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:40.821177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2ce74390-6d03-4e96-be4f-bf1453a81d53 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:41.010493 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-2ce74390-6d03-4e96-be4f-bf1453a81d53 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:41.019323 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2ce74390-6d03-4e96-be4f-bf1453a81d53 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1576 microversion: 2.1 time: 0.212646 Oct 27 20:12:41.019969 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4098/8045] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:40 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1576 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:42.046300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-57d1ecaf-1b2d-4148-9d1d-6113b24bd426 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:42.047142 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-57d1ecaf-1b2d-4148-9d1d-6113b24bd426 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:42.055238 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57d1ecaf-1b2d-4148-9d1d-6113b24bd426 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:42.055811 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57d1ecaf-1b2d-4148-9d1d-6113b24bd426 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:42.056331 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57d1ecaf-1b2d-4148-9d1d-6113b24bd426 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:42.057057 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57d1ecaf-1b2d-4148-9d1d-6113b24bd426 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:42.057536 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57d1ecaf-1b2d-4148-9d1d-6113b24bd426 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:42.057986 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-57d1ecaf-1b2d-4148-9d1d-6113b24bd426 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:42.190697 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-57d1ecaf-1b2d-4148-9d1d-6113b24bd426 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:42.199531 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-57d1ecaf-1b2d-4148-9d1d-6113b24bd426 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1576 microversion: 2.1 time: 0.157354 Oct 27 20:12:42.200435 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3948/8046] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:42 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:43.224267 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b6faec93-15db-49ff-a077-4f8c1bd9068d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:43.224890 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b6faec93-15db-49ff-a077-4f8c1bd9068d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:43.231664 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6faec93-15db-49ff-a077-4f8c1bd9068d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:43.232156 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6faec93-15db-49ff-a077-4f8c1bd9068d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:43.232598 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6faec93-15db-49ff-a077-4f8c1bd9068d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:43.233292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6faec93-15db-49ff-a077-4f8c1bd9068d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:43.233749 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6faec93-15db-49ff-a077-4f8c1bd9068d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:43.234177 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b6faec93-15db-49ff-a077-4f8c1bd9068d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:43.367312 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b6faec93-15db-49ff-a077-4f8c1bd9068d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:43.375186 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b6faec93-15db-49ff-a077-4f8c1bd9068d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1576 microversion: 2.1 time: 0.155691 Oct 27 20:12:43.375777 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4099/8047] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:43 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:44.398776 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-539f3795-8e9f-4ebf-bb7c-57a2247a1a26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:44.399413 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-539f3795-8e9f-4ebf-bb7c-57a2247a1a26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:44.406423 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-539f3795-8e9f-4ebf-bb7c-57a2247a1a26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:44.406939 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-539f3795-8e9f-4ebf-bb7c-57a2247a1a26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:44.407401 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-539f3795-8e9f-4ebf-bb7c-57a2247a1a26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:44.408120 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-539f3795-8e9f-4ebf-bb7c-57a2247a1a26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:44.408598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-539f3795-8e9f-4ebf-bb7c-57a2247a1a26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:44.409050 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-539f3795-8e9f-4ebf-bb7c-57a2247a1a26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:44.544521 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-539f3795-8e9f-4ebf-bb7c-57a2247a1a26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:44.553366 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-539f3795-8e9f-4ebf-bb7c-57a2247a1a26 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1576 microversion: 2.1 time: 0.158782 Oct 27 20:12:44.553941 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3949/8048] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:44 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:45.577314 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-18fbfeb8-0bc4-4bf3-a4ef-d376947f4b9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:45.577961 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-18fbfeb8-0bc4-4bf3-a4ef-d376947f4b9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:45.585636 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18fbfeb8-0bc4-4bf3-a4ef-d376947f4b9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:45.586120 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18fbfeb8-0bc4-4bf3-a4ef-d376947f4b9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:45.586592 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18fbfeb8-0bc4-4bf3-a4ef-d376947f4b9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:45.587288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18fbfeb8-0bc4-4bf3-a4ef-d376947f4b9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:45.587745 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18fbfeb8-0bc4-4bf3-a4ef-d376947f4b9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:45.588174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-18fbfeb8-0bc4-4bf3-a4ef-d376947f4b9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:45.719352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-18fbfeb8-0bc4-4bf3-a4ef-d376947f4b9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:45.727291 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-18fbfeb8-0bc4-4bf3-a4ef-d376947f4b9a tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1576 microversion: 2.1 time: 0.154226 Oct 27 20:12:45.727872 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4100/8049] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:45 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:46.751608 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-66fa2e61-a33e-4e6c-945e-80c51c647c44 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:46.752242 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-66fa2e61-a33e-4e6c-945e-80c51c647c44 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:46.760552 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fa2e61-a33e-4e6c-945e-80c51c647c44 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:46.761071 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fa2e61-a33e-4e6c-945e-80c51c647c44 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:46.761522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fa2e61-a33e-4e6c-945e-80c51c647c44 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:46.762236 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fa2e61-a33e-4e6c-945e-80c51c647c44 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:46.762744 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fa2e61-a33e-4e6c-945e-80c51c647c44 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:46.763194 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fa2e61-a33e-4e6c-945e-80c51c647c44 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:46.896259 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-66fa2e61-a33e-4e6c-945e-80c51c647c44 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:46.904256 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-66fa2e61-a33e-4e6c-945e-80c51c647c44 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1576 microversion: 2.1 time: 0.156602 Oct 27 20:12:46.904834 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3950/8050] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:46 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:47.928259 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-27712511-77ca-4dab-8d58-6b427d357325 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:47.928870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-27712511-77ca-4dab-8d58-6b427d357325 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:47.935690 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27712511-77ca-4dab-8d58-6b427d357325 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:47.936173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27712511-77ca-4dab-8d58-6b427d357325 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:47.936612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27712511-77ca-4dab-8d58-6b427d357325 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:47.937299 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27712511-77ca-4dab-8d58-6b427d357325 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:47.937754 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27712511-77ca-4dab-8d58-6b427d357325 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:47.938182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-27712511-77ca-4dab-8d58-6b427d357325 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:47.956038 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:12:48.077940 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-27712511-77ca-4dab-8d58-6b427d357325 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:48.086453 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-27712511-77ca-4dab-8d58-6b427d357325 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1576 microversion: 2.1 time: 0.162065 Oct 27 20:12:48.086948 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4101/8051] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:47 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:49.109862 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-65ee79d6-d50c-4f63-9c92-c13ac02b223d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:49.110416 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-65ee79d6-d50c-4f63-9c92-c13ac02b223d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:49.117367 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ee79d6-d50c-4f63-9c92-c13ac02b223d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:49.117865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ee79d6-d50c-4f63-9c92-c13ac02b223d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:49.118316 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ee79d6-d50c-4f63-9c92-c13ac02b223d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:49.119046 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ee79d6-d50c-4f63-9c92-c13ac02b223d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:49.119522 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ee79d6-d50c-4f63-9c92-c13ac02b223d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:49.119960 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-65ee79d6-d50c-4f63-9c92-c13ac02b223d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:49.123943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:12:49.256150 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-65ee79d6-d50c-4f63-9c92-c13ac02b223d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:49.263889 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-65ee79d6-d50c-4f63-9c92-c13ac02b223d tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1576 microversion: 2.1 time: 0.158025 Oct 27 20:12:49.264459 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3951/8052] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:49 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:50.289824 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0ebf6037-bf8f-4565-91ca-4526a828e7f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:50.290474 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0ebf6037-bf8f-4565-91ca-4526a828e7f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:50.293168 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=31 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:12:50.298371 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebf6037-bf8f-4565-91ca-4526a828e7f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:50.298895 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebf6037-bf8f-4565-91ca-4526a828e7f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:50.299338 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebf6037-bf8f-4565-91ca-4526a828e7f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:50.300060 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebf6037-bf8f-4565-91ca-4526a828e7f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:50.300525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebf6037-bf8f-4565-91ca-4526a828e7f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:50.300997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0ebf6037-bf8f-4565-91ca-4526a828e7f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:50.434725 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0ebf6037-bf8f-4565-91ca-4526a828e7f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:50.442690 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0ebf6037-bf8f-4565-91ca-4526a828e7f1 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1576 microversion: 2.1 time: 0.157465 Oct 27 20:12:50.443272 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4102/8053] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:50 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:51.467084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-799e14c8-561f-4195-b3d0-44f04e9920b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:51.467721 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-799e14c8-561f-4195-b3d0-44f04e9920b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:51.470485 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:12:51.476468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-799e14c8-561f-4195-b3d0-44f04e9920b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:51.476971 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-799e14c8-561f-4195-b3d0-44f04e9920b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:51.477429 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-799e14c8-561f-4195-b3d0-44f04e9920b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:51.478140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-799e14c8-561f-4195-b3d0-44f04e9920b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:51.478651 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-799e14c8-561f-4195-b3d0-44f04e9920b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:51.479104 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-799e14c8-561f-4195-b3d0-44f04e9920b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:51.614230 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-799e14c8-561f-4195-b3d0-44f04e9920b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:51.622068 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-799e14c8-561f-4195-b3d0-44f04e9920b3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1576 microversion: 2.1 time: 0.158969 Oct 27 20:12:51.622682 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3952/8054] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:51 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:52.188105 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-4f281e42-b8bf-40bd-b2d4-f8c3682aa7d2 req-a08fe177-94d6-4fec-8f98-1c60d6583d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5dd873-c006-4367-85b9-4360f51cf6e9", "name": "network-vif-plugged", "status": "completed", "tag": "b1ca8476-7710-417f-8ea5-22678866a65e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:12:52.201401 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4f281e42-b8bf-40bd-b2d4-f8c3682aa7d2 req-a08fe177-94d6-4fec-8f98-1c60d6583d21 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:52.201900 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4f281e42-b8bf-40bd-b2d4-f8c3682aa7d2 req-a08fe177-94d6-4fec-8f98-1c60d6583d21 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:52.202389 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-4f281e42-b8bf-40bd-b2d4-f8c3682aa7d2 req-a08fe177-94d6-4fec-8f98-1c60d6583d21 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:52.214553 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-4f281e42-b8bf-40bd-b2d4-f8c3682aa7d2 req-a08fe177-94d6-4fec-8f98-1c60d6583d21 service nova] Creating event network-vif-plugged:b1ca8476-7710-417f-8ea5-22678866a65e for instance 4f5dd873-c006-4367-85b9-4360f51cf6e9 on n-h1-860687-3 Oct 27 20:12:52.219719 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-4f281e42-b8bf-40bd-b2d4-f8c3682aa7d2 req-a08fe177-94d6-4fec-8f98-1c60d6583d21 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035538 Oct 27 20:12:52.220321 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4103/8055] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 20:12:52.647004 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc79a417-cc12-43e0-8f66-6517016512e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:52.647631 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fc79a417-cc12-43e0-8f66-6517016512e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:52.654563 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc79a417-cc12-43e0-8f66-6517016512e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:52.655092 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc79a417-cc12-43e0-8f66-6517016512e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:52.655609 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc79a417-cc12-43e0-8f66-6517016512e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:52.656265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc79a417-cc12-43e0-8f66-6517016512e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:52.656734 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc79a417-cc12-43e0-8f66-6517016512e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:52.657175 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc79a417-cc12-43e0-8f66-6517016512e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:52.793690 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc79a417-cc12-43e0-8f66-6517016512e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:52.801861 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc79a417-cc12-43e0-8f66-6517016512e2 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1576 microversion: 2.1 time: 0.159453 Oct 27 20:12:52.802461 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3953/8056] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:52 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:12:53.825997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-87ff5d28-77c8-42a2-a396-26932e669206 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:12:53.826648 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-87ff5d28-77c8-42a2-a396-26932e669206 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:12:53.834028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87ff5d28-77c8-42a2-a396-26932e669206 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:53.834550 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87ff5d28-77c8-42a2-a396-26932e669206 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:53.834991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87ff5d28-77c8-42a2-a396-26932e669206 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:53.835720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87ff5d28-77c8-42a2-a396-26932e669206 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:12:53.836174 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87ff5d28-77c8-42a2-a396-26932e669206 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:12:53.836601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-87ff5d28-77c8-42a2-a396-26932e669206 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:12:53.968922 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-87ff5d28-77c8-42a2-a396-26932e669206 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:12:53.977606 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-87ff5d28-77c8-42a2-a396-26932e669206 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1563 microversion: 2.1 time: 0.156191 Oct 27 20:12:53.978193 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4104/8057] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:12:53 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:13.454764 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8491adee-3952-419c-b084-1e292633142e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:13.455976 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8491adee-3952-419c-b084-1e292633142e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:13.461053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-a02bb757-aea3-4771-8913-db15cf44304b req-26c59a8b-d3c9-45d0-8823-1ef473a3db33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5dd873-c006-4367-85b9-4360f51cf6e9", "tag": "b1ca8476-7710-417f-8ea5-22678866a65e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:14:13.462627 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:14:13.463478 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=16 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:14:13.464331 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 20:14:13.464471 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 20:14:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 (ip 10.222.0.42) !!! Oct 27 20:14:13.467200 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8491adee-3952-419c-b084-1e292633142e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:13.468135 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8491adee-3952-419c-b084-1e292633142e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:13.468370 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=5 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:14:13.468731 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8491adee-3952-419c-b084-1e292633142e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:13.469510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=16 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:14:13.470097 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8491adee-3952-419c-b084-1e292633142e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:13.470335 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 20:14:13.470665 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 20:14:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 27 20:14:13.472041 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8491adee-3952-419c-b084-1e292633142e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:13.472944 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8491adee-3952-419c-b084-1e292633142e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:13.488768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a02bb757-aea3-4771-8913-db15cf44304b req-26c59a8b-d3c9-45d0-8823-1ef473a3db33 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:13.489288 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a02bb757-aea3-4771-8913-db15cf44304b req-26c59a8b-d3c9-45d0-8823-1ef473a3db33 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:13.489962 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-a02bb757-aea3-4771-8913-db15cf44304b req-26c59a8b-d3c9-45d0-8823-1ef473a3db33 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:13.505072 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-a02bb757-aea3-4771-8913-db15cf44304b req-26c59a8b-d3c9-45d0-8823-1ef473a3db33 service nova] Creating event network-changed:b1ca8476-7710-417f-8ea5-22678866a65e for instance 4f5dd873-c006-4367-85b9-4360f51cf6e9 on n-h1-860687-3 Oct 27 20:14:13.511234 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-a02bb757-aea3-4771-8913-db15cf44304b req-26c59a8b-d3c9-45d0-8823-1ef473a3db33 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056322 Oct 27 20:14:13.512164 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4105/8058] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:14:13.512387 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8491adee-3952-419c-b084-1e292633142e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 20:14:13.606330 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8491adee-3952-419c-b084-1e292633142e tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 204 len: 0 microversion: 2.1 time: 0.156142 Oct 27 20:14:13.607326 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3954/8059] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 20:14:13 2022] DELETE /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 20:14:13.620964 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-12de5604-a3dc-4105-8e49-d8ec881c2c3b tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:13.621803 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-12de5604-a3dc-4105-8e49-d8ec881c2c3b tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:13.630688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12de5604-a3dc-4105-8e49-d8ec881c2c3b tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:13.631329 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12de5604-a3dc-4105-8e49-d8ec881c2c3b tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:13.631841 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12de5604-a3dc-4105-8e49-d8ec881c2c3b tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:13.632663 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12de5604-a3dc-4105-8e49-d8ec881c2c3b tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:13.633336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12de5604-a3dc-4105-8e49-d8ec881c2c3b tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:13.633850 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-12de5604-a3dc-4105-8e49-d8ec881c2c3b tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:13.782119 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-12de5604-a3dc-4105-8e49-d8ec881c2c3b tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:13.791050 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-12de5604-a3dc-4105-8e49-d8ec881c2c3b tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1569 microversion: 2.1 time: 0.177047 Oct 27 20:14:13.791742 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4106/8060] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:13 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:14.816114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb34d037-c067-49ba-ba54-8fb3db1ca804 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:14.816865 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fb34d037-c067-49ba-ba54-8fb3db1ca804 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:14.824052 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb34d037-c067-49ba-ba54-8fb3db1ca804 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:14.824558 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb34d037-c067-49ba-ba54-8fb3db1ca804 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:14.825019 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb34d037-c067-49ba-ba54-8fb3db1ca804 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:14.826002 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb34d037-c067-49ba-ba54-8fb3db1ca804 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:14.826509 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb34d037-c067-49ba-ba54-8fb3db1ca804 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:14.826958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb34d037-c067-49ba-ba54-8fb3db1ca804 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:14.971834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-fb34d037-c067-49ba-ba54-8fb3db1ca804 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:14.980467 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fb34d037-c067-49ba-ba54-8fb3db1ca804 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1450 microversion: 2.1 time: 0.168879 Oct 27 20:14:14.981071 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3955/8061] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:14 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:15.863670 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-7961eb68-f978-460b-aa1c-91df10a3f5b7 req-b01f513a-8737-4ff1-a912-efa57de9d56e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5dd873-c006-4367-85b9-4360f51cf6e9", "name": "network-vif-deleted", "tag": "b1ca8476-7710-417f-8ea5-22678866a65e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:14:15.873129 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7961eb68-f978-460b-aa1c-91df10a3f5b7 req-b01f513a-8737-4ff1-a912-efa57de9d56e service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:15.874433 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7961eb68-f978-460b-aa1c-91df10a3f5b7 req-b01f513a-8737-4ff1-a912-efa57de9d56e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:15.875034 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-7961eb68-f978-460b-aa1c-91df10a3f5b7 req-b01f513a-8737-4ff1-a912-efa57de9d56e service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:15.887448 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-7961eb68-f978-460b-aa1c-91df10a3f5b7 req-b01f513a-8737-4ff1-a912-efa57de9d56e service nova] Creating event network-vif-deleted:b1ca8476-7710-417f-8ea5-22678866a65e for instance 4f5dd873-c006-4367-85b9-4360f51cf6e9 on n-h1-860687-3 Oct 27 20:14:15.892916 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-7961eb68-f978-460b-aa1c-91df10a3f5b7 req-b01f513a-8737-4ff1-a912-efa57de9d56e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100942 Oct 27 20:14:15.893553 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4107/8062] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:14:16.005203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2509e0df-a2f9-4bff-814f-c64da2769deb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:16.005771 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2509e0df-a2f9-4bff-814f-c64da2769deb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:16.012748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2509e0df-a2f9-4bff-814f-c64da2769deb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:16.013263 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2509e0df-a2f9-4bff-814f-c64da2769deb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:16.013750 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2509e0df-a2f9-4bff-814f-c64da2769deb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:16.014497 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2509e0df-a2f9-4bff-814f-c64da2769deb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:16.014978 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2509e0df-a2f9-4bff-814f-c64da2769deb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:16.015432 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2509e0df-a2f9-4bff-814f-c64da2769deb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:16.085442 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2509e0df-a2f9-4bff-814f-c64da2769deb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:16.094663 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2509e0df-a2f9-4bff-814f-c64da2769deb tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1219 microversion: 2.1 time: 0.094282 Oct 27 20:14:16.096096 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3956/8063] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:15 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:17.122211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-71e94bf5-f3f3-431d-9e04-a2e165a56d57 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:17.122938 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-71e94bf5-f3f3-431d-9e04-a2e165a56d57 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:17.129855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e94bf5-f3f3-431d-9e04-a2e165a56d57 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:17.130346 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e94bf5-f3f3-431d-9e04-a2e165a56d57 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:17.130810 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e94bf5-f3f3-431d-9e04-a2e165a56d57 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:17.131504 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e94bf5-f3f3-431d-9e04-a2e165a56d57 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:17.131960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e94bf5-f3f3-431d-9e04-a2e165a56d57 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:17.132390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-71e94bf5-f3f3-431d-9e04-a2e165a56d57 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:17.197310 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-71e94bf5-f3f3-431d-9e04-a2e165a56d57 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:17.205833 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-71e94bf5-f3f3-431d-9e04-a2e165a56d57 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1219 microversion: 2.1 time: 0.088587 Oct 27 20:14:17.206425 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4108/8064] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:17 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:18.229545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d3bfe6c9-3a18-47dc-8647-6d29d99797a3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:18.230469 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d3bfe6c9-3a18-47dc-8647-6d29d99797a3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:18.238574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3bfe6c9-3a18-47dc-8647-6d29d99797a3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:18.239091 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3bfe6c9-3a18-47dc-8647-6d29d99797a3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:18.239553 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3bfe6c9-3a18-47dc-8647-6d29d99797a3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:18.240315 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3bfe6c9-3a18-47dc-8647-6d29d99797a3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:18.240793 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3bfe6c9-3a18-47dc-8647-6d29d99797a3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:18.241239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d3bfe6c9-3a18-47dc-8647-6d29d99797a3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:18.310215 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d3bfe6c9-3a18-47dc-8647-6d29d99797a3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:18.318406 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d3bfe6c9-3a18-47dc-8647-6d29d99797a3 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1219 microversion: 2.1 time: 0.093045 Oct 27 20:14:18.319000 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3957/8065] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:18 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:19.342282 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f0a10523-5f3b-43cf-88ef-a21bad5ecc13 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:19.342948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f0a10523-5f3b-43cf-88ef-a21bad5ecc13 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:19.350100 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0a10523-5f3b-43cf-88ef-a21bad5ecc13 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:19.350629 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0a10523-5f3b-43cf-88ef-a21bad5ecc13 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:19.351067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0a10523-5f3b-43cf-88ef-a21bad5ecc13 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:19.351772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0a10523-5f3b-43cf-88ef-a21bad5ecc13 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:19.352234 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0a10523-5f3b-43cf-88ef-a21bad5ecc13 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:19.352666 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f0a10523-5f3b-43cf-88ef-a21bad5ecc13 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:19.416192 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-f0a10523-5f3b-43cf-88ef-a21bad5ecc13 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:19.424868 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f0a10523-5f3b-43cf-88ef-a21bad5ecc13 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1219 microversion: 2.1 time: 0.086555 Oct 27 20:14:19.425446 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4109/8066] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:19 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:20.448795 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e27beea2-47ff-4ff5-9c48-e282eb57ae86 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:20.449639 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e27beea2-47ff-4ff5-9c48-e282eb57ae86 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:20.457969 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e27beea2-47ff-4ff5-9c48-e282eb57ae86 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:20.459148 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e27beea2-47ff-4ff5-9c48-e282eb57ae86 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:20.459994 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e27beea2-47ff-4ff5-9c48-e282eb57ae86 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:20.460853 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e27beea2-47ff-4ff5-9c48-e282eb57ae86 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:20.461334 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e27beea2-47ff-4ff5-9c48-e282eb57ae86 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:20.461782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e27beea2-47ff-4ff5-9c48-e282eb57ae86 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:20.499775 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e27beea2-47ff-4ff5-9c48-e282eb57ae86 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:20.500285 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e27beea2-47ff-4ff5-9c48-e282eb57ae86 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:20.500729 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e27beea2-47ff-4ff5-9c48-e282eb57ae86 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:20.501190 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-e27beea2-47ff-4ff5-9c48-e282eb57ae86 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lazy-loading 'fault' on Instance uuid 4f5dd873-c006-4367-85b9-4360f51cf6e9 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 20:14:20.545354 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e27beea2-47ff-4ff5-9c48-e282eb57ae86 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b28f9423b40e0bf3ed5e697208cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e997bd7269417282b7994f0c6f3412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:20.553213 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e27beea2-47ff-4ff5-9c48-e282eb57ae86 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 200 len: 1178 microversion: 2.1 time: 0.108277 Oct 27 20:14:20.554173 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3958/8067] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:20 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 1178 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:21.578993 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2f3794cd-ce31-4f7a-997d-b722313f47e9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:21.579607 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-2f3794cd-ce31-4f7a-997d-b722313f47e9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] [instance: 4f5dd873-c006-4367-85b9-4360f51cf6e9] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:21.587035 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f3794cd-ce31-4f7a-997d-b722313f47e9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:21.587528 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f3794cd-ce31-4f7a-997d-b722313f47e9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:21.587972 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f3794cd-ce31-4f7a-997d-b722313f47e9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:21.588676 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f3794cd-ce31-4f7a-997d-b722313f47e9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:21.589137 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f3794cd-ce31-4f7a-997d-b722313f47e9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:21.589572 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-2f3794cd-ce31-4f7a-997d-b722313f47e9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:21.603523 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-2f3794cd-ce31-4f7a-997d-b722313f47e9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] HTTP exception thrown: Instance 4f5dd873-c006-4367-85b9-4360f51cf6e9 could not be found. Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2f3794cd-ce31-4f7a-997d-b722313f47e9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Request method failure captured: Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 HTTP/1.1 Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWuRcEVseTxIdR_4WpxC0bvwVUA13sjW-rR6RCAJsDUnA7GqnkHYt8cEovXteknM_knoJBPwqYKdp1aZ9iUwLOMDq4obd8QIs07SSrgcSKx1vv2eBFtCoI1yqun6VnYZ3raNdL0s709hlBP-Nmvh13y2kGKATKHbnDwM7cHA5VbYiK3Y Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: 84e997bd7269417282b7994f0c6f3412 Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestShelveInstance-2024553854 Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/84e997bd7269417282b7994f0c6f3412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/84e997bd7269417282b7994f0c6f3412"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_84e997bd7269417282b7994f0c6f3412", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/84e997bd7269417282b7994f0c6f3412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestShelveInstance-2024553854 Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: 84e997bd7269417282b7994f0c6f3412 Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestShelveInstance-2024553854 Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestShelveInstance-2024553854-project Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: ea6b28f9423b40e0bf3ed5e697208cab Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestShelveInstance-2024553854-project Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 4f5dd873-c006-4367-85b9-4360f51cf6e9 could not be found. Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '4f5dd873-c006-4367-85b9-4360f51cf6e9'} Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f5dd873-c006-4367-85b9-4360f51cf6e9 could not be found. Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f5dd873-c006-4367-85b9-4360f51cf6e9 could not be found. Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 20:14:21.605218 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:14:21.610605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:14:21.610605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 20:14:21.610605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 20:14:21.610605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 20:14:21.610605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 20:14:21.610605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f5dd873-c006-4367-85b9-4360f51cf6e9 could not be found. Oct 27 20:14:21.610605 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:14:21.610605 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-2f3794cd-ce31-4f7a-997d-b722313f47e9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Returning 404 to user: Instance 4f5dd873-c006-4367-85b9-4360f51cf6e9 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 20:14:21.610605 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-2f3794cd-ce31-4f7a-997d-b722313f47e9 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9" status: 404 len: 111 microversion: 2.1 time: 0.032331 Oct 27 20:14:21.611504 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4110/8068] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:21 2022] GET /compute/v2.1/servers/4f5dd873-c006-4367-85b9-4360f51cf6e9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 20:14:21.778869 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9b9f374d-d5c9-4698-ae26-f26c43879004 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] Calling method '.version_select at 0x7fc86bc585e0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:21.806691 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9b9f374d-d5c9-4698-ae26-f26c43879004 tempest-TestShelveInstance-2024553854 tempest-TestShelveInstance-2024553854-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1066558570" status: 202 len: 0 microversion: 2.1 time: 0.031293 Oct 27 20:14:21.811322 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3959/8069] 10.222.0.42 () {58 vars in 1254 bytes} [Thu Oct 27 20:14:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1066558570 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 20:14:39.268207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=12 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:14:39.268948 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=24 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:14:39.446459 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f957213b-43f0-4e9e-972b-50a486f73d87 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Action: 'create', calling method: .version_select at 0x7fc86b2388b0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1137863691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2LgYpHGEcf2IuOEzFGgLLHpNfTh9a+YKruKZHeJRP6kivFrSDSd5mTK4UhhXCtBSvsXjs6kN0YyB3AM6F6E/fipe2rjT9bzYOFAP0AjdzO+dPsiDqhiwkOORpYo7U47w=="}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:14:39.463467 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-f957213b-43f0-4e9e-972b-50a486f73d87 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Getting quotas for project a2ef8d55da334751960a31489737d63d. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 20:14:39.469853 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-f957213b-43f0-4e9e-972b-50a486f73d87 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Getting quotas for user a8d57a41f04e4f01a65d0965efcb3855 and project a2ef8d55da334751960a31489737d63d. Resources: {'key_pairs'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 20:14:39.500547 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f957213b-43f0-4e9e-972b-50a486f73d87 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.237828 Oct 27 20:14:39.501171 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4111/8070] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 20:14:39 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:14:40.630962 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:14:40.631770 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:14:40.635946 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1730807435", "imageRef": "77589569-9b6a-4afc-8af7-7a43ef9ebc00", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1137863691", "security_groups": [{"name": "tempest-secgroup-smoke-1318797482"}], "networks": [{"uuid": "914049a2-ac79-4c03-8f9f-637405e1070d"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:14:40.879252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] validate_networks() for [('914049a2-ac79-4c03-8f9f-637405e1070d', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 20:14:41.338821 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 20:14:41.339276 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 20:14:41.339855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 20:14:41.340304 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 20:14:41.340754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 20:14:41.351621 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:41.352166 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:41.352663 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:41.353472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:41.353953 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:41.354421 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:41.373180 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Getting quotas for project a2ef8d55da334751960a31489737d63d. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 20:14:41.379043 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.quota [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Getting quotas for user a8d57a41f04e4f01a65d0965efcb3855 and project a2ef8d55da334751960a31489737d63d. Resources: {'cores', 'instances', 'ram'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 20:14:41.394475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 20:14:41.398365 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77589569-9b6a-4afc-8af7-7a43ef9ebc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 20:14:41.454030 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a0037d4e-5afe-4979-8ca6-b07745c51a61 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.824850 Oct 27 20:14:41.455041 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3960/8071] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 20:14:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 20:14:41.467537 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-00c6aa5c-c214-4157-89ab-c7aef6e3e429 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:41.468190 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-00c6aa5c-c214-4157-89ab-c7aef6e3e429 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:41.640399 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-00c6aa5c-c214-4157-89ab-c7aef6e3e429 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:41.647739 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-00c6aa5c-c214-4157-89ab-c7aef6e3e429 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1249 microversion: 2.1 time: 0.185093 Oct 27 20:14:41.648331 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4112/8072] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:41 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1249 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:42.671513 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d667b306-a87d-4a2f-afe6-41008031989a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:42.672239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d667b306-a87d-4a2f-afe6-41008031989a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:42.731090 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-d667b306-a87d-4a2f-afe6-41008031989a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:42.739346 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d667b306-a87d-4a2f-afe6-41008031989a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1249 microversion: 2.1 time: 0.071667 Oct 27 20:14:42.739947 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3961/8073] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:42 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1249 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:43.762987 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5b1edf2b-864f-493b-957e-ecedf8f5d15a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:43.763612 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5b1edf2b-864f-493b-957e-ecedf8f5d15a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:43.818350 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5b1edf2b-864f-493b-957e-ecedf8f5d15a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:43.825349 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5b1edf2b-864f-493b-957e-ecedf8f5d15a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1249 microversion: 2.1 time: 0.066177 Oct 27 20:14:43.826183 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4113/8074] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:43 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1249 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:44.849427 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e498de3-19e1-409a-a743-140a77d7d12f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:44.850152 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9e498de3-19e1-409a-a743-140a77d7d12f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:44.905861 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-9e498de3-19e1-409a-a743-140a77d7d12f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:44.913720 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9e498de3-19e1-409a-a743-140a77d7d12f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1249 microversion: 2.1 time: 0.068487 Oct 27 20:14:44.914367 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3962/8075] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:44 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1249 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:45.940443 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-db82ef76-6805-451f-a4af-0b457419a5f9 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:45.941067 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-db82ef76-6805-451f-a4af-0b457419a5f9 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:45.947960 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db82ef76-6805-451f-a4af-0b457419a5f9 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:45.948448 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db82ef76-6805-451f-a4af-0b457419a5f9 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:45.948891 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db82ef76-6805-451f-a4af-0b457419a5f9 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:45.949609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db82ef76-6805-451f-a4af-0b457419a5f9 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:45.950063 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db82ef76-6805-451f-a4af-0b457419a5f9 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:45.950525 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-db82ef76-6805-451f-a4af-0b457419a5f9 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:46.018173 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-db82ef76-6805-451f-a4af-0b457419a5f9 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:46.026784 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-db82ef76-6805-451f-a4af-0b457419a5f9 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1253 microversion: 2.1 time: 0.091924 Oct 27 20:14:46.027384 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4114/8076] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:45 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1253 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:47.051569 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b87d1be-08c1-4f3f-b294-deb63c9c599b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:47.052209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6b87d1be-08c1-4f3f-b294-deb63c9c599b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:47.060437 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b87d1be-08c1-4f3f-b294-deb63c9c599b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:47.060956 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b87d1be-08c1-4f3f-b294-deb63c9c599b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:47.061420 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b87d1be-08c1-4f3f-b294-deb63c9c599b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:47.062155 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b87d1be-08c1-4f3f-b294-deb63c9c599b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:47.062666 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b87d1be-08c1-4f3f-b294-deb63c9c599b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:47.063117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b87d1be-08c1-4f3f-b294-deb63c9c599b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:47.140173 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-6b87d1be-08c1-4f3f-b294-deb63c9c599b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:47.149158 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b87d1be-08c1-4f3f-b294-deb63c9c599b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1307 microversion: 2.1 time: 0.102471 Oct 27 20:14:47.149756 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3963/8077] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:47 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:48.015700 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-dff9379c-e06c-4a09-8865-e2dcc9ab0b47 req-d4c8cc19-43ac-482d-abf3-03488b269c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed50501-f2ab-4292-ab24-19e81c98b1a6", "tag": "a1164ecd-da51-4262-9afc-5fb311dd871e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:14:48.029732 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-dff9379c-e06c-4a09-8865-e2dcc9ab0b47 req-d4c8cc19-43ac-482d-abf3-03488b269c24 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:48.030300 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-dff9379c-e06c-4a09-8865-e2dcc9ab0b47 req-d4c8cc19-43ac-482d-abf3-03488b269c24 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:48.030762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-dff9379c-e06c-4a09-8865-e2dcc9ab0b47 req-d4c8cc19-43ac-482d-abf3-03488b269c24 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:48.044915 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-dff9379c-e06c-4a09-8865-e2dcc9ab0b47 req-d4c8cc19-43ac-482d-abf3-03488b269c24 service nova] Creating event network-changed:a1164ecd-da51-4262-9afc-5fb311dd871e for instance 7ed50501-f2ab-4292-ab24-19e81c98b1a6 on n-h1-860687-3 Oct 27 20:14:48.050765 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-dff9379c-e06c-4a09-8865-e2dcc9ab0b47 req-d4c8cc19-43ac-482d-abf3-03488b269c24 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038837 Oct 27 20:14:48.051372 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4115/8078] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:14:48.173906 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2a3f52c1-f360-40a2-88a1-f8a2cbb3bc40 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:48.174657 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2a3f52c1-f360-40a2-88a1-f8a2cbb3bc40 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:48.181447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a3f52c1-f360-40a2-88a1-f8a2cbb3bc40 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:48.181955 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a3f52c1-f360-40a2-88a1-f8a2cbb3bc40 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:48.182545 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a3f52c1-f360-40a2-88a1-f8a2cbb3bc40 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:48.183265 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a3f52c1-f360-40a2-88a1-f8a2cbb3bc40 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:48.183769 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a3f52c1-f360-40a2-88a1-f8a2cbb3bc40 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:48.184218 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2a3f52c1-f360-40a2-88a1-f8a2cbb3bc40 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:48.415679 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2a3f52c1-f360-40a2-88a1-f8a2cbb3bc40 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:48.424063 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2a3f52c1-f360-40a2-88a1-f8a2cbb3bc40 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1375 microversion: 2.1 time: 0.254110 Oct 27 20:14:48.424656 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3964/8079] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:48 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1375 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:49.447281 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c5df00d5-3453-413d-b670-3253c19ea228 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:49.448007 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c5df00d5-3453-413d-b670-3253c19ea228 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:49.455429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5df00d5-3453-413d-b670-3253c19ea228 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:49.455986 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5df00d5-3453-413d-b670-3253c19ea228 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:49.456429 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5df00d5-3453-413d-b670-3253c19ea228 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:49.457121 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5df00d5-3453-413d-b670-3253c19ea228 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:49.457578 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5df00d5-3453-413d-b670-3253c19ea228 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:49.458008 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5df00d5-3453-413d-b670-3253c19ea228 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:49.603557 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c5df00d5-3453-413d-b670-3253c19ea228 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:49.613786 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c5df00d5-3453-413d-b670-3253c19ea228 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1375 microversion: 2.1 time: 0.170700 Oct 27 20:14:49.614418 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4116/8080] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:49 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:50.637574 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e521062-7a34-466f-adef-59223c6da906 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:50.638216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e521062-7a34-466f-adef-59223c6da906 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:50.645623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e521062-7a34-466f-adef-59223c6da906 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:50.646136 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e521062-7a34-466f-adef-59223c6da906 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:50.646635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e521062-7a34-466f-adef-59223c6da906 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:50.647373 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e521062-7a34-466f-adef-59223c6da906 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:50.647852 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e521062-7a34-466f-adef-59223c6da906 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:50.648630 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e521062-7a34-466f-adef-59223c6da906 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:50.786299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e521062-7a34-466f-adef-59223c6da906 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:50.794054 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e521062-7a34-466f-adef-59223c6da906 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1375 microversion: 2.1 time: 0.160563 Oct 27 20:14:50.794653 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3965/8081] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:50 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:51.819263 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-809e390c-ee0c-43c6-9511-c6d105cced97 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:51.819878 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-809e390c-ee0c-43c6-9511-c6d105cced97 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:51.826182 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-809e390c-ee0c-43c6-9511-c6d105cced97 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:51.826704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-809e390c-ee0c-43c6-9511-c6d105cced97 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:51.827142 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-809e390c-ee0c-43c6-9511-c6d105cced97 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:51.827831 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-809e390c-ee0c-43c6-9511-c6d105cced97 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:51.828287 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-809e390c-ee0c-43c6-9511-c6d105cced97 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:51.828720 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-809e390c-ee0c-43c6-9511-c6d105cced97 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:51.961966 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-809e390c-ee0c-43c6-9511-c6d105cced97 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:51.969844 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-809e390c-ee0c-43c6-9511-c6d105cced97 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1375 microversion: 2.1 time: 0.154735 Oct 27 20:14:51.970566 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4117/8082] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:51 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:52.813433 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-82e442b4-d4c8-4f6f-88df-ee74885842ac req-7e19ea97-6b80-4737-b482-45b508795b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed50501-f2ab-4292-ab24-19e81c98b1a6", "name": "network-vif-plugged", "status": "completed", "tag": "a1164ecd-da51-4262-9afc-5fb311dd871e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:14:52.818604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:14:52.824788 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-82e442b4-d4c8-4f6f-88df-ee74885842ac req-7e19ea97-6b80-4737-b482-45b508795b85 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:52.825288 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-82e442b4-d4c8-4f6f-88df-ee74885842ac req-7e19ea97-6b80-4737-b482-45b508795b85 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:52.826005 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-82e442b4-d4c8-4f6f-88df-ee74885842ac req-7e19ea97-6b80-4737-b482-45b508795b85 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:52.837502 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-82e442b4-d4c8-4f6f-88df-ee74885842ac req-7e19ea97-6b80-4737-b482-45b508795b85 service nova] Creating event network-vif-plugged:a1164ecd-da51-4262-9afc-5fb311dd871e for instance 7ed50501-f2ab-4292-ab24-19e81c98b1a6 on n-h1-860687-3 Oct 27 20:14:52.842759 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-82e442b4-d4c8-4f6f-88df-ee74885842ac req-7e19ea97-6b80-4737-b482-45b508795b85 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033410 Oct 27 20:14:52.843636 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3966/8083] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:14:52.993024 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-b2887d70-5163-45ed-ac50-5f75238b4ecb tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:52.993644 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-b2887d70-5163-45ed-ac50-5f75238b4ecb tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:53.000617 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2887d70-5163-45ed-ac50-5f75238b4ecb tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:53.001113 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2887d70-5163-45ed-ac50-5f75238b4ecb tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:53.001562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2887d70-5163-45ed-ac50-5f75238b4ecb tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:53.002274 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2887d70-5163-45ed-ac50-5f75238b4ecb tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:53.002762 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2887d70-5163-45ed-ac50-5f75238b4ecb tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:53.003199 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-b2887d70-5163-45ed-ac50-5f75238b4ecb tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:53.139681 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-b2887d70-5163-45ed-ac50-5f75238b4ecb tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:53.149964 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-b2887d70-5163-45ed-ac50-5f75238b4ecb tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1375 microversion: 2.1 time: 0.160911 Oct 27 20:14:53.150560 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4118/8084] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:52 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:54.175782 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-35d0df62-0579-42e1-a5f0-d0af2dd62183 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:54.176720 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-35d0df62-0579-42e1-a5f0-d0af2dd62183 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:54.183632 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35d0df62-0579-42e1-a5f0-d0af2dd62183 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:54.184160 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35d0df62-0579-42e1-a5f0-d0af2dd62183 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:54.184623 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35d0df62-0579-42e1-a5f0-d0af2dd62183 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:54.185353 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35d0df62-0579-42e1-a5f0-d0af2dd62183 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:54.185882 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35d0df62-0579-42e1-a5f0-d0af2dd62183 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:54.186336 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35d0df62-0579-42e1-a5f0-d0af2dd62183 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:54.324604 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-35d0df62-0579-42e1-a5f0-d0af2dd62183 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:54.333350 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-35d0df62-0579-42e1-a5f0-d0af2dd62183 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1561 microversion: 2.1 time: 0.163477 Oct 27 20:14:54.333937 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3967/8085] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:54 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:54.355955 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-96597666-9a9e-4fee-9df3-7bc64a2ae2e4 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:14:54.356567 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-96597666-9a9e-4fee-9df3-7bc64a2ae2e4 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:14:54.358533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=8 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:14:54.365601 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96597666-9a9e-4fee-9df3-7bc64a2ae2e4 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:54.366085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96597666-9a9e-4fee-9df3-7bc64a2ae2e4 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:54.366562 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96597666-9a9e-4fee-9df3-7bc64a2ae2e4 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:54.367252 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96597666-9a9e-4fee-9df3-7bc64a2ae2e4 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:54.367706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96597666-9a9e-4fee-9df3-7bc64a2ae2e4 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:54.368133 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-96597666-9a9e-4fee-9df3-7bc64a2ae2e4 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:54.499333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-96597666-9a9e-4fee-9df3-7bc64a2ae2e4 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:14:54.507981 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-96597666-9a9e-4fee-9df3-7bc64a2ae2e4 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1561 microversion: 2.1 time: 0.155852 Oct 27 20:14:54.508569 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4119/8086] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:14:54 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:14:56.146689 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=10 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:14:56.205496 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-fda1cf33-f94e-416a-ad9f-b2c9bcebee2c req-cf8310d7-5479-4ab4-854c-0bf0580a2518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed50501-f2ab-4292-ab24-19e81c98b1a6", "tag": "a1164ecd-da51-4262-9afc-5fb311dd871e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:14:56.215176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fda1cf33-f94e-416a-ad9f-b2c9bcebee2c req-cf8310d7-5479-4ab4-854c-0bf0580a2518 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:14:56.215683 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fda1cf33-f94e-416a-ad9f-b2c9bcebee2c req-cf8310d7-5479-4ab4-854c-0bf0580a2518 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:14:56.216140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fda1cf33-f94e-416a-ad9f-b2c9bcebee2c req-cf8310d7-5479-4ab4-854c-0bf0580a2518 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:14:56.228593 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-fda1cf33-f94e-416a-ad9f-b2c9bcebee2c req-cf8310d7-5479-4ab4-854c-0bf0580a2518 service nova] Creating event network-changed:a1164ecd-da51-4262-9afc-5fb311dd871e for instance 7ed50501-f2ab-4292-ab24-19e81c98b1a6 on n-h1-860687-3 Oct 27 20:14:56.233945 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-fda1cf33-f94e-416a-ad9f-b2c9bcebee2c req-cf8310d7-5479-4ab4-854c-0bf0580a2518 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093507 Oct 27 20:14:56.234602 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3968/8087] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 20:16:53.279917 n-d-860687-3 devstack@n-api.service[127029]: ERROR oslo.messaging._drivers.impl_rabbit [-] [40297e18-f715-404d-a7a8-44159721b4a8] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 20:16:53.280986 n-d-860687-3 devstack@n-api.service[127029]: ERROR oslo.messaging._drivers.impl_rabbit [-] [66fa3103-a1fe-46ef-965e-69c22fe0df2e] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 20:16:53.281510 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:16:53.282311 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=32 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:16:53.287561 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-07a2b77f-29c2-4a8e-bfd3-dc9d06e5c46a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-466698225"}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:16:53.289845 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-07a2b77f-29c2-4a8e-bfd3-dc9d06e5c46a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:16:53.297766 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07a2b77f-29c2-4a8e-bfd3-dc9d06e5c46a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:16:53.298255 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07a2b77f-29c2-4a8e-bfd3-dc9d06e5c46a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:16:53.298726 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07a2b77f-29c2-4a8e-bfd3-dc9d06e5c46a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:16:53.299424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07a2b77f-29c2-4a8e-bfd3-dc9d06e5c46a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:16:53.299886 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07a2b77f-29c2-4a8e-bfd3-dc9d06e5c46a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:16:53.300321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-07a2b77f-29c2-4a8e-bfd3-dc9d06e5c46a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:16:53.502247 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-07a2b77f-29c2-4a8e-bfd3-dc9d06e5c46a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "POST /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6/action" status: 202 len: 0 microversion: 2.1 time: 0.224799 Oct 27 20:16:53.502945 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4120/8088] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:16:53 2022] POST /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 20:16:57.295944 n-d-860687-3 devstack@n-api.service[127028]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a87a1486-b96d-4ed3-afbc-04da999a872c] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 20:16:57.296959 n-d-860687-3 devstack@n-api.service[127028]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e8240a4d-ecaa-42c4-8b5a-9ab82de7a90d] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 20:16:57.297568 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:16:57.298672 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=30 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:16:57.369643 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d0140dfe-ecea-479d-97dd-e39c4c280e05 req-fa556627-96ad-4fef-be2d-9bb787aa3826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed50501-f2ab-4292-ab24-19e81c98b1a6", "name": "network-vif-plugged", "status": "completed", "tag": "a1164ecd-da51-4262-9afc-5fb311dd871e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:16:57.392828 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d0140dfe-ecea-479d-97dd-e39c4c280e05 req-fa556627-96ad-4fef-be2d-9bb787aa3826 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:16:57.393338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d0140dfe-ecea-479d-97dd-e39c4c280e05 req-fa556627-96ad-4fef-be2d-9bb787aa3826 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:16:57.393767 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d0140dfe-ecea-479d-97dd-e39c4c280e05 req-fa556627-96ad-4fef-be2d-9bb787aa3826 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:16:57.407638 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d0140dfe-ecea-479d-97dd-e39c4c280e05 req-fa556627-96ad-4fef-be2d-9bb787aa3826 service nova] Creating event network-vif-plugged:a1164ecd-da51-4262-9afc-5fb311dd871e for instance 7ed50501-f2ab-4292-ab24-19e81c98b1a6 on n-h1-860687-3 Oct 27 20:16:57.412819 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d0140dfe-ecea-479d-97dd-e39c4c280e05 req-fa556627-96ad-4fef-be2d-9bb787aa3826 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119219 Oct 27 20:16:57.413433 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3969/8089] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:17:07.063145 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1632917449", "imageRef": "1adc958a-37ae-4b13-b0b2-8627b70f21ae", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1137863691", "security_groups": [{"name": "tempest-secgroup-smoke-1318797482"}], "networks": [{"uuid": "914049a2-ac79-4c03-8f9f-637405e1070d"}]}} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:17:07.073819 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:17:07.074533 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:17:07.093398 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] [66fa3103-a1fe-46ef-965e-69c22fe0df2e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39622. Oct 27 20:17:07.095416 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] [40297e18-f715-404d-a7a8-44159721b4a8] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39620. Oct 27 20:17:07.493265 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.network.neutron [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] validate_networks() for [('914049a2-ac79-4c03-8f9f-637405e1070d', None, None, None, None, None)] {{(pid=127029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 20:17:07.917622 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Flavor limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 20:17:07.918053 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Image limits 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 20:17:07.918577 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Flavor pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 20:17:07.918997 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Image pref 0:0:0 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 20:17:07.919420 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.virt.hardware [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 20:17:07.929336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:07.929851 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:07.930297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:07.931072 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:07.931523 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:07.931956 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:07.949367 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Getting quotas for project a2ef8d55da334751960a31489737d63d. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 20:17:07.956207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.quota [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Getting quotas for user a8d57a41f04e4f01a65d0965efcb3855 and project a2ef8d55da334751960a31489737d63d. Resources: {'cores', 'instances', 'ram'} {{(pid=127029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 20:17:07.969264 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Going to run 1 instances... {{(pid=127029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 20:17:07.971776 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1adc958a-37ae-4b13-b0b2-8627b70f21ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 20:17:08.020312 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-f6d40ee0-532a-414a-8571-48a7aa3a1d49 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.962065 Oct 27 20:17:08.020977 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4121/8090] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 20:17:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 20:17:08.032329 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:17:08.033203 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:17:08.039030 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-715db968-bbcf-4050-b9de-4f2f2bed2e6f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:08.040405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-715db968-bbcf-4050-b9de-4f2f2bed2e6f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:08.059260 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] [e8240a4d-ecaa-42c4-8b5a-9ab82de7a90d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39640. Oct 27 20:17:08.073970 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] [a87a1486-b96d-4ed3-afbc-04da999a872c] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39638. Oct 27 20:17:08.109927 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-715db968-bbcf-4050-b9de-4f2f2bed2e6f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:08.117378 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-715db968-bbcf-4050-b9de-4f2f2bed2e6f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1249 microversion: 2.1 time: 0.088822 Oct 27 20:17:08.118261 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3970/8091] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:08 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 20:17:09.141490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-9039d297-002a-4d8b-8c7d-367ccdc9aaac tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:09.142898 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-9039d297-002a-4d8b-8c7d-367ccdc9aaac tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:09.149476 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9039d297-002a-4d8b-8c7d-367ccdc9aaac tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:09.150033 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9039d297-002a-4d8b-8c7d-367ccdc9aaac tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:09.150816 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9039d297-002a-4d8b-8c7d-367ccdc9aaac tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:09.151593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9039d297-002a-4d8b-8c7d-367ccdc9aaac tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:09.152141 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9039d297-002a-4d8b-8c7d-367ccdc9aaac tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:09.152689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-9039d297-002a-4d8b-8c7d-367ccdc9aaac tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:09.238364 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-9039d297-002a-4d8b-8c7d-367ccdc9aaac tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:09.249765 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-9039d297-002a-4d8b-8c7d-367ccdc9aaac tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1319 microversion: 2.1 time: 0.111887 Oct 27 20:17:09.250362 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4122/8092] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:09 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1319 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:09.358572 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-8ee9aab7-08fb-418b-afc2-a2fff0de14a4 req-6fbfe0b1-40ee-4f17-bc64-0fe4a2a47df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed50501-f2ab-4292-ab24-19e81c98b1a6", "name": "network-vif-unplugged", "status": "completed", "tag": "a1164ecd-da51-4262-9afc-5fb311dd871e"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:17:09.375256 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8ee9aab7-08fb-418b-afc2-a2fff0de14a4 req-6fbfe0b1-40ee-4f17-bc64-0fe4a2a47df1 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:09.376007 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8ee9aab7-08fb-418b-afc2-a2fff0de14a4 req-6fbfe0b1-40ee-4f17-bc64-0fe4a2a47df1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:09.376614 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8ee9aab7-08fb-418b-afc2-a2fff0de14a4 req-6fbfe0b1-40ee-4f17-bc64-0fe4a2a47df1 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:09.390593 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-8ee9aab7-08fb-418b-afc2-a2fff0de14a4 req-6fbfe0b1-40ee-4f17-bc64-0fe4a2a47df1 service nova] Creating event network-vif-unplugged:a1164ecd-da51-4262-9afc-5fb311dd871e for instance 7ed50501-f2ab-4292-ab24-19e81c98b1a6 on n-h1-860687-3 Oct 27 20:17:09.397680 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-8ee9aab7-08fb-418b-afc2-a2fff0de14a4 req-6fbfe0b1-40ee-4f17-bc64-0fe4a2a47df1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051765 Oct 27 20:17:09.399255 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3971/8093] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:17:10.274665 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-0e0d79c2-36fc-4eeb-8fb9-d715bb3b4032 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:10.275465 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-0e0d79c2-36fc-4eeb-8fb9-d715bb3b4032 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:10.283186 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e0d79c2-36fc-4eeb-8fb9-d715bb3b4032 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:10.284579 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e0d79c2-36fc-4eeb-8fb9-d715bb3b4032 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:10.285022 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e0d79c2-36fc-4eeb-8fb9-d715bb3b4032 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:10.285770 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e0d79c2-36fc-4eeb-8fb9-d715bb3b4032 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:10.286231 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e0d79c2-36fc-4eeb-8fb9-d715bb3b4032 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:10.286688 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-0e0d79c2-36fc-4eeb-8fb9-d715bb3b4032 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:10.451788 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-0e0d79c2-36fc-4eeb-8fb9-d715bb3b4032 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:10.461962 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-0e0d79c2-36fc-4eeb-8fb9-d715bb3b4032 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1375 microversion: 2.1 time: 0.192098 Oct 27 20:17:10.462577 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4123/8094] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:10 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1375 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:11.487084 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-086643be-2148-454e-a41f-c262ac789e52 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:11.488355 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-086643be-2148-454e-a41f-c262ac789e52 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:11.512529 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-086643be-2148-454e-a41f-c262ac789e52 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:11.513049 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-086643be-2148-454e-a41f-c262ac789e52 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:11.514323 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-086643be-2148-454e-a41f-c262ac789e52 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:11.514470 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-086643be-2148-454e-a41f-c262ac789e52 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:11.515076 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-086643be-2148-454e-a41f-c262ac789e52 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:11.515699 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-086643be-2148-454e-a41f-c262ac789e52 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:11.683014 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-086643be-2148-454e-a41f-c262ac789e52 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:11.691986 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-086643be-2148-454e-a41f-c262ac789e52 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1375 microversion: 2.1 time: 0.210583 Oct 27 20:17:11.692590 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3972/8095] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:11 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1375 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:12.719606 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-5baf984c-2b70-4f12-aa57-ea0986e6d29a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:12.720336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-5baf984c-2b70-4f12-aa57-ea0986e6d29a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:12.728463 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5baf984c-2b70-4f12-aa57-ea0986e6d29a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:12.728963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5baf984c-2b70-4f12-aa57-ea0986e6d29a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:12.729413 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5baf984c-2b70-4f12-aa57-ea0986e6d29a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:12.730131 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5baf984c-2b70-4f12-aa57-ea0986e6d29a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:12.730625 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5baf984c-2b70-4f12-aa57-ea0986e6d29a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:12.731059 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-5baf984c-2b70-4f12-aa57-ea0986e6d29a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:12.878950 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-5baf984c-2b70-4f12-aa57-ea0986e6d29a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:12.888645 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-5baf984c-2b70-4f12-aa57-ea0986e6d29a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1375 microversion: 2.1 time: 0.174756 Oct 27 20:17:12.889343 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4124/8096] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:12 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:13.912374 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55166b47-7bae-48f3-af61-427fc5d5368a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:13.913140 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-55166b47-7bae-48f3-af61-427fc5d5368a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:13.920899 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55166b47-7bae-48f3-af61-427fc5d5368a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:13.921701 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55166b47-7bae-48f3-af61-427fc5d5368a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:13.922512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55166b47-7bae-48f3-af61-427fc5d5368a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:13.923252 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55166b47-7bae-48f3-af61-427fc5d5368a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:13.923866 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55166b47-7bae-48f3-af61-427fc5d5368a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:13.924368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55166b47-7bae-48f3-af61-427fc5d5368a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:14.079801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-55166b47-7bae-48f3-af61-427fc5d5368a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:14.089576 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-55166b47-7bae-48f3-af61-427fc5d5368a tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1375 microversion: 2.1 time: 0.181054 Oct 27 20:17:14.097489 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3973/8097] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:13 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1375 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:15.116407 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-81a97575-4fa0-41ab-aeff-b58dae22ad94 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:15.117694 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-81a97575-4fa0-41ab-aeff-b58dae22ad94 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:15.125424 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81a97575-4fa0-41ab-aeff-b58dae22ad94 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:15.126240 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81a97575-4fa0-41ab-aeff-b58dae22ad94 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:15.126884 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81a97575-4fa0-41ab-aeff-b58dae22ad94 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:15.127782 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81a97575-4fa0-41ab-aeff-b58dae22ad94 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:15.128409 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81a97575-4fa0-41ab-aeff-b58dae22ad94 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:15.129036 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-81a97575-4fa0-41ab-aeff-b58dae22ad94 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:15.300286 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-81a97575-4fa0-41ab-aeff-b58dae22ad94 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:15.309579 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-81a97575-4fa0-41ab-aeff-b58dae22ad94 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1375 microversion: 2.1 time: 0.197251 Oct 27 20:17:15.317253 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4125/8098] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:15 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1375 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:16.333532 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ee8bcad-c367-480d-b9b6-eb0e3de8ce26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:16.334174 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3ee8bcad-c367-480d-b9b6-eb0e3de8ce26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:16.341060 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ee8bcad-c367-480d-b9b6-eb0e3de8ce26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:16.342239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ee8bcad-c367-480d-b9b6-eb0e3de8ce26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:16.342931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ee8bcad-c367-480d-b9b6-eb0e3de8ce26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:16.343824 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ee8bcad-c367-480d-b9b6-eb0e3de8ce26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:16.344300 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ee8bcad-c367-480d-b9b6-eb0e3de8ce26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:16.344748 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ee8bcad-c367-480d-b9b6-eb0e3de8ce26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:16.495813 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ee8bcad-c367-480d-b9b6-eb0e3de8ce26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:16.504564 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3ee8bcad-c367-480d-b9b6-eb0e3de8ce26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1375 microversion: 2.1 time: 0.175076 Oct 27 20:17:16.505144 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3974/8099] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:16 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:17.527387 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-42875054-82fa-419f-ab1d-b80b01ba4f21 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:17.528012 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-42875054-82fa-419f-ab1d-b80b01ba4f21 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:17.535302 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42875054-82fa-419f-ab1d-b80b01ba4f21 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:17.535795 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42875054-82fa-419f-ab1d-b80b01ba4f21 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:17.536242 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42875054-82fa-419f-ab1d-b80b01ba4f21 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:17.536936 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42875054-82fa-419f-ab1d-b80b01ba4f21 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:17.537393 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42875054-82fa-419f-ab1d-b80b01ba4f21 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:17.537821 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-42875054-82fa-419f-ab1d-b80b01ba4f21 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:17.671565 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-42875054-82fa-419f-ab1d-b80b01ba4f21 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:17.679364 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-42875054-82fa-419f-ab1d-b80b01ba4f21 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1375 microversion: 2.1 time: 0.155900 Oct 27 20:17:17.679946 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4126/8100] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:17 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:18.704943 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2726ee25-f059-401c-ba6f-28a62da8a13d tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:18.705743 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2726ee25-f059-401c-ba6f-28a62da8a13d tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:18.708841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:17:18.714958 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2726ee25-f059-401c-ba6f-28a62da8a13d tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:18.715486 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2726ee25-f059-401c-ba6f-28a62da8a13d tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:18.715992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2726ee25-f059-401c-ba6f-28a62da8a13d tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:18.716834 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2726ee25-f059-401c-ba6f-28a62da8a13d tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:18.717310 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2726ee25-f059-401c-ba6f-28a62da8a13d tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:18.717759 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2726ee25-f059-401c-ba6f-28a62da8a13d tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:18.860694 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-2726ee25-f059-401c-ba6f-28a62da8a13d tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:18.868915 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2726ee25-f059-401c-ba6f-28a62da8a13d tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1375 microversion: 2.1 time: 0.168644 Oct 27 20:17:18.869598 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3975/8101] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:18 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:19.387991 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-fbd5098a-cd77-472d-baaa-0619a3e0179e req-de763906-b528-47cf-8f42-e94587cb57ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4254db22-4ac1-446f-88f6-6ee9d3945f0e", "tag": "6ab429a9-c452-43e0-a4ae-dc5d0701194d"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:17:19.393981 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:17:19.399104 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell0:SELECT=6 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:17:19.408297 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fbd5098a-cd77-472d-baaa-0619a3e0179e req-de763906-b528-47cf-8f42-e94587cb57ea service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:19.408793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fbd5098a-cd77-472d-baaa-0619a3e0179e req-de763906-b528-47cf-8f42-e94587cb57ea service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:19.409321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-fbd5098a-cd77-472d-baaa-0619a3e0179e req-de763906-b528-47cf-8f42-e94587cb57ea service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:19.421187 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-fbd5098a-cd77-472d-baaa-0619a3e0179e req-de763906-b528-47cf-8f42-e94587cb57ea service nova] Creating event network-changed:6ab429a9-c452-43e0-a4ae-dc5d0701194d for instance 4254db22-4ac1-446f-88f6-6ee9d3945f0e on n-h2-860687-3 Oct 27 20:17:19.426191 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-fbd5098a-cd77-472d-baaa-0619a3e0179e req-de763906-b528-47cf-8f42-e94587cb57ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042048 Oct 27 20:17:19.426831 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4127/8102] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:17:19.892871 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-920703e1-1866-4442-8607-fb7d066ecb3e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:19.893447 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-920703e1-1866-4442-8607-fb7d066ecb3e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:19.900268 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-920703e1-1866-4442-8607-fb7d066ecb3e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:19.900765 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-920703e1-1866-4442-8607-fb7d066ecb3e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:19.901216 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-920703e1-1866-4442-8607-fb7d066ecb3e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:19.901919 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-920703e1-1866-4442-8607-fb7d066ecb3e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:19.902405 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-920703e1-1866-4442-8607-fb7d066ecb3e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:19.902855 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-920703e1-1866-4442-8607-fb7d066ecb3e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:20.035343 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-920703e1-1866-4442-8607-fb7d066ecb3e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:20.043595 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-920703e1-1866-4442-8607-fb7d066ecb3e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1375 microversion: 2.1 time: 0.154628 Oct 27 20:17:20.048368 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3976/8103] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:19 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:21.069250 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-dcd875a2-0cd7-4828-9f4c-51c85975c4c5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:21.069963 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-dcd875a2-0cd7-4828-9f4c-51c85975c4c5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:21.077777 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcd875a2-0cd7-4828-9f4c-51c85975c4c5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:21.078320 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcd875a2-0cd7-4828-9f4c-51c85975c4c5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:21.078855 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcd875a2-0cd7-4828-9f4c-51c85975c4c5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:21.079575 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcd875a2-0cd7-4828-9f4c-51c85975c4c5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:21.080144 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcd875a2-0cd7-4828-9f4c-51c85975c4c5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:21.080584 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-dcd875a2-0cd7-4828-9f4c-51c85975c4c5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:21.225305 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-dcd875a2-0cd7-4828-9f4c-51c85975c4c5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:21.233619 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-dcd875a2-0cd7-4828-9f4c-51c85975c4c5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1375 microversion: 2.1 time: 0.169555 Oct 27 20:17:21.234205 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4128/8104] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:21 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:22.256816 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-72d3a74a-7a62-4e0c-a678-491c28edc16c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:22.257453 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-72d3a74a-7a62-4e0c-a678-491c28edc16c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:22.264644 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72d3a74a-7a62-4e0c-a678-491c28edc16c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:22.265157 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72d3a74a-7a62-4e0c-a678-491c28edc16c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:22.265615 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72d3a74a-7a62-4e0c-a678-491c28edc16c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:22.266338 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72d3a74a-7a62-4e0c-a678-491c28edc16c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:22.266848 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72d3a74a-7a62-4e0c-a678-491c28edc16c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:22.267299 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-72d3a74a-7a62-4e0c-a678-491c28edc16c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:22.415479 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-72d3a74a-7a62-4e0c-a678-491c28edc16c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:22.424019 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-72d3a74a-7a62-4e0c-a678-491c28edc16c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1375 microversion: 2.1 time: 0.171189 Oct 27 20:17:22.424607 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3977/8105] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:22 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:23.448211 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-d47e577a-887e-4d8e-9abd-c348bafe3577 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:23.448828 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-d47e577a-887e-4d8e-9abd-c348bafe3577 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:23.456798 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d47e577a-887e-4d8e-9abd-c348bafe3577 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:23.457326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d47e577a-887e-4d8e-9abd-c348bafe3577 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:23.457767 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d47e577a-887e-4d8e-9abd-c348bafe3577 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:23.458494 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d47e577a-887e-4d8e-9abd-c348bafe3577 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:23.458958 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d47e577a-887e-4d8e-9abd-c348bafe3577 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:23.459390 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-d47e577a-887e-4d8e-9abd-c348bafe3577 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:23.603530 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-d47e577a-887e-4d8e-9abd-c348bafe3577 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:23.612352 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-d47e577a-887e-4d8e-9abd-c348bafe3577 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1375 microversion: 2.1 time: 0.168069 Oct 27 20:17:23.612925 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4129/8106] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:23 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:24.531512 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-8091a73e-88de-4437-b250-ebf152a3020a req-3f576908-e783-4a0e-9c86-2712e4c60295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4254db22-4ac1-446f-88f6-6ee9d3945f0e", "name": "network-vif-plugged", "status": "completed", "tag": "6ab429a9-c452-43e0-a4ae-dc5d0701194d"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:17:24.543449 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8091a73e-88de-4437-b250-ebf152a3020a req-3f576908-e783-4a0e-9c86-2712e4c60295 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:24.543784 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8091a73e-88de-4437-b250-ebf152a3020a req-3f576908-e783-4a0e-9c86-2712e4c60295 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:24.544931 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8091a73e-88de-4437-b250-ebf152a3020a req-3f576908-e783-4a0e-9c86-2712e4c60295 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:24.557259 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-8091a73e-88de-4437-b250-ebf152a3020a req-3f576908-e783-4a0e-9c86-2712e4c60295 service nova] Creating event network-vif-plugged:6ab429a9-c452-43e0-a4ae-dc5d0701194d for instance 4254db22-4ac1-446f-88f6-6ee9d3945f0e on n-h2-860687-3 Oct 27 20:17:24.563894 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-8091a73e-88de-4437-b250-ebf152a3020a req-3f576908-e783-4a0e-9c86-2712e4c60295 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036179 Oct 27 20:17:24.564759 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3978/8107] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:17:24.636316 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-13c696a7-9fb4-4619-bae9-239221440230 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:24.636869 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-13c696a7-9fb4-4619-bae9-239221440230 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:24.643768 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13c696a7-9fb4-4619-bae9-239221440230 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:24.644262 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13c696a7-9fb4-4619-bae9-239221440230 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:24.644706 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13c696a7-9fb4-4619-bae9-239221440230 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:24.645414 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13c696a7-9fb4-4619-bae9-239221440230 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:24.645872 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13c696a7-9fb4-4619-bae9-239221440230 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:24.646307 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-13c696a7-9fb4-4619-bae9-239221440230 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:24.803750 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-13c696a7-9fb4-4619-bae9-239221440230 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:24.812014 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-13c696a7-9fb4-4619-bae9-239221440230 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1375 microversion: 2.1 time: 0.179745 Oct 27 20:17:24.812591 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4130/8108] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:24 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:25.836483 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-87659f1c-1042-449b-9dd7-75961585ad44 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:25.837134 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-87659f1c-1042-449b-9dd7-75961585ad44 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:25.843400 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87659f1c-1042-449b-9dd7-75961585ad44 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:25.843907 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87659f1c-1042-449b-9dd7-75961585ad44 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:25.844368 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87659f1c-1042-449b-9dd7-75961585ad44 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:25.845113 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87659f1c-1042-449b-9dd7-75961585ad44 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:25.845589 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87659f1c-1042-449b-9dd7-75961585ad44 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:25.846039 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87659f1c-1042-449b-9dd7-75961585ad44 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:25.980610 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-87659f1c-1042-449b-9dd7-75961585ad44 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:25.989330 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-87659f1c-1042-449b-9dd7-75961585ad44 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1375 microversion: 2.1 time: 0.158002 Oct 27 20:17:25.989911 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3979/8109] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:25 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:27.013295 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-1fabe9c1-c3f2-47b4-98da-ea8def759eb5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:27.013920 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-1fabe9c1-c3f2-47b4-98da-ea8def759eb5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:27.020786 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fabe9c1-c3f2-47b4-98da-ea8def759eb5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:27.021278 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fabe9c1-c3f2-47b4-98da-ea8def759eb5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:27.021722 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fabe9c1-c3f2-47b4-98da-ea8def759eb5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:27.022444 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fabe9c1-c3f2-47b4-98da-ea8def759eb5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:27.022912 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fabe9c1-c3f2-47b4-98da-ea8def759eb5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:27.023347 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-1fabe9c1-c3f2-47b4-98da-ea8def759eb5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:27.154321 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-1fabe9c1-c3f2-47b4-98da-ea8def759eb5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:27.162170 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-1fabe9c1-c3f2-47b4-98da-ea8def759eb5 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1560 microversion: 2.1 time: 0.152943 Oct 27 20:17:27.162774 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4131/8110] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:27 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:27.185717 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e43ad225-30a0-4bb8-a4bf-15fe44f4b3dd tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:17:27.186339 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e43ad225-30a0-4bb8-a4bf-15fe44f4b3dd tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:17:27.193176 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e43ad225-30a0-4bb8-a4bf-15fe44f4b3dd tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:27.193678 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e43ad225-30a0-4bb8-a4bf-15fe44f4b3dd tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:27.194137 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e43ad225-30a0-4bb8-a4bf-15fe44f4b3dd tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:27.194887 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e43ad225-30a0-4bb8-a4bf-15fe44f4b3dd tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:27.195363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e43ad225-30a0-4bb8-a4bf-15fe44f4b3dd tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:27.195841 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e43ad225-30a0-4bb8-a4bf-15fe44f4b3dd tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:27.325141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-e43ad225-30a0-4bb8-a4bf-15fe44f4b3dd tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:17:27.333669 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e43ad225-30a0-4bb8-a4bf-15fe44f4b3dd tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1560 microversion: 2.1 time: 0.152055 Oct 27 20:17:27.334278 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3980/8111] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:17:27 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:17:28.936609 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-190e4e57-3988-44ca-8f29-2c90253cbb71 req-de2ba0e2-dcd2-48c4-bbf4-a791705e9705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4254db22-4ac1-446f-88f6-6ee9d3945f0e", "tag": "6ab429a9-c452-43e0-a4ae-dc5d0701194d"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:17:28.947640 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-190e4e57-3988-44ca-8f29-2c90253cbb71 req-de2ba0e2-dcd2-48c4-bbf4-a791705e9705 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:17:28.948041 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-190e4e57-3988-44ca-8f29-2c90253cbb71 req-de2ba0e2-dcd2-48c4-bbf4-a791705e9705 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:17:28.948489 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-190e4e57-3988-44ca-8f29-2c90253cbb71 req-de2ba0e2-dcd2-48c4-bbf4-a791705e9705 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:17:28.961829 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-190e4e57-3988-44ca-8f29-2c90253cbb71 req-de2ba0e2-dcd2-48c4-bbf4-a791705e9705 service nova] Creating event network-changed:6ab429a9-c452-43e0-a4ae-dc5d0701194d for instance 4254db22-4ac1-446f-88f6-6ee9d3945f0e on n-h2-860687-3 Oct 27 20:17:28.967690 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-190e4e57-3988-44ca-8f29-2c90253cbb71 req-de2ba0e2-dcd2-48c4-bbf4-a791705e9705 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035761 Oct 27 20:17:28.968371 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4132/8112] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:19:42.321237 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=24 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:19:42.322009 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=52 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:19:42.323723 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 20:19:42.323919 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 20:19:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e/action (ip 10.222.0.42) !!! Oct 27 20:19:42.325543 n-d-860687-3 devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 20:19:42.325652 n-d-860687-3 devstack@n-api.service[127028]: Thu Oct 27 20:19:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e/action (ip 10.222.0.42) !!! Oct 27 20:19:42.395676 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-31f7c7b5-2fae-47d6-83b7-cc8b05b7c68e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-992806300"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:19:42.398077 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-31f7c7b5-2fae-47d6-83b7-cc8b05b7c68e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:19:42.405747 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31f7c7b5-2fae-47d6-83b7-cc8b05b7c68e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:19:42.406257 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31f7c7b5-2fae-47d6-83b7-cc8b05b7c68e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:19:42.406754 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31f7c7b5-2fae-47d6-83b7-cc8b05b7c68e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:19:42.407475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31f7c7b5-2fae-47d6-83b7-cc8b05b7c68e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:19:42.407948 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31f7c7b5-2fae-47d6-83b7-cc8b05b7c68e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:19:42.408399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-31f7c7b5-2fae-47d6-83b7-cc8b05b7c68e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:19:42.750009 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-31f7c7b5-2fae-47d6-83b7-cc8b05b7c68e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "POST /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e/action" status: 202 len: 0 microversion: 2.1 time: 0.434559 Oct 27 20:19:42.750702 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3981/8113] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 20:19:42 2022] POST /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 20:19:49.164438 n-d-860687-3 devstack@n-api.service[127029]: ERROR oslo.messaging._drivers.impl_rabbit [-] [66fa3103-a1fe-46ef-965e-69c22fe0df2e] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 20:19:49.166528 n-d-860687-3 devstack@n-api.service[127029]: ERROR oslo.messaging._drivers.impl_rabbit [-] [40297e18-f715-404d-a7a8-44159721b4a8] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 20:19:49.167812 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:19:49.168684 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=60 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:19:49.169490 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 20:19:49.169676 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 20:19:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 27 20:19:49.170651 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 20:19:49.171161 n-d-860687-3 devstack@n-api.service[127029]: Thu Oct 27 20:19:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 27 20:19:49.177604 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-b92e705e-58f4-4796-9b04-a54486929d88 req-5e496b79-c30b-4d5b-92bc-7eab4c57063a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4254db22-4ac1-446f-88f6-6ee9d3945f0e", "name": "network-vif-plugged", "status": "completed", "tag": "6ab429a9-c452-43e0-a4ae-dc5d0701194d"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:19:49.192738 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b92e705e-58f4-4796-9b04-a54486929d88 req-5e496b79-c30b-4d5b-92bc-7eab4c57063a service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:19:49.193222 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b92e705e-58f4-4796-9b04-a54486929d88 req-5e496b79-c30b-4d5b-92bc-7eab4c57063a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:19:49.193657 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b92e705e-58f4-4796-9b04-a54486929d88 req-5e496b79-c30b-4d5b-92bc-7eab4c57063a service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:19:49.206453 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-b92e705e-58f4-4796-9b04-a54486929d88 req-5e496b79-c30b-4d5b-92bc-7eab4c57063a service nova] Creating event network-vif-plugged:6ab429a9-c452-43e0-a4ae-dc5d0701194d for instance 4254db22-4ac1-446f-88f6-6ee9d3945f0e on n-h2-860687-3 Oct 27 20:19:49.211560 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-b92e705e-58f4-4796-9b04-a54486929d88 req-5e496b79-c30b-4d5b-92bc-7eab4c57063a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049085 Oct 27 20:19:49.212317 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4133/8114] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:20:00.476321 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:20:00.477620 n-d-860687-3 devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:20:00.483239 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-549fbd81-9fb5-4350-9282-c27f8343132b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:20:00.483680 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_api:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:20:00.484475 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-549fbd81-9fb5-4350-9282-c27f8343132b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:20:00.484879 n-d-860687-3 devstack@n-api.service[127029]: DEBUG dbcounter [-] [127029] Writing DB stats nova_cell1:SELECT=2 {{(pid=127029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 20:20:00.491835 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-549fbd81-9fb5-4350-9282-c27f8343132b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:00.492523 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-549fbd81-9fb5-4350-9282-c27f8343132b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:00.493141 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-549fbd81-9fb5-4350-9282-c27f8343132b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:00.493510 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] [40297e18-f715-404d-a7a8-44159721b4a8] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39958. Oct 27 20:20:00.494652 n-d-860687-3 devstack@n-api.service[127029]: INFO oslo.messaging._drivers.impl_rabbit [-] [66fa3103-a1fe-46ef-965e-69c22fe0df2e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39956. Oct 27 20:20:00.494992 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-549fbd81-9fb5-4350-9282-c27f8343132b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:00.495612 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-549fbd81-9fb5-4350-9282-c27f8343132b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:00.496205 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-549fbd81-9fb5-4350-9282-c27f8343132b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:00.527898 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-549fbd81-9fb5-4350-9282-c27f8343132b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 20:20:00.570704 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e0ad587c-f0b2-43ad-af16-bfa8b1e6b874 req-513e93a0-6387-49de-a91d-4ebda3774d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4254db22-4ac1-446f-88f6-6ee9d3945f0e", "tag": "6ab429a9-c452-43e0-a4ae-dc5d0701194d"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:20:00.585435 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e0ad587c-f0b2-43ad-af16-bfa8b1e6b874 req-513e93a0-6387-49de-a91d-4ebda3774d0f service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:00.586785 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e0ad587c-f0b2-43ad-af16-bfa8b1e6b874 req-513e93a0-6387-49de-a91d-4ebda3774d0f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:00.587291 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e0ad587c-f0b2-43ad-af16-bfa8b1e6b874 req-513e93a0-6387-49de-a91d-4ebda3774d0f service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:00.601099 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e0ad587c-f0b2-43ad-af16-bfa8b1e6b874 req-513e93a0-6387-49de-a91d-4ebda3774d0f service nova] Creating event network-changed:6ab429a9-c452-43e0-a4ae-dc5d0701194d for instance 4254db22-4ac1-446f-88f6-6ee9d3945f0e on n-h2-860687-3 Oct 27 20:20:00.607026 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e0ad587c-f0b2-43ad-af16-bfa8b1e6b874 req-513e93a0-6387-49de-a91d-4ebda3774d0f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130051 Oct 27 20:20:00.607644 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4134/8115] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 20:20:00.623285 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-549fbd81-9fb5-4350-9282-c27f8343132b tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 204 len: 0 microversion: 2.1 time: 0.148811 Oct 27 20:20:00.624484 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3982/8116] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 20:20:00 2022] DELETE /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 20:20:00.636610 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-c5961aff-a29b-4008-baad-42e21b04a20c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:20:00.637326 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-c5961aff-a29b-4008-baad-42e21b04a20c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:20:00.643823 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5961aff-a29b-4008-baad-42e21b04a20c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:00.644323 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5961aff-a29b-4008-baad-42e21b04a20c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:00.644772 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5961aff-a29b-4008-baad-42e21b04a20c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:00.645513 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5961aff-a29b-4008-baad-42e21b04a20c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:00.646000 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5961aff-a29b-4008-baad-42e21b04a20c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:00.646538 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-c5961aff-a29b-4008-baad-42e21b04a20c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:00.854331 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-c5961aff-a29b-4008-baad-42e21b04a20c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:20:00.862702 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-c5961aff-a29b-4008-baad-42e21b04a20c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1685 microversion: 2.1 time: 0.232364 Oct 27 20:20:00.863816 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4135/8117] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:20:00 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1685 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:20:01.887482 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-34b9a09c-475d-402e-9147-4aed93580131 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:20:01.888228 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-34b9a09c-475d-402e-9147-4aed93580131 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:20:01.894806 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34b9a09c-475d-402e-9147-4aed93580131 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:01.895303 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34b9a09c-475d-402e-9147-4aed93580131 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:01.895757 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34b9a09c-475d-402e-9147-4aed93580131 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:01.896468 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34b9a09c-475d-402e-9147-4aed93580131 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:01.896937 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34b9a09c-475d-402e-9147-4aed93580131 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:01.897379 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-34b9a09c-475d-402e-9147-4aed93580131 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:02.037363 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-34b9a09c-475d-402e-9147-4aed93580131 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:20:02.046147 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-34b9a09c-475d-402e-9147-4aed93580131 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1685 microversion: 2.1 time: 0.163580 Oct 27 20:20:02.046784 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3983/8118] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:20:01 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:20:03.045085 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-d4258183-16f0-42f0-a8b2-36a2dba04af7 req-5519ff7a-7d2f-4058-8996-ff6b3032ae99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4254db22-4ac1-446f-88f6-6ee9d3945f0e", "name": "network-vif-deleted", "tag": "6ab429a9-c452-43e0-a4ae-dc5d0701194d"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:20:03.056909 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d4258183-16f0-42f0-a8b2-36a2dba04af7 req-5519ff7a-7d2f-4058-8996-ff6b3032ae99 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:03.057394 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d4258183-16f0-42f0-a8b2-36a2dba04af7 req-5519ff7a-7d2f-4058-8996-ff6b3032ae99 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:03.057835 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-d4258183-16f0-42f0-a8b2-36a2dba04af7 req-5519ff7a-7d2f-4058-8996-ff6b3032ae99 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:03.072481 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-d4258183-16f0-42f0-a8b2-36a2dba04af7 req-5519ff7a-7d2f-4058-8996-ff6b3032ae99 service nova] Creating event network-vif-deleted:6ab429a9-c452-43e0-a4ae-dc5d0701194d for instance 4254db22-4ac1-446f-88f6-6ee9d3945f0e on n-h2-860687-3 Oct 27 20:20:03.073023 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bda05ab5-68ea-4bd7-8a36-19075917c95f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:20:03.073723 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bda05ab5-68ea-4bd7-8a36-19075917c95f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:20:03.077871 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-d4258183-16f0-42f0-a8b2-36a2dba04af7 req-5519ff7a-7d2f-4058-8996-ff6b3032ae99 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037015 Oct 27 20:20:03.078821 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4136/8119] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:20:03.082399 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bda05ab5-68ea-4bd7-8a36-19075917c95f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:03.082922 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bda05ab5-68ea-4bd7-8a36-19075917c95f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:03.083388 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bda05ab5-68ea-4bd7-8a36-19075917c95f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:03.084117 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bda05ab5-68ea-4bd7-8a36-19075917c95f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:03.084598 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bda05ab5-68ea-4bd7-8a36-19075917c95f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:03.085680 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bda05ab5-68ea-4bd7-8a36-19075917c95f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:03.161240 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-bda05ab5-68ea-4bd7-8a36-19075917c95f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:20:03.170005 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bda05ab5-68ea-4bd7-8a36-19075917c95f tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 200 len: 1334 microversion: 2.1 time: 0.103310 Oct 27 20:20:03.170649 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3984/8120] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:20:03 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:20:04.195098 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-67ac1be0-2130-45cf-8a12-a2d2c8d3ea2c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:20:04.195802 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-67ac1be0-2130-45cf-8a12-a2d2c8d3ea2c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 4254db22-4ac1-446f-88f6-6ee9d3945f0e] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:20:04.203207 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67ac1be0-2130-45cf-8a12-a2d2c8d3ea2c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:04.203716 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67ac1be0-2130-45cf-8a12-a2d2c8d3ea2c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:04.204155 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67ac1be0-2130-45cf-8a12-a2d2c8d3ea2c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:04.204838 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67ac1be0-2130-45cf-8a12-a2d2c8d3ea2c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:04.205292 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67ac1be0-2130-45cf-8a12-a2d2c8d3ea2c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:04.205717 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-67ac1be0-2130-45cf-8a12-a2d2c8d3ea2c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:04.220146 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-67ac1be0-2130-45cf-8a12-a2d2c8d3ea2c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] HTTP exception thrown: Instance 4254db22-4ac1-446f-88f6-6ee9d3945f0e could not be found. Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-67ac1be0-2130-45cf-8a12-a2d2c8d3ea2c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Request method failure captured: Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e HTTP/1.1 Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWuaqRc8-ZIz8rMGQ3-FDB3WNDSQnH8yRfm9t7YBJN09sCAC4cpZr8WjG96qRZGKI5kyvpFIK8nwya9x-TAP2MJkajXq15szmhe4kGNqQn0cSQ1fbDzjYg6lPS8SWN3yx6zfg_WDP0yMEELeXTj3VS6h4HyrmUa8s9B5FCPdaTc5Ocls Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: a2ef8d55da334751960a31489737d63d Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestSnapshotPattern-30455543 Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a2ef8d55da334751960a31489737d63d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2ef8d55da334751960a31489737d63d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a2ef8d55da334751960a31489737d63d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2ef8d55da334751960a31489737d63d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestSnapshotPattern-30455543 Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: a2ef8d55da334751960a31489737d63d Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestSnapshotPattern-30455543 Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestSnapshotPattern-30455543-project Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a8d57a41f04e4f01a65d0965efcb3855 Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestSnapshotPattern-30455543-project Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 4254db22-4ac1-446f-88f6-6ee9d3945f0e could not be found. Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '4254db22-4ac1-446f-88f6-6ee9d3945f0e'} Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4254db22-4ac1-446f-88f6-6ee9d3945f0e could not be found. Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4254db22-4ac1-446f-88f6-6ee9d3945f0e could not be found. Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 20:20:04.221793 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:20:04.225361 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:20:04.225361 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 20:20:04.225361 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 20:20:04.225361 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 20:20:04.225361 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 20:20:04.225361 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4254db22-4ac1-446f-88f6-6ee9d3945f0e could not be found. Oct 27 20:20:04.225361 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:20:04.225361 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-67ac1be0-2130-45cf-8a12-a2d2c8d3ea2c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Returning 404 to user: Instance 4254db22-4ac1-446f-88f6-6ee9d3945f0e could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 20:20:04.225361 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-67ac1be0-2130-45cf-8a12-a2d2c8d3ea2c tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e" status: 404 len: 111 microversion: 2.1 time: 0.033247 Oct 27 20:20:04.225361 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4137/8121] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:20:04 2022] GET /compute/v2.1/servers/4254db22-4ac1-446f-88f6-6ee9d3945f0e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 20:20:05.570344 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5708bca8-ff90-4950-a921-a5426413ed08 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:20:05.571209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5708bca8-ff90-4950-a921-a5426413ed08 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:20:05.572069 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-e43462e4-a730-49f0-b1ba-a2d846cdbfcc req-bd929a4e-b304-4134-ae96-3a999ae4bd69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed50501-f2ab-4292-ab24-19e81c98b1a6", "tag": "a1164ecd-da51-4262-9afc-5fb311dd871e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:20:05.582870 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e43462e4-a730-49f0-b1ba-a2d846cdbfcc req-bd929a4e-b304-4134-ae96-3a999ae4bd69 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:05.583628 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e43462e4-a730-49f0-b1ba-a2d846cdbfcc req-bd929a4e-b304-4134-ae96-3a999ae4bd69 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:05.584233 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5708bca8-ff90-4950-a921-a5426413ed08 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:05.584360 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-e43462e4-a730-49f0-b1ba-a2d846cdbfcc req-bd929a4e-b304-4134-ae96-3a999ae4bd69 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:05.585391 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5708bca8-ff90-4950-a921-a5426413ed08 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:05.585551 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5708bca8-ff90-4950-a921-a5426413ed08 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:05.586359 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5708bca8-ff90-4950-a921-a5426413ed08 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:05.586954 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5708bca8-ff90-4950-a921-a5426413ed08 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:05.587544 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5708bca8-ff90-4950-a921-a5426413ed08 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:05.596100 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-e43462e4-a730-49f0-b1ba-a2d846cdbfcc req-bd929a4e-b304-4134-ae96-3a999ae4bd69 service nova] Creating event network-changed:a1164ecd-da51-4262-9afc-5fb311dd871e for instance 7ed50501-f2ab-4292-ab24-19e81c98b1a6 on n-h1-860687-3 Oct 27 20:20:05.601704 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-e43462e4-a730-49f0-b1ba-a2d846cdbfcc req-bd929a4e-b304-4134-ae96-3a999ae4bd69 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033666 Oct 27 20:20:05.602311 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4138/8122] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:20:05.616703 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5708bca8-ff90-4950-a921-a5426413ed08 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 20:20:05.710281 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5708bca8-ff90-4950-a921-a5426413ed08 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 204 len: 0 microversion: 2.1 time: 0.143352 Oct 27 20:20:05.711506 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3985/8123] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 20:20:05 2022] DELETE /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 20:20:05.722984 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-89f2fe65-4a37-4247-9474-70171e37c5c0 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:20:05.726111 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-89f2fe65-4a37-4247-9474-70171e37c5c0 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:20:05.734654 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89f2fe65-4a37-4247-9474-70171e37c5c0 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:05.735151 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89f2fe65-4a37-4247-9474-70171e37c5c0 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:05.735593 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89f2fe65-4a37-4247-9474-70171e37c5c0 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:05.736336 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89f2fe65-4a37-4247-9474-70171e37c5c0 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:05.737054 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89f2fe65-4a37-4247-9474-70171e37c5c0 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:05.737490 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-89f2fe65-4a37-4247-9474-70171e37c5c0 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:05.887363 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.policy [None req-89f2fe65-4a37-4247-9474-70171e37c5c0 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127029) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:20:05.895229 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-89f2fe65-4a37-4247-9474-70171e37c5c0 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1686 microversion: 2.1 time: 0.177732 Oct 27 20:20:05.895815 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4139/8124] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:20:05 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:20:06.921061 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4821f488-2b0a-4bd2-a2d5-5a2bc5485916 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:20:06.921801 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4821f488-2b0a-4bd2-a2d5-5a2bc5485916 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:20:06.929114 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4821f488-2b0a-4bd2-a2d5-5a2bc5485916 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:06.929655 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4821f488-2b0a-4bd2-a2d5-5a2bc5485916 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:06.930209 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4821f488-2b0a-4bd2-a2d5-5a2bc5485916 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:06.931819 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4821f488-2b0a-4bd2-a2d5-5a2bc5485916 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:06.932472 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4821f488-2b0a-4bd2-a2d5-5a2bc5485916 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:06.932991 n-d-860687-3 devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4821f488-2b0a-4bd2-a2d5-5a2bc5485916 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:06.983689 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [req-b4b8c200-ac8f-4d3b-8d36-3bba4c835d24 req-207a0eb4-b483-494c-9f56-d8d6da399cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed50501-f2ab-4292-ab24-19e81c98b1a6", "name": "network-vif-deleted", "tag": "a1164ecd-da51-4262-9afc-5fb311dd871e"}]} {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 20:20:06.993352 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b4b8c200-ac8f-4d3b-8d36-3bba4c835d24 req-207a0eb4-b483-494c-9f56-d8d6da399cf5 service nova] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:06.994761 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b4b8c200-ac8f-4d3b-8d36-3bba4c835d24 req-207a0eb4-b483-494c-9f56-d8d6da399cf5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:06.995626 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [req-b4b8c200-ac8f-4d3b-8d36-3bba4c835d24 req-207a0eb4-b483-494c-9f56-d8d6da399cf5 service nova] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:07.007196 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.compute.server_external_events [req-b4b8c200-ac8f-4d3b-8d36-3bba4c835d24 req-207a0eb4-b483-494c-9f56-d8d6da399cf5 service nova] Creating event network-vif-deleted:a1164ecd-da51-4262-9afc-5fb311dd871e for instance 7ed50501-f2ab-4292-ab24-19e81c98b1a6 on n-h1-860687-3 Oct 27 20:20:07.011903 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.policy [None req-4821f488-2b0a-4bd2-a2d5-5a2bc5485916 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d57a41f04e4f01a65d0965efcb3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef8d55da334751960a31489737d63d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 20:20:07.012749 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [req-b4b8c200-ac8f-4d3b-8d36-3bba4c835d24 req-207a0eb4-b483-494c-9f56-d8d6da399cf5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094478 Oct 27 20:20:07.013421 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4140/8125] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 20:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 20:20:07.020157 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4821f488-2b0a-4bd2-a2d5-5a2bc5485916 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 200 len: 1499 microversion: 2.1 time: 0.104727 Oct 27 20:20:07.020837 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3986/8126] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:20:06 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 1499 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 20:20:08.045410 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bdaa201c-d91e-4876-a566-8ed1f2b1cb26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '>' {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:20:08.046158 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.compute.api [None req-bdaa201c-d91e-4876-a566-8ed1f2b1cb26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] [instance: 7ed50501-f2ab-4292-ab24-19e81c98b1a6] Fetching instance by UUID {{(pid=127029) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 20:20:08.052398 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdaa201c-d91e-4876-a566-8ed1f2b1cb26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:08.052888 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdaa201c-d91e-4876-a566-8ed1f2b1cb26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:08.053333 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdaa201c-d91e-4876-a566-8ed1f2b1cb26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:08.054028 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdaa201c-d91e-4876-a566-8ed1f2b1cb26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Acquiring lock "af35862a-071a-430c-affa-82567dc9805c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 20:20:08.054519 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdaa201c-d91e-4876-a566-8ed1f2b1cb26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 20:20:08.054953 n-d-860687-3 devstack@n-api.service[127029]: DEBUG oslo_concurrency.lockutils [None req-bdaa201c-d91e-4876-a566-8ed1f2b1cb26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Lock "af35862a-071a-430c-affa-82567dc9805c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 20:20:08.068362 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.wsgi [None req-bdaa201c-d91e-4876-a566-8ed1f2b1cb26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] HTTP exception thrown: Instance 7ed50501-f2ab-4292-ab24-19e81c98b1a6 could not be found. Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bdaa201c-d91e-4876-a566-8ed1f2b1cb26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Request method failure captured: Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: request: GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 HTTP/1.1 Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: Accept: application/json Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: Accept-Encoding: identity Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: Connection: close Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: Content-Length: 0 Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: Content-Type: application/json Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: Host: 10.222.0.42 Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: Openstack-System-Scope: None Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: User-Agent: python-urllib3/1.26.12 Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Auth-Token: gAAAAABjWuaqRc8-ZIz8rMGQ3-FDB3WNDSQnH8yRfm9t7YBJN09sCAC4cpZr8WjG96qRZGKI5kyvpFIK8nwya9x-TAP2MJkajXq15szmhe4kGNqQn0cSQ1fbDzjYg6lPS8SWN3yx6zfg_WDP0yMEELeXTj3VS6h4HyrmUa8s9B5FCPdaTc5Ocls Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Id: None Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Domain-Name: None Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Identity-Status: Confirmed Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Is-Admin-Project: True Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Id: default Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Domain-Name: Default Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Id: a2ef8d55da334751960a31489737d63d Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Project-Name: tempest-TestSnapshotPattern-30455543 Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Role: member,reader Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Roles: member,reader Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a2ef8d55da334751960a31489737d63d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2ef8d55da334751960a31489737d63d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a2ef8d55da334751960a31489737d63d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2ef8d55da334751960a31489737d63d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant: tempest-TestSnapshotPattern-30455543 Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Id: a2ef8d55da334751960a31489737d63d Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-Tenant-Name: tempest-TestSnapshotPattern-30455543 Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-User: tempest-TestSnapshotPattern-30455543-project Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Id: default Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-User-Domain-Name: Default Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-User-Id: a8d57a41f04e4f01a65d0965efcb3855 Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: X-User-Name: tempest-TestSnapshotPattern-30455543-project Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: method: > Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: exception: Instance 7ed50501-f2ab-4292-ab24-19e81c98b1a6 could not be found. Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: action_args: {'id': '7ed50501-f2ab-4292-ab24-19e81c98b1a6'} Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: {{(pid=127029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed50501-f2ab-4292-ab24-19e81c98b1a6 could not be found. Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed50501-f2ab-4292-ab24-19e81c98b1a6 could not be found. Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 20:20:08.070031 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:20:08.074304 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 20:20:08.074304 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 20:20:08.074304 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 20:20:08.074304 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 20:20:08.074304 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 20:20:08.074304 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed50501-f2ab-4292-ab24-19e81c98b1a6 could not be found. Oct 27 20:20:08.074304 n-d-860687-3 devstack@n-api.service[127029]: ERROR nova.api.openstack.wsgi Oct 27 20:20:08.074304 n-d-860687-3 devstack@n-api.service[127029]: DEBUG nova.api.openstack.wsgi [None req-bdaa201c-d91e-4876-a566-8ed1f2b1cb26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Returning 404 to user: Instance 7ed50501-f2ab-4292-ab24-19e81c98b1a6 could not be found. {{(pid=127029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 20:20:08.074304 n-d-860687-3 devstack@n-api.service[127029]: INFO nova.api.openstack.requestlog [None req-bdaa201c-d91e-4876-a566-8ed1f2b1cb26 tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6" status: 404 len: 111 microversion: 2.1 time: 0.031371 Oct 27 20:20:08.074304 n-d-860687-3 devstack@n-api.service[127029]: [pid: 127029|app: 0|req: 4141/8127] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 20:20:08 2022] GET /compute/v2.1/servers/7ed50501-f2ab-4292-ab24-19e81c98b1a6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 20:20:08.245635 n-d-860687-3 devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a97b016b-4d6d-440f-ba8c-d8f8951dd53e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] Calling method '.version_select at 0x7fc86980e280>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 20:20:08.277031 n-d-860687-3 devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a97b016b-4d6d-440f-ba8c-d8f8951dd53e tempest-TestSnapshotPattern-30455543 tempest-TestSnapshotPattern-30455543-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1137863691" status: 202 len: 0 microversion: 2.1 time: 0.036534 Oct 27 20:20:08.277624 n-d-860687-3 devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3987/8128] 10.222.0.42 () {58 vars in 1257 bytes} [Thu Oct 27 20:20:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1137863691 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)